Implementation of the open feature SDK in the java tracer #9885

manuel-alvarez-alvarez · 2025-10-30T13:36:02Z

What Does This Do

Implements the integration of the OpenFeature SDK within the Java tracer. This includes a new umbrella module called :products:feature-flagging that includes:

:agent feature flagging system to be initialized by the agent during startup.
:api implementation of the OpenFeature Java provider
:lib for feature flag configuration and exposure submission through the EVP proxy.
:bootstrap bridge exposing the FeatureFlagGateway API between the internal :agent (datadog classloader) and the :api (application classloader)

Motivation

This adds OpenFeature SDK support to the tracer so feature flag evaluations can be managed and reported consistently through the Datadog feature flagging system.

Additional Notes

Smoke tests are provided as a separate PR

Contributor Checklist

Format the title according the contribution guidelines
Assign the type: and (comp: or inst:) labels in addition to any useful labels
Don't use close, fix or any linking keywords when referencing an issue.
Use solves instead, and assign the PR milestone to the issue
Update the CODEOWNERS file on source file addition, move, or deletion
Update the public documentation in case of new configuration flag or behavior

Jira ticket: [PROJ-IDENT]

RFC

pr-commenter · 2025-10-30T14:23:32Z

Benchmarks

Startup

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	malvarez/open-feature-sdk
git_commit_date	1763584490	1763592825
git_commit_sha	`b3d2c4a`	`31a1f96`
release_version	1.56.0-SNAPSHOT~b3d2c4a83d	1.56.0-SNAPSHOT~31a1f961c5

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1763594657	1763594657
ci_job_id	1246511429	1246511429
ci_pipeline_id	83275681	83275681
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-1-e039sf35 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-1-e039sf35 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module	Agent	Agent
parent	None	None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 62 metrics, 3 unstable metrics.

Startup time reports for petclinic

gantt
    title petclinic - global startup overhead: candidate=1.56.0-SNAPSHOT~31a1f961c5, baseline=1.56.0-SNAPSHOT~b3d2c4a83d

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.098 s) : 0, 1098220
Total [baseline] (10.801 s) : 0, 10800508
Agent [candidate] (1.099 s) : 0, 1098550
Total [candidate] (10.721 s) : 0, 10721355
section appsec
Agent [baseline] (1.281 s) : 0, 1280720
Total [baseline] (11.088 s) : 0, 11087847
Agent [candidate] (1.278 s) : 0, 1278259
Total [candidate] (11.1 s) : 0, 11099781
section iast
Agent [baseline] (1.256 s) : 0, 1255725
Total [baseline] (11.275 s) : 0, 11275488
Agent [candidate] (1.236 s) : 0, 1235626
Total [candidate] (11.155 s) : 0, 11155255
section profiling
Agent [baseline] (1.227 s) : 0, 1226870
Total [baseline] (11.035 s) : 0, 11034677
Agent [candidate] (1.229 s) : 0, 1229242
Total [candidate] (11.051 s) : 0, 11051090

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.098 s	-
Agent	appsec	1.281 s	182.5 ms (16.6%)
Agent	iast	1.256 s	157.504 ms (14.3%)
Agent	profiling	1.227 s	128.65 ms (11.7%)
Total	tracing	10.801 s	-
Total	appsec	11.088 s	287.339 ms (2.7%)
Total	iast	11.275 s	474.981 ms (4.4%)
Total	profiling	11.035 s	234.169 ms (2.2%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.099 s	-
Agent	appsec	1.278 s	179.709 ms (16.4%)
Agent	iast	1.236 s	137.076 ms (12.5%)
Agent	profiling	1.229 s	130.692 ms (11.9%)
Total	tracing	10.721 s	-
Total	appsec	11.1 s	378.425 ms (3.5%)
Total	iast	11.155 s	433.899 ms (4.0%)
Total	profiling	11.051 s	329.735 ms (3.1%)

gantt
    title petclinic - break down per module: candidate=1.56.0-SNAPSHOT~31a1f961c5, baseline=1.56.0-SNAPSHOT~b3d2c4a83d

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.445 ms) : 0, 1445
crashtracking [candidate] (1.462 ms) : 0, 1462
BytebuddyAgent [baseline] (705.594 ms) : 0, 705594
BytebuddyAgent [candidate] (705.134 ms) : 0, 705134
GlobalTracer [baseline] (248.286 ms) : 0, 248286
GlobalTracer [candidate] (248.408 ms) : 0, 248408
AppSec [baseline] (32.265 ms) : 0, 32265
AppSec [candidate] (32.186 ms) : 0, 32186
Debugger [baseline] (63.605 ms) : 0, 63605
Debugger [candidate] (64.068 ms) : 0, 64068
Remote Config [baseline] (622.641 µs) : 0, 623
Remote Config [candidate] (631.918 µs) : 0, 632
Telemetry [baseline] (8.056 ms) : 0, 8056
Telemetry [candidate] (8.211 ms) : 0, 8211
Flare Poller [baseline] (3.615 ms) : 0, 3615
Flare Poller [candidate] (3.649 ms) : 0, 3649
section appsec
crashtracking [baseline] (1.46 ms) : 0, 1460
crashtracking [candidate] (1.468 ms) : 0, 1468
BytebuddyAgent [baseline] (730.918 ms) : 0, 730918
BytebuddyAgent [candidate] (729.008 ms) : 0, 729008
GlobalTracer [baseline] (240.08 ms) : 0, 240080
GlobalTracer [candidate] (240.189 ms) : 0, 240189
AppSec [baseline] (174.566 ms) : 0, 174566
AppSec [candidate] (173.955 ms) : 0, 173955
Debugger [baseline] (60.963 ms) : 0, 60963
Debugger [candidate] (61.307 ms) : 0, 61307
Remote Config [baseline] (658.079 µs) : 0, 658
Remote Config [candidate] (651.243 µs) : 0, 651
Telemetry [baseline] (8.379 ms) : 0, 8379
Telemetry [candidate] (8.204 ms) : 0, 8204
Flare Poller [baseline] (3.948 ms) : 0, 3948
Flare Poller [candidate] (3.777 ms) : 0, 3777
IAST [baseline] (24.669 ms) : 0, 24669
IAST [candidate] (24.731 ms) : 0, 24731
section iast
crashtracking [baseline] (1.486 ms) : 0, 1486
crashtracking [candidate] (1.453 ms) : 0, 1453
BytebuddyAgent [baseline] (843.466 ms) : 0, 843466
BytebuddyAgent [candidate] (827.1 ms) : 0, 827100
GlobalTracer [baseline] (240.197 ms) : 0, 240197
GlobalTracer [candidate] (237.5 ms) : 0, 237500
AppSec [baseline] (33.399 ms) : 0, 33399
AppSec [candidate] (33.397 ms) : 0, 33397
Debugger [baseline] (61.54 ms) : 0, 61540
Debugger [candidate] (61.088 ms) : 0, 61088
Remote Config [baseline] (565.418 µs) : 0, 565
Remote Config [candidate] (556.852 µs) : 0, 557
Telemetry [baseline] (7.709 ms) : 0, 7709
Telemetry [candidate] (7.724 ms) : 0, 7724
Flare Poller [baseline] (3.597 ms) : 0, 3597
Flare Poller [candidate] (3.534 ms) : 0, 3534
IAST [baseline] (28.543 ms) : 0, 28543
IAST [candidate] (28.343 ms) : 0, 28343
section profiling
crashtracking [baseline] (1.434 ms) : 0, 1434
crashtracking [candidate] (1.432 ms) : 0, 1432
BytebuddyAgent [baseline] (730.325 ms) : 0, 730325
BytebuddyAgent [candidate] (731.316 ms) : 0, 731316
GlobalTracer [baseline] (221.513 ms) : 0, 221513
GlobalTracer [candidate] (222.471 ms) : 0, 222471
AppSec [baseline] (32.245 ms) : 0, 32245
AppSec [candidate] (32.271 ms) : 0, 32271
Debugger [baseline] (62.548 ms) : 0, 62548
Debugger [candidate] (62.732 ms) : 0, 62732
Remote Config [baseline] (643.447 µs) : 0, 643
Remote Config [candidate] (641.727 µs) : 0, 642
Telemetry [baseline] (7.91 ms) : 0, 7910
Telemetry [candidate] (7.942 ms) : 0, 7942
Flare Poller [baseline] (3.767 ms) : 0, 3767
Flare Poller [candidate] (3.751 ms) : 0, 3751
ProfilingAgent [baseline] (96.913 ms) : 0, 96913
ProfilingAgent [candidate] (96.944 ms) : 0, 96944
Profiling [baseline] (97.495 ms) : 0, 97495
Profiling [candidate] (97.515 ms) : 0, 97515

Startup time reports for insecure-bank

gantt
    title insecure-bank - global startup overhead: candidate=1.56.0-SNAPSHOT~31a1f961c5, baseline=1.56.0-SNAPSHOT~b3d2c4a83d

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.1 s) : 0, 1099512
Total [baseline] (8.833 s) : 0, 8833456
Agent [candidate] (1.1 s) : 0, 1100437
Total [candidate] (8.809 s) : 0, 8809055
section iast
Agent [baseline] (1.241 s) : 0, 1241452
Total [baseline] (9.538 s) : 0, 9537651
Agent [candidate] (1.235 s) : 0, 1235060
Total [candidate] (9.524 s) : 0, 9524368

baseline results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.1 s	-
Agent	iast	1.241 s	141.94 ms (12.9%)
Total	tracing	8.833 s	-
Total	iast	9.538 s	704.195 ms (8.0%)

candidate results

Module	Variant	Duration	Δ tracing
Agent	tracing	1.1 s	-
Agent	iast	1.235 s	134.623 ms (12.2%)
Total	tracing	8.809 s	-
Total	iast	9.524 s	715.312 ms (8.1%)

gantt
    title insecure-bank - break down per module: candidate=1.56.0-SNAPSHOT~31a1f961c5, baseline=1.56.0-SNAPSHOT~b3d2c4a83d

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.446 ms) : 0, 1446
crashtracking [candidate] (1.464 ms) : 0, 1464
BytebuddyAgent [baseline] (706.416 ms) : 0, 706416
BytebuddyAgent [candidate] (706.741 ms) : 0, 706741
GlobalTracer [baseline] (248.917 ms) : 0, 248917
GlobalTracer [candidate] (249.618 ms) : 0, 249618
AppSec [baseline] (32.52 ms) : 0, 32520
AppSec [candidate] (32.303 ms) : 0, 32303
Debugger [baseline] (63.069 ms) : 0, 63069
Debugger [candidate] (63.006 ms) : 0, 63006
Remote Config [baseline] (618.2 µs) : 0, 618
Remote Config [candidate] (638.506 µs) : 0, 639
Telemetry [baseline] (8.034 ms) : 0, 8034
Telemetry [candidate] (8.155 ms) : 0, 8155
Flare Poller [baseline] (3.68 ms) : 0, 3680
Flare Poller [candidate] (3.637 ms) : 0, 3637
section iast
crashtracking [baseline] (1.463 ms) : 0, 1463
crashtracking [candidate] (1.47 ms) : 0, 1470
BytebuddyAgent [baseline] (833.622 ms) : 0, 833622
BytebuddyAgent [candidate] (828.562 ms) : 0, 828562
GlobalTracer [baseline] (237.886 ms) : 0, 237886
GlobalTracer [candidate] (236.939 ms) : 0, 236939
AppSec [baseline] (34.75 ms) : 0, 34750
AppSec [candidate] (34.862 ms) : 0, 34862
Debugger [baseline] (60.169 ms) : 0, 60169
Debugger [candidate] (59.977 ms) : 0, 59977
Remote Config [baseline] (579.777 µs) : 0, 580
Remote Config [candidate] (539.127 µs) : 0, 539
Telemetry [baseline] (7.631 ms) : 0, 7631
Telemetry [candidate] (7.523 ms) : 0, 7523
Flare Poller [baseline] (3.492 ms) : 0, 3492
Flare Poller [candidate] (3.458 ms) : 0, 3458
IAST [baseline] (26.834 ms) : 0, 26834
IAST [candidate] (26.728 ms) : 0, 26728

Load

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	malvarez/open-feature-sdk
git_commit_date	1763584490	1763592825
git_commit_sha	`b3d2c4a`	`31a1f96`
release_version	1.56.0-SNAPSHOT~b3d2c4a83d	1.56.0-SNAPSHOT~31a1f961c5

See matching parameters

	Baseline	Candidate
application	insecure-bank	insecure-bank
ci_job_date	1763595222	1763595222
ci_job_id	1246511430	1246511430
ci_pipeline_id	83275681	83275681
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-0-y6lbykym 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-0-y6lbykym 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 1 performance regressions! Performance is the same for 19 metrics, 16 unstable metrics.

scenario	Δ mean agg_http_req_duration_p50	Δ mean agg_http_req_duration_p95	Δ mean throughput	candidate mean agg_http_req_duration_p50	candidate mean agg_http_req_duration_p95	candidate mean throughput	baseline mean agg_http_req_duration_p50	baseline mean agg_http_req_duration_p95	baseline mean throughput
scenario:load:petclinic:iast:high_load	worse [+0.799ms; +1.747ms] or [+4.646%; +10.163%]	unsure [+0.563ms; +2.058ms] or [+1.986%; +7.257%]	unstable [-41.754op/s; +13.317op/s] or [-15.808%; +5.042%]	18.461ms	29.666ms	249.906op/s	17.188ms	28.355ms	264.125op/s

Request duration reports for petclinic

gantt
    title petclinic - request duration [CI 0.99] : candidate=1.56.0-SNAPSHOT~31a1f961c5, baseline=1.56.0-SNAPSHOT~b3d2c4a83d
    dateFormat X
    axisFormat %s
section baseline
no_agent (18.209 ms) : 18025, 18393
.   : milestone, 18209,
appsec (18.675 ms) : 18486, 18864
.   : milestone, 18675,
code_origins (17.879 ms) : 17699, 18060
.   : milestone, 17879,
iast (17.665 ms) : 17491, 17839
.   : milestone, 17665,
profiling (18.871 ms) : 18683, 19060
.   : milestone, 18871,
tracing (17.645 ms) : 17470, 17820
.   : milestone, 17645,
section candidate
no_agent (18.985 ms) : 18792, 19177
.   : milestone, 18985,
appsec (18.544 ms) : 18360, 18728
.   : milestone, 18544,
code_origins (17.44 ms) : 17268, 17612
.   : milestone, 17440,
iast (18.678 ms) : 18487, 18868
.   : milestone, 18678,
profiling (18.454 ms) : 18271, 18637
.   : milestone, 18454,
tracing (17.908 ms) : 17728, 18089
.   : milestone, 17908,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	18.209 ms [18.025 ms, 18.393 ms]	-
appsec	18.675 ms [18.486 ms, 18.864 ms]	466.275 µs (2.6%)
code_origins	17.879 ms [17.699 ms, 18.06 ms]	-329.236 µs (-1.8%)
iast	17.665 ms [17.491 ms, 17.839 ms]	-543.78 µs (-3.0%)
profiling	18.871 ms [18.683 ms, 19.06 ms]	662.806 µs (3.6%)
tracing	17.645 ms [17.47 ms, 17.82 ms]	-563.999 µs (-3.1%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	18.985 ms [18.792 ms, 19.177 ms]	-
appsec	18.544 ms [18.36 ms, 18.728 ms]	-440.588 µs (-2.3%)
code_origins	17.44 ms [17.268 ms, 17.612 ms]	-1.544 ms (-8.1%)
iast	18.678 ms [18.487 ms, 18.868 ms]	-306.876 µs (-1.6%)
profiling	18.454 ms [18.271 ms, 18.637 ms]	-530.697 µs (-2.8%)
tracing	17.908 ms [17.728 ms, 18.089 ms]	-1.076 ms (-5.7%)

Request duration reports for insecure-bank

gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.56.0-SNAPSHOT~31a1f961c5, baseline=1.56.0-SNAPSHOT~b3d2c4a83d
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.216 ms) : 1204, 1229
.   : milestone, 1216,
iast (3.226 ms) : 3180, 3272
.   : milestone, 3226,
iast_FULL (5.953 ms) : 5862, 6045
.   : milestone, 5953,
iast_GLOBAL (3.69 ms) : 3628, 3753
.   : milestone, 3690,
profiling (2.132 ms) : 2113, 2150
.   : milestone, 2132,
tracing (1.902 ms) : 1885, 1919
.   : milestone, 1902,
section candidate
no_agent (1.185 ms) : 1173, 1197
.   : milestone, 1185,
iast (3.338 ms) : 3288, 3388
.   : milestone, 3338,
iast_FULL (5.831 ms) : 5772, 5891
.   : milestone, 5831,
iast_GLOBAL (3.724 ms) : 3620, 3829
.   : milestone, 3724,
profiling (2.104 ms) : 2084, 2125
.   : milestone, 2104,
tracing (1.84 ms) : 1824, 1855
.   : milestone, 1840,

baseline results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	1.216 ms [1.204 ms, 1.229 ms]	-
iast	3.226 ms [3.18 ms, 3.272 ms]	2.009 ms (165.2%)
iast_FULL	5.953 ms [5.862 ms, 6.045 ms]	4.737 ms (389.4%)
iast_GLOBAL	3.69 ms [3.628 ms, 3.753 ms]	2.474 ms (203.3%)
profiling	2.132 ms [2.113 ms, 2.15 ms]	915.069 µs (75.2%)
tracing	1.902 ms [1.885 ms, 1.919 ms]	685.616 µs (56.4%)

candidate results

Variant	Request duration [CI 0.99]	Δ no_agent
no_agent	1.185 ms [1.173 ms, 1.197 ms]	-
iast	3.338 ms [3.288 ms, 3.388 ms]	2.153 ms (181.7%)
iast_FULL	5.831 ms [5.772 ms, 5.891 ms]	4.646 ms (392.1%)
iast_GLOBAL	3.724 ms [3.62 ms, 3.829 ms]	2.539 ms (214.3%)
profiling	2.104 ms [2.084 ms, 2.125 ms]	919.481 µs (77.6%)
tracing	1.84 ms [1.824 ms, 1.855 ms]	654.709 µs (55.2%)

Dacapo

Parameters

	Baseline	Candidate
baseline_or_candidate	baseline	candidate
git_branch	master	malvarez/open-feature-sdk
git_commit_date	1763584490	1763592825
git_commit_sha	`b3d2c4a`	`31a1f96`
release_version	1.56.0-SNAPSHOT~b3d2c4a83d	1.56.0-SNAPSHOT~31a1f961c5

See matching parameters

	Baseline	Candidate
application	biojava	biojava
ci_job_date	1763594920	1763594920
ci_job_id	1246511431	1246511431
ci_pipeline_id	83275681	83275681
cpu_model	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz	Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version	Linux runner-zfyrx7zua-project-304-concurrent-0-cww59216 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux	Linux runner-zfyrx7zua-project-304-concurrent-0-cww59216 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for tomcat

gantt
    title tomcat - execution time [CI 0.99] : candidate=1.56.0-SNAPSHOT~31a1f961c5, baseline=1.56.0-SNAPSHOT~b3d2c4a83d
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.476 ms) : 1465, 1488
.   : milestone, 1476,
appsec (3.705 ms) : 3480, 3930
.   : milestone, 3705,
iast (2.221 ms) : 2156, 2287
.   : milestone, 2221,
iast_GLOBAL (2.264 ms) : 2198, 2329
.   : milestone, 2264,
profiling (2.089 ms) : 2034, 2143
.   : milestone, 2089,
tracing (2.051 ms) : 2000, 2102
.   : milestone, 2051,
section candidate
no_agent (1.477 ms) : 1465, 1488
.   : milestone, 1477,
appsec (3.747 ms) : 3528, 3966
.   : milestone, 3747,
iast (2.227 ms) : 2162, 2293
.   : milestone, 2227,
iast_GLOBAL (2.259 ms) : 2194, 2325
.   : milestone, 2259,
profiling (2.084 ms) : 2029, 2138
.   : milestone, 2084,
tracing (2.048 ms) : 1997, 2099
.   : milestone, 2048,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.476 ms [1.465 ms, 1.488 ms]	-
appsec	3.705 ms [3.48 ms, 3.93 ms]	2.229 ms (151.0%)
iast	2.221 ms [2.156 ms, 2.287 ms]	745.198 µs (50.5%)
iast_GLOBAL	2.264 ms [2.198 ms, 2.329 ms]	787.455 µs (53.3%)
profiling	2.089 ms [2.034 ms, 2.143 ms]	612.547 µs (41.5%)
tracing	2.051 ms [2.0 ms, 2.102 ms]	574.891 µs (38.9%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	1.477 ms [1.465 ms, 1.488 ms]	-
appsec	3.747 ms [3.528 ms, 3.966 ms]	2.271 ms (153.8%)
iast	2.227 ms [2.162 ms, 2.293 ms]	750.871 µs (50.9%)
iast_GLOBAL	2.259 ms [2.194 ms, 2.325 ms]	782.983 µs (53.0%)
profiling	2.084 ms [2.029 ms, 2.138 ms]	607.311 µs (41.1%)
tracing	2.048 ms [1.997 ms, 2.099 ms]	571.88 µs (38.7%)

Execution time for biojava

gantt
    title biojava - execution time [CI 0.99] : candidate=1.56.0-SNAPSHOT~31a1f961c5, baseline=1.56.0-SNAPSHOT~b3d2c4a83d
    dateFormat X
    axisFormat %s
section baseline
no_agent (14.777 s) : 14777000, 14777000
.   : milestone, 14777000,
appsec (14.704 s) : 14704000, 14704000
.   : milestone, 14704000,
iast (18.498 s) : 18498000, 18498000
.   : milestone, 18498000,
iast_GLOBAL (18.118 s) : 18118000, 18118000
.   : milestone, 18118000,
profiling (14.714 s) : 14714000, 14714000
.   : milestone, 14714000,
tracing (14.543 s) : 14543000, 14543000
.   : milestone, 14543000,
section candidate
no_agent (14.917 s) : 14917000, 14917000
.   : milestone, 14917000,
appsec (14.966 s) : 14966000, 14966000
.   : milestone, 14966000,
iast (18.671 s) : 18671000, 18671000
.   : milestone, 18671000,
iast_GLOBAL (17.95 s) : 17950000, 17950000
.   : milestone, 17950000,
profiling (14.72 s) : 14720000, 14720000
.   : milestone, 14720000,
tracing (14.947 s) : 14947000, 14947000
.   : milestone, 14947000,

baseline results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	14.777 s [14.777 s, 14.777 s]	-
appsec	14.704 s [14.704 s, 14.704 s]	-73.0 ms (-0.5%)
iast	18.498 s [18.498 s, 18.498 s]	3.721 s (25.2%)
iast_GLOBAL	18.118 s [18.118 s, 18.118 s]	3.341 s (22.6%)
profiling	14.714 s [14.714 s, 14.714 s]	-63.0 ms (-0.4%)
tracing	14.543 s [14.543 s, 14.543 s]	-234.0 ms (-1.6%)

candidate results

Variant	Execution Time [CI 0.99]	Δ no_agent
no_agent	14.917 s [14.917 s, 14.917 s]	-
appsec	14.966 s [14.966 s, 14.966 s]	49.0 ms (0.3%)
iast	18.671 s [18.671 s, 18.671 s]	3.754 s (25.2%)
iast_GLOBAL	17.95 s [17.95 s, 17.95 s]	3.033 s (20.3%)
profiling	14.72 s [14.72 s, 14.72 s]	-197.0 ms (-1.3%)
tracing	14.947 s [14.947 s, 14.947 s]	30.0 ms (0.2%)

PerfectSlayer

🎯 suggestion: ‏Should we start having dedicated API module for the other products?
Because this is does not feel like "tracing" and I would rather not having sub-modules and third party dependencies from our public tracing API.

So what about starting a :products:open-features for your public API?
Because the direction for 2.x version will be to split all products from tracing and have them own their separate API which can have 3rd party dependency and language version requirement like yours.

gradle/libs.versions.toml

manuel-alvarez-alvarez · 2025-11-03T00:50:03Z

🎯 suggestion: ‏Should we start having dedicated API module for the other products? Because this is does not feel like "tracing" and I would rather not having sub-modules and third party dependencies from our public tracing API.

So what about starting a :products:open-features for your public API? Because the direction for 2.x version will be to split all products from tracing and have them own their separate API which can have 3rd party dependency and language version requirement like yours.

Hello @PerfectSlayer, thanks for the input! I did take your suggestion into account and also removed the draft status from the PR, so feel free to continue doing the review. We should also discuss the code owners from the new module (including members of the FFE team)

AlexeyKuznetsov-DD

left several minor comments

products/feature-flagging/lib/src/main/java/com/datadog/featureflag/ExposureWriterImpl.java

dd-java-agent/agent-featureflag/src/main/java/com/datadog/featureflag/ExposureWriterImpl.java

dd-java-agent/agent-feature-flagging/build.gradle

...moke-tests/featureflag/src/main/java/datadog/smoketest/springboot/SpringbootApplication.java

internal-api/src/main/java/datadog/trace/api/featureflag/exposure/Allocation.java

internal-api/src/main/java/datadog/trace/api/featureflag/exposure/Flag.java

internal-api/src/main/java/datadog/trace/api/featureflag/exposure/Subject.java

internal-api/src/main/java/datadog/trace/api/featureflag/exposure/Variant.java

products/feature-flagging/api/src/main/java/datadog/trace/api/openfeature/DDEvaluator.java

manuel-alvarez-alvarez · 2025-11-18T13:18:04Z

❔ question: ‏Can the whole DTO and FeatureFlagGate move to the :products:openfeature:lib module then?‏

It's a problem of class loaders, the FeatureFlaggingSystem is loaded inside the agent class loader, meanwhile the Provider and evaluator will typically be loaded by the app class loader. Hence we need them in a common class loader like the bootstrap (that's the reason to chose internal API, but we could move them if we redefine where to load each thing, e.g. loading the system in the same class loader as the provider).

manuel-alvarez-alvarez · 2025-11-18T23:46:47Z

❔ question: ‏Can the whole DTO and FeatureFlagGate move to the :products:openfeature:lib module then?‏

It's a problem of class loaders, the FeatureFlaggingSystem is loaded inside the agent class loader, meanwhile the Provider and evaluator will typically be loaded by the app class loader. Hence we need them in a common class loader like the bootstrap (that's the reason to chose internal API, but we could move them if we redefine where to load each thing, e.g. loading the system in the same class loader as the provider).

I've moved it inside a :boostrap module so it no longer needs to be part of :internal-api

PerfectSlayer

Thanks for iterating with us about finding the right modular architecture 🙏
Hopefully, we can built the standalone SDK easily from here.

internal-api/src/main/java/datadog/trace/api/intake/Intake.java

dd-trace-api/src/main/java/datadog/trace/api/config/FeatureFlaggingConfig.java

manuel-alvarez-alvarez changed the title ~~Malvarez/open feature sdk~~ Implementation of the open feature SDK in the java tracer Oct 30, 2025

manuel-alvarez-alvarez added type: enhancement Enhancements and improvements comp: api Tracer public API labels Oct 30, 2025

This comment has been minimized.

Sign in to view

PerfectSlayer reviewed Oct 30, 2025

View reviewed changes

gradle/libs.versions.toml Outdated Show resolved Hide resolved

manuel-alvarez-alvarez force-pushed the malvarez/open-feature-sdk branch 2 times, most recently from 8325366 to 135fcbd Compare November 3, 2025 00:39

manuel-alvarez-alvarez marked this pull request as ready for review November 3, 2025 00:50

manuel-alvarez-alvarez requested review from a team as code owners November 3, 2025 00:50

manuel-alvarez-alvarez requested review from a team, AlexeyKuznetsov-DD, PerfectSlayer and smola and removed request for a team November 3, 2025 00:50

AlexeyKuznetsov-DD reviewed Nov 3, 2025

View reviewed changes

manuel-alvarez-alvarez force-pushed the malvarez/open-feature-sdk branch 2 times, most recently from 7e03de2 to 738f569 Compare November 5, 2025 09:07

AlexeyKuznetsov-DD self-requested a review November 5, 2025 16:10

manuel-alvarez-alvarez force-pushed the malvarez/open-feature-sdk branch 3 times, most recently from 0388db6 to ca7c192 Compare November 6, 2025 13:26

manuel-alvarez-alvarez mentioned this pull request Nov 6, 2025

Add springboot smoke tests for the open feature SDK #9906

Closed

manuel-alvarez-alvarez force-pushed the malvarez/open-feature-sdk branch 3 times, most recently from a3c9e25 to bbf46e4 Compare November 13, 2025 15:43

manuel-alvarez-alvarez force-pushed the malvarez/open-feature-sdk branch 2 times, most recently from f66a140 to 9cd5aeb Compare November 14, 2025 02:40

manuel-alvarez-alvarez requested a review from PerfectSlayer November 19, 2025 00:01

PerfectSlayer approved these changes Nov 19, 2025

View reviewed changes

internal-api/src/main/java/datadog/trace/api/intake/Intake.java Show resolved Hide resolved

manuel-alvarez-alvarez force-pushed the malvarez/open-feature-sdk branch 2 times, most recently from 7550227 to b65cb5e Compare November 19, 2025 13:21

jandro996 reviewed Nov 19, 2025

View reviewed changes

dd-trace-api/src/main/java/datadog/trace/api/config/FeatureFlaggingConfig.java Show resolved Hide resolved

manuel-alvarez-alvarez added 17 commits November 19, 2025 23:53

Initial implementation of the OpenFeature SDK

1514e4d

Fix class name

c149316

Change in modularization

e4ce84d

Fix tests

f8d2c02

Fix package name

37a69be

Fix CODEOWNERS

1c5b259

Remove shadow jar

853fb98

Remove equals

805f42d

Add unit

77bcb52

Improve date handling

c698e49

Remove common classes from internal-api

81699d6

Add factory method for errors

8e8781e

Configure maven publishing for the SDK

b807173

Update codeowners

ead21d2

Remove log4j dependency from API

8a44b11

Fix coverage

45177ee

Fix class name

31a1f96

manuel-alvarez-alvarez force-pushed the malvarez/open-feature-sdk branch from 6fd2957 to 31a1f96 Compare November 19, 2025 22:53

manuel-alvarez-alvarez merged commit 8aa326f into master Nov 20, 2025
701 of 702 checks passed

manuel-alvarez-alvarez deleted the malvarez/open-feature-sdk branch November 20, 2025 00:03

github-actions bot added this to the 1.56.0 milestone Nov 20, 2025

PerfectSlayer added comp: openfeature OpenFeature and removed comp: api Tracer public API labels Nov 20, 2025

Implementation of the open feature SDK in the java tracer #9885

Implementation of the open feature SDK in the java tracer #9885

Uh oh!

Conversation

manuel-alvarez-alvarez commented Oct 30, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

What Does This Do

Motivation

Additional Notes

Contributor Checklist

Uh oh!

This comment has been minimized.

pr-commenter bot commented Oct 30, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Benchmarks

Startup

Parameters

Summary

Load

Parameters

Summary

Dacapo

Parameters

Summary

Uh oh!

PerfectSlayer left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

manuel-alvarez-alvarez commented Nov 3, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

AlexeyKuznetsov-DD left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

manuel-alvarez-alvarez commented Nov 18, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

manuel-alvarez-alvarez commented Nov 18, 2025

Uh oh!

PerfectSlayer left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

6 participants

manuel-alvarez-alvarez commented Oct 30, 2025 •

edited

Loading

pr-commenter bot commented Oct 30, 2025 •

edited

Loading

manuel-alvarez-alvarez commented Nov 3, 2025 •

edited

Loading

manuel-alvarez-alvarez commented Nov 18, 2025 •

edited

Loading