Skip to content

Make Code Origin for Spans default on #9873

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
merged 2 commits into from
Nov 12, 2025
Merged

Make Code Origin for Spans default on #9873

merged 2 commits into from
Nov 12, 2025
+6 −16

Conversation

@jpbempel
Copy link
Member

@jpbempel jpbempel commented Oct 28, 2025 •
edited
Loading

What Does This Do

by default Code Origin will be started

Motivation

Additional Notes

This feature can be disabled by setting DD_CODE_ORIGIN_FOR_SPANS_ENABLED=false

Contributor Checklist

Jira ticket: DEBUG-4173

@jpbempel jpbempel requested a review from a team as a code owner October 28, 2025 16:57
@jpbempel jpbempel requested a review from mcculls October 28, 2025 16:57
@jpbempel jpbempel added the comp: debugger Dynamic Instrumentation label Oct 28, 2025
@github-actions
Copy link
Contributor

github-actions bot commented Oct 28, 2025 •
edited
Loading

Hi! 👋 Thanks for your pull request! 🎉

To help us review it, please make sure to:

  • Add at least one type, and one component or instrumentation label to the pull request

If you need help, please check our contributing guidelines.

@jpbempel jpbempel added the type: enhancement Enhancements and improvements label Oct 28, 2025
@datadog-datadog-prod-us1
Copy link
Contributor

datadog-datadog-prod-us1 bot commented Oct 28, 2025 •
edited by datadog-official bot
Loading

🎯 Code Coverage
• Patch Coverage: 0.00%
• Total Coverage: 59.47% (-0.14%)

View detailed report

This comment will be updated automatically if new data arrives.
🔗 Commit SHA: 7beade4 | Docs | Datadog PR Page | Was this helpful? Give us feedback!

@pr-commenter
Copy link

pr-commenter bot commented Oct 28, 2025 •
edited
Loading

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master jpbempel/code-origin-default-on
git_commit_date 1762881452 1762929283
git_commit_sha 5db793a 7beade4
release_version 1.56.0-SNAPSHOT~5db793a092 1.56.0-SNAPSHOT~7beade4bca
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1762931182 1762931182
ci_job_id 1229112899 1229112899
ci_pipeline_id 82041083 82041083
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-d7o9jpor 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-d7o9jpor 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 10 performance improvements and 7 performance regressions! Performance is the same for 33 metrics, 15 unstable metrics.

scenario Δ mean execution_time candidate mean execution_time baseline mean execution_time
scenario:startup:insecure-bank:iast:Agent worse
[+226.292ms; +294.998ms] or [+2.438%; +3.179%]		 9.542s 9.281s
scenario:startup:insecure-bank:iast:Agent.start worse
[+53.167ms; +71.583ms] or [+4.499%; +6.057%]		 1.244s 1.182s
scenario:startup:insecure-bank:iast:Remote Config better
[-64.134µs; -28.490µs] or [-10.619%; -4.717%]		 557.645µs 603.957µs
scenario:startup:insecure-bank:iast:Flare Poller better
[-691.147µs; -494.521µs] or [-16.597%; -11.875%]		 3.572ms 4.164ms
scenario:startup:insecure-bank:tracing:Agent.start worse
[+46.436ms; +53.352ms] or [+4.417%; +5.075%]		 1.101s 1.051s
scenario:startup:insecure-bank:tracing:Remote Config better
[-74.785µs; -43.939µs] or [-10.478%; -6.156%]		 654.381µs 713.743µs
scenario:startup:petclinic:appsec:Agent.start worse
[+32.858ms; +79.333ms] or [+2.671%; +6.448%]		 1.286s 1.230s
scenario:startup:petclinic:appsec:Flare Poller better
[-432.288µs; -167.454µs] or [-10.618%; -4.113%]		 3.771ms 4.071ms
scenario:startup:petclinic:iast:Agent.start worse
[+56.573ms; +66.467ms] or [+4.793%; +5.631%]		 1.242s 1.180s
scenario:startup:petclinic:iast:Remote Config better
[-75.424µs; -27.753µs] or [-12.393%; -4.560%]		 557.032µs 608.620µs
scenario:startup:petclinic:iast:Flare Poller better
[-642.606µs; -404.372µs] or [-15.551%; -9.786%]		 3.609ms 4.132ms
scenario:startup:petclinic:profiling:Agent.start worse
[+30.531ms; +62.965ms] or [+2.559%; +5.278%]		 1.240s 1.193s
scenario:startup:petclinic:profiling:ProfilingAgent better
[-15.308ms; -13.692ms] or [-13.769%; -12.315%]		 96.682ms 111.182ms
scenario:startup:petclinic:profiling:Flare Poller better
[-459.601µs; -215.211µs] or [-11.111%; -5.203%]		 3.799ms 4.136ms
scenario:startup:petclinic:profiling:Profiling better
[-15.411ms; -13.795ms] or [-13.777%; -12.332%]		 97.259ms 111.862ms
scenario:startup:petclinic:tracing:Agent.start worse
[+37.702ms; +66.572ms] or [+3.583%; +6.326%]		 1.104s 1.052s
scenario:startup:petclinic:tracing:Remote Config better
[-99.235µs; -41.139µs] or [-13.572%; -5.626%]		 660.981µs 731.168µs
Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.56.0-SNAPSHOT~7beade4bca, baseline=1.56.0-SNAPSHOT~5db793a092

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.051 s) : 0, 1051195
Total [baseline] (8.651 s) : 0, 8651309
Agent [candidate] (1.101 s) : 0, 1101089
Total [candidate] (8.813 s) : 0, 8812775
section iast
Agent [baseline] (1.182 s) : 0, 1181859
Total [baseline] (9.281 s) : 0, 9280871
Agent [candidate] (1.244 s) : 0, 1244234
Total [candidate] (9.542 s) : 0, 9541516
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.051 s -
Agent iast 1.182 s 130.663 ms (12.4%)
Total tracing 8.651 s -
Total iast 9.281 s 629.561 ms (7.3%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.101 s -
Agent iast 1.244 s 143.145 ms (13.0%)
Total tracing 8.813 s -
Total iast 9.542 s 728.74 ms (8.3%) 
gantt
    title insecure-bank - break down per module: candidate=1.56.0-SNAPSHOT~7beade4bca, baseline=1.56.0-SNAPSHOT~5db793a092

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.473 ms) : 0, 1473
crashtracking [candidate] (1.471 ms) : 0, 1471
BytebuddyAgent [baseline] (707.259 ms) : 0, 707259
BytebuddyAgent [candidate] (705.995 ms) : 0, 705995
GlobalTracer [baseline] (246.729 ms) : 0, 246729
GlobalTracer [candidate] (245.094 ms) : 0, 245094
AppSec [baseline] (32.482 ms) : 0, 32482
AppSec [candidate] (32.27 ms) : 0, 32270
Debugger [baseline] (6.376 ms) : 0, 6376
Debugger [candidate] (68.466 ms) : 0, 68466
Remote Config [baseline] (713.743 µs) : 0, 714
Remote Config [candidate] (654.381 µs) : 0, 654
Telemetry [baseline] (14.814 ms) : 0, 14814
Telemetry [candidate] (8.728 ms) : 0, 8728
Flare Poller [baseline] (6.549 ms) : 0, 6549
Flare Poller [candidate] (3.696 ms) : 0, 3696
section iast
crashtracking [baseline] (1.466 ms) : 0, 1466
crashtracking [candidate] (1.481 ms) : 0, 1481
BytebuddyAgent [baseline] (829.416 ms) : 0, 829416
BytebuddyAgent [candidate] (833.306 ms) : 0, 833306
GlobalTracer [baseline] (235.159 ms) : 0, 235159
GlobalTracer [candidate] (235.348 ms) : 0, 235348
AppSec [baseline] (29.85 ms) : 0, 29850
AppSec [candidate] (31.517 ms) : 0, 31517
Debugger [baseline] (5.999 ms) : 0, 5999
Debugger [candidate] (65.261 ms) : 0, 65261
Remote Config [baseline] (603.957 µs) : 0, 604
Remote Config [candidate] (557.645 µs) : 0, 558
Telemetry [baseline] (8.578 ms) : 0, 8578
Telemetry [candidate] (8.195 ms) : 0, 8195
Flare Poller [baseline] (4.164 ms) : 0, 4164
Flare Poller [candidate] (3.572 ms) : 0, 3572
IAST [baseline] (31.784 ms) : 0, 31784
IAST [candidate] (30.075 ms) : 0, 30075
Loading
Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.56.0-SNAPSHOT~7beade4bca, baseline=1.56.0-SNAPSHOT~5db793a092

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.052 s) : 0, 1052322
Total [baseline] (10.868 s) : 0, 10867661
Agent [candidate] (1.104 s) : 0, 1104459
Total [candidate] (10.755 s) : 0, 10755298
section appsec
Agent [baseline] (1.23 s) : 0, 1230362
Total [baseline] (10.962 s) : 0, 10962023
Agent [candidate] (1.286 s) : 0, 1286458
Total [candidate] (11.119 s) : 0, 11118581
section iast
Agent [baseline] (1.18 s) : 0, 1180337
Total [baseline] (11.138 s) : 0, 11138098
Agent [candidate] (1.242 s) : 0, 1241856
Total [candidate] (11.18 s) : 0, 11179911
section profiling
Agent [baseline] (1.193 s) : 0, 1193051
Total [baseline] (10.96 s) : 0, 10960208
Agent [candidate] (1.24 s) : 0, 1239799
Total [candidate] (11.121 s) : 0, 11120552
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.052 s -
Agent appsec 1.23 s 178.04 ms (16.9%)
Agent iast 1.18 s 128.015 ms (12.2%)
Agent profiling 1.193 s 140.729 ms (13.4%)
Total tracing 10.868 s -
Total appsec 10.962 s 94.363 ms (0.9%)
Total iast 11.138 s 270.437 ms (2.5%)
Total profiling 10.96 s 92.547 ms (0.9%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.104 s -
Agent appsec 1.286 s 181.999 ms (16.5%)
Agent iast 1.242 s 137.398 ms (12.4%)
Agent profiling 1.24 s 135.34 ms (12.3%)
Total tracing 10.755 s -
Total appsec 11.119 s 363.283 ms (3.4%)
Total iast 11.18 s 424.612 ms (3.9%)
Total profiling 11.121 s 365.254 ms (3.4%) 
gantt
    title petclinic - break down per module: candidate=1.56.0-SNAPSHOT~7beade4bca, baseline=1.56.0-SNAPSHOT~5db793a092

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.482 ms) : 0, 1482
crashtracking [candidate] (1.469 ms) : 0, 1469
BytebuddyAgent [baseline] (708.571 ms) : 0, 708571
BytebuddyAgent [candidate] (707.533 ms) : 0, 707533
GlobalTracer [baseline] (246.875 ms) : 0, 246875
GlobalTracer [candidate] (245.964 ms) : 0, 245964
AppSec [baseline] (32.605 ms) : 0, 32605
AppSec [candidate] (32.365 ms) : 0, 32365
Debugger [baseline] (6.442 ms) : 0, 6442
Debugger [candidate] (69.374 ms) : 0, 69374
Remote Config [baseline] (731.168 µs) : 0, 731
Remote Config [candidate] (660.981 µs) : 0, 661
Telemetry [baseline] (11.693 ms) : 0, 11693
Telemetry [candidate] (8.609 ms) : 0, 8609
Flare Poller [baseline] (9.018 ms) : 0, 9018
Flare Poller [candidate] (3.676 ms) : 0, 3676
section appsec
crashtracking [baseline] (1.483 ms) : 0, 1483
crashtracking [candidate] (1.471 ms) : 0, 1471
BytebuddyAgent [baseline] (734.154 ms) : 0, 734154
BytebuddyAgent [candidate] (735.318 ms) : 0, 735318
GlobalTracer [baseline] (239.15 ms) : 0, 239150
GlobalTracer [candidate] (239.278 ms) : 0, 239278
AppSec [baseline] (175.97 ms) : 0, 175970
AppSec [candidate] (175.603 ms) : 0, 175603
Debugger [baseline] (6.037 ms) : 0, 6037
Debugger [candidate] (61.154 ms) : 0, 61154
Remote Config [baseline] (659.736 µs) : 0, 660
Remote Config [candidate] (642.19 µs) : 0, 642
Telemetry [baseline] (8.66 ms) : 0, 8660
Telemetry [candidate] (9.07 ms) : 0, 9070
Flare Poller [baseline] (4.071 ms) : 0, 4071
Flare Poller [candidate] (3.771 ms) : 0, 3771
IAST [baseline] (25.107 ms) : 0, 25107
IAST [candidate] (25.157 ms) : 0, 25157
section iast
crashtracking [baseline] (1.47 ms) : 0, 1470
crashtracking [candidate] (1.469 ms) : 0, 1469
BytebuddyAgent [baseline] (828.582 ms) : 0, 828582
BytebuddyAgent [candidate] (829.272 ms) : 0, 829272
GlobalTracer [baseline] (234.899 ms) : 0, 234899
GlobalTracer [candidate] (235.495 ms) : 0, 235495
AppSec [baseline] (30.587 ms) : 0, 30587
AppSec [candidate] (30.831 ms) : 0, 30831
Debugger [baseline] (6.008 ms) : 0, 6008
Debugger [candidate] (66.695 ms) : 0, 66695
Remote Config [baseline] (608.62 µs) : 0, 609
Remote Config [candidate] (557.032 µs) : 0, 557
Telemetry [baseline] (8.475 ms) : 0, 8475
Telemetry [candidate] (8.268 ms) : 0, 8268
Flare Poller [baseline] (4.132 ms) : 0, 4132
Flare Poller [candidate] (3.609 ms) : 0, 3609
IAST [baseline] (30.791 ms) : 0, 30791
IAST [candidate] (30.926 ms) : 0, 30926
section profiling
ProfilingAgent [baseline] (111.182 ms) : 0, 111182
ProfilingAgent [candidate] (96.682 ms) : 0, 96682
crashtracking [baseline] (1.454 ms) : 0, 1454
crashtracking [candidate] (1.462 ms) : 0, 1462
BytebuddyAgent [baseline] (728.387 ms) : 0, 728387
BytebuddyAgent [candidate] (734.809 ms) : 0, 734809
GlobalTracer [baseline] (222.099 ms) : 0, 222099
GlobalTracer [candidate] (223.446 ms) : 0, 223446
AppSec [baseline] (32.232 ms) : 0, 32232
AppSec [candidate] (32.566 ms) : 0, 32566
Debugger [baseline] (7.556 ms) : 0, 7556
Debugger [candidate] (68.291 ms) : 0, 68291
Remote Config [baseline] (687.592 µs) : 0, 688
Remote Config [candidate] (651.212 µs) : 0, 651
Telemetry [baseline] (15.59 ms) : 0, 15590
Telemetry [candidate] (8.024 ms) : 0, 8024
Flare Poller [baseline] (4.136 ms) : 0, 4136
Flare Poller [candidate] (3.799 ms) : 0, 3799
Profiling [baseline] (111.862 ms) : 0, 111862
Profiling [candidate] (97.259 ms) : 0, 97259
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master jpbempel/code-origin-default-on
git_commit_date 1762881452 1762929283
git_commit_sha 5db793a 7beade4
release_version 1.56.0-SNAPSHOT~5db793a092 1.56.0-SNAPSHOT~7beade4bca
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1762931671 1762931671
ci_job_id 1229112900 1229112900
ci_pipeline_id 82041083 82041083
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-1-jg8aqu4j 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-1-jg8aqu4j 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 2 performance improvements and 2 performance regressions! Performance is the same for 15 metrics, 17 unstable metrics.

scenario Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p95 Δ mean throughput candidate mean agg_http_req_duration_p50 candidate mean agg_http_req_duration_p95 candidate mean throughput baseline mean agg_http_req_duration_p50 baseline mean agg_http_req_duration_p95 baseline mean throughput
scenario:load:insecure-bank:iast_GLOBAL:high_load worse
[+73.532µs; +204.607µs] or [+2.622%; +7.297%]		 unsure
[+10.139µs; +428.894µs] or [+0.129%; +5.458%]		 unstable
[-225.915op/s; +81.915op/s] or [-17.368%; +6.297%]		 2.943ms 8.077ms 1228.781op/s 2.804ms 7.858ms 1300.781op/s
scenario:load:insecure-bank:iast_FULL:high_load unstable
[+182.408µs; +682.997µs] or [+3.763%; +14.090%]		 worse
[+344.751µs; +1453.112µs] or [+2.922%; +12.315%]		 unstable
[-167.927op/s; +23.177op/s] or [-19.865%; +2.742%]		 5.280ms 12.699ms 772.969op/s 4.847ms 11.800ms 845.344op/s
scenario:load:petclinic:appsec:high_load better
[-1.953ms; -0.983ms] or [-9.898%; -4.982%]		 better
[-2.552ms; -0.960ms] or [-8.032%; -3.021%]		 unstable
[-10.342op/s; +39.592op/s] or [-4.411%; +16.888%]		 18.265ms 30.015ms 249.062op/s 19.733ms 31.771ms 234.438op/s
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.56.0-SNAPSHOT~7beade4bca, baseline=1.56.0-SNAPSHOT~5db793a092
    dateFormat X
    axisFormat %s
section baseline
no_agent (19.414 ms) : 19212, 19615
.   : milestone, 19414,
appsec (19.911 ms) : 19704, 20117
.   : milestone, 19911,
code_origins (17.526 ms) : 17354, 17699
.   : milestone, 17526,
iast (17.996 ms) : 17816, 18176
.   : milestone, 17996,
profiling (18.527 ms) : 18343, 18711
.   : milestone, 18527,
tracing (17.895 ms) : 17717, 18073
.   : milestone, 17895,
section candidate
no_agent (17.995 ms) : 17815, 18176
.   : milestone, 17995,
appsec (18.736 ms) : 18547, 18926
.   : milestone, 18736,
code_origins (17.819 ms) : 17641, 17997
.   : milestone, 17819,
iast (17.757 ms) : 17578, 17937
.   : milestone, 17757,
profiling (18.464 ms) : 18275, 18652
.   : milestone, 18464,
tracing (18.01 ms) : 17828, 18193
.   : milestone, 18010,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 19.414 ms [19.212 ms, 19.615 ms] -
appsec 19.911 ms [19.704 ms, 20.117 ms] 497.186 µs (2.6%)
code_origins 17.526 ms [17.354 ms, 17.699 ms] -1.887 ms (-9.7%)
iast 17.996 ms [17.816 ms, 18.176 ms] -1.418 ms (-7.3%)
profiling 18.527 ms [18.343 ms, 18.711 ms] -886.573 µs (-4.6%)
tracing 17.895 ms [17.717 ms, 18.073 ms] -1.518 ms (-7.8%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 17.995 ms [17.815 ms, 18.176 ms] -
appsec 18.736 ms [18.547 ms, 18.926 ms] 740.994 µs (4.1%)
code_origins 17.819 ms [17.641 ms, 17.997 ms] -175.922 µs (-1.0%)
iast 17.757 ms [17.578 ms, 17.937 ms] -237.79 µs (-1.3%)
profiling 18.464 ms [18.275 ms, 18.652 ms] 468.23 µs (2.6%)
tracing 18.01 ms [17.828 ms, 18.193 ms] 15.048 µs (0.1%)
Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.56.0-SNAPSHOT~7beade4bca, baseline=1.56.0-SNAPSHOT~5db793a092
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.186 ms) : 1174, 1197
.   : milestone, 1186,
iast (3.299 ms) : 3251, 3347
.   : milestone, 3299,
iast_FULL (5.464 ms) : 5409, 5518
.   : milestone, 5464,
iast_GLOBAL (3.524 ms) : 3474, 3574
.   : milestone, 3524,
profiling (2.092 ms) : 2073, 2111
.   : milestone, 2092,
tracing (1.805 ms) : 1790, 1821
.   : milestone, 1805,
section candidate
no_agent (1.207 ms) : 1195, 1219
.   : milestone, 1207,
iast (3.241 ms) : 3200, 3282
.   : milestone, 3241,
iast_FULL (5.983 ms) : 5923, 6044
.   : milestone, 5983,
iast_GLOBAL (3.743 ms) : 3649, 3837
.   : milestone, 3743,
profiling (2.162 ms) : 2143, 2182
.   : milestone, 2162,
tracing (1.815 ms) : 1799, 1831
.   : milestone, 1815,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.186 ms [1.174 ms, 1.197 ms] -
iast 3.299 ms [3.251 ms, 3.347 ms] 2.113 ms (178.2%)
iast_FULL 5.464 ms [5.409 ms, 5.518 ms] 4.278 ms (360.7%)
iast_GLOBAL 3.524 ms [3.474 ms, 3.574 ms] 2.338 ms (197.2%)
profiling 2.092 ms [2.073 ms, 2.111 ms] 906.072 µs (76.4%)
tracing 1.805 ms [1.79 ms, 1.821 ms] 619.607 µs (52.3%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.207 ms [1.195 ms, 1.219 ms] -
iast 3.241 ms [3.2 ms, 3.282 ms] 2.034 ms (168.6%)
iast_FULL 5.983 ms [5.923 ms, 6.044 ms] 4.777 ms (395.8%)
iast_GLOBAL 3.743 ms [3.649 ms, 3.837 ms] 2.536 ms (210.2%)
profiling 2.162 ms [2.143 ms, 2.182 ms] 955.673 µs (79.2%)
tracing 1.815 ms [1.799 ms, 1.831 ms] 608.151 µs (50.4%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master jpbempel/code-origin-default-on
git_commit_date 1762881452 1762929283
git_commit_sha 5db793a 7beade4
release_version 1.56.0-SNAPSHOT~5db793a092 1.56.0-SNAPSHOT~7beade4bca
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1762931307 1762931307
ci_job_id 1229112901 1229112901
ci_pipeline_id 82041083 82041083
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-aranydp7 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-aranydp7 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.56.0-SNAPSHOT~7beade4bca, baseline=1.56.0-SNAPSHOT~5db793a092
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.477 ms) : 1465, 1488
.   : milestone, 1477,
appsec (3.704 ms) : 3486, 3922
.   : milestone, 3704,
iast (2.211 ms) : 2148, 2274
.   : milestone, 2211,
iast_GLOBAL (2.257 ms) : 2193, 2320
.   : milestone, 2257,
profiling (2.081 ms) : 2028, 2134
.   : milestone, 2081,
tracing (2.026 ms) : 1977, 2075
.   : milestone, 2026,
section candidate
no_agent (1.484 ms) : 1473, 1496
.   : milestone, 1484,
appsec (3.714 ms) : 3495, 3932
.   : milestone, 3714,
iast (2.209 ms) : 2146, 2272
.   : milestone, 2209,
iast_GLOBAL (2.254 ms) : 2190, 2317
.   : milestone, 2254,
profiling (2.058 ms) : 2007, 2109
.   : milestone, 2058,
tracing (2.033 ms) : 1983, 2082
.   : milestone, 2033,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.477 ms [1.465 ms, 1.488 ms] -
appsec 3.704 ms [3.486 ms, 3.922 ms] 2.227 ms (150.8%)
iast 2.211 ms [2.148 ms, 2.274 ms] 734.185 µs (49.7%)
iast_GLOBAL 2.257 ms [2.193 ms, 2.32 ms] 779.76 µs (52.8%)
profiling 2.081 ms [2.028 ms, 2.134 ms] 604.551 µs (40.9%)
tracing 2.026 ms [1.977 ms, 2.075 ms] 549.065 µs (37.2%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.484 ms [1.473 ms, 1.496 ms] -
appsec 3.714 ms [3.495 ms, 3.932 ms] 2.229 ms (150.2%)
iast 2.209 ms [2.146 ms, 2.272 ms] 724.71 µs (48.8%)
iast_GLOBAL 2.254 ms [2.19 ms, 2.317 ms] 769.261 µs (51.8%)
profiling 2.058 ms [2.007 ms, 2.109 ms] 573.737 µs (38.6%)
tracing 2.033 ms [1.983 ms, 2.082 ms] 548.049 µs (36.9%)
Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.56.0-SNAPSHOT~7beade4bca, baseline=1.56.0-SNAPSHOT~5db793a092
    dateFormat X
    axisFormat %s
section baseline
no_agent (14.811 s) : 14811000, 14811000
.   : milestone, 14811000,
appsec (14.809 s) : 14809000, 14809000
.   : milestone, 14809000,
iast (18.387 s) : 18387000, 18387000
.   : milestone, 18387000,
iast_GLOBAL (17.86 s) : 17860000, 17860000
.   : milestone, 17860000,
profiling (15.813 s) : 15813000, 15813000
.   : milestone, 15813000,
tracing (14.829 s) : 14829000, 14829000
.   : milestone, 14829000,
section candidate
no_agent (15.249 s) : 15249000, 15249000
.   : milestone, 15249000,
appsec (14.628 s) : 14628000, 14628000
.   : milestone, 14628000,
iast (18.605 s) : 18605000, 18605000
.   : milestone, 18605000,
iast_GLOBAL (18.047 s) : 18047000, 18047000
.   : milestone, 18047000,
profiling (14.957 s) : 14957000, 14957000
.   : milestone, 14957000,
tracing (14.758 s) : 14758000, 14758000
.   : milestone, 14758000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.811 s [14.811 s, 14.811 s] -
appsec 14.809 s [14.809 s, 14.809 s] -2.0 ms (-0.0%)
iast 18.387 s [18.387 s, 18.387 s] 3.576 s (24.1%)
iast_GLOBAL 17.86 s [17.86 s, 17.86 s] 3.049 s (20.6%)
profiling 15.813 s [15.813 s, 15.813 s] 1.002 s (6.8%)
tracing 14.829 s [14.829 s, 14.829 s] 18.0 ms (0.1%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.249 s [15.249 s, 15.249 s] -
appsec 14.628 s [14.628 s, 14.628 s] -621.0 ms (-4.1%)
iast 18.605 s [18.605 s, 18.605 s] 3.356 s (22.0%)
iast_GLOBAL 18.047 s [18.047 s, 18.047 s] 2.798 s (18.3%)
profiling 14.957 s [14.957 s, 14.957 s] -292.0 ms (-1.9%)
tracing 14.758 s [14.758 s, 14.758 s] -491.0 ms (-3.2%)

@jpbempel jpbempel force-pushed the jpbempel/code-origin-default-on branch from d56be96 to 3ff89a2 Compare October 29, 2025 08:41
@jpbempel jpbempel requested a review from a team as a code owner October 29, 2025 12:26
@jpbempel jpbempel force-pushed the jpbempel/code-origin-default-on branch from 8dddbde to 778754a Compare October 29, 2025 15:27
@pr-commenter
Copy link

pr-commenter bot commented Oct 29, 2025 •
edited
Loading

Kafka / producer-benchmark

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master jpbempel/code-origin-default-on
git_commit_date 1762881452 1762929283
git_commit_sha 5db793a 7beade4
See matching parameters
Baseline Candidate
ci_job_date 1762930397 1762930397
ci_job_id 1229112904 1229112904
ci_pipeline_id 82041083 82041083
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
jdkVersion 11.0.25 11.0.25
jmhVersion 1.36 1.36
jvm /usr/lib/jvm/java-11-openjdk-amd64/bin/java /usr/lib/jvm/java-11-openjdk-amd64/bin/java
jvmArgs -Dfile.encoding=UTF-8 -Djava.io.tmpdir=/go/src/github.com/DataDog/apm-reliability/dd-trace-java/platform/src/producer-benchmark/build/tmp/jmh -Duser.country=US -Duser.language=en -Duser.variant -Dfile.encoding=UTF-8 -Djava.io.tmpdir=/go/src/github.com/DataDog/apm-reliability/dd-trace-java/platform/src/producer-benchmark/build/tmp/jmh -Duser.country=US -Duser.language=en -Duser.variant
vmName OpenJDK 64-Bit Server VM OpenJDK 64-Bit Server VM
vmVersion 11.0.25+9-post-Ubuntu-1ubuntu122.04 11.0.25+9-post-Ubuntu-1ubuntu122.04

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 3 metrics, 0 unstable metrics.

See unchanged results
scenario Δ mean throughput
scenario:not-instrumented/KafkaProduceBenchmark.benchProduce same
scenario:only-tracing-dsm-disabled-benchmarks/KafkaProduceBenchmark.benchProduce same
scenario:only-tracing-dsm-enabled-benchmarks/KafkaProduceBenchmark.benchProduce same

@pr-commenter
Copy link

pr-commenter bot commented Oct 29, 2025 •
edited
Loading

Kafka / consumer-benchmark

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master jpbempel/code-origin-default-on
git_commit_date 1762881452 1762929283
git_commit_sha 5db793a 7beade4
See matching parameters
Baseline Candidate
ci_job_date 1762930438 1762930438
ci_job_id 1229112905 1229112905
ci_pipeline_id 82041083 82041083
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
jdkVersion 11.0.25 11.0.25
jmhVersion 1.36 1.36
jvm /usr/lib/jvm/java-11-openjdk-amd64/bin/java /usr/lib/jvm/java-11-openjdk-amd64/bin/java
jvmArgs -Dfile.encoding=UTF-8 -Djava.io.tmpdir=/go/src/github.com/DataDog/apm-reliability/dd-trace-java/platform/src/consumer-benchmark/build/tmp/jmh -Duser.country=US -Duser.language=en -Duser.variant -Dfile.encoding=UTF-8 -Djava.io.tmpdir=/go/src/github.com/DataDog/apm-reliability/dd-trace-java/platform/src/consumer-benchmark/build/tmp/jmh -Duser.country=US -Duser.language=en -Duser.variant
vmName OpenJDK 64-Bit Server VM OpenJDK 64-Bit Server VM
vmVersion 11.0.25+9-post-Ubuntu-1ubuntu122.04 11.0.25+9-post-Ubuntu-1ubuntu122.04

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 3 metrics, 0 unstable metrics.

See unchanged results
scenario Δ mean throughput
scenario:not-instrumented/KafkaConsumerBenchmark.benchConsume same
scenario:only-tracing-dsm-disabled-benchmarks/KafkaConsumerBenchmark.benchConsume same
scenario:only-tracing-dsm-enabled-benchmarks/KafkaConsumerBenchmark.benchConsume same

@jpbempel jpbempel force-pushed the jpbempel/code-origin-default-on branch from 778754a to 24b88d7 Compare October 30, 2025 09:53
@jpbempel jpbempel force-pushed the jpbempel/code-origin-default-on branch 6 times, most recently from ad98e42 to 71e7de7 Compare November 5, 2025 07:44
mcculls
mcculls reviewed Nov 11, 2025
View reviewed changes
Copy link
Contributor

@mcculls mcculls left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Code changes look ok - just need some reassurance about the performance impact

@jpbempel
Make Code Origin for Spans default on
36828d1 
by default Code Origin will be started
@jpbempel
fix tests
7beade4
@jpbempel jpbempel force-pushed the jpbempel/code-origin-default-on branch from 71e7de7 to 7beade4 Compare November 12, 2025 06:34
@tylfin
Copy link
Member

tylfin commented Nov 12, 2025

@mcculls We have a link to the benchmarking results in https://datadoghq.atlassian.net/browse/DEBUG-4173, this is still a WIP but startup time, latency, memory, CPU all look nominal to move this to a default-on feature. We also have about 190 orgs using this in production today.

@jpbempel jpbempel merged commit d422f6d into master Nov 12, 2025
543 checks passed
@jpbempel jpbempel deleted the jpbempel/code-origin-default-on branch November 12, 2025 15:37
@github-actions github-actions bot added this to the 1.56.0 milestone Nov 12, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@mcculls mcculls mcculls approved these changes

@tylfin tylfin tylfin approved these changes

Assignees

No one assigned

Labels

comp: debugger Dynamic Instrumentation type: enhancement Enhancements and improvements

Projects

None yet

Milestone

1.56.0

Development

Successfully merging this pull request may close these issues.

4 participants

@jpbempel @tylfin @mcculls