Skip to content

Update Gradle dependencies #8877

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 47 commits into
base: master
Choose a base branch
from

Conversation

github-actions[bot]
Copy link
Contributor

This PR updates the Gradle dependencies. ⚠️ Don't forget to squash commits before merging. ⚠️

  • Update PR title if a code change is needed to support one of those new dependencies

@github-actions github-actions bot added tag: no release notes Changes to exclude from release notes tag: dependencies Dependencies related changes labels May 25, 2025
@github-actions github-actions bot requested review from a team as code owners May 25, 2025 04:27
@github-actions github-actions bot requested review from jpbempel, daniel-mohedano, smola and sezen-datadog and removed request for a team May 25, 2025 04:27
@pr-commenter
Copy link

pr-commenter bot commented May 25, 2025

Debugger benchmarks

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
ci_job_date 1748148082 1748148451
end_time 2025-05-25T04:42:44 2025-05-25T04:48:51
git_branch master ci/update-gradle-dependencies-20250525
git_commit_sha ad6d5fe bd38cb2
start_time 2025-05-25T04:41:23 2025-05-25T04:47:32
See matching parameters
Baseline Candidate
ci_job_id 953380413 953380413
ci_pipeline_id 66059384 66059384
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
git_commit_date 1748147247 1748147247

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 10 metrics, 5 unstable metrics.

See unchanged results
scenario Δ mean agg_http_req_duration_min Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p75 Δ mean agg_http_req_duration_p99 Δ mean throughput
scenario:noprobe unstable
[-23.812µs; +17.089µs] or [-8.508%; +6.106%]
unstable
[-36.326µs; +28.243µs] or [-11.296%; +8.782%]
unstable
[-45.443µs; +40.470µs] or [-13.590%; +12.103%]
unstable
[-67.457µs; +164.431µs] or [-7.150%; +17.427%]
same
scenario:basic same same same unstable
[-121.090µs; +70.127µs] or [-13.544%; +7.844%]
same
scenario:loop unsure
[+15.834µs; +27.891µs] or [+0.159%; +0.279%]
same same same same
Request duration reports for reports
gantt
    title reports - request duration [CI 0.99] : candidate=None, baseline=None
    dateFormat X
    axisFormat %s
section baseline
noprobe (321.583 µs) : 294, 349
.   : milestone, 322,
basic (315.007 µs) : 307, 323
.   : milestone, 315,
loop (10.146 ms) : 10106, 10185
.   : milestone, 10146,
section candidate
noprobe (317.541 µs) : 284, 351
.   : milestone, 318,
basic (314.045 µs) : 305, 323
.   : milestone, 314,
loop (10.148 ms) : 10120, 10176
.   : milestone, 10148,
Loading
  • baseline results
Scenario Request median duration [CI 0.99]
noprobe 321.583 µs [293.982 µs, 349.184 µs]
basic 315.007 µs [307.129 µs, 322.885 µs]
loop 10.146 ms [10.106 ms, 10.185 ms]
  • candidate results
Scenario Request median duration [CI 0.99]
noprobe 317.541 µs [283.962 µs, 351.12 µs]
basic 314.045 µs [304.851 µs, 323.24 µs]
loop 10.148 ms [10.12 ms, 10.176 ms]

@pr-commenter
Copy link

pr-commenter bot commented May 25, 2025

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master ci/update-gradle-dependencies-20250525
git_commit_date 1746789389 1748147226
git_commit_sha ad6d5fe 8cce2a9
release_version 1.50.0-SNAPSHOT~ad6d5fef42 1.50.0-SNAPSHOT~8cce2a9f41
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1748149905 1748149905
ci_job_id 953379322 953379322
ci_pipeline_id 66059377 66059377
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-6b4twteb-project-304-concurrent-1-59talww7 6.8.0-1029-aws #31~22.04.1-Ubuntu SMP Thu Apr 24 21:16:18 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-6b4twteb-project-304-concurrent-1-59talww7 6.8.0-1029-aws #31~22.04.1-Ubuntu SMP Thu Apr 24 21:16:18 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None
variant iast iast

Summary

Found 1 performance improvements and 1 performance regressions! Performance is the same for 54 metrics, 15 unstable metrics.

scenario Δ mean execution_time candidate mean execution_time baseline mean execution_time
scenario:startup:petclinic:profiling:GlobalTracer better
[-19.848ms; -16.136ms] or [-5.245%; -4.264%]
360.404ms 378.396ms
scenario:startup:petclinic:profiling:AppSec worse
[+5.641ms; +9.012ms] or [+10.329%; +16.501%]
61.944ms 54.617ms
Startup time reports for insecure-bank
gantt
    title insecure-bank - global startup overhead: candidate=1.50.0-SNAPSHOT~8cce2a9f41, baseline=1.50.0-SNAPSHOT~ad6d5fef42

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.021 s) : 0, 1021014
Total [baseline] (8.749 s) : 0, 8749051
Agent [candidate] (1.026 s) : 0, 1026234
Total [candidate] (8.694 s) : 0, 8693635
section iast
Agent [baseline] (1.156 s) : 0, 1155588
Total [baseline] (9.219 s) : 0, 9218793
Agent [candidate] (1.15 s) : 0, 1149896
Total [candidate] (9.258 s) : 0, 9257675
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.149 s) : 0, 1148861
Total [baseline] (9.209 s) : 0, 9209494
Agent [candidate] (1.158 s) : 0, 1157569
Total [candidate] (9.227 s) : 0, 9227082
section iast_TELEMETRY_OFF
Agent [baseline] (1.148 s) : 0, 1147710
Total [baseline] (9.209 s) : 0, 9209251
Agent [candidate] (1.154 s) : 0, 1154387
Total [candidate] (9.24 s) : 0, 9240419
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.021 s -
Agent iast 1.156 s 134.574 ms (13.2%)
Agent iast_HARDCODED_SECRET_DISABLED 1.149 s 127.847 ms (12.5%)
Agent iast_TELEMETRY_OFF 1.148 s 126.696 ms (12.4%)
Total tracing 8.749 s -
Total iast 9.219 s 469.742 ms (5.4%)
Total iast_HARDCODED_SECRET_DISABLED 9.209 s 460.444 ms (5.3%)
Total iast_TELEMETRY_OFF 9.209 s 460.201 ms (5.3%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.026 s -
Agent iast 1.15 s 123.662 ms (12.1%)
Agent iast_HARDCODED_SECRET_DISABLED 1.158 s 131.335 ms (12.8%)
Agent iast_TELEMETRY_OFF 1.154 s 128.153 ms (12.5%)
Total tracing 8.694 s -
Total iast 9.258 s 564.04 ms (6.5%)
Total iast_HARDCODED_SECRET_DISABLED 9.227 s 533.447 ms (6.1%)
Total iast_TELEMETRY_OFF 9.24 s 546.784 ms (6.3%)
gantt
    title insecure-bank - break down per module: candidate=1.50.0-SNAPSHOT~8cce2a9f41, baseline=1.50.0-SNAPSHOT~ad6d5fef42

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (682.196 ms) : 0, 682196
BytebuddyAgent [candidate] (688.049 ms) : 0, 688049
GlobalTracer [baseline] (239.94 ms) : 0, 239940
GlobalTracer [candidate] (242.072 ms) : 0, 242072
AppSec [baseline] (56.257 ms) : 0, 56257
AppSec [candidate] (54.924 ms) : 0, 54924
Debugger [baseline] (8.439 ms) : 0, 8439
Debugger [candidate] (6.904 ms) : 0, 6904
Remote Config [baseline] (716.504 µs) : 0, 717
Remote Config [candidate] (709.948 µs) : 0, 710
Telemetry [baseline] (9.887 ms) : 0, 9887
Telemetry [candidate] (9.908 ms) : 0, 9908
section iast
BytebuddyAgent [baseline] (809.01 ms) : 0, 809010
BytebuddyAgent [candidate] (802.224 ms) : 0, 802224
GlobalTracer [baseline] (230.313 ms) : 0, 230313
GlobalTracer [candidate] (230.789 ms) : 0, 230789
IAST [baseline] (28.163 ms) : 0, 28163
IAST [candidate] (28.172 ms) : 0, 28172
AppSec [baseline] (50.085 ms) : 0, 50085
AppSec [candidate] (50.618 ms) : 0, 50618
Debugger [baseline] (5.882 ms) : 0, 5882
Debugger [candidate] (5.978 ms) : 0, 5978
Remote Config [baseline] (595.595 µs) : 0, 596
Remote Config [candidate] (601.077 µs) : 0, 601
Telemetry [baseline] (7.844 ms) : 0, 7844
Telemetry [candidate] (8.06 ms) : 0, 8060
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (802.453 ms) : 0, 802453
BytebuddyAgent [candidate] (809.144 ms) : 0, 809144
GlobalTracer [baseline] (230.252 ms) : 0, 230252
GlobalTracer [candidate] (231.909 ms) : 0, 231909
IAST [baseline] (27.445 ms) : 0, 27445
IAST [candidate] (29.018 ms) : 0, 29018
AppSec [baseline] (50.107 ms) : 0, 50107
AppSec [candidate] (48.627 ms) : 0, 48627
Debugger [baseline] (5.889 ms) : 0, 5889
Debugger [candidate] (5.893 ms) : 0, 5893
Remote Config [baseline] (596.627 µs) : 0, 597
Remote Config [candidate] (591.328 µs) : 0, 591
Telemetry [baseline] (7.855 ms) : 0, 7855
Telemetry [candidate] (7.903 ms) : 0, 7903
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (799.994 ms) : 0, 799994
BytebuddyAgent [candidate] (805.875 ms) : 0, 805875
GlobalTracer [baseline] (231.088 ms) : 0, 231088
GlobalTracer [candidate] (231.823 ms) : 0, 231823
IAST [baseline] (24.046 ms) : 0, 24046
IAST [candidate] (23.155 ms) : 0, 23155
AppSec [baseline] (54.553 ms) : 0, 54553
AppSec [candidate] (55.389 ms) : 0, 55389
Debugger [baseline] (5.973 ms) : 0, 5973
Debugger [candidate] (5.998 ms) : 0, 5998
Remote Config [baseline] (602.811 µs) : 0, 603
Remote Config [candidate] (620.346 µs) : 0, 620
Telemetry [baseline] (7.825 ms) : 0, 7825
Telemetry [candidate] (7.859 ms) : 0, 7859
Loading
Startup time reports for petclinic
gantt
    title petclinic - global startup overhead: candidate=1.50.0-SNAPSHOT~8cce2a9f41, baseline=1.50.0-SNAPSHOT~ad6d5fef42

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.033 s) : 0, 1033385
Total [baseline] (10.534 s) : 0, 10534463
Agent [candidate] (1.026 s) : 0, 1025689
Total [candidate] (10.517 s) : 0, 10517098
section appsec
Agent [baseline] (1.164 s) : 0, 1163907
Total [baseline] (10.705 s) : 0, 10705446
Agent [candidate] (1.164 s) : 0, 1164305
Total [candidate] (10.718 s) : 0, 10717805
section iast
Agent [baseline] (1.159 s) : 0, 1159114
Total [baseline] (10.937 s) : 0, 10937077
Agent [candidate] (1.16 s) : 0, 1159855
Total [candidate] (10.976 s) : 0, 10975852
section profiling
Agent [baseline] (1.281 s) : 0, 1281139
Total [baseline] (10.902 s) : 0, 10901793
Agent [candidate] (1.27 s) : 0, 1270247
Total [candidate] (10.91 s) : 0, 10909508
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.033 s -
Agent appsec 1.164 s 130.522 ms (12.6%)
Agent iast 1.159 s 125.729 ms (12.2%)
Agent profiling 1.281 s 247.754 ms (24.0%)
Total tracing 10.534 s -
Total appsec 10.705 s 170.983 ms (1.6%)
Total iast 10.937 s 402.614 ms (3.8%)
Total profiling 10.902 s 367.33 ms (3.5%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.026 s -
Agent appsec 1.164 s 138.616 ms (13.5%)
Agent iast 1.16 s 134.166 ms (13.1%)
Agent profiling 1.27 s 244.558 ms (23.8%)
Total tracing 10.517 s -
Total appsec 10.718 s 200.707 ms (1.9%)
Total iast 10.976 s 458.754 ms (4.4%)
Total profiling 10.91 s 392.41 ms (3.7%)
gantt
    title petclinic - break down per module: candidate=1.50.0-SNAPSHOT~8cce2a9f41, baseline=1.50.0-SNAPSHOT~ad6d5fef42

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (691.787 ms) : 0, 691787
BytebuddyAgent [candidate] (687.378 ms) : 0, 687378
GlobalTracer [baseline] (242.6 ms) : 0, 242600
GlobalTracer [candidate] (240.762 ms) : 0, 240762
AppSec [baseline] (55.795 ms) : 0, 55795
AppSec [candidate] (55.367 ms) : 0, 55367
Debugger [baseline] (6.378 ms) : 0, 6378
Debugger [candidate] (7.642 ms) : 0, 7642
Remote Config [baseline] (721.479 µs) : 0, 721
Remote Config [candidate] (709.321 µs) : 0, 709
Telemetry [baseline] (12.351 ms) : 0, 12351
Telemetry [candidate] (9.998 ms) : 0, 9998
section appsec
BytebuddyAgent [baseline] (702.487 ms) : 0, 702487
BytebuddyAgent [candidate] (702.6 ms) : 0, 702600
GlobalTracer [baseline] (237.294 ms) : 0, 237294
GlobalTracer [candidate] (237.096 ms) : 0, 237096
AppSec [baseline] (175.686 ms) : 0, 175686
AppSec [candidate] (175.904 ms) : 0, 175904
Debugger [baseline] (5.971 ms) : 0, 5971
Debugger [candidate] (5.923 ms) : 0, 5923
Remote Config [baseline] (623.593 µs) : 0, 624
Remote Config [candidate] (621.276 µs) : 0, 621
Telemetry [baseline] (7.423 ms) : 0, 7423
Telemetry [candidate] (7.735 ms) : 0, 7735
IAST [baseline] (21.633 ms) : 0, 21633
IAST [candidate] (21.724 ms) : 0, 21724
section iast
BytebuddyAgent [baseline] (809.43 ms) : 0, 809430
BytebuddyAgent [candidate] (809.412 ms) : 0, 809412
GlobalTracer [baseline] (232.151 ms) : 0, 232151
GlobalTracer [candidate] (232.941 ms) : 0, 232941
AppSec [baseline] (51.432 ms) : 0, 51432
AppSec [candidate] (49.12 ms) : 0, 49120
Debugger [baseline] (5.965 ms) : 0, 5965
Debugger [candidate] (5.978 ms) : 0, 5978
Remote Config [baseline] (607.817 µs) : 0, 608
Remote Config [candidate] (622.711 µs) : 0, 623
Telemetry [baseline] (7.954 ms) : 0, 7954
Telemetry [candidate] (7.994 ms) : 0, 7994
IAST [baseline] (26.992 ms) : 0, 26992
IAST [candidate] (29.405 ms) : 0, 29405
section profiling
ProfilingAgent [baseline] (109.397 ms) : 0, 109397
ProfilingAgent [candidate] (106.538 ms) : 0, 106538
BytebuddyAgent [baseline] (673.206 ms) : 0, 673206
BytebuddyAgent [candidate] (675.221 ms) : 0, 675221
GlobalTracer [baseline] (378.396 ms) : 0, 378396
GlobalTracer [candidate] (360.404 ms) : 0, 360404
AppSec [baseline] (54.617 ms) : 0, 54617
AppSec [candidate] (61.944 ms) : 0, 61944
Debugger [baseline] (6.153 ms) : 0, 6153
Debugger [candidate] (6.234 ms) : 0, 6234
Remote Config [baseline] (655.447 µs) : 0, 655
Remote Config [candidate] (643.188 µs) : 0, 643
Telemetry [baseline] (8.101 ms) : 0, 8101
Telemetry [candidate] (8.22 ms) : 0, 8220
Profiling [baseline] (109.422 ms) : 0, 109422
Profiling [candidate] (106.563 ms) : 0, 106563
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
end_time 2025-05-25T04:41:50 2025-05-25T04:49:35
git_branch master ci/update-gradle-dependencies-20250525
git_commit_date 1746789389 1748147226
git_commit_sha ad6d5fe 8cce2a9
release_version 1.50.0-SNAPSHOT~ad6d5fef42 1.50.0-SNAPSHOT~8cce2a9f41
start_time 2025-05-25T04:41:35 2025-05-25T04:49:20
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1748148974 1748148974
ci_job_id 953379323 953379323
ci_pipeline_id 66059377 66059377
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-6b4twteb-project-304-concurrent-2-o7zlrijl 6.8.0-1029-aws #31~22.04.1-Ubuntu SMP Thu Apr 24 21:16:18 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-6b4twteb-project-304-concurrent-2-o7zlrijl 6.8.0-1029-aws #31~22.04.1-Ubuntu SMP Thu Apr 24 21:16:18 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 18 unstable metrics.

Request duration reports for petclinic
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.50.0-SNAPSHOT~8cce2a9f41, baseline=1.50.0-SNAPSHOT~ad6d5fef42
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.378 ms) : 1358, 1397
.   : milestone, 1378,
appsec (1.732 ms) : 1707, 1756
.   : milestone, 1732,
appsec_no_iast (1.738 ms) : 1714, 1762
.   : milestone, 1738,
code_origins (1.663 ms) : 1636, 1691
.   : milestone, 1663,
iast (1.507 ms) : 1483, 1531
.   : milestone, 1507,
profiling (1.55 ms) : 1526, 1575
.   : milestone, 1550,
tracing (1.49 ms) : 1466, 1515
.   : milestone, 1490,
section candidate
no_agent (1.368 ms) : 1348, 1387
.   : milestone, 1368,
appsec (1.725 ms) : 1702, 1748
.   : milestone, 1725,
appsec_no_iast (1.727 ms) : 1702, 1751
.   : milestone, 1727,
code_origins (1.674 ms) : 1647, 1700
.   : milestone, 1674,
iast (1.517 ms) : 1492, 1541
.   : milestone, 1517,
profiling (1.569 ms) : 1545, 1593
.   : milestone, 1569,
tracing (1.494 ms) : 1471, 1516
.   : milestone, 1494,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.378 ms [1.358 ms, 1.397 ms] -
appsec 1.732 ms [1.707 ms, 1.756 ms] 353.836 µs (25.7%)
appsec_no_iast 1.738 ms [1.714 ms, 1.762 ms] 360.501 µs (26.2%)
code_origins 1.663 ms [1.636 ms, 1.691 ms] 285.376 µs (20.7%)
iast 1.507 ms [1.483 ms, 1.531 ms] 129.42 µs (9.4%)
profiling 1.55 ms [1.526 ms, 1.575 ms] 172.728 µs (12.5%)
tracing 1.49 ms [1.466 ms, 1.515 ms] 112.42 µs (8.2%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.368 ms [1.348 ms, 1.387 ms] -
appsec 1.725 ms [1.702 ms, 1.748 ms] 357.489 µs (26.1%)
appsec_no_iast 1.727 ms [1.702 ms, 1.751 ms] 359.18 µs (26.3%)
code_origins 1.674 ms [1.647 ms, 1.7 ms] 306.013 µs (22.4%)
iast 1.517 ms [1.492 ms, 1.541 ms] 148.996 µs (10.9%)
profiling 1.569 ms [1.545 ms, 1.593 ms] 201.687 µs (14.7%)
tracing 1.494 ms [1.471 ms, 1.516 ms] 126.023 µs (9.2%)
Request duration reports for insecure-bank
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.50.0-SNAPSHOT~8cce2a9f41, baseline=1.50.0-SNAPSHOT~ad6d5fef42
    dateFormat X
    axisFormat %s
section baseline
no_agent (379.811 µs) : 360, 399
.   : milestone, 380,
iast (523.099 µs) : 501, 545
.   : milestone, 523,
iast_FULL (734.667 µs) : 713, 756
.   : milestone, 735,
iast_GLOBAL (556.423 µs) : 534, 578
.   : milestone, 556,
iast_HARDCODED_SECRET_DISABLED (517.111 µs) : 495, 539
.   : milestone, 517,
iast_INACTIVE (460.086 µs) : 438, 482
.   : milestone, 460,
iast_TELEMETRY_OFF (511.116 µs) : 488, 535
.   : milestone, 511,
tracing (459.726 µs) : 438, 482
.   : milestone, 460,
section candidate
no_agent (393.562 µs) : 373, 414
.   : milestone, 394,
iast (524.964 µs) : 503, 547
.   : milestone, 525,
iast_FULL (740.661 µs) : 719, 763
.   : milestone, 741,
iast_GLOBAL (562.794 µs) : 541, 584
.   : milestone, 563,
iast_HARDCODED_SECRET_DISABLED (515.614 µs) : 492, 539
.   : milestone, 516,
iast_INACTIVE (458.346 µs) : 436, 480
.   : milestone, 458,
iast_TELEMETRY_OFF (516.282 µs) : 493, 540
.   : milestone, 516,
tracing (463.05 µs) : 441, 485
.   : milestone, 463,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 379.811 µs [360.138 µs, 399.484 µs] -
iast 523.099 µs [501.448 µs, 544.751 µs] 143.288 µs (37.7%)
iast_FULL 734.667 µs [713.009 µs, 756.324 µs] 354.856 µs (93.4%)
iast_GLOBAL 556.423 µs [534.387 µs, 578.46 µs] 176.612 µs (46.5%)
iast_HARDCODED_SECRET_DISABLED 517.111 µs [495.179 µs, 539.043 µs] 137.3 µs (36.1%)
iast_INACTIVE 460.086 µs [437.869 µs, 482.303 µs] 80.275 µs (21.1%)
iast_TELEMETRY_OFF 511.116 µs [487.578 µs, 534.654 µs] 131.305 µs (34.6%)
tracing 459.726 µs [437.733 µs, 481.72 µs] 79.915 µs (21.0%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 393.562 µs [373.227 µs, 413.897 µs] -
iast 524.964 µs [502.907 µs, 547.021 µs] 131.402 µs (33.4%)
iast_FULL 740.661 µs [718.716 µs, 762.606 µs] 347.099 µs (88.2%)
iast_GLOBAL 562.794 µs [541.256 µs, 584.332 µs] 169.232 µs (43.0%)
iast_HARDCODED_SECRET_DISABLED 515.614 µs [492.423 µs, 538.806 µs] 122.052 µs (31.0%)
iast_INACTIVE 458.346 µs [436.5 µs, 480.192 µs] 64.783 µs (16.5%)
iast_TELEMETRY_OFF 516.282 µs [492.993 µs, 539.57 µs] 122.719 µs (31.2%)
tracing 463.05 µs [440.659 µs, 485.441 µs] 69.488 µs (17.7%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master ci/update-gradle-dependencies-20250525
git_commit_date 1746789389 1748147226
git_commit_sha ad6d5fe 8cce2a9
release_version 1.50.0-SNAPSHOT~ad6d5fef42 1.50.0-SNAPSHOT~8cce2a9f41
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1748149480 1748149480
ci_job_id 953379324 953379324
ci_pipeline_id 66059377 66059377
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-7thvzwbb-project-304-concurrent-0-x685b081 6.8.0-1029-aws #31~22.04.1-Ubuntu SMP Thu Apr 24 21:16:18 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-7thvzwbb-project-304-concurrent-0-x685b081 6.8.0-1029-aws #31~22.04.1-Ubuntu SMP Thu Apr 24 21:16:18 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
variant appsec appsec

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for biojava
gantt
    title biojava - execution time [CI 0.99] : candidate=1.50.0-SNAPSHOT~8cce2a9f41, baseline=1.50.0-SNAPSHOT~ad6d5fef42
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.436 s) : 15436000, 15436000
.   : milestone, 15436000,
appsec (15.053 s) : 15053000, 15053000
.   : milestone, 15053000,
iast (19.004 s) : 19004000, 19004000
.   : milestone, 19004000,
iast_GLOBAL (18.34 s) : 18340000, 18340000
.   : milestone, 18340000,
profiling (14.712 s) : 14712000, 14712000
.   : milestone, 14712000,
tracing (15.182 s) : 15182000, 15182000
.   : milestone, 15182000,
section candidate
no_agent (15.134 s) : 15134000, 15134000
.   : milestone, 15134000,
appsec (14.987 s) : 14987000, 14987000
.   : milestone, 14987000,
iast (18.561 s) : 18561000, 18561000
.   : milestone, 18561000,
iast_GLOBAL (18.145 s) : 18145000, 18145000
.   : milestone, 18145000,
profiling (15.008 s) : 15008000, 15008000
.   : milestone, 15008000,
tracing (15.038 s) : 15038000, 15038000
.   : milestone, 15038000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.436 s [15.436 s, 15.436 s] -
appsec 15.053 s [15.053 s, 15.053 s] -383.0 ms (-2.5%)
iast 19.004 s [19.004 s, 19.004 s] 3.568 s (23.1%)
iast_GLOBAL 18.34 s [18.34 s, 18.34 s] 2.904 s (18.8%)
profiling 14.712 s [14.712 s, 14.712 s] -724.0 ms (-4.7%)
tracing 15.182 s [15.182 s, 15.182 s] -254.0 ms (-1.6%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.134 s [15.134 s, 15.134 s] -
appsec 14.987 s [14.987 s, 14.987 s] -147.0 ms (-1.0%)
iast 18.561 s [18.561 s, 18.561 s] 3.427 s (22.6%)
iast_GLOBAL 18.145 s [18.145 s, 18.145 s] 3.011 s (19.9%)
profiling 15.008 s [15.008 s, 15.008 s] -126.0 ms (-0.8%)
tracing 15.038 s [15.038 s, 15.038 s] -96.0 ms (-0.6%)
Execution time for tomcat
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.50.0-SNAPSHOT~8cce2a9f41, baseline=1.50.0-SNAPSHOT~ad6d5fef42
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.483 ms) : 1471, 1495
.   : milestone, 1483,
appsec (2.421 ms) : 2372, 2470
.   : milestone, 2421,
iast (2.193 ms) : 2131, 2256
.   : milestone, 2193,
iast_GLOBAL (2.235 ms) : 2173, 2296
.   : milestone, 2235,
profiling (2.055 ms) : 2005, 2105
.   : milestone, 2055,
tracing (2.014 ms) : 1966, 2061
.   : milestone, 2014,
section candidate
no_agent (1.484 ms) : 1472, 1496
.   : milestone, 1484,
appsec (2.421 ms) : 2371, 2470
.   : milestone, 2421,
iast (2.209 ms) : 2147, 2271
.   : milestone, 2209,
iast_GLOBAL (2.244 ms) : 2182, 2306
.   : milestone, 2244,
profiling (2.041 ms) : 1992, 2090
.   : milestone, 2041,
tracing (2.023 ms) : 1975, 2070
.   : milestone, 2023,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.483 ms [1.471 ms, 1.495 ms] -
appsec 2.421 ms [2.372 ms, 2.47 ms] 938.062 µs (63.3%)
iast 2.193 ms [2.131 ms, 2.256 ms] 710.48 µs (47.9%)
iast_GLOBAL 2.235 ms [2.173 ms, 2.296 ms] 751.78 µs (50.7%)
profiling 2.055 ms [2.005 ms, 2.105 ms] 572.305 µs (38.6%)
tracing 2.014 ms [1.966 ms, 2.061 ms] 531.056 µs (35.8%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.484 ms [1.472 ms, 1.496 ms] -
appsec 2.421 ms [2.371 ms, 2.47 ms] 936.549 µs (63.1%)
iast 2.209 ms [2.147 ms, 2.271 ms] 724.849 µs (48.8%)
iast_GLOBAL 2.244 ms [2.182 ms, 2.306 ms] 760.267 µs (51.2%)
profiling 2.041 ms [1.992 ms, 2.09 ms] 556.864 µs (37.5%)
tracing 2.023 ms [1.975 ms, 2.07 ms] 538.486 µs (36.3%)

@pr-commenter
Copy link

pr-commenter bot commented May 25, 2025

Kafka / producer-benchmark

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master ci/update-gradle-dependencies-20250525
git_commit_date 1748100937 1748147264
git_commit_sha c62a6fc d0ad6ba
See matching parameters
Baseline Candidate
ci_job_date 1748148527 1748148527
ci_job_id 953381532 953381532
ci_pipeline_id 66059391 66059391
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
jdkVersion 11.0.25 11.0.25
jmhVersion 1.36 1.36
jvm /usr/lib/jvm/java-11-openjdk-amd64/bin/java /usr/lib/jvm/java-11-openjdk-amd64/bin/java
jvmArgs -Dfile.encoding=UTF-8 -Djava.io.tmpdir=/go/src/github.com/DataDog/apm-reliability/dd-trace-java/platform/src/producer-benchmark/build/tmp/jmh -Duser.country=US -Duser.language=en -Duser.variant -Dfile.encoding=UTF-8 -Djava.io.tmpdir=/go/src/github.com/DataDog/apm-reliability/dd-trace-java/platform/src/producer-benchmark/build/tmp/jmh -Duser.country=US -Duser.language=en -Duser.variant
vmName OpenJDK 64-Bit Server VM OpenJDK 64-Bit Server VM
vmVersion 11.0.25+9-post-Ubuntu-1ubuntu122.04 11.0.25+9-post-Ubuntu-1ubuntu122.04

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 3 metrics, 0 unstable metrics.

See unchanged results
scenario Δ mean throughput
scenario:not-instrumented/KafkaProduceBenchmark.benchProduce unsure
[-54602.792op/s; -7344.235op/s] or [-2.973%; -0.400%]
scenario:only-tracing-dsm-disabled-benchmarks/KafkaProduceBenchmark.benchProduce same
scenario:only-tracing-dsm-enabled-benchmarks/KafkaProduceBenchmark.benchProduce same

@pr-commenter
Copy link

pr-commenter bot commented May 25, 2025

Kafka / consumer-benchmark

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master ci/update-gradle-dependencies-20250525
git_commit_date 1748100937 1748147252
git_commit_sha c62a6fc ae2a598
See matching parameters
Baseline Candidate
ci_job_date 1748148581 1748148581
ci_job_id 953380913 953380913
ci_pipeline_id 66059387 66059387
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
jdkVersion 11.0.25 11.0.25
jmhVersion 1.36 1.36
jvm /usr/lib/jvm/java-11-openjdk-amd64/bin/java /usr/lib/jvm/java-11-openjdk-amd64/bin/java
jvmArgs -Dfile.encoding=UTF-8 -Djava.io.tmpdir=/go/src/github.com/DataDog/apm-reliability/dd-trace-java/platform/src/consumer-benchmark/build/tmp/jmh -Duser.country=US -Duser.language=en -Duser.variant -Dfile.encoding=UTF-8 -Djava.io.tmpdir=/go/src/github.com/DataDog/apm-reliability/dd-trace-java/platform/src/consumer-benchmark/build/tmp/jmh -Duser.country=US -Duser.language=en -Duser.variant
vmName OpenJDK 64-Bit Server VM OpenJDK 64-Bit Server VM
vmVersion 11.0.25+9-post-Ubuntu-1ubuntu122.04 11.0.25+9-post-Ubuntu-1ubuntu122.04

Summary

Found 1 performance improvements and 1 performance regressions! Performance is the same for 1 metrics, 0 unstable metrics.

scenario Δ mean throughput
scenario:not-instrumented/KafkaConsumerBenchmark.benchConsume worse
[-14911.261op/s; -3634.223op/s] or [-4.994%; -1.217%]
scenario:only-tracing-dsm-disabled-benchmarks/KafkaConsumerBenchmark.benchConsume better
[+6628.290op/s; +16685.269op/s] or [+2.170%; +5.463%]
See unchanged results
scenario Δ mean throughput
scenario:only-tracing-dsm-enabled-benchmarks/KafkaConsumerBenchmark.benchConsume same

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
tag: dependencies Dependencies related changes tag: no release notes Changes to exclude from release notes
Projects
None yet
Development

Successfully merging this pull request may close these issues.

0 participants