Skip to content

Use JDK 8 by default #8883

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Draft
wants to merge 5 commits into
base: master
Choose a base branch
from
Draft

Use JDK 8 by default #8883

wants to merge 5 commits into from

Conversation

smola
Copy link
Member

@smola smola commented May 26, 2025

What Does This Do

Use JDK 8 by default, explicitly, to allow running gradle with newer JDKs.

Motivation

Additional Notes

Contributor Checklist

Jira ticket: APMJAVA-1342

@smola smola added tag: no release notes Changes to exclude from release notes comp: tooling Build & Tooling labels May 26, 2025
@pr-commenter
Copy link

pr-commenter bot commented May 26, 2025

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master smola/gradle-3-toolchain8
git_commit_date 1746789389 1748253874
git_commit_sha ad6d5fe 5e7ffc4
release_version 1.50.0-SNAPSHOT~ad6d5fef42 1.50.0-SNAPSHOT~5e7ffc43ea
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1748256320 1748256320
ci_job_id 953829123 953829123
ci_pipeline_id 66094629 66094629
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-6b4twteb-project-304-concurrent-0-mez2w76p 6.8.0-1029-aws #31~22.04.1-Ubuntu SMP Thu Apr 24 21:16:18 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-6b4twteb-project-304-concurrent-0-mez2w76p 6.8.0-1029-aws #31~22.04.1-Ubuntu SMP Thu Apr 24 21:16:18 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None
variant iast iast

Summary

Found 3 performance improvements and 2 performance regressions! Performance is the same for 55 metrics, 11 unstable metrics.

scenario Δ mean execution_time candidate mean execution_time baseline mean execution_time
scenario:startup:insecure-bank:tracing:Remote Config worse
[+23.086µs; +71.597µs] or [+3.341%; +10.361%]
738.343µs 691.001µs
scenario:startup:petclinic:profiling:ProfilingAgent better
[-9.327ms; -2.458ms] or [-8.428%; -2.221%]
104.778ms 110.670ms
scenario:startup:petclinic:profiling:GlobalTracer better
[-23.850ms; -10.498ms] or [-6.274%; -2.761%]
362.973ms 380.147ms
scenario:startup:petclinic:profiling:AppSec worse
[+5.447ms; +9.421ms] or [+9.895%; +17.114%]
62.478ms 55.044ms
scenario:startup:petclinic:profiling:Profiling better
[-9.328ms; -2.459ms] or [-8.427%; -2.221%]
104.802ms 110.696ms
Startup time reports for petclinic
gantt
    title petclinic - global startup overhead: candidate=1.50.0-SNAPSHOT~5e7ffc43ea, baseline=1.50.0-SNAPSHOT~ad6d5fef42

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.023 s) : 0, 1023343
Total [baseline] (10.523 s) : 0, 10522853
Agent [candidate] (1.021 s) : 0, 1021355
Total [candidate] (10.503 s) : 0, 10503393
section appsec
Agent [baseline] (1.167 s) : 0, 1166801
Total [baseline] (10.731 s) : 0, 10730734
Agent [candidate] (1.165 s) : 0, 1164571
Total [candidate] (10.694 s) : 0, 10694455
section iast
Agent [baseline] (1.15 s) : 0, 1150097
Total [baseline] (10.814 s) : 0, 10813757
Agent [candidate] (1.153 s) : 0, 1152950
Total [candidate] (10.853 s) : 0, 10852651
section profiling
Agent [baseline] (1.287 s) : 0, 1286865
Total [baseline] (10.851 s) : 0, 10851331
Agent [candidate] (1.28 s) : 0, 1280449
Total [candidate] (10.82 s) : 0, 10820020
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.023 s -
Agent appsec 1.167 s 143.458 ms (14.0%)
Agent iast 1.15 s 126.754 ms (12.4%)
Agent profiling 1.287 s 263.522 ms (25.8%)
Total tracing 10.523 s -
Total appsec 10.731 s 207.881 ms (2.0%)
Total iast 10.814 s 290.904 ms (2.8%)
Total profiling 10.851 s 328.477 ms (3.1%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.021 s -
Agent appsec 1.165 s 143.217 ms (14.0%)
Agent iast 1.153 s 131.595 ms (12.9%)
Agent profiling 1.28 s 259.095 ms (25.4%)
Total tracing 10.503 s -
Total appsec 10.694 s 191.062 ms (1.8%)
Total iast 10.853 s 349.259 ms (3.3%)
Total profiling 10.82 s 316.627 ms (3.0%)
gantt
    title petclinic - break down per module: candidate=1.50.0-SNAPSHOT~5e7ffc43ea, baseline=1.50.0-SNAPSHOT~ad6d5fef42

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (683.285 ms) : 0, 683285
BytebuddyAgent [candidate] (683.54 ms) : 0, 683540
GlobalTracer [baseline] (240.314 ms) : 0, 240314
GlobalTracer [candidate] (240.639 ms) : 0, 240639
AppSec [baseline] (55.169 ms) : 0, 55169
AppSec [candidate] (56.038 ms) : 0, 56038
Debugger [baseline] (12.008 ms) : 0, 12008
Debugger [candidate] (6.881 ms) : 0, 6881
Remote Config [baseline] (674.259 µs) : 0, 674
Remote Config [candidate] (722.624 µs) : 0, 723
Telemetry [baseline] (8.215 ms) : 0, 8215
Telemetry [candidate] (9.937 ms) : 0, 9937
section appsec
BytebuddyAgent [baseline] (703.13 ms) : 0, 703130
BytebuddyAgent [candidate] (702.6 ms) : 0, 702600
GlobalTracer [baseline] (238.084 ms) : 0, 238084
GlobalTracer [candidate] (237.458 ms) : 0, 237458
IAST [baseline] (22.166 ms) : 0, 22166
IAST [candidate] (21.816 ms) : 0, 21816
AppSec [baseline] (175.961 ms) : 0, 175961
AppSec [candidate] (175.911 ms) : 0, 175911
Debugger [baseline] (6.011 ms) : 0, 6011
Debugger [candidate] (5.988 ms) : 0, 5988
Remote Config [baseline] (626.358 µs) : 0, 626
Remote Config [candidate] (626.687 µs) : 0, 627
Telemetry [baseline] (8.196 ms) : 0, 8196
Telemetry [candidate] (7.414 ms) : 0, 7414
section iast
BytebuddyAgent [baseline] (802.707 ms) : 0, 802707
BytebuddyAgent [candidate] (804.488 ms) : 0, 804488
GlobalTracer [baseline] (230.729 ms) : 0, 230729
GlobalTracer [candidate] (231.57 ms) : 0, 231570
IAST [baseline] (29.211 ms) : 0, 29211
IAST [candidate] (29.384 ms) : 0, 29384
AppSec [baseline] (49.59 ms) : 0, 49590
AppSec [candidate] (49.488 ms) : 0, 49488
Debugger [baseline] (5.866 ms) : 0, 5866
Debugger [candidate] (5.936 ms) : 0, 5936
Remote Config [baseline] (593.346 µs) : 0, 593
Remote Config [candidate] (593.082 µs) : 0, 593
Telemetry [baseline] (7.885 ms) : 0, 7885
Telemetry [candidate] (7.887 ms) : 0, 7887
section profiling
BytebuddyAgent [baseline] (675.539 ms) : 0, 675539
BytebuddyAgent [candidate] (683.305 ms) : 0, 683305
GlobalTracer [baseline] (380.147 ms) : 0, 380147
GlobalTracer [candidate] (362.973 ms) : 0, 362973
AppSec [baseline] (55.044 ms) : 0, 55044
AppSec [candidate] (62.478 ms) : 0, 62478
Debugger [baseline] (6.183 ms) : 0, 6183
Debugger [candidate] (6.337 ms) : 0, 6337
Remote Config [baseline] (670.423 µs) : 0, 670
Remote Config [candidate] (651.05 µs) : 0, 651
Telemetry [baseline] (8.154 ms) : 0, 8154
Telemetry [candidate] (8.368 ms) : 0, 8368
ProfilingAgent [baseline] (110.67 ms) : 0, 110670
ProfilingAgent [candidate] (104.778 ms) : 0, 104778
Profiling [baseline] (110.696 ms) : 0, 110696
Profiling [candidate] (104.802 ms) : 0, 104802
Loading
Startup time reports for insecure-bank
gantt
    title insecure-bank - global startup overhead: candidate=1.50.0-SNAPSHOT~5e7ffc43ea, baseline=1.50.0-SNAPSHOT~ad6d5fef42

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.023 s) : 0, 1022539
Total [baseline] (8.64 s) : 0, 8639567
Agent [candidate] (1.026 s) : 0, 1026313
Total [candidate] (8.642 s) : 0, 8641650
section iast
Agent [baseline] (1.144 s) : 0, 1144049
Total [baseline] (9.215 s) : 0, 9214533
Agent [candidate] (1.153 s) : 0, 1153042
Total [candidate] (9.229 s) : 0, 9228622
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.147 s) : 0, 1146823
Total [baseline] (9.191 s) : 0, 9190702
Agent [candidate] (1.147 s) : 0, 1147322
Total [candidate] (9.141 s) : 0, 9141344
section iast_TELEMETRY_OFF
Agent [baseline] (1.14 s) : 0, 1140132
Total [baseline] (9.201 s) : 0, 9200585
Agent [candidate] (1.156 s) : 0, 1156204
Total [candidate] (9.23 s) : 0, 9230359
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.023 s -
Agent iast 1.144 s 121.51 ms (11.9%)
Agent iast_HARDCODED_SECRET_DISABLED 1.147 s 124.284 ms (12.2%)
Agent iast_TELEMETRY_OFF 1.14 s 117.593 ms (11.5%)
Total tracing 8.64 s -
Total iast 9.215 s 574.966 ms (6.7%)
Total iast_HARDCODED_SECRET_DISABLED 9.191 s 551.135 ms (6.4%)
Total iast_TELEMETRY_OFF 9.201 s 561.018 ms (6.5%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.026 s -
Agent iast 1.153 s 126.729 ms (12.3%)
Agent iast_HARDCODED_SECRET_DISABLED 1.147 s 121.009 ms (11.8%)
Agent iast_TELEMETRY_OFF 1.156 s 129.891 ms (12.7%)
Total tracing 8.642 s -
Total iast 9.229 s 586.972 ms (6.8%)
Total iast_HARDCODED_SECRET_DISABLED 9.141 s 499.694 ms (5.8%)
Total iast_TELEMETRY_OFF 9.23 s 588.709 ms (6.8%)
gantt
    title insecure-bank - break down per module: candidate=1.50.0-SNAPSHOT~5e7ffc43ea, baseline=1.50.0-SNAPSHOT~ad6d5fef42

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (682.649 ms) : 0, 682649
BytebuddyAgent [candidate] (686.708 ms) : 0, 686708
GlobalTracer [baseline] (240.263 ms) : 0, 240263
GlobalTracer [candidate] (241.328 ms) : 0, 241328
AppSec [baseline] (55.223 ms) : 0, 55223
AppSec [candidate] (54.748 ms) : 0, 54748
Debugger [baseline] (11.968 ms) : 0, 11968
Debugger [candidate] (9.217 ms) : 0, 9217
Remote Config [baseline] (691.001 µs) : 0, 691
Remote Config [candidate] (738.343 µs) : 0, 738
Telemetry [baseline] (8.212 ms) : 0, 8212
Telemetry [candidate] (9.837 ms) : 0, 9837
section iast
BytebuddyAgent [baseline] (798.907 ms) : 0, 798907
BytebuddyAgent [candidate] (805.227 ms) : 0, 805227
GlobalTracer [baseline] (229.338 ms) : 0, 229338
GlobalTracer [candidate] (231.657 ms) : 0, 231657
IAST [baseline] (29.814 ms) : 0, 29814
IAST [candidate] (29.945 ms) : 0, 29945
AppSec [baseline] (48.324 ms) : 0, 48324
AppSec [candidate] (48.308 ms) : 0, 48308
Debugger [baseline] (5.849 ms) : 0, 5849
Debugger [candidate] (5.909 ms) : 0, 5909
Remote Config [baseline] (589.2 µs) : 0, 589
Remote Config [candidate] (594.41 µs) : 0, 594
Telemetry [baseline] (7.831 ms) : 0, 7831
Telemetry [candidate] (7.849 ms) : 0, 7849
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (800.177 ms) : 0, 800177
BytebuddyAgent [candidate] (801.166 ms) : 0, 801166
GlobalTracer [baseline] (230.094 ms) : 0, 230094
GlobalTracer [candidate] (230.223 ms) : 0, 230223
IAST [baseline] (29.147 ms) : 0, 29147
IAST [candidate] (28.952 ms) : 0, 28952
AppSec [baseline] (49.466 ms) : 0, 49466
AppSec [candidate] (49.219 ms) : 0, 49219
Debugger [baseline] (5.959 ms) : 0, 5959
Debugger [candidate] (5.862 ms) : 0, 5862
Remote Config [baseline] (604.26 µs) : 0, 604
Remote Config [candidate] (602.554 µs) : 0, 603
Telemetry [baseline] (7.965 ms) : 0, 7965
Telemetry [candidate] (7.863 ms) : 0, 7863
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (795.216 ms) : 0, 795216
BytebuddyAgent [candidate] (806.915 ms) : 0, 806915
GlobalTracer [baseline] (229.477 ms) : 0, 229477
GlobalTracer [candidate] (232.402 ms) : 0, 232402
IAST [baseline] (22.155 ms) : 0, 22155
IAST [candidate] (22.526 ms) : 0, 22526
AppSec [baseline] (55.618 ms) : 0, 55618
AppSec [candidate] (56.166 ms) : 0, 56166
Debugger [baseline] (5.886 ms) : 0, 5886
Debugger [candidate] (6.024 ms) : 0, 6024
Remote Config [baseline] (588.659 µs) : 0, 589
Remote Config [candidate] (612.386 µs) : 0, 612
Telemetry [baseline] (7.762 ms) : 0, 7762
Telemetry [candidate] (7.837 ms) : 0, 7837
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
end_time 2025-05-26T10:15:25 2025-05-26T10:23:10
git_branch master smola/gradle-3-toolchain8
git_commit_date 1746789389 1748253874
git_commit_sha ad6d5fe 5e7ffc4
release_version 1.50.0-SNAPSHOT~ad6d5fef42 1.50.0-SNAPSHOT~5e7ffc43ea
start_time 2025-05-26T10:15:11 2025-05-26T10:22:56
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1748255389 1748255389
ci_job_id 953829124 953829124
ci_pipeline_id 66094629 66094629
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-7thvzwbb-project-304-concurrent-0-bic9nzlt 6.8.0-1029-aws #31~22.04.1-Ubuntu SMP Thu Apr 24 21:16:18 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-7thvzwbb-project-304-concurrent-0-bic9nzlt 6.8.0-1029-aws #31~22.04.1-Ubuntu SMP Thu Apr 24 21:16:18 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 18 unstable metrics.

Request duration reports for petclinic
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.50.0-SNAPSHOT~5e7ffc43ea, baseline=1.50.0-SNAPSHOT~ad6d5fef42
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.362 ms) : 1342, 1383
.   : milestone, 1362,
appsec (1.736 ms) : 1712, 1761
.   : milestone, 1736,
appsec_no_iast (1.739 ms) : 1716, 1763
.   : milestone, 1739,
code_origins (1.657 ms) : 1630, 1684
.   : milestone, 1657,
iast (1.521 ms) : 1496, 1545
.   : milestone, 1521,
profiling (1.503 ms) : 1480, 1527
.   : milestone, 1503,
tracing (1.498 ms) : 1474, 1522
.   : milestone, 1498,
section candidate
no_agent (1.366 ms) : 1346, 1385
.   : milestone, 1366,
appsec (1.749 ms) : 1725, 1772
.   : milestone, 1749,
appsec_no_iast (1.726 ms) : 1702, 1749
.   : milestone, 1726,
code_origins (1.679 ms) : 1653, 1706
.   : milestone, 1679,
iast (1.521 ms) : 1497, 1544
.   : milestone, 1521,
profiling (1.523 ms) : 1499, 1547
.   : milestone, 1523,
tracing (1.486 ms) : 1463, 1509
.   : milestone, 1486,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.362 ms [1.342 ms, 1.383 ms] -
appsec 1.736 ms [1.712 ms, 1.761 ms] 374.222 µs (27.5%)
appsec_no_iast 1.739 ms [1.716 ms, 1.763 ms] 376.984 µs (27.7%)
code_origins 1.657 ms [1.63 ms, 1.684 ms] 294.821 µs (21.6%)
iast 1.521 ms [1.496 ms, 1.545 ms] 158.568 µs (11.6%)
profiling 1.503 ms [1.48 ms, 1.527 ms] 141.385 µs (10.4%)
tracing 1.498 ms [1.474 ms, 1.522 ms] 135.54 µs (10.0%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.366 ms [1.346 ms, 1.385 ms] -
appsec 1.749 ms [1.725 ms, 1.772 ms] 382.94 µs (28.0%)
appsec_no_iast 1.726 ms [1.702 ms, 1.749 ms] 359.999 µs (26.4%)
code_origins 1.679 ms [1.653 ms, 1.706 ms] 313.721 µs (23.0%)
iast 1.521 ms [1.497 ms, 1.544 ms] 154.944 µs (11.3%)
profiling 1.523 ms [1.499 ms, 1.547 ms] 157.302 µs (11.5%)
tracing 1.486 ms [1.463 ms, 1.509 ms] 120.593 µs (8.8%)
Request duration reports for insecure-bank
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.50.0-SNAPSHOT~5e7ffc43ea, baseline=1.50.0-SNAPSHOT~ad6d5fef42
    dateFormat X
    axisFormat %s
section baseline
no_agent (387.113 µs) : 367, 408
.   : milestone, 387,
iast (519.878 µs) : 498, 542
.   : milestone, 520,
iast_FULL (740.205 µs) : 718, 762
.   : milestone, 740,
iast_GLOBAL (568.928 µs) : 547, 591
.   : milestone, 569,
iast_HARDCODED_SECRET_DISABLED (531.829 µs) : 509, 555
.   : milestone, 532,
iast_INACTIVE (470.117 µs) : 447, 493
.   : milestone, 470,
iast_TELEMETRY_OFF (517.85 µs) : 495, 541
.   : milestone, 518,
tracing (458.378 µs) : 436, 481
.   : milestone, 458,
section candidate
no_agent (385.929 µs) : 364, 408
.   : milestone, 386,
iast (517.614 µs) : 494, 541
.   : milestone, 518,
iast_FULL (744.322 µs) : 721, 768
.   : milestone, 744,
iast_GLOBAL (567.781 µs) : 546, 590
.   : milestone, 568,
iast_HARDCODED_SECRET_DISABLED (529.149 µs) : 506, 552
.   : milestone, 529,
iast_INACTIVE (463.016 µs) : 441, 486
.   : milestone, 463,
iast_TELEMETRY_OFF (498.826 µs) : 476, 522
.   : milestone, 499,
tracing (461.888 µs) : 440, 484
.   : milestone, 462,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 387.113 µs [366.6 µs, 407.626 µs] -
iast 519.878 µs [498.124 µs, 541.632 µs] 132.765 µs (34.3%)
iast_FULL 740.205 µs [718.111 µs, 762.3 µs] 353.092 µs (91.2%)
iast_GLOBAL 568.928 µs [546.776 µs, 591.08 µs] 181.815 µs (47.0%)
iast_HARDCODED_SECRET_DISABLED 531.829 µs [508.643 µs, 555.016 µs] 144.717 µs (37.4%)
iast_INACTIVE 470.117 µs [447.309 µs, 492.925 µs] 83.004 µs (21.4%)
iast_TELEMETRY_OFF 517.85 µs [494.635 µs, 541.064 µs] 130.737 µs (33.8%)
tracing 458.378 µs [436.214 µs, 480.542 µs] 71.266 µs (18.4%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 385.929 µs [364.14 µs, 407.718 µs] -
iast 517.614 µs [494.384 µs, 540.844 µs] 131.685 µs (34.1%)
iast_FULL 744.322 µs [720.864 µs, 767.78 µs] 358.393 µs (92.9%)
iast_GLOBAL 567.781 µs [545.652 µs, 589.909 µs] 181.852 µs (47.1%)
iast_HARDCODED_SECRET_DISABLED 529.149 µs [505.892 µs, 552.405 µs] 143.22 µs (37.1%)
iast_INACTIVE 463.016 µs [440.531 µs, 485.502 µs] 77.088 µs (20.0%)
iast_TELEMETRY_OFF 498.826 µs [475.614 µs, 522.038 µs] 112.897 µs (29.3%)
tracing 461.888 µs [439.516 µs, 484.259 µs] 75.959 µs (19.7%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master smola/gradle-3-toolchain8
git_commit_date 1746789389 1748253874
git_commit_sha ad6d5fe 5e7ffc4
release_version 1.50.0-SNAPSHOT~ad6d5fef42 1.50.0-SNAPSHOT~5e7ffc43ea
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1748255929 1748255929
ci_job_id 953829125 953829125
ci_pipeline_id 66094629 66094629
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-6b4twteb-project-304-concurrent-1-u34qmwmc 6.8.0-1029-aws #31~22.04.1-Ubuntu SMP Thu Apr 24 21:16:18 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-6b4twteb-project-304-concurrent-1-u34qmwmc 6.8.0-1029-aws #31~22.04.1-Ubuntu SMP Thu Apr 24 21:16:18 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
variant appsec appsec

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for biojava
gantt
    title biojava - execution time [CI 0.99] : candidate=1.50.0-SNAPSHOT~5e7ffc43ea, baseline=1.50.0-SNAPSHOT~ad6d5fef42
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.053 s) : 15053000, 15053000
.   : milestone, 15053000,
appsec (14.931 s) : 14931000, 14931000
.   : milestone, 14931000,
iast (18.841 s) : 18841000, 18841000
.   : milestone, 18841000,
iast_GLOBAL (18.269 s) : 18269000, 18269000
.   : milestone, 18269000,
profiling (14.874 s) : 14874000, 14874000
.   : milestone, 14874000,
tracing (14.871 s) : 14871000, 14871000
.   : milestone, 14871000,
section candidate
no_agent (14.965 s) : 14965000, 14965000
.   : milestone, 14965000,
appsec (15.076 s) : 15076000, 15076000
.   : milestone, 15076000,
iast (18.829 s) : 18829000, 18829000
.   : milestone, 18829000,
iast_GLOBAL (18.061 s) : 18061000, 18061000
.   : milestone, 18061000,
profiling (14.976 s) : 14976000, 14976000
.   : milestone, 14976000,
tracing (14.7 s) : 14700000, 14700000
.   : milestone, 14700000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.053 s [15.053 s, 15.053 s] -
appsec 14.931 s [14.931 s, 14.931 s] -122.0 ms (-0.8%)
iast 18.841 s [18.841 s, 18.841 s] 3.788 s (25.2%)
iast_GLOBAL 18.269 s [18.269 s, 18.269 s] 3.216 s (21.4%)
profiling 14.874 s [14.874 s, 14.874 s] -179.0 ms (-1.2%)
tracing 14.871 s [14.871 s, 14.871 s] -182.0 ms (-1.2%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.965 s [14.965 s, 14.965 s] -
appsec 15.076 s [15.076 s, 15.076 s] 111.0 ms (0.7%)
iast 18.829 s [18.829 s, 18.829 s] 3.864 s (25.8%)
iast_GLOBAL 18.061 s [18.061 s, 18.061 s] 3.096 s (20.7%)
profiling 14.976 s [14.976 s, 14.976 s] 11.0 ms (0.1%)
tracing 14.7 s [14.7 s, 14.7 s] -265.0 ms (-1.8%)
Execution time for tomcat
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.50.0-SNAPSHOT~5e7ffc43ea, baseline=1.50.0-SNAPSHOT~ad6d5fef42
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.484 ms) : 1473, 1496
.   : milestone, 1484,
appsec (2.408 ms) : 2359, 2457
.   : milestone, 2408,
iast (2.193 ms) : 2132, 2254
.   : milestone, 2193,
iast_GLOBAL (2.227 ms) : 2165, 2288
.   : milestone, 2227,
profiling (2.029 ms) : 1980, 2078
.   : milestone, 2029,
tracing (2.02 ms) : 1972, 2068
.   : milestone, 2020,
section candidate
no_agent (1.476 ms) : 1464, 1487
.   : milestone, 1476,
appsec (2.416 ms) : 2367, 2465
.   : milestone, 2416,
iast (2.182 ms) : 2121, 2244
.   : milestone, 2182,
iast_GLOBAL (2.224 ms) : 2163, 2286
.   : milestone, 2224,
profiling (2.472 ms) : 2239, 2705
.   : milestone, 2472,
tracing (2.007 ms) : 1959, 2054
.   : milestone, 2007,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.484 ms [1.473 ms, 1.496 ms] -
appsec 2.408 ms [2.359 ms, 2.457 ms] 923.697 µs (62.2%)
iast 2.193 ms [2.132 ms, 2.254 ms] 708.798 µs (47.8%)
iast_GLOBAL 2.227 ms [2.165 ms, 2.288 ms] 742.583 µs (50.0%)
profiling 2.029 ms [1.98 ms, 2.078 ms] 545.111 µs (36.7%)
tracing 2.02 ms [1.972 ms, 2.068 ms] 536.079 µs (36.1%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.476 ms [1.464 ms, 1.487 ms] -
appsec 2.416 ms [2.367 ms, 2.465 ms] 939.968 µs (63.7%)
iast 2.182 ms [2.121 ms, 2.244 ms] 706.534 µs (47.9%)
iast_GLOBAL 2.224 ms [2.163 ms, 2.286 ms] 748.605 µs (50.7%)
profiling 2.472 ms [2.239 ms, 2.705 ms] 996.058 µs (67.5%)
tracing 2.007 ms [1.959 ms, 2.054 ms] 530.742 µs (36.0%)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
comp: tooling Build & Tooling tag: no release notes Changes to exclude from release notes
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant