-
Notifications
You must be signed in to change notification settings - Fork 304
Add testing for latest stable version (JDK 24) #8875
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Draft
sarahchen6
wants to merge
3
commits into
master
Choose a base branch
from
sarahchen6/add-jdk-24-testing
base: master
Could not load branches
Branch not found: {{ refName }}
Loading
Could not load tags
Nothing to show
Loading
Are you sure you want to change the base?
Some commits from the old base branch may be removed from the timeline,
and old review comments may become outdated.
Draft
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
BenchmarksStartupParameters
See matching parameters
SummaryFound 0 performance improvements and 0 performance regressions! Performance is the same for 58 metrics, 13 unstable metrics. Startup time reports for insecure-bankgantt
title insecure-bank - global startup overhead: candidate=1.50.0-SNAPSHOT~c7ee38f9a8, baseline=1.50.0-SNAPSHOT~7787af738f
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (1.021 s) : 0, 1020579
Total [baseline] (8.501 s) : 0, 8500823
Agent [candidate] (1.025 s) : 0, 1025036
Total [candidate] (8.541 s) : 0, 8540846
section iast
Agent [baseline] (1.149 s) : 0, 1148962
Total [baseline] (9.217 s) : 0, 9216732
Agent [candidate] (1.149 s) : 0, 1148898
Total [candidate] (9.191 s) : 0, 9191169
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.153 s) : 0, 1153018
Total [baseline] (9.132 s) : 0, 9132162
Agent [candidate] (1.15 s) : 0, 1150171
Total [candidate] (9.145 s) : 0, 9144767
section iast_TELEMETRY_OFF
Agent [baseline] (1.153 s) : 0, 1153076
Total [baseline] (9.204 s) : 0, 9203620
Agent [candidate] (1.156 s) : 0, 1155994
Total [candidate] (9.235 s) : 0, 9235463
gantt
title insecure-bank - break down per module: candidate=1.50.0-SNAPSHOT~c7ee38f9a8, baseline=1.50.0-SNAPSHOT~7787af738f
dateFormat X
axisFormat %s
section tracing
BytebuddyAgent [baseline] (681.663 ms) : 0, 681663
BytebuddyAgent [candidate] (683.738 ms) : 0, 683738
GlobalTracer [baseline] (239.553 ms) : 0, 239553
GlobalTracer [candidate] (241.038 ms) : 0, 241038
AppSec [baseline] (57.809 ms) : 0, 57809
AppSec [candidate] (56.432 ms) : 0, 56432
Debugger [baseline] (6.149 ms) : 0, 6149
Debugger [candidate] (6.235 ms) : 0, 6235
Remote Config [baseline] (721.143 µs) : 0, 721
Remote Config [candidate] (738.674 µs) : 0, 739
Telemetry [baseline] (11.204 ms) : 0, 11204
Telemetry [candidate] (13.359 ms) : 0, 13359
section iast
BytebuddyAgent [baseline] (800.915 ms) : 0, 800915
BytebuddyAgent [candidate] (801.278 ms) : 0, 801278
GlobalTracer [baseline] (230.319 ms) : 0, 230319
GlobalTracer [candidate] (230.941 ms) : 0, 230941
IAST [baseline] (27.674 ms) : 0, 27674
IAST [candidate] (26.787 ms) : 0, 26787
AppSec [baseline] (51.982 ms) : 0, 51982
AppSec [candidate] (52.062 ms) : 0, 52062
Debugger [baseline] (5.982 ms) : 0, 5982
Debugger [candidate] (5.947 ms) : 0, 5947
Remote Config [baseline] (604.375 µs) : 0, 604
Remote Config [candidate] (593.437 µs) : 0, 593
Telemetry [baseline] (7.993 ms) : 0, 7993
Telemetry [candidate] (7.87 ms) : 0, 7870
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (804.243 ms) : 0, 804243
BytebuddyAgent [candidate] (801.485 ms) : 0, 801485
GlobalTracer [baseline] (231.095 ms) : 0, 231095
GlobalTracer [candidate] (230.542 ms) : 0, 230542
IAST [baseline] (29.377 ms) : 0, 29377
IAST [candidate] (26.301 ms) : 0, 26301
AppSec [baseline] (50.234 ms) : 0, 50234
AppSec [candidate] (53.768 ms) : 0, 53768
Debugger [baseline] (5.982 ms) : 0, 5982
Debugger [candidate] (6.011 ms) : 0, 6011
Remote Config [baseline] (602.188 µs) : 0, 602
Remote Config [candidate] (590.079 µs) : 0, 590
Telemetry [baseline] (7.948 ms) : 0, 7948
Telemetry [candidate] (7.952 ms) : 0, 7952
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (803.538 ms) : 0, 803538
BytebuddyAgent [candidate] (808.142 ms) : 0, 808142
GlobalTracer [baseline] (231.722 ms) : 0, 231722
GlobalTracer [candidate] (230.907 ms) : 0, 230907
IAST [baseline] (28.96 ms) : 0, 28960
IAST [candidate] (28.737 ms) : 0, 28737
AppSec [baseline] (50.725 ms) : 0, 50725
AppSec [candidate] (50.13 ms) : 0, 50130
Debugger [baseline] (6.062 ms) : 0, 6062
Debugger [candidate] (5.971 ms) : 0, 5971
Remote Config [baseline] (607.847 µs) : 0, 608
Remote Config [candidate] (596.41 µs) : 0, 596
Telemetry [baseline] (7.954 ms) : 0, 7954
Telemetry [candidate] (7.872 ms) : 0, 7872
Startup time reports for petclinicgantt
title petclinic - global startup overhead: candidate=1.50.0-SNAPSHOT~c7ee38f9a8, baseline=1.50.0-SNAPSHOT~7787af738f
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (1.019 s) : 0, 1019267
Total [baseline] (11.093 s) : 0, 11092587
Agent [candidate] (1.022 s) : 0, 1021876
Total [candidate] (11.144 s) : 0, 11143836
section appsec
Agent [baseline] (1.166 s) : 0, 1165748
Total [baseline] (11.206 s) : 0, 11205942
Agent [candidate] (1.163 s) : 0, 1162894
Total [candidate] (11.224 s) : 0, 11223941
section iast
Agent [baseline] (1.172 s) : 0, 1172318
Total [baseline] (11.396 s) : 0, 11395542
Agent [candidate] (1.149 s) : 0, 1148695
Total [candidate] (11.472 s) : 0, 11472187
section profiling
Agent [baseline] (1.268 s) : 0, 1268212
Total [baseline] (11.437 s) : 0, 11437267
Agent [candidate] (1.263 s) : 0, 1263078
Total [candidate] (11.432 s) : 0, 11431639
gantt
title petclinic - break down per module: candidate=1.50.0-SNAPSHOT~c7ee38f9a8, baseline=1.50.0-SNAPSHOT~7787af738f
dateFormat X
axisFormat %s
section tracing
BytebuddyAgent [baseline] (681.228 ms) : 0, 681228
BytebuddyAgent [candidate] (682.501 ms) : 0, 682501
GlobalTracer [baseline] (239.554 ms) : 0, 239554
GlobalTracer [candidate] (240.618 ms) : 0, 240618
AppSec [baseline] (57.684 ms) : 0, 57684
AppSec [candidate] (56.314 ms) : 0, 56314
Debugger [baseline] (6.124 ms) : 0, 6124
Debugger [candidate] (6.157 ms) : 0, 6157
Remote Config [baseline] (745.169 µs) : 0, 745
Remote Config [candidate] (731.489 µs) : 0, 731
Telemetry [baseline] (10.424 ms) : 0, 10424
Telemetry [candidate] (11.921 ms) : 0, 11921
section appsec
BytebuddyAgent [baseline] (702.621 ms) : 0, 702621
BytebuddyAgent [candidate] (700.655 ms) : 0, 700655
GlobalTracer [baseline] (238.206 ms) : 0, 238206
GlobalTracer [candidate] (237.757 ms) : 0, 237757
IAST [baseline] (21.964 ms) : 0, 21964
IAST [candidate] (22.001 ms) : 0, 22001
AppSec [baseline] (176.332 ms) : 0, 176332
AppSec [candidate] (175.95 ms) : 0, 175950
Debugger [baseline] (6.004 ms) : 0, 6004
Debugger [candidate] (5.986 ms) : 0, 5986
Remote Config [baseline] (621.783 µs) : 0, 622
Remote Config [candidate] (624.226 µs) : 0, 624
Telemetry [baseline] (7.368 ms) : 0, 7368
Telemetry [candidate] (7.364 ms) : 0, 7364
section iast
BytebuddyAgent [baseline] (817.417 ms) : 0, 817417
BytebuddyAgent [candidate] (800.727 ms) : 0, 800727
GlobalTracer [baseline] (234.975 ms) : 0, 234975
GlobalTracer [candidate] (230.629 ms) : 0, 230629
IAST [baseline] (26.929 ms) : 0, 26929
IAST [candidate] (25.143 ms) : 0, 25143
AppSec [baseline] (54.356 ms) : 0, 54356
AppSec [candidate] (54.344 ms) : 0, 54344
Debugger [baseline] (6.015 ms) : 0, 6015
Debugger [candidate] (5.877 ms) : 0, 5877
Remote Config [baseline] (609.42 µs) : 0, 609
Remote Config [candidate] (588.745 µs) : 0, 589
Telemetry [baseline] (8.027 ms) : 0, 8027
Telemetry [candidate] (7.849 ms) : 0, 7849
section profiling
BytebuddyAgent [baseline] (676.783 ms) : 0, 676783
BytebuddyAgent [candidate] (674.451 ms) : 0, 674451
GlobalTracer [baseline] (360.768 ms) : 0, 360768
GlobalTracer [candidate] (359.225 ms) : 0, 359225
AppSec [baseline] (61.766 ms) : 0, 61766
AppSec [candidate] (61.395 ms) : 0, 61395
Debugger [baseline] (6.102 ms) : 0, 6102
Debugger [candidate] (6.112 ms) : 0, 6112
Remote Config [baseline] (648.508 µs) : 0, 649
Remote Config [candidate] (644.568 µs) : 0, 645
Telemetry [baseline] (8.152 ms) : 0, 8152
Telemetry [candidate] (8.118 ms) : 0, 8118
ProfilingAgent [baseline] (103.108 ms) : 0, 103108
ProfilingAgent [candidate] (102.396 ms) : 0, 102396
Profiling [baseline] (103.132 ms) : 0, 103132
Profiling [candidate] (102.42 ms) : 0, 102420
LoadParameters
See matching parameters
SummaryFound 2 performance improvements and 4 performance regressions! Performance is the same for 5 metrics, 17 unstable metrics.
DacapoParameters
See matching parameters
SummaryFound 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics. Execution time for tomcatgantt
title tomcat - execution time [CI 0.99] : candidate=1.50.0-SNAPSHOT~c7ee38f9a8, baseline=1.50.0-SNAPSHOT~7787af738f
dateFormat X
axisFormat %s
section baseline
no_agent (1.476 ms) : 1464, 1487
. : milestone, 1476,
appsec (2.392 ms) : 2344, 2440
. : milestone, 2392,
iast (2.163 ms) : 2102, 2224
. : milestone, 2163,
iast_GLOBAL (2.218 ms) : 2157, 2280
. : milestone, 2218,
profiling (2.014 ms) : 1965, 2063
. : milestone, 2014,
tracing (1.998 ms) : 1951, 2045
. : milestone, 1998,
section candidate
no_agent (1.475 ms) : 1464, 1487
. : milestone, 1475,
appsec (2.385 ms) : 2337, 2433
. : milestone, 2385,
iast (2.178 ms) : 2117, 2239
. : milestone, 2178,
iast_GLOBAL (2.224 ms) : 2162, 2285
. : milestone, 2224,
profiling (2.016 ms) : 1967, 2064
. : milestone, 2016,
tracing (2.011 ms) : 1963, 2059
. : milestone, 2011,
Execution time for biojavagantt
title biojava - execution time [CI 0.99] : candidate=1.50.0-SNAPSHOT~c7ee38f9a8, baseline=1.50.0-SNAPSHOT~7787af738f
dateFormat X
axisFormat %s
section baseline
no_agent (15.477 s) : 15477000, 15477000
. : milestone, 15477000,
appsec (15.103 s) : 15103000, 15103000
. : milestone, 15103000,
iast (18.849 s) : 18849000, 18849000
. : milestone, 18849000,
iast_GLOBAL (17.877 s) : 17877000, 17877000
. : milestone, 17877000,
profiling (15.292 s) : 15292000, 15292000
. : milestone, 15292000,
tracing (14.799 s) : 14799000, 14799000
. : milestone, 14799000,
section candidate
no_agent (15.766 s) : 15766000, 15766000
. : milestone, 15766000,
appsec (14.759 s) : 14759000, 14759000
. : milestone, 14759000,
iast (18.712 s) : 18712000, 18712000
. : milestone, 18712000,
iast_GLOBAL (17.853 s) : 17853000, 17853000
. : milestone, 17853000,
profiling (15.307 s) : 15307000, 15307000
. : milestone, 15307000,
tracing (14.832 s) : 14832000, 14832000
. : milestone, 14832000,
|
97de10c
to
bfd5082
Compare
bfd5082
to
c7ee38f
Compare
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
What Does This Do
Add testing for
stable
image (JDK 24)Motivation
Add Java 24 tests to CI
Additional Notes
Contributor Checklist
type:
and (comp:
orinst:
) labels in addition to any usefull labelsclose
,fix
or any linking keywords when referencing an issue.Use
solves
instead, and assign the PR milestone to the issueJira ticket: https://datadoghq.atlassian.net/browse/LANGPLAT-421