Skip to content

Pin shared pipeline #8812

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Open
wants to merge 1 commit into
base: master
Choose a base branch
from
Open

Pin shared pipeline #8812

wants to merge 1 commit into from

Conversation

TonyCTHsu
Copy link

What Does This Do

Pin a version to shared pipeline to provide consistent result.

Contributor Checklist

@TonyCTHsu TonyCTHsu requested a review from a team as a code owner May 13, 2025 11:06
@TonyCTHsu TonyCTHsu requested a review from smola May 13, 2025 11:06
@github-actions GitHub Actions
Copy link
Contributor

Hi! 👋 Thanks for your pull request! 🎉

To help us review it, please make sure to:

  • Add at least one type, and one component or instrumentation label to the pull request

If you need help, please check our contributing guidelines.

@smola smola requested review from bric3 and PerfectSlayer May 13, 2025 11:08
@datadog-datadog-prod-us1
Copy link
Contributor

Datadog Summary

✅ Code Quality    ✅ Code Security    ✅ Dependencies

Was this helpful? Give us feedback!

@smola smola added tag: no release notes Changes to exclude from release notes comp: tooling Build & Tooling labels May 13, 2025
@smola smola requested a review from randomanderson May 13, 2025 11:08
@pr-commenter
Copy link

pr-commenter bot commented May 13, 2025 •
edited
Loading

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master tonycthsu/pin-shared-pipeline
git_commit_date 1747133319 1747133924
git_commit_sha 933cb97 e464538
release_version 1.50.0-SNAPSHOT~933cb976ca 1.50.0-SNAPSHOT~e464538753
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1747136171 1747136171
ci_job_id 935376500 935376500
ci_pipeline_id 64915832 64915832
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-qk7k1zfd-project-304-concurrent-3-e50ijeho 6.8.0-1028-aws #30~22.04.1-Ubuntu SMP Sun Apr 20 06:03:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-qk7k1zfd-project-304-concurrent-3-e50ijeho 6.8.0-1028-aws #30~22.04.1-Ubuntu SMP Sun Apr 20 06:03:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 58 metrics, 13 unstable metrics.

Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.50.0-SNAPSHOT~e464538753, baseline=1.50.0-SNAPSHOT~933cb976ca

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.027 s) : 0, 1026544
Total [baseline] (10.438 s) : 0, 10438216
Agent [candidate] (1.02 s) : 0, 1019807
Total [candidate] (10.445 s) : 0, 10445040
section appsec
Agent [baseline] (1.163 s) : 0, 1162788
Total [baseline] (10.747 s) : 0, 10746931
Agent [candidate] (1.166 s) : 0, 1165793
Total [candidate] (10.719 s) : 0, 10719124
section iast
Agent [baseline] (1.148 s) : 0, 1147536
Total [baseline] (10.874 s) : 0, 10873503
Agent [candidate] (1.149 s) : 0, 1149374
Total [candidate] (10.912 s) : 0, 10912092
section profiling
Agent [baseline] (1.283 s) : 0, 1283104
Total [baseline] (10.842 s) : 0, 10842185
Agent [candidate] (1.278 s) : 0, 1277660
Total [candidate] (10.923 s) : 0, 10922942
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.027 s -
Agent appsec 1.163 s 136.243 ms (13.3%)
Agent iast 1.148 s 120.992 ms (11.8%)
Agent profiling 1.283 s 256.56 ms (25.0%)
Total tracing 10.438 s -
Total appsec 10.747 s 308.715 ms (3.0%)
Total iast 10.874 s 435.287 ms (4.2%)
Total profiling 10.842 s 403.968 ms (3.9%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.02 s -
Agent appsec 1.166 s 145.986 ms (14.3%)
Agent iast 1.149 s 129.567 ms (12.7%)
Agent profiling 1.278 s 257.853 ms (25.3%)
Total tracing 10.445 s -
Total appsec 10.719 s 274.084 ms (2.6%)
Total iast 10.912 s 467.052 ms (4.5%)
Total profiling 10.923 s 477.901 ms (4.6%) 
gantt
    title petclinic - break down per module: candidate=1.50.0-SNAPSHOT~e464538753, baseline=1.50.0-SNAPSHOT~933cb976ca

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (686.928 ms) : 0, 686928
BytebuddyAgent [candidate] (681.756 ms) : 0, 681756
GlobalTracer [baseline] (241.162 ms) : 0, 241162
GlobalTracer [candidate] (239.761 ms) : 0, 239761
AppSec [baseline] (54.664 ms) : 0, 54664
AppSec [candidate] (55.954 ms) : 0, 55954
Debugger [baseline] (8.887 ms) : 0, 8887
Debugger [candidate] (8.289 ms) : 0, 8289
Remote Config [baseline] (700.447 µs) : 0, 700
Remote Config [candidate] (686.471 µs) : 0, 686
Telemetry [baseline] (10.472 ms) : 0, 10472
Telemetry [candidate] (9.756 ms) : 0, 9756
section appsec
BytebuddyAgent [baseline] (701.504 ms) : 0, 701504
BytebuddyAgent [candidate] (703.203 ms) : 0, 703203
GlobalTracer [baseline] (236.79 ms) : 0, 236790
GlobalTracer [candidate] (237.905 ms) : 0, 237905
AppSec [baseline] (176.177 ms) : 0, 176177
AppSec [candidate] (175.617 ms) : 0, 175617
Debugger [baseline] (5.941 ms) : 0, 5941
Debugger [candidate] (5.958 ms) : 0, 5958
Remote Config [baseline] (623.116 µs) : 0, 623
Remote Config [candidate] (630.318 µs) : 0, 630
Telemetry [baseline] (7.372 ms) : 0, 7372
Telemetry [candidate] (7.769 ms) : 0, 7769
IAST [baseline] (21.553 ms) : 0, 21553
IAST [candidate] (22.076 ms) : 0, 22076
section iast
BytebuddyAgent [baseline] (800.805 ms) : 0, 800805
BytebuddyAgent [candidate] (802.061 ms) : 0, 802061
GlobalTracer [baseline] (230.559 ms) : 0, 230559
GlobalTracer [candidate] (230.854 ms) : 0, 230854
AppSec [baseline] (50.123 ms) : 0, 50123
AppSec [candidate] (51.162 ms) : 0, 51162
Debugger [baseline] (5.894 ms) : 0, 5894
Debugger [candidate] (5.846 ms) : 0, 5846
Remote Config [baseline] (586.233 µs) : 0, 586
Remote Config [candidate] (568.343 µs) : 0, 568
Telemetry [baseline] (7.861 ms) : 0, 7861
Telemetry [candidate] (7.827 ms) : 0, 7827
IAST [baseline] (28.229 ms) : 0, 28229
IAST [candidate] (27.545 ms) : 0, 27545
section profiling
ProfilingAgent [baseline] (102.989 ms) : 0, 102989
ProfilingAgent [candidate] (104.544 ms) : 0, 104544
BytebuddyAgent [baseline] (676.401 ms) : 0, 676401
BytebuddyAgent [candidate] (671.485 ms) : 0, 671485
GlobalTracer [baseline] (375.614 ms) : 0, 375614
GlobalTracer [candidate] (373.541 ms) : 0, 373541
AppSec [baseline] (61.903 ms) : 0, 61903
AppSec [candidate] (62.033 ms) : 0, 62033
Debugger [baseline] (6.324 ms) : 0, 6324
Debugger [candidate] (6.381 ms) : 0, 6381
Remote Config [baseline] (668.765 µs) : 0, 669
Remote Config [candidate] (668.04 µs) : 0, 668
Telemetry [baseline] (8.2 ms) : 0, 8200
Telemetry [candidate] (8.336 ms) : 0, 8336
Profiling [baseline] (103.013 ms) : 0, 103013
Profiling [candidate] (104.567 ms) : 0, 104567
Loading
Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.50.0-SNAPSHOT~e464538753, baseline=1.50.0-SNAPSHOT~933cb976ca

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.02 s) : 0, 1020193
Total [baseline] (8.689 s) : 0, 8688528
Agent [candidate] (1.018 s) : 0, 1017910
Total [candidate] (8.65 s) : 0, 8650268
section iast
Agent [baseline] (1.148 s) : 0, 1148158
Total [baseline] (9.219 s) : 0, 9218573
Agent [candidate] (1.146 s) : 0, 1145911
Total [candidate] (9.212 s) : 0, 9211577
section iast_HARDCODED_SECRET_DISABLED
Agent [baseline] (1.156 s) : 0, 1155844
Total [baseline] (9.206 s) : 0, 9205853
Agent [candidate] (1.152 s) : 0, 1151827
Total [candidate] (9.177 s) : 0, 9176735
section iast_TELEMETRY_OFF
Agent [baseline] (1.151 s) : 0, 1151311
Total [baseline] (9.209 s) : 0, 9208669
Agent [candidate] (1.145 s) : 0, 1145087
Total [candidate] (9.211 s) : 0, 9211197
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.02 s -
Agent iast 1.148 s 127.965 ms (12.5%)
Agent iast_HARDCODED_SECRET_DISABLED 1.156 s 135.651 ms (13.3%)
Agent iast_TELEMETRY_OFF 1.151 s 131.118 ms (12.9%)
Total tracing 8.689 s -
Total iast 9.219 s 530.045 ms (6.1%)
Total iast_HARDCODED_SECRET_DISABLED 9.206 s 517.325 ms (6.0%)
Total iast_TELEMETRY_OFF 9.209 s 520.141 ms (6.0%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.018 s -
Agent iast 1.146 s 128.001 ms (12.6%)
Agent iast_HARDCODED_SECRET_DISABLED 1.152 s 133.917 ms (13.2%)
Agent iast_TELEMETRY_OFF 1.145 s 127.177 ms (12.5%)
Total tracing 8.65 s -
Total iast 9.212 s 561.309 ms (6.5%)
Total iast_HARDCODED_SECRET_DISABLED 9.177 s 526.467 ms (6.1%)
Total iast_TELEMETRY_OFF 9.211 s 560.929 ms (6.5%) 
gantt
    title insecure-bank - break down per module: candidate=1.50.0-SNAPSHOT~e464538753, baseline=1.50.0-SNAPSHOT~933cb976ca

    dateFormat X
    axisFormat %s
section tracing
BytebuddyAgent [baseline] (681.264 ms) : 0, 681264
BytebuddyAgent [candidate] (680.298 ms) : 0, 680298
GlobalTracer [baseline] (240.306 ms) : 0, 240306
GlobalTracer [candidate] (239.101 ms) : 0, 239101
AppSec [baseline] (54.146 ms) : 0, 54146
AppSec [candidate] (54.878 ms) : 0, 54878
Debugger [baseline] (10.383 ms) : 0, 10383
Debugger [candidate] (10.404 ms) : 0, 10404
Remote Config [baseline] (723.238 µs) : 0, 723
Remote Config [candidate] (728.149 µs) : 0, 728
Telemetry [baseline] (9.742 ms) : 0, 9742
Telemetry [candidate] (8.997 ms) : 0, 8997
section iast
BytebuddyAgent [baseline] (801.451 ms) : 0, 801451
BytebuddyAgent [candidate] (799.523 ms) : 0, 799523
GlobalTracer [baseline] (230.562 ms) : 0, 230562
GlobalTracer [candidate] (230.045 ms) : 0, 230045
IAST [baseline] (28.283 ms) : 0, 28283
IAST [candidate] (27.206 ms) : 0, 27206
AppSec [baseline] (48.547 ms) : 0, 48547
AppSec [candidate] (51.331 ms) : 0, 51331
Debugger [baseline] (5.844 ms) : 0, 5844
Debugger [candidate] (5.884 ms) : 0, 5884
Remote Config [baseline] (588.598 µs) : 0, 589
Remote Config [candidate] (587.725 µs) : 0, 588
Telemetry [baseline] (7.824 ms) : 0, 7824
Telemetry [candidate] (7.883 ms) : 0, 7883
section iast_HARDCODED_SECRET_DISABLED
BytebuddyAgent [baseline] (806.501 ms) : 0, 806501
BytebuddyAgent [candidate] (803.963 ms) : 0, 803963
GlobalTracer [baseline] (232.34 ms) : 0, 232340
GlobalTracer [candidate] (231.058 ms) : 0, 231058
IAST [baseline] (27.794 ms) : 0, 27794
IAST [candidate] (26.991 ms) : 0, 26991
AppSec [baseline] (50.222 ms) : 0, 50222
AppSec [candidate] (51.151 ms) : 0, 51151
Debugger [baseline] (5.936 ms) : 0, 5936
Debugger [candidate] (5.847 ms) : 0, 5847
Remote Config [baseline] (581.669 µs) : 0, 582
Remote Config [candidate] (586.563 µs) : 0, 587
Telemetry [baseline] (7.956 ms) : 0, 7956
Telemetry [candidate] (7.829 ms) : 0, 7829
section iast_TELEMETRY_OFF
BytebuddyAgent [baseline] (802.844 ms) : 0, 802844
BytebuddyAgent [candidate] (798.814 ms) : 0, 798814
GlobalTracer [baseline] (231.514 ms) : 0, 231514
GlobalTracer [candidate] (230.578 ms) : 0, 230578
IAST [baseline] (22.417 ms) : 0, 22417
IAST [candidate] (22.955 ms) : 0, 22955
AppSec [baseline] (56.397 ms) : 0, 56397
AppSec [candidate] (54.984 ms) : 0, 54984
Debugger [baseline] (6.003 ms) : 0, 6003
Debugger [candidate] (5.942 ms) : 0, 5942
Remote Config [baseline] (611.663 µs) : 0, 612
Remote Config [candidate] (607.046 µs) : 0, 607
Telemetry [baseline] (7.841 ms) : 0, 7841
Telemetry [candidate] (7.779 ms) : 0, 7779
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
end_time 2025-05-13T11:06:31 2025-05-13T11:14:20
git_branch master tonycthsu/pin-shared-pipeline
git_commit_date 1747133319 1747133924
git_commit_sha 933cb97 e464538
release_version 1.50.0-SNAPSHOT~933cb976ca 1.50.0-SNAPSHOT~e464538753
start_time 2025-05-13T11:06:17 2025-05-13T11:14:05
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1747135261 1747135261
ci_job_id 935376501 935376501
ci_pipeline_id 64915832 64915832
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-34dtxpkg-project-304-concurrent-2-2wz2su69 6.8.0-1028-aws #30~22.04.1-Ubuntu SMP Sun Apr 20 06:03:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-34dtxpkg-project-304-concurrent-2-2wz2su69 6.8.0-1028-aws #30~22.04.1-Ubuntu SMP Sun Apr 20 06:03:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
variant iast iast

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 18 unstable metrics.

Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.50.0-SNAPSHOT~e464538753, baseline=1.50.0-SNAPSHOT~933cb976ca
    dateFormat X
    axisFormat %s
section baseline
no_agent (393.43 µs) : 373, 414
.   : milestone, 393,
iast (522.634 µs) : 501, 544
.   : milestone, 523,
iast_FULL (736.509 µs) : 715, 758
.   : milestone, 737,
iast_GLOBAL (581.538 µs) : 559, 604
.   : milestone, 582,
iast_HARDCODED_SECRET_DISABLED (527.47 µs) : 505, 550
.   : milestone, 527,
iast_INACTIVE (471.14 µs) : 449, 493
.   : milestone, 471,
iast_TELEMETRY_OFF (513.594 µs) : 490, 537
.   : milestone, 514,
tracing (470.49 µs) : 448, 493
.   : milestone, 470,
section candidate
no_agent (389.568 µs) : 370, 409
.   : milestone, 390,
iast (520.842 µs) : 499, 543
.   : milestone, 521,
iast_FULL (743.559 µs) : 721, 766
.   : milestone, 744,
iast_GLOBAL (580.947 µs) : 559, 603
.   : milestone, 581,
iast_HARDCODED_SECRET_DISABLED (536.358 µs) : 514, 559
.   : milestone, 536,
iast_INACTIVE (472.759 µs) : 451, 495
.   : milestone, 473,
iast_TELEMETRY_OFF (512.622 µs) : 489, 536
.   : milestone, 513,
tracing (472.311 µs) : 449, 495
.   : milestone, 472,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 393.43 µs [373.312 µs, 413.549 µs] -
iast 522.634 µs [501.027 µs, 544.241 µs] 129.204 µs (32.8%)
iast_FULL 736.509 µs [714.66 µs, 758.358 µs] 343.079 µs (87.2%)
iast_GLOBAL 581.538 µs [558.935 µs, 604.14 µs] 188.107 µs (47.8%)
iast_HARDCODED_SECRET_DISABLED 527.47 µs [504.894 µs, 550.047 µs] 134.04 µs (34.1%)
iast_INACTIVE 471.14 µs [448.888 µs, 493.393 µs] 77.71 µs (19.8%)
iast_TELEMETRY_OFF 513.594 µs [490.303 µs, 536.885 µs] 120.164 µs (30.5%)
tracing 470.49 µs [448.386 µs, 492.593 µs] 77.059 µs (19.6%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 389.568 µs [369.697 µs, 409.44 µs] -
iast 520.842 µs [499.154 µs, 542.531 µs] 131.274 µs (33.7%)
iast_FULL 743.559 µs [721.328 µs, 765.79 µs] 353.991 µs (90.9%)
iast_GLOBAL 580.947 µs [558.673 µs, 603.221 µs] 191.379 µs (49.1%)
iast_HARDCODED_SECRET_DISABLED 536.358 µs [513.565 µs, 559.15 µs] 146.789 µs (37.7%)
iast_INACTIVE 472.759 µs [450.871 µs, 494.648 µs] 83.191 µs (21.4%)
iast_TELEMETRY_OFF 512.622 µs [488.796 µs, 536.448 µs] 123.054 µs (31.6%)
tracing 472.311 µs [449.408 µs, 495.213 µs] 82.742 µs (21.2%)
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.50.0-SNAPSHOT~e464538753, baseline=1.50.0-SNAPSHOT~933cb976ca
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.369 ms) : 1350, 1389
.   : milestone, 1369,
appsec (1.767 ms) : 1744, 1790
.   : milestone, 1767,
appsec_no_iast (1.746 ms) : 1723, 1770
.   : milestone, 1746,
code_origins (1.699 ms) : 1672, 1726
.   : milestone, 1699,
iast (1.529 ms) : 1505, 1553
.   : milestone, 1529,
profiling (1.547 ms) : 1522, 1572
.   : milestone, 1547,
tracing (1.525 ms) : 1500, 1550
.   : milestone, 1525,
section candidate
no_agent (1.371 ms) : 1351, 1392
.   : milestone, 1371,
appsec (1.751 ms) : 1726, 1775
.   : milestone, 1751,
appsec_no_iast (1.741 ms) : 1718, 1763
.   : milestone, 1741,
code_origins (1.694 ms) : 1667, 1721
.   : milestone, 1694,
iast (1.52 ms) : 1496, 1544
.   : milestone, 1520,
profiling (1.52 ms) : 1496, 1544
.   : milestone, 1520,
tracing (1.508 ms) : 1483, 1532
.   : milestone, 1508,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.369 ms [1.35 ms, 1.389 ms] -
appsec 1.767 ms [1.744 ms, 1.79 ms] 397.657 µs (29.0%)
appsec_no_iast 1.746 ms [1.723 ms, 1.77 ms] 377.368 µs (27.6%)
code_origins 1.699 ms [1.672 ms, 1.726 ms] 329.849 µs (24.1%)
iast 1.529 ms [1.505 ms, 1.553 ms] 159.435 µs (11.6%)
profiling 1.547 ms [1.522 ms, 1.572 ms] 177.802 µs (13.0%)
tracing 1.525 ms [1.5 ms, 1.55 ms] 156.11 µs (11.4%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 1.371 ms [1.351 ms, 1.392 ms] -
appsec 1.751 ms [1.726 ms, 1.775 ms] 379.122 µs (27.6%)
appsec_no_iast 1.741 ms [1.718 ms, 1.763 ms] 369.356 µs (26.9%)
code_origins 1.694 ms [1.667 ms, 1.721 ms] 322.501 µs (23.5%)
iast 1.52 ms [1.496 ms, 1.544 ms] 148.502 µs (10.8%)
profiling 1.52 ms [1.496 ms, 1.544 ms] 148.309 µs (10.8%)
tracing 1.508 ms [1.483 ms, 1.532 ms] 136.114 µs (9.9%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master tonycthsu/pin-shared-pipeline
git_commit_date 1747133319 1747133924
git_commit_sha 933cb97 e464538
release_version 1.50.0-SNAPSHOT~933cb976ca 1.50.0-SNAPSHOT~e464538753
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1747135767 1747135767
ci_job_id 935376502 935376502
ci_pipeline_id 64915832 64915832
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-ivhp-jxm-project-304-concurrent-2-g5e35m4t 6.8.0-1028-aws #30~22.04.1-Ubuntu SMP Sun Apr 20 06:03:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-ivhp-jxm-project-304-concurrent-2-g5e35m4t 6.8.0-1028-aws #30~22.04.1-Ubuntu SMP Sun Apr 20 06:03:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
variant appsec appsec

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.50.0-SNAPSHOT~e464538753, baseline=1.50.0-SNAPSHOT~933cb976ca
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.494 s) : 15494000, 15494000
.   : milestone, 15494000,
appsec (15.17 s) : 15170000, 15170000
.   : milestone, 15170000,
iast (19.366 s) : 19366000, 19366000
.   : milestone, 19366000,
iast_GLOBAL (18.05 s) : 18050000, 18050000
.   : milestone, 18050000,
profiling (14.883 s) : 14883000, 14883000
.   : milestone, 14883000,
tracing (15.138 s) : 15138000, 15138000
.   : milestone, 15138000,
section candidate
no_agent (14.94 s) : 14940000, 14940000
.   : milestone, 14940000,
appsec (15.171 s) : 15171000, 15171000
.   : milestone, 15171000,
iast (18.456 s) : 18456000, 18456000
.   : milestone, 18456000,
iast_GLOBAL (18.203 s) : 18203000, 18203000
.   : milestone, 18203000,
profiling (15.133 s) : 15133000, 15133000
.   : milestone, 15133000,
tracing (14.934 s) : 14934000, 14934000
.   : milestone, 14934000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.494 s [15.494 s, 15.494 s] -
appsec 15.17 s [15.17 s, 15.17 s] -324.0 ms (-2.1%)
iast 19.366 s [19.366 s, 19.366 s] 3.872 s (25.0%)
iast_GLOBAL 18.05 s [18.05 s, 18.05 s] 2.556 s (16.5%)
profiling 14.883 s [14.883 s, 14.883 s] -611.0 ms (-3.9%)
tracing 15.138 s [15.138 s, 15.138 s] -356.0 ms (-2.3%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 14.94 s [14.94 s, 14.94 s] -
appsec 15.171 s [15.171 s, 15.171 s] 231.0 ms (1.5%)
iast 18.456 s [18.456 s, 18.456 s] 3.516 s (23.5%)
iast_GLOBAL 18.203 s [18.203 s, 18.203 s] 3.263 s (21.8%)
profiling 15.133 s [15.133 s, 15.133 s] 193.0 ms (1.3%)
tracing 14.934 s [14.934 s, 14.934 s] -6.0 ms (-0.0%)
Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.50.0-SNAPSHOT~e464538753, baseline=1.50.0-SNAPSHOT~933cb976ca
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.47 ms) : 1459, 1482
.   : milestone, 1470,
appsec (2.409 ms) : 2359, 2459
.   : milestone, 2409,
iast (2.188 ms) : 2126, 2250
.   : milestone, 2188,
iast_GLOBAL (2.232 ms) : 2169, 2295
.   : milestone, 2232,
profiling (2.043 ms) : 1992, 2093
.   : milestone, 2043,
tracing (2.017 ms) : 1968, 2065
.   : milestone, 2017,
section candidate
no_agent (1.476 ms) : 1464, 1488
.   : milestone, 1476,
appsec (2.405 ms) : 2355, 2454
.   : milestone, 2405,
iast (2.189 ms) : 2127, 2252
.   : milestone, 2189,
iast_GLOBAL (2.228 ms) : 2166, 2291
.   : milestone, 2228,
profiling (2.03 ms) : 1980, 2079
.   : milestone, 2030,
tracing (2.011 ms) : 1963, 2060
.   : milestone, 2011,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.47 ms [1.459 ms, 1.482 ms] -
appsec 2.409 ms [2.359 ms, 2.459 ms] 938.724 µs (63.8%)
iast 2.188 ms [2.126 ms, 2.25 ms] 717.465 µs (48.8%)
iast_GLOBAL 2.232 ms [2.169 ms, 2.295 ms] 761.656 µs (51.8%)
profiling 2.043 ms [1.992 ms, 2.093 ms] 572.204 µs (38.9%)
tracing 2.017 ms [1.968 ms, 2.065 ms] 546.439 µs (37.2%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.476 ms [1.464 ms, 1.488 ms] -
appsec 2.405 ms [2.355 ms, 2.454 ms] 928.813 µs (62.9%)
iast 2.189 ms [2.127 ms, 2.252 ms] 713.285 µs (48.3%)
iast_GLOBAL 2.228 ms [2.166 ms, 2.291 ms] 752.096 µs (51.0%)
profiling 2.03 ms [1.98 ms, 2.079 ms] 553.596 µs (37.5%)
tracing 2.011 ms [1.963 ms, 2.06 ms] 535.176 µs (36.3%)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@bric3 bric3 bric3 approved these changes

@smola smola Awaiting requested review from smola smola is a code owner automatically assigned from DataDog/apm-java

@PerfectSlayer PerfectSlayer Awaiting requested review from PerfectSlayer

@randomanderson randomanderson Awaiting requested review from randomanderson

Assignees
No one assigned
Labels
comp: tooling Build & Tooling tag: no release notes Changes to exclude from release notes
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
3 participants
@TonyCTHsu @bric3 @smola