Skip to content

Conversation

@bouwkast
Copy link
Collaborator

Summary of changes

TODO

Reason for change

Implementation details

Test coverage

Other details

@bouwkast bouwkast added type:bug status:work-in-progress Actively worked on. If this is a PR, no review needed yet. WIP. identified-by:telemetry labels Dec 31, 2025
@datadog-official
Copy link

datadog-official bot commented Dec 31, 2025

⚠️ Tests

Fix all issues with Cursor

⚠️ Warnings

🧪 22 Tests failed

TestIastSqliInterpolatedString from Datadog.Trace.Security.IntegrationTests.Iast.AspNetCore5IastTestsFullSamplingIastEnabled (Datadog) (Fix with Cursor)

Verified path: D:\a\_work\1\s\tracer\test\Datadog.Trace.Security.IntegrationTests\..\snapshots\Iast.SqliInterpolatedString.AspNetCore5.IastEnabled.verified.txt ShipCountry) VALUES ('VINET','5','2021-01-01','2021-01-01',"
TestIastSqliInterpolatedString from Datadog.Trace.Security.IntegrationTests.Iast.AspNetCore5IastTestsFullSamplingIastEnabled (Datadog) (Fix with Cursor)

Verified path: D:\a\_work\1\s\tracer\test\Datadog.Trace.Security.IntegrationTests\..\snapshots\Iast.SqliInterpolatedString.AspNetCore5.IastEnabled.verified.txt ShipCountry) VALUES ('VINET','5','2021-01-01','2021-01-01',"
TestIastSqliInterpolatedString from Datadog.Trace.Security.IntegrationTests.Iast.AspNetCore5IastTestsFullSamplingIastEnabled (Datadog) (Fix with Cursor)

Verified path: D:\a\_work\1\s\tracer\test\Datadog.Trace.Security.IntegrationTests\..\snapshots\Iast.SqliInterpolatedString.AspNetCore5.IastEnabled.verified.txt ShipCountry) VALUES ('VINET','5','2021-01-01','2021-01-01',"
View all

ℹ️ Info

❄️ No new flaky tests detected

This comment will be updated automatically if new data arrives.
🔗 Commit SHA: 68a09e2 | Docs | Datadog PR Page | Was this helpful? Give us feedback!

@dd-trace-dotnet-ci-bot
Copy link

Execution-Time Benchmarks Report ⏱️

Execution-time results for samples comparing This PR (8024) and master.

✅ No regressions detected - check the details below

Full Metrics Comparison

FakeDbCommand

Metric Master (Mean ± 95% CI) Current (Mean ± 95% CI) Change Status
.NET Framework 4.8 - Baseline
duration68.27 ± (68.31 - 68.55) ms68.44 ± (68.49 - 68.73) ms+0.2%✅⬆️
.NET Framework 4.8 - Bailout
duration72.30 ± (72.32 - 72.55) ms72.12 ± (72.13 - 72.28) ms-0.2%
.NET Framework 4.8 - CallTarget+Inlining+NGEN
duration1002.91 ± (1004.44 - 1009.93) ms1003.75 ± (1004.89 - 1010.65) ms+0.1%✅⬆️
.NET Core 3.1 - Baseline
process.internal_duration_ms21.95 ± (21.92 - 21.99) ms21.88 ± (21.86 - 21.91) ms-0.3%
process.time_to_main_ms78.49 ± (78.36 - 78.62) ms78.58 ± (78.42 - 78.73) ms+0.1%✅⬆️
runtime.dotnet.exceptions.count0 ± (0 - 0)0 ± (0 - 0)+0.0%
runtime.dotnet.mem.committed10.93 ± (10.92 - 10.93) MB10.91 ± (10.90 - 10.91) MB-0.2%
runtime.dotnet.threads.count12 ± (12 - 12)12 ± (12 - 12)+0.0%
.NET Core 3.1 - Bailout
process.internal_duration_ms21.91 ± (21.88 - 21.93) ms21.82 ± (21.80 - 21.84) ms-0.4%
process.time_to_main_ms79.69 ± (79.59 - 79.79) ms79.90 ± (79.79 - 80.01) ms+0.3%✅⬆️
runtime.dotnet.exceptions.count0 ± (0 - 0)0 ± (0 - 0)+0.0%
runtime.dotnet.mem.committed10.95 ± (10.95 - 10.95) MB10.95 ± (10.95 - 10.96) MB+0.0%✅⬆️
runtime.dotnet.threads.count13 ± (13 - 13)13 ± (13 - 13)+0.0%
.NET Core 3.1 - CallTarget+Inlining+NGEN
process.internal_duration_ms250.47 ± (246.56 - 254.38) ms248.00 ± (244.09 - 251.92) ms-1.0%
process.time_to_main_ms470.76 ± (470.25 - 471.26) ms470.30 ± (469.82 - 470.77) ms-0.1%
runtime.dotnet.exceptions.count0 ± (0 - 0)0 ± (0 - 0)+0.0%
runtime.dotnet.mem.committed48.17 ± (48.14 - 48.19) MB48.25 ± (48.23 - 48.28) MB+0.2%✅⬆️
runtime.dotnet.threads.count28 ± (28 - 28)28 ± (28 - 28)+0.2%✅⬆️
.NET 6 - Baseline
process.internal_duration_ms20.67 ± (20.64 - 20.70) ms20.62 ± (20.59 - 20.64) ms-0.3%
process.time_to_main_ms67.96 ± (67.86 - 68.06) ms68.05 ± (67.95 - 68.15) ms+0.1%✅⬆️
runtime.dotnet.exceptions.count0 ± (0 - 0)0 ± (0 - 0)+0.0%
runtime.dotnet.mem.committed10.62 ± (10.62 - 10.63) MB10.65 ± (10.64 - 10.65) MB+0.2%✅⬆️
runtime.dotnet.threads.count10 ± (10 - 10)10 ± (10 - 10)+0.0%
.NET 6 - Bailout
process.internal_duration_ms20.49 ± (20.47 - 20.51) ms20.63 ± (20.60 - 20.66) ms+0.7%✅⬆️
process.time_to_main_ms68.71 ± (68.66 - 68.76) ms69.14 ± (69.07 - 69.20) ms+0.6%✅⬆️
runtime.dotnet.exceptions.count0 ± (0 - 0)0 ± (0 - 0)+0.0%
runtime.dotnet.mem.committed10.68 ± (10.67 - 10.68) MB10.75 ± (10.75 - 10.76) MB+0.7%✅⬆️
runtime.dotnet.threads.count11 ± (11 - 11)11 ± (11 - 11)+0.0%
.NET 6 - CallTarget+Inlining+NGEN
process.internal_duration_ms246.51 ± (244.39 - 248.63) ms244.73 ± (243.14 - 246.33) ms-0.7%
process.time_to_main_ms443.22 ± (442.57 - 443.87) ms439.82 ± (439.39 - 440.25) ms-0.8%
runtime.dotnet.exceptions.count0 ± (0 - 0)0 ± (0 - 0)+0.0%
runtime.dotnet.mem.committed48.72 ± (48.69 - 48.75) MB48.69 ± (48.66 - 48.71) MB-0.1%
runtime.dotnet.threads.count28 ± (28 - 28)28 ± (28 - 28)-0.4%
.NET 8 - Baseline
process.internal_duration_ms18.90 ± (18.88 - 18.92) ms18.87 ± (18.83 - 18.90) ms-0.2%
process.time_to_main_ms67.38 ± (67.26 - 67.49) ms67.24 ± (67.13 - 67.34) ms-0.2%
runtime.dotnet.exceptions.count0 ± (0 - 0)0 ± (0 - 0)+0.0%
runtime.dotnet.mem.committed7.66 ± (7.66 - 7.67) MB7.70 ± (7.69 - 7.71) MB+0.5%✅⬆️
runtime.dotnet.threads.count10 ± (10 - 10)10 ± (10 - 10)+0.0%
.NET 8 - Bailout
process.internal_duration_ms18.90 ± (18.87 - 18.93) ms18.89 ± (18.87 - 18.92) ms-0.0%
process.time_to_main_ms68.32 ± (68.26 - 68.38) ms68.19 ± (68.11 - 68.27) ms-0.2%
runtime.dotnet.exceptions.count0 ± (0 - 0)0 ± (0 - 0)+0.0%
runtime.dotnet.mem.committed7.75 ± (7.74 - 7.77) MB7.75 ± (7.74 - 7.75) MB-0.1%
runtime.dotnet.threads.count11 ± (11 - 11)11 ± (11 - 11)+0.0%
.NET 8 - CallTarget+Inlining+NGEN
process.internal_duration_ms176.74 ± (175.90 - 177.58) ms178.08 ± (177.26 - 178.90) ms+0.8%✅⬆️
process.time_to_main_ms424.56 ± (424.07 - 425.04) ms425.79 ± (425.19 - 426.38) ms+0.3%✅⬆️
runtime.dotnet.exceptions.count0 ± (0 - 0)0 ± (0 - 0)+0.0%
runtime.dotnet.mem.committed36.35 ± (36.32 - 36.37) MB36.40 ± (36.38 - 36.43) MB+0.2%✅⬆️
runtime.dotnet.threads.count27 ± (27 - 27)27 ± (27 - 27)+0.0%✅⬆️

HttpMessageHandler

Metric Master (Mean ± 95% CI) Current (Mean ± 95% CI) Change Status
.NET Framework 4.8 - Baseline
duration193.61 ± (193.64 - 194.50) ms193.25 ± (193.13 - 193.98) ms-0.2%
.NET Framework 4.8 - Bailout
duration197.42 ± (197.12 - 197.91) ms196.64 ± (196.58 - 197.22) ms-0.4%
.NET Framework 4.8 - CallTarget+Inlining+NGEN
duration1110.43 ± (1115.83 - 1129.36) ms1110.70 ± (1111.82 - 1119.01) ms+0.0%✅⬆️
.NET Core 3.1 - Baseline
process.internal_duration_ms187.58 ± (187.16 - 188.00) ms187.69 ± (187.36 - 188.01) ms+0.1%✅⬆️
process.time_to_main_ms80.81 ± (80.57 - 81.05) ms80.46 ± (80.31 - 80.61) ms-0.4%
runtime.dotnet.exceptions.count3 ± (3 - 3)3 ± (3 - 3)+0.0%
runtime.dotnet.mem.committed16.11 ± (16.09 - 16.14) MB16.17 ± (16.15 - 16.20) MB+0.4%✅⬆️
runtime.dotnet.threads.count20 ± (20 - 20)20 ± (20 - 20)-0.5%
.NET Core 3.1 - Bailout
process.internal_duration_ms186.90 ± (186.66 - 187.14) ms187.52 ± (187.15 - 187.89) ms+0.3%✅⬆️
process.time_to_main_ms81.86 ± (81.72 - 81.99) ms82.00 ± (81.85 - 82.15) ms+0.2%✅⬆️
runtime.dotnet.exceptions.count3 ± (3 - 3)3 ± (3 - 3)+0.0%
runtime.dotnet.mem.committed16.20 ± (16.17 - 16.23) MB16.13 ± (16.10 - 16.16) MB-0.4%
runtime.dotnet.threads.count21 ± (21 - 21)21 ± (20 - 21)-0.3%
.NET Core 3.1 - CallTarget+Inlining+NGEN
process.internal_duration_ms425.89 ± (422.68 - 429.10) ms425.16 ± (421.92 - 428.39) ms-0.2%
process.time_to_main_ms471.90 ± (471.39 - 472.41) ms473.10 ± (472.49 - 473.71) ms+0.3%✅⬆️
runtime.dotnet.exceptions.count3 ± (3 - 3)3 ± (3 - 3)+0.0%
runtime.dotnet.mem.committed58.68 ± (58.57 - 58.80) MB58.60 ± (58.48 - 58.72) MB-0.1%
runtime.dotnet.threads.count29 ± (29 - 30)29 ± (29 - 30)-0.1%
.NET 6 - Baseline
process.internal_duration_ms193.09 ± (192.72 - 193.46) ms192.76 ± (192.35 - 193.16) ms-0.2%
process.time_to_main_ms69.99 ± (69.82 - 70.17) ms70.05 ± (69.84 - 70.27) ms+0.1%✅⬆️
runtime.dotnet.exceptions.count4 ± (4 - 4)4 ± (4 - 4)+0.0%
runtime.dotnet.mem.committed16.32 ± (16.25 - 16.38) MB16.26 ± (16.16 - 16.35) MB-0.4%
runtime.dotnet.threads.count19 ± (19 - 19)18 ± (18 - 19)-2.3%
.NET 6 - Bailout
process.internal_duration_ms191.39 ± (191.07 - 191.71) ms191.79 ± (191.39 - 192.18) ms+0.2%✅⬆️
process.time_to_main_ms70.87 ± (70.75 - 70.99) ms70.81 ± (70.71 - 70.91) ms-0.1%
runtime.dotnet.exceptions.count4 ± (4 - 4)4 ± (4 - 4)+0.0%
runtime.dotnet.mem.committed16.10 ± (15.95 - 16.25) MB16.23 ± (16.11 - 16.36) MB+0.8%✅⬆️
runtime.dotnet.threads.count20 ± (20 - 20)20 ± (20 - 20)+0.4%✅⬆️
.NET 6 - CallTarget+Inlining+NGEN
process.internal_duration_ms455.81 ± (454.10 - 457.52) ms456.32 ± (454.53 - 458.10) ms+0.1%✅⬆️
process.time_to_main_ms446.19 ± (445.64 - 446.73) ms445.80 ± (445.25 - 446.34) ms-0.1%
runtime.dotnet.exceptions.count4 ± (4 - 4)4 ± (4 - 4)+0.0%
runtime.dotnet.mem.committed58.15 ± (58.03 - 58.27) MB58.13 ± (58.00 - 58.27) MB-0.0%
runtime.dotnet.threads.count30 ± (29 - 30)29 ± (29 - 30)-0.1%
.NET 8 - Baseline
process.internal_duration_ms189.71 ± (189.36 - 190.05) ms190.55 ± (190.16 - 190.94) ms+0.4%✅⬆️
process.time_to_main_ms69.19 ± (69.02 - 69.35) ms69.50 ± (69.34 - 69.66) ms+0.5%✅⬆️
runtime.dotnet.exceptions.count4 ± (4 - 4)4 ± (4 - 4)+0.0%
runtime.dotnet.mem.committed11.78 ± (11.75 - 11.81) MB11.74 ± (11.71 - 11.77) MB-0.4%
runtime.dotnet.threads.count18 ± (18 - 18)18 ± (18 - 18)+0.6%✅⬆️
.NET 8 - Bailout
process.internal_duration_ms190.23 ± (189.94 - 190.51) ms189.87 ± (189.51 - 190.22) ms-0.2%
process.time_to_main_ms70.67 ± (70.57 - 70.77) ms70.63 ± (70.51 - 70.74) ms-0.1%
runtime.dotnet.exceptions.count4 ± (4 - 4)4 ± (4 - 4)+0.0%
runtime.dotnet.mem.committed11.77 ± (11.74 - 11.81) MB11.75 ± (11.72 - 11.77) MB-0.2%
runtime.dotnet.threads.count19 ± (19 - 19)19 ± (19 - 19)-0.2%
.NET 8 - CallTarget+Inlining+NGEN
process.internal_duration_ms365.65 ± (363.86 - 367.44) ms365.47 ± (363.95 - 366.99) ms-0.1%
process.time_to_main_ms429.26 ± (428.75 - 429.76) ms429.91 ± (429.26 - 430.55) ms+0.2%✅⬆️
runtime.dotnet.exceptions.count4 ± (4 - 4)4 ± (4 - 4)+0.0%
runtime.dotnet.mem.committed47.95 ± (47.93 - 47.98) MB47.92 ± (47.89 - 47.96) MB-0.1%
runtime.dotnet.threads.count29 ± (29 - 29)29 ± (29 - 29)+0.2%✅⬆️
Comparison explanation

Execution-time benchmarks measure the whole time it takes to execute a program, and are intended to measure the one-off costs. Cases where the execution time results for the PR are worse than latest master results are highlighted in **red**. The following thresholds were used for comparing the execution times:

  • Welch test with statistical test for significance of 5%
  • Only results indicating a difference greater than 5% and 5 ms are considered.

Note that these results are based on a single point-in-time result for each branch. For full results, see the dashboard.

Graphs show the p99 interval based on the mean and StdDev of the test run, as well as the mean value of the run (shown as a diamond below the graph).

Duration charts
FakeDbCommand (.NET Framework 4.8)
gantt
    title Execution time (ms) FakeDbCommand (.NET Framework 4.8)
    dateFormat  x
    axisFormat %Q
    todayMarker off
    section Baseline
    This PR (8024) - mean (69ms)  : 67, 70
    master - mean (68ms)  : 67, 70

    section Bailout
    This PR (8024) - mean (72ms)  : 72, 73
    master - mean (72ms)  : 71, 74

    section CallTarget+Inlining+NGEN
    This PR (8024) - mean (1,008ms)  : 967, 1049
    master - mean (1,007ms)  : 968, 1047

Loading
FakeDbCommand (.NET Core 3.1)
gantt
    title Execution time (ms) FakeDbCommand (.NET Core 3.1)
    dateFormat  x
    axisFormat %Q
    todayMarker off
    section Baseline
    This PR (8024) - mean (106ms)  : 103, 108
    master - mean (106ms)  : 103, 109

    section Bailout
    This PR (8024) - mean (107ms)  : 105, 108
    master - mean (107ms)  : 105, 108

    section CallTarget+Inlining+NGEN
    This PR (8024) - mean (743ms)  : 688, 799
    master - mean (743ms)  : 680, 805

Loading
FakeDbCommand (.NET 6)
gantt
    title Execution time (ms) FakeDbCommand (.NET 6)
    dateFormat  x
    axisFormat %Q
    todayMarker off
    section Baseline
    This PR (8024) - mean (93ms)  : 91, 95
    master - mean (93ms)  : 91, 96

    section Bailout
    This PR (8024) - mean (94ms)  : 93, 96
    master - mean (94ms)  : 93, 95

    section CallTarget+Inlining+NGEN
    This PR (8024) - mean (709ms)  : 682, 735
    master - mean (715ms)  : 682, 748

Loading
FakeDbCommand (.NET 8)
gantt
    title Execution time (ms) FakeDbCommand (.NET 8)
    dateFormat  x
    axisFormat %Q
    todayMarker off
    section Baseline
    This PR (8024) - mean (92ms)  : 90, 95
    master - mean (92ms)  : 90, 94

    section Bailout
    This PR (8024) - mean (93ms)  : 91, 95
    master - mean (93ms)  : 92, 95

    section CallTarget+Inlining+NGEN
    This PR (8024) - mean (633ms)  : 612, 654
    master - mean (629ms)  : 615, 644

Loading
HttpMessageHandler (.NET Framework 4.8)
gantt
    title Execution time (ms) HttpMessageHandler (.NET Framework 4.8)
    dateFormat  x
    axisFormat %Q
    todayMarker off
    section Baseline
    This PR (8024) - mean (194ms)  : 190, 198
    master - mean (194ms)  : 190, 198

    section Bailout
    This PR (8024) - mean (197ms)  : 194, 200
    master - mean (198ms)  : 194, 201

    section CallTarget+Inlining+NGEN
    This PR (8024) - mean (1,115ms)  : 1064, 1167
    master - mean (1,123ms)  : 1045, 1201

Loading
HttpMessageHandler (.NET Core 3.1)
gantt
    title Execution time (ms) HttpMessageHandler (.NET Core 3.1)
    dateFormat  x
    axisFormat %Q
    todayMarker off
    section Baseline
    This PR (8024) - mean (277ms)  : 273, 281
    master - mean (277ms)  : 270, 283

    section Bailout
    This PR (8024) - mean (278ms)  : 273, 282
    master - mean (277ms)  : 274, 280

    section CallTarget+Inlining+NGEN
    This PR (8024) - mean (926ms)  : 878, 974
    master - mean (926ms)  : 877, 975

Loading
HttpMessageHandler (.NET 6)
gantt
    title Execution time (ms) HttpMessageHandler (.NET 6)
    dateFormat  x
    axisFormat %Q
    todayMarker off
    section Baseline
    This PR (8024) - mean (271ms)  : 264, 278
    master - mean (271ms)  : 266, 276

    section Bailout
    This PR (8024) - mean (271ms)  : 266, 275
    master - mean (270ms)  : 267, 274

    section CallTarget+Inlining+NGEN
    This PR (8024) - mean (932ms)  : 906, 957
    master - mean (931ms)  : 905, 958

Loading
HttpMessageHandler (.NET 8)
gantt
    title Execution time (ms) HttpMessageHandler (.NET 8)
    dateFormat  x
    axisFormat %Q
    todayMarker off
    section Baseline
    This PR (8024) - mean (270ms)  : 265, 274
    master - mean (269ms)  : 265, 273

    section Bailout
    This PR (8024) - mean (270ms)  : 266, 274
    master - mean (270ms)  : 267, 274

    section CallTarget+Inlining+NGEN
    This PR (8024) - mean (825ms)  : 806, 845
    master - mean (826ms)  : 805, 847

Loading

@pr-commenter
Copy link

pr-commenter bot commented Dec 31, 2025

Benchmarks

Benchmark execution time: 2025-12-31 19:48:43

Comparing candidate commit 68a09e2 in PR branch steven/fix-get-iast-null-ref with baseline commit 4fb09d3 in branch master.

Found 11 performance improvements and 4 performance regressions! Performance is the same for 157 metrics, 14 unstable metrics.

scenario:Benchmarks.Trace.ActivityBenchmark.StartStopWithChild net6.0

  • 🟥 throughput [-7798.080op/s; -5283.397op/s] or [-8.508%; -5.764%]

scenario:Benchmarks.Trace.Asm.AppSecBodyBenchmark.AllCycleSimpleBody netcoreapp3.1

  • 🟩 execution_time [-20.851ms; -14.493ms] or [-9.910%; -6.888%]

scenario:Benchmarks.Trace.AspNetCoreBenchmark.SendRequest net6.0

  • 🟥 execution_time [+20.118ms; +21.304ms] or [+21.278%; +22.532%]

scenario:Benchmarks.Trace.CIVisibilityProtocolWriterBenchmark.WriteAndFlushEnrichedTraces net472

  • 🟩 execution_time [-34.379ms; -29.485ms] or [-15.772%; -13.527%]
  • 🟩 throughput [+89.328op/s; +116.050op/s] or [+8.109%; +10.535%]

scenario:Benchmarks.Trace.CIVisibilityProtocolWriterBenchmark.WriteAndFlushEnrichedTraces net6.0

  • 🟩 execution_time [-45.000ms; -40.951ms] or [-23.501%; -21.386%]
  • 🟩 throughput [+262.534op/s; +292.906op/s] or [+19.616%; +21.885%]

scenario:Benchmarks.Trace.CharSliceBenchmark.OptimizedCharSliceWithPool net6.0

  • 🟩 execution_time [-68.677µs; -61.497µs] or [-6.210%; -5.561%]
  • 🟩 throughput [+53.446op/s; +59.639op/s] or [+5.911%; +6.595%]

scenario:Benchmarks.Trace.ElasticsearchBenchmark.CallElasticsearch netcoreapp3.1

  • 🟥 execution_time [+12.200ms; +15.054ms] or [+6.203%; +7.653%]
  • 🟩 throughput [+27074.275op/s; +33578.875op/s] or [+6.167%; +7.648%]

scenario:Benchmarks.Trace.ILoggerBenchmark.EnrichedLog net6.0

  • 🟩 execution_time [-17.092ms; -11.423ms] or [-8.064%; -5.389%]

scenario:Benchmarks.Trace.Log4netBenchmark.EnrichedLog netcoreapp3.1

  • 🟩 execution_time [-31.508ms; -29.702ms] or [-15.919%; -15.006%]

scenario:Benchmarks.Trace.NLogBenchmark.EnrichedLog netcoreapp3.1

  • 🟩 execution_time [-16.185ms; -12.114ms] or [-7.954%; -5.954%]

scenario:Benchmarks.Trace.SpanBenchmark.StartFinishScope netcoreapp3.1

  • 🟥 execution_time [+12.708ms; +17.865ms] or [+6.442%; +9.056%]

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

identified-by:telemetry status:work-in-progress Actively worked on. If this is a PR, no review needed yet. WIP. type:bug

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants