[Config Registry] 8/8 Add step for release

[anna-git]

Summary of changes

Reason for change

Implementation details

Test coverage

Other details

[datadog-datadog-prod-us1]

⚠️ Tests

✨ Fix all issues with Cursor

⚠️ Warnings

🧪 3 Tests failed

TestCookieNameRequest from Datadog.Trace.Security.IntegrationTests.Iast.AspNetCore5IastTestsSpanTelemetryIastEnabled (Datadog) (Fix with Cursor)

Results do not match.
Differences:
Received: Iast.CookieName.AspNetCore5.TelemetryEnabled.received.txt
Verified: Iast.CookieName.AspNetCore5.TelemetryEnabled.verified.txt
Compare Result:
- [
+ []
-   {
-     TraceId: Id_1,
-     SpanId: Id_2,
...

TestIastMetaStructTagSizeExceeded from Datadog.Trace.Security.IntegrationTests.Iast.AspNetCore5IastTestsSpanTelemetryIastEnabled (Datadog) (Fix with Cursor)

Results do not match.
Differences:
Received: Iast.MetaStructTagSizeExceeded.AspNetCore5.TelemetryEnabled.received.txt
Verified: Iast.MetaStructTagSizeExceeded.AspNetCore5.TelemetryEnabled.verified.txt
Compare Result:
- [
+ []
-   {
-     TraceId: Id_1,
-     SpanId: Id_2,
...

TestIastTelemetry from Datadog.Trace.Security.IntegrationTests.Iast.AspNetCore5IastTestsSpanTelemetryIastEnabled (Datadog) (Fix with Cursor)

Unable to determine port application is listening on

ℹ️ Info

❄️ No new flaky tests detected

_{This comment will be updated automatically if new data arrives.
🔗 Commit SHA: bae903c | Docs | Datadog PR Page | Was this helpful? Give us feedback!}

[dd-trace-dotnet-ci-bot]

Execution-Time Benchmarks Report ⏱️

Execution-time results for samples comparing This PR (8009) and master.

✅ No regressions detected - check the details below

Full Metrics Comparison

FakeDbCommand

Metric	Master (Mean ± 95% CI)	Current (Mean ± 95% CI)	Change	Status
.NET Framework 4.8 - Baseline
duration	76.61 ± (76.54 - 76.95) ms	76.51 ± (76.38 - 76.70) ms	-0.1%	✅
.NET Framework 4.8 - Bailout
duration	80.86 ± (80.77 - 81.19) ms	81.20 ± (81.05 - 81.45) ms	+0.4%	✅⬆️
.NET Framework 4.8 - CallTarget+Inlining+NGEN
duration	1064.34 ± (1065.64 - 1074.35) ms	1087.80 ± (1089.05 - 1096.17) ms	+2.2%	✅⬆️
.NET Core 3.1 - Baseline
process.internal_duration_ms	23.34 ± (23.28 - 23.40) ms	23.57 ± (23.51 - 23.63) ms	+1.0%	✅⬆️
process.time_to_main_ms	89.23 ± (89.02 - 89.44) ms	90.41 ± (90.20 - 90.62) ms	+1.3%	✅⬆️
runtime.dotnet.exceptions.count	0 ± (0 - 0)	0 ± (0 - 0)	+0.0%	✅
runtime.dotnet.mem.committed	10.89 ± (10.88 - 10.89) MB	10.92 ± (10.91 - 10.92) MB	+0.3%	✅⬆️
runtime.dotnet.threads.count	12 ± (12 - 12)	12 ± (12 - 12)	+0.0%	✅
.NET Core 3.1 - Bailout
process.internal_duration_ms	23.43 ± (23.37 - 23.50) ms	23.29 ± (23.22 - 23.36) ms	-0.6%	✅
process.time_to_main_ms	91.14 ± (90.92 - 91.36) ms	91.11 ± (90.87 - 91.36) ms	-0.0%	✅
runtime.dotnet.exceptions.count	0 ± (0 - 0)	0 ± (0 - 0)	+0.0%	✅
runtime.dotnet.mem.committed	10.92 ± (10.91 - 10.92) MB	10.96 ± (10.95 - 10.96) MB	+0.4%	✅⬆️
runtime.dotnet.threads.count	13 ± (13 - 13)	13 ± (13 - 13)	+0.0%	✅
.NET Core 3.1 - CallTarget+Inlining+NGEN
process.internal_duration_ms	242.87 ± (238.73 - 247.00) ms	241.22 ± (237.37 - 245.06) ms	-0.7%	✅
process.time_to_main_ms	508.36 ± (507.59 - 509.12) ms	517.33 ± (516.52 - 518.13) ms	+1.8%	✅⬆️
runtime.dotnet.exceptions.count	0 ± (0 - 0)	0 ± (0 - 0)	+0.0%	✅
runtime.dotnet.mem.committed	48.25 ± (48.23 - 48.27) MB	48.50 ± (48.48 - 48.53) MB	+0.5%	✅⬆️
runtime.dotnet.threads.count	28 ± (28 - 28)	28 ± (28 - 28)	-0.0%	✅
.NET 6 - Baseline
process.internal_duration_ms	22.27 ± (22.22 - 22.32) ms	22.11 ± (22.06 - 22.16) ms	-0.7%	✅
process.time_to_main_ms	78.88 ± (78.68 - 79.07) ms	77.94 ± (77.74 - 78.14) ms	-1.2%	✅
runtime.dotnet.exceptions.count	0 ± (0 - 0)	0 ± (0 - 0)	+0.0%	✅
runtime.dotnet.mem.committed	10.60 ± (10.60 - 10.60) MB	10.69 ± (10.68 - 10.71) MB	+0.9%	✅⬆️
runtime.dotnet.threads.count	10 ± (10 - 10)	10 ± (10 - 10)	+0.0%	✅
.NET 6 - Bailout
process.internal_duration_ms	22.07 ± (22.01 - 22.14) ms	22.10 ± (22.04 - 22.15) ms	+0.1%	✅⬆️
process.time_to_main_ms	79.48 ± (79.28 - 79.67) ms	79.06 ± (78.86 - 79.27) ms	-0.5%	✅
runtime.dotnet.exceptions.count	0 ± (0 - 0)	0 ± (0 - 0)	+0.0%	✅
runtime.dotnet.mem.committed	10.69 ± (10.68 - 10.69) MB	10.70 ± (10.69 - 10.71) MB	+0.1%	✅⬆️
runtime.dotnet.threads.count	11 ± (11 - 11)	11 ± (11 - 11)	+0.0%	✅
.NET 6 - CallTarget+Inlining+NGEN
process.internal_duration_ms	236.63 ± (232.29 - 240.96) ms	233.29 ± (229.27 - 237.31) ms	-1.4%	✅
process.time_to_main_ms	486.97 ± (486.09 - 487.84) ms	492.49 ± (491.71 - 493.28) ms	+1.1%	✅⬆️
runtime.dotnet.exceptions.count	0 ± (0 - 0)	0 ± (0 - 0)	+0.0%	✅
runtime.dotnet.mem.committed	48.95 ± (48.94 - 48.97) MB	49.16 ± (49.14 - 49.19) MB	+0.4%	✅⬆️
runtime.dotnet.threads.count	28 ± (28 - 28)	28 ± (28 - 28)	+0.0%	✅
.NET 8 - Baseline
process.internal_duration_ms	20.17 ± (20.13 - 20.21) ms	20.22 ± (20.18 - 20.27) ms	+0.3%	✅⬆️
process.time_to_main_ms	76.78 ± (76.62 - 76.95) ms	76.75 ± (76.58 - 76.93) ms	-0.0%	✅
runtime.dotnet.exceptions.count	0 ± (0 - 0)	0 ± (0 - 0)	+0.0%	✅
runtime.dotnet.mem.committed	7.65 ± (7.64 - 7.65) MB	7.64 ± (7.64 - 7.65) MB	-0.1%	✅
runtime.dotnet.threads.count	10 ± (10 - 10)	10 ± (10 - 10)	+0.0%	✅
.NET 8 - Bailout
process.internal_duration_ms	20.20 ± (20.14 - 20.26) ms	20.30 ± (20.23 - 20.36) ms	+0.5%	✅⬆️
process.time_to_main_ms	77.63 ± (77.45 - 77.81) ms	78.21 ± (78.02 - 78.41) ms	+0.8%	✅⬆️
runtime.dotnet.exceptions.count	0 ± (0 - 0)	0 ± (0 - 0)	+0.0%	✅
runtime.dotnet.mem.committed	7.71 ± (7.70 - 7.72) MB	7.71 ± (7.70 - 7.72) MB	+0.0%	✅⬆️
runtime.dotnet.threads.count	11 ± (11 - 11)	11 ± (11 - 11)	+0.0%	✅
.NET 8 - CallTarget+Inlining+NGEN
process.internal_duration_ms	194.64 ± (193.93 - 195.35) ms	193.26 ± (192.52 - 193.99) ms	-0.7%	✅
process.time_to_main_ms	467.46 ± (466.64 - 468.28) ms	472.44 ± (471.67 - 473.21) ms	+1.1%	✅⬆️
runtime.dotnet.exceptions.count	0 ± (0 - 0)	0 ± (0 - 0)	+0.0%	✅
runtime.dotnet.mem.committed	36.80 ± (36.75 - 36.84) MB	36.96 ± (36.92 - 37.00) MB	+0.4%	✅⬆️
runtime.dotnet.threads.count	27 ± (27 - 27)	27 ± (27 - 27)	-0.0%	✅

HttpMessageHandler

Metric	Master (Mean ± 95% CI)	Current (Mean ± 95% CI)	Change	Status
.NET Framework 4.8 - Baseline
duration	192.37 ± (192.17 - 192.99) ms	191.95 ± (191.76 - 192.51) ms	-0.2%	✅
.NET Framework 4.8 - Bailout
duration	195.89 ± (195.81 - 196.67) ms	195.88 ± (195.79 - 196.30) ms	-0.0%	✅
.NET Framework 4.8 - CallTarget+Inlining+NGEN
duration	1111.31 ± (1114.98 - 1122.32) ms	1138.44 ± (1140.92 - 1150.25) ms	+2.4%	✅⬆️
.NET Core 3.1 - Baseline
process.internal_duration_ms	186.10 ± (185.70 - 186.50) ms	187.61 ± (187.30 - 187.92) ms	+0.8%	✅⬆️
process.time_to_main_ms	80.75 ± (80.51 - 81.00) ms	80.89 ± (80.69 - 81.10) ms	+0.2%	✅⬆️
runtime.dotnet.exceptions.count	3 ± (3 - 3)	3 ± (3 - 3)	+0.0%	✅
runtime.dotnet.mem.committed	16.18 ± (16.15 - 16.20) MB	16.12 ± (16.09 - 16.14) MB	-0.4%	✅
runtime.dotnet.threads.count	20 ± (19 - 20)	20 ± (20 - 20)	+0.5%	✅⬆️
.NET Core 3.1 - Bailout
process.internal_duration_ms	185.55 ± (185.27 - 185.84) ms	186.17 ± (185.92 - 186.42) ms	+0.3%	✅⬆️
process.time_to_main_ms	82.03 ± (81.90 - 82.16) ms	81.94 ± (81.80 - 82.09) ms	-0.1%	✅
runtime.dotnet.exceptions.count	3 ± (3 - 3)	3 ± (3 - 3)	+0.0%	✅
runtime.dotnet.mem.committed	16.21 ± (16.18 - 16.24) MB	16.15 ± (16.12 - 16.18) MB	-0.4%	✅
runtime.dotnet.threads.count	21 ± (21 - 21)	21 ± (21 - 21)	-0.1%	✅
.NET Core 3.1 - CallTarget+Inlining+NGEN
process.internal_duration_ms	435.61 ± (433.20 - 438.02) ms	426.84 ± (423.88 - 429.79) ms	-2.0%	✅
process.time_to_main_ms	471.27 ± (470.71 - 471.82) ms	478.44 ± (477.87 - 479.00) ms	+1.5%	✅⬆️
runtime.dotnet.exceptions.count	3 ± (3 - 3)	3 ± (3 - 3)	+0.0%	✅
runtime.dotnet.mem.committed	58.62 ± (58.52 - 58.73) MB	59.03 ± (58.92 - 59.14) MB	+0.7%	✅⬆️
runtime.dotnet.threads.count	29 ± (29 - 29)	29 ± (29 - 30)	+0.0%	✅⬆️
.NET 6 - Baseline
process.internal_duration_ms	191.86 ± (191.42 - 192.31) ms	191.96 ± (191.59 - 192.33) ms	+0.1%	✅⬆️
process.time_to_main_ms	70.20 ± (69.98 - 70.42) ms	69.98 ± (69.80 - 70.16) ms	-0.3%	✅
runtime.dotnet.exceptions.count	4 ± (4 - 4)	4 ± (4 - 4)	+0.0%	✅
runtime.dotnet.mem.committed	16.21 ± (16.12 - 16.31) MB	16.07 ± (15.93 - 16.21) MB	-0.9%	✅
runtime.dotnet.threads.count	18 ± (18 - 19)	19 ± (18 - 19)	+0.8%	✅⬆️
.NET 6 - Bailout
process.internal_duration_ms	189.64 ± (189.43 - 189.86) ms	190.13 ± (189.83 - 190.44) ms	+0.3%	✅⬆️
process.time_to_main_ms	70.68 ± (70.55 - 70.81) ms	70.71 ± (70.57 - 70.84) ms	+0.0%	✅⬆️
runtime.dotnet.exceptions.count	4 ± (4 - 4)	4 ± (4 - 4)	+0.0%	✅
runtime.dotnet.mem.committed	15.84 ± (15.67 - 16.01) MB	16.15 ± (16.00 - 16.31) MB	+2.0%	✅⬆️
runtime.dotnet.threads.count	19 ± (19 - 19)	19 ± (19 - 19)	+0.9%	✅⬆️
.NET 6 - CallTarget+Inlining+NGEN
process.internal_duration_ms	447.62 ± (445.05 - 450.20) ms	442.60 ± (439.57 - 445.63) ms	-1.1%	✅
process.time_to_main_ms	449.21 ± (448.73 - 449.69) ms	456.42 ± (455.84 - 457.00) ms	+1.6%	✅⬆️
runtime.dotnet.exceptions.count	4 ± (4 - 4)	4 ± (4 - 4)	+0.0%	✅
runtime.dotnet.mem.committed	59.01 ± (58.89 - 59.12) MB	58.89 ± (58.77 - 59.01) MB	-0.2%	✅
runtime.dotnet.threads.count	29 ± (29 - 29)	29 ± (29 - 29)	+0.0%	✅⬆️
.NET 8 - Baseline
process.internal_duration_ms	189.17 ± (188.85 - 189.50) ms	189.17 ± (188.86 - 189.47) ms	-0.0%	✅
process.time_to_main_ms	69.87 ± (69.66 - 70.07) ms	69.76 ± (69.53 - 69.98) ms	-0.2%	✅
runtime.dotnet.exceptions.count	4 ± (4 - 4)	4 ± (4 - 4)	+0.0%	✅
runtime.dotnet.mem.committed	11.76 ± (11.73 - 11.79) MB	11.80 ± (11.77 - 11.83) MB	+0.4%	✅⬆️
runtime.dotnet.threads.count	18 ± (18 - 18)	18 ± (18 - 18)	-0.5%	✅
.NET 8 - Bailout
process.internal_duration_ms	188.44 ± (188.17 - 188.71) ms	190.76 ± (190.27 - 191.25) ms	+1.2%	✅⬆️
process.time_to_main_ms	70.62 ± (70.48 - 70.76) ms	71.23 ± (71.04 - 71.41) ms	+0.9%	✅⬆️
runtime.dotnet.exceptions.count	4 ± (4 - 4)	4 ± (4 - 4)	+0.0%	✅
runtime.dotnet.mem.committed	11.75 ± (11.68 - 11.81) MB	11.79 ± (11.77 - 11.82) MB	+0.4%	✅⬆️
runtime.dotnet.threads.count	19 ± (18 - 19)	19 ± (19 - 19)	+3.1%	✅⬆️
.NET 8 - CallTarget+Inlining+NGEN
process.internal_duration_ms	364.09 ± (362.59 - 365.58) ms	368.28 ± (366.87 - 369.70) ms	+1.2%	✅⬆️
process.time_to_main_ms	433.41 ± (432.78 - 434.03) ms	443.10 ± (442.40 - 443.79) ms	+2.2%	✅⬆️
runtime.dotnet.exceptions.count	4 ± (4 - 4)	4 ± (4 - 4)	+0.0%	✅
runtime.dotnet.mem.committed	48.14 ± (48.09 - 48.19) MB	48.39 ± (48.37 - 48.42) MB	+0.5%	✅⬆️
runtime.dotnet.threads.count	29 ± (29 - 29)	29 ± (29 - 29)	+0.0%	✅⬆️

Comparison explanation

Execution-time benchmarks measure the whole time it takes to execute a program, and are intended to measure the one-off costs. Cases where the execution time results for the PR are worse than latest master results are highlighted in **red**. The following thresholds were used for comparing the execution times:

• Welch test with statistical test for significance of 5%
• Only results indicating a difference greater than 5% and 5 ms are considered.

Note that these results are based on a single point-in-time result for each branch. For full results, see the dashboard.

Graphs show the p99 interval based on the mean and StdDev of the test run, as well as the mean value of the run (shown as a diamond below the graph).

Duration charts

FakeDbCommand (.NET Framework 4.8)

gantt
    title Execution time (ms) FakeDbCommand (.NET Framework 4.8)
    dateFormat  x
    axisFormat %Q
    todayMarker off
    section Baseline
    This PR (8009) - mean (77ms)  : 74, 79
    master - mean (77ms)  : 74, 80

    section Bailout
    This PR (8009) - mean (81ms)  : 79, 83
    master - mean (81ms)  : 78, 84

    section CallTarget+Inlining+NGEN
    This PR (8009) - mean (1,093ms)  : 1042, 1143
    master - mean (1,070ms)  : 1007, 1133

Loading

FakeDbCommand (.NET Core 3.1)

gantt
    title Execution time (ms) FakeDbCommand (.NET Core 3.1)
    dateFormat  x
    axisFormat %Q
    todayMarker off
    section Baseline
    This PR (8009) - mean (121ms)  : 118, 125
    master - mean (120ms)  : 115, 124

    section Bailout
    This PR (8009) - mean (122ms)  : 119, 124
    master - mean (122ms)  : 118, 125

    section CallTarget+Inlining+NGEN
    This PR (8009) - mean (798ms)  : 743, 853
    master - mean (792ms)  : 725, 859

Loading

FakeDbCommand (.NET 6)

gantt
    title Execution time (ms) FakeDbCommand (.NET 6)
    dateFormat  x
    axisFormat %Q
    todayMarker off
    section Baseline
    This PR (8009) - mean (107ms)  : 103, 111
    master - mean (108ms)  : 103, 112

    section Bailout
    This PR (8009) - mean (108ms)  : 105, 110
    master - mean (108ms)  : 106, 110

    section CallTarget+Inlining+NGEN
    This PR (8009) - mean (755ms)  : 685, 826
    master - mean (758ms)  : 673, 843

Loading

FakeDbCommand (.NET 8)

gantt
    title Execution time (ms) FakeDbCommand (.NET 8)
    dateFormat  x
    axisFormat %Q
    todayMarker off
    section Baseline
    This PR (8009) - mean (105ms)  : 102, 108
    master - mean (105ms)  : 102, 108

    section Bailout
    This PR (8009) - mean (107ms)  : 103, 110
    master - mean (106ms)  : 103, 109

    section CallTarget+Inlining+NGEN
    This PR (8009) - mean (702ms)  : 674, 730
    master - mean (701ms)  : 679, 723

Loading

HttpMessageHandler (.NET Framework 4.8)

gantt
    title Execution time (ms) HttpMessageHandler (.NET Framework 4.8)
    dateFormat  x
    axisFormat %Q
    todayMarker off
    section Baseline
    This PR (8009) - mean (192ms)  : 188, 196
    master - mean (193ms)  : 189, 196

    section Bailout
    This PR (8009) - mean (196ms)  : 194, 199
    master - mean (196ms)  : 192, 200

    section CallTarget+Inlining+NGEN
    This PR (8009) - mean (1,146ms)  : 1078, 1214
    master - mean (1,119ms)  : 1066, 1171

Loading

HttpMessageHandler (.NET Core 3.1)

gantt
    title Execution time (ms) HttpMessageHandler (.NET Core 3.1)
    dateFormat  x
    axisFormat %Q
    todayMarker off
    section Baseline
    This PR (8009) - mean (277ms)  : 272, 282
    master - mean (276ms)  : 269, 283

    section Bailout
    This PR (8009) - mean (276ms)  : 273, 279
    master - mean (276ms)  : 272, 279

    section CallTarget+Inlining+NGEN
    This PR (8009) - mean (934ms)  : 887, 982
    master - mean (931ms)  : 890, 972

Loading

HttpMessageHandler (.NET 6)

gantt
    title Execution time (ms) HttpMessageHandler (.NET 6)
    dateFormat  x
    axisFormat %Q
    todayMarker off
    section Baseline
    This PR (8009) - mean (270ms)  : 265, 275
    master - mean (270ms)  : 262, 278

    section Bailout
    This PR (8009) - mean (269ms)  : 265, 273
    master - mean (268ms)  : 265, 272

    section CallTarget+Inlining+NGEN
    This PR (8009) - mean (928ms)  : 885, 971
    master - mean (927ms)  : 889, 964

Loading

HttpMessageHandler (.NET 8)

gantt
    title Execution time (ms) HttpMessageHandler (.NET 8)
    dateFormat  x
    axisFormat %Q
    todayMarker off
    section Baseline
    This PR (8009) - mean (268ms)  : 265, 272
    master - mean (269ms)  : 264, 273

    section Bailout
    This PR (8009) - mean (271ms)  : 264, 279
    master - mean (269ms)  : 265, 273

    section CallTarget+Inlining+NGEN
    This PR (8009) - mean (842ms)  : 813, 871
    master - mean (828ms)  : 810, 846

Loading