Skip to content

chore: fix test validation messages

ea68e83
Select commit
Loading
Failed to load commit list.
Sign in for the full log view
Merged

feat: Add validator for benchmarks that contains null runtime #2771

chore: fix test validation messages
ea68e83
Select commit
Loading
Failed to load commit list.
GitHub Actions / report succeeded Jun 15, 2025 in 1s

report ✅

Tests passed successfully

Report Passed Failed Skipped Time
test-linux-trx-15659621179/TestResults/linux(x64)-exporters-net8.0.trx 51✅ 6s 864ms
test-linux-trx-15659621179/TestResults/linux(x64)-integration-net8.0.trx 235✅ 17⚪ 27m 03s 277ms
test-linux-trx-15659621179/TestResults/linux(x64)-unit-net8.0.trx 925✅ 8⚪ 3m 48s 608ms
test-macos(arm64)-trx-15659621179/TestResults/macos(arm64)-exporters-net8.0.trx 51✅ 6s 737ms
test-macos(arm64)-trx-15659621179/TestResults/macos(arm64)-integration-net8.0.trx 233✅ 17⚪ 15m 10s 460ms
test-macos(arm64)-trx-15659621179/TestResults/macos(arm64)-unit-net8.0.trx 925✅ 8⚪ 2m 39s 936ms
test-macos(x64)-trx-15659621179/TestResults/macos(x64)-exporters-net8.0.trx 51✅ 8s 831ms
test-macos(x64)-trx-15659621179/TestResults/macos(x64)-integration-net8.0.trx 237✅ 17⚪ 33m 52s 422ms
test-macos(x64)-trx-15659621179/TestResults/macos(x64)-unit-net8.0.trx 925✅ 8⚪ 4m 55s 024ms
test-windows-core-trx-15659621179/TestResults/windows(x64)-integration-net8.0.trx 247✅ 7⚪ 25m 54s 888ms
test-windows-full-trx-15659621179/TestResults/windows(x64)-integration-net462.trx 271✅ 13⚪ 24m 56s 792ms

✅ test-linux-trx-15659621179/TestResults/linux(x64)-exporters-net8.0.trx

51 tests were completed in 6s 864ms with 51 passed, 0 failed and 0 skipped.

Test suite Passed Failed Skipped Time
BenchmarkDotNet.Exporters.Plotting.Tests.ScottPlotExporterTests 51✅ 6s 271ms

✅ test-linux-trx-15659621179/TestResults/linux(x64)-integration-net8.0.trx

252 tests were completed in 27m 03s 277ms with 235 passed, 0 failed and 17 skipped.

Test suite Passed Failed Skipped Time
BenchmarkDotNet.IntegrationTests.MemoryDiagnoserTests 11✅ 4m 03s 288ms
BenchmarkDotNet.IntegrationTests.ArgumentsTests 59✅ 3m 28s 193ms
BenchmarkDotNet.IntegrationTests.ThreadingDiagnoserTests 4✅ 2m 27s 393ms
BenchmarkDotNet.IntegrationTests.BenchmarkSwitcherTest 21✅ 1m 46s 673ms
BenchmarkDotNet.IntegrationTests.ParamsTests 12✅ 1m 20s 492ms
BenchmarkDotNet.IntegrationTests.ExceptionHandlingTests 17✅ 1m 14s 129ms
BenchmarkDotNet.IntegrationTests.NativeAotTests 1✅ 56s 660ms
BenchmarkDotNet.IntegrationTests.NuGetReferenceTests 1✅ 1⚪ 53s 117ms
BenchmarkDotNet.IntegrationTests.WasmTests 1✅ 52s 702ms
BenchmarkDotNet.IntegrationTests.MonoTests 1✅ 49s 797ms
BenchmarkDotNet.IntegrationTests.AllSetupAndCleanupTest 7✅ 47s 269ms
BenchmarkDotNet.IntegrationTests.CustomBuildConfigurationTests 1✅ 47s 104ms
BenchmarkDotNet.IntegrationTests.ParamSourceTests 11✅ 42s 954ms
BenchmarkDotNet.IntegrationTests.GcModeTests 6✅ 40s 085ms
BenchmarkDotNet.IntegrationTests.DotMemoryTests 1✅ 39s 566ms
BenchmarkDotNet.IntegrationTests.RunStrategyTests 1✅ 36s 882ms
BenchmarkDotNet.IntegrationTests.DisassemblyDiagnoserTests 4✅ 28s 041ms
BenchmarkDotNet.IntegrationTests.EventProcessorTests 6✅ 21s 121ms
BenchmarkDotNet.IntegrationTests.EnvironmentVariablesTests 3✅ 19s 988ms
BenchmarkDotNet.IntegrationTests.DotTraceTests 1✅ 19s 536ms
BenchmarkDotNet.IntegrationTests.AsyncBenchmarksTests 2✅ 16s 276ms
BenchmarkDotNet.IntegrationTests.ExceptionDiagnoserTests 1✅ 15s 023ms
BenchmarkDotNet.IntegrationTests.DryRunTests 2✅ 13s 606ms
BenchmarkDotNet.IntegrationTests.ProcessorArchitectureTest 2✅ 13s 233ms
BenchmarkDotNet.IntegrationTests.StandardErrorTests 2✅ 13s 187ms
BenchmarkDotNet.IntegrationTests.ValuesReturnedByBenchmarkTest 2✅ 11s 336ms
BenchmarkDotNet.IntegrationTests.ReferencesTests 2✅ 9s 817ms
BenchmarkDotNet.IntegrationTests.PriorityTests 1✅ 7s 897ms
BenchmarkDotNet.IntegrationTests.BaselineRatioColumnTest 1✅ 7s 291ms
BenchmarkDotNet.IntegrationTests.BaselineRatioColumnWithLongParamsTest 1✅ 7s 270ms
BenchmarkDotNet.IntegrationTests.StatResultExtenderTests 1✅ 7s 081ms
BenchmarkDotNet.IntegrationTests.FailingProcessSpawnTests 1✅ 6s 972ms
BenchmarkDotNet.IntegrationTests.EngineTests 3✅ 6s 946ms
BenchmarkDotNet.IntegrationTests.BaselineRatioResultExtenderNoBaselineTest 1✅ 6s 917ms
BenchmarkDotNet.IntegrationTests.SetupAndCleanupTests 1✅ 6s 796ms
BenchmarkDotNet.IntegrationTests.AppConfigTests 1✅ 6s 737ms
BenchmarkDotNet.IntegrationTests.WakeLockTests 5✅ 4⚪ 6s 699ms
BenchmarkDotNet.IntegrationTests.AttributesTests 1✅ 6s 679ms
BenchmarkDotNet.IntegrationTests.ToolchainTest 1✅ 6s 668ms
BenchmarkDotNet.IntegrationTests.LanguageVersionTests 1✅ 6s 643ms
BenchmarkDotNet.IntegrationTests.CustomEngineTests 1✅ 6s 639ms
BenchmarkDotNet.IntegrationTests.JitRuntimeValidationTest 3✅ 1⚪ 6s 474ms
BenchmarkDotNet.IntegrationTests.FSharpTests 1✅ 4s 650ms
BenchmarkDotNet.IntegrationTests.AssemblyConfigTests 1✅ 4s 629ms
BenchmarkDotNet.IntegrationTests.BuildTimeoutTests 1✅ 1s 142ms
BenchmarkDotNet.IntegrationTests.InProcessEmitTest 6✅ 1⚪ 258ms
BenchmarkDotNet.IntegrationTests.InProcessTest 11✅ 140ms
BenchmarkDotNet.IntegrationTests.ValidatorsTest 2✅ 22ms
BenchmarkDotNet.IntegrationTests.BaselineRatioResultExtenderErrorTest 1✅ 9ms
BenchmarkDotNet.IntegrationTests.ExporterIOTests 3✅ 1⚪ 4ms
BenchmarkDotNet.IntegrationTests.JitOptimizationsTests 2✅ 3ms
BenchmarkDotNet.IntegrationTests.PowerManagementApplierTests 2⚪ 2ms
BenchmarkDotNet.IntegrationTests.ProcessPropertiesTests 2⚪ 2ms
BenchmarkDotNet.IntegrationTests.ExtraAttributesForEntryMethodTests 1⚪ 1ms
BenchmarkDotNet.IntegrationTests.LargeAddressAwareTest 1⚪ 1ms
BenchmarkDotNet.IntegrationTests.MultipleRuntimesTest 1⚪ 1ms
BenchmarkDotNet.IntegrationTests.PathTooLongTests 1⚪ 1ms
BenchmarkDotNet.IntegrationTests.RoslynToolchainTest 1⚪ 1ms
BenchmarkDotNet.IntegrationTests.GlobalSetupAttributeInvalidMethodTest 1✅ 1ms
BenchmarkDotNet.IntegrationTests.IntegrationTestSetupTests 1✅ 1ms

✅ test-linux-trx-15659621179/TestResults/linux(x64)-unit-net8.0.trx

933 tests were completed in 3m 48s 608ms with 925 passed, 0 failed and 8 skipped.

Test suite Passed Failed Skipped Time
BenchmarkDotNet.Tests.Running.RunningEmptyBenchmarkTests 19✅ 3m 47s 714ms
BenchmarkDotNet.Tests.Engine.EngineFactoryTests 11✅ 3s 009ms
BenchmarkDotNet.Tests.Columns.RatioColumnTest 1✅ 2s 880ms
BenchmarkDotNet.Tests.Exporters.MarkdownExporterVerifyTests 17✅ 2s 198ms
BenchmarkDotNet.Tests.Exporters.CommonExporterVerifyTests 3✅ 1s 955ms
BenchmarkDotNet.Tests.Perfonar.PerfonarTests 14✅ 295ms
BenchmarkDotNet.Tests.ConfigParserTests 96✅ 3⚪ 270ms
BenchmarkDotNet.Tests.Validators.ReturnValueValidatorTests 15✅ 172ms
BenchmarkDotNet.Tests.Reports.DefaultColumnProvidersTests 3✅ 134ms
BenchmarkDotNet.Tests.Validators.ExecutionValidatorTests 26✅ 74ms
BenchmarkDotNet.Tests.Configs.ImmutableConfigTests 38✅ 2⚪ 71ms
BenchmarkDotNet.Tests.Reports.SummaryTableTests 22✅ 70ms
BenchmarkDotNet.Tests.Mathematics.StatisticsTests 9✅ 59ms
BenchmarkDotNet.Tests.CodeGeneratorTests 2✅ 54ms
BenchmarkDotNet.Tests.Analysers.OutliersAnalyserTests 25✅ 52ms
BenchmarkDotNet.Tests.CsProjGeneratorTests 10✅ 51ms
BenchmarkDotNet.Tests.CorrectionsSuggesterTests 10✅ 44ms
BenchmarkDotNet.Tests.TypeFilterTests 16✅ 44ms
BenchmarkDotNet.Tests.BuildResultTests 4✅ 44ms
BenchmarkDotNet.Tests.Configs.JobTests 13✅ 41ms
BenchmarkDotNet.Tests.Validators.ParamsValidatorTests 32✅ 33ms
BenchmarkDotNet.Tests.Engine.EngineResultStageTests 1✅ 29ms
BenchmarkDotNet.Tests.Attributes.ParamsAllValuesVerifyTests 7✅ 28ms
BenchmarkDotNet.Tests.Validators.CompilationValidatorTests 27✅ 24ms
BenchmarkDotNet.Tests.Detectors.Cpu.LinuxCpuInfoParserTests 11✅ 22ms
BenchmarkDotNet.Tests.Reports.RatioPrecisionTests 3✅ 20ms
BenchmarkDotNet.Tests.Mathematics.RankTests 1✅ 17ms
BenchmarkDotNet.Tests.FullNameProviderTests 20✅ 17ms
BenchmarkDotNet.Tests.MonoDisassemblyOutputParserTests 4✅ 17ms
BenchmarkDotNet.Tests.Reports.ColumnTests 1✅ 16ms
BenchmarkDotNet.Tests.Detectors.Cpu.WmicCpuInfoParserTests 5✅ 16ms
BenchmarkDotNet.Tests.Running.BenchmarkConverterTests 11✅ 15ms
BenchmarkDotNet.Tests.Engine.EngineActualStageTests 3✅ 15ms
BenchmarkDotNet.Tests.Reports.RatioStyleTests 2✅ 13ms
BenchmarkDotNet.Tests.Exporters.XmlSerializerTests 23✅ 13ms
BenchmarkDotNet.Tests.GenericBuilderTests 6✅ 13ms
BenchmarkDotNet.Tests.GlobFilterTests 20✅ 13ms
BenchmarkDotNet.Tests.Configs.ConfigPerMethodTests 4✅ 12ms
BenchmarkDotNet.Tests.Validators.DeferredExecutionValidatorTests 7✅ 12ms
BenchmarkDotNet.Tests.Order.DefaultOrdererTests 2✅ 11ms
BenchmarkDotNet.Tests.Columns.StatisticalTestColumnTests 5✅ 11ms
BenchmarkDotNet.Tests.ReflectionTests 8✅ 11ms
BenchmarkDotNet.Tests.Validators.RuntimeValidatorTests 3✅ 10ms
BenchmarkDotNet.Tests.Analysers.ZeroMeasurementHelperTests 21✅ 10ms
BenchmarkDotNet.Tests.Running.JobRuntimePropertiesComparerTests 4✅ 1⚪ 10ms
BenchmarkDotNet.Tests.AppConfigGeneratorTests 8✅ 1⚪ 9ms
BenchmarkDotNet.Tests.Reports.DisplayPrecisionManagerTests 29✅ 9ms
BenchmarkDotNet.Tests.RuntimeVersionDetectionTests 36✅ 9ms
BenchmarkDotNet.Tests.Portability.VirtualBoxTests 5✅ 8ms
BenchmarkDotNet.Tests.ParamsSourceTests 1✅ 7ms
BenchmarkDotNet.Tests.ParameterComparerTests 6✅ 7ms
BenchmarkDotNet.Tests.Loggers.LoggerWithPrefixTests 11✅ 7ms
BenchmarkDotNet.Tests.Reports.SummaryTests 1✅ 7ms
BenchmarkDotNet.Tests.ParameterInstanceTests 25✅ 6ms
BenchmarkDotNet.Tests.Columns.MetricColumnTests 4✅ 6ms
BenchmarkDotNet.Tests.EventPipeProfilerTests 5✅ 6ms
BenchmarkDotNet.Tests.Engine.EngineWarmupStageTests 6✅ 6ms
BenchmarkDotNet.Tests.Environments.HostEnvironmentInfoTests 4✅ 5ms
BenchmarkDotNet.Tests.Order.JobOrderTests 27✅ 5ms
BenchmarkDotNet.Tests.Configs.CategoriesTests 3✅ 4ms
BenchmarkDotNet.Tests.Engine.EnginePilotStageTests 3✅ 4ms
BenchmarkDotNet.Tests.LightJsonSerializerTests 2✅ 4ms
BenchmarkDotNet.Tests.StringExtensionsTests 19✅ 4ms
BenchmarkDotNet.Tests.Configs.EnvironmentVariableTests 6✅ 4ms
BenchmarkDotNet.Tests.Validators.SetupCleanupValidatorTests 2✅ 4ms
BenchmarkDotNet.Tests.SourceCodeHelperTests 25✅ 3ms
BenchmarkDotNet.Tests.Detectors.Cpu.CpuInfoFormatterTests 1✅ 2ms
BenchmarkDotNet.Tests.Attributes.MutatorAttributesTests 1✅ 2ms
BenchmarkDotNet.Tests.Detectors.Cpu.SysctlCpuInfoParserTests 3✅ 2ms
BenchmarkDotNet.Tests.BenchmarkDotNetInfoTests 4✅ 1ms
BenchmarkDotNet.Tests.FolderNameTests 12✅ 1ms
BenchmarkDotNet.Tests.SimpleJsonTests 2✅ 1ms
BenchmarkDotNet.Tests.CsvHelperTests 8✅ 1ms
BenchmarkDotNet.Tests.ArtifactFileNameHelperTests 1⚪ 1ms
BenchmarkDotNet.Tests.Configs.ConfigOptionsTests 10✅ 1ms
BenchmarkDotNet.Tests.LevenshteinDistanceCalculatorTests 6✅ 1ms
BenchmarkDotNet.Tests.dotMemory.DotMemoryTests 1✅ 1ms
BenchmarkDotNet.Tests.TargetFrameworkVersionParsingTestscs 4✅ 1ms
BenchmarkDotNet.Tests.dotTrace.DotTraceTests 1✅ 1ms
BenchmarkDotNet.Tests.Mathematics.NumeralSystemTests 3✅ 1ms
BenchmarkDotNet.Tests.Helpers.LinuxOsReleaseHelperTests 14✅ 1ms
BenchmarkDotNet.Tests.Portability.HyperVTests 8✅ 1ms
BenchmarkDotNet.Tests.SummaryStyleTests 1✅ 1ms
BenchmarkDotNet.Tests.XUnit.EnvRequirementCheckerTests 1✅ 1ms
BenchmarkDotNet.Tests.Portability.VMwareTests 7✅ 1ms
BenchmarkDotNet.Tests.FrameworkVersionHelperTests 16✅ 1ms
BenchmarkDotNet.Tests.CharacteristicPresenterTests 3✅ 1ms
BenchmarkDotNet.Tests.Columns.TagColumnTests 1✅ 1ms
BenchmarkDotNet.Tests.Properties.BenchmarkDotNetInfoTests 5✅ 1ms

✅ test-macos(arm64)-trx-15659621179/TestResults/macos(arm64)-exporters-net8.0.trx

51 tests were completed in 6s 737ms with 51 passed, 0 failed and 0 skipped.

Test suite Passed Failed Skipped Time
BenchmarkDotNet.Exporters.Plotting.Tests.ScottPlotExporterTests 51✅ 6s 331ms

✅ test-macos(arm64)-trx-15659621179/TestResults/macos(arm64)-integration-net8.0.trx

250 tests were completed in 15m 10s 460ms with 233 passed, 0 failed and 17 skipped.

Test suite Passed Failed Skipped Time
BenchmarkDotNet.IntegrationTests.ArgumentsTests 59✅ 2m 10s 045ms
BenchmarkDotNet.IntegrationTests.MemoryDiagnoserTests 11✅ 2m 06s 299ms
BenchmarkDotNet.IntegrationTests.BenchmarkSwitcherTest 21✅ 1m 11s 888ms
BenchmarkDotNet.IntegrationTests.ParamsTests 12✅ 51s 849ms
BenchmarkDotNet.IntegrationTests.RunStrategyTests 1✅ 46s 690ms
BenchmarkDotNet.IntegrationTests.ExceptionHandlingTests 17✅ 46s 283ms
BenchmarkDotNet.IntegrationTests.AllSetupAndCleanupTest 7✅ 34s 046ms
BenchmarkDotNet.IntegrationTests.DotMemoryTests 1✅ 32s 175ms
BenchmarkDotNet.IntegrationTests.WasmTests 1✅ 30s 750ms
BenchmarkDotNet.IntegrationTests.ParamSourceTests 11✅ 30s 298ms
BenchmarkDotNet.IntegrationTests.NuGetReferenceTests 1✅ 1⚪ 29s 528ms
BenchmarkDotNet.IntegrationTests.MonoTests 1✅ 28s 838ms
BenchmarkDotNet.IntegrationTests.CustomBuildConfigurationTests 1✅ 27s 280ms
BenchmarkDotNet.IntegrationTests.GcModeTests 6✅ 26s 084ms
BenchmarkDotNet.IntegrationTests.ThreadingDiagnoserTests 2✅ 18s 360ms
BenchmarkDotNet.IntegrationTests.DotTraceTests 1✅ 16s 124ms
BenchmarkDotNet.IntegrationTests.EventProcessorTests 6✅ 13s 572ms
BenchmarkDotNet.IntegrationTests.ExceptionDiagnoserTests 1✅ 13s 008ms
BenchmarkDotNet.IntegrationTests.EnvironmentVariablesTests 3✅ 11s 931ms
BenchmarkDotNet.IntegrationTests.AsyncBenchmarksTests 2✅ 11s 697ms
BenchmarkDotNet.IntegrationTests.DryRunTests 2✅ 8s 484ms
BenchmarkDotNet.IntegrationTests.StandardErrorTests 2✅ 8s 425ms
BenchmarkDotNet.IntegrationTests.ProcessorArchitectureTest 2✅ 8s 326ms
BenchmarkDotNet.IntegrationTests.ValuesReturnedByBenchmarkTest 2✅ 7s 796ms
BenchmarkDotNet.IntegrationTests.ReferencesTests 2✅ 6s 158ms
BenchmarkDotNet.IntegrationTests.StatResultExtenderTests 1✅ 5s 311ms
BenchmarkDotNet.IntegrationTests.BaselineRatioColumnWithLongParamsTest 1✅ 5s 219ms
BenchmarkDotNet.IntegrationTests.SetupAndCleanupTests 1✅ 5s 117ms
BenchmarkDotNet.IntegrationTests.PriorityTests 1✅ 5s 101ms
BenchmarkDotNet.IntegrationTests.EngineTests 3✅ 4s 880ms
BenchmarkDotNet.IntegrationTests.BaselineRatioColumnTest 1✅ 4s 877ms
BenchmarkDotNet.IntegrationTests.CustomEngineTests 1✅ 4s 379ms
BenchmarkDotNet.IntegrationTests.BaselineRatioResultExtenderNoBaselineTest 1✅ 4s 231ms
BenchmarkDotNet.IntegrationTests.AppConfigTests 1✅ 4s 157ms
BenchmarkDotNet.IntegrationTests.LanguageVersionTests 1✅ 4s 062ms
BenchmarkDotNet.IntegrationTests.JitRuntimeValidationTest 3✅ 1⚪ 3s 982ms
BenchmarkDotNet.IntegrationTests.FailingProcessSpawnTests 1✅ 3s 974ms
BenchmarkDotNet.IntegrationTests.WakeLockTests 5✅ 4⚪ 3s 962ms
BenchmarkDotNet.IntegrationTests.AttributesTests 1✅ 3s 952ms
BenchmarkDotNet.IntegrationTests.ToolchainTest 1✅ 3s 905ms
BenchmarkDotNet.IntegrationTests.FSharpTests 1✅ 3s 319ms
BenchmarkDotNet.IntegrationTests.AssemblyConfigTests 1✅ 2s 653ms
BenchmarkDotNet.IntegrationTests.InProcessEmitTest 6✅ 1⚪ 238ms
BenchmarkDotNet.IntegrationTests.InProcessTest 11✅ 185ms
BenchmarkDotNet.IntegrationTests.ValidatorsTest 2✅ 58ms
BenchmarkDotNet.IntegrationTests.BaselineRatioResultExtenderErrorTest 1✅ 42ms
BenchmarkDotNet.IntegrationTests.ExporterIOTests 3✅ 1⚪ 3ms
BenchmarkDotNet.IntegrationTests.PowerManagementApplierTests 2⚪ 2ms
BenchmarkDotNet.IntegrationTests.ProcessPropertiesTests 2⚪ 2ms
BenchmarkDotNet.IntegrationTests.JitOptimizationsTests 2✅ 2ms
BenchmarkDotNet.IntegrationTests.ExtraAttributesForEntryMethodTests 1⚪ 1ms
BenchmarkDotNet.IntegrationTests.LargeAddressAwareTest 1⚪ 1ms
BenchmarkDotNet.IntegrationTests.MultipleRuntimesTest 1⚪ 1ms
BenchmarkDotNet.IntegrationTests.PathTooLongTests 1⚪ 1ms
BenchmarkDotNet.IntegrationTests.RoslynToolchainTest 1⚪ 1ms
BenchmarkDotNet.IntegrationTests.NativeAotTests 1✅ 1ms
BenchmarkDotNet.IntegrationTests.GlobalSetupAttributeInvalidMethodTest 1✅ 1ms
BenchmarkDotNet.IntegrationTests.DisassemblyDiagnoserTests 4✅ 1ms
BenchmarkDotNet.IntegrationTests.BuildTimeoutTests 1✅ 1ms
BenchmarkDotNet.IntegrationTests.IntegrationTestSetupTests 1✅ 1ms

✅ test-macos(arm64)-trx-15659621179/TestResults/macos(arm64)-unit-net8.0.trx

933 tests were completed in 2m 39s 936ms with 925 passed, 0 failed and 8 skipped.

Test suite Passed Failed Skipped Time
BenchmarkDotNet.Tests.Running.RunningEmptyBenchmarkTests 19✅ 2m 36s 083ms
BenchmarkDotNet.Tests.Exporters.MarkdownExporterVerifyTests 17✅ 4s 299ms
BenchmarkDotNet.Tests.Engine.EngineFactoryTests 11✅ 3s 556ms
BenchmarkDotNet.Tests.Columns.RatioColumnTest 1✅ 1s 798ms
BenchmarkDotNet.Tests.Validators.ExecutionValidatorTests 26✅ 1s 042ms
BenchmarkDotNet.Tests.Exporters.CommonExporterVerifyTests 3✅ 891ms
BenchmarkDotNet.Tests.Perfonar.PerfonarTests 14✅ 275ms
BenchmarkDotNet.Tests.ConfigParserTests 96✅ 3⚪ 195ms
BenchmarkDotNet.Tests.Reports.SummaryTableTests 22✅ 50ms
BenchmarkDotNet.Tests.Configs.ConfigPerMethodTests 4✅ 46ms
BenchmarkDotNet.Tests.TypeFilterTests 16✅ 39ms
BenchmarkDotNet.Tests.Analysers.OutliersAnalyserTests 25✅ 37ms
BenchmarkDotNet.Tests.Validators.ParamsValidatorTests 32✅ 37ms
BenchmarkDotNet.Tests.Columns.MetricColumnTests 4✅ 36ms
BenchmarkDotNet.Tests.Configs.ImmutableConfigTests 38✅ 2⚪ 28ms
BenchmarkDotNet.Tests.Order.DefaultOrdererTests 2✅ 27ms
BenchmarkDotNet.Tests.CorrectionsSuggesterTests 10✅ 19ms
BenchmarkDotNet.Tests.MonoDisassemblyOutputParserTests 4✅ 18ms
BenchmarkDotNet.Tests.Attributes.ParamsAllValuesVerifyTests 7✅ 18ms
BenchmarkDotNet.Tests.CsProjGeneratorTests 10✅ 18ms
BenchmarkDotNet.Tests.Validators.ReturnValueValidatorTests 15✅ 17ms
BenchmarkDotNet.Tests.BuildResultTests 4✅ 17ms
BenchmarkDotNet.Tests.Configs.JobTests 13✅ 14ms
BenchmarkDotNet.Tests.Reports.DisplayPrecisionManagerTests 29✅ 14ms
BenchmarkDotNet.Tests.Engine.EngineResultStageTests 1✅ 13ms
BenchmarkDotNet.Tests.Running.JobRuntimePropertiesComparerTests 4✅ 1⚪ 13ms
BenchmarkDotNet.Tests.Reports.RatioPrecisionTests 3✅ 13ms
BenchmarkDotNet.Tests.ParameterComparerTests 6✅ 12ms
BenchmarkDotNet.Tests.CodeGeneratorTests 2✅ 10ms
BenchmarkDotNet.Tests.Detectors.Cpu.LinuxCpuInfoParserTests 11✅ 10ms
BenchmarkDotNet.Tests.Exporters.XmlSerializerTests 23✅ 9ms
BenchmarkDotNet.Tests.Columns.StatisticalTestColumnTests 5✅ 9ms
BenchmarkDotNet.Tests.Engine.EngineWarmupStageTests 6✅ 8ms
BenchmarkDotNet.Tests.Order.JobOrderTests 27✅ 8ms
BenchmarkDotNet.Tests.Reports.RatioStyleTests 2✅ 8ms
BenchmarkDotNet.Tests.Validators.CompilationValidatorTests 27✅ 8ms
BenchmarkDotNet.Tests.RuntimeVersionDetectionTests 36✅ 7ms
BenchmarkDotNet.Tests.Mathematics.StatisticsTests 9✅ 7ms
BenchmarkDotNet.Tests.FullNameProviderTests 20✅ 7ms
BenchmarkDotNet.Tests.Reports.DefaultColumnProvidersTests 3✅ 7ms
BenchmarkDotNet.Tests.GlobFilterTests 20✅ 7ms
BenchmarkDotNet.Tests.Engine.EngineActualStageTests 3✅ 7ms
BenchmarkDotNet.Tests.Validators.DeferredExecutionValidatorTests 7✅ 7ms
BenchmarkDotNet.Tests.Running.BenchmarkConverterTests 11✅ 6ms
BenchmarkDotNet.Tests.Detectors.Cpu.WmicCpuInfoParserTests 5✅ 6ms
BenchmarkDotNet.Tests.Configs.CategoriesTests 3✅ 6ms
BenchmarkDotNet.Tests.GenericBuilderTests 6✅ 6ms
BenchmarkDotNet.Tests.AppConfigGeneratorTests 8✅ 1⚪ 5ms
BenchmarkDotNet.Tests.Environments.HostEnvironmentInfoTests 4✅ 5ms
BenchmarkDotNet.Tests.Configs.ConfigOptionsTests 10✅ 5ms
BenchmarkDotNet.Tests.Reports.SummaryTests 1✅ 5ms
BenchmarkDotNet.Tests.Analysers.ZeroMeasurementHelperTests 21✅ 5ms
BenchmarkDotNet.Tests.Engine.EnginePilotStageTests 3✅ 4ms
BenchmarkDotNet.Tests.SimpleJsonTests 2✅ 4ms
BenchmarkDotNet.Tests.Configs.EnvironmentVariableTests 6✅ 4ms
BenchmarkDotNet.Tests.ParameterInstanceTests 25✅ 4ms
BenchmarkDotNet.Tests.Loggers.LoggerWithPrefixTests 11✅ 4ms
BenchmarkDotNet.Tests.Validators.RuntimeValidatorTests 3✅ 3ms
BenchmarkDotNet.Tests.XUnit.EnvRequirementCheckerTests 1✅ 3ms
BenchmarkDotNet.Tests.Portability.VirtualBoxTests 5✅ 3ms
BenchmarkDotNet.Tests.Validators.SetupCleanupValidatorTests 2✅ 3ms
BenchmarkDotNet.Tests.Mathematics.RankTests 1✅ 2ms
BenchmarkDotNet.Tests.EventPipeProfilerTests 5✅ 2ms
BenchmarkDotNet.Tests.ReflectionTests 8✅ 2ms
BenchmarkDotNet.Tests.ParamsSourceTests 1✅ 2ms
BenchmarkDotNet.Tests.StringExtensionsTests 19✅ 2ms
BenchmarkDotNet.Tests.Reports.ColumnTests 1✅ 2ms
BenchmarkDotNet.Tests.SourceCodeHelperTests 25✅ 2ms
BenchmarkDotNet.Tests.Detectors.Cpu.CpuInfoFormatterTests 1✅ 1ms
BenchmarkDotNet.Tests.Helpers.LinuxOsReleaseHelperTests 14✅ 1ms
BenchmarkDotNet.Tests.Portability.HyperVTests 8✅ 1ms
BenchmarkDotNet.Tests.CsvHelperTests 8✅ 1ms
BenchmarkDotNet.Tests.ArtifactFileNameHelperTests 1⚪ 1ms
BenchmarkDotNet.Tests.dotTrace.DotTraceTests 1✅ 1ms
BenchmarkDotNet.Tests.Attributes.MutatorAttributesTests 1✅ 1ms
BenchmarkDotNet.Tests.dotMemory.DotMemoryTests 1✅ 1ms
BenchmarkDotNet.Tests.BenchmarkDotNetInfoTests 4✅ 1ms
BenchmarkDotNet.Tests.Portability.VMwareTests 7✅ 1ms
BenchmarkDotNet.Tests.Detectors.Cpu.SysctlCpuInfoParserTests 3✅ 1ms
BenchmarkDotNet.Tests.FolderNameTests 12✅ 1ms
BenchmarkDotNet.Tests.LightJsonSerializerTests 2✅ 1ms
BenchmarkDotNet.Tests.LevenshteinDistanceCalculatorTests 6✅ 1ms
BenchmarkDotNet.Tests.TargetFrameworkVersionParsingTestscs 4✅ 1ms
BenchmarkDotNet.Tests.Mathematics.NumeralSystemTests 3✅ 1ms
BenchmarkDotNet.Tests.CharacteristicPresenterTests 3✅ 1ms
BenchmarkDotNet.Tests.SummaryStyleTests 1✅ 1ms
BenchmarkDotNet.Tests.Columns.TagColumnTests 1✅ 1ms
BenchmarkDotNet.Tests.FrameworkVersionHelperTests 16✅ 1ms
BenchmarkDotNet.Tests.Properties.BenchmarkDotNetInfoTests 5✅ 1ms

✅ test-macos(x64)-trx-15659621179/TestResults/macos(x64)-exporters-net8.0.trx

51 tests were completed in 8s 831ms with 51 passed, 0 failed and 0 skipped.

Test suite Passed Failed Skipped Time
BenchmarkDotNet.Exporters.Plotting.Tests.ScottPlotExporterTests 51✅ 8s 063ms

✅ test-macos(x64)-trx-15659621179/TestResults/macos(x64)-integration-net8.0.trx

254 tests were completed in 33m 52s 422ms with 237 passed, 0 failed and 17 skipped.

Test suite Passed Failed Skipped Time
BenchmarkDotNet.IntegrationTests.ArgumentsTests 59✅ 5m 30s 274ms
BenchmarkDotNet.IntegrationTests.MemoryDiagnoserTests 11✅ 4m 05s 517ms
BenchmarkDotNet.IntegrationTests.ParamsTests 12✅ 2m 57s 714ms
BenchmarkDotNet.IntegrationTests.BenchmarkSwitcherTest 21✅ 2m 22s 677ms
BenchmarkDotNet.IntegrationTests.ExceptionHandlingTests 17✅ 1m 56s 606ms
BenchmarkDotNet.IntegrationTests.ParamSourceTests 11✅ 1m 18s 640ms
BenchmarkDotNet.IntegrationTests.AllSetupAndCleanupTest 7✅ 1m 14s 007ms
BenchmarkDotNet.IntegrationTests.GcModeTests 6✅ 1m 04s 810ms
BenchmarkDotNet.IntegrationTests.NuGetReferenceTests 1✅ 1⚪ 1m 02s 509ms
BenchmarkDotNet.IntegrationTests.MonoTests 1✅ 1m 00s 796ms
BenchmarkDotNet.IntegrationTests.WasmTests 1✅ 1m 00s 543ms
BenchmarkDotNet.IntegrationTests.CustomBuildConfigurationTests 1✅ 59s 362ms
BenchmarkDotNet.IntegrationTests.RunStrategyTests 1✅ 50s 245ms
BenchmarkDotNet.IntegrationTests.DotMemoryTests 1✅ 45s 469ms
BenchmarkDotNet.IntegrationTests.ThreadingDiagnoserTests 2✅ 33s 866ms
BenchmarkDotNet.IntegrationTests.EventProcessorTests 6✅ 32s 915ms
BenchmarkDotNet.IntegrationTests.ProcessorArchitectureTest 2✅ 32s 080ms
BenchmarkDotNet.IntegrationTests.EnvironmentVariablesTests 3✅ 31s 404ms
BenchmarkDotNet.IntegrationTests.AsyncBenchmarksTests 2✅ 25s 421ms
BenchmarkDotNet.IntegrationTests.DotTraceTests 1✅ 24s 614ms
BenchmarkDotNet.IntegrationTests.StandardErrorTests 2✅ 21s 283ms
BenchmarkDotNet.IntegrationTests.ExceptionDiagnoserTests 1✅ 21s 244ms
BenchmarkDotNet.IntegrationTests.DryRunTests 2✅ 20s 512ms
BenchmarkDotNet.IntegrationTests.PriorityTests 1✅ 18s 168ms
BenchmarkDotNet.IntegrationTests.ValuesReturnedByBenchmarkTest 2✅ 17s 635ms
BenchmarkDotNet.IntegrationTests.ReferencesTests 2✅ 17s 083ms
BenchmarkDotNet.IntegrationTests.StatResultExtenderTests 1✅ 11s 595ms
BenchmarkDotNet.IntegrationTests.BaselineRatioColumnTest 1✅ 11s 525ms
BenchmarkDotNet.IntegrationTests.EngineTests 3✅ 11s 423ms
BenchmarkDotNet.IntegrationTests.BaselineRatioColumnWithLongParamsTest 1✅ 11s 115ms
BenchmarkDotNet.IntegrationTests.JitRuntimeValidationTest 3✅ 1⚪ 11s 072ms
BenchmarkDotNet.IntegrationTests.LanguageVersionTests 1✅ 10s 837ms
BenchmarkDotNet.IntegrationTests.ToolchainTest 1✅ 10s 777ms
BenchmarkDotNet.IntegrationTests.AttributesTests 1✅ 10s 740ms
BenchmarkDotNet.IntegrationTests.BaselineRatioResultExtenderNoBaselineTest 1✅ 10s 685ms
BenchmarkDotNet.IntegrationTests.SetupAndCleanupTests 1✅ 10s 636ms
BenchmarkDotNet.IntegrationTests.AppConfigTests 1✅ 10s 330ms
BenchmarkDotNet.IntegrationTests.CustomEngineTests 1✅ 10s 305ms
BenchmarkDotNet.IntegrationTests.FailingProcessSpawnTests 1✅ 10s 046ms
BenchmarkDotNet.IntegrationTests.WakeLockTests 5✅ 4⚪ 8s 953ms
BenchmarkDotNet.IntegrationTests.FSharpTests 1✅ 7s 200ms
BenchmarkDotNet.IntegrationTests.AssemblyConfigTests 1✅ 6s 383ms
BenchmarkDotNet.IntegrationTests.InProcessEmitTest 6✅ 1⚪ 504ms
BenchmarkDotNet.IntegrationTests.InProcessTest 11✅ 352ms
BenchmarkDotNet.IntegrationTests.ValidatorsTest 2✅ 97ms
BenchmarkDotNet.IntegrationTests.BaselineRatioResultExtenderErrorTest 1✅ 58ms
BenchmarkDotNet.IntegrationTests.ExporterIOTests 3✅ 1⚪ 9ms
BenchmarkDotNet.IntegrationTests.JitOptimizationsTests 2✅ 4ms
BenchmarkDotNet.IntegrationTests.DisassemblyDiagnoserTests 8✅ 3ms
BenchmarkDotNet.IntegrationTests.PowerManagementApplierTests 2⚪ 2ms
BenchmarkDotNet.IntegrationTests.ProcessPropertiesTests 2⚪ 2ms
BenchmarkDotNet.IntegrationTests.GlobalSetupAttributeInvalidMethodTest 1✅ 2ms
BenchmarkDotNet.IntegrationTests.ExtraAttributesForEntryMethodTests 1⚪ 1ms
BenchmarkDotNet.IntegrationTests.LargeAddressAwareTest 1⚪ 1ms
BenchmarkDotNet.IntegrationTests.MultipleRuntimesTest 1⚪ 1ms
BenchmarkDotNet.IntegrationTests.PathTooLongTests 1⚪ 1ms
BenchmarkDotNet.IntegrationTests.RoslynToolchainTest 1⚪ 1ms
BenchmarkDotNet.IntegrationTests.NativeAotTests 1✅ 1ms
BenchmarkDotNet.IntegrationTests.BuildTimeoutTests 1✅ 1ms
BenchmarkDotNet.IntegrationTests.IntegrationTestSetupTests 1✅ 1ms

✅ test-macos(x64)-trx-15659621179/TestResults/macos(x64)-unit-net8.0.trx

933 tests were completed in 4m 55s 024ms with 925 passed, 0 failed and 8 skipped.

Test suite Passed Failed Skipped Time
BenchmarkDotNet.Tests.Running.RunningEmptyBenchmarkTests 19✅ 4m 53s 543ms
BenchmarkDotNet.Tests.Columns.RatioColumnTest 1✅ 4s 823ms
BenchmarkDotNet.Tests.Exporters.MarkdownExporterVerifyTests 17✅ 4s 037ms
BenchmarkDotNet.Tests.Engine.EngineFactoryTests 11✅ 3s 909ms
BenchmarkDotNet.Tests.Perfonar.PerfonarTests 14✅ 2s 314ms
BenchmarkDotNet.Tests.Validators.ExecutionValidatorTests 26✅ 1s 103ms
BenchmarkDotNet.Tests.ConfigParserTests 96✅ 3⚪ 470ms
BenchmarkDotNet.Tests.Exporters.CommonExporterVerifyTests 3✅ 354ms
BenchmarkDotNet.Tests.ParamsSourceTests 1✅ 165ms
BenchmarkDotNet.Tests.Reports.SummaryTableTests 22✅ 112ms
BenchmarkDotNet.Tests.TypeFilterTests 16✅ 72ms
BenchmarkDotNet.Tests.Mathematics.RankTests 1✅ 70ms
BenchmarkDotNet.Tests.Attributes.ParamsAllValuesVerifyTests 7✅ 68ms
BenchmarkDotNet.Tests.Analysers.OutliersAnalyserTests 25✅ 68ms
BenchmarkDotNet.Tests.CsProjGeneratorTests 10✅ 65ms
BenchmarkDotNet.Tests.GenericBuilderTests 6✅ 55ms
BenchmarkDotNet.Tests.Reports.ColumnTests 1✅ 54ms
BenchmarkDotNet.Tests.Configs.JobTests 13✅ 46ms
BenchmarkDotNet.Tests.CorrectionsSuggesterTests 10✅ 41ms
BenchmarkDotNet.Tests.Reports.SummaryTests 1✅ 39ms
BenchmarkDotNet.Tests.Configs.ImmutableConfigTests 38✅ 2⚪ 38ms
BenchmarkDotNet.Tests.Detectors.Cpu.SysctlCpuInfoParserTests 3✅ 36ms
BenchmarkDotNet.Tests.Validators.ReturnValueValidatorTests 15✅ 35ms
BenchmarkDotNet.Tests.Reports.RatioStyleTests 2✅ 33ms
BenchmarkDotNet.Tests.Mathematics.StatisticsTests 9✅ 30ms
BenchmarkDotNet.Tests.Reports.DefaultColumnProvidersTests 3✅ 28ms
BenchmarkDotNet.Tests.Validators.ParamsValidatorTests 32✅ 27ms
BenchmarkDotNet.Tests.Validators.CompilationValidatorTests 27✅ 25ms
BenchmarkDotNet.Tests.Reports.RatioPrecisionTests 3✅ 25ms
BenchmarkDotNet.Tests.Order.DefaultOrdererTests 2✅ 24ms
BenchmarkDotNet.Tests.Columns.StatisticalTestColumnTests 5✅ 23ms
BenchmarkDotNet.Tests.BuildResultTests 4✅ 23ms
BenchmarkDotNet.Tests.Running.JobRuntimePropertiesComparerTests 4✅ 1⚪ 22ms
BenchmarkDotNet.Tests.FullNameProviderTests 20✅ 20ms
BenchmarkDotNet.Tests.Running.BenchmarkConverterTests 11✅ 19ms
BenchmarkDotNet.Tests.GlobFilterTests 20✅ 18ms
BenchmarkDotNet.Tests.Detectors.Cpu.LinuxCpuInfoParserTests 11✅ 17ms
BenchmarkDotNet.Tests.MonoDisassemblyOutputParserTests 4✅ 17ms
BenchmarkDotNet.Tests.Exporters.XmlSerializerTests 23✅ 16ms
BenchmarkDotNet.Tests.Configs.ConfigPerMethodTests 4✅ 15ms
BenchmarkDotNet.Tests.LightJsonSerializerTests 2✅ 15ms
BenchmarkDotNet.Tests.Engine.EngineActualStageTests 3✅ 15ms
BenchmarkDotNet.Tests.Analysers.ZeroMeasurementHelperTests 21✅ 14ms
BenchmarkDotNet.Tests.EventPipeProfilerTests 5✅ 13ms
BenchmarkDotNet.Tests.Validators.DeferredExecutionValidatorTests 7✅ 13ms
BenchmarkDotNet.Tests.FrameworkVersionHelperTests 16✅ 12ms
BenchmarkDotNet.Tests.Engine.EngineWarmupStageTests 6✅ 11ms
BenchmarkDotNet.Tests.Engine.EngineResultStageTests 1✅ 11ms
BenchmarkDotNet.Tests.AppConfigGeneratorTests 8✅ 1⚪ 10ms
BenchmarkDotNet.Tests.Reports.DisplayPrecisionManagerTests 29✅ 10ms
BenchmarkDotNet.Tests.ParameterComparerTests 6✅ 9ms
BenchmarkDotNet.Tests.Engine.EnginePilotStageTests 3✅ 9ms
BenchmarkDotNet.Tests.Configs.CategoriesTests 3✅ 8ms
BenchmarkDotNet.Tests.LevenshteinDistanceCalculatorTests 6✅ 6ms
BenchmarkDotNet.Tests.RuntimeVersionDetectionTests 36✅ 6ms
BenchmarkDotNet.Tests.StringExtensionsTests 19✅ 6ms
BenchmarkDotNet.Tests.Configs.EnvironmentVariableTests 6✅ 6ms
BenchmarkDotNet.Tests.Order.JobOrderTests 27✅ 6ms
BenchmarkDotNet.Tests.Validators.RuntimeValidatorTests 3✅ 5ms
BenchmarkDotNet.Tests.Validators.SetupCleanupValidatorTests 2✅ 5ms
BenchmarkDotNet.Tests.ReflectionTests 8✅ 5ms
BenchmarkDotNet.Tests.Detectors.Cpu.CpuInfoFormatterTests 1✅ 5ms
BenchmarkDotNet.Tests.Detectors.Cpu.WmicCpuInfoParserTests 5✅ 4ms
BenchmarkDotNet.Tests.Environments.HostEnvironmentInfoTests 4✅ 4ms
BenchmarkDotNet.Tests.Portability.HyperVTests 8✅ 4ms
BenchmarkDotNet.Tests.ParameterInstanceTests 25✅ 4ms
BenchmarkDotNet.Tests.CodeGeneratorTests 2✅ 4ms
BenchmarkDotNet.Tests.Columns.MetricColumnTests 4✅ 3ms
BenchmarkDotNet.Tests.Loggers.LoggerWithPrefixTests 11✅ 3ms
BenchmarkDotNet.Tests.Helpers.LinuxOsReleaseHelperTests 14✅ 3ms
BenchmarkDotNet.Tests.Columns.TagColumnTests 1✅ 3ms
BenchmarkDotNet.Tests.SourceCodeHelperTests 25✅ 3ms
BenchmarkDotNet.Tests.Configs.ConfigOptionsTests 10✅ 2ms
BenchmarkDotNet.Tests.Attributes.MutatorAttributesTests 1✅ 2ms
BenchmarkDotNet.Tests.dotTrace.DotTraceTests 1✅ 2ms
BenchmarkDotNet.Tests.Portability.VMwareTests 7✅ 1ms
BenchmarkDotNet.Tests.SimpleJsonTests 2✅ 1ms
BenchmarkDotNet.Tests.Mathematics.NumeralSystemTests 3✅ 1ms
BenchmarkDotNet.Tests.CsvHelperTests 8✅ 1ms
BenchmarkDotNet.Tests.FolderNameTests 12✅ 1ms
BenchmarkDotNet.Tests.CharacteristicPresenterTests 3✅ 1ms
BenchmarkDotNet.Tests.dotMemory.DotMemoryTests 1✅ 1ms
BenchmarkDotNet.Tests.ArtifactFileNameHelperTests 1⚪ 1ms
BenchmarkDotNet.Tests.TargetFrameworkVersionParsingTestscs 4✅ 1ms
BenchmarkDotNet.Tests.Portability.VirtualBoxTests 5✅ 1ms
BenchmarkDotNet.Tests.XUnit.EnvRequirementCheckerTests 1✅ 1ms
BenchmarkDotNet.Tests.BenchmarkDotNetInfoTests 4✅ 1ms
BenchmarkDotNet.Tests.SummaryStyleTests 1✅ 1ms
BenchmarkDotNet.Tests.Properties.BenchmarkDotNetInfoTests 5✅ 1ms

✅ test-windows-core-trx-15659621179/TestResults/windows(x64)-integration-net8.0.trx

254 tests were completed in 25m 54s 888ms with 247 passed, 0 failed and 7 skipped.

Test suite Passed Failed Skipped Time
BenchmarkDotNet.IntegrationTests.MemoryDiagnoserTests 11✅ 4m 35s 473ms
BenchmarkDotNet.IntegrationTests.ArgumentsTests 59✅ 3m 36s 762ms
BenchmarkDotNet.IntegrationTests.BenchmarkSwitcherTest 21✅ 1m 48s 470ms
BenchmarkDotNet.IntegrationTests.ParamsTests 12✅ 1m 21s 761ms
BenchmarkDotNet.IntegrationTests.ExceptionHandlingTests 17✅ 1m 16s 539ms
BenchmarkDotNet.IntegrationTests.NuGetReferenceTests 1✅ 1⚪ 53s 517ms
BenchmarkDotNet.IntegrationTests.AllSetupAndCleanupTest 7✅ 48s 568ms
BenchmarkDotNet.IntegrationTests.DotMemoryTests 1✅ 47s 811ms
BenchmarkDotNet.IntegrationTests.MonoTests 1✅ 46s 894ms
BenchmarkDotNet.IntegrationTests.CustomBuildConfigurationTests 1✅ 46s 737ms
BenchmarkDotNet.IntegrationTests.ParamSourceTests 11✅ 44s 273ms
BenchmarkDotNet.IntegrationTests.GcModeTests 6✅ 40s 642ms
BenchmarkDotNet.IntegrationTests.RunStrategyTests 1✅ 34s 866ms
BenchmarkDotNet.IntegrationTests.JitRuntimeValidationTest 7✅ 32s 623ms
BenchmarkDotNet.IntegrationTests.WakeLockTests 8✅ 2⚪ 29s 021ms
BenchmarkDotNet.IntegrationTests.DisassemblyDiagnoserTests 4✅ 28s 965ms
BenchmarkDotNet.IntegrationTests.ThreadingDiagnoserTests 2✅ 28s 945ms
BenchmarkDotNet.IntegrationTests.DotTraceTests 1✅ 23s 080ms
BenchmarkDotNet.IntegrationTests.EventProcessorTests 6✅ 21s 589ms
BenchmarkDotNet.IntegrationTests.EnvironmentVariablesTests 3✅ 20s 619ms
BenchmarkDotNet.IntegrationTests.AsyncBenchmarksTests 2✅ 17s 022ms
BenchmarkDotNet.IntegrationTests.ExceptionDiagnoserTests 1✅ 16s 126ms
BenchmarkDotNet.IntegrationTests.StandardErrorTests 2✅ 13s 687ms
BenchmarkDotNet.IntegrationTests.ProcessorArchitectureTest 2✅ 13s 631ms
BenchmarkDotNet.IntegrationTests.DryRunTests 2✅ 13s 619ms
BenchmarkDotNet.IntegrationTests.ProcessPropertiesTests 2✅ 13s 599ms
BenchmarkDotNet.IntegrationTests.LargeAddressAwareTest 1✅ 12s 773ms
BenchmarkDotNet.IntegrationTests.MultipleRuntimesTest 1✅ 12s 718ms
BenchmarkDotNet.IntegrationTests.ValuesReturnedByBenchmarkTest 2✅ 12s 211ms
BenchmarkDotNet.IntegrationTests.ReferencesTests 2✅ 9s 912ms
BenchmarkDotNet.IntegrationTests.PriorityTests 1✅ 7s 906ms
BenchmarkDotNet.IntegrationTests.BaselineRatioColumnTest 1✅ 7s 592ms
BenchmarkDotNet.IntegrationTests.BaselineRatioColumnWithLongParamsTest 1✅ 7s 441ms
BenchmarkDotNet.IntegrationTests.StatResultExtenderTests 1✅ 7s 346ms
BenchmarkDotNet.IntegrationTests.EngineTests 3✅ 7s 128ms
BenchmarkDotNet.IntegrationTests.SetupAndCleanupTests 1✅ 7s 126ms
BenchmarkDotNet.IntegrationTests.FailingProcessSpawnTests 1✅ 7s 122ms
BenchmarkDotNet.IntegrationTests.BaselineRatioResultExtenderNoBaselineTest 1✅ 7s 056ms
BenchmarkDotNet.IntegrationTests.AppConfigTests 1✅ 6s 922ms
BenchmarkDotNet.IntegrationTests.CustomEngineTests 1✅ 6s 883ms
BenchmarkDotNet.IntegrationTests.AttributesTests 1✅ 6s 817ms
BenchmarkDotNet.IntegrationTests.ToolchainTest 1✅ 6s 816ms
BenchmarkDotNet.IntegrationTests.LanguageVersionTests 1✅ 6s 784ms
BenchmarkDotNet.IntegrationTests.PathTooLongTests 1✅ 6s 658ms
BenchmarkDotNet.IntegrationTests.FSharpTests 1✅ 4s 619ms
BenchmarkDotNet.IntegrationTests.AssemblyConfigTests 1✅ 4s 596ms
BenchmarkDotNet.IntegrationTests.BuildTimeoutTests 1✅ 1s 236ms
BenchmarkDotNet.IntegrationTests.InProcessEmitTest 6✅ 1⚪ 624ms
BenchmarkDotNet.IntegrationTests.InProcessTest 11✅ 269ms
BenchmarkDotNet.IntegrationTests.ValidatorsTest 2✅ 64ms
BenchmarkDotNet.IntegrationTests.BaselineRatioResultExtenderErrorTest 1✅ 46ms
BenchmarkDotNet.IntegrationTests.PowerManagementApplierTests 2✅ 29ms
BenchmarkDotNet.IntegrationTests.ExporterIOTests 4✅ 12ms
BenchmarkDotNet.IntegrationTests.JitOptimizationsTests 2✅ 3ms
BenchmarkDotNet.IntegrationTests.ExtraAttributesForEntryMethodTests 1⚪ 1ms
BenchmarkDotNet.IntegrationTests.RoslynToolchainTest 1⚪ 1ms
BenchmarkDotNet.IntegrationTests.WasmTests 1⚪ 1ms
BenchmarkDotNet.IntegrationTests.GlobalSetupAttributeInvalidMethodTest 1✅ 1ms
BenchmarkDotNet.IntegrationTests.NativeAotTests 1✅ 1ms
BenchmarkDotNet.IntegrationTests.IntegrationTestSetupTests 1✅ 1ms

✅ test-windows-full-trx-15659621179/TestResults/windows(x64)-integration-net462.trx

284 tests were completed in 24m 56s 792ms with 271 passed, 0 failed and 13 skipped.

Test suite Passed Failed Skipped Time
BenchmarkDotNet.IntegrationTests.DisassemblyDiagnoserTests 12✅ 7m 56s 276ms
BenchmarkDotNet.IntegrationTests.JitRuntimeValidationTest 7✅ 3m 14s 841ms
BenchmarkDotNet.IntegrationTests.TailCallDiagnoserTests 4✅ 2m 41s 459ms
BenchmarkDotNet.IntegrationTests.MemoryDiagnoserTests 14✅ 4⚪ 1m 53s 388ms
BenchmarkDotNet.IntegrationTests.MultipleRuntimesTest 1✅ 1m 25s 337ms
BenchmarkDotNet.IntegrationTests.LargeAddressAwareTest 1✅ 1m 24s 642ms
BenchmarkDotNet.IntegrationTests.RunStrategyTests 1✅ 54s 720ms
BenchmarkDotNet.IntegrationTests.DotMemoryTests 1✅ 53s 315ms
BenchmarkDotNet.IntegrationTests.BenchmarkSwitcherTest 19✅ 2⚪ 43s 848ms
BenchmarkDotNet.IntegrationTests.NuGetReferenceTests 2✅ 43s 007ms
BenchmarkDotNet.IntegrationTests.InProcessEmitTest 12✅ 40s 528ms
BenchmarkDotNet.IntegrationTests.ArgumentsTests 57✅ 1⚪ 23s 370ms
BenchmarkDotNet.IntegrationTests.DotTraceTests 1✅ 21s 288ms
BenchmarkDotNet.IntegrationTests.ValuesReturnedByBenchmarkTest 2✅ 11s 032ms
BenchmarkDotNet.IntegrationTests.ExceptionDiagnoserTests 1✅ 10s 525ms
BenchmarkDotNet.IntegrationTests.AllSetupAndCleanupTest 7✅ 9s 747ms
BenchmarkDotNet.IntegrationTests.ParamSourceTests 11✅ 8s 428ms
BenchmarkDotNet.IntegrationTests.ExceptionHandlingTests 17✅ 5s 485ms
BenchmarkDotNet.IntegrationTests.AsyncBenchmarksTests 2✅ 4s 449ms
BenchmarkDotNet.IntegrationTests.ParamsTests 11✅ 3s 673ms
BenchmarkDotNet.IntegrationTests.EngineTests 3✅ 2s 762ms
BenchmarkDotNet.IntegrationTests.EventProcessorTests 6✅ 2s 337ms
BenchmarkDotNet.IntegrationTests.GcModeTests 7✅ 2s 035ms
BenchmarkDotNet.IntegrationTests.ReferencesTests 4✅ 1s 974ms
BenchmarkDotNet.IntegrationTests.PriorityTests 1✅ 1s 819ms
BenchmarkDotNet.IntegrationTests.BuildTimeoutTests 1✅ 1s 653ms
BenchmarkDotNet.IntegrationTests.WakeLockTests 8✅ 2⚪ 1s 391ms
BenchmarkDotNet.IntegrationTests.RoslynToolchainTest 4✅ 1s 271ms
BenchmarkDotNet.IntegrationTests.BaselineRatioColumnTest 1✅ 1s 075ms
BenchmarkDotNet.IntegrationTests.BaselineRatioColumnWithLongParamsTest 1✅ 1s 066ms
BenchmarkDotNet.IntegrationTests.InProcessTest 10✅ 1s 051ms
BenchmarkDotNet.IntegrationTests.ProcessorArchitectureTest 3✅ 871ms
BenchmarkDotNet.IntegrationTests.DryRunTests 2✅ 867ms
BenchmarkDotNet.IntegrationTests.EnvironmentVariablesTests 3✅ 863ms
BenchmarkDotNet.IntegrationTests.StatResultExtenderTests 1✅ 852ms
BenchmarkDotNet.IntegrationTests.ProcessPropertiesTests 2✅ 601ms
BenchmarkDotNet.IntegrationTests.BaselineRatioResultExtenderNoBaselineTest 1✅ 584ms
BenchmarkDotNet.IntegrationTests.SetupAndCleanupTests 1✅ 563ms
BenchmarkDotNet.IntegrationTests.StandardErrorTests 2✅ 559ms
BenchmarkDotNet.IntegrationTests.ToolchainTest 1✅ 320ms
BenchmarkDotNet.IntegrationTests.LanguageVersionTests 1✅ 302ms
BenchmarkDotNet.IntegrationTests.AppConfigTests 1✅ 301ms
BenchmarkDotNet.IntegrationTests.AssemblyConfigTests 1✅ 297ms
BenchmarkDotNet.IntegrationTests.AttributesTests 1✅ 294ms
BenchmarkDotNet.IntegrationTests.ExtraAttributesForEntryMethodTests 1✅ 291ms
BenchmarkDotNet.IntegrationTests.CopyToOutputTests 1✅ 276ms
BenchmarkDotNet.IntegrationTests.CustomEngineTests 1✅ 265ms
BenchmarkDotNet.IntegrationTests.FSharpTests 1✅ 264ms
BenchmarkDotNet.IntegrationTests.PathTooLongTests 1✅ 262ms
BenchmarkDotNet.IntegrationTests.FailingProcessSpawnTests 1✅ 119ms
BenchmarkDotNet.IntegrationTests.ValidatorsTest 2✅ 88ms
BenchmarkDotNet.IntegrationTests.PowerManagementApplierTests 2✅ 34ms
BenchmarkDotNet.IntegrationTests.Diagnosers.ProcessMetricsTests 3✅ 17ms
BenchmarkDotNet.IntegrationTests.ExporterIOTests 4✅ 10ms
BenchmarkDotNet.IntegrationTests.BaselineRatioResultExtenderErrorTest 1✅ 7ms
BenchmarkDotNet.IntegrationTests.JitOptimizationsTests 2✅ 5ms
BenchmarkDotNet.IntegrationTests.CustomBuildConfigurationTests 1⚪ 1ms
BenchmarkDotNet.IntegrationTests.GlobalSetupAttributeInvalidMethodTest 1✅ 1ms
BenchmarkDotNet.IntegrationTests.IntegrationTestSetupTests 1✅ 1ms
BenchmarkDotNet.IntegrationTests.MonoTests 1⚪ 1ms
BenchmarkDotNet.IntegrationTests.NativeAotTests 1⚪ 1ms
BenchmarkDotNet.IntegrationTests.WasmTests 1⚪ 1ms