feat: Add validator for benchmarks that contains null runtime #2771
report ✅
✅ test-linux-trx-15659621179/TestResults/linux(x64)-exporters-net8.0.trx
51 tests were completed in 6s 864ms with 51 passed, 0 failed and 0 skipped.
| Test suite | Passed | Failed | Skipped | Time |
|---|---|---|---|---|
| BenchmarkDotNet.Exporters.Plotting.Tests.ScottPlotExporterTests | 51✅ | 6s 271ms |
✅ test-linux-trx-15659621179/TestResults/linux(x64)-integration-net8.0.trx
252 tests were completed in 27m 03s 277ms with 235 passed, 0 failed and 17 skipped.
| Test suite | Passed | Failed | Skipped | Time |
|---|---|---|---|---|
| BenchmarkDotNet.IntegrationTests.MemoryDiagnoserTests | 11✅ | 4m 03s 288ms | ||
| BenchmarkDotNet.IntegrationTests.ArgumentsTests | 59✅ | 3m 28s 193ms | ||
| BenchmarkDotNet.IntegrationTests.ThreadingDiagnoserTests | 4✅ | 2m 27s 393ms | ||
| BenchmarkDotNet.IntegrationTests.BenchmarkSwitcherTest | 21✅ | 1m 46s 673ms | ||
| BenchmarkDotNet.IntegrationTests.ParamsTests | 12✅ | 1m 20s 492ms | ||
| BenchmarkDotNet.IntegrationTests.ExceptionHandlingTests | 17✅ | 1m 14s 129ms | ||
| BenchmarkDotNet.IntegrationTests.NativeAotTests | 1✅ | 56s 660ms | ||
| BenchmarkDotNet.IntegrationTests.NuGetReferenceTests | 1✅ | 1⚪ | 53s 117ms | |
| BenchmarkDotNet.IntegrationTests.WasmTests | 1✅ | 52s 702ms | ||
| BenchmarkDotNet.IntegrationTests.MonoTests | 1✅ | 49s 797ms | ||
| BenchmarkDotNet.IntegrationTests.AllSetupAndCleanupTest | 7✅ | 47s 269ms | ||
| BenchmarkDotNet.IntegrationTests.CustomBuildConfigurationTests | 1✅ | 47s 104ms | ||
| BenchmarkDotNet.IntegrationTests.ParamSourceTests | 11✅ | 42s 954ms | ||
| BenchmarkDotNet.IntegrationTests.GcModeTests | 6✅ | 40s 085ms | ||
| BenchmarkDotNet.IntegrationTests.DotMemoryTests | 1✅ | 39s 566ms | ||
| BenchmarkDotNet.IntegrationTests.RunStrategyTests | 1✅ | 36s 882ms | ||
| BenchmarkDotNet.IntegrationTests.DisassemblyDiagnoserTests | 4✅ | 28s 041ms | ||
| BenchmarkDotNet.IntegrationTests.EventProcessorTests | 6✅ | 21s 121ms | ||
| BenchmarkDotNet.IntegrationTests.EnvironmentVariablesTests | 3✅ | 19s 988ms | ||
| BenchmarkDotNet.IntegrationTests.DotTraceTests | 1✅ | 19s 536ms | ||
| BenchmarkDotNet.IntegrationTests.AsyncBenchmarksTests | 2✅ | 16s 276ms | ||
| BenchmarkDotNet.IntegrationTests.ExceptionDiagnoserTests | 1✅ | 15s 023ms | ||
| BenchmarkDotNet.IntegrationTests.DryRunTests | 2✅ | 13s 606ms | ||
| BenchmarkDotNet.IntegrationTests.ProcessorArchitectureTest | 2✅ | 13s 233ms | ||
| BenchmarkDotNet.IntegrationTests.StandardErrorTests | 2✅ | 13s 187ms | ||
| BenchmarkDotNet.IntegrationTests.ValuesReturnedByBenchmarkTest | 2✅ | 11s 336ms | ||
| BenchmarkDotNet.IntegrationTests.ReferencesTests | 2✅ | 9s 817ms | ||
| BenchmarkDotNet.IntegrationTests.PriorityTests | 1✅ | 7s 897ms | ||
| BenchmarkDotNet.IntegrationTests.BaselineRatioColumnTest | 1✅ | 7s 291ms | ||
| BenchmarkDotNet.IntegrationTests.BaselineRatioColumnWithLongParamsTest | 1✅ | 7s 270ms | ||
| BenchmarkDotNet.IntegrationTests.StatResultExtenderTests | 1✅ | 7s 081ms | ||
| BenchmarkDotNet.IntegrationTests.FailingProcessSpawnTests | 1✅ | 6s 972ms | ||
| BenchmarkDotNet.IntegrationTests.EngineTests | 3✅ | 6s 946ms | ||
| BenchmarkDotNet.IntegrationTests.BaselineRatioResultExtenderNoBaselineTest | 1✅ | 6s 917ms | ||
| BenchmarkDotNet.IntegrationTests.SetupAndCleanupTests | 1✅ | 6s 796ms | ||
| BenchmarkDotNet.IntegrationTests.AppConfigTests | 1✅ | 6s 737ms | ||
| BenchmarkDotNet.IntegrationTests.WakeLockTests | 5✅ | 4⚪ | 6s 699ms | |
| BenchmarkDotNet.IntegrationTests.AttributesTests | 1✅ | 6s 679ms | ||
| BenchmarkDotNet.IntegrationTests.ToolchainTest | 1✅ | 6s 668ms | ||
| BenchmarkDotNet.IntegrationTests.LanguageVersionTests | 1✅ | 6s 643ms | ||
| BenchmarkDotNet.IntegrationTests.CustomEngineTests | 1✅ | 6s 639ms | ||
| BenchmarkDotNet.IntegrationTests.JitRuntimeValidationTest | 3✅ | 1⚪ | 6s 474ms | |
| BenchmarkDotNet.IntegrationTests.FSharpTests | 1✅ | 4s 650ms | ||
| BenchmarkDotNet.IntegrationTests.AssemblyConfigTests | 1✅ | 4s 629ms | ||
| BenchmarkDotNet.IntegrationTests.BuildTimeoutTests | 1✅ | 1s 142ms | ||
| BenchmarkDotNet.IntegrationTests.InProcessEmitTest | 6✅ | 1⚪ | 258ms | |
| BenchmarkDotNet.IntegrationTests.InProcessTest | 11✅ | 140ms | ||
| BenchmarkDotNet.IntegrationTests.ValidatorsTest | 2✅ | 22ms | ||
| BenchmarkDotNet.IntegrationTests.BaselineRatioResultExtenderErrorTest | 1✅ | 9ms | ||
| BenchmarkDotNet.IntegrationTests.ExporterIOTests | 3✅ | 1⚪ | 4ms | |
| BenchmarkDotNet.IntegrationTests.JitOptimizationsTests | 2✅ | 3ms | ||
| BenchmarkDotNet.IntegrationTests.PowerManagementApplierTests | 2⚪ | 2ms | ||
| BenchmarkDotNet.IntegrationTests.ProcessPropertiesTests | 2⚪ | 2ms | ||
| BenchmarkDotNet.IntegrationTests.ExtraAttributesForEntryMethodTests | 1⚪ | 1ms | ||
| BenchmarkDotNet.IntegrationTests.LargeAddressAwareTest | 1⚪ | 1ms | ||
| BenchmarkDotNet.IntegrationTests.MultipleRuntimesTest | 1⚪ | 1ms | ||
| BenchmarkDotNet.IntegrationTests.PathTooLongTests | 1⚪ | 1ms | ||
| BenchmarkDotNet.IntegrationTests.RoslynToolchainTest | 1⚪ | 1ms | ||
| BenchmarkDotNet.IntegrationTests.GlobalSetupAttributeInvalidMethodTest | 1✅ | 1ms | ||
| BenchmarkDotNet.IntegrationTests.IntegrationTestSetupTests | 1✅ | 1ms |
✅ test-linux-trx-15659621179/TestResults/linux(x64)-unit-net8.0.trx
933 tests were completed in 3m 48s 608ms with 925 passed, 0 failed and 8 skipped.
| Test suite | Passed | Failed | Skipped | Time |
|---|---|---|---|---|
| BenchmarkDotNet.Tests.Running.RunningEmptyBenchmarkTests | 19✅ | 3m 47s 714ms | ||
| BenchmarkDotNet.Tests.Engine.EngineFactoryTests | 11✅ | 3s 009ms | ||
| BenchmarkDotNet.Tests.Columns.RatioColumnTest | 1✅ | 2s 880ms | ||
| BenchmarkDotNet.Tests.Exporters.MarkdownExporterVerifyTests | 17✅ | 2s 198ms | ||
| BenchmarkDotNet.Tests.Exporters.CommonExporterVerifyTests | 3✅ | 1s 955ms | ||
| BenchmarkDotNet.Tests.Perfonar.PerfonarTests | 14✅ | 295ms | ||
| BenchmarkDotNet.Tests.ConfigParserTests | 96✅ | 3⚪ | 270ms | |
| BenchmarkDotNet.Tests.Validators.ReturnValueValidatorTests | 15✅ | 172ms | ||
| BenchmarkDotNet.Tests.Reports.DefaultColumnProvidersTests | 3✅ | 134ms | ||
| BenchmarkDotNet.Tests.Validators.ExecutionValidatorTests | 26✅ | 74ms | ||
| BenchmarkDotNet.Tests.Configs.ImmutableConfigTests | 38✅ | 2⚪ | 71ms | |
| BenchmarkDotNet.Tests.Reports.SummaryTableTests | 22✅ | 70ms | ||
| BenchmarkDotNet.Tests.Mathematics.StatisticsTests | 9✅ | 59ms | ||
| BenchmarkDotNet.Tests.CodeGeneratorTests | 2✅ | 54ms | ||
| BenchmarkDotNet.Tests.Analysers.OutliersAnalyserTests | 25✅ | 52ms | ||
| BenchmarkDotNet.Tests.CsProjGeneratorTests | 10✅ | 51ms | ||
| BenchmarkDotNet.Tests.CorrectionsSuggesterTests | 10✅ | 44ms | ||
| BenchmarkDotNet.Tests.TypeFilterTests | 16✅ | 44ms | ||
| BenchmarkDotNet.Tests.BuildResultTests | 4✅ | 44ms | ||
| BenchmarkDotNet.Tests.Configs.JobTests | 13✅ | 41ms | ||
| BenchmarkDotNet.Tests.Validators.ParamsValidatorTests | 32✅ | 33ms | ||
| BenchmarkDotNet.Tests.Engine.EngineResultStageTests | 1✅ | 29ms | ||
| BenchmarkDotNet.Tests.Attributes.ParamsAllValuesVerifyTests | 7✅ | 28ms | ||
| BenchmarkDotNet.Tests.Validators.CompilationValidatorTests | 27✅ | 24ms | ||
| BenchmarkDotNet.Tests.Detectors.Cpu.LinuxCpuInfoParserTests | 11✅ | 22ms | ||
| BenchmarkDotNet.Tests.Reports.RatioPrecisionTests | 3✅ | 20ms | ||
| BenchmarkDotNet.Tests.Mathematics.RankTests | 1✅ | 17ms | ||
| BenchmarkDotNet.Tests.FullNameProviderTests | 20✅ | 17ms | ||
| BenchmarkDotNet.Tests.MonoDisassemblyOutputParserTests | 4✅ | 17ms | ||
| BenchmarkDotNet.Tests.Reports.ColumnTests | 1✅ | 16ms | ||
| BenchmarkDotNet.Tests.Detectors.Cpu.WmicCpuInfoParserTests | 5✅ | 16ms | ||
| BenchmarkDotNet.Tests.Running.BenchmarkConverterTests | 11✅ | 15ms | ||
| BenchmarkDotNet.Tests.Engine.EngineActualStageTests | 3✅ | 15ms | ||
| BenchmarkDotNet.Tests.Reports.RatioStyleTests | 2✅ | 13ms | ||
| BenchmarkDotNet.Tests.Exporters.XmlSerializerTests | 23✅ | 13ms | ||
| BenchmarkDotNet.Tests.GenericBuilderTests | 6✅ | 13ms | ||
| BenchmarkDotNet.Tests.GlobFilterTests | 20✅ | 13ms | ||
| BenchmarkDotNet.Tests.Configs.ConfigPerMethodTests | 4✅ | 12ms | ||
| BenchmarkDotNet.Tests.Validators.DeferredExecutionValidatorTests | 7✅ | 12ms | ||
| BenchmarkDotNet.Tests.Order.DefaultOrdererTests | 2✅ | 11ms | ||
| BenchmarkDotNet.Tests.Columns.StatisticalTestColumnTests | 5✅ | 11ms | ||
| BenchmarkDotNet.Tests.ReflectionTests | 8✅ | 11ms | ||
| BenchmarkDotNet.Tests.Validators.RuntimeValidatorTests | 3✅ | 10ms | ||
| BenchmarkDotNet.Tests.Analysers.ZeroMeasurementHelperTests | 21✅ | 10ms | ||
| BenchmarkDotNet.Tests.Running.JobRuntimePropertiesComparerTests | 4✅ | 1⚪ | 10ms | |
| BenchmarkDotNet.Tests.AppConfigGeneratorTests | 8✅ | 1⚪ | 9ms | |
| BenchmarkDotNet.Tests.Reports.DisplayPrecisionManagerTests | 29✅ | 9ms | ||
| BenchmarkDotNet.Tests.RuntimeVersionDetectionTests | 36✅ | 9ms | ||
| BenchmarkDotNet.Tests.Portability.VirtualBoxTests | 5✅ | 8ms | ||
| BenchmarkDotNet.Tests.ParamsSourceTests | 1✅ | 7ms | ||
| BenchmarkDotNet.Tests.ParameterComparerTests | 6✅ | 7ms | ||
| BenchmarkDotNet.Tests.Loggers.LoggerWithPrefixTests | 11✅ | 7ms | ||
| BenchmarkDotNet.Tests.Reports.SummaryTests | 1✅ | 7ms | ||
| BenchmarkDotNet.Tests.ParameterInstanceTests | 25✅ | 6ms | ||
| BenchmarkDotNet.Tests.Columns.MetricColumnTests | 4✅ | 6ms | ||
| BenchmarkDotNet.Tests.EventPipeProfilerTests | 5✅ | 6ms | ||
| BenchmarkDotNet.Tests.Engine.EngineWarmupStageTests | 6✅ | 6ms | ||
| BenchmarkDotNet.Tests.Environments.HostEnvironmentInfoTests | 4✅ | 5ms | ||
| BenchmarkDotNet.Tests.Order.JobOrderTests | 27✅ | 5ms | ||
| BenchmarkDotNet.Tests.Configs.CategoriesTests | 3✅ | 4ms | ||
| BenchmarkDotNet.Tests.Engine.EnginePilotStageTests | 3✅ | 4ms | ||
| BenchmarkDotNet.Tests.LightJsonSerializerTests | 2✅ | 4ms | ||
| BenchmarkDotNet.Tests.StringExtensionsTests | 19✅ | 4ms | ||
| BenchmarkDotNet.Tests.Configs.EnvironmentVariableTests | 6✅ | 4ms | ||
| BenchmarkDotNet.Tests.Validators.SetupCleanupValidatorTests | 2✅ | 4ms | ||
| BenchmarkDotNet.Tests.SourceCodeHelperTests | 25✅ | 3ms | ||
| BenchmarkDotNet.Tests.Detectors.Cpu.CpuInfoFormatterTests | 1✅ | 2ms | ||
| BenchmarkDotNet.Tests.Attributes.MutatorAttributesTests | 1✅ | 2ms | ||
| BenchmarkDotNet.Tests.Detectors.Cpu.SysctlCpuInfoParserTests | 3✅ | 2ms | ||
| BenchmarkDotNet.Tests.BenchmarkDotNetInfoTests | 4✅ | 1ms | ||
| BenchmarkDotNet.Tests.FolderNameTests | 12✅ | 1ms | ||
| BenchmarkDotNet.Tests.SimpleJsonTests | 2✅ | 1ms | ||
| BenchmarkDotNet.Tests.CsvHelperTests | 8✅ | 1ms | ||
| BenchmarkDotNet.Tests.ArtifactFileNameHelperTests | 1⚪ | 1ms | ||
| BenchmarkDotNet.Tests.Configs.ConfigOptionsTests | 10✅ | 1ms | ||
| BenchmarkDotNet.Tests.LevenshteinDistanceCalculatorTests | 6✅ | 1ms | ||
| BenchmarkDotNet.Tests.dotMemory.DotMemoryTests | 1✅ | 1ms | ||
| BenchmarkDotNet.Tests.TargetFrameworkVersionParsingTestscs | 4✅ | 1ms | ||
| BenchmarkDotNet.Tests.dotTrace.DotTraceTests | 1✅ | 1ms | ||
| BenchmarkDotNet.Tests.Mathematics.NumeralSystemTests | 3✅ | 1ms | ||
| BenchmarkDotNet.Tests.Helpers.LinuxOsReleaseHelperTests | 14✅ | 1ms | ||
| BenchmarkDotNet.Tests.Portability.HyperVTests | 8✅ | 1ms | ||
| BenchmarkDotNet.Tests.SummaryStyleTests | 1✅ | 1ms | ||
| BenchmarkDotNet.Tests.XUnit.EnvRequirementCheckerTests | 1✅ | 1ms | ||
| BenchmarkDotNet.Tests.Portability.VMwareTests | 7✅ | 1ms | ||
| BenchmarkDotNet.Tests.FrameworkVersionHelperTests | 16✅ | 1ms | ||
| BenchmarkDotNet.Tests.CharacteristicPresenterTests | 3✅ | 1ms | ||
| BenchmarkDotNet.Tests.Columns.TagColumnTests | 1✅ | 1ms | ||
| BenchmarkDotNet.Tests.Properties.BenchmarkDotNetInfoTests | 5✅ | 1ms |
✅ test-macos(arm64)-trx-15659621179/TestResults/macos(arm64)-exporters-net8.0.trx
51 tests were completed in 6s 737ms with 51 passed, 0 failed and 0 skipped.
| Test suite | Passed | Failed | Skipped | Time |
|---|---|---|---|---|
| BenchmarkDotNet.Exporters.Plotting.Tests.ScottPlotExporterTests | 51✅ | 6s 331ms |
✅ test-macos(arm64)-trx-15659621179/TestResults/macos(arm64)-integration-net8.0.trx
250 tests were completed in 15m 10s 460ms with 233 passed, 0 failed and 17 skipped.
| Test suite | Passed | Failed | Skipped | Time |
|---|---|---|---|---|
| BenchmarkDotNet.IntegrationTests.ArgumentsTests | 59✅ | 2m 10s 045ms | ||
| BenchmarkDotNet.IntegrationTests.MemoryDiagnoserTests | 11✅ | 2m 06s 299ms | ||
| BenchmarkDotNet.IntegrationTests.BenchmarkSwitcherTest | 21✅ | 1m 11s 888ms | ||
| BenchmarkDotNet.IntegrationTests.ParamsTests | 12✅ | 51s 849ms | ||
| BenchmarkDotNet.IntegrationTests.RunStrategyTests | 1✅ | 46s 690ms | ||
| BenchmarkDotNet.IntegrationTests.ExceptionHandlingTests | 17✅ | 46s 283ms | ||
| BenchmarkDotNet.IntegrationTests.AllSetupAndCleanupTest | 7✅ | 34s 046ms | ||
| BenchmarkDotNet.IntegrationTests.DotMemoryTests | 1✅ | 32s 175ms | ||
| BenchmarkDotNet.IntegrationTests.WasmTests | 1✅ | 30s 750ms | ||
| BenchmarkDotNet.IntegrationTests.ParamSourceTests | 11✅ | 30s 298ms | ||
| BenchmarkDotNet.IntegrationTests.NuGetReferenceTests | 1✅ | 1⚪ | 29s 528ms | |
| BenchmarkDotNet.IntegrationTests.MonoTests | 1✅ | 28s 838ms | ||
| BenchmarkDotNet.IntegrationTests.CustomBuildConfigurationTests | 1✅ | 27s 280ms | ||
| BenchmarkDotNet.IntegrationTests.GcModeTests | 6✅ | 26s 084ms | ||
| BenchmarkDotNet.IntegrationTests.ThreadingDiagnoserTests | 2✅ | 18s 360ms | ||
| BenchmarkDotNet.IntegrationTests.DotTraceTests | 1✅ | 16s 124ms | ||
| BenchmarkDotNet.IntegrationTests.EventProcessorTests | 6✅ | 13s 572ms | ||
| BenchmarkDotNet.IntegrationTests.ExceptionDiagnoserTests | 1✅ | 13s 008ms | ||
| BenchmarkDotNet.IntegrationTests.EnvironmentVariablesTests | 3✅ | 11s 931ms | ||
| BenchmarkDotNet.IntegrationTests.AsyncBenchmarksTests | 2✅ | 11s 697ms | ||
| BenchmarkDotNet.IntegrationTests.DryRunTests | 2✅ | 8s 484ms | ||
| BenchmarkDotNet.IntegrationTests.StandardErrorTests | 2✅ | 8s 425ms | ||
| BenchmarkDotNet.IntegrationTests.ProcessorArchitectureTest | 2✅ | 8s 326ms | ||
| BenchmarkDotNet.IntegrationTests.ValuesReturnedByBenchmarkTest | 2✅ | 7s 796ms | ||
| BenchmarkDotNet.IntegrationTests.ReferencesTests | 2✅ | 6s 158ms | ||
| BenchmarkDotNet.IntegrationTests.StatResultExtenderTests | 1✅ | 5s 311ms | ||
| BenchmarkDotNet.IntegrationTests.BaselineRatioColumnWithLongParamsTest | 1✅ | 5s 219ms | ||
| BenchmarkDotNet.IntegrationTests.SetupAndCleanupTests | 1✅ | 5s 117ms | ||
| BenchmarkDotNet.IntegrationTests.PriorityTests | 1✅ | 5s 101ms | ||
| BenchmarkDotNet.IntegrationTests.EngineTests | 3✅ | 4s 880ms | ||
| BenchmarkDotNet.IntegrationTests.BaselineRatioColumnTest | 1✅ | 4s 877ms | ||
| BenchmarkDotNet.IntegrationTests.CustomEngineTests | 1✅ | 4s 379ms | ||
| BenchmarkDotNet.IntegrationTests.BaselineRatioResultExtenderNoBaselineTest | 1✅ | 4s 231ms | ||
| BenchmarkDotNet.IntegrationTests.AppConfigTests | 1✅ | 4s 157ms | ||
| BenchmarkDotNet.IntegrationTests.LanguageVersionTests | 1✅ | 4s 062ms | ||
| BenchmarkDotNet.IntegrationTests.JitRuntimeValidationTest | 3✅ | 1⚪ | 3s 982ms | |
| BenchmarkDotNet.IntegrationTests.FailingProcessSpawnTests | 1✅ | 3s 974ms | ||
| BenchmarkDotNet.IntegrationTests.WakeLockTests | 5✅ | 4⚪ | 3s 962ms | |
| BenchmarkDotNet.IntegrationTests.AttributesTests | 1✅ | 3s 952ms | ||
| BenchmarkDotNet.IntegrationTests.ToolchainTest | 1✅ | 3s 905ms | ||
| BenchmarkDotNet.IntegrationTests.FSharpTests | 1✅ | 3s 319ms | ||
| BenchmarkDotNet.IntegrationTests.AssemblyConfigTests | 1✅ | 2s 653ms | ||
| BenchmarkDotNet.IntegrationTests.InProcessEmitTest | 6✅ | 1⚪ | 238ms | |
| BenchmarkDotNet.IntegrationTests.InProcessTest | 11✅ | 185ms | ||
| BenchmarkDotNet.IntegrationTests.ValidatorsTest | 2✅ | 58ms | ||
| BenchmarkDotNet.IntegrationTests.BaselineRatioResultExtenderErrorTest | 1✅ | 42ms | ||
| BenchmarkDotNet.IntegrationTests.ExporterIOTests | 3✅ | 1⚪ | 3ms | |
| BenchmarkDotNet.IntegrationTests.PowerManagementApplierTests | 2⚪ | 2ms | ||
| BenchmarkDotNet.IntegrationTests.ProcessPropertiesTests | 2⚪ | 2ms | ||
| BenchmarkDotNet.IntegrationTests.JitOptimizationsTests | 2✅ | 2ms | ||
| BenchmarkDotNet.IntegrationTests.ExtraAttributesForEntryMethodTests | 1⚪ | 1ms | ||
| BenchmarkDotNet.IntegrationTests.LargeAddressAwareTest | 1⚪ | 1ms | ||
| BenchmarkDotNet.IntegrationTests.MultipleRuntimesTest | 1⚪ | 1ms | ||
| BenchmarkDotNet.IntegrationTests.PathTooLongTests | 1⚪ | 1ms | ||
| BenchmarkDotNet.IntegrationTests.RoslynToolchainTest | 1⚪ | 1ms | ||
| BenchmarkDotNet.IntegrationTests.NativeAotTests | 1✅ | 1ms | ||
| BenchmarkDotNet.IntegrationTests.GlobalSetupAttributeInvalidMethodTest | 1✅ | 1ms | ||
| BenchmarkDotNet.IntegrationTests.DisassemblyDiagnoserTests | 4✅ | 1ms | ||
| BenchmarkDotNet.IntegrationTests.BuildTimeoutTests | 1✅ | 1ms | ||
| BenchmarkDotNet.IntegrationTests.IntegrationTestSetupTests | 1✅ | 1ms |
✅ test-macos(arm64)-trx-15659621179/TestResults/macos(arm64)-unit-net8.0.trx
933 tests were completed in 2m 39s 936ms with 925 passed, 0 failed and 8 skipped.
| Test suite | Passed | Failed | Skipped | Time |
|---|---|---|---|---|
| BenchmarkDotNet.Tests.Running.RunningEmptyBenchmarkTests | 19✅ | 2m 36s 083ms | ||
| BenchmarkDotNet.Tests.Exporters.MarkdownExporterVerifyTests | 17✅ | 4s 299ms | ||
| BenchmarkDotNet.Tests.Engine.EngineFactoryTests | 11✅ | 3s 556ms | ||
| BenchmarkDotNet.Tests.Columns.RatioColumnTest | 1✅ | 1s 798ms | ||
| BenchmarkDotNet.Tests.Validators.ExecutionValidatorTests | 26✅ | 1s 042ms | ||
| BenchmarkDotNet.Tests.Exporters.CommonExporterVerifyTests | 3✅ | 891ms | ||
| BenchmarkDotNet.Tests.Perfonar.PerfonarTests | 14✅ | 275ms | ||
| BenchmarkDotNet.Tests.ConfigParserTests | 96✅ | 3⚪ | 195ms | |
| BenchmarkDotNet.Tests.Reports.SummaryTableTests | 22✅ | 50ms | ||
| BenchmarkDotNet.Tests.Configs.ConfigPerMethodTests | 4✅ | 46ms | ||
| BenchmarkDotNet.Tests.TypeFilterTests | 16✅ | 39ms | ||
| BenchmarkDotNet.Tests.Analysers.OutliersAnalyserTests | 25✅ | 37ms | ||
| BenchmarkDotNet.Tests.Validators.ParamsValidatorTests | 32✅ | 37ms | ||
| BenchmarkDotNet.Tests.Columns.MetricColumnTests | 4✅ | 36ms | ||
| BenchmarkDotNet.Tests.Configs.ImmutableConfigTests | 38✅ | 2⚪ | 28ms | |
| BenchmarkDotNet.Tests.Order.DefaultOrdererTests | 2✅ | 27ms | ||
| BenchmarkDotNet.Tests.CorrectionsSuggesterTests | 10✅ | 19ms | ||
| BenchmarkDotNet.Tests.MonoDisassemblyOutputParserTests | 4✅ | 18ms | ||
| BenchmarkDotNet.Tests.Attributes.ParamsAllValuesVerifyTests | 7✅ | 18ms | ||
| BenchmarkDotNet.Tests.CsProjGeneratorTests | 10✅ | 18ms | ||
| BenchmarkDotNet.Tests.Validators.ReturnValueValidatorTests | 15✅ | 17ms | ||
| BenchmarkDotNet.Tests.BuildResultTests | 4✅ | 17ms | ||
| BenchmarkDotNet.Tests.Configs.JobTests | 13✅ | 14ms | ||
| BenchmarkDotNet.Tests.Reports.DisplayPrecisionManagerTests | 29✅ | 14ms | ||
| BenchmarkDotNet.Tests.Engine.EngineResultStageTests | 1✅ | 13ms | ||
| BenchmarkDotNet.Tests.Running.JobRuntimePropertiesComparerTests | 4✅ | 1⚪ | 13ms | |
| BenchmarkDotNet.Tests.Reports.RatioPrecisionTests | 3✅ | 13ms | ||
| BenchmarkDotNet.Tests.ParameterComparerTests | 6✅ | 12ms | ||
| BenchmarkDotNet.Tests.CodeGeneratorTests | 2✅ | 10ms | ||
| BenchmarkDotNet.Tests.Detectors.Cpu.LinuxCpuInfoParserTests | 11✅ | 10ms | ||
| BenchmarkDotNet.Tests.Exporters.XmlSerializerTests | 23✅ | 9ms | ||
| BenchmarkDotNet.Tests.Columns.StatisticalTestColumnTests | 5✅ | 9ms | ||
| BenchmarkDotNet.Tests.Engine.EngineWarmupStageTests | 6✅ | 8ms | ||
| BenchmarkDotNet.Tests.Order.JobOrderTests | 27✅ | 8ms | ||
| BenchmarkDotNet.Tests.Reports.RatioStyleTests | 2✅ | 8ms | ||
| BenchmarkDotNet.Tests.Validators.CompilationValidatorTests | 27✅ | 8ms | ||
| BenchmarkDotNet.Tests.RuntimeVersionDetectionTests | 36✅ | 7ms | ||
| BenchmarkDotNet.Tests.Mathematics.StatisticsTests | 9✅ | 7ms | ||
| BenchmarkDotNet.Tests.FullNameProviderTests | 20✅ | 7ms | ||
| BenchmarkDotNet.Tests.Reports.DefaultColumnProvidersTests | 3✅ | 7ms | ||
| BenchmarkDotNet.Tests.GlobFilterTests | 20✅ | 7ms | ||
| BenchmarkDotNet.Tests.Engine.EngineActualStageTests | 3✅ | 7ms | ||
| BenchmarkDotNet.Tests.Validators.DeferredExecutionValidatorTests | 7✅ | 7ms | ||
| BenchmarkDotNet.Tests.Running.BenchmarkConverterTests | 11✅ | 6ms | ||
| BenchmarkDotNet.Tests.Detectors.Cpu.WmicCpuInfoParserTests | 5✅ | 6ms | ||
| BenchmarkDotNet.Tests.Configs.CategoriesTests | 3✅ | 6ms | ||
| BenchmarkDotNet.Tests.GenericBuilderTests | 6✅ | 6ms | ||
| BenchmarkDotNet.Tests.AppConfigGeneratorTests | 8✅ | 1⚪ | 5ms | |
| BenchmarkDotNet.Tests.Environments.HostEnvironmentInfoTests | 4✅ | 5ms | ||
| BenchmarkDotNet.Tests.Configs.ConfigOptionsTests | 10✅ | 5ms | ||
| BenchmarkDotNet.Tests.Reports.SummaryTests | 1✅ | 5ms | ||
| BenchmarkDotNet.Tests.Analysers.ZeroMeasurementHelperTests | 21✅ | 5ms | ||
| BenchmarkDotNet.Tests.Engine.EnginePilotStageTests | 3✅ | 4ms | ||
| BenchmarkDotNet.Tests.SimpleJsonTests | 2✅ | 4ms | ||
| BenchmarkDotNet.Tests.Configs.EnvironmentVariableTests | 6✅ | 4ms | ||
| BenchmarkDotNet.Tests.ParameterInstanceTests | 25✅ | 4ms | ||
| BenchmarkDotNet.Tests.Loggers.LoggerWithPrefixTests | 11✅ | 4ms | ||
| BenchmarkDotNet.Tests.Validators.RuntimeValidatorTests | 3✅ | 3ms | ||
| BenchmarkDotNet.Tests.XUnit.EnvRequirementCheckerTests | 1✅ | 3ms | ||
| BenchmarkDotNet.Tests.Portability.VirtualBoxTests | 5✅ | 3ms | ||
| BenchmarkDotNet.Tests.Validators.SetupCleanupValidatorTests | 2✅ | 3ms | ||
| BenchmarkDotNet.Tests.Mathematics.RankTests | 1✅ | 2ms | ||
| BenchmarkDotNet.Tests.EventPipeProfilerTests | 5✅ | 2ms | ||
| BenchmarkDotNet.Tests.ReflectionTests | 8✅ | 2ms | ||
| BenchmarkDotNet.Tests.ParamsSourceTests | 1✅ | 2ms | ||
| BenchmarkDotNet.Tests.StringExtensionsTests | 19✅ | 2ms | ||
| BenchmarkDotNet.Tests.Reports.ColumnTests | 1✅ | 2ms | ||
| BenchmarkDotNet.Tests.SourceCodeHelperTests | 25✅ | 2ms | ||
| BenchmarkDotNet.Tests.Detectors.Cpu.CpuInfoFormatterTests | 1✅ | 1ms | ||
| BenchmarkDotNet.Tests.Helpers.LinuxOsReleaseHelperTests | 14✅ | 1ms | ||
| BenchmarkDotNet.Tests.Portability.HyperVTests | 8✅ | 1ms | ||
| BenchmarkDotNet.Tests.CsvHelperTests | 8✅ | 1ms | ||
| BenchmarkDotNet.Tests.ArtifactFileNameHelperTests | 1⚪ | 1ms | ||
| BenchmarkDotNet.Tests.dotTrace.DotTraceTests | 1✅ | 1ms | ||
| BenchmarkDotNet.Tests.Attributes.MutatorAttributesTests | 1✅ | 1ms | ||
| BenchmarkDotNet.Tests.dotMemory.DotMemoryTests | 1✅ | 1ms | ||
| BenchmarkDotNet.Tests.BenchmarkDotNetInfoTests | 4✅ | 1ms | ||
| BenchmarkDotNet.Tests.Portability.VMwareTests | 7✅ | 1ms | ||
| BenchmarkDotNet.Tests.Detectors.Cpu.SysctlCpuInfoParserTests | 3✅ | 1ms | ||
| BenchmarkDotNet.Tests.FolderNameTests | 12✅ | 1ms | ||
| BenchmarkDotNet.Tests.LightJsonSerializerTests | 2✅ | 1ms | ||
| BenchmarkDotNet.Tests.LevenshteinDistanceCalculatorTests | 6✅ | 1ms | ||
| BenchmarkDotNet.Tests.TargetFrameworkVersionParsingTestscs | 4✅ | 1ms | ||
| BenchmarkDotNet.Tests.Mathematics.NumeralSystemTests | 3✅ | 1ms | ||
| BenchmarkDotNet.Tests.CharacteristicPresenterTests | 3✅ | 1ms | ||
| BenchmarkDotNet.Tests.SummaryStyleTests | 1✅ | 1ms | ||
| BenchmarkDotNet.Tests.Columns.TagColumnTests | 1✅ | 1ms | ||
| BenchmarkDotNet.Tests.FrameworkVersionHelperTests | 16✅ | 1ms | ||
| BenchmarkDotNet.Tests.Properties.BenchmarkDotNetInfoTests | 5✅ | 1ms |
✅ test-macos(x64)-trx-15659621179/TestResults/macos(x64)-exporters-net8.0.trx
51 tests were completed in 8s 831ms with 51 passed, 0 failed and 0 skipped.
| Test suite | Passed | Failed | Skipped | Time |
|---|---|---|---|---|
| BenchmarkDotNet.Exporters.Plotting.Tests.ScottPlotExporterTests | 51✅ | 8s 063ms |
✅ test-macos(x64)-trx-15659621179/TestResults/macos(x64)-integration-net8.0.trx
254 tests were completed in 33m 52s 422ms with 237 passed, 0 failed and 17 skipped.
| Test suite | Passed | Failed | Skipped | Time |
|---|---|---|---|---|
| BenchmarkDotNet.IntegrationTests.ArgumentsTests | 59✅ | 5m 30s 274ms | ||
| BenchmarkDotNet.IntegrationTests.MemoryDiagnoserTests | 11✅ | 4m 05s 517ms | ||
| BenchmarkDotNet.IntegrationTests.ParamsTests | 12✅ | 2m 57s 714ms | ||
| BenchmarkDotNet.IntegrationTests.BenchmarkSwitcherTest | 21✅ | 2m 22s 677ms | ||
| BenchmarkDotNet.IntegrationTests.ExceptionHandlingTests | 17✅ | 1m 56s 606ms | ||
| BenchmarkDotNet.IntegrationTests.ParamSourceTests | 11✅ | 1m 18s 640ms | ||
| BenchmarkDotNet.IntegrationTests.AllSetupAndCleanupTest | 7✅ | 1m 14s 007ms | ||
| BenchmarkDotNet.IntegrationTests.GcModeTests | 6✅ | 1m 04s 810ms | ||
| BenchmarkDotNet.IntegrationTests.NuGetReferenceTests | 1✅ | 1⚪ | 1m 02s 509ms | |
| BenchmarkDotNet.IntegrationTests.MonoTests | 1✅ | 1m 00s 796ms | ||
| BenchmarkDotNet.IntegrationTests.WasmTests | 1✅ | 1m 00s 543ms | ||
| BenchmarkDotNet.IntegrationTests.CustomBuildConfigurationTests | 1✅ | 59s 362ms | ||
| BenchmarkDotNet.IntegrationTests.RunStrategyTests | 1✅ | 50s 245ms | ||
| BenchmarkDotNet.IntegrationTests.DotMemoryTests | 1✅ | 45s 469ms | ||
| BenchmarkDotNet.IntegrationTests.ThreadingDiagnoserTests | 2✅ | 33s 866ms | ||
| BenchmarkDotNet.IntegrationTests.EventProcessorTests | 6✅ | 32s 915ms | ||
| BenchmarkDotNet.IntegrationTests.ProcessorArchitectureTest | 2✅ | 32s 080ms | ||
| BenchmarkDotNet.IntegrationTests.EnvironmentVariablesTests | 3✅ | 31s 404ms | ||
| BenchmarkDotNet.IntegrationTests.AsyncBenchmarksTests | 2✅ | 25s 421ms | ||
| BenchmarkDotNet.IntegrationTests.DotTraceTests | 1✅ | 24s 614ms | ||
| BenchmarkDotNet.IntegrationTests.StandardErrorTests | 2✅ | 21s 283ms | ||
| BenchmarkDotNet.IntegrationTests.ExceptionDiagnoserTests | 1✅ | 21s 244ms | ||
| BenchmarkDotNet.IntegrationTests.DryRunTests | 2✅ | 20s 512ms | ||
| BenchmarkDotNet.IntegrationTests.PriorityTests | 1✅ | 18s 168ms | ||
| BenchmarkDotNet.IntegrationTests.ValuesReturnedByBenchmarkTest | 2✅ | 17s 635ms | ||
| BenchmarkDotNet.IntegrationTests.ReferencesTests | 2✅ | 17s 083ms | ||
| BenchmarkDotNet.IntegrationTests.StatResultExtenderTests | 1✅ | 11s 595ms | ||
| BenchmarkDotNet.IntegrationTests.BaselineRatioColumnTest | 1✅ | 11s 525ms | ||
| BenchmarkDotNet.IntegrationTests.EngineTests | 3✅ | 11s 423ms | ||
| BenchmarkDotNet.IntegrationTests.BaselineRatioColumnWithLongParamsTest | 1✅ | 11s 115ms | ||
| BenchmarkDotNet.IntegrationTests.JitRuntimeValidationTest | 3✅ | 1⚪ | 11s 072ms | |
| BenchmarkDotNet.IntegrationTests.LanguageVersionTests | 1✅ | 10s 837ms | ||
| BenchmarkDotNet.IntegrationTests.ToolchainTest | 1✅ | 10s 777ms | ||
| BenchmarkDotNet.IntegrationTests.AttributesTests | 1✅ | 10s 740ms | ||
| BenchmarkDotNet.IntegrationTests.BaselineRatioResultExtenderNoBaselineTest | 1✅ | 10s 685ms | ||
| BenchmarkDotNet.IntegrationTests.SetupAndCleanupTests | 1✅ | 10s 636ms | ||
| BenchmarkDotNet.IntegrationTests.AppConfigTests | 1✅ | 10s 330ms | ||
| BenchmarkDotNet.IntegrationTests.CustomEngineTests | 1✅ | 10s 305ms | ||
| BenchmarkDotNet.IntegrationTests.FailingProcessSpawnTests | 1✅ | 10s 046ms | ||
| BenchmarkDotNet.IntegrationTests.WakeLockTests | 5✅ | 4⚪ | 8s 953ms | |
| BenchmarkDotNet.IntegrationTests.FSharpTests | 1✅ | 7s 200ms | ||
| BenchmarkDotNet.IntegrationTests.AssemblyConfigTests | 1✅ | 6s 383ms | ||
| BenchmarkDotNet.IntegrationTests.InProcessEmitTest | 6✅ | 1⚪ | 504ms | |
| BenchmarkDotNet.IntegrationTests.InProcessTest | 11✅ | 352ms | ||
| BenchmarkDotNet.IntegrationTests.ValidatorsTest | 2✅ | 97ms | ||
| BenchmarkDotNet.IntegrationTests.BaselineRatioResultExtenderErrorTest | 1✅ | 58ms | ||
| BenchmarkDotNet.IntegrationTests.ExporterIOTests | 3✅ | 1⚪ | 9ms | |
| BenchmarkDotNet.IntegrationTests.JitOptimizationsTests | 2✅ | 4ms | ||
| BenchmarkDotNet.IntegrationTests.DisassemblyDiagnoserTests | 8✅ | 3ms | ||
| BenchmarkDotNet.IntegrationTests.PowerManagementApplierTests | 2⚪ | 2ms | ||
| BenchmarkDotNet.IntegrationTests.ProcessPropertiesTests | 2⚪ | 2ms | ||
| BenchmarkDotNet.IntegrationTests.GlobalSetupAttributeInvalidMethodTest | 1✅ | 2ms | ||
| BenchmarkDotNet.IntegrationTests.ExtraAttributesForEntryMethodTests | 1⚪ | 1ms | ||
| BenchmarkDotNet.IntegrationTests.LargeAddressAwareTest | 1⚪ | 1ms | ||
| BenchmarkDotNet.IntegrationTests.MultipleRuntimesTest | 1⚪ | 1ms | ||
| BenchmarkDotNet.IntegrationTests.PathTooLongTests | 1⚪ | 1ms | ||
| BenchmarkDotNet.IntegrationTests.RoslynToolchainTest | 1⚪ | 1ms | ||
| BenchmarkDotNet.IntegrationTests.NativeAotTests | 1✅ | 1ms | ||
| BenchmarkDotNet.IntegrationTests.BuildTimeoutTests | 1✅ | 1ms | ||
| BenchmarkDotNet.IntegrationTests.IntegrationTestSetupTests | 1✅ | 1ms |
✅ test-macos(x64)-trx-15659621179/TestResults/macos(x64)-unit-net8.0.trx
933 tests were completed in 4m 55s 024ms with 925 passed, 0 failed and 8 skipped.
| Test suite | Passed | Failed | Skipped | Time |
|---|---|---|---|---|
| BenchmarkDotNet.Tests.Running.RunningEmptyBenchmarkTests | 19✅ | 4m 53s 543ms | ||
| BenchmarkDotNet.Tests.Columns.RatioColumnTest | 1✅ | 4s 823ms | ||
| BenchmarkDotNet.Tests.Exporters.MarkdownExporterVerifyTests | 17✅ | 4s 037ms | ||
| BenchmarkDotNet.Tests.Engine.EngineFactoryTests | 11✅ | 3s 909ms | ||
| BenchmarkDotNet.Tests.Perfonar.PerfonarTests | 14✅ | 2s 314ms | ||
| BenchmarkDotNet.Tests.Validators.ExecutionValidatorTests | 26✅ | 1s 103ms | ||
| BenchmarkDotNet.Tests.ConfigParserTests | 96✅ | 3⚪ | 470ms | |
| BenchmarkDotNet.Tests.Exporters.CommonExporterVerifyTests | 3✅ | 354ms | ||
| BenchmarkDotNet.Tests.ParamsSourceTests | 1✅ | 165ms | ||
| BenchmarkDotNet.Tests.Reports.SummaryTableTests | 22✅ | 112ms | ||
| BenchmarkDotNet.Tests.TypeFilterTests | 16✅ | 72ms | ||
| BenchmarkDotNet.Tests.Mathematics.RankTests | 1✅ | 70ms | ||
| BenchmarkDotNet.Tests.Attributes.ParamsAllValuesVerifyTests | 7✅ | 68ms | ||
| BenchmarkDotNet.Tests.Analysers.OutliersAnalyserTests | 25✅ | 68ms | ||
| BenchmarkDotNet.Tests.CsProjGeneratorTests | 10✅ | 65ms | ||
| BenchmarkDotNet.Tests.GenericBuilderTests | 6✅ | 55ms | ||
| BenchmarkDotNet.Tests.Reports.ColumnTests | 1✅ | 54ms | ||
| BenchmarkDotNet.Tests.Configs.JobTests | 13✅ | 46ms | ||
| BenchmarkDotNet.Tests.CorrectionsSuggesterTests | 10✅ | 41ms | ||
| BenchmarkDotNet.Tests.Reports.SummaryTests | 1✅ | 39ms | ||
| BenchmarkDotNet.Tests.Configs.ImmutableConfigTests | 38✅ | 2⚪ | 38ms | |
| BenchmarkDotNet.Tests.Detectors.Cpu.SysctlCpuInfoParserTests | 3✅ | 36ms | ||
| BenchmarkDotNet.Tests.Validators.ReturnValueValidatorTests | 15✅ | 35ms | ||
| BenchmarkDotNet.Tests.Reports.RatioStyleTests | 2✅ | 33ms | ||
| BenchmarkDotNet.Tests.Mathematics.StatisticsTests | 9✅ | 30ms | ||
| BenchmarkDotNet.Tests.Reports.DefaultColumnProvidersTests | 3✅ | 28ms | ||
| BenchmarkDotNet.Tests.Validators.ParamsValidatorTests | 32✅ | 27ms | ||
| BenchmarkDotNet.Tests.Validators.CompilationValidatorTests | 27✅ | 25ms | ||
| BenchmarkDotNet.Tests.Reports.RatioPrecisionTests | 3✅ | 25ms | ||
| BenchmarkDotNet.Tests.Order.DefaultOrdererTests | 2✅ | 24ms | ||
| BenchmarkDotNet.Tests.Columns.StatisticalTestColumnTests | 5✅ | 23ms | ||
| BenchmarkDotNet.Tests.BuildResultTests | 4✅ | 23ms | ||
| BenchmarkDotNet.Tests.Running.JobRuntimePropertiesComparerTests | 4✅ | 1⚪ | 22ms | |
| BenchmarkDotNet.Tests.FullNameProviderTests | 20✅ | 20ms | ||
| BenchmarkDotNet.Tests.Running.BenchmarkConverterTests | 11✅ | 19ms | ||
| BenchmarkDotNet.Tests.GlobFilterTests | 20✅ | 18ms | ||
| BenchmarkDotNet.Tests.Detectors.Cpu.LinuxCpuInfoParserTests | 11✅ | 17ms | ||
| BenchmarkDotNet.Tests.MonoDisassemblyOutputParserTests | 4✅ | 17ms | ||
| BenchmarkDotNet.Tests.Exporters.XmlSerializerTests | 23✅ | 16ms | ||
| BenchmarkDotNet.Tests.Configs.ConfigPerMethodTests | 4✅ | 15ms | ||
| BenchmarkDotNet.Tests.LightJsonSerializerTests | 2✅ | 15ms | ||
| BenchmarkDotNet.Tests.Engine.EngineActualStageTests | 3✅ | 15ms | ||
| BenchmarkDotNet.Tests.Analysers.ZeroMeasurementHelperTests | 21✅ | 14ms | ||
| BenchmarkDotNet.Tests.EventPipeProfilerTests | 5✅ | 13ms | ||
| BenchmarkDotNet.Tests.Validators.DeferredExecutionValidatorTests | 7✅ | 13ms | ||
| BenchmarkDotNet.Tests.FrameworkVersionHelperTests | 16✅ | 12ms | ||
| BenchmarkDotNet.Tests.Engine.EngineWarmupStageTests | 6✅ | 11ms | ||
| BenchmarkDotNet.Tests.Engine.EngineResultStageTests | 1✅ | 11ms | ||
| BenchmarkDotNet.Tests.AppConfigGeneratorTests | 8✅ | 1⚪ | 10ms | |
| BenchmarkDotNet.Tests.Reports.DisplayPrecisionManagerTests | 29✅ | 10ms | ||
| BenchmarkDotNet.Tests.ParameterComparerTests | 6✅ | 9ms | ||
| BenchmarkDotNet.Tests.Engine.EnginePilotStageTests | 3✅ | 9ms | ||
| BenchmarkDotNet.Tests.Configs.CategoriesTests | 3✅ | 8ms | ||
| BenchmarkDotNet.Tests.LevenshteinDistanceCalculatorTests | 6✅ | 6ms | ||
| BenchmarkDotNet.Tests.RuntimeVersionDetectionTests | 36✅ | 6ms | ||
| BenchmarkDotNet.Tests.StringExtensionsTests | 19✅ | 6ms | ||
| BenchmarkDotNet.Tests.Configs.EnvironmentVariableTests | 6✅ | 6ms | ||
| BenchmarkDotNet.Tests.Order.JobOrderTests | 27✅ | 6ms | ||
| BenchmarkDotNet.Tests.Validators.RuntimeValidatorTests | 3✅ | 5ms | ||
| BenchmarkDotNet.Tests.Validators.SetupCleanupValidatorTests | 2✅ | 5ms | ||
| BenchmarkDotNet.Tests.ReflectionTests | 8✅ | 5ms | ||
| BenchmarkDotNet.Tests.Detectors.Cpu.CpuInfoFormatterTests | 1✅ | 5ms | ||
| BenchmarkDotNet.Tests.Detectors.Cpu.WmicCpuInfoParserTests | 5✅ | 4ms | ||
| BenchmarkDotNet.Tests.Environments.HostEnvironmentInfoTests | 4✅ | 4ms | ||
| BenchmarkDotNet.Tests.Portability.HyperVTests | 8✅ | 4ms | ||
| BenchmarkDotNet.Tests.ParameterInstanceTests | 25✅ | 4ms | ||
| BenchmarkDotNet.Tests.CodeGeneratorTests | 2✅ | 4ms | ||
| BenchmarkDotNet.Tests.Columns.MetricColumnTests | 4✅ | 3ms | ||
| BenchmarkDotNet.Tests.Loggers.LoggerWithPrefixTests | 11✅ | 3ms | ||
| BenchmarkDotNet.Tests.Helpers.LinuxOsReleaseHelperTests | 14✅ | 3ms | ||
| BenchmarkDotNet.Tests.Columns.TagColumnTests | 1✅ | 3ms | ||
| BenchmarkDotNet.Tests.SourceCodeHelperTests | 25✅ | 3ms | ||
| BenchmarkDotNet.Tests.Configs.ConfigOptionsTests | 10✅ | 2ms | ||
| BenchmarkDotNet.Tests.Attributes.MutatorAttributesTests | 1✅ | 2ms | ||
| BenchmarkDotNet.Tests.dotTrace.DotTraceTests | 1✅ | 2ms | ||
| BenchmarkDotNet.Tests.Portability.VMwareTests | 7✅ | 1ms | ||
| BenchmarkDotNet.Tests.SimpleJsonTests | 2✅ | 1ms | ||
| BenchmarkDotNet.Tests.Mathematics.NumeralSystemTests | 3✅ | 1ms | ||
| BenchmarkDotNet.Tests.CsvHelperTests | 8✅ | 1ms | ||
| BenchmarkDotNet.Tests.FolderNameTests | 12✅ | 1ms | ||
| BenchmarkDotNet.Tests.CharacteristicPresenterTests | 3✅ | 1ms | ||
| BenchmarkDotNet.Tests.dotMemory.DotMemoryTests | 1✅ | 1ms | ||
| BenchmarkDotNet.Tests.ArtifactFileNameHelperTests | 1⚪ | 1ms | ||
| BenchmarkDotNet.Tests.TargetFrameworkVersionParsingTestscs | 4✅ | 1ms | ||
| BenchmarkDotNet.Tests.Portability.VirtualBoxTests | 5✅ | 1ms | ||
| BenchmarkDotNet.Tests.XUnit.EnvRequirementCheckerTests | 1✅ | 1ms | ||
| BenchmarkDotNet.Tests.BenchmarkDotNetInfoTests | 4✅ | 1ms | ||
| BenchmarkDotNet.Tests.SummaryStyleTests | 1✅ | 1ms | ||
| BenchmarkDotNet.Tests.Properties.BenchmarkDotNetInfoTests | 5✅ | 1ms |
✅ test-windows-core-trx-15659621179/TestResults/windows(x64)-integration-net8.0.trx
254 tests were completed in 25m 54s 888ms with 247 passed, 0 failed and 7 skipped.
| Test suite | Passed | Failed | Skipped | Time |
|---|---|---|---|---|
| BenchmarkDotNet.IntegrationTests.MemoryDiagnoserTests | 11✅ | 4m 35s 473ms | ||
| BenchmarkDotNet.IntegrationTests.ArgumentsTests | 59✅ | 3m 36s 762ms | ||
| BenchmarkDotNet.IntegrationTests.BenchmarkSwitcherTest | 21✅ | 1m 48s 470ms | ||
| BenchmarkDotNet.IntegrationTests.ParamsTests | 12✅ | 1m 21s 761ms | ||
| BenchmarkDotNet.IntegrationTests.ExceptionHandlingTests | 17✅ | 1m 16s 539ms | ||
| BenchmarkDotNet.IntegrationTests.NuGetReferenceTests | 1✅ | 1⚪ | 53s 517ms | |
| BenchmarkDotNet.IntegrationTests.AllSetupAndCleanupTest | 7✅ | 48s 568ms | ||
| BenchmarkDotNet.IntegrationTests.DotMemoryTests | 1✅ | 47s 811ms | ||
| BenchmarkDotNet.IntegrationTests.MonoTests | 1✅ | 46s 894ms | ||
| BenchmarkDotNet.IntegrationTests.CustomBuildConfigurationTests | 1✅ | 46s 737ms | ||
| BenchmarkDotNet.IntegrationTests.ParamSourceTests | 11✅ | 44s 273ms | ||
| BenchmarkDotNet.IntegrationTests.GcModeTests | 6✅ | 40s 642ms | ||
| BenchmarkDotNet.IntegrationTests.RunStrategyTests | 1✅ | 34s 866ms | ||
| BenchmarkDotNet.IntegrationTests.JitRuntimeValidationTest | 7✅ | 32s 623ms | ||
| BenchmarkDotNet.IntegrationTests.WakeLockTests | 8✅ | 2⚪ | 29s 021ms | |
| BenchmarkDotNet.IntegrationTests.DisassemblyDiagnoserTests | 4✅ | 28s 965ms | ||
| BenchmarkDotNet.IntegrationTests.ThreadingDiagnoserTests | 2✅ | 28s 945ms | ||
| BenchmarkDotNet.IntegrationTests.DotTraceTests | 1✅ | 23s 080ms | ||
| BenchmarkDotNet.IntegrationTests.EventProcessorTests | 6✅ | 21s 589ms | ||
| BenchmarkDotNet.IntegrationTests.EnvironmentVariablesTests | 3✅ | 20s 619ms | ||
| BenchmarkDotNet.IntegrationTests.AsyncBenchmarksTests | 2✅ | 17s 022ms | ||
| BenchmarkDotNet.IntegrationTests.ExceptionDiagnoserTests | 1✅ | 16s 126ms | ||
| BenchmarkDotNet.IntegrationTests.StandardErrorTests | 2✅ | 13s 687ms | ||
| BenchmarkDotNet.IntegrationTests.ProcessorArchitectureTest | 2✅ | 13s 631ms | ||
| BenchmarkDotNet.IntegrationTests.DryRunTests | 2✅ | 13s 619ms | ||
| BenchmarkDotNet.IntegrationTests.ProcessPropertiesTests | 2✅ | 13s 599ms | ||
| BenchmarkDotNet.IntegrationTests.LargeAddressAwareTest | 1✅ | 12s 773ms | ||
| BenchmarkDotNet.IntegrationTests.MultipleRuntimesTest | 1✅ | 12s 718ms | ||
| BenchmarkDotNet.IntegrationTests.ValuesReturnedByBenchmarkTest | 2✅ | 12s 211ms | ||
| BenchmarkDotNet.IntegrationTests.ReferencesTests | 2✅ | 9s 912ms | ||
| BenchmarkDotNet.IntegrationTests.PriorityTests | 1✅ | 7s 906ms | ||
| BenchmarkDotNet.IntegrationTests.BaselineRatioColumnTest | 1✅ | 7s 592ms | ||
| BenchmarkDotNet.IntegrationTests.BaselineRatioColumnWithLongParamsTest | 1✅ | 7s 441ms | ||
| BenchmarkDotNet.IntegrationTests.StatResultExtenderTests | 1✅ | 7s 346ms | ||
| BenchmarkDotNet.IntegrationTests.EngineTests | 3✅ | 7s 128ms | ||
| BenchmarkDotNet.IntegrationTests.SetupAndCleanupTests | 1✅ | 7s 126ms | ||
| BenchmarkDotNet.IntegrationTests.FailingProcessSpawnTests | 1✅ | 7s 122ms | ||
| BenchmarkDotNet.IntegrationTests.BaselineRatioResultExtenderNoBaselineTest | 1✅ | 7s 056ms | ||
| BenchmarkDotNet.IntegrationTests.AppConfigTests | 1✅ | 6s 922ms | ||
| BenchmarkDotNet.IntegrationTests.CustomEngineTests | 1✅ | 6s 883ms | ||
| BenchmarkDotNet.IntegrationTests.AttributesTests | 1✅ | 6s 817ms | ||
| BenchmarkDotNet.IntegrationTests.ToolchainTest | 1✅ | 6s 816ms | ||
| BenchmarkDotNet.IntegrationTests.LanguageVersionTests | 1✅ | 6s 784ms | ||
| BenchmarkDotNet.IntegrationTests.PathTooLongTests | 1✅ | 6s 658ms | ||
| BenchmarkDotNet.IntegrationTests.FSharpTests | 1✅ | 4s 619ms | ||
| BenchmarkDotNet.IntegrationTests.AssemblyConfigTests | 1✅ | 4s 596ms | ||
| BenchmarkDotNet.IntegrationTests.BuildTimeoutTests | 1✅ | 1s 236ms | ||
| BenchmarkDotNet.IntegrationTests.InProcessEmitTest | 6✅ | 1⚪ | 624ms | |
| BenchmarkDotNet.IntegrationTests.InProcessTest | 11✅ | 269ms | ||
| BenchmarkDotNet.IntegrationTests.ValidatorsTest | 2✅ | 64ms | ||
| BenchmarkDotNet.IntegrationTests.BaselineRatioResultExtenderErrorTest | 1✅ | 46ms | ||
| BenchmarkDotNet.IntegrationTests.PowerManagementApplierTests | 2✅ | 29ms | ||
| BenchmarkDotNet.IntegrationTests.ExporterIOTests | 4✅ | 12ms | ||
| BenchmarkDotNet.IntegrationTests.JitOptimizationsTests | 2✅ | 3ms | ||
| BenchmarkDotNet.IntegrationTests.ExtraAttributesForEntryMethodTests | 1⚪ | 1ms | ||
| BenchmarkDotNet.IntegrationTests.RoslynToolchainTest | 1⚪ | 1ms | ||
| BenchmarkDotNet.IntegrationTests.WasmTests | 1⚪ | 1ms | ||
| BenchmarkDotNet.IntegrationTests.GlobalSetupAttributeInvalidMethodTest | 1✅ | 1ms | ||
| BenchmarkDotNet.IntegrationTests.NativeAotTests | 1✅ | 1ms | ||
| BenchmarkDotNet.IntegrationTests.IntegrationTestSetupTests | 1✅ | 1ms |
✅ test-windows-full-trx-15659621179/TestResults/windows(x64)-integration-net462.trx
284 tests were completed in 24m 56s 792ms with 271 passed, 0 failed and 13 skipped.
| Test suite | Passed | Failed | Skipped | Time |
|---|---|---|---|---|
| BenchmarkDotNet.IntegrationTests.DisassemblyDiagnoserTests | 12✅ | 7m 56s 276ms | ||
| BenchmarkDotNet.IntegrationTests.JitRuntimeValidationTest | 7✅ | 3m 14s 841ms | ||
| BenchmarkDotNet.IntegrationTests.TailCallDiagnoserTests | 4✅ | 2m 41s 459ms | ||
| BenchmarkDotNet.IntegrationTests.MemoryDiagnoserTests | 14✅ | 4⚪ | 1m 53s 388ms | |
| BenchmarkDotNet.IntegrationTests.MultipleRuntimesTest | 1✅ | 1m 25s 337ms | ||
| BenchmarkDotNet.IntegrationTests.LargeAddressAwareTest | 1✅ | 1m 24s 642ms | ||
| BenchmarkDotNet.IntegrationTests.RunStrategyTests | 1✅ | 54s 720ms | ||
| BenchmarkDotNet.IntegrationTests.DotMemoryTests | 1✅ | 53s 315ms | ||
| BenchmarkDotNet.IntegrationTests.BenchmarkSwitcherTest | 19✅ | 2⚪ | 43s 848ms | |
| BenchmarkDotNet.IntegrationTests.NuGetReferenceTests | 2✅ | 43s 007ms | ||
| BenchmarkDotNet.IntegrationTests.InProcessEmitTest | 12✅ | 40s 528ms | ||
| BenchmarkDotNet.IntegrationTests.ArgumentsTests | 57✅ | 1⚪ | 23s 370ms | |
| BenchmarkDotNet.IntegrationTests.DotTraceTests | 1✅ | 21s 288ms | ||
| BenchmarkDotNet.IntegrationTests.ValuesReturnedByBenchmarkTest | 2✅ | 11s 032ms | ||
| BenchmarkDotNet.IntegrationTests.ExceptionDiagnoserTests | 1✅ | 10s 525ms | ||
| BenchmarkDotNet.IntegrationTests.AllSetupAndCleanupTest | 7✅ | 9s 747ms | ||
| BenchmarkDotNet.IntegrationTests.ParamSourceTests | 11✅ | 8s 428ms | ||
| BenchmarkDotNet.IntegrationTests.ExceptionHandlingTests | 17✅ | 5s 485ms | ||
| BenchmarkDotNet.IntegrationTests.AsyncBenchmarksTests | 2✅ | 4s 449ms | ||
| BenchmarkDotNet.IntegrationTests.ParamsTests | 11✅ | 3s 673ms | ||
| BenchmarkDotNet.IntegrationTests.EngineTests | 3✅ | 2s 762ms | ||
| BenchmarkDotNet.IntegrationTests.EventProcessorTests | 6✅ | 2s 337ms | ||
| BenchmarkDotNet.IntegrationTests.GcModeTests | 7✅ | 2s 035ms | ||
| BenchmarkDotNet.IntegrationTests.ReferencesTests | 4✅ | 1s 974ms | ||
| BenchmarkDotNet.IntegrationTests.PriorityTests | 1✅ | 1s 819ms | ||
| BenchmarkDotNet.IntegrationTests.BuildTimeoutTests | 1✅ | 1s 653ms | ||
| BenchmarkDotNet.IntegrationTests.WakeLockTests | 8✅ | 2⚪ | 1s 391ms | |
| BenchmarkDotNet.IntegrationTests.RoslynToolchainTest | 4✅ | 1s 271ms | ||
| BenchmarkDotNet.IntegrationTests.BaselineRatioColumnTest | 1✅ | 1s 075ms | ||
| BenchmarkDotNet.IntegrationTests.BaselineRatioColumnWithLongParamsTest | 1✅ | 1s 066ms | ||
| BenchmarkDotNet.IntegrationTests.InProcessTest | 10✅ | 1s 051ms | ||
| BenchmarkDotNet.IntegrationTests.ProcessorArchitectureTest | 3✅ | 871ms | ||
| BenchmarkDotNet.IntegrationTests.DryRunTests | 2✅ | 867ms | ||
| BenchmarkDotNet.IntegrationTests.EnvironmentVariablesTests | 3✅ | 863ms | ||
| BenchmarkDotNet.IntegrationTests.StatResultExtenderTests | 1✅ | 852ms | ||
| BenchmarkDotNet.IntegrationTests.ProcessPropertiesTests | 2✅ | 601ms | ||
| BenchmarkDotNet.IntegrationTests.BaselineRatioResultExtenderNoBaselineTest | 1✅ | 584ms | ||
| BenchmarkDotNet.IntegrationTests.SetupAndCleanupTests | 1✅ | 563ms | ||
| BenchmarkDotNet.IntegrationTests.StandardErrorTests | 2✅ | 559ms | ||
| BenchmarkDotNet.IntegrationTests.ToolchainTest | 1✅ | 320ms | ||
| BenchmarkDotNet.IntegrationTests.LanguageVersionTests | 1✅ | 302ms | ||
| BenchmarkDotNet.IntegrationTests.AppConfigTests | 1✅ | 301ms | ||
| BenchmarkDotNet.IntegrationTests.AssemblyConfigTests | 1✅ | 297ms | ||
| BenchmarkDotNet.IntegrationTests.AttributesTests | 1✅ | 294ms | ||
| BenchmarkDotNet.IntegrationTests.ExtraAttributesForEntryMethodTests | 1✅ | 291ms | ||
| BenchmarkDotNet.IntegrationTests.CopyToOutputTests | 1✅ | 276ms | ||
| BenchmarkDotNet.IntegrationTests.CustomEngineTests | 1✅ | 265ms | ||
| BenchmarkDotNet.IntegrationTests.FSharpTests | 1✅ | 264ms | ||
| BenchmarkDotNet.IntegrationTests.PathTooLongTests | 1✅ | 262ms | ||
| BenchmarkDotNet.IntegrationTests.FailingProcessSpawnTests | 1✅ | 119ms | ||
| BenchmarkDotNet.IntegrationTests.ValidatorsTest | 2✅ | 88ms | ||
| BenchmarkDotNet.IntegrationTests.PowerManagementApplierTests | 2✅ | 34ms | ||
| BenchmarkDotNet.IntegrationTests.Diagnosers.ProcessMetricsTests | 3✅ | 17ms | ||
| BenchmarkDotNet.IntegrationTests.ExporterIOTests | 4✅ | 10ms | ||
| BenchmarkDotNet.IntegrationTests.BaselineRatioResultExtenderErrorTest | 1✅ | 7ms | ||
| BenchmarkDotNet.IntegrationTests.JitOptimizationsTests | 2✅ | 5ms | ||
| BenchmarkDotNet.IntegrationTests.CustomBuildConfigurationTests | 1⚪ | 1ms | ||
| BenchmarkDotNet.IntegrationTests.GlobalSetupAttributeInvalidMethodTest | 1✅ | 1ms | ||
| BenchmarkDotNet.IntegrationTests.IntegrationTestSetupTests | 1✅ | 1ms | ||
| BenchmarkDotNet.IntegrationTests.MonoTests | 1⚪ | 1ms | ||
| BenchmarkDotNet.IntegrationTests.NativeAotTests | 1⚪ | 1ms | ||
| BenchmarkDotNet.IntegrationTests.WasmTests | 1⚪ | 1ms |