The active test run was aborted. Reason: Test host process crashed

[fanyang-mono]

Build

https://dev.azure.com/dnceng-public/cbb18261-c48f-4abb-8651-8cdcb5474649/_build/results?buildId=351450

Build leg reported

chrome-DebuggerTests.EvaluateOnCallFrameTests.WorkItemExecution

Pull Request

dotnet/runtime#89217

Known issue core information

Fill out the known issue JSON section by following the step by step documentation on how to create a known issue

 {
    "ErrorMessage" : "The active test run was aborted. Reason: Test host process crashed",
    "BuildRetry": false,
    "ErrorPattern": "",
    "ExcludeConsoleLog": false
 }

@dotnet/dnceng

Release Note Category

• Feature changes/additions
• Bug fixes
• Internal Infrastructure Improvements

Release Note Description

Additional information about the issue reported

No response

Report

Build	Definition	Step Name	Console log	Pull Request
1024848	dotnet/roslyn	Run Integration Tests	Log
1024264	dotnet/roslyn	Run Integration Tests	Log
1024242	dotnet/roslyn	Run Integration Tests	Log	dotnet/roslyn#78213
1024156	dotnet/roslyn	Run Integration Tests	Log
1023228	dotnet/roslyn	Run Integration Tests	Log
1022065	dotnet/roslyn	Run Integration Tests	Log	dotnet/roslyn#78220
1020803	dotnet/roslyn	Run Integration Tests	Log	dotnet/roslyn#78205
1020781	dotnet/roslyn	Run Integration Tests	Log	dotnet/roslyn#78208
1020569	dotnet/roslyn	Run Integration Tests	Log
1020430	dotnet/roslyn	Run Integration Tests	Log
1019623	dotnet/roslyn	Run Integration Tests	Log	dotnet/roslyn#78186
2688805	dotnet-fsharp	CmdLine	Log
1018026	dotnet/roslyn	Run Integration Tests	Log	dotnet/roslyn#78167
1016599	dotnet/roslyn	Run Integration Tests	Log	dotnet/roslyn#78154
1016601	dotnet/roslyn	Run Integration Tests	Log	dotnet/roslyn#78154
1014204	dotnet/roslyn	Run Integration Tests	Log
1012624	dotnet/roslyn	Run Integration Tests	Log
1010308	dotnet/roslyn	Run Integration Tests	Log	dotnet/roslyn#77568
1010304	dotnet/roslyn	Run Integration Tests	Log	dotnet/roslyn#77568
1009837	dotnet/roslyn	Run Integration Tests	Log
1008803	dotnet/roslyn	Run Integration Tests	Log
1008229	dotnet/roslyn	Run Integration Tests	Log
1006989	dotnet/roslyn	Run Integration Tests	Log
1006662	dotnet/roslyn	Run Integration Tests	Log
1006414	dotnet/roslyn	Run Integration Tests	Log	dotnet/roslyn#77568
1006410	dotnet/roslyn	Run Integration Tests	Log	dotnet/roslyn#77568
2679708	dotnet-orleans	Test	Log
1004274	dotnet/roslyn	Run Integration Tests	Log	dotnet/roslyn#77920
2676657	dotnet-roslyn	Run Unit Tests	Log
1001003	dotnet/roslyn	Run Unit Tests	Log
2676652	dotnet-roslyn	Run Unit Tests	Log
1001000	dotnet/roslyn	Run Unit Tests	Log
2676538	dotnet-roslyn	Run Unit Tests	Log
2676213	dotnet-roslyn	Run Unit Tests	Log
2675920	dotnet-roslyn	Run Unit Tests	Log
999740	dotnet/roslyn	Run Unit Tests	Log
2675778	dotnet-roslyn	Run Unit Tests	Log
999473	dotnet/roslyn	Run Unit Tests	Log
999169	dotnet/roslyn	Run Integration Tests	Log
2674366	dotnet-roslyn	Run Unit Tests	Log
997928	dotnet/roslyn	Run Unit Tests	Log
2674323	dotnet-roslyn	Run Unit Tests	Log
997860	dotnet/roslyn	Run Unit Tests	Log
996724	dotnet/roslyn	Run Integration Tests	Log
995980	dotnet/roslyn	Run Integration Tests	Log
995449	dotnet/roslyn	Run Integration Tests	Log	dotnet/roslyn#77859
2672210	dotnet-interactive	Test / Blame	Log
994130	dotnet/roslyn	Run Integration Tests	Log
2672129	dotnet-roslyn	Run Unit Tests	Log
994074	dotnet/roslyn	Run Unit Tests	Log

Build	Definition	Test	Pull Request
1025043	dotnet/sdk	Microsoft.WebTools.AspireService.Tests.dll.WorkItemExecution	dotnet/sdk#48689
1024954	dotnet/sdk	Microsoft.WebTools.AspireService.Tests.dll.WorkItemExecution	dotnet/sdk#47076
2693348	dotnet-aspnetcore	Microsoft.AspNetCore.Mvc.FunctionalTests--net10.0.WorkItemExecution
1023300	dotnet/sdk	Microsoft.WebTools.AspireService.Tests.dll.WorkItemExecution	dotnet/sdk#48640
1023289	dotnet/sdk	dotnet-watch.Tests.dll.1.WorkItemExecution	dotnet/sdk#48611
1023164	dotnet/aspnetcore	Microsoft.AspNetCore.Mvc.FunctionalTests--net10.0.WorkItemExecution	dotnet/aspnetcore#61503
1023178	dotnet/sdk	dotnet-watch.Tests.dll.1.WorkItemExecution	dotnet/sdk#48587
1023168	dotnet/sdk	Microsoft.NET.Sdk.Razor.Tool.Tests.dll.1.WorkItemExecution	dotnet/sdk#48637
1021108	dotnet/sdk	Microsoft.DotNet.Watch.UnitTests.ApplyDeltaTests.Microsoft.DotNet.Watch.UnitTests.ApplyDeltaTests.Aspire	dotnet/sdk#48028
1020922	dotnet/sdk	dotnet-watch.Tests.dll.1.WorkItemExecution	dotnet/sdk#48589
1020766	dotnet/aspnetcore	Templates.Mvc.Test.BlazorTemplateTest.BlazorWebTemplate_IndividualAuth(args: ["--interactivity Auto"])	dotnet/aspnetcore#61554
1020770	dotnet/roslyn	workitem_273.WorkItemExecution
2690458	dotnet-aspnetcore	Microsoft.AspNetCore.Authentication.Test--net10.0.WorkItemExecution
1019892	dotnet/aspnetcore	Microsoft.AspNetCore.Mvc.FunctionalTests--net10.0.WorkItemExecution	dotnet/aspnetcore#61316
1019981	dotnet/sdk	dotnet-watch.Tests.dll.1.WorkItemExecution	dotnet/sdk#48556
1019718	dotnet/aspnetcore	Templates.Mvc.Test.BlazorTemplateTest.BlazorWebTemplate_IndividualAuth(args: ["--interactivity Auto"])
2689266	dotnet-sdk	dotnet-watch.Tests.dll.1.WorkItemExecution	#49269
1018918	dotnet/aspnetcore	Templates.Mvc.Test.BlazorTemplateTest.BlazorWebTemplate_IndividualAuth(args: ["--interactivity Auto"])	dotnet/aspnetcore#61402
1018909	dotnet/aspire	Aspire.Hosting.Seq.Tests.WorkItemExecution
1018363	dotnet/sdk	dotnet.Tests.dll.25.WorkItemExecution	dotnet/sdk#48501
1018164	dotnet/aspnetcore	Microsoft.AspNetCore.Mvc.FunctionalTests--net10.0.WorkItemExecution
1017988	dotnet/sdk	dotnet-watch.Tests.dll.1.WorkItemExecution	dotnet/sdk#48494
1017695	dotnet/roslyn	workitem_7.WorkItemExecution	dotnet/roslyn#78134
1017569	dotnet/sdk	dotnet-watch.Tests.dll.5.WorkItemExecution	dotnet/sdk#48494
1017353	dotnet/sdk	dotnet-watch.Tests.dll.1.WorkItemExecution	dotnet/sdk#48486
1016809	dotnet/sdk	dotnet-watch.Tests.dll.1.WorkItemExecution	dotnet/sdk#48472
1016553	dotnet/sdk	Microsoft.WebTools.AspireService.Tests.dll.WorkItemExecution	dotnet/sdk#48454
1016364	dotnet/aspnetcore	Microsoft.AspNetCore.Mvc.FunctionalTests--net10.0.WorkItemExecution
1016293	dotnet/sdk	dotnet-watch.Tests.dll.1.WorkItemExecution	dotnet/sdk#48447
1015954	dotnet/aspnetcore	Templates.Mvc.Test.BlazorTemplateTest.BlazorWebTemplate_IndividualAuth
1015665	dotnet/roslyn	workitem_7.WorkItemExecution	dotnet/roslyn#78111
1015325	dotnet/sdk	dotnet-watch.Tests.dll.1.WorkItemExecution	dotnet/sdk#48430
1015239	dotnet/sdk	dotnet-watch.Tests.dll.1.WorkItemExecution	dotnet/sdk#48393
1014294	dotnet/sdk	dotnet-watch.Tests.dll.5.WorkItemExecution	dotnet/sdk#48412
1015036	dotnet/sdk	dotnet-watch.Tests.dll.1.WorkItemExecution	dotnet/sdk#48425
1014974	dotnet/sdk	Microsoft.WebTools.AspireService.Tests.dll.WorkItemExecution	dotnet/sdk#48362
2685693	dotnet-aspnetcore	Microsoft.AspNetCore.Mvc.FunctionalTests--net10.0.WorkItemExecution
1014302	dotnet/sdk	Microsoft.NET.Sdk.Razor.Tool.Tests.dll.1.WorkItemExecution	dotnet/sdk#48413
1014093	dotnet/aspnetcore	Microsoft.AspNetCore.Mvc.FunctionalTests--net10.0.WorkItemExecution	dotnet/aspnetcore#61463
2685332	dotnet-sdk	dotnet-watch.Tests.dll.1.WorkItemExecution	#49129
1013461	dotnet/roslyn	workitem_146.WorkItemExecution	dotnet/roslyn#78111
1013477	dotnet/sdk	dotnet-watch.Tests.dll.1.WorkItemExecution	dotnet/sdk#48274
1013491	dotnet/aspnetcore	Microsoft.AspNetCore.Mvc.FunctionalTests--net10.0.WorkItemExecution
1013432	dotnet/aspnetcore	Microsoft.AspNetCore.Mvc.FunctionalTests--net10.0.WorkItemExecution
1013247	dotnet/sdk	Microsoft.WebTools.AspireService.Tests.dll.WorkItemExecution	dotnet/sdk#48385
1012824	dotnet/sdk	dotnet-watch.Tests.dll.1.WorkItemExecution	dotnet/sdk#48363
1012531	dotnet/roslyn	workitem_273.WorkItemExecution
1012395	dotnet/aspnetcore	Microsoft.AspNetCore.App.Analyzers.Test--net10.0.WorkItemExecution	dotnet/aspnetcore#61428
1012414	dotnet/sdk	dotnet-watch.Tests.dll.1.WorkItemExecution	dotnet/sdk#48356
1012227	dotnet/aspnetcore	Microsoft.AspNetCore.Mvc.FunctionalTests--net10.0.WorkItemExecution
1011518	dotnet/aspnetcore	Microsoft.AspNetCore.Mvc.FunctionalTests--net10.0.WorkItemExecution	dotnet/aspnetcore#61270
2683475	dotnet-sdk	dotnet-watch.Tests.dll.1.WorkItemExecution	#48610
1010767	dotnet/aspnetcore	Microsoft.AspNetCore.Mvc.FunctionalTests--net10.0.WorkItemExecution	dotnet/aspnetcore#61306
1010510	dotnet/sdk	dotnet-watch.Tests.dll.1.WorkItemExecution	dotnet/sdk#48298
1010475	dotnet/sdk	dotnet-watch.Tests.dll.1.WorkItemExecution	dotnet/sdk#48305
1010372	dotnet/sdk	dotnet-watch.Tests.dll.1.WorkItemExecution	dotnet/sdk#48298
2682841	dotnet-sdk	dotnet-watch.Tests.dll.1.WorkItemExecution	#48610
1010182	dotnet/aspire	Aspire.Hosting.Nats.Tests.WorkItemExecution
1010094	dotnet/sdk	dotnet-watch.Tests.dll.1.WorkItemExecution	dotnet/sdk#48277
1009247	dotnet/sdk	dotnet-watch.Tests.dll.1.WorkItemExecution	dotnet/sdk#48246
1009236	dotnet/sdk	dotnet-watch.Tests.dll.1.WorkItemExecution	dotnet/sdk#48087
1008533	dotnet/sdk	dotnet-watch.Tests.dll.3.WorkItemExecution	dotnet/sdk#48226
1008115	dotnet/sdk	dotnet-watch.Tests.dll.1.WorkItemExecution	dotnet/sdk#45520
1008009	dotnet/sdk	dotnet-watch.Tests.dll.5.WorkItemExecution	dotnet/sdk#48085
1007851	dotnet/sdk	dotnet-watch.Tests.dll.5.WorkItemExecution	dotnet/sdk#48225
2681148	dotnet-aspnetcore	Microsoft.AspNetCore.Mvc.FunctionalTests--net10.0.WorkItemExecution
1007531	dotnet/sdk	dotnet-watch.Tests.dll.1.WorkItemExecution	dotnet/sdk#48151
1007494	dotnet/sdk	Microsoft.NET.Sdk.Razor.Tool.Tests.dll.1.WorkItemExecution	dotnet/sdk#48150
1007356	dotnet/sdk	dotnet-watch.Tests.dll.1.WorkItemExecution	dotnet/sdk#48185
1007325	dotnet/aspire	Aspire.Hosting.RabbitMQ.Tests.WorkItemExecution
1006764	dotnet/sdk	Microsoft.NET.Sdk.Razor.Tool.Tests.dll.1.WorkItemExecution	dotnet/sdk#48173
1006022	dotnet/aspnetcore	Templates.Mvc.Test.BlazorTemplateTest.BlazorWebTemplate_IndividualAuth(args: ["--interactivity Auto"])	dotnet/aspnetcore#61326
1005544	dotnet/aspire	Aspire.Hosting.SqlServer.Tests.WorkItemExecution
1004803	dotnet/aspire	Aspire.Hosting.PostgreSQL.Tests.WorkItemExecution
997125	dotnet/aspnetcore	Microsoft.AspNetCore.Mvc.FunctionalTests--net10.0.WorkItemExecution	dotnet/aspnetcore#61204
1003597	dotnet/aspnetcore	Microsoft.AspNetCore.App.Analyzers.Test--net10.0.WorkItemExecution	dotnet/aspnetcore#61296
1003460	dotnet/aspnetcore	Interop.FunctionalTests--net9.0.WorkItemExecution	dotnet/aspnetcore#60353
2678133	dotnet-sdk	dotnet-watch.Tests.dll.1.WorkItemExecution	#48610
1002778	dotnet/aspire	Aspire.Hosting.Nats.Tests.WorkItemExecution
2677506	dotnet-aspnetcore	Microsoft.AspNetCore.OutputCaching.Tests--net8.0.WorkItemExecution
2677502	dotnet-aspnetcore	Microsoft.AspNetCore.Server.Kestrel.Transport.Quic.Tests--net9.0.WorkItemExecution
1002150	dotnet/aspnetcore	Microsoft.AspNetCore.Mvc.FunctionalTests--net10.0.WorkItemExecution
2677076	dotnet-dotnet-monitor	Microsoft.Diagnostics.Monitoring.Tool.UnitTests-net9.0-arm64.WorkItemExecution
1001709	dotnet/aspnetcore	Microsoft.AspNetCore.Mvc.FunctionalTests--net10.0.WorkItemExecution	dotnet/aspnetcore#61270
1001324	dotnet/aspire	Aspire.Hosting.RabbitMQ.Tests.WorkItemExecution
1000897	dotnet/sdk	dotnet-watch.Tests.dll.5.WorkItemExecution	dotnet/sdk#48069
1000431	dotnet/aspire	Aspire.Hosting.Kafka.Tests.WorkItemExecution
1000326	dotnet/sdk	dotnet-watch.Tests.dll.5.WorkItemExecution	dotnet/sdk#47712
1000297	dotnet/roslyn	workitem_196.WorkItemExecution
2676188	dotnet-aspnetcore	Microsoft.AspNetCore.Mvc.FunctionalTests--net10.0.WorkItemExecution
1000160	dotnet/sdk	Microsoft.WebTools.AspireService.Tests.dll.WorkItemExecution	dotnet/sdk#48015
1000076	dotnet/aspire	Aspire.Hosting.Elasticsearch.Tests.WorkItemExecution
999715	dotnet/sdk	Microsoft.WebTools.AspireService.Tests.dll.WorkItemExecution	dotnet/sdk#48034
999222	dotnet/sdk	Microsoft.NET.Sdk.Razor.Tool.Tests.dll.1.WorkItemExecution	dotnet/sdk#48020
998918	dotnet/sdk	dotnet-watch.Tests.dll.1.WorkItemExecution	dotnet/sdk#48012
998916	dotnet/sdk	dotnet-watch.Tests.dll.5.WorkItemExecution	dotnet/sdk#48004
998929	dotnet/aspire	Aspire.Hosting.Elasticsearch.Tests.WorkItemExecution
998760	dotnet/aspire	Aspire.Hosting.Elasticsearch.Tests.WorkItemExecution
998690	dotnet/aspire	Aspire.Hosting.Elasticsearch.Tests.WorkItemExecution
998253	dotnet/sdk	Microsoft.NET.Sdk.Razor.Tool.Tests.dll.1.WorkItemExecution	dotnet/sdk#47996
Displaying 100 of 121 results

Summary

24-Hour Hit Count	7-Day Hit Count	1-Month Count
3	25	171

Known issue validation

Build: 🔎
Result validation: ⚠️ Validation could not be done without an Azure DevOps build URL on the issue. Please add it to the "Build: 🔎" line.
Validation performed at: 2/8/2024 9:24:30 PM UTC

[andriipatsula]

Hello @fanyang-mono, could you please update the "ErrorMessage" : "" by following the step by step documentation on how to create a known issue

[fanyang-mono]

Updated.

[pavelsavara]

This is duplicate of dotnet/runtime#89409, except here it's not only wasm debugger

[dougbu]

@pavelsavara and @fanyang-mono, should this issue be closed in favour of dotnet/runtime#94560❔ if not, the error message isn't sufficiently precise to understand what (if anything) we (DNCEng) could do about it.

[pavelsavara]

@pavelsavara and @fanyang-mono, should this issue be closed in favour of

You mean dotnet/runtime#89409

I think we should keep this one, because this one has some hits which are not just wasm debugger related.
Here we see other repo failures, on roslyn and aspnetcore CI.

if not, the error message isn't sufficiently precise to understand what (if anything) we (DNCEng) could do about it.

I have not investigated it myself yet. But got questions which could help to narrow it down

• are there crash dump files on the machine ?
• are there some hints on what's going on in the log files before crash ?
• is this OOM or stack overflow in disguise ?
• did we run out of disk space or number of inodes ?
• hit some limit in docker container ?
• is this always the same OS, version, image ?
• could this be hardware issue ?

[fanyang-mono]

This issue was originally created to track issues happened to wasm debugger tests (belonging to dotnet/runtime repo). However, the error message was generic enough to include issues from other repos, such as dotnet/roslyn and dotnet/aspnetcore. We need insights from owners from dotnet/roslyn and dotnet/aspnetcore to confirm that they are aware of these issue. And if they are okay to close this issue as well. We could close then.

[mitchdenny]

We just got an instance of this in the dotnet/aspire repo. It wasn't a WASM related failure for us. Just looks like the test process crashed and took a few tests with it.

[nagilson]

@marcpopMSFT was working on getting the test infrastructure to generate crash dumps when it times out to help with investigation. I think it was generating the dumps but not yet correctly uploading them to the artifacts.

We are waiting to hear from the infra team on an issue with this.