Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

The active test run was aborted. Reason: Test host process crashed #451

Open
3 tasks
fanyang-mono opened this issue Jul 25, 2023 · 7 comments
Open
3 tasks

Comments

@fanyang-mono
Copy link
Member

fanyang-mono commented Jul 25, 2023

Build

https://dev.azure.com/dnceng-public/cbb18261-c48f-4abb-8651-8cdcb5474649/_build/results?buildId=351450

Build leg reported

chrome-DebuggerTests.EvaluateOnCallFrameTests.WorkItemExecution

Pull Request

dotnet/runtime#89217

Known issue core information

Fill out the known issue JSON section by following the step by step documentation on how to create a known issue

 {
    "ErrorMessage" : "The active test run was aborted. Reason: Test host process crashed",
    "BuildRetry": false,
    "ErrorPattern": "",
    "ExcludeConsoleLog": false
 }

@dotnet/dnceng

Release Note Category

  • Feature changes/additions
  • Bug fixes
  • Internal Infrastructure Improvements

Release Note Description

Additional information about the issue reported

No response

Report

Build Definition Step Name Console log Pull Request
871606 dotnet/roslyn Run Integration Tests Log dotnet/roslyn#75943
871504 dotnet/roslyn Run Integration Tests Log
871353 dotnet/roslyn Run Integration Tests Log
871278 dotnet/roslyn Run Integration Tests Log dotnet/roslyn#75928
2582898 dotnet-interactive Test / Blame Log
871146 dotnet/roslyn Run Integration Tests Log
871131 dotnet/roslyn Run Integration Tests Log dotnet/roslyn#75936
870817 dotnet/roslyn Run Unit Tests Log
870565 dotnet/roslyn Run Integration Tests Log
870539 dotnet/roslyn Run Integration Tests Log
2582109 dotnet-interactive Test / Blame Log
870435 dotnet/roslyn Run Integration Tests Log dotnet/roslyn#75764
870362 dotnet/roslyn Run Integration Tests Log
870247 dotnet/roslyn Run Integration Tests Log dotnet/roslyn#75862
870192 dotnet/roslyn Run Integration Tests Log
870009 dotnet/roslyn Run Integration Tests Log
869806 dotnet/roslyn Run Integration Tests Log
869650 dotnet/roslyn Run Unit Tests Log
869510 dotnet/roslyn Run Integration Tests Log dotnet/roslyn#75911
868892 dotnet/roslyn Run Unit Tests Log
868993 dotnet/roslyn Run Integration Tests Log dotnet/roslyn#75895
868870 dotnet/roslyn Run Integration Tests Log
868549 dotnet/roslyn Run Integration Tests Log dotnet/roslyn#75879
868450 dotnet/roslyn Run Integration Tests Log
868445 dotnet/roslyn Run Integration Tests Log
868230 dotnet/roslyn Run Integration Tests Log dotnet/roslyn#75876
868212 dotnet/roslyn Run Integration Tests Log
867945 dotnet/roslyn Run Integration Tests Log
867912 dotnet/roslyn Run Integration Tests Log dotnet/roslyn#75860
867069 dotnet/roslyn Run Integration Tests Log dotnet/roslyn#75862
867652 dotnet/roslyn Run Integration Tests Log
867164 dotnet/roslyn Run Integration Tests Log
867065 dotnet/roslyn Run Integration Tests Log
867058 dotnet/roslyn Run Integration Tests Log
2579725 dotnet-interactive Test / Blame Log
865346 dotnet/roslyn Run Integration Tests Log
865299 dotnet/roslyn Run Integration Tests Log
864894 dotnet/roslyn Run Integration Tests Log
864274 dotnet/roslyn Run Integration Tests Log dotnet/roslyn#75803
864366 dotnet/roslyn Run Integration Tests Log dotnet/roslyn#75818
863761 dotnet/roslyn Run Integration Tests Log dotnet/roslyn#75796
863161 dotnet/roslyn Run Integration Tests Log
862990 dotnet/roslyn Run Integration Tests Log
861889 dotnet/roslyn Run Integration Tests Log dotnet/roslyn#75758
860350 dotnet/roslyn Run Integration Tests Log
860089 dotnet/roslyn Run Integration Tests Log dotnet/roslyn#75672
858280 dotnet/roslyn Run Integration Tests Log
2572844 dotnet-interactive Test / Blame Log
857579 dotnet/roslyn Run Integration Tests Log dotnet/roslyn#75663
855922 dotnet/roslyn Run Integration Tests Log
855033 dotnet/roslyn Run Integration Tests Log
2570726 dotnet-interactive Test / Blame Log
854040 dotnet/roslyn Run Integration Tests Log dotnet/roslyn#75644
852895 dotnet/roslyn Run Integration Tests Log
852817 dotnet/roslyn Run Integration Tests Log
850472 dotnet/roslyn Run Integration Tests Log dotnet/roslyn#74836
846249 dotnet/roslyn Run Integration Tests Log dotnet/roslyn#74836
849418 dotnet/roslyn Run Integration Tests Log
2565876 dotnet-interactive Test / Blame Log
849364 dotnet/roslyn Run Integration Tests Log dotnet/roslyn#75568
848163 dotnet/roslyn Run Integration Tests Log dotnet/roslyn#69804
848133 dotnet/roslyn Run Integration Tests Log dotnet/roslyn#66425
Build Definition Test Pull Request
871285 dotnet/roslyn Microsoft.CodeAnalysis.CSharp.CodeStyle.UnitTests_Microsoft.CodeAnalysis.CSharp.CommandLine.UnitTests_9.WorkItemExecution
870710 dotnet/roslyn Microsoft.CodeAnalysis.CSharp.Features.UnitTests_25.WorkItemExecution
870136 dotnet/runtime chrome-DebuggerTests.BreakpointTests.WorkItemExecution dotnet/runtime#104637
869909 dotnet/roslyn Microsoft.CodeAnalysis.UnitTests_Microsoft.CodeAnalysis.VisualBasic.CodeStyle.UnitTests_208.WorkItemExecution dotnet/roslyn#75862
869646 dotnet/aspnetcore Templates.Mvc.Tests--net8.0.WorkItemExecution
869615 dotnet/runtime chrome-DebuggerTests.GetPropertiesTests.WorkItemExecution
869483 dotnet/roslyn Microsoft.CodeAnalysis.VisualBasic.Emit.UnitTests_228.WorkItemExecution dotnet/roslyn#75862
869217 dotnet/aspnetcore Microsoft.AspNetCore.Server.Kestrel.Transport.NamedPipes.Tests--net9.0.WorkItemExecution
868925 dotnet/runtime chrome-DebuggerTests.GetPropertiesTests.WorkItemExecution dotnet/runtime#104637
868540 dotnet/runtime chrome-DebuggerTests.MiscTests.WorkItemExecution dotnet/runtime#99596
868361 dotnet/aspnetcore Microsoft.AspNetCore.Mvc.FunctionalTests--net10.0.WorkItemExecution
2580851 dotnet-roslyn Microsoft.CodeAnalysis.CSharp.CodeStyle.UnitTests_15.WorkItemExecution
868388 dotnet/runtime chrome-DebuggerTests.CallFunctionOnTests.WorkItemExecution dotnet/runtime#106557
867559 dotnet/aspnetcore Microsoft.AspNetCore.Mvc.FunctionalTests--net10.0.WorkItemExecution dotnet/aspnetcore#58872
867442 dotnet/aspnetcore Templates.Mvc.Tests--net8.0.WorkItemExecution
866931 dotnet/runtime chrome-DebuggerTests.EvaluateOnCallFrameTests.WorkItemExecution
866215 dotnet/runtime chrome-DebuggerTests.GetPropertiesTests.WorkItemExecution
866108 dotnet/aspnetcore Microsoft.AspNetCore.Mvc.FunctionalTests--net10.0.WorkItemExecution
866081 dotnet/runtime chrome-DebuggerTests.BreakpointTests.WorkItemExecution
865900 dotnet/aspnetcore Templates.Mvc.Tests--net8.0.WorkItemExecution
865509 dotnet/aspnetcore Templates.Mvc.Tests--net8.0.WorkItemExecution
865362 dotnet/roslyn Microsoft.CodeAnalysis.CSharp.Symbol.UnitTests_Microsoft.CodeAnalysis.CSharp.Syntax.UnitTests_69.WorkItemExecution dotnet/roslyn#75821
2578279 dotnet-roslyn Microsoft.CodeAnalysis.CSharp.CodeStyle.UnitTests_Microsoft.CodeAnalysis.CSharp.CommandLine.UnitTests_17.WorkItemExecution
865123 dotnet/runtime chrome-DebuggerTests.MiscTests.WorkItemExecution
865015 dotnet/roslyn Microsoft.CodeAnalysis.CSharp.Symbol.UnitTests_Microsoft.CodeAnalysis.CSharp.Syntax.UnitTests_69.WorkItemExecution dotnet/roslyn#75821
864317 dotnet/roslyn Microsoft.CodeAnalysis.CSharp.Syntax.UnitTests_Microsoft.CodeAnalysis.CSharp.Workspaces.UnitTests_Microsoft.CodeAnalysis.EditorFeatures.UnitTests_56.WorkItemExecution dotnet/roslyn#75821
864214 dotnet/roslyn Microsoft.CodeAnalysis.CSharp.Features.UnitTests_115.WorkItemExecution
863764 dotnet/runtime chrome-DebuggerTests.SteppingTests.WorkItemExecution dotnet/runtime#109584
2576820 dotnet-dotnet-monitor Microsoft.Diagnostics.Monitoring.Tool.UnitTests-net9.0-arm64.WorkItemExecution
862338 dotnet/runtime chrome-DebuggerTests.BreakpointTests.WorkItemExecution
861850 dotnet/roslyn Microsoft.CodeAnalysis.VisualBasic.Emit.UnitTests_Microsoft.CodeAnalysis.VisualBasic.ExpressionEvaluator.ExpressionCompiler.UnitTests_Microsoft.CodeAn..._54.WorkItemExecution dotnet/roslyn#75672
860909 dotnet/aspnetcore Templates.Mvc.Tests--net8.0.WorkItemExecution
860675 dotnet/aspnetcore Microsoft.AspNetCore.Mvc.FunctionalTests--net10.0.WorkItemExecution
860693 dotnet/aspnetcore Microsoft.AspNetCore.Components.Endpoints.Tests--net10.0.WorkItemExecution dotnet/aspnetcore#58612
860682 dotnet/runtime chrome-DebuggerTests.GetPropertiesTests.WorkItemExecution dotnet/runtime#104637
859691 dotnet/aspnetcore Templates.Mvc.Tests--net8.0.WorkItemExecution
859609 dotnet/runtime chrome-DebuggerTests.EvaluateOnCallFrameTests.WorkItemExecution dotnet/runtime#109495
859485 dotnet/aspnetcore InMemory.FunctionalTests--net10.0.WorkItemExecution
859264 dotnet/runtime chrome-DebuggerTests.BreakpointTests.WorkItemExecution dotnet/runtime#108469
859040 dotnet/aspnetcore Templates.Mvc.Tests--net8.0.WorkItemExecution
858983 dotnet/runtime chrome-DebuggerTests.MiscTests.WorkItemExecution dotnet/runtime#108469
858594 dotnet/runtime chrome-DebuggerTests.MiscTests.WorkItemExecution dotnet/runtime#109381
858165 dotnet/aspnetcore Templates.Tests--net10.0.WorkItemExecution dotnet/aspnetcore#58734
857377 dotnet/runtime chrome-DebuggerTests.GetPropertiesTests.WorkItemExecution dotnet/runtime#109079
857296 dotnet/aspnetcore Templates.Mvc.Tests--net8.0.WorkItemExecution
856935 dotnet/runtime chrome-DebuggerTests.BreakpointTests.WorkItemExecution
856647 dotnet/runtime chrome-DebuggerTests.MiscTests.WorkItemExecution dotnet/runtime#109278
856355 dotnet/aspnetcore Templates.Mvc.Tests--net8.0.WorkItemExecution
856059 dotnet/aspnetcore Microsoft.AspNetCore.Mvc.FunctionalTests--net10.0.WorkItemExecution dotnet/aspnetcore#58656
854417 dotnet/aspire Aspire.Milvus.Client.Tests.WorkItemExecution
854031 dotnet/roslyn Microsoft.CodeAnalysis.CSharp.Features.UnitTests_28.WorkItemExecution dotnet/roslyn#75642
853565 dotnet/roslyn Microsoft.CodeAnalysis.CSharp.Features.UnitTests_45.WorkItemExecution dotnet/roslyn#75632
852899 dotnet/aspire Aspire.Hosting.Elasticsearch.Tests.ElasticsearchFunctionalTests.Aspire.Hosting.Elasticsearch.Tests.ElasticsearchFunctionalTests.WithDataShouldPersistStateBetweenUsages(useVolume: True)
852205 dotnet/aspnetcore Microsoft.AspNetCore.Mvc.FunctionalTests--net10.0.WorkItemExecution
851766 dotnet/roslyn Microsoft.CodeAnalysis.VisualBasic.Emit.UnitTests_Microsoft.CodeAnalysis.VisualBasic.ExpressionEvaluator.ExpressionCompiler.UnitTests_Microsoft.CodeAn..._77.WorkItemExecution
851666 dotnet/aspire Aspire.Hosting.Elasticsearch.Tests.WorkItemExecution
851110 dotnet/aspnetcore Microsoft.AspNetCore.Mvc.FunctionalTests--net10.0.WorkItemExecution
849790 dotnet/aspnetcore Templates.Mvc.Tests--net8.0.WorkItemExecution
848411 dotnet/aspnetcore Microsoft.AspNetCore.Mvc.FunctionalTests--net10.0.WorkItemExecution
2564809 dotnet-aspnetcore Microsoft.AspNetCore.Mvc.FunctionalTests--net10.0.WorkItemExecution
847936 dotnet/aspnetcore Microsoft.AspNetCore.Mvc.FunctionalTests--net10.0.WorkItemExecution dotnet/aspnetcore#58513

Summary

24-Hour Hit Count 7-Day Hit Count 1-Month Count
2 54 123

Known issue validation

Build: 🔎
Result validation: ⚠️ Validation could not be done without an Azure DevOps build URL on the issue. Please add it to the "Build: 🔎" line.
Validation performed at: 2/8/2024 9:24:30 PM UTC

@andriipatsula
Copy link
Member

Hello @fanyang-mono, could you please update the "ErrorMessage" : "" by following the step by step documentation on how to create a known issue

@fanyang-mono
Copy link
Member Author

Updated.

@pavelsavara
Copy link
Member

pavelsavara commented Nov 7, 2023

This is duplicate of dotnet/runtime#89409, except here it's not only wasm debugger

@dougbu
Copy link
Member

dougbu commented Nov 23, 2023

@pavelsavara and @fanyang-mono, should this issue be closed in favour of dotnet/runtime#94560❔ if not, the error message isn't sufficiently precise to understand what (if anything) we (DNCEng) could do about it.

@pavelsavara
Copy link
Member

@pavelsavara and @fanyang-mono, should this issue be closed in favour of

You mean dotnet/runtime#89409

I think we should keep this one, because this one has some hits which are not just wasm debugger related.
Here we see other repo failures, on roslyn and aspnetcore CI.

if not, the error message isn't sufficiently precise to understand what (if anything) we (DNCEng) could do about it.

I have not investigated it myself yet. But got questions which could help to narrow it down

  • are there crash dump files on the machine ?
  • are there some hints on what's going on in the log files before crash ?
  • is this OOM or stack overflow in disguise ?
  • did we run out of disk space or number of inodes ?
  • hit some limit in docker container ?
  • is this always the same OS, version, image ?
  • could this be hardware issue ?

@fanyang-mono
Copy link
Member Author

This issue was originally created to track issues happened to wasm debugger tests (belonging to dotnet/runtime repo). However, the error message was generic enough to include issues from other repos, such as dotnet/roslyn and dotnet/aspnetcore. We need insights from owners from dotnet/roslyn and dotnet/aspnetcore to confirm that they are aware of these issue. And if they are okay to close this issue as well. We could close then.

@mitchdenny
Copy link
Member

We just got an instance of this in the dotnet/aspire repo. It wasn't a WASM related failure for us. Just looks like the test process crashed and took a few tests with it.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

7 participants