The active test run was aborted. Reason: Test host process crashed

[fanyang-mono]

Build

https://dev.azure.com/dnceng-public/cbb18261-c48f-4abb-8651-8cdcb5474649/_build/results?buildId=351450

Build leg reported

chrome-DebuggerTests.EvaluateOnCallFrameTests.WorkItemExecution

Pull Request

dotnet/runtime#89217

Known issue core information

Fill out the known issue JSON section by following the step by step documentation on how to create a known issue

 {
    "ErrorMessage" : "The active test run was aborted. Reason: Test host process crashed",
    "BuildRetry": false,
    "ErrorPattern": "",
    "ExcludeConsoleLog": false
 }

@dotnet/dnceng

Release Note Category

• Feature changes/additions
• Bug fixes
• Internal Infrastructure Improvements

Release Note Description

Additional information about the issue reported

No response

Report

Build	Definition	Step Name	Console log	Pull Request
2796811	dotnet-orleans	Test	Log
2796688	dotnet-roslyn	Run Unit Tests	Log
1152251	dotnet/roslyn	Run Unit Tests	Log
1151315	dotnet/roslyn	Run Integration Tests	Log
1151081	dotnet/roslyn	Run Unit Tests	Log
2795845	dotnet-roslyn	Run Unit Tests	Log
1151075	dotnet/roslyn	Run Integration Tests	Log
2795009	dotnet-interactive	Test / Blame	Log
1144421	dotnet/roslyn	Run Integration Tests	Log	dotnet/roslyn#80215
2790187	dotnet-interactive	Test / Blame	Log
1134824	dotnet/roslyn	Run Integration Tests	Log

Build	Definition	Test	Pull Request
1159255	dotnet/sdk	dotnet-watch.Tests.dll.3.WorkItemExecution	dotnet/sdk#50999
2802589	dotnet-aspnetcore	Microsoft.AspNetCore.Server.Kestrel.Transport.Quic.Tests--net9.0.WorkItemExecution
1159103	dotnet/aspnetcore	Microsoft.AspNetCore.Server.HttpSys.ResponseBodyTests.ResponseBody_WriteContentLength_PassedThrough
1158916	dotnet/sdk	dotnet-watch.Tests.dll.6.WorkItemExecution	dotnet/sdk#50946
1158849	dotnet/sdk	dotnet-watch.Tests.dll.3.WorkItemExecution	dotnet/sdk#50992
1158808	dotnet/sdk	dotnet-watch.Tests.dll.4.WorkItemExecution	dotnet/sdk#51019
1158755	dotnet/sdk	dotnet-watch.Tests.dll.3.WorkItemExecution	dotnet/sdk#51016
1158684	dotnet/sdk	dotnet-watch.Tests.dll.4.WorkItemExecution	dotnet/sdk#51014
1158599	dotnet/aspnetcore	Microsoft.AspNetCore.Http.Abstractions.Tests--net10.0.WorkItemExecution
1158448	dotnet/sdk	dotnet-watch.Tests.dll.7.WorkItemExecution	dotnet/sdk#50992
1157799	dotnet/sdk	dotnet-watch.Tests.dll.4.WorkItemExecution	dotnet/sdk#50975
1158291	dotnet/sdk	dotnet-watch.Tests.dll.5.WorkItemExecution	dotnet/sdk#50992
1157923	dotnet/sdk	Microsoft.WebTools.AspireService.Tests.dll.WorkItemExecution	dotnet/sdk#51006
1158166	dotnet/aspnetcore	Microsoft.AspNetCore.Server.HttpSys.Listener.AuthenticationOnExistingQueueTests_CreateOrAttach_UseNewUrlPrefix.AuthTypes_AllowAnonymousButSpecify401_Success(authType: Negotiate)	dotnet/aspnetcore#63829
1158055	dotnet/roslyn	workitem_18.WorkItemExecution	dotnet/roslyn#80456
1158000	dotnet/roslyn	workitem_1.WorkItemExecution
1157860	dotnet/aspnetcore	Microsoft.AspNetCore.Server.HttpSys.Listener.AuthenticationOnExistingQueueTests_CreateOrAttach_UseNewUrlPrefix.AuthTypes_AllowAnonymousButSpecify401_Success	dotnet/aspnetcore#63814
1157814	dotnet/sdk	dotnet-watch.Tests.dll.4.WorkItemExecution	dotnet/sdk#50496
1157462	dotnet/sdk	dotnet-watch.Tests.dll.6.WorkItemExecution	dotnet/sdk#50946
2801265	dotnet-aspnetcore	Microsoft.AspNetCore.Mvc.FunctionalTests--net10.0.WorkItemExecution
1157424	dotnet/sdk	dotnet-watch.Tests.dll.3.WorkItemExecution	dotnet/sdk#50983
1157258	dotnet/sdk	dotnet-watch.Tests.dll.2.WorkItemExecution	dotnet/sdk#50951
1157136	dotnet/sdk	dotnet-watch.Tests.dll.2.WorkItemExecution	dotnet/sdk#50951
1157052	dotnet/aspnetcore	Microsoft.AspNetCore.Http.Abstractions.Tests--net10.0.WorkItemExecution	dotnet/aspnetcore#63796
2800731	dotnet-aspnetcore	Microsoft.AspNetCore.Server.Kestrel.Transport.Quic.Tests.QuicConnectionContextTests.StreamPool_Heartbeat_ExpiredStreamRemoved
1156801	dotnet/sdk	dotnet-watch.Tests.dll.3.WorkItemExecution	dotnet/sdk#50901
1156426	dotnet/sdk	dotnet-watch.Tests.dll.6.WorkItemExecution	dotnet/sdk#50946
1155947	dotnet/aspnetcore	Microsoft.AspNetCore.Http.Abstractions.Tests--net10.0.WorkItemExecution	dotnet/aspnetcore#63776
1154766	dotnet/sdk	dotnet-watch.Tests.dll.4.WorkItemExecution	dotnet/sdk#50954
1155743	dotnet/sdk	dotnet-watch.Tests.dll.4.WorkItemExecution	dotnet/sdk#50963
1155714	dotnet/aspnetcore	Microsoft.AspNetCore.Http.Extensions.Tests--net10.0.WorkItemExecution	dotnet/aspnetcore#63773
1155142	dotnet/sdk	Microsoft.WebTools.AspireService.Tests.dll.WorkItemExecution	dotnet/sdk#50949
1154969	dotnet/sdk	dotnet-watch.Tests.dll.7.WorkItemExecution	dotnet/sdk#50389
1154464	dotnet/aspnetcore	Microsoft.AspNetCore.Http.Extensions.Tests--net10.0.WorkItemExecution
1154418	dotnet/aspnetcore	Microsoft.AspNetCore.Server.HttpSys.ResponseBodyTests.ResponseBody_WriteContentLength_PassedThrough
1154297	dotnet/sdk	dotnet-watch.Tests.dll.2.WorkItemExecution	dotnet/sdk#50951
1153942	dotnet/sdk	Microsoft.CodeAnalysis.NetAnalyzers.UnitTests.dll.19.WorkItemExecution	dotnet/sdk#50933
2798502	dotnet-aspnetcore	Microsoft.AspNetCore.Mvc.FunctionalTests--net10.0.WorkItemExecution
1154092	dotnet/sdk	dotnet-watch.Tests.dll.2.WorkItemExecution	dotnet/sdk#50844
1154045	dotnet/sdk	dotnet-watch.Tests.dll.2.WorkItemExecution	dotnet/sdk#50844
1153382	dotnet/aspnetcore	Microsoft.AspNetCore.Server.HttpSys.ResponseTests.Response_ServerSendsSpecificStatus_ServerProvidesReasonPhrase
1153414	dotnet/sdk	dotnet-watch.Tests.dll.1.WorkItemExecution	dotnet/sdk#50940
1153415	dotnet/sdk	Microsoft.CodeAnalysis.NetAnalyzers.UnitTests.dll.94.WorkItemExecution	dotnet/sdk#50941
1153355	dotnet/aspnetcore	Microsoft.AspNetCore.Http.Extensions.Tests--net10.0.WorkItemExecution	dotnet/aspnetcore#63746
1153201	dotnet/sdk	dotnet-watch.Tests.dll.2.WorkItemExecution	dotnet/sdk#50844
1153209	dotnet/aspnetcore	Microsoft.AspNetCore.Http.Extensions.Tests--net10.0.WorkItemExecution	dotnet/aspnetcore#63720
1152946	dotnet/aspnetcore	Microsoft.AspNetCore.Http.Extensions.Tests--net10.0.WorkItemExecution	dotnet/aspnetcore#63738
1152686	dotnet/aspnetcore	Microsoft.AspNetCore.Http.Abstractions.Tests--net10.0.WorkItemExecution
2796885	dotnet-sdk	dotnet-watch.Tests.dll.1.WorkItemExecution	#53444
1152185	dotnet/aspnetcore	Microsoft.AspNetCore.Http.Abstractions.Tests--net10.0.WorkItemExecution	dotnet/aspnetcore#63708
1151905	dotnet/aspnetcore	Microsoft.AspNetCore.Http.Extensions.Tests--net10.0.WorkItemExecution	dotnet/aspnetcore#63708
1151916	dotnet/sdk	dotnet-watch.Tests.dll.2.WorkItemExecution	dotnet/sdk#50844
2796347	dotnet-aspnetcore	Microsoft.AspNetCore.Server.HttpSys.ResponseBodyTests.ResponseBody_WriteContentLength_PassedThrough
1151670	dotnet/sdk	Microsoft.WebTools.AspireService.Tests.dll.WorkItemExecution	dotnet/sdk#50897
1151470	dotnet/sdk	dotnet-watch.Tests.dll.4.WorkItemExecution	dotnet/sdk#50648
1151406	dotnet/sdk	dotnet-watch.Tests.dll.7.WorkItemExecution	dotnet/sdk#50896
2796001	dotnet-aspnetcore	Microsoft.AspNetCore.Server.Kestrel.Transport.Quic.Tests--net9.0.WorkItemExecution
2796042	dotnet-sdk	dotnet-watch.Tests.dll.3.WorkItemExecution	#53445
1151311	dotnet/sdk	dotnet-watch.Tests.dll.1.WorkItemExecution	dotnet/sdk#50027
1151237	dotnet/sdk	dotnet-watch.Tests.dll.2.WorkItemExecution	dotnet/sdk#50844
2795860	dotnet-sdk	dotnet-watch.Tests.dll.1.WorkItemExecution	#53437
1150921	dotnet/sdk	dotnet-watch.Tests.dll.2.WorkItemExecution	dotnet/sdk#50844
1150688	dotnet/sdk	dotnet-watch.Tests.dll.1.WorkItemExecution	dotnet/sdk#50885
1150440	dotnet/sdk	dotnet-watch.Tests.dll.7.WorkItemExecution	dotnet/sdk#50780
1150221	dotnet/sdk	dotnet-watch.Tests.dll.6.WorkItemExecution	dotnet/sdk#50877
1150115	dotnet/sdk	Microsoft.CodeAnalysis.NetAnalyzers.UnitTests.dll.26.WorkItemExecution	dotnet/sdk#50868
1149689	dotnet/sdk	Microsoft.WebTools.AspireService.Tests.dll.WorkItemExecution	dotnet/sdk#50648
1149296	dotnet/sdk	dotnet-watch.Tests.dll.1.WorkItemExecution	dotnet/sdk#50853
1149130	dotnet/sdk	dotnet-watch.Tests.dll.1.WorkItemExecution	dotnet/sdk#50845
1148258	dotnet/sdk	dotnet-watch.Tests.dll.7.WorkItemExecution	dotnet/sdk#50389
1148231	dotnet/aspnetcore	Microsoft.AspNetCore.Mvc.FunctionalTests--net10.0.WorkItemExecution
1147515	dotnet/sdk	Microsoft.CodeAnalysis.NetAnalyzers.UnitTests.dll.89.WorkItemExecution	dotnet/sdk#50757
2792658	dotnet-aspnetcore	InMemory.FunctionalTests--net8.0.WorkItemExecution
1147190	dotnet/sdk	Microsoft.WebTools.AspireService.Tests.dll.WorkItemExecution	dotnet/sdk#50803
1146950	dotnet/sdk	dotnet-watch.Tests.dll.1.WorkItemExecution	dotnet/sdk#50663
1146449	dotnet/sdk	Microsoft.NET.Sdk.Razor.Tool.Tests.dll.1.WorkItemExecution	dotnet/sdk#50780
1145732	dotnet/sdk	dotnet-watch.Tests.dll.1.WorkItemExecution	dotnet/sdk#50765
1145339	dotnet/sdk	Microsoft.CodeAnalysis.NetAnalyzers.UnitTests.dll.19.WorkItemExecution	dotnet/sdk#50757
1144969	dotnet/sdk	dotnet-watch.Tests.dll.1.WorkItemExecution	dotnet/sdk#50465
1144833	dotnet/aspnetcore	Microsoft.AspNetCore.Mvc.FunctionalTests--net10.0.WorkItemExecution	dotnet/aspnetcore#63631
1144824	dotnet/sdk	Microsoft.CodeAnalysis.NetAnalyzers.UnitTests.dll.4.WorkItemExecution	dotnet/sdk#50739
1144516	dotnet/aspnetcore	Microsoft.AspNetCore.App.Analyzers.Test--net10.0.WorkItemExecution
1144505	dotnet/sdk	dotnet-watch.Tests.dll.1.WorkItemExecution	dotnet/sdk#50465
1144372	dotnet/roslyn	workitem_6.WorkItemExecution	dotnet/roslyn#80216
1143962	dotnet/aspnetcore	dotnet-microsoft.openapi.Tests--net10.0.WorkItemExecution	dotnet/aspnetcore#63609
1144037	dotnet/sdk	Microsoft.DotNet.Watch.UnitTests.ApplyDeltaTests.Microsoft.DotNet.Watch.UnitTests.ApplyDeltaTests.ProjectChange_Update	dotnet/sdk#50468
1144049	dotnet/sdk	dotnet-watch.Tests.dll.1.WorkItemExecution	dotnet/sdk#50727
1143939	dotnet/sdk	Microsoft.CodeAnalysis.NetAnalyzers.UnitTests.dll.113.WorkItemExecution	dotnet/sdk#50723
1143776	dotnet/sdk	dotnet-watch.Tests.dll.1.WorkItemExecution	dotnet/sdk#50699
1142833	dotnet/aspnetcore	dotnet-microsoft.openapi.Tests--net10.0.WorkItemExecution	dotnet/aspnetcore#63594
1142973	dotnet/sdk	Microsoft.NET.Build.Tests.GivenThatWeWantToBuildANetCoreApp.Microsoft.NET.Build.Tests.GivenThatWeWantToBuildANetCoreApp.It_targets_the_right_shared_framework	dotnet/sdk#50648
1142732	dotnet/sdk	Microsoft.WebTools.AspireService.Tests.dll.WorkItemExecution	dotnet/sdk#50590
1142698	dotnet/aspnetcore	Microsoft.AspNetCore.Mvc.Core.Test--net10.0.WorkItemExecution
1142797	dotnet/sdk	Microsoft.CodeAnalysis.NetAnalyzers.UnitTests.dll.8.WorkItemExecution	dotnet/sdk#50696
1142729	dotnet/sdk	dotnet-watch.Tests.dll.3.WorkItemExecution	dotnet/sdk#50591
1141626	dotnet/aspnetcore	Microsoft.AspNetCore.Server.HttpSys.Listener.AuthenticationOnExistingQueueTests_CreateOrAttach_UseNewUrlPrefix.AuthType_AllowAnonymousButSpecify401_ChallengesAdded	dotnet/aspnetcore#63553
1141640	dotnet/sdk	Microsoft.CodeAnalysis.NetAnalyzers.UnitTests.dll.94.WorkItemExecution	dotnet/sdk#50664
1141328	dotnet/sdk	Microsoft.NET.Build.Tests.GivenThatWeWantToResolveConflicts.Microsoft.NET.Build.Tests.GivenThatWeWantToResolveConflicts.PrunePackageDataSucceeds	dotnet/sdk#50648
1141340	dotnet/aspnetcore	dotnet-microsoft.openapi.Tests--net10.0.WorkItemExecution	dotnet/aspnetcore#63553
1141289	dotnet/sdk	dotnet-watch.Tests.dll.1.WorkItemExecution	dotnet/sdk#50553
Displaying 100 of 135 results

Summary

24-Hour Hit Count	7-Day Hit Count	1-Month Count
12	44	146

Known issue validation

Build: 🔎
Result validation: ⚠️ Validation could not be done without an Azure DevOps build URL on the issue. Please add it to the "Build: 🔎" line.
Validation performed at: 2/8/2024 9:24:30 PM UTC

[andriipatsula]

Hello @fanyang-mono, could you please update the "ErrorMessage" : "" by following the step by step documentation on how to create a known issue

[fanyang-mono]

Updated.

[pavelsavara]

This is duplicate of dotnet/runtime#89409, except here it's not only wasm debugger

[dougbu]

@pavelsavara and @fanyang-mono, should this issue be closed in favour of dotnet/runtime#94560❔ if not, the error message isn't sufficiently precise to understand what (if anything) we (DNCEng) could do about it.

[pavelsavara]

@pavelsavara and @fanyang-mono, should this issue be closed in favour of

You mean dotnet/runtime#89409

I think we should keep this one, because this one has some hits which are not just wasm debugger related.
Here we see other repo failures, on roslyn and aspnetcore CI.

if not, the error message isn't sufficiently precise to understand what (if anything) we (DNCEng) could do about it.

I have not investigated it myself yet. But got questions which could help to narrow it down

• are there crash dump files on the machine ?
• are there some hints on what's going on in the log files before crash ?
• is this OOM or stack overflow in disguise ?
• did we run out of disk space or number of inodes ?
• hit some limit in docker container ?
• is this always the same OS, version, image ?
• could this be hardware issue ?

[fanyang-mono]

This issue was originally created to track issues happened to wasm debugger tests (belonging to dotnet/runtime repo). However, the error message was generic enough to include issues from other repos, such as dotnet/roslyn and dotnet/aspnetcore. We need insights from owners from dotnet/roslyn and dotnet/aspnetcore to confirm that they are aware of these issue. And if they are okay to close this issue as well. We could close then.

[mitchdenny]

We just got an instance of this in the dotnet/aspire repo. It wasn't a WASM related failure for us. Just looks like the test process crashed and took a few tests with it.

[nagilson]

@marcpopMSFT was working on getting the test infrastructure to generate crash dumps when it times out to help with investigation. I think it was generating the dumps but not yet correctly uploading them to the artifacts.

We are waiting to hear from the infra team on an issue with this.