Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Failure on Helix tests - Tests timing out #40074

Open
MiYanni opened this issue Apr 9, 2024 · 7 comments
Open

Failure on Helix tests - Tests timing out #40074

MiYanni opened this issue Apr 9, 2024 · 7 comments

Comments

@MiYanni
Copy link
Member

MiYanni commented Apr 9, 2024

Build Information

Build: https://dev.azure.com/dnceng-public/cbb18261-c48f-4abb-8651-8cdcb5474649/_build/results?buildId=635799
Build error leg or test failing: Microsoft.DotNet.MSBuildSdkResolver.Tests.dll.3.WorkItemExecution
Pull request: #40059

Error Message

Fill the error message using step by step known issues guidance.

{
  "ErrorMessage": "END OF WORK ITEM LOG: Command timed out, and was killed",
  "BuildRetry": false,
  "ExcludeConsoleLog": false
}

Known issue validation

Build: 🔎 https://dev.azure.com/dnceng-public/public/_build/results?buildId=635799
Error message validated: [END OF WORK ITEM LOG: Command timed out, and was killed]
Result validation: ✅ Known issue matched with the provided build.
Validation performed at: 4/9/2024 5:21:23 PM UTC

Report

Build Definition Test Pull Request
882883 dotnet/sdk Microsoft.NET.Build.Tests.dll.14.WorkItemExecution #45179
882840 dotnet/sdk Microsoft.NET.Sdk.Razor.Tool.Tests.dll.1.WorkItemExecution #45228
882738 dotnet/sdk Microsoft.NET.Sdk.Razor.Tests.dll.10.WorkItemExecution #45179
877297 dotnet/sdk Microsoft.NET.Build.Tests.dll.23.WorkItemExecution #45056
882531 dotnet/sdk Microsoft.NET.Sdk.Razor.Tests.dll.10.WorkItemExecution #44974
881976 dotnet/sdk Microsoft.NET.Build.Tests.dll.23.WorkItemExecution #45179
881847 dotnet/sdk Microsoft.NET.Build.Tests.dll.1.WorkItemExecution #45213
881840 dotnet/sdk Microsoft.NET.Sdk.BlazorWebAssembly.Tests.dll.4.WorkItemExecution #44765
881594 dotnet/sdk dotnet.Tests.dll.15.WorkItemExecution #45053
881595 dotnet/sdk Microsoft.NET.Build.Tests.dll.14.WorkItemExecution #44974
881603 dotnet/sdk Microsoft.NET.Sdk.BlazorWebAssembly.Tests.dll.4.WorkItemExecution #45179
881392 dotnet/sdk Microsoft.NET.Sdk.Razor.Tests.dll.10.WorkItemExecution #45179
881513 dotnet/sdk Microsoft.NET.Build.Tests.dll.23.WorkItemExecution #45192
880244 dotnet/sdk Microsoft.NET.Publish.Tests.dll.7.WorkItemExecution #45159
881396 dotnet/sdk dotnet-watch.Tests.dll.6.WorkItemExecution #45131
880512 dotnet/sdk Microsoft.NET.Build.Tests.dll.23.WorkItemExecution #45167
881072 dotnet/sdk Microsoft.NET.Sdk.BlazorWebAssembly.Tests.dll.4.WorkItemExecution #45192
880855 dotnet/sdk Microsoft.NET.Build.Tests.dll.23.WorkItemExecution #45179
880741 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution #45171
880736 dotnet/sdk Microsoft.NET.Publish.Tests.dll.7.WorkItemExecution #44974
880749 dotnet/sdk Microsoft.NET.Publish.Tests.dll.7.WorkItemExecution #45174
878114 dotnet/sdk Microsoft.NET.Build.Tests.dll.20.WorkItemExecution #45053
880496 dotnet/sdk dotnet.Tests.dll.25.WorkItemExecution #45125
880380 dotnet/sdk Microsoft.NET.Publish.Tests.GivenThatWeWantToRunILLink1.ILLink_links_simple_app_without_analysis_warnings_and_it_runs #44540
880425 dotnet/sdk Microsoft.NET.Build.Tests.dll.23.WorkItemExecution #45156
880303 dotnet/sdk Microsoft.NET.Sdk.Razor.Tool.Tests.dll.1.WorkItemExecution #45144
880107 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution #45131
878656 dotnet/sdk EndToEnd.Tests.dll.2.WorkItemExecution #45115
879808 dotnet/sdk Microsoft.NET.Sdk.Razor.Tests.dll.10.WorkItemExecution #44899
879918 dotnet/sdk Microsoft.NET.Build.Tests.dll.23.WorkItemExecution #45151
879751 dotnet/sdk dotnet-watch.Tests.dll.2.WorkItemExecution #45147
879638 dotnet/sdk dotnet-watch.Tests.dll.2.WorkItemExecution #43085
879617 dotnet/sdk Microsoft.NET.Sdk.Razor.Tool.Tests.dll.1.WorkItemExecution #45137
879450 dotnet/sdk Microsoft.NET.Publish.Tests.dll.5.WorkItemExecution #44417
879431 dotnet/sdk Microsoft.NET.Sdk.Razor.Tests.dll.10.WorkItemExecution #44974
879190 dotnet/sdk Microsoft.NET.Sdk.Razor.Tests.dll.10.WorkItemExecution #45128
878962 dotnet/sdk Microsoft.NET.Sdk.BlazorWebAssembly.Tests.dll.4.WorkItemExecution #45108
879274 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution #45131
879317 dotnet/sdk Microsoft.NET.Sdk.Razor.Tests.dll.10.WorkItemExecution #45125
878867 dotnet/sdk Microsoft.NET.Build.Tests.dll.24.WorkItemExecution #44856
879244 dotnet/sdk Microsoft.NET.Publish.Tests.dll.7.WorkItemExecution #45095
879225 dotnet/sdk Microsoft.NET.Sdk.Razor.Tests.dll.10.WorkItemExecution #45125
879114 dotnet/sdk Microsoft.NET.Sdk.Razor.Tool.Tests.dll.1.WorkItemExecution #44969
878861 dotnet/sdk Microsoft.NET.Sdk.Razor.Tests.dll.10.WorkItemExecution #44974
876391 dotnet/sdk Microsoft.NET.Publish.Tests.GivenThatWeWantToRunILLink1.ILLink_links_simple_app_without_analysis_warnings_and_it_runs #44540
873544 dotnet/sdk Microsoft.NET.Sdk.Razor.Tests.dll.10.WorkItemExecution #44956
878388 dotnet/sdk Microsoft.NET.Sdk.Razor.Tests.dll.10.WorkItemExecution #45108
878144 dotnet/sdk Microsoft.NET.Sdk.Razor.Tool.Tests.dll.1.WorkItemExecution #44417
878108 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution #45091
877787 dotnet/sdk Microsoft.NET.Sdk.BlazorWebAssembly.Tests.dll.1.WorkItemExecution #45046
877997 dotnet/sdk Microsoft.NET.Publish.Tests.dll.7.WorkItemExecution #45095
877961 dotnet/sdk dotnet.Tests.dll.6.WorkItemExecution #45007
877942 dotnet/sdk Microsoft.NET.Sdk.Razor.Tool.Tests.dll.1.WorkItemExecution #45073
877955 dotnet/sdk Microsoft.NET.Build.Tests.dll.23.WorkItemExecution #44899
877897 dotnet/sdk dotnet-watch.Tests.dll.2.WorkItemExecution #45084
877802 dotnet/sdk Microsoft.NET.Build.Tests.dll.23.WorkItemExecution #45081
877758 dotnet/sdk Microsoft.NET.Build.Tests.dll.14.WorkItemExecution #44899
877716 dotnet/sdk Microsoft.NET.Build.Tests.dll.1.WorkItemExecution #44786
877637 dotnet/sdk Microsoft.NET.Build.Tests.dll.1.WorkItemExecution #45071
877627 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution #44786
877636 dotnet/sdk dotnet-watch.Tests.dll.2.WorkItemExecution #45070
877305 dotnet/sdk dotnet.Tests.dll.15.WorkItemExecution #45046
877502 dotnet/sdk Microsoft.NET.Build.Tests.dll.1.WorkItemExecution #45052
877446 dotnet/sdk dotnet.Tests.dll.15.WorkItemExecution #44786
877424 dotnet/sdk Microsoft.NET.Sdk.Razor.Tests.dll.10.WorkItemExecution #44786
877383 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution #44786
877303 dotnet/sdk Microsoft.NET.Publish.Tests.dll.7.WorkItemExecution #45058
877309 dotnet/sdk Microsoft.NET.Publish.Tests.dll.7.WorkItemExecution #44786
877240 dotnet/sdk Microsoft.NET.Sdk.Razor.Tests.dll.19.WorkItemExecution #44786
875878 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution #44974
876270 dotnet/sdk Microsoft.NET.Sdk.Razor.Tests.dll.10.WorkItemExecution #45007
874245 dotnet/sdk dotnet.Tests.dll.27.WorkItemExecution #44899
877117 dotnet/sdk Microsoft.NET.Sdk.Razor.Tests.dll.10.WorkItemExecution #45052
876945 dotnet/sdk Microsoft.NET.Publish.Tests.dll.7.WorkItemExecution #44786
876977 dotnet/sdk Microsoft.NET.Publish.Tests.dll.7.WorkItemExecution #44958
876780 dotnet/sdk dotnet.Tests.dll.15.WorkItemExecution #45046
876774 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution #44786
876387 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution #44963
2586915 dotnet-sdk dotnet-watch.Tests.dll.3.WorkItemExecution #45249
876242 dotnet/sdk Microsoft.NET.Publish.Tests.dll.7.WorkItemExecution #44786
876138 dotnet/sdk Microsoft.NET.Publish.Tests.dll.7.WorkItemExecution #44786
875084 dotnet/sdk Microsoft.NET.Clean.Tests.dll.WorkItemExecution #44958
876040 dotnet/sdk dotnet.Tests.dll.15.WorkItemExecution #44417
875914 dotnet/sdk dotnet.Tests.dll.27.WorkItemExecution #44786
875908 dotnet/sdk dotnet-watch.Tests.dll.2.WorkItemExecution #45021
875785 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution #44786
875754 dotnet/sdk dotnet-watch.Tests.dll.5.WorkItemExecution #45009
875651 dotnet/sdk dotnet.Tests.dll.16.WorkItemExecution #44417
875513 dotnet/sdk Microsoft.NET.Sdk.Razor.Tool.Tests.dll.1.WorkItemExecution #44828
875499 dotnet/sdk dotnet-watch.Tests.dll.1.WorkItemExecution #44805
875495 dotnet/sdk Microsoft.NET.Sdk.BlazorWebAssembly.Tests.dll.4.WorkItemExecution #44417
874185 dotnet/sdk Microsoft.NET.Build.Tests.dll.23.WorkItemExecution #44805
875354 dotnet/sdk Microsoft.NET.Build.Tests.dll.23.WorkItemExecution #44786
875288 dotnet/sdk dotnet-watch.Tests.dll.4.WorkItemExecution #44786
875211 dotnet/sdk dotnet.Tests.dll.14.WorkItemExecution #44967
875019 dotnet/sdk Microsoft.NET.Sdk.Razor.Tests.dll.10.WorkItemExecution #44417
875023 dotnet/sdk Microsoft.WebTools.AspireService.Tests.dll.WorkItemExecution #44828
874749 dotnet/sdk dotnet.Tests.dll.6.WorkItemExecution #44974
874772 dotnet/sdk Microsoft.NET.Sdk.Razor.Tests.dll.10.WorkItemExecution #44986
874824 dotnet/sdk Microsoft.NET.Publish.Tests.dll.5.WorkItemExecution #44988
Displaying 100 of 360 results

Summary

24-Hour Hit Count 7-Day Hit Count 1-Month Count
3 57 360
@nagilson
Copy link
Member

@tmat May you please look at this dotnet watch failure?

@tmat
Copy link
Member

tmat commented May 20, 2024

@nagilson I checked a few logs from above and it looks like the failures are in release/8.0.1xx branch. That wouldn't have various test infra fixes.

@nagilson
Copy link
Member

Thank you for checking :) @tmat, which test infra fixes are you referring to? It may be worth porting them over to 8.0.1xx. Any disagreements @marcpopMSFT?

@nagilson
Copy link
Member

We also just hit it in main, so there might be another existing problem: #41045

@baronfel
Copy link
Member

@tmat this is popping up again in the rc1 branches, when you get back can you take a look?

@tmat
Copy link
Member

tmat commented Aug 15, 2024

@baronfel I can take a look. Do you have a link to the failed run? The test log should be good enough to determine the issue on main/rc1 branches.

@baronfel
Copy link
Member

The helix timeouts are most of the failed tests in this pipeline, but you can't access them right now due to helix auth issues.

@akoeplinger akoeplinger changed the title Darwin Build_Release failure on Helix tests - Tests timing out Failure on Helix tests - Tests timing out Nov 15, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

4 participants