The Operation will be canceled. The next steps may not contain expected logs.

[tarekgh]

Build

https://dev.azure.com/dnceng-public/cbb18261-c48f-4abb-8651-8cdcb5474649/_build/results?buildId=696281

Build leg reported

Build / browser-wasm linux Release LibraryTests / Send to Helix

Pull Request

dotnet/runtime#103009

Known issue core information

Fill out the known issue JSON section by following the step by step documentation on how to create a known issue

 {
    "ErrorMessage" : "The Operation will be canceled. The next steps may not contain expected logs.",
    "BuildRetry": false,
    "ErrorPattern": "",
    "ExcludeConsoleLog": false
 }

@dotnet/dnceng

Release Note Category

• Feature changes/additions
• Bug fixes
• Internal Infrastructure Improvements

Release Note Description

Additional information about the issue reported

No response

Known issue validation

Build: 🔎 https://dev.azure.com/dnceng-public/public/_build/results?buildId=696281
Error message validated: [The Operation will be canceled. The next steps may not contain expected logs.]
Result validation: ✅ Known issue matched with the provided build.
Validation performed at: 6/4/2024 8:08:48 PM UTC

Report

Build	Repository	Step Name	Console log	Pull Request
1573858	dotnet/maui	Controls CollectionView	Log
1573843	dotnet/runtime	Build product	Log	dotnet/runtime#132419
1573824	dotnet/roslyn	Run Unit Tests	Log
1573794	dotnet/diagnostics	Run SOS.Tests on Helix (Unix)	Log	dotnet/diagnostics#5981
1573728	dotnet/maui	Controls Shell	Log
1573724	dotnet/maui	Controls Shell	Log
1573601	dotnet/aspnetcore	Run Quarantined Tests	Log
1573570	dotnet/aspnetcore	Run build.cmd helix target	Log
1573386	dotnet/maui	Controls CollectionView	Log
1573387	dotnet/maui	Controls Shell	Log
1573366	dotnet/roslyn	Run Unit Tests	Log
1573359	dotnet/aspnetcore	Run Quarantined Tests	Log
1573353	dotnet/roslyn	Run Unit Tests	Log
1573324	dotnet/maui	Controls Shell	Log
1573321	dotnet/maui	Controls Shell	Log
1573332	dotnet/roslyn	Run Unit Tests	Log
1573330	dotnet/roslyn	Run Unit Tests	Log
1573334	dotnet/roslyn	Run Unit Tests	Log
1573304	dotnet/maui	Controls Shell	Log	dotnet/maui#37855
1573275	dotnet/roslyn	Run Unit Tests	Log
1573215	dotnet/runtime	Build product	Log	dotnet/runtime#132534
1573170	dotnet/maui	Controls Shell	Log
1573116	dotnet/aspnetcore	Run Quarantined Tests	Log
1572852	dotnet/runtime	Send to Helix	Log	dotnet/runtime#132891
1573073	dotnet/diagnostics	Run SOS.Tests on Helix (Unix)	Log	dotnet/diagnostics#5981
1572953	dotnet/maui	Controls Shell	Log
1572867	dotnet/maui	Controls Shell	Log	dotnet/maui#37732
1572803	dotnet/maui	Controls Shell	Log
1572946	dotnet/roslyn	Run Unit Tests	Log
1572916	dotnet/roslyn	Run Unit Tests	Log
1572576	dotnet/maui	Controls CollectionView	Log	dotnet/maui#37953
1572847	dotnet/roslyn	Run Unit Tests	Log
1572589	dotnet/maui	Controls Shell	Log
1572586	dotnet/aspnetcore	Run Quarantined Tests	Log
1572494	dotnet/maui	Controls Layout	Log
1572482	dotnet/maui	Controls CollectionView	Log
1572488	dotnet/maui	Controls Shell	Log
1572581	dotnet/runtime	Build product	Log	dotnet/runtime#132419
1572400	dotnet/diagnostics	Run SOS.Tests on Helix (Unix)	Log	dotnet/diagnostics#5981
1572376	dotnet/roslyn	Run Unit Tests	Log
1572006	dotnet/maui	Controls Shell	Log
1570154	dotnet/maui	Controls CollectionView	Log	dotnet/maui#37438
1571899	dotnet/runtime	Generate CORE_ROOT	Log
1571930	dotnet/runtime	Build Tests	Log	dotnet/runtime#132821
1571815	dotnet/roslyn	Run Unit Tests	Log
1569741	dotnet/maui	Controls CollectionView	Log
1571845	dotnet/aspnetcore	Run Quarantined Tests	Log
1571840	dotnet/roslyn	Run Unit Tests	Log
1571836	dotnet/maui	Controls (CV1)	Log
1571817	dotnet/roslyn	Run Unit Tests	Log
1571819	dotnet/maui	Controls Shell	Log
1571813	dotnet/roslyn	Run Unit Tests	Log
1571721	dotnet/sdk	Run AoT Tests	Log	dotnet/sdk#55743
1571719	dotnet/sdk	Run AoT Tests	Log	dotnet/sdk#55714
1571578	dotnet/maui	Controls Shell	Log
1571513	dotnet/maui	Controls Shell	Log	dotnet/maui#37863
1571488	dotnet/maui	Controls CollectionView	Log
1571603	dotnet/roslyn	Run Unit Tests	Log
1571476	dotnet/maui	Controls Shell	Log
1571451	dotnet/maui	Controls Shell	Log	dotnet/maui#37034
1571553	dotnet/runtime	Monitor Helix Jobs	Log
1571353	dotnet/runtime	Send to Helix	Log	dotnet/runtime#132420
1571251	dotnet/runtime	Zip Build Assets	Log	dotnet/runtime#132796
1571505	dotnet/roslyn	Run Unit Tests	Log
1571490	dotnet/roslyn	Run Unit Tests	Log
1571174	dotnet/runtime	Zip Build Assets	Log	dotnet/runtime#132850
1571095	dotnet/runtime	Send to Helix	Log
1571281	dotnet/maui	Checkout dotnet/maui@refs/pull/37732/merge to s	Log	dotnet/maui#37732
1571086	dotnet/runtime	Zip Build Assets	Log	dotnet/runtime#132275
1570973	dotnet/runtime	Send tests to Helix (Unix)	Log
1571121	dotnet/maui	Controls Border,BoxView,Brush,Button	Log
1571179	dotnet/runtime	Send to Helix	Log	dotnet/runtime#132143
1571154	dotnet/runtime	Send to Helix	Log	dotnet/runtime#132849
1571214	dotnet/roslyn	Run Unit Tests	Log
1571139	dotnet/runtime	Send to Helix	Log	dotnet/runtime#132847
1571066	dotnet/maui	Controls Shell	Log
1571124	dotnet/runtime	Send to Helix	Log	dotnet/runtime#132838
1571115	dotnet/runtime	Send to Helix	Log	dotnet/runtime#132846
1571110	dotnet/runtime	Send to Helix	Log	dotnet/runtime#132816
1571000	dotnet/maui	Controls Shell	Log
1570570	dotnet/maui	Controls CollectionView	Log
1571170	dotnet/roslyn	Run Unit Tests	Log
1570892	dotnet/runtime	Send to Helix	Log	dotnet/runtime#132765
1570963	dotnet/maui	Controls CollectionView	Log	dotnet/maui#37849
1570947	dotnet/maui	Controls CollectionView	Log	dotnet/maui#37833
1570916	dotnet/maui	Controls Shell	Log	dotnet/maui#37732
1570723	dotnet/runtime	Send to Helix	Log	dotnet/runtime#131934
1570765	dotnet/maui	Install Appium	Log	dotnet/maui#37732
1570957	dotnet/maui	DeviceTestsAndroid_Mono (Windows)	Log	dotnet/maui#37894
1570294	dotnet/runtime	Send tests to Helix (Unix)	Log
1570722	dotnet/maui	Run Integration Tests - RunOniOS_MauiRelease_CoreCLR	Log	dotnet/maui#37853
1570834	dotnet/runtime	Build product	Log	dotnet/runtime#132527
1570637	dotnet/maui	Controls CollectionView	Log	dotnet/maui#37307
1570319	dotnet/runtime	Send to Helix	Log
1570817	dotnet/maui	Install .NET	Log	dotnet/maui#37732
1570609	dotnet/maui	Run Integration Tests - RunOniOS_MauiRelease	Log	dotnet/maui#37772
1570611	dotnet/maui	Controls Border,BoxView,Brush,Button	Log
1570687	dotnet/runtime	Build product	Log	dotnet/runtime#132739
1569889	dotnet/runtime	Send to Helix	Log	dotnet/runtime#132759
1570562	dotnet/maui	Controls Shell	Log	dotnet/maui#36474
Displaying 100 of 1192 results

Summary

24-Hour Hit Count	7-Day Hit Count	1-Month Count
10	302	1192

[dkurepa]

These appear to be timeout cancellations, and most of them are happening on the same runtime leg that uses OSX.1200.ARM64.Open, looking at grafana, they do indeed appear to be quite high. Will check with the team on what we can do about this

[dkurepa]

For pipelines experiencing timeouts on osx.1200.arm64.open we recommend using osx.14.arm64.open, as this queue has a lot more machines

[dkurepa]

There is also a number of Publish Using Darc timeouts, these are in 99% of cases AzDo Api issues. During the Publish Using Darc job, we queue up a Maestro Promotion pipeline, that downloads the artifacts from the build calling it, and publishes them where they need to go. While publishing is happening, the build pipeline keeps busy waiting for the promotion pipeline to be done, checking the status of it every 60 seconds. In cases where this times out, the build most likely did get promoted, the AzDo API just kept telling us the wrong thing

[ivanpovazan]

@dkurepa for context, the same timeouts are also caught with this tracking #1883
where I asked about potentially bumping the queues to osx.13.amd/arm64, would that suffice?
(bumping to osx.14 is not an option right now as we still want testing on osx.13 which is the minimum supported OS version)

[CarnaViire]

For the "known issues" folks: the timeout here is reported twice, making BA red despite the tracking issue. E.g.:

1️⃣ dotnet/runtime#117255

2️⃣ dotnet/runtime#117800

cc @AlitzelMendez