Skip to content

[Flaky Test] Quarantine 8 flaky tests - #14646

Open
github-actions[bot] wants to merge 1 commit into
mainfrom
quarantine-flaky-tests-2026-08-05-dc13f53767efa815
Open

[Flaky Test] Quarantine 8 flaky tests#14646
github-actions[bot] wants to merge 1 commit into
mainfrom
quarantine-flaky-tests-2026-08-05-dc13f53767efa815

Conversation

@github-actions

@github-actions github-actions Bot commented Aug 5, 2026

Copy link
Copy Markdown
Contributor

Quarantines 8 flaky tests that have been failing intermittently across multiple distinct rolling main builds. All tests have pre-existing open tracking issues.


BuildCheck.UnitTests.EndToEndTests.TFMinNonSdkCheckTest

Flaky-test key (automated de-duplication — do not edit):

flaky-test-id: Microsoft.Build.BuildCheck.UnitTests.EndToEndTests.TFMinNonSdkCheckTest

Tracked by #14539. Observed in 3 distinct rolling main builds (1527742, 1532844, 1536982). Multiple distinct error hashes. First seen 2026-07-27, last seen 2026-08-03.


XMakeAppTests.LoggerThrowsMemberAccessExceptionWhenClassIsInvalid

Flaky-test key (automated de-duplication — do not edit):

flaky-test-id: Microsoft.Build.UnitTests.XMakeAppTests.LoggerThrowsMemberAccessExceptionWhenClassIsInvalid

Tracked by #14627. Observed in 1 distinct PR and 2 distinct rolling main builds (1527742, 1532844). 4 distinct error hashes. First seen 2026-07-27, last seen 2026-08-03.


CodeTaskFactoryTests.BuildTaskSimpleCodeFactory

Flaky-test key (automated de-duplication — do not edit):

flaky-test-id: Microsoft.Build.UnitTests.CodeTaskFactoryTests.BuildTaskSimpleCodeFactory

Tracked by #14571. Observed in 3 distinct rolling main builds (1527742, 1532844, 1536982) on FullOnWindows Release. First seen 2026-07-27, last seen 2026-08-03.


CodeTaskFactoryTests.BuildTaskDateCodeFactory

Flaky-test key (automated de-duplication — do not edit):

flaky-test-id: Microsoft.Build.UnitTests.CodeTaskFactoryTests.BuildTaskDateCodeFactory

Tracked by #14576. Observed in 3 distinct rolling main builds (1527742, 1532844, 1536982) on FullOnWindows Release. First seen 2026-07-27, last seen 2026-08-03.


CodeTaskFactoryTests.BuildTaskSimpleCodeFactoryTestExtraUsing

Flaky-test key (automated de-duplication — do not edit):

flaky-test-id: Microsoft.Build.UnitTests.CodeTaskFactoryTests.BuildTaskSimpleCodeFactoryTestExtraUsing

Tracked by #14577. Observed in 3 distinct rolling main builds (1527742, 1532844, 1536982) on FullOnWindows Release. First seen 2026-07-27, last seen 2026-08-03.


CodeTaskFactoryTests.EmbedsGeneratedFileInBinlog

Flaky-test key (automated de-duplication — do not edit):

flaky-test-id: Microsoft.Build.UnitTests.CodeTaskFactoryTests.EmbedsGeneratedFileInBinlog

Tracked by #14569. Observed in 3 distinct rolling main builds (1527742, 1532844, 1536982) on FullOnWindows Release. First seen 2026-07-27, last seen 2026-08-03.


CodeTaskFactoryTests.BuildTaskSimpleCodeFactory_NoAssemblyNameRedirect

Flaky-test key (automated de-duplication — do not edit):

flaky-test-id: Microsoft.Build.UnitTests.CodeTaskFactoryTests.BuildTaskSimpleCodeFactory_NoAssemblyNameRedirect

Tracked by #14575. Observed in 3 distinct rolling main builds (1527742, 1532844, 1536982) on FullOnWindows Release. First seen 2026-07-27, last seen 2026-08-03.


TaskEnvironment_Tests.TaskEnvironment_SetEnvironment_ShouldReplaceAllVariables

Flaky-test key (automated de-duplication — do not edit):

flaky-test-id: Microsoft.Build.UnitTests.TaskEnvironment_Tests.TaskEnvironment_SetEnvironment_ShouldReplaceAllVariables

Tracked by #14626. Test method cleanup failures observed in 3 distinct rolling main builds (1527742, 1532844, 1536982) on multiple legs. First seen 2026-07-27, last seen 2026-08-03.

Warning

Firewall blocked 1 domain

The following domain was blocked by the firewall during workflow execution:

  • southcentralus0.in.applicationinsights.azure.com

To allow these domains, add them to the network.allowed list in your workflow frontmatter:

network:
  allowed:
    - defaults
    - "southcentralus0.in.applicationinsights.azure.com"

See Network Configuration for more information.

Generated by Flaky Test Triage · sonnet46 · 120.5 AIC · ⌖ 7.41 AIC · ⊞ 15K ·

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
@github-actions github-actions Bot added the flaky-test Tests that have failed but passed on rerun. label Aug 5, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

flaky-test Tests that have failed but passed on rerun.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

0 participants