Skip to content

[Quarantine] AddValidationIntegrationTest.FormWithNestedValidation_Works#67700

Closed
DeagleGross wants to merge 1 commit into
dotnet:mainfrom
DeagleGross:quarantine-form-nested-validation
Closed

[Quarantine] AddValidationIntegrationTest.FormWithNestedValidation_Works#67700
DeagleGross wants to merge 1 commit into
dotnet:mainfrom
DeagleGross:quarantine-form-nested-validation

Conversation

@DeagleGross

Copy link
Copy Markdown
Member

Quarantines the flaky Blazor E2E test AddValidationIntegrationTest.FormWithNestedValidation_Works.

Failure rate

Analyzing the last 80 aspnetcore-components-e2e builds (~24 hours):

  • Failed in 24 builds (~30%)
  • 4 failures on refs/heads/main (~33% of main runs in the window)
  • Spread across 20 different unrelated PRs — not caused by any specific change

Failure signature

Assert.Equal() Failure: Collections differ
Expected: ["Email is required.", "Full Name is required.", "Order Name is required.", "Product Name is required.", "Street is required.", "Zip Code is required."]
Actual:   ["Order Name is required."]

The test submits a form and asserts the validation summary contains 6 required-field messages, but only the first one is present. Looks like a Selenium/Blazor race between the submit click and the summary rendering.

Example failing builds

Tracking

/cc @dotnet/aspnetcore-blazor

Test fails ~30% of the time (24 of last 80 aspnetcore-components-e2e
builds, including 4 on refs/heads/main), across 20 different unrelated
PRs. Signature: form validation summary asserts 6 required-field
messages but only 1 is present, suggesting a race between form
submission and Blazor rendering the full summary.

Tracking issue: dotnet#67699

Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>
Copilot AI review requested due to automatic review settings July 9, 2026 12:33
@DeagleGross
DeagleGross requested a review from a team as a code owner July 9, 2026 12:33

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Quarantines the flaky Blazor E2E test AddValidationIntegrationTest.FormWithNestedValidation_Works so CI can sequester it while the underlying issue is investigated (tracked in #67699).

Changes:

  • Add QuarantinedTest attribute to FormWithNestedValidation_Works.
  • Add the required Microsoft.AspNetCore.InternalTesting using for the quarantine attribute.
Show a summary per file
File Description
src/Components/test/E2ETest/ServerRenderingTests/AddValidationIntegrationTest.cs Marks the flaky E2E test as quarantined (links to issue #67699) so failures don’t block unrelated PRs.

Copilot's findings

  • Files reviewed: 1/1 changed files
  • Comments generated: 0

@oroztocil

Copy link
Copy Markdown
Member

@DeagleGross Should be already fixed by #67680

Has the test failed on main after this was merged?

@oroztocil

Copy link
Copy Markdown
Member

Based on Copilot analysis, the test has not failed once since the fix was merged.

@wtgodbe

wtgodbe commented Jul 9, 2026

Copy link
Copy Markdown
Member

+1 to @oroztocil, let's not quarantine this unless it fails again after #67680

@DeagleGross

Copy link
Copy Markdown
Member Author

Sorry, missinterpreted test failures in #67635; closing the PR then

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants