test(chromium): fixme flaky "should ignore page.pause when headed" on macOS - #41959
Closed
microsoft-playwright-automation[bot] wants to merge 1 commit into
Closed
test(chromium): fixme flaky "should ignore page.pause when headed" on macOS#41959microsoft-playwright-automation[bot] wants to merge 1 commit into
microsoft-playwright-automation[bot] wants to merge 1 commit into
Conversation
… macOS `launchServer › should ignore page.pause when headed` flakes on macOS chromium only — never on Linux or Windows. It launches a headed remote server and opens the Inspector via `page.pause()`; on a loaded macOS runner the remote process is slow to exit on SIGINT, so the `startRemoteServer` fixture teardown blows the (already `test.slow`) budget: `Tearing down "startRemoteServer" exceeded the test timeout of 90000ms`. DB evidence (rolling ~2-week window, final verdict per run): | bot | runs | fails | | --- | --- | --- | | chromium-macos-15-large | 174 | 15 (8.6%) | | chromium-macos-14-xlarge | 176 | 7 | | chromium-macos-15-xlarge | 174 | 3 | | chrome-macos-latest | 172 | 1 | | all Linux / Windows bots | — | 0 | Failures span 15 distinct runs/SHAs (07-07 → 07-22), so it's a real flake, not one bad run. No linked issue exists; scoping a fixme narrowed to chromium + macOS while the headed teardown hang is investigated. Verified locally on macos-15-large (Intel): skipped on chromium (`npm run ctest` → 2 skipped), still runs on firefox (`npm run ftest` → 2 passed). `npm run flint` passes. <details> <summary>chromium-macos-15-large run history (174 runs, oldest first)</summary> [🟩](https://github.com/microsoft/playwright/actions/runs/28866308287/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/28873490820/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/28875446309/attempts/1)[🟧](https://github.com/microsoft/playwright/actions/runs/28890081894/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/28890567394/attempts/1)[🟥](https://github.com/microsoft/playwright/actions/runs/28891955630/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/28902894453/attempts/1)[🟧](https://github.com/microsoft/playwright/actions/runs/28928109454/attempts/1)[🟧](https://github.com/microsoft/playwright/actions/runs/28938485606/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/28938794208/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/28939257621/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/28955218250/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/28956057852/attempts/1)[🟧](https://github.com/microsoft/playwright/actions/runs/28959626412/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/28960485377/attempts/1)[🟧](https://github.com/microsoft/playwright/actions/runs/28961086678/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/28964329424/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/28965502424/attempts/1)[🟧](https://github.com/microsoft/playwright/actions/runs/28965644405/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/28965711826/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/28969094103/attempts/1)[🟧](https://github.com/microsoft/playwright/actions/runs/28969520041/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/28980946873/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29005148863/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29007006549/attempts/1)[🟧](https://github.com/microsoft/playwright/actions/runs/29007195865/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29017723928/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29042634067/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29048400472/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29061435297/attempts/1)[🟥](https://github.com/microsoft/playwright/actions/runs/29064347446/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29077304281/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29097158670/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29099052102/attempts/1)[🟧](https://github.com/microsoft/playwright/actions/runs/29104555430/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29108562907/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29109943209/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29112994315/attempts/1)[🟧](https://github.com/microsoft/playwright/actions/runs/29121472402/attempts/1)[🟧](https://github.com/microsoft/playwright/actions/runs/29124335331/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29124318697/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29125414211/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29125729353/attempts/1)[🟥](https://github.com/microsoft/playwright/actions/runs/29128339905/attempts/1)[🟧](https://github.com/microsoft/playwright/actions/runs/29128376120/attempts/1)[🟥](https://github.com/microsoft/playwright/actions/runs/29130091891/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29130426820/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29155485041/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29199182739/attempts/1)[🟧](https://github.com/microsoft/playwright/actions/runs/29243262130/attempts/1)[🟧](https://github.com/microsoft/playwright/actions/runs/29130091891/attempts/2)[🟧](https://github.com/microsoft/playwright/actions/runs/29259263344/attempts/1)[🟧](https://github.com/microsoft/playwright/actions/runs/29295691040/attempts/1)[🟧](https://github.com/microsoft/playwright/actions/runs/29301677592/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29308472932/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29312025613/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29314690931/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29323062383/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29324655149/attempts/1)[🟧](https://github.com/microsoft/playwright/actions/runs/29324825065/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29332318831/attempts/1)[🟧](https://github.com/microsoft/playwright/actions/runs/29332309029/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29337734864/attempts/1)[🟥](https://github.com/microsoft/playwright/actions/runs/29337724291/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29338439922/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29340863234/attempts/1)[🟧](https://github.com/microsoft/playwright/actions/runs/29344305083/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29344433094/attempts/1)[🟧](https://github.com/microsoft/playwright/actions/runs/29351198689/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29356060340/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29361876195/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29366381195/attempts/1)[🟧](https://github.com/microsoft/playwright/actions/runs/29369499364/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29374339482/attempts/1)[🟧](https://github.com/microsoft/playwright/actions/runs/29394850590/attempts/1)[🟥](https://github.com/microsoft/playwright/actions/runs/29406290737/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29406305129/attempts/1)[🟥](https://github.com/microsoft/playwright/actions/runs/29406265900/attempts/1)[🟥](https://github.com/microsoft/playwright/actions/runs/29406278363/attempts/1)[🟧](https://github.com/microsoft/playwright/actions/runs/29406325718/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29415751923/attempts/1)[🟧](https://github.com/microsoft/playwright/actions/runs/29416836043/attempts/1)[🟥](https://github.com/microsoft/playwright/actions/runs/29416849206/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29417339107/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29420362810/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29421177744/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29426009862/attempts/1)[🟧](https://github.com/microsoft/playwright/actions/runs/29434021274/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29449506755/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29457511205/attempts/1)[🟥](https://github.com/microsoft/playwright/actions/runs/29461343212/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29493630712/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29493689996/attempts/1)[🟧](https://github.com/microsoft/playwright/actions/runs/29494668376/attempts/1)[🟧](https://github.com/microsoft/playwright/actions/runs/29496276570/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29497431241/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29501896183/attempts/1)[🟥](https://github.com/microsoft/playwright/actions/runs/29504809298/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29505924688/attempts/1)[🟧](https://github.com/microsoft/playwright/actions/runs/29506925842/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29507208821/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29507279787/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29510845830/attempts/1)[🟥](https://github.com/microsoft/playwright/actions/runs/29513769523/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29516108305/attempts/1)[🟧](https://github.com/microsoft/playwright/actions/runs/29525081398/attempts/1)[🟧](https://github.com/microsoft/playwright/actions/runs/29527833904/attempts/1)[🟧](https://github.com/microsoft/playwright/actions/runs/29528556146/attempts/1)[🟧](https://github.com/microsoft/playwright/actions/runs/29531605213/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29531635659/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29536656250/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29544830063/attempts/1)[🟧](https://github.com/microsoft/playwright/actions/runs/29585973013/attempts/1)[🟧](https://github.com/microsoft/playwright/actions/runs/29587651108/attempts/1)[🟧](https://github.com/microsoft/playwright/actions/runs/29589683538/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29589934673/attempts/1)[🟧](https://github.com/microsoft/playwright/actions/runs/29595934280/attempts/1)[🟧](https://github.com/microsoft/playwright/actions/runs/29598530258/attempts/1)[🟧](https://github.com/microsoft/playwright/actions/runs/29602613490/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29611131294/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29611318218/attempts/1)[🟥](https://github.com/microsoft/playwright/actions/runs/29611445029/attempts/1)[🟧](https://github.com/microsoft/playwright/actions/runs/29612805092/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29613759502/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29618375255/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29686210360/attempts/1)[🟧](https://github.com/microsoft/playwright/actions/runs/29730373358/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29734693205/attempts/1)[🟧](https://github.com/microsoft/playwright/actions/runs/29755368802/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29762776585/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29763385504/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29769696091/attempts/1)[🟧](https://github.com/microsoft/playwright/actions/runs/29775716877/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29780743634/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29782328403/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29784817456/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29789509369/attempts/1)[🟧](https://github.com/microsoft/playwright/actions/runs/29791328941/attempts/1)[🟧](https://github.com/microsoft/playwright/actions/runs/29791345408/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29800511868/attempts/1)[🟧](https://github.com/microsoft/playwright/actions/runs/29822273353/attempts/1)[🟧](https://github.com/microsoft/playwright/actions/runs/29835236639/attempts/1)[🟧](https://github.com/microsoft/playwright/actions/runs/29838699822/attempts/1)[🟧](https://github.com/microsoft/playwright/actions/runs/29844141129/attempts/1)[🟧](https://github.com/microsoft/playwright/actions/runs/29845175984/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29845392058/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29855614229/attempts/1)[🟧](https://github.com/microsoft/playwright/actions/runs/29855625844/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29856729151/attempts/1)[🟧](https://github.com/microsoft/playwright/actions/runs/29859883032/attempts/1)[🟧](https://github.com/microsoft/playwright/actions/runs/29865460136/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29866867131/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29867308985/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29873996100/attempts/1)[🟥](https://github.com/microsoft/playwright/actions/runs/29874748609/attempts/1)[🟧](https://github.com/microsoft/playwright/actions/runs/29874783963/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29877078341/attempts/1)[🟧](https://github.com/microsoft/playwright/actions/runs/29879172510/attempts/1)[🟧](https://github.com/microsoft/playwright/actions/runs/29904950059/attempts/1)[🟧](https://github.com/microsoft/playwright/actions/runs/29915407358/attempts/1)[🟧](https://github.com/microsoft/playwright/actions/runs/29918102409/attempts/1)[🟧](https://github.com/microsoft/playwright/actions/runs/29924682554/attempts/1)[🟧](https://github.com/microsoft/playwright/actions/runs/29931173316/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29932910968/attempts/1)[🟧](https://github.com/microsoft/playwright/actions/runs/29933325202/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/29938598979/attempts/1)[🟧](https://github.com/microsoft/playwright/actions/runs/29940740538/attempts/1)[🟧](https://github.com/microsoft/playwright/actions/runs/29945241493/attempts/1)[🟧](https://github.com/microsoft/playwright/actions/runs/29957712363/attempts/1)[🟥](https://github.com/microsoft/playwright/actions/runs/29960743816/attempts/1)[🟧](https://github.com/microsoft/playwright/actions/runs/29986800439/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30000526442/attempts/1)[🟩](https://github.com/microsoft/playwright/actions/runs/30002550609/attempts/1)[🟧](https://github.com/microsoft/playwright/actions/runs/30003704436/attempts/1) </details> Suggested-reviewer: dgozman https://github.com/microsoft/playwright/actions/runs/30013663508
Contributor
Test results for "tests 1"5 flaky50228 passed, 1190 skipped Merge workflow run. |
Contributor
Test results for "MCP"3 failed 7783 passed, 1262 skipped Merge workflow run. |
This was referenced Jul 23, 2026
This was referenced Jul 27, 2026
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
launchServer › should ignore page.pause when headedflakes on macOS chromium only — never on Linux or Windows. It launches a headed remote server and opens the Inspector viapage.pause(); on a loaded macOS runner the remote process is slow to exit on SIGINT, so thestartRemoteServerfixture teardown blows the (alreadytest.slow) budget:Tearing down "startRemoteServer" exceeded the test timeout of 90000ms.DB evidence (rolling ~2-week window, final verdict per run):
Failures span 15 distinct runs/SHAs (07-07 → 07-22), so it's a real flake, not one bad run. No linked issue exists; scoping a fixme narrowed to chromium + macOS while the headed teardown hang is investigated.
Verified locally on macos-15-large (Intel): skipped on chromium (
npm run ctest→ 2 skipped), still runs on firefox (npm run ftest→ 2 passed).npm run flintpasses.chromium-macos-15-large run history (174 runs, oldest first)
🟩🟩🟩🟧🟩🟥🟩🟧🟧🟩🟩🟩🟩🟧🟩🟧🟩🟩🟧🟩🟩🟧🟩🟩🟩🟧🟩🟩🟩🟩🟥🟩🟩🟩🟧🟩🟩🟩🟧🟧🟩🟩🟩🟥🟧🟥🟩🟩🟩🟧🟧🟧🟧🟧🟩🟩🟩🟩🟩🟧🟩🟧🟩🟥🟩🟩🟧🟩🟧🟩🟩🟩🟧🟩🟧🟥🟩🟥🟥🟧🟩🟧🟥🟩🟩🟩🟩🟧🟩🟩🟥🟩🟩🟧🟧🟩🟩🟥🟩🟧🟩🟩🟩🟥🟩🟧🟧🟧🟧🟩🟩🟩🟧🟧🟧🟩🟧🟧🟧🟩🟩🟥🟧🟩🟩🟩🟧🟩🟧🟩🟩🟩🟧🟩🟩🟩🟩🟧🟧🟩🟧🟧🟧🟧🟧🟩🟩🟧🟩🟧🟧🟩🟩🟩🟥🟧🟩🟧🟧🟧🟧🟧🟧🟩🟧🟩🟧🟧🟧🟥🟧🟩🟩🟧
Suggested-reviewer: dgozman
https://github.com/microsoft/playwright/actions/runs/30013663508