Skip to content

[devops] Report if tests on older macOS bots time out. - #14438

Merged
rolfbjarne merged 9 commits into
dotnet:mainfrom
rolfbjarne:devops-report-timeouts
Mar 23, 2022
Merged

[devops] Report if tests on older macOS bots time out.#14438
rolfbjarne merged 9 commits into
dotnet:mainfrom
rolfbjarne:devops-report-timeouts

Conversation

@rolfbjarne

@rolfbjarne rolfbjarne commented Mar 17, 2022

Copy link
Copy Markdown
Member

Also relax the requirement for GitHub comments to have a description, since we don't need to say more than that it timed out.

This is how it ends up looking: #14438 (comment)

@rolfbjarne rolfbjarne added the not-notes-worthy Ignore for release notes label Mar 17, 2022
@rolfbjarne rolfbjarne changed the title [devops] Report if tests on older macOS bots timed out. [devops] Report if tests on older macOS bots times out. Mar 17, 2022
@rolfbjarne rolfbjarne added the skip-all-tests Skip all the tests label Mar 17, 2022
@vs-mobiletools-engineering-service2

This comment was marked as outdated.

@vs-mobiletools-engineering-service2

This comment was marked as outdated.

@vs-mobiletools-engineering-service2

This comment was marked as outdated.

@rolfbjarne

This comment was marked as outdated.

@vs-mobiletools-engineering-service2

This comment was marked as outdated.

@vs-mobiletools-engineering-service2

This comment was marked as outdated.

@vs-mobiletools-engineering-service2

This comment was marked as outdated.

@vs-mobiletools-engineering-service2

This comment was marked as outdated.

@vs-mobiletools-engineering-service2

This comment was marked as outdated.

@vs-mobiletools-engineering-service2

This comment was marked as outdated.

@vs-mobiletools-engineering-service2

Copy link
Copy Markdown
Collaborator

❌ Tests timed out on macOS M1 - Mac Big Sur (11.5) ❌

Pipeline on Agent
Merge 61d6a6c into 7d500da

@vs-mobiletools-engineering-service2

Copy link
Copy Markdown
Collaborator

❌ Tests timed out on macOS Mac Catalina (10.15) ❌

Pipeline on Agent
Merge 61d6a6c into 7d500da

@vs-mobiletools-engineering-service2

Copy link
Copy Markdown
Collaborator

✅ [CI Build] Tests passed on VSTS: simulator tests iOS. ✅

Tests passed on VSTS: simulator tests iOS.

No tests selected.

Pipeline on Agent XAMBOT-1017.Monterey'
Merge 61d6a6c into 7d500da

@rolfbjarne rolfbjarne changed the title [devops] Report if tests on older macOS bots times out. [devops] Report if tests on older macOS bots time out. Mar 22, 2022
@rolfbjarne
rolfbjarne marked this pull request as ready for review March 22, 2022 19:56
@vs-mobiletools-engineering-service2

Copy link
Copy Markdown
Collaborator

❌ Tests timed out on macOS M1 - Mac Big Sur (11.5) ❌

Pipeline on Agent
Merge e7dffc0 into 7d500da

@vs-mobiletools-engineering-service2

Copy link
Copy Markdown
Collaborator

❌ Tests timed out on macOS Mac Catalina (10.15) ❌

Pipeline on Agent
Merge e7dffc0 into 7d500da

@vs-mobiletools-engineering-service2

Copy link
Copy Markdown
Collaborator

✅ [CI Build] Tests passed on VSTS: simulator tests iOS. ✅

Tests passed on VSTS: simulator tests iOS.

No tests selected.

Pipeline on Agent XAMBOT-1044.Monterey'
Merge e7dffc0 into 7d500da

@mandel-macaque mandel-macaque left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Two minor things that you can or not change.

- pwsh: |
Import-Module $Env:SYSTEM_DEFAULTWORKINGDIRECTORY\xamarin-macios\tools\devops\automation\scripts\GitHub.psm1
$testsPath = "$(Build.SourcesDirectory)/artifacts/mac-test-package/tests"
if (-not ([IO.File]::Exists("$testsPath/test-run-completed"))) {

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

There is a more pwsh way to do this:

if (-not (Test-Path -Path "$testsPath/test-run-completed" -PathType Leaf)) {

Not that it does make a huge diff.

$testsPath = "$(Build.SourcesDirectory)/artifacts/mac-test-package/tests"
if (-not ([IO.File]::Exists("$testsPath/test-run-completed"))) {
Set-GitHubStatus -Status "error" -Description "Tests timed out on macOS $Env:CONTEXT." -Context "$Env:CONTEXT"
$request = New-GitHubComment -Header "Tests timed out on macOS $Env:CONTEXT" -Description "" -Message "" -Emoji ":x:"

@mandel-macaque mandel-macaque Mar 23, 2022

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
$request = New-GitHubComment -Header "Tests timed out on macOS $Env:CONTEXT" -Description "" -Message "" -Emoji ":x:"
$request = New-GitHubComment -Header "Tests timed out on macOS $Env:CONTEXT" -Message "" -Emoji ":x:"

Don't even pass description since you made the change for that in the PR.

@rolfbjarne
rolfbjarne merged commit aa3d95e into dotnet:main Mar 23, 2022
@rolfbjarne
rolfbjarne deleted the devops-report-timeouts branch March 23, 2022 21:35
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

not-notes-worthy Ignore for release notes skip-all-tests Skip all the tests

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants