Skip to content

[dotnet] future proof the test - #17739

Merged
stephen-hawley merged 8 commits into
dotnet:mainfrom
stephen-hawley:lets-document-a-bit
Mar 8, 2023
Merged

[dotnet] future proof the test#17739
stephen-hawley merged 8 commits into
dotnet:mainfrom
stephen-hawley:lets-document-a-bit

Conversation

@stephen-hawley

Copy link
Copy Markdown
Contributor

Tests fail, especially reflection based tests.
Wouldn't you like it if a test came with a blueprint on how to fix the issue you created? Yes, of course you would. So here it is.

@stephen-hawley stephen-hawley added not-notes-worthy Ignore for release notes dotnet An issue or pull request related to .NET (6) labels Mar 7, 2023
@github-actions

github-actions Bot commented Mar 7, 2023

Copy link
Copy Markdown
Contributor

⚠️ Your code has been reformatted. ⚠️

If this is not desired, add the actions-disable-autoformat label, and revert the reformatting commit.

If files unrelated to your change were modified, try reverting the reformatting commit + merging with the target branch (and push those changes).

Comment thread tests/cecil-tests/BlittablePInvokes.cs Outdated
Comment thread tests/cecil-tests/BlittablePInvokes.cs Outdated
stephen-hawley and others added 2 commits March 7, 2023 12:04
Co-authored-by: Rolf Bjarne Kvinge <rolf@xamarin.com>
Co-authored-by: Rolf Bjarne Kvinge <rolf@xamarin.com>
@vs-mobiletools-engineering-service2

This comment has been minimized.

@vs-mobiletools-engineering-service2

This comment has been minimized.

@vs-mobiletools-engineering-service2

This comment has been minimized.

@vs-mobiletools-engineering-service2

This comment has been minimized.

@vs-mobiletools-engineering-service2

This comment has been minimized.

@vs-mobiletools-engineering-service2

This comment has been minimized.

Comment thread tests/cecil-tests/BlittablePInvokes.cs Outdated
Comment thread tests/cecil-tests/BlittablePInvokes.cs Outdated
Comment thread tests/cecil-tests/BlittablePInvokes.cs Outdated
Comment thread tests/cecil-tests/BlittablePInvokes.cs Outdated
@vs-mobiletools-engineering-service2

This comment has been minimized.

@vs-mobiletools-engineering-service2

This comment has been minimized.

stephen-hawley and others added 4 commits March 7, 2023 16:44
Co-authored-by: Haritha Mohan <harithamohan@microsoft.com>
Co-authored-by: Haritha Mohan <harithamohan@microsoft.com>
Co-authored-by: Haritha Mohan <harithamohan@microsoft.com>
Co-authored-by: Haritha Mohan <harithamohan@microsoft.com>
@vs-mobiletools-engineering-service2

Copy link
Copy Markdown
Collaborator

✅ API diff for current PR / commit

Legacy Xamarin (No breaking changes)
  • iOS (no change detected)
  • tvOS (no change detected)
  • watchOS (no change detected)
  • macOS (no change detected)
NET (empty diffs)
  • iOS: (empty diff detected)
  • tvOS: (empty diff detected)
  • MacCatalyst: (empty diff detected)
  • macOS: (empty diff detected)

✅ API diff vs stable

Legacy Xamarin (No breaking changes)
.NET (No breaking changes)
Legacy Xamarin (stable) vs .NET

✅ Generator diff

Generator diff is empty

Pipeline on Agent
Hash: 518180177c0fae7f35eace08bb21574ed25dbc98 [PR build]

@vs-mobiletools-engineering-service2

Copy link
Copy Markdown
Collaborator

✅ API diff for current PR / commit

Legacy Xamarin (No breaking changes)
  • iOS (no change detected)
  • tvOS (no change detected)
  • watchOS (no change detected)
  • macOS (no change detected)
NET (empty diffs)
  • iOS: (empty diff detected)
  • tvOS: (empty diff detected)
  • MacCatalyst: (empty diff detected)
  • macOS: (empty diff detected)

✅ API diff vs stable

Legacy Xamarin (No breaking changes)
.NET (No breaking changes)
Legacy Xamarin (stable) vs .NET

✅ Generator diff

Generator diff is empty

Pipeline on Agent
Hash: 518180177c0fae7f35eace08bb21574ed25dbc98 [PR build]

@vs-mobiletools-engineering-service2

Copy link
Copy Markdown
Collaborator

💻 [PR Build] Tests on macOS M1 - Mac Big Sur (11.5) passed 💻

All tests on macOS M1 - Mac Big Sur (11.5) passed.

Pipeline on Agent
Hash: 518180177c0fae7f35eace08bb21574ed25dbc98 [PR build]

@vs-mobiletools-engineering-service2

Copy link
Copy Markdown
Collaborator

💻 [PR Build] Tests on macOS M1 - Mac Ventura (13.0) passed 💻

All tests on macOS M1 - Mac Ventura (13.0) passed.

Pipeline on Agent
Hash: 518180177c0fae7f35eace08bb21574ed25dbc98 [PR build]

@vs-mobiletools-engineering-service2

Copy link
Copy Markdown
Collaborator

📚 [PR Build] Artifacts 📚

Packages generated

View packages

Pipeline on Agent XAMBOT-1043.Monterey'
Hash: 518180177c0fae7f35eace08bb21574ed25dbc98 [PR build]

@vs-mobiletools-engineering-service2

Copy link
Copy Markdown
Collaborator

💻 [PR Build] Tests on macOS M1 - Mac Ventura (13.0) passed 💻

All tests on macOS M1 - Mac Ventura (13.0) passed.

Pipeline on Agent
Hash: 518180177c0fae7f35eace08bb21574ed25dbc98 [PR build]

@vs-mobiletools-engineering-service2

Copy link
Copy Markdown
Collaborator

💻 [PR Build] Tests on macOS M1 - Mac Big Sur (11.5) passed 💻

All tests on macOS M1 - Mac Big Sur (11.5) passed.

Pipeline on Agent
Hash: 518180177c0fae7f35eace08bb21574ed25dbc98 [PR build]

@vs-mobiletools-engineering-service2

Copy link
Copy Markdown
Collaborator

📚 [PR Build] Artifacts 📚

Packages generated

View packages

Pipeline on Agent XAMBOT-1108.Monterey'
Hash: 518180177c0fae7f35eace08bb21574ed25dbc98 [PR build]

@vs-mobiletools-engineering-service2

This comment has been minimized.

@vs-mobiletools-engineering-service2

This comment has been minimized.

@vs-mobiletools-engineering-service2

Copy link
Copy Markdown
Collaborator

🔥 [CI Build] Test results 🔥

Test results

❌ Tests failed on VSTS: simulator tests

0 tests crashed, 84 tests failed, 141 tests passed.

Failures

❌ dotnettests tests [attempt 2]

1 tests failed, 0 tests passed.
Details
  • DotNet tests: Failed (Execution failed with exit code 1)

Html Report (VSDrops) Download

❌ framework tests [attempt 2]

4 tests failed, 4 tests passed.
Details
  • framework-test/Mac [dotnet]/Debug [dotnet]: BuildFailure
  • framework-test/Mac Catalyst [dotnet]/Debug [dotnet]: BuildFailure
  • framework-test/iOS Unified 64-bits - simulator/Debug [dotnet]: BuildFailure
  • framework-test/tvOS - simulator/Debug [dotnet]: BuildFailure

Html Report (VSDrops) Download

❌ interdependent_binding_projects tests [attempt 2]

4 tests failed, 3 tests passed.
Details
  • interdependent-binding-projects/Mac [dotnet]/Debug [dotnet]: BuildFailure
  • interdependent-binding-projects/Mac Catalyst [dotnet]/Debug [dotnet]: BuildFailure
  • interdependent-binding-projects/iOS Unified 64-bits - simulator/Debug [dotnet]: BuildFailure
  • interdependent-binding-projects/tvOS - simulator/Debug [dotnet]: BuildFailure

Html Report (VSDrops) Download

❌ introspection tests [attempt 2]

6 tests failed, 2 tests passed.
Details
  • introspection/Mac [dotnet]/Debug [dotnet]: BuildFailure
  • introspection/Mac Catalyst [dotnet]/Debug [dotnet]: BuildFailure
  • introspection/iOS Unified 64-bits - simulator/Debug [dotnet]: BuildFailure
  • introspection/iOS Unified 64-bits - simulator/Debug: BuildFailure
  • introspection/tvOS - simulator/Debug [dotnet]: BuildFailure
  • introspection/tvOS - simulator/Debug: BuildFailure

Html Report (VSDrops) Download

❌ linker tests [attempt 2]

40 tests failed, 25 tests passed.
Details
  • dont link/Mac [dotnet]/Debug [dotnet]: BuildFailure
  • dont link/Mac [dotnet]/Release [dotnet]: BuildFailure
  • dont link/Mac Catalyst [dotnet]/Debug [dotnet]: BuildFailure
  • dont link/Mac Catalyst [dotnet]/Release [dotnet]: BuildFailure
  • dont link/iOS Unified 64-bits - simulator/Debug [dotnet]: BuildFailure
  • dont link/iOS Unified 64-bits - simulator/Release [dotnet]: BuildFailure
  • dont link/tvOS - simulator/Debug [dotnet]: BuildFailure
  • dont link/tvOS - simulator/Release [dotnet]: BuildFailure
  • link sdk/Mac [dotnet]/Debug [dotnet]: BuildFailure
  • link sdk/Mac [dotnet]/Release [dotnet]: BuildFailure
  • link sdk/Mac Catalyst [dotnet]/Debug [dotnet]: BuildFailure
  • link sdk/Mac Catalyst [dotnet]/Release [dotnet]: BuildFailure
  • link sdk/iOS Unified 64-bits - simulator/Debug [dotnet]: BuildFailure
  • link sdk/iOS Unified 64-bits - simulator/Release [dotnet]: BuildFailure
  • link sdk/tvOS - simulator/Debug [dotnet]: BuildFailure
  • link sdk/tvOS - simulator/Release [dotnet]: BuildFailure
  • link all/Mac [dotnet]/Debug [dotnet]: BuildFailure
  • link all/Mac [dotnet]/Release [dotnet]: BuildFailure
  • link all/Mac Catalyst [dotnet]/Debug [dotnet]: BuildFailure
  • link all/Mac Catalyst [dotnet]/Release [dotnet]: BuildFailure
  • link all/iOS Unified 64-bits - simulator/Debug [dotnet]: BuildFailure
  • link all/iOS Unified 64-bits - simulator/Release [dotnet]: BuildFailure
  • link all/tvOS - simulator/Debug [dotnet]: BuildFailure
  • link all/tvOS - simulator/Release [dotnet]: BuildFailure
  • trimmode copy/Mac [dotnet]/Debug [dotnet]: BuildFailure
  • trimmode copy/Mac [dotnet]/Release [dotnet]: BuildFailure
  • trimmode copy/Mac Catalyst [dotnet]/Debug [dotnet]: BuildFailure ( (failed to parse the logs: The Writer is closed or in error state.))
  • trimmode copy/Mac Catalyst [dotnet]/Release [dotnet]: BuildFailure
  • trimmode copy/iOS Unified 64-bits - simulator/Debug [dotnet]: BuildFailure
  • trimmode copy/iOS Unified 64-bits - simulator/Release [dotnet]: BuildFailure
  • trimmode copy/tvOS - simulator/Debug [dotnet]: BuildFailure
  • trimmode copy/tvOS - simulator/Release [dotnet]: BuildFailure
  • trimmode link/Mac [dotnet]/Debug [dotnet]: BuildFailure
  • trimmode link/Mac [dotnet]/Release [dotnet]: BuildFailure
  • trimmode link/Mac Catalyst [dotnet]/Debug [dotnet]: BuildFailure
  • trimmode link/Mac Catalyst [dotnet]/Release [dotnet]: BuildFailure
  • trimmode link/iOS Unified 64-bits - simulator/Debug [dotnet]: BuildFailure
  • trimmode link/iOS Unified 64-bits - simulator/Release [dotnet]: BuildFailure
  • trimmode link/tvOS - simulator/Debug [dotnet]: BuildFailure
  • trimmode link/tvOS - simulator/Release [dotnet]: BuildFailure

Html Report (VSDrops) Download

❌ monotouch tests [attempt 2]

21 tests failed, 4 tests passed.
Details
  • monotouch-test/Mac [dotnet]/Debug [dotnet]: BuildFailure
  • monotouch-test/Mac [dotnet]/Debug (static registrar) [dotnet]: BuildFailure
  • monotouch-test/Mac [dotnet]/Release [dotnet]: BuildFailure
  • monotouch-test/Mac Catalyst [dotnet]/Debug [dotnet]: BuildFailure
  • monotouch-test/Mac Catalyst [dotnet]/Release [dotnet]: BuildFailure
  • monotouch-test/iOS Unified 64-bits - simulator/Debug [dotnet]: BuildFailure
  • monotouch-test/iOS Unified 64-bits - simulator/Debug: BuildFailure
  • monotouch-test/iOS Unified 64-bits - simulator/Debug (LinkSdk) [dotnet]: BuildFailure
  • monotouch-test/iOS Unified 64-bits - simulator/Debug (static registrar) [dotnet]: BuildFailure
  • monotouch-test/iOS Unified 64-bits - simulator/Release (all optimizations) [dotnet]: BuildFailure
  • monotouch-test/iOS Unified 64-bits - simulator/Debug (LinkSdk): BuildFailure
  • monotouch-test/iOS Unified 64-bits - simulator/Debug (static registrar): BuildFailure
  • monotouch-test/iOS Unified 64-bits - simulator/Release (all optimizations): BuildFailure
  • monotouch-test/tvOS - simulator/Debug [dotnet]: BuildFailure
  • monotouch-test/tvOS - simulator/Debug: BuildFailure
  • monotouch-test/tvOS - simulator/Debug (LinkSdk) [dotnet]: BuildFailure
  • monotouch-test/tvOS - simulator/Debug (static registrar) [dotnet]: BuildFailure
  • monotouch-test/tvOS - simulator/Release (all optimizations) [dotnet]: BuildFailure
  • monotouch-test/tvOS - simulator/Debug (LinkSdk): BuildFailure
  • monotouch-test/tvOS - simulator/Debug (static registrar): BuildFailure
  • monotouch-test/tvOS - simulator/Release (all optimizations): BuildFailure

Html Report (VSDrops) Download

❌ mtouch tests [attempt 2]

1 tests failed, 0 tests passed.
Details
  • MTouch tests/NUnit: Failed (Execution failed with exit code 1)

Html Report (VSDrops) Download

❌ xammac tests [attempt 2]

3 tests failed, 0 tests passed.
Details
  • xammac tests/Mac Modern/Debug: BuildFailure
  • xammac tests/Mac Modern/Release: BuildFailure
  • xammac tests/Mac Modern/Release (all optimizations): BuildFailure

Html Report (VSDrops) Download

❌ xcframework tests [attempt 2]

4 tests failed, 4 tests passed.
Details
  • xcframework-test/Mac [dotnet]/Debug [dotnet]: BuildFailure
  • xcframework-test/Mac Catalyst [dotnet]/Debug [dotnet]: BuildFailure
  • xcframework-test/iOS Unified 64-bits - simulator/Debug [dotnet]: BuildFailure
  • xcframework-test/tvOS - simulator/Debug [dotnet]: BuildFailure

Html Report (VSDrops) Download

Successes

✅ bcl: All 69 tests passed. Html Report (VSDrops) Download
✅ cecil: All 1 tests passed. Html Report (VSDrops) Download
✅ fsharp: All 7 tests passed. Html Report (VSDrops) Download
✅ generator: All 2 tests passed. Html Report (VSDrops) Download
✅ install_source: All 1 tests passed. Html Report (VSDrops) Download
✅ mac_binding_project: All 1 tests passed. Html Report (VSDrops) Download
✅ mmp: All 2 tests passed. Html Report (VSDrops) Download
✅ mononative: All 12 tests passed. Html Report (VSDrops) Download
✅ msbuild: All 2 tests passed. Html Report (VSDrops) Download
✅ xtro: All 2 tests passed. Html Report (VSDrops) Download

Pipeline on Agent
Hash: 518180177c0fae7f35eace08bb21574ed25dbc98 [PR build]

@stephen-hawley
stephen-hawley merged commit 4c1e568 into dotnet:main Mar 8, 2023
@stephen-hawley
stephen-hawley deleted the lets-document-a-bit branch March 8, 2023 17:30
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

dotnet An issue or pull request related to .NET (6) not-notes-worthy Ignore for release notes

Projects

None yet

Development

Successfully merging this pull request may close these issues.

6 participants