Skip to content

[tests] Update NUnit packages to latest stable versions#25516

Draft
rolfbjarne wants to merge 1 commit into
mainfrom
dev/rolf/nunitv4-bump
Draft

[tests] Update NUnit packages to latest stable versions#25516
rolfbjarne wants to merge 1 commit into
mainfrom
dev/rolf/nunitv4-bump

Conversation

@rolfbjarne
Copy link
Copy Markdown
Member

Update the following package versions:

  • NUnit: 4.4.0 → 4.6.1
  • NUnit3TestAdapter: 6.1.0 → 6.2.0
  • NUnitAnalyzers: 4.7.0 → 4.13.0
  • NUnitXmlTestLogger: 3.1.15 → 8.0.0
  • NUnitLite: 3.12.0 → 4.6.1
  • NUnitV2ResultWriter: 3.6.0 → 3.8.0

Also remove the tools/nunit3-console* scripts, they're no longer needed.

Update the following package versions:
- NUnit: 4.4.0 → 4.6.1
- NUnit3TestAdapter: 6.1.0 → 6.2.0
- NUnitAnalyzers: 4.7.0 → 4.13.0
- NUnitXmlTestLogger: 3.1.15 → 8.0.0
- NUnitLite: 3.12.0 → 4.6.1
- NUnitV2ResultWriter: 3.6.0 → 3.8.0

Also remove the tools/nunit3-console* scripts, they're no longer needed.

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
Copy link
Copy Markdown
Contributor

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Updates the repository’s centralized NUnit-related package versions used by test projects, and removes legacy nunit3-console wrapper scripts from tools/ as they’re no longer referenced.

Changes:

  • Bump NUnit, NUnit3TestAdapter, NUnit.Analyzers, NUnitXml.TestLogger, NUnitLite, and NUnitV2ResultWriter versions via Directory.Build.props.
  • Remove version-pinned tools/nunit3-console-* bash wrappers that invoked nunit3-console.exe via mono.

Reviewed changes

Copilot reviewed 5 out of 5 changed files in this pull request and generated no comments.

Show a summary per file
File Description
tools/nunit3-console-3.9.0 Removed legacy mono-based nunit3-console wrapper script.
tools/nunit3-console-3.10.0 Removed legacy mono-based nunit3-console wrapper script.
tools/nunit3-console-3.11.1 Removed legacy mono-based nunit3-console wrapper script.
tools/nunit3-console-3.12.0 Removed legacy mono-based nunit3-console wrapper script.
Directory.Build.props Centralized version bumps for NUnit-related test dependencies (including NUnitXml.TestLogger 8.0.0 and NUnit 4.6.1).

@vs-mobiletools-engineering-service2
Copy link
Copy Markdown
Collaborator

✅ [PR Build #ac3edee] Build passed (Detect API changes) ✅

Pipeline on Agent
Hash: ac3edeeefda076d9ee886b5d548d373a8c83529e [PR build]

@vs-mobiletools-engineering-service2

This comment has been minimized.

@vs-mobiletools-engineering-service2
Copy link
Copy Markdown
Collaborator

✅ [PR Build #ac3edee] Build passed (Build packages) ✅

Pipeline on Agent
Hash: ac3edeeefda076d9ee886b5d548d373a8c83529e [PR build]

@vs-mobiletools-engineering-service2
Copy link
Copy Markdown
Collaborator

✅ API diff for current PR / commit

NET (empty diffs)

✅ API diff vs stable

NET (empty diffs)

ℹ️ Generator diff

Generator Diff: vsdrops (html) vsdrops (raw diff) gist (raw diff) - Please review changes)

Pipeline on Agent
Hash: ac3edeeefda076d9ee886b5d548d373a8c83529e [PR build]

@vs-mobiletools-engineering-service2
Copy link
Copy Markdown
Collaborator

✅ [PR Build #ac3edee] Build passed (Build macOS tests) ✅

Pipeline on Agent
Hash: ac3edeeefda076d9ee886b5d548d373a8c83529e [PR build]

@vs-mobiletools-engineering-service2
Copy link
Copy Markdown
Collaborator

🔥 [CI Build #ac3edee] Test results 🔥

Test results

❌ Tests failed on VSTS: test results

0 tests crashed, 86 tests failed, 97 tests passed.

Failures

❌ dotnettests tests (iOS)

1 tests failed, 0 tests passed.

Failed tests

  • DotNet tests: Failed (Execution failed with exit code 1)
    • Xamarin.Tests.BundleStructureTest.Build(iOS,"ios-arm64",All,"Deb...: No unexpected files
      Assert.That(unexpectedFiles, Is.Empty)
      Expected:
      But was: < "nunit.framework.legacy.dll" >

    • Xamarin.Tests.BundleStructureTest.Build(iOS,"ios-arm64",All,"Rel...: No unexpected files
      Assert.That(unexpectedFiles, Is.Empty)
      Expected:
      But was: < "nunit.framework.legacy.dll" >

    • Xamarin.Tests.BundleStructureTest.Build(iOS,"iossimulator-x64",A...: No unexpected files
      Assert.That(unexpectedFiles, Is.Empty)
      Expected:
      But was: < "nunit.framework.legacy.dll" >

Html Report (VSDrops) Download

❌ dotnettests tests (MacCatalyst)

1 tests failed, 0 tests passed.

Failed tests

  • DotNet tests: Failed (Execution failed with exit code 1)
    • Xamarin.Tests.BundleStructureTest.Build(MacCatalyst,"maccatalyst...: No unexpected files
      Assert.That(unexpectedFiles, Is.Empty)
      Expected:
      But was: < "Contents/MonoBundle/nunit.framew...
    • Xamarin.Tests.BundleStructureTest.Build(MacCatalyst,"maccatalyst...: No unexpected files
      Assert.That(unexpectedFiles, Is.Empty)
      Expected:
      But was: < "Contents/MonoBundle/nunit.framew...
    • Xamarin.Tests.BundleStructureTest.Build(MacCatalyst,"maccatalyst...: No unexpected files
      Assert.That(unexpectedFiles, Is.Empty)
      Expected:
      But was: < "Contents/MonoBundle/nunit.framew...

Html Report (VSDrops) Download

❌ dotnettests tests (macOS)

1 tests failed, 0 tests passed.

Failed tests

  • DotNet tests: Failed (Execution failed with exit code 1)
    • Xamarin.Tests.BundleStructureTest.Build(MacOSX,"osx-x64;osx-arm6...: No unexpected files
      Assert.That(unexpectedFiles, Is.Empty)
      Expected:
      But was: < "Contents/MonoBundle/nunit.framew...
    • Xamarin.Tests.BundleStructureTest.Build(MacOSX,"osx-x64",All,"De...: No unexpected files
      Assert.That(unexpectedFiles, Is.Empty)
      Expected:
      But was: < "Contents/MonoBundle/nunit.framew...
    • Xamarin.Tests.BundleStructureTest.Build(MacOSX,"osx-x64",All,"Re...: No unexpected files
      Assert.That(unexpectedFiles, Is.Empty)
      Expected:
      But was: < "Contents/MonoBundle/nunit.framew...

Html Report (VSDrops) Download

❌ dotnettests tests (tvOS)

1 tests failed, 0 tests passed.

Failed tests

  • DotNet tests: Failed (Execution failed with exit code 1)
    • Xamarin.Tests.BundleStructureTest.Build(TVOS,"tvos-arm64",All,"D...: No unexpected files
      Assert.That(unexpectedFiles, Is.Empty)
      Expected:
      But was: < "nunit.framework.legacy.dll" >

    • Xamarin.Tests.BundleStructureTest.Build(TVOS,"tvos-arm64",All,"R...: No unexpected files
      Assert.That(unexpectedFiles, Is.Empty)
      Expected:
      But was: < "nunit.framework.legacy.dll" >

Html Report (VSDrops) Download

❌ monotouch tests (iOS)

18 tests failed, 0 tests passed.

Failed tests

  • monotouch-test/iOS - simulator/Debug: Failed
  • monotouch-test/iOS - simulator/Release (link sdk): BuildFailure
  • monotouch-test/iOS - simulator/Release (link all): Failed
  • monotouch-test/iOS - simulator/Debug (LinkSdk): Failed
  • monotouch-test/iOS - simulator/Debug (static registrar): Failed
  • monotouch-test/iOS - simulator/Release (all optimizations): Failed
  • monotouch-test/iOS - simulator/Debug (ARM64): Failed
  • monotouch-test/iOS - simulator/Release (NativeAOT, ARM64): Crashed
  • monotouch-test/iOS - simulator/Release (trimmable static registrar, NativeAOT, ARM64): Crashed
  • monotouch-test/iOS - simulator/Debug (managed static registrar): Failed
  • monotouch-test/iOS - simulator/Release (managed static registrar, all optimizations): Failed
  • monotouch-test/iOS - simulator/Release (NativeAOT, x64): Crashed
  • monotouch-test/iOS - simulator/Release (trimmable static registrar, NativeAOT, x64): Crashed
  • monotouch-test/iOS - simulator/Debug (interpreter): Failed
  • monotouch-test/iOS - simulator/Release (interpreter): Failed
  • monotouch-test/iOS - simulator/Release (compat inline dlfcn): Failed
  • monotouch-test/iOS - simulator/Release (strict inline dlfcn, link sdk): Failed
  • monotouch-test/iOS - simulator/Release (NativeAOT, .NET 11 defaults): Crashed

Html Report (VSDrops) Download

❌ monotouch tests (MacCatalyst)

20 tests failed, 0 tests passed.

Failed tests

  • monotouch-test/Mac Catalyst/Debug: Failed (Test run failed.
    Tests run: 3763 Passed: 3599 Inconclusive: 10 Failed: 5 Ignored: 159)
  • monotouch-test/Mac Catalyst/Release (link sdk): Failed (Test run failed.
    Tests run: 3760 Passed: 3592 Inconclusive: 10 Failed: 5 Ignored: 163)
  • monotouch-test/Mac Catalyst/Release (link all): Failed (Test run failed.
    Tests run: 3760 Passed: 3592 Inconclusive: 10 Failed: 5 Ignored: 163)
  • monotouch-test/Mac Catalyst/Debug (ARM64): Failed (Test run failed.
    Tests run: 3763 Passed: 3594 Inconclusive: 13 Failed: 5 Ignored: 164)
  • monotouch-test/Mac Catalyst/Debug (managed static registrar): Failed (Test run failed.
    Tests run: 3760 Passed: 3569 Inconclusive: 10 Failed: 5 Ignored: 186)
  • monotouch-test/Mac Catalyst/Debug (static registrar): Failed (Test run failed.
    Tests run: 3760 Passed: 3568 Inconclusive: 10 Failed: 5 Ignored: 187)
  • monotouch-test/Mac Catalyst/Debug (static registrar, ARM64): Failed (Test run failed.
    Tests run: 3760 Passed: 3598 Inconclusive: 10 Failed: 5 Ignored: 157)
  • monotouch-test/Mac Catalyst/Release (managed static registrar): Failed (Test run failed.
    Tests run: 3760 Passed: 3591 Inconclusive: 10 Failed: 5 Ignored: 164)
  • monotouch-test/Mac Catalyst/Release (managed static registrar, all optimizations): Failed (Test run failed.
    Tests run: 3760 Passed: 3583 Inconclusive: 11 Failed: 5 Ignored: 172)
  • monotouch-test/Mac Catalyst/Release (NativeAOT): TimedOut (Execution timed out after 1200 seconds.
    Test run crashed)
  • monotouch-test/Mac Catalyst/Release (NativeAOT, ARM64): TimedOut (Execution timed out after 1200 seconds.
    Test run crashed)
  • monotouch-test/Mac Catalyst/Release (NativeAOT, x64): TimedOut (Execution timed out after 1200 seconds.
    Test run crashed)
  • monotouch-test/Mac Catalyst/Release (trimmable static registrar, NativeAOT): Failed (Test run crashed (exit code: 134).
    Test run crashed)
  • monotouch-test/Mac Catalyst/Release (trimmable static registrar, NativeAOT, ARM64): TimedOut (Execution timed out after 1200 seconds.
    Test run crashed)
  • monotouch-test/Mac Catalyst/Release (trimmable static registrar, NativeAOT, x64): TimedOut (Execution timed out after 1200 seconds.
    Test run crashed)
  • monotouch-test/Mac Catalyst/Release (static registrar): Failed (Test run failed.
    Tests run: 3760 Passed: 3591 Inconclusive: 11 Failed: 5 Ignored: 164)
  • monotouch-test/Mac Catalyst/Release (static registrar, all optimizations): Failed (Test run failed.
    Tests run: 3760 Passed: 3586 Inconclusive: 11 Failed: 5 Ignored: 169)
  • monotouch-test/Mac Catalyst/Release (ARM64, LLVM): Failed (Test run failed.
    Tests run: 3760 Passed: 3592 Inconclusive: 11 Failed: 5 Ignored: 163)
  • monotouch-test/Mac Catalyst/Debug (interpreter): Failed (Test run failed.
    Tests run: 3763 Passed: 3598 Inconclusive: 10 Failed: 5 Ignored: 160)
  • monotouch-test/Mac Catalyst/Release (interpreter): Failed (Test run failed.
    Tests run: 3760 Passed: 3591 Inconclusive: 10 Failed: 5 Ignored: 164)

Html Report (VSDrops) Download

❌ monotouch tests (macOS)

20 tests failed, 0 tests passed.

Failed tests

  • monotouch-test/macOS/Debug: Failed (Test run failed.
    Tests run: 3713 Passed: 3604 Inconclusive: 5 Failed: 1 Ignored: 108)
  • monotouch-test/macOS/Release (link sdk): Failed (Test run failed.
    Tests run: 3710 Passed: 3600 Inconclusive: 4 Failed: 1 Ignored: 109)
  • monotouch-test/macOS/Release (link all): Failed (Test run failed.
    Tests run: 3710 Passed: 3570 Inconclusive: 4 Failed: 1 Ignored: 139)
  • monotouch-test/macOS/Debug (ARM64): TimedOut (Execution timed out after 1200 seconds.
    Test run crashed)
  • monotouch-test/macOS/Debug (managed static registrar): Failed (Test run failed.
    Tests run: 3710 Passed: 3604 Inconclusive: 4 Failed: 1 Ignored: 105)
  • monotouch-test/macOS/Debug (trimmable static registrar): Failed (Test run failed.
    Tests run: 3710 Passed: 3574 Inconclusive: 4 Failed: 1 Ignored: 135)
  • monotouch-test/macOS/Debug (static registrar): Failed (Test run failed.
    Tests run: 3710 Passed: 3603 Inconclusive: 4 Failed: 1 Ignored: 106)
  • monotouch-test/macOS/Debug (static registrar, ARM64): Failed (Test run failed.
    Tests run: 3710 Passed: 3602 Inconclusive: 5 Failed: 1 Ignored: 107)
  • monotouch-test/macOS/Release (managed static registrar): Failed (Test run failed.
    Tests run: 3710 Passed: 3602 Inconclusive: 4 Failed: 1 Ignored: 107)
  • monotouch-test/macOS/Release (trimmable static registrar): Failed (Test run failed.
    Tests run: 3710 Passed: 3603 Inconclusive: 4 Failed: 1 Ignored: 106)
  • monotouch-test/macOS/Release (managed static registrar, all optimizations): Failed (Test run failed.
    Tests run: 3710 Passed: 3604 Inconclusive: 4 Failed: 1 Ignored: 105)
  • monotouch-test/macOS/Release (trimmable static registrar, all optimizations): Failed (Test run failed.
    Tests run: 3710 Passed: 3605 Inconclusive: 4 Failed: 1 Ignored: 104)
  • monotouch-test/macOS/Release (NativeAOT): Failed (Test run crashed (exit code: 134).
    Test run crashed)
  • monotouch-test/macOS/Release (NativeAOT, ARM64): Failed (Test run crashed (exit code: 134).
    Test run crashed)
  • monotouch-test/macOS/Release (NativeAOT, x64): Failed (Test run crashed (exit code: 134).
    Test run crashed)
  • monotouch-test/macOS/Release (trimmable static registrar, NativeAOT): Failed (Test run crashed (exit code: 134).
    Test run crashed)
  • monotouch-test/macOS/Release (trimmable static registrar, NativeAOT, ARM64): Failed (Test run crashed (exit code: 134).
    Test run crashed)
  • monotouch-test/macOS/Release (trimmable static registrar, NativeAOT, x64): Failed (Test run crashed (exit code: 134).
    Test run crashed)
  • monotouch-test/macOS/Release (static registrar): Failed (Test run failed.
    Tests run: 3710 Passed: 3602 Inconclusive: 4 Failed: 1 Ignored: 107)
  • monotouch-test/macOS/Release (static registrar, all optimizations): Failed (Test run failed.
    Tests run: 3710 Passed: 3603 Inconclusive: 4 Failed: 1 Ignored: 106)

Html Report (VSDrops) Download

❌ monotouch tests (tvOS)

18 tests failed, 0 tests passed.

Failed tests

  • monotouch-test/tvOS - simulator/Debug: LaunchTimedOut
  • monotouch-test/tvOS - simulator/Release (link sdk): LaunchTimedOut
  • monotouch-test/tvOS - simulator/Release (link all): LaunchTimedOut
  • monotouch-test/tvOS - simulator/Debug (LinkSdk): LaunchTimedOut
  • monotouch-test/tvOS - simulator/Debug (static registrar): LaunchTimedOut
  • monotouch-test/tvOS - simulator/Release (all optimizations): LaunchTimedOut
  • monotouch-test/tvOS - simulator/Debug (ARM64): LaunchTimedOut
  • monotouch-test/tvOS - simulator/Release (NativeAOT, ARM64): LaunchTimedOut
  • monotouch-test/tvOS - simulator/Release (trimmable static registrar, NativeAOT, ARM64): LaunchTimedOut
  • monotouch-test/tvOS - simulator/Debug (managed static registrar): LaunchTimedOut
  • monotouch-test/tvOS - simulator/Release (managed static registrar, all optimizations): LaunchTimedOut
  • monotouch-test/tvOS - simulator/Release (NativeAOT, x64): LaunchTimedOut
  • monotouch-test/tvOS - simulator/Release (trimmable static registrar, NativeAOT, x64): LaunchTimedOut
  • monotouch-test/tvOS - simulator/Debug (interpreter): LaunchTimedOut
  • monotouch-test/tvOS - simulator/Release (interpreter): LaunchTimedOut
  • monotouch-test/tvOS - simulator/Release (compat inline dlfcn): LaunchTimedOut
  • monotouch-test/tvOS - simulator/Release (strict inline dlfcn, link sdk): LaunchTimedOut
  • monotouch-test/tvOS - simulator/Release (NativeAOT, .NET 11 defaults): LaunchTimedOut

Html Report (VSDrops) Download

❌ windows tests

1 tests failed, 2 tests passed.

Failed tests

  • Remote .NET tests/Xamarin.Tests.WindowsTest.BundleStructureWithRemoteMac(iOS,"ios-arm64",All,"Debug"): Failed: No unexpected files

Html Report (VSDrops) Download

❌ Tests on macOS Monterey (12) tests

1 tests failed, 4 tests passed.

Failed tests

  • monotouch-test: Failed (exit code 2)
    • InvokeTest : TargetFramework doesn't support timeout on tests.
    • InvokeTest : TargetFramework doesn't support timeout on tests.
    • InvokeTest : TargetFramework doesn't support timeout on tests.
    • ... and 9 more failures

Html Report (VSDrops) Download

❌ Tests on macOS Ventura (13) tests

1 tests failed, 4 tests passed.

Failed tests

  • monotouch-test: Failed (exit code 2)
    • InvokeTest : TargetFramework doesn't support timeout on tests.
    • InvokeTest : TargetFramework doesn't support timeout on tests.
    • InvokeTest : TargetFramework doesn't support timeout on tests.
    • ... and 9 more failures

Html Report (VSDrops) Download

❌ Tests on macOS Sonoma (14) tests

1 tests failed, 4 tests passed.

Failed tests

  • monotouch-test: Failed (exit code 2)
    • InvokeTest : TargetFramework doesn't support timeout on tests.
    • InvokeTest : TargetFramework doesn't support timeout on tests.
    • AddSharedWebCredentialNotNullPassword : TargetFramework doesn't support timeout on tests.
    • ... and 3 more failures

Html Report (VSDrops) Download

❌ Tests on macOS Sequoia (15) tests

1 tests failed, 4 tests passed.

Failed tests

  • monotouch-test: Failed (exit code 2)
    • InvokeTest : TargetFramework doesn't support timeout on tests.
    • InvokeTest : TargetFramework doesn't support timeout on tests.
    • InvokeTest : TargetFramework doesn't support timeout on tests.
    • ... and 9 more failures

Html Report (VSDrops) Download

❌ Tests on macOS Tahoe (26) tests

1 tests failed, 4 tests passed.

Failed tests

  • monotouch-test: Failed (exit code 2)
    • InvokeTest : TargetFramework doesn't support timeout on tests.
    • InvokeTest : TargetFramework doesn't support timeout on tests.
    • InvokeTest : TargetFramework doesn't support timeout on tests.
    • ... and 9 more failures

Html Report (VSDrops) Download

Successes

✅ cecil: All 1 tests passed. Html Report (VSDrops) Download
✅ dotnettests (Multiple platforms): All 1 tests passed. Html Report (VSDrops) Download
✅ framework: All 2 tests passed. Html Report (VSDrops) Download
✅ fsharp: All 4 tests passed. Html Report (VSDrops) Download
✅ generator: All 5 tests passed. Html Report (VSDrops) Download
✅ interdependent-binding-projects: All 4 tests passed. Html Report (VSDrops) Download
✅ introspection: All 6 tests passed. Html Report (VSDrops) Download
✅ linker (iOS): All 11 tests passed. Html Report (VSDrops) Download
✅ linker (MacCatalyst): All 11 tests passed. Html Report (VSDrops) Download
✅ linker (macOS): All 11 tests passed. Html Report (VSDrops) Download
✅ linker (tvOS): All 11 tests passed. Html Report (VSDrops) Download
✅ msbuild: All 2 tests passed. Html Report (VSDrops) Download
✅ sharpie: All 1 tests passed. Html Report (VSDrops) Download
✅ xcframework: All 4 tests passed. Html Report (VSDrops) Download
✅ xtro: All 1 tests passed. Html Report (VSDrops) Download

macOS tests

Linux Build Verification

Linux build succeeded

Pipeline on Agent
Hash: ac3edeeefda076d9ee886b5d548d373a8c83529e [PR build]

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants