[CoreCLR] Microsoft.DotNet.CoreSetup.Test.HostActivation.FrameworkResolution.RollForwardOnNoCandidateFx.RollForwardOnMinor_RollOverPreRelease Test failure HostActivation.Tests_net6.0_x86

[mdh1418]

Failure on unrelated PR #58456

XUnit : error : Tests failed: D:\workspace\_work\1\s\artifacts\TestResults\Debug\HostActivation.Tests_net6.0_x86.html [net6.0|x86] [D:\workspace\_work\1\s\src\installer\tests\HostActivation.Tests\HostActivation.Tests.csproj]
##[error]XUnit(0,0): error : (NETCORE_ENGINEERING_TELEMETRY=Test) Tests failed: D:\workspace\_work\1\s\artifacts\TestResults\Debug\HostActivation.Tests_net6.0_x86.html [net6.0|x86]

Build: https://dev.azure.com/dnceng/public/_build/results?buildId=1331944&view=logs&j=f827f174-7a88-54e3-54c2-8dcd28f39edd&t=5bc77b52-54d3-5da9-c79e-6dacacea45ab

Installer-coreclr-windows_x86-Debug
RollForwardOnMajor_PicksLatestReleasePatch
RollForwardToPreReleaseToClosestPreRelease_FromRelease
RollForwardOnMinor_RollOverPreRelease
RollForwardToClosestReleaseWithPreReleaseAvailable_FromRelease
RollForwardToPreReleaseOnMinor_FromRelease
RollForwardToLatestPatch_PicksLatestReleasePatch
ReconcileFrameworkReferences_InnerFrameworkReference_PreRelease
RollForwardToPreReleaseToLatestPatch_FromRelease
RollForwardOnMinor_PicksLatestReleasePatch
RollForwardToLatestPatch_WithHigherPreReleasePresent

I couldn't figure out the best area label to add to this issue. If you have write-permissions please help me learn by adding exactly one area label.

Tagging subscribers to this area: @vitek-karas, @agocke, @VSadov
See info in area-owners.md if you want to be subscribed.

Issue Details

---

Failure on unrelated PR #58456

XUnit : error : Tests failed: D:\workspace\_work\1\s\artifacts\TestResults\Debug\HostActivation.Tests_net6.0_x86.html [net6.0|x86] [D:\workspace\_work\1\s\src\installer\tests\HostActivation.Tests\HostActivation.Tests.csproj]
##[error]XUnit(0,0): error : (NETCORE_ENGINEERING_TELEMETRY=Test) Tests failed: D:\workspace\_work\1\s\artifacts\TestResults\Debug\HostActivation.Tests_net6.0_x86.html [net6.0|x86]

Build: https://dev.azure.com/dnceng/public/_build/results?buildId=1331944&view=logs&j=f827f174-7a88-54e3-54c2-8dcd28f39edd&t=5bc77b52-54d3-5da9-c79e-6dacacea45ab

Installer-coreclr-windows_x86-Debug
RollForwardOnMajor_PicksLatestReleasePatch
RollForwardToPreReleaseToClosestPreRelease_FromRelease
RollForwardOnMinor_RollOverPreRelease
RollForwardToClosestReleaseWithPreReleaseAvailable_FromRelease
RollForwardToPreReleaseOnMinor_FromRelease
RollForwardToLatestPatch_PicksLatestReleasePatch
ReconcileFrameworkReferences_InnerFrameworkReference_PreRelease
RollForwardToPreReleaseToLatestPatch_FromRelease
RollForwardOnMinor_PicksLatestReleasePatch
RollForwardToLatestPatch_WithHigherPreReleasePresent

Author:	mdh1418
Assignees:	-
Labels:	area-Host, untriaged
Milestone:	-

[vitek-karas]

Several tests which all fail in a similar way:
Framework resolution picks the wrong version. Unfortunately the tests don't have any logging around what directories are actually available on disk, so it's hard to tell what's wrong. The test passed on rerun... so it's probably some kind of transient failure.

Full log of the failure:

Microsoft.DotNet.CoreSetup.Test.HostActivation.FrameworkResolution.RollForwardOnNoCandidateFx.RollForwardOnMinor_RollOverPreRelease(rollForwardOnNoCandidateFx: null, applyPatches: null, resolvedFramework: "4.5.2") [FAIL]
      The command output did not contain expected result: "mock frameworks: Microsoft.NETCore.App 4.5.2""
File Name: D:\workspace\_work\1\s\artifacts\tests\Debug\ha\frameworkResolution\0\WithManyVersions\dotnet.exe
Arguments: D:\workspace\_work\1\s\artifacts\tests\Debug\ha\frameworkResolution\0\FrameworkReferenceApp\FrameworkReferenceApp.dll
Exit Code: 0
StdOut:
--- Invoked hostpolicy mock - corehost_load
mock version: 369365249 124
mock config: <empty>
mock fx_dir: D:\workspace\_work\1\s\artifacts\tests\Debug\ha\frameworkResolution\0\WithManyVersions\shared\Microsoft.NETCore.App\4.5.1-preview.1
mock fx_name: Microsoft.NETCore.App
mock deps_file: 
mock is_framework_dependent: 1
mock probe_paths: <empty>
mock host_mode: 1
mock tfm: 
mock additional_deps_serialized: 
mock fx_ver: 4.4.0
mock fx_names: 
mock fx_names: Microsoft.NETCore.App
mock fx_dirs: 
mock fx_dirs: D:\workspace\_work\1\s\artifacts\tests\Debug\ha\frameworkResolution\0\WithManyVersions\shared\Microsoft.NETCore.App\4.5.1-preview.1
mock fx_requested_versions: 
mock fx_requested_versions: 4.4.0
mock fx_found_versions: 
mock fx_found_versions: 4.5.1-preview.1
mock host_command:
mock host_info_host_path:D:\workspace\_work\1\s\artifacts\tests\Debug\ha\frameworkResolution\0\WithManyVersions\dotnet.exe
mock host_info_dotnet_root:D:\workspace\_work\1\s\artifacts\tests\Debug\ha\frameworkResolution\0\WithManyVersions\
mock host_info_app_path:D:\workspace\_work\1\s\artifacts\tests\Debug\ha\frameworkResolution\0\WithManyVersions\dotnet.dll
mock single_file_bundle_header_offset:0
mock frameworks:   [requested: ] [path: ]
mock frameworks: Microsoft.NETCore.App 4.5.1-preview.1 [requested: 4.4.0] [path: D:\workspace\_work\1\s\artifacts\tests\Debug\ha\frameworkResolution\0\WithManyVersions\shared\Microsoft.NETCore.App\4.5.1-preview.1]

StdErr:
Tracing enabled @ Tue Aug 31 19:38:31 2021 GMT
--- Invoked dotnet [version: 7.0.0-ci, commit hash: 29c5cc608aad5f7d02266b18c9533b5bbf19ec0d] main = {
D:\workspace\_work\1\s\artifacts\tests\Debug\ha\frameworkResolution\0\WithManyVersions\dotnet.exe
D:\workspace\_work\1\s\artifacts\tests\Debug\ha\frameworkResolution\0\FrameworkReferenceApp\FrameworkReferenceApp.dll
}
Reading fx resolver directory=[D:\workspace\_work\1\s\artifacts\tests\Debug\ha\frameworkResolution\0\WithManyVersions\host\fxr]
Considering fxr version=[7.0.0-ci]...
Detected latest fxr version=[D:\workspace\_work\1\s\artifacts\tests\Debug\ha\frameworkResolution\0\WithManyVersions\host\fxr\7.0.0-ci]...
Resolved fxr [D:\workspace\_work\1\s\artifacts\tests\Debug\ha\frameworkResolution\0\WithManyVersions\host\fxr\7.0.0-ci\hostfxr.dll]...
Loaded library from D:\workspace\_work\1\s\artifacts\tests\Debug\ha\frameworkResolution\0\WithManyVersions\host\fxr\7.0.0-ci\hostfxr.dll
Invoking fx resolver [D:\workspace\_work\1\s\artifacts\tests\Debug\ha\frameworkResolution\0\WithManyVersions\host\fxr\7.0.0-ci\hostfxr.dll] hostfxr_main_startupinfo
Host path: [D:\workspace\_work\1\s\artifacts\tests\Debug\ha\frameworkResolution\0\WithManyVersions\dotnet.exe]
Dotnet path: [D:\workspace\_work\1\s\artifacts\tests\Debug\ha\frameworkResolution\0\WithManyVersions\]
App path: [D:\workspace\_work\1\s\artifacts\tests\Debug\ha\frameworkResolution\0\WithManyVersions\dotnet.dll]
Tracing enabled @ Tue Aug 31 19:38:31 2021 GMT
--- Invoked hostfxr_main_startupinfo [commit hash: 29c5cc608aad5f7d02266b18c9533b5bbf19ec0d]
Checking if CoreCLR path exists=[D:\workspace\_work\1\s\artifacts\tests\Debug\ha\frameworkResolution\0\WithManyVersions\coreclr.dll]
--- Executing in muxer mode...
Using the provided arguments to determine the application to execute.
Using dotnet root path [D:\workspace\_work\1\s\artifacts\tests\Debug\ha\frameworkResolution\0\WithManyVersions\]
App runtimeconfig.json from [D:\workspace\_work\1\s\artifacts\tests\Debug\ha\frameworkResolution\0\FrameworkReferenceApp\FrameworkReferenceApp.dll]
Runtime config is cfg=D:\workspace\_work\1\s\artifacts\tests\Debug\ha\frameworkResolution\0\FrameworkReferenceApp\FrameworkReferenceApp.runtimeconfig.json dev=D:\workspace\_work\1\s\artifacts\tests\Debug\ha\frameworkResolution\0\FrameworkReferenceApp\FrameworkReferenceApp.runtimeconfig.dev.json
Attempting to read runtime config: D:\workspace\_work\1\s\artifacts\tests\Debug\ha\frameworkResolution\0\FrameworkReferenceApp\FrameworkReferenceApp.runtimeconfig.json
Attempting to read dev runtime config: D:\workspace\_work\1\s\artifacts\tests\Debug\ha\frameworkResolution\0\FrameworkReferenceApp\FrameworkReferenceApp.runtimeconfig.dev.json
Runtime config [D:\workspace\_work\1\s\artifacts\tests\Debug\ha\frameworkResolution\0\FrameworkReferenceApp\FrameworkReferenceApp.runtimeconfig.json] is valid=[1]
--- The specified framework 'Microsoft.NETCore.App', version '4.4.0', apply_patches=1, version_compatibility_range=minor is compatible with the previously referenced version '4.4.0'.
--- Resolving FX directory, name 'Microsoft.NETCore.App' version '4.4.0'
DOTNET_MULTILEVEL_LOOKUP is set to 0
Multilevel lookup is false
Searching FX directory in [D:\workspace\_work\1\s\artifacts\tests\Debug\ha\frameworkResolution\0\WithManyVersions]
Attempting FX roll forward starting from version='[4.4.0]', apply_patches=1, version_compatibility_range=minor, roll_to_highest_version=0, prefer_release=0
'Roll forward' enabled with version_compatibility_range [minor]. Looking for the lowest release/pre-release greater than or equal version to [4.4.0]
Found version [4.5.1-preview.1]
Framework reference resolved to version '4.5.1-preview.1'.
Changing Selected FX version from [] to [D:\workspace\_work\1\s\artifacts\tests\Debug\ha\frameworkResolution\0\WithManyVersions\shared\Microsoft.NETCore.App\4.5.1-preview.1]
Chose FX version [D:\workspace\_work\1\s\artifacts\tests\Debug\ha\frameworkResolution\0\WithManyVersions\shared\Microsoft.NETCore.App\4.5.1-preview.1]
Runtime config is cfg=D:\workspace\_work\1\s\artifacts\tests\Debug\ha\frameworkResolution\0\WithManyVersions\shared\Microsoft.NETCore.App\4.5.1-preview.1\Microsoft.NETCore.App.runtimeconfig.json dev=D:\workspace\_work\1\s\artifacts\tests\Debug\ha\frameworkResolution\0\WithManyVersions\shared\Microsoft.NETCore.App\4.5.1-preview.1\Microsoft.NETCore.App.runtimeconfig.dev.json
Attempting to read runtime config: D:\workspace\_work\1\s\artifacts\tests\Debug\ha\frameworkResolution\0\WithManyVersions\shared\Microsoft.NETCore.App\4.5.1-preview.1\Microsoft.NETCore.App.runtimeconfig.json
Attempting to read dev runtime config: D:\workspace\_work\1\s\artifacts\tests\Debug\ha\frameworkResolution\0\WithManyVersions\shared\Microsoft.NETCore.App\4.5.1-preview.1\Microsoft.NETCore.App.runtimeconfig.dev.json
Runtime config [D:\workspace\_work\1\s\artifacts\tests\Debug\ha\frameworkResolution\0\WithManyVersions\shared\Microsoft.NETCore.App\4.5.1-preview.1\Microsoft.NETCore.App.runtimeconfig.json] is valid=[1]
--- Summary of all frameworks:
     framework:'Microsoft.NETCore.App', lowest requested version='4.4.0', found version='4.5.1-preview.1', effective reference version='4.4.0' apply_patches=1, version_compatibility_range=minor, roll_to_highest_version=0, folder=D:\workspace\_work\1\s\artifacts\tests\Debug\ha\frameworkResolution\0\WithManyVersions\shared\Microsoft.NETCore.App\4.5.1-preview.1
Executing as a framework-dependent app as per config file [D:\workspace\_work\1\s\artifacts\tests\Debug\ha\frameworkResolution\0\FrameworkReferenceApp\FrameworkReferenceApp.runtimeconfig.json]
--- Resolving hostpolicy.dll version from deps json [D:\workspace\_work\1\s\artifacts\tests\Debug\ha\frameworkResolution\0\WithManyVersions\shared\Microsoft.NETCore.App\4.5.1-preview.1\Microsoft.NETCore.App.deps.json]
Cannot use file stream for [D:\workspace\_work\1\s\artifacts\tests\Debug\ha\frameworkResolution\0\WithManyVersions\shared\Microsoft.NETCore.App\4.5.1-preview.1\Microsoft.NETCore.App.deps.json]: No such file or directory
The expected hostpolicy.dll directory is [D:\workspace\_work\1\s\artifacts\tests\Debug\ha\frameworkResolution\0\WithManyVersions\shared\Microsoft.NETCore.App\4.5.1-preview.1]
Loaded library from D:\workspace\_work\1\s\artifacts\tests\Debug\ha\frameworkResolution\0\WithManyVersions\shared\Microsoft.NETCore.App\4.5.1-preview.1\hostpolicy.dll
Probed for and did not resolve library symbol corehost_main_with_output_buffer
Probed for and did not resolve library symbol corehost_initialize
Tracing enabled @ Tue Aug 31 19:38:31 2021 GMT
--- Invoked hostpolicy mock - corehost_load
--- Invoked hostpolicy mock - corehost_main
--- Invoked hostpolicy mock - corehost_unload

"
      Stack Trace:
           at FluentAssertions.Execution.XUnit2TestFramework.Throw(String message)
           at FluentAssertions.Execution.TestFrameworkProvider.Throw(String message)
           at FluentAssertions.Execution.DefaultAssertionStrategy.HandleFailure(String message)
           at FluentAssertions.Execution.AssertionScope.FailWith(String message, Object[] args)
        /_/src/installer/tests/TestUtils/Assertions/CommandResultAssertions.cs(58,0): at Microsoft.DotNet.CoreSetup.Test.CommandResultAssertions.HaveStdOutContaining(String pattern)
        /_/src/installer/tests/HostActivation.Tests/FrameworkResolution/FrameworkResolutionCommandResultExtensions.cs(13,0): at Microsoft.DotNet.CoreSetup.Test.HostActivation.FrameworkResolution.FrameworkResolutionCommandResultExtensions.HaveResolvedFramework(CommandResultAssertions assertion, String name, String version)
        /_/src/installer/tests/HostActivation.Tests/FrameworkResolution/FrameworkResolutionCommandResultExtensions.cs(18,0): at Microsoft.DotNet.CoreSetup.Test.HostActivation.FrameworkResolution.FrameworkResolutionCommandResultExtensions.ShouldHaveResolvedFramework(CommandResult result, String resolvedFrameworkName, String resolvedFrameworkVersion)
        /_/src/installer/tests/HostActivation.Tests/FrameworkResolution/FrameworkResolutionCommandResultExtensions.cs(40,0): at Microsoft.DotNet.CoreSetup.Test.HostActivation.FrameworkResolution.FrameworkResolutionCommandResultExtensions.ShouldHaveResolvedFrameworkOrFailToFind(CommandResult result, String resolvedFrameworkName, String resolvedFrameworkVersion)
        /_/src/installer/tests/HostActivation.Tests/FrameworkResolution/RollForwardOnNoCandidateFx.cs(476,0): at Microsoft.DotNet.CoreSetup.Test.HostActivation.FrameworkResolution.RollForwardOnNoCandidateFx.RollForwardOnMinor_RollOverPreRelease(Nullable`1 rollForwardOnNoCandidateFx, Nullable`1 applyPatches, String resolvedFramework)

[vitek-karas]

This is very likely a duplicate of #58228.