----- start Wed 30 Mar 2022 12:20:07 PM UTC =============== To repro directly: =====================================================
pushd .
/root/helix/work/correlation/dotnet exec --runtimeconfig System.Security.Cryptography.X509Certificates.Tests.runtimeconfig.json --depsfile System.Security.Cryptography.X509Certificates.Tests.deps.json xunit.console.dll System.Security.Cryptography.X509Certificates.Tests.dll -xml testResults.xml -nologo -nocolor -trait category=OuterLoop -notrait category=IgnoreForCI -notrait category=failing
popd
===========================================================================================================
/root/helix/work/workitem/e /root/helix/work/workitem/e
Discovering: System.Security.Cryptography.X509Certificates.Tests (method display = ClassAndMethod, method display options = None)
Discovered: System.Security.Cryptography.X509Certificates.Tests (found 50 of 713 test cases)
Starting: System.Security.Cryptography.X509Certificates.Tests (parallel test collections = on, max threads = 4)
System.Security.Cryptography.X509Certificates.Tests.X509FilesystemTests.VerifyCrlCache [SKIP]
Condition(s) not met: "RunManualTests"
System.Security.Cryptography.X509Certificates.Tests.RevocationTests.DynamicRevocationTests.RevokeEndEntity_PolicyErrors_NotTimeValid(policyErrors: False, notTimeValid: True) [FAIL]
System.AggregateException : One or more errors occurred. (Assert.Equal() Failure
↓ (pos 1)
Expected: [NoError, NoError, NotTimeValid | Revoked]
Actual: [NoError, RevocationStatusUnknown | OfflineRevocati···
↑ (pos 1)) (Assert.Equal() Failure
↓ (pos 1)
Expected: [NoError, NoError, NotTimeValid | Revoked]
Actual: [NoError, RevocationStatusUnknown | OfflineRevocati···
↑ (pos 1)) (Assert.Equal() Failure
↓ (pos 1)
Expected: [NoError, NoError, NotTimeValid | Revoked]
Actual: [NoError, RevocationStatusUnknown | OfflineRevocati···
↑ (pos 1)) (Assert.Equal() Failure
↓ (pos 1)
Expected: [NoError, NoError, NotTimeValid | Revoked]
Actual: [NoError, RevocationStatusUnknown | OfflineRevocati···
↑ (pos 1)) (Assert.Equal() Failure
↓ (pos 1)
Expected: [NoError, NoError, NotTimeValid | Revoked]
Actual: [NoError, RevocationStatusUnknown | OfflineRevocati···
↑ (pos 1))
---- Assert.Equal() Failure
↓ (pos 1)
Expected: [NoError, NoError, NotTimeValid | Revoked]
Actual: [NoError, RevocationStatusUnknown | OfflineRevocati···
↑ (pos 1)
---- Assert.Equal() Failure
↓ (pos 1)
Expected: [NoError, NoError, NotTimeValid | Revoked]
Actual: [NoError, RevocationStatusUnknown | OfflineRevocati···
↑ (pos 1)
---- Assert.Equal() Failure
↓ (pos 1)
Expected: [NoError, NoError, NotTimeValid | Revoked]
Actual: [NoError, RevocationStatusUnknown | OfflineRevocati···
↑ (pos 1)
---- Assert.Equal() Failure
↓ (pos 1)
Expected: [NoError, NoError, NotTimeValid | Revoked]
Actual: [NoError, RevocationStatusUnknown | OfflineRevocati···
↑ (pos 1)
---- Assert.Equal() Failure
↓ (pos 1)
Expected: [NoError, NoError, NotTimeValid | Revoked]
Actual: [NoError, RevocationStatusUnknown | OfflineRevocati···
↑ (pos 1)
Stack Trace:
/_/src/libraries/Common/tests/TestUtilities/System/RetryHelper.cs(48,0): at System.RetryHelper.Execute(Action test, Int32 maxAttempts, Func`2 backoffFunc, Predicate`1 retryWhen)
/_/src/libraries/System.Security.Cryptography.X509Certificates/tests/RevocationTests/DynamicRevocationTests.cs(1543,0): at System.Security.Cryptography.X509Certificates.Tests.RevocationTests.DynamicRevocationTests.SimpleTest(PkiOptions pkiOptions, RunSimpleTest callback, String callerName, Boolean pkiOptionsInTestName)
/_/src/libraries/System.Security.Cryptography.X509Certificates/tests/RevocationTests/DynamicRevocationTests.cs(645,0): at System.Security.Cryptography.X509Certificates.Tests.RevocationTests.DynamicRevocationTests.RevokeEndEntity_PolicyErrors_NotTimeValid(Boolean policyErrors, Boolean notTimeValid)
----- Inner Stack Trace #1 (Xunit.Sdk.EqualException) -----
/_/src/libraries/System.Security.Cryptography.X509Certificates/tests/RevocationTests/DynamicRevocationTests.cs(1572,0): at System.Security.Cryptography.X509Certificates.Tests.RevocationTests.DynamicRevocationTests.AssertChainStatus(X509Chain chain, X509ChainStatusFlags rootStatus, X509ChainStatusFlags issrStatus, X509ChainStatusFlags leafStatus)
/_/src/libraries/System.Security.Cryptography.X509Certificates/tests/RevocationTests/DynamicRevocationTests.cs(683,0): at System.Security.Cryptography.X509Certificates.Tests.RevocationTests.DynamicRevocationTests.<>c__DisplayClass24_0.<RevokeEndEntity_PolicyErrors_NotTimeValid>b__0(CertificateAuthority root, CertificateAuthority intermediate, X509Certificate2 endEntity, ChainHolder holder, RevocationResponder responder)
/_/src/libraries/System.Security.Cryptography.X509Certificates/tests/RevocationTests/DynamicRevocationTests.cs(1541,0): at System.Security.Cryptography.X509Certificates.Tests.RevocationTests.DynamicRevocationTests.<>c__DisplayClass46_0.<SimpleTest>b__0()
/_/src/libraries/Common/tests/TestUtilities/System/RetryHelper.cs(40,0): at System.RetryHelper.Execute(Action test, Int32 maxAttempts, Func`2 backoffFunc, Predicate`1 retryWhen)
----- Inner Stack Trace #2 (Xunit.Sdk.EqualException) -----
/_/src/libraries/System.Security.Cryptography.X509Certificates/tests/RevocationTests/DynamicRevocationTests.cs(1572,0): at System.Security.Cryptography.X509Certificates.Tests.RevocationTests.DynamicRevocationTests.AssertChainStatus(X509Chain chain, X509ChainStatusFlags rootStatus, X509ChainStatusFlags issrStatus, X509ChainStatusFlags leafStatus)
/_/src/libraries/System.Security.Cryptography.X509Certificates/tests/RevocationTests/DynamicRevocationTests.cs(683,0): at System.Security.Cryptography.X509Certificates.Tests.RevocationTests.DynamicRevocationTests.<>c__DisplayClass24_0.<RevokeEndEntity_PolicyErrors_NotTimeValid>b__0(CertificateAuthority root, CertificateAuthority intermediate, X509Certificate2 endEntity, ChainHolder holder, RevocationResponder responder)
/_/src/libraries/System.Security.Cryptography.X509Certificates/tests/RevocationTests/DynamicRevocationTests.cs(1541,0): at System.Security.Cryptography.X509Certificates.Tests.RevocationTests.DynamicRevocationTests.<>c__DisplayClass46_0.<SimpleTest>b__0()
/_/src/libraries/Common/tests/TestUtilities/System/RetryHelper.cs(40,0): at System.RetryHelper.Execute(Action test, Int32 maxAttempts, Func`2 backoffFunc, Predicate`1 retryWhen)
----- Inner Stack Trace #3 (Xunit.Sdk.EqualException) -----
/_/src/libraries/System.Security.Cryptography.X509Certificates/tests/RevocationTests/DynamicRevocationTests.cs(1572,0): at System.Security.Cryptography.X509Certificates.Tests.RevocationTests.DynamicRevocationTests.AssertChainStatus(X509Chain chain, X509ChainStatusFlags rootStatus, X509ChainStatusFlags issrStatus, X509ChainStatusFlags leafStatus)
/_/src/libraries/System.Security.Cryptography.X509Certificates/tests/RevocationTests/DynamicRevocationTests.cs(683,0): at System.Security.Cryptography.X509Certificates.Tests.RevocationTests.DynamicRevocationTests.<>c__DisplayClass24_0.<RevokeEndEntity_PolicyErrors_NotTimeValid>b__0(CertificateAuthority root, CertificateAuthority intermediate, X509Certificate2 endEntity, ChainHolder holder, RevocationResponder responder)
/_/src/libraries/System.Security.Cryptography.X509Certificates/tests/RevocationTests/DynamicRevocationTests.cs(1541,0): at System.Security.Cryptography.X509Certificates.Tests.RevocationTests.DynamicRevocationTests.<>c__DisplayClass46_0.<SimpleTest>b__0()
/_/src/libraries/Common/tests/TestUtilities/System/RetryHelper.cs(40,0): at System.RetryHelper.Execute(Action test, Int32 maxAttempts, Func`2 backoffFunc, Predicate`1 retryWhen)
----- Inner Stack Trace #4 (Xunit.Sdk.EqualException) -----
/_/src/libraries/System.Security.Cryptography.X509Certificates/tests/RevocationTests/DynamicRevocationTests.cs(1572,0): at System.Security.Cryptography.X509Certificates.Tests.RevocationTests.DynamicRevocationTests.AssertChainStatus(X509Chain chain, X509ChainStatusFlags rootStatus, X509ChainStatusFlags issrStatus, X509ChainStatusFlags leafStatus)
/_/src/libraries/System.Security.Cryptography.X509Certificates/tests/RevocationTests/DynamicRevocationTests.cs(683,0): at System.Security.Cryptography.X509Certificates.Tests.RevocationTests.DynamicRevocationTests.<>c__DisplayClass24_0.<RevokeEndEntity_PolicyErrors_NotTimeValid>b__0(CertificateAuthority root, CertificateAuthority intermediate, X509Certificate2 endEntity, ChainHolder holder, RevocationResponder responder)
/_/src/libraries/System.Security.Cryptography.X509Certificates/tests/RevocationTests/DynamicRevocationTests.cs(1541,0): at System.Security.Cryptography.X509Certificates.Tests.RevocationTests.DynamicRevocationTests.<>c__DisplayClass46_0.<SimpleTest>b__0()
/_/src/libraries/Common/tests/TestUtilities/System/RetryHelper.cs(40,0): at System.RetryHelper.Execute(Action test, Int32 maxAttempts, Func`2 backoffFunc, Predicate`1 retryWhen)
----- Inner Stack Trace #5 (Xunit.Sdk.EqualException) -----
/_/src/libraries/System.Security.Cryptography.X509Certificates/tests/RevocationTests/DynamicRevocationTests.cs(1572,0): at System.Security.Cryptography.X509Certificates.Tests.RevocationTests.DynamicRevocationTests.AssertChainStatus(X509Chain chain, X509ChainStatusFlags rootStatus, X509ChainStatusFlags issrStatus, X509ChainStatusFlags leafStatus)
/_/src/libraries/System.Security.Cryptography.X509Certificates/tests/RevocationTests/DynamicRevocationTests.cs(683,0): at System.Security.Cryptography.X509Certificates.Tests.RevocationTests.DynamicRevocationTests.<>c__DisplayClass24_0.<RevokeEndEntity_PolicyErrors_NotTimeValid>b__0(CertificateAuthority root, CertificateAuthority intermediate, X509Certificate2 endEntity, ChainHolder holder, RevocationResponder responder)
/_/src/libraries/System.Security.Cryptography.X509Certificates/tests/RevocationTests/DynamicRevocationTests.cs(1541,0): at System.Security.Cryptography.X509Certificates.Tests.RevocationTests.DynamicRevocationTests.<>c__DisplayClass46_0.<SimpleTest>b__0()
/_/src/libraries/Common/tests/TestUtilities/System/RetryHelper.cs(40,0): at System.RetryHelper.Execute(Action test, Int32 maxAttempts, Func`2 backoffFunc, Predicate`1 retryWhen)
System.AggregateException : One or more errors occurred. (Assert.Equal() Failure
↓ (pos 1)
Expected: [NotValidForUsage, NotValidForUsage, NotTimeValid | Revoked ···
Actual: [NotValidForUsage, NotValidForUsage | RevocationStatusUnknow···
↑ (pos 1)) (Assert.Equal() Failure
↓ (pos 1)
Expected: [NotValidForUsage, NotValidForUsage, NotTimeValid | Revoked ···
Actual: [NotValidForUsage, NotValidForUsage | RevocationStatusUnknow···
↑ (pos 1)) (Assert.Equal() Failure
↓ (pos 1)
Expected: [NotValidForUsage, NotValidForUsage, NotTimeValid | Revoked ···
Actual: [NotValidForUsage, NotValidForUsage | RevocationStatusUnknow···
↑ (pos 1)) (Assert.Equal() Failure
↓ (pos 1)
Expected: [NotValidForUsage, NotValidForUsage, NotTimeValid | Revoked ···
Actual: [NotValidForUsage, NotValidForUsage | RevocationStatusUnknow···
↑ (pos 1)) (Assert.Equal() Failure
↓ (pos 1)
Expected: [NotValidForUsage, NotValidForUsage, NotTimeValid | Revoked ···
Actual: [NotValidForUsage, NotValidForUsage | RevocationStatusUnknow···
↑ (pos 1))
---- Assert.Equal() Failure
↓ (pos 1)
Expected: [NotValidForUsage, NotValidForUsage, NotTimeValid | Revoked ···
Actual: [NotValidForUsage, NotValidForUsage | RevocationStatusUnknow···
↑ (pos 1)
---- Assert.Equal() Failure
↓ (pos 1)
Expected: [NotValidForUsage, NotValidForUsage, NotTimeValid | Revoked ···
Actual: [NotValidForUsage, NotValidForUsage | RevocationStatusUnknow···
↑ (pos 1)
---- Assert.Equal() Failure
↓ (pos 1)
Expected: [NotValidForUsage, NotValidForUsage, NotTimeValid | Revoked ···
Actual: [NotValidForUsage, NotValidForUsage | RevocationStatusUnknow···
↑ (pos 1)
---- Assert.Equal() Failure
↓ (pos 1)
Expected: [NotValidForUsage, NotValidForUsage, NotTimeValid | Revoked ···
Actual: [NotValidForUsage, NotValidForUsage | RevocationStatusUnknow···
↑ (pos 1)
---- Assert.Equal() Failure
↓ (pos 1)
Expected: [NotValidForUsage, NotValidForUsage, NotTimeValid | Revoked ···
Actual: [NotValidForUsage, NotValidForUsage | RevocationStatusUnknow···
↑ (pos 1)
Stack Trace:
/_/src/libraries/Common/tests/TestUtilities/System/RetryHelper.cs(48,0): at System.RetryHelper.Execute(Action test, Int32 maxAttempts, Func`2 backoffFunc, Predicate`1 retryWhen)
/_/src/libraries/System.Security.Cryptography.X509Certificates/tests/RevocationTests/DynamicRevocationTests.cs(1543,0): at System.Security.Cryptography.X509Certificates.Tests.RevocationTests.DynamicRevocationTests.SimpleTest(PkiOptions pkiOptions, RunSimpleTest callback, String callerName, Boolean pkiOptionsInTestName)
System.Security.Cryptography.X509Certificates.Tests.RevocationTests.DynamicRevocationTests.RevokeEndEntity_PolicyErrors_NotTimeValid(policyErrors: True, notTimeValid: True) [FAIL]
/_/src/libraries/System.Security.Cryptography.X509Certificates/tests/RevocationTests/DynamicRevocationTests.cs(645,0): at System.Security.Cryptography.X509Certificates.Tests.RevocationTests.DynamicRevocationTests.RevokeEndEntity_PolicyErrors_NotTimeValid(Boolean policyErrors, Boolean notTimeValid)
----- Inner Stack Trace #1 (Xunit.Sdk.EqualException) -----
/_/src/libraries/System.Security.Cryptography.X509Certificates/tests/RevocationTests/DynamicRevocationTests.cs(1572,0): at System.Security.Cryptography.X509Certificates.Tests.RevocationTests.DynamicRevocationTests.AssertChainStatus(X509Chain chain, X509ChainStatusFlags rootStatus, X509ChainStatusFlags issrStatus, X509ChainStatusFlags leafStatus)
/_/src/libraries/System.Security.Cryptography.X509Certificates/tests/RevocationTests/DynamicRevocationTests.cs(683,0): at System.Security.Cryptography.X509Certificates.Tests.RevocationTests.DynamicRevocationTests.<>c__DisplayClass24_0.<RevokeEndEntity_PolicyErrors_NotTimeValid>b__0(CertificateAuthority root, CertificateAuthority intermediate, X509Certificate2 endEntity, ChainHolder holder, RevocationResponder responder)
/_/src/libraries/System.Security.Cryptography.X509Certificates/tests/RevocationTests/DynamicRevocationTests.cs(1541,0): at System.Security.Cryptography.X509Certificates.Tests.RevocationTests.DynamicRevocationTests.<>c__DisplayClass46_0.<SimpleTest>b__0()
/_/src/libraries/Common/tests/TestUtilities/System/RetryHelper.cs(40,0): at System.RetryHelper.Execute(Action test, Int32 maxAttempts, Func`2 backoffFunc, Predicate`1 retryWhen)
----- Inner Stack Trace #2 (Xunit.Sdk.EqualException) -----
/_/src/libraries/System.Security.Cryptography.X509Certificates/tests/RevocationTests/DynamicRevocationTests.cs(1572,0): at System.Security.Cryptography.X509Certificates.Tests.RevocationTests.DynamicRevocationTests.AssertChainStatus(X509Chain chain, X509ChainStatusFlags rootStatus, X509ChainStatusFlags issrStatus, X509ChainStatusFlags leafStatus)
/_/src/libraries/System.Security.Cryptography.X509Certificates/tests/RevocationTests/DynamicRevocationTests.cs(683,0): at System.Security.Cryptography.X509Certificates.Tests.RevocationTests.DynamicRevocationTests.<>c__DisplayClass24_0.<RevokeEndEntity_PolicyErrors_NotTimeValid>b__0(CertificateAuthority root, CertificateAuthority intermediate, X509Certificate2 endEntity, ChainHolder holder, RevocationResponder responder)
/_/src/libraries/System.Security.Cryptography.X509Certificates/tests/RevocationTests/DynamicRevocationTests.cs(1541,0): at System.Security.Cryptography.X509Certificates.Tests.RevocationTests.DynamicRevocationTests.<>c__DisplayClass46_0.<SimpleTest>b__0()
/_/src/libraries/Common/tests/TestUtilities/System/RetryHelper.cs(40,0): at System.RetryHelper.Execute(Action test, Int32 maxAttempts, Func`2 backoffFunc, Predicate`1 retryWhen)
----- Inner Stack Trace #3 (Xunit.Sdk.EqualException) -----
/_/src/libraries/System.Security.Cryptography.X509Certificates/tests/RevocationTests/DynamicRevocationTests.cs(1572,0): at System.Security.Cryptography.X509Certificates.Tests.RevocationTests.DynamicRevocationTests.AssertChainStatus(X509Chain chain, X509ChainStatusFlags rootStatus, X509ChainStatusFlags issrStatus, X509ChainStatusFlags leafStatus)
/_/src/libraries/System.Security.Cryptography.X509Certificates/tests/RevocationTests/DynamicRevocationTests.cs(683,0): at System.Security.Cryptography.X509Certificates.Tests.RevocationTests.DynamicRevocationTests.<>c__DisplayClass24_0.<RevokeEndEntity_PolicyErrors_NotTimeValid>b__0(CertificateAuthority root, CertificateAuthority intermediate, X509Certificate2 endEntity, ChainHolder holder, RevocationResponder responder)
/_/src/libraries/System.Security.Cryptography.X509Certificates/tests/RevocationTests/DynamicRevocationTests.cs(1541,0): at System.Security.Cryptography.X509Certificates.Tests.RevocationTests.DynamicRevocationTests.<>c__DisplayClass46_0.<SimpleTest>b__0()
/_/src/libraries/Common/tests/TestUtilities/System/RetryHelper.cs(40,0): at System.RetryHelper.Execute(Action test, Int32 maxAttempts, Func`2 backoffFunc, Predicate`1 retryWhen)
----- Inner Stack Trace #4 (Xunit.Sdk.EqualException) -----
/_/src/libraries/System.Security.Cryptography.X509Certificates/tests/RevocationTests/DynamicRevocationTests.cs(1572,0): at System.Security.Cryptography.X509Certificates.Tests.RevocationTests.DynamicRevocationTests.AssertChainStatus(X509Chain chain, X509ChainStatusFlags rootStatus, X509ChainStatusFlags issrStatus, X509ChainStatusFlags leafStatus)
/_/src/libraries/System.Security.Cryptography.X509Certificates/tests/RevocationTests/DynamicRevocationTests.cs(683,0): at System.Security.Cryptography.X509Certificates.Tests.RevocationTests.DynamicRevocationTests.<>c__DisplayClass24_0.<RevokeEndEntity_PolicyErrors_NotTimeValid>b__0(CertificateAuthority root, CertificateAuthority intermediate, X509Certificate2 endEntity, ChainHolder holder, RevocationResponder responder)
/_/src/libraries/System.Security.Cryptography.X509Certificates/tests/RevocationTests/DynamicRevocationTests.cs(1541,0): at System.Security.Cryptography.X509Certificates.Tests.RevocationTests.DynamicRevocationTests.<>c__DisplayClass46_0.<SimpleTest>b__0()
/_/src/libraries/Common/tests/TestUtilities/System/RetryHelper.cs(40,0): at System.RetryHelper.Execute(Action test, Int32 maxAttempts, Func`2 backoffFunc, Predicate`1 retryWhen)
----- Inner Stack Trace #5 (Xunit.Sdk.EqualException) -----
/_/src/libraries/System.Security.Cryptography.X509Certificates/tests/RevocationTests/DynamicRevocationTests.cs(1572,0): at System.Security.Cryptography.X509Certificates.Tests.RevocationTests.DynamicRevocationTests.AssertChainStatus(X509Chain chain, X509ChainStatusFlags rootStatus, X509ChainStatusFlags issrStatus, X509ChainStatusFlags leafStatus)
/_/src/libraries/System.Security.Cryptography.X509Certificates/tests/RevocationTests/DynamicRevocationTests.cs(683,0): at System.Security.Cryptography.X509Certificates.Tests.RevocationTests.DynamicRevocationTests.<>c__DisplayClass24_0.<RevokeEndEntity_PolicyErrors_NotTimeValid>b__0(CertificateAuthority root, CertificateAuthority intermediate, X509Certificate2 endEntity, ChainHolder holder, RevocationResponder responder)
/_/src/libraries/System.Security.Cryptography.X509Certificates/tests/RevocationTests/DynamicRevocationTests.cs(1541,0): at System.Security.Cryptography.X509Certificates.Tests.RevocationTests.DynamicRevocationTests.<>c__DisplayClass46_0.<SimpleTest>b__0()
/_/src/libraries/Common/tests/TestUtilities/System/RetryHelper.cs(40,0): at System.RetryHelper.Execute(Action test, Int32 maxAttempts, Func`2 backoffFunc, Predicate`1 retryWhen)
System.Security.Cryptography.X509Certificates.Tests.RevocationTests.DynamicRevocationTests.RevokeIntermediate_PolicyErrors_NotTimeValid(policyErrors: False, notTimeValid: True) [FAIL]
@dotnet/area-system-security these failures are happening in the latest commit of the release/preview3 branch, so please help investigate them.
All runs for this branch: https://github.com/dotnet/runtime/runs/5759085052
The test methods of the
DynamicRevocationTestsclass are failing in the release/preview3 branch.Example: https://helixre8s23ayyeko0k025g8.blob.core.windows.net/dotnet-runtime-refs-heads-release-70-preview3211ebe1264504428a7/System.Security.Cryptography.X509Certificates.Tests/1/console.cdbd36e3.log?sv=2019-07-07&se=2022-04-19T12%3A04%3A49Z&sr=c&sp=rl&sig=8NJYc9pU5N%2BK0dJJ7iY2mDoA2Mp6SbcQ4O00KUCKiYA%3D
Output example:
Details