Run Information
Regressions in System.Buffers.Text.Tests.Utf8ParserTests


Test Report
Repro
git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Buffers.Text.Tests.Utf8ParserTests*'
Related Issues
Regressions
Improvements
Details
Payloads
Baseline
Compare
Histogram
Edge Detector Info
Collection Data
System.Buffers.Text.Tests.Utf8ParserTests.TryParseInt64(value: 9223372036854775807)
Description of detection logic
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionWindowed: Marked as regression because 22.19283269865067 > 16.63086313259269.
IsChangePoint: Marked as a change because one of 9/3/2022 11:44:47 AM, 9/13/2022 12:23:36 PM, 9/23/2022 1:16:35 AM, 10/11/2022 8:42:28 PM, 10/19/2022 7:27:15 PM, 10/31/2022 4:38:04 PM, 11/7/2022 4:10:19 PM, 11/14/2022 7:25:10 PM falls between 11/5/2022 10:22:58 PM and 11/14/2022 7:25:10 PM.
IsRegressionStdDev: Marked as regression because -9.275690621249364 (T) = (0 -20.313302515916632) / Math.Sqrt((0.008833013323346104 / (16)) + (8.364027773330086 / (37))) is less than -2.007583770314729 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (16) + (37) - 2, .025) and -0.2777451580932452 = (15.897773031853854 - 20.313302515916632) / 15.897773031853854 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Buffers.Text.Tests.Utf8ParserTests.TryParseInt64(value: -9223372036854775808)
```log
Description of detection logic
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionWindowed: Marked as regression because 22.764201648476273 > 17.18611372837554.
IsChangePoint: Marked as a change because one of 9/3/2022 11:44:47 AM, 9/13/2022 12:23:36 PM, 9/23/2022 1:16:35 AM, 10/11/2022 8:42:28 PM, 10/19/2022 7:27:15 PM, 10/31/2022 4:38:04 PM, 11/7/2022 4:10:19 PM, 11/14/2022 7:25:10 PM falls between 11/5/2022 10:22:58 PM and 11/14/2022 7:25:10 PM.
IsRegressionStdDev: Marked as regression because -9.683494999969362 (T) = (0 -20.98591058883155) / Math.Sqrt((0.03630723696880299 / (16)) + (8.243052325497068 / (38))) is less than -2.0066468050606243 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (16) + (38) - 2, .025) and -0.2755608216815791 = (16.452301005267397 - 20.98591058883155) / 16.452301005267397 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository
### Run Information
Regressions in System.Tests.Perf_Char

Test Report
Repro
git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Tests.Perf_Char*'
Related Issues
Regressions
Improvements
Details
Payloads
Baseline
Compare
Histogram
Edge Detector Info
Collection Data
System.Tests.Perf_Char.Char_ToLowerInvariant(input: "Hello World!")
Description of detection logic
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionWindowed: Marked as regression because 18.443254325458796 > 17.554240302805468.
IsChangePoint: Marked as a change because one of 10/2/2022 4:08:26 PM, 10/6/2022 2:13:23 PM, 10/11/2022 8:42:28 PM, 11/7/2022 4:10:19 PM, 11/14/2022 7:25:10 PM falls between 11/5/2022 10:22:58 PM and 11/14/2022 7:25:10 PM.
IsRegressionStdDev: Marked as regression because -7.407192860548463 (T) = (0 -17.667164066808535) / Math.Sqrt((0.026924164569101915 / (16)) + (0.5379986921396405 / (37))) is less than -2.007583770314729 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (16) + (37) - 2, .025) and -0.056414439356238084 = (16.723705591883636 - 17.667164066808535) / 16.723705591883636 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository
Run Information
Regressions in System.Collections.IndexerSet<String>
| Benchmark |
Baseline |
Test |
Test/Base |
Test Quality |
Edge Detector |
Baseline IR |
Compare IR |
IR Ratio |
Baseline ETL |
Compare ETL |
| Span - Duration of single invocation |
180.68 ns |
232.97 ns |
1.29 |
0.15 |
False |
|
|
|
|
|

Test Report
Repro
git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Collections.IndexerSet<String>*'
Related Issues
Regressions
Improvements
Details
Payloads
Baseline
Compare
Histogram
Edge Detector Info
Collection Data
System.Collections.IndexerSet<String>.Span(Size: 512)
Description of detection logic
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionWindowed: Marked as regression because 232.97036899333656 > 189.69328612427577.
IsChangePoint: Marked as a change because one of 9/3/2022 11:44:47 AM, 9/13/2022 12:23:36 PM, 9/23/2022 1:16:35 AM, 10/2/2022 4:08:45 AM, 10/6/2022 2:13:23 PM, 10/19/2022 7:27:15 PM, 11/1/2022 2:33:16 AM, 11/7/2022 4:10:19 PM, 11/14/2022 7:25:10 PM falls between 11/5/2022 10:22:58 PM and 11/14/2022 7:25:10 PM.
IsRegressionStdDev: Marked as regression because -9.562505528165778 (T) = (0 -220.26905320647865) / Math.Sqrt((0.07188265773928504 / (16)) + (632.5508165942249 / (37))) is less than -2.007583770314729 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (16) + (37) - 2, .025) and -0.21880445013484376 = (180.72550783852893 - 220.26905320647865) / 180.72550783852893 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository
Run Information
Regressions in System.IO.Tests.StreamReaderReadLineTests


Test Report
Repro
git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.IO.Tests.StreamReaderReadLineTests*'
Related Issues
Regressions
Improvements
Details
Payloads
Baseline
Compare
Histogram
Edge Detector Info
Collection Data
System.IO.Tests.StreamReaderReadLineTests.ReadLineAsync(LineLengthRange: [ 1, 1])
Description of detection logic
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionWindowed: Marked as regression because 399.37636711045366 > 350.6809496355553.
IsChangePoint: Marked as a change because one of 11/7/2022 4:10:19 PM, 11/14/2022 7:25:10 PM falls between 11/5/2022 10:22:58 PM and 11/14/2022 7:25:10 PM.
IsRegressionStdDev: Marked as regression because -14.782936413555788 (T) = (0 -380185.54868294) / Math.Sqrt((55698918.822174944 / (16)) + (147909593.661088 / (37))) is less than -2.007583770314729 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (16) + (37) - 2, .025) and -0.11898847745903653 = (339758.23374540306 - 380185.54868294) / 339758.23374540306 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.IO.Tests.StreamReaderReadLineTests.ReadLineAsync(LineLengthRange: [ 0, 0])
```log
Description of detection logic
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionWindowed: Marked as regression because 628.2965556666667 > 559.288579140625.
IsChangePoint: Marked as a change because one of 11/7/2022 4:10:19 PM, 11/14/2022 7:25:10 PM falls between 11/5/2022 10:22:58 PM and 11/14/2022 7:25:10 PM.
IsRegressionStdDev: Marked as regression because -16.44234515368953 (T) = (0 -642223.0471008036) / Math.Sqrt((261482968.2116026 / (16)) + (733203162.991802 / (37))) is less than -2.007583770314729 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (16) + (37) - 2, .025) and -0.1819663655528818 = (543351.3726089782 - 642223.0471008036) / 543351.3726089782 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository
Run Information
Regressions in System.MathBenchmarks.Double


Test Report
Repro
git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.MathBenchmarks.Double*'
Related Issues
Regressions
Improvements
Details
Payloads
Baseline
Compare
Histogram
Edge Detector Info
Collection Data
System.MathBenchmarks.Double.Min
Description of detection logic
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionWindowed: Marked as regression because 6.482171705064343 > 5.723887925295047.
IsChangePoint: Marked as a change because one of 9/3/2022 11:44:47 AM, 9/13/2022 12:23:36 PM, 9/23/2022 1:16:35 AM, 9/29/2022 7:42:19 AM, 10/11/2022 8:42:28 PM, 11/7/2022 4:10:19 PM, 11/14/2022 7:25:10 PM falls between 11/5/2022 10:22:58 PM and 11/14/2022 7:25:10 PM.
IsRegressionStdDev: Marked as regression because -12.803226097013333 (T) = (0 -6303.204940285497) / Math.Sqrt((3.84953204434635 / (16)) + (168650.9891305228 / (38))) is less than -2.0066468050606243 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (16) + (38) - 2, .025) and -0.15650154266359861 = (5450.234788073226 - 6303.204940285497) / 5450.234788073226 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.MathBenchmarks.Double.Max
```log
Description of detection logic
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionWindowed: Marked as regression because 5.972719048528849 > 5.720471996915976.
IsChangePoint: Marked as a change because one of 10/25/2022 2:34:53 PM, 11/7/2022 4:10:19 PM, 11/14/2022 7:25:10 PM falls between 11/5/2022 10:22:58 PM and 11/14/2022 7:25:10 PM.
IsRegressionStdDev: Marked as regression because -11.69958332677974 (T) = (0 -5873.789380132023) / Math.Sqrt((9922.69638986074 / (16)) + (42591.86102422702 / (38))) is less than -2.0066468050606243 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (16) + (38) - 2, .025) and -0.09064314245089053 = (5385.6198709804 - 5873.789380132023) / 5385.6198709804 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository
Run Information
Regressions in System.Collections.CtorFromCollection<String>

Test Report
Repro
git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Collections.CtorFromCollection<String>*'
Related Issues
Regressions
Improvements
Details
Payloads
Baseline
Compare
Histogram
Edge Detector Info
Collection Data
System.Collections.CtorFromCollection<String>.ImmutableDictionary(Size: 512)
Description of detection logic
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionWindowed: Marked as regression because 150.22714089285716 > 146.92920510999852.
IsChangePoint: Marked as a change because one of 9/23/2022 1:16:35 AM, 10/17/2022 8:10:07 PM, 11/7/2022 4:10:19 PM, 11/14/2022 7:25:10 PM falls between 11/5/2022 10:22:58 PM and 11/14/2022 7:25:10 PM.
IsRegressionStdDev: Marked as regression because -8.918226090802639 (T) = (0 -148104.51312537215) / Math.Sqrt((2858308.008602207 / (16)) + (19906848.030958474 / (38))) is less than -2.0066468050606243 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (16) + (38) - 2, .025) and -0.053152963662812615 = (140629.63143575285 - 148104.51312537215) / 140629.63143575285 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository
Run Information
Regressions in System.Linq.Tests.Perf_Enumerable


Test Report
Repro
git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Linq.Tests.Perf_Enumerable*'
Related Issues
Regressions
Improvements
Details
Payloads
Baseline
Compare
Histogram
Edge Detector Info
Collection Data
System.Linq.Tests.Perf_Enumerable.WhereSingle_LastElementMatches(input: Array)
Description of detection logic
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionWindowed: Marked as regression because 211.41983451963767 > 199.6457327533048.
IsChangePoint: Marked as a change because one of 9/3/2022 11:44:47 AM, 9/13/2022 12:23:36 PM, 10/6/2022 2:13:23 PM, 10/31/2022 4:38:04 PM, 11/7/2022 4:10:19 PM, 11/14/2022 7:25:10 PM falls between 11/5/2022 10:22:58 PM and 11/14/2022 7:25:10 PM.
IsRegressionStdDev: Marked as regression because -9.554168513126532 (T) = (0 -205.32897386055) / Math.Sqrt((0.21048794115904007 / (16)) + (91.40288433743625 / (37))) is less than -2.007583770314729 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (16) + (37) - 2, .025) and -0.07913150774878853 = (190.27242962156993 - 205.32897386055) / 190.27242962156993 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Linq.Tests.Perf_Enumerable.WhereFirst_LastElementMatches(input: Array)
```log
Description of detection logic
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionWindowed: Marked as regression because 211.77893976575027 > 200.48165072676463.
IsChangePoint: Marked as a change because one of 9/3/2022 11:44:47 AM, 9/13/2022 12:23:36 PM, 10/6/2022 2:13:23 PM, 10/31/2022 4:38:04 PM, 11/7/2022 4:10:19 PM, 11/14/2022 7:25:10 PM falls between 11/5/2022 10:22:58 PM and 11/14/2022 7:25:10 PM.
IsRegressionStdDev: Marked as regression because -8.521672071752441 (T) = (0 -206.2262572746283) / Math.Sqrt((4.72527723640078 / (16)) + (101.3877538279305 / (36))) is less than -2.0085591120996775 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (16) + (36) - 2, .025) and -0.07862236251955844 = (191.19412357899157 - 206.2262572746283) / 191.19412357899157 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository
Run Information
Regressions in System.Collections.IterateFor<Int32>


Test Report
Repro
git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Collections.IterateFor<Int32>*'
Related Issues
Regressions
Improvements
Details
Payloads
Baseline
Compare
Histogram
Edge Detector Info
Collection Data
System.Collections.IterateFor<Int32>.ImmutableList(Size: 512)
Description of detection logic
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionWindowed: Marked as regression because 11.890829597317571 > 11.486369528882046.
IsChangePoint: Marked as a change because one of 9/7/2022 1:05:52 PM, 9/23/2022 1:16:35 AM, 9/24/2022 1:05:07 PM, 10/2/2022 4:08:26 PM, 10/6/2022 2:13:23 PM, 11/3/2022 3:03:31 PM, 11/7/2022 4:10:19 PM, 11/14/2022 7:25:10 PM falls between 11/5/2022 10:22:58 PM and 11/14/2022 7:25:10 PM.
IsRegressionStdDev: Marked as regression because -8.84961754672181 (T) = (0 -11841.863696315608) / Math.Sqrt((87101.69213736545 / (16)) + (81012.02349001147 / (37))) is less than -2.007583770314729 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (16) + (37) - 2, .025) and -0.06985328302425661 = (11068.680055681167 - 11841.863696315608) / 11068.680055681167 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
```#### System.Collections.IterateFor<Int32>.ImmutableSortedSet(Size: 512)
```log
Description of detection logic
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionWindowed: Marked as regression because 11.899732989282093 > 11.490290404405876.
IsChangePoint: Marked as a change because one of 9/23/2022 1:16:35 AM, 9/29/2022 7:42:19 AM, 10/2/2022 4:08:26 PM, 11/3/2022 3:03:31 PM, 11/7/2022 4:10:19 PM, 11/14/2022 7:25:10 PM falls between 11/5/2022 10:22:58 PM and 11/14/2022 7:25:10 PM.
IsRegressionStdDev: Marked as regression because -6.804122098263 (T) = (0 -11859.249976383551) / Math.Sqrt((190493.31053203033 / (16)) + (18735.330497867715 / (37))) is less than -2.007583770314729 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (16) + (37) - 2, .025) and -0.06828515744266861 = (11101.202608461776 - 11859.249976383551) / 11101.202608461776 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository
Run Information
Regressions in Benchstone.BenchI.IniArray
| Benchmark |
Baseline |
Test |
Test/Base |
Test Quality |
Edge Detector |
Baseline IR |
Compare IR |
IR Ratio |
Baseline ETL |
Compare ETL |
| Test - Duration of single invocation |
45.89 ms |
50.58 ms |
1.10 |
0.03 |
False |
|
|
|
|
|

Test Report
Repro
git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'Benchstone.BenchI.IniArray*'
Related Issues
Regressions
Improvements
Details
Payloads
Baseline
Compare
Histogram
Edge Detector Info
Collection Data
Benchstone.BenchI.IniArray.Test
Description of detection logic
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionWindowed: Marked as regression because 50.5768609625 > 48.045140797500004.
IsChangePoint: Marked as a change because one of 9/3/2022 11:44:47 AM, 9/13/2022 12:23:36 PM, 9/23/2022 1:16:35 AM, 10/11/2022 8:42:28 PM, 10/19/2022 7:27:15 PM, 10/31/2022 4:38:04 PM, 11/7/2022 4:10:19 PM, 11/14/2022 7:25:10 PM falls between 11/5/2022 10:22:58 PM and 11/14/2022 7:25:10 PM.
IsRegressionStdDev: Marked as regression because -7.6601565865674655 (T) = (0 -49174234.29111843) / Math.Sqrt((580328568350.4752 / (16)) + (7794842012276.436 / (38))) is less than -2.0066468050606243 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (16) + (38) - 2, .025) and -0.08287946820905547 = (45410625.77578125 - 49174234.29111843) / 45410625.77578125 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository
Run Information
Regressions in System.Globalization.Tests.StringSearch

Test Report
Repro
git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Globalization.Tests.StringSearch*'
Related Issues
Regressions
Improvements
Details
Payloads
Baseline
Compare
Histogram
Edge Detector Info
Collection Data
System.Globalization.Tests.StringSearch.LastIndexOf_Word_NotFound(Options: (en-US, OrdinalIgnoreCase, False))
Description of detection logic
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionWindowed: Marked as regression because 591.8351749027564 > 567.4671108117338.
IsChangePoint: Marked as a change because one of 9/3/2022 11:44:47 AM, 9/13/2022 12:23:36 PM, 9/23/2022 1:16:35 AM, 10/2/2022 4:08:26 PM, 10/6/2022 2:13:23 PM, 10/31/2022 4:38:04 PM, 11/7/2022 4:10:19 PM, 11/14/2022 7:25:10 PM falls between 11/5/2022 10:22:58 PM and 11/14/2022 7:25:10 PM.
IsRegressionStdDev: Marked as regression because -9.546341918368938 (T) = (0 -575.9324839835615) / Math.Sqrt((0.2801493266789964 / (16)) + (519.7217256342007 / (38))) is less than -2.0066468050606243 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (16) + (38) - 2, .025) and -0.06534736839842478 = (540.6053472018067 - 575.9324839835615) / 540.6053472018067 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository
Run Information
Regressions in System.Collections.AddGivenSize<String>
| Benchmark |
Baseline |
Test |
Test/Base |
Test Quality |
Edge Detector |
Baseline IR |
Compare IR |
IR Ratio |
Baseline ETL |
Compare ETL |
| Stack - Duration of single invocation |
1.56 μs |
1.77 μs |
1.13 |
0.17 |
False |
|
|
|
|
|

Test Report
Repro
git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Collections.AddGivenSize<String>*'
Related Issues
Regressions
Improvements
Details
Payloads
Baseline
Compare
Histogram
Edge Detector Info
Collection Data
System.Collections.AddGivenSize<String>.Stack(Size: 512)
Description of detection logic
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionWindowed: Marked as regression because 1.7698955011042725 > 1.6382135665752704.
IsChangePoint: Marked as a change because one of 9/3/2022 12:10:33 AM, 9/13/2022 12:23:36 PM, 9/27/2022 11:22:50 AM, 10/2/2022 4:08:26 PM, 10/6/2022 2:13:23 PM, 10/19/2022 7:27:15 PM, 10/31/2022 4:38:04 PM, 11/7/2022 4:10:19 PM, 11/14/2022 7:25:10 PM falls between 11/5/2022 10:22:58 PM and 11/14/2022 7:25:10 PM.
IsRegressionStdDev: Marked as regression because -12.956980256617758 (T) = (0 -1714.828413933533) / Math.Sqrt((36.82722375868465 / (16)) + (5363.622930104425 / (38))) is less than -2.0066468050606243 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (16) + (38) - 2, .025) and -0.09950127483860234 = (1559.6420424207836 - 1714.828413933533) / 1559.6420424207836 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository
Run Information
Regressions in System.Buffers.Text.Tests.Utf8ParserTests
Test Report
Repro
Related Issues
Regressions
Improvements
Details
Payloads
Baseline
Compare
Histogram
Edge Detector Info
Collection Data
System.Buffers.Text.Tests.Utf8ParserTests.TryParseInt64(value: 9223372036854775807)
Description of detection logic
Description of detection logic
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository
Regressions in System.Tests.Perf_Char
Test Report
Repro
Related Issues
Regressions
Improvements
Details
Payloads
Baseline
Compare
Histogram
Edge Detector Info
Collection Data
System.Tests.Perf_Char.Char_ToLowerInvariant(input: "Hello World!")
Description of detection logic
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository
Run Information
Regressions in System.Collections.IndexerSet<String>
Test Report
Repro
Related Issues
Regressions
Improvements
Details
Payloads
Baseline
Compare
Histogram
Edge Detector Info
Collection Data
System.Collections.IndexerSet<String>.Span(Size: 512)
Description of detection logic
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository
Run Information
Regressions in System.IO.Tests.StreamReaderReadLineTests
Test Report
Repro
Related Issues
Regressions
Improvements
Details
Payloads
Baseline
Compare
Histogram
Edge Detector Info
Collection Data
System.IO.Tests.StreamReaderReadLineTests.ReadLineAsync(LineLengthRange: [ 1, 1])
Description of detection logic
Description of detection logic
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository
Run Information
Regressions in System.MathBenchmarks.Double
Test Report
Repro
Related Issues
Regressions
Improvements
Details
Payloads
Baseline
Compare
Histogram
Edge Detector Info
Collection Data
System.MathBenchmarks.Double.Min
Description of detection logic
Description of detection logic
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository
Run Information
Regressions in System.Collections.CtorFromCollection<String>
Test Report
Repro
Related Issues
Regressions
Improvements
Details
Payloads
Baseline
Compare
Histogram
Edge Detector Info
Collection Data
System.Collections.CtorFromCollection<String>.ImmutableDictionary(Size: 512)
Description of detection logic
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository
Run Information
Regressions in System.Linq.Tests.Perf_Enumerable
Test Report
Repro
Related Issues
Regressions
Improvements
Details
Payloads
Baseline
Compare
Histogram
Edge Detector Info
Collection Data
System.Linq.Tests.Perf_Enumerable.WhereSingle_LastElementMatches(input: Array)
Description of detection logic
Description of detection logic
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository
Run Information
Regressions in System.Collections.IterateFor<Int32>
Test Report
Repro
Related Issues
Regressions
Improvements
Details
Payloads
Baseline
Compare
Histogram
Edge Detector Info
Collection Data
System.Collections.IterateFor<Int32>.ImmutableList(Size: 512)
Description of detection logic
Description of detection logic
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository
Run Information
Regressions in Benchstone.BenchI.IniArray
Test Report
Repro
Related Issues
Regressions
Improvements
Details
Payloads
Baseline
Compare
Histogram
Edge Detector Info
Collection Data
Benchstone.BenchI.IniArray.Test
Description of detection logic
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository
Run Information
Regressions in System.Globalization.Tests.StringSearch
Test Report
Repro
Related Issues
Regressions
Improvements
Details
Payloads
Baseline
Compare
Histogram
Edge Detector Info
Collection Data
System.Globalization.Tests.StringSearch.LastIndexOf_Word_NotFound(Options: (en-US, OrdinalIgnoreCase, False))
Description of detection logic
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository
Run Information
Regressions in System.Collections.AddGivenSize<String>
Test Report
Repro
Related Issues
Regressions
Improvements
Details
Payloads
Baseline
Compare
Histogram
Edge Detector Info
Collection Data
System.Collections.AddGivenSize<String>.Stack(Size: 512)
Description of detection logic
Docs
Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository