[Perf] Linux/arm64: 5 Regressions in System.Buffers.Tests.SearchValuesCharTests on 7/22/2024 3:17:40 PM

[performanceautofiler]

Run Information

Name	Value
Architecture	arm64
OS	ubuntu 22.04
Queue	AmpereUbuntu
Baseline	d285c824a7b240a50c20bf61e0602f3239d76b8c
Compare	47da68b95373df56f8edade7f7736217581c9a3e
Diff	Diff
Configs	CompilationMode:tiered, RunKind:micro

Regressions in System.Buffers.Tests.SearchValuesCharTests

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio
LastIndexOfAnyExcept - Duration of single invocation 📝 - Benchmark Source ADX - Test Multi Config Graph	29.16 ns	38.86 ns	1.33	0.07	True
IndexOfAny - Duration of single invocation 📝 - Benchmark Source ADX - Test Multi Config Graph	29.16 ns	41.01 ns	1.41	0.08	True
LastIndexOfAny - Duration of single invocation 📝 - Benchmark Source ADX - Test Multi Config Graph	27.56 ns	38.73 ns	1.41	0.06	False
ContainsAny - Duration of single invocation 📝 - Benchmark Source ADX - Test Multi Config Graph	30.17 ns	37.19 ns	1.23	0.06	False
IndexOfAnyExcept - Duration of single invocation 📝 - Benchmark Source ADX - Test Multi Config Graph	29.36 ns	42.90 ns	1.46	0.01	True

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Buffers.Tests.SearchValuesCharTests*'

Details

System.Buffers.Tests.SearchValuesCharTests.LastIndexOfAnyExcept(Values: "abcdefABCDEF0123456789Ü")

ETL Files

Histogram

JIT Disasms

System.Buffers.Tests.SearchValuesCharTests.IndexOfAny(Values: "abcdefABCDEF0123456789Ü")

ETL Files

Histogram

JIT Disasms

System.Buffers.Tests.SearchValuesCharTests.LastIndexOfAny(Values: "abcdefABCDEF0123456789Ü")

ETL Files

Histogram

JIT Disasms

System.Buffers.Tests.SearchValuesCharTests.ContainsAny(Values: "abcdefABCDEF0123456789Ü")

ETL Files

Histogram

JIT Disasms

System.Buffers.Tests.SearchValuesCharTests.IndexOfAnyExcept(Values: "abcdefABCDEF0123456789Ü")

ETL Files

Histogram

JIT Disasms

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

[LoopedBard3]

Likely due to #103216, FYI @MihaZupan

Also seeing this on the x64 win/linux systems, just haven't had a triage covering this timeframe for those systems.

[stephentoub]

I think we should revert #103216. At this point I don't think we have sufficient evidence that its pros outweigh the cons.

[dotnet-policy-service]

Tagging subscribers to this area: @dotnet/area-system-buffers
See info in area-owners.md if you want to be subscribed.