[armel] Crossgen2 skip many methods during Version Bubble compilation

[alpencolt]

Description

As we discussed by email, crossgen2 doesn't compile many methods which should compile in Large Version Bubble mode with option compilebubblegenerics .
From @jkotas

• Methods like GetIndexOfFirstNonAsciiByte_Default that use Vector<T> should be crossgened after Implement concept of unstable ABI into crossgen2 #40820 . If you are running with this change, it sounds like a bug or configuration problem.
• Methods like SpanHelpers.IndexOf are marked with AggressiveOptimization that prevents them from being precompiled. I think this is just a bug. The reason for them being marked this way should no longer apply after Implement concept of unstable ABI into crossgen2 #40820.
• Generic instantiations like System.Collections.Concurrent.ConcurrentDictionary`2[System.Int32,System.__Canon] contained within same version bubble are either a bug in crossgen2 or should be taken care of by having PGO data.
• IL_STUB_PInvoke - these should get fixed by Source generation of ILStub for DllImport #43060.
• IL_STUB_ReversePInvoke - this should be avoidable by changing the code to take advantage of UnmanagedCallersOnlyAttribute and function pointers.

Configuration

Commit: 855e296
OS: Tizen/armel
Application used for profiling: https://github.com/Samsung/Tizen-CSharp-Samples/tree/master/Wearable/Calculator

Data

Added JIT traces. Remove txt extension and open in PerfView
Calculator-fullni.nettrace.txt
Calculator-fullni_compilebubblegeneric.nettrace.txt
Calculator_crossgen1_fullni.nettrace.txt

cc @jkotas @gbalykov

[gbalykov]

System.Private.CoreLib.dll compilation command:

${OVERLAY}/corerun ${OVERLAY}/crossgen2/crossgen2.dll -r:${OVERLAY}/* -r:${OVERLAY}/crossgen2/* ${CROSSGEN_OPTIONS} -o:$OVERLAY/System.Private.CoreLib.ni.dll $OVERLAY/System.Private.CoreLib.dll &>$OVERLAY/System.Private.CoreLib.dll.out

CROSSGEN_OPTIONS is -O for Calculator-fullni.nettrace.txt and -O --inputbubble --compilebubblegenerics for Calculator-fullni_compilebubblegeneric.nettrace.txt.

Command for other dlls is similar except that additional -r:... references are added if required.

[gbalykov]

Also note, that next PR is required to correctly gather ETW events with env variables setup: #44068

[jkotas]

cc @mangod9

[mangod9]

Thanks @alpencolt
cc @dotnet/crossgen-contrib @nattress since we have been recently comparing methods compiled by cg vs cg2

[alpencolt]

@mangod9 I've also added trace for first crossgen (see updated issue). Other measurements performed for crossgen2.

[HJLeee]

@alpencolt Please share the procedure and commands you used for nettrace capture.

[gbalykov]

Next command was used to capture jit etw events for app:

COMPlus_EnableEventPipe=1 COMPlus_EventPipeConfig="Microsoft-Windows-DotNETRuntime:0x10000210b8:5" COMPlus_EventPipeOutputPath=`pwd`/trace.nettrace COMPlus_EventPipeRundown=0 ./corerun $APP.dll

Before this one needs to compile all system and app dlls with command similar to SPC.dll above, and put them in the same dir. Also, Tizen app was modified to exit right when it appears on screen.