Stabilized perf results for SDCA benchmark

[briancylui]

// * Legends *
  Mean         : Arithmetic mean of all measurements
  Error        : Half of 99.9% confidence interval
  StdDev       : Standard deviation of all measurements
  Extra Metric : Value of the provided extra metric
  Gen 0        : GC Generation 0 collects per 1k Operations
  Gen 1        : GC Generation 1 collects per 1k Operations
  Gen 2        : GC Generation 2 collects per 1k Operations
  Allocated    : Allocated memory per single operation (managed only, inclusive, 1KB = 1024B)
  1 ms         : 1 Millisecond (0.001 sec)

netcoreapp3.0 with my change:

Iteration 1:

BenchmarkDotNet=v0.11.1, OS=Windows 10.0.17134.228 (1803/April2018Update/Redstone4)
Intel Core i7-7700 CPU 3.60GHz (Kaby Lake), 1 CPU, 8 logical and 4 physical cores
.NET Core SDK=2.2.100-refac-20180613-1
  [Host]     : .NET Core 3.0.0-preview1-26822-01 (CoreCLR 4.6.26817.05, CoreFX 4.6.26817.04), 64bit RyuJIT
  Job-GTVULA : .NET Core 3.0.0-preview1-26822-01 (CoreCLR 4.6.26817.05, CoreFX 4.6.26817.04), 64bit RyuJIT

Toolchain=netcoreapp3.0  MaxIterationCount=20  WarmupCount=1

Method	Mean	Error	StdDev	Extra Metric	Gen 0	Gen 1	Gen 2	Allocated
TrainIris	216.023 ms	8.8653 ms	10.2093 ms	-	10000.0000	1000.0000	-	15247.45 KB
TrainSentiment	1,589.261 ms	28.9778 ms	27.1058 ms	-	174000.0000	48000.0000	7000.0000	733297.57 KB
PredictIris	1.175 ms	0.0235 ms	0.0261 ms	AccuracyMacro: 0.98	27.3438	13.6719	1.9531	88.67 KB
PredictIrisBatchOf1	1.199 ms	0.0365 ms	0.0420 ms	AccuracyMacro: 0.98	27.3438	13.6719	1.9531	91.21 KB
PredictIrisBatchOf2	1.300 ms	0.1005 ms	0.1158 ms	AccuracyMacro: 0.98	27.3438	13.6719	1.9531	88.04 KB
PredictIrisBatchOf5	1.268 ms	0.1105 ms	0.1182 ms	AccuracyMacro: 0.98	27.3438	13.6719	1.9531	88.34 KB

Iteration 2:

BenchmarkDotNet=v0.11.1, OS=Windows 10.0.17134.228 (1803/April2018Update/Redstone4)
Intel Core i7-7700 CPU 3.60GHz (Kaby Lake), 1 CPU, 8 logical and 4 physical cores
.NET Core SDK=2.2.100-refac-20180613-1
  [Host]     : .NET Core 3.0.0-preview1-26822-01 (CoreCLR 4.6.26817.05, CoreFX 4.6.26817.04), 64bit RyuJIT
  Job-IKUNTW : .NET Core 3.0.0-preview1-26822-01 (CoreCLR 4.6.26817.05, CoreFX 4.6.26817.04), 64bit RyuJIT

Toolchain=netcoreapp3.0  MaxIterationCount=20  WarmupCount=1

Method	Mean	Error	StdDev	Extra Metric	Gen 0	Gen 1	Gen 2	Allocated
TrainIris	227.126 ms	16.8999 ms	19.4619 ms	-	8000.0000	1000.0000	-	12488.88 KB
TrainSentiment	1,572.884 ms	8.5717 ms	8.0179 ms	-	173000.0000	48000.0000	7000.0000	733286.82 KB
PredictIris	1.236 ms	0.0872 ms	0.1004 ms	AccuracyMacro: 0.98	27.3438	13.6719	1.9531	87.97 KB
PredictIrisBatchOf1	1.276 ms	0.1012 ms	0.1083 ms	AccuracyMacro: 0.98	27.3438	13.6719	1.9531	87.95 KB
PredictIrisBatchOf2	1.283 ms	0.0754 ms	0.0807 ms	AccuracyMacro: 0.98	27.3438	13.6719	1.9531	89.24 KB
PredictIrisBatchOf5	1.314 ms	0.0858 ms	0.0988 ms	AccuracyMacro: 0.98	27.3438	13.6719	1.9531	88.35 KB

Iteration 3:

BenchmarkDotNet=v0.11.1, OS=Windows 10.0.17134.228 (1803/April2018Update/Redstone4)
Intel Core i7-7700 CPU 3.60GHz (Kaby Lake), 1 CPU, 8 logical and 4 physical cores
.NET Core SDK=2.2.100-refac-20180613-1
  [Host]     : .NET Core 3.0.0-preview1-26822-01 (CoreCLR 4.6.26817.05, CoreFX 4.6.26817.04), 64bit RyuJIT
  Job-GJLRFC : .NET Core 3.0.0-preview1-26822-01 (CoreCLR 4.6.26817.05, CoreFX 4.6.26817.04), 64bit RyuJIT

Toolchain=netcoreapp3.0  MaxIterationCount=20  WarmupCount=1

Method	Mean	Error	StdDev	Extra Metric	Gen 0	Gen 1	Gen 2	Allocated
TrainIris	229.834 ms	11.0593 ms	12.2924 ms	-	8000.0000	1000.0000	-	14982.94 KB
TrainSentiment	1,564.884 ms	7.4128 ms	6.9340 ms	-	173000.0000	48000.0000	7000.0000	733277.59 KB
PredictIris	1.154 ms	0.0216 ms	0.0212 ms	AccuracyMacro: 0.98	27.3438	13.6719	1.9531	87.98 KB
PredictIrisBatchOf1	1.149 ms	0.0214 ms	0.0200 ms	AccuracyMacro: 0.98	27.3438	13.6719	1.9531	87.95 KB
PredictIrisBatchOf2	1.158 ms	0.0214 ms	0.0200 ms	AccuracyMacro: 0.98	27.3438	13.6719	1.9531	88.05 KB
PredictIrisBatchOf5	1.130 ms	0.0200 ms	0.0187 ms	AccuracyMacro: 0.98	27.3438	13.6719	1.9531	88.35 KB

Iteration 4:

BenchmarkDotNet=v0.11.1, OS=Windows 10.0.17134.228 (1803/April2018Update/Redstone4)
Intel Core i7-7700 CPU 3.60GHz (Kaby Lake), 1 CPU, 8 logical and 4 physical cores
.NET Core SDK=2.2.100-refac-20180613-1
  [Host]     : .NET Core 3.0.0-preview1-26822-01 (CoreCLR 4.6.26817.05, CoreFX 4.6.26817.04), 64bit RyuJIT
  Job-KQAEJT : .NET Core 3.0.0-preview1-26822-01 (CoreCLR 4.6.26817.05, CoreFX 4.6.26817.04), 64bit RyuJIT

Toolchain=netcoreapp3.0  MaxIterationCount=20  WarmupCount=1

Method	Mean	Error	StdDev	Extra Metric	Gen 0	Gen 1	Gen 2	Allocated
TrainIris	243.822 ms	19.6938 ms	22.6794 ms	-	9000.0000	1000.0000	-	12733.62 KB
TrainSentiment	1,572.886 ms	11.5264 ms	10.7818 ms	-	174000.0000	48000.0000	7000.0000	733300.7 KB
PredictIris	1.145 ms	0.0148 ms	0.0132 ms	AccuracyMacro: 0.98	27.3438	13.6719	1.9531	87.98 KB
PredictIrisBatchOf1	1.177 ms	0.0178 ms	0.0167 ms	AccuracyMacro: 0.98	27.3438	13.6719	1.9531	87.95 KB
PredictIrisBatchOf2	1.144 ms	0.0231 ms	0.0266 ms	AccuracyMacro: 0.98	27.3438	13.6719	1.9531	88.05 KB
PredictIrisBatchOf5	1.145 ms	0.0115 ms	0.0096 ms	AccuracyMacro: 0.98	27.3438	13.6719	1.9531	88.35 KB

netcoreapp3.0 without my change:

Iteration 1:

BenchmarkDotNet=v0.11.1, OS=Windows 10.0.17134.228 (1803/April2018Update/Redstone4)
Intel Core i7-7700 CPU 3.60GHz (Kaby Lake), 1 CPU, 8 logical and 4 physical cores
.NET Core SDK=2.2.100-refac-20180613-1
  [Host]     : .NET Core 3.0.0-preview1-26822-01 (CoreCLR 4.6.26817.05, CoreFX 4.6.26817.04), 64bit RyuJIT
  Job-KWCVBS : .NET Core 3.0.0-preview1-26822-01 (CoreCLR 4.6.26817.05, CoreFX 4.6.26817.04), 64bit RyuJIT

Toolchain=netcoreapp3.0  MaxIterationCount=20  WarmupCount=1

Method	Mean	Error	StdDev	Extra Metric	Gen 0	Gen 1	Gen 2	Allocated
TrainIris	225.593 ms	15.2744 ms	17.5901 ms	-	8000.0000	1000.0000	-	12428.61 KB
TrainSentiment	1,573.964 ms	20.2117 ms	18.9060 ms	-	175000.0000	49000.0000	7000.0000	733282.92 KB
PredictIris	1.139 ms	0.0142 ms	0.0119 ms	AccuracyMacro: 0.98	27.3438	13.6719	1.9531	88.84 KB
PredictIrisBatchOf1	1.297 ms	0.1127 ms	0.1206 ms	AccuracyMacro: 0.98	27.3438	13.6719	1.9531	87.6 KB
PredictIrisBatchOf2	1.294 ms	0.0550 ms	0.0565 ms	AccuracyMacro: 0.98	27.3438	13.6719	1.9531	88.91 KB
PredictIrisBatchOf5	1.288 ms	0.0629 ms	0.0724 ms	AccuracyMacro: 0.98	27.3438	13.6719	1.9531	89.21 KB

Iteration 2:

BenchmarkDotNet=v0.11.1, OS=Windows 10.0.17134.228 (1803/April2018Update/Redstone4)
Intel Core i7-7700 CPU 3.60GHz (Kaby Lake), 1 CPU, 8 logical and 4 physical cores
.NET Core SDK=2.2.100-refac-20180613-1
  [Host]     : .NET Core 3.0.0-preview1-26822-01 (CoreCLR 4.6.26817.05, CoreFX 4.6.26817.04), 64bit RyuJIT
  Job-YEFPWN : .NET Core 3.0.0-preview1-26822-01 (CoreCLR 4.6.26817.05, CoreFX 4.6.26817.04), 64bit RyuJIT

Toolchain=netcoreapp3.0  MaxIterationCount=20  WarmupCount=1

Method	Mean	Error	StdDev	Extra Metric	Gen 0	Gen 1	Gen 2	Allocated
TrainIris	226.184 ms	14.1509 ms	16.2962 ms	-	9000.0000	1000.0000	-	13030.15 KB
TrainSentiment	1,587.411 ms	32.2680 ms	35.8658 ms	-	174000.0000	49000.0000	7000.0000	733283.49 KB
PredictIris	1.178 ms	0.0229 ms	0.0225 ms	AccuracyMacro: 0.98	27.3438	13.6719	1.9531	88.84 KB
PredictIrisBatchOf1	1.218 ms	0.0177 ms	0.0157 ms	AccuracyMacro: 0.98	27.3438	13.6719	1.9531	88.81 KB
PredictIrisBatchOf2	1.198 ms	0.0404 ms	0.0449 ms	AccuracyMacro: 0.98	27.3438	13.6719	1.9531	88.91 KB
PredictIrisBatchOf5	1.145 ms	0.0282 ms	0.0313 ms	AccuracyMacro: 0.98	27.3438	13.6719	1.9531	89.21 KB

Iteration 3:

BenchmarkDotNet=v0.11.1, OS=Windows 10.0.17134.228 (1803/April2018Update/Redstone4)
Intel Core i7-7700 CPU 3.60GHz (Kaby Lake), 1 CPU, 8 logical and 4 physical cores
.NET Core SDK=2.2.100-refac-20180613-1
  [Host]     : .NET Core 3.0.0-preview1-26822-01 (CoreCLR 4.6.26817.05, CoreFX 4.6.26817.04), 64bit RyuJIT
  Job-MTTJMO : .NET Core 3.0.0-preview1-26822-01 (CoreCLR 4.6.26817.05, CoreFX 4.6.26817.04), 64bit RyuJIT

Toolchain=netcoreapp3.0  MaxIterationCount=20  WarmupCount=1

Method	Mean	Error	StdDev	Extra Metric	Gen 0	Gen 1	Gen 2	Allocated
TrainIris	219.535 ms	9.8675 ms	10.9677 ms	-	8000.0000	1000.0000	-	12329.34 KB
TrainSentiment	1,568.072 ms	5.1976 ms	4.6075 ms	-	173000.0000	48000.0000	7000.0000	733287.3 KB
PredictIris	1.141 ms	0.0121 ms	0.0107 ms	AccuracyMacro: 0.98	27.3438	13.6719	1.9531	88.84 KB
PredictIrisBatchOf1	1.140 ms	0.0189 ms	0.0177 ms	AccuracyMacro: 0.98	27.3438	13.6719	1.9531	88.81 KB
PredictIrisBatchOf2	1.148 ms	0.0216 ms	0.0191 ms	AccuracyMacro: 0.98	27.3438	13.6719	1.9531	88.9 KB
PredictIrisBatchOf5	1.116 ms	0.0152 ms	0.0135 ms	AccuracyMacro: 0.98	27.3438	13.6719	1.9531	89.21 KB

Iteration 4:

BenchmarkDotNet=v0.11.1, OS=Windows 10.0.17134.228 (1803/April2018Update/Redstone4)
Intel Core i7-7700 CPU 3.60GHz (Kaby Lake), 1 CPU, 8 logical and 4 physical cores
.NET Core SDK=2.2.100-refac-20180613-1
  [Host]     : .NET Core 3.0.0-preview1-26822-01 (CoreCLR 4.6.26817.05, CoreFX 4.6.26817.04), 64bit RyuJIT
  Job-EGFHYI : .NET Core 3.0.0-preview1-26822-01 (CoreCLR 4.6.26817.05, CoreFX 4.6.26817.04), 64bit RyuJIT

Toolchain=netcoreapp3.0  MaxIterationCount=20  WarmupCount=1

Method	Mean	Error	StdDev	Extra Metric	Gen 0	Gen 1	Gen 2	Allocated
TrainIris	222.402 ms	8.5488 ms	9.8448 ms	-	7000.0000	1000.0000	-	12335.98 KB
TrainSentiment	1,571.256 ms	10.4606 ms	9.7849 ms	-	173000.0000	48000.0000	7000.0000	733281.97 KB
PredictIris	1.195 ms	0.0384 ms	0.0442 ms	AccuracyMacro: 0.98	27.3438	13.6719	1.9531	88.84 KB
PredictIrisBatchOf1	1.167 ms	0.0228 ms	0.0223 ms	AccuracyMacro: 0.98	27.3438	13.6719	1.9531	87.6 KB
PredictIrisBatchOf2	1.220 ms	0.0282 ms	0.0314 ms	AccuracyMacro: 0.98	27.3438	13.6719	1.9531	88.91 KB
PredictIrisBatchOf5	1.136 ms	0.0215 ms	0.0201 ms	AccuracyMacro: 0.98	27.3438	13.6719	1.9531	89.21 KB

[briancylui]

@danmosemsft @eerhardt @safern @tannergooding: Please find above the end-to-end perf results for the SDCA benchmark. I collected perf results for netcoreapp3.0 before and after my change, and ran each case for 4 times to ensure the results are consistent and stable, thanks to Adam's latest PR.

Summary: the perf results look comparable before and after my change.