[Perf] Changes at 6/6/2022 10:51:35 AM

[performanceautofiler]

Run Information

Architecture	x86
OS	Windows 10.0.18362
Baseline	6a56aa3512c912df602bf074dc925b77f3895b24
Compare	be4d292eaf27f3890c877b08f6bf9e2f6279e343
Diff	Diff

Regressions in System.Collections.Sort<IntStruct>

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
Array - Duration of single invocation	5.93 μs	7.00 μs	1.18	0.02	False
List - Duration of single invocation	5.89 μs	7.31 μs	1.24	0.01	False

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Collections.Sort<IntStruct>*'

Details

Payloads

Baseline
Compare

Histogram

System.Collections.Sort<IntStruct>.Array(Size: 512)

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 7.003596000000001 > 6.2123963500000015.
IsChangePoint: Marked as a change because one of 5/15/2022 3:27:46 PM, 5/23/2022 3:43:39 PM, 5/30/2022 12:57:05 PM, 6/6/2022 7:24:37 AM, 6/7/2022 9:00:42 AM falls between 5/29/2022 5:15:01 PM and 6/7/2022 9:00:42 AM.
IsRegressionStdDev: Marked as regression because -35.453193290289335 (T) = (0 -7034.276408730158) / Math.Sqrt((54197.04420312031 / (66)) + (5487.413503586505 / (6))) is less than -1.9944371117706434 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (66) + (6) - 2, .025) and -0.26579063457658925 = (5557.2195089618 - 7034.276408730158) / 5557.2195089618 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Collections.Sort<IntStruct>.List(Size: 512)

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 7.305872 > 6.189354399999999.
IsChangePoint: Marked as a change because one of 5/30/2022 12:57:05 PM, 6/6/2022 7:24:37 AM, 6/7/2022 9:00:42 AM falls between 5/29/2022 5:15:01 PM and 6/7/2022 9:00:42 AM.
IsRegressionStdDev: Marked as regression because -36.795958062880345 (T) = (0 -7337.980604845448) / Math.Sqrt((74018.14448348044 / (65)) + (7101.398874982391 / (6))) is less than -1.9949454151066512 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (65) + (6) - 2, .025) and -0.3186490352803767 = (5564.771526401804 - 7337.980604845448) / 5564.771526401804 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

### Run Information

Architecture	x86
OS	Windows 10.0.18362
Baseline	6a56aa3512c912df602bf074dc925b77f3895b24
Compare	be4d292eaf27f3890c877b08f6bf9e2f6279e343
Diff	Diff

Regressions in System.Net.Tests.Perf_WebUtility

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio	Baseline ETL	Compare ETL
Decode_DecodingRequired - Duration of single invocation	140.22 ns	157.08 ns	1.12	0.01	False
Decode_NoDecodingRequired - Duration of single invocation	89.25 ns	120.20 ns	1.35	0.03	True

Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Net.Tests.Perf_WebUtility*'

Details

Payloads

Baseline
Compare

Histogram

System.Net.Tests.Perf_WebUtility.Decode_DecodingRequired

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 157.07541381129928 > 147.2050039567633.
IsChangePoint: Marked as a change because one of 5/9/2022 11:56:12 AM, 5/30/2022 12:57:05 PM, 6/6/2022 7:24:37 AM, 6/7/2022 9:00:42 AM falls between 5/29/2022 5:15:01 PM and 6/7/2022 9:00:42 AM.
IsRegressionStdDev: Marked as regression because -35.61252931348467 (T) = (0 -156.9787349716951) / Math.Sqrt((10.868892283232054 / (65)) + (0.01803705011968672 / (6))) is less than -1.9949454151066512 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (65) + (6) - 2, .025) and -0.10326338796061403 = (142.28581922025964 - 156.9787349716951) / 142.28581922025964 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

```#### System.Net.Tests.Perf_WebUtility.Decode_NoDecodingRequired

```log

Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because 120.19684455823547 > 93.6731096620465.
IsChangePoint: Marked as a change because one of 5/30/2022 12:57:05 PM, 6/6/2022 7:24:37 AM, 6/7/2022 9:00:42 AM falls between 5/29/2022 5:15:01 PM and 6/7/2022 9:00:42 AM.
IsRegressionStdDev: Marked as regression because -24.791556820333756 (T) = (0 -120.13596745128989) / Math.Sqrt((47.99803779357623 / (66)) + (0.0032370525643749246 / (6))) is less than -1.9944371117706434 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (66) + (6) - 2, .025) and -0.21366320646436654 = (98.98624825355708 - 120.13596745128989) / 98.98624825355708 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked as regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

[AndyAyersMS]

Possibly dotnet/runtime#63095