Skip to content

Regressions in System.Reflection.Invoke #74938

Description

@performanceautofiler

Run Information

Architecture arm64
OS ubuntu 20.04
Baseline 04be559193a8331bcbce95135e20bce5777ed90c
Compare e98fc2a32fd0ea90092d5f93485e2aebd7ec0402
Diff Diff

Regressions in System.Reflection.Invoke

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
Field_Get_int - Duration of single invocation 92.46 ns 99.50 ns 1.08 0.07 False

graph
Test Report

Repro

git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net6.0 --filter 'System.Reflection.Invoke*'
Details

Payloads

Baseline
Compare

Histogram

System.Reflection.Invoke.Field_Get_int


Description of detection logic

IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small.
IsRegressionChecked: Marked as regression because the three check build points were 0.05 greater than the baseline.
IsRegressionWindowed: Marked as regression because we could not find enough baseline builds for window checking.
IsChangePoint: Marked as a change because one of 8/26/2022 8:34:07 PM, 9/1/2022 1:51:24 AM falls between 8/23/2022 7:19:33 AM and 9/1/2022 1:51:24 AM.
IsRegressionStdDev: Marked as regression because -10.041417277844243 (T) = (0 -100.13175447452583) / Math.Sqrt((7.789277324621301 / (21)) + (2.9893176474027543 / (17))) is less than -2.028094000977961 = MathNet.Numerics.Distributions.StudentT.InvCDF(0, 1, (21) + (17) - 2, .025) and -0.08009065341293857 = (92.70680582053294 - 100.13175447452583) / 92.70680582053294 is less than -0.05.
IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small.
IsChangeEdgeDetector: Marked not as a regression because Edge Detector said so.

Docs

Profiling workflow for dotnet/runtime repository
Benchmarking workflow for dotnet/runtime repository

Metadata

Metadata

Assignees

Type

No type

Fields

No fields configured for issues without a type.

Projects

No projects

Milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions