Skip to content

Instantly share code, notes, and snippets.

@AndyAyersMS

AndyAyersMS/BDN log

Last active April 26, 2023 00:16
Show Gist options
  • Save AndyAyersMS/fee669df4424779a0048ac7674ae804c to your computer and use it in GitHub Desktop.
Save AndyAyersMS/fee669df4424779a0048ac7674ae804c to your computer and use it in GitHub Desktop.
Download ZIP
System.Numerics.Tests.Perf_Vector3.ReflectBenchmark BDN spew
Raw
BDN log
c:\repos\performance\src\benchmarks\micro>dotnet run -c Release -f net6.0 -- --filter System.Numerics.Tests.Perf_Vector3.ReflectBenchmark --corerun D:\bugs\r84264\base-rel\corerun.exe D:\bugs\r84264\diff-rel\corerun.exe --iterationCount 15 --apples -p ETW
C:\Program Files\dotnet\sdk\8.0.100-preview.2.23157.25\Sdks\Microsoft.NET.Sdk\targets\Microsoft.NET.EolTargetFrameworks.targets(28,5): warning NETSDK1138: The target framework
'netcoreapp3.1' is out of support and will not receive security updates in the future. Please refer to https://aka.ms/dotnet-core-support for more information about the support
policy. [c:\repos\performance\src\benchmarks\micro\MicroBenchmarks.csproj::TargetFramework=netcoreapp3.1]
Each benchmark is going to be executed just once to get invocation counts.
// Validating benchmarks:
// ***** BenchmarkRunner: Start *****
// ***** Found 1 benchmark(s) in total *****
// ***** Building 1 exe(s) in Parallel: Start *****
// start dotnet restore /p:UseSharedCompilation=false /p:BuildInParallel=false /m:1 /p:Deterministic=true /p:Optimize=true in c:\repos\performance\artifacts\bin\MicroBenchmarks\Release\net6.0\cfa0d4f4-7485-4744-b39f-b7c137402957
// command took 5.04s and exited with 0
// start dotnet build -c Release --no-restore /p:UseSharedCompilation=false /p:BuildInParallel=false /m:1 /p:Deterministic=true /p:Optimize=true in c:\repos\performance\artifacts\bin\MicroBenchmarks\Release\net6.0\cfa0d4f4-7485-4744-b39f-b7c137402957
// command took 4.34s and exited with 0
// start dotnet publish -c Release --no-build --no-restore /p:UseSharedCompilation=false /p:BuildInParallel=false /m:1 /p:Deterministic=true /p:Optimize=true --output "c:\repos\performance\artifacts\bin\MicroBenchmarks\Release\net6.0\cfa0d4f4-7485-4744-b39f-b7c137402957\bin\Release\net6.0\publish" in c:\repos\performance\artifacts\bin\MicroBenchmarks\Release\net6.0\cfa0d4f4-7485-4744-b39f-b7c137402957
// command took 1.7s and exited with 0
Copying c:\repos\performance\artifacts\bin\MicroBenchmarks\Release\net6.0\cfa0d4f4-7485-4744-b39f-b7c137402957\bin\Release\net6.0\publish\CommandLine.dll to D:\bugs\r84264\ccf84a4d-03c8-4637-976d-2064b450374a\CommandLine.dll
Copying c:\repos\performance\artifacts\bin\MicroBenchmarks\Release\net6.0\cfa0d4f4-7485-4744-b39f-b7c137402957\bin\Release\net6.0\publish\Microsoft.CodeAnalysis.CSharp.dll to D:\bugs\r84264\ccf84a4d-03c8-4637-976d-2064b450374a\Microsoft.CodeAnalysis.CSharp.dll
Copying c:\repos\performance\artifacts\bin\MicroBenchmarks\Release\net6.0\cfa0d4f4-7485-4744-b39f-b7c137402957\bin\Release\net6.0\publish\Microsoft.CodeAnalysis.dll to D:\bugs\r84264\ccf84a4d-03c8-4637-976d-2064b450374a\Microsoft.CodeAnalysis.dll
// ***** Done, took 00:00:13 (13.6 sec) *****
// Found 1 benchmarks:
// Perf_Vector3.ReflectBenchmark: Job-HCBVZF(EvaluateOverhead=False, PowerPlanMode=00000000-0000-0000-0000-000000000000, Toolchain=\base-rel\corerun.exe, IterationCount=1, IterationTime=250.0000 ms, MaxIterationCount=20, MinIterationCount=15, WarmupCount=1)
// **************************
// Benchmark: Perf_Vector3.ReflectBenchmark: Job-HCBVZF(EvaluateOverhead=False, PowerPlanMode=00000000-0000-0000-0000-000000000000, Toolchain=\base-rel\corerun.exe, IterationCount=1, IterationTime=250.0000 ms, MaxIterationCount=20, MinIterationCount=15, WarmupCount=1)
// *** Execute ***
// Launch: 1 / 1
// Execute: D:\bugs\r84264\ccf84a4d-03c8-4637-976d-2064b450374a\corerun.exe cfa0d4f4-7485-4744-b39f-b7c137402957.dll --anonymousPipes 2860 2856 --benchmarkName System.Numerics.Tests.Perf_Vector3.ReflectBenchmark --job "EvaluateOverhead=False, PowerPlanMode=00000000-0000-0000-0000-000000000000, Toolchain=\base-rel\corerun.exe, IterationCount=1, IterationTime=250.0000 ms, MaxIterationCount=20, MinIterationCount=15, WarmupCount=1" --benchmarkId 0 in c:\repos\performance\artifacts\bin\MicroBenchmarks\Release\net6.0\cfa0d4f4-7485-4744-b39f-b7c137402957\bin\Release\net6.0\publish
// BeforeAnythingElse
// Benchmark Process Environment Information:
// Runtime=.NET 8.0.0 (42.42.42.42424), X64 RyuJIT AVX2
// GC=Concurrent Workstation
// HardwareIntrinsics=AVX2,AES,BMI1,BMI2,FMA,LZCNT,PCLMUL,POPCNT VectorSize=256
// Job: Job-UMTAKW(EvaluateOverhead=False, PowerPlanMode=00000000-0000-0000-0000-000000000000, IterationCount=1, IterationTime=250.0000 ms, MaxIterationCount=20, MinIterationCount=15, WarmupCount=1)
OverheadJitting 1: 1 op, 220400.00 ns, 220.4000 us/op
WorkloadJitting 1: 1 op, 457100.00 ns, 457.1000 us/op
OverheadJitting 2: 16 op, 370200.00 ns, 23.1375 us/op
WorkloadJitting 2: 16 op, 439300.00 ns, 27.4563 us/op
WorkloadPilot 1: 16 op, 700.00 ns, 43.7500 ns/op
WorkloadPilot 2: 5714288 op, 37959600.00 ns, 6.6429 ns/op
WorkloadPilot 3: 37634016 op, 205352400.00 ns, 5.4566 ns/op
WorkloadPilot 4: 45816384 op, 86266700.00 ns, 1.8829 ns/op
WorkloadPilot 5: 132775408 op, 251521000.00 ns, 1.8943 ns/op
WorkloadPilot 6: 131972496 op, 249015400.00 ns, 1.8869 ns/op
WorkloadPilot 7: 132494320 op, 255665300.00 ns, 1.9296 ns/op
WorkloadPilot 8: 129558384 op, 238814600.00 ns, 1.8433 ns/op
WorkloadPilot 9: 135626544 op, 244517400.00 ns, 1.8029 ns/op
WorkloadPilot 10: 138667584 op, 271102600.00 ns, 1.9551 ns/op
WorkloadWarmup 1: 138667584 op, 267811700.00 ns, 1.9313 ns/op
// BeforeActualRun
WorkloadActual 1: 138667584 op, 310703900.00 ns, 2.2406 ns/op
// AfterActualRun
WorkloadResult 1: 138667584 op, 310703900.00 ns, 2.2406 ns/op
// AfterAll
// Benchmark Process 43884 has exited with code 0.
Mean = 2.241 ns, StdErr = 0.000 ns (0.00%), N = 1, StdDev = 0.000 ns
Min = 2.241 ns, Q1 = 2.241 ns, Median = 2.241 ns, Q3 = 2.241 ns, Max = 2.241 ns
IQR = 0.000 ns, LowerFence = 2.241 ns, UpperFence = 2.241 ns
ConfidenceInterval = [NaN ns; NaN ns] (CI 99.9%), Margin = NaN ns (NaN% of Mean)
Skewness = NaN, Kurtosis = NaN, MValue = 2
// ** Remained 0 (0.0%) benchmark(s) to run. Estimated finish 2023-04-25 17:08 (0h 0m from now) **
// ***** BenchmarkRunner: Finish *****
// * Export *
c:\repos\performance\artifacts\bin\MicroBenchmarks\Release\net6.0\BenchmarkDotNet.Artifacts\results\System.Numerics.Tests.Perf_Vector3-report-github.md
c:\repos\performance\artifacts\bin\MicroBenchmarks\Release\net6.0\BenchmarkDotNet.Artifacts\results\System.Numerics.Tests.Perf_Vector3-report-full.json
// * Detailed results *
Perf_Vector3.ReflectBenchmark: Job-HCBVZF(EvaluateOverhead=False, PowerPlanMode=00000000-0000-0000-0000-000000000000, Toolchain=\base-rel\corerun.exe, IterationCount=1, IterationTime=250.0000 ms, MaxIterationCount=20, MinIterationCount=15, WarmupCount=1)
Runtime = .NET 8.0.0 (42.42.42.42424), X64 RyuJIT AVX2; GC = Concurrent Workstation
Mean = 2.241 ns, StdErr = 0.000 ns (0.00%), N = 1, StdDev = 0.000 ns
Min = 2.241 ns, Q1 = 2.241 ns, Median = 2.241 ns, Q3 = 2.241 ns, Max = 2.241 ns
IQR = 0.000 ns, LowerFence = 2.241 ns, UpperFence = 2.241 ns
ConfidenceInterval = [NaN ns; NaN ns] (CI 99.9%), Margin = NaN ns (NaN% of Mean)
Skewness = NaN, Kurtosis = NaN, MValue = 2
-------------------- Histogram --------------------
[1.741 ns ; 2.741 ns) | @
---------------------------------------------------
// * Summary *
BenchmarkDotNet=v0.13.2.2052-nightly, OS=Windows 11 (10.0.22621.1555)
Intel Core i7-8700 CPU 3.20GHz (Coffee Lake), 1 CPU, 12 logical and 6 physical cores
.NET SDK=8.0.100-preview.2.23157.25
[Host] : .NET 6.0.16 (6.0.1623.17311), X64 RyuJIT AVX2
Job-HCBVZF : .NET 8.0.0 (42.42.42.42424), X64 RyuJIT AVX2
EvaluateOverhead=False PowerPlanMode=00000000-0000-0000-0000-000000000000 Toolchain=\base-rel\corerun.exe
IterationCount=1 IterationTime=250.0000 ms MaxIterationCount=20
MinIterationCount=15 WarmupCount=1
| Method | Mean | Error | Median | Min | Max | Ratio |
|----------------- |---------:|------:|---------:|---------:|---------:|------:|
| ReflectBenchmark | 2.241 ns | NA | 2.241 ns | 2.241 ns | 2.241 ns | 1.00 |
// * Legends *
Mean : Arithmetic mean of all measurements
Error : Half of 99.9% confidence interval
Median : Value separating the higher half of all measurements (50th percentile)
Min : Minimum
Max : Maximum
Ratio : Mean of the ratio distribution ([Current]/[Baseline])
1 ns : 1 Nanosecond (0.000000001 sec)
// ***** BenchmarkRunner: End *****
Run time: 00:00:03 (3.09 sec), executed benchmarks: 1
Global total time: 00:00:16 (16.97 sec), executed benchmarks: 1
// * Artifacts cleanup *
Actual benchmarking is going to happen now!
// Validating benchmarks:
// ***** BenchmarkRunner: Start *****
// ***** Found 2 benchmark(s) in total *****
// ***** Building 2 exe(s) in Parallel: Start *****
// ***** Done, took 00:00:15 (15.14 sec) *****
// Found 2 benchmarks:
// Perf_Vector3.ReflectBenchmark: Job-VYWMKB(EvaluateOverhead=False, OutlierMode=DontRemove, PowerPlanMode=00000000-0000-0000-0000-000000000000, Toolchain=\base-rel\corerun.exe, InvocationCount=138667584, IterationCount=15, IterationTime=250.0000 ms, MaxIterationCount=20, MinIterationCount=15, UnrollFactor=16, WarmupCount=1)
// Perf_Vector3.ReflectBenchmark: Job-PJKOED(EvaluateOverhead=False, OutlierMode=DontRemove, PowerPlanMode=00000000-0000-0000-0000-000000000000, Toolchain=\diff-rel\corerun.exe, InvocationCount=138667584, IterationCount=15, IterationTime=250.0000 ms, MaxIterationCount=20, MinIterationCount=15, UnrollFactor=16, WarmupCount=1)
// **************************
// Benchmark: Perf_Vector3.ReflectBenchmark: Job-VYWMKB(EvaluateOverhead=False, OutlierMode=DontRemove, PowerPlanMode=00000000-0000-0000-0000-000000000000, Toolchain=\base-rel\corerun.exe, InvocationCount=138667584, IterationCount=15, IterationTime=250.0000 ms, MaxIterationCount=20, MinIterationCount=15, UnrollFactor=16, WarmupCount=1)
// *** Execute ***
// Launch: 1 / 1
// Execute: D:\bugs\r84264\ccf84a4d-03c8-4637-976d-2064b450374a\corerun.exe 7872e33c-aad6-412c-b8ca-6d8eea8b8d77.dll --anonymousPipes 2520 2668 --benchmarkName System.Numerics.Tests.Perf_Vector3.ReflectBenchmark --job "EvaluateOverhead=False, OutlierMode=DontRemove, PowerPlanMode=00000000-0000-0000-0000-000000000000, Toolchain=\base-rel\corerun.exe, InvocationCount=138667584, IterationCount=15, IterationTime=250.0000 ms, MaxIterationCount=20, MinIterationCount=15, UnrollFactor=16, WarmupCount=1" --benchmarkId 0 in c:\repos\performance\artifacts\bin\MicroBenchmarks\Release\net6.0\7872e33c-aad6-412c-b8ca-6d8eea8b8d77\bin\Release\net6.0\publish
// BeforeAnythingElse
// Benchmark Process Environment Information:
// Runtime=.NET 8.0.0 (42.42.42.42424), X64 RyuJIT AVX2
// GC=Concurrent Workstation
// HardwareIntrinsics=AVX2,AES,BMI1,BMI2,FMA,LZCNT,PCLMUL,POPCNT VectorSize=256
// Job: Job-SXGWIR(EvaluateOverhead=False, OutlierMode=DontRemove, PowerPlanMode=00000000-0000-0000-0000-000000000000, InvocationCount=138667584, IterationCount=15, IterationTime=250.0000 ms, MaxIterationCount=20, MinIterationCount=15, UnrollFactor=16, WarmupCount=1)
OverheadJitting 1: 16 op, 697600.00 ns, 43.6000 us/op
WorkloadJitting 1: 16 op, 973200.00 ns, 60.8250 us/op
WorkloadWarmup 1: 138667584 op, 402315400.00 ns, 2.9013 ns/op
// BeforeActualRun
WorkloadActual 1: 138667584 op, 260152200.00 ns, 1.8761 ns/op
WorkloadActual 2: 138667584 op, 255688600.00 ns, 1.8439 ns/op
WorkloadActual 3: 138667584 op, 253359000.00 ns, 1.8271 ns/op
WorkloadActual 4: 138667584 op, 265781300.00 ns, 1.9167 ns/op
WorkloadActual 5: 138667584 op, 257854900.00 ns, 1.8595 ns/op
WorkloadActual 6: 138667584 op, 259470500.00 ns, 1.8712 ns/op
WorkloadActual 7: 138667584 op, 279004200.00 ns, 2.0120 ns/op
WorkloadActual 8: 138667584 op, 264306000.00 ns, 1.9060 ns/op
WorkloadActual 9: 138667584 op, 263432200.00 ns, 1.8997 ns/op
WorkloadActual 10: 138667584 op, 262462600.00 ns, 1.8927 ns/op
WorkloadActual 11: 138667584 op, 264592000.00 ns, 1.9081 ns/op
WorkloadActual 12: 138667584 op, 263249100.00 ns, 1.8984 ns/op
WorkloadActual 13: 138667584 op, 261990300.00 ns, 1.8893 ns/op
WorkloadActual 14: 138667584 op, 263225500.00 ns, 1.8982 ns/op
WorkloadActual 15: 138667584 op, 263428300.00 ns, 1.8997 ns/op
// AfterActualRun
WorkloadResult 1: 138667584 op, 260152200.00 ns, 1.8761 ns/op
WorkloadResult 2: 138667584 op, 255688600.00 ns, 1.8439 ns/op
WorkloadResult 3: 138667584 op, 253359000.00 ns, 1.8271 ns/op
WorkloadResult 4: 138667584 op, 265781300.00 ns, 1.9167 ns/op
WorkloadResult 5: 138667584 op, 257854900.00 ns, 1.8595 ns/op
WorkloadResult 6: 138667584 op, 259470500.00 ns, 1.8712 ns/op
WorkloadResult 7: 138667584 op, 279004200.00 ns, 2.0120 ns/op
WorkloadResult 8: 138667584 op, 264306000.00 ns, 1.9060 ns/op
WorkloadResult 9: 138667584 op, 263432200.00 ns, 1.8997 ns/op
WorkloadResult 10: 138667584 op, 262462600.00 ns, 1.8927 ns/op
WorkloadResult 11: 138667584 op, 264592000.00 ns, 1.9081 ns/op
WorkloadResult 12: 138667584 op, 263249100.00 ns, 1.8984 ns/op
WorkloadResult 13: 138667584 op, 261990300.00 ns, 1.8893 ns/op
WorkloadResult 14: 138667584 op, 263225500.00 ns, 1.8982 ns/op
WorkloadResult 15: 138667584 op, 263428300.00 ns, 1.8997 ns/op
// GC: 0 0 0 400 138667584
// Threading: 0 0 138667584
// AfterAll
// Benchmark Process 4952 has exited with code 0.
Mean = 1.893 ns, StdErr = 0.011 ns (0.56%), N = 15, StdDev = 0.041 ns
Min = 1.827 ns, Q1 = 1.874 ns, Median = 1.898 ns, Q3 = 1.903 ns, Max = 2.012 ns
IQR = 0.029 ns, LowerFence = 1.830 ns, UpperFence = 1.947 ns
ConfidenceInterval = [1.849 ns; 1.937 ns] (CI 99.9%), Margin = 0.044 ns (2.33% of Mean)
Skewness = 1.16, Kurtosis = 5.16, MValue = 2
// ** Remained 1 (50.0%) benchmark(s) to run. Estimated finish 2023-04-25 17:09 (0h 0m from now) **
// **************************
// Benchmark: Perf_Vector3.ReflectBenchmark: Job-PJKOED(EvaluateOverhead=False, OutlierMode=DontRemove, PowerPlanMode=00000000-0000-0000-0000-000000000000, Toolchain=\diff-rel\corerun.exe, InvocationCount=138667584, IterationCount=15, IterationTime=250.0000 ms, MaxIterationCount=20, MinIterationCount=15, UnrollFactor=16, WarmupCount=1)
// *** Execute ***
// Launch: 1 / 1
// Execute: D:\bugs\r84264\14725438-373f-451f-9a74-85fec5cbba08\corerun.exe 422961f5-6ec4-4df3-9e27-2d07dac052f2.dll --anonymousPipes 2700 2696 --benchmarkName System.Numerics.Tests.Perf_Vector3.ReflectBenchmark --job "EvaluateOverhead=False, OutlierMode=DontRemove, PowerPlanMode=00000000-0000-0000-0000-000000000000, Toolchain=\diff-rel\corerun.exe, InvocationCount=138667584, IterationCount=15, IterationTime=250.0000 ms, MaxIterationCount=20, MinIterationCount=15, UnrollFactor=16, WarmupCount=1" --benchmarkId 0 in c:\repos\performance\artifacts\bin\MicroBenchmarks\Release\net6.0\422961f5-6ec4-4df3-9e27-2d07dac052f2\bin\Release\net6.0\publish
// BeforeAnythingElse
// Benchmark Process Environment Information:
// Runtime=.NET 8.0.0 (42.42.42.42424), X64 RyuJIT AVX2
// GC=Concurrent Workstation
// HardwareIntrinsics=AVX2,AES,BMI1,BMI2,FMA,LZCNT,PCLMUL,POPCNT VectorSize=256
// Job: Job-CBWSCR(EvaluateOverhead=False, OutlierMode=DontRemove, PowerPlanMode=00000000-0000-0000-0000-000000000000, InvocationCount=138667584, IterationCount=15, IterationTime=250.0000 ms, MaxIterationCount=20, MinIterationCount=15, UnrollFactor=16, WarmupCount=1)
OverheadJitting 1: 16 op, 723800.00 ns, 45.2375 us/op
WorkloadJitting 1: 16 op, 961300.00 ns, 60.0812 us/op
WorkloadWarmup 1: 138667584 op, 4346374300.00 ns, 31.3438 ns/op
// BeforeActualRun
WorkloadActual 1: 138667584 op, 5301226600.00 ns, 38.2297 ns/op
WorkloadActual 2: 138667584 op, 5142787000.00 ns, 37.0872 ns/op
WorkloadActual 3: 138667584 op, 5116062800.00 ns, 36.8944 ns/op
WorkloadActual 4: 138667584 op, 5088548600.00 ns, 36.6960 ns/op
WorkloadActual 5: 138667584 op, 5152811200.00 ns, 37.1595 ns/op
WorkloadActual 6: 138667584 op, 5155934100.00 ns, 37.1820 ns/op
WorkloadActual 7: 138667584 op, 5133969200.00 ns, 37.0236 ns/op
WorkloadActual 8: 138667584 op, 5126960900.00 ns, 36.9730 ns/op
WorkloadActual 9: 138667584 op, 5104601800.00 ns, 36.8118 ns/op
WorkloadActual 10: 138667584 op, 5196076000.00 ns, 37.4715 ns/op
WorkloadActual 11: 138667584 op, 5309531500.00 ns, 38.2896 ns/op
WorkloadActual 12: 138667584 op, 5332628500.00 ns, 38.4562 ns/op
WorkloadActual 13: 138667584 op, 5348738300.00 ns, 38.5724 ns/op
WorkloadActual 14: 138667584 op, 5244826300.00 ns, 37.8230 ns/op
WorkloadActual 15: 138667584 op, 5191477500.00 ns, 37.4383 ns/op
// AfterActualRun
WorkloadResult 1: 138667584 op, 5301226600.00 ns, 38.2297 ns/op
WorkloadResult 2: 138667584 op, 5142787000.00 ns, 37.0872 ns/op
WorkloadResult 3: 138667584 op, 5116062800.00 ns, 36.8944 ns/op
WorkloadResult 4: 138667584 op, 5088548600.00 ns, 36.6960 ns/op
WorkloadResult 5: 138667584 op, 5152811200.00 ns, 37.1595 ns/op
WorkloadResult 6: 138667584 op, 5155934100.00 ns, 37.1820 ns/op
WorkloadResult 7: 138667584 op, 5133969200.00 ns, 37.0236 ns/op
WorkloadResult 8: 138667584 op, 5126960900.00 ns, 36.9730 ns/op
WorkloadResult 9: 138667584 op, 5104601800.00 ns, 36.8118 ns/op
WorkloadResult 10: 138667584 op, 5196076000.00 ns, 37.4715 ns/op
WorkloadResult 11: 138667584 op, 5309531500.00 ns, 38.2896 ns/op
WorkloadResult 12: 138667584 op, 5332628500.00 ns, 38.4562 ns/op
WorkloadResult 13: 138667584 op, 5348738300.00 ns, 38.5724 ns/op
WorkloadResult 14: 138667584 op, 5244826300.00 ns, 37.8230 ns/op
WorkloadResult 15: 138667584 op, 5191477500.00 ns, 37.4383 ns/op
// GC: 0 0 0 400 138667584
// Threading: 0 0 138667584
// AfterAll
// Benchmark Process 38448 has exited with code 0.
Mean = 37.474 ns, StdErr = 0.165 ns (0.44%), N = 15, StdDev = 0.638 ns
Min = 36.696 ns, Q1 = 36.998 ns, Median = 37.182 ns, Q3 = 38.026 ns, Max = 38.572 ns
IQR = 1.028 ns, LowerFence = 35.456 ns, UpperFence = 39.569 ns
ConfidenceInterval = [36.792 ns; 38.156 ns] (CI 99.9%), Margin = 0.682 ns (1.82% of Mean)
Skewness = 0.51, Kurtosis = 1.6, MValue = 2
// ** Remained 0 (0.0%) benchmark(s) to run. Estimated finish 2023-04-25 17:10 (0h 0m from now) **
// ***** BenchmarkRunner: Finish *****
// * Export *
c:\repos\performance\artifacts\bin\MicroBenchmarks\Release\net6.0\BenchmarkDotNet.Artifacts\results\System.Numerics.Tests.Perf_Vector3-report-github.md
c:\repos\performance\artifacts\bin\MicroBenchmarks\Release\net6.0\BenchmarkDotNet.Artifacts\results\System.Numerics.Tests.Perf_Vector3-report-full.json
// * Detailed results *
Perf_Vector3.ReflectBenchmark: Job-VYWMKB(EvaluateOverhead=False, OutlierMode=DontRemove, PowerPlanMode=00000000-0000-0000-0000-000000000000, Toolchain=\base-rel\corerun.exe, InvocationCount=138667584, IterationCount=15, IterationTime=250.0000 ms, MaxIterationCount=20, MinIterationCount=15, UnrollFactor=16, WarmupCount=1)
Runtime = .NET 8.0.0 (42.42.42.42424), X64 RyuJIT AVX2; GC = Concurrent Workstation
Mean = 1.893 ns, StdErr = 0.011 ns (0.56%), N = 15, StdDev = 0.041 ns
Min = 1.827 ns, Q1 = 1.874 ns, Median = 1.898 ns, Q3 = 1.903 ns, Max = 2.012 ns
IQR = 0.029 ns, LowerFence = 1.830 ns, UpperFence = 1.947 ns
ConfidenceInterval = [1.849 ns; 1.937 ns] (CI 99.9%), Margin = 0.044 ns (2.33% of Mean)
Skewness = 1.16, Kurtosis = 5.16, MValue = 2
-------------------- Histogram --------------------
[1.821 ns ; 1.868 ns) | @@@
[1.868 ns ; 1.939 ns) | @@@@@@@@@@@
[1.939 ns ; 1.990 ns) |
[1.990 ns ; 2.034 ns) | @
---------------------------------------------------
Perf_Vector3.ReflectBenchmark: Job-PJKOED(EvaluateOverhead=False, OutlierMode=DontRemove, PowerPlanMode=00000000-0000-0000-0000-000000000000, Toolchain=\diff-rel\corerun.exe, InvocationCount=138667584, IterationCount=15, IterationTime=250.0000 ms, MaxIterationCount=20, MinIterationCount=15, UnrollFactor=16, WarmupCount=1)
Runtime = .NET 8.0.0 (42.42.42.42424), X64 RyuJIT AVX2; GC = Concurrent Workstation
Mean = 37.474 ns, StdErr = 0.165 ns (0.44%), N = 15, StdDev = 0.638 ns
Min = 36.696 ns, Q1 = 36.998 ns, Median = 37.182 ns, Q3 = 38.026 ns, Max = 38.572 ns
IQR = 1.028 ns, LowerFence = 35.456 ns, UpperFence = 39.569 ns
ConfidenceInterval = [36.792 ns; 38.156 ns] (CI 99.9%), Margin = 0.682 ns (1.82% of Mean)
Skewness = 0.51, Kurtosis = 1.6, MValue = 2
-------------------- Histogram --------------------
[36.356 ns ; 37.513 ns) | @@@@@@@@@@
[37.513 ns ; 38.785 ns) | @@@@@
---------------------------------------------------
// * Summary *
BenchmarkDotNet=v0.13.2.2052-nightly, OS=Windows 11 (10.0.22621.1555)
Intel Core i7-8700 CPU 3.20GHz (Coffee Lake), 1 CPU, 12 logical and 6 physical cores
.NET SDK=8.0.100-preview.2.23157.25
[Host] : .NET 6.0.16 (6.0.1623.17311), X64 RyuJIT AVX2
Job-VYWMKB : .NET 8.0.0 (42.42.42.42424), X64 RyuJIT AVX2
Job-PJKOED : .NET 8.0.0 (42.42.42.42424), X64 RyuJIT AVX2
EvaluateOverhead=False OutlierMode=DontRemove PowerPlanMode=00000000-0000-0000-0000-000000000000
InvocationCount=138667584 IterationCount=15 IterationTime=250.0000 ms
MaxIterationCount=20 MinIterationCount=15 UnrollFactor=16
WarmupCount=1
| Method | Job | Toolchain | Mean | Error | StdDev | Median | Min | Max | Ratio | RatioSD | Allocated | Alloc Ratio |
|----------------- |----------- |---------------------- |----------:|----------:|----------:|----------:|----------:|----------:|------:|--------:|----------:|------------:|
| ReflectBenchmark | Job-VYWMKB | \base-rel\corerun.exe | 1.893 ns | 0.0442 ns | 0.0413 ns | 1.898 ns | 1.827 ns | 2.012 ns | 1.00 | 0.00 | - | NA |
| ReflectBenchmark | Job-PJKOED | \diff-rel\corerun.exe | 37.474 ns | 0.6820 ns | 0.6380 ns | 37.182 ns | 36.696 ns | 38.572 ns | 19.80 | 0.54 | - | NA |
// * Hints *
Outliers
Perf_Vector3.ReflectBenchmark: EvaluateOverhead=False, OutlierMode=DontRemove, PowerPlanMode=00000000-0000-0000-0000-000000000000, Toolchain=\base-rel\corerun.exe, InvocationCount=138667584, IterationCount=15, IterationTime=250.0000 ms, MaxIterationCount=20, MinIterationCount=15, UnrollFactor=16, WarmupCount=1 -> 2 outliers were detected (1.83 ns, 2.01 ns)
// * Legends *
Mean : Arithmetic mean of all measurements
Error : Half of 99.9% confidence interval
StdDev : Standard deviation of all measurements
Median : Value separating the higher half of all measurements (50th percentile)
Min : Minimum
Max : Maximum
Ratio : Mean of the ratio distribution ([Current]/[Baseline])
RatioSD : Standard deviation of the ratio distribution ([Current]/[Baseline])
Allocated : Allocated memory per single operation (managed only, inclusive, 1KB = 1024B)
Alloc Ratio : Allocated memory ratio distribution ([Current]/[Baseline])
1 ns : 1 Nanosecond (0.000000001 sec)
// * Diagnostic Output - MemoryDiagnoser *
// * Diagnostic Output - EtwProfiler *
Exported 2 trace file(s). Example:
c:\repos\performance\artifacts\bin\MicroBenchmarks\Release\net6.0\BenchmarkDotNet.Artifacts\System.Numerics.Tests.Perf_Vector3.ReflectBenchmark-_base-rel_corerun.exe-20230425-170824.etl
// ***** BenchmarkRunner: End *****
Run time: 00:01:44 (104.86 sec), executed benchmarks: 2
Global total time: 00:02:00 (120.05 sec), executed benchmarks: 2
// * Artifacts cleanup *
Raw
Default ETW Analysis
C:\repos\instructionsretiredexplorer\src>dotnet run -- -process corerun "c:\repos\performance\artifacts\bin\MicroBenchmarks\Release\net6.0\BenchmarkDotNet.Artifacts\System.Numerics.Tests.Perf_Vector3.ReflectBenchmark-_base-rel_corerun.exe-20230425-170824.etl" -show-samples ReflectBenchmark
Will show samples for methods matching `ReflectBenchmark`
Mining ETL from c:\repos\performance\artifacts\bin\MicroBenchmarks\Release\net6.0\BenchmarkDotNet.Artifacts\System.Numerics.Tests.Perf_Vector3.ReflectBenchmark-_base-rel_corerun.exe-20230425-170824.etl for process corerun
PMC interval now 10000
Found process [4952] corerun: "D:\bugs\r84264\ccf84a4d-03c8-4637-976d-2064b450374a\corerun.exe" 7872e33c-aad6-412c-b8ca-6d8eea8b8d77.dll --anonymousPipes 2520 2668 --benchmarkName System.Numerics.Tests.Perf_Vector3.ReflectBenchmark --job "EvaluateOverhead=False, OutlierMode=DontRemove, PowerPlanMode=00000000-0000-0000-0000-000000000000, Toolchain=\base-rel\corerun.exe, InvocationCount=138667584, IterationCount=15, IterationTime=250.0000 ms, MaxIterationCount=20, MinIterationCount=15, UnrollFactor=16, WarmupCount=1" --benchmarkId 0
==> benchmark process is [4952]
eh? unknown module ID 140710356336640
eh? unknown module ID 140710356336640
eh? reloading method [System.Private.CoreLib]dynamicClass.InvokeStub_EventSourceAttribute.set_Name(class System.Object,class System.Object,int*)
eh? reloading method [System.Private.CoreLib]dynamicClass.InvokeStub_EventAttribute.set_Level(class System.Object,class System.Object,int*)
eh? reloading method [System.Private.CoreLib]dynamicClass.InvokeStub_EventAttribute.set_Task(class System.Object,class System.Object,int*)
eh? reloading method [System.Private.CoreLib]dynamicClass.InvokeStub_EventAttribute.set_Opcode(class System.Object,class System.Object,int*)
Can't map address 7FF9AF1C9518 -- 4940000 counts
Samples for corerun: 5050 events for Process
Jitting : 04.48% 2.26E+06 samples 1257 methods
JitInterface : 02.55% 1.29E+06 samples
Jit-generated code: 79.60% 4.02E+07 samples
Jitted code : 79.60% 4.02E+07 samples
MinOpts code : 00.00% 0 samples
FullOpts code : 00.00% 0 samples
Tier-0 code : 01.45% 7.3E+05 samples
Tier-1 code : 78.16% 3.95E+07 samples
R2R code : 00.00% 0 samples
09.82% 4.96E+06 ? Unknown
54.55% 2.755E+07 Tier-1 [MicroBenchmarks]Perf_Vector3.ReflectBenchmark()
23.60% 1.192E+07 Tier-1 [7872e33c-aad6-412c-b8ca-6d8eea8b8d77]Runnable_0.WorkloadActionUnroll(int64)
02.99% 1.51E+06 native coreclr.dll
01.92% 9.7E+05 native clrjit.dll
01.82% 9.2E+05 native CI.dll
01.45% 7.3E+05 Tier-0 [MicroBenchmarks]Perf_Vector3.ReflectBenchmark()
01.41% 7.1E+05 native ntoskrnl.exe
01.35% 6.8E+05 native System.Private.CoreLib.dll
00.55% 2.8E+05 native ntdll.dll
00.10% 5E+04 native icu.dll
00.06% 3E+04 native ucrtbase.dll
00.06% 3E+04 native FLTMGR.SYS
00.06% 3E+04 native nvlddmkm.sys
Raw samples for [MicroBenchmarks]Perf_Vector3.ReflectBenchmark() at 0x00007FF9AEE65F40 -- 0x00007FF9AEE65FDB (length 0x009B)
0x0000 : 9
0x0005 : 5
0x0008 : 8
0x000D : 1
0x0017 : 5
0x001B : 1
0x002D : 7
0x0037 : 4
0x004C : 7
0x0051 : 1
0x0073 : 10
0x0083 : 7
0x0087 : 3
0x0099 : 5
Raw samples for [MicroBenchmarks]Perf_Vector3.ReflectBenchmark() at 0x00007FF9AEE68BA0 -- 0x00007FF9AEE68BDC (length 0x003C)
0x0000 : 540
0x0003 : 549
0x000B : 2
0x0019 : 569
0x001D : 48
0x0025 : 489
0x0029 : 3
0x002D : 14
0x0031 : 46
0x0038 : 495
Raw
PGO ETW Analysis
C:\repos\instructionsretiredexplorer\src>dotnet run -- -process corerun "c:\repos\performance\artifacts\bin\MicroBenchmarks\Release\net6.0\BenchmarkDotNet.Artifacts\System.Numerics.Tests.Perf_Vector3.ReflectBenchmark-_diff-rel_corerun.exe-20230425-170824.etl" -show-samples ReflectBenchmark
Will show samples for methods matching `ReflectBenchmark`
Mining ETL from c:\repos\performance\artifacts\bin\MicroBenchmarks\Release\net6.0\BenchmarkDotNet.Artifacts\System.Numerics.Tests.Perf_Vector3.ReflectBenchmark-_diff-rel_corerun.exe-20230425-170824.etl for process corerun
PMC interval now 10000
Found process [38448] corerun: "D:\bugs\r84264\14725438-373f-451f-9a74-85fec5cbba08\corerun.exe" 422961f5-6ec4-4df3-9e27-2d07dac052f2.dll --anonymousPipes 2700 2696 --benchmarkName System.Numerics.Tests.Perf_Vector3.ReflectBenchmark --job "EvaluateOverhead=False, OutlierMode=DontRemove, PowerPlanMode=00000000-0000-0000-0000-000000000000, Toolchain=\diff-rel\corerun.exe, InvocationCount=138667584, IterationCount=15, IterationTime=250.0000 ms, MaxIterationCount=20, MinIterationCount=15, UnrollFactor=16, WarmupCount=1" --benchmarkId 0
==> benchmark process is [38448]
eh? unknown module ID 140710356336640
eh? unknown module ID 140710356336640
eh? reloading method [System.Private.CoreLib]dynamicClass.InvokeStub_EventSourceAttribute.set_Name(class System.Object,class System.Object,int*)
eh? reloading method [System.Private.CoreLib]dynamicClass.InvokeStub_EventAttribute.set_Level(class System.Object,class System.Object,int*)
eh? reloading method [System.Private.CoreLib]dynamicClass.InvokeStub_EventAttribute.set_Task(class System.Object,class System.Object,int*)
eh? reloading method [System.Private.CoreLib]dynamicClass.InvokeStub_EventAttribute.set_Opcode(class System.Object,class System.Object,int*)
Samples for corerun: 87928 events for Process
Jitting : 00.30% 2.61E+06 samples 1300 methods
JitInterface : 00.18% 1.59E+06 samples
Jit-generated code: 99.15% 8.72E+08 samples
Jitted code : 99.15% 8.72E+08 samples
MinOpts code : 00.00% 0 samples
FullOpts code : 00.00% 0 samples
Tier-0 code : 00.07% 6.4E+05 samples
Tier-1 code : 99.08% 8.71E+08 samples
R2R code : 00.00% 0 samples
95.88% 8.43E+08 Tier-1 [MicroBenchmarks]Perf_Vector3.ReflectBenchmark()
03.20% 2.815E+07 Tier-1 [422961f5-6ec4-4df3-9e27-2d07dac052f2]Runnable_0.WorkloadActionUnroll(int64)
00.20% 1.77E+06 native ntoskrnl.exe
00.16% 1.44E+06 native coreclr.dll
00.12% 1.02E+06 native clrjit.dll
00.11% 9.4E+05 native CI.dll
00.08% 6.8E+05 native System.Private.CoreLib.dll
00.07% 6.4E+05 Tier-0 [MicroBenchmarks]Perf_Vector3.ReflectBenchmark()
Raw samples for [MicroBenchmarks]Perf_Vector3.ReflectBenchmark() at 0x00007FF9AEE69660 -- 0x00007FF9AEE696FB (length 0x009B)
0x0000 : 7
0x0005 : 4
0x0008 : 5
0x0017 : 7
0x0023 : 1
0x002D : 7
0x0037 : 7
0x0041 : 1
0x004C : 8
0x0051 : 1
0x0073 : 5
0x007A : 1
0x0083 : 4
0x0087 : 1
0x0099 : 5
Raw samples for [MicroBenchmarks]Perf_Vector3.ReflectBenchmark() at 0x00007FF9AEE6C630 -- 0x00007FF9AEE6C66C (length 0x003C)
0x0000 : 605
0x0003 : 541
0x000B : 6
0x0013 : 3
0x0019 : 3186
0x001D : 68387
0x0025 : 5636
0x0029 : 2650
0x002D : 2158
0x0031 : 566
0x0038 : 562
0x003B : 1
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment