Skip to content

Instantly share code, notes, and snippets.

@davidbarsky

davidbarsky/Criterion.txt

Created November 16, 2019 00:58
Show Gist options
  • Save davidbarsky/3620247e6cf74e77e1d5d4c24014c6d1 to your computer and use it in GitHub Desktop.
Save davidbarsky/3620247e6cf74e77e1d5d4c24014c6d1 to your computer and use it in GitHub Desktop.
Download ZIP
Performance Impact of Downcasting to Registry on Close
Raw
Criterion.txt
Running /Users/dbarsky/Developer/Rust/tracing/target/release/deps/filter-1f05138b0829f7a9
static/baseline_single_threaded
time: [109.35 ns 110.75 ns 112.28 ns]
change: [-19.618% -12.070% -3.7712%] (p = 0.01 < 0.05)
Performance has improved.
Found 4 outliers among 100 measurements (4.00%)
2 (2.00%) high mild
2 (2.00%) high severe
static/single_threaded time: [59.616 ns 60.292 ns 61.067 ns]
change: [-43.963% -36.500% -27.781%] (p = 0.00 < 0.05)
Performance has improved.
Found 11 outliers among 100 measurements (11.00%)
4 (4.00%) low mild
3 (3.00%) high mild
4 (4.00%) high severe
static/baseline_multithreaded
time: [32.599 us 33.538 us 34.554 us]
change: [+8.5403% +25.485% +40.905%] (p = 0.00 < 0.05)
Performance has regressed.
Found 5 outliers among 100 measurements (5.00%)
3 (3.00%) high mild
2 (2.00%) high severe
static/multithreaded time: [30.814 us 33.107 us 35.942 us]
change: [-16.757% -0.5120% +18.696%] (p = 0.96 > 0.05)
No change in performance detected.
Found 8 outliers among 100 measurements (8.00%)
1 (1.00%) low mild
5 (5.00%) high mild
2 (2.00%) high severe
dynamic/baseline_single_threaded
time: [199.44 ns 203.15 ns 207.88 ns]
change: [-40.510% -29.863% -19.878%] (p = 0.00 < 0.05)
Performance has improved.
Found 5 outliers among 100 measurements (5.00%)
5 (5.00%) high mild
dynamic/single_threaded time: [903.70 ns 910.38 ns 917.80 ns]
change: [-19.537% -10.594% -1.6894%] (p = 0.04 < 0.05)
Performance has improved.
Found 6 outliers among 100 measurements (6.00%)
1 (1.00%) high mild
5 (5.00%) high severe
dynamic/baseline_multithreaded
time: [33.008 us 34.519 us 36.735 us]
change: [+19.545% +32.061% +49.006%] (p = 0.00 < 0.05)
Performance has regressed.
Found 14 outliers among 100 measurements (14.00%)
4 (4.00%) low mild
5 (5.00%) high mild
5 (5.00%) high severe
dynamic/multithreaded time: [36.710 us 38.320 us 39.806 us]
change: [-42.858% -19.360% +3.2987%] (p = 0.37 > 0.05)
No change in performance detected.
Found 1 outliers among 100 measurements (1.00%)
1 (1.00%) high mild
Running /Users/dbarsky/Developer/Rust/tracing/target/release/deps/fmt-a5db8e258b530cad
new_span/single_thread/1
time: [1.0932 us 1.1077 us 1.1207 us]
thrpt: [892.30 Kelem/s 902.81 Kelem/s 914.72 Kelem/s]
change:
time: [-18.285% -13.284% -8.7764%] (p = 0.00 < 0.05)
thrpt: [+9.6207% +15.319% +22.376%]
Performance has improved.
Benchmarking new_span/multithreaded/1: Warming up for 3.0000 s
Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 19.0s or reduce sample count to 30
new_span/multithreaded/1
time: [88.523 us 90.641 us 92.836 us]
thrpt: [10.772 Kelem/s 11.033 Kelem/s 11.297 Kelem/s]
change:
time: [-27.530% -21.528% -15.243%] (p = 0.00 < 0.05)
thrpt: [+17.984% +27.434% +37.988%]
Performance has improved.
Found 4 outliers among 100 measurements (4.00%)
1 (1.00%) low severe
3 (3.00%) high mild
new_span/single_thread/10
time: [9.4948 us 9.5488 us 9.6086 us]
thrpt: [1.0407 Melem/s 1.0472 Melem/s 1.0532 Melem/s]
change:
time: [-31.600% -24.171% -16.790%] (p = 0.00 < 0.05)
thrpt: [+20.178% +31.875% +46.198%]
Performance has improved.
Found 7 outliers among 100 measurements (7.00%)
5 (5.00%) high mild
2 (2.00%) high severe
Benchmarking new_span/multithreaded/10: Warming up for 3.0000 s
Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 15.7s or reduce sample count to 30
new_span/multithreaded/10
time: [98.857 us 100.81 us 102.77 us]
thrpt: [97.303 Kelem/s 99.198 Kelem/s 101.16 Kelem/s]
change:
time: [-10.656% -7.5213% -4.6000%] (p = 0.00 < 0.05)
thrpt: [+4.8218% +8.1330% +11.926%]
Performance has improved.
Found 3 outliers among 100 measurements (3.00%)
2 (2.00%) low mild
1 (1.00%) high mild
new_span/single_thread/50
time: [45.920 us 46.244 us 46.534 us]
thrpt: [1.0745 Melem/s 1.0812 Melem/s 1.0888 Melem/s]
change:
time: [-19.280% -16.465% -12.137%] (p = 0.00 < 0.05)
thrpt: [+13.814% +19.710% +23.884%]
Performance has improved.
Found 1 outliers among 100 measurements (1.00%)
1 (1.00%) high severe
Benchmarking new_span/multithreaded/50: Warming up for 3.0000 s
Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 16.3s or reduce sample count to 30
new_span/multithreaded/50
time: [154.46 us 160.45 us 166.71 us]
thrpt: [299.92 Kelem/s 311.62 Kelem/s 323.70 Kelem/s]
change:
time: [-18.292% -13.906% -9.4148%] (p = 0.00 < 0.05)
thrpt: [+10.393% +16.153% +22.387%]
Performance has improved.
Found 9 outliers among 100 measurements (9.00%)
2 (2.00%) low mild
5 (5.00%) high mild
2 (2.00%) high severe
event/root/single_threaded/1
time: [2.2384 us 2.2891 us 2.3511 us]
thrpt: [425.33 Kelem/s 436.85 Kelem/s 446.75 Kelem/s]
change:
time: [-30.496% -21.696% -12.896%] (p = 0.00 < 0.05)
thrpt: [+14.805% +27.708% +43.876%]
Performance has improved.
Found 12 outliers among 100 measurements (12.00%)
6 (6.00%) high mild
6 (6.00%) high severe
Benchmarking event/root/multithreaded/1: Warming up for 3.0000 s
Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 22.9s or reduce sample count to 30
event/root/multithreaded/1
time: [89.388 us 91.740 us 94.318 us]
thrpt: [10.602 Kelem/s 10.900 Kelem/s 11.187 Kelem/s]
change:
time: [-28.754% -19.347% -9.5959%] (p = 0.00 < 0.05)
thrpt: [+10.614% +23.989% +40.359%]
Performance has improved.
Found 8 outliers among 100 measurements (8.00%)
1 (1.00%) low severe
1 (1.00%) low mild
5 (5.00%) high mild
1 (1.00%) high severe
event/unique_parent/single_threaded/1
time: [2.9510 us 2.9761 us 3.0058 us]
thrpt: [332.69 Kelem/s 336.01 Kelem/s 338.87 Kelem/s]
change:
time: [-70.454% -63.761% -54.948%] (p = 0.00 < 0.05)
thrpt: [+121.96% +175.95% +238.45%]
Performance has improved.
Found 8 outliers among 100 measurements (8.00%)
5 (5.00%) high mild
3 (3.00%) high severe
Benchmarking event/unique_parent/multithreaded/1: Warming up for 3.0000 s
Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 17.6s or reduce sample count to 30
event/unique_parent/multithreaded/1
time: [57.757 us 60.496 us 63.539 us]
thrpt: [15.738 Kelem/s 16.530 Kelem/s 17.314 Kelem/s]
change:
time: [-39.265% -27.263% -12.824%] (p = 0.00 < 0.05)
thrpt: [+14.710% +37.481% +64.649%]
Performance has improved.
Found 8 outliers among 100 measurements (8.00%)
5 (5.00%) high mild
3 (3.00%) high severe
Benchmarking event/shared_parent/multithreaded/1: Warming up for 3.0000 s
Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 15.9s or reduce sample count to 30
event/shared_parent/multithreaded/1
time: [55.931 us 59.666 us 63.721 us]
thrpt: [15.694 Kelem/s 16.760 Kelem/s 17.879 Kelem/s]
change:
time: [+2.5672% +9.5324% +17.153%] (p = 0.01 < 0.05)
thrpt: [-14.642% -8.7028% -2.5029%]
Performance has regressed.
Found 8 outliers among 100 measurements (8.00%)
4 (4.00%) high mild
4 (4.00%) high severe
event/root/single_threaded/10
time: [21.787 us 21.928 us 22.105 us]
thrpt: [452.38 Kelem/s 456.03 Kelem/s 458.98 Kelem/s]
change:
time: [-3.0901% -0.8453% +2.7435%] (p = 0.63 > 0.05)
thrpt: [-2.6702% +0.8525% +3.1886%]
No change in performance detected.
Found 13 outliers among 100 measurements (13.00%)
10 (10.00%) high mild
3 (3.00%) high severe
Benchmarking event/root/multithreaded/10: Warming up for 3.0000 s
Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 15.7s or reduce sample count to 30
event/root/multithreaded/10
time: [129.96 us 132.06 us 134.22 us]
thrpt: [74.503 Kelem/s 75.723 Kelem/s 76.948 Kelem/s]
change:
time: [-18.958% -14.550% -10.165%] (p = 0.00 < 0.05)
thrpt: [+11.315% +17.028% +23.393%]
Performance has improved.
Found 7 outliers among 100 measurements (7.00%)
1 (1.00%) low mild
2 (2.00%) high mild
4 (4.00%) high severe
event/unique_parent/single_threaded/10
time: [31.300 us 32.415 us 33.708 us]
thrpt: [296.66 Kelem/s 308.50 Kelem/s 319.49 Kelem/s]
change:
time: [-6.5445% -3.3174% +1.4043%] (p = 0.10 > 0.05)
thrpt: [-1.3849% +3.4312% +7.0028%]
No change in performance detected.
Found 16 outliers among 100 measurements (16.00%)
14 (14.00%) high mild
2 (2.00%) high severe
Benchmarking event/unique_parent/multithreaded/10: Warming up for 3.0000 s
Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 16.5s or reduce sample count to 30
event/unique_parent/multithreaded/10
time: [89.407 us 91.678 us 93.656 us]
thrpt: [106.77 Kelem/s 109.08 Kelem/s 111.85 Kelem/s]
change:
time: [-24.797% -21.101% -16.691%] (p = 0.00 < 0.05)
thrpt: [+20.035% +26.745% +32.973%]
Performance has improved.
Found 16 outliers among 100 measurements (16.00%)
7 (7.00%) low severe
4 (4.00%) low mild
1 (1.00%) high mild
4 (4.00%) high severe
Benchmarking event/shared_parent/multithreaded/10: Warming up for 3.0000 s
Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 16.7s or reduce sample count to 30
event/shared_parent/multithreaded/10
time: [87.170 us 90.526 us 93.689 us]
thrpt: [106.74 Kelem/s 110.47 Kelem/s 114.72 Kelem/s]
change:
time: [-18.429% -13.395% -8.0172%] (p = 0.00 < 0.05)
thrpt: [+8.7160% +15.466% +22.593%]
Performance has improved.
Found 3 outliers among 100 measurements (3.00%)
1 (1.00%) high mild
2 (2.00%) high severe
event/root/single_threaded/50
time: [108.60 us 109.10 us 109.66 us]
thrpt: [455.94 Kelem/s 458.29 Kelem/s 460.43 Kelem/s]
change:
time: [-15.466% -12.997% -10.281%] (p = 0.00 < 0.05)
thrpt: [+11.460% +14.938% +18.296%]
Performance has improved.
Found 6 outliers among 100 measurements (6.00%)
1 (1.00%) high mild
5 (5.00%) high severe
Benchmarking event/root/multithreaded/50: Warming up for 3.0000 s
Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 18.0s or reduce sample count to 30
event/root/multithreaded/50
time: [296.95 us 306.64 us 316.20 us]
thrpt: [158.13 Kelem/s 163.06 Kelem/s 168.38 Kelem/s]
change:
time: [-10.209% -4.6740% +1.3867%] (p = 0.13 > 0.05)
thrpt: [-1.3677% +4.9032% +11.370%]
No change in performance detected.
Found 7 outliers among 100 measurements (7.00%)
2 (2.00%) low mild
3 (3.00%) high mild
2 (2.00%) high severe
event/unique_parent/single_threaded/50
time: [145.63 us 146.19 us 146.81 us]
thrpt: [340.57 Kelem/s 342.02 Kelem/s 343.35 Kelem/s]
change:
time: [-18.116% -16.446% -14.624%] (p = 0.00 < 0.05)
thrpt: [+17.130% +19.683% +22.125%]
Performance has improved.
Found 6 outliers among 100 measurements (6.00%)
4 (4.00%) high mild
2 (2.00%) high severe
Benchmarking event/unique_parent/multithreaded/50: Warming up for 3.0000 s
Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 17.7s or reduce sample count to 30
event/unique_parent/multithreaded/50
time: [181.99 us 203.62 us 225.53 us]
thrpt: [221.70 Kelem/s 245.55 Kelem/s 274.73 Kelem/s]
change:
time: [-21.661% -5.4689% +15.213%] (p = 0.58 > 0.05)
thrpt: [-13.205% +5.7853% +27.651%]
No change in performance detected.
Found 1 outliers among 100 measurements (1.00%)
1 (1.00%) high mild
Benchmarking event/shared_parent/multithreaded/50: Warming up for 3.0000 s
Warning: Unable to complete 100 samples in 5.0s. You may wish to increase target time to 18.7s or reduce sample count to 30
event/shared_parent/multithreaded/50
time: [199.62 us 222.53 us 245.17 us]
thrpt: [203.94 Kelem/s 224.69 Kelem/s 250.48 Kelem/s]
change:
time: [-21.679% +3.3846% +35.511%] (p = 0.84 > 0.05)
thrpt: [-26.205% -3.2738% +27.679%]
No change in performance detected.
tracing/tracing-subscriber on  david/downcast_ref-registry [$?] is 📦 v0.1.5 via v1.39.0 took 9m30s
❯
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment