Skip to content

Instantly share code, notes, and snippets.

@zesterer

zesterer/flume-benchmarks.txt

Created March 21, 2020 17:19
Show Gist options
  • Save zesterer/f1f4419b969a2f056f3d75bedcf82866 to your computer and use it in GitHub Desktop.
Save zesterer/f1f4419b969a2f056f3d75bedcf82866 to your computer and use it in GitHub Desktop.
Download ZIP
Raw
flume-benchmarks.txt
Arch Linux, 4 cores, 8 threads, AMD Ryzen 7
===========================================
create-flume time: [133.58 ns 133.99 ns 134.43 ns]
change: [-2.8490% -2.1632% -1.5710%] (p = 0.00 < 0.05)
Performance has improved.
create-crossbeam time: [189.86 ns 190.24 ns 190.67 ns]
change: [+1.3594% +1.8473% +2.3118%] (p = 0.00 < 0.05)
Performance has regressed.
Found 6 outliers among 100 measurements (6.00%)
3 (3.00%) high mild
3 (3.00%) high severe
create-std time: [43.570 ns 43.623 ns 43.685 ns]
change: [-10.524% -9.6196% -8.6932%] (p = 0.00 < 0.05)
Performance has improved.
Found 10 outliers among 100 measurements (10.00%)
6 (6.00%) high mild
4 (4.00%) high severe
oneshot-flume time: [159.31 ns 159.52 ns 159.72 ns]
change: [-1.9619% -1.6585% -1.3579%] (p = 0.00 < 0.05)
Performance has improved.
Found 7 outliers among 100 measurements (7.00%)
1 (1.00%) low mild
3 (3.00%) high mild
3 (3.00%) high severe
oneshot-crossbeam time: [234.83 ns 234.95 ns 235.09 ns]
change: [-1.0240% -0.4751% +0.0108%] (p = 0.07 > 0.05)
No change in performance detected.
Found 9 outliers among 100 measurements (9.00%)
3 (3.00%) high mild
6 (6.00%) high severe
oneshot-std time: [59.054 ns 59.084 ns 59.117 ns]
change: [-2.9545% -2.6300% -2.3301%] (p = 0.00 < 0.05)
Performance has improved.
Found 6 outliers among 100 measurements (6.00%)
3 (3.00%) high mild
3 (3.00%) high severe
inout-flume time: [27.308 ns 27.347 ns 27.384 ns]
change: [-2.7962% -2.5600% -2.3130%] (p = 0.00 < 0.05)
Performance has improved.
Found 4 outliers among 100 measurements (4.00%)
2 (2.00%) low mild
2 (2.00%) high mild
inout-crossbeam time: [51.115 ns 51.136 ns 51.159 ns]
change: [-1.1920% -0.6961% -0.3642%] (p = 0.00 < 0.05)
Change within noise threshold.
Found 5 outliers among 100 measurements (5.00%)
3 (3.00%) high mild
2 (2.00%) high severe
inout-std time: [37.825 ns 37.897 ns 37.989 ns]
change: [-3.6222% -3.1486% -2.6825%] (p = 0.00 < 0.05)
Performance has improved.
Found 12 outliers among 100 measurements (12.00%)
6 (6.00%) high mild
6 (6.00%) high severe
hydra-32t-1m-flume time: [80.169 us 80.500 us 80.847 us]
change: [-7.9356% -6.2221% -4.5228%] (p = 0.00 < 0.05)
Performance has improved.
Found 9 outliers among 100 measurements (9.00%)
3 (3.00%) high mild
6 (6.00%) high severe
hydra-32t-1m-crossbeam time: [319.64 us 333.83 us 349.48 us]
change: [-2.9307% +15.467% +36.434%] (p = 0.13 > 0.05)
No change in performance detected.
Found 9 outliers among 100 measurements (9.00%)
2 (2.00%) high mild
7 (7.00%) high severe
hydra-32t-1m-std time: [85.483 us 85.804 us 86.138 us]
change: [-9.2860% -7.6250% -5.9473%] (p = 0.00 < 0.05)
Performance has improved.
Found 4 outliers among 100 measurements (4.00%)
1 (1.00%) high mild
3 (3.00%) high severe
hydra-32t-1000m-flume time: [1.6869 ms 1.7030 ms 1.7185 ms]
change: [-3.4783% -0.3870% +1.7532%] (p = 0.83 > 0.05)
No change in performance detected.
Found 1 outliers among 100 measurements (1.00%)
1 (1.00%) high severe
hydra-32t-1000m-crossbeam
time: [3.7028 ms 3.7592 ms 3.8236 ms]
change: [-5.3485% -0.1672% +5.2059%] (p = 0.95 > 0.05)
No change in performance detected.
Found 8 outliers among 100 measurements (8.00%)
6 (6.00%) high mild
2 (2.00%) high severe
hydra-32t-1000m-std time: [3.1381 ms 3.1716 ms 3.2049 ms]
change: [-20.627% -17.183% -13.337%] (p = 0.00 < 0.05)
Performance has improved.
Found 2 outliers among 100 measurements (2.00%)
1 (1.00%) high mild
1 (1.00%) high severe
hydra-256t-1m-flume time: [805.63 us 820.07 us 833.71 us]
change: [-10.414% -8.3106% -6.2808%] (p = 0.00 < 0.05)
Performance has improved.
Found 1 outliers among 100 measurements (1.00%)
1 (1.00%) low mild
hydra-256t-1m-crossbeam time: [2.9733 ms 3.1097 ms 3.2665 ms]
change: [-17.024% -3.6416% +13.262%] (p = 0.67 > 0.05)
No change in performance detected.
Found 6 outliers among 100 measurements (6.00%)
5 (5.00%) high mild
1 (1.00%) high severe
hydra-256t-1m-std time: [734.01 us 738.54 us 743.18 us]
change: [-13.335% -11.867% -10.246%] (p = 0.00 < 0.05)
Performance has improved.
Found 10 outliers among 100 measurements (10.00%)
1 (1.00%) low mild
7 (7.00%) high mild
2 (2.00%) high severe
hydra-1t-1000m-flume time: [30.377 us 32.015 us 33.837 us]
change: [-65.751% -61.771% -57.510%] (p = 0.00 < 0.05)
Performance has improved.
Found 13 outliers among 100 measurements (13.00%)
9 (9.00%) high mild
4 (4.00%) high severe
hydra-1t-1000m-crossbeam
time: [55.437 us 57.895 us 60.432 us]
change: [-26.133% -18.953% -10.418%] (p = 0.00 < 0.05)
Performance has improved.
Found 10 outliers among 100 measurements (10.00%)
3 (3.00%) high mild
7 (7.00%) high severe
hydra-1t-1000m-std time: [167.20 us 171.97 us 177.22 us]
change: [-9.1933% -3.6674% +2.2349%] (p = 0.24 > 0.05)
No change in performance detected.
hydra-4t-10000m-flume time: [3.2868 ms 3.4051 ms 3.5243 ms]
change: [-26.067% -22.160% -18.083%] (p = 0.00 < 0.05)
Performance has improved.
Found 1 outliers among 100 measurements (1.00%)
1 (1.00%) high mild
hydra-4t-10000m-crossbeam
time: [3.5902 ms 3.7245 ms 3.8705 ms]
change: [+26.946% +32.072% +37.270%] (p = 0.00 < 0.05)
Performance has regressed.
hydra-4t-10000m-std time: [4.7448 ms 4.8228 ms 4.9011 ms]
change: [-10.146% -7.2030% -4.1096%] (p = 0.00 < 0.05)
Performance has improved.
Found 5 outliers among 100 measurements (5.00%)
2 (2.00%) high mild
3 (3.00%) high severe
robin-u-32t-1m-flume time: [282.76 us 286.02 us 289.56 us]
change: [-3.1427% -1.8716% -0.6136%] (p = 0.00 < 0.05)
Change within noise threshold.
Found 4 outliers among 100 measurements (4.00%)
3 (3.00%) high mild
1 (1.00%) high severe
robin-u-32t-1m-crossbeam
time: [290.07 us 293.83 us 297.64 us]
change: [-15.595% -10.741% -7.1286%] (p = 0.00 < 0.05)
Performance has improved.
Found 2 outliers among 100 measurements (2.00%)
2 (2.00%) high severe
robin-u-32t-1m-std time: [301.59 us 304.49 us 307.28 us]
change: [+0.2777% +1.8095% +3.2553%] (p = 0.02 < 0.05)
Change within noise threshold.
Found 3 outliers among 100 measurements (3.00%)
3 (3.00%) high mild
robin-u-4t-1000m-flume time: [155.14 us 162.28 us 169.62 us]
change: [-27.507% -22.428% -17.532%] (p = 0.00 < 0.05)
Performance has improved.
Found 7 outliers among 100 measurements (7.00%)
4 (4.00%) high mild
3 (3.00%) high severe
robin-u-4t-1000m-crossbeam
time: [176.16 us 182.57 us 189.02 us]
change: [-32.489% -17.680% +0.1802%] (p = 0.08 > 0.05)
No change in performance detected.
Found 4 outliers among 100 measurements (4.00%)
4 (4.00%) low mild
robin-u-4t-1000m-std time: [202.55 us 209.45 us 216.48 us]
change: [-3.2601% +0.8853% +4.9297%] (p = 0.68 > 0.05)
No change in performance detected.
robin-b-32t-16m-flume time: [911.85 us 915.34 us 919.17 us]
change: [-41.873% -37.735% -33.498%] (p = 0.00 < 0.05)
Performance has improved.
Found 10 outliers among 100 measurements (10.00%)
4 (4.00%) high mild
6 (6.00%) high severe
robin-b-32t-16m-crossbeam
time: [3.0555 ms 3.2059 ms 3.3669 ms]
change: [-14.808% -6.4679% +3.0848%] (p = 0.19 > 0.05)
No change in performance detected.
Found 5 outliers among 100 measurements (5.00%)
5 (5.00%) high mild
robin-b-32t-16m-std time: [915.91 us 917.92 us 920.14 us]
change: [-49.316% -44.540% -39.271%] (p = 0.00 < 0.05)
Performance has improved.
Found 7 outliers among 100 measurements (7.00%)
4 (4.00%) high mild
3 (3.00%) high severe
robin-b-4t-1000m-flume time: [18.694 ms 18.863 ms 19.040 ms]
change: [-9.3961% -7.4700% -5.4414%] (p = 0.00 < 0.05)
Performance has improved.
Found 2 outliers among 100 measurements (2.00%)
1 (1.00%) high mild
1 (1.00%) high severe
robin-b-4t-1000m-crossbeam
time: [617.73 us 638.63 us 660.91 us]
change: [-55.628% -49.529% -42.416%] (p = 0.00 < 0.05)
Performance has improved.
Found 4 outliers among 100 measurements (4.00%)
3 (3.00%) high mild
1 (1.00%) high severe
robin-b-4t-1000m-std time: [20.468 ms 20.651 ms 20.833 ms]
change: [-8.4178% -6.4608% -4.3895%] (p = 0.00 < 0.05)
Performance has improved.
Found 5 outliers among 100 measurements (5.00%)
3 (3.00%) low mild
2 (2.00%) high mild
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment