Skip to content

Instantly share code, notes, and snippets.

@patrickt

patrickt/fused-effects-1.1-benchmarks

Created August 2, 2020 18:30
Show Gist options
  • Save patrickt/7beb3f075b04d3fc15f39b238666bc41 to your computer and use it in GitHub Desktop.
Save patrickt/7beb3f075b04d3fc15f39b238666bc41 to your computer and use it in GitHub Desktop.
Download ZIP
Raw
fused-effects-1.1-benchmarks
benchmarked Error/Either
time 24.22 μs (22.36 μs .. 26.34 μs)
0.983 R² (0.970 R² .. 0.998 R²)
mean 22.90 μs (22.65 μs .. 23.36 μs)
std dev 1.045 μs (590.7 ns .. 1.930 μs)
variance introduced by outliers: 24% (moderately inflated)
benchmarked Error/Identity/Church.ErrorC
time 9.092 ms (8.772 ms .. 9.300 ms)
0.995 R² (0.990 R² .. 0.998 R²)
mean 9.440 ms (9.299 ms .. 9.710 ms)
std dev 544.2 μs (328.7 μs .. 838.4 μs)
variance introduced by outliers: 26% (moderately inflated)
benchmarked Error/Identity/Either.ErrorC
time 46.78 μs (45.70 μs .. 49.14 μs)
0.983 R² (0.970 R² .. 0.992 R²)
mean 50.03 μs (48.64 μs .. 51.35 μs)
std dev 4.269 μs (3.498 μs .. 4.623 μs)
variance introduced by outliers: 56% (severely inflated)
benchmarked Error/Identity/ExceptT
time 22.80 μs (22.46 μs .. 23.08 μs)
0.999 R² (0.998 R² .. 0.999 R²)
mean 22.88 μs (22.77 μs .. 23.01 μs)
std dev 405.5 ns (320.2 ns .. 509.1 ns)
benchmarked Error/IO/Church.ErrorC
time 9.008 ms (8.935 ms .. 9.110 ms)
0.999 R² (0.999 R² .. 1.000 R²)
mean 8.812 ms (8.762 ms .. 8.853 ms)
std dev 130.7 μs (112.9 μs .. 158.2 μs)
benchmarked Error/IO/Either.ErrorC
time 24.44 μs (24.00 μs .. 25.07 μs)
0.995 R² (0.990 R² .. 0.998 R²)
mean 23.98 μs (23.61 μs .. 24.26 μs)
std dev 1.117 μs (752.2 ns .. 1.582 μs)
variance introduced by outliers: 27% (moderately inflated)
benchmarked Error/IO/ExceptT
time 23.20 μs (22.98 μs .. 23.60 μs)
0.999 R² (0.998 R² .. 0.999 R²)
mean 24.11 μs (23.90 μs .. 24.30 μs)
std dev 679.8 ns (583.9 ns .. 796.8 ns)
variance introduced by outliers: 13% (moderately inflated)
benchmarked Interpret/Identity/InterpretC
time 55.81 μs (54.91 μs .. 57.07 μs)
0.998 R² (0.997 R² .. 0.999 R²)
mean 53.86 μs (53.54 μs .. 54.36 μs)
std dev 1.418 μs (1.164 μs .. 1.827 μs)
variance introduced by outliers: 11% (moderately inflated)
benchmarked Interpret/Identity/InterpretStateC
time 55.82 μs (54.86 μs .. 57.00 μs)
0.998 R² (0.997 R² .. 0.999 R²)
mean 55.82 μs (55.37 μs .. 56.24 μs)
std dev 1.424 μs (1.237 μs .. 1.643 μs)
benchmarked Interpret/Identity/StateC
time 57.80 μs (55.69 μs .. 60.43 μs)
0.993 R² (0.987 R² .. 0.999 R²)
mean 55.91 μs (55.45 μs .. 56.90 μs)
std dev 1.948 μs (1.325 μs .. 3.186 μs)
variance introduced by outliers: 16% (moderately inflated)
benchmarked Interpret/IO/InterpretC
time 73.51 μs (71.85 μs .. 75.38 μs)
0.996 R² (0.994 R² .. 0.998 R²)
mean 71.26 μs (70.43 μs .. 72.00 μs)
std dev 2.276 μs (1.652 μs .. 2.875 μs)
variance introduced by outliers: 14% (moderately inflated)
benchmarked Interpret/IO/InterpretStateC
time 74.05 μs (72.55 μs .. 76.83 μs)
0.992 R² (0.981 R² .. 0.999 R²)
mean 74.39 μs (73.39 μs .. 75.77 μs)
std dev 4.078 μs (1.696 μs .. 5.868 μs)
variance introduced by outliers: 33% (moderately inflated)
benchmarked Interpret/IO/StateC
time 72.67 μs (70.44 μs .. 76.62 μs)
0.992 R² (0.986 R² .. 0.998 R²)
mean 73.13 μs (72.41 μs .. 74.02 μs)
std dev 3.030 μs (2.253 μs .. 3.840 μs)
variance introduced by outliers: 22% (moderately inflated)
benchmarked NonDet/N-queens problem/NonDet.Church/4
time 13.89 μs (13.63 μs .. 14.16 μs)
0.996 R² (0.989 R² .. 0.999 R²)
mean 13.77 μs (13.65 μs .. 13.91 μs)
std dev 504.9 ns (378.7 ns .. 738.7 ns)
variance introduced by outliers: 18% (moderately inflated)
benchmarked NonDet/N-queens problem/NonDet.Church/8
time 894.0 μs (839.8 μs .. 927.6 μs)
0.986 R² (0.978 R² .. 0.994 R²)
mean 862.5 μs (846.5 μs .. 880.8 μs)
std dev 56.53 μs (49.87 μs .. 66.60 μs)
variance introduced by outliers: 40% (moderately inflated)
benchmarking NonDet/N-queens problem/NonDet.Church/16 ... took 15.13 s, total 56 iterations
benchmarked NonDet/N-queens problem/NonDet.Church/16
time 280.6 ms (269.8 ms .. 286.2 ms)
0.998 R² (0.994 R² .. 1.000 R²)
mean 272.7 ms (268.1 ms .. 277.0 ms)
std dev 8.054 ms (6.851 ms .. 9.466 ms)
benchmarked NonDet/N-queens problem/[]/4
time 11.67 μs (11.42 μs .. 11.88 μs)
0.998 R² (0.997 R² .. 0.999 R²)
mean 11.57 μs (11.51 μs .. 11.65 μs)
std dev 250.9 ns (194.0 ns .. 313.5 ns)
benchmarked NonDet/N-queens problem/[]/8
time 746.9 μs (731.5 μs .. 784.7 μs)
0.974 R² (0.945 R² .. 0.994 R²)
mean 803.6 μs (786.6 μs .. 833.0 μs)
std dev 69.86 μs (52.04 μs .. 93.39 μs)
variance introduced by outliers: 55% (severely inflated)
benchmarking NonDet/N-queens problem/[]/16 ... took 14.57 s, total 56 iterations
benchmarked NonDet/N-queens problem/[]/16
time 259.7 ms (252.1 ms .. 267.2 ms)
0.999 R² (0.998 R² .. 1.000 R²)
mean 265.4 ms (262.3 ms .. 268.4 ms)
std dev 5.245 ms (3.510 ms .. 7.336 ms)
benchmarked Reader/ask/(->)
time 24.88 μs (23.54 μs .. 26.54 μs)
0.981 R² (0.967 R² .. 0.992 R²)
mean 24.14 μs (23.81 μs .. 25.01 μs)
std dev 1.780 μs (1.239 μs .. 2.600 μs)
variance introduced by outliers: 46% (moderately inflated)
benchmarked Reader/ask/Identity/ReaderC
time 25.18 μs (24.19 μs .. 27.07 μs)
0.980 R² (0.971 R² .. 0.988 R²)
mean 25.51 μs (24.86 μs .. 26.01 μs)
std dev 1.886 μs (1.633 μs .. 2.044 μs)
variance introduced by outliers: 47% (moderately inflated)
benchmarked Reader/ask/Identity/ReaderT
time 22.57 μs (22.18 μs .. 22.93 μs)
0.997 R² (0.995 R² .. 0.999 R²)
mean 24.35 μs (23.72 μs .. 25.36 μs)
std dev 2.595 μs (1.656 μs .. 3.750 μs)
variance introduced by outliers: 66% (severely inflated)
benchmarked Reader/ask/IO/ReaderC
time 23.85 μs (23.59 μs .. 24.05 μs)
0.999 R² (0.999 R² .. 1.000 R²)
mean 23.56 μs (23.44 μs .. 23.68 μs)
std dev 392.1 ns (312.2 ns .. 621.0 ns)
benchmarked Reader/ask/IO/ReaderT
time 22.62 μs (22.29 μs .. 22.83 μs)
0.999 R² (0.997 R² .. 1.000 R²)
mean 23.90 μs (23.43 μs .. 25.15 μs)
std dev 2.509 μs (706.9 ns .. 5.046 μs)
variance introduced by outliers: 65% (severely inflated)
benchmarked Reader/local/(->)
time 23.37 μs (23.10 μs .. 23.78 μs)
0.998 R² (0.997 R² .. 0.999 R²)
mean 23.75 μs (23.60 μs .. 23.94 μs)
std dev 578.1 ns (487.0 ns .. 695.0 ns)
benchmarked Reader/local/Identity/ReaderC
time 23.05 μs (22.54 μs .. 23.50 μs)
0.996 R² (0.992 R² .. 0.999 R²)
mean 23.85 μs (23.57 μs .. 24.54 μs)
std dev 1.413 μs (656.3 ns .. 2.733 μs)
variance introduced by outliers: 37% (moderately inflated)
benchmarked Reader/local/Identity/ReaderT
time 23.97 μs (23.58 μs .. 24.37 μs)
0.998 R² (0.996 R² .. 0.999 R²)
mean 23.66 μs (23.47 μs .. 23.87 μs)
std dev 714.3 ns (549.6 ns .. 950.2 ns)
variance introduced by outliers: 13% (moderately inflated)
benchmarked Reader/local/IO/ReaderC
time 23.79 μs (23.39 μs .. 24.29 μs)
0.998 R² (0.996 R² .. 0.999 R²)
mean 23.98 μs (23.79 μs .. 24.15 μs)
std dev 630.0 ns (544.1 ns .. 711.5 ns)
variance introduced by outliers: 11% (moderately inflated)
benchmarked Reader/local/IO/ReaderT
time 22.89 μs (22.40 μs .. 23.27 μs)
0.997 R² (0.995 R² .. 0.998 R²)
mean 25.01 μs (24.42 μs .. 25.99 μs)
std dev 2.510 μs (1.735 μs .. 3.816 μs)
variance introduced by outliers: 64% (severely inflated)
benchmarked State/Identity/Church.StateC
time 56.87 μs (55.01 μs .. 59.91 μs)
0.981 R² (0.970 R² .. 0.991 R²)
mean 57.46 μs (56.36 μs .. 58.67 μs)
std dev 3.803 μs (2.812 μs .. 4.531 μs)
variance introduced by outliers: 43% (moderately inflated)
benchmarked State/Identity/Lazy.StateC
time 54.83 μs (54.08 μs .. 55.74 μs)
0.999 R² (0.997 R² .. 1.000 R²)
mean 54.59 μs (54.36 μs .. 55.03 μs)
std dev 1.015 μs (575.2 ns .. 1.513 μs)
benchmarked State/Identity/Strict.StateC
time 54.21 μs (53.82 μs .. 54.63 μs)
1.000 R² (1.000 R² .. 1.000 R²)
mean 54.06 μs (53.91 μs .. 54.21 μs)
std dev 558.4 ns (346.9 ns .. 848.1 ns)
benchmarked State/Identity/Lazy.StateT
time 54.64 μs (53.86 μs .. 55.41 μs)
0.999 R² (0.999 R² .. 1.000 R²)
mean 54.26 μs (54.05 μs .. 54.46 μs)
std dev 696.1 ns (573.8 ns .. 871.8 ns)
benchmarked State/Identity/Strict.StateT
time 57.12 μs (55.66 μs .. 58.02 μs)
0.998 R² (0.997 R² .. 0.999 R²)
mean 55.31 μs (55.02 μs .. 55.65 μs)
std dev 1.167 μs (939.0 ns .. 1.402 μs)
benchmarked State/IO/Church.StateC
time 54.72 μs (53.36 μs .. 55.96 μs)
0.995 R² (0.989 R² .. 0.998 R²)
mean 57.11 μs (56.46 μs .. 58.71 μs)
std dev 3.404 μs (2.024 μs .. 5.415 μs)
variance introduced by outliers: 36% (moderately inflated)
benchmarked State/IO/Lazy.StateC
time 55.12 μs (54.58 μs .. 55.96 μs)
0.999 R² (0.997 R² .. 1.000 R²)
mean 55.02 μs (54.72 μs .. 55.37 μs)
std dev 1.118 μs (722.8 ns .. 1.663 μs)
benchmarked State/IO/Strict.StateC
time 54.56 μs (53.17 μs .. 56.91 μs)
0.993 R² (0.987 R² .. 0.999 R²)
mean 55.24 μs (54.64 μs .. 55.95 μs)
std dev 2.300 μs (1.523 μs .. 3.202 μs)
variance introduced by outliers: 22% (moderately inflated)
benchmarked State/IO/Lazy.StateT
time 58.15 μs (55.49 μs .. 60.94 μs)
0.988 R² (0.978 R² .. 0.996 R²)
mean 58.06 μs (57.35 μs .. 59.89 μs)
std dev 3.693 μs (2.500 μs .. 5.132 μs)
variance introduced by outliers: 40% (moderately inflated)
benchmarked State/IO/Strict.StateT
time 57.72 μs (56.38 μs .. 59.58 μs)
0.995 R² (0.993 R² .. 0.998 R²)
mean 58.00 μs (57.22 μs .. 59.17 μs)
std dev 3.150 μs (2.398 μs .. 4.122 μs)
variance introduced by outliers: 32% (moderately inflated)
benchmarking Writer/(,) w ... took 8.963 s, total 56 iterations
benchmarked Writer/(,) w
time 173.8 ms (159.2 ms .. 189.9 ms)
0.991 R² (0.986 R² .. 0.999 R²)
mean 158.7 ms (155.1 ms .. 165.3 ms)
std dev 8.178 ms (4.397 ms .. 13.30 ms)
benchmarked Writer/Identity/Church.WriterC
time 42.47 ms (41.14 ms .. 43.96 ms)
0.995 R² (0.987 R² .. 0.998 R²)
mean 44.97 ms (43.72 ms .. 46.21 ms)
std dev 2.758 ms (2.086 ms .. 4.077 ms)
variance introduced by outliers: 19% (moderately inflated)
benchmarked Writer/Identity/Strict.WriterC
time 492.9 μs (472.6 μs .. 517.2 μs)
0.990 R² (0.985 R² .. 0.997 R²)
mean 501.4 μs (494.4 μs .. 510.8 μs)
std dev 25.02 μs (21.27 μs .. 28.57 μs)
variance introduced by outliers: 30% (moderately inflated)
benchmarked Writer/Identity/CPS.WriterT
time 498.3 μs (477.7 μs .. 520.6 μs)
0.990 R² (0.985 R² .. 0.995 R²)
mean 484.2 μs (478.8 μs .. 497.4 μs)
std dev 26.46 μs (19.90 μs .. 36.31 μs)
variance introduced by outliers: 33% (moderately inflated)
benchmarking Writer/Identity/Lazy.WriterT ... took 7.658 s, total 56 iterations
benchmarked Writer/Identity/Lazy.WriterT
time 142.9 ms (140.4 ms .. 146.3 ms)
0.999 R² (0.997 R² .. 1.000 R²)
mean 135.1 ms (128.9 ms .. 138.4 ms)
std dev 7.930 ms (3.602 ms .. 12.91 ms)
variance introduced by outliers: 18% (moderately inflated)
benchmarking Writer/Identity/Strict.WriterT ... took 9.173 s, total 56 iterations
benchmarked Writer/Identity/Strict.WriterT
time 178.5 ms (167.5 ms .. 190.2 ms)
0.994 R² (0.989 R² .. 0.999 R²)
mean 160.9 ms (155.4 ms .. 167.2 ms)
std dev 10.33 ms (7.106 ms .. 14.44 ms)
variance introduced by outliers: 18% (moderately inflated)
benchmarked Writer/IO/Church.WriterC
time 38.81 ms (37.96 ms .. 39.75 ms)
0.999 R² (0.997 R² .. 1.000 R²)
mean 41.59 ms (40.64 ms .. 44.39 ms)
std dev 2.939 ms (1.919 ms .. 3.767 ms)
variance introduced by outliers: 24% (moderately inflated)
benchmarked Writer/IO/Strict.WriterC
time 2.106 ms (2.033 ms .. 2.215 ms)
0.987 R² (0.977 R² .. 0.995 R²)
mean 2.064 ms (2.028 ms .. 2.109 ms)
std dev 127.5 μs (100.6 μs .. 161.6 μs)
variance introduced by outliers: 39% (moderately inflated)
benchmarked Writer/IO/CPS.WriterT
time 11.44 ms (10.99 ms .. 11.86 ms)
0.992 R² (0.987 R² .. 0.997 R²)
mean 10.13 ms (9.890 ms .. 10.44 ms)
std dev 695.7 μs (550.9 μs .. 839.8 μs)
variance introduced by outliers: 34% (moderately inflated)
benchmarking Writer/IO/Lazy.WriterT ... took 13.54 s, total 56 iterations
benchmarked Writer/IO/Lazy.WriterT
time 254.6 ms (245.0 ms .. 261.8 ms)
0.998 R² (0.993 R² .. 1.000 R²)
mean 240.4 ms (233.7 ms .. 246.6 ms)
std dev 10.74 ms (6.591 ms .. 16.29 ms)
benchmarking Writer/IO/Strict.WriterT ... took 14.38 s, total 56 iterations
benchmarked Writer/IO/Strict.WriterT
time 269.7 ms (254.2 ms .. 280.4 ms)
0.997 R² (0.995 R² .. 1.000 R²)
mean 258.3 ms (255.0 ms .. 262.8 ms)
std dev 7.005 ms (4.058 ms .. 9.994 ms)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment