My standard 'install a specific ripgrep' benchmark, now with hyperfine and zero install with nix

benchmark.md

With Rust and Hyperfine installed natively

(through https://rustup.rs)

hyperfine --warmup=1 'cargo install -f [email protected]'

Without installation on any machine with Nix

nix-shell -p cargo hyperfine --run "hyperfine --warmup=1 'cargo install -f [email protected]'"

Without hyperfine

This won't be quite as comparable, hyperfine is really great for benchmarking, but if you only have cargo, just run the install twice:

cargo install -f [email protected] && cargo install -f [email protected]

Steamdeck - 48.6s

This seems... weirdly slow. I'm sure it used to run in half this time.

Thinkcentre - 39.6s

Benchmark 1: cargo install -f ripgrep@14.1.0
  Time (mean ± σ):     39.647 s ±  0.210 s    [User: 130.243 s, System: 5.717 s]
  Range (min … max):   39.481 s … 39.883 s    3 runs

An old thin workstation I had lying around with an old i5-6400T

X13 Yoga - 14s

Benchmark 1: cargo install -f ripgrep@14.1.0
  Time (mean ± σ):     14.152 s ±  0.349 s    [User: 81.808 s, System: 3.044 s]
  Range (min … max):   13.777 s … 14.868 s    10 runs

Sometimes thermal throttling pushes this to 24s.

2024 Ryzen 9 7950X PC build - 5.7s

💨

Raspberry Pi 5 - 63s

Model B Rev 1.0 - 8GB Memory, Raspbian installed to m.2 SSD

Benchmark 1: cargo install -f ripgrep@14.1.0
  Time (mean ± σ):     63.482 s ±  4.722 s    [User: 189.718 s, System: 2.429 s]
  Range (min … max):   53.597 s … 67.314 s    10 runs

Minisforum 890Pro - 8s

Ryzen 9 8945HS, 64GB memory

Benchmark 1: cargo install -f ripgrep
  Time (mean ± σ):      8.017 s ±  0.218 s    [User: 62.088 s, System: 3.826 s]
  Range (min … max):    7.884 s …  8.456 s    10 runs

Nipogi GK3 - 56s

Intel N95, 8GB memory

Benchmark 1: cargo install -f ripgrep@14.1.0
  Time (mean ± σ):     56.684 s ±  2.264 s    [User: 138.628 s, System: 7.249 s]
  Range (min … max):   52.068 s … 58.990 s    10 runs

Framework 12 - 21s

Intel i3 base version, 16GB memory

Benchmark 1: cargo install -f ripgrep@14.1.0
  Time (mean ± σ):     22.313 s ±  0.533 s    [User: 141.531 s, System: 5.313 s]
  Range (min … max):   21.104 s … 23.221 s    10 runs

Note: 10s slower using 8GB of memory