Skip to content

Instantly share code, notes, and snippets.

@gtirloni
Created February 7, 2025 15:34
Show Gist options
  • Save gtirloni/06a35ef824b0440c878c62aae91bd507 to your computer and use it in GitHub Desktop.
Save gtirloni/06a35ef824b0440c878c62aae91bd507 to your computer and use it in GitHub Desktop.
ollama_deepseek_r1_benchmarks.md

ollama/deepseek benchmarks

machine: macbook 14" m4 max, 36GB

prompt: "please write a short story about a geek trying to learn the c programming language in a forest"

deepseek-r1:1.5b

total memory used: 13GB

total duration:       6.356363916s
load duration:        33.417875ms
prompt eval count:    21 token(s)
prompt eval duration: 132ms
prompt eval rate:     159.09 tokens/s
eval count:           975 token(s)
eval duration:        6.188s
eval rate:            157.56 tokens/s

deepseek-r1:7b

total memory used: 17GB

total duration:       13.423743292s
load duration:        29.165292ms
prompt eval count:    21 token(s)
prompt eval duration: 233ms
prompt eval rate:     90.13 tokens/s
eval count:           801 token(s)
eval duration:        13.159s
eval rate:            60.87 tokens/s

deepseek-r1:14b

total memory used: 21GB

total duration:       36.935593834s
load duration:        31.377792ms
prompt eval count:    21 token(s)
prompt eval duration: 339ms
prompt eval rate:     61.95 tokens/s
eval count:           1120 token(s)
eval duration:        36.563s
eval rate:            30.63 tokens/s

deepseek-r1:32b

total memory used: 28GB (+ fan noise)

total duration:       1m20.137086542s
load duration:        32.158584ms
prompt eval count:    21 token(s)
prompt eval duration: 807ms
prompt eval rate:     26.02 tokens/s
eval count:           1156 token(s)
eval duration:        1m19.296s
eval rate:            14.58 tokens/s

deepseek-r1:70b

total memory used: 28GB + 14GB swap

multiple crashes, no output.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment