Created
July 20, 2026 19:01
-
-
Save zmccoy/55b1a743193b27b64f8f0268279ec975 to your computer and use it in GitHub Desktop.
CMS using FlowStats - INCRBY Benchmark
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| ~ via 🆂 v3.8.2 via ❄️ | |
| ❯ valkey-cli CMS.INITBYDIM sketchdim 1000 5 | |
| OK | |
| ~ via 🆂 v3.8.2 via ❄️ | |
| ❯ valkey-cli CMS.INCRBY sketchdim hello 1 | |
| 1) (integer) 1 | |
| ~ via 🆂 v3.8.2 via ❄️ | |
| ❯ valkey-benchmark -n 1000000 CMS.INCRBY sketchdim hello 1 | |
| ====== CMS.INCRBY sketchdim hello 1 ====== | |
| 1000000 requests completed in 7.98 seconds | |
| 50 parallel clients | |
| 54 bytes payload | |
| keep alive: 1 | |
| host configuration "save": 3600 1 300 100 60 10000 | |
| host configuration "appendonly": no | |
| multi-thread: no | |
| Latency by percentile distribution: | |
| 0.000% <= 0.087 milliseconds (cumulative count 1) | |
| 50.000% <= 0.255 milliseconds (cumulative count 522890) | |
| 75.000% <= 0.303 milliseconds (cumulative count 784960) | |
| 87.500% <= 0.335 milliseconds (cumulative count 875308) | |
| 93.750% <= 0.391 milliseconds (cumulative count 938504) | |
| 96.875% <= 0.455 milliseconds (cumulative count 969494) | |
| 98.438% <= 0.511 milliseconds (cumulative count 984385) | |
| 99.219% <= 0.559 milliseconds (cumulative count 993228) | |
| 99.609% <= 0.599 milliseconds (cumulative count 996396) | |
| 99.805% <= 0.743 milliseconds (cumulative count 998078) | |
| 99.902% <= 1.095 milliseconds (cumulative count 999044) | |
| 99.951% <= 1.207 milliseconds (cumulative count 999551) | |
| 99.976% <= 1.351 milliseconds (cumulative count 999756) | |
| 99.988% <= 1.711 milliseconds (cumulative count 999878) | |
| 99.994% <= 2.287 milliseconds (cumulative count 999939) | |
| 99.997% <= 3.855 milliseconds (cumulative count 999970) | |
| 99.998% <= 6.391 milliseconds (cumulative count 999988) | |
| 99.999% <= 6.399 milliseconds (cumulative count 999994) | |
| 100.000% <= 6.415 milliseconds (cumulative count 999998) | |
| 100.000% <= 6.423 milliseconds (cumulative count 999999) | |
| 100.000% <= 6.431 milliseconds (cumulative count 1000000) | |
| 100.000% <= 6.431 milliseconds (cumulative count 1000000) | |
| Cumulative distribution of latencies: | |
| 0.007% <= 0.103 milliseconds (cumulative count 68) | |
| 41.428% <= 0.207 milliseconds (cumulative count 414280) | |
| 78.496% <= 0.303 milliseconds (cumulative count 784960) | |
| 94.848% <= 0.407 milliseconds (cumulative count 948482) | |
| 98.250% <= 0.503 milliseconds (cumulative count 982501) | |
| 99.668% <= 0.607 milliseconds (cumulative count 996677) | |
| 99.789% <= 0.703 milliseconds (cumulative count 997886) | |
| 99.844% <= 0.807 milliseconds (cumulative count 998436) | |
| 99.873% <= 0.903 milliseconds (cumulative count 998731) | |
| 99.884% <= 1.007 milliseconds (cumulative count 998843) | |
| 99.907% <= 1.103 milliseconds (cumulative count 999072) | |
| 99.955% <= 1.207 milliseconds (cumulative count 999551) | |
| 99.973% <= 1.303 milliseconds (cumulative count 999729) | |
| 99.978% <= 1.407 milliseconds (cumulative count 999777) | |
| 99.981% <= 1.503 milliseconds (cumulative count 999811) | |
| 99.985% <= 1.607 milliseconds (cumulative count 999846) | |
| 99.988% <= 1.703 milliseconds (cumulative count 999876) | |
| 99.989% <= 1.807 milliseconds (cumulative count 999893) | |
| 99.992% <= 1.903 milliseconds (cumulative count 999915) | |
| 99.992% <= 2.007 milliseconds (cumulative count 999922) | |
| 99.993% <= 2.103 milliseconds (cumulative count 999929) | |
| 99.995% <= 3.103 milliseconds (cumulative count 999945) | |
| 99.997% <= 4.103 milliseconds (cumulative count 999971) | |
| 99.997% <= 6.103 milliseconds (cumulative count 999972) | |
| 100.000% <= 7.103 milliseconds (cumulative count 1000000) | |
| Summary: | |
| throughput summary: 125297.59 requests per second | |
| latency summary (msec): | |
| avg min p50 p95 p99 max | |
| 0.248 0.080 0.255 0.415 0.543 6.431 |
Author
Using Rust-Count-Min-Sketch underneath:
❯ valkey-benchmark -n 1000000 CMS.QUERY sketchdim hello
CMS.QUERY sketchdim hello: rps=119336.0 (overall: 134462.0) avg_msec=0.252 (overall: 0.229) 100981 request CMS.QUERY sketchdim hello: rps=122936.3 (overall: 131574.9) avg_msec=0.256 (overall: 0.236) 131838 request CMS.QUERY sketchdim hello: rps=156516.0 (overall: 136555.1) avg_msec=0.191 (overall: 0.225) 170967 request CMS.QUERY sketchdim hello: rps=149780.0 (overall: 138756.3) avg_msec=0.201 (overall: 0.221) 208412 request CMS.QUERY sketchdim hello: rps=153612.0 (overall: 140876.1) avg_msec=0.190 (overall: 0.216) 246815 request CMS.QUERY sketchdim hello: rps=152136.0 (overall: 142282.2) avg_msec=0.194 (overall: 0.213) 284849 request CMS.QUERY sketchdim hello: rps=169808.0 (overall: 145337.9) avg_msec=0.172 (overall: 0.208) 327301 request CMS.QUERY sketchdim hello: rps=163075.7 (overall: 147116.7) avg_msec=0.182 (overall: 0.205) 368233 request CMS.QUERY sketchdim hello: rps=160196.0 (overall: 148304.4) avg_msec=0.185 (overall: 0.203) 408282 request CMS.QUERY sketchdim hello: rps=137484.0 (overall: 147403.6) avg_msec=0.220 (overall: 0.204) 442653 request CMS.QUERY sketchdim hello: rps=152236.0 (overall: 147775.0) avg_msec=0.196 (overall: 0.204) 480712 request CMS.QUERY sketchdim hello: rps=167816.0 (overall: 149205.2) avg_msec=0.179 (overall: 0.202) 522666 request CMS.QUERY sketchdim hello: rps=156984.0 (overall: 149723.4) avg_msec=0.191 (overall: 0.201) 561912 request CMS.QUERY sketchdim hello: rps=151708.0 (overall: 149847.4) avg_msec=0.196 (overall: 0.201) 599839 request CMS.QUERY sketchdim hello: rps=151757.0 (overall: 149960.0) avg_msec=0.197 (overall: 0.200) 637930 request CMS.QUERY sketchdim hello: rps=166032.0 (overall: 150852.1) avg_msec=0.183 (overall: 0.199) 679438 request CMS.QUERY sketchdim hello: rps=157316.0 (overall: 151192.0) avg_msec=0.187 (overall: 0.199) 718767 request CMS.QUERY sketchdim hello: rps=160720.0 (overall: 151668.1) avg_msec=0.188 (overall: 0.198) 758947 request CMS.QUERY sketchdim hello: rps=156504.0 (overall: 151898.2) avg_msec=0.195 (overall: 0.198) 798073 request CMS.QUERY sketchdim hello: rps=157224.0 (overall: 152140.1) avg_msec=0.191 (overall: 0.198) 837379 request CMS.QUERY sketchdim hello: rps=159581.7 (overall: 152464.6) avg_msec=0.188 (overall: 0.197) 877434 request CMS.QUERY sketchdim hello: rps=159088.0 (overall: 152740.4) avg_msec=0.187 (overall: 0.197) 917206 request CMS.QUERY sketchdim hello: rps=161904.0 (overall: 153106.6) avg_msec=0.186 (overall: 0.196) 957682 request CMS.QUERY sketchdim hello: rps=159180.7 (overall: 153339.2) avg_msec=0.187 (overall: 0.196) 997318 request ====== CMS.QUERY sketchdim hello ======
1000000 requests completed in 6.52 seconds
50 parallel clients
45 bytes payload
keep alive: 1
host configuration "save": 3600 1 300 100 60 10000
host configuration "appendonly": no
multi-thread: no
Latency by percentile distribution:
0.000% <= 0.087 milliseconds (cumulative count 2)
50.000% <= 0.167 milliseconds (cumulative count 534831)
75.000% <= 0.247 milliseconds (cumulative count 764758)
87.500% <= 0.287 milliseconds (cumulative count 877579)
93.750% <= 0.327 milliseconds (cumulative count 942126)
96.875% <= 0.375 milliseconds (cumulative count 970394)
98.438% <= 0.431 milliseconds (cumulative count 985751)
99.219% <= 0.487 milliseconds (cumulative count 992821)
99.609% <= 0.535 milliseconds (cumulative count 996373)
99.805% <= 0.575 milliseconds (cumulative count 998127)
99.902% <= 0.711 milliseconds (cumulative count 999028)
99.951% <= 1.151 milliseconds (cumulative count 999523)
99.976% <= 1.399 milliseconds (cumulative count 999765)
99.988% <= 1.455 milliseconds (cumulative count 999892)
99.994% <= 1.535 milliseconds (cumulative count 999941)
99.997% <= 1.647 milliseconds (cumulative count 999973)
99.998% <= 1.687 milliseconds (cumulative count 999985)
99.999% <= 1.735 milliseconds (cumulative count 999993)
100.000% <= 1.791 milliseconds (cumulative count 999997)
100.000% <= 1.823 milliseconds (cumulative count 999999)
100.000% <= 1.839 milliseconds (cumulative count 1000000)
100.000% <= 1.839 milliseconds (cumulative count 1000000)
Cumulative distribution of latencies:
0.032% <= 0.103 milliseconds (cumulative count 319)
70.796% <= 0.207 milliseconds (cumulative count 707956)
91.151% <= 0.303 milliseconds (cumulative count 911509)
98.046% <= 0.407 milliseconds (cumulative count 980458)
99.412% <= 0.503 milliseconds (cumulative count 994116)
99.856% <= 0.607 milliseconds (cumulative count 998558)
99.898% <= 0.703 milliseconds (cumulative count 998982)
99.919% <= 0.807 milliseconds (cumulative count 999188)
99.921% <= 0.903 milliseconds (cumulative count 999205)
99.922% <= 1.007 milliseconds (cumulative count 999218)
99.933% <= 1.103 milliseconds (cumulative count 999325)
99.957% <= 1.207 milliseconds (cumulative count 999568)
99.972% <= 1.303 milliseconds (cumulative count 999720)
99.978% <= 1.407 milliseconds (cumulative count 999782)
99.993% <= 1.503 milliseconds (cumulative count 999934)
99.996% <= 1.607 milliseconds (cumulative count 999961)
99.999% <= 1.703 milliseconds (cumulative count 999989)
100.000% <= 1.807 milliseconds (cumulative count 999998)
100.000% <= 1.903 milliseconds (cumulative count 1000000)
Summary:
throughput summary: 153303.70 requests per second
latency summary (msec):
avg min p50 p95 p99 max
0.196 0.080 0.167 0.343 0.463 1.839
Author
Rust-Count-Min-Sketch Implementation INCRBY
❯ valkey-benchmark -n 1000000 CMS.INCRBY sketchdim hello 1
CMS.INCRBY sketchdim hello 1: rps=130416.0 (overall: 130416.0) avg_msec=0.248 (overall: 0.248) 32604 reque CMS.INCRBY sketchdim hello 1: rps=121964.1 (overall: 126181.6) avg_msec=0.255 (overall: 0.252) 63217 reque CMS.INCRBY sketchdim hello 1: rps=129340.0 (overall: 127233.0) avg_msec=0.227 (overall: 0.243) 95552 reque CMS.INCRBY sketchdim hello 1: rps=145900.0 (overall: 131895.1) avg_msec=0.211 (overall: 0.234) 132027 requ CMS.INCRBY sketchdim hello 1: rps=155652.0 (overall: 136642.7) avg_msec=0.198 (overall: 0.226) 170940 requ CMS.INCRBY sketchdim hello 1: rps=142320.0 (overall: 137588.3) avg_msec=0.227 (overall: 0.226) 206520 requ CMS.INCRBY sketchdim hello 1: rps=159692.0 (overall: 140744.1) avg_msec=0.196 (overall: 0.221) 246443 requ CMS.INCRBY sketchdim hello 1: rps=153348.0 (overall: 142318.8) avg_msec=0.209 (overall: 0.220) 284780 requ CMS.INCRBY sketchdim hello 1: rps=146669.3 (overall: 142803.7) avg_msec=0.206 (overall: 0.218) 321594 requ CMS.INCRBY sketchdim hello 1: rps=148260.0 (overall: 143348.9) avg_msec=0.215 (overall: 0.218) 358659 requ CMS.INCRBY sketchdim hello 1: rps=141244.0 (overall: 143157.7) avg_msec=0.221 (overall: 0.218) 393970 requ CMS.INCRBY sketchdim hello 1: rps=124984.0 (overall: 141644.2) avg_msec=0.249 (overall: 0.220) 425216 requ CMS.INCRBY sketchdim hello 1: rps=141244.0 (overall: 141613.5) avg_msec=0.225 (overall: 0.221) 460527 requ CMS.INCRBY sketchdim hello 1: rps=147310.8 (overall: 142021.7) avg_msec=0.207 (overall: 0.220) 497502 requ CMS.INCRBY sketchdim hello 1: rps=156172.0 (overall: 142964.3) avg_msec=0.200 (overall: 0.218) 536545 requ CMS.INCRBY sketchdim hello 1: rps=147268.0 (overall: 143233.1) avg_msec=0.215 (overall: 0.218) 573362 requ CMS.INCRBY sketchdim hello 1: rps=148716.0 (overall: 143555.4) avg_msec=0.204 (overall: 0.217) 610541 requ CMS.INCRBY sketchdim hello 1: rps=159664.0 (overall: 144449.7) avg_msec=0.192 (overall: 0.216) 650457 requ CMS.INCRBY sketchdim hello 1: rps=137916.3 (overall: 144104.8) avg_msec=0.223 (overall: 0.216) 685074 requ CMS.INCRBY sketchdim hello 1: rps=129392.0 (overall: 143369.7) avg_msec=0.252 (overall: 0.218) 717422 requ CMS.INCRBY sketchdim hello 1: rps=152800.0 (overall: 143818.4) avg_msec=0.198 (overall: 0.217) 755622 requ CMS.INCRBY sketchdim hello 1: rps=146148.0 (overall: 143924.2) avg_msec=0.210 (overall: 0.216) 792159 requ CMS.INCRBY sketchdim hello 1: rps=155984.0 (overall: 144448.2) avg_msec=0.193 (overall: 0.215) 831155 requ CMS.INCRBY sketchdim hello 1: rps=142418.3 (overall: 144363.4) avg_msec=0.218 (overall: 0.215) 866902 requ CMS.INCRBY sketchdim hello 1: rps=148668.0 (overall: 144535.4) avg_msec=0.214 (overall: 0.215) 904069 requ CMS.INCRBY sketchdim hello 1: rps=152076.0 (overall: 144825.2) avg_msec=0.204 (overall: 0.215) 942088 requ CMS.INCRBY sketchdim hello 1: rps=151196.0 (overall: 145061.0) avg_msec=0.200 (overall: 0.214) 979887 requ ====== CMS.INCRBY sketchdim hello 1 ======
1000000 requests completed in 6.90 seconds
50 parallel clients
54 bytes payload
keep alive: 1
host configuration "save": 3600 1 300 100 60 10000
host configuration "appendonly": no
multi-thread: no
Latency by percentile distribution:
0.000% <= 0.087 milliseconds (cumulative count 1)
50.000% <= 0.183 milliseconds (cumulative count 535125)
75.000% <= 0.271 milliseconds (cumulative count 763323)
87.500% <= 0.311 milliseconds (cumulative count 882313)
93.750% <= 0.359 milliseconds (cumulative count 939686)
96.875% <= 0.423 milliseconds (cumulative count 970092)
98.438% <= 0.487 milliseconds (cumulative count 985521)
99.219% <= 0.527 milliseconds (cumulative count 992355)
99.609% <= 0.559 milliseconds (cumulative count 996253)
99.805% <= 0.591 milliseconds (cumulative count 998108)
99.902% <= 0.711 milliseconds (cumulative count 999040)
99.951% <= 1.071 milliseconds (cumulative count 999540)
99.976% <= 1.135 milliseconds (cumulative count 999783)
99.988% <= 1.167 milliseconds (cumulative count 999885)
99.994% <= 1.231 milliseconds (cumulative count 999940)
99.997% <= 1.351 milliseconds (cumulative count 999970)
99.998% <= 1.439 milliseconds (cumulative count 999985)
99.999% <= 1.535 milliseconds (cumulative count 999995)
100.000% <= 1.559 milliseconds (cumulative count 999997)
100.000% <= 1.591 milliseconds (cumulative count 999999)
100.000% <= 1.607 milliseconds (cumulative count 1000000)
100.000% <= 1.607 milliseconds (cumulative count 1000000)
Cumulative distribution of latencies:
0.012% <= 0.103 milliseconds (cumulative count 122)
62.833% <= 0.207 milliseconds (cumulative count 628329)
86.463% <= 0.303 milliseconds (cumulative count 864632)
96.442% <= 0.407 milliseconds (cumulative count 964415)
98.844% <= 0.503 milliseconds (cumulative count 988436)
99.847% <= 0.607 milliseconds (cumulative count 998467)
99.901% <= 0.703 milliseconds (cumulative count 999013)
99.920% <= 0.807 milliseconds (cumulative count 999197)
99.924% <= 0.903 milliseconds (cumulative count 999238)
99.933% <= 1.007 milliseconds (cumulative count 999333)
99.969% <= 1.103 milliseconds (cumulative count 999691)
99.992% <= 1.207 milliseconds (cumulative count 999923)
99.996% <= 1.303 milliseconds (cumulative count 999965)
99.998% <= 1.407 milliseconds (cumulative count 999980)
99.999% <= 1.503 milliseconds (cumulative count 999989)
100.000% <= 1.607 milliseconds (cumulative count 1000000)
Summary:
throughput summary: 144906.53 requests per second
latency summary (msec):
avg min p50 p95 p99 max
0.214 0.080 0.183 0.383 0.519 1.607
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.