client calls

0 writeup

This test is not that conclusive, but its a start to test how much of a "tax" running AlchemyDB as a VirtualMachine must be paid.

All tests were run from one machine to another (both w/ phenom X4 @ 3.0 GHz CPUs)

The bare-metal was run on a 64bit Ubuntu 9.10
The Virtual machine was run on the same 64 bit Ubuntu 9.10 and the Virtual Machine was a Debian 5 (32 bit), the Hypervisor was VMware workstation 7.0.

A little bit stupid that the Virtual Machine was 32bit, but this is just a quick nothing-special first test to get a ballpark idea ... No special configuration was done in any of this, this is basically right out of the box.

Results: BareMetal VM      TAX
INSERT     71.6    49.6    31%
SELECT     66.5    46.1    31%
UPDATE     63.5    42.5    33%
DELETE     72.9    49.5    32%

So basically a 31.3% TAX .. almost one-third

So in this (sub-optimal) setup that is the Tax AlchemyDatabase pays for being Virtualised

bare-metal results

INSERT
  1000003 requests completed in 13.96 seconds
  200 parallel clients

39.29% <= 2 milliseconds
82.68% <= 3 milliseconds
99.79% <= 4 milliseconds
99.87% <= 5 milliseconds
99.89% <= 6 milliseconds
99.96% <= 7 milliseconds
99.98% <= 8 milliseconds
99.99% <= 9 milliseconds
99.99% <= 10 milliseconds
99.99% <= 13 milliseconds
99.99% <= 14 milliseconds
99.99% <= 17 milliseconds
99.99% <= 19 milliseconds
99.99% <= 21 milliseconds
99.99% <= 24 milliseconds
99.99% <= 26 milliseconds
99.99% <= 28 milliseconds
99.99% <= 30 milliseconds
99.99% <= 33 milliseconds
99.99% <= 36 milliseconds
99.99% <= 37 milliseconds
99.99% <= 38 milliseconds
99.99% <= 39 milliseconds
99.99% <= 40 milliseconds
100.00% <= 41 milliseconds
100.00% <= 42 milliseconds
100.00% <= 43 milliseconds
71628.32 requests per second

SELECT:
  1000002 requests completed in 15.03 seconds
  200 parallel clients

0.00% <= 1 milliseconds
13.86% <= 2 milliseconds
89.03% <= 3 milliseconds
97.47% <= 4 milliseconds
99.91% <= 5 milliseconds
99.91% <= 6 milliseconds
99.95% <= 7 milliseconds
99.98% <= 8 milliseconds
99.99% <= 9 milliseconds
99.99% <= 10 milliseconds
99.99% <= 12 milliseconds
99.99% <= 13 milliseconds
99.99% <= 15 milliseconds
99.99% <= 17 milliseconds
99.99% <= 19 milliseconds
99.99% <= 21 milliseconds
99.99% <= 23 milliseconds
99.99% <= 24 milliseconds
99.99% <= 26 milliseconds
99.99% <= 27 milliseconds
99.99% <= 28 milliseconds
99.99% <= 29 milliseconds
99.99% <= 30 milliseconds
99.99% <= 31 milliseconds
99.99% <= 32 milliseconds
99.99% <= 33 milliseconds
100.00% <= 34 milliseconds
100.00% <= 35 milliseconds
100.00% <= 36 milliseconds
100.00% <= 37 milliseconds
100.00% <= 219 milliseconds
100.00% <= 221 milliseconds
100.00% <= 223 milliseconds
100.00% <= 224 milliseconds
100.00% <= 226 milliseconds
66516.03 requests per second

UPDATE:
  1000005 requests completed in 15.74 seconds
  200 parallel clients

0.00% <= 1 milliseconds
5.04% <= 2 milliseconds
85.68% <= 3 milliseconds
95.48% <= 4 milliseconds
99.88% <= 5 milliseconds
99.88% <= 6 milliseconds
99.90% <= 7 milliseconds
99.93% <= 8 milliseconds
99.96% <= 9 milliseconds
99.97% <= 10 milliseconds
99.99% <= 11 milliseconds
99.99% <= 12 milliseconds
99.99% <= 13 milliseconds
100.00% <= 14 milliseconds
100.00% <= 15 milliseconds
100.00% <= 19 milliseconds
100.00% <= 22 milliseconds
100.00% <= 26 milliseconds
100.00% <= 31 milliseconds
100.00% <= 35 milliseconds
100.00% <= 39 milliseconds
100.00% <= 42 milliseconds
100.00% <= 44 milliseconds
100.00% <= 45 milliseconds
100.00% <= 46 milliseconds
63528.68 requests per second

DELETE:
  1000000 requests completed in 13.95 seconds
  200 parallel clients

0.01% <= 1 milliseconds
35.91% <= 2 milliseconds
92.44% <= 3 milliseconds
99.71% <= 4 milliseconds
99.86% <= 5 milliseconds
99.89% <= 6 milliseconds
99.92% <= 7 milliseconds
99.92% <= 8 milliseconds
99.93% <= 9 milliseconds
99.93% <= 10 milliseconds
99.94% <= 11 milliseconds
99.94% <= 16 milliseconds
99.95% <= 20 milliseconds
99.96% <= 21 milliseconds
99.96% <= 22 milliseconds
99.97% <= 23 milliseconds
99.98% <= 24 milliseconds
99.98% <= 25 milliseconds
99.98% <= 26 milliseconds
99.98% <= 30 milliseconds
99.98% <= 33 milliseconds
99.98% <= 34 milliseconds
99.98% <= 35 milliseconds
99.98% <= 36 milliseconds
99.99% <= 52 milliseconds
100.00% <= 53 milliseconds
100.00% <= 54 milliseconds
72934.14 requests per second

virtualisation overhead for AlchemyDB

C=200
REQ=1000000

SERVER_IP="192.168.1.155"
CLI="./redisql-cli -h $SERVER_IP"
BENCH="./gen-benchmark -h $SERVER_IP"

$CLI CREATE TABLE speed_test "(id INT, val INT)"
time taskset -c 1 $BENCH -c $C -n $REQ -s -A OK -Q INSERT INTO speed_test VALUES "(000000000001,1)"
time taskset -c 1 $BENCH -c $C -n $REQ -s -A LINE -Q SELECT \* FROM speed_test WHERE "id=000000000001"; 
time taskset -c 1 $BENCH -c $C -n $REQ -s -A OK -Q UPDATE speed_test SET "val = val + 1" WHERE "id=000000000001"
time taskset -c 1 $BENCH -c $C -n $REQ -s -A OK -Q DELETE FROM speed_test WHERE "id=000000000001"

vmware instance

INSERT
1000004 requests completed in 20.16 seconds
  200 parallel clients

0.01% <= 0 milliseconds
0.12% <= 1 milliseconds
5.07% <= 2 milliseconds
30.66% <= 3 milliseconds
68.38% <= 4 milliseconds
96.36% <= 5 milliseconds
99.59% <= 6 milliseconds
99.86% <= 7 milliseconds
99.89% <= 8 milliseconds
99.89% <= 9 milliseconds
99.90% <= 10 milliseconds
99.92% <= 11 milliseconds
99.93% <= 12 milliseconds
99.95% <= 13 milliseconds
99.96% <= 14 milliseconds
99.96% <= 15 milliseconds
99.96% <= 17 milliseconds
99.96% <= 18 milliseconds
99.97% <= 19 milliseconds
99.98% <= 20 milliseconds
99.98% <= 21 milliseconds
99.99% <= 22 milliseconds
99.99% <= 23 milliseconds
99.99% <= 211 milliseconds
99.99% <= 225 milliseconds
99.99% <= 226 milliseconds
99.99% <= 227 milliseconds
99.99% <= 228 milliseconds
99.99% <= 229 milliseconds
99.99% <= 230 milliseconds
99.99% <= 231 milliseconds
99.99% <= 232 milliseconds
99.99% <= 233 milliseconds
99.99% <= 234 milliseconds
99.99% <= 235 milliseconds
99.99% <= 236 milliseconds
99.99% <= 237 milliseconds
99.99% <= 238 milliseconds
99.99% <= 239 milliseconds
99.99% <= 241 milliseconds
99.99% <= 242 milliseconds
99.99% <= 243 milliseconds
99.99% <= 244 milliseconds
100.00% <= 245 milliseconds
100.00% <= 246 milliseconds
100.00% <= 247 milliseconds
100.00% <= 248 milliseconds
100.00% <= 250 milliseconds
100.00% <= 251 milliseconds
100.00% <= 253 milliseconds
100.00% <= 254 milliseconds
100.00% <= 255 milliseconds
100.00% <= 256 milliseconds
100.00% <= 258 milliseconds
100.00% <= 260 milliseconds
100.00% <= 262 milliseconds
100.00% <= 263 milliseconds
100.00% <= 264 milliseconds
100.00% <= 265 milliseconds
100.00% <= 266 milliseconds
100.00% <= 268 milliseconds
100.00% <= 270 milliseconds
100.00% <= 271 milliseconds
100.00% <= 272 milliseconds
100.00% <= 274 milliseconds
100.00% <= 275 milliseconds
100.00% <= 277 milliseconds
100.00% <= 279 milliseconds
100.00% <= 280 milliseconds
100.00% <= 282 milliseconds
100.00% <= 283 milliseconds
100.00% <= 285 milliseconds
100.00% <= 286 milliseconds
100.00% <= 287 milliseconds
100.00% <= 288 milliseconds
100.00% <= 290 milliseconds
100.00% <= 292 milliseconds
100.00% <= 294 milliseconds
100.00% <= 296 milliseconds
100.00% <= 298 milliseconds
100.00% <= 299 milliseconds
100.00% <= 301 milliseconds
100.00% <= 303 milliseconds
100.00% <= 304 milliseconds
49610.76 requests per second

SELECT  1000001 requests completed in 21.66 seconds
  200 parallel clients

0.00% <= 0 milliseconds
0.10% <= 1 milliseconds
1.90% <= 2 milliseconds
26.00% <= 3 milliseconds
53.43% <= 4 milliseconds
90.15% <= 5 milliseconds
99.22% <= 6 milliseconds
99.91% <= 7 milliseconds
99.95% <= 8 milliseconds
99.96% <= 9 milliseconds
99.96% <= 21 milliseconds
99.96% <= 22 milliseconds
99.96% <= 23 milliseconds
99.96% <= 24 milliseconds
99.96% <= 25 milliseconds
99.97% <= 26 milliseconds
99.97% <= 27 milliseconds
99.97% <= 28 milliseconds
99.97% <= 29 milliseconds
99.97% <= 30 milliseconds
99.97% <= 31 milliseconds
99.97% <= 32 milliseconds
99.97% <= 33 milliseconds
99.97% <= 34 milliseconds
99.97% <= 35 milliseconds
99.97% <= 36 milliseconds
99.97% <= 38 milliseconds
99.97% <= 39 milliseconds
99.97% <= 40 milliseconds
99.97% <= 41 milliseconds
99.97% <= 42 milliseconds
99.97% <= 43 milliseconds
99.97% <= 44 milliseconds
99.97% <= 45 milliseconds
99.97% <= 46 milliseconds
99.97% <= 47 milliseconds
99.97% <= 49 milliseconds
99.97% <= 50 milliseconds
99.97% <= 52 milliseconds
99.97% <= 53 milliseconds
99.97% <= 60 milliseconds
99.98% <= 61 milliseconds
99.99% <= 62 milliseconds
99.99% <= 63 milliseconds
99.99% <= 207 milliseconds
99.99% <= 208 milliseconds
99.99% <= 209 milliseconds
99.99% <= 210 milliseconds
99.99% <= 211 milliseconds
99.99% <= 212 milliseconds
99.99% <= 213 milliseconds
99.99% <= 214 milliseconds
99.99% <= 215 milliseconds
99.99% <= 217 milliseconds
99.99% <= 218 milliseconds
99.99% <= 219 milliseconds
99.99% <= 220 milliseconds
99.99% <= 221 milliseconds
99.99% <= 224 milliseconds
99.99% <= 225 milliseconds
99.99% <= 227 milliseconds
100.00% <= 228 milliseconds
100.00% <= 229 milliseconds
100.00% <= 230 milliseconds
100.00% <= 231 milliseconds
100.00% <= 232 milliseconds
100.00% <= 233 milliseconds
100.00% <= 234 milliseconds
100.00% <= 236 milliseconds
100.00% <= 237 milliseconds
100.00% <= 238 milliseconds
100.00% <= 239 milliseconds
100.00% <= 241 milliseconds
100.00% <= 242 milliseconds
100.00% <= 243 milliseconds
100.00% <= 244 milliseconds
100.00% <= 246 milliseconds
100.00% <= 247 milliseconds
100.00% <= 248 milliseconds
100.00% <= 250 milliseconds
100.00% <= 251 milliseconds
100.00% <= 253 milliseconds
100.00% <= 255 milliseconds
100.00% <= 257 milliseconds
100.00% <= 259 milliseconds
100.00% <= 261 milliseconds
100.00% <= 262 milliseconds
100.00% <= 264 milliseconds
100.00% <= 266 milliseconds
100.00% <= 267 milliseconds
100.00% <= 268 milliseconds
100.00% <= 269 milliseconds
100.00% <= 270 milliseconds
100.00% <= 272 milliseconds
100.00% <= 274 milliseconds
100.00% <= 276 milliseconds
100.00% <= 277 milliseconds
100.00% <= 279 milliseconds
100.00% <= 280 milliseconds
100.00% <= 283 milliseconds
100.00% <= 285 milliseconds
100.00% <= 286 milliseconds
100.00% <= 287 milliseconds
100.00% <= 289 milliseconds
100.00% <= 290 milliseconds
100.00% <= 292 milliseconds
100.00% <= 293 milliseconds
100.00% <= 295 milliseconds
100.00% <= 296 milliseconds
46165.97 requests per second

UPDATE:
  1000003 requests completed in 23.51 seconds
  200 parallel clients

0.04% <= 1 milliseconds
1.50% <= 2 milliseconds
17.19% <= 3 milliseconds
41.76% <= 4 milliseconds
81.32% <= 5 milliseconds
97.08% <= 6 milliseconds
99.52% <= 7 milliseconds
99.76% <= 8 milliseconds
99.80% <= 9 milliseconds
99.81% <= 10 milliseconds
99.82% <= 11 milliseconds
99.83% <= 12 milliseconds
99.84% <= 13 milliseconds
99.86% <= 14 milliseconds
99.87% <= 15 milliseconds
99.87% <= 16 milliseconds
99.88% <= 21 milliseconds
99.88% <= 22 milliseconds
99.88% <= 23 milliseconds
99.88% <= 24 milliseconds
99.88% <= 25 milliseconds
99.88% <= 26 milliseconds
99.88% <= 27 milliseconds
99.88% <= 28 milliseconds
99.88% <= 29 milliseconds
99.88% <= 30 milliseconds
99.88% <= 31 milliseconds
99.88% <= 32 milliseconds
99.88% <= 33 milliseconds
99.88% <= 34 milliseconds
99.88% <= 35 milliseconds
99.89% <= 36 milliseconds
99.89% <= 37 milliseconds
99.89% <= 38 milliseconds
99.89% <= 39 milliseconds
99.89% <= 40 milliseconds
99.89% <= 41 milliseconds
99.90% <= 42 milliseconds
99.91% <= 43 milliseconds
99.92% <= 44 milliseconds
99.93% <= 45 milliseconds
99.94% <= 46 milliseconds
99.95% <= 47 milliseconds
99.95% <= 48 milliseconds
99.95% <= 49 milliseconds
99.95% <= 50 milliseconds
99.95% <= 52 milliseconds
99.95% <= 53 milliseconds
99.95% <= 55 milliseconds
99.95% <= 63 milliseconds
99.95% <= 64 milliseconds
99.96% <= 65 milliseconds
99.98% <= 66 milliseconds
99.99% <= 67 milliseconds
99.99% <= 212 milliseconds
99.99% <= 213 milliseconds
99.99% <= 214 milliseconds
99.99% <= 217 milliseconds
99.99% <= 219 milliseconds
99.99% <= 220 milliseconds
99.99% <= 221 milliseconds
99.99% <= 222 milliseconds
99.99% <= 223 milliseconds
99.99% <= 224 milliseconds
99.99% <= 225 milliseconds
99.99% <= 226 milliseconds
99.99% <= 227 milliseconds
99.99% <= 229 milliseconds
99.99% <= 230 milliseconds
99.99% <= 231 milliseconds
99.99% <= 233 milliseconds
99.99% <= 234 milliseconds
99.99% <= 236 milliseconds
99.99% <= 238 milliseconds
99.99% <= 239 milliseconds
100.00% <= 240 milliseconds
100.00% <= 242 milliseconds
100.00% <= 245 milliseconds
100.00% <= 246 milliseconds
100.00% <= 248 milliseconds
100.00% <= 249 milliseconds
100.00% <= 250 milliseconds
100.00% <= 251 milliseconds
100.00% <= 252 milliseconds
100.00% <= 253 milliseconds
100.00% <= 254 milliseconds
100.00% <= 256 milliseconds
100.00% <= 261 milliseconds
100.00% <= 262 milliseconds
100.00% <= 263 milliseconds
100.00% <= 265 milliseconds
100.00% <= 266 milliseconds
100.00% <= 267 milliseconds
100.00% <= 269 milliseconds
100.00% <= 271 milliseconds
100.00% <= 272 milliseconds
100.00% <= 274 milliseconds
100.00% <= 275 milliseconds
100.00% <= 276 milliseconds
100.00% <= 278 milliseconds
100.00% <= 280 milliseconds
100.00% <= 282 milliseconds
100.00% <= 285 milliseconds
100.00% <= 287 milliseconds
100.00% <= 288 milliseconds
100.00% <= 290 milliseconds
100.00% <= 291 milliseconds
100.00% <= 292 milliseconds
100.00% <= 294 milliseconds
100.00% <= 296 milliseconds
100.00% <= 299 milliseconds
100.00% <= 301 milliseconds
100.00% <= 303 milliseconds
100.00% <= 304 milliseconds
100.00% <= 306 milliseconds
100.00% <= 309 milliseconds
100.00% <= 311 milliseconds
100.00% <= 312 milliseconds
42529.79 requests per second

DELETE:
  1000002 requests completed in 20.19 seconds
  200 parallel clients

0.00% <= 0 milliseconds
0.08% <= 1 milliseconds
6.28% <= 2 milliseconds
31.45% <= 3 milliseconds
67.28% <= 4 milliseconds
96.49% <= 5 milliseconds
99.60% <= 6 milliseconds
99.84% <= 7 milliseconds
99.86% <= 8 milliseconds
99.87% <= 9 milliseconds
99.88% <= 10 milliseconds
99.89% <= 11 milliseconds
99.91% <= 12 milliseconds
99.92% <= 13 milliseconds
99.94% <= 14 milliseconds
99.95% <= 15 milliseconds
99.95% <= 16 milliseconds
99.95% <= 17 milliseconds
99.95% <= 18 milliseconds
99.96% <= 20 milliseconds
99.96% <= 21 milliseconds
99.96% <= 22 milliseconds
99.97% <= 23 milliseconds
99.97% <= 24 milliseconds
99.97% <= 25 milliseconds
99.97% <= 26 milliseconds
99.97% <= 28 milliseconds
99.97% <= 42 milliseconds
99.97% <= 43 milliseconds
99.98% <= 44 milliseconds
99.99% <= 45 milliseconds
99.99% <= 46 milliseconds
99.99% <= 212 milliseconds
99.99% <= 213 milliseconds
99.99% <= 215 milliseconds
99.99% <= 224 milliseconds
99.99% <= 225 milliseconds
99.99% <= 226 milliseconds
99.99% <= 227 milliseconds
99.99% <= 229 milliseconds
99.99% <= 230 milliseconds
99.99% <= 231 milliseconds
99.99% <= 232 milliseconds
99.99% <= 233 milliseconds
99.99% <= 234 milliseconds
99.99% <= 235 milliseconds
99.99% <= 236 milliseconds
99.99% <= 237 milliseconds
99.99% <= 238 milliseconds
99.99% <= 239 milliseconds
100.00% <= 241 milliseconds
100.00% <= 242 milliseconds
100.00% <= 243 milliseconds
100.00% <= 244 milliseconds
100.00% <= 245 milliseconds
100.00% <= 246 milliseconds
100.00% <= 247 milliseconds
100.00% <= 248 milliseconds
100.00% <= 249 milliseconds
100.00% <= 250 milliseconds
100.00% <= 251 milliseconds
100.00% <= 252 milliseconds
100.00% <= 253 milliseconds
100.00% <= 254 milliseconds
100.00% <= 256 milliseconds
100.00% <= 257 milliseconds
100.00% <= 258 milliseconds
100.00% <= 259 milliseconds
100.00% <= 260 milliseconds
100.00% <= 261 milliseconds
100.00% <= 263 milliseconds
100.00% <= 264 milliseconds
100.00% <= 265 milliseconds
100.00% <= 266 milliseconds
100.00% <= 267 milliseconds
100.00% <= 269 milliseconds
100.00% <= 270 milliseconds
100.00% <= 271 milliseconds
100.00% <= 272 milliseconds
100.00% <= 274 milliseconds
100.00% <= 275 milliseconds
100.00% <= 277 milliseconds
100.00% <= 279 milliseconds
100.00% <= 281 milliseconds
100.00% <= 282 milliseconds
100.00% <= 284 milliseconds
100.00% <= 286 milliseconds
100.00% <= 288 milliseconds
100.00% <= 289 milliseconds
100.00% <= 291 milliseconds
100.00% <= 293 milliseconds
100.00% <= 294 milliseconds
100.00% <= 296 milliseconds
100.00% <= 298 milliseconds
100.00% <= 299 milliseconds
100.00% <= 300 milliseconds
49524.66 requests per second