Skip to content

Instantly share code, notes, and snippets.

@gao-feng
Last active September 2, 2017 14:46
Show Gist options
  • Save gao-feng/8c63744b781e415bcdaca35c89d29dd1 to your computer and use it in GitHub Desktop.
Save gao-feng/8c63744b781e415bcdaca35c89d29dd1 to your computer and use it in GitHub Desktop.
xenpv vs qemu on gce
vm memory:512M,cpu:2
read write 4k-seqread 4k-randread 4k-seqwrite 4k-randwrite memory cpu(per-request) boot time
xenpv(9p) 19902KB/s 38357KB/s 35793KB/s 5615KB/s 31051KB/s 11737KB/s 203MB/s 2.13ms 1181ms
qemu(9p) 7211KB/s 7501KB/s 5649KB/s 1726KB/s 5220KB/s 4639KB/s 68MB/s 12.33ms 6095ms
xenpv(block) 45285KB/s 36627KB/s 11010KB/s 6028KB/s 6027KB/s 6027KB/s
qemu(block) 43737KB/s 34741KB/s 2929KB/s 2842KB/s 2634KB/s 2262KB/s
host 42613KB/s 36609KB/s 11044KB/s 6028KB/s 6028KB/s 6027KB/s 211MB/s 2.10ms
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
1, io
xenpv(9p):
************************************************
1)read:
READ: io=2048.0MB, aggrb=20295KB/s, minb=5073KB/s, maxb=5419KB/s, mint=96744msec, maxt=103330msec
READ: io=2048.0MB, aggrb=20073KB/s, minb=5018KB/s, maxb=5178KB/s, mint=101240msec, maxt=104476msec
READ: io=2048.0MB, aggrb=19338KB/s, minb=4834KB/s, maxb=4870KB/s, mint=107651msec, maxt=108445msec
2)write:
WRITE: io=2048.0MB, aggrb=38225KB/s, minb=9556KB/s, maxb=9587KB/s, mint=54686msec, maxt=54862msec
WRITE: io=2048.0MB, aggrb=38552KB/s, minb=9638KB/s, maxb=9730KB/s, mint=53882msec, maxt=54397msec
WRITE: io=2048.0MB, aggrb=38296KB/s, minb=9574KB/s, maxb=9620KB/s, mint=54498msec, maxt=54761msec
3)4k:
Run status group 0 (all jobs):
READ: io=1347.6MB, aggrb=22958KB/s, minb=22958KB/s, maxb=22958KB/s, mint=60081msec, maxt=60081msec
Run status group 1 (all jobs):
READ: io=340464KB, aggrb=5674KB/s, minb=5674KB/s, maxb=5674KB/s, mint=60001msec, maxt=60001msec
Run status group 2 (all jobs):
WRITE: io=1602.5MB, aggrb=27341KB/s, minb=27341KB/s, maxb=27341KB/s, mint=60001msec, maxt=60001msec
Run status group 3 (all jobs):
WRITE: io=690508KB, aggrb=11480KB/s, minb=11480KB/s, maxb=11480KB/s, mint=60147msec, maxt=60147msec
----------------------
Run status group 0 (all jobs):
READ: io=2463.9MB, aggrb=42049KB/s, minb=42049KB/s, maxb=42049KB/s, mint=60001msec, maxt=60001msec
Run status group 1 (all jobs):
READ: io=329344KB, aggrb=5488KB/s, minb=5488KB/s, maxb=5488KB/s, mint=60001msec, maxt=60001msec
Run status group 2 (all jobs):
WRITE: io=1909.1MB, aggrb=32595KB/s, minb=32595KB/s, maxb=32595KB/s, mint=60001msec, maxt=60001msec
Run status group 3 (all jobs):
WRITE: io=717884KB, aggrb=11898KB/s, minb=11898KB/s, maxb=11898KB/s, mint=60333msec, maxt=60333msec
----------------------------
Run status group 0 (all jobs):
READ: io=2482.9MB, aggrb=42372KB/s, minb=42372KB/s, maxb=42372KB/s, mint=60001msec, maxt=60001msec
Run status group 1 (all jobs):
READ: io=341152KB, aggrb=5685KB/s, minb=5685KB/s, maxb=5685KB/s, mint=60001msec, maxt=60001msec
Run status group 2 (all jobs):
WRITE: io=1946.4MB, aggrb=33217KB/s, minb=33217KB/s, maxb=33217KB/s, mint=60001msec, maxt=60001msec
Run status group 3 (all jobs):
WRITE: io=724536KB, aggrb=11835KB/s, minb=11835KB/s, maxb=11835KB/s, mint=61215msec, maxt=61215msec
************************************************
qemu(9p):
************************************************
1)read:
READ: io=2048.0MB, aggrb=7181KB/s, minb=1795KB/s, maxb=1842KB/s, mint=284559msec, maxt=292039msec
READ: io=2048.0MB, aggrb=7085KB/s, minb=1771KB/s, maxb=2197KB/s, mint=238545msec, maxt=295983msec
READ: io=2048.0MB, aggrb=7369KB/s, minb=1842KB/s, maxb=1897KB/s, mint=276308msec, maxt=284584msec
2)write:
WRITE: io=2048.0MB, aggrb=7353KB/s, minb=1838KB/s, maxb=2291KB/s, mint=228823msec, maxt=285189msec
WRITE: io=2048.0MB, aggrb=7443KB/s, minb=1860KB/s, maxb=2067KB/s, mint=253538msec, maxt=281726msec
WRITE: io=2048.0MB, aggrb=7709KB/s, minb=1927KB/s, maxb=2203KB/s, mint=237977msec, maxt=272025msec
3)4k:
Run status group 0 (all jobs):
READ: io=369836KB, aggrb=6163KB/s, minb=6163KB/s, maxb=6163KB/s, mint=60001msec, maxt=60001msec
Run status group 1 (all jobs):
READ: io=101100KB, aggrb=1684KB/s, minb=1684KB/s, maxb=1684KB/s, mint=60001msec, maxt=60001msec
Run status group 2 (all jobs):
WRITE: io=306768KB, aggrb=5112KB/s, minb=5112KB/s, maxb=5112KB/s, mint=60001msec, maxt=60001msec
Run status group 3 (all jobs):
WRITE: io=266440KB, aggrb=4440KB/s, minb=4440KB/s, maxb=4440KB/s, mint=60001msec, maxt=60001msec
-------------------------
Run status group 0 (all jobs):
READ: io=308176KB, aggrb=5135KB/s, minb=5135KB/s, maxb=5135KB/s, mint=60008msec, maxt=60008msec
Run status group 1 (all jobs):
READ: io=106184KB, aggrb=1769KB/s, minb=1769KB/s, maxb=1769KB/s, mint=60001msec, maxt=60001msec
Run status group 2 (all jobs):
WRITE: io=319748KB, aggrb=5328KB/s, minb=5328KB/s, maxb=5328KB/s, mint=60002msec, maxt=60002msec
Run status group 3 (all jobs):
WRITE: io=290380KB, aggrb=4839KB/s, minb=4839KB/s, maxb=4839KB/s, mint=60001msec, maxt=60001msec
************************************************
xenpv(block):
************************************************
1)read:
READ: io=2048.0MB, aggrb=49151KB/s, minb=12287KB/s, maxb=21037KB/s, mint=24922msec, maxt=42667msec
READ: io=2048.0MB, aggrb=49153KB/s, minb=12288KB/s, maxb=128628KB/s, mint=4076msec, maxt=42665msec
READ: io=2048.0MB, aggrb=37553KB/s, minb=9388KB/s, maxb=9671KB/s, mint=54210msec, maxt=55844msec
2)write:
WRITE: io=2048.0MB, aggrb=36623KB/s, minb=9155KB/s, maxb=10650KB/s, mint=49226msec, maxt=57262msec
WRITE: io=2048.0MB, aggrb=36638KB/s, minb=9159KB/s, maxb=17438KB/s, mint=30065msec, maxt=57239msec
WRITE: io=2048.0MB, aggrb=36620KB/s, minb=9155KB/s, maxb=17433KB/s, mint=30073msec, maxt=57267msec
3)4k:
Run status group 0 (all jobs):
READ: io=660620KB, aggrb=11008KB/s, minb=11008KB/s, maxb=11008KB/s, mint=60011msec, maxt=60011msec
Run status group 1 (all jobs):
READ: io=361820KB, aggrb=6029KB/s, minb=6029KB/s, maxb=6029KB/s, mint=60011msec, maxt=60011msec
Run status group 2 (all jobs):
WRITE: io=361744KB, aggrb=6027KB/s, minb=6027KB/s, maxb=6027KB/s, mint=60011msec, maxt=60011msec
Run status group 3 (all jobs):
WRITE: io=361764KB, aggrb=6028KB/s, minb=6028KB/s, maxb=6028KB/s, mint=60011msec, maxt=60011msec
--------------------
Run status group 0 (all jobs):
READ: io=661064KB, aggrb=11015KB/s, minb=11015KB/s, maxb=11015KB/s, mint=60012msec, maxt=60012msec
Run status group 1 (all jobs):
READ: io=361804KB, aggrb=6028KB/s, minb=6028KB/s, maxb=6028KB/s, mint=60011msec, maxt=60011msec
Run status group 2 (all jobs):
WRITE: io=361724KB, aggrb=6027KB/s, minb=6027KB/s, maxb=6027KB/s, mint=60011msec, maxt=60011msec
Run status group 3 (all jobs):
WRITE: io=361820KB, aggrb=6029KB/s, minb=6029KB/s, maxb=6029KB/s, mint=60011msec, maxt=60011msec
------------------------------
Run status group 0 (all jobs):
READ: io=660608KB, aggrb=11008KB/s, minb=11008KB/s, maxb=11008KB/s, mint=60011msec, maxt=60011msec
Run status group 1 (all jobs):
READ: io=361732KB, aggrb=6027KB/s, minb=6027KB/s, maxb=6027KB/s, mint=60010msec, maxt=60010msec
Run status group 2 (all jobs):
WRITE: io=361688KB, aggrb=6027KB/s, minb=6027KB/s, maxb=6027KB/s, mint=60011msec, maxt=60011msec
Run status group 3 (all jobs):
WRITE: io=361664KB, aggrb=6026KB/s, minb=6026KB/s, maxb=6026KB/s, mint=60012msec, maxt=60012msec
************************************************
qemu(block):
1) read:
READ: io=2048.0MB, aggrb=48321KB/s, minb=12080KB/s, maxb=18271KB/s, mint=28695msec, maxt=43400msec
READ: io=2048.0MB, aggrb=48509KB/s, minb=12127KB/s, maxb=17620KB/s, mint=29754msec, maxt=43232msec
READ: io=2048.0MB, aggrb=34382KB/s, minb=8595KB/s, maxb=15424KB/s, mint=33991msec, maxt=60995msec
2) write:
WRITE: io=2048.0MB, aggrb=36707KB/s, minb=9176KB/s, maxb=13956KB/s, mint=37566msec, maxt=57132msec
WRITE: io=2048.0MB, aggrb=34080KB/s, minb=8520KB/s, maxb=12877KB/s, mint=40713msec, maxt=61536msec
WRITE: io=2048.0MB, aggrb=33437KB/s, minb=8359KB/s, maxb=16056KB/s, mint=32652msec, maxt=62718msec
3) 4k
Run status group 0 (all jobs):
READ: io=175856KB, aggrb=2930KB/s, minb=2930KB/s, maxb=2930KB/s, mint=60001msec, maxt=60001msec
Run status group 1 (all jobs):
READ: io=180348KB, aggrb=3005KB/s, minb=3005KB/s, maxb=3005KB/s, mint=60002msec, maxt=60002msec
Run status group 2 (all jobs):
WRITE: io=148076KB, aggrb=2467KB/s, minb=2467KB/s, maxb=2467KB/s, mint=60013msec, maxt=60013msec
Run status group 3 (all jobs):
WRITE: io=130292KB, aggrb=2171KB/s, minb=2171KB/s, maxb=2171KB/s, mint=60001msec, maxt=60001msec
-----------------------------
Run status group 0 (all jobs):
READ: io=179584KB, aggrb=2992KB/s, minb=2992KB/s, maxb=2992KB/s, mint=60002msec, maxt=60002msec
Run status group 1 (all jobs):
READ: io=167144KB, aggrb=2785KB/s, minb=2785KB/s, maxb=2785KB/s, mint=60002msec, maxt=60002msec
Run status group 2 (all jobs):
WRITE: io=152100KB, aggrb=2534KB/s, minb=2534KB/s, maxb=2534KB/s, mint=60001msec, maxt=60001msec
Run status group 3 (all jobs):
WRITE: io=133864KB, aggrb=2231KB/s, minb=2231KB/s, maxb=2231KB/s, mint=60001msec, maxt=60001msec
-----------------------------
Run status group 0 (all jobs):
READ: io=169032KB, aggrb=2805KB/s, minb=2805KB/s, maxb=2805KB/s, mint=60241msec, maxt=60241msec
Run status group 1 (all jobs):
READ: io=164300KB, aggrb=2738KB/s, minb=2738KB/s, maxb=2738KB/s, mint=60002msec, maxt=60002msec
Run status group 2 (all jobs):
WRITE: io=159116KB, aggrb=2651KB/s, minb=2651KB/s, maxb=2651KB/s, mint=60001msec, maxt=60001msec
Run status group 3 (all jobs):
WRITE: io=143192KB, aggrb=2386KB/s, minb=2386KB/s, maxb=2386KB/s, mint=60001msec, maxt=60001msec
************************************************
host(block)
1)read:
READ: io=2048.0MB, aggrb=49136KB/s, minb=12284KB/s, maxb=115736KB/s, mint=4530msec, maxt=42680msec
READ: io=2048.0MB, aggrb=49137KB/s, minb=12284KB/s, maxb=30524KB/s, mint=17176msec, maxt=42679msec
READ: io=2048.0MB, aggrb=29567KB/s, minb=7391KB/s, maxb=55662KB/s, mint=9419msec, maxt=70928msec
2)write:
WRITE: io=2048.0MB, aggrb=36605KB/s, minb=9151KB/s, maxb=16194KB/s, mint=32375msec, maxt=57291msec
WRITE: io=2048.0MB, aggrb=36603KB/s, minb=9150KB/s, maxb=14655KB/s, mint=35774msec, maxt=57293msec
WRITE: io=2048.0MB, aggrb=36619KB/s, minb=9154KB/s, maxb=15309KB/s, mint=34247msec, maxt=57269msec
3)4k:
Run status group 0 (all jobs):
READ: io=662324KB, aggrb=11036KB/s, minb=11036KB/s, maxb=11036KB/s, mint=60011msec, maxt=60011msec
Run status group 1 (all jobs):
READ: io=361780KB, aggrb=6028KB/s, minb=6028KB/s, maxb=6028KB/s, mint=60010msec, maxt=60010msec
Run status group 2 (all jobs):
WRITE: io=361780KB, aggrb=6028KB/s, minb=6028KB/s, maxb=6028KB/s, mint=60011msec, maxt=60011msec
Run status group 3 (all jobs):
WRITE: io=361756KB, aggrb=6028KB/s, minb=6028KB/s, maxb=6028KB/s, mint=60011msec, maxt=60011msec
------------------------
Run status group 0 (all jobs):
READ: io=663320KB, aggrb=11053KB/s, minb=11053KB/s, maxb=11053KB/s, mint=60011msec, maxt=60011msec
Run status group 1 (all jobs):
READ: io=361788KB, aggrb=6028KB/s, minb=6028KB/s, maxb=6028KB/s, mint=60011msec, maxt=60011msec
Run status group 2 (all jobs):
WRITE: io=361768KB, aggrb=6028KB/s, minb=6028KB/s, maxb=6028KB/s, mint=60011msec, maxt=60011msec
Run status group 3 (all jobs):
WRITE: io=361728KB, aggrb=6027KB/s, minb=6027KB/s, maxb=6027KB/s, mint=60010msec, maxt=60010msec
----------------------------
Run status group 0 (all jobs):
READ: io=662832KB, aggrb=11044KB/s, minb=11044KB/s, maxb=11044KB/s, mint=60012msec, maxt=60012msec
Run status group 1 (all jobs):
READ: io=361772KB, aggrb=6028KB/s, minb=6028KB/s, maxb=6028KB/s, mint=60010msec, maxt=60010msec
Run status group 2 (all jobs):
WRITE: io=361772KB, aggrb=6028KB/s, minb=6028KB/s, maxb=6028KB/s, mint=60011msec, maxt=60011msec
Run status group 3 (all jobs):
WRITE: io=361744KB, aggrb=6027KB/s, minb=6027KB/s, maxb=6027KB/s, mint=60011msec, maxt=60011msec
************************************************
2,sysbench
xenpv:
***********************************************
1)cpu:
Running the test with following options:
Number of threads: 2
Doing CPU performance benchmark
Threads started!
Done.
Maximum prime number checked in CPU test: 10000
Test execution summary:
total time: 10.7040s
total number of events: 10000
total time taken by event execution: 21.3716
per-request statistics:
min: 1.05ms
avg: 2.14ms
max: 13.06ms
approx. 95 percentile: 8.06ms
Threads fairness:
events (avg/stddev): 5000.0000/3.00
execution time (avg/stddev): 10.6858/0.00
----------------------------------------------------
Test execution summary:
total time: 10.6658s
total number of events: 10000
total time taken by event execution: 21.3091
per-request statistics:
min: 1.05ms
avg: 2.13ms
max: 13.08ms
approx. 95 percentile: 8.06ms
Threads fairness:
events (avg/stddev): 5000.0000/4.00
execution time (avg/stddev): 10.6546/0.00
----------------------------------------------------
Test execution summary:
total time: 10.6731s
total number of events: 10000
total time taken by event execution: 21.3310
per-request statistics:
min: 1.05ms
avg: 2.13ms
max: 12.09ms
approx. 95 percentile: 8.06ms
Threads fairness:
events (avg/stddev): 5000.0000/2.00
execution time (avg/stddev): 10.6655/0.00
----------------------------------------------------
2)memory:
Running the test with following options:
Number of threads: 1
Doing memory operations speed test
Memory block size: 1K
Memory transfer size: 102400M
Memory operations type: write
Memory scope type: global
Threads started!
Done.
Operations performed: 104857600 (207822.30 ops/sec)
102400.00 MB transferred (202.95 MB/sec)
Test execution summary:
total time: 504.5541s
total number of events: 104857600
total time taken by event execution: 381.0835
per-request statistics:
min: 0.00ms
avg: 0.00ms
max: 136.10ms
approx. 95 percentile: 0.00ms
Threads fairness:
events (avg/stddev): 104857600.0000/0.00
execution time (avg/stddev): 381.0835/0.00
-----------------------------
Operations performed: 104857600 (208978.12 ops/sec)
102400.00 MB transferred (204.08 MB/sec)
Test execution summary:
total time: 501.7635s
total number of events: 104857600
total time taken by event execution: 385.3780
per-request statistics:
min: 0.00ms
avg: 0.00ms
max: 135.58ms
approx. 95 percentile: 0.00ms
Threads fairness:
events (avg/stddev): 104857600.0000/0.00
execution time (avg/stddev): 385.3780/0.00
************************************************
qemu:
************************************************
1)cpu:
Maximum prime number checked in CPU test: 10000
Test execution summary:
total time: 61.5733s
total number of events: 10000
total time taken by event execution: 123.0559
per-request statistics:
min: 2.69ms
avg: 12.31ms
max: 625.56ms
approx. 95 percentile: 9.83ms
Threads fairness:
events (avg/stddev): 5000.0000/152.00
execution time (avg/stddev): 61.5280/0.00
----------------------------------------------------
Maximum prime number checked in CPU test: 10000
Test execution summary:
total time: 61.4892s
total number of events: 10000
total time taken by event execution: 122.8914
per-request statistics:
min: 2.68ms
avg: 12.29ms
max: 627.49ms
approx. 95 percentile: 9.10ms
Threads fairness:
events (avg/stddev): 5000.0000/41.00
execution time (avg/stddev): 61.4457/0.01
----------------------------------------------------
Maximum prime number checked in CPU test: 10000
Test execution summary:
total time: 61.9808s
total number of events: 10000
total time taken by event execution: 123.8749
per-request statistics:
min: 2.68ms
avg: 12.39ms
max: 883.52ms
approx. 95 percentile: 13.39ms
Threads fairness:
events (avg/stddev): 5000.0000/153.00
execution time (avg/stddev): 61.9375/0.00
----------------------------------------------------
2)memory:
Running the test with following options:
Number of threads: 1
Doing memory operations speed test
Memory block size: 1K
Memory transfer size: 102400M
Memory operations type: write
Memory scope type: global
Threads started!
Done.
Operations performed: 104857600 (78081.42 ops/sec)
102400.00 MB transferred (76.25 MB/sec)
Test execution summary:
total time: 1342.9264s
total number of events: 104857600
total time taken by event execution: 1071.2745
per-request statistics:
min: 0.00ms
avg: 0.01ms
max: 136.22ms
approx. 95 percentile: 0.00ms
Threads fairness:
events (avg/stddev): 104857600.0000/0.00
execution time (avg/stddev): 1071.2745/0.00
------------------------
Operations performed: 104857600 (61608.49 ops/sec)
102400.00 MB transferred (60.16 MB/sec)
Test execution summary:
total time: 1701.9993s
total number of events: 104857600
total time taken by event execution: 1352.1831
per-request statistics:
min: 0.00ms
avg: 0.01ms
max: 131.81ms
approx. 95 percentile: 0.00ms
Threads fairness:
events (avg/stddev): 104857600.0000/0.00
execution time (avg/stddev): 1352.1831/0.00
************************************************
host:
cpu:
Test execution summary:
total time: 10.5083s
total number of events: 10000
total time taken by event execution: 21.0009
per-request statistics:
min: 1.04ms
avg: 2.10ms
max: 9.64ms
approx. 95 percentile: 5.08ms
Threads fairness:
events (avg/stddev): 5000.0000/1.00
execution time (avg/stddev): 10.5004/0.00
------------------------------------------------
Test execution summary:
total time: 10.5041s
total number of events: 10000
total time taken by event execution: 20.9935
per-request statistics:
min: 1.04ms
avg: 2.10ms
max: 9.10ms
approx. 95 percentile: 5.08ms
Threads fairness:
events (avg/stddev): 5000.0000/0.00
execution time (avg/stddev): 10.4968/0.00
-------------------------------------------------
Test execution summary:
total time: 10.5098s
total number of events: 10000
total time taken by event execution: 21.0013
per-request statistics:
min: 1.04ms
avg: 2.10ms
max: 10.80ms
approx. 95 percentile: 5.08ms
Threads fairness:
events (avg/stddev): 5000.0000/3.00
execution time (avg/stddev): 10.5007/0.00
memory:
Operations performed: 104857600 (216626.17 ops/sec)
102400.00 MB transferred (211.55 MB/sec)
Test execution summary:
total time: 484.0486s
total number of events: 104857600
total time taken by event execution: 369.9596
per-request statistics:
min: 0.00ms
avg: 0.00ms
max: 131.11ms
approx. 95 percentile: 0.00ms
Threads fairness:
events (avg/stddev): 104857600.0000/0.00
execution time (avg/stddev): 369.9596/0.00
------------------------------
Operations performed: 104857600 (217157.56 ops/sec)
102400.00 MB transferred (212.07 MB/sec)
Test execution summary:
total time: 482.8641s
total number of events: 104857600
total time taken by event execution: 363.4296
per-request statistics:
min: 0.00ms
avg: 0.00ms
max: 129.02ms
approx. 95 percentile: 0.00ms
Threads fairness:
events (avg/stddev): 104857600.0000/0.00
execution time (avg/stddev): 363.4296/0.00
************************************************
3, start time:
xenpv:
************************************************
Time to run a POD is 1186 ms
real 0m1.208s
user 0m0.012s
sys 0m0.011s
-----------------
Time to run a POD is 1136 ms
real 0m1.158s
user 0m0.005s
sys 0m0.016s
----------------------
Time to run a POD is 1221 ms
real 0m1.243s
user 0m0.011s
sys 0m0.011s
************************************************
qemu:
************************************************
Time to run a POD is 6253 ms
real 0m6.274s
user 0m0.005s
sys 0m0.014s
---------------------------
Time to run a POD is 5979 ms
real 0m6.001s
user 0m0.010s
sys 0m0.011s
----------------------------
Time to run a POD is 6054 ms
real 0m6.076s
user 0m0.005s
sys 0m0.016s
************************************************
host
block:
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment