Linux installation notes (tested under Ubuntu 14.04LTS/12.04LTS), assuming VirtualBox is already installed on host.
Yuan-Kuei Hsueh phstudy
phstudy
/ README.md
Created
July 1, 2014 05:49
— forked from magnetikonline/README.md
cd ~/.vagrant.d/boxes/puppetlab-centos-64-nocm/0/virtualbox/ VBoxManage clonehd "box-disk1.vmdk" "cloned-box-disk1.vdi" --format vdi VBoxManage modifyhd "cloned-box-disk1.vdi" --resize 81920 VBoxManage clonehd "cloned-box-disk1.vdi" "cloned-box-disk1.vmdk" --format vmdk # write down uuid
modify box.ovf
start an new vm and attach cloned-box-disk1.vmdk
fdisk /dev/sdX
phstudy
/ TestDFSIO_results.log
Created
May 19, 2014 10:31
JPS_HA 4 Nodes - 8GB/Node 2NN, 2DN, 2NM (VMs deployed on 4 different HDD and tuned JVM parameters)
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| ----- TestDFSIO ----- : write | |
| Date & time: Mon May 19 17:14:20 CST 2014 | |
| Number of files: 10 | |
| Total MBytes processed: 10000.0 | |
| Throughput mb/sec: 13.56559439686689 | |
| Average IO rate mb/sec: 13.863067626953125 | |
| IO rate std deviation: 2.1142203063369194 | |
| Test exec time sec: 321.241 | |
| ----- TestDFSIO ----- : write |
phstudy
/ TestDFSIO_results.log
Created
May 19, 2014 08:57
HA 4 Nodes - 8GB/Node 2NN, 2DN, 2NM (VMs deployed on 4 different HDD and tuned JVM parameters)
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| ----- TestDFSIO ----- : write | |
| Date & time: Mon May 19 11:11:17 CST 2014 | |
| Number of files: 10 | |
| Total MBytes processed: 10000.0 | |
| Throughput mb/sec: 15.226401361849337 | |
| Average IO rate mb/sec: 15.8214111328125 | |
| IO rate std deviation: 3.6683988613521583 | |
| Test exec time sec: 295.618 | |
| ----- TestDFSIO ----- : write |
phstudy
/ TestDFSIO_results.log
Last active
August 29, 2015 14:01
HA 4 Nodes - 8GB/Node 2NN, 3DN, 3NM (VMs deployed on 4 different HDD and tuned JVM parameters)
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| ----- TestDFSIO ----- : write | |
| Date & time: Sun May 18 08:15:05 CST 2014 | |
| Number of files: 10 | |
| Total MBytes processed: 10000.0 | |
| Throughput mb/sec: 9.214067669955782 | |
| Average IO rate mb/sec: 9.27421760559082 | |
| IO rate std deviation: 0.7552383706698728 | |
| Test exec time sec: 261.614 | |
| ----- TestDFSIO ----- : write |
phstudy
/ TestDFSIO_results.log
Created
May 17, 2014 23:55
HA 4 Nodes - 8GB/Node 2NN, 3DN, 3NM (VMs deployed on 4 different HDD)
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| ----- TestDFSIO ----- : read | |
| Date & time: Sun May 18 07:24:03 CST 2014 | |
| Number of files: 10 | |
| Total MBytes processed: 10000.0 | |
| Throughput mb/sec: 51.92404550623348 | |
| Average IO rate mb/sec: 65.51341247558594 | |
| IO rate std deviation: 30.326697909865505 | |
| Test exec time sec: 84.001 | |
| ----- TestDFSIO ----- : read |
phstudy
/ HA_1DN_1NM_read_TestDFSIO_results.log
Created
May 16, 2014 10:43
HA 4 Nodes - 8GB/Node 2NN, 1DN, 1NM
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| ----- TestDFSIO ----- : read | |
| Date & time: Fri May 16 17:43:43 CST 2014 | |
| Number of files: 10 | |
| Total MBytes processed: 10000.0 | |
| Throughput mb/sec: 80.46800189904485 | |
| Average IO rate mb/sec: 81.07865905761719 | |
| IO rate std deviation: 7.228150704445114 | |
| Test exec time sec: 187.542 | |
| ----- TestDFSIO ----- : read |
phstudy
/ HA_1DN_3NM_read_TestDFSIO_results.log
Created
May 16, 2014 10:43
HA 4 Nodes - 8GB/Node 2NN, 1DN, 3NM
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| ----- TestDFSIO ----- : read | |
| Date & time: Fri May 16 14:33:46 CST 2014 | |
| Number of files: 10 | |
| Total MBytes processed: 10000.0 | |
| Throughput mb/sec: 15.215165259517466 | |
| Average IO rate mb/sec: 15.31158447265625 | |
| IO rate std deviation: 1.1998894009063248 | |
| Test exec time sec: 176.768 | |
| ----- TestDFSIO ----- : read |
phstudy
/ HA_read_TestDFSIO_results.log
Created
May 16, 2014 05:43
HA 4 Nodes - 8GB/Node 2NN, 3DN, 3NM
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| ----- TestDFSIO ----- : read | |
| Date & time: Fri May 16 13:21:58 CST 2014 | |
| Number of files: 10 | |
| Total MBytes processed: 10000.0 | |
| Throughput mb/sec: 15.751603513237647 | |
| Average IO rate mb/sec: 26.165821075439453 | |
| IO rate std deviation: 16.41244162412394 | |
| Test exec time sec: 177.314 | |
| ----- TestDFSIO ----- : read |
phstudy
/ Bighadoop_read_TestDFSIO_results.log
Created
May 16, 2014 03:43
Bighadoop Single Node - 32GB NN, SNN, DN (without Hive & HBase)
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| ----- TestDFSIO ----- : read | |
| Date & time: Fri May 16 11:33:04 CST 2014 | |
| Number of files: 10 | |
| Total MBytes processed: 10000.0 | |
| Throughput mb/sec: 291.97932786358723 | |
| Average IO rate mb/sec: 328.28546142578125 | |
| IO rate std deviation: 105.94441144516256 | |
| Test exec time sec: 49.525 | |
| ----- TestDFSIO ----- : read |