Skip to content

Instantly share code, notes, and snippets.

@qrtt1
Last active August 29, 2015 14:01
Show Gist options
  • Save qrtt1/577c6ea2f8be9795426a to your computer and use it in GitHub Desktop.
Save qrtt1/577c6ea2f8be9795426a to your computer and use it in GitHub Desktop.
etu-misc
http://www.commandlinefu.com/commands/view/1026/empty-the-linux-buffer-cache
sync && echo 3 > /proc/sys/vm/drop_caches
ity-scheduler/*.jar
STARTUP_MSG: build = https://svn.apache.org/repos/asf/hadoop/common -r 1529768; compiled by 'hortonmu' on 2013-10-07T06:28Z
STARTUP_MSG: java = 1.7.0_45
************************************************************/
14/05/23 13:45:45 INFO datanode.DataNode: registered UNIX signal handlers for [TERM, HUP, INT]
14/05/23 13:45:49 INFO security.UserGroupInformation: Login successful for user hdfs/[email protected] using keytab file /tmp/kt2/hdfs.keytab
14/05/23 13:45:50 INFO impl.MetricsConfig: loaded properties from hadoop-metrics2.properties
14/05/23 13:45:50 INFO impl.MetricsSystemImpl: Scheduled snapshot period at 10 second(s).
14/05/23 13:45:50 INFO impl.MetricsSystemImpl: DataNode metrics system started
14/05/23 13:45:50 INFO datanode.DataNode: Configured hostname is node4
14/05/23 13:45:50 FATAL datanode.DataNode: Exception in secureMain
java.lang.RuntimeException: Cannot start secure cluster without privileged resources.
at org.apache.hadoop.hdfs.server.datanode.DataNode.startDataNode(DataNode.java:648)
at org.apache.hadoop.hdfs.server.datanode.DataNode.<init>(DataNode.java:259)
at org.apache.hadoop.hdfs.server.datanode.DataNode.makeInstance(DataNode.java:1727)
at org.apache.hadoop.hdfs.server.datanode.DataNode.instantiateDataNode(DataNode.java:1642)
at org.apache.hadoop.hdfs.server.datanode.DataNode.createDataNode(DataNode.java:1665)
at org.apache.hadoop.hdfs.server.datanode.DataNode.secureMain(DataNode.java:1837)
at org.apache.hadoop.hdfs.server.datanode.DataNode.main(DataNode.java:1858)
14/05/23 13:45:50 INFO util.ExitUtil: Exiting with status 1
14/05/23 13:45:50 INFO datanode.DataNode: SHUTDOWN_MSG:
/************************************************************
SHUTDOWN_MSG: Shutting down DataNode at node4/172.31.14.111
************************************************************/
2014-05-28 00:04:24,348 INFO org.apache.hadoop.util.JvmPauseMonitor: Detected pause in JVM or host machine (eg GC): pause of approximately 1664ms
No GCs detected
14/05/27 14:12:23 INFO fs.TestDFSIO: ----- TestDFSIO ----- : write
14/05/27 14:12:23 INFO fs.TestDFSIO: Date & time: Tue May 27 14:12:23 UTC 2014
14/05/27 14:12:23 INFO fs.TestDFSIO: Number of files: 10
14/05/27 14:12:23 INFO fs.TestDFSIO: Total MBytes processed: 10000.0
14/05/27 14:12:23 INFO fs.TestDFSIO: Throughput mb/sec: 5.83145123244806
14/05/27 14:12:23 INFO fs.TestDFSIO: Average IO rate mb/sec: 5.881524085998535
14/05/27 14:12:23 INFO fs.TestDFSIO: IO rate std deviation: 0.5480157072291605
14/05/27 14:12:23 INFO fs.TestDFSIO: Test exec time sec: 1243.406
14/05/27 14:12:23 INFO fs.TestDFSIO:
14/05/27 14:29:09 INFO fs.TestDFSIO: ----- TestDFSIO ----- : write
14/05/27 14:29:09 INFO fs.TestDFSIO: Date & time: Tue May 27 14:29:09 UTC 2014
14/05/27 14:29:09 INFO fs.TestDFSIO: Number of files: 10
14/05/27 14:29:09 INFO fs.TestDFSIO: Total MBytes processed: 10000.0
14/05/27 14:29:09 INFO fs.TestDFSIO: Throughput mb/sec: 6.629976377394168
14/05/27 14:29:09 INFO fs.TestDFSIO: Average IO rate mb/sec: 6.688625335693359
14/05/27 14:29:09 INFO fs.TestDFSIO: IO rate std deviation: 0.6456076565239154
14/05/27 14:29:09 INFO fs.TestDFSIO: Test exec time sec: 873.427
14/05/27 14:43:42 INFO fs.TestDFSIO: ----- TestDFSIO ----- : write
14/05/27 14:43:42 INFO fs.TestDFSIO: Date & time: Tue May 27 14:43:42 UTC 2014
14/05/27 14:43:42 INFO fs.TestDFSIO: Number of files: 10
14/05/27 14:43:42 INFO fs.TestDFSIO: Total MBytes processed: 10000.0
14/05/27 14:43:42 INFO fs.TestDFSIO: Throughput mb/sec: 6.662686821738482
14/05/27 14:43:42 INFO fs.TestDFSIO: Average IO rate mb/sec: 6.711602687835693
14/05/27 14:43:42 INFO fs.TestDFSIO: IO rate std deviation: 0.5996107891204637
14/05/27 14:43:42 INFO fs.TestDFSIO: Test exec time sec: 858.609
14/05/27 14:43:42 INFO fs.TestDFSIO:
14/05/28 00:15:45 INFO fs.TestDFSIO: ----- TestDFSIO ----- : write
14/05/28 00:15:45 INFO fs.TestDFSIO: Date & time: Wed May 28 00:15:45 UTC 2014
14/05/28 00:15:45 INFO fs.TestDFSIO: Number of files: 10
14/05/28 00:15:45 INFO fs.TestDFSIO: Total MBytes processed: 10000.0
14/05/28 00:15:45 INFO fs.TestDFSIO: Throughput mb/sec: 7.790849958357907
14/05/28 00:15:45 INFO fs.TestDFSIO: Average IO rate mb/sec: 7.84994649887085
14/05/28 00:15:45 INFO fs.TestDFSIO: IO rate std deviation: 0.6850474268781115
14/05/28 00:15:45 INFO fs.TestDFSIO: Test exec time sec: 743.342
14/05/28 00:15:45 INFO fs.TestDFSIO:
14/05/28 00:31:20 INFO fs.TestDFSIO: ----- TestDFSIO ----- : write
14/05/28 00:31:20 INFO fs.TestDFSIO: Date & time: Wed May 28 00:31:20 UTC 2014
14/05/28 00:31:20 INFO fs.TestDFSIO: Number of files: 10
14/05/28 00:31:20 INFO fs.TestDFSIO: Total MBytes processed: 10000.0
14/05/28 00:31:20 INFO fs.TestDFSIO: Throughput mb/sec: 8.164165030431926
14/05/28 00:31:20 INFO fs.TestDFSIO: Average IO rate mb/sec: 8.180898666381836
14/05/28 00:31:20 INFO fs.TestDFSIO: IO rate std deviation: 0.37204603293984095
14/05/28 00:31:20 INFO fs.TestDFSIO: Test exec time sec: 715.908
14/05/28 00:42:47 INFO fs.TestDFSIO: ----- TestDFSIO ----- : write
14/05/28 00:42:47 INFO fs.TestDFSIO: Date & time: Wed May 28 00:42:47 UTC 2014
14/05/28 00:42:47 INFO fs.TestDFSIO: Number of files: 10
14/05/28 00:42:47 INFO fs.TestDFSIO: Total MBytes processed: 10000.0
14/05/28 00:42:47 INFO fs.TestDFSIO: Throughput mb/sec: 8.814222629635179
14/05/28 00:42:47 INFO fs.TestDFSIO: Average IO rate mb/sec: 8.867423057556152
14/05/28 00:42:47 INFO fs.TestDFSIO: IO rate std deviation: 0.6978996586586595
14/05/28 00:42:47 INFO fs.TestDFSIO: Test exec time sec: 682.948
14/05/28 00:54:23 INFO fs.TestDFSIO: ----- TestDFSIO ----- : write
14/05/28 00:54:23 INFO fs.TestDFSIO: Date & time: Wed May 28 00:54:23 UTC 2014
14/05/28 00:54:23 INFO fs.TestDFSIO: Number of files: 10
14/05/28 00:54:23 INFO fs.TestDFSIO: Total MBytes processed: 10000.0
14/05/28 00:54:23 INFO fs.TestDFSIO: Throughput mb/sec: 8.635243017326616
14/05/28 00:54:23 INFO fs.TestDFSIO: Average IO rate mb/sec: 8.663406372070312
14/05/28 00:54:23 INFO fs.TestDFSIO: IO rate std deviation: 0.4870779103695256
14/05/28 00:54:23 INFO fs.TestDFSIO: Test exec time sec: 690.264
14/05/28 01:06:04 INFO fs.TestDFSIO: ----- TestDFSIO ----- : write
14/05/28 01:06:04 INFO fs.TestDFSIO: Date & time: Wed May 28 01:06:04 UTC 2014
14/05/28 01:06:04 INFO fs.TestDFSIO: Number of files: 10
14/05/28 01:06:04 INFO fs.TestDFSIO: Total MBytes processed: 10000.0
14/05/28 01:06:04 INFO fs.TestDFSIO: Throughput mb/sec: 8.471044276454224
14/05/28 01:06:04 INFO fs.TestDFSIO: Average IO rate mb/sec: 8.49848461151123
14/05/28 01:06:04 INFO fs.TestDFSIO: IO rate std deviation: 0.4956346609010488
14/05/28 01:06:04 INFO fs.TestDFSIO: Test exec time sec: 696.225
14/05/28 01:28:55 INFO fs.TestDFSIO: ----- TestDFSIO ----- : write
14/05/28 01:28:55 INFO fs.TestDFSIO: Date & time: Wed May 28 01:28:55 UTC 2014
14/05/28 01:28:55 INFO fs.TestDFSIO: Number of files: 10
14/05/28 01:28:55 INFO fs.TestDFSIO: Total MBytes processed: 10000.0
14/05/28 01:28:55 INFO fs.TestDFSIO: Throughput mb/sec: 8.951485633313133
14/05/28 01:28:55 INFO fs.TestDFSIO: Average IO rate mb/sec: 8.98818588256836
14/05/28 01:28:55 INFO fs.TestDFSIO: IO rate std deviation: 0.578472669420112
14/05/28 01:28:55 INFO fs.TestDFSIO: Test exec time sec: 664.647
14/05/28 13:01:59 INFO fs.TestDFSIO: ----- TestDFSIO ----- : write
14/05/28 13:01:59 INFO fs.TestDFSIO: Date & time: Wed May 28 13:01:59 UTC 2014
14/05/28 13:01:59 INFO fs.TestDFSIO: Number of files: 10
14/05/28 13:01:59 INFO fs.TestDFSIO: Total MBytes processed: 10000.0
14/05/28 13:01:59 INFO fs.TestDFSIO: Throughput mb/sec: 32.75262921731042
14/05/28 13:01:59 INFO fs.TestDFSIO: Average IO rate mb/sec: 56.817298889160156
14/05/28 13:01:59 INFO fs.TestDFSIO: IO rate std deviation: 25.99846217031096
14/05/28 13:01:59 INFO fs.TestDFSIO: Test exec time sec: 240.859
14/05/28 13:01:59 INFO fs.TestDFSIO:
--
14/05/28 13:06:04 INFO fs.TestDFSIO: ----- TestDFSIO ----- : write
14/05/28 13:06:04 INFO fs.TestDFSIO: Date & time: Wed May 28 13:06:04 UTC 2014
14/05/28 13:06:04 INFO fs.TestDFSIO: Number of files: 10
14/05/28 13:06:04 INFO fs.TestDFSIO: Total MBytes processed: 10000.0
14/05/28 13:06:04 INFO fs.TestDFSIO: Throughput mb/sec: 33.18797002462547
14/05/28 13:06:04 INFO fs.TestDFSIO: Average IO rate mb/sec: 56.3619384765625
14/05/28 13:06:04 INFO fs.TestDFSIO: IO rate std deviation: 26.03947117613823
14/05/28 13:06:04 INFO fs.TestDFSIO: Test exec time sec: 237.351
14/05/28 13:06:04 INFO fs.TestDFSIO:
--
14/05/28 13:10:04 INFO fs.TestDFSIO: ----- TestDFSIO ----- : write
14/05/28 13:10:04 INFO fs.TestDFSIO: Date & time: Wed May 28 13:10:04 UTC 2014
14/05/28 13:10:04 INFO fs.TestDFSIO: Number of files: 10
14/05/28 13:10:04 INFO fs.TestDFSIO: Total MBytes processed: 10000.0
14/05/28 13:10:04 INFO fs.TestDFSIO: Throughput mb/sec: 34.46600101330043
14/05/28 13:10:04 INFO fs.TestDFSIO: Average IO rate mb/sec: 59.10173416137695
14/05/28 13:10:04 INFO fs.TestDFSIO: IO rate std deviation: 26.845080721832044
14/05/28 13:10:04 INFO fs.TestDFSIO: Test exec time sec: 235.238
14/05/28 13:10:04 INFO fs.TestDFSIO:
--
14/05/28 13:13:52 INFO fs.TestDFSIO: ----- TestDFSIO ----- : write
14/05/28 13:13:52 INFO fs.TestDFSIO: Date & time: Wed May 28 13:13:52 UTC 2014
14/05/28 13:13:52 INFO fs.TestDFSIO: Number of files: 10
14/05/28 13:13:52 INFO fs.TestDFSIO: Total MBytes processed: 10000.0
14/05/28 13:13:52 INFO fs.TestDFSIO: Throughput mb/sec: 37.48097840346024
14/05/28 13:13:52 INFO fs.TestDFSIO: Average IO rate mb/sec: 64.90235900878906
14/05/28 13:13:52 INFO fs.TestDFSIO: IO rate std deviation: 30.737194141430788
14/05/28 13:13:52 INFO fs.TestDFSIO: Test exec time sec: 222.807
14/05/28 13:13:52 INFO fs.TestDFSIO:
--
14/05/28 13:17:43 INFO fs.TestDFSIO: ----- TestDFSIO ----- : write
14/05/28 13:17:43 INFO fs.TestDFSIO: Date & time: Wed May 28 13:17:43 UTC 2014
14/05/28 13:17:43 INFO fs.TestDFSIO: Number of files: 10
14/05/28 13:17:43 INFO fs.TestDFSIO: Total MBytes processed: 10000.0
14/05/28 13:17:43 INFO fs.TestDFSIO: Throughput mb/sec: 34.810457061301214
14/05/28 13:17:43 INFO fs.TestDFSIO: Average IO rate mb/sec: 59.74126434326172
14/05/28 13:17:43 INFO fs.TestDFSIO: IO rate std deviation: 28.26038399276496
14/05/28 13:17:43 INFO fs.TestDFSIO: Test exec time sec: 225.651
14/05/28 13:17:43 INFO fs.TestDFSIO:
--
14/05/28 13:21:44 INFO fs.TestDFSIO: ----- TestDFSIO ----- : write
14/05/28 13:21:44 INFO fs.TestDFSIO: Date & time: Wed May 28 13:21:44 UTC 2014
14/05/28 13:21:44 INFO fs.TestDFSIO: Number of files: 10
14/05/28 13:21:44 INFO fs.TestDFSIO: Total MBytes processed: 10000.0
14/05/28 13:21:44 INFO fs.TestDFSIO: Throughput mb/sec: 33.34222459322486
14/05/28 13:21:44 INFO fs.TestDFSIO: Average IO rate mb/sec: 58.749977111816406
14/05/28 13:21:44 INFO fs.TestDFSIO: IO rate std deviation: 31.69898944049397
14/05/28 13:21:44 INFO fs.TestDFSIO: Test exec time sec: 236.913
14/05/28 13:21:44 INFO fs.TestDFSIO:
--
14/05/28 13:25:41 INFO fs.TestDFSIO: ----- TestDFSIO ----- : write
14/05/28 13:25:41 INFO fs.TestDFSIO: Date & time: Wed May 28 13:25:41 UTC 2014
14/05/28 13:25:41 INFO fs.TestDFSIO: Number of files: 10
14/05/28 13:25:41 INFO fs.TestDFSIO: Total MBytes processed: 10000.0
14/05/28 13:25:41 INFO fs.TestDFSIO: Throughput mb/sec: 34.20943701529504
14/05/28 13:25:41 INFO fs.TestDFSIO: Average IO rate mb/sec: 57.22454833984375
14/05/28 13:25:41 INFO fs.TestDFSIO: IO rate std deviation: 26.414209098530396
14/05/28 13:25:41 INFO fs.TestDFSIO: Test exec time sec: 230.771
14/05/28 13:25:41 INFO fs.TestDFSIO:
--
14/05/28 13:30:03 INFO fs.TestDFSIO: ----- TestDFSIO ----- : write
14/05/28 13:30:03 INFO fs.TestDFSIO: Date & time: Wed May 28 13:30:03 UTC 2014
14/05/28 13:30:03 INFO fs.TestDFSIO: Number of files: 10
14/05/28 13:30:03 INFO fs.TestDFSIO: Total MBytes processed: 10000.0
14/05/28 13:30:03 INFO fs.TestDFSIO: Throughput mb/sec: 30.194695395912845
14/05/28 13:30:03 INFO fs.TestDFSIO: Average IO rate mb/sec: 54.21417999267578
14/05/28 13:30:03 INFO fs.TestDFSIO: IO rate std deviation: 26.591375522429786
14/05/28 13:30:03 INFO fs.TestDFSIO: Test exec time sec: 256.948
14/05/28 13:30:03 INFO fs.TestDFSIO:
--
14/05/28 13:34:11 INFO fs.TestDFSIO: ----- TestDFSIO ----- : write
14/05/28 13:34:11 INFO fs.TestDFSIO: Date & time: Wed May 28 13:34:11 UTC 2014
14/05/28 13:34:11 INFO fs.TestDFSIO: Number of files: 10
14/05/28 13:34:11 INFO fs.TestDFSIO: Total MBytes processed: 10000.0
14/05/28 13:34:11 INFO fs.TestDFSIO: Throughput mb/sec: 33.28761833748319
14/05/28 13:34:11 INFO fs.TestDFSIO: Average IO rate mb/sec: 58.82111740112305
14/05/28 13:34:11 INFO fs.TestDFSIO: IO rate std deviation: 26.364972827874286
14/05/28 13:34:11 INFO fs.TestDFSIO: Test exec time sec: 242.726
14/05/28 13:34:11 INFO fs.TestDFSIO:
14/05/28 03:31:24 INFO fs.TestDFSIO: ----- TestDFSIO ----- : write
14/05/28 03:31:24 INFO fs.TestDFSIO: Date & time: Wed May 28 03:31:24 UTC 2014
14/05/28 03:31:24 INFO fs.TestDFSIO: Number of files: 10
14/05/28 03:31:24 INFO fs.TestDFSIO: Total MBytes processed: 10000.0
14/05/28 03:31:24 INFO fs.TestDFSIO: Throughput mb/sec: 13.778564686916564
14/05/28 03:31:24 INFO fs.TestDFSIO: Average IO rate mb/sec: 13.81797981262207
14/05/28 03:31:24 INFO fs.TestDFSIO: IO rate std deviation: 0.7363069246087172
14/05/28 03:31:24 INFO fs.TestDFSIO: Test exec time sec: 452.293
14/05/28 03:35:16 INFO fs.TestDFSIO: ----- TestDFSIO ----- : write
14/05/28 03:35:16 INFO fs.TestDFSIO: Date & time: Wed May 28 03:35:16 UTC 2014
14/05/28 03:35:16 INFO fs.TestDFSIO: Number of files: 10
14/05/28 03:35:16 INFO fs.TestDFSIO: Total MBytes processed: 10000.0
14/05/28 03:35:16 INFO fs.TestDFSIO: Throughput mb/sec: 37.948791900209855
14/05/28 03:35:16 INFO fs.TestDFSIO: Average IO rate mb/sec: 65.73049926757812
14/05/28 03:35:16 INFO fs.TestDFSIO: IO rate std deviation: 28.28364114925643
14/05/28 03:35:16 INFO fs.TestDFSIO: Test exec time sec: 227.037
14/05/28 03:42:38 INFO fs.TestDFSIO: ----- TestDFSIO ----- : write
14/05/28 03:42:38 INFO fs.TestDFSIO: Date & time: Wed May 28 03:42:38 UTC 2014
14/05/28 03:42:38 INFO fs.TestDFSIO: Number of files: 10
14/05/28 03:42:38 INFO fs.TestDFSIO: Total MBytes processed: 10000.0
14/05/28 03:42:38 INFO fs.TestDFSIO: Throughput mb/sec: 14.409616401601774
14/05/28 03:42:38 INFO fs.TestDFSIO: Average IO rate mb/sec: 14.420265197753906
14/05/28 03:42:38 INFO fs.TestDFSIO: IO rate std deviation: 0.39071963288990236
14/05/28 03:42:38 INFO fs.TestDFSIO: Test exec time sec: 437.532
14/05/28 03:49:59 INFO fs.TestDFSIO: ----- TestDFSIO ----- : write
14/05/28 03:49:59 INFO fs.TestDFSIO: Date & time: Wed May 28 03:49:59 UTC 2014
14/05/28 03:49:59 INFO fs.TestDFSIO: Number of files: 10
14/05/28 03:49:59 INFO fs.TestDFSIO: Total MBytes processed: 10000.0
14/05/28 03:49:59 INFO fs.TestDFSIO: Throughput mb/sec: 14.076299172032083
14/05/28 03:49:59 INFO fs.TestDFSIO: Average IO rate mb/sec: 14.172903060913086
14/05/28 03:49:59 INFO fs.TestDFSIO: IO rate std deviation: 1.169700264500688
14/05/28 03:49:59 INFO fs.TestDFSIO: Test exec time sec: 437.404
14/05/28 03:57:28 INFO fs.TestDFSIO: ----- TestDFSIO ----- : write
14/05/28 03:57:28 INFO fs.TestDFSIO: Date & time: Wed May 28 03:57:28 UTC 2014
14/05/28 03:57:28 INFO fs.TestDFSIO: Number of files: 10
14/05/28 03:57:28 INFO fs.TestDFSIO: Total MBytes processed: 10000.0
14/05/28 03:57:28 INFO fs.TestDFSIO: Throughput mb/sec: 13.873858875107523
14/05/28 03:57:28 INFO fs.TestDFSIO: Average IO rate mb/sec: 13.958587646484375
14/05/28 03:57:28 INFO fs.TestDFSIO: IO rate std deviation: 1.0755503598375156
14/05/28 03:57:28 INFO fs.TestDFSIO: Test exec time sec: 444.337
14/05/28 04:04:38 INFO fs.TestDFSIO: ----- TestDFSIO ----- : write
14/05/28 04:04:38 INFO fs.TestDFSIO: Date & time: Wed May 28 04:04:38 UTC 2014
14/05/28 04:04:38 INFO fs.TestDFSIO: Number of files: 10
14/05/28 04:04:38 INFO fs.TestDFSIO: Total MBytes processed: 10000.0
14/05/28 04:04:38 INFO fs.TestDFSIO: Throughput mb/sec: 14.644397419657174
14/05/28 04:04:38 INFO fs.TestDFSIO: Average IO rate mb/sec: 14.661384582519531
14/05/28 04:04:38 INFO fs.TestDFSIO: IO rate std deviation: 0.49627235901061967
14/05/28 04:04:38 INFO fs.TestDFSIO: Test exec time sec: 424.97
14/05/28 04:12:04 INFO fs.TestDFSIO: ----- TestDFSIO ----- : write
14/05/28 04:12:04 INFO fs.TestDFSIO: Date & time: Wed May 28 04:12:04 UTC 2014
14/05/28 04:12:04 INFO fs.TestDFSIO: Number of files: 10
14/05/28 04:12:04 INFO fs.TestDFSIO: Total MBytes processed: 10000.0
14/05/28 04:12:04 INFO fs.TestDFSIO: Throughput mb/sec: 14.5883602391324
14/05/28 04:12:04 INFO fs.TestDFSIO: Average IO rate mb/sec: 14.6036376953125
14/05/28 04:12:04 INFO fs.TestDFSIO: IO rate std deviation: 0.4645169014612126
14/05/28 04:12:04 INFO fs.TestDFSIO: Test exec time sec: 442.226
14/05/28 04:18:56 INFO fs.TestDFSIO: ----- TestDFSIO ----- : write
14/05/28 04:18:56 INFO fs.TestDFSIO: Date & time: Wed May 28 04:18:56 UTC 2014
14/05/28 04:18:56 INFO fs.TestDFSIO: Number of files: 10
14/05/28 04:18:56 INFO fs.TestDFSIO: Total MBytes processed: 10000.0
14/05/28 04:18:56 INFO fs.TestDFSIO: Throughput mb/sec: 15.47436671154233
14/05/28 04:18:56 INFO fs.TestDFSIO: Average IO rate mb/sec: 15.491287231445312
14/05/28 04:18:56 INFO fs.TestDFSIO: IO rate std deviation: 0.5032551663607637
14/05/28 04:18:56 INFO fs.TestDFSIO: Test exec time sec: 407.678
14/05/28 04:26:02 INFO fs.TestDFSIO: ----- TestDFSIO ----- : write
14/05/28 04:26:02 INFO fs.TestDFSIO: Date & time: Wed May 28 04:26:02 UTC 2014
14/05/28 04:26:02 INFO fs.TestDFSIO: Number of files: 10
14/05/28 04:26:02 INFO fs.TestDFSIO: Total MBytes processed: 10000.0
14/05/28 04:26:02 INFO fs.TestDFSIO: Throughput mb/sec: 14.406544028559534
14/05/28 04:26:02 INFO fs.TestDFSIO: Average IO rate mb/sec: 14.418968200683594
14/05/28 04:26:02 INFO fs.TestDFSIO: IO rate std deviation: 0.4197025340982014
14/05/28 04:26:02 INFO fs.TestDFSIO: Test exec time sec: 421.356
[hdfs@vm4 ~]$ hdfs dfsadmin -report
Configured Capacity: 63837060711 (59.45 GB)
Present Capacity: 60264034304 (56.13 GB)
DFS Remaining: 49629675520 (46.22 GB)
DFS Used: 10634358784 (9.90 GB)
DFS Used%: 17.65%
Under replicated blocks: 157
Blocks with corrupt replicas: 0
Missing blocks: 0
-------------------------------------------------
Datanodes available: 2 (2 total, 0 dead)
Live datanodes:
Name: 192.168.90.13:1004 (vm3)
Hostname: vm3
Rack: /default
Decommission Status : Normal
Configured Capacity: 63837060711 (59.45 GB)
DFS Used: 10634334208 (9.90 GB)
Non DFS Used: 3573050983 (3.33 GB)
DFS Remaining: 49629675520 (46.22 GB)
DFS Used%: 16.66%
DFS Remaining%: 77.74%
Configured Cache Capacity: 601882624 (574 MB)
Cache Used: 0 (0 B)
Cache Remaining: 601882624 (574 MB)
Cache Used%: 0.00%
Cache Remaining%: 100.00%
Last contact: Wed May 28 15:15:52 UTC 2014
Name: 192.168.90.14:1004 (vm4)
Hostname: vm4
Rack: /default
Decommission Status : Normal
Configured Capacity: 0 (0 B)
DFS Used: 24576 (24 KB)
Non DFS Used: 0 (0 B)
DFS Remaining: 0 (0 B)
DFS Used%: 100.00%
DFS Remaining%: 0.00%
Configured Cache Capacity: 694157312 (662 MB)
Cache Used: 0 (0 B)
Cache Remaining: 694157312 (662 MB)
Cache Used%: 0.00%
Cache Remaining%: 100.00%
Last contact: Wed May 28 15:15:52 UTC 2014
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment