Skip to content

Instantly share code, notes, and snippets.

@akm
Last active November 19, 2015 04:23
Show Gist options
  • Save akm/98d3367cdefb554154a7 to your computer and use it in GitHub Desktop.
Save akm/98d3367cdefb554154a7 to your computer and use it in GitHub Desktop.
hbase shellからexportする方法 ref: http://qiita.com/akm/items/84d918270f158a144c2f
hbase(main):041:0* org.apache.hadoop.hbase.mapreduce.Export.main(["foo", "/tmp/foo.dump"])
2015-11-19 03:28:11,249 INFO [main] Configuration.deprecation: session.id is deprecated. Instead, use dfs.metrics.session-id
(snip)
2015-11-19 03:16:44,307 INFO [main] mapreduce.Job: Job job_local2087152213_0001 completed successfully
2015-11-19 03:16:44,327 INFO [main] mapreduce.Job: Counters: 18
File System Counters
FILE: Number of bytes read=74629416
FILE: Number of bytes written=843785016
FILE: Number of read operations=0
FILE: Number of large read operations=0
FILE: Number of write operations=0
Map-Reduce Framework
Map input records=3127
Map output records=3127
Input split bytes=357
Spilled Records=0
Failed Shuffles=0
Merged Map outputs=0
GC time elapsed (ms)=106
CPU time spent (ms)=0
Physical memory (bytes) snapshot=0
Virtual memory (bytes) snapshot=0
Total committed heap usage (bytes)=3116630016
File Input Format Counters
Bytes Read=0
File Output Format Counters
Bytes Written=377205884
$
$ puts `ls -la /tmp`
bash: puts: command not found
args = [t, "/tmp/#{t}"]
conf = org.apache.hadoop.hbase.HBaseConfiguration.create();
job = org.apache.hadoop.hbase.mapreduce.Export.createSubmittableJob(conf, args);
job.waitForCompletion(true)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment