Skip to content

Instantly share code, notes, and snippets.

@sankars
Last active October 8, 2015 17:42
Show Gist options
  • Select an option

  • Save sankars/7bae0988c23dd8beea69 to your computer and use it in GitHub Desktop.

Select an option

Save sankars/7bae0988c23dd8beea69 to your computer and use it in GitHub Desktop.
HDFS common commands
## run hdfs balancer
sudo -u hdfs hdfs balancer
## hdfs health check
sudo -u hdfs hdfs fsck
## restore deleted files. For hive user
hdfs mv /User/hive/.Trash/source /target
## set replication
sudo -u hdfs hdfs dfs -setrep -w 1 /
## check size
hadoop fs -du -h /user/hive/warehouse/smarttv.db/programdata
hadoop fs -du -s -h /user/hive/warehouse/smarttv.db/programdata
## clear trash
hdfs dfs -expunge
## format namenode
sudo -u hdfs hadoop namenode -format
## distcp
sudo -u hdfs hadoop distcp /hbase hdfs://172.27.140.78/
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment