Skip to content

Instantly share code, notes, and snippets.

@mfernest
Last active January 28, 2016 10:28
Show Gist options
  • Save mfernest/50c8b4d8ee0b5655eed2 to your computer and use it in GitHub Desktop.
Save mfernest/50c8b4d8ee0b5655eed2 to your computer and use it in GitHub Desktop.
Boot camp transcripts
[mboeru]
# sudo -u hdfs hadoop fs -put /tmp/social-landlord-rents-borough.xls /user/hdfs/social-landlord-rents-borough.xls
# sudo -u hdfs hdfs dfsadmin -allowSnapshot /user/hdfs
Allowing snaphot on /user/hdfs succeeded
# sudo -u hdfs hdfs dfs -createSnapshot /user/hdfs snap1
Created snapshot /user/hdfs/.snapshot/snap1
# sudo -u hdfs hadoop fs -put /tmp/social-landlord-rents-borough.xls /user/hdfs/social-landlord-rents-borough.xls
# sudo -u hdfs hdfs dfsadmin -allowSnapshot /user/hdfs
Allowing snaphot on /user/hdfs succeeded
# sudo -u hdfs hdfs dfs -createSnapshot /user/hdfs snap1
Created snapshot /user/hdfs/.snapshot/snap1
# sudo -u hdfs hadoop fs -ls /user/hdfs
Found 3 items
drwx------ - hdfs supergroup 0 2016-01-26 10:25 /user/hdfs/.Trash
drwx------ - hdfs supergroup 0 2016-01-26 11:25 /user/hdfs/.staging
-rw-r--r-- 3 hdfs supergroup 58368 2016-01-26 12:20 /user/hdfs/social-landlord-rents-borough.xls
# sudo -u hdfs hadoop fs -rm /user/hdfs/social-landlord-rents-borough.xls
16/01/26 12:32:20 INFO fs.TrashPolicyDefault: Namenode trash configuration: Deletion interval = 1440 minutes, Emptier interval = 0 minutes.
Moved: 'hdfs://nameservice1/user/hdfs/social-landlord-rents-borough.xls' to trash at: hdfs://nameservice1/user/hdfs/.Trash/Current
# sudo -u hdfs hadoop fs -rm -skipTrash /user/hdfs/.Trash/Current/user/hdfs/social-landlord-rents-borough.xls
Deleted /user/hdfs/.Trash/Current/user/hdfs/social-landlord-rents-borough.xls
# sudo -u hdfs hdfs dfs -lsr /user/hdfs/.snapshot
lsr: DEPRECATED: Please use 'ls -R' instead.
drwx------ - hdfs supergroup 0 2016-01-26 12:23 /user/hdfs/.snapshot/snap1
drwx------ - hdfs supergroup 0 2016-01-26 10:25 /user/hdfs/.snapshot/snap1/.Trash
drwx------ - hdfs supergroup 0 2016-01-26 12:32 /user/hdfs/.snapshot/snap1/.Trash/Current
drwx------ - hdfs supergroup 0 2016-01-26 10:32 /user/hdfs/.snapshot/snap1/.Trash/Current/tmp
drwx------ - hdfs supergroup 0 2016-01-26 11:31 /user/hdfs/.snapshot/snap1/.Trash/Current/tmp/ArnaudDelanoue
-rw-r--r-- 3 hdfs supergroup 0 2016-01-26 12:09 /user/hdfs/.snapshot/snap1/.Trash/Current/tmp/ArnaudDelanoue/.distcp.tmp.attempt_local443579124_0001_m_000000_0
-rw-r--r-- 3 hdfs supergroup 0 2016-01-26 12:09 /user/hdfs/.snapshot/snap1/.Trash/Current/tmp/ArnaudDelanoue/.distcp.tmp.attempt_local68980338_0001_m_000000_0
-rw-r--r-- 3 hdfs supergroup 1000000000 2016-01-26 10:47 /user/hdfs/.snapshot/snap1/.Trash/Current/tmp/ArnaudDelanoue/part-m-00000
drwxr-xr-x - root supergroup 0 2016-01-26 10:23 /user/hdfs/.snapshot/snap1/.Trash/Current/tmp/mboeru
drwx------ - hdfs supergroup 0 2016-01-26 11:25 /user/hdfs/.snapshot/snap1/.staging
-rw-r--r-- 3 hdfs supergroup 58368 2016-01-26 12:20 /user/hdfs/.snapshot/snap1/social-landlord-rents-borough.xls
# sudo -u hdfs hdfs dfs -cp /user/hdfs/.snapshot/snap1/social-landlord-rents-borough.xls /user/hdfs/social-landlord-rents-borough.xls
# sudo -u hdfs hdfs dfs -ls /user/hdfs/
Found 3 items
drwx------ - hdfs supergroup 0 2016-01-26 10:25 /user/hdfs/.Trash
drwx------ - hdfs supergroup 0 2016-01-26 11:25 /user/hdfs/.staging
-rw-r--r-- 3 hdfs supergroup 58368 2016-01-26 12:36 /user/hdfs/social-landlord-rents-borough.xls
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment