Skip to content

Instantly share code, notes, and snippets.

@bepcyc
Created August 22, 2014 17:11
Show Gist options
  • Select an option

  • Save bepcyc/fc13e6986a83e8176df5 to your computer and use it in GitHub Desktop.

Select an option

Save bepcyc/fc13e6986a83e8176df5 to your computer and use it in GitHub Desktop.
yarn node -list -all 2>>/dev/null|cut -f3|grep -v "Total Nodes"|grep -P "\:\d{2,}$"|cut -d':' -f1
hadoop fs -mkdir /tmp/${tmp_dir}
hadoop fs -put ${dest} /tmp/${tmp_dir}/
pdsh hadoop fs -get /tmp/${tmp_dir}/${dest}
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment