Skip to content

Instantly share code, notes, and snippets.

@y3nr1ng
Created March 10, 2019 03:29
Show Gist options
  • Save y3nr1ng/e92dd91e6ae2d1cc55f7a4195d0cf719 to your computer and use it in GitHub Desktop.
Save y3nr1ng/e92dd91e6ae2d1cc55f7a4195d0cf719 to your computer and use it in GitHub Desktop.
Parallel Duplicate
# all operations work under SOURCE
cd SOURCE
# list files
rsync -avzm --stats --safe-links --ignore-existing --dry-run --human-readable \
SOURCE DESTINATION > FILE_LIST
# rsync files
cat FILE_LIST | parallel --will-cite -j NUM_THREADS \
rsync -avzm --relative --stats --safe-links --ignore-existing --human-readable {} \
DESTINATION > LOG_FILE
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment