Last active
July 2, 2022 12:23
-
-
Save ryanjdillon/46fdca9b131cb45d2a90bcff5608f998 to your computer and use it in GitHub Desktop.
Sync data to S3 with `aws s3 sync`, an AWS `rsync` emulator
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| # Install the aws cli | |
| source your-venv/bin/activate | |
| pip install awscli | |
| # Setup your credentials | |
| aws configure | |
| # Check out what is going to get transfered first | |
| aws s3 sync ./path/to/data s3://bucket-name --exclude "*" --include "*.nc" --dryrun | |
| # Remove --dryrun to sync for realsies |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment