Created
August 11, 2020 15:31
-
-
Save sshleifer/539a4774811fc9d8bead50a5ebd5bfc8 to your computer and use it in GitHub Desktop.
s3 translation dataset upload workflow
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| tar -czvf wmt16_en_ru.tgz wmt16_en_ru | |
| # wmt16_en_ru/ | |
| # wmt16_en_ru/train.source | |
| # wmt16_en_ru/train.target | |
| # wmt16_en_ru/test.target | |
| # wmt16_en_ru/test.source | |
| # wmt16_en_ru/val.source | |
| # wmt16_en_ru/val.target | |
| aws s3 cp wmt16_en_ru.tgz s3://datasets.huggingface.co/translation/ |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment