Created
May 3, 2024 11:51
-
-
Save visionscaper/a5b1d8c5a95b08958aefd2a2591a1045 to your computer and use it in GitHub Desktop.
MLPug persona chatbot training example used for testing 6xAMD MI100 experimental server build
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
python examples/persona_chatbot/pytorch/train.py \ | |
--experiment-name persona-bot-6xMI100 \ | |
--num-dataloader-workers 2 \ | |
--use-mixed-precision \ | |
--batch-size 30 \ | |
--batch-chunk-size 10 \ | |
--num-choices 8 \ | |
--sequence-length-outlier-threshold 0.05 \ | |
--learning-rate 6.25e-5 \ | |
--lr-warmup-schedule \ | |
--num-epochs 6 \ | |
--progress-log-period 10 \ | |
--distributed |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment