Skip to content

Instantly share code, notes, and snippets.

Show Gist options
  • Save visionscaper/a5b1d8c5a95b08958aefd2a2591a1045 to your computer and use it in GitHub Desktop.
Save visionscaper/a5b1d8c5a95b08958aefd2a2591a1045 to your computer and use it in GitHub Desktop.
MLPug persona chatbot training example used for testing 6xAMD MI100 experimental server build
python examples/persona_chatbot/pytorch/train.py \
--experiment-name persona-bot-6xMI100 \
--num-dataloader-workers 2 \
--use-mixed-precision \
--batch-size 30 \
--batch-chunk-size 10 \
--num-choices 8 \
--sequence-length-outlier-threshold 0.05 \
--learning-rate 6.25e-5 \
--lr-warmup-schedule \
--num-epochs 6 \
--progress-log-period 10 \
--distributed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment