Last active
February 15, 2025 07:29
-
-
Save Artem-B/b5443c64ecc3ad2f7308093c693278fa to your computer and use it in GitHub Desktop.
Download monstral model on runpod.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| export HF_HUB_ENABLE_HF_TRANSFER=1 && | |
| apt update && | |
| apt install -y nvtop && | |
| pip install hf_transfer && | |
| export HF_HUB_ENABLE_HF_TRANSFER=1 | |
| MODEL=MikeRoz/MarsupialAI_Dumbstral-169B-5.0bpw-h6-exl2 | |
| MODEL=BigHuggyD/MarsupialAI_Monstral-123B-v2_exl2_8.0bpw_h8 | |
| MODEL BigHuggyD/TheDrummer_Behemoth-123B-v1.2_exl2_7.0bpw_h8 | |
| huggingface-cli download --local-dir models/model $MODEL |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
MODEL=BigHuggyD/TheDrummer_Behemoth-123B-v1_exl2_7.0bpw_h8