This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| name: main | |
| on: | |
| push: | |
| branches: [ main ] | |
| env: | |
| CARGO_TERM_COLOR: always | |
| jobs: |
ahoho
/ convert-hf-to-pth.py
Created
April 2, 2023 19:35
Convert huggingface model to pytorch checkpoint (modified from alpaca-lora)
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| # Convert a huggingface LLaMA checkpoint to an (unsharded) pytorch checkpoint | |
| # comes from https://github.com/tloen/alpaca-lora/blob/main/export_state_dict_checkpoint.py | |
| import argparse | |
| import json | |
| from pathlib import Path | |
| import torch | |
| import transformers | |
| from transformers import LlamaForCausalLM, LlamaTokenizer # noqa: E402 |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| { | |
| "LoRA_type": "Standard", | |
| "adaptive_noise_scale": 0, | |
| "additional_parameters": "", | |
| "block_alphas": "", | |
| "block_dims": "", | |
| "block_lr_zero_threshold": "", | |
| "bucket_no_upscale": true, | |
| "bucket_reso_steps": 64, | |
| "cache_latents": true, |
OlderNewer