Mr Stone Stone-dielianhua
Stella2211
/ mem_eff_fp8_convert.py
Last active
March 27, 2025 06:03
メモリ効率のいいfp8化スクリプト。 / Memory efficient fp8 conversion script.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| import json | |
| from pathlib import Path | |
| import torch | |
| from tqdm import tqdm | |
| import struct | |
| from typing import Dict, Any | |
| import sys | |
| # input file | |
| if(len(sys.argv) < 3): |