This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
ME: | |
[rank14]: Traceback (most recent call last): | |
[rank14]: File "<frozen runpy>", line 198, in _run_module_as_main | |
[rank14]: File "<frozen runpy>", line 88, in _run_code | |
[rank14]: File "/scratch/axolotl/src/axolotl/cli/train.py", line 59, in <module> | |
[rank14]: fire.Fire(do_cli) | |
[rank14]: File "/home/ehartford/miniconda3/envs/axolotl/lib/python3.12/site-packages/fire/core.py", line 141, in Fire | |
[rank14]: component_trace = _Fire(component, args, parsed_flag_args, context, name) | |
[rank14]: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ | |
[rank14]: File "/home/ehartford/miniconda3/envs/axolotl/lib/python3.12/site-packages/fire/core.py", line 475, in _Fire |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
import copy | |
import os | |
import safetensors.torch | |
import glob | |
import json | |
def transform_st(path: str, out_dir: str): | |
data = safetensors.torch.load_file(path) | |
old_keys = list(data.keys()) |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
The following values were not passed to `accelerate launch` and had defaults used instead: | |
`--num_processes` was set to a value of `4` | |
More than one GPU was found, enabling multi-GPU training. | |
If this was unintended please pass in `--num_processes=1`. | |
`--num_machines` was set to a value of `1` | |
`--mixed_precision` was set to a value of `'no'` | |
`--dynamo_backend` was set to a value of `'no'` | |
To avoid this warning pass in values for each of the problematic parameters or run `accelerate config`. | |
/workspace/axolotl/transformers/src/transformers/deepspeed.py:23: FutureWarning: transformers.deepspeed module is deprecated and will be removed in a future version. Please import deepspeed modules directly from transformers.integrations | |
warnings.warn( |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
// npm i express axios && node ./oailogger.js | |
const express = require('express'); | |
const axios = require('axios'); | |
const bodyParser = require('body-parser'); | |
const stream = require('stream'); | |
const { promisify } = require('util'); | |
const fs = require('fs'); | |
const logStream = fs.createWriteStream('logs.jsonl', { flags: 'a' }); | |
const app = express(); |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
from transformers import AutoModelForCausalLM, AutoTokenizer | |
from peft import PeftModel | |
import torch | |
import os | |
import argparse | |
def get_args(): | |
parser = argparse.ArgumentParser() |
NewerOlder