This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
The following values were not passed to `accelerate launch` and had defaults used instead: | |
`--num_processes` was set to a value of `4` | |
More than one GPU was found, enabling multi-GPU training. | |
If this was unintended please pass in `--num_processes=1`. | |
`--num_machines` was set to a value of `1` | |
`--mixed_precision` was set to a value of `'no'` | |
`--dynamo_backend` was set to a value of `'no'` | |
To avoid this warning pass in values for each of the problematic parameters or run `accelerate config`. | |
/workspace/axolotl/transformers/src/transformers/deepspeed.py:23: FutureWarning: transformers.deepspeed module is deprecated and will be removed in a future version. Please import deepspeed modules directly from transformers.integrations | |
warnings.warn( |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
// npm i express axios && node ./oailogger.js | |
const express = require('express'); | |
const axios = require('axios'); | |
const bodyParser = require('body-parser'); | |
const stream = require('stream'); | |
const { promisify } = require('util'); | |
const fs = require('fs'); | |
const logStream = fs.createWriteStream('logs.jsonl', { flags: 'a' }); | |
const app = express(); |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
from transformers import AutoModelForCausalLM, AutoTokenizer | |
from peft import PeftModel | |
import torch | |
import os | |
import argparse | |
def get_args(): | |
parser = argparse.ArgumentParser() |
NewerOlder