rom1504

See https://gist.github.com/rom1504/67ada3dedbecc113ae2dbdfd9c642d83 for step by step about spark jars

rom1504

Install

git clone https://github.com/mlfoundations/open_clip.git
cd open_clip
python3.8 -m venv .env
source .env/bin/activate
pip install -U pip
pip install torch torchvision torchaudio --extra-index-url https://download.pytorch.org/whl/cu113
pip install -e .

rom1504

First follow https://huggingface.co/docs/huggingface_hub/how-to-upstream#push-files-with-git-lfs

1. https://huggingface.co/new-dataset
2. git clone https://huggingface.co/datasets/user/dataset
3. cd dataset
4. put your files in the current folder (probably a mv)
5. git lfs track *
6. git add .
7. git commit -m "dataset"
8. git push