Currently you will need to hotfix/manually update some packages in order to get the performance you deserve when using a lovelace gpu (4080/4090/etc)
- add to webui-user.sh: export TORCH_COMMAND="pip install torch torchvision --extra-index-url https://download.pytorch.org/whl/cu117"
- source ./venv/bin/activate
- pip install xformers==0.0.16rc424
- pip install triton
- download https://developer.download.nvidia.com/compute/redist/cudnn/v8.7.0/local_installers/11.8/cudnn-linux-x86_64-8.7.0.84_cuda11-archive.tar.xz
- copy all files /cudnn-linux-x86_64-8.7.0.84_cuda11-archive/lib/* to venv/lib/python3.10/site-packages/torch/lib