Skip to content

Instantly share code, notes, and snippets.

@donglixp

donglixp/mi250_flash.sh

Created December 27, 2023 02:51
Show Gist options
  • Save donglixp/7c3b2004852b11a2b56c756c1d18484f to your computer and use it in GitHub Desktop.
Save donglixp/7c3b2004852b11a2b56c756c1d18484f to your computer and use it in GitHub Desktop.
Download ZIP
Raw
mi250_flash.sh
# The library contains bug; do not use
cd $(mktemp -d)
git clone --recursive https://github.com/ROCmSoftwarePlatform/flash-attention.git
export GPU_ARCHS="gfx90a"
cd flash-attention
export PYTHON_SITE_PACKAGES=$(python -c 'import site; print(site.getsitepackages()[0])')
patch "${PYTHON_SITE_PACKAGES}/torch/utils/hipify/hipify_python.py" hipify_patch.patch
pip install .
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment