Update README.md

main
Wang Peng 2 years ago committed by GitHub
parent bf3a9bffa9
commit 5eeac089dc
No known key found for this signature in database
GPG Key ID: 4AEE18F83AFDEB23

@ -63,7 +63,7 @@ Before running the code, make sure you have setup the environment and installed
pip install transformers==4.31.0 accelerate tiktoken einops pip install transformers==4.31.0 accelerate tiktoken einops
``` ```
We recommend installing `flash-attention` for higher efficiency and lower memory usage. We recommend installing [flash-attention](https://github.com/Dao-AILab/flash-attention) for higher efficiency and lower memory usage.
```bash ```bash
git clone -b v1.0.8 https://github.com/Dao-AILab/flash-attention git clone -b v1.0.8 https://github.com/Dao-AILab/flash-attention

Loading…
Cancel
Save