Skip to content

Commit

Permalink
document that packaging needs to be installed before flash-attn (axol…
Browse files Browse the repository at this point in the history
  • Loading branch information
winglian authored Sep 12, 2023
1 parent e614bf8 commit d7a356f
Showing 1 changed file with 4 additions and 1 deletion.
5 changes: 4 additions & 1 deletion README.md
Original file line number Diff line number Diff line change
Expand Up @@ -71,6 +71,7 @@ Get started with Axolotl in just a few steps! This quickstart guide will walk yo
git clone https://github.com/OpenAccess-AI-Collective/axolotl
cd axolotl

pip3 install packaging
pip3 install -e .[flash-attn]
pip3 install -U git+https://github.com/huggingface/peft.git

Expand Down Expand Up @@ -105,6 +106,7 @@ accelerate launch scripts/finetune.py examples/openllama-3b/lora.yml \

3. Install axolotl along with python dependencies
```bash
pip3 install packaging
pip3 install -e .[flash-attn]
```

Expand Down Expand Up @@ -140,7 +142,8 @@ accelerate launch scripts/finetune.py examples/openllama-3b/lora.yml \
git clone https://github.com/OpenAccess-AI-Collective/axolotl
cd axolotl
pip3 install -e .
pip3 install packaging
pip3 install -e .[flash-attn]
pip3 install protobuf==3.20.3
pip3 install -U --ignore-installed requests Pillow psutil scipy
```
Expand Down

0 comments on commit d7a356f

Please sign in to comment.