From fd833aff3ed457db8257092627c673e913c59cca Mon Sep 17 00:00:00 2001 From: Hamel Husain Date: Wed, 13 Mar 2024 21:55:20 -0700 Subject: [PATCH] Update fsdp_qlora.md --- docs/fsdp_qlora.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/docs/fsdp_qlora.md b/docs/fsdp_qlora.md index 1e143fc3bf..14b2c1a571 100644 --- a/docs/fsdp_qlora.md +++ b/docs/fsdp_qlora.md @@ -25,7 +25,7 @@ To enable `QLoRA` with `FSDP`, you need to perform the following steps: - [PR #1378](https://github.com/OpenAccess-AI-Collective/axolotl/pull/1378) enabling QLoRA in FSDP in Axolotl. - [Blog Post](https://www.answer.ai/posts/2024-03-06-fsdp-qlora.html) from the [Answer.AI](https://www.answer.ai/) team describing the work that enabled QLoRA in FSDP. -- Related HuggingFace PRs Enabling FDSP + QLorA: +- Related HuggingFace PRs Enabling FDSP + QLoRA: - Accelerate [PR#2544](https://github.com/huggingface/accelerate/pull/2544 ) - Transformers [PR#29587](https://github.com/huggingface/transformers/pull/29587) - TRL [PR#1416](https://github.com/huggingface/trl/pull/1416)