Fix(version): Update FA to work with Mistral SWA (axolotl-ai-cloud#673)

mkeoliya · Oct 4, 2023 · b79d703 · b79d703
1 parent 0067dde
commit b79d703
Showing 1 changed file with 1 addition and 1 deletion.
diff --git a/requirements.txt b/requirements.txt
@@ -12,7 +12,7 @@ addict
 fire
 PyYAML>=6.0
 datasets
-flash-attn>=2.2.1
+flash-attn>=2.3.0
 sentencepiece
 wandb
 einops