Update mistral/README.md (#647)

axolotl-ai-cloud · Sep 28, 2023 · b88f515 · b88f515
1 parent eb41f76
commit b88f515
Showing 1 changed file with 12 additions and 0 deletions.
diff --git a/examples/mistral/README.md b/examples/mistral/README.md
@@ -0,0 +1,12 @@
+**Mistral 7B** is a language model with a total of 7.3 billion parameters, showcasing a notable performance across a variety of benchmarks.
+
+Fine Tune:
+```shell
+accelerate launch -m axolotl.cli.train examples/mistral/config.yml
+
+```
+
+If you run into CUDA OOM, use deepspeed with config zero2.json:
+```shell
+accelerate launch -m axolotl.cli.train examples/mistral/config.yml --deepspeed deepspeed/zero2.json
+```