From b88f51512aa1524b60893ba84266088d922d84df Mon Sep 17 00:00:00 2001
From: Adarsh Shirawalmath <114558126+adarshxs@users.noreply.github.com>
Date: Thu, 28 Sep 2023 19:54:56 +0530
Subject: [PATCH] Update mistral/README.md (#647)

---
 examples/mistral/README.md | 12 ++++++++++++
 1 file changed, 12 insertions(+)
 create mode 100644 examples/mistral/README.md

diff --git a/examples/mistral/README.md b/examples/mistral/README.md
new file mode 100644
index 0000000000..d1efb2cab3
--- /dev/null
+++ b/examples/mistral/README.md
@@ -0,0 +1,12 @@
+**Mistral 7B** is a language model with a total of 7.3 billion parameters, showcasing a notable performance across a variety of benchmarks.
+
+Fine Tune:
+```shell
+accelerate launch -m axolotl.cli.train examples/mistral/config.yml
+
+```
+
+If you run into CUDA OOM, use deepspeed with config zero2.json:
+```shell
+accelerate launch -m axolotl.cli.train examples/mistral/config.yml --deepspeed deepspeed/zero2.json
+```