From 3fafebb912773cd139fa516dcd840e8064757925 Mon Sep 17 00:00:00 2001 From: Wing Lian Date: Thu, 14 Sep 2023 10:33:14 -0400 Subject: [PATCH] Add readme to point out that deepspeed should be used --- examples/phi/README.md | 7 +++++++ 1 file changed, 7 insertions(+) create mode 100644 examples/phi/README.md diff --git a/examples/phi/README.md b/examples/phi/README.md new file mode 100644 index 0000000000..fcbbe1eb2f --- /dev/null +++ b/examples/phi/README.md @@ -0,0 +1,7 @@ +# Phi + +Due to some nuances with the phi code, please use deepspeed when training phi. + +```shell +accelerate launch scripts/finetune.py examples/phi/phi-ft.yml --deepspeed deepspeed/zero2.json +```