diff --git a/docs/faq.md b/docs/faq.md
index e5b729e269..6542306538 100644
--- a/docs/faq.md
+++ b/docs/faq.md
@@ -12,3 +12,7 @@ This usually happens when you run out of system RAM.
 > Exitcode -7 while using deepspeed
 
 Try upgrading deepspeed w: `pip install -U deepspeed`
+
+> AttributeError: 'DummyOptim' object has no attribute 'step'
+
+You may be using deepspeed with single gpu. Please don't set `deepspeed:` in yaml or cli.