Update training.md

foundation-model-stack · Dec 18, 2024 · 6cadf05 · 6cadf05
1 parent 9103007
commit 6cadf05
Showing 1 changed file with 2 additions and 0 deletions.
diff --git a/training/training.md b/training/training.md
@@ -1,3 +1,5 @@
+# Training
+
 We trained our Bamba model with FSDP using our training repo [here](https://github.com/foundation-model-stack/fms-fsdp/tree/mamba-new).
 Note that this training effort was started before FSDP2 and also long before we contributed
 `Mamba2-Hybrid` to HF, so we were doing FSDP1 training with [official Mamba implementation](https://github.com/state-spaces/mamba).