Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
fix(model): apply gate fp32 only for mixtral (#1241)
* fix(model): apply gate fp32 only for mixtral * Update src/axolotl/utils/models.py * fix gate layer check --------- Co-authored-by: Wing Lian <wing.lian@gmail.com>
- Loading branch information