Skip to content

Commit

Permalink
fix num gpu check (#1760)
Browse files Browse the repository at this point in the history
  • Loading branch information
winglian authored Jul 17, 2024
1 parent 5f58555 commit 152ab76
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion src/axolotl/utils/config/models/input/v0_4_1/__init__.py
Original file line number Diff line number Diff line change
Expand Up @@ -1198,7 +1198,7 @@ def check_multigpu_unsloth(cls, data):
or data.get("unsloth_lora_o")
):
capabilities = data.get("capabilities")
if capabilities and capabilities.get("num_gpus") > 1:
if capabilities and capabilities.get("n_gpu", 0) > 1:
raise ValueError(
"unsloth_lora_mlp, unsloth_lora_qkv, and unsloth_lora_o are not compatible with multi-GPU training."
)
Expand Down

0 comments on commit 152ab76

Please sign in to comment.