Skip to content

Commit

Permalink
yo
Browse files Browse the repository at this point in the history
  • Loading branch information
snarayan21 committed Jul 28, 2024
1 parent 5e07a05 commit 7a66beb
Showing 1 changed file with 1 addition and 0 deletions.
1 change: 1 addition & 0 deletions llmfoundry/callbacks/hf_checkpointer.py
Original file line number Diff line number Diff line change
Expand Up @@ -517,6 +517,7 @@ def tensor_hook(
new_model_instance.generation_config.update(
**original_model.generation_config.to_dict(),
)
new_model_instance.name_or_path = original_model.name_or_path

# Then load the state dict in with "assign" so that the state dict
# is loaded properly even though the model is initially on meta device.
Expand Down

0 comments on commit 7a66beb

Please sign in to comment.