Skip to content

Commit

Permalink
add param init fns back
Browse files Browse the repository at this point in the history
  • Loading branch information
dakinggg committed May 27, 2024
1 parent 1507c8b commit 76921d8
Showing 1 changed file with 3 additions and 2 deletions.
5 changes: 3 additions & 2 deletions llmfoundry/models/mpt/modeling_mpt.py
Original file line number Diff line number Diff line change
Expand Up @@ -75,10 +75,11 @@
mpt_get_total_params,
)

# Import the fcs here so that recursive code creating the files for hf checkpoints can find them
# This is the only exception because fc.py is not imported in any other place in the codebase
# Import the fcs and param_init_fns here so that the recursive code creating the files for hf checkpoints can find them
# These are the exceptions because fc.py and param_init_fns.py are not imported in any other place in the import tree
# isort: off
from llmfoundry.models.layers.fc import fcs # type: ignore
from llmfoundry.models.utils.param_init_fns import generic_param_init_fn_ # type: ignore
# isort: on

log = logging.getLogger(__name__)
Expand Down

0 comments on commit 76921d8

Please sign in to comment.