Skip to content

Commit

Permalink
pc
Browse files Browse the repository at this point in the history
  • Loading branch information
dakinggg committed Apr 12, 2024
1 parent 9e2f728 commit d7192af
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion llmfoundry/models/utils/param_init_fns.py
Original file line number Diff line number Diff line change
Expand Up @@ -157,7 +157,7 @@ def generic_param_init_fn_(
emb_init_uniform_lim: Optional[Union[Tuple[float, float], float]] = None,
**kwargs: Any,
) -> None:

print('in init')
print(type(module))
print(isinstance(module, GLU))
Expand Down

0 comments on commit d7192af

Please sign in to comment.