Skip to content

Commit

Permalink
Add redundancy check
Browse files Browse the repository at this point in the history
  • Loading branch information
janEbert committed Aug 19, 2024
1 parent 92ca94c commit ed73196
Showing 1 changed file with 4 additions and 0 deletions.
4 changes: 4 additions & 0 deletions examples/nlp/language_modeling/megatron_gpt_coord_check.py
Original file line number Diff line number Diff line change
Expand Up @@ -107,6 +107,10 @@ def main(cfg) -> None:
break
shrink_factors.append(shrink_factor)
df = []
assert len(shrink_factors) > 1, (
'cannot perform coordinate check with just one width. '
'Please increase base scalable widths to make sure they can be divided by powers of two > 1.'
)

for shrink_factor in shrink_factors:
# `set_base_shapes` returns the model
Expand Down

0 comments on commit ed73196

Please sign in to comment.