Skip to content

Commit

Permalink
cleanup
Browse files Browse the repository at this point in the history
  • Loading branch information
Eitan Turok committed Aug 12, 2024
1 parent c14252d commit 92b1607
Showing 1 changed file with 1 addition and 2 deletions.
3 changes: 1 addition & 2 deletions megablocks/layers/mlp.py
Original file line number Diff line number Diff line change
Expand Up @@ -179,8 +179,7 @@ def create_dmoe_expert_weights(
columns,
init_method,
)
weights = weights.view([-1, columns])
return weights
return weights.view([-1, columns])


class MemoryOptimizedMLP(torch.autograd.Function):
Expand Down

0 comments on commit 92b1607

Please sign in to comment.