Skip to content

Commit

Permalink
Updating disctonv layer norm impl
Browse files Browse the repository at this point in the history
  • Loading branch information
szaman19 committed May 24, 2023
1 parent 8c3d5ca commit 13aff25
Showing 1 changed file with 1 addition and 0 deletions.
1 change: 1 addition & 0 deletions src/layers/regularizers/distconv/distconv_layer_norm.cu
Original file line number Diff line number Diff line change
Expand Up @@ -179,6 +179,7 @@ void LayerNormalization<Backend, DataType>::calculate_backward_stats(
const DCTensor<Allocator>& statistics,
DCTensor<Allocator>& statistics_grad)
{

const auto& input_dims = input.get_local_shape();
const auto& statistics_dims = statistics.get_local_shape();
const auto local_num_samples = input_dims[3];
Expand Down

0 comments on commit 13aff25

Please sign in to comment.