Skip to content

Commit

Permalink
Update rotary_embedding.py
Browse files Browse the repository at this point in the history
  • Loading branch information
pcmoritz authored Jun 28, 2024
1 parent e06d0d2 commit 703e6a3
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion vllm/model_executor/layers/rotary_embedding.py
Original file line number Diff line number Diff line change
Expand Up @@ -804,7 +804,7 @@ def get_rope(
}
rotary_emb = DeepseekScalingRotaryEmbedding(
head_size, rotary_dim, original_max_position, base,
is_neox_style, scaling_factor, dtype, *extra_kwargs)
is_neox_style, scaling_factor, dtype, **extra_kwargs)
# The correct one should be "longrope" but keep "su" here
# for backward compatible
elif scaling_type == "su" or scaling_type == "longrope":
Expand Down

0 comments on commit 703e6a3

Please sign in to comment.