Skip to content

Commit

Permalink
remove extra whitespace
Browse files Browse the repository at this point in the history
  • Loading branch information
akllm committed Nov 11, 2024
1 parent c8865cf commit 6937cc7
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion vllm/transformers_utils/tokenizers/mistral.py
Original file line number Diff line number Diff line change
Expand Up @@ -287,4 +287,4 @@ def convert_ids_to_tokens(
# if underlying tokenizeir is sentencepiece, we just add "�"
tokens = [self.tokenizer.id_to_byte_piece(id) for id in ids]

return tokens
return tokens

0 comments on commit 6937cc7

Please sign in to comment.