Skip to content

Commit

Permalink
Fix typo
Browse files Browse the repository at this point in the history
  • Loading branch information
xiaohanzhan-db committed Dec 18, 2023
1 parent 06b9a1f commit ea54d9f
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion scripts/data_prep/convert_dataset_hf.py
Original file line number Diff line number Diff line change
Expand Up @@ -232,7 +232,7 @@ def build_hf_dataset(
else:
if not isinstance(tokenizer, PreTrainedTokenizerBase):
raise ValueError(
f'{tokenizer=} must be of type PreTrainedTokenizerBase')
f'{tokenizer} must be of type PreTrainedTokenizerBase')
if max_length is None:
raise ValueError(f'max_length must be set.')
if bos_text + eos_text == '':
Expand Down

0 comments on commit ea54d9f

Please sign in to comment.