You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Please also upload the tokenizers.model(sentencepiece tokenizer) file because I would like to extend the smollm2-360m model to a non-english language, but only sentencepiece tokenizer can be extended & not huggingface tokenizers(tokenizers.json)
The text was updated successfully, but these errors were encountered:
Please also upload the tokenizers.model(sentencepiece tokenizer) file because I would like to extend the smollm2-360m model to a non-english language, but only sentencepiece tokenizer can be extended & not huggingface tokenizers(tokenizers.json)
The text was updated successfully, but these errors were encountered: