Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

reduce verbosity of the special tokens #1472

Merged
merged 1 commit into from
Apr 1, 2024
Merged

Conversation

winglian
Copy link
Collaborator

@winglian winglian commented Apr 1, 2024

the logging of the special tokens was a bit excessive...

@winglian winglian requested a review from NanoCode012 April 1, 2024 11:24
@NanoCode012 NanoCode012 merged commit 0b10377 into main Apr 1, 2024
7 checks passed
@winglian winglian deleted the tokenizer-verbosity branch August 16, 2024 14:42
djsaunde pushed a commit that referenced this pull request Dec 17, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants