Add tokenizer-only flag to only download tokenizers from HF or oras#895
Merged
irenedea merged 10 commits intomosaicml:mainfrom irenedea:dl-tokenizerJan 23, 2024
+37-10
Commits
Commits on Jan 23, 2024
- committed
- committed
- committed
- committed
- committed
- committed
- authored
- committed
