Adds support for chat formatted finetuning input data.#884
Merged
milocress merged 28 commits intomosaicml:main from milocress:milo/use-chat-tokenizersJan 26, 2024
+307-50
Commits
Commits on Jan 18, 2024
Commits on Jan 19, 2024
Commits on Jan 22, 2024
- committed
- committed
- committed
- committed
Commits on Jan 24, 2024
Commits on Jan 25, 2024
- committed
- committed
- committed
- committed
- committed
- committed
- committed
- authored