Add use_tokenizer_eos option to convert text to mds script · mosaicml/llm-foundry@3bca64a

Triggered via pull request January 8, 2024 21:31

irenedea

synchronize #843

irenedea:tok2

Status Success

Total duration 13m 45s

Artifacts 1

pr-cpu.yaml

on: pull_request

Matrix: pytest-cpu

Produced during runtime

Name	Size
coverage-2e83f5856fc673053c4344ab6e7759fbf17ed1f5-cpu-2.1.0 Expired	304 KB