Skip to content

Default to using tokenizer eos and bos in convert_text_to_mds.py #96

Default to using tokenizer eos and bos in convert_text_to_mds.py

Default to using tokenizer eos and bos in convert_text_to_mds.py #96

Triggered via pull request December 28, 2023 00:44
@irenedeairenedea
synchronize #823
irenedea:tok
Status Success
Total duration 4m 10s
Artifacts

smoketest.yaml

on: pull_request
Matrix: smoketest
Fit to window
Zoom out
Zoom in