Code

Tiktoken chat format fix#893

Code

Merged

rajammanabrolu merged 3 commits intomainmosaicml/llm-foundry:mainfrom raj/tiktoken-fixesmosaicml/llm-foundry:raj/tiktoken-fixesCopy head branch name to clipboardJan 30, 2024

+11-15

Commits

Commits on Jan 22, 2024

• sys prompt fix

  rajammanabrolu

  committed
  5971009

Commits on Jan 30, 2024

• remove eos tokens

  rajammanabrolu

  committed
  0af09e3

• Merge branch 'main' into raj/tiktoken-fixes

  rajammanabrolu

  authored
  990771e