Skip to content

Fix error when decoding a token in the id gap (or out of range) in a tiktoken tokenizer #2902

Fix error when decoding a token in the id gap (or out of range) in a tiktoken tokenizer

Fix error when decoding a token in the id gap (or out of range) in a tiktoken tokenizer #2902

Triggered via pull request January 8, 2024 08:03
Status Success
Total duration 2m 37s
Artifacts

codeql-analysis.yml

on: pull_request
Matrix: Analyze
Fit to window
Zoom out
Zoom in

Annotations

1 warning
Analyze (python)
The following actions uses node12 which is deprecated and will be forced to run on node16: actions/checkout@v2. For more info: https://github.blog/changelog/2023-06-13-github-actions-all-actions-will-run-on-node16-instead-of-node12-by-default/