Skip to content

load drafter on gpu 0 only & free tokenizer #370

load drafter on gpu 0 only & free tokenizer

load drafter on gpu 0 only & free tokenizer #370

Triggered via push September 15, 2024 19:50
Status Failure
Total duration 1m 55s
Artifacts
Matrix: ci
Fit to window
Zoom out
Zoom in

Annotations

5 errors
Ruff (F841): poc/dsi.py#L925
poc/dsi.py:925:5: F841 Local variable `drafter_name` is assigned to but never used
Ruff (F841): poc/dsi.py#L927
poc/dsi.py:927:5: F841 Local variable `drafter_dtype` is assigned to but never used
Ruff (F841): poc/dsi.py#L928
poc/dsi.py:928:5: F841 Local variable `vocab_size` is assigned to but never used
Ruff (F841): poc/dsi.py#L929
poc/dsi.py:929:5: F841 Local variable `lookahead` is assigned to but never used
ci (3.11.9, ubuntu-latest)
Process completed with exit code 1.