Skip to content

Actions: keyboardAnt/distributed-speculative-inference

Actions

All workflows

Actions

Loading...
Loading

Showing runs from all workflows
487 workflow runs
487 workflow runs

Filter by Event

Filter by Status

Filter by Branch

Filter by Actor

load_model: support dtype Python tests #361: Commit 4a536c7 pushed by keyboardAnt
September 14, 2024 18:49 2m 3s nadav/actual-llm-coroutines-manager
nadav/actual-llm-coroutines-manager
September 14, 2024 18:49 2m 3s
load models in half precision Python tests #360: Commit cbbbbb9 pushed by keyboardAnt
September 13, 2024 22:37 2m 6s nadav/actual-llm-coroutines-manager
nadav/actual-llm-coroutines-manager
September 13, 2024 22:37 2m 6s
vicuna-13b & lookahead=1 Python tests #359: Commit e5c6003 pushed by keyboardAnt
September 13, 2024 22:18 2m 5s nadav/actual-llm-coroutines-manager
nadav/actual-llm-coroutines-manager
September 13, 2024 22:18 2m 5s
logging Python tests #358: Commit 1b22c53 pushed by keyboardAnt
September 13, 2024 22:04 2m 55s nadav/actual-llm-coroutines-manager
nadav/actual-llm-coroutines-manager
September 13, 2024 22:04 2m 55s
pad accepted tok_ids to fix assignment Python tests #357: Commit f3a9a44 pushed by keyboardAnt
September 13, 2024 21:59 2m 1s nadav/actual-llm-coroutines-manager
nadav/actual-llm-coroutines-manager
September 13, 2024 21:59 2m 1s
fix torch assignment Python tests #356: Commit 8f80bc9 pushed by keyboardAnt
September 13, 2024 21:52 2m 6s nadav/actual-llm-coroutines-manager
nadav/actual-llm-coroutines-manager
September 13, 2024 21:52 2m 6s
fix torch assignment/view (accepted tok ids) Python tests #355: Commit 106bafb pushed by keyboardAnt
September 13, 2024 21:50 2m 7s nadav/actual-llm-coroutines-manager
nadav/actual-llm-coroutines-manager
September 13, 2024 21:50 2m 7s
support accepting only a prefix of batches Python tests #354: Commit 5cf1a5a pushed by keyboardAnt
September 13, 2024 19:44 2m 5s nadav/actual-llm-coroutines-manager
nadav/actual-llm-coroutines-manager
September 13, 2024 19:44 2m 5s
lookahead=1 Python tests #353: Commit dcebd6d pushed by keyboardAnt
September 13, 2024 19:33 2m 11s nadav/actual-llm-coroutines-manager
nadav/actual-llm-coroutines-manager
September 13, 2024 19:33 2m 11s
improve loggging & set lookahead=2 Python tests #352: Commit 172ab92 pushed by keyboardAnt
September 13, 2024 19:27 2m 13s nadav/actual-llm-coroutines-manager
nadav/actual-llm-coroutines-manager
September 13, 2024 19:27 2m 13s
wip fixing rejection sampling Python tests #351: Commit f08c3a9 pushed by keyboardAnt
September 13, 2024 18:46 2m 11s nadav/actual-llm-coroutines-manager
nadav/actual-llm-coroutines-manager
September 13, 2024 18:46 2m 11s
fix logging issue Python tests #350: Commit bcf284d pushed by keyboardAnt
September 13, 2024 18:36 2m 18s nadav/actual-llm-coroutines-manager
nadav/actual-llm-coroutines-manager
September 13, 2024 18:36 2m 18s
fix rejection_sampler Python tests #349: Commit 592a02c pushed by keyboardAnt
September 13, 2024 18:35 2m 3s nadav/actual-llm-coroutines-manager
nadav/actual-llm-coroutines-manager
September 13, 2024 18:35 2m 3s
run dsi Python tests #348: Commit e5dc4fb pushed by keyboardAnt
September 13, 2024 18:14 2m 8s nadav/actual-llm-coroutines-manager
nadav/actual-llm-coroutines-manager
September 13, 2024 18:14 2m 8s
logging Python tests #347: Commit cd78e10 pushed by keyboardAnt
September 13, 2024 18:12 2m 10s nadav/actual-llm-coroutines-manager
nadav/actual-llm-coroutines-manager
September 13, 2024 18:12 2m 10s
improve logging Python tests #346: Commit 236c7bc pushed by keyboardAnt
September 13, 2024 17:44 2m 14s nadav/actual-llm-coroutines-manager
nadav/actual-llm-coroutines-manager
September 13, 2024 17:44 2m 14s
generate only 100 tokens to avoid OOM & improve logging Python tests #345: Commit 363cda3 pushed by keyboardAnt
September 13, 2024 17:42 2m 37s nadav/actual-llm-coroutines-manager
nadav/actual-llm-coroutines-manager
September 13, 2024 17:42 2m 37s
manager: preempt all & fix verifier n; worker: do not preempt valid t… Python tests #344: Commit c0a08c3 pushed by keyboardAnt
September 13, 2024 17:26 2m 13s nadav/actual-llm-coroutines-manager
nadav/actual-llm-coroutines-manager
September 13, 2024 17:26 2m 13s
format Python tests #343: Commit c5aaa9d pushed by keyboardAnt
September 12, 2024 21:33 36m 59s nadav/actual-llm-coroutines-manager
nadav/actual-llm-coroutines-manager
September 12, 2024 21:33 36m 59s
remove commented out code Python tests #342: Commit cea3d08 pushed by keyboardAnt
September 12, 2024 21:33 1m 50s nadav/actual-llm-coroutines-manager
nadav/actual-llm-coroutines-manager
September 12, 2024 21:33 1m 50s
use Verifier & Drafter. TODO: Implement Verifier's lookabehind Python tests #341: Commit 55a5078 pushed by keyboardAnt
September 12, 2024 21:32 1m 51s nadav/actual-llm-coroutines-manager
nadav/actual-llm-coroutines-manager
September 12, 2024 21:32 1m 51s
add a baseline hf generate Python tests #340: Commit 302849b pushed by keyboardAnt
September 12, 2024 20:35 2m 12s nadav/actual-llm-coroutines-manager
nadav/actual-llm-coroutines-manager
September 12, 2024 20:35 2m 12s
measure time Python tests #339: Commit dc73343 pushed by keyboardAnt
September 12, 2024 20:28 2m 11s nadav/actual-llm-coroutines-manager
nadav/actual-llm-coroutines-manager
September 12, 2024 20:28 2m 11s
parameterize main Python tests #338: Commit e946f55 pushed by keyboardAnt
September 12, 2024 20:23 1m 52s nadav/actual-llm-coroutines-manager
nadav/actual-llm-coroutines-manager
September 12, 2024 20:23 1m 52s
print final decoded output Python tests #337: Commit 0657de6 pushed by keyboardAnt
September 12, 2024 20:00 2m 3s nadav/actual-llm-coroutines-manager
nadav/actual-llm-coroutines-manager
September 12, 2024 20:00 2m 3s