Skip to content

Commit

Permalink
[torch.compile][misc] fix comments (vllm-project#10993)
Browse files Browse the repository at this point in the history
Signed-off-by: youkaichao <[email protected]>
  • Loading branch information
youkaichao authored Dec 8, 2024
1 parent a11f326 commit 43b05fa
Showing 1 changed file with 2 additions and 2 deletions.
4 changes: 2 additions & 2 deletions vllm/config.py
Original file line number Diff line number Diff line change
Expand Up @@ -2177,8 +2177,8 @@ class CompilationConfig(BaseModel):
TODO: move outside cudagraph logic into compilation.
torch.compile will handle cudagraph capture logic in the future.
- cudagraph_capture_sizes: sizes to capture cudagraph.
- None: capture sizes are inferred from compilation context.
- List[int]: capture sizes are specified.
- None (default): capture sizes are inferred from vllm config.
- List[int]: capture sizes are specified as given.
- cudagraph_num_of_warmups: number of warmup runs for cudagraph.
It means the first several runs will be treated as warmup runs.
Only after that, the execution will be recorded, and the recorded
Expand Down

0 comments on commit 43b05fa

Please sign in to comment.