Skip to content

Commit

Permalink
fix annotation
Browse files Browse the repository at this point in the history
Signed-off-by: youkaichao <[email protected]>
  • Loading branch information
youkaichao committed Dec 10, 2024
1 parent 16d2a6d commit 187015f
Showing 1 changed file with 3 additions and 3 deletions.
6 changes: 3 additions & 3 deletions vllm/forward_context.py
Original file line number Diff line number Diff line change
Expand Up @@ -10,10 +10,10 @@

logger = init_logger(__name__)

track_batchsize = envs.VLLM_LOG_BATCHSIZE_INTERVAL >= 0
batchsize_counter = Counter()
track_batchsize: bool = envs.VLLM_LOG_BATCHSIZE_INTERVAL >= 0
batchsize_counter: Counter = Counter()
last_logging_time: float = 0
batchsize_logging_interval = envs.VLLM_LOG_BATCHSIZE_INTERVAL
batchsize_logging_interval: float = envs.VLLM_LOG_BATCHSIZE_INTERVAL


@dataclass
Expand Down

0 comments on commit 187015f

Please sign in to comment.