Skip to content

Commit

Permalink
remove list
Browse files Browse the repository at this point in the history
Signed-off-by: youkaichao <[email protected]>
  • Loading branch information
youkaichao committed Dec 10, 2024
1 parent 187015f commit e1e790c
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion vllm/forward_context.py
Original file line number Diff line number Diff line change
Expand Up @@ -52,7 +52,7 @@ def set_forward_context(context: Any, vllm_config: VllmConfig):
batchsize_counter[batchsize] += 1
if time.monotonic() - last_logging_time > batchsize_logging_interval:
last_logging_time = time.monotonic()
sorted_data = sorted(list(batchsize_counter.items()),
sorted_data = sorted(batchsize_counter.items(),
key=lambda x: x[1],
reverse=True)
logger.info("Batchsize distribution (batchsize, count): %s",
Expand Down

0 comments on commit e1e790c

Please sign in to comment.