Skip to content

Commit

Permalink
added log to search for
Browse files Browse the repository at this point in the history
  • Loading branch information
milocress committed Apr 2, 2024
1 parent be48d2d commit 6a7746e
Showing 1 changed file with 1 addition and 0 deletions.
1 change: 1 addition & 0 deletions llmfoundry/data/packing.py
Original file line number Diff line number Diff line change
Expand Up @@ -451,6 +451,7 @@ def profile(raw_batch_size: int) -> Tuple[Optional[float], Optional[float]]:
waste_percent = 100 * packer.waste
return padding_percent, waste_percent

log.info('Profiling packing ratios')
with logging_redirect_tqdm(loggers=[log]):
for packing_ratio, raw_batch_size in (pbar := tqdm(
zip(packing_ratios, raw_batch_sizes),
Expand Down

0 comments on commit 6a7746e

Please sign in to comment.