Skip to content

Commit

Permalink
Improve memory usage in test_bert_batch_dram.py
Browse files Browse the repository at this point in the history
  • Loading branch information
blozano-tt committed Dec 11, 2024
1 parent 8b82811 commit 2abd3fe
Showing 1 changed file with 7 additions and 0 deletions.
Original file line number Diff line number Diff line change
Expand Up @@ -221,6 +221,13 @@ def run_bert_question_and_answering_inference(
profiler.end("processing_output_to_string")

del tt_out
del tt_embedding
del tt_attention_mask
del tt_embedding_inputs
del bert_input
del pytorch_out
if "single_inputs" in locals():
del single_inputs

profiler.print()

Expand Down

0 comments on commit 2abd3fe

Please sign in to comment.