Update TRT-LLM example, achieve 28k tok/s (#991) · modal-labs/modal-examples@81b0b47 · GitHub

Commit

Update TRT-LLM example, achieve 28k tok/s (#991)

Browse files

* update version, update prose and formatting

* switch to H100, make it go brrrt

Loading branch information

charlesfrye authored Nov 22, 2024

1 parent 1c549d5 commit 81b0b47