Skip to content
Python package

0.45.0: LLM.int8() support for H100; faster 4-bit/8-bit inference #951

Sign in to view logs

0.45.0: LLM.int8() support for H100; faster 4-bit/8-bit inference

0.45.0: LLM.int8() support for H100; faster 4-bit/8-bit inference #951

This job was skipped