Skip to content
Python package

0.45.0: LLM.int8() support for H100; faster 4-bit/8-bit inference #951

Sign in to view logs

0.45.0: LLM.int8() support for H100; faster 4-bit/8-bit inference

0.45.0: LLM.int8() support for H100; faster 4-bit/8-bit inference #951

build-shared-libs-cuda (windows-latest, x86_64, 12.3.2)

build-shared-libs-cuda (windows-latest, x86_64, 12.3.2)
succeeded Dec 5, 2024 in 7m 21s