Skip to content
Python package

0.45.0: LLM.int8() support for H100; faster 4-bit/8-bit inference #951

Sign in to view logs

0.45.0: LLM.int8() support for H100; faster 4-bit/8-bit inference

0.45.0: LLM.int8() support for H100; faster 4-bit/8-bit inference #951

Annotations

1 warning

build-shared-libs-cuda (ubuntu-latest, x86_64, 12.4.1)

build-shared-libs-cuda (ubuntu-latest, x86_64, 12.4.1)
succeeded Dec 5, 2024 in 5m 13s