Skip to content
Python package

0.45.0: LLM.int8() support for H100; faster 4-bit/8-bit inference #951

Sign in to view logs

0.45.0: LLM.int8() support for H100; faster 4-bit/8-bit inference

0.45.0: LLM.int8() support for H100; faster 4-bit/8-bit inference #951

Annotations

1 warning

build-wheels (ubuntu-latest, 3.10, x86_64)

build-wheels (ubuntu-latest, 3.10, x86_64)
succeeded Dec 5, 2024 in 1m 7s