Skip to content

Allow GPTQModel to auto select Marlin or faster kernels for inference only ops #3869

Allow GPTQModel to auto select Marlin or faster kernels for inference only ops

Allow GPTQModel to auto select Marlin or faster kernels for inference only ops #3869

Annotations

1 error

build (3.9)

failed Jan 7, 2025 in 2m 38s