Skip to content

Allow GPTQModel to auto select Marlin or faster kernels for inference only ops #52

Allow GPTQModel to auto select Marlin or faster kernels for inference only ops

Allow GPTQModel to auto select Marlin or faster kernels for inference only ops #52

build (3.12, macos-15)

succeeded Jan 7, 2025 in 50m 50s