Skip to content
Back to pull request #2138

Allow GPTQModel to auto select Marlin or faster kernels for inference only ops #5999

Sign in to view logs

Allow GPTQModel to auto select Marlin or faster kernels for inference only ops

Allow GPTQModel to auto select Marlin or faster kernels for inference only ops #5999

build (3.9, ubuntu-20.04)

build (3.9, ubuntu-20.04)
succeeded Jan 7, 2025 in 1m 39s