Skip to content
Back to pull request #2138

Allow GPTQModel to auto select Marlin or faster kernels for inference only ops #3869

Sign in to view logs

Allow GPTQModel to auto select Marlin or faster kernels for inference only ops

Allow GPTQModel to auto select Marlin or faster kernels for inference only ops #3869

Run time

Learn about OS pricing on GitHub Actions
Job Run time
build (3.9)
2m 38s
build (3.11)
2m 25s
5m 3s