Skip to content

Allow GPTQModel to auto select Marlin or faster kernels for inference only ops #5157

Allow GPTQModel to auto select Marlin or faster kernels for inference only ops

Allow GPTQModel to auto select Marlin or faster kernels for inference only ops #5157

Status Success
Total duration 20m 29s
Artifacts

test_bettertransformer.yml

on: pull_request
Matrix: build
Fit to window
Zoom out
Zoom in