Skip to content

override device_map if the model is gptq-based#611

Closed
Napuh wants to merge 4 commits intoaxolotl-ai-cloud:mainfrom Napuh:override-device-map-gptq