Add arbitrary scales (huggingface#15) (huggingface#1625)

Co-authored-by: Linoy Buchnik <[email protected]>
skavulya · Dec 20, 2024 · c6df122 · c6df122
1 parent 45f04a0
commit c6df122
Showing 1 changed file with 7 additions and 0 deletions.
diff --git a/examples/text-generation/quantization_config/maxabs_quant_arbitrary.json b/examples/text-generation/quantization_config/maxabs_quant_arbitrary.json
@@ -0,0 +1,7 @@
+{
+    "method": "HOOKS",
+    "mode": "QUANTIZE",
+    "observer": "maxabs",
+    "scale_method": "maxabs_arbitrary",
+    "dump_stats_path": "./hqt_output/measure"
+}