From 9fa71c7ecde173764e161875af05c8e13f8967c5 Mon Sep 17 00:00:00 2001 From: xhedit <71542719+xhedit@users.noreply.github.com> Date: Wed, 13 Mar 2024 19:09:31 -0400 Subject: [PATCH] Update README.md --- README.md | 6 +++--- 1 file changed, 3 insertions(+), 3 deletions(-) diff --git a/README.md b/README.md index 518da2e..c3ccba9 100644 --- a/README.md +++ b/README.md @@ -31,14 +31,14 @@ quantkit download teknium/Hermes-Trismegistus-Mistral-7B --no-cache
-Only download the safetensors version of a model (useful for models that have both safetensors and pytorch): +Only download the safetensors version of a model (useful for models that have torch and safetensor): ``` quantkit download mistralai/Mistral-7B-v0.1 --no-cache --safetensors-only -out mistral7b ```
-Download and convert a model to safetensors, deleting the original pytorch bins: +Download and convert a model to safetensor, deleting the original pytorch bins: ``` quantkit safetensor migtissera/Tess-10.7B-v1.5b --delete-original ``` @@ -54,7 +54,7 @@ quantkit awq mistralai/Mistral-7B-v0.1 -out Mistral-7B-v0.1-AWQ Convert a model to GPTQ (4 bits / group-size 32): ``` -quantkit gptq mistral7b -out Mistral-7B-v0.1-AWQ -b 4 --group-size 32 +quantkit gptq mistral7b -out Mistral-7B-v0.1-GPTQ -b 4 --group-size 32 ```