Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

invalid load key v while unpickling the adapter #16

Open
pxc3113 opened this issue May 11, 2023 · 0 comments
Open

invalid load key v while unpickling the adapter #16

pxc3113 opened this issue May 11, 2023 · 0 comments

Comments

@pxc3113
Copy link

pxc3113 commented May 11, 2023

(textgen) C:\Users\35934\textgen>python vigogne/scripts/export_state_dict_checkpoint.py --base_model_name_or_path "decapoda-research/llama-13b-hf" --lora_model_name_or_path "C:\Users\35934\textgen\vigogne-instruct-13b" --output_dir . --base_model_size "13B"

===================================BUG REPORT===================================
Welcome to bitsandbytes. For bug reports, please run

python -m bitsandbytes

and submit this information together with your error trace to: https://github.com/TimDettmers/bitsandbytes/issues

bin C:\Users\35934\miniconda3\envs\textgen\lib\site-packages\bitsandbytes\libbitsandbytes_cpu.so
C:\Users\35934\miniconda3\envs\textgen\lib\site-packages\bitsandbytes\cextension.py:33: UserWarning: The installed version of bitsandbytes was compiled without GPU support. 8-bit optimizers, 8-bit multiplication, and GPU quantization are unavailable.
warn("The installed version of bitsandbytes was compiled without GPU support. "
CUDA SETUP: Loading binary C:\Users\35934\miniconda3\envs\textgen\lib\site-packages\bitsandbytes\libbitsandbytes_cpu.so...
argument of type 'WindowsPath' is not iterable
Loading checkpoint shards: 100%|████████████████████████████████████████████████████████████████████| 41/41 [02:24<00:00, 3.54s/it]
Traceback (most recent call last):
File "C:\Users\35934\textgen\vigogne\scripts\export_state_dict_checkpoint.py", line 146, in
fire.Fire(main)
File "C:\Users\35934\miniconda3\envs\textgen\lib\site-packages\fire\core.py", line 141, in Fire
component_trace = _Fire(component, args, parsed_flag_args, context, name)
File "C:\Users\35934\miniconda3\envs\textgen\lib\site-packages\fire\core.py", line 475, in _Fire
component, remaining_args = _CallAndUpdateTrace(
File "C:\Users\35934\miniconda3\envs\textgen\lib\site-packages\fire\core.py", line 691, in _CallAndUpdateTrace
component = fn(*varargs, **kwargs)
File "C:\Users\35934\textgen\vigogne\scripts\export_state_dict_checkpoint.py", line 42, in main
lora_model = PeftModel.from_pretrained(
File "C:\Users\35934\miniconda3\envs\textgen\lib\site-packages\peft\peft_model.py", line 181, in from_pretrained
model.load_adapter(model_id, adapter_name, **kwargs)
File "C:\Users\35934\miniconda3\envs\textgen\lib\site-packages\peft\peft_model.py", line 380, in load_adapter
adapters_weights = torch.load(
File "C:\Users\35934\miniconda3\envs\textgen\lib\site-packages\torch\serialization.py", line 815, in load
return _legacy_load(opened_file, map_location, pickle_module, **pickle_load_args)
File "C:\Users\35934\miniconda3\envs\textgen\lib\site-packages\torch\serialization.py", line 1033, in _legacy_load
magic_number = pickle_module.load(f, **pickle_load_args)
_pickle.UnpicklingError: invalid load key, 'v'.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant