Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

RuntimeError: Internal: could not parse ModelProto from /home/smusleh/miniGPT-Med/llama-2-7b-chat-hf/tokenizer.model #1438

Open
smusleh opened this issue Dec 9, 2024 · 1 comment

Comments

@smusleh
Copy link

smusleh commented Dec 9, 2024

System Info

Ubuntu 22.04.5 LTS
CPU 12Gen Intel Core i7-12700KF

Reproduction

I followed installation instruction step by step
Then I ran the python command
python demo_v2.py --cfg-path eval_configs/minigptv2_eval.yaml --gpu-id 0

Expected behavior

===================================BUG REPORT===================================
Welcome to bitsandbytes. For bug reports, please submit your error trace to: https://github.com/TimDettmers/bitsandbytes/issues

Initializing Chat
Traceback (most recent call last):
.....
return self.LoadFromFile(model_file)
File "/home/smusleh/anaconda3/envs/miniGPT-Med/lib/python3.9/site-packages/sentencepiece/init.py", line 316, in LoadFromFile
return _sentencepiece.SentencePieceProcessor_LoadFromFile(self, arg)
RuntimeError: Internal: could not parse ModelProto from /home/smusleh/miniGPT-Med/llama-2-7b-chat-hf/tokenizer.model

@bbbdbbb
Copy link

bbbdbbb commented Dec 11, 2024

I encountered a similar issue to yours. The materials I found suggest that the recent updates to peft and bitsandbytes may be the cause. However, even after updating the versions of peft and bitsandbytes, I am still getting the following error:

  File "/home/czb/miniconda3/envs/minigpt/lib/python3.8/site-packages/bitsandbytes/cextension.py", line 22, in <module>
    raise RuntimeError('''
RuntimeError: 
        CUDA Setup failed despite GPU being available. Inspect the CUDA SETUP outputs above to fix your environment!
        If you cannot find any issues and suspect a bug, please open an issue with details about your environment:
        https://github.com/TimDettmers/bitsandbytes/issues```

Have you been able to resolve the issue?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants