Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

garbled text generation on Mac #3629

Open
GPTLocalhost opened this issue Nov 21, 2024 · 0 comments
Open

garbled text generation on Mac #3629

GPTLocalhost opened this issue Nov 21, 2024 · 0 comments

Comments

@GPTLocalhost
Copy link

python3 -m fastchat.serve.cli --device mps --model-path lmsys/vicuna-7b-v1.5

The above command produces the following garbled text. What can I do? Thank you for any advcie.

USER: hello
ASSISTANT: We detected that you are passing past_key_values as a tuple of tuples. This is deprecated and will be removed in v4.47. Please convert your cache or use an appropriate Cache class (https://huggingface.co/docs/transformers/kv_cache#legacy-cache-format)
sol assumColor� objects sk requireical During> город emptynotationsel National vb�“.igiниюheckIII пери
viceenen0trz Nan органuallyNotFoundannelaalrivatelag externesstoffográutelyenschapp.emblyUID становникаird Gh, државиW grandessingleusettshoraój printedРСР removnection�l,\ enter host Simple3archivigit Biography фран thing Ottoхівовано Wolfgangeor Invaliddbc Une�� Lynбуnego FrederEpandasindowrachestre hijdep BranVALUE`arium

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant