Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

TypeError #146

Open
ZCzzzzzz opened this issue Aug 14, 2024 · 1 comment
Open

TypeError #146

ZCzzzzzz opened this issue Aug 14, 2024 · 1 comment

Comments

@ZCzzzzzz
Copy link

我在使用vllm0.5.0测试chatglm-6b的性能,一开始运行vllm时出现“AttributeError: ‘ChatGLMTokenizer‘ object has no attribute ‘tokenizer‘”的错误,把chatglm-6b中的tokenization_chatglm.py替换了之后运行vllm的benchmark_throughput.py时又出现如下错误,请问怎么解决?
Uploading chatglm报错.png…

@ZCzzzzzz
Copy link
Author

Traceback (most recent call last):
File "/workspace/zc/vllm-0.5.0/benchmarks/benchmark_throughput.py", line 411, in
main(args)
File "/workspace/zc/vllm-0.5.0/benchmarks/benchmark_throughput.py", line 211, in main
tokenizer = AutoTokenizer.from_pretrained(
File "/usr/local/lib/python3.10/site-packages/transformers/models/auto/tokenization_auto.py", line 882, in from_pretrained
return tokenizer_class.from_pretrained(
File "/usr/local/lib/python3.10/site-packages/transformers/tokenization_utils_base.py", line 2271, in from_pretrained
return cls._from_pretrained(
File "/usr/local/lib/python3.10/site-packages/transformers/tokenization_utils_base.py", line 2505, in _from_pretrained
tokenizer = cls(*init_inputs, **init_kwargs)
File "/root/.cache/huggingface/modules/transformers_modules/tokenization_chatglm.py", line 89, in init
self.tokenizer = SPTokenizer(vocab_file)
File "/root/.cache/huggingface/modules/transformers_modules/tokenization_chatglm.py", line 14, in init
assert os.path.isfile(model_path), model_path
File "/usr/local/lib/python3.10/genericpath.py", line 30, in isfile
st = os.stat(path)
TypeError: stat: path should be string, bytes, os.PathLike or integer, not NoneType

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant