We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
./llama2.soc llama2-7b_int8_1dev.bmodel Demo for LLama2-7B in BM1684X Init Environment ... Load tokenizer.model ... Done! Device [ 0 ] loading .... [BMRT][bmcpu_setup:406] INFO:cpu_lib 'libcpuop.so' is loaded. bmcpu init: skip cpu_user_defined open usercpu.so, init user_cpu_init Model[llama2-7b_int8_1dev.bmodel] loading .... [BMRT][load_bmodel:1084] INFO:Loading bmodel from [llama2-7b_int8_1dev.bmodel]. Thanks for your patience... [BMRT][load_bmodel:1023] INFO:pre net num: 0, load net num: 66 [BMODEL][read_binary:461] FATAL: size + offset <= binary->size()
The text was updated successfully, but these errors were encountered:
请提供完整的复现流程,包括不限于以下要素: 1.测试平台。 2.测试的SDK版本,包括libsophon的版本,可以通过bm-smi、bm_version命令查看,bm_version命令仅限soc模式下使用。 3.提供bm-smi显示的TPU内存大小。 4.是否有按照README要求修改内存分布。
Sorry, something went wrong.
SophonSDK version: 23.09 LTS sophon-soc-libsophon : 0.4.9 sophon-soc-libsophon-dev : 0.4.9 sophon-mw-soc-sophon-ffmpeg : 0.8.0 sophon-mw-soc-sophon-opencv : 0.8.0 BL2 BL31 psys-sdhc KernelVersion : Linux aibox-bm1684x 5.4.217-bm1684 #3 SMP Tue Apr 23 10:23:57 CST 2024 aarch64 aarch64 aarch64 GNU/Linux HWVersion: 0x00 MCUVersion: 0x02
No branches or pull requests
./llama2.soc llama2-7b_int8_1dev.bmodel
Demo for LLama2-7B in BM1684X
Init Environment ...
Load tokenizer.model ... Done!
Device [ 0 ] loading ....
[BMRT][bmcpu_setup:406] INFO:cpu_lib 'libcpuop.so' is loaded.
bmcpu init: skip cpu_user_defined
open usercpu.so, init user_cpu_init
Model[llama2-7b_int8_1dev.bmodel] loading ....
[BMRT][load_bmodel:1084] INFO:Loading bmodel from [llama2-7b_int8_1dev.bmodel]. Thanks for your patience...
[BMRT][load_bmodel:1023] INFO:pre net num: 0, load net num: 66
[BMODEL][read_binary:461] FATAL: size + offset <= binary->size()
The text was updated successfully, but these errors were encountered: