Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[<Agent component: framework|tool|llm|etc...>] ollama._types.ResponseError: pull model manifest: file does not exist #487

Open
3 tasks done
mushenL opened this issue Jun 13, 2024 · 0 comments
Assignees
Labels
bug Something isn't working

Comments

@mushenL
Copy link
Collaborator

mushenL commented Jun 13, 2024

Initial Checks

  • I have searched GitHub for a duplicate issue and I'm sure this is something new
  • I have read and followed the docs & demos and still think this is a bug
  • I am confident that the issue is with modelscope-agent (not my code, or another library in the ecosystem)

What happened + What you expected to happen

ollama._types.ResponseError: pull model manifest: file does not exist

Versions / Dependencies

modelscope 1.12.0
Python 3.8.18
Mac

Reproduction script

from modelscope_agent.agents import RolePlay

role_template = '你是一个agent小助手,你需要根据用户的要求来回答他们的问题'
llm_config = {
'model': 'qwen2_7b_instruct_q5_k_m',
'model_server': 'ollama',
}
function_list = []

import pdb; pdb.set_trace()

bot = RolePlay(function_list=function_list,llm=llm_config, instruction=role_template)

response = bot.run("你好,请以李云龙的语气和我对话")
text = ''
for chunk in response:
text += chunk
print(text)

Issue Severity

None

@mushenL mushenL added the bug Something isn't working label Jun 13, 2024
@mushenL mushenL self-assigned this Jun 13, 2024
mushenL pushed a commit to mushenL/modelscope-agent that referenced this issue Jun 13, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

1 participant