Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Enable more supported models with ollama #462

Open
yanxi0830 opened this issue Nov 15, 2024 · 1 comment
Open

Enable more supported models with ollama #462

yanxi0830 opened this issue Nov 15, 2024 · 1 comment
Labels
good first issue Good for newcomers

Comments

@yanxi0830
Copy link
Contributor

🚀 The feature, motivation and pitch

Context

  • We currently have ollama supported models defined in
    model_aliases = [
    build_model_alias(
    "llama3.1:8b-instruct-fp16",
    CoreModelId.llama3_1_8b_instruct.value,
    ),
    build_model_alias(
    "llama3.1:70b-instruct-fp16",
    CoreModelId.llama3_1_70b_instruct.value,
    ),
    build_model_alias(
    "llama3.2:1b-instruct-fp16",
    CoreModelId.llama3_2_1b_instruct.value,
    ),
    build_model_alias(
    "llama3.2:3b-instruct-fp16",
    CoreModelId.llama3_2_3b_instruct.value,
    ),
    build_model_alias(
    "llama-guard3:8b",
    CoreModelId.llama_guard_3_8b.value,
    ),
    build_model_alias(
    "llama-guard3:1b",
    CoreModelId.llama_guard_3_1b.value,
    ),
    build_model_alias(
    "x/llama3.2-vision:11b-instruct-fp16",
    CoreModelId.llama3_2_11b_vision_instruct.value,

New Feature

  • We should enable support for more llama models served with ollama, with updating these list of aliases.
  • ollama supported llama models: https://ollama.com/search?q=llama

Alternatives

No response

Additional context

No response

@yanxi0830 yanxi0830 added the good first issue Good for newcomers label Nov 15, 2024
@hickeyma
Copy link
Contributor

@yanxi0830 I would like to work on this is that's OK?

ashwinb pushed a commit that referenced this issue Nov 23, 2024
# What does this PR do?

Update the llama model supported list for Ollama.

- [x] Addresses issue (#462)

Signed-off-by: Martin Hickey <[email protected]>
SLR722 pushed a commit that referenced this issue Nov 27, 2024
# What does this PR do?

Update the llama model supported list for Ollama.

- [x] Addresses issue (#462)

Signed-off-by: Martin Hickey <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
good first issue Good for newcomers
Projects
None yet
Development

No branches or pull requests

2 participants