Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Can we add openrouter as an API provider? #62

Open
chenyuz3 opened this issue Oct 21, 2024 · 4 comments
Open

Can we add openrouter as an API provider? #62

chenyuz3 opened this issue Oct 21, 2024 · 4 comments

Comments

@chenyuz3
Copy link

Or simply let us decide the url for api (for openai compatible apis)?

@hiidemo
Copy link

hiidemo commented Oct 21, 2024

I am also interested in this issue

@tylermaran
Copy link
Contributor

Hey @chenyuz3.

  1. There is a PR open to add vercel sdk (Add Vercel SDK to node package to support multiple models #46) to switch between different models on the node package.
  2. Totally agree on allowing a url for openai compatible apis. We've had this request a few times!

Also are you on the python or the node version right now?

@chenyuz3
Copy link
Author

Hey @chenyuz3.

  1. There is a PR open to add vercel sdk (Add Vercel SDK to node package to support multiple models #46) to switch between different models on the node package.
  2. Totally agree on allowing a url for openai compatible apis. We've had this request a few times!

Also are you on the python or the node version right now?

Hi Tyler, I am using python and I tried to use the Azure option in the demo where I tried to simply change the url there but it failed

@pradhyumna85
Copy link
Contributor

pradhyumna85 commented Oct 21, 2024

@chenyuz3, your use case is already supported in python SDK, you just need to set different environment variables and pass the model parameter as shown here https://docs.litellm.ai/docs/providers/openrouter

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

4 participants