Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

chatbit-rag-app not working with Azure OpenAI #358

Open
bshetti opened this issue Dec 11, 2024 · 0 comments
Open

chatbit-rag-app not working with Azure OpenAI #358

bshetti opened this issue Dec 11, 2024 · 0 comments
Labels
bug Something isn't working documentation Improvements or additions to documentation

Comments

@bshetti
Copy link

bshetti commented Dec 11, 2024

When using the chatbot rag app, I ran into a few issues running this on my mac
1- the requirements file had issues with urllib3 version not working for botocore. I had to remove the version numbers to make it build a container
2-When running the container, the app comes up and works for bedrock, but with Azure OpenAI it fails with the following issues:

Here is the log error from the container when using Azure:
/usr/local/lib/python3.9/site-packages/langchain_community/chat_models/azure_openai.py:175: UserWarning: As of openai>=1.0.0, if deployment_name (or alias azure_deployment) is specified then openai_api_base (or alias base_url) should not be. Instead use deployment_name (or alias azure_deployment) and azure_endpoint.
warnings.warn(
/usr/local/lib/python3.9/site-packages/langchain_community/chat_models/azure_openai.py:183: UserWarning: As of openai>=1.0.0, if openai_api_base (or alias base_url) is specified it is expected to be of the form https://example-resource.azure.openai.com/openai/deployments/example-deployment. Updating "https://eden-pmm-dev-openai-eastus-

These are the env variables in the env file:

Uncomment and complete if you want to use Azure OpenAI

LLM_TYPE=azure
OPENAI_VERSION="2024-02-15-preview"
OPENAI_BASE_URL="https://eden-pmm-dev-openai-eastus-2.openai.azure.com/openai/deployments/gpt-4o-global"
OPENAI_API_KEY=ffae57d3XXXXX17bb0c7d27531
OPENAI_ENGINE="gpt-4o-global"

Just seems odd. Is there something wrong in the code or my config?

@bshetti bshetti added bug Something isn't working documentation Improvements or additions to documentation labels Dec 11, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working documentation Improvements or additions to documentation
Projects
None yet
Development

No branches or pull requests

1 participant