New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add AWS Bedrock as an option (at least for Claude access) #63

Open

rberger opened this issue Jun 28, 2024 · 1 comment

rberger commented Jun 28, 2024

Would you consider adding AWS Bedrock and some (Claude) if not all their options as a source for LLMs?
Amazon Bedrock Runtime examples using SDK for Python (Boto3)

CGarces commented Jul 4, 2024

Using boto3 require some abstaction layer between maestro source code and bedrock

There is a more easy way, Anthropic’s client SDK already has implemented a proxy to amazon bedrock.

https://docs.anthropic.com/en/api/claude-on-amazon-bedrock

Change the dependency to anthropic[bedrock]
Modify all clients to use AnthropicBedrock
Cross your fingers and share your tests!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment