Support for AWS Bedrock models

[MartinRistov]

Be happy to collab and help build this out, if you have some guidance! Cheers

[mmurad2]

Hi @MartinRistov I just checked and there is a contribution in progress here. I'll ping you once it is merged for a review!

[Tomas2D]

Temporary workaround with the use of LangChain. @MartinRistov

import { BaseMessage } from "bee-agent-framework/llms/primitives/message";
import { LangChainChatLLM } from "bee-agent-framework/adapters/langchain/llms/chat";

// you need to install this package first @langchain/community
import { BedrockChat } from "@langchain/community/chat_models/bedrock";

console.info("===CHAT===");
const llm = new LangChainChatLLM(
    new Bedrock({
      model: "anthropic.claude-v2",
      region: process.env.BEDROCK_AWS_REGION ?? "us-east-1",
      // endpointUrl: "custom.amazonaws.com",
      credentials: {
        accessKeyId: process.env.BEDROCK_AWS_ACCESS_KEY_ID,
        secretAccessKey: process.env.BEDROCK_AWS_SECRET_ACCESS_KEY,
      },
      temperature: 0,
      maxTokens: undefined,
      maxRetries: 2,
      // other params...
    })
);

const response = await llm.generate([
  BaseMessage.of({
    role: "user",
    text: "Hello world!",
  }),
]);

Related code: https://github.com/i-am-bee/bee-agent-framework/blob/main/examples/llms/providers/langchain.ts
LangChain documentation: https://js.langchain.com/docs/integrations/llms/bedrock#instantiation

[mmurad2]

AWS bedrock is now supported as inference provider (thanks to @abughali!) https://github.com/i-am-bee/bee-agent-framework/blob/main/examples/llms/providers/bedrock.ts

Looking forward to you feedback on this @MartinRistov!

[Tomas2D]

Released in v0.0.41