Support for Amazon Nova models via Amazon Bedrock

[micahwalter]

Description

I'd love to see the Amazon Nova models available via the Amazon Bedrock provider.

I'd be happy to help with this!

[meowgorithm]

Hey! We're 100% down to add support for Amazon Nova. Give us a little bit to come back with some more details on implementation, but in general it'll be similar to how to how we handle Anthropic models in Bedrock.

[Gustave-241021]

@micahwalter I have already introduced some corresponding models in Catwalk, you just need to implement them in Fantasy to use them charmbracelet/catwalk#144

[micahwalter]

Ah thanks! I don't really understand the diff between Catwalk and Fantasy and how they relate to Crush.. but this sounds good! Happy New Year!

[andreynering]

Hi @micahwalter!

Let us know if you're willing to open a PR for it.

We're here to assist you if you need any direction. Just let me know if you prefer email, Slack or Discord (or something else) and I'm available to chat.

[micahwalter]

Yes, I can work on this. Just need to understand how to implement the models here. I'll have a look and will find you on Discord shortly.

[micahwalter]

When I look at this file - providers/bedrock/bedrock.go - It seems like it was intended to be a interface to Bedrock models, but what it's actually doing is just referring to the providers/anthropic/bedrock.go file where you are using the AWS SDK for Go to auth to Bedrock.

Seems like providers/bedrock/bedrock.go should be where the SDK for Bedrock stuff lives?

[andreynering]

@micahwalter Yes. We should probably keep using the Anthropic SDK for Claude models, but use Bedrock SDK for Amazon stuff.

We have a similar scenario for the Google adapter. It uses either the Anthropic or Gemini SDK, depending on the model:

fantasy/providers/google/google.go

Line 156 in ee7f5ff

if strings.Contains(modelID, "anthropic") || strings.Contains(modelID, "claude") {

[micahwalter]

OK I have submitted PRs for both Fantasy and Catwalk.. I wrote most of this code with Kiro... but it does have comprehensive tests, and I have tried this with a local install of Crush and it all seems to work!

[andreynering]

@micahwalter Thank you! This is in my TODO list to review. 🙂

[Gustave-241021]

Is the pull request (PR) I submitted earlier abandoned? charmbracelet/catwalk#144

[andreynering]

@Gustave-241021 As you can see by looking at #117 and charmbracelet/catwalk#155, this actually required more work than just adding a couple models to Catwalk.

Also, @micahwalter is an Amazon employee, so he has knowledge on how to properly use their SDKs to accomplish this. 🙂

[Gustave-241021]

@andreynering Okay, I will remove it from my attention list. Thank you