Anthropic via AWS Bedrock

[StevenXL]

Hi!

Great project; I really like the direction / plan for it.

I would like to start using it locally, but would require it to support AWS Bedrock. Does it do that yet?

[josharian]

It does not yet.

I’ve never used Bedrock before. According to Claude, it is not just a matter of a different endpoint URL and API key, but the request and response format is different as well. If that is in fact,true, the effort required to integrate this is a bit harder, and not likely something I see us working on in the very near term. There is enough layering in pace that this isn’t a significant architectural change, just a pile of code (which Claude would be fine at writing), and then some inevitable fairly tedious debugging.

A pull request would be welcome, if you feel inspired and get it working.

[jmpolom]

I’ve never used Bedrock before. According to Claude, it is not just a matter of a different endpoint URL and API key, but the request and response format is different as well. If that is in fact,true, the effort required to integrate this is a bit harder, and not likely something I see us working on in the very near term.

I haven't used this myself however there is a shim layer tool from AWS that presents an openai compatible API endpoint and translates between the openai format and bedrock API format: bedrock-access-gateway

This might be a stop gap option for those looking to use sketch with bedrock until native support can be integrated?

[josharian]

Sketch is no longer being actively developed. (We'll be archiving the project soon.) Folks are of course more than welcome to fork and run with it.