AWS Bedrock platform support

[bjalt]

I'm trying to integrate the Bedrock platform to be used with the llm-chain. I was trying to implement Bedrock using async-aws BedrockClient to offload the signing Http calls part. While looking into the possibilities to integrate I saw the issue that the ModelClients always expect a HttpResponse.
To facilitate using the BedrockClient I need a ModelClient which does not return a HttpResponse but rather handles the conversion internally and then return a LlmResponse directly.

Would that be something you are willing to merge or do you have a pointer how to better go about the integration?

[chr-hertel]

Hey @bjalt,

thanks for reaching out & the idea - that would be interesting to see! I'm currently not 100% happy with the extension point of the ModelClient - or the Platform in general. you can see with #280 that i went weird ways already myself - so your use-case, solution and workaround might help to iron that out.

Thanks already!

[bjalt]

See #312 for progress.

[chr-hertel]

Yup, best solution to go with a separate Platform class 👍 looks good already

[bjalt]

@chr-hertel Should I create a PR to the LLM-Chain Bundle for the changes to allow Bedrock configuration?

I will also have a look at the demo application if something needs to be changed there.

[chr-hertel]

@bjalt I'm happy if you'd have a look - currently the bundle is not up to Speed with all changes in LLM Chain, unfortunately

[bjalt]

@chr-hertel Yes, the Image handling in the profile is also broken. I'll have a look what else I can see.