Missing docs/2-provision-azure-resources.md

[rwmehta]

The introduction md in the docs links to docs/2-provision-azure-resources.md as the next page, but it doesn't appear to exist anymore.

Also, I wasn't sure where to ask this question, but will this repo work with a non-OpenAI model deployed in AI Foundry, i.e. Llama? It's a little hard to tell because the prerequisites say OpenAI service is needed, which I believe is only limited to OpenAI's models, but there are other models in AI Foundry that use the OpenAI API (e.g. chat completions).

[olafwrieden]

Hi @rwmehta we are fixing the broken documentation link. It seems it was removed a long time ago but the links have not been updated. I've just fixed this yesterday in #442 and it's undergoing review. In short, you can use the one-click Deploy to Azure button to set up the resources, then reference them in your .env.local file.

Currently it only supports Azure OpenAI models because Azure Chat has been designed that way and it's tied into the infrastructure as code. When you set your environment variables, you can reference a an OpenAI deployment from AI Foundry but no other model providers. There is an open Issue asking for other models via AI Foundry but no work has started as it requires a fundamental change in the application. Different models have different capabilities/limitations/request bodies - meaning we'd need to show/hide functionality based on the model selected and add a translation layer like Semantic Kernel in the middle to form the expected payload for said model. You can read more on #480. Yes, technically possible but you'd have to make the modifications yourself at this time. If you do, and you'd like to share back with this community we welcome a Pull Request.

[rwmehta]

Thanks for the quick reply @olafwrieden. I'm not familiar with this codebase, so if you were able to point me in a more specific direction of what would need to be changed/could estimate how much time you think it'd take, I would really appreciate it.

Unfortunately I'm crunched for time for deploying a web UI, so just trying to figure out if this is still a viable option for me.

Thanks for the help!