When Change Host , I can not list model

[edwardkuo]

After I changed the Host to 0.0.0.0 and tried to modify other Clients to make calls, I found that I couldn't load the model or execute the List command. The following error occurred:

PS C:\tool> foundry cache list
Exception: Request to local service failed. Uri:http://0.0.0.0:5272/openai/models
IPv4 address 0.0.0.0 and IPv6 address ::0 are unspecified addresses that cannot be used as a target address. (Parameter 'hostName') (0.0.0.0:5272)
Please check service status with 'foundry service status'.

However, when I changed it to localhost, it worked. This logic seems a bit unreasonable.

[filipw]

yes this is the same error as reported here #16 (comment)

[HaoHoo]

Looks like foundry model list is OK. But foundry model load and foundry cache list report 503

[HaoHoo]

Setting the host to 0.0.0.0 is denied in 0.2.9261.3945.
But we still need to the Foundry Local work on outer IPs

[edwardkuo]

Since the version update 0.2.9261.3945, we have been unable to convert IPs (not—-host command), which means we cannot provide services for other external clients to connect and use. Is there any special consideration regarding this?

[skottmckay]

It was a security requirement for the initial release to only accept local connections.

We will look at a potential enhancement where a user can explicitly enable other addresses if they understand the security implications of doing so.

[edwardkuo]

Thank you, @skottmckay, for your explanation. Earlier versions allowed other clients to connect. So, was the original goal of Local limited to being called only on a single machine? Or is it considered an edge solution? If the latter, this would enable Foundry Local to take greater advantage of edge capabilities.