Makes port optional in the URL for serverless compute

[jacobphillips99]

Currently the implementation for hosting server-side models relies on binding to a "port" number such as 8000. However, if we want to use cloud-based compute orchestration platforms like Modal, there's no persistent port as the provider handles all the networking. We want to make the port number optional for the URL.

In auto_eval Job SQLModel, policy_server_port is cast as an integer type. In order to prevent database migration, we use -1 as a sentinel value to avoid adding the port to the URL.

See similar PR in mse-check repo: zhouzypaul/mse-check#1

[zhouzypaul]

Thanks for the PR!

We would also need to modify this API endpoint here to support testing the connecting without having a port:

auto_eval/job_scheduler.py

Line 259 in 89d9aba

def test_policy_server(request: PolicyServerTestRequest):

[jacobphillips99]

@zhouzypaul made a helper function and updated the downstream messages!

[zhouzypaul]

Thanks! Will merge in a branch for testing!