setup vllm runner #1
Description
Add vllm runner within a "backend" folder and setup python functions (Backend service) to trigger inference. These functions will be used to create the gRPC definition
{{ message }}
Add vllm runner within a "backend" folder and setup python functions (Backend service) to trigger inference. These functions will be used to create the gRPC definition