benchmark for vLLM #6
Description
I've successfully used the benchmark sweep.py on llama-cpp, but i'm wondering if there is also a sweep.py available for vLLM
{{ message }}
I've successfully used the benchmark sweep.py on llama-cpp, but i'm wondering if there is also a sweep.py available for vLLM