vllm: error: unrecognized arguments: --tool-server demo

[chaitanyamanem]

I am trying to run the tool usage example of gpt-oss, using the below commands

pip install gpt-oss
vllm serve ... --tool-server demo

I am using the pre-built docker rocm/vllm-dev:open-mi300-08052025, but i am getting below error

vllm: error: unrecognized arguments: --tool-server demo

Any help appreciated

[simon-mo]

The rocm image indeed don't have the prebuild wheel similar to the cuda wheel. cc @hongxiayang

FYI for CUDA image we ended up building from source with the pre-release gpt-oss repository.

[chaitanyamanem]

Thanks for responding. Is there a way to make the tool calls work on rocm image ?

[hongxiayang]

@chaitanyamanem I will help you.