Skip to content

fix: update scripts to adapt to new vllm versions#270

Merged
jiarong0907 merged 1 commit intoovg-project:mainfrom
ztang2370:fix/update-benchmark-script-to-adapt-to-new-vllm-version
Mar 12, 2026
Merged

fix: update scripts to adapt to new vllm versions#270
jiarong0907 merged 1 commit intoovg-project:mainfrom
ztang2370:fix/update-benchmark-script-to-adapt-to-new-vllm-version

Conversation

@ztang2370
Copy link
Contributor

This PR

  1. Removes disable-log-requests as this flag was removed from vllm since v0.12.0 (Scheduled removal of override_pooler_config and disable_log_requests vllm-project/vllm#29402)

  2. Updates benchmarks/bench_latency_benefit/bench_kvcached_vllm.py to make it compatible with newer vllm versions.

Copy link
Collaborator

@jiarong0907 jiarong0907 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM. Thank you!

@jiarong0907 jiarong0907 merged commit bd0b8ed into ovg-project:main Mar 12, 2026
6 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants