Skip to content

adding cli entry for moe_configs#858

Open
danichan-mkm wants to merge 2 commits intoROCm:rocm_ck_moe_a16w4from
danichan-mkm:moe_config_flags
Open

adding cli entry for moe_configs#858
danichan-mkm wants to merge 2 commits intoROCm:rocm_ck_moe_a16w4from
danichan-mkm:moe_config_flags

Conversation

@danichan-mkm
Copy link

@danichan-mkm danichan-mkm commented Feb 11, 2026

Purpose

add cli entry for moe_configs so that we can specify which moe method to use from the serve command

@danichan-mkm danichan-mkm changed the title solving formatting issues adding cli entry for moe_configs Feb 11, 2026
@danichan-mkm
Copy link
Author

usage:
vllm serve model_name --moe_config.backend=TRITON
vllm serve model_name --moe_config.backend=CK
vllm serve model_name --moe_config.backend=MARLIN

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant