Skip to content

Cuda graphed torch grouped mm for MoE inference. #3677

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Draft
sidsingh-nvidia wants to merge 105 commits into
base: main
Choose a base branch
from
+2,970 −241

work with qwen3 on hopper

b7821ac
Select commit
Loading
Failed to load commit list.
Sign in for the full log view
Draft

Cuda graphed torch grouped mm for MoE inference. #3677

work with qwen3 on hopper
b7821ac
Select commit
Loading
Failed to load commit list.
assign-reviewer
succeeded Mar 3, 2026 in 12s