Skip to content

[QUARK-479] Fix per-layer quant dtype in DeepSeek attention init #268

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
thpereir wants to merge 2 commits into
base: thpereir/quark_quant_layer
Choose a base branch
from

fix: use per-layer resolve for MTP FP4 bypass in deepseek_mtp

6045cef
Select commit
Loading
Failed to load commit list.
Open

[QUARK-479] Fix per-layer quant dtype in DeepSeek attention init #268

fix: use per-layer resolve for MTP FP4 bypass in deepseek_mtp
6045cef
Select commit
Loading
Failed to load commit list.

There are no checks for this commit