[Feature] Mamba Hybrid Models#520

Open

clairesonglee wants to merge 25 commits intomainfrom

clairlee/dev/hybrid

Commits on Jan 29, 2026

initial commit

clairesonglee
authored and
Lee
committed
set self.lr_warmup_steps < self.lr_decay_steps

clairesonglee
authored and
Lee
committed
unwrap model to remove loss_mask parameter

clairesonglee
authored and
Lee
committed
add zebra-llama (hybrid mla mamba model) support

Mingyuyang-1
authored and
Lee
committed
add Zebra-Llama 3B configurations

Mingyuyang-1
authored and
Lee
committed
add Zebra-Llama 1B configs and remove unused configs

Mingyuyang-1
authored and
Lee
committed
remove unused configs

Mingyuyang-1
authored and
Lee
committed
Set submodule mamba to track enable-primus-hybrid-models branch
clairesonglee
committed

Commits on Feb 3, 2026

Commits on Feb 4, 2026

Commits on Feb 5, 2026

Commits on Feb 6, 2026

code lint with pre-commit
clairesonglee
committed