[bugfix] fix mtp (#12)

Jintao-Huang · web-flow · commit e3e3d48c3703 · 2026-04-03T10:37:55.000+08:00
diff --git a/src/mcore_bridge/patcher.py b/src/mcore_bridge/patcher.py
@@ -423,6 +423,7 @@ def forward(
             input_ids=input_ids,
             position_ids=position_ids,
             embedding=embedding,
+            packed_seq_params=packed_seq_params,
             hidden_states=hidden_states,
         )
         assert not self.transformer_layer.self_attention.config.apply_rope_fusion

Original file line number	Diff line number	Diff line change
`@@ -423,6 +423,7 @@ def forward(`
`423`	`423`	`input_ids=input_ids,`
`424`	`424`	`position_ids=position_ids,`
`425`	`425`	`embedding=embedding,`
	`426`	`+ packed_seq_params=packed_seq_params,`
`426`	`427`	`hidden_states=hidden_states,`
`427`	`428`	`)`
`428`	`429`	`assert not self.transformer_layer.self_attention.config.apply_rope_fusion`