Moe multipod#67

Open

bhavya01 wants to merge 17 commits intoalanwaketan/moefrom

Commits on Oct 21, 2024

Simplify moe code
bhavya01
committed

Commits on Oct 24, 2024

Add payload for GMM forward pass
bhavya01
committed

Commits on Oct 25, 2024

Commits on Oct 28, 2024

Commits on Oct 29, 2024

Commits on Oct 31, 2024

Fix reduce-scatter in backward pass according to number of slices
bhavya01
committed

Commits on Feb 7, 2025