fix ddp bug when --overlap-grad-reduce and --num-optim > 1#3693

Open

wplf wants to merge 3 commits intoNVIDIA:mainfrom

wplf:fix-ddp-bug-with-overlap

Commits on Mar 4, 2026

fix ddp bug when --overlap-grad-reduce and --num-distributed-optimizer-instances > 1
wplf
committed
Merge branch 'main' into fix-ddp-bug-with-overlap
wplf
authored

Commits on Mar 5, 2026

Merge branch 'main' into fix-ddp-bug-with-overlap
wplf
authored