fix ddp bug when --overlap-grad-reduce and --num-distributed-optimi for dev#3694
Open
wplf wants to merge 1 commit intoNVIDIA:devfrom
Open
fix ddp bug when --overlap-grad-reduce and --num-distributed-optimi for dev#3694wplf wants to merge 1 commit intoNVIDIA:devfrom
wplf wants to merge 1 commit intoNVIDIA:devfrom
