Support for DDP with multi nodes

[Freja71122]

Hi there,

I found the code can only run with multi gpus in one node, if there are supports for multi gpus in multi nodes?

@SteveJunGao

[SteveJunGao]

Hi @Freja71122,

Unfortunately, I haven't tried to run the code on multi-nodes, it only supports multi-gpus for now. It would be great if someone in the open-source community can extend it to multi-nodes

[SteveJunGao]

Hi @Freja71122, any updates on this issue? do you have further questions? or it's good to close this?

[Freja71122]

Thanks for your reply. I add the multi-nodes support feature, and hope it will help.
#40

I will close the issue, since I got enough help.