Skip to content

Releases: NVIDIA-NeMo/Emerging-Optimizers

v0.1.0

12 Nov 03:59
d5363b4

Choose a tag to compare

Add support of preconditioning optimizers, Muon, Soap, PGSD.

Add support of distributed Newton-Schulz for tensor parallel support in Muon.