diff --git a/README.md b/README.md index bc6efef9..a8eb5804 100644 --- a/README.md +++ b/README.md @@ -15,7 +15,7 @@ -## Overview +## (Testing) Overview NeMo DFM (Diffusion Foundation Models) is a library under [NeMo Framework](https://github.com/NVIDIA-NeMo), focusing on diffusion models for **Video**, **Image**, and **Text** generation. It unifies cutting-edge diffusion-based architectures and training techniques, prioritizing efficiency and performance from research prototyping to production deployment. diff --git a/dfm/src/megatron/model/wan/rope_utils.py b/dfm/src/megatron/model/wan/rope_utils.py index e3449275..1fe4ae80 100644 --- a/dfm/src/megatron/model/wan/rope_utils.py +++ b/dfm/src/megatron/model/wan/rope_utils.py @@ -18,7 +18,7 @@ class Wan3DRopeEmbeddings(torch.nn.Module): """ - Wan 3D RoPE embeddings implementation. + Wan 3D RoPE embeddings implementation. Change for Testing. Implements Wan's 3D RoPE embeddings for Mcore Attention based on Wan's implementation at https://github.com/Wan-Video/Wan2.1/blob/main/wan/modules/model.py. """