diff --git a/third_party/Megatron-LM b/third_party/Megatron-LM
index 847781764..45b404c8a 160000
--- a/third_party/Megatron-LM
+++ b/third_party/Megatron-LM
@@ -1 +1 @@
-Subproject commit 847781764fe468c90caec16309deded245c1022c
+Subproject commit 45b404c8aa2ff923d1e0a8b0ee8aec45d827cef4