Skip to content

Commit 2741e3f

Browse files
committed
fix cookbook
1 parent fdd14ee commit 2741e3f

File tree

2 files changed

+2
-2
lines changed

2 files changed

+2
-2
lines changed

cookbook/megatron/tp.sh

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1 +1 @@
1-
CUDA_VISIBLE_DEVICES=0,1,2,3,4,5,6,7 torchrun --nproc_per_node=8 ddp.py
1+
CUDA_VISIBLE_DEVICES=0,1,2,3,4,5,6,7 torchrun --nproc_per_node=8 tp.py

cookbook/megatron/tp_moe.sh

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1 +1 @@
1-
CUDA_VISIBLE_DEVICES=0,1,2,3,4,5,6,7 torchrun --nproc_per_node=8 ddp_moe.py
1+
CUDA_VISIBLE_DEVICES=0,1,2,3,4,5,6,7 torchrun --nproc_per_node=8 tp_moe.py

0 commit comments

Comments
 (0)