Add DPO support for DeepSpeed-Chat#828

Merged

tjruwase merged 11 commits intodeepspeedai:masterfrom

stceum:dpo_support

Jan 6, 2025

Commits on Oct 30, 2024

Merge branch 'master' into dpo_support
loadams
authored

Commits on Dec 18, 2024

Merge branch 'master' into dpo_support
tjruwase
authored

Commits on Dec 27, 2024

Merge branch 'master' into dpo_support
stceum
authored

Commits on Jan 1, 2025

Update README.md for Step2 DPO finetuning.
stceum
committed

Commits on Jan 2, 2025

Add opt 350M training log demo for step 2 dpo finetuning in DeepSpeed-Chat.
stceum
committed

Commits on Jan 3, 2025

Address the formatting issue in step2 dpo finetuning in DeepSpeed-Chat.
stceum
committed