Llama v2 finetuning#1

Open

bhargaveede wants to merge 18 commits intobhargaveede:beede/llamav2from

itayhubara:llama_v2_finetuning

Commits on Jan 18, 2024

adding initial code drop for llm finetune
itayhubara
committed

Commits on Feb 1, 2024

Commits on Feb 5, 2024

Commits on Feb 6, 2024

fix logging bug and update HP
itayhubara
committed

Commits on Feb 19, 2024

adding patch for memmory issue and fused model enablement
itayhubara
committed

Commits on Feb 21, 2024

fixing dataset and model links and updating bash script and readme
itayhubara
committed

Commits on Feb 23, 2024

Commits on Feb 25, 2024

Remove training_step
michal2409
committed

Commits on Feb 26, 2024

Commits on Feb 28, 2024

adding weight decay to TrainingArguments and BLOCK_START BLOCK_STOP
itayhubara
committed

Commits on Feb 29, 2024

Commits on Mar 11, 2024

updating bash script for GBS=8
itayhubara
committed

Commits on Mar 31, 2024

scripts/mlperf_logging_utils.py
itayhubara
committed