Skip to content
This repository was archived by the owner on Sep 23, 2025. It is now read-only.

[Finetune] Add finetune Gaudi workflow#240

Open
Deegue wants to merge 11 commits intointel:mainfrom
Deegue:add_finetune_gaudi2
Open

[Finetune] Add finetune Gaudi workflow#240
Deegue wants to merge 11 commits intointel:mainfrom
Deegue:add_finetune_gaudi2

Conversation

@Deegue
Copy link
Copy Markdown
Contributor

@Deegue Deegue commented May 30, 2024

Including following models:
"EleutherAI/gpt-j-6b"
"meta-llama/Llama-2-7b-chat-hf"
"mistralai/Mistral-7B-v0.1"
"google/gemma-2b"

@Deegue Deegue changed the title [Finetune] Add finetune gaudi2 workflow [Finetune] Add finetune Gaudi workflow May 30, 2024
docker exec "finetune" bash -c "llm_on_ray-finetune --config_file llm_on_ray/finetune/finetune_gaudi.yaml"
}

denas_lora_test_gaudi(){
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

deltatuner is removed, not supported.

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

removed, thanks for review!

docker image prune -f
}

build_and_prune_gaudi() {
Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

there is no need to duplicate code, could you merge this with build_and_prune

Signed-off-by: Yizhong Zhang <zyzzxycj@163.com>
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants