Skip to content

update evaluations#2

Draft
ouhenio wants to merge 12 commits intomainfrom
add-evaluations
Draft

update evaluations#2
ouhenio wants to merge 12 commits intomainfrom
add-evaluations

Conversation

@ouhenio
Copy link

@ouhenio ouhenio commented Jul 30, 2024

This PR:

  • Updates the README with usage instruction, so our collaborator have an easier time using this tool.
  • Adds a Makefile for an friendlier interface.
    • Models included: Phi-2, Phi-3
    • Tasks included: MMLU_ES, Hellaswag_es

Todos:

  • : Add funcitonal vllm option.
  • : Improve output formatting.
  • : Add PSUs.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant