feat: implement medcalc bench scenario, metrics and specs#1

Draft

sashimono-san wants to merge 118 commits intomainfrom

feat/medcalc_bench_scenario

Commits on Nov 23, 2024

Commits on Nov 26, 2024

UNTESTED implementation of Medalign with new setup, pushing to test on Carina
aunell
committed

Commits on Nov 27, 2024

Commits on Nov 30, 2024

Added llama 3.1 instruct and medalign to schema_medical
MiguelAFH
committed

Commits on Dec 1, 2024

Added display name for Llama 3.2 1B Instruct
MiguelAFH
committed

Commits on Dec 3, 2024

Update summarization metrics and MedAlign spec to bring bertscore online, change bertscore backbone model to fit on 40GB GPU
aunell
committed

Commits on Dec 7, 2024

Added MedDialog to MEDHELM
MiguelAFH
committed

Commits on Dec 11, 2024

feat: implement medcalc bench scenario, metrics and specs
Leonardo Schettini
committed

Commits on Dec 12, 2024

feat: med calc bench one shot spec
Leonardo Schettini
committed

Commits on Dec 14, 2024

Added MIMIC-RRS scenario
MiguelAFH
committed

Commits on Dec 15, 2024

Commits on Dec 16, 2024

dischargeMe scenario + schema update
aunell
committed

Commits on Dec 17, 2024

fix: dataset loading and standardize naming
Leonardo Schettini
committed

Commits on Dec 19, 2024

Added medi_qa scenario
MiguelAFH
committed

Commits on Dec 22, 2024

feat: add mimic billing codes
suhana13
committed

Commits on Jan 6, 2025

Commits on Jan 9, 2025

Commits on Jan 10, 2025

Commits on Jan 14, 2025

Commits on Jan 15, 2025

Commits on Jan 17, 2025

Commits on Jan 18, 2025

Commits on Jan 19, 2025

Commits on Jan 20, 2025

update n2c2 to run within HELM environment
HennyJie
committed

Commits on Jan 22, 2025

Fixed prompts for ehrshot and n2c2
MiguelAFH
committed

Commits on Jan 23, 2025

Commits on Jan 24, 2025

Commits on Jan 30, 2025

Commits on Jan 31, 2025

Commits on Feb 4, 2025

Commits on Feb 6, 2025

Merged main
MiguelAFH
committed

Commits on Feb 7, 2025

Merge branch 'main' into med-helm
MiguelAFH
committed

Commits on Feb 9, 2025