-
Notifications
You must be signed in to change notification settings - Fork 8
Open
Labels
enhancementNew feature or requestNew feature or request
Description
The plan is for me to get more familiar with the Course Lab Benchmark while taking notes on areas that could be improved. After that, I’ll submit a PR with the proposed updates.
The end goal isn’t super structured yet but a few things I have in mind are:
- Add tests
- Add support for including additional courses (right now, we only include
mit_65840_2024). We should have a more generic data schema so that labs from other classes can be included as well.- Then also update the instructions on how to extend the benchmark accordingly
- Add templates for pre-training and fine-tuning
xuafeng
Metadata
Metadata
Assignees
Labels
enhancementNew feature or requestNew feature or request