Skip to content

Conversation

@qimcis
Copy link
Collaborator

@qimcis qimcis commented Jan 8, 2026

Description

Added cs537 fall 2021 final, find the original exam here

Testing

Ran benchmarks/courseexam_bench/tests/test_data_schema.py

Checklist

  • Tests pass locally
  • Code follows project style guidelines
  • Documentation updated (if needed)

@tareknaser tareknaser self-requested a review January 8, 2026 16:55
Copy link
Collaborator

@tareknaser tareknaser left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for putting this together! I left a few comments but it's in good shape overall

@xuafeng xuafeng requested a review from paizhangliu January 8, 2026 18:18
@qimcis qimcis requested a review from tareknaser January 9, 2026 01:51
@tareknaser
Copy link
Collaborator

If #61 gets merged first, we’ll need some small updates to ExactMatch questions
mainly adding the options in the JSON for the LLM to choose from

@qimcis
Copy link
Collaborator Author

qimcis commented Jan 10, 2026

If #61 gets merged first, we’ll need some small updates to ExactMatch questions mainly adding the options in the JSON for the LLM to choose from

added! should be good to go once #61 is merged

Copy link
Collaborator

@tareknaser tareknaser left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thank you!
I added a few minor comments but all the previous comments have been addressed and I’ve approved this PR

Signed-off-by: Tarek <tareknaser360@gmail.com>
@tareknaser tareknaser merged commit 1ba10f8 into refactor_course_exam_bench Jan 12, 2026
tareknaser added a commit that referenced this pull request Jan 13, 2026
* add cs537 fall 2021 final exam

* add institution

* fix

* add solutions

* update metadata

* add choice array

* avoid extra restrictions on LLM output

Signed-off-by: Tarek <tareknaser360@gmail.com>

---------

Signed-off-by: Tarek <tareknaser360@gmail.com>
Co-authored-by: Tarek <tareknaser360@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants