Skip to content

Conversation

@tareknaser
Copy link
Collaborator

Description

Added 6.5840 Spring 2025 Exam 1 to courseexam benchmark

Testing

Ran benchmarks/courseexam_bench/tests/test_data_schema.py

Checklist

  • Tests pass locally
  • Code follows project style guidelines
  • Documentation updated (if needed)

@xuafeng xuafeng requested review from paizhangliu and qimcis January 9, 2026 19:36
@xuafeng
Copy link
Collaborator

xuafeng commented Jan 9, 2026

Hi @qimcis and @paizhangliu, could you please help arerk check his PR? Thanks.

Copy link
Contributor

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

This pull request adds the 6.5840 Spring 2025 Exam I to the courseexam benchmark. The PR includes an exam markdown file with 11 questions covering distributed systems topics and a PDF solution file.

Key Changes

  • Added exam metadata with score statistics (total: 65, avg: 51.85, median: 52)
  • Added 11 questions covering MapReduce, fault tolerance, linearizability, GFS, Raft, ZooKeeper, and Spanner
  • Included answer keys and grading instructions for each question

Reviewed changes

Copilot reviewed 1 out of 2 changed files in this pull request and generated 2 comments.

File Description
exam.md Contains the exam questions, metadata, answers, and grading instructions in structured markdown format
q25-1-sol.pdf Binary PDF file containing exam solutions (777 lines of PDF content)
Comments suppressed due to low confidence (1)

benchmarks/courseexam_bench/data/6_5840_distributed_system_engineering_spring_2025_exam_i/exam.md:292

  • There is a formatting issue. "t+ 1" should be "t + 1" (with spaces around the plus sign for consistency with mathematical notation).
C. Raft guarantees that a leader in term tis leader in term t+ 1

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

Copy link
Contributor

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Copilot reviewed 1 out of 2 changed files in this pull request and generated no new comments.


💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

Copy link
Collaborator

@xuafeng xuafeng left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Look great for me.

@tareknaser
Copy link
Collaborator Author

If #61 gets merged first, we’ll need some small updates to ExactMatch questions
mainly adding the options in the JSON for the LLM to choose from

Signed-off-by: Tarek <tareknaser360@gmail.com>
@tareknaser tareknaser merged commit 436242c into main Jan 12, 2026
4 checks passed
@tareknaser tareknaser deleted the course_65840 branch January 12, 2026 20:53
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants