Skip to content

pyright mt-bench: Fix type issues#80

Merged
tomtseng merged 1 commit intomainfrom
tomtseng/mtbench-type
Feb 7, 2026
Merged

pyright mt-bench: Fix type issues#80
tomtseng merged 1 commit intomainfrom
tomtseng/mtbench-type

Conversation

@tomtseng
Copy link
Collaborator

@tomtseng tomtseng commented Feb 7, 2026

Changes

Fix/ignore pyright type issues in MT-Bench

Testing

Ran uv run tests/evals/test_mt_bench.py --tier medium. Results are similar to #58:

MT-Bench Results:
  Overall Score: 6.97
  Turn 1 Score:  7.40
  Turn 2 Score:  6.55

@tomtseng tomtseng merged commit aa176a3 into main Feb 7, 2026
1 of 2 checks passed
@tomtseng tomtseng deleted the tomtseng/mtbench-type branch February 7, 2026 06:04
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant