Skip to content

Pull requests: OpenHands/benchmarks

New pull request New
19 Open 203 Closed
19 Open 203 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

Align default argument values with evaluation repository
#377 opened Jan 28, 2026 by simonrosenberg • Draft
Require explicit model_name for SWE-Bench converters
#376 opened Jan 28, 2026 by simonrosenberg Loading…
@simonrosenberg
2
refactor(swtbench): regroup all hyperparameters in constants.py
#372 opened Jan 27, 2026 by simonrosenberg Loading…
1
4
refactor(gaia): regroup all hyperparameters in constants.py
#371 opened Jan 27, 2026 by simonrosenberg Loading…
1
6
refactor(commit0): consolidate hyperparameters in constants.py
#370 opened Jan 27, 2026 by simonrosenberg Loading…
1
7
Regroup all multiswebench hyperparameters in constants.py
#369 opened Jan 27, 2026 by simonrosenberg Loading…
1
Regroup all swebenchmultimodal hyperparameters in constants.py openhands
#368 opened Jan 27, 2026 by simonrosenberg Loading…
1
Align Laminar runs with CI eval IDs
#362 opened Jan 26, 2026 by simonrosenberg Loading…
@simonrosenberg
3
Add security benchmark with ASTRA
#361 opened Jan 26, 2026 by XZ-X • Draft
Add SDK commit hash to workflow run titles for index benchmarks
#351 opened Jan 21, 2026 by juanmichelini Loading…
1
build(deps): bump the version-all group across 1 directory with 15 updates dependencies Pull requests that update a dependency file python:uv Pull requests that update python:uv code
#336 opened Jan 17, 2026 by dependabot bot Loading…
fix(swebench-multimodal): create output.report.json for consistency
#331 opened Jan 16, 2026 by juanmichelini Loading…
4
BREAKING: Rename --max-attempts to --n-critic-runs
#325 opened Jan 16, 2026 by juanmichelini • Draft
1
Fix SDK submodule update to handle commit SHAs
#311 opened Jan 14, 2026 by juanmichelini Loading…
8
Fix dataset loading schema validation issue in CI
#304 opened Jan 13, 2026 by juanmichelini Loading…
2
build(deps): bump actions/github-script from 7 to 8 in the version-all group dependencies Pull requests that update a dependency file github_actions Pull requests that update GitHub Actions code
#292 opened Jan 12, 2026 by dependabot bot Loading…
Add add_resolve_rate_to_predictions function to output_utils
#199 opened Dec 23, 2025 by juanmichelini • Draft
1
2
Agentic code search
#141 opened Dec 8, 2025 by adityasoni9998 Loading…
5
API-based Critic implementation build-swebench-200 Build 200 SWE-Bench Verified Image based on SDK version on this PR.
#117 opened Nov 26, 2025 by xingyaoww • Draft
2
ProTip! Follow long discussions with comments:>50.