Add thinking prefix and tool response for empty assistant messages#13

Draft

AlexCuadron wants to merge 112 commits intomainfrom

openhands-workspace-af5oj22b

Commits on Feb 25, 2025

Commits on Feb 26, 2025

Merge remote-tracking branch 'origin/main'
AlexCuadron
committed
Add polyglot benchmark implementation
AlexCuadron
committed
Fix argument parser in polyglot benchmark
AlexCuadron
committed
Improve polyglot benchmark path handling and fix logging error
AlexCuadron
committed
Add Docker configuration options and troubleshooting guide
AlexCuadron
committed
Add local Docker image build support for polyglot benchmark
AlexCuadron
committed
Set Docker image to build automatically by default
AlexCuadron
committed
Fix Docker build issues by adding unzip and simplifying Gradle installation
AlexCuadron
committed
Restrict polyglot benchmark to use only the same tools as SWE-Bench (execute_bash, finish, str_replace_editor)
AlexCuadron
committed
Fix runtime completion to use Docker runtime for running tests
AlexCuadron
committed
Add script to test one instance per language in polyglot benchmark
AlexCuadron
committed
Add one-per-language testing mode to polyglot benchmark run_infer.sh
AlexCuadron
committed
Update README with one-per-language testing instructions and command-line options
AlexCuadron
committed
Enable LLM completions logging in aider_bench run_infer.py
AlexCuadron
committed
Include tools information in evaluation output directory names
AlexCuadron
committed
Add evaluation parameter to run_infer.sh scripts for aider_bench and polyglot_benchmark
AlexCuadron
committed
Update README files with documentation for the new evaluation parameter
AlexCuadron
committed
Fix output directory detection in evaluation scripts
AlexCuadron
committed
Fix LLM completions logging to ensure it's enabled in all benchmarks
AlexCuadron
committed
Improve output directory detection in evaluation scripts with better path matching and debugging output
AlexCuadron
committed
Fix handling of 'eval' parameter to prevent it from being treated as an instance ID
AlexCuadron
committed
Merge pull request #6 from AlexCuadron/polyglot-benchmark-clean
AlexCuadron
authored

Commits on Feb 28, 2025

Commits on Mar 1, 2025

Commits on Mar 2, 2025

Commits on Mar 3, 2025

Commits on Mar 5, 2025

Merge pull request #12 from AlexCuadron/aime2024-benchmark
AlexCuadron
authored

Commits on Mar 6, 2025

Add thinking prefix and tool response for empty assistant messages
AlexCuadron
committed