Skip to content

Add action gain logging for tool evaluation#1

Draft
Ahermit01 wants to merge 1 commit intomainfrom
codex/optimize-image-quality-assessment
Draft

Add action gain logging for tool evaluation#1
Ahermit01 wants to merge 1 commit intomainfrom
codex/optimize-image-quality-assessment

Conversation

@Ahermit01
Copy link
Copy Markdown
Owner

Summary

  • add a reusable ActionGainRecord data structure and helpers for exporting action-to-quality gain samples
  • instrument the main pipeline to compute IQA scores before/after each tool invocation, dump the delta-Q logs into summary.json, and gate it behind an ActionGainLogging profile flag

Testing

  • python - <<'PY'
    import utils.action_gain_predictor as agp
    print('records ok', agp.ActionGainRecord)
    PY

Codex Task

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant