Skip to content

fix: llm_judge test category has no execution path in cogworks-eval.py #33

@williamhallatt

Description

@williamhallatt

test-case-template.jsonl and deployment-skill/test-cases.jsonl define llm_judge category cases. cogworks-eval.py only handles activation-based behavioral tests — no code path to run LLM-judge quality checks exists. Fix: annotate templates as aspirational or implement a runner in cogworks-eval.py. Part of tests/ audit #23-#32.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions