Skip to content

Add eval.yaml test cases for each skill #2

@TheStack-ai

Description

@TheStack-ai

Context

swing-skills has 6 skills (clarify, mortem, options, research, review, trace) but none have eval.yaml test files for use with pulser eval.

What to do

Add an eval.yaml next to each skill's SKILL.md with 2-3 test cases that verify the skill works correctly.

Example for swing-review/eval.yaml:

tests:
  - name: "catches obvious bug"
    input: "Review: function add(a,b) { return a - b }"
    assert:
      - contains: "subtract"
      - min-length: 50

Files to create

  • skills/swing-clarify/eval.yaml
  • skills/swing-mortem/eval.yaml
  • skills/swing-options/eval.yaml
  • skills/swing-research/eval.yaml
  • skills/swing-review/eval.yaml
  • skills/swing-trace/eval.yaml

Difficulty: Easy

No code knowledge needed — just YAML.

Metadata

Metadata

Assignees

No one assigned

    Labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions