Skip to content

Add Anthropic's skill-creator skill#2

Open
aman-remote wants to merge 2 commits intomainfrom
add-skill-creator
Open

Add Anthropic's skill-creator skill#2
aman-remote wants to merge 2 commits intomainfrom
add-skill-creator

Conversation

@aman-remote
Copy link
Copy Markdown
Collaborator

Adds the official skill-creator from Anthropic's skills repo.

This is a comprehensive toolkit for creating, testing, and iterating on skills:

  • Iteration loop: Draft a skill → spawn test cases (with-skill + baseline) → review outputs → improve → repeat
  • Eval viewer: Browser-based tool for qualitative review of outputs + quantitative benchmarks
  • Agents: Grader (assertion checking), comparator (blind A/B), analyzer (pattern detection)
  • Description optimization: Generates trigger eval queries, runs an optimization loop to improve skill triggering accuracy
  • Packaging: Bundles skills into .skill files
  • Scripts: Benchmark aggregation, report generation, eval runner

Includes all bundled resources (agents/, scripts/, eval-viewer/, assets/, references/).

aman-remote added 2 commits March 4, 2026 22:59
Full skill creation toolkit from https://github.com/anthropics/skills:
- Draft → test → review → improve iteration loop
- Eval viewer for qualitative + quantitative review
- Subagent-based parallel test execution with baselines
- Grader, comparator, and analyzer agents
- Description optimization for better skill triggering
- Skill packaging (.skill files)
- Benchmark aggregation with variance analysis
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant