Skip to content

refactor(create-expert): document why exec is used in expert-tester#374

Merged
FL4TLiN3 merged 1 commit intomainfrom
refactor/357-document-exec-usage
Jan 3, 2026
Merged

refactor(create-expert): document why exec is used in expert-tester#374
FL4TLiN3 merged 1 commit intomainfrom
refactor/357-document-exec-usage

Conversation

@FL4TLiN3
Copy link
Contributor

@FL4TLiN3 FL4TLiN3 commented Jan 3, 2026

Summary

Add documentation explaining why exec is used in expert-tester instead of delegation.

Changes

Added explanation note in expert-tester instruction:

NOTE: We use `exec` instead of delegation because we need to test the Expert as a black-box,
exactly as end-users would run it via the CLI. This ensures realistic test conditions.

Rationale

Per user decision: documentation only, no design changes. The expert-tester uses exec to invoke perstack CLI commands rather than delegating to the expert under test. This is intentional because:

  1. Black-box testing: Tests should exercise the Expert exactly as users would
  2. Realistic conditions: CLI execution includes all real runtime behaviors
  3. End-to-end verification: Catches issues that might not appear with delegation

Closes #357

🤖 Generated with Claude Code


Note

Documentation-only update

  • In create-expert-toml.ts, updates expert-tester instructions to explain using exec (instead of delegation) to run experts as a black-box via CLI for realistic test conditions
  • Adds .changeset/document-exec-usage.md to record the patch-level change for create-expert

No functional code changes

Written by Cursor Bugbot for commit 3c30c9a. This will update automatically on new commits. Configure here.

Add explanation that exec is used instead of delegation for black-box
testing that matches how end-users run Experts via CLI.

Closes #357
@codecov
Copy link

codecov bot commented Jan 3, 2026

Codecov Report

✅ All modified and coverable lines are covered by tests.

📢 Thoughts on this report? Let us know!

@FL4TLiN3 FL4TLiN3 merged commit d86fedc into main Jan 3, 2026
7 checks passed
@FL4TLiN3 FL4TLiN3 deleted the refactor/357-document-exec-usage branch January 3, 2026 06:15
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Refactor: expert-tester uses exec instead of delegation for testing

1 participant