Skip to content

[docs] docs: sync smoke-claude toolset and max-turns after token optimization #1641

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
lpcox merged 1 commit into from
Apr 4, 2026
+3 −4
Merged

[docs] docs: sync smoke-claude toolset and max-turns after token optimization #1641

Changes from all commits
Commits
Show all changes
1 commit
Select commit
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
7 changes: 3 additions & 4 deletions docs/test-analysis/ci-smoke.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -163,14 +163,13 @@ These are gh-aw agentic workflows compiled from `.md` source files into `.lock.y

| Attribute | Value |
|-----------|-------|
| **What it tests** | Claude Code engine running inside AWF sandbox with MCP servers, Playwright, file I/O, and bash tools |
| **Engine** | `claude` (max 15 turns) |
| **What it tests** | Claude Code engine running inside AWF sandbox with GitHub API, Playwright, file I/O, and bash tools |
| **Engine** | `claude` (max 8 turns) |
| **Triggers** | Every 12h (schedule), PR (opened/synchronize/reopened), manual dispatch |
| **Timeout** | 10 minutes |
| **Network allowed** | defaults, github, playwright |
| **Tools** | cache-memory, github (repos, pull_requests), playwright, edit, bash |
| **Tools** | github (repos, pull_requests), playwright, bash |
| **Safe outputs** | add-comment (hide older), add-labels (smoke-claude) |
| **MCP** | ghcr.io/github/gh-aw-mcpg container |
| **Real-world mapping** | Validates that Claude Code can operate within AWF's network sandbox: GitHub API access via MCP, browser automation via Playwright, local file operations — the core use case for agentic workflows |
| **Gaps** | Non-deterministic (AI agent may behave differently). No HTTPS blocking verification. |
| **Integration test relationship** | High-level end-to-end complement. Integration tests verify AWF mechanics (iptables, proxy); this verifies an actual AI agent works through the firewall. |
Expand Down