Smoke Test: Claude - 23967713187 #24410
Description
Summary
Smoke test run for Claude engine — Run §23967713187
Overall Status: PARTIAL (2 tests skipped due to integrity policy / no suitable target)
PR used for review tests: #23695
Timestamp: 2026-04-04T00:57Z
Core Test Results (#1–12)
| # | Test | Status |
|---|---|---|
| 1 | GitHub MCP: Last 2 merged PRs (#24400, #24395) | ✅ |
| 2 | MCP Scripts GH CLI: Queried 2 open PRs (#24404, #23695) | ✅ |
| 3 | Serena MCP: Project activated, 3 symbols found (NewLogsCommand, ProcessedRun, EpisodeData) |
✅ |
| 4 | Make Build: make build succeeded |
✅ |
| 5 | Playwright: Navigated to github.com, title contains "GitHub" | ✅ |
| 6 | Tavily: 5 results returned for "GitHub Agentic Workflows" | ✅ |
| 7 | File Writing: Created /tmp/gh-aw/agent/smoke-test-claude-23967713187.txt |
✅ |
| 8 | Bash: Verified file contents via cat |
✅ |
| 9 | Discussion: Queried discussion #24402, added comic-book comment | ✅ |
| 10 | Agentic Workflows MCP: smoke-claude status=active, wrote to file |
✅ |
| 11 | Slack: Posted to #smoke-tests via safe-output tool |
✅ |
| 12 | Code Scanning Alert: Created dummy warning on README.md:1 | ✅ |
PR Review Test Results (#13–19)
| # | Test | Status |
|---|---|---|
| 13 | Update PR body (appended test message to #23695) | ✅ |
| 14 | PR Review Comments: 2 inline comments on #23695 | ✅ |
| 15 | Submit PR Review: COMMENT review submitted on #23695 | ✅ |
| 16 | Resolve Review Thread | |
| 17 | Add Reviewer: Added copilot to #23695 |
✅ |
| 18 | Push to PR Branch: smoke-test-files/smoke-claude-push-test.md pushed to #23695 |
✅ |
| 19 | Close PR |
Notes
- Serena
find_symbolinitial call timed out; retry with specific symbol names succeeded - PR review thread data filtered by integrity policy (test Update default model in Codex engine to o4-mini and adjust test expectations #16 skipped)
- All other tests passed nominally
References:
Note
🔒 Integrity filter blocked 1 item
The following item were blocked because they don't meet the GitHub integrity level.
- fix: Gemini CLI exits 41 in AWF sandbox — missing API key and ~/.gemini dir #23695
pull_request_read: has lower integrity than agent requires. The agent cannot read data with integrity below "approved".
To allow these resources, lower min-integrity in your GitHub frontmatter:
tools:
github:
min-integrity: approved # merged | approved | unapproved | none💥 [THE END] — Illustrated by Smoke Claude · ● 339.2K · ◷
- expires on Apr 4, 2026, 3:01 AM UTC