-
Notifications
You must be signed in to change notification settings - Fork 322
Smoke Test: Claude - 23900581947 #24103
Copy link
Copy link
Closed as not planned
Labels
Description
Overview
Smoke test run for Claude engine on 2026-04-02. PR used for review testing: #24065 (refactor: migrate features.difc-proxy to tools.github.integrity-proxy).
Overall Status: PARTIAL (core tests all pass; 3 tests skipped due to environment constraints)
Test Results
Core Tests (#1–11)
| # | Test | Result |
|---|---|---|
| 1 | GitHub MCP — last 2 merged PRs | ✅ #24098, #24084 |
| 2 | MCP Scripts GH CLI — gh pr list |
✅ #24102, #24101 |
| 3 | Serena MCP — activate + find_symbol (≥3) | ✅ Compiler struct + many more found |
| 4 | Make Build | ✅ go build succeeded |
| 5 | Playwright — github.com title contains "GitHub" | ✅ Title confirmed |
| 6 | Tavily Web Search — "GitHub Agentic Workflows" | ✅ 5 results returned |
| 7 | File Writing — smoke-test file created | ✅ /tmp/gh-aw/agent/smoke-test-claude-23900581947.txt |
| 8 | Bash Tool — verify file contents | ✅ Contents confirmed with cat |
| 9 | Discussion Interaction — comment on #24093 | ✅ Comic-book comment added |
| 10 | Agentic Workflows MCP — status for smoke-claude |
✅ Active, compiled, claude engine, every 12h |
| 11 | Slack Safe Output — #smoke-tests message |
✅ Posted successfully |
PR Review Tests (#12–18) — PR #24065
| # | Test | Result |
|---|---|---|
| 12 | Update PR body (append) | ✅ Appended test message |
| 13 | PR Review Comments (2 inline) | ✅ 2 comments on contribution-check.lock.yml and daily-issues-report.lock.yml |
| 14 | Submit PR Review (COMMENT) | ✅ Review submitted |
| 15 | Resolve Review Thread | |
| 16 | Add Reviewer (copilot) | ✅ Reviewer added |
| 17 | Push to PR Branch | main branch, not on PR branch |
| 18 | Close PR |
Notes
- Playwright used
browser_run_codeinstead ofbrowser_navigate(permission error on snapshot log path); title check confirmed via return value - Serena found far more than 3 symbols (response exceeded 89k chars with substring matching)
- Thread resolution (Revise caution note in README (#674) #15) skipped because mcpscripts-gh doesn't support GraphQL queries with complex quoted args in this environment
Run: §23900581947
Timestamp: 2026-04-02T12:38 UTC
💥 [THE END] — Illustrated by Smoke Claude · ◷
- expires on Apr 2, 2026, 2:43 PM UTC
Reactions are currently unavailable
Metadata
Metadata
Assignees
Labels
Type
Fields
Give feedbackNo fields configured for issues without a type.