-
Notifications
You must be signed in to change notification settings - Fork 326
Smoke Test: Claude - 23986960030 #24577
Copy link
Copy link
Closed as not planned
Labels
Description
Summary
Smoke test run for Claude engine — Run §23986960030
PR used for review testing: #24441
Timestamp: 2026-04-04T20:34 UTC
Overall Status: PARTIAL (2 tests skipped, all others passed)
Test Results
| # | Test | Result |
|---|---|---|
| 1 | GitHub MCP: Review last 2 merged PRs (#24571, #24559) | ✅ |
| 2 | mcpscripts-gh: Query 2 PRs (#24574, #24503) | ✅ |
| 3 | Serena: Activate project + find symbols (EngineName, CopilotEngine, ClaudeEngine) | ✅ |
| 4 | Make build: make build succeeded |
✅ |
| 5 | Playwright: Navigated to https://github.com, title contains "GitHub" | ✅ |
| 6 | Tavily: Searched "GitHub Agentic Workflows", 5 results returned | ✅ |
| 7 | File writing: Created /tmp/gh-aw/agent/smoke-test-claude-23986960030.txt |
✅ |
| 8 | Bash: Verified file creation with cat |
✅ |
| 9 | Discussion: Queried discussion #24572, added comic-book comment | ✅ |
| 10 | Agentic Workflows MCP: smoke-claude status = active, compiled = yes | ✅ |
| 11 | Slack: Posted to #smoke-tests | ✅ |
| 12 | Code scanning alert: Dummy warning on README.md:1 | ✅ |
| 13 | Update PR body: Appended to PR #24441 | ✅ |
| 14 | Review comments: 2 inline comments on PR #24441 | ✅ |
| 15 | Submit PR review: COMMENT review submitted on #24441 | ✅ |
| 16 | Resolve review thread | |
| 17 | Add reviewer: copilot added to PR #24441 |
✅ |
| 18 | Push to PR branch: smoke-claude-push-test.md pushed to #24441 branch |
✅ |
| 19 | Close PR |
Notes
- Tavily initially rate-limited (429) on first attempt, succeeded on retry.
- Playwright had a permission error on first attempt (screenshot log dir), succeeded via snapshot.
- Serena
find_symboltimed out on first call; subsequent calls succeeded.
References: §23986960030
💥 [THE END] — Illustrated by Smoke Claude · ● 254.1K · ◷
- expires on Apr 4, 2026, 10:39 PM UTC
Reactions are currently unavailable
Metadata
Metadata
Assignees
Labels
Type
Fields
Give feedbackNo fields configured for issues without a type.