Smoke Test: Copilot - 23987300615 #24582
Description
Test Results
| # | Test | Status |
|---|---|---|
| 1 | GitHub CLI (list merged PRs via MCP) | ❌ MCP gateway not running at port 80 |
| 2 | mcpscripts-gh (list open PRs) | ✅ #24578, #24574 returned |
| 3 | Serena CLI (activate + find_symbol) | ❌ MCP gateway not running at port 80 |
| 4 | Playwright CLI (navigate to github.com) | ❌ MCP gateway not running at port 80 |
| 5 | Web Fetch (fetch github.com) | ✅ Response contains "GitHub" |
| 6 | File Writing | ✅ Created /tmp/gh-aw/agent/smoke-test-copilot-23987300615.txt |
| 7 | Bash Tool | ✅ File read back successfully |
| 8 | Discussion Interaction | ✅ Discussion #24576 found and commented |
| 9 | Build gh-aw | ✅ make build succeeded |
| 10 | Discussion Creation | ✅ "copilot was here" discussion created |
| 11 | Workflow Dispatch (haiku-printer) | ✅ Dispatched haiku about software testing |
| 12 | PR Review | ✅ 2 inline comments + review submitted; replied to comment #3035916493 |
Overall Status: ⚠️ PARTIAL PASS
Core functionality (build, file I/O, web fetch, GitHub API, PR review) all passed. Tests 1, 3, and 4 failed because the MCP gateway was not running at 127.0.0.1:80 — the CLI wrapper scripts generated by this PR's feature require the gateway to be active at runtime, but in this non-interactive context the gateway process wasn't started. This is expected behavior — these tests require the full workflow setup.
PR Finding: Confirmed a bash syntax bug in the generated CLI scripts (nested double-quote escaping in jq expression at mount_mcp_as_cli.cjs:335).
Details
- Run URL: https://github.com/github/gh-aw/actions/runs/23987300615
- Timestamp: 2026-04-04T20:52:09Z
- PR: feat: mount MCP servers as local CLIs after gateway starts #24503 — feat: mount MCP servers as local CLIs after gateway starts
- PR Author:
@copilot-swe-agent(app) - Assignees: @pelikhan,
@Copilot
📰 BREAKING: Report filed by Smoke Copilot · ● 2.3M · ◷
- expires on Apr 4, 2026, 10:59 PM UTC