Smoke Test: Copilot - 23985224521 #24555
Description
Test Results
| # | Test | Status | Notes |
|---|---|---|---|
| 1 | GitHub CLI (github CLI command) | Scripts exist but have bash syntax error — used mcpscripts-gh as fallback |
|
| 2 | MCP Scripts GH CLI (mcpscripts-gh) |
✅ | PRs #24544, #24539 listed successfully |
| 3 | Serena CLI (serena activate_project) |
❌ | Generated script has bash syntax error (unclosed quote in jq expression) |
| 4 | Playwright CLI (playwright browser_navigate) |
❌ | Same bash syntax error in generated scripts |
| 5 | Web Fetch (fetch https://github.com) | ✅ | Response contains "GitHub" |
| 6 | File Writing | ✅ | /tmp/gh-aw/agent/smoke-test-copilot-23985224521.txt created |
| 7 | Bash Tool | ✅ | File content verified with cat |
| 8 | Discussion Interaction | ✅ | Discussion #24552 found, comment added |
| 9 | Build gh-aw | ✅ | make build succeeded |
| 10 | Discussion Creation | ✅ | Created via create_discussion |
| 11 | Workflow Dispatch | ✅ | haiku-printer triggered |
| 12 | PR Review | ✅ | 2 inline comments + review submitted + reply to existing comment |
Overall Status: ⚠️ PARTIAL PASS
Critical finding: The generated MCP CLI bash scripts (in /home/runner/work/_temp/gh-aw/mcp-cli/bin/) have a syntax error — an unclosed quote in a multi-line jq expression causes bash -n validation to fail. This affects Serena, GitHub, Playwright, and all other MCP CLI tools generated by PR #24503's mount_mcp_as_cli.cjs.
Details
- PR Author: copilot-swe-agent (bot)
- PR Assignees: pelikhan, Copilot
- Run URL: https://github.com/github/gh-aw/actions/runs/23985224521
- Timestamp: 2026-04-04T18:47:38Z
- Event: pull_request (PR feat: mount MCP servers as local CLIs after gateway starts #24503)
📰 BREAKING: Report filed by Smoke Copilot · ● 2.1M · ◷
- expires on Apr 4, 2026, 8:53 PM UTC