[prompt-clustering] Copilot Agent Prompt Clustering Analysis — 2026-01-21 to 2026-02-07

[github-actions[bot]]

Summary

Metric	Value
Analysis period	2026-01-21 – 2026-02-07 (18 days)
Total tasks analyzed	861
Merged (success)	590 (68.5%)
Not merged	271 (31.5%)
Clusters identified	7
Clustering method	TF-IDF (150 features, bigrams) + K-Means (silhouette-optimized)

Cluster Overview

#	Cluster	Tasks	Merge Rate	Avg Files	Avg Comments
1	Issue-Driven Maintenance	230 (27%)	🔴 61%	13.2	1.77
2	Workflow Automation & CI Fixes	129 (15%)	🟡 74%	17.0	2.21
3	safe-outputs & Infrastructure	113 (13%)	🟡 74%	21.7	4.44
4	MCP Server Integration	104 (12%)	🟡 72%	13.9	3.74
5	CLI & Workflow Tooling	103 (12%)	🟢 78%	31.7	3.83
6	Campaign System & Docs	94 (11%)	🔴 56%	8.1	1.85
7	Debug & Targeted Fixes	88 (10%)	🟡 70%	21.6	1.53

Cluster Details & Sample Tasks

1. Issue-Driven Maintenance

• Size: 230 tasks (27% of total)
• Success rate: 🔴 61% (141 merged)
• Avg files changed: 13.2  |  Avg comments: 1.77
• Top keywords: issue, workflow, discussion, code, comments, miner, section, task
• Description: Tasks generated from GitHub issues using a structured XML-like context template. The agent resolves open issues across many domains.

Representative examples:

• ✅ Merge maintenance jobs and add comprehensive logging
• ✅ Enable safe-input tool tracking for Daily Performance Summary workflow
• ✅ Disallow invalid permissions: read shorthand, require read-all

Recommendation: Lowest success rate (61%). XML issue-context prompts are verbose and unfocused — extract and distill the single actionable task per prompt.

---

2. Workflow Automation & CI Fixes

• Size: 129 tasks (15% of total)
• Success rate: 🟡 74% (96 merged)
• Avg files changed: 17.0  |  Avg comments: 2.21
• Top keywords: job, failure, fix, agent, workflow, url, issue, logs
• Description: Tasks that fix failing workflows, CI pipelines, and agent automation logic. Includes CI Failure Doctor dispatched fixes.

Representative examples:

• ✅ Update parent issue template for agentic-workflow failures
• ✅ Fix TypeScript type error in close_older_issues.cjs - add type guard f
• ✅ Add error handling to agent output ingestion for better failure diagno

Recommendation: Strong success rate. CI Failure Doctor pattern (direct run reference URL) is effective. Consider expanding automated failure dispatch.

---

3. safe-outputs & Infrastructure

• Size: 113 tasks (13% of total)
• Success rate: 🟡 74% (83 merged)
• Avg files changed: 21.7  |  Avg comments: 4.44
• Top keywords: project, safe, update, outputs, output, create, workflow, field
• Description: Tasks focused on the safe-outputs MCP server: container configuration, git access, tool registration, HTTP transport migration.

Representative examples:

• ✅ Update pdf-summary workflow: simplify title and add discussion creatio
• ✅ Move safe-output file from /tmp to /opt for read-only agent access
• ✅ Enable append-only comments in smoke-copilot workflow

Recommendation: High engagement (avg 4.4 comments) — add more Docker/container context in prompts to reduce iteration.

---

4. MCP Server Integration

• Size: 104 tasks (12% of total)
• Success rate: 🟡 72% (75 merged)
• Avg files changed: 13.9  |  Avg comments: 3.74
• Top keywords: mcp, tool, server, tools, patch, see, pull, run
• Description: Tasks that update, fix, or extend MCP server integrations (Sentry, GitHub, Playwright, agentic-workflows server itself).

Representative examples:

• ✅ chore: Update Sentry MCP server to 0.27.0
• ✅ Add missing get_repository tool to repos toolset
• ✅ Add codemod to migrate MCP per-server network config to top-level

Recommendation: Good success rate. Version-pinned MCP update prompts with commit references work well — standardize this as a template.

---

5. CLI & Workflow Tooling

• Size: 103 tasks (12% of total)
• Success rate: 🟢 78% (80 merged)
• Avg files changed: 31.7  |  Avg comments: 3.83
• Top keywords: file, version, remove, agentic, frontmatter, github, command, workflows
• Description: Tasks touching the gh-aw CLI, frontmatter parsing, version constants, codemods, and workflow compilation tooling.

Representative examples:

• ✅ Add interactive engine selection and secret configuration to init comm
• ✅ Remove active/passive campaign distinction
• ✅ Add codemod to delete dangling upgrade-agentic-workflow.md file

Recommendation: Highest success rate (78%) with most files changed (avg 31.7). Well-scoped CLI feature prompts with explicit acceptance criteria work best.

---

6. Campaign System & Docs

• Size: 94 tasks (11% of total)
• Success rate: 🔴 56% (53 merged)
• Avg files changed: 8.1  |  Avg comments: 1.85
• Top keywords: campaign, security, docs, dependabot, alert, project, issue, bump
• Description: Tasks designing/iterating on the campaign/orchestration system, documentation site updates, and Dependabot management.

Representative examples:

• ✅ chore: campaign discovery via label-based approach
• ✅ Clarify tracker-id is optional for campaign worker workflows
• ✅ Replace campaign fusion with first-class dispatch-only workers

Recommendation: Lowest success rate (56%). Abstract architecture prompts stall. Break into concrete implementation sub-tasks.

---

7. Debug & Targeted Fixes

• Size: 88 tasks (10% of total)
• Success rate: 🟡 70% (62 merged)
• Avg files changed: 21.6  |  Avg comments: 1.53
• Top keywords: reference, debug, fix, tests, review, logs, failed, file
• Description: Targeted bug fixes triggered by CI failure references or short imperative prompts (lint, format, test fixes).

Representative examples:

• ✅ Fix markdown code region balancer: distinguish consecutive blocks from
• ✅ Fix safe-outputs server startup by copying tools.json to expected loca
• ✅ Fix setup.sh: Add missing safe-outputs MCP HTTP transport files

Recommendation: Short, direct "Reference: <url> fix X" prompts are highly effective for targeted fixes.

---

Key Findings

1. Issue-Driven tasks are most common but least successful (61% vs 68.5% avg). XML issue-context prompts are verbose and diluted.
2. CLI & Workflow Tooling has the highest success rate (78%) with the most files per PR (avg 31.7) — concrete, well-scoped feature prompts win.
3. Campaign System tasks struggle most (56%). Abstract architecture prompts produce WIP-heavy stalled PRs.
4. CI Failure Doctor pattern is highly effective: Reference: <url> targeted fix prompts have 70% success on narrow problems with minimal discussion overhead.
5. safe-outputs cluster shows highest comment engagement (avg 4.4 per PR) — container infra debugging benefits from richer system context in prompts.

Recommendations

1. Decompose issue-driven prompts: Extract and distill the single actionable task from GitHub issue bodies rather than passing the full context.
2. Standardize MCP update template: update X to version Y, see PR #N pattern is working well — codify it as a reusable template.
3. Use run-URL references for targeted fixes: Reference: <url> fix <problem> is the most efficient prompt style for known failures.
4. Stage campaign/architecture tasks: Large design-refactor prompts should be staged: design discussion → interface definition → implementation.
5. Add container context to safe-outputs prompts: Include Docker base image, mount paths, and tool registration requirements upfront.

Recent 100 Tasks (full list: 861 PRs analyzed)

PR	Title	Cluster	Outcome	Files	Date
#14253	Document Actions permission restrictions detected by in	Workflow Automation & CI Fixes	merged	1	2026-02-07
#14255	Fix issue-monster workflow by enabling needs.* expressi	Workflow Automation & CI Fixes	merged	113	2026-02-07
#14257	Fix compiler obfuscation: Don't wrap static quoted valu	Issue-Driven Maintenance	merged	66	2026-02-07
#14258	Standardize trial command help text with Examples secti	Issue-Driven Maintenance	closed	1	2026-02-07
#14259	Investigation: CI failure #14239 is false alarm, no cha	Workflow Automation & CI Fixes	closed	0	2026-02-07
#14264	Revert MCP Gateway to v0.0.78	CLI & Workflow Tooling	closed	148	2026-02-07
#14265	[WIP] Revert gh-aw-mcpg version in constants.go	CLI & Workflow Tooling	closed	0	2026-02-07
#14266	Document SSL-bump feature for AWF firewall	Issue-Driven Maintenance	merged	1	2026-02-07
#14267	Verify @playwright/mcp version is already updated to 0.	MCP Server Integration	closed	0	2026-02-07
#14268	Add workflow guidance and cross-references to CLI help	Issue-Driven Maintenance	closed	5	2026-02-07
#14269	Revert gh-aw-mcpg to v0.0.103	CLI & Workflow Tooling	merged	149	2026-02-07
#14273	[WIP] Add documentation for health command in CLI	Issue-Driven Maintenance	closed	0	2026-02-07
#14274	[WIP] Fix firewall SSL-bump configuration extraction	Issue-Driven Maintenance	closed	0	2026-02-07
#14007	Add telemetry.enterprise.githubcopilot.com to copilot e	Issue-Driven Maintenance	merged	100	2026-02-06
#14041	Add plugin installation support via frontmatter with du	CLI & Workflow Tooling	merged	158	2026-02-06
#14042	[WIP] Update footer with community feedback message	Campaign System & Docs	closed	0	2026-02-06
#14044	Remove GH_TOKEN from agentic-workflows MCP server confi	Workflow Automation & CI Fixes	merged	146	2026-02-06
#14053	Add working directory logging and Docker workdir for ag	MCP Server Integration	merged	30	2026-02-06
#14056	[WIP] Debug workflow failure in Workflow Normalizer	Workflow Automation & CI Fixes	closed	0	2026-02-06
#14057	[WIP] Debug workflow failure in agent performance analy	Workflow Automation & CI Fixes	closed	0	2026-02-06
#14062	Fix dispatch_workflow to use PR branch ref and resolve	Debug & Targeted Fixes	merged	2	2026-02-06
#14069	Remove payload-dir from frontmatter documentation	CLI & Workflow Tooling	merged	1	2026-02-06
#14095	Replace emojis with Starlight icons in documentation	Campaign System & Docs	closed	8	2026-02-06
#14098	Consolidate monitoring pattern into ProjectOps	Campaign System & Docs	closed	6	2026-02-06
#14110	[WIP] Fix layout and logo text centering in Quickstart	Campaign System & Docs	closed	0	2026-02-06
#14119	Fix textblob version check in Copilot PR NLP Analysis w	Workflow Automation & CI Fixes	merged	2	2026-02-06
#14120	Fix gh-aw binary availability for user-defined steps in	Workflow Automation & CI Fixes	merged	24	2026-02-06
#14121	Investigation: Daily Issues Report Generator failure ca	Workflow Automation & CI Fixes	closed	0	2026-02-06
#14125	Fix add_comment to handle discussion numbers via fallba	Debug & Targeted Fixes	merged	2	2026-02-06
#14127	Fix daily-fact workflow action-tag to include missing p	MCP Server Integration	merged	87	2026-02-06
#14129	Add unit tests for compiler_yaml_main_job.go	Issue-Driven Maintenance	merged	86	2026-02-06
#14139	Refactor MCP server update tool to call Go function dir	MCP Server Integration	closed	9	2026-02-06
#14140	Add binary path detection for MCP server self-invocatio	MCP Server Integration	merged	6	2026-02-06
#14147	Add daily concurrency analysis workflow for MCP server	MCP Server Integration	merged	2	2026-02-06
#14149	Add max-tokens and max-iterations execution bounds to e	Issue-Driven Maintenance	closed	10	2026-02-06
#14150	Remove prompt file management functions from init/upgra	CLI & Workflow Tooling	merged	10	2026-02-06
#14156	Capture exit codes and stderr when gh CLI commands fail	MCP Server Integration	merged	3	2026-02-06
#14167	[WIP] Implement daily exploratory testing for audit and	MCP Server Integration	closed	0	2026-02-06
#14168	Add daily exploratory testing workflow for CLI tools	MCP Server Integration	merged	3	2026-02-06
#14171	Fix smoke-claude: handle tool failures gracefully and g	safe-outputs & Infrastructure	merged	3	2026-02-06
#14173	Rename MCP server identifier from agentic_workflows to	MCP Server Integration	merged	31	2026-02-06
#14182	Add Dependabot Project Manager workflow with bundling a	Campaign System & Docs	merged	2	2026-02-06
#14183	[WIP] Fix MCP server permission denied error for testin	Issue-Driven Maintenance	closed	30	2026-02-06
#14184	Limit create-issue to 1 in daily-cli-tools-tester workf	MCP Server Integration	merged	2	2026-02-06
#14189	Teach create workflow agent to discover CLI automation	safe-outputs & Infrastructure	merged	2	2026-02-06
#14191	Format auto-added "Fixes #N" as bullet point in PR body	Issue-Driven Maintenance	merged	1	2026-02-06
#14198	[WIP] Update agentic workflows server name to agenticwo	MCP Server Integration	closed	0	2026-02-06
#14201	Add network access to agentic-workflows MCP server cont	MCP Server Integration	merged	28	2026-02-06
#14208	Wrap agent log rendering in collapsible details section	Issue-Driven Maintenance	merged	4	2026-02-06
#14209	Make upgrade command version check non-blocking with Gi	Workflow Automation & CI Fixes	merged	2	2026-02-06
#14211	Add edit tool and full bash access to daily-cli-tools-t	MCP Server Integration	merged	2	2026-02-06
#14220	Fix 403 error: Configure github-token for Dependabot al	Debug & Targeted Fixes	closed	3	2026-02-06
#14221	Fix TestRuntimeSetupPreservesUserVersions false positiv	Workflow Automation & CI Fixes	merged	4	2026-02-06
#14222	Remove anonymous bash tool syntax, require explicit con	MCP Server Integration	merged	33	2026-02-06
#14225	Refactor Dependabot Project Manager to process PRs inst	Campaign System & Docs	merged	2	2026-02-06
#14227	Review Dependabot npm PRs for docs/package.json bundle	safe-outputs & Infrastructure	closed	6	2026-02-06
#14242	Fix strict mode tests using deprecated anonymous bash s	Debug & Targeted Fixes	merged	1	2026-02-06
#13820	Add shared workflow for Microsoft Amplifier CLI	Issue-Driven Maintenance	closed	4	2026-02-05
#13842	Fix agentic-chat instruction file path in documentation	Debug & Targeted Fixes	merged	2	2026-02-05
#13843	Align compiler step name capitalization: "copilot" → "C	Issue-Driven Maintenance	merged	5	2026-02-05
#13844	Add safe-outputs configuration to notion-issue-summary	MCP Server Integration	closed	2	2026-02-05
#13847	Fix broken GitHub Copilot documentation link in frontma	CLI & Workflow Tooling	merged	1	2026-02-05
#13848	Remove pirate theme from default workflow messages	CLI & Workflow Tooling	merged	8	2026-02-05
#13849	Remove Windows build support from release pipeline and	CLI & Workflow Tooling	closed	6	2026-02-05
#13853	Normalize file paths to Unix format in compiled .lock.y	CLI & Workflow Tooling	merged	3	2026-02-05
#13854	Remove windows-386 from release build targets	CLI & Workflow Tooling	merged	2	2026-02-05
#13855	[WIP] Debug Copilot Agent prompt clustering analysis wo	Workflow Automation & CI Fixes	closed	11	2026-02-05
#13859	Fix Serena container selection array handling bug	Workflow Automation & CI Fixes	closed	2	2026-02-05
#13860	Delete .github/aw/*.md files now downloaded from GitHub	CLI & Workflow Tooling	closed	17	2026-02-05
#13864	Add video embedding support via astro-embed	Campaign System & Docs	closed	4	2026-02-05
#13901	Include .agents folder in sparse checkout for agent job	Workflow Automation & CI Fixes	merged	3	2026-02-05
#13902	Add Video component for Astro Starlight documentation	Issue-Driven Maintenance	merged	3	2026-02-05
#13903	Configure PR triage reports with 1-day expiration and a	MCP Server Integration	merged	2	2026-02-05
#13906	[WIP] Fix fallback issue creation route for safe output	safe-outputs & Infrastructure	closed	0	2026-02-05
#13907	Add issues:write permission to create-discussion jobs f	safe-outputs & Infrastructure	merged	50	2026-02-05
#13914	Use workflow-id markers for close-older-discussions	Issue-Driven Maintenance	merged	4	2026-02-05
#13915	Add missing category field to workflows using create-di	CLI & Workflow Tooling	closed	6	2026-02-05
#13918	Add security rationale to permissions documentation	Issue-Driven Maintenance	merged	1	2026-02-05
#13920	Fix firewall SSL-bump field extraction in frontmatter p	Issue-Driven Maintenance	merged	3	2026-02-05
#13925	Remove unnecessary test dependency from canary_go job	MCP Server Integration	merged	1	2026-02-05
#13931	Fix runtime-import file path resolution and checkout	CLI & Workflow Tooling	merged	149	2026-02-05
#13932	Remove tests asserting specific version constant values	Workflow Automation & CI Fixes	merged	90	2026-02-05
#13935	Downgrade Claude Code CLI to 2.1.29	CLI & Workflow Tooling	merged	37	2026-02-05
#13936	[WIP] Downgrade Claude to version 2.1.29	CLI & Workflow Tooling	closed	0	2026-02-05
#13939	Add script to generate video poster images with auto-de	Campaign System & Docs	merged	5	2026-02-05
#13940	Remove italic styling from video captions to align with	MCP Server Integration	merged	1	2026-02-05
#13942	fix: Remove duplicate Go module cache causing tar confl	Workflow Automation & CI Fixes	merged	2	2026-02-05
#13945	Add agent-generated files directory to artifact uploads	MCP Server Integration	merged	146	2026-02-05
#13946	docs: add getting started videos to index landing page	CLI & Workflow Tooling	merged	1	2026-02-05
#13948	Mount gh CLI binary in agentic-workflows MCP server con	MCP Server Integration	merged	27	2026-02-05
#13949	Simplify permissions: agent job ALWAYS gets contents:re	Workflow Automation & CI Fixes	merged	5	2026-02-05
#13955	Add symbol search verification to smoke workflow Serena	MCP Server Integration	merged	4	2026-02-05
#13956	Add serena container to predownload list when enabled	MCP Server Integration	merged	21	2026-02-05
#13966	[WIP] Fix failing GitHub Actions workflow test	Workflow Automation & CI Fixes	merged	1	2026-02-05
#13969	Fix MCP parameter rendering for arrays and objects in C	Debug & Targeted Fixes	merged	3	2026-02-05
#13974	Add --cmd argument to agentic-workflows MCP server in d	MCP Server Integration	merged	32	2026-02-05
#13980	fix: ensure /home/runner/.copilot directory has correct	Workflow Automation & CI Fixes	merged	2	2026-02-05
#13984	Upgrade MCP Gateway to v0.0.101	safe-outputs & Infrastructure	closed	146	2026-02-05
#13993	Integrate gh-aw-mcpg v0.0.113	CLI & Workflow Tooling	closed	59	2026-02-05
#13996	Add CLI build steps for dev mode in agentic-workflows a	MCP Server Integration	merged	36	2026-02-05

References: §23868260260

AI generated by Copilot Agent Prompt Clustering Analysis · history

• expires on Apr 2, 2026, 8:38 PM UTC

[github-actions[bot]]

This discussion was automatically closed because it expired on 2026-04-02T20:38:11.186Z.

Closed by Workflow