[workflow-analysis] Weekly Workflow Analysis — 2026-03-17 to 2026-03-23

[github-actions[bot]]

This report covers agentic workflow runs from the past week (2026-03-16 → 2026-03-23) across Claude and Codex engines.

Summary

Metric	Value
Total runs analyzed	9 (3 Claude, 6 Codex)
Successful	8
Failed	1
Success rate	88.9%
Total Claude cost	~$2.74
Total Claude tokens	~4.86M

Note: Copilot-engine run logs could not be retrieved due to data volume (query timed out). Analysis below covers Claude and Codex engines only.

---

Failure Analysis

Schema Feature Coverage Checker — §23425050593

• Engine: Codex
• Conclusion: failure (in safe_outputs job)
• Root cause: The agent's required validation step (make recompile / make agent-finish) calls go mod download, which attempts to reach proxy.golang.org. This domain is blocked by the network firewall (243 of 269 requests blocked).
• Impact: The agent completed its main task successfully — it produced a patch creating 10 schema demo workflows covering previously uncovered frontmatter fields (bots, command, container, disable-model-invocation, environment, github-app, infer, labels, metadata, post-steps). However, the PR could not be submitted because safe-output validation failed.
• Remaining uncovered fields (noted by agent): private, run-name, secrets

Firewall breakdown for Schema Feature Coverage Checker

Domain	Allowed	Blocked
api.openai.com:443	22	0
proxy.golang.org:443	0	243
ab.chatgpt.com:443	0	4 (expected — telemetry)

Recommendation: Add proxy.golang.org to the allowed network domains for the Schema Feature Coverage Checker workflow, or restructure validation to avoid requiring go mod download at agent runtime.

---

DIFC Integrity Filtering

The DIFC integrity gateway filtered several resources across both engines. These are security controls working as intended — agents cannot read content from untrusted contributors unless it meets integrity thresholds.

Filtered events this week

Workflow	Tool	Resource	Author	Association
Daily Documentation Updater	search_pull_requests	#22335	dsyme	CONTRIBUTOR
Daily Documentation Updater	search_pull_requests	#22296	dsyme	CONTRIBUTOR
Daily Documentation Updater	search_issues	#20391	dsyme	CONTRIBUTOR
Daily Documentation Updater	search_issues	#20207	Esomoire-consultancy-Company	NONE
Daily Documentation Updater	search_issues	#16498	dsyme	CONTRIBUTOR
AI Moderator	issue_read	#22380	samuelkahessay	NONE

Notable: The AI Moderator was unable to read issue #22380 (integrity below threshold), causing a missing_data signal. The moderator correctly reported this limitation rather than silently failing.

---

Performance Metrics (Claude Engine)

Per-run breakdown

Workflow	Duration	Tokens	Cost	Turns
Go Fan	6.7m	1,216,344	$0.97	34
Daily Documentation Updater	8.7m	3,642,117	$1.77	52

Observation: The Daily Documentation Updater consumed 3.6M tokens across 52 turns (~$1.77). This is a notably high token count for a documentation task. The agent made 6 pull_request_read calls and 2 search_issues calls, suggesting it may be doing broad PR/issue scanning that could be scoped more narrowly.

Recommendation: Consider adding explicit scope filters to the Daily Documentation Updater (e.g., filter by date range, label, or specific sections) to reduce context size and cost.

---

Firewall Analysis — Codex Engine

The Codex firewall blocked ab.chatgpt.com consistently across all runs (3–4 blocked requests per run). This is expected behavior — it's OpenAI telemetry/analytics traffic and does not affect workflow outcomes.

The only actionable firewall issue is proxy.golang.org for the Schema Feature Coverage Checker (see failure analysis above).

---

Reliability Metrics by Workflow

Workflow	Engine	Runs	Success	Notes
Smoke Codex	Codex	2	2	PR smoke tests, avg ~10m
Changeset Generator	Codex	2	2	Avg ~5.4m
AI Moderator	Codex	1	1	1 missing_data (integrity filter)
Schema Feature Coverage Checker	Codex	1	0	Firewall blocking proxy.golang.org
Go Fan	Claude	1	1	Healthy
Daily Documentation Updater	Claude	1	1	High token cost

---

Recommendations Summary

Priority	Action	Workflow
High	Add proxy.golang.org to allowed network domains	Schema Feature Coverage Checker
Medium	Scope PR/issue queries to reduce token usage	Daily Documentation Updater
Low	Consider approving CONTRIBUTOR-authored PRs/issues for relevant workflows	Multiple

References:

• §23425050593 — Schema Feature Coverage Checker (failure)
• §23421309717 — Daily Documentation Updater (high cost)
• §23422824609 — AI Moderator (missing data)

AI generated by Weekly Workflow Analysis · history

• expires on Mar 24, 2026, 9:44 AM UTC

[github-actions[bot]]

This discussion was automatically closed because it expired on 2026-03-24T09:44:42.637Z.

Closed by Workflow