[observability] Observability Coverage Report - 2026-03-22

[github-actions[bot]]

Executive Summary

Analyzed workflow logs from the last 7 days for github/gh-aw to assess observability coverage for AWF Firewall and MCP Gateway telemetry.

A total of 398 runs were downloaded. Of these, 60 were active agent runs (agent-stdio.log present) and used as the observability denominator. The remaining 338 runs were mostly skipped/non-agent runs and are treated as N/A for firewall/MCP telemetry checks.

Key Alerts and Anomalies

🔴 Critical Issues:

• Missing firewall telemetry for Smoke Gemini run 23392520645 (§23392520645).

⚠️ Warnings:

• MCP telemetry quality warning for jsweep - JavaScript Unbloater run 23394595343: rpc-messages.jsonl present but zero parsed MCP tool-call events (§23394595343).

Coverage Summary

Component	Runs Analyzed	Logs Present	Coverage	Status
AWF Firewall (access.log-derived telemetry)	60 (firewall_enabled_workflows)	59	98.33%	🔴
MCP Gateway (gateway.jsonl or rpc-messages.jsonl)	60 (mcp_enabled_workflows)	60	100.00%	⚠️

📋 Detailed Run Analysis

Firewall-Enabled Runs (status breakdown)

• Healthy: 59
• Warning: 0
• Critical: 1

Missing Firewall Logs (access.log)

Workflow	Run ID	Date	Link
Smoke Gemini	23392520645	2026-03-22	§23392520645

MCP-Enabled Runs (status breakdown)

• Healthy: 59
• Warning: 1
• Critical: 0

Missing MCP Telemetry (no gateway.jsonl or rpc-messages.jsonl)

Workflow	Run ID	Date	Link
None	-	-	-

🔍 Telemetry Quality Analysis

Firewall Log Quality

• Total firewall entries analyzed: 1,694
• Allowed requests: 1,624
• Blocked requests: 70 (4.13%)
• Unique domains observed: 13
• Most accessed domains: api.githubcopilot.com:443 (1098), api.anthropic.com:443 (323), api.openai.com:443 (142)

Gateway Log Quality

• Telemetry source: gateway.jsonl 0 runs, rpc-messages.jsonl 60 runs
• MCP tool-call events parsed: 1,028
• Warning-level telemetry runs: 1
• Average response time: N/A (not consistently derivable from rpc fallback artifacts)

Recommended Actions

1. Investigate and fix missing firewall telemetry generation/parsing for run §23392520645.
2. Add a guardrail check to fail active agent runs when firewall telemetry is missing.
3. Add stricter validation for rpc fallback logs to flag zero-tool-call telemetry early (run §23394595343).

📊 Historical Trends

Historical trend series was not computed in this run. Snapshot baselines:

• Firewall coverage (active agent runs): 98.33%
• MCP telemetry coverage (active agent runs): 100.00%

Context

• Analysis window: Last 7 days
• Runs downloaded: 398
• Active agent runs analyzed for observability: 60
• Triggering run: §23398492722

References:

• §23392520645
• §23394595343
• §23398492722

AI generated by Daily Observability Report for AWF Firewall and MCP Gateway · history

• expires on Mar 23, 2026, 8:07 AM UTC

[github-actions[bot]]

This discussion has been marked as outdated by Daily Observability Report for AWF Firewall and MCP Gateway.

A newer discussion is available at Discussion #22394.