Skip to content

Agentic CI/CD: expand AI-powered drift detection org-wide #10

@JoeCardoso13

Description

@JoeCardoso13

Context

PR contributor-toolkit#36 introduces an AI-powered docs drift detection workflow using claude-code-action. It runs on PRs and flags when CLAUDE.md / README.md no longer match repo reality.

Once merged, this becomes the foundation for broader agentic CI/CD checks across the org.

Current state

  • Workflow lives in contributor-toolkit/.github/workflows/docs-drift-check.yml
  • Uses anthropics/claude-code-action@v1 with Sonnet
  • Gated to JoeCardoso13 PRs only (cost control during experimentation)
  • Uses a repo-level ANTHROPIC_API_KEY secret

Future directions

Short-term

  • Verify the workflow works end-to-end after merging the PR that introduces it
  • Evaluate the quality of drift detection on real PRs

Medium-term

  • Move ANTHROPIC_API_KEY from repo secret to org secret
  • Remove the user gate or replace with an org team check
  • Adopt a reusable workflow so other repos can call one central definition

Long-term

  • Cross-repo drift detection: e.g., PATTERNS.md in contributor-toolkit references conventions used in mcp-server-template-python / mcp-server-template-typescript — detect when template repos diverge from documented patterns

Metadata

Metadata

Assignees

Labels

No labels
No labels

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions