Skip to content

Conversation

@academo
Copy link
Contributor

@academo academo commented Jan 15, 2026

What this PR does / why we need it:

This is a proof of concept alternative to #2322

The main differences are:

  • guide the model towards fetching online links
  • compile information for both frontend and backend without conditionals

Tests

methodology

I did separate tests with coding agents and several coding models, with a brand new scaffolded data source (no changes only boilerplate) I asked the agent: can you add variable query variable support to this datasource?

cursor agent, with codex, claude code

cursor-agent doesn't have an integrated web_fetch tool, it follows instructions to use curl and fetches the documentation before trying to implement a solution. sometimes it hallucinates a documentation url but when it finds a 404 it fetches the index and then the real doc, this doesn't happen all the time

image

claude code with sonnet, haiku and opus

follows instructions and fetch documentation before trying to implement. sometimes it fetches the index first, sometimes just guesses the URL correctly.

Opencode with GLM 4.7

follows instructions, it hallucinated many documentation urls before deciding to fetch the index and get the real documentation url

Gemini-cli with gemini 2.5

ignored AGENTS.md and had to create a GEMINI.md instead. once created it followed instructions, first fetching the index then the correct documentation.

@github-actions
Copy link
Contributor

github-actions bot commented Jan 15, 2026

Hello! 👋 This repository uses Auto for releasing packages using PR labels.

✨ This PR can be merged but will not trigger a new release. To trigger a new release add the release label before merging.
NOTE: When merging a PR with the release label please avoid merging another PR. For further information see here.

@grafana-plugins-platform-bot grafana-plugins-platform-bot bot moved this from 📬 Triage to 🔬 In review in Grafana Catalog Team Jan 15, 2026
@academo academo added create-plugin related to the create-plugin tool minor Increment the minor version when merged labels Jan 22, 2026
@academo academo self-assigned this Jan 22, 2026
@academo academo marked this pull request as ready for review February 11, 2026 11:08
@academo academo requested a review from a team as a code owner February 11, 2026 11:08
Copilot AI review requested due to automatic review settings February 11, 2026 11:08
@academo academo requested a review from a team as a code owner February 11, 2026 11:08
Copy link
Contributor

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Consolidates LLM/coding-agent guidance for scaffolded Grafana plugins by removing panel-specific AGENTS content and introducing a shared, common AGENTS.md + instructions file under the common template.

Changes:

  • Removed panel template’s AGENTS.md and related agent instruction/task markdown files.
  • Added a common AGENTS.md entrypoint and a shared .config/AGENTS/instructions.md with documentation-fetching guidance and critical rules.

Reviewed changes

Copilot reviewed 5 out of 5 changed files in this pull request and generated 3 comments.

Show a summary per file
File Description
packages/create-plugin/templates/panel/AGENTS.md Removed panel-specific agent scaffold entrypoint so common template can supply it.
packages/create-plugin/templates/panel/.config/AGENTS/instructions.md Removed panel-specific agent fundamentals guidance.
packages/create-plugin/templates/panel/.config/AGENTS/tasks/add-panel-options.md Removed panel-specific “add panel options” task doc.
packages/create-plugin/templates/common/AGENTS.md Added shared agent scaffold entrypoint for all plugin templates.
packages/create-plugin/templates/common/.config/AGENTS/instructions.md Added shared agent instructions, doc index links, and “critical rules”.

@@ -0,0 +1,2 @@
## Project knowledge
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

why are we repeating this instead of using @AGENTS.md ?

because users tend to like their tools as they work. Claude likes claude.md and it'll try to modify (via its memory functions) and users might decide to remove AGENTS.md "because CLAUDE.md already exists" or similar with other agents that don't use either CLAUDE.md or GEMINI.md

so even though this is duplicated we are create a more future-proof approach for users with diverse coding tools and file preference.

Users are free to delete the agents files they don't need, but if we only have the real content in AGENTS.md and that's the one the user deletes we lose the any way to discover our instructions.md

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

create-plugin related to the create-plugin tool minor Increment the minor version when merged

Projects

Status: 🔬 In review

Development

Successfully merging this pull request may close these issues.

1 participant