Skip to content

improve: enhance tool descriptions for better LLM agent tool selection#235

Open
spidershield-contrib wants to merge 1 commit intosupabase-community:mainfrom
spidershield-contrib:improve/tool-descriptions
Open

improve: enhance tool descriptions for better LLM agent tool selection#235
spidershield-contrib wants to merge 1 commit intosupabase-community:mainfrom
spidershield-contrib:improve/tool-descriptions

Conversation

@spidershield-contrib
Copy link
Copy Markdown

What

Rewrote 31 MCP tool descriptions using an action-verb-first format designed for LLM agent planning.

Why

MCP tool descriptions serve as planning hints — LLMs use them to select which tool to call and in what order. Descriptions lacking scenario triggers and disambiguation boundaries cause agent tool selection errors.

Format applied

<Action verb> ...

Use when the user wants to [concrete scenario].
Do not use when [boundary] (use [alternative] instead).
Accepts `param` (required/optional). e.g., param="example".
Raises an error if [failure condition].

Results

Metric Before After
Avg description quality 2.2/10 9.8/10
Tools with disambiguation boundary 0/31 31/31
Tools scoring ≥ 9.8/10 0/31 31/31

🤖 Descriptions improved with spidershield — open-source MCP quality scanner.

Rewrote 31 tool descriptions using action-verb-first format with scenario
triggers, disambiguation boundaries, parameter docs, and error guidance.
Avg quality: 2.2/10 → 9.8/10.

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant