-
Notifications
You must be signed in to change notification settings - Fork 1
Open
Labels
enhancementNew feature or requestNew feature or request
Description
Is your feature request related to a problem? Please describe.
Evaluating whether skills can be replaced by documentation links. It's unclear if guiding an agent via docs alone produces equivalent results to providing a structured skill — this creates uncertainty about when a skill is actually necessary.
Describe the solution you'd like
Run a controlled experiment:
- Take an existing skill (e.g. the ADK wrapper skill)
- Run the same prompt twice — once with the skill, once with the agent pointed only at the documentation (no skill provided)
- Measure: does the agent find/use the docs on its own, or does it need to be directed? Are outcomes equivalent?
Describe alternatives you've considered
- Always providing a skill regardless of whether docs alone would suffice
- Relying on anecdotal observations without a structured comparison
Additional context
Result should either validate skills-as-doc-pointers or identify where structured skills add irreplaceable value.
Reactions are currently unavailable
Metadata
Metadata
Assignees
Labels
enhancementNew feature or requestNew feature or request