Describe the feature you'd like to see included in Oxygen.
If the current request is coming from a known LLM AI bot like GPTBot / Claude-User then don't render the page with full HTML. It would be much more efficient for the agent if we just returned the content in Markdown.
What are the use cases for this feature?
If you return Markdown instead of HTML then the agent will index Oxygen websites much easier. Most LLMs will actually prefer websites that return content in Markdown and skip over HTML-only sites.
You could also look for Accept: text/markdown
Examples of this feature or functionality.
Describe the feature you'd like to see included in Oxygen.
If the current request is coming from a known LLM AI bot like
GPTBot/Claude-Userthen don't render the page with full HTML. It would be much more efficient for the agent if we just returned the content in Markdown.What are the use cases for this feature?
If you return Markdown instead of HTML then the agent will index Oxygen websites much easier. Most LLMs will actually prefer websites that return content in Markdown and skip over HTML-only sites.
You could also look for
Accept: text/markdownExamples of this feature or functionality.