Agent Discovery Checker
Check if your site has the right discovery files for AI agents. We scan for llms.txt, ai.txt, MCP config, agent-discovery.json, NLWeb, OpenAPI, and more.
AI Agent Discovery Files
Essential
- •
robots.txt— Controls which AI crawlers can access your content - •
sitemap.xml— Helps AI crawlers discover all your pages - •
llms.txt— Structured description of your site for LLMs
Recommended
- •
ai.txt— AI usage policy declaration - •
agent-discovery.json— Machine-readable capability manifest - •
.well-known/mcp.json— MCP tool configuration for AI agents
Advanced
- •
.well-known/nlweb— Natural language web query support - •
openapi.json— API specification for programmatic access - •
llms-full.txt— Extended LLM-friendly content