What is llms.txt?
llms.txt is the llmstxt.org convention for publishing machine-readable site summaries for AI crawlers and agents. Learn how BearAudit discovers and previews llms.txt files.
llms.txt is the llmstxt.org convention: a markdown file at /llms.txt (with optional /llms-full.txt) that summarises a site for LLM and AI agents—similar in spirit to robots.txt but oriented toward helpful context rather than crawl rules. Some sites still publish a misspelled /llm.txt; BearAudit checks that path as a fallback.
Why sites publish it
- Help AI assistants answer questions about your product accurately
- Point agents to documentation, policies, and API boundaries
- Complement WebMCP and structured APIs for agentic SEO
How BearAudit uses it
The llms.txt page fetches and previews discovered llms.txt (and related) files for your property, with markdown rendering and navigation between linked docs. Use it to audit whether your AI-facing summary matches your public positioning and technical docs.