What is llm.txt?
llm.txt is a convention for publishing machine-readable site summaries for AI crawlers and agents. Learn how BearAudit discovers and previews llm.txt files.
llm.txt is an emerging convention: a text or markdown file (often at /llm.txt or linked from /.well-known/) that summarises a site for LLM and AI agents—similar in spirit to robots.txt but oriented toward helpful context rather than crawl rules.
Why sites publish it
- Help AI assistants answer questions about your product accurately
- Point agents to documentation, policies, and API boundaries
- Complement WebMCP and structured APIs for agentic SEO
How BearAudit uses it
The llm.txt page fetches and previews discovered llm.txt (and related) files for your property, with markdown rendering and navigation between linked docs. Use it to audit whether your AI-facing summary matches your public positioning and technical docs.