What is llms.txt?

llms.txt is a proposed standard file that websites can publish to tell AI models how to best read and use their content. Placed at the root of a site (like /llms.txt), it offers a clean, structured guide to the site's most important pages — think of it as an AI-friendly table of contents.

Why do websites need a file just for AI?

Normal web pages are cluttered with navigation, ads, scripts, and styling that get in an LLM's way. A regular sitemap helps search crawlers find pages, but it isn't tailored to how an AI actually reads — it's just a list of URLs, not a guide to what matters. An llms.txt file, written in simple Markdown, lists the key pages and links to clean text versions, making it far easier for a model to find and understand the substance of a site instead of wrestling with the page's plumbing.

What goes in an llms.txt file?

The format is deliberately simple, which is part of why it's easy to adopt:

• A short description of what the site or project is.
• Links to the most important pages — docs, key articles, product information.
• Optional links to clean, text-only versions of those pages for easy reading.
• Brief notes giving context on what each link contains.

Because it's just Markdown, you can write one by hand and keep it current without special tooling.

Should you bother publishing one?

It matters more as AI assistants and search tools increasingly read websites to answer questions. Publishing llms.txt is a low-effort way to make your content more accessible to those systems — and to nudge how you're represented when an AI summarizes your site. It's an emerging convention rather than a universally enforced rule, and adoption is still growing, so not every AI tool reads it yet.

But for a site owner thinking about visibility in an AI-driven web, it's a small, durable step worth taking.