Guide

    What Is llms.txt?

    AEO-RankUpdated 4 min read

    Short answer

    llms.txt is a plain Markdown file at the root of a website, at /llms.txt, that gives AI tools a short summary of the site and links to its most useful pages. It was proposed in 2024 by Jeremy Howard of Answer.AI. No major AI engine has confirmed it uses llms.txt for ranking, but it is quick to add.

    What goes in an llms.txt file?

    The proposal sets out a simple Markdown structure: an H1 with the site or company name, a short summary in a blockquote, optional notes, then H2 sections listing important pages as links with one-line descriptions. An Optional section can list pages that matter less. Keep it short, accurate and limited to pages that exist.

    • # Company or site name
    • > One-paragraph summary of what you do
    • ## Sections of links, each with a short description
    • ## Optional: lower-priority pages

    Does llms.txt help you rank in ChatGPT or Gemini?

    There is no public confirmation that ChatGPT, Gemini, Claude or Perplexity use llms.txt when choosing what to cite, so treat it as a low-cost extra, not a ranking factor. What does matter is that AI crawlers can reach your pages at all, and that your content is in the HTML they fetch.

    How is llms.txt different from robots.txt?

    robots.txt tells crawlers what they may and may not fetch; it is about permission. llms.txt tells AI tools what is worth reading and summarises the site; it is about guidance. They work together: an llms.txt link is useless if robots.txt, a firewall or a bot-blocking setting stops AI crawlers from reaching the page.

    How do you add llms.txt to your site?

    Write the file in Markdown, save it as llms.txt in your site's public root so it is served at yourdomain.com/llms.txt as plain text, and update it whenever you add or remove important pages. You can see ours at aeo-rank.ai/llms.txt as a working example.

    1. 1

      Draft the summary

      Write one paragraph that defines your company the same way your homepage and schema do.

    2. 2

      List key pages

      Add services, pricing, guides and proof pages, each with a one-line description.

    3. 3

      Publish at the root

      Serve the file at /llms.txt as text/plain.

    4. 4

      Keep it current

      Remove links to pages that no longer exist and add new ones as they launch.

    Frequently asked questions

    Is llms.txt an official standard?

    No. It is a community proposal, not a standard from a standards body, and AI companies have not committed to using it.

    What is llms-full.txt?

    Some sites also publish llms-full.txt, which contains the full text of key pages in one file rather than just links.

    Should I block AI crawlers if I publish llms.txt?

    Not if you want to appear in AI answers. Check robots.txt and any firewall settings so GPTBot, OAI-SearchBot, ClaudeBot, PerplexityBot and Google can reach your pages.

    Keep reading

    See how AI engines answer for your brand

    AEO-Rank tracks how ChatGPT, Gemini, Claude, Grok and Perplexity mention and cite your brand, and our team turns the gaps into an AEO and GEO plan.