Does llms.txt Work? What Google and AI Bots Really Do With It

Not in any way anyone has shown. Google says Search ignores llms.txt. In one 12-week server-log study of 83 sites, OpenAI’s crawler fetched the file 7 times, against 3,990 fetches of robots.txt. Adding one is cheap and harmless, but it is not a ranking or citation lever, and anyone selling it as one is ahead of the evidence.

What llms.txt is

llms.txt is a plain Markdown file at yourdomain.com/llms.txt. It lists your most important pages with a short description of each, so an AI assistant could find your key content without crawling the whole site. Jeremy Howard proposed it in September 2024, and the spec lives at llmstxt.org. It is a proposal. There is no standards body behind it, and no AI company has agreed to read it.

What Google says

Google’s guide to optimizing for generative AI features (last updated July 2026) tells site owners they don’t need llms.txt to appear in AI Overviews, AI Mode or the rest of Google Search, because Google Search doesn’t use it. It adds that creating one for other services is fine and will neither help nor harm your visibility in Google.

Google staff said the same earlier. John Mueller wrote in 2025 that no AI system currently uses llms.txt, and in June 2026 he called it purely speculative for now.

What server logs show

The better question is whether AI crawlers fetch the file at all. EZY Research watched 83 sites that had an llms.txt for 12 weeks (27 April to 19 July 2026) and counted fetches by verified crawler. The results:

• OpenAI: 7 llms.txt fetches vs 3,990 robots.txt fetches.
• Anthropic (ClaudeBot): 9 vs 3,120.
• PerplexityBot: 0 vs 775.
• Meta’s crawler: 193 llms.txt fetches vs 172 robots.txt fetches, the one major exception.

Treat this as one useful data point, not a verdict. EZY sells AI visibility tools, and its panel leans toward small-business sites. Still, it matches what Google says and what Mueller reported from server logs.

Who does read it

The file does get fetched, mostly by other readers. Some companies publish an llms.txt for their own developer documentation, and developer tools or AI agents may use one when a person points them at a docs site. If your business sells software or has technical documentation, that is the case where it could pay off. For a local business, it likely won’t do anything.

What actually gets you cited

Google’s guide says the basics matter most. Here is the practical version:

• Be indexed and crawlable. A page that isn’t in the index can’t be retrieved. Check with the Google Index Checker.
• Don’t block AI crawlers by accident. robots.txt is the file crawlers actually check, so a stray rule there can keep you out. The AI Crawler Checker shows which bots your robots.txt allows. See also our guide to robots.txt best practices.
• Publish something worth quoting. Google asks for original, non-commodity content with a point of view. A clear answer in the first two sentences, backed by named sources, is easy for people and machines to quote.
• Keep business details accurate. For local businesses, Google points to Google Business Profile. Our Google Business Profile Audit checks yours.

To see where you stand today, ask what ChatGPT says about your business with the AI Visibility Checker, or run the AEO Readiness Checker.

Should you add one anyway?

If it takes ten minutes and you have a short list of pages worth pointing to, yes. It costs nothing, Google says it won’t hurt, and the format may matter more later. Just keep your expectations honest and don’t pay anyone for it.

The format is simple: a name, a one-line summary, then sections of links with short notes.

# Example Plumbing
> Emergency and routine plumbing for homes in Austin, Texas.

## Key pages
- [Services](https://example.com/services/): What we fix and what it costs
- [Service areas](https://example.com/areas/): Neighborhoods we cover
- [Contact](https://example.com/contact/): Phone, hours and booking

The llms.txt Generator builds a valid file from your site. You can see ours, which Rank Math generates automatically. Upload the file to your site root and keep it short.

FAQs

Does ChatGPT read llms.txt?

OpenAI hasn’t said it does. In the 83-site log study, OpenAI’s crawler fetched llms.txt 7 times in 12 weeks, compared with 3,990 fetches of robots.txt.

Does llms.txt help SEO?

No. Google says Search ignores it, so it neither helps nor harms your rankings in Google.

Is llms.txt the same as robots.txt?

No. robots.txt tells crawlers what they may access and is checked constantly. llms.txt is a suggested reading list for AI, and almost no crawler requests it.

Can llms.txt hurt my site?

Google says it won’t affect your visibility. The only risk is a file that points to outdated or wrong pages, so keep it current.

What should I do instead?

Make sure your pages are indexed, your robots.txt isn’t blocking AI crawlers, and your content answers questions better than the pages competing with it.