In this article
Quick Answer
No evidence yet shows that llms.txt improves AI visibility. Originality.ai counted 36,120 llms.txt files by May 2026, up from 4,088 a year earlier, but Ahrefs found that 97 percent of them received zero requests in May 2026 across 137,000 domains. Google says you do not need new machine-readable files or AI text files to appear in AI Overviews or AI Mode. Publish one only if it costs you little, and spend your effort on crawlable, answer-first pages.
What llms.txt Is
llms.txt is a proposed convention, not an official standard. It is a Markdown file at the root of your site that lists your most useful pages with short descriptions, so that AI tools could read a clean summary instead of crawling everything. A longer variant, llms-full.txt, carries the full text of those pages.
What the 2026 Data Shows
Two 2026 studies, reported by PPC Land, point the same way: many sites adopted the file, and almost nobody reads it.
Ahrefs also reported that SEO audit tools, not AI assistants, made up the largest share of requests where any occurred. Originality.ai put the combined count of sites using llms.txt, llms-full.txt or ai.txt at 38,980.
A caution about these numbers
What Google Says
In its guide for site owners, Google states that you do not need to create new machine-readable files, AI text files or markup to appear in AI Overviews or AI Mode, and that no special schema.org data is required. A page only needs to be indexed and eligible to show with a snippet.
Our Position
We publish llms.txt and llms-full.txt for phantomcore.io because we can generate them from our own pages at almost no cost. We do not rely on them, and we have not seen evidence that they change how often we are cited. If writing and maintaining the file would take real time from your team, the data says that time is better spent elsewhere.
What to Do Instead
- 1
Let crawlers in
Check robots.txt, your CDN and firewall rules. Google lists allowing crawling as a basic step, and robots.txt is its control for Search.
- 2
Serve real text in the HTML
If your page body is streamed in late or hidden behind tabs, a crawler may see only part of it. Check the page source, not just the browser view.
- 3
Write an answer first
Put a short, self-contained summary under each main heading, then the detail below it.
- 4
Back claims with sources
Numbers, named sources and links give AI tools something safe to quote. See our GEO guide for the research.
- 5
Keep structured data accurate
Google says no special schema is needed, but markup must match the visible text.
- 6
Watch real crawler requests
Check your server logs or CDN analytics for AI user agents. If a bot requests /llms.txt on your site, you will see it. That is better evidence than a blog post.
Our guides on GEO for UAE businesses and the Google Business Profile checklist cover the steps in detail. If your site needs rebuilding so that its text is server-rendered, our web development team can help.
Frequently asked questions
What is llms.txt?
llms.txt is a proposed convention: a Markdown file at the root of a website (yoursite.com/llms.txt) that lists the most useful pages for AI tools, with short descriptions. A larger variant, llms-full.txt, holds the full text. It is not an official web standard.
Does llms.txt improve rankings or AI citations?
There is no good evidence that it does. Ahrefs found that 97% of llms.txt files got no requests in May 2026, and Google says you do not need new machine-readable or AI text files to appear in AI Overviews or AI Mode.
Can an llms.txt file hurt my site?
It is unlikely to cause harm on its own. The costs are the time to write it and the chance that it falls out of date, which is worse than having none, so only publish one you will maintain.
Does PhantomCore use llms.txt?
Yes. We publish llms.txt and llms-full.txt because they are cheap for us to generate from our own pages. We do not rely on them for visibility and we have not seen evidence that they change it.
What is the difference between robots.txt and llms.txt?
robots.txt tells crawlers which URLs they may fetch, and Google uses it to control crawling for Search. llms.txt only suggests pages for AI tools to read. It does not grant or block access.
Sources (checked November 2026)
AI search for your business
Spend the effort where it counts.
Book a demo and we will review how your pages look to a crawler, and what to fix first.