llms.txt and Grounding Page: Guide and Source of Facts for AI Systems

llms.txt and the Grounding Page give AI systems and LLMs orientation and extend SEO into AI search. The llms.txt file guides AI agents to the most important content on a website. The Grounding Page provides verified information about companies, brands and people.

Key takeaways:

  • llms.txt: a Markdown table of contents for AI agents and developer tools, generated automatically with little effort.
  • Grounding Page: an indexable page with verified facts about a company and its brands, the basis for profiles, directories and AI answers.
  • Impact: mentions, directories and consistent data drive most AI visibility. The llms.txt adds to them at minimal cost.

llms.txt and Grounding Page compared: two building blocks with a clear division of tasks

Both building blocks complement classic SEO and make a website understandable for AI systems. Each serves a different purpose:

Criterionllms.txtGrounding Page
PurposeGuide to selected contentSource of facts about the entity: company, brand, person or product
FormatMarkdown file in the root directoryHTML page with structured data
ReadersAI agents, coding assistants, developer toolsSearch engines, AI systems via the search index, and people
Retrievaldirectly at the URL /llms.txtvia the Google and Bing index
Maintenanceautomatic with every changereview by a responsible person, for example quarterly
Documented impactno measurable effect on AI citationscase studies showing gains, without a control group

Both draw on the same information: services, core data and descriptions. A shared data source keeps them consistent.

llms.txt: the Markdown standard from llmstxt.org with H1, summary and link lists

The llms.txt is a Markdown file in the root directory of a website, for example https://digitalagenten.com/llms.txt. Jeremy Howard proposed the standard in September 2024 on llmstxt.org.

The llms.txt file helps large language models (LLMs) quickly find the most important content at inference time. It is intended for retrieval by AI agents, not for training.

The robots.txt controls access, and the sitemap.xml lists all URLs for search engines. The llms.txt shows AI systems selected URLs with context.

H1 as the only required element: the name of the website or company

Only an H1 with the name is required. All other elements are recommended.

The name should match exactly the name used in the business profile, structured data and directories. This lets AI systems attribute all information unambiguously to the same entity.

Summary as a blockquote: the company in two sentences

A blockquote with “>” summarizes the offering, location and focus areas. Factual statements give AI systems more context than promotional copy.

A short paragraph below it can link to the company’s facts page.

Link lists under H2: the most important URLs with a short description

Each section groups links in the format “[Name](URL): Description”. Typical sections are company, services, guides and documentation.

The description explains in exactly one sentence what information the linked page contains.

Optional section: secondary content for limited context windows

AI systems can skip links under “## Optional” when context is limited. Typical optional items are the blog overview, sitemap and archives.

llms-full.txt: all content in a single file

The llms-full.txt contains the full text of the linked pages in Markdown. Anthropic, the company behind Claude, introduced the format in 2024 together with Mintlify for developer documentation.

For company websites, the llms.txt is usually sufficient. For half of the domains that offer both versions, the file sizes differ by no more than 5% (SEOmator).

llms.txt fetches by AI crawlers: 97% of files without a single request

The file is already widespread: 8.6% of the 100,000 largest domains according to Cloudflare Radar have an llms.txt (SEOmator, September 2026). Log file studies show how often AI crawlers actually fetch it:

  • Ahrefs (June 2026, 137,210 domains): 97% of the roughly 38,000 llms.txt files received no request in May. Of around 22,000 requests, 4.51% came from GPTBot, 0.8% from ClaudeBot and 21.7% from SEO audit tools.
  • EZY.ai (July 2026, 83 websites, vendor study): GPTBot fetched the llms.txt 7 times and the robots.txt 3,990 times. ClaudeBot came in at 9 versus 3,120, PerplexityBot at 0 versus 775, Googlebot at 67 versus 5,125.
  • ThinkAI (October 2026, one website, four months): 131 llms.txt fetches out of 4.0 million bot requests. Markdown versions of individual pages were fetched around 60 times more often.
  • Meta-ExternalAgent is the exception among LLM crawlers: 193 llms.txt fetches compared with 172 robots.txt fetches (EZY.ai).

A case study by Wix (December 2025) shows more requests: with a rel=alternate link in the HTML head, OAI-SearchBot fetched the llms.txt more than 5,000 times across seven websites.

Adding such a link to the head is therefore a simple way to test this exact effect on your own website.

Google, OpenAI, Anthropic and Perplexity: no official support for llms.txt

  • Google: According to its AI optimization guide (as of July 2026), Google Search ignores llms.txt files. John Mueller said in June 2025: “no AI system currently uses llms.txt”.
  • OpenAI and Perplexity: Both control their crawlers via robots.txt. They use llms.txt as an index of their own documentation.
  • Anthropic: For ClaudeBot, Claude-User and Claude-SearchBot, Anthropic refers exclusively to robots.txt.
  • Chrome Lighthouse: A dedicated audit checks the llms.txt as an “emerging convention” (documentation, as of May 2026). If the file is missing, the audit is marked as not applicable.

For classic SEO and rankings, the llms.txt is therefore neutral. Its value lies with AI agents and developer tools that retrieve content in a targeted way.

Grounding Page: verified brand facts as a source for AI answers

A grounding page is a page on your own domain that consolidates the key information about an entity: company, brand, person or product. Uberall describes it as a “single, authoritative, citable source of truth”.

Large language models such as ChatGPT, Claude and Gemini find the page via the search index. It answers typical questions about the offering, services and contacts, precisely and with sources. This enables AI systems to cite correctly.

Grounding pages extend the classic About Us page with verifiable information. The term GroundingPage is a registered trademark of Hanns Kronenberg.

Grounding and Grounding Page: retrieval process and source

Grounding refers to a language model (LLM) retrieving current web content, for example Grounding with Google Search in Gemini or Grounding with Bing Search.

The facts page is the source that should be found during this process. It becomes visible as soon as Google and Bing index it.

Fact table: subject, description, evidence and ownership

The Grounding Page Standard by Hanns Kronenberg (version 1.7, October 2026) relies on a stable definition, a clear delineation and a consistent structure.

A proven approach is a fact table with subject, description, canonical reference, scope, evidence and maintenance ownership. Related entities such as locations, products and people get their own sections.

Grounding Page example: the digitalagenten facts page

The digitalagenten facts page consolidates core data, service areas with jump links, contacts and frequently asked questions in German and English.

An Organization schema with a service catalog mirrors the visible information. The llms.txt links to this page in its very first paragraph.

Impact on AI visibility: mentions and directories outperform llms.txt

  • llms.txt: SE Ranking found no correlation between llms.txt and AI citations across around 300,000 domains (October 2026).
  • Schema markup: Ahrefs compared 1,885 pages with new JSON-LD against control pages. Citations in AI Mode (+2.4%) and ChatGPT (+2.2%) did not increase significantly.
  • Mentions: Across 75,000 brands, web mentions correlate most strongly with visibility in AI Overviews (0.664), backlinks considerably less (0.218) (Ahrefs, May 2025).
  • Directories: 42% of 6.8 million citations in ChatGPT, Gemini and Perplexity come from directories and listings, 44% from websites (Yext, October 2025).
  • Grounding pages: A vendor case study with 16 pages shows AI visibility rising from 25.3 to 34.4 points after two weeks, without a control group (groundingpage.com).

The grounding page delivers its value as a single, consistent reference. Profiles, directories and press releases adopt the same data.

This creates consistent mentions that AI systems cite in their answers.

Use cases: llms.txt for agents, Grounding Page for facts, both from one data source

  • llms.txt: useful when documentation, service pages or guides should be made accessible to AI agents and coding assistants. For APIs, MCP servers complement the llms.txt. Effort: set up once, then automatic.
  • Grounding Page: useful when AI systems should describe a company, brand or person correctly. Effort: research the information, approve it and review it regularly.
  • Both together: useful for companies with multiple services and locations. One data source feeds the website, llms.txt, facts page, structured data and directories.

For Generative Engine Optimization (GEO), the combination is the most robust approach: the file makes content accessible, the page secures unambiguous information.

Creating llms.txt and keeping it updated automatically: the digitalagenten.com example

The digitalagenten llms.txt is generated automatically from WordPress. Five steps lead to a file that maintains itself:

  1. Select content: facts page, services by area, guides and studies. Privacy policy, job postings and outdated posts are excluded.
  2. Reuse descriptions: the meta descriptions provide the text, and a filter removes calls to action.
  3. Write the Markdown: H1, summary, link to the facts page, H2 sections and “## Optional”.
  4. Place it in the root directory: the llms.txt file sits at /llms.txt next to robots.txt and sitemap.xml, in UTF-8 and without a BOM character.
  5. Keep it current: every change to pages or posts triggers a rebuild, plus a daily run and a cache purge at Cloudflare.

Tools make getting started easier: the generator in Yoast SEO, plugins for WordPress and Shopify, or MCP servers for documentation.

Yoast generates the file weekly from the five most recently updated pieces of content. For websites with many service pages, a custom selection offers more control.

Creating and maintaining a Grounding Page: evidence, structure and fixed review dates

Your own grounding page comes together step by step:

  1. Collect facts: company name, legal form, location, founding year, services, contacts and key figures, each backed by evidence.
  2. Define the structure: a short definition at the top, fact table, service areas, delineation and frequently asked questions. One topic per URL.
  3. Add structured data: schema markup of type Organization with the same information as the visible text, plus sameAs links to the profiles.
  4. Review and reconcile: quarterly with a date, plus a comparison with the business profile, Yext listings and directories.

Each step increases the likelihood that AI answers describe and cite brands correctly. Bing recommends phrasing content directly, keeping entity names consistent and placing key information at the top.

Measuring llms.txt and Grounding Page fetches: log files, AI bot tracking and prompt monitoring

  • Log files: analyze requests to the URL /llms.txt and to the facts page by crawler user agent, such as GPTBot, ClaudeBot, OAI-SearchBot, PerplexityBot and Meta-ExternalAgent.
  • AI bot tracking: plugins and CDN statistics, for example from Cloudflare, show trends even without raw data.
  • Prompt monitoring: the SISTRIX AI Tracker measures whether ChatGPT, Gemini and Perplexity mention the brand and which sources they cite in their LLM answers.
  • Before-and-after comparison: one measurement before the grounding page goes live and one after four to eight weeks.

Common llms.txt and Grounding Page mistakes: encoding, promotional copy and contradictory information

Clean files and consistent information secure the impact of both building blocks. Common mistakes can be checked before going live:

  • Encoding: an invisible BOM character before the H1 or escaped characters such as “\-” make parsing harder.
  • Promotional copy: calls to action in the summary give AI systems no usable information.
  • Language versions: English titles with German URLs confuse attribution.
  • Contradictions: inconsistent information across the facts page, business profile and directories weakens the entity.
  • Instructions to AI systems: Ahrefs recommends neutral descriptions because instructions can be treated as prompt injection.

llms.txt and Grounding Page in a GEO program: foundations for lasting AI visibility

Generative Engine Optimization (GEO) extends classic SEO with content, mentions and measurement in AI answers. Within it, llms.txt and grounding pages are low-effort technical foundations.

The greatest impact comes from combining them with mentions, directories and citable content:

The digitalagenten GEO agency implements all building blocks in one program, from the grounding page to monitoring. This keeps brands visible in AI answers over the long term.

Conclusion: maintain llms.txt automatically, build out the Grounding Page as a source of facts

With automated maintenance, the llms.txt requires hardly any effort and makes content accessible to AI agents.

The grounding page provides the verified facts that profiles, directories and AI answers draw on.

The greatest AI visibility comes when both building blocks are fed from one data source and are followed by mentions outside your own website.

FAQ: llms.txt and Grounding Page

The llms.txt sits in the root directory, i.e. at https://domain.de/llms.txt. According to Jeremy Howard’s proposal from September 2024, it is a UTF-8 text file with Markdown formatting.

According to its own AI optimization guide (as of July 2026), Google ignores the llms.txt. The file affects rankings in Google Search neither positively nor negatively.

The llms.txt links to the most important pages with a short description. The llms-full.txt contains the full text of these pages and is best suited to developer documentation.

A grounding page is created in four steps: collect information with evidence, define a structure with a definition and fact table, add an Organization schema and review it regularly.

The About Us page tells the story and values. The grounding page consolidates verifiable information in a fixed structure, phrased neutrally and backed by evidence. The two pages complement each other.

The llms.txt links to the facts page and the core service pages. Both are maintained from the same data source and therefore stay unambiguous and consistent.

Lorenz Wacker, Managing Partner and Digital Strategist at digitalagenten Berlin

Lorenz Wacker

Managing Partner

Lorenz Wacker is Managing Partner and Digital Strategist at digitalagenten in Berlin and specializes in comprehensive digital strategy.

As managing director, he combines SEO, ads, content and AI into multichannel strategies.

Lorenz has industry experience in automotive, financial services, insurance, online media, telecommunications, retail, travel and healthcare.