SEO to Get Noticed by AI? The Role of llms.txt and a Setup Guide
Until now, SEO has primarily focused on “being ranked highly by Google.” However, **an era where AI serves as the gateway to information** is upon us.
3 min read
Until now, SEO has primarily focused on “being ranked highly by Google.” However, an era where AI serves as the gateway to information is upon us.
Generative AI tools like ChatGPT, Perplexity, and Gemini are beginning to read, summarize, and cite content from the internet.
Amid this trend, **llms.txt (LLMS Text)** is gaining attention.
Feature and specification statements were checked on July 31, 2026 against llms.txt – A proposal to provide information to help LLMs use a website. The article distinguishes what the official source confirms from editorial organization and recommendations.
What is llms.txt?
llms.txt is a new rules file designed for AI crawlers.
Just as robots.txt is a crawl control file for search engines, llms.txt serves to allow or restrict AI models like ChatGPT, Claude, and Perplexity from accessing and learning from a website.
It should be placed directly in the site’s root directory:
https://example.com/llms.txt
By creating this file, you can clearly communicate your intentions to AI development companies.
Why is llms.txt important?
Future SEO is not just about search. AI will cite, summarize, and learn from your articles, and the question is whether your blog will be included in the “information disseminated by AI.”
For example:
- ChatGPT cites your blog
- Perplexity displays your articles with attribution
- Gemini generates summaries in Discover
In these cases, it’s important to explicitly state whether AI is allowed to reference your content.
The mechanism for doing this is llms.txt.
Basic Syntax
Here’s the simplest permission setting:
User-Agent: *
Allow: /
This means “Allow all AI systems to access all pages.”
If you want to exclude only specific paths:
User-Agent: *
Disallow: /private/
You can also block specific models (such as gpt-4):
User-Agent: gpt-4
Disallow: /
Adding an AI Policy Page Provides Greater Peace of Mind
In addition to llms.txt, creating a page such as /ai-policy will help build trust with AI systems.
Examples of content to include:
- This site permits AI-generated summaries and citations
- Model developers must comply with copyright and citation rules
- Contact: XX
Tips for Improving Your Visibility in Discover and AI Search
To be “selected” by AI, the following are important in addition to llms.txt:
- OGP settings (title, description, thumbnail image)
- Structured data (JSON-LD such as
BlogPosting) - Clearly stating author and publisher information (e.g., on the /about page)
- A simple and accurate page structure
These optimizations make your content more likely to be featured in AI search results and summary-based media.
Conclusion
In the age of AI, SEO requires you to consider not only the “human eye” but also the “AI eye.”
llms.txt is one of the “gateways” to future content distribution.
Let’s start preparing now to create a blog that ChatGPT and Gemini will naturally choose to feature.
May your content reach both people and AI.
Primary sources checked
Important claims should also link to the relevant source in the article body.
- llms.txt – A proposal to provide information to help LLMs use a websitellms.txt · provider-primary-source · Checked: 2026-07-31