What is llms.txt?
A Markdown file at your domain root that lists your key pages with titles and short descriptions, so ChatGPT, Claude and other AI tools can understand your site.
| robots.txt | sitemap.xml | llms.txt | |
|---|---|---|---|
| Purpose | Control bot access | List URLs for indexing | Structured content for AI |
| Audience | Search crawlers | Search crawlers | LLMs & AI assistants |
| Content | Allow / disallow rules | URL list | Titles, summaries, links |
Where to upload llms.txt
At your domain root: https://yourdomain.com/llms.txt
| cPanel / WordPress | /public_html/llms.txt |
| Laravel / Symfony | /public/llms.txt |
| Next.js / React / Nuxt | /public/llms.txt |
| Netlify / Vercel / Cloudflare | /public/llms.txt |
| Shopify | Content → Files, then redirect /llms.txt |
FAQ
Is llms.txt an official standard?+
Not yet. It's a convention proposed in 2024 that's gaining adoption.
Do search engines use it?+
No. Google and Bing ignore it. It's for AI tools like ChatGPT, Claude and Perplexity.
How often should I update it?+
Whenever you add or restructure important pages. Monthly is plenty for most sites.
Can I have more than one?+
No. One llms.txt per domain, at the root.