Generate a structured llms.txt file for your website, the AI-era companion to robots.txt. Helps ChatGPT, Claude, and Perplexity understand and prioritise your content.
Site Information
Key Topics and Expertise
Important Pages
Add your most important pages. AI models will prioritise these when citing your site.
Optional Details
Your llms.txt File
Copy and upload to your site root as llms.txt
llms.txt and upload it to your server root so it is accessible at yourdomain.com/llms.txt. On WordPress, upload via FTP or File Manager to the public_html folder.
What Is an llms.txt File?
An llms.txt file is a plain-text, Markdown-formatted file placed at the root of your domain that tells AI language model crawlers which pages matter most. It sits alongside robots.txt and gives systems like GPTBot, ClaudeBot, and PerplexityBot a prioritised map of your content.
AI referral traffic is still a small share of overall web traffic, roughly one percent by most 2026 measurements, but it is growing fast and Google's AI Overviews now appear on close to half of all Google searches. Giving AI systems a clear content hierarchy is a practical way to prepare for that shift. This free llms.txt generator builds a correctly formatted file in under two minutes with no coding required.
Where robots.txt acts as a gate controlling crawler access, llms.txt acts as a signpost directing AI models toward your highest-value pages. Together the two files form part of the foundation of modern AI search optimisation.
Why Your Site Might Want an llms.txt File
AI-referred sessions grew roughly 527 percent year over year between January and May 2025 according to Previsible and SparkToro research, even though AI referral traffic overall still makes up only about one percent of total web traffic. Growth from a small base is still growth worth preparing for. Without an llms.txt file, AI crawlers must infer your content hierarchy from links and schema alone, which increases the risk of AI systems surfacing outdated pages or low-authority posts instead of your flagship resources.
| AI Crawler | Owner | Powers | llms.txt Awareness |
|---|---|---|---|
| GPTBot | OpenAI | ChatGPT training and browsing | Yes |
| OAI-SearchBot | OpenAI | ChatGPT search features | Yes |
| ClaudeBot | Anthropic | Claude web features | Yes |
| PerplexityBot | Perplexity | Perplexity AI search | Yes |
| Bytespider | ByteDance | TikTok AI features | Partial |
| CCBot | Common Crawl | Model training data | Training only |
"Awareness" means the crawler's operator has acknowledged or supports the llms.txt convention. It is a voluntary, community-driven standard, not something every crawler is confirmed to parse and act on programmatically.
How to Use This llms.txt Generator
Enter your site name and a short description. This description becomes the entity definition AI models use when attributing content to your brand. Next, add the URLs and short titles of your most important pages, including your best-performing articles, key service pages, and cornerstone content.
Click Generate to produce your llms.txt output. Copy the text, save it as a plain .txt file named exactly llms.txt, and upload it to your domain root at https://yourdomain.com/llms.txt. On WordPress, upload via FTP to the public_html folder or use a file manager plugin. Confirm it loads correctly before submitting your sitemap for recrawl.
llms.txt vs robots.txt: Key Differences
| File | Purpose | Controls | Audience |
|---|---|---|---|
| robots.txt | Crawler access gate | Which URLs crawlers can visit | All crawlers |
| llms.txt | Content priority guide | Which pages AI should prioritise | AI language models |
| sitemap.xml | URL discovery map | Which URLs exist and when updated | All crawlers |
Use all three files together. robots.txt controls access, llms.txt guides AI priority, and sitemap.xml enables discovery. A site with all three gives AI search engines the clearest possible picture of your content.
Frequently Asked Questions About llms.txt
Complete Your AI Search Workflow
Control which crawlers, including AI bots, can access your site. Pair with llms.txt.
Open Tool → 🗺SEOXML Sitemap GeneratorHelp crawlers discover every page on your site alongside your llms.txt file.
Open Tool → 🔍SEOGoogle SERP SimulatorPreview your title and meta description in Google results before you publish.
Open Tool → 🧩Technical SEOSchema Markup GeneratorAdd structured data so AI systems can read your content as accurately as possible.
Open Tool → 🎯AI SearchAEO Readiness CheckerScore your content against 15 AI citation signals to see if it is likely to be cited.
Open Tool → 🛡️SEOE-E-A-T Score CheckerCheck your pages for the trust and authority signals both Google and AI systems reward.
Open Tool →