Free llms.txt generator

Enter your website and we draft an llms.txt file from your homepage and sitemap, with page titles and descriptions filled in. Rename or remove sections, then copy or download the file for your site root.

FreeNo sign-upBy JIN Design

How to use it

  1. Enter your website address, such as www.yoursite.com.sg, and press Generate.
  2. Check the site name and summary. The summary comes from your homepage meta description, so rewrite it if it reads like an advert.
  3. Rename sections, untick pages you do not want listed, or move a section to Optional.
  4. Make any last edits in the text box, then copy or download llms.txt and upload it so it opens at yoursite.com/llms.txt. If your site already has one, we check it against the format and test a few of its links first.

What is llms.txt?

llms.txt is a plain text file in Markdown that sits at the root of a website, at /llms.txt, and gives language models a short, curated guide to the site and the pages that matter most. Jeremy Howard proposed it in September 2024, and the format is described at llmstxt.org.

The format is simple. The only required part is an H1 with the name of the site. After it comes an optional summary in a blockquote, optional paragraphs of detail, and then H2 sections that each hold a list of links, written as - [Page title](https://...): what the page covers. A section named Optional holds pages a model can skip when it needs a shorter version.

# Example Dental Clinic

> Family dental clinic in Tampines offering check-ups, braces and implants.

## Services

- [Braces](https://www.example.com.sg/braces/): types of braces, treatment time and how to book a consultation

## Optional

- [Privacy policy](https://www.example.com.sg/privacy/)

Do AI assistants and Google use llms.txt?

llms.txt is a proposed convention, not an agreed standard, and support is limited. Google is clear about its own products. Its guide to optimizing for generative AI features says Google Search does not use llms.txt files, and that keeping one will neither harm nor help your visibility or rankings in Google Search. It also says it is fine to create one for other services that do use it.

We have not found a public statement from OpenAI, Anthropic or Perplexity that their assistants use llms.txt when they answer questions. What these assistants clearly do use is your pages themselves, so clear page titles, descriptions and content still matter most.

So why make one? It takes a few minutes and does no harm, and tools are starting to look for it. Webflow has an upload setting for it and Shopify now serves a file at /llms.txt by default. Chrome's Lighthouse also has an experimental agentic browsing category that checks whether a site has one at its root. If AI tools do start relying on it, yours will already be accurate. In the meantime, use our AI search checker to see whether AI crawlers can reach your pages.

llms.txt vs robots.txt vs sitemap.xml

The three files sit side by side at the root of your site but do different jobs.

  • robots.txt tells crawlers which parts of the site they may crawl. It is the only one of the three that controls access, and it is a formal standard (RFC 9309). To allow or block AI crawlers, you add rules for their user agents, such as GPTBot or Google-Extended, here.
  • sitemap.xml lists every page you want search engines to find, with optional last-modified dates. It is meant for machines and can run to thousands of addresses.
  • llms.txt is a short summary in Markdown for language models: your key pages with one line on each. It does not block or allow anything, and it should be curated rather than a copy of your sitemap.

How to add llms.txt to WordPress, Shopify and Webflow

Whatever the platform, the goal is the same: the file must open at https://www.yoursite.com/llms.txt as plain text. Open that address in a browser once you are done to check it.

WordPress: upload llms.txt with your hosting file manager or SFTP into the folder that holds wp-config.php, which is usually public_html. If you use Yoast SEO, it can also create and update the file for you under Yoast SEO, Settings, Site features, in the AI tools group (Yoast's guide). Yoast refreshes its file every week, and its specification says it will not overwrite an llms.txt file that is already there. So pick one approach: if you upload your own file, Yoast's version will not replace it.

Shopify: Shopify does not let you upload files to the root of your store. Instead, every store already serves an automatic file at /llms.txt that mirrors the store's /agents.md, which Shopify generates for you. Open yourstore.com/llms.txt to see what yours says today. To use your own version, go to Online Store, Themes, open the menu on your theme and choose Edit code, then add a new file in the Templates folder named llms.txt.liquid and paste the text in (Shopify's documentation). Shopify's documentation notes that most stores can keep the automatic file, and that once you add your own, you need to keep it up to date.

Webflow: open Site settings, go to the SEO tab and upload the file in the llms.txt section, then publish the site. Webflow serves it from the root of your custom domain (Webflow's guide).

Other sites: put the file in the same public folder as your robots.txt. On a custom-coded site that is usually the public or static folder of the project.

What makes a good llms.txt file

Write the summary for someone who has never heard of you, saying what you do and who it is for. Add a short paragraph with the facts people ask about most often. For a Singapore business that might be your registered company name and UEN, the areas you serve, opening hours, payment options such as PayNow, the languages your team speaks and any licences you hold.

List the pages that answer real customer questions, such as your services, products, locations and contact page, each with a description that says what is on the page. You do not need every blog post. Put supporting pages, such as policies, under Optional.

Keep it current. When your services or URLs change, update the file, so it never sends AI tools to pages that no longer exist. Running this generator again after a redesign is a quick way to start the new version.

Frequently asked questions

Is this llms.txt generator free?

Yes. It is free and needs no sign-up. To build the file we read your homepage, your sitemap and up to 30 key pages, the same way a browser would. We do not save your website address or the file.

Will an llms.txt file help my Google rankings?

No. Google says Google Search does not use llms.txt, and that the file will neither harm nor help your visibility or rankings in Google Search. Good page titles, descriptions and content are what help.

Why does my Shopify store already have an llms.txt?

Shopify serves one for every store automatically, copied from the store's /agents.md. You can keep it, or publish your own version by adding a file named llms.txt.liquid to the Templates folder of your theme.

Where does the llms.txt file go?

At the root of your domain, so it opens at https://www.yoursite.com/llms.txt, next to robots.txt. The proposal also allows a file inside a folder, such as /docs/llms.txt, for that part of a site.

Does llms.txt block AI crawlers from my site?

No. llms.txt only describes your site. To allow or block crawlers such as GPTBot or ClaudeBot, add rules to your robots.txt file.

Why does the generator say it could not find a sitemap?

We look for Sitemap: lines in your robots.txt, then at /sitemap.xml and /sitemap_index.xml. If none of those work, we build the file from the links on your homepage instead. Our sitemap checker can show you what is wrong.

More free tools

All tools →

Ready to move to AI-powered web?

Tell us about your website. We'll show you where it could work harder for you, without the sales pitch.