Free AI search readiness checker (AEO and GEO)
Enter your website and we check which AI and search crawlers your robots.txt lets in, along with your sitemap, llms.txt and the page details that ChatGPT, Perplexity and Google rely on.
FreeNo sign-upBy JIN Design
We fetch the page, robots.txt, llms.txt and your sitemap, nothing else. The report is not saved.
How to use it
- Enter your website address. The homepage is a good start, and you can check any other page the same way.
- Press Check my site. We fetch the page, your robots.txt, llms.txt and sitemap, which usually takes a few seconds.
- Go through the results from the top. Anything marked Fail or Warning comes with a plain-English fix.
- Make the changes, then run the check again to confirm them.
What is AI search, and what do AEO and GEO mean?
AI search is when someone asks ChatGPT, Perplexity, Claude, Microsoft Copilot or Google's AI Overviews a question and gets a written answer instead of a list of links. When these tools look things up on the web, they usually show the pages they used as sources, with links.
AEO (answer engine optimisation) and GEO (generative engine optimisation) are two names for the same goal: making it easy for these tools to find your pages, understand them and pick them as a source. For most Singapore businesses the work overlaps heavily with good SEO. The pages need to be open to the right crawlers and easy to read, with clear facts about your business.
This checker covers the technical side of that. Whether an AI tool actually mentions you also depends on your content and on what other websites say about you, which no checker can measure from a single page.
How ChatGPT, Perplexity and Google AI Overviews choose their sources
None of these companies publishes a formula for choosing sources, but each documents how its crawlers work, and that tells you what you control.
- Google AI Overviews and AI Mode draw on pages in Google's search index. Google says there are no extra requirements beyond being indexed and eligible to show a snippet, and no special files or schema are needed. Normal SEO applies.
- ChatGPT search relies on OpenAI's
OAI-SearchBot. OpenAI's crawler documentation says sites that block it will not be shown in ChatGPT search answers, although they can still appear as navigational links. - Perplexity uses
PerplexityBotto surface and link websites in its answers, according to its crawler documentation. - Claude uses
Claude-SearchBotfor search results, and Anthropic notes that blocking it may reduce your visibility in Claude's answers. - Microsoft Copilot answers draw on Bing, so
Bingbotneeds access. Bing lets you limit how Copilot uses a page with the noarchive and nocache tags.
In practice, what you control is whether the search crawlers can get in and how easy each page is to read and summarise. It also helps when your business details match across your website, Google Business Profile and directory listings.
To see whether AI tools already send you visitors, open GA4 at Reports, Acquisition, Traffic acquisition and look for the AI Assistant channel. Google added it to the default channel groups for visits referred by assistants such as ChatGPT, Gemini and Copilot. Visits from AI Overviews and AI Mode are not in it; they count as Google organic search. GA4 also files any link tagged utm_medium=ai-assistant under that channel, so if you place links yourself, for example in a custom GPT, tag them with our UTM link builder.
Which AI crawlers should you allow in robots.txt?
AI companies run two kinds of crawler, and it helps to treat them differently.
Search and answer crawlers fetch pages so the tool can show and cite them: Googlebot, Bingbot, OAI-SearchBot, Claude-SearchBot, PerplexityBot, Applebot and meta-webindexer. If robots.txt blocks one of these, that product generally stops using your pages in its answers. For a business that wants enquiries, these should be allowed. A related group (ChatGPT-User, Claude-User, Perplexity-User) opens a page only when a person asks the assistant about it. OpenAI and Perplexity say these user-triggered fetchers may not follow robots.txt.
Training crawlers collect content to train AI models: GPTBot, ClaudeBot, Google-Extended, Applebot-Extended, meta-externalagent, CCBot and Bytespider. Blocking them is a business decision, and for most of them it does not touch search. Google states that Google-Extended does not affect inclusion or ranking in Google Search, but it does also control whether Gemini Apps and Vertex AI can ground their answers in your pages (Google's crawler list). Meta says meta-externalagent is used for training and also for indexing content for its products (Meta's crawler list). Apple says pages that disallow Applebot-Extended can still appear in its search results.
A robots.txt that welcomes search crawlers but opts out of training could look like this:
User-agent: GPTBot
User-agent: ClaudeBot
User-agent: Google-Extended
User-agent: Applebot-Extended
User-agent: CCBot
Disallow: /
User-agent: *
Allow: /
Sitemap: https://www.example.com.sg/sitemap.xml
Crawlers follow the most specific User-agent group that names them and fall back to * otherwise, as set out in the robots.txt standard (RFC 9309). If robots.txt cannot be loaded at all because of a server error or timeout, the standard tells crawlers to treat the whole site as off limits, so a broken robots.txt is worse than none.
Where to change it on your website platform
- WordPress with Yoast SEO: Yoast SEO, Tools, File editor (Yoast's guide). With Rank Math: Rank Math SEO, General Settings, Edit robots.txt.
- Wix: SEO & GEO in the dashboard, then Tools and settings, Robots.txt Editor (Wix's guide).
- Shopify: add a
robots.txt.liquidfile to your theme under Online Store, Themes, Edit code (Shopify's guide). - Squarespace: robots.txt cannot be edited directly. Settings, Crawlers has a "Block known artificial intelligence crawlers" option, which adds a list of mostly training crawlers (Squarespace's guide).
- Webflow: Site settings, SEO, Indexing, where you enter robots.txt rules and then publish (Webflow's guide).
Cloudflare and other firewalls
Hosting, CDN and firewall settings can block crawlers before robots.txt is even read. Cloudflare is the common case: since July 2025 it asks every new domain at sign-up whether to allow AI crawlers, with blocking as the default. If your site runs through Cloudflare, open AI Crawl Control in the dashboard and check that the search crawlers you want are allowed.
Cloudflare can also manage robots.txt for you. Its managed robots.txt adds Disallow rules for known AI training crawlers and, since September 2025, a line such as Content-Signal: search=yes, ai-train=no (Cloudflare's Content Signals Policy). The signal states your preference for search, for use in AI answers (ai-input) and for training; it does not block anything by itself. This checker shows the line if it finds one.
What is llms.txt, and do you need one?
llms.txt is a Markdown file at the root of your website (/llms.txt) that gives AI tools a short, clean summary of your site. It was proposed by Jeremy Howard in September 2024. The only required part is an H1 with your name. After that the format suggests a one-line summary in a > blockquote and ## sections listing links to your key pages with a short note on each.
It is a proposed convention, not a standard. None of the major AI search companies documents that its crawlers read it, and Google's guide to generative AI features says llms.txt files neither help nor harm visibility in Google Search. We still add one to the AI-powered websites we build, because it takes little effort and gives any tool that does read it an accurate summary of the business. This checker treats a missing llms.txt as a note rather than a problem.
Which structured data helps AI search understand your business?
Structured data is a block of JSON-LD in your page's code that states facts in a form software can read without guessing, using the schema.org vocabulary. The types worth having on most business websites are:
- Organization or LocalBusiness (or a more specific type such as Dentist or ProfessionalService) on the homepage, with your name, logo, address, phone number, opening hours and social profiles.
- Article or BlogPosting on articles, with the headline, author and dates.
- FAQPage is optional now. Google stopped showing FAQ rich results on 7 May 2026 and removed their documentation in June 2026. The markup is still valid schema.org, but clear questions and answers in the visible text matter more.
Google says structured data is not required for its generative AI features and there is no special schema to add, while still recommending it as part of good SEO. Whatever you add must match what visitors can see on the page (Google's structured data guide). The text itself matters just as much. Put your main content in the HTML your server sends, use clear headings, and answer common customer questions in plain sentences, so any crawler can read it whether or not it runs JavaScript.
Frequently asked questions
Is this AI search checker free?
Yes. It is free with no sign-up. For each check we fetch up to four files from the site you enter (the page, robots.txt, llms.txt and the sitemap) and show you the report. We do not save the report.
What is the difference between SEO, AEO and GEO?
SEO is about ranking in search results. AEO (answer engine optimisation) and GEO (generative engine optimisation) are about being used and cited as a source in AI answers from tools such as ChatGPT, Perplexity and Google AI Overviews. The foundations are the same, starting with pages crawlers can reach and content that clearly answers the question.
Will blocking GPTBot remove my website from ChatGPT?
No. OpenAI uses GPTBot for training and OAI-SearchBot for ChatGPT search, and says each setting is independent. You can block GPTBot and still appear in ChatGPT search, as long as OAI-SearchBot is allowed.
Does Google-Extended affect Google Search or AI Overviews?
Google says Google-Extended does not affect inclusion or ranking in Google Search. AI Overviews and AI Mode are part of Google Search, so they follow the rules for Googlebot and the snippet controls such as nosnippet.
If every check passes, will AI tools recommend my business?
Not necessarily. Passing means nothing technical is stopping AI search tools from reaching and reading the page. Whether they cite you also depends on how well your content answers the question and what other sites say about you.
Why does the checker say my site refused it?
Some hosting, CDN and firewall settings block automated visitors, and our checker identifies itself as JINDesignTools. AI crawlers may be refused too, unless your firewall settings allow verified crawlers. Check your bot protection settings (on Cloudflare, AI Crawl Control) and make sure the crawlers you want are allowed.
More free tools
All tools →Ready to move to AI-powered web?
Tell us about your website. We'll show you where it could work harder for you, without the sales pitch.






