Guide, updated 2026-10-24
Can AI read your products?
A merchant on the Shopify Community checked 98 stores: only 2 blocked any AI crawler in robots.txt, yet 65 of the 94 they tested never came up in an AI answer that didn't name the store. For most shops, crawler access is fine. The gap is whether the crawler finds anything it can use once it arrives.
That study is one merchant's own analysis, so treat the numbers as a direction, not a measurement.
Why AI can miss a product that people can see
Most AI crawlers read the HTML your server sends and stop there. In Vercel and MERJ's analysis of crawler traffic, none of the major AI crawlers ran JavaScript: OpenAI's (OAI-SearchBot, ChatGPT-User, GPTBot), Anthropic's ClaudeBot, PerplexityBot, Meta-ExternalAgent and Bytespider. Google's Gemini uses Googlebot's rendering and Applebot renders pages too, but the others see only the first HTML.
So anything an app or theme script adds after the page loads (a description pulled in by a page builder, prices, variants, reviews, size charts) can be invisible to ChatGPT search, Claude and Perplexity, even though shoppers see it.
Check 1: is your product text in the page source?
- Open a product page, then View page source (Ctrl+U, or Option+Cmd+U on a Mac). Not "Inspect": the inspector shows the page after scripts ran.
- Search the source (Ctrl+F) for a sentence from your product description, and for the price.
- If you find them, crawlers can read them. If you only see them in "Inspect", a script adds them and most AI crawlers miss them. Ask your theme developer or app vendor to render that text in the page itself.
Check 2: does the page carry Product structured data?
Structured data is a block of JSON-LD in the page that states, in a fixed format, what the product is: name, image, price, currency, availability. Google documents it as merchant listing markup for pages where people can buy. Many Shopify themes output it; some custom themes and page builders drop it.
- In the same page source, search for
application/ld+json. - Look for
"@type": "Product"with"offers"inside it (price, priceCurrency, availability). - No block, or no offers in it? Add it in the theme or with a structured-data app, then validate the page in Google's Rich Results Test.
Check 3: what does your robots.txt say?
Shopify generates a default robots.txt that works for most stores (in the merchant's sample above, only 2 of 98 stores blocked any AI crawler). If your theme has a robots.txt.liquid template, that template replaces Shopify's default, so an old edit or an app can change who gets in. Shopify's docs recommend saving a copy of your current /robots.txt before changing the template. Our free check reads the live file the way 20 AI crawlers do and names the line that decides each one.
What to fix first
- Text first: description, price and key facts in the HTML the server sends.
- Then Product structured data with offers.
- Then robots.txt: keep AI search crawlers allowed; block training crawlers only if that is your choice.
Our $19 report audits up to 10 of your pages for exactly this: text that loads without JavaScript, structured data, titles, canonicals, the sitemap and llms.txt, with fixes ordered by points at stake.
Check your store
Sources
- Shopify Community, a merchant's own check of 98 stores for AI crawler blocks and AI answer visibility (2026), found through search.
- Vercel and MERJ, The rise of the AI crawler (JavaScript rendering by crawler), 2024-12-17.
- Google Search Central, Introduction to Product structured data (product snippets and merchant listings).
- Shopify developer docs, Customize robots.txt (default file, robots.txt.liquid replaces it).