Skip to content

How AI crawlers read a product page

A machine summarising your product cannot see your design. It reads what the page says, in order, and repeats the parts it can state confidently.

By cartscaling Reviewed 6 min read
How AI crawlers read a product page: laptop displaying online cosmetics store with discount offers.

A shopper asking an assistant about a product is asking a system that has read a lot of pages and now has to say something specific and defensible about yours. What it can say is limited by what your page actually states in words.

That is the whole thing to understand. Not a ranking trick, not a new channel to game. These systems favour text they can extract and facts they can attribute, and they cannot use what is not stated. A page built for humans scanning visually, where the important details live in a photograph, a tab that loads on click, or an implication, gives a machine very little to work with even when the page is beautiful.

So the practical work is unglamorous and it overlaps almost entirely with writing a genuinely useful product page. Say what the thing is, in sentences, in the page itself, and say the parts a buyer would ask about before they buy.

They read text, in order, without the design

Strip the styling from your product page and read what is left, in sequence. That is close to what a machine gets.

Does it begin with a clear statement of what the product is, who it is for and what makes it different, or does it begin with three navigation lists and a promotional banner. Does the sequence make sense read aloud. Is the heading structure meaningful, so the sections are labelled by what they contain rather than by design intent.

Two specific issues come up constantly. Content that only appears after interaction, such as specifications inside a tab or an accordion that loads its contents when clicked, may not be part of the page as retrieved. Where the platform allows, keep that content in the page and collapse it visually rather than fetching it on demand.

And content assembled entirely in the browser after the fact. Some crawlers execute scripts and some do not, and the ones that do not see whatever the page contained before the scripts ran. If your description, price or reviews are added afterwards, some readers see a shell.

View the page as source text once. It is a fast and uncomfortable exercise.

If a fact only exists inside an image, it does not exist to anything reading your page.

A fact inside an image does not exist

The most common gap in ecommerce pages is a specification sheet that is a picture.

Dimensions, materials, compatibility, care instructions, ingredient lists, size charts. All of these are frequently supplied by manufacturers as images, and stores drop them in because they look tidy and take no work to publish.

To a machine reading the page, they are decoration. The facts they carry cannot be quoted, compared or used to answer a question, which means your product is absent from exactly the conversations where those facts decide the purchase. The same is true for a size chart baked into a graphic, and for the dimensions that only exist in the third photograph.

The fix is to put the same information in text as well. It does not have to replace the image. A specification list in the page, a size table as an actual table, and the material and dimensions written into the description all cover it.

This is also an accessibility improvement and a conversion improvement, since a customer on a phone can read text and cannot zoom comfortably into a chart. Three benefits from the same afternoon of work is a good ratio.

Structured data is the second copy of the same truth

Once the facts are in the text, stating them again in structured form removes the guesswork about which number is the price and which is the weight.

For a product page that means the item, its identifiers, brand, price, currency, availability and the reviews shown on the page. It is the same information a shopping feed carries, which is not a coincidence: both exist so a machine does not have to infer anything.

The rule is consistency. The structured data must agree with the visible page, and the visible page must agree with the feed. Where they disagree, you have told three different stories about one product and none of them can be relied on.

It is also worth stating the boring facts explicitly rather than assuming they can be worked out. Shipping cost and delivery window, returns period, warranty, country of origin, what is included in the box. Buyers ask assistants about these constantly, and a page that answers them plainly is a page that can be used to answer.

Structured data does not replace the writing. It confirms it.

Write the sentence you want quoted

When a system summarises, it favours sentences that are self contained, specific and checkable. That is a writing instruction you can act on directly.

Instead of a paragraph of atmosphere that mentions durability somewhere in the middle, write the sentence: this jacket uses a coated ripstop shell and is rated for light rain, not for sustained downpours. Instead of implying who it suits, say who it suits and who it does not.

Honesty about limits works particularly well here, and it is the part stores resist. A page that states what the product is not for is more useful to a shopper, more likely to be used as a source, and it reduces returns from people who would have bought the wrong thing.

The same applies to comparisons within your own range. A sentence explaining when to choose the larger model over the smaller one is exactly the kind of guidance a shopper asks for, and it belongs on your page rather than in someone else's article.

Keep sentences complete. A bulleted fragment can lose its subject when lifted out, while a full sentence carries its meaning with it.

Say the same thing everywhere you appear

A page is not read in isolation. Systems weigh what a page says against what other sources say about the same product, and inconsistency reduces confidence in all of it.

So the product name, the specifications and the claims should match across your product page, your feed, your marketplace listings if you have them, the manufacturer's information and any material you supply to retailers. Where your version disagrees with everyone else's, the disagreement is what gets noticed.

This extends to the business itself. The store name, what you sell, where you ship, your returns policy and your contact details should be stated somewhere clear and consistently. A shopper asking whether a store ships to their country is asking a question that many stores answer only inside a checkout.

The practical version is a short audit: pick three products, list what each source says about them, and reconcile the differences. It usually turns up an old specification still circulating, a discontinued variant listed somewhere, or a returns window that changed on one page and not the others.

What you cannot control

It is worth being clear about the limits, because there is a lot of confident advice around that is not grounded in anything.

You cannot control which sources a system chooses, how it words a summary, or whether it mentions you at all. You cannot verify most of it, because answers vary by phrasing, by user and over time. Anyone offering a method to place your brand in an assistant's recommendations is describing something they cannot control either.

What you can control is whether your page is usable as a source. Facts in text. Structured data that agrees with them. Questions answered plainly. Consistency across the places you appear. Access not blocked by accident, which is worth checking, since crawler rules are sometimes copied between sites without anyone reading them.

The reassuring part is that this list is not speculative. Every item on it also helps a human buyer, a search engine and a shopping feed. That is the test we apply before recommending any of this work: if it only pays off in a scenario nobody can measure, it does not go in the plan.

Related

Your plan is free.

A person reads it. You keep the plan. No logins, no call first.

Store, name, email and phone. A person replies from a real inbox. Privacy

Get your free growth plan