How Google crawls a store with thousands of filtered URLs
A store looks simple to a shopper and enormous to a crawler. Every filter for size, color, brand or price, and every sort order, can produce its own URL. Google's guide to managing crawling of faceted navigation URLs explains the problem: crawlers can't tell whether a filtered URL is useful without fetching it, so they typically access a very large number of them. The time that takes is time they have less of for new, useful pages.
What Google recommends
- If filtered pages don't need to rank, block the filter parameters in robots.txt, while still allowing product pages and the unfiltered category page.
- If some filtered pages should rank, use the standard & separator between parameters, keep filters in a fixed order, and return a 404 for combinations with no results.
- Canonical tags help, slowly. Pointing filtered URLs at a canonical version may gradually reduce crawling, but Google calls this less effective over the long term than blocking.
Links tell Google what matters
Google's page on ecommerce site navigation structure says it looks at the links between pages, and the more links a page has pointing to it within a site, the higher its relative importance. It recommends linking from menus to category pages, from categories to sub-categories, and from there to products. If categories don't link to every product, a sitemap or a Merchant Center feed helps Google find the rest.
Product data in two places
Per Google's product structured data documentation, pages where customers can buy from you are eligible for merchant listings, which can show details such as shipping and return policies. You can supply the data through on-page markup, a Merchant Center feed or both. Google shows these enhancements at its own discretion. Our answer on what schema markup is covers the basics, and stores on Shopify have platform-specific rules covered under Shopify SEO.
