Our client, a large national chain, suspected they weren’t efficiently capturing their target audience’s attention and traffic as well as they could.
While users could filter pages based on product attributes like brand, color, or size, allowing search engines to crawl pages with each combination of attributes was not an option, as it would mean crawlign a huge number of low value, unoptimized pages that would eat up their crawl budget and create massive duplication issues. On the other hand, blocking crawling of these pages would result in vast lost opportunity where they have the products users want, but would not show up in search results.