ABOUT

Recently, I started working for a US-based Shopify website. I found Crawled but not indexed URLs to be a huge bottleneck. The website is tiny compared to some of the e-commerce websites I have worked on – it has at most 25 products!

However, it had more than 5.5K URLs in the “Not Indexed” section.

During my technical SEO audit, I noticed the Shopify-generated URLs were clogging up the crawl budget. After a short discussion, the developer and I updated the robots.txt file to block the parameter URLs.

In just two to three weeks, we got a massive boost in indexing and traffic:

Crawled – currently not indexed dropped from 5.5K to less than 3.5K
Indexed pages are up from just 340 to more than 1K – almost 200% up
Total Impressions are up from 1.7 K daily to 4.5K – about 160% up!
Total clicks up by more than 150%
It’s an early day for the client and me, but I am happy to show that a tiny change can bring excellent results!