Wednesday, January 29, 2020

Indexed but Blocked by Robots.txt

I have an issue with a large E Commerce site whereby millions (yes, Millions!) Of long URL strings are being picked up by Search Console as Indexed But Blocked by Robots.txt.

These strings contain thousands of possible variations of filterable attributes in our Amasty Improved Navigation bar. These attributes are set up as URL parameters in SC, but are still being indexed. We want the core categories / brand pages to be indexed, but not when filters are applied. These are for navigation and UX.

I'm at a loss as to why this i happening and some advice on how to resolve would be super appreciated!

submitted by /u/RichieHermetic
[link] [comments]

from Search Engine Optimization: The Latest SEO News https://www.reddit.com/r/SEO/comments/ew0udo/indexed_but_blocked_by_robotstxt/>

No comments:

Post a Comment