Hey,
My site is being crawled by the following bots
semmrush bot
ahrefs robot
opensiteexplorer dotbot
google bot
Should i block these crawlers from accessing my site? Why? Which ones?
[link] [comments]
from Search Engine Optimization: The Latest SEO News https://www.reddit.com/r/SEO/comments/et5vkw/should_i_block_some_crawlers_from_crawling_my_site/>
No comments:
Post a Comment