I have noticed AhrefsBot has been crawling my website like crazy today. Can I take this as a sign that one of my competitors is trying to analyze my website? I don't use Ahrefs, so can I just block them using robots.txt? Would that be advisable?
[link] [comments]
from Search Engine Optimization: The Latest SEO News https://www.reddit.com/r/SEO/comments/a0i5mf/ahrefsbot_is_crawling_my_website_like_crazy/>
No comments:
Post a Comment