Friday, January 3, 2020

How to create robots.txt for Yandex & SEMrush bots?

I want to disallow following page for Yandex & SEMrush bots:

/book/my-spiritual-life-book/

Please tell me how to write robots.txt file for above condition.

submitted by /u/Rlogical_Techsoft
[link] [comments]

from Search Engine Optimization: The Latest SEO News https://www.reddit.com/r/SEO/comments/ejc75r/how_to_create_robotstxt_for_yandex_semrush_bots/>

No comments:

Post a Comment