Sunday, April 4, 2021

How to change robot.txt and crawl through CMS Website?

So I work with a client who has CMS website and wanted to track its performance and keywords

That CMS website is so rigid that they dont have any optimization settings

So the last time I check, robot.txt disallow any crawling attempt to the CMS website

I wanted to crawl with external SEO tools, to perform the keyword strategy better. But couldnt find any setting related inside it.

Is there any way to solve this? I tried to contact the Developer support but they wont answering

Thanks in advance

submitted by /u/Slow_Huckleberry408
[link] [comments]

from Search Engine Optimization: The Latest SEO News https://www.reddit.com/r/SEO/comments/mjxu3p/how_to_change_robottxt_and_crawl_through_cms/>

No comments:

Post a Comment