Hi, I recently read a guide from Yoast SEO and crawl budget grabbed my attention. From their site:
Pros and cons of using robots.txt Pro: managing crawl budget
It’s generally understood that a search spider arrives at a website with a pre-determined “allowance” for how many pages it will crawl (or, how much resource/time it’ll spend, based on a site’s authority/size/reputation), and SEOs call this the crawl budget. This means that if you block sections of your site from the search engine spider, you can allow your crawl budget to be used for other sections.
How accurate is this? It would benefit me if my homepage gains more attention from crawling bots, as I have a domain score of 1. Do you advise me to add <meta name="robots" content="noindex,nofollow"> to my other pages if my home stands out?
I would like to hear your thoughts!
[link] [comments]
from Search Engine Optimization: The Latest SEO News https://www.reddit.com/r/SEO/comments/j4250j/serp_crawl_budget/>
No comments:
Post a Comment