This is the first sitemap I’ve had to create for a very large website. Using Screaming Frog. To try and keep it simple we are only including folders that are high priority. Home page plus 7 folders. 2 of the folders aren’t being crawled at all. Trying to determine why. The site navigation isn’t the best (which will hopefully be addressed in the future). Are the folders possibly not being crawled because there is currently no internal navigation leading to the folders? I’m just a bit stumped as to what else it could be. The folders don’t require a login. I can do a site: search on Google and see that they’re already indexed. So they’re not being blocked on the backend.
[link] [comments]
from Search Engine Optimization: The Latest SEO News https://www.reddit.com/r/SEO/comments/docmsj/creating_sitemap_for_large_site_only_including/>
No comments:
Post a Comment