Bingbot and Googlebot are ignoring the HSTS header. I verified that the header is being sent, but both bots continue trying to crawl urls using HTTP.
Bingbot continues trying to access urls I deleted more than 3 years ago. And Googlebot continually tries accessing /ads.txt, which never existed.
Can I (and should I) do something about this?
[link] [comments]
from Search Engine Optimization: The Latest SEO News https://www.reddit.com/r/SEO/comments/hwzzyq/bingbot_and_googlebot_ignoring_hsts_header_and/>
No comments:
Post a Comment