Google’s John Mueller confirmed that the GoogleProber and the GoogleProducer (which we lined right here) are each legit Googlebot person brokers and crawlers. “These are official Google requests with a user-agent particular to the Google Information config in Writer Heart so if they’re blocked the feeds you arrange could not work correctly,” John added.
John did admit there is a matter with one or each of those bots crawling an excessive amount of (both for his web site or on the whole). John mentioned, “We’ve got discovered a problem that has effects on you the place we’re making too frequent requests and this will probably be fastened shortly.” John additionally mentioned “We’ll additionally work on fixing the damaged info-link.”
Listed below are these tweets for extra context:
Hello @searchliaison @dannysullivan @JohnMu we’re seeing quite a lot of site visitors to writer’s websites with a brand new user-agent ‘GoogleProducer; (+https://t.co/5l7Fm3K043) ‘. Our WAF is at the moment blocking it, nevertheless it’s origin is definitely Google Proxy hosts. Is that this legit site visitors? Thanks! pic.twitter.com/twVlVI5gqJ
— Hernán Marsili (@hmarsili) January 31, 2023
Thanks, additionally, from the identical IPs now we have establish elevated exercise from GoogleProber UA. pic.twitter.com/J8eN3pRK32
— Hernán Marsili (@hmarsili) February 1, 2023
… We’ve got discovered a problem that has effects on you the place we’re making too frequent requests and this will probably be fastened shortly. We’ll additionally work on fixing the damaged info-link.
— johnmu is a rating issue and so are you 🐀 (@JohnMu) February 7, 2023
Discussion board dialogue at Twitter.
Replace: February tenth Google added it to the listing of supported Googlebots.
