Re: What is - Mozilla/5.0 (compatible; Googlebot/2.1; +http:
I was about to ask the same question... It appears to me that there has been a definite change in Googlebot lately. We are being hit heavily by Googlebot from new IP's like 66.249.6*.* rather than old 64.68.* and from what i see in logs, this seems to have a 'Freshbot' behavior.
All hits from Googlebot with 'Mozilla' inside seem to come at a slower pace and going a bit deeper. If that difference still exists, I think this should be some sort of equivalent of the former Deepbot.
Anyone else noticed this?
|