Wow! Googlebot spidering my site ALL DAY!

[freelancemom]

I'm not kidding, I've never seen anything like it :D

For hours Googlebot 2.1 has been spidering my site and forum. The site isn't THAT big...

A few weeks ago I submitted my xml sitemap and expected some action -- but not like this!

Any other such sightings out there?

Lori

[ADAM Web Design]

I've seen that happen a few times before where Google does a deeeeeeeeeeeeeeeeeep crawl and often goes over things a few times.

This FAQ might help you if you follow the contact link and let them know what's going on. It's not a common thing, but it's not completely unheard of either. I've had to do it once or twice.

[freelancemom]

Thanks -- so you think I should contact Google about it then? They are still there now even - so it has almost been 24 hours.

Lori

[ADAM Web Design]

I would. Let them know what's up.

[freelancemom]

Well, I let them know yesterday. Didn't hear a reply.

The bot did actually leave for awhile, but came back early evening and is still there now.

Not complaining :) Just astonished!

[freelancemom]

It hasn't left yet... I'm wondering if my site broke Google :)

Here are my bot stats for this month:

12 different robots Hits Bandwidth
Googlebot 254572 7.69 GB
MSNBot 1640 58.23 MB
Inktomi Slurp 494 11.18 MB
WISENutbot 113 3.03 MB 08
Unknown robot 90 1.91 MB 08
Unknown robot 87 2.29 MB
Unknown robot 29 713.50 KB
Alexa (IA Archiver) 14 576.91 KB
AskJeeves 10 390.57 KB
Walhello appie 4 96.75 KB
LinkWalker 2 0
Voila 1 39.15 KB

Is anyone else seeing anything like this happening?

[gsecur]

I think something is wrong, the Google bot never leaves my site, and even then it never generates that much bandwidth. Max I have had was 10gb in the month.

[steve_avs]

I have noticed that Google is spidering a lot more pages than it used to. Last weekend it spidered over 12,000 pages or about 1/4 of my total pages. Thats by far the most I've ever seen. Maybe they added more spiders?

Steve

[ATK]

I understand the importance of the bots and can see the benefit of checking bot activity but how in Gods name do I check bot activity for my site??

Any help would be much appreciated!

[ATK]

I understand the importance of the bots and can see the benefit of checking bot activity but how in Gods name do I check bot activity for my site??

Any help would be much appreciated!