Submit Your Article Forum Rules Search
WebProWorld
Register FAQ Calendar Mark Forums Read


Search Engine Optimization Forum SEO is much easier with help from peers and experts! The WebProWorld SEO forum is for the discussion and exploration of various search engine optimization topics. Any non (engine) specific SEO or SEM topics should go here.

Share Thread: & Tags

Share Thread:

Reply
 
LinkBack Thread Tools Display Modes
  #1 (permalink)  
Old 01-29-2005, 05:49 AM
WebProWorld New Member
 
Join Date: Jul 2004
Posts: 14
GnnC RepRank 0
Default Googlebot using too much bandwidth

We have a situation currently where Googlebot is doing an amazing amount of activity on one of our websites, to the tune of 30-40 M per day. I am at a loss to understand why
this is occuring, and hope you have some idea.

The only idea I have to stop it is to add a robots.txt to ban GoogleBot from the site.
Reply With Quote
  #2 (permalink)  
Old 01-29-2005, 05:54 AM
cbp cbp is offline
WebProWorld 1,000+ Club
 
Join Date: Oct 2003
Posts: 4,938
cbp RepRank 1
Default

The critters are very active at the moment:
http://www.webproworld.com/viewtopic.php?t=37372

Google suggest:
Quote:
8. Help! Googlebot is crawling my site too fast. What can I do?

Please send an email to googlebot@google.com with the name of your site and a detailed description of the problem. Please also include a portion of the weblog that shows Google accesses, so we can track down the problem more quickly on our end.
http://www.google.com/intl/en/webmas...q.html#toofast

CBP
Reply With Quote
Reply

  WebProWorld > Search Engines > Search Engine Optimization Forum

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are On
Pingbacks are On
Refbacks are On



All times are GMT -4. The time now is 04:55 PM.



Search Engine Optimization by vBSEO 3.3.0