View Single Post
  #7 (permalink)  
Old 07-04-2007, 05:46 AM
hitchman hitchman is offline
WebProWorld New Member
 
Join Date: Feb 2007
Location: Essex, UK
Posts: 1
hitchman RepRank 0
Default Re: Slurp Chewing up 20+ gigs per Month per Site

I had problems last year with Slurp following an events calendar on one of our sites. Even though there were very few events listed it was finding all the links to dates, and previous/next month links, and had followed them through many decades past and future before I started to get bandwidth warnings on the site.

They did sort the problem out and replied very quickly. I suspect they may have just restricted crawling on that particular site though.
Reply With Quote