Quote:
Originally Posted by timmathews.com
...I know bandwith is expensive when you don't host your own sites from a datacenter or the like, but if spiders are crawling the crap out of your site, it is for a reason.
I let them go.
|
I second the motion. I believe spiders are visiting our sites for a number of reasons and one of them is to list us in the directories etc. I usually try to find out where they came from and then see what they're about...most of the time they've got me on their site. : )