View Single Post
  #6 (permalink)  
Old 02-28-2008, 05:55 PM
wige's Avatar
wige wige is online now
Moderator
WebProWorld Moderator
 
Join Date: Jun 2006
Location: United States
Posts: 2,661
wige RepRank 9wige RepRank 9wige RepRank 9wige RepRank 9wige RepRank 9wige RepRank 9wige RepRank 9wige RepRank 9wige RepRank 9wige RepRank 9wige RepRank 9
Default Re: Would I be blocking Google?

Quote:
Originally Posted by business-directory View Post
Wige; cheers - I have to ask, do you have proof to back up your statement that spiders are stateless? I want to believe you, but it will mean that I'll have to come up with something else to stop email harvesters from access (
The only way to prove it would be to set up your logs to show the cookies contained in requests, and you will note that the spiders never send a request containing a cookie, which is the mechanism that maintains state. (The web is really stateless, the only way to simulate state other than AJAX is with cookies) In addition, if you use sessions, a session will typically expire before the next visit of a spider.
__________________
The best way to learn anything, is to question everything.
Reply With Quote