iEntry 10th Anniversary Forum Rules Search
WebProWorld
Register FAQ Calendar Mark Forums Read
Web Programming Discussion Forum Working with an API? Developing a plugin? Writing a Mod or script for your favorite blog, Web 2.0 site or Forum? Welcome.

Share Thread: & Tags

Share Thread:

Reply
 
LinkBack Thread Tools Display Modes
  #1 (permalink)  
Old 10-01-2004, 07:23 PM
WebProWorld New Member
 
Join Date: Jun 2004
Location: Phoenix
Posts: 4
mwenn1 RepRank 0
Default spider tracking with asp?

does anyone know of any ASP code that will track spiders? I have found other languages but nothing in ASP.
Reply With Quote
  #2 (permalink)  
Old 10-01-2004, 08:45 PM
WebProWorld Member
 
Join Date: Sep 2004
Location: Idaho
Posts: 40
MHenscheid RepRank 0
Default

I use key words that appear in: request.ServerVariables("HTTP_USER_AGENT")

I convert the returned value to lower case and check for the following: (text, corresponding bot)
scooter,AltaVista
googlebot,Google
slurp,Inktomi
lycos_spider,Lycos
gulliver,Northern Light
infoseek sidewinder,Infoseek
architextspider,Excite
msnbot,MSN

I have not had this implemented long enough to determine if all of them work. I have seen MSN, AltaVista and Google run through though.
Reply With Quote
Reply

  WebProWorld > Webmaster, IT and Security Discussion > Web Programming Discussion Forum

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are On
Pingbacks are On
Refbacks are On



All times are GMT -4. The time now is 04:07 AM.



Search Engine Optimization by vBSEO 3.3.0