spider tracking with asp?

mwenn1 · #1 (**permalink**) 10-01-2004, 07:23 PM

does anyone know of any ASP code that will track spiders? I have found other languages but nothing in ASP.

MHenscheid · #2 (**permalink**) 10-01-2004, 08:45 PM

I use key words that appear in: request.ServerVariables("HTTP_USER_AGENT")

I convert the returned value to lower case and check for the following: (text, corresponding bot)
scooter,AltaVista
googlebot,Google
slurp,Inktomi
lycos_spider,Lycos
gulliver,Northern Light
infoseek sidewinder,Infoseek
architextspider,Excite
msnbot,MSN

I have not had this implemented long enough to determine if all of them work. I have seen MSN, AltaVista and Google run through though.