PDA

View Full Version : Yahoo Slurp


Fredwat
10-08-2004, 02:58 PM
What is the coding for no index for specifically Google and Yahoo!. Isn't there a way to prevent one or the other from coming to your site?

Thanks
tcampione
10-08-2004, 06:57 PM
The full database is available at: http://www.robotstxt.org/wc/active/html/index.html

Slurp is #224 (Inktomi Slurp)

user agent is slurp

/*tom*/