cjshu
12-12-2003, 12:56 PM
What is the correct way to construct the robot.txt tag?
flood6
12-12-2003, 01:18 PM
This is my favorite robots.txt tutorial:
http://www.searchengineworld.com/robots/robots_tutorial.htm
Then when you're done, you can have it validated here:
http://www.searchengineworld.com/cgi-bin/robotcheck.cgi
Hope that helps...