Thread: Errors of robots.txt unreachable in google webmaster sitemap
View Single Post
  #2 (permalink)  
Old 08-29-2008, 05:26 PM
incrediblehelp's Avatar
incrediblehelp incrediblehelp is offline
WebProWorld 1,000+ Club
WebProWorld MVP
  
Join Date: Jan 2004
Location: Live in Cincy Now
Posts: 7,573
incrediblehelp RepRank 4incrediblehelp RepRank 4incrediblehelp RepRank 4incrediblehelp RepRank 4incrediblehelp RepRank 4
Default Re: Errors of robots.txt unreachable in google webmaster sitemap
Because all the bots look for a robots.txt everytime they go to a website. Why not just add one?
Reply With Quote