View Single Post
  #5 (permalink)  
Old 03-13-2007, 06:33 PM
Dubbya's Avatar
Dubbya Dubbya is offline
WebProWorld 1,000+ Club
WebProWorld MVP
 
Join Date: Nov 2006
Location: Steinbach, Manitoba, Canada
Posts: 1,300
Dubbya RepRank 4Dubbya RepRank 4Dubbya RepRank 4Dubbya RepRank 4Dubbya RepRank 4
Default

There are a couple of other methods to do a bulk "delisting", one of them being via a robots.txt file.

It's my understanding that this is not the best method. Apparently, using the "noindex" may not work as intended since, from what I can tell, Googlebot keeps looking for the page to see if the "noindex" is there, thus perpetuating the file not found error.

I have not tried this, so can't say with absolute certainty that this is in fact the case, but wouldn't be at all surprised. We're talking about Google here.

I'd appreciate knowing if the robots.txt method proves successful, so if anyone tries it, please give us the "heads up".
Reply With Quote