Thread: Duplicate content penalty?!?!
View Single Post
  #8 (permalink)  
Old 01-03-2007, 01:56 PM
incrediblehelp's Avatar
incrediblehelp incrediblehelp is offline
Moderator
WebProWorld Moderator
  

Join Date: Jan 2004
Location: Live in Cincy Now
Posts: 7,702
incrediblehelp RepRank 4incrediblehelp RepRank 4incrediblehelp RepRank 4incrediblehelp RepRank 4
Default
Yes but what if the freeweb has a robots txt in the home folder? The spider will listen to the instructions in the home directory first, then subfolder second, if it sees conflicting commands.
Reply With Quote