PDA

View Full Version : Google: Subdomain duplicate Content



kruser
09-02-2007, 12:24 PM
Hello,

Is there a way to hide a directory so that search engines like google will not see duplicate pages when using a sub domain?
As an example if the main site has a directory somesite.com/sub_domain_directory/index.html
and the sub domain sub_domain.somesite.com points to somesite.com/sub_domain_directory/index.html .
How do you hide the somesite.com/sub_domain_directory ?
Or is this not a concern?

Best Regards,
Randy

Webnauts
09-02-2007, 11:34 PM
With robots.txt: The Web Robots FAQ (http://www.robotstxt.org/wc/faq.html)

wige
09-04-2007, 10:23 AM
Are you trying to hide the directory from the search engines, or should that directory not be accessible to anyone except through the subdomain? I recently did something similar on my main site, purely to make FTP uploads easier, and blocked the entire directory through htaccess.
<Directory /somedirectory>
Order deny,allow
Deny from All
</Directory>

Webnauts
09-04-2007, 07:00 PM
Create a text file calling it robots.txt adding the following information, and then add it in your main folder your server:


User-agent: Googlebot
Disallow: /sub_domain_directory

User-agent: Slurp
Disallow: /sub_domain_directory

User-agent: MsnBot
Disallow: /sub_domain_directory

User-agent: *
Disallow: /sub_domain_directory