Wordpress Privacy Setting - Keeping The Search Engines Away

[iceman007]

I noticed that wordpress by default has your privacy settings set to "private" which hides it from search engines.

I was wondering if anyone knows how if it really blocks search engines from visiting and indexing your wordpress site?

[danlefree]

It adds the following robots.txt file:


User-agent: *
Disallow: /

... and yes, that will block all the reputable search engines.

[thersey]

You can also give the indexing instructions in the http header without using a robot.txt file. The advantage is higher privacy to your website.

Add X-Robots-Tag: noindex to the http header.