Re: How to stop Google from crawling secure content/directory?
The previous post has been very clear. Although I would add that if your pages are in a secure area, Google should not be able to get to those pages. Even if you include a noindex no follow directive, users could still get to those pages. You should implement a secure access via a password instead so that no SE and no undesidered users get to your private pages.
Last edited by mjtaylor; 01-02-2008 at 07:25 PM.
Reason: removing links not in sig
|