View Single Post
  #1 (permalink)  
Old 01-02-2008, 07:37 AM
Ozzman Ozzman is offline
WebProWorld Member
 
Join Date: Mar 2007
Posts: 61
Ozzman RepRank 0
Post How to stop Google from crawling secure content/directory?

My post title is clearly stating about my question . But lets repeat it. How can we stop google bots to crawl through a secure (not-willing-to-share) information from one of the website's directories.

Can we use robots.txt for this or you may suggest any other better treatment for this?

If Google crawls any secure information from a website content and shows it in seacrh engines then what can we do to let this information disappeared from Google search results?

Your co-operation is appreciated in adavance.
Reply With Quote