Ironic...I just posted in the "chelseasofnewyork.com" thread about LinkManager. But they are not being deceptive. Stupid maybe. Why they setup their directory structure this way is really dumb. The directories listed to disallow in the robots.txt file are the configuration directories as you stated in your followup. They allow the user to choose whether to use this on-site home or FTP to a local directory on their web-server. So the ones listed in the robots.txt file are those hosting the files themselves therefore the directories are secured from being indexed.
Jim
__________________
Jim Starkweather
Webmaster - Armorama.com
|