Quote:
|
Originally Posted by thecat
why can they list a website on their search engine without permission from the website owner?
|
Erm, lol, your signature......is that your site? if so why put it there if you dont want SE's to pick it up? :D
Robot text file:
Call it robots.txt, and put:
User-Agent: *
Disallow: /
save & upload it in your root directory......
Bingo......
most SE's will will not crawl your site.