Quote:
|
Originally Posted by Conficio
After all syndication is not as simple as the technology makes it. One still has to respect the copyright of the piece.
|
So your robots text file for all your websites look like this right:
User-agent: *
Disallow: /