Off limits.... googlebot only
Out of curiosity I want to test some robot code.
For a "Google only" site what robot code works best....
meta or robot.txt
Will "all" SE's really follow these street signs????
If one wanted Google to be the ONLY SE to spider a site .... how best to write the code?
|