Quote:
Originally Posted by balix
...Or how to know about google robots work ?
|
For robots.txt: what this file does is tell the search engines (and in this case Google) which files or directories you don't want them to crawl.
There aren't a lot of people who use it to block content from the search engines and I don't use it that much either. The sites I work on never really have to worry about that.
The robots.txt file is something you can think about last.
Just sign up at Google's Webmaster Tools and go from there...we will help you...