Questions about robot.txt

[csutoras]

If you don't have anything private, what is the purpose of having a robot.txt...

Any added value for having one?

Thanks

[stymiee]

They are used to tell web crawlers what files they cannot crawl. Having one does not boost your rankings in the SERPs.

[incrediblehelp]

Having one also avoids the search engines getting a 404 error everytime they look for one.