Hey everyone,
The yahoo robot comes to my site looks at my robots.txt file then leaves my site. Can anyone give me some advice on this. My site was # 3 on the first page of Yahoo search for the term grandfather clocks, now it is nowhere to be found on Yahoo for this same term. This happened about a month ago. My robots.txt file is below, I do not see anything wrong with it.
__________________________________________________ ___
# robots.txt for
http://www.mikesthings.com/
User-agent: *
Disallow: /public_html/cgi-bin/
Disallow: /public_html/custom.html
Disallow: /public_html/test/
__________________________________________________ ___