I work alot about my php skills last time ... somewhere in your pages you have to put ... long scripts that displays poor data for google spider ... some stuped example ... get time from
www.clock.com + your zodiacal sign count it and display your lucky number :P it's alot of writing and all that slowing access for spiders like googlebot I find a solution to refresh once page .. and output a public_html/cache/cached_page_from_last_refresh.txt that I am including in my pages ... the question that wondering me is for how exactly time googlebot crawls one of my pages .... probably most of users here know about WGET in linux ... i thing googlebot is something like wgeter :) that downloads the source code ... and after that the experts have to know how filter it .. this is not the question now ... the question is for tool like a "ping" in DOS but from google machines ... it's too complicated ... I've got lot of question like this but please excuse my
BAD ENGLISH CONTENT WARNING :)
cause I am sure that SERP rankings and quality of the sites factor is ... FAST ACCESS from the bots
best regards: Rudi