Yes it can and it DOES!!
In my experience (recently) one of my HubPage got crawled in less than
1 n half hour. The page is about
super nintendo entertainment system or SNES
I agree that it may possible for with wiki and ugc (user generated content) websites. You will have to experiment buddy.
Apart from that, here is official Google statement:
Quote:
How often does Google crawl the web?
Google's spiders regularly crawl the web to rebuild our index. Crawls are based on many factors such as PageRank, links to a page, and crawling constraints such as the number of parameters in a URL. Any number of factors can affect the crawl frequency of individual sites.
|
Thank you