Crawl

[sjk]

Hey all,

Maybe it’s just me, but I've noticed Google chomping at my sites (more than one) over the last 24 hours. I'm not trying to start a big debate thread about PR Update (as there are plenty of heated threads on that already :o), just noticed it in my logs and though maybe others may have noticed the same thing. GOOGLEBOT has been indexing all my sites relentlessly for the past 24 hours straight; page after page after page. Does that signify anything important? Usually they hit me in an overnight process in the middle of the night (*sigh* oh, say around 11PM EST) and only pull a few KB worth of pages. It seems like they have crawled all pages of all my sites. Just thought I'd throw that out there and see what others have to say, maybe others have experience with seeing this happen and might know what usually occurs after such an event.

[bhartzer]

The more often you update your web pages the more often Googlebot will visit your site. Google is constantly updating, so there's never really a major "update" like we have had previously.

[sjk]

Hi bhartzer,

Thanks for the reply. You know, I made some major changes with the titles and text. Googlebot hit my index page and one other each night for about a week after all the changes (as normal). Then - after about a week, it sarted crawling all the pages. So I guess it waits a while or something. Naturally I didn't associate the updates from a week ago with the crawl but I guess that's just how they do it; I'll have to keep that in mind.

Thanks!

[bhartzer]

The more often you update your pages the more they will be crawled.