Googlebot visits

[w-gresse]

Hi Guys, a couple of questions please:

1. How regularly does Google spider websites?
2. Does it cover the whole world in one go, or region by region?
3. Is there an easy way to check/monitor when Google has paid you a visit, than having to look at your cached pages for currency?

Many thanks, William

[minstrel]

Originally Posted by w-gresse

1. How regularly does Google spider websites?

That depends on the site - sites with more frequent updates or higher PR get spidered more often.

2. Does it cover the whole world in one go

No... only Santa Claus can do that. Googlebot does it one site at a time.

3. Is there an easy way to check/monitor when Google has paid you a visit, than having to look at your cached pages for currency?

Look in your web server logs for googlebot.

[w-gresse]

Thanks Minstrel,

What I meant by:

2. Does it cover the whole world in one go?

Do they start somewhere, e.g. once a month and then let the spidering continue till all (targeted) sites are covered? Do they start the spidering at different places in the world, at different times, etc.

Rather trivial questions I guess, but would be interesting to know.

William

[adore]

Spidering is a constant process and you cannot say where it starts or when it's finished. It's something like robots go through Internet and index pages they meet. After indexing a page, they go through one of available links to another page and continue to index, and so on...

[calebtheredwood]

Originally Posted by w-gresse

3. Is there an easy way to check/monitor when Google has paid you a visit, than having to look at your cached pages for currency?

Is this why there is a date posted after my site listing on Google? Why does it show a new date about every two or three days? Am I getting spidered that often? If so, is that a good thing?

[minstrel]

re: cached pages

Originally Posted by calebtheredwood

Is this why there is a date posted after my site listing on Google? Why does it show a new date about every two or three days? Am I getting spidered that often? If so, is that a good thing?

yes. yes. and yes.