Yahoo Spider. When?

[bbilou]

Does Yahoo perform regular crawls of a site, and if so does anyone know when the next one is?

[incrediblehelp]

If you have a IBL to your website from a website that is indexed by Yahoo, you should expect the Yahoo crawler (Slurp) to visit you soon.

[juliemarg]

How do you check whether they've spidered you?

(sorry, I know I'm supposed to already know this, but I can't find the directions)

[incrediblehelp]

It is in your raw logs or stat program/software provided by your hoster. Do you have access to either of those?

[juliemarg]

I don't think so. I'm hosted at blogger.com. I have tracking software from www.sitemeter.com.

I only know that occasionally (very occasionally), I get vists from yahoo searchers.

2,418 google.com 60.5%
846 Not referred from a search engine 21.2%
410 search.msn.com 10.3%
56 search.yahoo.com 1.4%
42 google.co.uk 1.1%
37 google.ca 0.9%
19 google.com.au 0.5%
15 search.comcast.net 0.4%
11 google.de 0.3%
8 search.earthlink.net 0.2%
8 google.nl 0.2%
7 google.fr 0.2%
6 search.sympatico.msn.ca 0.2%
6 search.netscape.com 0.2%
6 google.com.mx 0.2%
5 search.msn.co.uk 0.1%
5 google.com.ar 0.1%
5 google.co.in 0.1%
4 search.hp.netscape.com 0.1%

[incrediblehelp]

Well you would need access to your webstats in some way to know if Slurp is visiting.

[crush123]

do you modify your content often?
then look for the cache of your site in search engines and if that is the latest one, it means that that search engine has crawled your site recently.
oterwise, it has not.
build more incoming links so that search engines may crawl more often

[incrediblehelp]

Don't worry so much about the cache from the search engines because that can be inaccurate. Check your raw logs for when the search engines spider your website.

Their are a few tools out there that can give you in-depth analysis of spider activity like CrawlTracks or Robot Manager 3.0

[lourdes]

Wao!!That is incredible to know..