PDA

View Full Version : How often is Yahoo spidering?



BungleBob
07-10-2004, 05:00 AM
We've seen a recent increase in Yahoo traffic - though it still isn't performing like Google! - but Yahoo's index still never seems to be as fresh as the big G.

I'd be interested to know how often Y's spiders are visiting everybody's sites? (assuming you're NOT in the SiteMatch programme) We're seeing lower activity levels from Yahoo - can they really compete whilst their indexes aren't fresh?

So, couple of questions:
How quicky are new sites being picked up?
How regularly are they re-indexed/spidered?

ronniethedodger
07-10-2004, 08:37 AM
How quicky are new sites being picked up?

New sites? Don't hold your breath. Established sites with decent backlinks, expect sub-par performance.


How regularly are they re-indexed/spidered?

See above. Although, I have noticed some increased activity on both established and newer sites. Possibly they are getting their act together.

BungleBob
07-12-2004, 05:01 PM
Cheers - looks like we shouldn't be in too much hurry to see Yahoo overtaking Google yet!

bhartzer
07-13-2004, 11:56 AM
I see the Yahoo! Slurp spider every day on my sites. I do update them often, though. The more often you update a page the more it tends to come back to revisit your site.

sfowler
07-14-2004, 04:56 PM
My site is relatively new, about 8 weeks, and has just made it into the Yahoo! index. Google took about 4 weeks. MSN still has nothing. I also make regular changes, more than once per week, so I hope to see Slurp and colleagues more often in future.

clasione
07-16-2004, 01:19 PM
I've been seeing Slurp quite often on fresh content sites... About every day or so...