msn search robot

[PhillipH]

this lil dude was quick to come to my websites. i only registered a couple of days ago, maybe coincidence. It just begs the question whether paying for an index is wise.

Guest 4 18 Oct 2004 at 1:05am 18 Oct 2004 at 1:26am 21 minutes Search Robot MSN

[bhartzer]

The MSN bot is definitely being very aggressive. I've actually stopped it from indexing certain sites because of it being overly-aggressive, chewing up bandwidth on certain sites. I'm not going to let MSNBot spider certain sites until their search is available to the public.

[sfowler]

I agree. I do not yet have a problem with bandwidthe (more's the pity!), but MSN will be the first to go if it becomes an issue.

[jawn_tech]

I agree too. Go public, then we'll dance.

When it does become public, I'm glad their spider makes more frequent rounds though than Yahoo. I don't see Y as often for some reason.