MSNBot Question

sgsmorgan · #1 (**permalink**) 01-30-2008, 08:04 AM

Hi Gang

Just looked at my weblogs for one of my domains and looking at the AWStats I noticed that it had picked up MSNBot as well as MSNBot-media. Anyone know what the difference is?

Cheers

Steve

**wige** · #2 (**permalink**) 01-30-2008, 10:04 AM

As far as I know, it is for MSN/Live Media Search. The little bit of research I have done after seeing the bot in my own logs indicates it is not very well behaved. It is aggressive and does not play well with servers. It ignores rate limiting tags and sometimes bypasses or does not parse robots.txt. I have seen a lot of posts on various forums about webmasters banning it.