iEntry 10th Anniversary Forum Rules Search
WebProWorld
Register FAQ Calendar Mark Forums Read
Search Engine Optimization Forum SEO is much easier with help from peers and experts! The WebProWorld SEO forum is for the discussion and exploration of various search engine optimization topics. Any non (engine) specific SEO or SEM topics should go here.

Share Thread: & Tags

Share Thread:

Reply
 
LinkBack Thread Tools Display Modes
  #1 (permalink)  
Old 08-22-2005, 04:30 PM
WebProWorld 1,000+ Club
 
Join Date: Dec 2004
Posts: 11,007
WPW_Feedbot RepRank 0
Default MSN Says We'll Slow Down The News & Feed Crawling

Yahoo's Jeremy Zawodny noticed that MSN Search seemed to be overactively hitting his RSS feed, prompting MSN Search to respond via its blog that the news and blog crawler in testing may have been a tad hyperactive. MSN promises some tuning to get it to behave. FYI, MSNBot does have instructions you can use to tell it to slow down, something put in place soon after the main web crawler prompted some complaints last year, when it was a bit hyperactive. It's unclear whether the news/blog/feed crawler is using the same robot name and thus responding to the same commands....

Read more...
Reply With Quote
Reply

  WebProWorld > Search Engines > Search Engine Optimization Forum

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are On
Pingbacks are On
Refbacks are On



All times are GMT -4. The time now is 10:46 PM.



Search Engine Optimization by vBSEO 3.3.0