WebProWorld Part of WebProNews.com
Page One Link To Us Edit Profile Private Messages Archives FAQ RSS Feeds  
 

Go Back   WebProWorld > Search Engines > MSN Search Discussion Forum
Subscribe to the Newsletter FREE!


Register FAQ Members List Calendar Arcade Chatbox Mark Forums Read

MSN Search Discussion Forum Topics and discussions specific to MSN and/or Live Search. There is also a subforum for the discussion of Microsoft AdCenter.

Reply
 
LinkBack Thread Tools Display Modes
  #1 (permalink)  
Old 09-12-2004, 02:06 AM
deen deen is offline
WebProWorld New Member
 

Join Date: Sep 2003
Location: New York
Posts: 1
deen RepRank 0
Default wondering MSNbot not crawling in www.fredbelaywatches.com

Hi, I have few websites maintained by me which has a very good tremendous amount of natural traffic and my web statistic report shows the day and time the crawlers visit every day.
www.impulsenovelties.com
www.unitedjamaath.com
www.impulsewatches.com has a very good traffic, MSNBOT & googlebot & inktomi visits almost every day same as other spiders too.

I have another website http://www.fredbelaywatches.com which is crawled by google almost every day. The surprise is google started crawling very soon after (with in few days)I hosted this website.
The question I want to ask you all is,
  • Why is the google bot just crawling the index page every and not the other page?
    Why is my google list always in second position for the kewword "fred belay" though the other website ranking in first position shows the last crawled date as August 2 2004?
    How can I let the MSNBOT know about the presence of http://www.fredbelaywatches.com, I had already placed my links on those websites where I see the MSNBOT crawling almost everyday.
The following is the recent visit statistics of one of my website as of 12 Sep 2004 - 00:07.
MSNBot
1686 Hits
18.95 MB
11 Sep 2004 - 23:02

Googlebot (Google)
491 Hits
6.30 MB
12 Sep 2004 - 00:06

InternetSeer
239 Hits
77.31 KB
11 Sep 2004 - 23:45

Inktomi Slurp
195 Hits
3.05 MB
11 Sep 2004 - 23:56

Alexa (IA Archiver)
96 Hits
1.62 MB
08 Sep 2004 - 06:48

Unknown robot (identified by 'crawl')
94 Hits
324.69 KB
09 Sep 2004 - 23:32

IBM_Planetwide
32 Hits
205.60 KB
08 Sep 2004 - 23:51

WISENutbot (Looksmart)
18 Hits
242.75 KB
10 Sep 2004 - 18:42

Pompos
5 Hits
113.83 KB
01 Sep 2004 - 10:44

GigaBot
5 Hits
105.65 KB
07 Sep 2004 - 11:47

Please guide me to solve this.

Thanks
Deen
__________________
<a href="http://www.fredbelaywatches.com/products/LeatherBand/Regular--Band/Mens--Watch--1.htm">
Fred Belay Leather band wrist watches</a>
Reply With Quote
  #2 (permalink)  
Old 09-30-2004, 11:28 AM
bhartzer bhartzer is offline
WebProWorld 1,000+ Club
 

Join Date: May 2004
Location: Dallas, Texas USA
Posts: 1,551
bhartzer RepRank 1
Default

At this point, I wouldn't be too worried about MSNbot not visiting your site. In fact, I personally don't allow MSNBot to crawl my sites because their search engine is not really ready yet and they're not sending me traffic.

I cannot justify letting a search engine that doesn't exist chew up all the bandwidth I have available to me. They're not sending me traffic, they're not making me money, so why should I spend money on bandwidth to allow them to spider my sites?
__________________
Bhartzer Blog
Reply With Quote
  #3 (permalink)  
Old 10-08-2004, 10:44 AM
sfowler's Avatar
sfowler sfowler is offline
WebProWorld Veteran
 

Join Date: May 2004
Location: Vienna, Austria
Posts: 967
sfowler RepRank 0
Default

MSN spend half the day wandering about my site as well. I have no problems with bandwidth at hte moment (unfortunately!), but if it was an issue I might block them.
__________________
Simon - Biogas, Rauchgasanalysator and Rauchgasanalysegerät
Reply With Quote
Reply

  WebProWorld > Search Engines > MSN Search Discussion Forum
Tags: crawling, msnbot, wondering



Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

vB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are On
Pingbacks are On
Refbacks are On



Search Engine Friendly URLs by vBSEO 3.0.0