View Full Version : How to get Spidered and Indexed by MSN?
shilmy
03-09-2005, 08:56 AM
Hi,
My site, designerbags.info, got spidered almost everyday by msnbot, and the index are updated almost immediately (especially the homepage).
But msnbot seems never crawled my others site. I already submit the site to MSN, put a link on designerbags.info homepage and my others website. But it still do not crawled my sites.
Any idea on how to be spidered by MSN?
Regards,
Sjarief
chiron
03-14-2005, 03:49 AM
MSN (and all the rest) are a tricky lot sometimes. It is possible, since designerbags is itself rather new and in the crummy penalty box phase (0 PR, etc) that you are not seeing a deeper link run from bots to your second site based on that.
I could be wrong, but you might consider having a friend or business partner/affiliate with an established site link to your second site, and my guess is you'll see it indexed within 30 days.
Just wait a bit longer. My new site ( launched jan '05 ) gets indexed after more than one month. Not just on MSN but on google too ( took 2 months before it gets indexed ). When did you submit your site to msn?
shilmy
03-15-2005, 04:23 AM
May be you are right, patience is the key here. I submit to MSN about 2 weeks ago.
But, seeing MSNbot crawling everyday to my site (designerbags.info) and update the index, got me to think that may be I should take advantage of it, by puting link to my other sites. ...but the bot didn't take the bait.
Regards,
Sjarief
TrafficProducer
03-15-2005, 05:43 AM
MSN Beta, ( yes it appears to still work ), submit may help you get Crawled:-
http://beta.search.msn.co.uk/docs/submit.aspx?&geovar=76
shilmy
03-15-2005, 06:32 PM
MSN Beta, ( yes it appears to still work ), submit may help you get Crawled:-
http://beta.search.msn.co.uk/docs/submit.aspx?&geovar=76
You're probably right, I remember submitted designerbags.info when MSN is still in beta. It get crawled and indexed not long after that.
tomzo
04-01-2005, 09:34 AM
The best way to get spidered is to simply submit your website to as many directories as possible. Search engines will index your pages through backlinks form other sites.
DMC_34
04-01-2005, 01:45 PM
Find a site which ranks well on MSN for your given keyword. If you can get a link from it, this is a sure way to get indexed and daily by MSN. I bought a link from MSN's #1 listing for a holiday. I am now indexed daily as well as ranking in the top 20 for that keyword with just one link and content on a site that less than 2 months old.
randy776
04-13-2005, 11:47 AM
I don't think there is any sure way to get spydered! I have a site that has been a PR6 in Google (now a 5), it shows over 8,000 backlinks in Yahoo, and 2,645 in MSN. The site is an extremely popular heavy traffic site - getting over 200,000 searches a month from google alone.
I have tried every way possible to get spydered by MSN to no avail. I contacted support and they said I was not being penalized and that I should submit the site vis their submission form. Still no MSNBOT.
Ironically, I have 30+ other sites and none of them have been spydered. Yet I designed a new site for a friend the other day, loaded it on the same server and it was spydered and in the index within a week.....weird stuff!!
wavedancing
04-20-2005, 11:24 PM
I believe the best way to get spidered is to put an link on some site visited frequently by search engines. I have a site visited almost everyday by google. So every time I build a new site, I put a link there. Usually it will be spidered in the next day.
shilmy
04-21-2005, 03:46 AM
I believe the best way to get spidered is to put an link on some site visited frequently by search engines. I have a site visited almost everyday by google. So every time I build a new site, I put a link there. Usually it will be spidered in the next day.
Unfortunately, that's not the case with MSN. As I've mentioned in first post in this thread, I've done this, but until now my site still not spidered.
Regards,
Sjarief
randy776
04-21-2005, 03:37 PM
LIkewise here. As I said earlier I have a site that has about 3,000 backlinks in MSN, but my site is site is not spydered either.
The site is extremely well represented in all other search engines but MSN has ignored it and all of my other sites.
wavedancing
04-25-2005, 11:48 PM
Unfortunately, that's not the case with MSN. As I've mentioned in first post in this thread, I've done this, but until now my site still not spidered.
Regards,
Sjarief
Have you tried to put the link on a relavent page?
randy776
04-26-2005, 09:40 AM
Have you tried to put the link on a relavent page?
I am guessing at least a few of those 3,000 backlinks that my site has are relevent. :-)
Not to beat on this point, but I am really puzzled on what could possibly be the reason a site like mine could be overlooked.
I am not being egotistical, but with all of those backlinks in the index, literally tens of thousands of pages in the site, no penalty in place (according to MSN Support), and millions of pages views a month, hundreds of thousands of google searches!
How can MSN be an effective search engine if it misses sites like this. And can't provide a reasonable explanation as to why....?
Realistically this is the first time I have ever faced a major search engines that I can;t even get in. Google has it's quirks like the sandbox, and page rank fiasco, BUT I can get any page I want IN the Google index in a matter of days. Same with Yahoo. But, MSN has yet to provide me an explanation as to how I can crack their index,
26 sites
Combines 10,000+ MSN Backlinks
Millions of visitors
Over 100,000 pages
Total pages indexed by MSN = O
wrmineo
04-27-2005, 09:41 AM
... spidered almost everyday by msnbot, and the index are updated almost immediately (especially the homepage)... seems never crawled my others site ... Regards, Sjarief
These are all valid points, and I hate to seem elementary, but you may be overlooking something more simple in the way of approaching a solution.
Play the "what's different" game and you may find your answer(s) without beating yourself up with a plethora of potentials ...
Does the second site have:
robot.txt file in the domain root?
DocType declarations and (W3C) valid code?
correct meta's for robot index follow revisit?
You may have already done this, but sometimes it's the simple solutions most oft overlooked.
Good Luck ~ Happy Surfing