403- forbidden Error

[trancehead]

Hi,

Whenever I submit my site to yahoo i get a 403 - forbidden error. The site is accessible to browsers and directory browsing is turned off (it has to be it is n e-commerce site).

Very few of my pages are indexed in Yahoo or MSN but google doesn't have this problem as it is indexing pages just fine.

Any ideas what the problem might be?

[Webnauts]

I think you need a mod_rewrite for the shop.
That would make great sence if I got your question right.

[Keimos]

trancehead,

You have disabled view source, how the hell can we help if we cannot see.

Has something else been blocked in the process?

Keimos

[incrediblehelp]

You dont have to submit to search engines

[Webnauts]

Do you have a sitemap? Is that probably missing?
Here you can get one on the fly: http://www.xml-sitemaps.com/

[Webnauts]

The site cannot be crawled... Sorry.

[Paul B]

Xeno reports about 10,000 pages/links very slowly then times out. Many pages are spidered 3 and 4 times over due to sort by price/ starts / alphabetically.

They are all https:// this will slow down your site for visitors and SE spiders...

[Paul B]

Further:

Enter your URL here:
http://gsitecrawler.com/tools/Server-Status.aspx

for www.cybercellar.com, you'll get the following result:

Error: URL 'https://www.cybercellar.com/Default.asp' does not start with 'http://'!

Looks like it's https:// that's the problem....

[trancehead]

Hi,

Subscribed to the thread but wasn't notified when replies cam in :(. My bad.

Anyways, vasically what happens on every page of the site is that there is a script that checks whether the page is https and if not redirects to the secure page.

Can yahoo and MSN not crawl secure sites?

You have disabled view source, how the hell can we help if we cannot see.

I haven't disabled anything.

Has something else been blocked in the process?

Like what? there isn't anything very advanced on there at all.

I think you need a mod_rewrite for the shop.

On a shared IIS server so this isn't really possible.

Oh well, let me take out the https on this page and see if that helps any.

[trancehead]

OK the problem wasn't with the https per say. On this page it checks whether the visitor has a cookie indicating the part of the world they are in. It checks whether this cookie is present and redirects to a specific section of the site that is dedicated to that country.

Once that automatic redirection was taken Yahoo accepted it gracefully. My question is now how to do the redirect (using ASP) without Yahoo and MSN having probems?

[trancehead]

no worries. I think I have solved the problem. Thanks for eveybodies help :)