iEntry 10th Anniversary Forum Rules Search
WebProWorld
Register FAQ Calendar Mark Forums Read
Search Engine Optimization Forum SEO is much easier with help from peers and experts! The WebProWorld SEO forum is for the discussion and exploration of various search engine optimization topics. Any non (engine) specific SEO or SEM topics should go here.

Share Thread: & Tags

Share Thread:

Reply
 
LinkBack Thread Tools Display Modes
  #1 (permalink)  
Old 01-16-2007, 12:51 PM
WebProWorld Pro
 
Join Date: Mar 2006
Location: Costa Rica
Posts: 125
internet-marketing-cr RepRank 0
Default 500 internal server error stops googlebot crawling my site?

Hello webproworld members, thanks for any advice you can give me on this matter.

My website has a sitemap that was submitted to google, when I check google webmaster tools, it shows me a 500 internal error server for 45 ulr's including the home page.

My question is: Does a 500 internal server error stops googlebot from crawling my site?
How do I check it, and how do I fix it?
Reply With Quote
  #2 (permalink)  
Old 01-16-2007, 01:00 PM
Webnauts's Avatar
WebProWorld 1,000+ Club
WebProWorld MVP
 
Join Date: Aug 2003
Location: Worldwide
Posts: 8,164
Webnauts RepRank 9Webnauts RepRank 9Webnauts RepRank 9Webnauts RepRank 9Webnauts RepRank 9Webnauts RepRank 9Webnauts RepRank 9Webnauts RepRank 9Webnauts RepRank 9Webnauts RepRank 9
Default

Do you get server error messages when you visit those pages with your browser? Are you on apache server? If yes, did you check your .htaccess file? Can you make and provide here a screenshot of that info? Can you provide us here with an URL?

All that can make things easier to find out.
__________________
"Being an expert isn't telling other people what you know. It's understanding what questions to ask, and flexibly applying your knowledge to the specific situation at hand. Being an expert means providing sensible, highly contextual direction." Jeff Atwood
SEO Workers - Search Engine Optimization Consulting Company | SEO Analysis Tool | Webnauts Net SEO
Reply With Quote
  #3 (permalink)  
Old 01-16-2007, 01:15 PM
WebProWorld Pro
 
Join Date: Mar 2006
Location: Costa Rica
Posts: 125
internet-marketing-cr RepRank 0
Default

Thanks for getting back to me.

I work doing some SEO for the site, specially link building.

Last December some changes where done by the IT Department to the site, I believe they change the back-end system of the site. When doing so they change the URL's, this was not having in account and it all generated broken links, we had top ten rankings on Google for our main keywords, and our site was last crawled on Dec 6 aprox. Since then I haven't seen any activity of the bots on the site, and we lost our rankings, google still displays some of the old pages of the site, we tried to fixed this redirecting the old pages to the new ones and some others where redirected to the home page. Also a sitemap was created for the site and submitted to Google last week, we get an OK on the sitemap but it shows a 500 internal server error for 45 URL's.

The url is [Edited by Mod Webnauts: URL deleted. See forums quidelines]

When I visit the home page with the browser I don't get the server error.
Reply With Quote
  #4 (permalink)  
Old 01-16-2007, 01:22 PM
Webnauts's Avatar
WebProWorld 1,000+ Club
WebProWorld MVP
 
Join Date: Aug 2003
Location: Worldwide
Posts: 8,164
Webnauts RepRank 9Webnauts RepRank 9Webnauts RepRank 9Webnauts RepRank 9Webnauts RepRank 9Webnauts RepRank 9Webnauts RepRank 9Webnauts RepRank 9Webnauts RepRank 9Webnauts RepRank 9
Default

I tried to check for broken links, and I got a server error too. So that is sure a server side problem. You better check that with your server admin. The site does not seem to be crawlable.
__________________
"Being an expert isn't telling other people what you know. It's understanding what questions to ask, and flexibly applying your knowledge to the specific situation at hand. Being an expert means providing sensible, highly contextual direction." Jeff Atwood
SEO Workers - Search Engine Optimization Consulting Company | SEO Analysis Tool | Webnauts Net SEO
Reply With Quote
  #5 (permalink)  
Old 01-16-2007, 02:01 PM
WebProWorld Pro
 
Join Date: Mar 2006
Location: Costa Rica
Posts: 125
internet-marketing-cr RepRank 0
Default

Thanks webnauts, I appreciate it. Is there any way I can check if googlebot is crawling the site, or just by checking the cache of the page I know if it is crawling it or not? Last cache says Dec 6/2006. This is so I can go to the IT Department with some facts, they say that Googlebot and others are crawling the site.

Does the 500 internal server error given on the webmaster tools for the site stops Google from crawling the site? It says 45 unreachable URL's incluiding the home page.
Reply With Quote
  #6 (permalink)  
Old 01-16-2007, 02:09 PM
Webnauts's Avatar
WebProWorld 1,000+ Club
WebProWorld MVP
 
Join Date: Aug 2003
Location: Worldwide
Posts: 8,164
Webnauts RepRank 9Webnauts RepRank 9Webnauts RepRank 9Webnauts RepRank 9Webnauts RepRank 9Webnauts RepRank 9Webnauts RepRank 9Webnauts RepRank 9Webnauts RepRank 9Webnauts RepRank 9
Default

Quote:
Originally Posted by internet-marketing-cr
Does the 500 internal server error given on the webmaster tools for the site stops Google from crawling the site?
Yes!
__________________
"Being an expert isn't telling other people what you know. It's understanding what questions to ask, and flexibly applying your knowledge to the specific situation at hand. Being an expert means providing sensible, highly contextual direction." Jeff Atwood
SEO Workers - Search Engine Optimization Consulting Company | SEO Analysis Tool | Webnauts Net SEO
Reply With Quote
  #7 (permalink)  
Old 01-16-2007, 03:07 PM
WebProWorld Pro
 
Join Date: Mar 2006
Location: Costa Rica
Posts: 125
internet-marketing-cr RepRank 0
Default

Thanks webnauts, I really appreciate your help.
Reply With Quote
  #8 (permalink)  
Old 01-16-2007, 09:34 PM
DrTandem1's Avatar
WebProWorld 1,000+ Club
 
Join Date: Oct 2003
Location: Encinitas, CA
Posts: 1,830
DrTandem1 RepRank 2
Default

Internal Server Errors will stop the 'bots from crawling that page and any links it may have had. I suppose, if it gets enough errors, then the 'bot will stop crawling the site for a period of time as it is a waste of its time.
__________________
DrTandem's San Diego Web Page Design, drtandem.com
Reply With Quote
  #9 (permalink)  
Old 01-17-2007, 04:02 PM
WebProWorld New Member
 
Join Date: Jan 2007
Posts: 8
mediatitan RepRank 0
Default Patriots

The Patriots are a very low-classed team.
Reply With Quote
  #10 (permalink)  
Old 01-17-2007, 10:28 PM
Webnauts's Avatar
WebProWorld 1,000+ Club
WebProWorld MVP
 
Join Date: Aug 2003
Location: Worldwide
Posts: 8,164
Webnauts RepRank 9Webnauts RepRank 9Webnauts RepRank 9Webnauts RepRank 9Webnauts RepRank 9Webnauts RepRank 9Webnauts RepRank 9Webnauts RepRank 9Webnauts RepRank 9Webnauts RepRank 9
Default Re: Patriots

Quote:
Originally Posted by mediatitan
The Patriots are a very low-classed team.
What does that suppose to mean?
__________________
"Being an expert isn't telling other people what you know. It's understanding what questions to ask, and flexibly applying your knowledge to the specific situation at hand. Being an expert means providing sensible, highly contextual direction." Jeff Atwood
SEO Workers - Search Engine Optimization Consulting Company | SEO Analysis Tool | Webnauts Net SEO
Reply With Quote
  #11 (permalink)  
Old 01-18-2007, 02:57 PM
WebProWorld New Member
 
Join Date: Jan 2007
Posts: 8
mediatitan RepRank 0
Default Re: Patriots

Quote:
Originally Posted by Webnauts
Quote:
Originally Posted by mediatitan
The Patriots are a very low-classed team.
What does that suppose to mean?
Its just a rebutal to the first sentence of the most recent newsletter I received from you guys. Nothing to do with this thread - just had to say it somewhere. I expect it to be deleted. As far as what it means literally... that actually wasn't said by me originally - it came from the league's MVP.

-t
Reply With Quote
Reply

  WebProWorld > Search Engines > Search Engine Optimization Forum

Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are On
Pingbacks are On
Refbacks are On



All times are GMT -4. The time now is 05:49 AM.



Search Engine Optimization by vBSEO 3.3.0