Submit Your Article Forum Rules

Page 1 of 2 12 LastLast
Results 1 to 10 of 11

Thread: 500 internal server error stops googlebot crawling my site?

  1. #1

    500 internal server error stops googlebot crawling my site?

    Hello webproworld members, thanks for any advice you can give me on this matter.

    My website has a sitemap that was submitted to google, when I check google webmaster tools, it shows me a 500 internal error server for 45 ulr's including the home page.

    My question is: Does a 500 internal server error stops googlebot from crawling my site?
    How do I check it, and how do I fix it?

  2. #2
    WebProWorld MVP Webnauts's Avatar
    Join Date
    Aug 2003
    Location
    European Community
    Posts
    9,028
    Do you get server error messages when you visit those pages with your browser? Are you on apache server? If yes, did you check your .htaccess file? Can you make and provide here a screenshot of that info? Can you provide us here with an URL?

    All that can make things easier to find out.

  3. #3
    Thanks for getting back to me.

    I work doing some SEO for the site, specially link building.

    Last December some changes where done by the IT Department to the site, I believe they change the back-end system of the site. When doing so they change the URL's, this was not having in account and it all generated broken links, we had top ten rankings on Google for our main keywords, and our site was last crawled on Dec 6 aprox. Since then I haven't seen any activity of the bots on the site, and we lost our rankings, google still displays some of the old pages of the site, we tried to fixed this redirecting the old pages to the new ones and some others where redirected to the home page. Also a sitemap was created for the site and submitted to Google last week, we get an OK on the sitemap but it shows a 500 internal server error for 45 URL's.

    The url is [Edited by Mod Webnauts: URL deleted. See forums quidelines]

    When I visit the home page with the browser I don't get the server error.

  4. #4
    WebProWorld MVP Webnauts's Avatar
    Join Date
    Aug 2003
    Location
    European Community
    Posts
    9,028
    I tried to check for broken links, and I got a server error too. So that is sure a server side problem. You better check that with your server admin. The site does not seem to be crawlable.

  5. #5
    Thanks webnauts, I appreciate it. Is there any way I can check if googlebot is crawling the site, or just by checking the cache of the page I know if it is crawling it or not? Last cache says Dec 6/2006. This is so I can go to the IT Department with some facts, they say that Googlebot and others are crawling the site.

    Does the 500 internal server error given on the webmaster tools for the site stops Google from crawling the site? It says 45 unreachable URL's incluiding the home page.

  6. #6
    WebProWorld MVP Webnauts's Avatar
    Join Date
    Aug 2003
    Location
    European Community
    Posts
    9,028
    Quote Originally Posted by internet-marketing-cr
    Does the 500 internal server error given on the webmaster tools for the site stops Google from crawling the site?
    Yes!

  7. #7
    Thanks webnauts, I really appreciate your help.

  8. #8
    Senior Member DrTandem1's Avatar
    Join Date
    Oct 2003
    Posts
    1,828
    Internal Server Errors will stop the 'bots from crawling that page and any links it may have had. I suppose, if it gets enough errors, then the 'bot will stop crawling the site for a period of time as it is a waste of its time.
    DrTandem's San Diego Web Page Design, drtandem.com

  9. #9
    Junior Member
    Join Date
    Jan 2007
    Posts
    8

    Patriots

    The Patriots are a very low-classed team.

  10. #10
    WebProWorld MVP Webnauts's Avatar
    Join Date
    Aug 2003
    Location
    European Community
    Posts
    9,028

    Re: Patriots

    Quote Originally Posted by mediatitan
    The Patriots are a very low-classed team.
    What does that suppose to mean?

Page 1 of 2 12 LastLast

Similar Threads

  1. robots.txt unreachable - googlebot stopped crawling
    By jb1702 in forum Google Discussion Forum
    Replies: 5
    Last Post: 07-01-2007, 07:59 PM
  2. Server Error 500 on PHP/MySQL site
    By MarcieZoob in forum Web Programming Discussion Forum
    Replies: 6
    Last Post: 07-17-2005, 06:02 AM
  3. "Internal Server Error" problem
    By Dot_Commer in forum Web Programming Discussion Forum
    Replies: 5
    Last Post: 09-09-2004, 10:05 AM
  4. Googlebot Crawling AdSense WebSearch Pages
    By ronniethedodger in forum Google Discussion Forum
    Replies: 0
    Last Post: 08-16-2004, 02:36 AM
  5. Dynamic site: Tackling 500 Http Server error
    By lucks in forum Graphics & Design Discussion Forum
    Replies: 2
    Last Post: 05-13-2004, 10:03 PM

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •