Submit Your Article Forum Rules

Results 1 to 7 of 7

Thread: How to stop Google from spidering a series of pages

  1. #1
    Senior Member ep2012's Avatar
    Join Date
    Oct 2004
    Posts
    397

    How to stop Google from spidering a series of pages

    Hi,

    Someone hacked my WP & even though I got someone to go in & clean it up, Google still thinks the page & sub pages is there & keeps telling me there's so many 404 pages.

    How do I stop G from thinking it's there so it stops spidering it?

    Here's a SS

    http://i972.photobucket.com/albums/a...-404Errors.jpg

    Thanks


    Michelle

  2. #2
    Moderator SteveGerencser's Avatar
    Join Date
    Jan 2005
    Location
    Small town Tennessee
    Posts
    2,127
    You can manually remove the pages in GWT.
    Dad always said, if you are good at something, make sure they pay you for it.
    Coming soon : SEO Pros Live Hangout on Air
    Internet Marketing | Animal Charms Animal Jewelry

  3. #3
    Senior Member ep2012's Avatar
    Join Date
    Oct 2004
    Posts
    397
    But they don't exist, that's what I'm saying.

    They certainly weren't my pages, the hacker snuck them in the code somewhere & the person who fixed it says they are gone.

    I can't confirm this as I'm not a coder.

  4. #4
    Moderator SteveGerencser's Avatar
    Join Date
    Jan 2005
    Location
    Small town Tennessee
    Posts
    2,127
    Go in to Google webmaster tools, and use the remove url option. Google thinks they exist. That's all that matters. Tell them they are gone. Then in 3 or 6 months they will try again, see the pages are still gone and stop trying to reach them.
    Dad always said, if you are good at something, make sure they pay you for it.
    Coming soon : SEO Pros Live Hangout on Air
    Internet Marketing | Animal Charms Animal Jewelry

  5. #5

  6. #6
    Junior Member
    Join Date
    Nov 2012
    Posts
    4
    With robots.txt you can use it to prevent indexing totally, prevent certain areas of your site from being ... penalized for spamming a search engine with a series of overly similar pages. ... You know that the spider that Google sends out is called 'Googlebot'.

  7. #7
    Moderator C0ldf1re's Avatar
    Join Date
    Mar 2010
    Location
    127.0.0.1
    Posts
    1,481
    Quote Originally Posted by ep2012 View Post
    But they don't exist, that's what I'm saying...
    Quote Originally Posted by SteveGerencser View Post
    ... Google thinks they exist. That's all that matters...
    It looks like Google have "cached" your website. They have kept a copy on their own servers, and Google's copy still has the webpages that you have now removed from your real site. One essential is to prepare an updated sitemap and submit it to Google. With a bit of luck, Google will completely re-index your site and re-cache your site as it now is.

    You can suppress 404 errors from appearing by adding this line to your htaccess file (in the root folder on your server):
    ErrorDocument 404 /index.php

    (It is actually a very simple and easy thing to do. You just have to conquer the initial terror at the thought of touching the incomprehensible parts of the system. )
    Last edited by C0ldf1re; 11-28-2012 at 08:26 AM.

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •