How can we find Old pages in Google's Index database?

Ozzman · #1 (**permalink**) 02-28-2008, 06:07 AM

In the past, we changed our website's look and feel and we also changed lots of URLs. At that time, we did not care and applied 302 redirects from old URLs TO new URLs. Now the problem is that Google still keeps plenty of our old web pages in its index. We found some of these old pages and redirected (301) to our new website pages. But, i wonder there are still hundreds of such old web pages which need to be redirected to correct pages of today.

Please suggest me what should I do to find out those old pages in Google's Index? Is there any tool for that? If yes, please suggest me.

Alan-Hart · #2 (**permalink**) 02-28-2008, 06:23 AM

type this into google...

site:sitename.com

replace sitename.com with your site's domain. It will list every page that google has indexed for that site.

**incrediblehelp** · #3 (**permalink**) 02-28-2008, 08:34 AM

Ozz dont you know what and how many pages were on your old website?

Ozzman · #4 (**permalink**) 02-28-2008, 09:00 AM

Quote:

Originally Posted by incrediblehelp

Ozz dont you know what and how many pages were on your old website?

I really don’t know how many pages were on our old websites but I mas sure there are hundreds of it. In the mean time we changed our old product names and that’s why we generated new URLs according to new product names. We did this for twice or thrice in last 4-5 years. That’s why I am sure there are junks of such old pages which are still in Google's index which need to be searched and then assigned accurate HTTP header statuses.

**incrediblehelp** · #5 (**permalink**) 02-28-2008, 09:04 AM

Why not look at the traffic stats and see if these any old pages are getting some. 301 redirect only those over as those are the only ones that you have to worry about. Just kill the rest.

CKarsting · #6 (**permalink**) 02-28-2008, 02:48 PM

IF the pages are still indexed and have any PR, why not reuse them for one way linking to a new internal page you are trying to boost or a seperate website with similar content? I typically choose to recycle, not redirect.

CKarsting
Seo Webmaster

<snip please add your link to your signature file and not the body of the post CD>

**incrediblehelp** · #7 (**permalink**) 02-28-2008, 03:02 PM

Well for one he is having troubles even knowing what they are or finding them.

webmax · #8 (**permalink**) 02-28-2008, 04:40 PM

In Google Webmasters Tools there's a place where you can see all the URLs that G has indexed for your site, when they last got crawled, and what was the outcome. Then there is also a place under Tools where you can remove URLs yourself. Before you have access to these tools you have to submit your site to G using a file with a number that they generate for you.

Orion · #9 (**permalink**) 02-28-2008, 04:57 PM

Using the site: search will show everything that is indexed with Google, don't forget MSN and Yahoo and other engines out there.

If you have google sitemap make sure to update and resubmit it. Webmaster tools to remove urls is also excellent.

Lastly, if you want to recover old content or see what the pages were (not just what's indexed) the waybackmachine can be really helpful!

Hope that helps,

slickricky · #10 (**permalink**) 02-28-2008, 09:30 PM

You definitely want to check out Google's WebMaster Tools, not only will you get the information you're looking for, but you'll see a lot of other useful information too!

Affordable Help and Design using Designers Central, the Official Weblog of SlickRicky Internet Designs

datetopia · #11 (**permalink**) 02-29-2008, 04:44 AM

You could also use this website to check older website versions and get the old links from there:
http://web.archive.org/collections/web.html

activeco · #12 (**permalink**) 02-29-2008, 05:03 AM

Check all the links on the web pointing to you and if needed redirect them 301 or notify webmasters to change the link.
For the rest follow the message #5 here from incrediblehelp.
There is nothing wrong with the code 404 for anything that don't exist on your server and have no valuable incoming links.

saif · #13 (**permalink**) 03-01-2008, 01:13 AM

type into google

site:Example Web Page

sitename.com with your site's domain. It will list every page that google has indexed for that site.
You can also use this website to check older website versions and get the old links from google:

oimdiane · #14 (**permalink**) 03-01-2008, 02:40 PM

Quote:

Originally Posted by webmax

In Google Webmasters Tools there's a place where you can see all the URLs that G has indexed for your site, when they last got crawled, and what was the outcome. Then there is also a place under Tools where you can remove URLs yourself. Before you have access to these tools you have to submit your site to G using a file with a number that they generate for you.

I'll be anxious to hear of the perfect solution, too, since I have tried and tried to use the webmaster tool in Google to remove about 100 pages myself. I've followed the directions to the T and the only thing it did was question existing pages and find even more. It's been a madhouse up and down cycle trying to get rid of things that don't belong!

One example/problem is a cgi-bin folder of stuff still showing up (was an affiliate program thing) that has not been anyway near connected with my one website for years! I've even changed hosting several times over. Got a sitemap in that lists "here's what I have just look at this" and the works, but still the issue remains of "lost pages" showing up and perhaps counting against me in the long run. Can't fix what you don't have or can't find. (I've tried every method known to mankind lol!)

Good Luck! I will watch this forum and pray someone has the answers

Webnauts · #15 (**permalink**) 03-02-2008, 07:54 PM

Quote:

Originally Posted by saif

type into google

site:Example Web Page

sitename.com with your site's domain. It will list every page that google has indexed for that site.

That is not correct! They do not list all pages.

carolin.c22 · #16 (**permalink**) 03-03-2008, 03:12 AM

Quote:

Originally Posted by webmax

In Google Webmasters Tools there's a place where you can see all the URLs that G has indexed for your site, when they last got crawled, and what was the outcome. Then there is also a place under Tools where you can remove URLs yourself. Before you have access to these tools you have to submit your site to G using a file with a number that they generate for you.

here is google's web masters tools URL
https://www.google.com/webmasters/to...overview?hl=en

Webnauts · #17 (**permalink**) 08-28-2008, 10:27 AM

Quote:

Originally Posted by Ozzman

In the past, we changed our website's look and feel and we also changed lots of URLs. At that time, we did not care and applied 302 redirects from old URLs TO new URLs. Now the problem is that Google still keeps plenty of our old web pages in its index. We found some of these old pages and redirected (301) to our new website pages. But, i wonder there are still hundreds of such old web pages which need to be redirected to correct pages of today.

Please suggest me what should I do to find out those old pages in Google's Index? Is there any tool for that? If yes, please suggest me.

We have setup a few days a tool in our labs which we can retrieve old pages which are invisible, like a part of the supplementals and even deeper in the cache index.

Since the 24th of August we are cleaning up our forums. Google with the "site" operator showed 194 pages, which not all could be retrieved searching, since that virus warning shows up and we got blocked.

Until today we added in the GWT 762 urls which have been deleted and we still have found more which we still adding at the moment.

Unfortunately we do not provide the tool to the public. But the answer to your question is given. Its possible to retrieve old pages and get rid of them!