Duplicate Content Filter

[Ellio]

We think we have just been hit by the duplicate content filter.

For many years we have had similar pages for the "index.html" and "home.html" file names in both the parent and sub directories. (I wish I could remember why!)

In the last few days Google has cached the home pages first and then removed the index pages for duplicate content (we think).

We have now removed all the "home.html" pages (there are no links to them internally or externally) and are hoping that following Google finding no page when re-caching the "home" pages they will then re-index the "index.html" pages and we will be back to normal.

Our concern is that if the index pages now have no cache when will google have another look. Its a high profile site with (previously) many top 5 positions in the serps and many backlinks.

Can anybody offer any advice on this and possible timescales to get back to normal?

[brian.mark]

Best advice I can give is to make sure you have a 301 redirect from home.html to index.html to make sure that Google realizes that index.html is the one they should have as well as directing any traffic landing on that page through any search or link goes to the right page. It usually doesn't take long once a 301 is in place for the SERPs to adjust.

I would also like to point out that duplicate content doesn't get the page removed from the index, but rather just filtered from the results. If your page is indeed gone from their index, you may have something else going on.

Brian.

[Ellio]

Brian,

Sorry to sound daft but can you remind me how to set up a 301 redirect?

Many thanks

[Ellio]

Brian,

Following he changes if I search for the index url on google i get this with no cache info or description:

..............
adviceonline.co.uk/


Google can show you the following information for this URL:

Find web pages that are similar to www.adviceonline.co.uk/
Find web pages that link to www.adviceonline.co.uk/
Find web pages from the site www.adviceonline.co.uk/
Find web pages that contain the term "www.adviceonline.co.uk/"

.....................

Any ideas?

[Ellio]

Brian,

Am I correct in thinking this is what needs to be in our HTAcess file:

# Redirects (from site path to URL)
Redirect /home.html http://www.adviceonline.co.uk/index.html

[brian.mark]

Almost. You need to make it permanent with the 301 portion or it'll be temporary (302) and can cause issues in Yahoo.

redirect 301 /home.html http://www.adviceonline.co.uk/index.html

Brian.

[Ellio]

Many thanks Brian.