What is Wrong Here - Duplicate Content?

[cz]

I have moved our "crime blog" to new digs but I'm worrie about possible duplicate content penalties.

On the new blog (launched yesterday), there are several posts displayed on the first page. These are also in categories - as snippets - then by clicking to "read more" the original post comes up.

Here's an example of the first page and following the first post:

Crime Information - Self Defense Blog > Self Defense > Two-Handed Neck Grab Defense - Bunkai

The problem is 3 diferent URL's resolving to the same post. Do you think perhaps? Any advice is very welcome!

CZ

[optimalwebsite]

Hi there,

I'm not an expert when it comes to blogs but I don't think this would cause a problem. I've seen lots of other blogs feed the same way, and not run into duplicate content penalties.

Congrats on a nice looking site.

Regards,


Joel!

[mjtaylor]

Dup content is definitely an issue on blogs ... use your robots.txt file to keep the SEs out of the archives.

Cheers, MJ

[cz]

Thank you Joel - my son designs & I write (or try) ; )

MJ,
Thanks, I found your post very interesting - that's why we've moved the blog to WP from Blogger. The Beta or new version of Blogger kept all the archives of the site hidden via a 'server side" no index, no follow robot text.

We could find the file through searching but not from inside the Blogger Dashboard>Template. We lost archive posts - about 280 archived with PR3 went to PR0 and only the "Home" page stayed at PR4. Won't this happen again if we exclude our archives with Robots Text commands?

Thanks and I hope you see this and can comment back.

CZ

[tnt7]

Originally Posted by mjtaylor

Dup content is definitely an issue on blogs ... use your robots.txt file to keep the SEs out of the archives.

Cheers, MJ

Is this an answer to his particular question or a just a general statement? I am very interested in a definative answer. In my opinion it would not trigger dup content filters, but I am no expert. You basically have the same exact page just in different sections. I do think multiple categories will lessen your "link juice", but so will all those tags.

On my ecommerce sites I have specials on the main page which are also in my main categories and do not trip duplicate content filters. (Which is the same structure as his site)

Can using the robots.txt file to keep the spiders out of the archives restrict deep spidering of the site? Or would they definately deep spider the cateogories?


Thanks,

EDIT : After pondering this for a while the only thing I can see is the excerpt that is used under the cateogry and archives are exaclty the same text. I can see something there, but would definately appreciate some more thoughts from experience.

[Webnauts]

There is a duplicated content issue. Here are some tips how to deal with them if you are still using WP: SEO with Robots.txt

[tnt7]

Found this while searching

Word Press Duplicate Content Issue and Fix

Some other threads too site:www.webproworld.com wordpress duplicate

I would just make sure you have all of your post categorized and remove the archives. Kind of pointless to users in my opinion.

[mjtaylor]

Originally Posted by cz

Thanks and I hope you see this and can comment back.

CZ

I think Webnauts post has more than adequately and definitively answered the questions, yes?

[cz]

"Webnauts post has more than adequately and definitively answered the questions"

I appreciate his input, but answered me definitively and adequately? No.

The affirmation of my previously stated fear of WP and duplicate content and the link to robot text?

If you say so. I'll keep staring at it and wait for the answer to reveal itself to me.... ; )

CZ

[Webnauts]

Originally Posted by cz

I have moved our "crime blog" to new digs but I'm worrie about possible duplicate content penalties.

You should worry. You have duplicated content issues.

Originally Posted by cz

On the new blog (launched yesterday), there are several posts displayed on the first page. These are also in categories - as snippets - then by clicking to "read more" the original post comes up.

Here's an example of the first page and following the first post:

Crime Information - Self Defense Blog > Self Defense > Two-Handed Neck Grab Defense - Bunkai

The problem is 3 diferent URL's resolving to the same post. Do you think perhaps? Any advice is very welcome!

That is a normal blog software behaviour and functionality, and that is why you have duplicated content problems. And I already gave you the best and easiest implementation techniques to get rid of the problem. How can you see we did not help you out? If you cannot understand technical aspects and implementation techniques, I guess then it is time to hire an SEO or live with your present situation.

Just my two ... you know what.

[cz]

I think Webnauts post has more than adequately and definitively answered the questions, yes?

The affirmation of my previously stated fear of WP and duplicate content and the link to robot text? I appreciate his input, but answered me definitively and adequately? No.

He did make a very helpful suggestion, for which I'm grateful.

If you cannot understand technical aspects and implementation techniques, I guess then it is time to hire an SEO or live with your present situation.

That is exactly what I did. A forum member who also understands the technical aspects and the implementation techniques is on it! I love this forum - I appreciate everyone's assistance immensely but sometimes, to my misfortune - I always answer truthfully (as I see things).

Fact is, I wanted Webnauts to do this but fell asleep watching a ball game and I never got to PM you dude! You sound a little "snappy" - did I do or say something out of line? Probably too small of job for you to bother with so no harm no foul right? Sorry about it, if so!

Thanks Again!
CZ

[Webnauts]

Cz I was referring to your previous post. Did I possibly misunderstand something? If so, then sorry buddy.

[cz]

Webnauts,

No apology required! You hit the nail on the head! I wasn't able to handle it. I appreciate your posting into my thread and the link. I wasn't certain that I'd be able to figure it out (correctly). The answer was in there though.

I respect your threads/posts and have read them many times. Thanks for the years of service here. I'm not an SEO or a programmer but I have learned a lot from all of the members who give their time so generously.

I've heard, if you hang around certain groups long enough - a little rubs off and you get better too! Unfortunately that doesn't apply to me and programming.

Thanks,
CZ

[Webnauts]

Cz, I think I found an easy solution for your problem. You might would like to install for your WP blog the plugin: Robots Meta « Extend › Plugins

[cz]

Thanks Webnauts!

Right on! That does look very simple and exactly what's needed. I'll pass this along to my pal and see if he's already done something or if he wants to use this. Looks like something that all will welcome with a sigh of relief. Great find!

Thanks again,
Cz

[Palindrome]

Webnauts latest suggestion is an excellent solution and a neccessary one. Whilst there is logic in feeling there shouldn't be a problem, that's how blogs work, this may not be entirely accurate.

In a Google post a few months back, on the general issue of duplicate content, Adam Lasnik wrote:

"Understand your CMS: Make sure you're familiar with how content is displayed on your Web site, particularly if it includes a blog, a forum, or related system that often shows the same content in multiple formats."

In traditional Google fashion, this is a hint rather than a clear statement but the inference is there. Time spent removing this sort risk is definitely not wasted.

Surrey PC Help Desk

[NameCritic]

Originally Posted by Webnauts

There is a duplicated content issue. Here are some tips how to deal with them if you are still using WP: SEO with Robots.txt

Great info there. I appreciate it. Creating my robots.txt for all my blogs now.

[cz]

Thanks for that link Webnauts!

It only took a few minutes over the phone with somebody who knew what they were doing and it was installed and he let me login and tick the checkboxes. Hope it works ok, I don't know why it wouldn't? I will let you all know how I fare.

cz

[Webnauts]

Slightly off-topic? Worth to have a look though: Official Google Webmaster Central Blog: Google, duplicate content caused by URL parameters, and you

[Palindrome]

Thanks Webnauts, interesting post. Not without an element of the standard Google contradiction but even that can become a business asset.

[cz]

Hi Everyone,

Webnauts -

I read your followup post on "Official Google Webmaster Central Blog: Google, duplicate content caused by URL parameters, and you" and found it to be a little difficult to understand.

For the blog Crime Information - Self Defense Blog - what we did do was use the plugin that you first suggested: "Robots Meta « Extend › Plugins" and checked all of the suggested boxes.

When looking at a story on the main page - it all looks spiderable as do the snippets source code on pages within the category. The final categorized post - where it says "read more" - leading to just that post. This page shows up as "nofollow" to the categories but other than that - there are hidden archives and ways a spider could getinside anywhere it wanted.

Would someone look and see if we still are in a duplicated content condition? Sorry - but we'd like to get this blog set right and it doesn't seem to be working. Preventing us from much needed time working on e-comerce sites.

Thank you!
Cz