Spidering

[t'mack]

Google is starting to include new parts of my site (www.whathappenedlastnight.net) in their search results. I've made a lot of changes to the site and the structure recently so I'm patiently waiting for it all to appear.

I've used the site:whathappenedlastnight.net search and it reports 6,250 results. By moving through the pages it gets to page 53 before stating "In order to show you the most relvant results..."etc.

I wondered how these figures relate to what Google has actually indexed, and if they relate at all? In the 530 returned there are suplemental results, and it doesnt seem to be ordered in any particular way.

[incrediblehelp]

Your pages may feel very similar if not duplicated in nature by Google so they may choose to not rank some or even put them in the SI.

[Irishjim]

ditto on Incredible's comment. Also, keep in mind Google is using a form of their famous sandbox for new content.

Check to see what MSN search is bringing in. They seem to be a few days ahead of Google in their updating of new material.

This duplicate content problem Incredible mentioned is something to take seriously. I'm not too sure how it impacts on "same site" info but I lost a #1 ranked page from my www.tourclare.com site last week and I believe it was because of BigDaddy's attitude towards scrapers.

My sin was placing links to other sites in Lahinch, Ireland and using copy from the links' sites (with their permission) in these links.

Something else to be careful of...

[incrediblehelp]

I'm not too sure how it impacts on "same site" info

Should not be an issue. They usually just pick one and rank it, but as always their could be special circumstances.

[t'mack]

Thanks for your advice guys - MSN does seem to pick up on the changes much quicker than Google at the moment.

Noticed that MSN returns a lot of duplicate content.

http://search.msn.co.uk/results.aspx...988&FORM=REDIR

5 out of the 10 returned are from the same source.