View Single Post
  #9 (permalink)  
Old 04-03-2008, 06:52 AM
chandrika's Avatar
chandrika chandrika is offline
WebProWorld Veteran
 
Join Date: Oct 2005
Location: Cambridge, UK
Posts: 376
chandrika RepRank 4chandrika RepRank 4chandrika RepRank 4chandrika RepRank 4
Default Re: Cloaking A Sitemap

Yes I guess there are some legitimate scrapers, I have seen a couple that use scraped content, but in a useful way and provide a backlink.

So I am always going to run the risk of blocking legitimate visitors and bots if I try to tackle it that way.

The specific problem with the sites that use my sitemap url in a script that shows Googlebot my content as theirs, I suppose is somewhat different to scraping, as they are not actually scraping my site, just trying to trick Googlebot to think that my content is on their website, when it isnt at all.
__________________
2009 Hairstyles - Pictures of 2009 hairstyles and a virtual hairstyler demo.
Price Comparison Site - Compare prices of well known brands and products.
Reply With Quote