View Single Post
  #3 (permalink)  
Old 04-02-2008, 07:17 PM
chandrika's Avatar
chandrika chandrika is offline
WebProWorld Veteran
 
Join Date: Oct 2005
Location: Cambridge, UK
Posts: 376
chandrika RepRank 4chandrika RepRank 4chandrika RepRank 4chandrika RepRank 4
Default Re: Cloaking A Sitemap

Well, I thought that it would not be so easy for them to scrape it if they cant access my sitemap. The sitemap makes it very easy for a scraper to find any and all URL's in my site, they dont need to use bots or anything, simply take the sitemap and there they have a very nice index of every single page on my site.

When I see sites that have scraped mine in google, I get to see a little of the scripts they use to do it, and it appears that they use a link to my sitemap to generate the content for their site.

Maybe it is not called scraping, because they do not actually take my content and display it anywhere, they simply present my content to Google as their content, use my page names, titles etc. But click the link in the search results and it is just a redirect to the affiliate page.

For example

One such sitedoing this as seen in the search results...

Fuji Z5fd Rasp Berry
www. MYSITE.com/shopUK/sitemap.php?merchant=PC+World.
www. MYSITE.com/shopUK/product/FUJI-Z5FD-MOCHA.html ...
laptopwin DOT info/fuji-z5fd-rasp-berry/ - Similar pages - Note this

The link in the results simply redirects via affiliate link to the merchants site.

It is really annoying me because it is not the one occurence, it is alot of similar sites doing this and I want to do something about it. So I thought if I cloak my sitemap, then sites like this, i they use my sitemap to create their pages and content, will be blocked from doing so.


Maybe its not important, maybe it doesnt matter and wont do any harm to my site, but I am not sure about that and so want to understand it really.
__________________
2009 Hairstyles - Pictures of 2009 hairstyles and a virtual hairstyler demo.
Price Comparison Site - Compare prices of well known brands and products.

Last edited by chandrika; 04-02-2008 at 07:19 PM.
Reply With Quote