Re: Cloaking A Sitemap
Well, I thought that it would not be so easy for them to scrape it if they cant access my sitemap. The sitemap makes it very easy for a scraper to find any and all URL's in my site, they dont need to use bots or anything, simply take the sitemap and there they have a very nice index of every single page on my site.
When I see sites that have scraped mine in google, I get to see a little of the scripts they use to do it, and it appears that they use a link to my sitemap to generate the content for their site.
Maybe it is not called scraping, because they do not actually take my content and display it anywhere, they simply present my content to Google as their content, use my page names, titles etc. But click the link in the search results and it is just a redirect to the affiliate page.
For example
One such sitedoing this as seen in the search results...
Fuji Z5fd Rasp Berry
www. MYSITE.com/shopUK/sitemap.php?merchant=PC+World.
www. MYSITE.com/shopUK/product/FUJI-Z5FD-MOCHA.html ...
laptopwin DOT info/fuji-z5fd-rasp-berry/ - Similar pages - Note this
The link in the results simply redirects via affiliate link to the merchants site.
It is really annoying me because it is not the one occurence, it is alot of similar sites doing this and I want to do something about it. So I thought if I cloak my sitemap, then sites like this, i they use my sitemap to create their pages and content, will be blocked from doing so.
Maybe its not important, maybe it doesnt matter and wont do any harm to my site, but I am not sure about that and so want to understand it really.
Last edited by chandrika; 04-02-2008 at 07:19 PM.
|