View Single Post
  #6 (permalink)  
Old 04-05-2008, 09:33 AM
MursPlace MursPlace is offline
WebProWorld Member
 
Join Date: Jan 2008
Posts: 27
MursPlace RepRank 1
Default Re: MSN links--Thousand of pages linking from all different domains but seem the same

Quote:
Originally Posted by chandrika View Post
I have been having a similar problem, and found this blog that gives some handy tips to try to stop rogue softwares lifting all your content.

Use a simple bottrap to block bad bots - stop others from stealing your content today
That was a good bit of information.
If you're doing the "Ban" or "Disallow" to all those types of USER_AGENT connections I'll give a try to reverse it and only allow "Human" and the big 3 search engines.

The concept is sound but only time will tell. Drawback is that you have to create a new Disallow for any new bad bot so it might be easier to just allow the good search engine spiders, content copyright bots, plagiarism bots etc.
  • Do you have a method of tracking bots attempting to copy your site or at least your articles section?
  • Wound you agree to share your results in about 30 days?
I feel plagiarism, leeching, scraping confuses more consumers and directly affects valid storefront owners. I learned by the "School of Hard Knocks" by posting on wordpress some articles I wrote for my site. I will never do that again.
Reply With Quote