Quote:
Originally Posted by incrediblehelp
So are you worried about this because you don't want to see all the errors in your logs files or just don't want some weird bot crawling your pages and taking bandwidth? Sounds just like a crappy scrapper bot to me.
|
I am not really worried about the errors showing up. I am worried that somebody out there is trying to steal our content, or trying to pull our keywords or something along those lines. I could just be paranoid.
Chances are if they are stealing keywords, it is one sites that when you click on the results in Goolge, it has nothing to do with what the site actually is. Somebody just trying to gain rankings.