Preventing Bad bots (robots)

[sck4784]

Hi all, how can i prevent bad bots or robots that I would not want on the system?

Please guide me.

thanks & regards

[botslist]

You only need two steps.

Step 1)

Identify the bots you don't want. You can do this (a) by running a bot detection script on your website, or (b) by getting a list of bots that someone has already identified (for example, from my website).

Step 2)

Decide what you want to do with the bad bots. You can (a) just deny them access to your site by closing the connection or (b) redirect them to another page on or off your website to explain why access is being denied, just in case your visitor is a real user and not a bot.

That's it. Not difficult at all, but it can be tricky depending on what you are trying to accomplish.

[mikesmith76]

I'm sure there is an .htaccess file somewhere around here to block bad user agents and / or possibly ip addresses. Not sure how complete it is but may be a good starting point.

If i remember correctly i think it was kgun who originally posted them.

[sharoncreech]

There are very nice and effective trap scripts that can catch bad robots and block them from accessing your site. I found one cgi script on webamsterworld and it do very good job.

[Keimos]

Hi sck4784,

The answer depending on whether it is a windows (htaccess) host or another host (robots.txt) is to put the following in that file.


Disallow: (name of the robot)

It does vary on occasions but what you are saying is do not come in. There should not be a need for more complicated methods but I admit if something else is needed then somebody else advise otherwise.



Keimos

[Vectorman211]

You guys are missing the question. This has nothing to do with a webhost (as I interpret the question). He/she is asking about securing his/her PC from spyware/malware. The answer is don't use IE but if you do keep it patched. Install Lavasoft's Adaware software and use it religeously or buy the full version and get real time monitoring. Also, don't go to bad websites like porn or crack sites, you're asking for trouble there. Lastly, don't use any peer2peer file sharing applications like limewire. Furthermore, the best way to protect your PC from malware is to unplug the network cable