WebProWorld Part of WebProNews.com
Page One Link To Us Edit Profile Private Messages Archives FAQ RSS Feeds  
 

Go Back   WebProWorld > Webmaster, IT and Security Discussion > Internet Security Discussion Forum
Subscribe to the Newsletter FREE!


Register FAQ Members List Calendar Arcade Chatbox Mark Forums Read

Internet Security Discussion Forum This forum is for the discussion of security related issues. If you find a new Phishing scheme, spyware, virus or malicious site - let us know about it. If any of the above found you... here's where you ask for help.

Reply
 
LinkBack Thread Tools Display Modes
  #1 (permalink)  
Old 09-04-2005, 06:11 PM
Phiber Phiber is offline
WebProWorld Member
 

Join Date: Aug 2004
Location: Croatia
Posts: 45
Phiber RepRank 0
Default My list of denied bots

Some bots that are used to copy your content.
Put it in your .htaccess file:

Code:
SetEnvIf User-Agent ^OmniExplorer bad_bad_bot=1
SetEnvIf User-Agent ^EmailSiphon bad_bad_bot=1
SetEnvIf User-Agent ^EmailWolf bad_bad_bot=1
SetEnvIf User-Agent ^ExtractorPro bad_bad_bot=1
SetEnvIf User-Agent ^Mozilla.*NEWT bad_bad_bot=1
SetEnvIf User-Agent ^Crescent bad_bad_bot=1
SetEnvIf User-Agent ^CherryPicker bad_bad_bot=1
SetEnvIf User-Agent ^[Ww]eb[Bb]andit bad_bad_bot=1
SetEnvIf User-Agent ^WebEMailExtrac.* bad_bad_bot=1
SetEnvIf User-Agent ^NICErsPRO bad_bad_bot=1
SetEnvIf User-Agent ^Teleport bad_bad_bot=1
SetEnvIf User-Agent ^Zeus.*Webster bad_bad_bot=1
SetEnvIf User-Agent ^Microsoft.URL bad_bad_bot=1
SetEnvIf User-Agent ^Wget bad_bad_bot=1
SetEnvIf User-Agent ^LinkWalker bad_bad_bot=1
SetEnvIf User-Agent ^sitecheck.internetseer.com bad_bad_bot=1
SetEnvIf User-Agent ^ia_archiver bad_bad_bot=1
SetEnvIf User-Agent ^DIIbot bad_bad_bot=1
SetEnvIf User-Agent ^psbot bad_bad_bot=1
SetEnvIf User-Agent ^EmailCollector bad_bad_bot=1
SetEnvIf User-Agent ^InternetSeer.com bad_bad_bot=1
deny from env=bad_bad_bot
Reply With Quote
Reply

  WebProWorld > Webmaster, IT and Security Discussion > Internet Security Discussion Forum
Tags: bots, denied, list



Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

vB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are On
Pingbacks are On
Refbacks are On



Search Engine Friendly URLs by vBSEO 3.0.0