RE: [cobalt-users] [RAQ3] Apache User-Agent blocking for all sites

[Greg Hewitt-Long <cobaltusers@xxxxxxxxxxxxxxxxxxx>]

> > SetEnvIfNoCase User-Agent "^EmailSiphon" bad_bot SetEnvIfNoCase
>> User-Agent "^EmailWolf" bad_bot
>>
>> <Directory "/home/sites/*/">
>>         Order Allow,Deny
>>         Allow from all
>>         Deny from env=bad_bot
>> </Directory>
>>
>>
>
>Looks right according to
>http://test.evolt.org/article/Using_Apache_to_stop_bad_robots/18/15126/?
>format=print
>Although I don't know if you need /*/ I think just /home/sites/ would
>cover every directory you're concerned about below that.
>
>You might want to see http://www.neilgunton.com/spambot_trap/ as well
>especially http://www.neilgunton.com/spambot_trap/bad_agents.txt
>

Thanks Dan,

I got the bad_bot environment thing from the link you published - I have an even bigger "bad_bots" list - it can be found at:

http://support.webyourbusiness.com/badbots.txt

The list you found has a list of 104 user-agents, I have 2.17, although some are duplicated with different version numbers, I have a far stricter determination on what is undesirable traffic!

regards

Greg Hewitt-Long

ps - if you spot something on my list that you consider "good" as a user-agent, please feel free to let me know why!
-- 
http://www.webyourbusiness.com/
Providers of E-Commerce Software &
Web Design Consultancy and Services.
PH: (970) 266-0195   FAX: (970) 266-0158