[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]
Re: [cobalt-users] OT bot warnings
- Subject: Re: [cobalt-users] OT bot warnings
- From: SteelHead <brk@xxxxxxxxxxxxxxxx>
- Date: Tue Oct 23 18:39:30 2001
- Organization: LinuxHelpers
- List-id: Mailing list for users to share thoughts on Cobalt products. <cobalt-users.list.cobalt.com>
On Monday 22 October 2001 20:18, Dan Kriwitsky wrote:
> I just suffered what is almost a DOS. A company called
> Cyveillance crawled my site ignoring my robots.txt and
> downloaded a couple GB of data. 63.148.99.245 is the IP.
> Cyveillance (NETBLK-QWEST-63-148-99-224)
> QWEST-63-148-99-224 63.148.99.224 - 63.148.99.255
>
> BTW, I also saw webclipping.com exhibiting the same
> behavior from 209.73.228.163.
>
> And here I thought I was getting lots of good hits
> instead of useless traffic.
>
> --
> Dan Kriwitsky
>
>Ouch,
Thanks for the heads up.
Did you see a way to shut them out by ip blocking, or is is
a multiple ip# crawler?
Bill