[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

[cobalt-users] OT bot warnings



I just suffered what is almost a DOS. A company called Cyveillance crawled
my site ignoring my robots.txt and downloaded a couple GB of data.
63.148.99.245 is the IP.
Cyveillance (NETBLK-QWEST-63-148-99-224) QWEST-63-148-99-224
						 63.148.99.224 - 63.148.99.255

BTW, I also saw webclipping.com exhibiting the same behavior from
209.73.228.163.

And here I thought I was getting lots of good hits instead of useless
traffic.

--
Dan Kriwitsky