Re: [cobalt-users] OT bot warnings

["Wayne Sagar" <shortfork@xxxxxxxxxxx>]

> Subject: [cobalt-users] OT bot warnings

> I just suffered what is almost a DOS. A company called Cyveillance crawled
> my site ignoring my robots.txt and downloaded a couple GB of data.
> 63.148.99.245 is the IP.
<snip>
> BTW, I also saw webclipping.com exhibiting the same behavior from
> 209.73.228.163.
>
> And here I thought I was getting lots of good hits instead of useless
> traffic.

<ducking & kidding!!!>

Just what does this have to do with Cobalt or RaQ's <ducking again and 
running>

<g> Actually Dan, the Webclippings visits are not that bad if you want to 
get your site "out there" I asked them to stop visiting at one point and 
then recinded the request on further inspection.

They not only look for plagarisim for the companies that suscribe to them, 
it would seem that they "book" you for reference to their suscribers, should 
you be of interest to them.

A couple years ago (and again this year) my main site was listed in the 
"aviation's top xx number of websites) book, which at first blush to me 
looked like a way for the publisher to get the webmasters "so honored" to 
buy thier book. I didn't and I did not list their link as asked on my site..

Not too long after the book published, I actually got a sponsor deal out of 
it by someone who's boss had asked them to survey aviation sites for places 
to assign their advertising..

So while I'm not totally sure about the webclippings nor do I know about the 
other one, sometimes what at first blush seems like useless traffic, or 
blatant self promotion by a company, is actually notable in at least you 
have become big enough to be noticed as needing to be monitored by the 
companies like webclippings.. and sometimes leads to a "sale"...

Wayne Sagar
(hopefully not still on your killfile list:)

_________________________________________________________________
Get your FREE download of MSN Explorer at http://explorer.msn.com/intl.asp