[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]
RE: [cobalt-users] Should I be concerned?
- Subject: RE: [cobalt-users] Should I be concerned?
- From: Bob G7 <Bob_G7@xxxxxxxxxx>
- Date: Mon Sep 16 11:54:01 2002
- List-id: Mailing list for users to share thoughts on Sun Cobalt products. <cobalt-users.list.cobalt.com>
>
> > The past 2 days I have been "scanned" by something or someone
> > called "oBot" for dozens of directories and files that have
> > never existed on any of my websites. The is creating a good
> > sized /var/log/httpd/error log file.
> >
> > Has anyone else seen this?
> > Is there a way to stop this?
> > Is it time to get out the scatter gun and start kicking some a__'s?
> >
>
> Is it only scanning one site or more?
>
> User-agent: oBot
> Disallow: /
>
> http://www.spiderhunter.com/ seems to say it's not really a spider.
>
Thanks Dan, it's only scanning 1 site so far but since all my sites link
together, I assume it will hit the others sooner or later.
Excuse my dumbness, but where would this be correct/workable on my
robots.txt file?
User-agent: *
Disallow: /cgi-bin/
Disallow: /tmp/
Disallow: /private/
User-agent: oBot
Disallow: /
Thanks