[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

RE: [cobalt-users] Should I be concerned?



>
> > The past 2 days I have been "scanned" by something or someone
> > called "oBot" for dozens of directories and files that have
> > never existed on any of my websites. The is creating a good
> > sized /var/log/httpd/error log file.
> >
> > Has anyone else seen this?
> > Is there a way to stop this?
> > Is it time to get out the scatter gun and start kicking some a__'s?
> >
>
> Is it only scanning one site or more?
>
> User-agent: oBot
> Disallow: /
>
> http://www.spiderhunter.com/ seems to say it's not really a spider.
>
Thanks Dan, it's only scanning 1 site so far but since all my sites link
together, I assume it will hit the others sooner or later.

Excuse my dumbness, but where would this be correct/workable on my
robots.txt file?

User-agent: *
Disallow: /cgi-bin/
Disallow: /tmp/
Disallow: /private/
User-agent: oBot
Disallow: /

Thanks