[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]
RE: [cobalt-users] blocking a crawler
- Subject: RE: [cobalt-users] blocking a crawler
- From: "Dan Kriwitsky" <webhosting@xxxxxxxxx>
- Date: Sun May 6 02:54:01 2001
- List-id: Mailing list for users to share thoughts on Cobalt products. <cobalt-users.list.cobalt.com>
> yeh, tried that, but ti is looking at one page all the time, not trying to
> crawl the site. I put the ip into ipchains without the -l option, so it
> won't be in the logs anymore.
>
The other option is in access.conf
<Directory /home/sites/site#/path/to/dir>
Order allow,deny
allow from all
deny from xx.xx.xxx.xx
#xx = IP
</Directory>
--
Dan Kriwitsky