[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]
RE: [cobalt-users] Robots.txt
- Subject: RE: [cobalt-users] Robots.txt
- From: Dom Latter <DLatter@xxxxxxxxxxxxxxx>
- Date: Wed Jun 20 03:45:27 2001
- List-id: Mailing list for users to share thoughts on Cobalt products. <cobalt-users.list.cobalt.com>
Zarrir Junior [mailto:zarrir@xxxxxxxxxxxx] wrote:
> How can i, for instance forbid a robot to search my pages?
It's worth pointing out that robots.txt is only advisory.