[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]
RE: [cobalt-users] Should I be concerned?
- Subject: RE: [cobalt-users] Should I be concerned?
- From: "Dan Kriwitsky" <list1@xxxxxxxxxxxxxxxxxxxx>
- Date: Mon Sep 16 12:05:13 2002
- List-id: Mailing list for users to share thoughts on Sun Cobalt products. <cobalt-users.list.cobalt.com>
> Excuse my dumbness, but where would this be correct/workable
> on my robots.txt file?
>
> User-agent: *
> Disallow: /cgi-bin/
> Disallow: /tmp/
> Disallow: /private/
> User-agent: oBot
> Disallow: /
>
Looks good to me. http://www.robotstxt.org/wc/robots.html
--
Dan Kriwitsky
Please reply to the list only. Offlist replies are not read.