Re: [cobalt-users] Robots.txt

["Zarrir Junior" <zarrir@xxxxxxxxxxxx>]

> > # Prevent all robots from visiting this site:
> > User-agent: *
> > Disallow: /
> Copy those lines you have above, name the file robots.txt, and drop it
> into the /web directory of whichever site you want to do this for.
> Alternatively, you can do this in particular folders rather than
> affecting the entire site by listing off the particular folders like
> so:
> User-agent: *
> Disallow: /members
> /images
> /somefolder
> /someotherfolder

            Thanks , Carrie!