[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]
Re: [cobalt-users] Error 404 Page
- Subject: Re: [cobalt-users] Error 404 Page
- From: Shaun Masterman <shaun@xxxxxxxxxxxx>
- Date: Fri Apr 6 09:16:03 2001
- Organization: Headsets.com, Inc.
- List-id: Mailing list for users to share thoughts on Cobalt products. <cobalt-users.list.cobalt.com>
> I'm running it right now calling the error pages in the
> home directory and they are getting indexed by the
> search engines... (not good) ...snip...
If the search engines are picking it up, then they are following
a broken link to it, which won't change no matter how you
link the file in. Search engines don't scan your root folder for
files (they can't unless you don't have an index.html in your
web root, and you allow directory browsing), they go to the
page you submitted and follow the links therein. I'm surprised
any search engines include the page even after following a
link because an error code (either 404 or document redirect)
is reported back to the browser (I think!! :-) and search
spiders are supposedly smart enough to discard these...
Shaun.