[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: [cobalt-users] Error 404 Page



> I'm running it right now calling the error pages in the 
> home directory and they are getting indexed by the 
> search engines... (not good) ...snip...

If the search engines are picking it up, then they are following 
a broken link to it, which won't change no matter how you 
link the file in. Search engines don't scan your root folder for 
files (they can't unless you don't have an index.html in your 
web root, and you allow directory browsing), they go to the 
page you submitted and follow the links therein. I'm surprised 
any search engines include the page even after following a 
link because an error code (either 404 or document redirect) 
is reported back to the browser (I think!! :-) and search 
spiders are supposedly smart enough to discard these...

Shaun.