Re: [cobalt-users] [RaQ2] combined-access files

["H.P. Stroebel" <hpstr@xxxxxxxxxxxxx>]

Gerald Waugh schrieb:
> 
> Sorry for the amount of included data,
> but the "these items in my combined-access log files looked strange/
> Why is this user looking for robots.txt?

because it is a robot :-)

for more info consult for example
http://info.webcrawler.com/mak/projects/robots/norobots.html

-- 

H. P.  Ströbel

PGP Digital Fingerprint :
58E0 6ECB 620A A689 E206 
BCA8 300F BC45 6EEC F7C3

Yes, I do. But not Yahoo.