[cobalt-users] Raq Mysteriously reboots

[Brian Kosick <briank@xxxxxxxx>]

Hello all,
	our Raq3 seems to be possessed, it reboots on its own.  I have not been 
able to put a finger on why it does it.  There seems to be nothing unusual 
happening in the logs, "except" for what appears to me to be a memory 
error.  Even the memory error doesn't show up all the time.  It happens 
very sporadically, for example, it rebooted itself four times in one day 
last week, and we go along fine for a month maybe more, then all of a 
sudden it'll do it all over again.

Has anyone else experienced this before?  If so, what was the problem and 
the solution?

> Nov 14 11:42:31 raq in.qpopper[12662]: [AUTH] Failed attempted login to
> carse from host (cle-ts2-250.ppp.nacs.net) 207.
> 166.194.250
> Nov 14 11:45:02 raq proftpd[12836]: raq.nacs.net (localhost[127.0.0.1]) -
> FTP session closed.
> Nov 14 11:45:06 raq telnetd[12840]: ttloop:  read: Broken pipe
> Nov 14 11:51:18 raq PAM_pwdb[13220]: authentication failure; (uid=0) ->
> barbs for qpop service
> Nov 14 11:51:29 raq in.qpopper[13220]: barbs at
> node-d8e9f4ca.powerinter.net (216.233.244.202): -ERR [AUTH] PAM authent
> ication failed for user "barbs": Authentication failure (7)
> Nov 14 11:51:29 raq in.qpopper[13220]: [AUTH] Failed attempted login to
> barbs from host (node-d8e9f4ca.powerinter.net)
> 216.233.244.202
> Nov 14 12:00:03 raq proftpd[13616]: raq.nacs.net (localhost[127.0.0.1]) -
> FTP session closed.
> Nov 14 12:00:06 raq telnetd[13620]: ttloop:  read: Broken pipe
> Nov 14 12:10:42 raq proftpd[12635]: 207.166.222.246
> (cle-ts9-48.ppp.nacs.net[207.166.209.48]) - FTP no transfer timeout
> , disconnected.
> Nov 14 12:15:03 raq proftpd[14271]: raq.nacs.net (localhost[127.0.0.1]) -
> FTP session closed.
> Nov 14 12:15:06 raq telnetd[14275]: ttloop:  read: Broken pipe
> Nov 14 12:23:47 raq syslogd 1.3-3: restart.
>
>
> Also did the Raq reboot last night?  here is am excerpt from about 4 AM
> this morning.
> If I'm not mistaken, are those memory errors that are popping up? Or
> perhaps maybe we have a bum processor?  Or incorrectly compiled
> kernel?  I'm thinking probably one of the first two though.
>
> 03:45:02 raq proftpd[28465]: raq.nacs.net (localhost[127.0.0.1]) - FTP
> session closed.
> Nov 14 03:45:05 raq telnetd[28469]: ttloop:  read: Broken pipe
> Nov 14 04:00:02 raq proftpd[28754]: raq.nacs.net (localhost[127.0.0.1]) -
> FTP session closed.
> Nov 14 04:00:06 raq telnetd[28760]: ttloop:  read: Broken pipe
> Nov 14 04:15:07 raq proftpd[29920]: raq.nacs.net (localhost[127.0.0.1]) -
> FTP session closed.
> Nov 14 04:15:12 raq telnetd[29947]: ttloop:  read: Broken pipe
> Nov 14 04:30:03 raq proftpd[30373]: raq.nacs.net (localhost[127.0.0.1]) -
> FTP session closed.
> Nov 14 04:30:07 raq telnetd[30379]: ttloop:  read: Broken pipe
> Nov 14 04:36:26 raq syslogd 1.3-3: restart.
> Nov 14 04:37:24 raq kernel: general protection fault: 0040
> Nov 14 04:37:24 raq kernel: CPU:    0
> Nov 14 04:37:24 raq kernel: EIP:    0010:[sys_newstat+82/116]
> Nov 14 04:37:24 raq kernel: EFLAGS: 00010287
> Nov 14 04:37:24 raq kernel: eax: bfffe710   ebx: 00000000   ecx:
> c023e960   edx: c03268f8
> Nov 14 04:37:24 raq kernel: esi: c3154e20   edi: 081c99e8   ebp:
> bfffe750   esp: c6e93fa0
> Nov 14 04:37:24 raq kernel: ds: 0018   es: 0018   ss: 0018
> Nov 14 04:37:24 raq kernel: Process parseReport.pl (pid: 30659, process nr:
> 125, stackpage=c6e93000)
> Nov 14 04:37:24 raq kernel: Stack: c6e93fbc c6e92000 080c6960 08548340
> bfffe5b0 ffffff00 c0109049 c6e93fc4
> Nov 14 04:37:24 raq kernel:        c0108f38 081c99e8 bfffe710 04040004
> 080c6960 081c99e8 bfffe750 0000006a
> Nov 14 04:37:24 raq kernel:        0000002b 0000002b 0000006a 4012d53d
> 00000023 00000202 bfffe700 0000002b
> Nov 14 04:37:24 raq kernel: Call Trace: [error_code+45/52] 
[system_call+52/56]
> Nov 14 04:37:24 raq kernel: Code: cb 46 08 50 e8 15 fe ff ff 89 c3 83 c4 10
> 83 c4 f4 56 e8 e7
> Nov 14 04:37:24 raq kernel: general protection fault: fbc8
> Nov 14 04:37:24 raq kernel: CPU:    0
> Nov 14 04:37:24 raq kernel: EIP:    0010:[sys_newstat+82/116]
> Nov 14 04:37:24 raq kernel: EFLAGS: 00010287
> Nov 14 04:37:24 raq kernel: eax: bffffcc0   ebx: 00000000   ecx:
> c023e960   edx: c038a0d8
> Nov 14 04:37:24 raq kernel: esi: c6b86440   edi: 087a7820   ebp:
> bffffd00   esp: c94f9fa0
> Nov 14 04:37:24 raq kernel: ds: 0018   es: 0018   ss: 0018
> Nov 14 04:37:24 raq kernel: Process split_logs (pid: 30518, process nr:
> 164, stackpage=c94f9000)
> Nov 14 04:37:24 raq kernel: Stack: 00000000 c94f8000 080c6960 00000000
> 00000000 c01241c4 c0109049 c94f9fc4
> Nov 14 04:37:24 raq kernel:        c0108f38 087a7820 bffffcc0 04040004
> 080c6960 087a7820 bffffd00 0000006a
> Nov 14 04:37:24 raq kernel:        0000002b 0000002b 0000006a 4012d53d
> 00000023 00000202 bffffcb0 0000002b
> Nov 14 04:37:24 raq kernel: Call Trace: [sys_read+0/208] [error_code+45/52]
> [system_call+52/56]
> Nov 14 04:37:24 raq kernel: Code: cb 46 08 50 e8 15 fe ff ff 89 c3 83 c4 10
> 83 c4 f4 56 e8 e7
> Nov 14 04:45:02 raq proftpd[30926]: raq.nacs.net (localhost[127.0.0.1]) -
> FTP session closed.
> Nov 14 04:45:05 raq telnetd[30930]: ttloop:  read: Broken pipe
> Nov 14 05:00:07 raq proftpd[31307]: raq.nacs.net (localhost[127.0.0.1]) -
> FTP session closed.
> Nov 14 05:00:12 raq telnetd[31313]: ttloop:  read: Broken pipe
> Nov 14 05:15:01 raq proftpd[31590]: raq.nacs.net (localhost[127.0.0.1]) -
> FTP session closed.
> Nov 14 05:15:04 raq telnetd[31594]: ttloop:  read: Broken pipe
Brian Kosick
Web Programmer
New Age Consulting Service, Inc.
216-619-2000
briank@xxxxxxxx