[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]
RE: [cobalt-users] HELP HELP HELP RAQ4r CPU slowly creeps up till server is un-usable
- Subject: RE: [cobalt-users] HELP HELP HELP RAQ4r CPU slowly creeps up till server is un-usable
- From: "Matt" <mattm@xxxxxxxxxx>
- Date: Fri Mar 21 09:15:02 2003
- Organization: Parcom Internet Web Hosting
- List-id: Mailing list for users to share thoughts on Sun Cobalt products. <cobalt-users.list.cobalt.com>
Here is my info when I run "df"
Filesystem 1k-blocks Used Available Use% Mounted on
/dev/md1 743371 671050 72321 91% /
/dev/md3 198275 127087 71188 65% /var
/dev/md4 18107071 3903420 14203651 22% /home
Here is my info when I run "free"
total used free shared buffers cached
Mem: 517104 422968 94136 516724 18724 159216
-/+ buffers/cache: 245028 272076
Swap: 131448 0 131448
Here is my info when I run "ps -aux"
USER PID %CPU %MEM VSZ RSS TTY STAT START TIME COMMAND
root 1 0.0 0.0 1120 472 ? S 07:23 0:04 init
root 2 0.0 0.0 0 0 ? SW 07:23 0:00 [kflushd]
root 3 0.0 0.0 0 0 ? SW 07:23 0:00 [kupdate]
root 4 0.0 0.0 0 0 ? SW 07:23 0:00 [kswapd]
root 5 0.0 0.0 0 0 ? SW< 07:24 0:00 [mdrecoveryd]
root 6 0.0 0.0 0 0 ? SW< 07:24 0:00 [raid1d]
root 7 0.0 0.0 0 0 ? SW< 07:24 0:00 [raid1d]
root 8 0.0 0.0 0 0 ? SW< 07:24 0:00 [raid1d]
root 9 0.0 0.0 0 0 ? SW< 07:24 0:00 [raid1d]
root 493 0.0 0.1 1172 524 ? S 07:25 0:05 syslogd -m 0
root 502 0.0 0.1 1436 768 ? S 07:25 0:00 klogd
root 556 0.0 0.1 1328 616 ? S 07:25 0:00 crond
root 568 0.0 0.0 1136 484 ? S 07:25 0:00 inetd
root 580 0.0 1.1 7704 5884 ? S 07:25 0:01
/usr/sbin/httpd.admsrv -f /etc/admserv/conf/httpd.conf
root 603 0.0 1.2 8300 6468 ? S 07:25 0:00
/usr/sbin/httpd.admsrv -f /etc/admserv/conf/httpd.conf
root 604 0.0 1.7 13560 9152 ? S 07:25 0:01
/usr/sbin/httpd -f /etc/httpd/conf/httpd.conf
root 633 0.0 0.2 2632 1376 ? S 07:25 0:00 sendmail:
rejecting connections on daemon MTA: load average: 125
httpd 662 0.3 2.7 18304 14264 ? S 07:25 0:21
/usr/sbin/httpd -f /etc/httpd/conf/httpd.conf
httpd 663 0.3 2.5 16816 12956 ? S 07:25 0:22
/usr/sbin/httpd -f /etc/httpd/conf/httpd.conf
httpd 664 0.2 2.4 16728 12868 ? S 07:25 0:18
/usr/sbin/httpd -f /etc/httpd/conf/httpd.conf
httpd 667 0.4 2.4 16768 12908 ? S 07:26 0:30
/usr/sbin/httpd -f /etc/httpd/conf/httpd.conf
httpd 668 0.4 2.5 17284 13372 ? S 07:26 0:28
/usr/sbin/httpd -f /etc/httpd/conf/httpd.conf
httpd 669 0.3 2.6 17712 13812 ? S 07:26 0:21
/usr/sbin/httpd -f /etc/httpd/conf/httpd.conf
httpd 670 0.3 2.4 16648 12732 ? S 07:26 0:21
/usr/sbin/httpd -f /etc/httpd/conf/httpd.conf
httpd 671 0.4 2.6 17308 13448 ? S 07:26 0:30
/usr/sbin/httpd -f /etc/httpd/conf/httpd.conf
httpd 672 0.3 2.6 17560 13648 ? S 07:26 0:21
/usr/sbin/httpd -f /etc/httpd/conf/httpd.conf
httpd 673 0.3 2.4 18192 12528 ? S 07:26 0:23
/usr/sbin/httpd -f /etc/httpd/conf/httpd.conf
postgres 675 0.0 0.2 4636 1332 ? SN 07:26 0:00
/usr/bin/postmaster
httpd 759 0.3 2.6 17608 13740 ? S 07:26 0:23
/usr/sbin/httpd -f /etc/httpd/conf/httpd.conf
root 849 0.0 0.1 1456 672 ? S 07:26 0:00
/home/chiliasp/asp-server-3000/caspd
root 850 0.0 0.1 1456 672 ? S 07:26 0:00
/home/chiliasp/asp-server-3000/caspd
root 851 0.0 0.1 1456 672 ? S 07:26 0:00
/home/chiliasp/asp-server-3000/caspd
root 858 0.0 1.1 9708 6056 ? S 07:26 0:00
/home/chiliasp/asp-server-3000/caspeng -p:3001 -mt:5
root 866 0.0 1.1 9708 6056 ? S 07:26 0:00
/home/chiliasp/asp-server-3000/caspeng -p:3001 -mt:5
root 867 0.0 1.1 9708 6056 ? S 07:26 0:00
/home/chiliasp/asp-server-3000/caspeng -p:3001 -mt:5
root 868 0.0 1.1 9708 6056 ? S 07:26 0:00
/home/chiliasp/asp-server-3000/caspeng -p:3001 -mt:5
root 869 0.0 1.1 9708 6056 ? S 07:26 0:00
/home/chiliasp/asp-server-3000/caspeng -p:3001 -mt:5
root 870 0.0 1.1 9708 6056 ? S 07:26 0:00
/home/chiliasp/asp-server-3000/caspeng -p:3001 -mt:5
root 871 0.0 1.1 9708 6056 ? S 07:26 0:00
/home/chiliasp/asp-server-3000/caspeng -p:3001 -mt:5
root 872 0.0 1.1 9708 6056 ? S 07:26 0:00
/home/chiliasp/asp-server-3000/caspeng -p:3001 -mt:5
httpd 996 0.3 2.7 18016 14080 ? S 07:26 0:23
/usr/sbin/httpd -f /etc/httpd/conf/httpd.conf
root 1317 0.0 0.1 1444 664 ? S 07:26 0:00
/home/chiliasp/admin/bin/admdog
root 1318 0.0 0.1 1444 664 ? S 07:26 0:00
/home/chiliasp/admin/bin/admdog
root 1319 0.0 0.1 1444 664 ? S 07:26 0:00
/home/chiliasp/admin/bin/admdog
root 1325 0.0 1.1 9604 5940 ? S 07:26 0:00
/home/chiliasp/admin/bin/admeng -p:5102 -mt:1
root 1328 0.0 1.1 9604 5940 ? S 07:26 0:00
/home/chiliasp/admin/bin/admeng -p:5102 -mt:1
root 1329 0.0 1.1 9604 5940 ? S 07:26 0:00
/home/chiliasp/admin/bin/admeng -p:5102 -mt:1
root 1330 0.0 1.1 9604 5940 ? S 07:26 0:00
/home/chiliasp/admin/bin/admeng -p:5102 -mt:1
root 1336 0.0 0.2 2408 1196 ? S 07:26 0:00
/home/chiliasp/admin/bin/admd -f /home/chiliasp/admin/conf/admd.conf
nobody 1339 0.0 0.2 2592 1292 ? S 07:26 0:00
/home/chiliasp/admin/bin/admd -f /home/chiliasp/admin/conf/admd.conf
root 1347 0.0 0.1 1672 824 ? S 07:26 0:00 sh
/usr/bin/safe_mysqld --datadir=/home/mysql --pid-file=/home/mysql/
httpd 1364 0.5 2.6 17480 13596 ? S 07:26 0:37
/usr/sbin/httpd -f /etc/httpd/conf/httpd.conf
root 1370 0.0 0.4 3640 2556 ? S 07:26 0:00 perl
/usr/local/sbin/poprelayd -d
mysql 1380 0.0 2.9 17640 15180 ? S 07:26 0:00
/usr/sbin/mysqld --basedir=/ --datadir=/home/mysql --user=mysql --pid
root 1382 0.0 1.2 8304 6464 ? S 07:26 0:00
/usr/sbin/httpd.admsrv -f /etc/admserv/conf/httpd.conf
mysql 1386 0.0 2.9 17612 15152 ? S 07:26 0:00
/usr/sbin/mysqld --basedir=/ --datadir=/home/mysql --user=mysql --pid
mysql 1387 0.0 2.9 17612 15152 ? S 07:26 0:00
/usr/sbin/mysqld --basedir=/ --datadir=/home/mysql --user=mysql --pid
root 1405 0.0 0.0 296 128 ? S 07:26 0:00
/sbin/lcdsleep
root 1466 0.0 0.0 1136 460 ? S 07:26 0:00 /sbin/getty
ttyS0 115200
root 1470 0.0 1.2 8308 6456 ? S 07:26 0:00
/usr/sbin/httpd.admsrv -f /etc/admserv/conf/httpd.conf
httpd 1589 0.3 2.5 16808 12948 ? S 07:28 0:25
/usr/sbin/httpd -f /etc/httpd/conf/httpd.conf
httpd 1645 0.3 2.3 15964 12104 ? S 07:28 0:24
/usr/sbin/httpd -f /etc/httpd/conf/httpd.conf
httpd 1691 0.3 2.6 19528 13652 ? S 07:29 0:24
/usr/sbin/httpd -f /etc/httpd/conf/httpd.conf
httpd 1694 0.4 2.4 16448 12588 ? S 07:29 0:26
/usr/sbin/httpd -f /etc/httpd/conf/httpd.conf
httpd 1695 0.2 2.4 16360 12496 ? S 07:29 0:18
/usr/sbin/httpd -f /etc/httpd/conf/httpd.conf
httpd 1739 0.4 2.3 18012 12328 ? S 07:29 0:26
/usr/sbin/httpd -f /etc/httpd/conf/httpd.conf
httpd 1741 0.5 2.6 17408 13548 ? S 07:29 0:33
/usr/sbin/httpd -f /etc/httpd/conf/httpd.conf
root 2029 0.0 1.2 8276 6400 ? S 07:32 0:00
/usr/sbin/httpd.admsrv -f /etc/admserv/conf/httpd.conf
httpd 4056 0.3 2.4 16516 12660 ? S 07:55 0:15
/usr/sbin/httpd -f /etc/httpd/conf/httpd.conf
httpd 4375 0.3 2.4 16600 12740 ? S 07:58 0:16
/usr/sbin/httpd -f /etc/httpd/conf/httpd.conf
httpd 5238 0.3 2.5 17208 13348 ? S 08:03 0:14
/usr/sbin/httpd -f /etc/httpd/conf/httpd.conf
httpd 6054 0.5 3.0 19732 15740 ? S 08:11 0:20
/usr/sbin/httpd -f /etc/httpd/conf/httpd.conf
httpd 6055 0.3 2.5 17152 13296 ? S 08:11 0:15
/usr/sbin/httpd -f /etc/httpd/conf/httpd.conf
root 6319 0.0 1.2 8296 6460 ? S 08:13 0:00
/usr/sbin/httpd.admsrv -f /etc/admserv/conf/httpd.conf
httpd 9080 0.2 2.2 15784 11784 ? S 08:42 0:05
/usr/sbin/httpd -f /etc/httpd/conf/httpd.conf
httpd 9405 0.2 2.3 16220 12216 ? S 08:47 0:04
/usr/sbin/httpd -f /etc/httpd/conf/httpd.conf
httpd 10650 0.2 2.2 15596 11600 ? S 09:04 0:01
/usr/sbin/httpd -f /etc/httpd/conf/httpd.conf
root 10652 0.0 0.3 2776 1672 ? S 09:04 0:00 sendmail:
server dsg4.mail.your-info.net [65.198.223.134] (may be for
root 10663 0.0 0.3 2984 1820 ? S 09:04 0:00 sendmail:
q2/h2LH4YA10663 dsg4.mail.your-info.net [65.198.223.134] (m
httpd 10678 0.1 2.2 15628 11612 ? S 09:04 0:01
/usr/sbin/httpd -f /etc/httpd/conf/httpd.conf
httpd 10727 0.1 2.2 15772 11768 ? S 09:05 0:01
/usr/sbin/httpd -f /etc/httpd/conf/httpd.conf
httpd 10833 0.2 2.2 15368 11500 ? S 09:09 0:01
/usr/sbin/httpd -f /etc/httpd/conf/httpd.conf
httpd 10860 0.1 2.1 15092 11232 ? S 09:09 0:00
/usr/sbin/httpd -f /etc/httpd/conf/httpd.conf
httpd 10861 0.0 2.0 14492 10500 ? S 09:09 0:00
/usr/sbin/httpd -f /etc/httpd/conf/httpd.conf
httpd 10862 0.0 1.8 15776 9712 ? S 09:09 0:00
/usr/sbin/httpd -f /etc/httpd/conf/httpd.conf
httpd 10878 0.1 2.1 15376 11348 ? S 09:10 0:00
/usr/sbin/httpd -f /etc/httpd/conf/httpd.conf
httpd 10888 0.1 2.1 15360 11336 ? S 09:10 0:00
/usr/sbin/httpd -f /etc/httpd/conf/httpd.conf
httpd 10903 0.2 2.1 15132 11256 ? S 09:10 0:00
/usr/sbin/httpd -f /etc/httpd/conf/httpd.conf
httpd 10905 0.1 2.1 15184 11156 ? S 09:10 0:00
/usr/sbin/httpd -f /etc/httpd/conf/httpd.conf
httpd 10906 0.1 2.1 14864 10988 ? S 09:10 0:00
/usr/sbin/httpd -f /etc/httpd/conf/httpd.conf
httpd 10979 0.1 2.1 15116 11180 ? S 09:12 0:00
/usr/sbin/httpd -f /etc/httpd/conf/httpd.conf
httpd 10988 0.1 2.1 14892 10988 ? S 09:12 0:00
/usr/sbin/httpd -f /etc/httpd/conf/httpd.conf
root 10992 0.7 1.8 10588 9368 ? R 09:13 0:01 perl
/usr/admserv/cgi-bin/.cobalt/siteList/siteList.cgi
httpd 11009 0.2 2.1 15092 11216 ? S 09:13 0:00
/usr/sbin/httpd -f /etc/httpd/conf/httpd.conf
root 11018 0.0 0.1 1472 756 ? S 09:13 0:00 in.telnetd:
216.127.51.50
httpd 11022 0.1 2.1 14892 10956 ? S 09:13 0:00
/usr/sbin/httpd -f /etc/httpd/conf/httpd.conf
httpd 11024 0.6 2.3 15948 12076 ? S 09:13 0:01
/usr/sbin/httpd -f /etc/httpd/conf/httpd.conf
mysql 11029 0.1 3.2 19288 16664 ? S 09:14 0:00
/usr/sbin/mysqld --basedir=/ --datadir=/home/mysql --user=mysql --pid
root 11030 0.0 0.1 2052 980 pts/0 S 09:14 0:00 login --
admin
mysql 11042 0.2 3.2 19288 16664 ? R 09:14 0:00
/usr/sbin/mysqld --basedir=/ --datadir=/home/mysql --user=mysql --pid
admin 11043 0.0 0.1 1724 964 pts/0 S 09:14 0:00 -bash
mysql 11050 0.5 3.2 19288 16824 ? S 09:14 0:00
/usr/sbin/mysqld --basedir=/ --datadir=/home/mysql --user=mysql --pid
mysql 11059 0.2 3.2 19288 16824 ? S 09:14 0:00
/usr/sbin/mysqld --basedir=/ --datadir=/home/mysql --user=mysql --pid
mysql 11060 0.3 3.2 19288 16848 ? S 09:14 0:00
/usr/sbin/mysqld --basedir=/ --datadir=/home/mysql --user=mysql --pid
root 11064 0.0 0.1 1328 652 ? S 09:15 0:00 CROND
root 11065 0.0 0.1 1644 732 ? S 09:15 0:00 /bin/bash -c
/usr/local/sbin/swatch >>/var/cobalt/adm.log 2>&1
mysql 11087 0.3 3.2 19288 16848 ? S 09:15 0:00
/usr/sbin/mysqld --basedir=/ --datadir=/home/mysql --user=mysql --pid
mysql 11093 0.4 3.2 19288 16848 ? R 09:15 0:00
/usr/sbin/mysqld --basedir=/ --datadir=/home/mysql --user=mysql --pid
root 11096 1.1 0.1 2084 920 ? R 09:15 0:00 in.qpopper -R
root 11105 1.1 0.2 2388 1308 ? R 09:16 0:00 proftpd:
connected: 24-90-15-73.nyc.rr.com (24.90.15.73:49165)
root 11110 1.4 0.1 2084 920 ? R 09:16 0:00 in.qpopper -R
root 11111 0.0 0.1 1676 800 ? S 09:16 0:00 sh
/etc/rc.d/init.d/lcd-showip
root 11119 1.9 0.1 2084 904 ? R 09:16 0:00 in.qpopper -R
root 11121 0.0 0.1 1680 820 ? S 09:16 0:00 bash
/sbin/lcdstop
mysql 11124 0.3 3.2 19288 16848 ? S 09:16 0:00
/usr/sbin/mysqld --basedir=/ --datadir=/home/mysql --user=mysql --pid
mysql 11125 0.0 3.2 19496 16944 ? S 09:17 0:00
/usr/sbin/mysqld --basedir=/ --datadir=/home/mysql --user=mysql --pid
admin 11126 0.0 0.1 2504 816 pts/0 R 09:17 0:00 ps -aux
root 11133 0.0 0.1 1676 820 ? S 09:17 0:00 bash
/sbin/lcdstop
root 11134 0.0 0.0 1100 428 ? R 09:17 0:00 pidof
/sbin/swritelcd
root 11136 0.0 0.2 2388 1308 ? R 09:17 0:00 proftpd:
connected: 24-90-15-73.nyc.rr.com (24.90.15.73:49166)
mysql 11137 0.0 3.2 19496 16944 ? S 09:17 0:00
/usr/sbin/mysqld --basedir=/ --datadir=/home/mysql --user=mysql --pid
mysql 11138 0.0 3.2 19496 16944 ? S 09:17 0:00
/usr/sbin/mysqld --basedir=/ --datadir=/home/mysql --user=mysql --pid
root 11139 0.0 0.1 2084 904 ? R 09:17 0:00 in.qpopper -R
root 11141 0.0 0.1 2084 880 ? R 09:17 0:00 in.qpopper -R
Once again if anyone could help me- it would be much appreciated.
Matt
-----Original Message-----
From: cobalt-users-admin@xxxxxxxxxxxxxxx
[mailto:cobalt-users-admin@xxxxxxxxxxxxxxx] On Behalf Of SteelHead
Sent: Friday, March 21, 2003 8:25 AM
To: cobalt-users@xxxxxxxxxxxxxxx
Subject: Re: [cobalt-users] HELP HELP HELP RAQ4r CPU slowly creeps up till
server is un-usable
check mem and partition useage as well.. you could have a swap problem or a
partition full. bill
----- Original Message -----
From: "Matt" <mattm@xxxxxxxxxx>
To: <cobalt-users@xxxxxxxxxxxxxxx>
Sent: Friday, March 21, 2003 7:15 AM
Subject: RE: [cobalt-users] HELP HELP HELP RAQ4r CPU slowly creeps up till
server is un-usable
> Does anyone else have any insight into this?
>
> Thank You,
>
> Matt
>
> -----Original Message-----
> From: cobalt-users-admin@xxxxxxxxxxxxxxx
> [mailto:cobalt-users-admin@xxxxxxxxxxxxxxx] On Behalf Of Matt
> Sent: Thursday, March 20, 2003 8:09 PM
> To: cobalt-users@xxxxxxxxxxxxxxx
> Subject: [cobalt-users] HELP HELP HELP RAQ4r CPU slowly creeps up till
> server is un-usable
>
>
> Hello,
>
> Alright this is a really weird issue and I am hoping that someone may
> have some insite on how to fix this- it has become to frustrating for
> words...
>
> What Happened:
> -Tuesday night around midnight my RAQ4r decided to max out the CPU
rendering
> SMTP useless and web pretty much the same. Every since then I have had
> to pretty much reboot the server ever hour... After that the server
> usually takes an hour for the CPU to ramp up to a critical state.
>
> What I have done.
> - First I though it was the mirroring between my two drive (I have the
> latest kernel installed---slow, fixed with echo ETC... command)
that
> wasn't it..
> - Second I thought it was Tomkat- Removed it from my httpd.conf file.. It
> doesn't start-- Which is good-- cause it would take forever to get the
> thing started.. I though that was eating my CPU... Nope! Wasn't it..
> - Third I have read every log file I can think of.. /var/log-->
> messages, secure, maillog, xferlog-- CD'd to httpd read access, error
> logs and I
have
> found nothing suspicious other that the usual CPU load to high,, POP
> login rejected cause Sendmail has shut it self off due to the 20%
> process limit (Which I have gone into the Sendmail.cf file and upped
> it to 80 just get users mail to send,, ;-( This is not good and I know
> that but,, I am in a bad situation..
> - Fourth I have tailed all of the logs above, mainly the access log in
httpd
> and watch the CPU usage- Hoping to find the ONE site that is killing
> my CPU.. But I have yet to find it.. I have also shut down the sites
> that I
> suspected- but this did not help either.. It's just a gradual process-
that
> the naked eye's cannot see..
>
> If anyone has experienced this, or heard about IT through someone's
> second cousins grandpa's brothers best friend ;-)) and can tell me
> about it or
how
> they fixed it-- Or another way to track it down IT WOULD BE SO GREATLY
> APPRECIATED!! I have put two day's into this problem and it's driving
> me nutz!
>
> Thank You,
>
> Matt
>
> _____________________________________
> cobalt-users mailing list
> cobalt-users@xxxxxxxxxxxxxxx
> To subscribe/unsubscribe, or to SEARCH THE ARCHIVES, go to:
> http://list.cobalt.com/mailman/listinfo/cobalt-users
>
>
> _____________________________________
> cobalt-users mailing list
> cobalt-users@xxxxxxxxxxxxxxx
> To subscribe/unsubscribe, or to SEARCH THE ARCHIVES, go to:
> http://list.cobalt.com/mailman/listinfo/cobalt-users
>
>
_____________________________________
cobalt-users mailing list
cobalt-users@xxxxxxxxxxxxxxx
To subscribe/unsubscribe, or to SEARCH THE ARCHIVES, go to:
http://list.cobalt.com/mailman/listinfo/cobalt-users