aix5.3崩溃

eof007

出现问题时，基本登不进去，偶尔进去，执行命令是出错\r\n以下为一段log，启动执行成功过一次svmon，发现有很多free内存。\r\n有谁能给点提示吗？谢谢\r\n\r\n# snap -ac\r\n/usr/sbin/snap[4555]: 6222834 Killed\r\n/usr/sbin/snap[4873]: 6787682 Killed\r\n/usr/sbin/snap[4873]: 6222840 Killed\r\nChecking space requirement for general information/usr/sbin/snap[47]: 6787686 Killed\r\n. failed.\r\n\r\nsnap: invalid operation in function \"run_cmd\": \r\n        cmd=\'date > /tmp/ibmsupt/general/general.snap 2>&1\'\r\n        comp=\'general\'\r\n\r\n# snap -ac\r\n/usr/sbin/snap[4555]: 8458508 Killed\r\n/usr/sbin/snap[4560]: 6578816 Killed\r\n/usr/sbin/snap[4580]: 6639650 Killed\r\nCould not load program awk:\r\nSymbol resolution failed for awk because:\r\nThere is not enough kernel memory. Try again later.\r\nChecking space requirement for general information./usr/sbin/snap[47]: 6578836 Killed\r\n./usr/sbin/snap[16]: 6448018 Killed\r\n/usr/sbin/snap[47]: 6619648 Killed\r\n./usr/sbin/snap[47]: 6619654 Killed\r\n. failed.\r\n\r\nsnap: invalid operation in function \"run_cmd\": \r\n        cmd=\'trcnm > /tmp/ibmsupt/general/trcnm.out\'\r\n        comp=\'general\'\r\n\r\n# snap -ac\r\nChecking space requirement for general information./usr/sbin/snap[16]: 6484234 Killed\r\nAUTHSTATE=compat\r\nERRNO=25\r\nFCEDIT=/usr/bin/ed\r\nHISTFILE=/var/log/.hist/root/192.168.204.41.hist.20080116_142922\r\nHISTSIZE=4096\r\nHISTTIMEFORMAT=\'[%Y.%m.%d %H:%M:%S]\'\r\nHOME=/\r\nIFS=\'   \r\n\'\r\nLANG=en_US\r\nLC_CTYPE=C\r\nLC_MESSAGES=C\r\nLC_NUMERIC=C\r\nLC_TIME=C\r\nLC__FASTMSG=true\r\nLINENO=84\r\nLOCPATH=/usr/lib/nls/loc\r\nLOGIN=root\r\nLOGNAME=root\r\nMAIL=/usr/spool/mail/root\r\nMAILCHECK=600\r\nMAILMSG=\'[YOU HAVE NEW MAIL]\'\r\nNLSPATH=/usr/lib/nls/msg/%L/%N:/usr/lib/nls/msg/%L/%N.cat\r\nODMDIR=/etc/objrepos\r\nOPTIND=0\r\nPATH=/usr/bin:/etc:/usr/sbin:/usr/ucb:/usr/bin/X11:/sbin:/usr/bin:/etc:/usr/sbin:/usr/ucb:/usr/bin/X11:/sbin:/usr/java14/jre/bin:/usr/java14/bin:/usr/DynamicLinkManager/bin\r\nPPID=6443450\r\nPS2=\'> \'\r\nPS3=\'#? \'\r\nPS4=\'+ \'\r\nPWD=/\r\nRANDOM=11810\r\nSECONDS=1\r\nSHELL=/usr/bin/ksh\r\nTERM=vt100\r\nTMOUT=0\r\nTZ=BEIST-8\r\nUMASKSAVE=022\r\nUSER=root\r\n_=--\r\naction=y\r\nallarg=n\r\narchive_data=y\r\nascript=getRtasHeap\r\nbadargs=n\r\nbootinfo=/usr/sbin/bootinfo\r\ncmd=\'cp -p /var/adm/ras/trcfile  /tmp/ibmsupt/general >/dev/null 2>&1\'\r\ncmdto_ck=cp\r\ncom=exportfs\r\ncomp=general\r\ncomplist=\'async dump dump/autoload filesys general kernel lang nfs printer XS25 sna tcpip install ssa scraid lvm wlm hacmp pcixscsi\'\r\ncompress_header=\'\'\r\ndestdir=/tmp/ibmsupt\r\ndevice=n\r\ndevtype=\'\'\r\ndiagdir=/tmp/ibmsupt/general/diagnostics\r\ndirlist_all=\'async dump dump/autoload filesys general kernel lang nfs printer XS25 sna tcpip install ssa scraid lvm wlm hacmp pcixscsi testcase other\'\r\ndoXS25=n\r\ndoadump=n\r\ndoall=y\r\ndoasync=n\r\ndocheck=y\r\ndoclean=n\r\ndodev=n\r\ndodump=n\r\ndofs=n\r\ndogen=n\r\ndogenoscan=n\r\ndohacmp=n\r\ndohw=y\r\ndoinst=n\r\ndokern=n\r\ndolang=n\r\ndolvm=n\r\ndomflag=n\r\ndomtrace=n\r\ndoneparsingargs=n\r\ndonfs=n\r\ndopcixscsi=n\r\ndopred=y\r\ndoprt=n\r\ndoscanonly=n\r\ndoscraid=n\r\ndoscript=n\r\ndoscripta=y\r\ndosec=y\r\ndosna=n\r\ndosplit=n\r\ndossa=n\r\ndotar=y\r\ndotcp=n\r\ndoview=n\r\ndowlm=n\r\nfile_cnt=0\r\nfile_lst=\'\'\r\nfilearg=n\r\ngen_data=y\r\ngen_data_sub_command=n\r\ni=1\r\ninitsetup_done=n\r\nkernel=/unix\r\nmemsize=\'/usr/sbin/bootinfo -r\'\r\nmutualexclusion=y\r\nnetcmd=n\r\nnetcmdlist=\'df enq netstat arp rpcinfo exportfs\'\r\nnew_cmd=\'\'\r\nnodenames=\'\'\r\nnonparsedargument=n\r\nnumshifts=1\r\nnumtokensaftergetopt=2\r\nnumtokensbeforegetopt=1\r\nparameterlist=-ac\r\nparameters=\' \"-ac\"\'\r\nparametershifts=2\r\nparm=-ac\r\npassno=1\r\nscanfiles=\'\'\r\nscriptarg=n\r\nscriptdir=getRtasHeap\r\nscriptlist=\' lsvirt getRtasHeap \'\r\nscriptlista=\'svCollect,all lsvirt getRtasHeap\'\r\nscriptrepos=/usr/lib/ras/snapscripts\r\nscripts=\'svCollect,all lsvirt getRtasHeap\'\r\nsetfile=/tmp/ibmsupt/general/survdump.settings\r\nskipSsaAdapterDumpCollection=no\r\nsleep_time=5\r\nsnapdir=/tmp/ibmsupt/general\r\nsnapfile=/tmp/ibmsupt/general/general.snap\r\nsplitsize=0\r\nstate=\' 1 2 3 4 5 6 7 8 9 10 11 16 17 18 19 20 21 99 121 102\'\r\nstring=\'\'\r\ntemp_bytes=\'\'\r\ntokenlist=\' a  c   \'\r\ntotal_bytes=\'\'\r\ntrcfile=/var/adm/ras/trcfile\r\n./usr/sbin/snap[47]: 5448540 Killed\r\n../usr/sbin/snap[78]: 6484264 Killed\r\n. failed.\r\n\r\nsnap: invalid operation in function \"run_cmd\": \r\n        cmd=\'cp -p /etc/lpp/diagnostics/data/diagrpt* /tmp/ibmsupt/general/diagnostics >/dev/null 2>&1\'\r\n        comp=\'general\'\r\n\r\n# snap -ac\r\n/usr/sbin/snap[4555]: 6558718 Killed\r\nChecking space requirement for general information/usr/sbin/snap[16]: 5817244 Killed\r\n./usr/sbin/snap[2]: 5817248 Killed\r\n/usr/sbin/snap[78]: 5817252 Killed\r\n. failed.\r\n\r\nsnap: invalid operation in function \"run_cmd\": \r\n        cmd=\'cp -p /var/adm/ras/trcfile  /tmp/ibmsupt/general >/dev/null 2>&1\'\r\n        comp=\'general\'\r\n\r\n# snap -Ac\r\nKilled\r\n# \r\n# \r\n# \r\n# snap -ac\r\nKilled\r\n# snap -ac\r\n/usr/sbin/snap[4554]: 7418092 Killed\r\n/usr/sbin/snap[4555]: 7418094 Killed\r\n/usr/sbin/snap[4580]: 6189574 Killed\r\n/usr/sbin/snap[4873]: 7418098 Killed\r\nChecking space requirement for general information/usr/sbin/snap[16]: 6189584 Killed\r\n.AUTHSTATE=compat\r\nERRNO=25\r\nFCEDIT=/usr/bin/ed\r\nHISTFILE=/var/log/.hist/root/192.168.204.41.hist.20080116_142922\r\nHISTSIZE=4096\r\nHISTTIMEFORMAT=\'[%Y.%m.%d %H:%M:%S]\'\r\nHOME=/\r\nIFS=\'   \r\n\'\r\nLANG=en_US\r\nLC_CTYPE=C\r\nLC_MESSAGES=C\r\nLC_NUMERIC=C\r\nLC_TIME=C\r\nLC__FASTMSG=true\r\nLINENO=84\r\nLOCPATH=/usr/lib/nls/loc\r\nLOGIN=root\r\nLOGNAME=root\r\nMAIL=/usr/spool/mail/root\r\nMAILCHECK=600\r\nMAILMSG=\'[YOU HAVE NEW MAIL]\'\r\nNLSPATH=/usr/lib/nls/msg/%L/%N:/usr/lib/nls/msg/%L/%N.cat\r\nODMDIR=/etc/objrepos\r\nOPTIND=0\r\nPATH=/usr/bin:/etc:/usr/sbin:/usr/ucb:/usr/bin/X11:/sbin:/usr/bin:/etc:/usr/sbin:/usr/ucb:/usr/bin/X11:/sbin:/usr/java14/jre/bin:/usr/java14/bin:/usr/DynamicLinkManager/bin\r\nPPID=6443450\r\nPS2=\'> \'\r\nPS3=\'#? \'\r\nPS4=\'+ \'\r\nPWD=/\r\nRANDOM=11761\r\nSECONDS=0\r\nSHELL=/usr/bin/ksh\r\nTERM=vt100\r\nTMOUT=0\r\nTZ=BEIST-8\r\nUMASKSAVE=022\r\nUSER=root\r\n_=--\r\naction=y\r\nallarg=n\r\narchive_data=y\r\nascript=getRtasHeap\r\nbadargs=n\r\nbootinfo=/usr/sbin/bootinfo\r\ncmd=\'cp -p /var/adm/ras/trcfile  /tmp/ibmsupt/general >/dev/null 2>&1\'\r\ncmdto_ck=cp\r\ncom=exportfs\r\ncomp=general\r\ncomplist=\'async dump dump/autoload filesys general kernel lang nfs printer XS25 sna tcpip install ssa scraid lvm wlm hacmp pcixscsi\'\r\ncompress_header=\'\'\r\ndestdir=/tmp/ibmsupt\r\ndevice=n\r\ndevtype=\'\'\r\ndiagdir=/tmp/ibmsupt/general/diagnostics\r\ndirlist_all=\'async dump dump/autoload filesys general kernel lang nfs printer XS25 sna tcpip install ssa scraid lvm wlm hacmp pcixscsi testcase other\'\r\ndoXS25=n\r\ndoadump=n\r\ndoall=y\r\ndoasync=n\r\ndocheck=y\r\ndoclean=n\r\ndodev=n\r\ndodump=n\r\ndofs=n\r\ndogen=n\r\ndogenoscan=n\r\ndohacmp=n\r\ndohw=y\r\ndoinst=n\r\ndokern=n\r\ndolang=n\r\ndolvm=n\r\ndomflag=n\r\ndomtrace=n\r\ndoneparsingargs=n\r\ndonfs=n\r\ndopcixscsi=n\r\ndopred=y\r\ndoprt=n\r\ndoscanonly=n\r\ndoscraid=n\r\ndoscript=n\r\ndoscripta=y\r\ndosec=y\r\ndosna=n\r\ndosplit=n\r\ndossa=n\r\ndotar=y\r\ndotcp=n\r\ndoview=n\r\ndowlm=n\r\nfile_cnt=0\r\nfile_lst=\'\'\r\nfilearg=n\r\ngen_data=y\r\ngen_data_sub_command=n\r\ni=1\r\ninitsetup_done=n\r\nkernel=/unix\r\nmemsize=\'/usr/sbin/bootinfo -r\'\r\nmutualexclusion=y\r\nnetcmd=n\r\nnetcmdlist=\'df enq netstat arp rpcinfo exportfs\'\r\nnew_cmd=\'\'\r\nnodenames=\'\'\r\nnonparsedargument=n\r\nnumshifts=1\r\nnumtokensaftergetopt=\'\'\r\nnumtokensbeforegetopt=\'\'\r\nparameterlist=-ac\r\nparameters=\' \"-ac\"\'\r\nparametershifts=2\r\nparm=-ac\r\npassno=1\r\nscanfiles=\'\'\r\nscriptarg=n\r\nscriptdir=\'\'\r\nscriptlist=\'svCollect   \'\r\nscriptlista=\'svCollect,all lsvirt getRtasHeap\'\r\nscriptrepos=/usr/lib/ras/snapscripts\r\nscripts=\'svCollect,all lsvirt getRtasHeap\'\r\nsetfile=/tmp/ibmsupt/general/survdump.settings\r\nskipSsaAdapterDumpCollection=no\r\nsleep_time=5\r\nsnapdir=/tmp/ibmsupt/general\r\nsnapfile=/tmp/ibmsupt/general/general.snap\r\nsplitsize=0\r\nstate=\' 1 2 3 4 5 6 7 8 9 10 11 16 17 18 19 20 21 99 121 102\'\r\nstring=\'\'\r\ntemp_bytes=\'\'\r\ntokenlist=\' a  c   \'\r\ntotal_bytes=\'\'\r\ntrcfile=/var/adm/ras/trcfile\r\n./usr/sbin/snap[2]: 7417858 Killed\r\n/usr/sbin/snap[78]: 6189600 Killed\r\n. failed.\r\n\r\nsnap: invalid operation in function \"run_cmd\": \r\n        cmd=\'cp -p /etc/trcfmt /tmp/ibmsupt/general >/dev/null 2>&1\'\r\n        comp=\'general\'\r\n\r\n# svmon\r\nKilled\r\n# svmon\r\n               size      inuse       free        pin    virtual\r\nmemory     30408704   24396847    6011827   15469160   21502737\r\npg space    7864320     138673\r\n\r\n               work       pers       clnt\r\npin        15469160          0          0\r\nin use     21479309          0    2917538\r\n# svmon\r\nKilled\r\n# svmon\r\n               size      inuse       free        pin    virtual\r\nmemory     30408704   24391707    6017046   15469124   21497612\r\npg space    7864320     138641\r\n\r\n               work       pers       clnt\r\npin        15469124          0          0\r\nin use     21474229          0    2917478\r\n# df -k\r\nFilesystem    1024-blocks      Free %Used    Iused %Iused Mounted on\r\n/dev/hd4          2097152   1713156   19%     3064     1% /\r\n/dev/hd2          7733248   4293444   45%    41073     5% /usr\r\n/dev/hd9var       1048576    299796   72%     3354     5% /var\r\n/dev/hd3          2097152   1791948   15%      784     1% /tmp\r\n/dev/hd1          2097152   1838772   13%      311     1% /home\r\n/proc                   -         -    -         -     -  /proc\r\n/dev/hd10opt       131072     28176   79%     2333    27% /opt\r\n/dev/u01_lv     901775360 133531220   86%   239510     1% /u01\r\n/dev/fslv02     398458880 291844212   27%   340649     1% /erpdata_bak\r\n/dev/fslv01     398458880  89622588   78%     1200     1% /erparch\r\n\r\n# \r\n# \r\n# exit \r\n$ sqlplus \'/ as sysdba\'\r\nexec(): 0509-036 Cannot load program sqlplus because of the following errors:\r\n        0509-150   Dependent module libpthreads.a(shr_xpg5_64.o) could not be loaded.\r\n        0509-022 Cannot load module libpthreads.a(shr_xpg5_64.o).\r\n        0509-026 System error: There is not enough memory available now.\r\n$ sqlplus \'/ as sysdba\'\r\nexec(): 0509-036 Cannot load program sqlplus because of the following errors:\r\n        0509-150   Dependent module libpthreads.a(shr_xpg5_64.o) could not be loaded.\r\n        0509-022 Cannot load module libpthreads.a(shr_xpg5_64.o).\r\n        0509-026 System error: There is not enough memory available now.\r\n$ exit

liudw

你的系统缺少补丁84780