请帮忙分析错误日志hs_err_pid.log

rain4321

5.17        hs_err_pid1887.log
#
# An unexpected error has been detected by HotSpot Virtual Machine:
#
#  Internal Error (/CLO/Components/JAVA_HOTSPOT/Src/src/share/vm/gc_implementation/parallelScavenge/parallelScavengeHeap.cpp, 544), pid=1887, tid=11
#
# Java VM: Java HotSpot(TM) Server VM (1.4.2 1.4.2.17-071106-04:26-PA_RISC2.0 PA2.0 (aCC_AP) mixed mode)
#
# Error: Unimplemented()

---------------  T H R E A D  ---------------

Current thread (000167d0):  VMThread [id=11, lwp_id=1045274]

Stack: [d97f9000,d9879000)
VM_Operation (d842b920): VM_HeapDumper, mode: safepoint, requested by thread 00095ec0


---------------  P R O C E S S  ---------------

Java Threads: ( => current thread )
  01cc0598 JavaThread "ExecuteThread: '14' for queue: 'JmsDispatcher'" daemon [_thread_blocked, id=98, lwp_id=1045482]
  01cc0428 JavaThread "ExecuteThread: '13' for queue: 'JmsDispatcher'" daemon [_thread_blocked, id=97, lwp_id=1045481]
  01cc02b8 JavaThread "ExecuteThread: '12' for queue: 'JmsDispatcher'" daemon [_thread_blocked, id=96, lwp_id=1045480]
  01cc0148 JavaThread "ExecuteThread: '11' for queue: 'JmsDispatcher'" daemon [_thread_blocked, id=95, lwp_id=1045479]
  01cbffd8 JavaThread "ExecuteThread: '10' for queue: 'JmsDispatcher'" daemon [_thread_blocked, id=94, lwp_id=1045478]
  01cbfe68 JavaThread "ExecuteThread: '9' for queue: 'JmsDispatcher'" daemon [_thread_blocked, id=93, lwp_id=1045477]
  01cbfcf8 JavaThread "ExecuteThread: '8' for queue: 'JmsDispatcher'" daemon [_thread_blocked, id=92, lwp_id=1045476]
  01cbfb88 JavaThread "ExecuteThread: '7' for queue: 'JmsDispatcher'" daemon [_thread_blocked, id=91, lwp_id=1045475]
  01cbfa18 JavaThread "ExecuteThread: '6' for queue: 'JmsDispatcher'" daemon [_thread_blocked, id=90, lwp_id=1045474]
  01cbf8a8 JavaThread "ExecuteThread: '5' for queue: 'JmsDispatcher'" daemon [_thread_blocked, id=89, lwp_id=1045462]
  01cbf738 JavaThread "ExecuteThread: '4' for queue: 'JmsDispatcher'" daemon [_thread_blocked, id=88, lwp_id=1045447]
  01cbf5c8 JavaThread "ExecuteThread: '3' for queue: 'JmsDispatcher'" daemon [_thread_blocked, id=87, lwp_id=1045436]
  01cbf458 JavaThread "ExecuteThread: '2' for queue: 'JmsDispatcher'" daemon [_thread_blocked, id=86, lwp_id=1045432]
  01cbf2e8 JavaThread "ExecuteThread: '1' for queue: 'JmsDispatcher'" daemon [_thread_blocked, id=85, lwp_id=1045431]
  01cbf178 JavaThread "ExecuteThread: '0' for queue: 'JmsDispatcher'" daemon [_thread_blocked, id=84, lwp_id=1045430]
  01cbf008 JavaThread "ExecuteThread: '8' for queue: 'weblogic.socket.Muxer'" daemon [_thread_blocked, id=83, lwp_id=1045426]
  01cbee98 JavaThread "ExecuteThread: '7' for queue: 'weblogic.socket.Muxer'" daemon [_thread_blocked, id=82, lwp_id=1045425]
  01cbed28 JavaThread "ExecuteThread: '6' for queue: 'weblogic.socket.Muxer'" daemon [_thread_blocked, id=81, lwp_id=1045424]
  01cbebb8 JavaThread "ExecuteThread: '5' for queue: 'weblogic.socket.Muxer'" daemon [_thread_blocked, id=80, lwp_id=1045423]
  01cbea48 JavaThread "ExecuteThread: '4' for queue: 'weblogic.socket.Muxer'" daemon [_thread_blocked, id=79, lwp_id=1045422]
  01cbe8d8 JavaThread "ExecuteThread: '3' for queue: 'weblogic.socket.Muxer'" daemon [_thread_blocked, id=78, lwp_id=1045421]
  01cbe768 JavaThread "ExecuteThread: '2' for queue: 'weblogic.socket.Muxer'" daemon [_thread_blocked, id=77, lwp_id=1045420]
  01cbe5f8 JavaThread "ExecuteThread: '1' for queue: 'weblogic.socket.Muxer'" daemon [_thread_blocked, id=76, lwp_id=1045419]
  01cbe488 JavaThread "ExecuteThread: '0' for queue: 'weblogic.socket.Muxer'" daemon [_thread_blocked, id=75, lwp_id=1045418]
  00098140 JavaThread "ListenThread.Default" [_thread_blocked, id=74, lwp_id=1045417]
  00097fd0 JavaThread "Thread-9" [_thread_blocked, id=73, lwp_id=1045416]
  02b27758 JavaThread "ExecuteThread: '5' for queue: 'JMS.TimerClientPool'" daemon [_thread_blocked, id=72, lwp_id=1045415]
  02b275e8 JavaThread "ExecuteThread: '4' for queue: 'JMS.TimerClientPool'" daemon [_thread_blocked, id=71, lwp_id=1045414]
  02b27478 JavaThread "ExecuteThread: '3' for queue: 'JMS.TimerClientPool'" daemon [_thread_blocked, id=70, lwp_id=1045413]
  02b27308 JavaThread "ExecuteThread: '2' for queue: 'JMS.TimerClientPool'" daemon [_thread_blocked, id=69, lwp_id=1045412]
  02b27198 JavaThread "ExecuteThread: '1' for queue: 'JMS.TimerClientPool'" daemon [_thread_blocked, id=68, lwp_id=1045411]
  02b27028 JavaThread "ExecuteThread: '0' for queue: 'JMS.TimerClientPool'" daemon [_thread_blocked, id=67, lwp_id=1045410]
  00097e60 JavaThread "Thread-8" daemon [_thread_blocked, id=66, lwp_id=1045409]
  00097cf0 JavaThread "Thread-7" daemon [_thread_blocked, id=65, lwp_id=1045408]
  00097b80 JavaThread "ExecuteThread: '0' for queue: 'JMS.TimerTreePool'" daemon [_thread_blocked, id=64, lwp_id=1045407]
  00097a10 JavaThread "Thread-6" [_thread_blocked, id=63, lwp_id=1045406]
  000978a0 JavaThread "weblogic.health.CoreHealthMonitor" daemon [_thread_blocked, id=62, lwp_id=1045405]
  00097170 JavaThread "Thread-5" [_thread_blocked, id=61, lwp_id=1045404]
  02563200 JavaThread "DoSManager" [_thread_blocked, id=60, lwp_id=1045401]
  00097730 JavaThread "VDE Transaction Processor Thread" [_thread_blocked, id=58, lwp_id=1045399]
  000975c0 JavaThread "ExecuteThread: '2' for queue: 'weblogic.admin.RMI'" daemon [_thread_blocked, id=57, lwp_id=1045398]
  00097450 JavaThread "ExecuteThread: '1' for queue: 'weblogic.admin.RMI'" daemon [_thread_blocked, id=56, lwp_id=1045397]
  000972e0 JavaThread "ExecuteThread: '0' for queue: 'weblogic.admin.RMI'" daemon [_thread_blocked, id=55, lwp_id=1045396]
  00094090 JavaThread "ExecuteThread: '1' for queue: 'weblogic.admin.HTTP'" daemon [_thread_blocked, id=54, lwp_id=1045395]
  00094370 JavaThread "ExecuteThread: '0' for queue: 'weblogic.admin.HTTP'" daemon [_thread_blocked, id=53, lwp_id=1045394]
  000944e0 JavaThread "weblogic.security.SpinnerRandomSource" daemon [_thread_blocked, id=52, lwp_id=1045393]
  00097000 JavaThread "weblogic.time.TimeEventGenerator" daemon [_thread_blocked, id=51, lwp_id=1045392]
  00096e90 JavaThread "ExecuteThread: '4' for queue: 'weblogic.kernel.System'" daemon [_thread_blocked, id=50, lwp_id=1045391]
  00096d20 JavaThread "ExecuteThread: '3' for queue: 'weblogic.kernel.System'" daemon [_thread_blocked, id=49, lwp_id=1045390]
  00096bb0 JavaThread "ExecuteThread: '2' for queue: 'weblogic.kernel.System'" daemon [_thread_blocked, id=48, lwp_id=1045389]
  00096a40 JavaThread "ExecuteThread: '1' for queue: 'weblogic.kernel.System'" daemon [_thread_blocked, id=47, lwp_id=1045388]
  000968d0 JavaThread "ExecuteThread: '0' for queue: 'weblogic.kernel.System'" daemon [_thread_blocked, id=46, lwp_id=1045387]
  00096760 JavaThread "ExecuteThread: '24' for queue: 'weblogic.kernel.Default'" daemon [_thread_blocked, id=45, lwp_id=1045386]
  000965f0 JavaThread "ExecuteThread: '23' for queue: 'weblogic.kernel.Default'" daemon [_thread_blocked, id=44, lwp_id=1045385]
  00096480 JavaThread "ExecuteThread: '22' for queue: 'weblogic.kernel.Default'" daemon [unknown thread state, id=43, lwp_id=1045384]
  00096310 JavaThread "ExecuteThread: '21' for queue: 'weblogic.kernel.Default'" daemon [_thread_blocked, id=42, lwp_id=1045383]
  000961a0 JavaThread "ExecuteThread: '20' for queue: 'weblogic.kernel.Default'" daemon [_thread_blocked, id=41, lwp_id=1045382]
  00096030 JavaThread "ExecuteThread: '19' for queue: 'weblogic.kernel.Default'" daemon [_thread_blocked, id=40, lwp_id=1045381]
  00095ec0 JavaThread "ExecuteThread: '18' for queue: 'weblogic.kernel.Default'" daemon [_thread_blocked, id=39, lwp_id=1045380]
  00095d50 JavaThread "ExecuteThread: '17' for queue: 'weblogic.kernel.Default'" daemon [_thread_blocked, id=38, lwp_id=1045379]
  00095be0 JavaThread "ExecuteThread: '16' for queue: 'weblogic.kernel.Default'" daemon [_thread_blocked, id=37, lwp_id=1045378]
  00095a70 JavaThread "ExecuteThread: '15' for queue: 'weblogic.kernel.Default'" daemon [_thread_blocked, id=36, lwp_id=1045377]
  00095900 JavaThread "ExecuteThread: '14' for queue: 'weblogic.kernel.Default'" daemon [_thread_blocked, id=35, lwp_id=1045376]
  00095790 JavaThread "ExecuteThread: '13' for queue: 'weblogic.kernel.Default'" daemon [_thread_blocked, id=34, lwp_id=1045375]
  00095620 JavaThread "ExecuteThread: '12' for queue: 'weblogic.kernel.Default'" daemon [_thread_blocked, id=33, lwp_id=1045374]
  000954b0 JavaThread "ExecuteThread: '11' for queue: 'weblogic.kernel.Default'" daemon [_thread_blocked, id=32, lwp_id=1045373]
  00095340 JavaThread "ExecuteThread: '10' for queue: 'weblogic.kernel.Default'" daemon [_thread_blocked, id=31, lwp_id=1045372]
  000951d0 JavaThread "ExecuteThread: '9' for queue: 'weblogic.kernel.Default'" daemon [_thread_blocked, id=30, lwp_id=1045371]
  00095060 JavaThread "ExecuteThread: '8' for queue: 'weblogic.kernel.Default'" daemon [_thread_blocked, id=29, lwp_id=1045370]
  00094ef0 JavaThread "ExecuteThread: '7' for queue: 'weblogic.kernel.Default'" daemon [_thread_blocked, id=28, lwp_id=1045369]
  00094d80 JavaThread "ExecuteThread: '6' for queue: 'weblogic.kernel.Default'" daemon [_thread_blocked, id=27, lwp_id=1045368]
  00094c10 JavaThread "ExecuteThread: '5' for queue: 'weblogic.kernel.Default'" daemon [_thread_blocked, id=26, lwp_id=1045367]
  00094aa0 JavaThread "ExecuteThread: '4' for queue: 'weblogic.kernel.Default'" daemon [_thread_blocked, id=25, lwp_id=1045366]
  00094930 JavaThread "ExecuteThread: '3' for queue: 'weblogic.kernel.Default'" daemon [_thread_blocked, id=24, lwp_id=1045364]
  000947c0 JavaThread "ExecuteThread: '2' for queue: 'weblogic.kernel.Default'" daemon [_thread_blocked, id=23, lwp_id=1045363]
  00094650 JavaThread "ExecuteThread: '1' for queue: 'weblogic.kernel.Default'" daemon [_thread_blocked, id=22, lwp_id=1045362]
  00094200 JavaThread "ExecuteThread: '0' for queue: 'weblogic.kernel.Default'" daemon [_thread_blocked, id=21, lwp_id=1045361]
  00093f20 JavaThread "Thread-1" daemon [_thread_blocked, id=20, lwp_id=1045359]
  008095e0 JavaThread "CompilerThread1" daemon [_thread_blocked, id=18, lwp_id=1045281]
  00808b88 JavaThread "CompilerThread0" daemon [_thread_blocked, id=17, lwp_id=1045280]
  000be260 JavaThread "AdapterThread" daemon [_thread_blocked, id=16, lwp_id=1045279]
  00093db0 JavaThread "Signal Dispatcher" daemon [_thread_blocked, id=15, lwp_id=1045278]
  00093c40 JavaThread "Finalizer" daemon [_thread_blocked, id=13, lwp_id=1045276]
  00093ad0 JavaThread "Reference Handler" daemon [_thread_blocked, id=12, lwp_id=1045275]
  00093960 JavaThread "main" [_thread_blocked, id=1, lwp_id=1045223]

Other Threads:
=>000167d0 VMThread [id=11, lwp_id=1045274]
  00016980 WatcherThread [id=19, lwp_id=1045282]

VM state:at safepoint (normal execution)

VM Mutex/Monitor currently owned by a thread:  ([mutex/lock_event])
[0001c7f8/00059c28]  - owner thread: 000167d0
[00037378/0005a1c8]  - owner thread: 00095ec0

Heap
PSYoungGen      total 355840K, used 225280K [da400000, f7f00000, f7f00000)
  eden [da400000,e8000000,e8000000)
  from [eff80000,eff80000,f7f00000)
  to   [e8000000,e8000000,eff80000)
PSOldGen        total 1459200K, used 1459200K [66c00000, bfd00000, bfd00000)
  object [66c00000,bfd00000,bfd00000)
PSPermGen       total 1048576K, used 79780K [26c00000, 66c00000, 66c00000)
  object [26c00000,2b9e91e8,66c00000)

Dynamic libraries:
/opt/java1.4/bin/PA_RISC2.0/java
        text:0x00001000-0x00010ffc data:0x00011000-0x00012ef8
/opt/java1.4/jre/lib/PA_RISC2.0/server/libjvm.sl
        text:0xfa400000-0xfae84000 data:0xfa23b000-0xfa400000
/usr/lib/libpthread.1
        text:0xfa102000-0xfa11b000 data:0xfa0ff000-0xfa102000
/usr/lib/libm.2
        text:0xfa11c000-0xfa148000 data:0xfa11b000-0xfa11c000
/usr/lib/librt.2
        text:0xfa149000-0xfa14d000 data:0xfa148000-0xfa149000
/usr/lib/libcl.2
        text:0xfa150000-0xfa23b000 data:0xfae85000-0xfae91000
/usr/lib/libisamstub.1
        text:0xfae84000-0xfae85000 data:0xfa14d000-0xfa14e000
/usr/lib/libCsup.2
        text:0xfae94000-0xfaeaf000 data:0xfae91000-0xfae94000
/usr/lib/libc.2
        text:0xfaed6000-0xfb01c000 data:0xfaec3000-0xfaed6000
/usr/lib/libdld.2
        text:0xfaebc000-0xfaebf000 data:0xfaebb000-0xfaebc000
/opt/java1.4/jre/lib/PA_RISC2.0/native_threads/libhpi.sl
        text:0xfa0eb000-0xfa0fd000 data:0xfa0ea000-0xfa0eb000
/usr/lib/libnss_files.1
        text:0xfa0df000-0xfa0e8000 data:0xfa0de000-0xfa0df000
/opt/java1.4/jre/lib/PA_RISC2.0/libverify.sl
        text:0xfa04d000-0xfa05d000 data:0xfa04c000-0xfa04d000
/opt/java1.4/jre/lib/PA_RISC2.0/libjava.sl
        text:0xfa023000-0xfa04c000 data:0xfa021000-0xfa023000
/opt/java1.4/jre/lib/PA_RISC2.0/libzip.sl
        text:0xfa00b000-0xfa01f000 data:0xfa009000-0xfa00b000
/usr/lib/nls/loc/locales.2/zh_CN.hp15CN
        text:0xfa006000-0xfa009000 data:0xd9652000-0xd9777000
/usr/lib/nls/loc/methods.2/libhp15CN.sl
        text:0xfa004000-0xfa006000 data:0xfa003000-0xfa004000
/opt/java1.4/jre/lib/PA_RISC2.0/libnet.sl
        text:0xf7f70000-0xf7f80000 data:0xfa002000-0xfa003000
/usr/lib/libnm.sl
        text:0xf7f65000-0xf7f70000 data:0xfa001000-0xfa002000
/usr/lib/libnss_dns.1
        text:0xf7f5f000-0xf7f65000 data:0xfa000000-0xfa001000
/usr/lib/libnss_nis.1
        text:0xf7f58000-0xf7f5f000 data:0xf7f57000-0xf7f58000
/usr/lib/libnsl.1
        text:0xd8e3d000-0xd8ecc000 data:0xf7f4a000-0xf7f57000
/usr/lib/libxti.2
        text:0xf7f2e000-0xf7f46000 data:0xf7f2b000-0xf7f2e000
/opt/bea2/weblogic81/server/lib/hpux11/libweblogicunix1.sl
        text:0xf7f28000-0xf7f2b000 data:0xf7f27000-0xf7f28000
/usr/lib/libnsl_s.2
        text:0xf7f0f000-0xf7f27000 data:0xf7f0c000-0xf7f0f000
/opt/java1.4/jre/lib/PA_RISC2.0/libnio.sl
        text:0xf7f05000-0xf7f0c000 data:0xf7f04000-0xf7f05000
/opt/java1.4/jre/lib/PA_RISC2.0/libioser12.sl
        text:0xda2fa000-0xda2fe000 data:0xf7f01000-0xf7f02000
/opt/bea2/weblogic81/server/lib/hpux11/libmuxer.sl
        text:0xda2f7000-0xda2fa000 data:0xf7f00000-0xf7f01000

VM Arguments:
jvm_args: -Xms1900m -Xmx1900m -XXermSize=1024m -XX:MaxPermSize=1024m -XX:NewRatio=3 -XX:SurvivorRatio=10 -XX:+UseParallelGC -XX:+UseAdaptiveSizePolicy -Xloggc:/opt/bea2/weblogic81/wbb.log -XX:+HeapDumpOnOutOfMemoryError -XX:+PrintGCDetails -Dweblogic.PosixSocketReaders=9 -Dweblogic.Name=myserver -Dweblogic.ProductionModeEnabled=true -Djava.security.policy=/opt/bea2/weblogic81/server/lib/weblogic.policy
java_command: weblogic.Server
Launcher Type: generic

Environment Variables:
JAVA_HOME=/opt/java1.4
CLASSPATH=/opt/pdm/bea/src/cpdm/classes:/opt/java1.4/lib/tools.jar:/opt/bea2/weblogic81/server/lib/weblogic_sp.jar:/opt/bea2/weblogic81/server/lib/weblogic.jar:/opt/bea2/weblogic81/server/lib/ojdbc14.jar::/opt/bea2/weblogic81/common/eval/pointbase/lib/pbserver44.jar:/opt/bea2/weblogic81/common/eval/pointbase/lib/pbclient44.jar:/opt/java1.4/jre/lib/rt.jar:/opt/bea2/weblogic81/server/lib/webservices.jar:
PATH=/opt/bea2/weblogic81/server/bin:/opt/java1.4/jre/bin:/opt/java1.4/bin:/usr/sbin:/usr/bin:/usr/sbin:.:/sbin:/home/root:/opt/java1.4/bin:/usr/bin:/opt/bea2/user_projects/domains/jfpdmdomain:/opt/pdm/timeservice
SHELL=/usr/bin/sh
DISPLAY=10.0.227.7:0.0
SHLIB_PATH=/opt/java1.4/jre/lib/PA_RISC2.0:/opt/java1.4/jre/lib/PA_RISC2.0/server:/opt/java1.4/jre/../lib/PA_RISC2.0:/opt/bea2/weblogic81/server/lib/hpux11:/opt/bea2/weblogic81/server/lib/hpux11/oci920_8


---------------  S Y S T E M  ---------------

OS: HPUX
uname:HP-UX B.11.11 U 9000/800
rlimit: STACK 8192k, CORE 2097151k, NOFILE 2048, AS infinity
load average:0.13 0.13 0.13

CPU:total 8

Memory: 4k page, physical 16775168k

vm_info: Java HotSpot(TM) Server VM (1.4.2.17-071106-04:26-PA_RISC2.0) for hp-ux-pa-risc, built on Nov  6 2007 07:35:13 by jinteg with aCC

rain4321

补充：
目前weblogic8.1.6基本每两天就会出现一次jdk1.4.2_17宕掉的情况，导致weblogic也不能访问；
我发现有几个感觉异常的地方，请帮忙分析一下
1 、 Internal Error (/CLO/Components/JAVA_HOTSPOT/Src/src/share/vm/gc_implementation/parallelScavenge/parallelScavengeHeap.cpp, 544), pid=1887, tid=11
2、  01cc0598 JavaThread "ExecuteThread: '14' for queue: 'JmsDispatcher'" daemon [_thread_blocked, id=98, lwp_id=1045482]
       01cc0428 JavaThread "ExecuteThread: '13' for queue: 'JmsDispatcher'" daemon [_thread_blocked, id=97, lwp_id=1045481]

3、/opt/java1.4/jre/lib/PA_RISC2.0/libioser12.sl
        text:0xda2fa000-0xda2fe000 data:0xf7f01000-0xf7f02000
    /opt/bea2/weblogic81/server/lib/hpux11/libmuxer.sl
        text:0xda2f7000-0xda2fa000 data:0xf7f00000-0xf7f01000

4、Heap
PSYoungGen      total 355840K, used 225280K [da400000, f7f00000, f7f00000)
  eden [da400000,e8000000,e8000000)
  from [eff80000,eff80000,f7f00000)
  to   [e8000000,e8000000,eff80000)
PSOldGen        total 1459200K, used 1459200K [66c00000, bfd00000, bfd00000)
  object [66c00000,bfd00000,bfd00000)
PSPermGen       total 1048576K, used 79780K [26c00000, 66c00000, 66c00000)
  object [26c00000,2b9e91e8,66c00000)



5、jvm_args: -Xms1900m -Xmx1900m -XXermSize=1024m -XX:MaxPermSize=1024m -XX:NewRatio=3 -XX:SurvivorRatio=10 -XX:+UseParallelGC



系统环境如上面的最后System 部分：

OS: HPUX
uname:HP-UX B.11.11 U 9000/800
rlimit: STACK 8192k, CORE 2097151k, NOFILE 2048, AS infinity
load average:0.13 0.13 0.13

CPU:total 8

Memory: 4k page, physical 16775168k

vm_info: Java HotSpot(TM) Server VM (1.4.2.17-071106-04:26-PA_RISC2.0) for hp-ux-pa-risc, built on Nov  6 2007 07:35:13 by jinteg with aCC

另外补充目前设置的部分内核参数：

sysdef :

dbc_max_pct                  20
dbc_min_pct                   5

maxdsiz                  503866*4K
maxdsiz_64bit            262144*4K
maxfiles                   2048
maxfiles_lim               2048

maxssiz                    2048
maxssiz_64bit              2048

maxuprc                      75            好像有点小

nfile                     30010



kmtune -l | more

max_thread_proc    3000

maxusers               1000

[ 本帖最后由 rain4321 于 2008-5-21 09:06 编辑 ]