JVM core dump
JVMs crushed on my three node weblogic8.1 cluster.
Not always happen, and can be any of the nodes.
I tries jdk141_05,jdk141_02 and jdk142_04. There wan't any difference.
The os is solaris 5.8. Here is the output of uname -s:
SunOS smpc3 5.8 Generic_117350-02 sun4u sparc SUNW,Sun-Fire-280R
I saw "Cannot access memory at address" in the gdb output. Could it be the reason?
and how to figure out the real cause?
Thanks!!
------------gdb output---------------
$ gdb /nfs/tools/jdk/solaris/j2sdk1.4.2_02/bin/java core_142_04
GNU gdb 20000314
Copyright 1998 Free Software Foundation, Inc.
GDB is free software, covered by the GNU General Public License, and you are
welcome to change it and/or distribute copies of it under certain conditions.
Type "show copying" to see the conditions.
There is absolutely no warranty for GDB. Type "show warranty" for details.
This GDB was configured as "sparc-sun-solaris2.8"...
(no debugging symbols found)...
Core was generated by `/nfs/tools/jdk/solaris/j2sdk1.4.2_04/bin/java -server -ms1536m -mx1536m -XX:Max'.
Program terminated with signal 9, Killed.
Cannot access memory at address 0xffffffffff3e9aac
#0 0xff3691f0 in ?? ()
(gdb)
Here is the full one:
core 'core_142_04' of 3500: /nfs/tools/jdk/solaris/j2sdk1.4.2_04/bin/java -server -ms1536m -mx1536
----------------- lwp# 12 / thread# 11 --------------------
ff3691f0 __sigprocmask (ff36b7f4, 0, 0, 78501d98, ff37c000, 0) + 8
ff35dd0c _sigon (78501d98, ff3838a8, 6, 784ff7f4, 78501d98, ff38321c) + d0
ff360d4c thrpkill (0, b, 6, ff37c000, b, ff2c0458) + f8
ff24bce0 raise (6, 0, 0, ffffffff, ff2c03c4, ff3831fc) + 40
ff235984 abort (ff2bc008, 784ff948, 0, fffffff8, 4, 784ff969) + 100
fe498498 __1cCosFabort6Fi_v_ (1, fe553722, 784ff9f8, fe570000, fe5b78bc, 3db2e4) + 80
fe4967ac __1cCosbBhandle_unexpected_exception6FpnGThread_ipCpv_v_ (fff68, b, fe16d550, 78500738, b, 0) + 2d4
fe1d90ac JVM_handle_solaris_signal (fe16d550, 78500738, 78500480, 3400, 35ec, 0) + 91c
ff36b118 __sighndlr (b, 78500738, 78500480, fe1d875c, 78501e40, 78501e30) + c
ff36811c sigacthandler (b, 78501d98, 0, 0, 0, ff37c000) + 708
--- called from signal handler with signal 11 (SIGSEGV) ---
fe16d550 __1cMURShiftINodeFValue6kMpnOPhaseTransform__pknEType__ (d84034, 78500d4c, 1, 0, 1f7240, 1175f38) + f8
fe0d2180 __1cMPhaseIterGVNNtransform_old6MpnENode__2_ (78500d4c, e56318, 130, 78500e9c, 16, 1976b80) + 1d4
fe19b1e8 __1cMPhaseIterGVNIoptimize6M_v_ (78500d4c, 0, fe5b89f8, 0, 0, 0) + a0
fe202008 __1cHCompileIOptimize6M_v_ (78501298, fe5335c4, 785011ac, fe570000, 0, 0) + 168
fe2008b4 __1cHCompile2t6MpnFciEnv_pnHciScope_pnIciMethod_iii_v_ (fe5333f9, 2f1dac, 49e8dc, 37ee54, ffffffff, 1) + bac
fe1fd08c __1cKC2CompilerOcompile_method6MpnFciEnv_pnHciScope_pnIciMethod_ii_v_ (2bb30, 78501ab4, 0, ef1890, ffffffff, 0) + 64
fe1fc850 __1cNCompileBrokerZinvoke_compiler_on_method6FpnLCompileTask__v_ (6ef, 0, ffffffff, fe5aee50, fe5bbbe4, fff68) + 61c
fe2ac1f8 __1cNCompileBrokerUcompiler_thread_loop6F_v_ (fe533c01, fe5af218, fff68, 100518, 306d10, fe269254) + 428
fe26927c __1cKJavaThreadDrun6M_v_ (fff68, c, 40, 0, b, ff37c000) + 284
fe26575c _start (fff68, ff37d658, 1, 1, ff37c000, 0) + 134
ff36b01c threadstart (fff68, 0, 0, 0, 0, 0) + 40
----------------- lwp# 13 / thread# 12 --------------------
ff29d61c _poll (0, 0, 0, f9181b40, ff2bf1bc, f9181b40) + 8
ff36aa28 select (0, 32, 0, 0, 0, 0) + 34
fe107a24 __1cCosFsleep6FpnGThread_xi_i_ (101750, 0, 32, 0, 1, f9181cad) + 214
fe2c0ed4 __1cNWatcherThreadDrun6M_v_ (101750, d, 7f, 0, c, ff37c000) + 1e4
fe26575c _start (101750, ff37d658, 1, 1, ff37c000, 0) + 134
ff36b01c threadstart (101750, 0, 0, 0, 0, 0) + 40
----------------- lwp# 14 / thread# 13 --------------------
ff29f444 ___lwp_cond_wait (1060610, 10605f8, bd4d90, c, d9882398, 0) + 8
fe2924a0 __1cNObjectMonitorGenter26MpnGThread__v_ (5000, 525c, 5000, 50dc, 4800, 4af0) + 3f4
fe18fa84 __1cSInterpreterRuntimeMmonitorenter6FpnKJavaThread_pnPBasicObjectLock__v_ (bd4d90, 74a7feb0, 74a7ff40, f94163d0, 8, 0) + 88
f940a608 ???????? (74a7ff44, b7, 0, 2000, 0, 0)
f9405804 ???????? (74a7ffd8, b8, 0, f94160d0, 8, 74a7fed8)
f9405750 ???????? (74a80064, b7, 0, f9416250, 4, 74a7ff70)
f9405804 ???????? (74a800f4, daf91f58, 0, f94160d0, 4, 74a80000)
f9405a8c ???????? (74a8018c, b6, 0, f94163d0, 4, 74a80090)
f9405804 ???????? (74a80208, d91598c8, dc30b534, f9415e98, 14, 74a80118)
f9430b40 ???????? (9b584888, 9d856020, 7fc90288, d91680d8, c, 74a801c0)
f9c8c110 ???????? (9b584888, 7fc90380, d91680d8, d90046e8, 8, 74a80220)
f9c842c4 ???????? (bd4d90, d9000398, 9b584888, 9b585010, 1, 0)
f9c7ef44 ???????? (7fc90288, 9b5856a0, 9ca90890, dae577e0, bd4d90, 0)
f9430d48 ???????? (7fc902b8, b7, 74a8046c, f9415028, db337ab8, db337ab8)
f9405750 ???????? (74a8048c, db1e5578, 0, f9416120, c, 74a80350)
f94059d8 ???????? (74a8052c, b6, 0, f94163d0, 24, 74a80410)
f9405750 ???????? (74a805cc, db608378, 0, f9415e50, 24, 74a804b0)
f94059d8 ???????? (74a8068c, db133e10, 0, f94163d0, 24, 74a80550)
f94059d8 ???????? (74a8074c, b6, 0, f94163d0, 24, 74a80610)
f9405750 ???????? (74a808d4, dc208df0, 0, f9415e50, 24, 74a806c8)
f94059d8 ???????? (74a8097c, dc208df0, 0, f94163d0, 4, 74a80868)
f94059d8 ???????? (74a80a34, db334690, 0, f94163d0, 4, 74a80908)
f94059d8 ???????? (74a80ae4, db1179b0, 0, f94163d0, 14, 74a809b8)
f94059d8 ???????? (74a80b7c, b6, 0, f94163d0, 14, 74a80a78)
f9405750 ???????? (74a80c0c, b6, 0, f9415e50, 14, 74a80b08)
f9405804 ???????? (74a80c8c, b7, 0, f9415e50, 4, 74a80bb0)
f9405750 ???????? (74a80d14, b6, 0, f94160d0, 4, 74a80c28)
f9405750 ???????? (74a80db4, daf8eb48, 0, f9415e50, 10, 74a80ca8)
f94059d8 ???????? (74a80e74, daf89ab0, 0, f94163d0, 10, 74a80d38)
f94059d8 ???????? (74a80f3c, b8, 0, f94163d0, 10, 74a80df8)
f9405750 ???????? (74a8103c, b6, 0, f9416250, 10, 74a80ec8)
f9405804 ???????? (74a810cc, b6, 0, f9415e98, c, 74a80fd0)
f9405804 ???????? (74a8116c, b6, 0, f9415e98, 8, 74a81060)
f9405750 ???????? (74a8121c, db05d900, 0, f9415e50, 4, 74a81100)
f94059d8 ???????? (74a812dc, dafac208, 0, f94163d0, 8, 74a811a0)
f94059d8 ???????? (74a813f4, b6, 0, f94163d0, 8, 74a81260)
f9405750 ???????? (74a81484, b7, 0, f9415e50, 14, 74a81388)
f9405804 ???????? (74a81514, b6, 0, f94160d0, 10, 74a81418)
f9405804 ???????? (74a81594, d90bdcf8, 0, f9415e50, 10, 74a814a8)
f94059d8 ???????? (74a8162c, b6, 0, f94163d0, 4, 74a81530)
f9405750 ???????? (74a816c4, b8, 0, f9415e50, c, 74a815c8)
f9405750 ???????? (74a8178c, b6, 0, f94160d0, c, 74a81648)
f9405804 ???????? (74a81814, d9811f18, 0, f9415e50, 8, 74a81728)
f9405a8c ???????? (74a818a4, b6, 0, f94163d0, 8, 74a817b0)
f9405804 ???????? (74a81934, 0, 0, f9415e50, 8, 74a81840)
f940010c ???????? (74a819c0, 74a81c28, a, d981a9b0, 4, 74a818d8)
fe15d48c __1cJJavaCallsLcall_helper6FpnJJavaValue_pnMmethodHandle_pnRJavaCallArguments_pnGThread__v_ (74a81c20, 74a81a88, 74a81b40, bd4d90, bd4d90, 74a81a98) + 27c
fe24b784 __1cJJavaCallsMcall_virtual6FpnJJavaValue_nLKlassHandle_nMsymbolHandle_4pnRJavaCallArguments_pnGThread__v_ (fe570000, 1f0bf8, 74a81b34, 74a81b30, 74a81b40, bd4d90) + 164
fe25e8dc __1cJJavaCallsMcall_virtual6FpnJJavaValue_nGHandle_nLKlassHandle_nMsymbolHandle_5pnGThread__v_ (74a81c20, 74a81c1c, 74a81c14, 74a81c0c, 74a81c04, bd4d90) + 6c
fe26fc74 __1cMthread_entry6FpnKJavaThread_pnGThread__v_ (bd4d90, bd4d90, 41abc0, 1f0bf8, 306d10, fe269254) + 128
fe26927c __1cKJavaThreadDrun6M_v_ (bd4d90, e, 40, 0, d, ff37c000) + 284
fe26575c _start (bd4d90, ff37d658, 1, 1, ff37c000, 0) + 134
ff36b01c threadstart (bd4d90, 0, 0, 0, 0, 0) + 40
----------------- lwp# 15 / thread# 14 --------------------
ff29f444 ___lwp_cond_wait (bd4f48, bd4f30, e9fd58, 5, d9882398, 0) + 8
fe2924a0 __1cNObjectMonitorGenter26MpnGThread__v_ (5000, 525c, 5000, 50dc, 4800, 4af0) + 3f4
fe18fa84 __1cSInterpreterRuntimeMmonitorenter6FpnKJavaThread_pnPBasicObjectLock__v_ (e9fd58, 7497feb0, 7497ff40, f94163d0, 8, 0) + 88
f940a608 ???????? (7497ff44, b7, 0, 2000, 0, 0)
f9405804 ???????? (7497ffd8, b8, 0, f94160d0, 8, 7497fed8)
f9405750 ???????? (74980064, b7, 0, f9416250, 4, 7497ff70)
f9405804 ???????? (749800f4, daf91f58, 0, f94160d0, 4, 74980000)
f9405a8c ???????? (7498018c, b6, 0, f94163d0, 4, 74980090)
f9405804 ???????? (74980208, d91598c8, dc30b534, f9415e98, 14, 74980118)
f9430b40 ???????? (9b584888, 9d854178, 7f2cbb30, d91680d8, c, 749801c0)
f9c8c110 ???????? (9b584888, 7f2cbc28, d91680d8, d90046e8, 8, 74980220)
f9c842c4 ???????? (e9fd58, d9000398, 9b584888, 9b585010, 1, 0)
f9c7ef44 ???????? (7f2cbb30, 9b5856a0, 9ca90890, dae577e0, e9fd58, 0)
f9430d48 ???????? (7f2cbb60, b7, 7498046c, f9415028, db337ab8, db337ab8)
f9405750 ???????? (7498048c, db1e5578, 0, f9416120, c, 74980350)
f94059d8 ???????? (7498052c, b6, 0, f94163d0, 24, 74980410)
f9405750 ???????? (749805cc, db608378, 0, f9415e50, 24, 749804b0)
f94059d8 ???????? (7498068c, db133e10, 0, f94163d0, 24, 74980550)
f94059d8 ???????? (7498074c, b6, 0, f94163d0, 24, 74980610)
f9405750 ???????? (749808d4, dc208df0, 0, f9415e50, 24, 749806c8)
f94059d8 ???????? (7498097c, dc208df0, 0, f94163d0, 4, 74980868)
f94059d8 ???????? (74980a34, db334690, 0, f94163d0, 4, 74980908)
f94059d8 ???????? (74980ae4, db1179b0, 0, f94163d0, 14, 749809b8)
f94059d8 ???????? (74980b7c, b6, 0, f94163d0, 14, 74980a78)
f9405750 ???????? (74980c0c, b6, 0, f9415e50, 14, 74980b08)
f9405804 ???????? (74980c8c, b7, 0, f9415e50, 4, 74980bb0)
f9405750 ???????? (74980d14, b6, 0, f94160d0, 4, 74980c28)
f9405750 ???????? (74980db4, daf8eb48, 0, f9415e50, 10, 74980ca8)
f94059d8 ???????? (74980e74, daf89ab0, 0, f94163d0, 10, 74980d38)
f94059d8 ???????? (74980f3c, b8, 0, f94163d0, 10, 74980df8)
f9405750 ???????? (7498103c, b6, 0, f9416250, 10, 74980ec8)
f9405804 ???????? (749810cc, b6, 0, f9415e98, c, 74980fd0)
f9405804 ???????? (7498116c, b6, 0, f9415e98, 8, 74981060)
f9405750 ???????? (7498121c, db05d900, 0, f9415e50, 4, 74981100)
f94059d8 ???????? (749812dc, dafac208, 0, f94163d0, 8, 749811a0)
f94059d8 ???????? (749813f4, b6, 0, f94163d0, 8, 74981260)
f9405750 ???????? (74981484, b7, 0, f9415e50, 14, 74981388)
f9405804 ???????? (74981514, b6, 0, f94160d0, 10, 74981418)
f9405804 ???????? (74981594, d90bdcf8, 0, f9415e50, 10, 749814a8)
f94059d8 ???????? (7498162c, b6, 0, f94163d0, 4, 74981530)
f9405750 ???????? (749816c4, b8, 0, f9415e50, c, 749815c8)
f9405750 ???????? (7498178c, b6, 0, f94160d0, c, 74981648)
f9405804 ???????? (74981814, d9811f18, 0, f9415e50, 8, 74981728)
f9405a8c ???????? (749818a4, b6, 0, f94163d0, 8, 749817b0)
f9405804 ???????? (74981934, 0, 0, f9415e50, 8, 74981840)
f940010c ???????? (749819c0, 74981c28, a, d981a9b0, 4, 749818d8)
fe15d48c __1cJJavaCallsLcall_helper6FpnJJavaValue_pnMmethodHandle_pnRJavaCallArguments_pnGThread__v_ (74981c20, 74981a88, 74981b40, e9fd58, e9fd58, 74981a98) + 27c
fe24b784 __1cJJavaCallsMcall_virtual6FpnJJavaValue_nLKlassHandle_nMsymbolHandle_4pnRJavaCallArguments_pnGThread__v_ (fe570000, 1ce9f0, 74981b34, 74981b30, 74981b40, e9fd58) + 164
fe25e8dc __1cJJavaCallsMcall_virtual6FpnJJavaValue_nGHandle_nLKlassHandle_nMsymbolHandle_5pnGThread__v_ (74981c20, 74981c1c, 74981c14, 74981c0c, 74981c04, e9fd58) + 6c
fe26fc74 __1cMthread_entry6FpnKJavaThread_pnGThread__v_ (e9fd58, e9fd58, 41b060, 1ce9f0, 306d10, fe269254) + 128
fe26927c __1cKJavaThreadDrun6M_v_ (e9fd58, f, 40, 0, e, ff37c000) + 284
fe26575c _start (e9fd58, ff37d658, 1, 1, ff37c000, 0) + 134
ff36b01c threadstart (e9fd58, 0, 0, 0, 0, 0) + 40
----------------- lwp# 16 / thread# 15 --------------------
ff29f444 ___lwp_cond_wait (ea0120, ea0108, e9fef8, b, d9882398, 0) + 8
fe2924a0 __1cNObjectMonitorGenter26MpnGThread__v_ (5000, 525c, 5000, 50dc, 4800, 4af0) + 3f4
fe18fa84 __1cSInterpreterRuntimeMmonitorenter6FpnKJavaThread_pnPBasicObjectLock__v_ (e9fef8, 7487feb0, 7487ff40, f94163d0, 8, 0) + 88
f940a608 ???????? (7487ff44, b7, 0, 2000, 0, 0)
f9405804 ???????? (7487ffd8, b8, 0, f94160d0, 8, 7487fed8)
f9405750 ???????? (74880064, b7, 0, f9416250, 4, 7487ff70)
f9405804 ???????? (748800f4, daf91f58, 0, f94160d0, 4, 74880000)
f9405a8c ???????? (7488018c, b6, 0, f94163d0, 4, 74880090)
f9405804 ???????? (74880208, d91598c8, dc30b534, f9415e98, 14, 74880118)
f9430b40 ???????? (9b584888, 9d855228, 7ec08520, d91680d8, c, 748801c0)
f9c8c110 ???????? (9b584888, 7ec08618, d91680d8, d90046e8, 8, 74880220)
f9c842c4 ???????? (e9fef8, d9000398, 9b584888, 9b585010, 1, 0)
f9c7ef44 ???????? (7ec08520, 9b5856a0, 9ca90890, dae577e0, e9fef8, 0)
f9430d48 ???????? (7ec08550, b7, 7488046c, f9415028, db337ab8, db337ab8)
f9405750 ???????? (7488048c, db1e5578, 0, f9416120, c, 74880350)
f94059d8 ???????? (7488052c, b6, 0, f94163d0, 24, 74880410)
f9405750 ???????? (748805cc, db608378, 0, f9415e50, 24, 748804b0)
f94059d8 ???????? (7488068c, db133e10, 0, f94163d0, 24, 74880550)
f94059d8 ???????? (7488074c, b6, 0, f94163d0, 24, 74880610)
f9405750 ???????? (748808d4, dc208df0, 0, f9415e50, 24, 748806c8)
f94059d8 ???????? (7488097c, dc208df0, 0, f94163d0, 4, 74880868)
f94059d8 ???????? (74880a34, db334690, 0, f94163d0, 4, 74880908)
f94059d8 ???????? (74880ae4, db1179b0, 0, f94163d0, 14, 748809b8)
f94059d8 ???????? (74880b7c, b6, 0, f94163d0, 14, 74880a78)
f9405750 ???????? (74880c0c, b6, 0, f9415e50, 14, 74880b08)
f9405804 ???????? (74880c8c, b7, 0, f9415e50, 4, 74880bb0)
f9405750 ???????? (74880d14, b6, 0, f94160d0, 4, 74880c28)
f9405750 ???????? (74880db4, daf8eb48, 0, f9415e50, 10, 74880ca8)
f94059d8 ???????? (74880e74, daf89ab0, 0, f94163d0, 10, 74880d38)
f94059d8 ???????? (74880f3c, b8, 0, f94163d0, 10, 74880df8)
f9405750 ???????? (7488103c, b6, 0, f9416250, 10, 74880ec8)
f9405804 ???????? (748810cc, b6, 0, f9415e98, c, 74880fd0)
f9405804 ???????? (7488116c, b6, 0, f9415e98, 8, 74881060)
f9405750 ???????? (7488121c, db05d900, 0, f9415e50, 4, 74881100)
f94059d8 ???????? (748812dc, dafac208, 0, f94163d0, 8, 748811a0)
f94059d8 ???????? (748813f4, b6, 0, f94163d0, 8, 74881260)
f9405750 ???????? (74881484, b7, 0, f9415e50, 14, 74881388)
f9405804 ???????? (74881514, b6, 0, f94160d0, 10, 74881418)
f9405804 ???????? (74881594, d90bdcf8, 0, f9415e50, 10, 748814a8)
f94059d8 ???????? (7488162c, b6, 0, f94163d0, 4, 74881530)
f9405750 ???????? (748816c4, b8, 0, f9415e50, c, 748815c8)
f9405750 ???????? (7488178c, b6, 0, f94160d0, c, 74881648)
f9405804 ???????? (74881814, d9811f18, 0, f9415e50, 8, 74881728)
f9405a8c ???????? (748818a4, b6, 0, f94163d0, 8, 748817b0)
f9405804 ???????? (74881934, 0, 0, f9415e50, 8, 74881840)
f940010c ???????? (748819c0, 74881c28, a, d981a9b0, 4, 748818d8)
fe15d48c __1cJJavaCallsLcall_helper6FpnJJavaValue_pnMmethodHandle_pnRJavaCallArguments_pnGThread__v_ (74881c20, 74881a88, 74881b40, e9fef8, e9fef8, 74881a98) + 27c
fe24b784 __1cJJavaCallsMcall_virtual6FpnJJavaValue_nLKlassHandle_nMsymbolHandle_4pnRJavaCallArguments_pnGThread__v_ (fe570000, 8f9840, 74881b34, 74881b30, 74881b40, e9fef8) + 164
fe25e8dc __1cJJavaCallsMcall_virtual6FpnJJavaValue_nGHandle_nLKlassHandle_nMsymbolHandle_5pnGThread__v_ (74881c20, 74881c1c, 74881c14, 74881c0c, 74881c04, e9fef8) + 6c
fe26fc74 __1cMthread_entry6FpnKJavaThread_pnGThread__v_ (e9fef8, e9fef8, a5ad70, 8f9840, 306d10, fe269254) + 128
fe26927c __1cKJavaThreadDrun6M_v_ (e9fef8, 10, 40, 0, f, ff37c000) + 284
fe26575c _start (e9fef8, ff37d658, 1, 1, ff37c000, 0) + 134
ff36b01c threadstart (e9fef8, 0, 0, 0, 0, 0) + 40
----------------- lwp# 17 / thread# 16 --------------------
ff29f444 ___lwp_cond_wait (5ba2c0, 5ba2a8, 10a5b20, 8, d9882398, 0) + 8
fe2924a0 __1cNObjectMonitorGenter26MpnGThread__v_ (5000, 525c, 5000, 50dc, 4800, 4af0) + 3f4
fe18fa84 __1cSInterpreterRuntimeMmonitorenter6FpnKJavaThread_pnPBasicObjectLock__v_ (10a5b20, 7477feb0, 7477ff40, f94163d0, 8, 0) + 88
f940a608 ???????? (7477ff44, b7, 0, 2000, 0, 0)
f9405804 ???????? (7477ffd8, b8, 0, f94160d0, 8, 7477fed8)
f9405750 ???????? (74780064, b7, 0, f9416250, 4, 7477ff70)
f9405804 ???????? (747800f4, daf91f58, 0, f94160d0, 4, 74780000)
f9405a8c ???????? (7478018c, b6, 0, f94163d0, 4, 74780090)
f9405804 ???????? (74780208, d91598c8, dc30b534, f9415e98, 14, 74780118)
f9430b40 ???????? (9b584888, 9d856bf0, 7f873c38, d91680d8, c, 747801c0)
f9c8c110 ???????? (9b584888, 7f873d30, d91680d8, d90046e8, 8, 74780220)
f9c842c4 ???????? (10a5b20, d9000398, 9b584888, 9b585010, 1, 0)
f9c7ef44 ???????? (7f873c38, 9b5856a0, 9ca90890, dae577e0, 10a5b20, 0)
f9430d48 ???????? (7f873c68, b7, 7478046c, f9415028, db337ab8, db337ab8)
f9405750 ???????? (7478048c, db1e5578, 0, f9416120, c, 74780350)
f94059d8 ???????? (7478052c, b6, 0, f94163d0, 24, 74780410)
f9405750 ???????? (747805cc, db608378, 0, f9415e50, 24, 747804b0)
f94059d8 ???????? (7478068c, db133e10, 0, f94163d0, 24, 74780550)
f94059d8 ???????? (7478074c, b6, 0, f94163d0, 24, 74780610)
f9405750 ???????? (747808d4, dc208df0, 0, f9415e50, 24, 747806c8)
f94059d8 ???????? (7478097c, dc208df0, 0, f94163d0, 4, 74780868)
f94059d8 ???????? (74780a34, db334690, 0, f94163d0, 4, 74780908)
f94059d8 ???????? (74780ae4, db1179b0, 0, f94163d0, 14, 747809b8)
f94059d8 ???????? (74780b7c, b6, 0, f94163d0, 14, 74780a78)
f9405750 ???????? (74780c0c, b6, 0, f9415e50, 14, 74780b08)
f9405804 ???????? (74780c8c, b7, 0, f9415e50, 4, 74780bb0)
f9405750 ???????? (74780d14, b6, 0, f94160d0, 4, 74780c28)
f9405750 ???????? (74780db4, daf8eb48, 0, f9415e50, 10, 74780ca8)
f94059d8 ???????? (74780e74, daf89ab0, 0, f94163d0, 10, 74780d38)
f94059d8 ???????? (74780f3c, b8, 0, f94163d0, 10, 74780df8)
f9405750 ???????? (7478103c, b6, 0, f9416250, 10, 74780ec8)
f9405804 ???????? (747810cc, b6, 0, f9415e98, c, 74780fd0)
f9405804 ???????? (7478116c, b6, 0, f9415e98, 8, 74781060)
f9405750 ???????? (7478121c, db05d900, 0, f9415e50, 4, 74781100)
f94059d8 ???????? (747812dc, dafac208, 0, f94163d0, 8, 747811a0)
f94059d8 ???????? (747813f4, b6, 0, f94163d0, 8, 74781260)
f9405750 ???????? (74781484, b7, 0, f9415e50, 14, 74781388)
f9405804 ???????? (74781514, b6, 0, f94160d0, 10, 74781418)
f9405804 ???????? (74781594, d90bdcf8, 0, f9415e50, 10, 747814a8)
f94059d8 ???????? (7478162c, b6, 0, f94163d0, 4, 74781530)
f9405750 ???????? (747816c4, b8, 0, f9415e50, c, 747815c8)
f9405750 ???????? (7478178c, b6, 0, f94160d0, c, 74781648)
f9405804 ???????? (74781814, d9811f18, 0, f9415e50, 8, 74781728)
f9405a8c ???????? (747818a4, b6, 0, f94163d0, 8, 747817b0)
f9405804 ???????? (74781934, 0, 0, f9415e50, 8, 74781840)
f940010c ???????? (747819c0, 74781c28, a, d981a9b0, 4, 747818d8)
fe15d48c __1cJJavaCallsLcall_helper6FpnJJavaValue_pnMmethodHandle_pnRJavaCallArguments_pnGThread__v_ (74781c20, 74781a88, 74781b40, 10a5b20, 10a5b20, 74781a98) + 27c
fe24b784 __1cJJavaCallsMcall_virtual6FpnJJavaValue_nLKlassHandle_nMsymbolHandle_4pnRJavaCallArguments_pnGThread__v_ (fe570000, 1f07f8, 74781b34, 74781b30, 74781b40, 10a5b20) + 164
fe25e8dc __1cJJavaCallsMcall_virtual6FpnJJavaValue_nGHandle_nLKlassHandle_nMsymbolHandle_5pnGThread__v_ (74781c20, 74781c1c, 74781c14, 74781c0c, 74781c04, 10a5b20) + 6c
fe26fc74 __1cMthread_entry6FpnKJavaThread_pnGThread__v_ (10a5b20, 10a5b20, 41af20, 1f07f8, 306d10, fe269254) + 128
fe26927c __1cKJavaThreadDrun6M_v_ (10a5b20, 11, 40, 0, 10, ff37c000) + 284
fe26575c _start (10a5b20, ff37d658, 1, 1, ff37c000, 0) + 134
ff36b01c threadstart (10a5b20, 0, 0, 0, 0, 0) + 40
----------------- lwp# 18 / thread# 17 --------------------
ff29f444 ___lwp_cond_wait (f5d568, f5d550, 3f8268, a, d9882398, 0) + 8
fe2924a0 __1cNObjectMonitorGenter26MpnGThread__v_ (5000, 525c, 5000, 50dc, 4800, 4af0) + 3f4
fe18fa84 __1cSInterpreterRuntimeMmonitorenter6FpnKJavaThread_pnPBasicObjectLock__v_ (3f8268, 7467feb0, 7467ff40, f94163d0, 8, 0) + 88
f940a608 ???????? (7467ff44, b7, 0, 2000, 0, 0)
f9405804 ???????? (7467ffd8, b8, 0, f94160d0, 8, 7467fed8)
f9405750 ???????? (74680064, b7, 0, f9416250, 4, 7467ff70)
f9405804 ???????? (746800f4, daf91f58, 0, f94160d0, 4, 74680000)
f9405a8c ???????? (7468018c, b6, 0, f94163d0, 4, 74680090)
f9405804 ???????? (74680208, d91598c8, dc30b534, f9415e98, 14, 74680118)
f9430b40 ???????? (9b584888, 9d857640, 7f4ba0d0, d91680d8, c, 746801c0)
f9c8c110 ???????? (9b584888, 7f4ba1c8, d91680d8, d90046e8, 8, 74680220)
f9c842c4 ???????? (3f8268, d9000398, 9b584888, 9b585010, 1, 0)
f9c7ef44 ???????? (7f4ba0d0, 9b5856a0, 9ca90890, dae577e0, 3f8268, 0)
f9430d48 ???????? (7f4ba100, b7, 7468046c, f9415028, db337ab8, db337ab8)
f9405750 ???????? (7468048c, db1e5578, 0, f9416120, c, 74680350)
f94059d8 ???????? (7468052c, b6, 0, f94163d0, 24, 74680410)
f9405750 ???????? (746805cc, db608378, 0, f9415e50, 24, 746804b0)
f94059d8 ???????? (7468068c, db133e10, 0, f94163d0, 24, 74680550)
f94059d8 ???????? (7468074c, b6, 0, f94163d0, 24, 74680610)
f9405750 ???????? (746808d4, dc208df0, 0, f9415e50, 24, 746806c8)
f94059d8 ???????? (7468097c, dc208df0, 0, f94163d0, 4, 74680868)
f94059d8 ???????? (74680a34, db334690, 0, f94163d0, 4, 74680908)
f94059d8 ???????? (74680ae4, db1179b0, 0, f94163d0, 14, 746809b8)
f94059d8 ???????? (74680b7c, b6, 0, f94163d0, 14, 74680a78)
f9405750 ???????? (74680c0c, b6, 0, f9415e50, 14, 74680b08)
f9405804 ???????? (74680c8c, b7, 0, f9415e50, 4, 74680bb0)
f9405750 ???????? (74680d14, b6, 0, f94160d0, 4, 74680c28)
f9405750 ???????? (74680db4, daf8eb48, 0, f9415e50, 10, 74680ca8)
f94059d8 ???????? (74680e74, daf89ab0, 0, f94163d0, 10, 74680d38)
f94059d8 ???????? (74680f3c, b8, 0, f94163d0, 10, 74680df8)
f9405750 ???????? (7468103c, b6, 0, f9416250, 10, 74680ec8)
f9405804 ???????? (746810cc, b6, 0, f9415e98, c, 74680fd0)
f9405804 ???????? (7468116c, b6, 0, f9415e98, 8, 74681060)
f9405750 ???????? (7468121c, db05d900, 0, f9415e50, 4, 74681100)
f94059d8 ???????? (746812dc, dafac208, 0, f94163d0, 8, 746811a0)
f94059d8 ???????? (746813f4, b6, 0, f94163d0, 8, 74681260)
f9405750 ???????? (74681484, b7, 0, f9415e50, 14, 74681388)
f9405804 ???????? (74681514, b6, 0, f94160d0, 10, 74681418)
f9405804 ???????? (74681594, d90bdcf8, 0, f9415e50, 10, 746814a8)
f94059d8 ???????? (7468162c, b6, 0, f94163d0, 4, 74681530)
f9405750 ???????? (746816c4, b8, 0, f9415e50, c, 746815c8)
f9405750 ???????? (7468178c, b6, 0, f94160d0, c, 74681648)
f9405804 ???????? (74681814, d9811f18, 0, f9415e50, 8, 74681728)
f9405a8c ???????? (746818a4, b6, 0, f94163d0, 8, 746817b0)
f9405804 ???????? (74681934, 0, 0, f9415e50, 8, 74681840)
f940010c ???????? (746819c0, 74681c28, a, d981a9b0, 4, 746818d8)
fe15d48c __1cJJavaCallsLcall_helper6FpnJJavaValue_pnMmethodHandle_pnRJavaCallArguments_pnGThread__v_ (74681c20, 74681a88, 74681b40, 3f8268, 3f8268, 74681a98) + 27c
fe24b784 __1cJJavaCallsMcall_virtual6FpnJJavaValue_nLKlassHandle_nMsymbolHandle_4pnRJavaCallArguments_pnGThread__v_ (fe570000, 449b48, 74681b34, 74681b30, 74681b40, 3f8268) + 164
fe25e8dc __1cJJavaCallsMcall_virtual6FpnJJavaValue_nGHandle_nLKlassHandle_nMsymbolHandle_5pnGThread__v_ (74681c20, 74681c1c, 74681c14, 74681c0c, 74681c04, 3f8268) + 6c
fe26fc74 __1cMthread_entry6FpnKJavaThread_pnGThread__v_ (3f8268, 3f8268, 41b000, 449b48, 306d10, fe269254) + 128
fe26927c __1cKJavaThreadDrun6M_v_ (3f8268, 12, 40, 0, 11, ff37c000) + 284
fe26575c _start (3f8268, ff37d658, 1, 1, ff37c000, 0) + 134
ff36b01c threadstart (3f8268, 0, 0, 0, 0, 0) + 40
----------------- lwp# 19 / thread# 18 --------------------
ff29f444 ___lwp_cond_wait (128b688, 128b670, 3f8408, 3, d9882398, 0) + 8
fe2924a0 __1cNObjectMonitorGenter26MpnGThread__v_ (5000, 525c, 5000, 50dc, 4800, 4af0) + 3f4
fe18fa84 __1cSInterpreterRuntimeMmonitorenter6FpnKJavaThread_pnPBasicObjectLock__v_ (3f8408, 7457feb0, 7457ff40, f94163d0, 8, 0) + 88
f940a608 ???????? (7457ff44, b7, 0, 2000, 0, 0)
f9405804 ???????? (7457ffd8, b8, 0, f94160d0, 8, 7457fed8)
f9405750 ???????? (74580064, b7, 0, f9416250, 4, 7457ff70)
f9405804 ???????? (745800f4, daf91f58, 0, f94160d0, 4, 74580000)
f9405a8c ???????? (7458018c, b6, 0, f94163d0, 4, 74580090)
f9405804 ???????? (74580208, d91598c8, dc30b534, f9415e98, 14, 74580118)
f9430b40 ???????? (9b584888, 9d855648, 7f1e97d8, d91680d8, c, 745801c0)
f9c8c110 ???????? (9b584888, 7f1e98d0, d91680d8, d90046e8, 8, 74580220)
f9c842c4 ???????? (3f8408, d9000398, 9b584888, 9b585010, 1, 0)
f9c7ef44 ???????? (7f1e97d8, 9b5856a0, 9ca90890, dae577e0, 3f8408, 0)
f9430d48 ???????? (7f1e9808, b7, 7458046c, f9415028, db337ab8, db337ab8)
f9405750 ???????? (7458048c, db1e5578, 0, f9416120, c, 74580350)
f94059d8 ???????? (7458052c, b6, 0, f94163d0, 24, 74580410)
f9405750 ???????? (745805cc, db608378, 0, f9415e50, 24, 745804b0)
f94059d8 ???????? (7458068c, db133e10, 0, f94163d0, 24, 74580550)
f94059d8 ???????? (7458074c, b6, 0, f94163d0, 24, 74580610)
f9405750 ???????? (745808d4, dc208df0, 0, f9415e50, 24, 745806c8)
f94059d8 ???????? (7458097c, dc208df0, 0, f94163d0, 4, 74580868)
f94059d8 ???????? (74580a34, db334690, 0, f94163d0, 4, 74580908)
f94059d8 ???????? (74580ae4, db1179b0, 0, f94163d0, 14, 745809b8)
f94059d8 ???????? (74580b7c, b6, 0, f94163d0, 14, 74580a78)
f9405750 ???????? (74580c0c, b6, 0, f9415e50, 14, 74580b08)
f9405804 ???????? (74580c8c, b7, 0, f9415e50, 4, 74580bb0)
f9405750 ???????? (74580d14, b6, 0, f94160d0, 4, 74580c28)
f9405750 ???????? (74580db4, daf8eb48, 0, f9415e50, 10, 74580ca8)
f94059d8 ???????? (74580e74, daf89ab0, 0, f94163d0, 10, 74580d38)
f94059d8 ???????? (74580f3c, b8, 0, f94163d0, 10, 74580df8)
f9405750 ???????? (7458103c, b6, 0, f94162a0, 10, 74580ec8)
f9405804 ???????? (745810cc, b6, 0, f9415e98, c, 74580fd0)
f9405804 ???????? (7458116c, b6, 0, f9415e98, 8, 74581060)
f9405750 ???????? (7458121c, db05d900, 0, f9415e50, 4, 74581100)
f94059d8 ???????? (745812dc, dafac208, 0, f94163d0, 8, 745811a0)
f94059d8 ???????? (745813f4, b6, 0, f94163d0, 8, 74581260)
f9405750 ???????? (74581484, b7, 0, f9415e50, 14, 74581388)
f9405804 ???????? (74581514, b6, 0, f94160d0, 10, 74581418)
f9405804 ???????? (74581594, d90bdcf8, 0, f9415e50, 10, 745814a8)
f94059d8 ???????? (7458162c, b6, 0, f94163d0, 4, 74581530)
f9405750 ???????? (745816c4, b8, 0, f9415e50, c, 745815c8)
f9405750 ???????? (7458178c, b6, 0, f94160d0, c, 74581648)
f9405804 ???????? (74581814, d9811f18, 0, f9415e50, 8, 74581728)
f9405a8c ???????? (745818a4, b6, 0, f94163d0, 8, 745817b0)
f9405804 ???????? (74581934, 0, 0, f9415e50, 8, 74581840)
f940010c ???????? (745819c0, 74581c28, a, d981a9b0, 4, 745818d8)
fe15d48c __1cJJavaCallsLcall_helper6FpnJJavaValue_pnMmethodHandle_pnRJavaCallArguments_pnGThread__v_ (74581c20, 74581a88, 74581b40, 3f8408, 3f8408, 74581a98) + 27c
fe24b784 __1cJJavaCallsMcall_virtual6FpnJJavaValue_nLKlassHandle_nMsymbolHandle_4pnRJavaCallArguments_pnGThread__v_ (fe570000, 4005b0, 74581b34, 74581b30, 74581b40, 3f8408) + 164
fe25e8dc __1cJJavaCallsMcall_virtual6FpnJJavaValue_nGHandle_nLKlassHandle_nMsymbolHandle_5pnGThread__v_ (74581c20, 74581c1c, 74581c14, 74581c0c, 74581c04, 3f8408) + 6c
fe26fc74 __1cMthread_entry6FpnKJavaThread_pnGThread__v_ (3f8408, 3f8408, 41ae40, 4005b0, 306d10, fe269254) + 128
fe26927c __1cKJavaThreadDrun6M_v_ (3f8408, 13, 40, 0, 12, ff37c000) + 284
fe26575c _start (3f8408, ff37d658, 1, 1, ff37c000, 0) + 134
ff36b01c threadstart (3f8408, 0, 0, 0, 0, 0) + 40
----------------- lwp# 20 / thread# 19 --------------------
ff29f444 ___lwp_cond_wait (128b798, 128b780, 10a5cc0, 7, d9882398, 0) + 8
fe2924a0 __1cNObjectMonitorGenter26MpnGThread__v_ (5000, 525c, 5000, 50dc, 4800, 4af0) + 3f4
fe18fa84 __1cSInterpreterRuntimeMmonitorenter6FpnKJavaThread_pnPBasicObjectLock__v_ (10a5cc0, 7447feb0, 7447ff40, f94163d0, 8, 0) + 88
f940a608 ???????? (7447ff44, b7, 0, 2000, 0, 0)
f9405804 ???????? (7447ffd8, b8, 0, f94160d0, 8, 7447fed8)
f9405750 ???????? (74480064, b7, 0, f9416250, 4, 7447ff70)
f9405804 ???????? (744800f4, daf91f58, 0, f94160d0, 4, 74480000)
f9405a8c ???????? (7448018c, b6, 0, f94163d0, 4, 74480090)
f9405804 ???????? (74480208, d91598c8, dc30b534, f9415e98, 14, 74480118)
f9430b40 ???????? (9b584888, 9d856830, 7f591dc8, d91680d8, c, 744801c0)
f9c8c110 ???????? (9b584888, 7f591ec0, d91680d8, d90046e8, 8, 74480220)
f9c842c4 ???????? (10a5cc0, d9000398, 9b584888, 9b585010, 1, 0)
f9c7ef44 ???????? (7f591dc8, 9b5856a0, 9ca90890, dae577e0, 10a5cc0, 0)
f9430d48 ???????? (7f591df8, b7, 7448046c, f9415028, db337ab8, db337ab8)
f9405750 ???????? (7448048c, db1e5578, 0, f9416120, c, 74480350)
f94059d8 ???????? (7448052c, b6, 0, f94163d0, 24, 74480410)
f9405750 ???????? (744805cc, db608378, 0, f9415e50, 24, 744804b0)
f94059d8 ???????? (7448068c, db133e10, 0, f94163d0, 24, 74480550)
f94059d8 ???????? (7448074c, b6, 0, f94163d0, 24, 74480610)
f9405750 ???????? (744808d4, dc208df0, 0, f9415e50, 24, 744806c8)
f94059d8 ???????? (7448097c, dc208df0, 0, f94163d0, 4, 74480868)
f94059d8 ???????? (74480a34, db334690, 0, f94163d0, 4, 74480908)
f94059d8 ???????? (74480ae4, db1179b0, 0, f94163d0, 14, 744809b8)
f94059d8 ???????? (74480b7c, b6, 0, f94163d0, 14, 74480a78)
f9405750 ???????? (74480c0c, b6, 0, f9415e50, 14, 74480b08)
f9405804 ???????? (74480c8c, b7, 0, f9415e50, 4, 74480bb0)
f9405750 ???????? (74480d14, b6, 0, f94160d0, 4, 74480c28)
f9405750 ???????? (74480db4, daf8eb48, 0, f9415e50, 10, 74480ca8)
f94059d8 ???????? (74480e74, daf89ab0, 0, f94163d0, 10, 74480d38)
f94059d8 ???????? (74480f3c, b8, 0, f94163d0, 10, 74480df8)
f9405750 ???????? (7448103c, b6, 0, f9416250, 10, 74480ec8)
f9405804 ???????? (744810cc, b6, 0, f9415e98, c, 74480fd0)
f9405804 ???????? (7448116c, b6, 0, f9415e98, 8, 74481060)
f9405750 ???????? (7448121c, db05d900, 0, f9415e50, 4, 74481100)
f94059d8 ???????? (744812dc, dafac208, 0, f94163d0, 8, 744811a0)
f94059d8 ???????? (744813f4, b6, 0, f94163d0, 8, 74481260)
f9405750 ???????? (74481484, b7, 0, f9415e50, 14, 74481388)
f9405804 ???????? (74481514, b6, 0, f94160d0, 10, 74481418)
f9405804 ???????? (74481594, d90bdcf8, 0, f9415e50, 10, 744814a8)
f94059d8 ???????? (7448162c, b6, 0, f94163d0, 4, 74481530)
f9405750 ???????? (744816c4, b8, 0, f9415e50, c, 744815c8)
f9405750 ???????? (7448178c, b6, 0, f94160d0, c, 74481648)
f9405804 ???????? (74481814, d9811f18, 0, f9415e50, 8, 74481728)
f9405a8c ???????? (744818a4, b6, 0, f94163d0, 8, 744817b0)
f9405804 ???????? (74481934, 0, 0, f9415e50, 8, 74481840)
f940010c ???????? (744819c0, 74481c28, a, d981a9b0, 4, 744818d8)
fe15d48c __1cJJavaCallsLcall_helper6FpnJJavaValue_pnMmethodHandle_pnRJavaCallArguments_pnGThread__v_ (74481c20, 74481a88, 74481b40, 10a5cc0, 10a5cc0, 74481a98) + 27c
fe24b784 __1cJJavaCallsMcall_virtual6FpnJJavaValue_nLKlassHandle_nMsymbolHandle_4pnRJavaCallArguments_pnGThread__v_ (fe570000, 2278a8, 74481b34, 74481b30, 74481b40, 10a5cc0) + 164
fe25e8dc __1cJJavaCallsMcall_virtual6FpnJJavaValue_nGHandle_nLKlassHandle_nMsymbolHandle_5pnGThread__v_ (74481c20, 74481c1c, 74481c14, 74481c0c, 74481c04, 10a5cc0) + 6c
fe26fc74 __1cMthread_entry6FpnKJavaThread_pnGThread__v_ (10a5cc0, 10a5cc0, 41af80, 2278a8, 306d10, fe269254) + 128
fe26927c __1cKJavaThreadDrun6M_v_ (10a5cc0, 14, 40, 0, 13, ff37c000) + 284
fe26575c _start (10a5cc0, ff37d658, 1, 1, ff37c000, 0) + 134
ff36b01c threadstart (10a5cc0, 0, 0,
Similar Messages
-
Need help asap on know where/why my JVM core dumped. I've the logs from the process but they dont seen to indicate any odd thing. I've tried to debug the core using dbx like :
dbx /usr/bin/java ./core
but keep getting message: dbx: program is not activePls advise ASAP.
Can anyone also point how to contact Sun for this like sending them the core over etc.This document may help: http://java.sun.com/j2se/1.5/pdf/jdk50_ts_guide.pdf
To contact Sun, click the Contact Us link at the bottom of the page. All of their services have charges associated. -
I am using JNI in my Java application , 12 hours after running my test case get a JVM crash -
1) These are the parameters with which i invoke my Java program
java -d64 -Xcheck:jni -Xmx2560M -Xms2560M -Xss256k RunQueries
2) The Heap output at the time of the core shows "from space" as 100% used , does this signify anything?
Heap at VM Abort:
Heap
def new generation total 848128K, used 672342K [0xfffffffe93c00000, 0xfffffffec9150000, 0xfffffffec9150000)
eden space 822464K, 78% used [0xfffffffe93c00000, 0xfffffffebb385b90, 0xfffffffec5f30000)
from space 25664K, 100% used [0xfffffffec7840000, 0xfffffffec9150000, 0xfffffffec9150000)
to space 25664K, 0% used [0xfffffffec5f30000, 0xfffffffec5f30000, 0xfffffffec7840000)
tenured generation total 1747648K, used 1350866K [0xfffffffec9150000, 0xffffffff33c00000, 0xffffffff33c00000)
the space 1747648K, 77% used [0xfffffffec9150000, 0xffffffff1b884830, 0xffffffff1b884a00, 0xffffffff33c00000)
compacting perm gen total 16384K, used 13550K [0xffffffff33c00000, 0xffffffff34c00000, 0xffffffff37c00000)
the space 16384K, 82% used [0xffffffff33c00000, 0xffffffff3493b860, 0xffffffff3493ba00, 0xffffffff34c00000)
Local Time = Mon Feb 12 21:49:40 2007
Elapsed Time = 61687
# The exception above was detected in native code outside the VM
# Java VM: Java HotSpot(TM) 64-Bit Server VM (1.4.2_07-b05 mixed mode)
3) A dbx on the Java core shows the location in the JNI code where the core dump occured.
dbx `which java` core
For information about new features see `help changes'
To remove this message, put `dbxenv suppress_startup_message 7.3' in your .dbxrc
Reading java
dbx: internal warning: writable memory segment 0x7cb00000[16384] of size 0 in core
core file header read successfully
Reading ld.so.1
Reading libthread.so.1
Reading libdl.so.1
Reading libc.so.1
Reading libc_psr.so.1
Reading libjvm.so
Reading libCrun.so.1
Reading libsocket.so.1
Reading libnsl.so.1
Reading libm.so.1
WARNING!!
A loadobject was found with an unexpected checksum value.
See `help core mismatch' for details, and run `proc -map'
to see what checksum values were expected and found.
dbx: warning: Some symbolic information might be incorrect.
t@1 (l@1) terminated by signal ABRT (Abort)
0xffffffff7eea822c: lwpkill+0x0008: bcc,a,pt %icc,_lwp_kill+0x18 ! 0xffffffff7eea823c
Current function is Java_getLoid (optimized)
7239 e = cod_to_long (*(o_object*) data, &loid_as_long);
(dbx) where
current thread: t@1
[1] lwpkill(0x0, 0x6, 0xffffffffffffffe6, 0x0, 0x0, 0x0), at 0xffffffff7eea822c
[2] raise(0x6, 0x0, 0xffffffff7fffad30, 0x7fbffeff00003ff6, 0x0, 0x2), at 0xffffffff7ee58a8c
[3] abort(0x0, 0xffffffff7fffae10, 0x0, 0xfffffffffffffff8, 0x0, 0xffffffff7fffae39), at 0xffffffff7ee3e3b8
[4] os::abort(0x1, 0xffffffff7e9d295c, 0xffffffff7fffaf10, 0xffffffff7e9d24a9, 0x4b007c, 0xffffffff7eb78878), at 0xffffffff7e90951c
[5] os::handle_unexpected_exception(0x10011e600, 0xa, 0xfffffffe90345704, 0xffffffff7fffbeb0, 0xffffffff7e69c6f8, 0x0), at 0xffffffff7e907e08
[6] JVM_handle_solaris_signal(0xffffffff7fffbeb0, 0xffffffff7e9d443e, 0xffffffff7fffbbd0, 0x1, 0x0, 0x1), at 0xffffffff7e69c800
[7] __sighndlr(0xa, 0xffffffff7fffbeb0, 0xffffffff7fffbbd0, 0xffffffff7e69cb9c, 0x0, 0x0), at 0xffffffff7f2188d8
---- called from signal handler with signal 10 (SIGBUS) ------
=>[8] Java_getLoid(vjEnv = ???, cls = ???, handle = ???, attr = ???) (optimized), at 0xfffffffe90345704 (line ~7239) in "j.c"
I have added checks for this function call to ensure that no invalid pointer is being sent to it which could cause a segmentation violation.
Please could someone give me some pointers on how to solve this problem, the error occurs at this point only 12 hours after running the test case..First step is to add the option -Xcheck:jni to your java command line. It will flag common JNI errors.
If that doesn't identify the problem, then compile your jni code with debugging symbols (-g) and add the following option to the java command line when you run your test: -XX:+ShowMessageBoxOnError. When you hit the problem again, the VM will keep the process alive instead of calling abort(). Then you can use dbx to attach to the live process and should be able to get a better idea of what went wrong. -
Hi all,
We have faced this problem in our production system.
Machine is Solaris 8, sparc, Running Java 1.3.1_08 hotspot version.
I searched around quite a bit but no good solution.
Here is the stack trace that I have just before the JVM crashes.
Also, I am new to gdb. I tried to connect to core dump file through gdb but i
do not see any details. The application is running on japanese platform how can
I read the core file?
Regards
Tapan
~~~~~~~~~~~~~~~~~~~~~~
STACK TRACE -
<2004/04/26 9:44:34:JST> <Info> <T3Services> <Integral5: ReliableTopicConnection.createTopicSession:
INSIDE...>
Tag 'insert' can't insert page '/dealing/Snippet.do?name=pricingDetail.edit'.
Check if it exists.
Null property value for 'allQuotes'
java.lang.IllegalArgumentException: Null property value for 'allQuotes'
at org.apache.commons.beanutils.PropertyUtils.getNestedProperty(PropertyUtils.java:619)
at org.apache.commons.beanutils.PropertyUtils.getProperty(PropertyUtils.java:669)
at org.apache.struts.util.RequestUtils.lookup(RequestUtils.java:509)
at org.apache.struts.taglib.bean.DefineTag.doStartTag(DefineTag.java:200)
at directDerivatives._integral._dealing._swap._CC.__PricingDetailEdit._jspService(__PricingDetailEdit.java:325)
at weblogic.servlet.jsp.JspBase.service(JspBase.java:27)
at weblogic.servlet.internal.ServletStubImpl.invokeServlet(ServletStubImpl.java:262)
at weblogic.servlet.internal.ServletStubImpl.invokeServlet(ServletStubImpl.java:198)
at weblogic.servlet.internal.RequestDispatcherImpl.include(RequestDispatcherImpl.java:530)
at weblogic.servlet.internal.RequestDispatcherImpl.include(RequestDispatcherImpl.java:350)
at org.apache.struts.tiles.ActionComponentServlet.processForward(ActionComponentServlet.java:262)
at org.apache.struts.tiles.ActionComponentServlet.processActionForward(ActionComponentServlet.java:104)
at org.apache.struts.action.ActionServlet.process(ActionServlet.java:1529)
at com.integral.jsp.framework.IdcActionServlet.validateRequest(IdcActionServlet.java:331)
at com.integral.jsp.framework.IdcActionServlet.process(IdcActionServlet.java:139)
at org.apache.struts.action.ActionServlet.doGet(ActionServlet.java:487)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:740)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:853)
at weblogic.servlet.internal.ServletStubImpl.invokeServlet(ServletStubImpl.java:262)
at weblogic.servlet.internal.ServletStubImpl.invokeServlet(ServletStubImpl.java:198)
at weblogic.servlet.internal.RequestDispatcherImpl.include(RequestDispatcherImpl.java:530)
at weblogic.servlet.internal.RequestDispatcherImpl.include(RequestDispatcherImpl.java:350)
at weblogic.servlet.jsp.PageContextImpl.include(PageContextImpl.java:123)
at org.apache.struts.taglib.tiles.InsertTag$InsertHandler.doEndTag(InsertTag.java:733)
at org.apache.struts.taglib.tiles.InsertTag.doEndTag(InsertTag.java:368)
at directDerivatives._integral._dealing._workflow._template.__DealingFormLayout._jspService(__DealingFormLayout.java:1912)
at weblogic.servlet.jsp.JspBase.service(JspBase.java:27)
at weblogic.servlet.internal.ServletStubImpl.invokeServlet(ServletStubImpl.java:262)
at weblogic.servlet.internal.ServletStubImpl.invokeServlet(ServletStubImpl.java:198)
at weblogic.servlet.internal.RequestDispatcherImpl.forward(RequestDispatcherImpl.java:284)
at org.apache.struts.tiles.ActionComponentServlet.processForward(ActionComponentServlet.java:264)
at org.apache.struts.tiles.ActionComponentServlet.processActionForward(ActionComponentServlet.java:104)
at org.apache.struts.action.ActionServlet.process(ActionServlet.java:1529)
at com.integral.jsp.framework.IdcActionServlet.validateRequest(IdcActionServlet.java:331)
at com.integral.jsp.framework.IdcActionServlet.process(IdcActionServlet.java:139)
at org.apache.struts.action.ActionServlet.doGet(ActionServlet.java:487)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:740)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:853)
at weblogic.servlet.internal.ServletStubImpl.invokeServlet(ServletStubImpl.java:262)
at weblogic.servlet.internal.ServletStubImpl.invokeServlet(ServletStubImpl.java:198)
at weblogic.servlet.internal.WebAppServletContext.invokeServlet(WebAppServletContext.java:2678)
at weblogic.servlet.internal.ServletRequestImpl.execute(ServletRequestImpl.java:2412)
at weblogic.kernel.ExecuteThread.execute(ExecuteThread.java:140)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:121)<2004/04/26 9:44:34:JST>
<Info> <T3Services> <Integral5: ReliableTopicConnection.createTopicSession: ABOUT
TO ACQUIRE LOCK...>
<2004/04/26 9:44:34:JST> <Info> <T3Services> <Integral5: ReliableTopicConnection.createTopicSession:
ABOUT TO ACQUIRE LOCK...>
<2004/04/26 9:44:34:JST> <Info> <T3Services> <Integral5: ReliableTopicConnection.createTopicSession:
INSIDE...>
<2004/04/26 9:44:34:JST> <Info> <T3Services> <Integral5: ReliableTopicConnection.createTopicSession:
INSIDE...>
An irrecoverable stack overflow has occurred.
Unexpected Signal : 11 occurred at PC=0xfb3d40cc
Function name=getValue (compiled Java code)
Library=(N/A)
Current Java thread:
Dynamic libraries:
0x10000 /opt/weblogic/jdk131/bin/../bin/sparc/native_threads/java
0xff350000 /usr/lib/libthread.so.1
0xff390000 /usr/lib/libdl.so.1
0xff200000 /usr/lib/libc.so.1
0xff330000 /usr/platform/SUNW,Ultra-80/lib/libc_psr.so.1
0xfe400000 /opt/weblogic/jdk131/jre/lib/sparc/client/libjvm.so
0xff2e0000 /usr/lib/libCrun.so.1
0xff1e0000 /usr/lib/libsocket.so.1
0xff100000 /usr/lib/libnsl.so.1
0xff0d0000 /usr/lib/libm.so.1
0xff310000 /usr/lib/libw.so.1
0xff0b0000 /usr/lib/libmp.so.2
0xff060000 /opt/weblogic/jdk131/jre/lib/sparc/native_threads/libhpi.so
0xff030000 /opt/weblogic/jdk131/jre/lib/sparc/libverify.so
0xfe7c0000 /opt/weblogic/jdk131/jre/lib/sparc/libjava.so
0xfe790000 /opt/weblogic/jdk131/jre/lib/sparc/libzip.so
0xfe2d0000 /usr/lib/locale/ja_JP.PCK/ja_JP.PCK.so.2
0xfe2b0000 /usr/lib/locale/ja_JP.PCK/methods_ja_JP.PCK.so.2
0xaf5e0000 /opt/weblogic/jdk131/jre/lib/sparc/libnet.so
0xaf360000 /usr/lib/nss_files.so.1
0xaf340000 /opt/weblogic/wlserver/lib/solaris/libmuxer.so
0xaf320000 /usr/ucblib/libucb.so.1
0xaf230000 /usr/lib/libresolv.so.2
0xaf140000 /usr/lib/libelf.so.1
0xa7080000 /opt/weblogic/wlserver/lib/solaris/oci920_8/libweblogicoci37.so
0xa6400000 /opt/oracle/product/lib32/libclntsh.so.9.0
0xaf010000 /usr/lib/libC.so.5
0xaef60000 /opt/oracle/product/lib32/libwtc9.so
0xaef40000 /usr/lib/libgen.so.1
0xaef20000 /usr/lib/libsched.so.1
0xaee60000 /usr/lib/libaio.so.1
0xaee40000 /usr/lib/librt.so.1
0xad760000 /opt/weblogic/jdk131/jre/lib/sparc/libioser12.so
Local Time = Mon Apr 26 09:44:34 2004
Elapsed Time = 67979
# HotSpot Virtual Machine Error : 11
# Error ID : 4F530E43505002BD 01
# Please report this error at
# http://java.sun.com/cgi-bin/bugreport.cgi
# Java VM: Java HotSpot(TM) Client VM (1.3.1_08-b03 mixed mode)
<2004/04/26 9:44:34:JST> <Info> <T3Services> <Integral5: ReliableTopicConnection.createTopicSession:
ABOUT TO ACQUIRE LOCK...>
ˆÙíI—¹Before debugging, look at these 20 or so search hits - at least one one of them looks like a possibility.
http://search.java.sun.com/search/java/index.jsp?qp=&nh=10&qt=4F530E43505002CC&col=javabugs&col=javaforums&x=27&y=9
Also - if the problem came on suddenly, what changed....environment, software, power, hardware, etc??? -
Hello everyone,
My java program was running and all of a sudden JVM crashed. It generated a core dump file and a error log file. Somehow after couple of days the core dump file disappeared. I wanted to log onto the server to transfer the 'core' file to my PC but I could not find it anymore.
Could someone please tell me if this is normal? I am a newbie to JVM. I don't know if JVM auto-removes the core file after a few days? Now I lost the core file and cannot find out what went wrong to cause my server crashed. Please help!
I am running Solaris 8 & JDK_1.2.2_10.
Thanks a bunch!!!
Best regards,
mjhuIn some systems there is a policy to periodically remove all core files and corresponding actions are taken. This might or might not apply to yours.
I also saw a system whose /tmp directory was emptied with each reboot.
It might have even been a memory-based virtual directory, I am not sure. -
Hi,
I am using JDK 1.4.1_07 to run an application on Tomcat 4.1.27 on Solaris 5.8. I get a core dump on a load test. catalina.out has this line:
# HotSpot Virtual Machine Error, Internal Error
# Please report this error at
# http://java.sun.com/cgi-bin/bugreport.cgi
# Java VM: Java HotSpot(TM) Server VM (1.4.1_07-b02 mixed mode)
# Error ID: 434934595045264C4F570E43505009D0 01
# Problematic Thread: prio=5 tid=0x10be48 nid=0xf runnable
The page http://java.sun.com/cgi-bin/bugreport.cgi is not available. Where can I file a bug report? Any ideas on the crash?
Thanks,
ChandriI do not have problem changing the jdk version, but my application runs slow on jdk1.4.2, till i figure out why it slow i want continue using jdk1.4.1.
Is this a know issues in Jdk1.4.1, I see a bug (Bug Id: 4908923) on core dump, is this related?
http://developer.java.sun.com/developer/bugParade/bugs/4908923.html
See the both note, fix to this bug is not included in jdk1.4.1_07.
Any idea? -
Analyzing core dumps generated by JVM
I have an application written in Java that is crashing with JVM core dumps. All debug symbols have been installed but since the default build of JDK doesn't have Java binary with debug information, it is difficult to nail down the problem. gdb shows ?? for method calls. Are there any debug builds available for JDK 6u33 on Linux? From what I understand, the code base for OpenJDK 6 is different from Oracle's JDK releases so the chances of openjdk debug build having same symbol information are fairly low. Any help or direction is greatly appreciated.
VisualVM allows you to compare two memory snapshots obtained from VisualVM's lightweight memory profiler.
Have a look at the VisualVM user's guide on visualvm.dev.java.net for more detailed info.
Regards,
Luis-Miguel Alventosa - VisualVM dev team - http://blogs.sun.com/lmalventosa -
Hotspot core dumping during JVM garbage collection ?
We have an application which calls a 3rd party supplied server API which has recently been upgraded to use Java 1.5
We are getting the following error reported by our client application. The application is also now running Java 1.5 but references many classes in jar files which would have quite old code in.
The supplier of the API has stated that the problem requires us to recompile all our jar files using v 1.5 ( including things like jconnect and jms ?!?!? ). This sounds like a bit of a cop-out to me, not to mention being impossible since we don't have the source for things like jconnect.
I suspect that there is a garbage collection problem at the bottom of all this, but I'm not sure how I can "prove" this, nor do I currently have any real clue as to how to fix any GC problem that may exist.
The application is supposed to wait for a message on a MQSeries queue and then transforms it via Xalan XSLT and sends it to a Server application. I've tried playing around with heap sizes etc but that just seems to make it worse. If I leave it at the settings that the previous version used then the client at least manages to process a couple of messages before core dumping. There doesn't seem to be a consistent trigger event to cause the core dump ( it's not a message arriving on a queue for example ) but it does seem to be fairly consistent timewise, i.e. after
Any ideas gratefully accepted.
Here's a logfile excerpt from my applications showing the Hotspot error message :
=====================================================================================
08-Jul-2008 10:01:05 Waiting for messages from COLT.BBFS
08-Jul-2008 10:02:05 Waiting for messages from COLT.BBFS
08-Jul-2008 10:03:05 Waiting for messages from COLT.BBFS
405.815: [GC [PSYoungGen: 17331K->9244K(37632K)] 111702K->103615K(192128K), 0.1615910 secs]
405.977: [Full GC#
# An unexpected error has been detected by HotSpot Virtual Machine:
# SIGBUS (0xa) at pc=0xfe141348, pid=2600, tid=8
# Java VM: Java HotSpot(TM) Server VM (1.5.0_03-b07 mixed mode)
# Problematic frame:
# V [libjvm.so+0x141348]
# An error report file with more information is saved as hs_err_pid2600.log
# If you would like to submit a bug report, please visit:
# http://java.sun.com/webapps/bugreport/crash.jsp
=====================================================================================
The logfile referred to in the error message contains the following.
=====================================================================================
# An unexpected error has been detected by HotSpot Virtual Machine:
# SIGBUS (0xa) at pc=0xfe141348, pid=2600, tid=8
# Java VM: Java HotSpot(TM) Server VM (1.5.0_03-b07 mixed mode)
# Problematic frame:
# V [libjvm.so+0x141348]
--------------- T H R E A D ---------------
Current thread (0x001484d8): VMThread [id=8]
siginfo:si_signo=10, si_errno=0, si_code=1, si_addr=0x0000080f
Registers:
O0=0x00487588 O1=0xfe7d6454 O2=0x000079b0 O3=0x00007800
O4=0x00008868 O5=0x00147d48 O6=0xf8781460 O7=0xfe0f7938
G1=0xe52aaae8 G2=0x00000003 G3=0x00000003 G4=0x001484d8
G5=0xf8781d98 G6=0x00000002 G7=0xf8781d98 Y=0x805683e2
PC=0xfe141348 nPC=0xfe14134c
Top of Stack: (sp=0xf8781460)
0xf8781460: fe786000 00c6ba20 fe10013c e54bab68
0xf8781470: 0000080f e54bab6c 0000080f 00000004
0xf8781480: 00487588 00000134 e54bab6c 00000004
0xf8781490: 00000001 00000000 f87814c0 fe17aef4
0xf87814a0: fe6485b4 fe7d899c 001484d8 0011da40
0xf87814b0: 00148988 00148c10 00148d7c f8781880
0xf87814c0: 007c3389 007c3c0e 00000f87 00008868
0xf87814d0: 00008800 00487588 fe141310 fe7d6454
Instructions: (pc=0xfe141348)
0xfe141338: ec 06 c0 1a 80 a5 a0 00 22 40 00 0a ba 07 60 01
0xfe141348: f2 05 a0 00 ae 0e 60 03 80 a5 e0 03 22 40 00 05
Stack: [0xf8702000,0xf8781d98), sp=0xf8781460, free space=509k
Native frames: (J=compiled Java code, j=interpreted, Vv=VM code, C=native code)
V [libjvm.so+0x141348]
V [libjvm.so+0x17aefc]
V [libjvm.so+0x2d557c]
V [libjvm.so+0x300ef8]
V [libjvm.so+0x301e84]
V [libjvm.so+0x2ff950]
V [libjvm.so+0x29df30]
V [libjvm.so+0x362b44]
V [libjvm.so+0x6436f0]
VM_Operation (0xe03012b0): parallel gc system gc, mode: safepoint, requested by thread 0x0031bca0
--------------- P R O C E S S ---------------
Java Threads: ( => current thread )
0x00b2c028 JavaThread "Thread-4" [_thread_in_native, id=85]
0x007f5048 JavaThread "Thread-0" [_thread_blocked, id=84]
0x00c27cf0 JavaThread "Notification Delivery" [_thread_blocked, id=81]
0x0026fa08 JavaThread "RMI LeaseChecker" daemon [_thread_blocked, id=73]
0x00821048 JavaThread "RMI RenewClean-[162.11.2.32:44425]" daemon [_thread_blocked, id=70]
0x0031bca0 JavaThread "GC Daemon" daemon [_thread_blocked, id=67]
0x00cd5d28 JavaThread "RMI Reaper" [_thread_blocked, id=66]
0x003c9300 JavaThread "Timer-0" daemon [_thread_blocked, id=65]
0x00929fe0 JavaThread "RMI TCP Accept-0" daemon [_thread_in_native, id=64]
0x0089bf18 JavaThread "SeedGenerator Thread" daemon [_thread_blocked, id=42]
0x00c47248 JavaThread "Pool thread #7" daemon [_thread_blocked, id=38]
0x00c466a0 JavaThread "Pool thread #6" daemon [_thread_blocked, id=37]
0x00311850 JavaThread "Pool thread #5" daemon [_thread_blocked, id=36]
0x00287a40 JavaThread "Pool thread #4" daemon [_thread_blocked, id=35]
0x00286e98 JavaThread "Pool thread #3" daemon [_thread_blocked, id=34]
0x00c134b0 JavaThread "Pool thread #2" daemon [_thread_blocked, id=33]
0x00ad09e0 JavaThread "Pool thread #1" daemon [_thread_blocked, id=32]
0x00286cd8 JavaThread "PoolThreadManager" daemon [_thread_blocked, id=31]
0x00c129e0 JavaThread "Channel Reaper" daemon [_thread_blocked, id=30]
0x00c669e8 JavaThread "ORB Daemon Thread" daemon [_thread_blocked, id=29]
0x00b10170 JavaThread "Worker for ServerProtocol: (iiop) /0.0.0.0:20168" daemon [_thread_blocked, id=22]
0x008a17e0 JavaThread "Syn~ Client" daemon [_thread_blocked, id=21]
0x003dc378 JavaThread "PoolScavenger0" daemon [_thread_blocked, id=20]
0x0015a928 JavaThread "Low Memory Detector" daemon [_thread_blocked, id=15]
0x00159880 JavaThread "CompilerThread1" daemon [_thread_blocked, id=14]
0x00158a18 JavaThread "CompilerThread0" daemon [_thread_blocked, id=13]
0x00157b98 JavaThread "AdapterThread" daemon [_thread_blocked, id=12]
0x00156dc8 JavaThread "Signal Dispatcher" daemon [_thread_blocked, id=11]
0x0014ccd8 JavaThread "Finalizer" daemon [_thread_blocked, id=10]
0x0014ad90 JavaThread "Reference Handler" daemon [_thread_blocked, id=9]
0x00038238 JavaThread "main" [_thread_in_native, id=1]
Other Threads:
=>0x001484d8 VMThread [id=8]
0x0015c3b0 WatcherThread [id=16]
VM state:at safepoint (normal execution)
VM Mutex/Monitor currently owned by a thread: ([mutex/lock_event])
[0x00037728/0x00037758] Threads_lock - owner thread: 0x001484d8
[0x00033650/0x00037ba8] Heap_lock - owner thread: 0x0031bca0
Heap
PSYoungGen total 37632K, used 9244K [0xf2eb0000, 0xf7ba0000, 0xf8400000)
eden space 28352K, 0% used [0xf2eb0000,0xf2eb0000,0xf4a60000)
from space 9280K, 99% used [0xf4a60000,0xf5367080,0xf5370000)
to space 25216K, 0% used [0xf6300000,0xf6300000,0xf7ba0000)
PSOldGen total 154496K, used 94371K [0xe8400000, 0xf1ae0000, 0xf2eb0000)
object space 154496K, 61% used [0xe8400000,0xee028e78,0xf1ae0000)
PSPermGen total 35584K, used 18260K [0xe4400000, 0xe66c0000, 0xe8400000)
object space 35584K, 51% used [0xe4400000,0xe55d5158,0xe66c0000)
Dynamic libraries:
0x00010000 /dsdvlp/java/jvm/jdk1.5.0_03/bin/java
0xff350000 /usr/lib/libthread.so.1
0xff340000 /usr/lib/libdl.so.1
0xff200000 /usr/lib/libc.so.1
0xff390000 /usr/platform/SUNW,Sun-Fire-880/lib/libc_psr.so.1
0xfe000000 /dsdvlp/java/jvm/jdk1.5.0_03/jre/lib/sparc/server/libjvm.so
0xff1e0000 /usr/lib/libsocket.so.1
0xff2d0000 /usr/lib/libsched.so.1
0xff1b0000 /usr/lib/libCrun.so.1
0xff160000 /usr/lib/libm.so.1
0xff080000 /usr/lib/libnsl.so.1
0xff060000 /usr/lib/libmp.so.2
0xff030000 /dsdvlp/java/jvm/jdk1.5.0_03/jre/lib/sparc/native_threads/libhpi.so
0xfdfc0000 /dsdvlp/java/jvm/jdk1.5.0_03/jre/lib/sparc/libverify.so
0xfdf80000 /dsdvlp/java/jvm/jdk1.5.0_03/jre/lib/sparc/libjava.so
0xfdf50000 /dsdvlp/java/jvm/jdk1.5.0_03/jre/lib/sparc/libzip.so
0xfb7e0000 /usr/lib/locale/en_GB.ISO8859-1/en_GB.ISO8859-1.so.2
0xe4190000 /dsdvlp/java/jvm/jdk1.5.0_03/jre/lib/sparc/libnet.so
0xe3bd0000 /dsdvlp/lib/5/libSolarisNatives.so
0xe3e90000 /dsdvlp/java/jvm/jdk1.5.0_03/jre/lib/sparc/librmi.so
VM Arguments:
jvm_args: -Djava.ext.dirs=/dsdvlp/java/tmijar/firs7/lib/cli:/dsdvlp/java/tmijar/firs7/lib/cli/ext:/dsdvlp/java/tmijar/firs7/lib/cmn/OpenORB:/dsdvlp/java/tmijar/firs7/lib/cmn/OpenORB/ext:/dsdvlp/java/tmijar/firs7/lib/cmn:/dsdvlp/java/tmijar/firs7/lib/cmn/ext:/dsdvlp/java/tmijar/firs7/daemonlib -Duser.dir=/dsdvlp/java/tmijar/firs7 -Dopenorb.config=file:/dsdvlp/java/tmijar/firs7/configs/OpenORB/config/SynOpenORB.xml -Dopenorb.home=file:/dsdvlp/java/tmijar/firs7/configs/OpenORB -Dcom.coexis.syn.general.orbbinding=com.coexis.syn.general.orbbinding.openorb.OpenORBBinding_1_4 -Dsun.rmi.dgc.client.gcInterval=360000 -Dsun.rmi.dgc.server.gcInterval=360000000 -Xms32m -Xmx256m -Dcom.coexis.syn.clientcommandsconfiglocation=file://localhost//dsdvlp/java/tmijar/firs7/configs/clientcommands.xml -Dcom.coexis.syn.clientconfiglocation=file://localhost//dsdvlp/java/tmijar/firs7/configs/fsbbtd_client.xml -XX:+PrintGCTimeStamps -XX:+PrintGCDetails
java_command: com.coexis.syn.mqmessaging.daemon.RunDaemon -p /dsdvlp/bin/5/lndsfsd_fsbbtd.properties start
Environment Variables:
JAVA_HOME=/dsdvlp/java/jvm/jdk150
CLASSPATH=.:/dsdvlp/java/jar/jconnect520.jar:/dsdvlp/java/jar/vbjapp340.jar:/dsdvlp/java/jar/vbjorb340.jar:/dsdvlp/java/jar/javax_jndi120.jar
PATH=/usr/local/etc:/usr/lang:/usr/openwin/bin:/usr/ucb:/bin:/usr/etc:/usr/local/5/bin:/dsdvlp/bin/5:/dsdvlp/bin/4:/home/app/sybase/5/bin:/home/app/sybase/5/localscripts:/home/app/sybase/5/sqr:/home/app/lang:/home/app/lang/SC2.0.1:/usr/ccs/bin:/usr/local/opt/Acrobat3/bin:/dsdvlp/bin:.
LD_LIBRARY_PATH=/dsdvlp/java/jvm/jdk1.5.0_03/jre/lib/sparc/server:/dsdvlp/java/jvm/jdk1.5.0_03/jre/lib/sparc:/dsdvlp/java/jvm/jdk1.5.0_03/jre/../lib/sparc:/usr/lib:/usr/openwin/lib:/usr/local/5/lib:/dsdvlp/lib/5:/dstest/lib/5:/home/app/sybase/5/lib:/dstest/cats/sun4/lib:/tmitest/Opus/opus/lib
SHELL=/bin/csh
DISPLAY=CLI00184.mfil.local:1.0
OS=5
--------------- S Y S T E M ---------------
OS: Solaris 8 2/02 s28s_u7wos_08a SPARC
Copyright 2002 Sun Microsystems, Inc. All Rights Reserved.
Assembled 18 December 2001
uname:SunOS 5.8 Generic_117350-20 sun4u (T1 libthread)
rlimit: STACK 8192k, CORE 9216k, NOFILE 4096, AS infinity
load average:2.24 2.67 2.68
CPU:total 4 has_v8, has_v9, has_vis1, has_vis2, is_ultra3
Memory: 8k page, physical 8388608k(166384k free)
vm_info: Java HotSpot(TM) Server VM (1.5.0_03-b07) for solaris-sparc, built on Apr 13 2005 03:31:26 by unknown with unknown Workshop:0x550The very first suggestion I have is to move your VM to a more recent update of 1.5.0.
It looks like you are crashing with 5.0u3, and I'm pretty sure 5.0u16 is available. You
don't want to waste your time chasing a bug that's already been fixed. -
Investigation on JVM crash without core dump (by JIT compiler)
Hi, All
I posted "JVM crash without core dump due to CompilerThread1" couple months ago.
http://forum.java.sun.com/thread.jspa?threadID=5253434
I would like show what we found, and ask couple questions
1) The reason of JVM crash is "CompilerThread0/1 wanted to allocate more native memory and eventually exceeded the limit of 32-bit Linux (on Redhat, the limit of VIRT is 3G)
2) After we lower the heap size (to reduce process size) and added process size monitor (track process size every minute) and JIT compilation log (-XX:+PrintCompilation),
We found sometimes JVM process jumped more than 800M when compiling one method. with the following log
Total time for which application threads were stopped: 0.1997400 seconds
5828 xxx.xxx.SomeClass::someMethod (1507 bytes)
5828 COMPILE SKIPPED: out of nodes during split (not retryable)
549002.449: [GC [PSYoungGen: 517897K->28390K(551296K)] 942855K->453348K(1229952K), 0.0726350 secs]
if we saw "COMPILE SKIPPED: out of nodes during split (not retryable)", the process size of JVM (VIRT/RES) always jumped 800M~1000M, and sometimes the memory get reverted in 30mins to couple hours, and sometimes it lasted forever. (so before we have larger footprint, this jump will kill JVM, right now, if the jump lasts forever, any more allocation on top of it also can kill jvm (much rare))
3) This is definitely a bug of JVM, because
it only happened on server mode, not client mode
it is random, that method can be compiled success on other JVM or next restart (we have 20 JVMs)
the method is not that complicate, like 100 lines, (bigger method gets compiled success)
this only happen on PROD environment, we can't reproduce it locally or QA (the method is always compiled success)
It mostly like under some condition (maybe node space is not enough), to compile that method will trigger JVM trying to allocate much more native memory.
4) We are going to disable this method by ".hotspot_compiler" to fix it, right now we are using lower footprint, JVM dies rarely.
+To understand more about this, I have some questions about JIT compiling+
I saw same method are compiled more than once from JIT log, like the method caused our problem, it only happens on 2nd time compilation.
Is it that JIT compiler will recompile the method with deeper optimization level some time, and more optimization it uses, the more memory it requires?
(like gcc has -O2 -O3)
Thanks!
NeoToday, one JVM crashed again, with
{Heap before gc invocations=4188:
PSYoungGen total 540864K, used 487958K [0x8ba50000, 0xb1250000, 0xb1250000)
eden space 467328K, 100% used [0x8ba50000,0xa82b0000,0xa82b0000)
from space 73536K, 28% used [0xa82b0000,0xa96d5850,0xaca80000)
to space 71680K, 0% used [0xacc50000,0xacc50000,0xb1250000)
ParOldGen total 1024000K, used 493477K [0x4d250000, 0x8ba50000, 0x8ba50000)
object space 1024000K, 48% used [0x4d250000,0x6b439610,0x8ba50000)
PSPermGen total 101760K, used 101240K [0x2d250000, 0x335b0000, 0x4d250000)
object space 101760K, 99% used [0x2d250000,0x3352e1f8,0x335b0000)
405290.711: [GC [PSYoungGen: 487958K->17397K(544192K)] 981435K->518248K(1568192K), 0.0769350 secs]
Heap after gc invocations=4188:
PSYoungGen total 544192K, used 17397K [0x8ba50000, 0xb1250000, 0xb1250000)
eden space 472512K, 0% used [0x8ba50000,0x8ba50000,0xa87c0000)
from space 71680K, 24% used [0xacc50000,0xadd4d480,0xb1250000)
to space 70208K, 0% used [0xa87c0000,0xa87c0000,0xacc50000)
ParOldGen total 1024000K, used 500851K [0x4d250000, 0x8ba50000, 0x8ba50000)
object space 1024000K, 48% used [0x4d250000,0x6bb6cf70,0x8ba50000)
PSPermGen total 101760K, used 101240K [0x2d250000, 0x335b0000, 0x4d250000)
object space 101760K, 99% used [0x2d250000,0x3352e1f8,0x335b0000)
Total time for which application threads were stopped: 0.0779620 seconds
Exception in thread "CompilerThread1" java.lang.OutOfMemoryError: requested 4522768 bytes for Chunk::new. Out of swap space? -
Help on JVM Crash with core dump on solaris - 1.5_17
Some times in my load test scenarios on sun os boxes JVM crashing with core dump. Here is some dump from the file
# An unexpected error has been detected by HotSpot Virtual Machine:
# SIGSEGV (0xb) at pc=0xfea07f40, pid=1564, tid=10
# Java VM: Java HotSpot(TM) Server VM (1.5.0_17-b04 mixed mode)
# Problematic frame:
# V [libjvm.so+0x207f40]
--------------- T H R E A D ---------------
Current thread (0x0014e220): JavaThread "CompilerThread1" daemon [_thread_in_native, id=10]
siginfo:si_signo=11, si_errno=0, si_code=1, si_addr=0x00000000
Registers:
O0=0x00000010 O1=0x019c1960 O2=0x01e00ec0 O3=0x002bdc48
O4=0x01042c68 O5=0xc467eb4c O6=0xc467e330 O7=0x01042c68
G1=0x01e00ea0 G2=0xff014c94 G3=0x000000e6 G4=0x01c5a4e4
G5=0x01736e20 G6=0x00000000 G7=0xfb9e4200 Y=0x00000000
PC=0xfea07f40 nPC=0xfea07f44
--------------- S Y S T E M ---------------
OS: Solaris 10 5/08 s10s_u5wos_10 SPARC
Copyright 2008 Sun Microsystems, Inc. All Rights Reserved.
Use is subject to license terms.
Assembled 24 March 2008
uname:SunOS 5.10 Generic_127127-11 sun4v (T2 libthread)
rlimit: STACK 8192k, CORE infinity, NOFILE 65536, AS infinity
load average:2.73 2.67 2.21
CPU:total 32 has_v8, has_v9, has_vis1, has_vis2, is_ultra3, is_sun4v, is_niagara1
Memory: 8k page, physical 8257536k(366576k free)
vm_info: Java HotSpot(TM) Server VM (1.5.0_17-b04) for solaris-sparc, built on Nov 10 2008 01:58:40 by unknown with unknown Workshop:0x550
Here is the stack dump of the kill quit thread
----------------- lwp# 10 / thread# 10 --------------------
ff2c5bf0 lwpkill (6, 0, ff2f2e10, ff2a8bd0, ffffffff, 6) + 8
ff2410f8 abort (7400, 1, 7c00, ad314, ff2f12d8, 0) + 110
fee7e58c __1cCosFabort6Fi_v_ (1, 0, ff013084, fefde000, 7d94, 7c00) + 58
fef0de48 __1cHVMErrorOreport_and_die6M_v_ (0, ff03a640, ff033ff4, 1, fee82c88, ff033ff4) + c84
fea74138 JVM_handle_solaris_signal (b, c467e2b0, c467dff8, 8000, ff032fa0, 14e220) + ab4
ff2c4b28 __sighndlr (b, c467e2b0, c467dff8, fea7364c, 0, 1) + c
ff2b9b00 call_user_handler (b, ffbffeff, c, 0, fb9e4200, c467dff8) + 3b8
fea07f40 __1cMPhaseChaitinFSplit6MI_I_ (c467ec2c, 0, 0, 3677ac, 398, c) + 3410
fea13c68 __1cMPhaseChaitinRRegister_Allocate6M_v_ (c467eb4c, e88, dc0, ff0137d8, c467fb14, 48d) + 720
fea17c64 __1cHCompileICode_Gen6M_v_ (c467f218, 9e0c, 9c00, fef56b15, 0, c467ec2c) + 2b0
fea7ff14 __1cHCompile2t5B6MpnFciEnv_pnKC2Compiler_pnIciMethod_ii_v_ (c467f218, 0, 346c8, 0, fef569b8, 0) + c08
fea75fb8 __1cKC2CompilerOcompile_method6MpnFciEnv_pnIciMethod_i_v_ (c467fb14, fef42a90, 1e40f58, 244, 346c8, d1800000) + b0
fea76b68 __1cNCompileBrokerZinvoke_compiler_on_method6FpnLCompileTask__v_ (908928, 14e7fc, 13c900, 14e220, fef57367, c467fb14) + 4cc
feb3357c __1cNCompileBrokerUcompiler_thread_loop6F_v_ (ff0330b8, 13c8a0, 14e220, c5e67700, 14e7f8, 0) + 44c
feadbd20 __1cKJavaThreadDrun6M_v_ (14e220, ff037040, 7820, 0, 7800, 9400) + 2b0
fee7e0a8 __1cG_start6Fpv_0_ (14e220, 61c, fefde000, 0, 5874, 5800) + 208
ff2c49fc lwpstart (0, 0, 0, 0, 0, 0)
Any idea on this dump, helps me a lot.
Thanks.[http://java.sun.com/javase/6/webnotes/trouble/TSG-VM/html/crashes.html]
-
JVM crashes with " ErrOut:Abort - core dumped "
Hi
I am using Sun Sparc server.when running my installer i am getting an error
ErrOut:
Abort - core dumped
Server Version:
bash-2.03$ isainfo
sparcv9 sparc
bash-2.03$ isainfo -v
64-bit sparcv9 applications
32-bit sparc applications
bash-2.03$ isainfo -k
sparcv9
bash-2.03$
I installed jdk 1.4.2_16 java version.
Please help in solving this issue... We are unable to go with Installation
==================================================
I+In LOG FILE:+
An unexpected exception has been detected in native code outside the VM.
Unexpected Signal : 11 occurred at PC=0xEC10E15C
Function=[Unknown. Nearest: Java_sun_awt_font_NativeFontWrapper_registerFonts+0x346C]
Library=/tmp/SIEBEL/isjAAABfaqsI/lib/sparc/libfontmanager.so
Current Java thread:
at sun.awt.font.NativeFontWrapper.registerFonts(Native Method)
- locked <f6468460> (a java.lang.Class)
at sun.java2d.SunGraphicsEnvironment.addPathFonts(SunGraphicsEnvironment.java:736)
at sun.java2d.SunGraphicsEnvironment.registerFonts(SunGraphicsEnvironment.java:590)
at sun.java2d.SunGraphicsEnvironment.access$100(SunGraphicsEnvironment.java:49)
at sun.java2d.SunGraphicsEnvironment$2.run(SunGraphicsEnvironment.java:209)
at java.security.AccessController.doPrivileged(Native Method)
at sun.java2d.SunGraphicsEnvironment.loadFonts(SunGraphicsEnvironment.java:203)
- locked <ee39ad38> (a sun.awt.X11GraphicsEnvironment)
at sun.java2d.SunGraphicsEnvironment.initTerminalNames(SunGraphicsEnvironment.java:1029)
at sun.java2d.SunGraphicsEnvironment.initCompositeFonts(SunGraphicsEnvironment.java:795)
at sun.java2d.SunGraphicsEnvironment.access$200(SunGraphicsEnvironment.java:49)
at sun.java2d.SunGraphicsEnvironment$1.run(SunGraphicsEnvironment.java:160)
at java.security.AccessController.doPrivileged(Native Method)
at sun.java2d.SunGraphicsEnvironment.<init>(SunGraphicsEnvironment.java:78)
at sun.awt.X11GraphicsEnvironment.<init>(X11GraphicsEnvironment.java:150)
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:39)
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:27)
at java.lang.reflect.Constructor.newInstance(Constructor.java:274)
at java.lang.Class.newInstance0(Class.java:306)
at java.lang.Class.newInstance(Class.java:259)
at java.awt.GraphicsEnvironment.getLocalGraphicsEnvironment(GraphicsEnvironment.java:62)
- locked <f641dc98> (a java.lang.Class)
at java.awt.Font.initializeFont(Font.java:309)
at java.awt.Font.<init>(Font.java:345)
at javax.swing.plaf.FontUIResource.<init>(FontUIResource.java:36)
at com.sun.java.swing.plaf.motif.MotifLookAndFeel.initComponentDefaults(MotifLookAndFeel.java:181)
at javax.swing.plaf.basic.BasicLookAndFeel.getDefaults(BasicLookAndFeel.java:81)
at javax.swing.UIManager.setLookAndFeel(UIManager.java:394)
at javax.swing.UIManager.setLookAndFeel(UIManager.java:424)
at com.installshield.wizard.swing.SwingWizardUI.switchToSystemLAF(SwingWizardUI.java:26)
at com.installshield.wizard.swing.SwingWizardUI.initialize(SwingWizardUI.java:216)
at com.installshield.wizard.StandardWizardListener.wizardInitializing(StandardWizardListener.java:25)
at com.installshield.wizard.Wizard$WizardListenerInitializer.run(Wizard.java:1619)
at java.lang.Thread.run(Thread.java:536)
Dynamic libraries:
0x10000 /tmp/SIEBEL/isjAAABfaqsI/bin/java
0xff350000 /usr/lib/libthread.so.1
0xff3a0000 /usr/lib/libdl.so.1
0xff200000 /usr/lib/libc.so.1
0xff340000 /usr/platform/SUNW,Sun-Fire-880/lib/libc_psr.so.1
0xfe000000 /tmp/SIEBEL/isjAAABfaqsI/lib/sparc/client/libjvm.so
0xff2e0000 /usr/lib/libCrun.so.1
0xff1e0000 /usr/lib/libsocket.so.1
0xff100000 /usr/lib/libnsl.so.1
0xff0d0000 /usr/lib/libm.so.1
0xff1c0000 /usr/lib/libmp.so.2
0xff0a0000 /tmp/SIEBEL/isjAAABfaqsI/lib/sparc/native_threads/libhpi.so
0xff070000 /tmp/SIEBEL/isjAAABfaqsI/lib/sparc/libverify.so
0xff020000 /tmp/SIEBEL/isjAAABfaqsI/lib/sparc/libjava.so
0xfe7e0000 /tmp/SIEBEL/isjAAABfaqsI/lib/sparc/libzip.so
0xfe510000 /tmp/SIEBEL/isjAAABfaqsI/lib/sparc/libnet.so
0xfe4f0000 /tmp/SIEBEL/ismp002/5868705.tmp
0xfa080000 /tmp/SIEBEL/isjAAABfaqsI/lib/sparc/libawt.so
0xfe470000 /tmp/SIEBEL/isjAAABfaqsI/lib/sparc/libmlib_image.so
0xfc490000 /tmp/SIEBEL/isjAAABfaqsI/lib/sparc/motif21/libmawt.so
0xec580000 /usr/dt/lib/libXm.so.4
0xfc420000 /usr/openwin/lib/libXt.so.4
0xfdfd0000 /usr/openwin/lib/libXext.so.0
0xfdfb0000 /usr/openwin/lib/libXtst.so.1
0xec200000 /usr/openwin/lib/libX11.so.4
0xfa3a0000 /usr/openwin/lib/libdps.so.5
0xfc7e0000 /usr/openwin/lib/libSM.so.6
0xfa150000 /usr/openwin/lib/libICE.so.6
0xec100000 /tmp/SIEBEL/isjAAABfaqsI/lib/sparc/libfontmanager.so
Local Time = Wed Feb 27 13:33:57 2008
Elapsed Time = 7
# The exception above was detected in native code outside the VM
# Java VM: Java HotSpot(TM) Client VM (1.4.1_02-b06 mixed mode)
# An error report file has been saved as hs_err_pid17568.log.
# Please refer to the file for further information.
#Hi,
any news from this error? Have you solved it?
Rgs
Janne Johansson -
Application cause java core dump, how can i do?
Hi
In the case, we're using JDK 1.4 and Hibernate on Aix 64 bit, but seems we've got lots of java core even occupied full hard space and cause application crash
system info :
JavaVersion is J2RE 1.4.2 IBM AIX 5L for PowerPC (64 bit JVM)
build caix64142ifx-20051115 (SR3 + 94164 + 97403 + 97482)
(note the 64 bit JVM).
-Xmx=1024 and -xms=512, free heap is 330,415,568 bytes, and allocated
is 1073,740,288 bytes.
some core dump :
WebContainer : 4
at java.io.ObjectInputStream.readString()
at java.io.ObjectInputStream.readObject0()
at java.io.ObjectInputStream.defaultReadFields()
at java.io.ObjectInputStream.readSerialData()
at java.io.ObjectInputStream.readOrdinaryObject()
at java.io.ObjectInputStream.readObject0()
at java.io.ObjectInputStream.readArray()
at java.io.ObjectInputStream.readObject0()
at java.io.ObjectInputStream.defaultReadFields()
at java.io.ObjectInputStream.readSerialData()
at java.io.ObjectInputStream.readOrdinaryObject()
at java.io.ObjectInputStream.readObject0()
at java.io.ObjectInputStream.readArray()
at java.io.ObjectInputStream.readObject0()
at java.io.ObjectInputStream.defaultReadFields()
at java.io.ObjectInputStream.readSerialData()
at java.io.ObjectInputStream.readOrdinaryObject()
at java.io.ObjectInputStream.readObject0() at java.io.ObjectInputStream.readArray()
at java.io.ObjectInputStream.readObject0()
at java.io.ObjectInputStream.defaultReadFields()
at java.io.ObjectInputStream.readSerialData()
at java.io.ObjectInputStream.readOrdinaryObject()
at java.io.ObjectInputStream.readObject0()
at java.io.ObjectInputStream.readArray()
at java.io.ObjectInputStream.readObject0()
at java.io.ObjectInputStream.defaultReadFields()
at java.io.ObjectInputStream.readSerialData()
at java.io.ObjectInputStream.readOrdinaryObject()
at java.io.ObjectInputStream.readObject0()
at java.io.ObjectInputStream.defaultReadFields()
at java.io.ObjectInputStream.readSerialData()
at java.io.ObjectInputStream.readOrdinaryObject()
at java.io.ObjectInputStream.readObject0()
at java.io.ObjectInputStream.readArray()
at java.io.ObjectInputStream.readObject0()
at java.io.ObjectInputStream.defaultReadFields()
at java.io.ObjectInputStream.readSerialData()
at java.io.ObjectInputStream.readOrdinaryObject()
at java.io.ObjectInputStream.readObject0()
at java.io.ObjectInputStream.readArray()
at java.io.ObjectInputStream.readObject0()
at java.io.ObjectInputStream.defaultReadFields()
at java.io.ObjectInputStream.readSerialData()
at java.io.ObjectInputStream.readOrdinaryObject()
at java.io.ObjectInputStream.readObject0()
at java.io.ObjectInputStream.readArray()
at java.io.ObjectInputStream.readObject0()
at java.io.ObjectInputStream.readObject()
at java.util.HashMap.readObject()
at sun.reflect.GeneratedMethodAccessor399.invoke()
at sun.reflect.DelegatingMethodAccessorImpl.invoke()
at java.lang.reflect.Method.invoke()
at java.io.ObjectStreamClass.invokeReadObject()
at java.io.ObjectInputStream.readSerialData()
at java.io.ObjectInputStream.readOrdinaryObject()
at java.io.ObjectInputStream.readObject0()
at java.io.ObjectInputStream.defaultReadFields()
at java.io.ObjectInputStream.readSerialData()
at java.io.ObjectInputStream.readOrdinaryObject()
at java.io.ObjectInputStream.readObject0()
at java.io.ObjectInputStream.readObject()
at com.ibm.ws.naming.util.Serialization$1.run()
at com.ibm.ws.security.util.AccessController.doPrivileged()
at com.ibm.ws.naming.util.Serialization.deserializeObject()
at com.ibm.ws.naming.util.Helpers
.processSerializedObjectForLookupExt()
at com.ibm.ws.naming.util.Helpers.processSerializedObjectForLookup()
at com.ibm.ws.naming.jndicos.CNContextImpl.processResolveResults()
at com.ibm.ws.naming.jndicos.CNContextImpl.doLookup()
at com.ibm.ws.naming.jndicos.CNContextImpl.doLookup()
at com.ibm.ws.naming.jndicos.CNContextImpl.lookupExt()
at com.ibm.ws.naming.jndicos.CNContextImpl.lookup()
at com.ibm.ws.naming.util.WsnInitCtx.lookup()
at javax.naming.InitialContext.lookup()
at com.ibm.wsspi.RegistryLoader.getPluginRegistry()
at com.ibm.wsspi.IPluginRegistryFactory.getPluginRegistry()
at ibmjsp.com2E_ibm_2E_ws_2E_console_2E_appmanagement
._collectionTableLayout._jspService()
at com.ibm.ws.jsp.runtime.HttpJspBase.service()
at javax.servlet.http.HttpServlet.service()
at com.ibm.ws.webcontainer.servlet.ServletWrapper.service()
at com.ibm.ws.webcontainer.servlet.ServletWrapper.service()
at com.ibm.ws.webcontainer.filter.WebAppFilterChain.doFilter()
at com.ibm.ws.webcontainer.filter.WebAppFilterChain._doFilter()
at com.ibm.ws.webcontainer.servlet.ServletWrapper.handleRequest()
at com.ibm.wsspi.webcontainer.servlet.GenericServletWrapper
.handleRequest()
at com.ibm.ws.jsp.webcontainerext.JSPExtensionServletWrapper
.handleRequest()
at com.ibm.ws.webcontainer.webapp.WebAppRequestDispatcher.include()
at org.apache.jasper.runtime.JspRuntimeLibrary.include()
at org.apache.jasper.runtime.PageContextImpl.include()
at org.apache.struts.tiles.TilesUtilImpl.doInclude()
at org.apache.struts.tiles.TilesUtil.doInclude()
at org.apache.struts.taglib.tiles.InsertTag.doInclude()
at org.apache.struts.taglib.tiles.InsertTag$InsertHandler.doEndTag()
at org.apache.struts.taglib.tiles.InsertTag.doEndTag()
at ibmjsp.secure.layouts.vboxLayout._jspService()
at com.ibm.ws.jsp.runtime.HttpJspBase.service()
at javax.servlet.http.HttpServlet.service()
at com.ibm.ws.webcontainer.servlet.ServletWrapper.service()
at com.ibm.ws.webcontainer.servlet.ServletWrapper.service()
at com.ibm.ws.webcontainer.filter.WebAppFilterChain.doFilter()
... more stack lines not shown ===================================
"WebContainer: 2" shows much
the same stack trace, but extends to include
@com.ibm.ws.console.core.servlet.WSCUrlFilter.continueStoringTaskState()
at com.ibm.ws.console.core.servlet.WSCUrlFilter.doFilter()
at com.ibm.ws.webcontainer.filter.FilterInstanceWrapper.doFilter()
at com.ibm.ws.webcontainer.filter.WebAppFilterChain.doFilter()
at com.ibm.ws.webcontainer.filter.WebAppFilterChain._doFilter()
at com.ibm.ws.webcontainer.servlet.ServletWrapper.handleRequest()
Through IBM, we got those answer :
Looking at the javacore files, we're seeing OOM errors. However,
looking at a heapdump, we're not seeing total heap space exhaustion -
around half of the heap is occupied, and occupancy by the vartious
objects seems, to me at least, to be normal.
The threads
seem to be using the compound class loader to load the customer's
"Hibernate" code - and in the largest of the threads in the heapdump -
(it consumes 258,720,168 bytes), the class org/hibernate/impl/Session
Impl and its children - consume 129,540,864 bytes.
The other 128,785,680 is consumed by org/hibernate/proxy/CGLIBLazyInitia
lizer. There are some other classes that make up the small difference
if you added these numbers.
The class com/softleader/hibernate/util/HibernateUtil and its children
consume 74,932,848 bytes.
I could go on through the heapdump, but there are very large classes
in here, and it may be more advantageous to get a verbosegc turned on
to show the patterns of JVM Heap requirements.
I suppose that the customer is developing this app for a 32bit
architecture market, since they are keeping their JVM Heap within the
32 bit limits. If this is the case, then Xmx=1280 and Xms=384 seems a
more reasonable JVM setting. If they are not, and they want to try
Xmx above 1280, then we have not yet had much experience with 64 bit
but I'd expect that the larger heapsize would benefit the application.
Either way, we need verbosegc turned on to monitor the heap requests.
That mean, i have to turn up JVM Heap size? or what can i do for it?
Thanks a lot.I'd hook up a profiler to your app and monitor it to see what's happening and what objects aren't playing nice.
-
JDB crashes while lodading core dump or throws errors
I'm having here RHEL 5.1 system and some core dumps generated by our 32 bit java application. This application uses JNI and for some reason (that I'm still trying to figure out) is crashing while executing JNI calls.
I can load the core dumps inside gdb and even backtrace the native stack of the program and see the variables inside the shared library where it's crashing. But I need to take a closer look on the java stack and some of the variable values on the java side also.
I did try to use JDB to do this like it's described in the Troubleshooting guide for Java 6 but for some unknown reason when I do try to attach JDB to the core dumps I either get some error thrown on the console or JDB crashes and produces a hs_err_pit*.log file. I have used this technique already few times and didn't had any problems with JDB. I'm wondering if it could be that the core dump files are too big - some of them are around 3 Gb. But one of them is ~600Mb and also is crashing. So is ti possible bug in JDB or I'm missing something. I'm posting the error and the one of the hs_err_pid files.
Appreciate any help and ideas
$ jdb -connect sun.jvm.hotspot.jdi.SACoreAttachingConnector:javaExecutable=/usr/java/jdk/bin/java,core=core.31919
java.io.IOException
at sun.jvm.hotspot.jdi.SACoreAttachingConnector.attach(SACoreAttachingConnector.java:123)
at com.sun.tools.example.debug.tty.VMConnection.attachTarget(VMConnection.java:358)
at com.sun.tools.example.debug.tty.VMConnection.open(VMConnection.java:168)
at com.sun.tools.example.debug.tty.Env.init(Env.java:64)
at com.sun.tools.example.debug.tty.TTY.main(TTY.java:1010)
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at sun.jvm.hotspot.jdi.SACoreAttachingConnector.createVirtualMachine(SACoreAttachingConnector.java:80)
at sun.jvm.hotspot.jdi.SACoreAttachingConnector.attach(SACoreAttachingConnector.java:108)
... 4 more
Caused by: sun.jvm.hotspot.debugger.DebuggerException: Can't attach to the core file
at sun.jvm.hotspot.debugger.linux.LinuxDebuggerLocal.attach0(Native Method)
at sun.jvm.hotspot.debugger.linux.LinuxDebuggerLocal.attach(LinuxDebuggerLocal.java:258)
at sun.jvm.hotspot.HotSpotAgent.attachDebugger(HotSpotAgent.java:625)
at sun.jvm.hotspot.HotSpotAgent.setupDebuggerLinux(HotSpotAgent.java:611)
at sun.jvm.hotspot.HotSpotAgent.setupDebugger(HotSpotAgent.java:322)
at sun.jvm.hotspot.HotSpotAgent.go(HotSpotAgent.java:297)
at sun.jvm.hotspot.HotSpotAgent.attach(HotSpotAgent.java:157)
at sun.jvm.hotspot.jdi.VirtualMachineImpl.createVirtualMachineForCorefile(VirtualMachineImpl.java:190)
... 10 more
Fatal error:
Unable to attach to target VM.
# An unexpected error has been detected by Java Runtime Environment:
# SIGSEGV (0xb) at pc=0xafcfa6bd, pid=3653, tid=4160613264
# Java VM: Java HotSpot(TM) Server VM (1.6.0_03-b05 mixed mode)
# Problematic frame:
# C [libsaproc.so+0x36bd]
# If you would like to submit a bug report, please visit:
# http://java.sun.com/webapps/bugreport/crash.jsp
--------------- T H R E A D ---------------
Current thread (0x08058000): JavaThread "main" [_thread_in_native, id=3654]
siginfo:si_signo=11, si_errno=0, si_code=1, si_addr=0x00000151
Registers:
EAX=0xf7ffdabc, EBX=0xafcff25c, ECX=0xafd72d08, EDX=0x00000149
ESP=0xf7fdc520, EBP=0xf7fdc538, ESI=0xafd72d08, EDI=0x08058000
EIP=0xafcfa6bd, CR2=0x00000151, EFLAGS=0x00010206
Top of Stack: (sp=0xf7fdc520)
0xf7fdc520: 464c457f 00010101 000000a2 0000009c
0xf7fdc530: 0000009f afcff25c f7fdc588 afcfb01a
0xf7fdc540: afd67780 f7ffdabc 00200034 afcfaff4
0xf7fdc550: 004a004b 00000000 00200034 0028000a
0xf7fdc560: 004a004b afba13e0 00001110 afcff25c
0xf7fdc570: afb8e2e8 08058000 f7fdc5a8 afcf93b3
0xf7fdc580: 00000004 afcff25c f7fdc5a8 afcf9964
0xf7fdc590: afd67780 f7ffdabc f7fdd72c 00000004
Instructions: (pc=0xafcfa6bd)
0xafcfa6ad: 8d 14 85 00 00 00 00 8b 41 24 8b 14 10 8b 45 0c
0xafcfa6bd: 3b 42 08 72 08 8b 45 f8 89 45 f4 eb b1 8b 45 f8
Stack: [0xf7f8e000,0xf7fdf000), sp=0xf7fdc520, free space=313k
Native frames: (J=compiled Java code, j=interpreted, Vv=VM code, C=native code)
C [libsaproc.so+0x36bd]
C [libsaproc.so+0x401a]
C [libsaproc.so+0x2964] ps_pdread+0x1c
C [libsaproc.so+0x4d3e]
C [libsaproc.so+0x4ffd] Pgrab_core+0x281
C [libsaproc.so+0x56c7] Java_sun_jvm_hotspot_debugger_linux_LinuxDebuggerLocal_attach0__Ljava_lang_String_2Ljava_lang_String_2+0x99
j sun.jvm.hotspot.debugger.linux.LinuxDebuggerLocal.attach0(Ljava/lang/String;Ljava/lang/String;)V+0
j sun.jvm.hotspot.debugger.linux.LinuxDebuggerLocal.attach(Ljava/lang/String;Ljava/lang/String;)V+29
j sun.jvm.hotspot.HotSpotAgent.attachDebugger()V+43
j sun.jvm.hotspot.HotSpotAgent.setupDebuggerLinux()V+122
j sun.jvm.hotspot.HotSpotAgent.setupDebugger()V+95
j sun.jvm.hotspot.HotSpotAgent.go()V+1
j sun.jvm.hotspot.HotSpotAgent.attach(Ljava/lang/String;Ljava/lang/String;)V+56
j sun.jvm.hotspot.jdi.VirtualMachineImpl.createVirtualMachineForCorefile(Lcom/sun/jdi/VirtualMachineManager;Ljava/lang/String;Ljava/lang/String;I)Lsun/jvm/hotspot/jdi/VirtualMachineImpl;+58
v ~StubRoutines::call_stub
V [libjvm.so+0x2c5ecd]
V [libjvm.so+0x4523b8]
V [libjvm.so+0x2c5d60]
V [libjvm.so+0x49a08f]
V [libjvm.so+0x49ca8c]
V [libjvm.so+0x331e88]
C [libjava.so+0x15224] Java_sun_reflect_NativeMethodAccessorImpl_invoke0+0x34
j sun.reflect.NativeMethodAccessorImpl.invoke0(Ljava/lang/reflect/Method;Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+0
j sun.reflect.NativeMethodAccessorImpl.invoke(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+87
j sun.reflect.DelegatingMethodAccessorImpl.invoke(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+6
j java.lang.reflect.Method.invoke(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+161
j sun.jvm.hotspot.jdi.SACoreAttachingConnector.createVirtualMachine(Ljava/lang/Class;Ljava/lang/String;Ljava/lang/String;)Lcom/sun/jdi/VirtualMachine;+122
j sun.jvm.hotspot.jdi.SACoreAttachingConnector.attach(Ljava/util/Map;)Lcom/sun/jdi/VirtualMachine;+90
j com.sun.tools.example.debug.tty.VMConnection.attachTarget()Lcom/sun/jdi/VirtualMachine;+13
j com.sun.tools.example.debug.tty.VMConnection.open()Lcom/sun/jdi/VirtualMachine;+33
j com.sun.tools.example.debug.tty.Env.init(Ljava/lang/String;ZI)V+28
j com.sun.tools.example.debug.tty.TTY.main([Ljava/lang/String;)V+1207
v ~StubRoutines::call_stub
V [libjvm.so+0x2c5ecd]
V [libjvm.so+0x4523b8]
V [libjvm.so+0x2c5d60]
V [libjvm.so+0x2ef186]
V [libjvm.so+0x2e082b]
C [jdb+0x1af8] JavaMain+0x2c8
C [libpthread.so.0+0x543b]
Java frames: (J=compiled Java code, j=interpreted, Vv=VM code)
j sun.jvm.hotspot.debugger.linux.LinuxDebuggerLocal.attach0(Ljava/lang/String;Ljava/lang/String;)V+0
j sun.jvm.hotspot.debugger.linux.LinuxDebuggerLocal.attach(Ljava/lang/String;Ljava/lang/String;)V+29
j sun.jvm.hotspot.HotSpotAgent.attachDebugger()V+43
j sun.jvm.hotspot.HotSpotAgent.setupDebuggerLinux()V+122
j sun.jvm.hotspot.HotSpotAgent.setupDebugger()V+95
j sun.jvm.hotspot.HotSpotAgent.go()V+1
j sun.jvm.hotspot.HotSpotAgent.attach(Ljava/lang/String;Ljava/lang/String;)V+56
j sun.jvm.hotspot.jdi.VirtualMachineImpl.createVirtualMachineForCorefile(Lcom/sun/jdi/VirtualMachineManager;Ljava/lang/String;Ljava/lang/String;I)Lsun/jvm/hotspot/jdi/VirtualMachineImpl;+58
v ~StubRoutines::call_stub
j sun.reflect.NativeMethodAccessorImpl.invoke0(Ljava/lang/reflect/Method;Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+0
j sun.reflect.NativeMethodAccessorImpl.invoke(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+87
j sun.reflect.DelegatingMethodAccessorImpl.invoke(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+6
j java.lang.reflect.Method.invoke(Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;+161
j sun.jvm.hotspot.jdi.SACoreAttachingConnector.createVirtualMachine(Ljava/lang/Class;Ljava/lang/String;Ljava/lang/String;)Lcom/sun/jdi/VirtualMachine;+122
j sun.jvm.hotspot.jdi.SACoreAttachingConnector.attach(Ljava/util/Map;)Lcom/sun/jdi/VirtualMachine;+90
j com.sun.tools.example.debug.tty.VMConnection.attachTarget()Lcom/sun/jdi/VirtualMachine;+13
j com.sun.tools.example.debug.tty.VMConnection.open()Lcom/sun/jdi/VirtualMachine;+33
j com.sun.tools.example.debug.tty.Env.init(Ljava/lang/String;ZI)V+28
j com.sun.tools.example.debug.tty.TTY.main([Ljava/lang/String;)V+1207
v ~StubRoutines::call_stub
--------------- P R O C E S S ---------------
Java Threads: ( => current thread )
0xafd08c00 JavaThread "Thread-1" daemon [_thread_blocked, id=3682]
0x0819b000 JavaThread "Low Memory Detector" daemon [_thread_blocked, id=3680]
0x08199400 JavaThread "CompilerThread1" daemon [_thread_blocked, id=3679]
0x08198000 JavaThread "CompilerThread0" daemon [_thread_blocked, id=3678]
0x08196c00 JavaThread "Signal Dispatcher" daemon [_thread_blocked, id=3677]
0x08183c00 JavaThread "Finalizer" daemon [_thread_blocked, id=3676]
0x08183400 JavaThread "Reference Handler" daemon [_thread_blocked, id=3675]
=>0x08058000 JavaThread "main" [_thread_in_native, id=3654]
Other Threads:
0x08180800 VMThread [id=3671]
0x0819c800 WatcherThread [id=3681]
VM state:not at safepoint (normal execution)
VM Mutex/Monitor currently owned by a thread: None
Heap
PSYoungGen total 9280K, used 2718K [0xedca0000, 0xee6f0000, 0xf4e60000)
eden space 8000K, 33% used [0xedca0000,0xedf47b40,0xee470000)
from space 1280K, 0% used [0xee5b0000,0xee5b0000,0xee6f0000)
to space 1280K, 0% used [0xee470000,0xee470000,0xee5b0000)
PSOldGen total 84992K, used 0K [0xb4e60000, 0xba160000, 0xedca0000)
object space 84992K, 0% used [0xb4e60000,0xb4e60000,0xba160000)
PSPermGen total 16384K, used 3088K [0xb0e60000, 0xb1e60000, 0xb4e60000)
object space 16384K, 18% used [0xb0e60000,0xb1164398,0xb1e60000)
Dynamic libraries:
00b31000-00b4a000 r-xp 00000000 fd:00 5932045 /lib/ld-2.5.so
00b4a000-00b4b000 r-xp 00019000 fd:00 5932045 /lib/ld-2.5.so
00b4b000-00b4c000 rwxp 0001a000 fd:00 5932045 /lib/ld-2.5.so
00b4e000-00c88000 r-xp 00000000 fd:00 5932057 /lib/libc-2.5.so
00c88000-00c8a000 r-xp 00139000 fd:00 5932057 /lib/libc-2.5.so
00c8a000-00c8b000 rwxp 0013b000 fd:00 5932057 /lib/libc-2.5.so
00c8b000-00c8e000 rwxp 00c8b000 00:00 0
00c90000-00ca3000 r-xp 00000000 fd:00 5932059 /lib/libpthread-2.5.so
00ca3000-00ca4000 r-xp 00012000 fd:00 5932059 /lib/libpthread-2.5.so
00ca4000-00ca5000 rwxp 00013000 fd:00 5932059 /lib/libpthread-2.5.so
00ca5000-00ca7000 rwxp 00ca5000 00:00 0
00ca9000-00cab000 r-xp 00000000 fd:00 5932058 /lib/libdl-2.5.so
00cab000-00cac000 r-xp 00001000 fd:00 5932058 /lib/libdl-2.5.so
00cac000-00cad000 rwxp 00002000 fd:00 5932058 /lib/libdl-2.5.so
00caf000-00cb6000 r-xp 00000000 fd:00 5932062 /lib/librt-2.5.so
00cb6000-00cb7000 r-xp 00006000 fd:00 5932062 /lib/librt-2.5.so
00cb7000-00cb8000 rwxp 00007000 fd:00 5932062 /lib/librt-2.5.so
00d9b000-00dc0000 r-xp 00000000 fd:00 5932060 /lib/libm-2.5.so
00dc0000-00dc1000 r-xp 00024000 fd:00 5932060 /lib/libm-2.5.so
00dc1000-00dc2000 rwxp 00025000 fd:00 5932060 /lib/libm-2.5.so
06000000-065a0000 r-xp 00000000 fd:00 16777229 /usr/java/jdk1.6.0_03/jre/lib/i386/server/libjvm.so
065a0000-065db000 rwxp 005a0000 fd:00 16777229 /usr/java/jdk1.6.0_03/jre/lib/i386/server/libjvm.so
065db000-069fc000 rwxp 065db000 00:00 0
08048000-08052000 r-xp 00000000 fd:00 16810695 /usr/java/jdk1.6.0_03/bin/jdb
08052000-08053000 rwxp 00009000 fd:00 16810695 /usr/java/jdk1.6.0_03/bin/jdb
08053000-08289000 rwxp 08053000 00:00 0 [heap]
afa00000-afa39000 rwxp afa00000 00:00 0
afa39000-afb00000 ---p afa39000 00:00 0
afb00000-afbf2000 rwxp afb00000 00:00 0
afbf2000-afc00000 ---p afbf2000 00:00 0
afcf7000-afcff000 r-xp 00000000 fd:00 16777232 /usr/java/jdk1.6.0_03/jre/lib/i386/libsaproc.so
afcff000-afd00000 rwxp 00007000 fd:00 16777232 /usr/java/jdk1.6.0_03/jre/lib/i386/libsaproc.so
afd00000-afe00000 rwxp afd00000 00:00 0
afe60000-afe63000 ---p afe60000 00:00 0
afe63000-afeb1000 rwxp afe63000 00:00 0
afeb1000-afeb6000 r-xp 00000000 fd:00 5931062 /lib/libthread_db-1.0.so
afeb6000-afeb7000 r-xp 00004000 fd:00 5931062 /lib/libthread_db-1.0.so
afeb7000-afeb8000 rwxp 00005000 fd:00 5931062 /lib/libthread_db-1.0.so
afecb000-afede000 r-xp 00000000 fd:00 16777249 /usr/java/jdk1.6.0_03/jre/lib/i386/libnet.so
afede000-afedf000 rwxp 00013000 fd:00 16777249 /usr/java/jdk1.6.0_03/jre/lib/i386/libnet.so
afedf000-afefe000 r-xs 00152000 fd:00 16810648 /usr/java/jdk1.6.0_03/lib/sa-jdi.jar
afefe000-aff5b000 r-xs 00b3c000 fd:00 16811549 /usr/java/jdk1.6.0_03/lib/tools.jar
aff5b000-aff5c000 ---p aff5b000 00:00 0
aff5c000-affdc000 rwxp aff5c000 00:00 0
affdc000-affdf000 ---p affdc000 00:00 0
affdf000-b002d000 rwxp affdf000 00:00 0
b002d000-b0030000 ---p b002d000 00:00 0
b0030000-b00ae000 rwxp b0030000 00:00 0
b00ae000-b00b1000 ---p b00ae000 00:00 0
b00b1000-b012f000 rwxp b00b1000 00:00 0
b012f000-b0132000 ---p b012f000 00:00 0
b0132000-b0180000 rwxp b0132000 00:00 0
b0180000-b0380000 r-xp 00000000 fd:00 15535906 /usr/lib/locale/locale-archive
b0380000-b0383000 ---p b0380000 00:00 0
b0383000-b03d1000 rwxp b0383000 00:00 0
b03d1000-b03d4000 ---p b03d1000 00:00 0
b03d4000-b0422000 rwxp b03d4000 00:00 0
b0422000-b0423000 ---p b0422000 00:00 0
b0423000-b04d3000 rwxp b0423000 00:00 0
b04d3000-b064f000 r-xs 02c8f000 fd:00 16777319 /usr/java/jdk1.6.0_03/jre/lib/rt.jar
b064f000-b0650000 ---p b064f000 00:00 0
b0650000-b06d0000 rwxp b0650000 00:00 0
b06d0000-b06d1000 ---p b06d0000 00:00 0
b06d1000-b0751000 rwxp b06d1000 00:00 0
b0751000-b0752000 ---p b0751000 00:00 0
b0752000-b07d2000 rwxp b0752000 00:00 0
b07d2000-b07d3000 ---p b07d2000 00:00 0
b07d3000-b0853000 rwxp b07d3000 00:00 0
b0853000-b0854000 ---p b0853000 00:00 0
b0854000-b08d4000 rwxp b0854000 00:00 0
b08d4000-b08d5000 ---p b08d4000 00:00 0
b08d5000-b0955000 rwxp b08d5000 00:00 0
b0955000-b0956000 ---p b0955000 00:00 0
b0956000-b09d6000 rwxp b0956000 00:00 0
b09d6000-b09d7000 ---p b09d6000 00:00 0
b09d7000-b0a5f000 rwxp b09d7000 00:00 0
b0a5f000-b0a77000 rwxp b0a5f000 00:00 0
b0a77000-b0aa1000 rwxp b0a77000 00:00 0
b0aa1000-b0c3f000 rwxp b0aa1000 00:00 0
b0c3f000-b0c47000 rwxp b0c3f000 00:00 0
b0c47000-b0c5f000 rwxp b0c47000 00:00 0
b0c5f000-b0c89000 rwxp b0c5f000 00:00 0
b0c89000-b0e26000 rwxp b0c89000 00:00 0
b0e26000-b0e2c000 rwxp b0e26000 00:00 0
b0e2c000-b0e5f000 rwxp b0e2c000 00:00 0
b0e5f000-b1e60000 rwxp b0e5f000 00:00 0
b1e60000-b4e60000 rwxp b1e60000 00:00 0
b4e60000-ba160000 rwxp b4e60000 00:00 0
ba160000-edca0000 rwxp ba160000 00:00 0
edca0000-ee6f0000 rwxp edca0000 00:00 0
ee6f0000-f4e60000 rwxp ee6f0000 00:00 0
f4e63000-f4e6c000 rwxp f4e63000 00:00 0
f4e6c000-f4f23000 rwxp f4e6c000 00:00 0
f4f23000-f5163000 rwxp f4f23000 00:00 0
f5163000-f7f23000 rwxp f5163000 00:00 0
f7f23000-f7f32000 r-xp 00000000 fd:00 16777245 /usr/java/jdk1.6.0_03/jre/lib/i386/libzip.so
f7f32000-f7f34000 rwxp 0000e000 fd:00 16777245 /usr/java/jdk1.6.0_03/jre/lib/i386/libzip.so
f7f34000-f7f57000 r-xp 00000000 fd:00 16777241 /usr/java/jdk1.6.0_03/jre/lib/i386/libjava.so
f7f57000-f7f59000 rwxp 00023000 fd:00 16777241 /usr/java/jdk1.6.0_03/jre/lib/i386/libjava.so
f7f59000-f7f62000 r-xp 00000000 fd:00 5931048 /lib/libnss_files-2.5.so
f7f62000-f7f63000 r-xp 00008000 fd:00 5931048 /lib/libnss_files-2.5.so
f7f63000-f7f64000 rwxp 00009000 fd:00 5931048 /lib/libnss_files-2.5.so
f7f64000-f7f77000 r-xp 00000000 fd:00 5931145 /lib/libnsl-2.5.so
f7f77000-f7f78000 r-xp 00012000 fd:00 5931145 /lib/libnsl-2.5.so
f7f78000-f7f79000 rwxp 00013000 fd:00 5931145 /lib/libnsl-2.5.so
f7f79000-f7f7b000 rwxp f7f79000 00:00 0
f7f82000-f7f8d000 r-xp 00000000 fd:00 16777240 /usr/java/jdk1.6.0_03/jre/lib/i386/libverify.so
f7f8d000-f7f8e000 rwxp 0000b000 fd:00 16777240 /usr/java/jdk1.6.0_03/jre/lib/i386/libverify.so
f7f8e000-f7f91000 ---p f7f8e000 00:00 0
f7f91000-f7fe1000 rwxp f7f91000 00:00 0
f7fe1000-f7fe8000 r-xp 00000000 fd:00 16777243 /usr/java/jdk1.6.0_03/jre/lib/i386/jli/libjli.so
f7fe8000-f7fea000 rwxp 00006000 fd:00 16777243 /usr/java/jdk1.6.0_03/jre/lib/i386/jli/libjli.so
f7fec000-f7ff4000 rwxs 00000000 fd:00 19562502 /tmp/hsperfdata_omnitrak/3653
f7ff4000-f7ffa000 r-xp 00000000 fd:00 16777227 /usr/java/jdk1.6.0_03/jre/lib/i386/native_threads/libhpi.so
f7ffa000-f7ffb000 rwxp 00006000 fd:00 16777227 /usr/java/jdk1.6.0_03/jre/lib/i386/native_threads/libhpi.so
f7ffb000-f7ffc000 rwxp f7ffb000 00:00 0
f7ffc000-f7ffd000 r-xp f7ffc000 00:00 0
f7ffd000-f7ffe000 rwxp f7ffd000 00:00 0
ff9fb000-ffa03000 rwxp ff9fb000 00:00 0 [stack]
ffffe000-fffff000 r-xp ffffe000 00:00 0
VM Arguments:
jvm_args: -Dapplication.home=/usr/java/jdk1.6.0_03
java_command: com.sun.tools.example.debug.tty.TTY -connect sun.jvm.hotspot.jdi.SACoreAttachingConnector:javaExecutable=/usr/java/jdk/bin/java,core=core.25602
Launcher Type: SUN_STANDARD
Environment Variables:
PATH=/usr/java/jdk/bin:/usr/kerberos/bin:/usr/local/bin:/bin:/usr/bin
LD_LIBRARY_PATH=/usr/java/jdk1.6.0_03/jre/lib/i386/server:/usr/java/jdk1.6.0_03/jre/lib/i386:/usr/java/jdk1.6.0_03/jre/../lib/i386
SHELL=/bin/bash
Signal Handlers:
SIGSEGV: [libjvm.so+0x53c560], sa_mask[0]=0x7ffbfeff, sa_flags=0x10000004
SIGBUS: [libjvm.so+0x53c560], sa_mask[0]=0x7ffbfeff, sa_flags=0x10000004
SIGFPE: [libjvm.so+0x451a50], sa_mask[0]=0x7ffbfeff, sa_flags=0x10000004
SIGPIPE: [libjvm.so+0x451a50], sa_mask[0]=0x7ffbfeff, sa_flags=0x10000004
SIGILL: [libjvm.so+0x451a50], sa_mask[0]=0x7ffbfeff, sa_flags=0x10000004
SIGUSR1: SIG_DFL, sa_mask[0]=0x00000000, sa_flags=0x00000000
SIGUSR2: [libjvm.so+0x453a80], sa_mask[0]=0x00000000, sa_flags=0x10000004
SIGHUP: [libjvm.so+0x4534a0], sa_mask[0]=0x7ffbfeff, sa_flags=0x10000004
SIGINT: [libjvm.so+0x4534a0], sa_mask[0]=0x7ffbfeff, sa_flags=0x10000004
SIGQUIT: [libjvm.so+0x4534a0], sa_mask[0]=0x7ffbfeff, sa_flags=0x10000004
SIGTERM: [libjvm.so+0x4534a0], sa_mask[0]=0x7ffbfeff, sa_flags=0x10000004
SIGUSR2: [libjvm.so+0x453a80], sa_mask[0]=0x00000000, sa_flags=0x10000004
--------------- S Y S T E M ---------------
OS:Red Hat Enterprise Linux Client release 5.1 (Tikanga)
uname:Linux 2.6.18-53.el5 #1 SMP Wed Oct 10 16:34:19 EDT 2007 x86_64
libc:glibc 2.5 NPTL 2.5
rlimit: STACK 10240k, CORE 0k, NPROC 53248, NOFILE 1024, AS infinity
load average:0.07 0.22 0.42
CPU:total 8 (4 cores per cpu, 1 threads per core) family 6 model 7 stepping 6, cmov, cx8, fxsr, mmx, sse, sse2, sse3, ssse3
Memory: 4k page, physical 6113940k(245496k free), swap 2097144k(2097144k free)
vm_info: Java HotSpot(TM) Server VM (1.6.0_03-b05) for linux-x86, built on Sep 24 2007 22:32:39 by "java_re" with gcc 3.2.1-7a (J2SE release)Thank you for your responds!
I'm not trying at all to transfer the core to a different system. I'm debugging on the same linux red hat box where the cores where produced and I'm using the JDB version from the same JDK that was used to run the app.
I'm wondering what makes you think that I'm possibly mixing core files?
Here is the output that JDB generates when I define LIBSAPROC_DEBUG=1. This is the case when JDB crashes:
$ jdb -connect sun.jvm.hotspot.jdi.SACoreAttachingConnector:javaExecutable=/usr/java/jdk/bin/java,core=core.23850
libsaproc DEBUG: Note header with n_type = 1 and n_descsz = 144
libsaproc DEBUG: got integer regset for lwp 24310
libsaproc DEBUG: integer regset
libsaproc DEBUG: eax = 0x0
libsaproc DEBUG: ebx = 0x5d2a
libsaproc DEBUG: ecx = 0x5ef6
libsaproc DEBUG: edx = 0x6
libsaproc DEBUG: esp = 0x324fd0e4
libsaproc DEBUG: ebp = 0x324fd0e4
libsaproc DEBUG: esi = 0x324fd19c
libsaproc DEBUG: edi = 0x78eff4
libsaproc DEBUG: eip = 0xffffe410
libsaproc DEBUG: Note header with n_type = 3 and n_descsz = 124
libsaproc DEBUG: Note header with n_type = 6 and n_descsz = 144
libsaproc DEBUG: Note header with n_type = 2 and n_descsz = 108
libsaproc DEBUG: Note header with n_type = 1189489535 and n_descsz = 512
libsaproc DEBUG: Note header with n_type = 1 and n_descsz = 144
libsaproc DEBUG: got integer regset for lwp 27070
libsaproc DEBUG: integer regset
libsaproc DEBUG: eax = 0xfffffe00
libsaproc DEBUG: ebx = 0xa
libsaproc DEBUG: ecx = 0x312edad8
libsaproc DEBUG: edx = 0x33f4d1a4
libsaproc DEBUG: esp = 0x312edac0
libsaproc DEBUG: ebp = 0x312edac0
libsaproc DEBUG: esi = 0x0
libsaproc DEBUG: edi = 0x2000
libsaproc DEBUG: eip = 0xffffe410
libsaproc DEBUG: Note header with n_type = 2 and n_descsz = 108
libsaproc DEBUG: Note header with n_type = 1189489535 and n_descsz = 512
libsaproc DEBUG: Note header with n_type = 1 and n_descsz = 144
libsaproc DEBUG: got integer regset for lwp 27063
libsaproc DEBUG: integer regset
libsaproc DEBUG: eax = 0xfffffe00
libsaproc DEBUG: ebx = 0xa
libsaproc DEBUG: ecx = 0x334fccd8
libsaproc DEBUG: edx = 0x33f4d1a4
libsaproc DEBUG: esp = 0x334fccc0
libsaproc DEBUG: ebp = 0x334fccc0
libsaproc DEBUG: esi = 0x0
libsaproc DEBUG: edi = 0x2000
libsaproc DEBUG: eip = 0xffffe410
libsaproc DEBUG: Note header with n_type = 2 and n_descsz = 108
libsaproc DEBUG: Note header with n_type = 1189489535 and n_descsz = 512
libsaproc DEBUG: Note header with n_type = 1 and n_descsz = 144
libsaproc DEBUG: got integer regset for lwp 1754
libsaproc DEBUG: integer regset
libsaproc DEBUG: eax = 0xfffffffc
libsaproc DEBUG: ebx = 0x32baab38
libsaproc DEBUG: ecx = 0x1
libsaproc DEBUG: edx = 0x6ddd00
libsaproc DEBUG: esp = 0x32baaaf0
libsaproc DEBUG: ebp = 0x32baaaf0
libsaproc DEBUG: esi = 0x1eed0
libsaproc DEBUG: edi = 0x78eff4
libsaproc DEBUG: eip = 0xffffe410
libsaproc DEBUG: Note header with n_type = 2 and n_descsz = 108
libsaproc DEBUG: Note header with n_type = 1189489535 and n_descsz = 512
libsaproc DEBUG: Note header with n_type = 1 and n_descsz = 144
libsaproc DEBUG: got integer regset for lwp 24325
libsaproc DEBUG: integer regset
libsaproc DEBUG: eax = 0xfffffffc
libsaproc DEBUG: ebx = 0x834486c
libsaproc DEBUG: ecx = 0x0
libsaproc DEBUG: edx = 0x306bf
libsaproc DEBUG: esp = 0x32bfdda8
libsaproc DEBUG: ebp = 0x32bfdda8
libsaproc DEBUG: esi = 0x0
libsaproc DEBUG: edi = 0x306bf
libsaproc DEBUG: eip = 0xffffe410
libsaproc DEBUG: Note header with n_type = 2 and n_descsz = 108
libsaproc DEBUG: Note header with n_type = 1189489535 and n_descsz = 512
libsaproc DEBUG: Note header with n_type = 1 and n_descsz = 144
libsaproc DEBUG: got integer regset for lwp 24319
libsaproc DEBUG: integer regset
libsaproc DEBUG: eax = 0xfffffffc
libsaproc DEBUG: ebx = 0x831e8cc
libsaproc DEBUG: ecx = 0x0
libsaproc DEBUG: edx = 0x2d49f7
libsaproc DEBUG: esp = 0x33259cb0
libsaproc DEBUG: ebp = 0x33259cb0
libsaproc DEBUG: esi = 0x33259cc4
libsaproc DEBUG: edi = 0x2d49f7
libsaproc DEBUG: eip = 0xffffe410
libsaproc DEBUG: Note header with n_type = 2 and n_descsz = 108
libsaproc DEBUG: Note header with n_type = 1189489535 and n_descsz = 512
libsaproc DEBUG: Note header with n_type = 1 and n_descsz = 144
libsaproc DEBUG: got integer regset for lwp 24318
libsaproc DEBUG: integer regset
libsaproc DEBUG: eax = 0xfffffffc
libsaproc DEBUG: ebx = 0x83783a4
libsaproc DEBUG: ecx = 0x0
libsaproc DEBUG: edx = 0x38dd3
libsaproc DEBUG: esp = 0x3330ab30
libsaproc DEBUG: ebp = 0x3330ab30
libsaproc DEBUG: esi = 0x3330ab44
libsaproc DEBUG: edi = 0x38dd3
libsaproc DEBUG: eip = 0xffffe410
libsaproc DEBUG: Note header with n_type = 2 and n_descsz = 108
libsaproc DEBUG: Note header with n_type = 1189489535 and n_descsz = 512
libsaproc DEBUG: Note header with n_type = 1 and n_descsz = 144
libsaproc DEBUG: got integer regset for lwp 24317
libsaproc DEBUG: integer regset
libsaproc DEBUG: eax = 0x1
libsaproc DEBUG: ebx = 0x827bb60
libsaproc DEBUG: ecx = 0x1
libsaproc DEBUG: edx = 0x1
libsaproc DEBUG: esp = 0x3335bb0c
libsaproc DEBUG: ebp = 0x3335bb0c
libsaproc DEBUG: esi = 0x3335bbb8
libsaproc DEBUG: edi = 0x827bb60
libsaproc DEBUG: eip = 0xffffe410
libsaproc DEBUG: Note header with n_type = 2 and n_descsz = 108
libsaproc DEBUG: Note header with n_type = 1189489535 and n_descsz = 512
libsaproc DEBUG: Note header with n_type = 1 and n_descsz = 144
libsaproc DEBUG: got integer regset for lwp 24316
libsaproc DEBUG: integer regset
libsaproc DEBUG: eax = 0xfffffffc
libsaproc DEBUG: ebx = 0x8082d14
libsaproc DEBUG: ecx = 0x0
libsaproc DEBUG: edx = 0x1
libsaproc DEBUG: esp = 0x33d5ca98
libsaproc DEBUG: ebp = 0x33d5ca98
libsaproc DEBUG: esi = 0x33d5caac
libsaproc DEBUG: edi = 0x1
libsaproc DEBUG: eip = 0xffffe410
libsaproc DEBUG: Note header with n_type = 2 and n_descsz = 108
libsaproc DEBUG: Note header with n_type = 1189489535 and n_descsz = 512
libsaproc DEBUG: Note header with n_type = 1 and n_descsz = 144
libsaproc DEBUG: got integer regset for lwp 24315
libsaproc DEBUG: integer regset
libsaproc DEBUG: eax = 0xfffffffc
libsaproc DEBUG: ebx = 0x8378204
libsaproc DEBUG: ecx = 0x0
libsaproc DEBUG: edx = 0x1
libsaproc DEBUG: esp = 0x334adac8
libsaproc DEBUG: ebp = 0x334adac8
libsaproc DEBUG: esi = 0x0
libsaproc DEBUG: edi = 0x1
libsaproc DEBUG: eip = 0xffffe410
libsaproc DEBUG: Note header with n_type = 2 and n_descsz = 108
libsaproc DEBUG: Note header with n_type = 1189489535 and n_descsz = 512
libsaproc DEBUG: Note header with n_type = 1 and n_descsz = 144
libsaproc DEBUG: got integer regset for lwp 24314
libsaproc DEBUG: integer regset
libsaproc DEBUG: eax = 0x19
libsaproc DEBUG: ebx = 0x33f164cc
libsaproc DEBUG: ecx = 0x9b
libsaproc DEBUG: edx = 0x39f99940
libsaproc DEBUG: esp = 0x320f9a14
libsaproc DEBUG: ebp = 0x1e
libsaproc DEBUG: esi = 0x2
libsaproc DEBUG: edi = 0x39f975a0
libsaproc DEBUG: eip = 0x33f0e054
libsaproc DEBUG: Note header with n_type = 2 and n_descsz = 108
libsaproc DEBUG: Note header with n_type = 1189489535 and n_descsz = 512
libsaproc DEBUG: Note header with n_type = 1 and n_descsz = 144
libsaproc DEBUG: got integer regset for lwp 24313
libsaproc DEBUG: integer regset
libsaproc DEBUG: eax = 0x39c534e0
libsaproc DEBUG: ebx = 0x33f164cc
libsaproc DEBUG: ecx = 0x321fabba
libsaproc DEBUG: edx = 0x6
libsaproc DEBUG: esp = 0x321faa70
libsaproc DEBUG: ebp = 0x321faa7c
libsaproc DEBUG: esi = 0x2
libsaproc DEBUG: edi = 0x39c53478
libsaproc DEBUG: eip = 0x33f1028e
libsaproc DEBUG: Note header with n_type = 2 and n_descsz = 108
libsaproc DEBUG: Note header with n_type = 1189489535 and n_descsz = 512
libsaproc DEBUG: Note header with n_type = 1 and n_descsz = 144
libsaproc DEBUG: got integer regset for lwp 24312
libsaproc DEBUG: integer regset
libsaproc DEBUG: eax = 0x29
libsaproc DEBUG: ebx = 0x39bd4780
libsaproc DEBUG: ecx = 0x1
libsaproc DEBUG: edx = 0x2400d1a2
libsaproc DEBUG: esp = 0x322fbc50
libsaproc DEBUG: ebp = 0x322fbc7c
libsaproc DEBUG: esi = 0x33f167a8
libsaproc DEBUG: edi = 0xf9000607
libsaproc DEBUG: eip = 0x33f0ef54
libsaproc DEBUG: Note header with n_type = 2 and n_descsz = 108
libsaproc DEBUG: Note header with n_type = 1189489535 and n_descsz = 512
libsaproc DEBUG: Note header with n_type = 1 and n_descsz = 144
libsaproc DEBUG: got integer regset for lwp 24311
libsaproc DEBUG: integer regset
libsaproc DEBUG: eax = 0xfffffffc
libsaproc DEBUG: ebx = 0x827ac04
libsaproc DEBUG: ecx = 0x0
libsaproc DEBUG: edx = 0x137ee7
libsaproc DEBUG: esp = 0x323fcd28
libsaproc DEBUG: ebp = 0x323fcd28
libsaproc DEBUG: esi = 0x0
libsaproc DEBUG: edi = 0x137ee7
libsaproc DEBUG: eip = 0xffffe410
libsaproc DEBUG: Note header with n_type = 2 and n_descsz = 108
libsaproc DEBUG: Note header with n_type = 1189489535 and n_descsz = 512
libsaproc DEBUG: Note header with n_type = 1 and n_descsz = 144
libsaproc DEBUG: got integer regset for lwp 24309
libsaproc DEBUG: integer regset
libsaproc DEBUG: eax = 0x6
libsaproc DEBUG: ebx = 0x3a5c0970
libsaproc DEBUG: ecx = 0x2
libsaproc DEBUG: edx = 0xb
libsaproc DEBUG: esp = 0x325febd0
libsaproc DEBUG: ebp = 0x3a5c1cdc
libsaproc DEBUG: esi = 0x6
libsaproc DEBUG: edi = 0x4
libsaproc DEBUG: eip = 0x33f0ef06
libsaproc DEBUG: Note header with n_type = 2 and n_descsz = 108
libsaproc DEBUG: Note header with n_type = 1189489535 and n_descsz = 512
libsaproc DEBUG: Note header with n_type = 1 and n_descsz = 144
libsaproc DEBUG: got integer regset for lwp 24308
libsaproc DEBUG: integer regset
libsaproc DEBUG: eax = 0x5
libsaproc DEBUG: ebx = 0x3a98cb48
libsaproc DEBUG: ecx = 0x2
libsaproc DEBUG: edx = 0x9
libsaproc DEBUG: esp = 0x32cfea50
libsaproc DEBUG: ebp = 0x3a98dde8
libsaproc DEBUG: esi = 0x5
libsaproc DEBUG: edi = 0x5
libsaproc DEBUG: eip = 0x33f0f084
libsaproc DEBUG: Note header with n_type = 2 and n_descsz = 108
libsaproc DEBUG: Note header with n_type = 1189489535 and n_descsz = 512
libsaproc DEBUG: Note header with n_type = 1 and n_descsz = 144
libsaproc DEBUG: got integer regset for lwp 24307
libsaproc DEBUG: integer regset
libsaproc DEBUG: eax = 0x8
libsaproc DEBUG: ebx = 0x3a1fd104
libsaproc DEBUG: ecx = 0x0
libsaproc DEBUG: edx = 0x6
libsaproc DEBUG: esp = 0x3345c984
libsaproc DEBUG: ebp = 0x3345c984
libsaproc DEBUG: esi = 0x29
libsaproc DEBUG: edi = 0x0
libsaproc DEBUG: eip = 0x33f0f210
libsaproc DEBUG: Note header with n_type = 2 and n_descsz = 108
libsaproc DEBUG: Note header with n_type = 1189489535 and n_descsz = 512
libsaproc DEBUG: Note header with n_type = 1 and n_descsz = 144
libsaproc DEBUG: got integer regset for lwp 24304
libsaproc DEBUG: integer regset
libsaproc DEBUG: eax = 0xfffffffc
libsaproc DEBUG: ebx = 0x82ee0ac
libsaproc DEBUG: ecx = 0x0
libsaproc DEBUG: edx = 0x1
libsaproc DEBUG: esp = 0x332aad90
libsaproc DEBUG: ebp = 0x332aad90
libsaproc DEBUG: esi = 0x332aada4
libsaproc DEBUG: edi = 0x1
libsaproc DEBUG: eip = 0xffffe410
libsaproc DEBUG: Note header with n_type = 2 and n_descsz = 108
libsaproc DEBUG: Note header with n_type = 1189489535 and n_descsz = 512
libsaproc DEBUG: Note header with n_type = 1 and n_descsz = 144
libsaproc DEBUG: got integer regset for lwp 24015
libsaproc DEBUG: integer regset
libsaproc DEBUG: eax = 0xfffffffc
libsaproc DEBUG: ebx = 0x856427c
libsaproc DEBUG: ecx = 0x0
libsaproc DEBUG: edx = 0x1
libsaproc DEBUG: esp = 0x33b5ca90
libsaproc DEBUG: ebp = 0x33b5ca90
libsaproc DEBUG: esi = 0x33b5caa4
libsaproc DEBUG: edi = 0x1
libsaproc DEBUG: eip = 0xffffe410
libsaproc DEBUG: Note header with n_type = 2 and n_descsz = 108
libsaproc DEBUG: Note header with n_type = 1189489535 and n_descsz = 512
libsaproc DEBUG: Note header with n_type = 1 and n_descsz = 144
libsaproc DEBUG: got integer regset for lwp 24014
libsaproc DEBUG: integer regset
libsaproc DEBUG: eax = 0xfffffffc
libsaproc DEBUG: ebx = 0x818b8e4
libsaproc DEBUG: ecx = 0x0
libsaproc DEBUG: edx = 0x3
libsaproc DEBUG: esp = 0x33bada98
libsaproc DEBUG: ebp = 0x33bada98
libsaproc DEBUG: esi = 0x0
libsaproc DEBUG: edi = 0x3
libsaproc DEBUG: eip = 0xffffe410
libsaproc DEBUG: Note header with n_type = 2 and n_descsz = 108
libsaproc DEBUG: Note header with n_type = 1189489535 and n_descsz = 512
libsaproc DEBUG: Note header with n_type = 1 and n_descsz = 144
libsaproc DEBUG: got integer regset for lwp 24013
libsaproc DEBUG: integer regset
libsaproc DEBUG: eax = 0xfffffe00
libsaproc DEBUG: ebx = 0x5
libsaproc DEBUG: ecx = 0x33bfedd0
libsaproc DEBUG: edx = 0x33f4d1a4
libsaproc DEBUG: esp = 0x33bfedb8
libsaproc DEBUG: ebp = 0x33bfedb8
libsaproc DEBUG: esi = 0x0
libsaproc DEBUG: edi = 0x827e400
libsaproc DEBUG: eip = 0xffffe410
libsaproc DEBUG: Note header with n_type = 2 and n_descsz = 108
libsaproc DEBUG: Note header with n_type = 1189489535 and n_descsz = 512
libsaproc DEBUG: Note header with n_type = 1 and n_descsz = 144
libsaproc DEBUG: got integer regset for lwp 24011
libsaproc DEBUG: integer regset
libsaproc DEBUG: eax = 0xfffffffc
libsaproc DEBUG: ebx = 0x828951c
libsaproc DEBUG: ecx = 0x0
libsaproc DEBUG: edx = 0x1
libsaproc DEBUG: esp = 0x33dadcd8
libsaproc DEBUG: ebp = 0x33dadcd8
libsaproc DEBUG: esi = 0x33dadcec
libsaproc DEBUG: edi = 0x1
libsaproc DEBUG: eip = 0xffffe410
libsaproc DEBUG: Note header with n_type = 2 and n_descsz = 108
libsaproc DEBUG: Note header with n_type = 1189489535 and n_descsz = 512
libsaproc DEBUG: Note header with n_type = 1 and n_descsz = 144
libsaproc DEBUG: got integer regset for lwp 24010
libsaproc DEBUG: integer regset
libsaproc DEBUG: eax = 0xfffffffc
libsaproc DEBUG: ebx = 0x849caac
libsaproc DEBUG: ecx = 0x0
libsaproc DEBUG: edx = 0x1
libsaproc DEBUG: esp = 0x33dfec68
libsaproc DEBUG: ebp = 0x33dfec68
libsaproc DEBUG: esi = 0x33dfec7c
libsaproc DEBUG: edi = 0x1
libsaproc DEBUG: eip = 0xffffe410
libsaproc DEBUG: Note header with n_type = 2 and n_descsz = 108
libsaproc DEBUG: Note header with n_type = 1189489535 and n_descsz = 512
libsaproc DEBUG: Note header with n_type = 1 and n_descsz = 144
libsaproc DEBUG: got integer regset for lwp 23868
libsaproc DEBUG: integer regset
libsaproc DEBUG: eax = 0xfffffffc
libsaproc DEBUG: ebx = 0x80c213c
libsaproc DEBUG: ecx = 0x0
libsaproc DEBUG: edx = 0x1
libsaproc DEBUG: esp = 0x34090f78
libsaproc DEBUG: ebp = 0x34090f78
libsaproc DEBUG: esi = 0x34090f8c
libsaproc DEBUG: edi = 0x1
libsaproc DEBUG: eip = 0xffffe410
libsaproc DEBUG: Note header with n_type = 2 and n_descsz = 108
libsaproc DEBUG: Note header with n_type = 1189489535 and n_descsz = 512
libsaproc DEBUG: Note header with n_type = 1 and n_descsz = 144
libsaproc DEBUG: got integer regset for lwp 23867
libsaproc DEBUG: integer regset
libsaproc DEBUG: eax = 0xfffffffc
libsaproc DEBUG: ebx = 0x819e294
libsaproc DEBUG: ecx = 0x0
libsaproc DEBUG: edx = 0x1
libsaproc DEBUG: esp = 0x340e2018
libsaproc DEBUG: ebp = 0x340e2018
libsaproc DEBUG: esi = 0x0
libsaproc DEBUG: edi = 0x1
libsaproc DEBUG: eip = 0xffffe410
libsaproc DEBUG: Note header with n_type = 2 and n_descsz = 108
libsaproc DEBUG: Note header with n_type = 1189489535 and n_descsz = 512
libsaproc DEBUG: Note header with n_type = 1 and n_descsz = 144
libsaproc DEBUG: got integer regset for lwp 23866
libsaproc DEBUG: integer regset
libsaproc DEBUG: eax = 0xfffffffc
libsaproc DEBUG: ebx = 0x8199a5c
libsaproc DEBUG: ecx = 0x0
libsaproc DEBUG: edx = 0x434
libsaproc DEBUG: esp = 0x34162e48
libsaproc DEBUG: ebp = 0x34162e48
libsaproc DEBUG: esi = 0x0
libsaproc DEBUG: edi = 0x434
libsaproc DEBUG: eip = 0xffffe410
libsaproc DEBUG: Note header with n_type = 2 and n_descsz = 108
libsaproc DEBUG: Note header with n_type = 1189489535 and n_descsz = 512
libsaproc DEBUG: Note header with n_type = 1 and n_descsz = 144
libsaproc DEBUG: got integer regset for lwp 23865
libsaproc DEBUG: integer regset
libsaproc DEBUG: eax = 0xfffffffc
libsaproc DEBUG: ebx = 0x8199a5c
libsaproc DEBUG: ecx = 0x0
libsaproc DEBUG: edx = 0x432
libsaproc DEBUG: esp = 0x341e3ec8
libsaproc DEBUG: ebp = 0x341e3ec8
libsaproc DEBUG: esi = 0x0
libsaproc DEBUG: edi = 0x432
libsaproc DEBUG: eip = 0xffffe410
libsaproc DEBUG: Note header with n_type = 2 and n_descsz = 108
libsaproc DEBUG: Note header with n_type = 1189489535 and n_descsz = 512
libsaproc DEBUG: Note header with n_type = 1 and n_descsz = 144
libsaproc DEBUG: got integer regset for lwp 23864
libsaproc DEBUG: integer regset
libsaproc DEBUG: eax = 0xfffffffc
libsaproc DEBUG: ebx = 0x65e80a0
libsaproc DEBUG: ecx = 0x0
libsaproc DEBUG: edx = 0x0
libsaproc DEBUG: esp = 0x34234fb0
libsaproc DEBUG: ebp = 0x34234fb0
libsaproc DEBUG: esi = 0x0
libsaproc DEBUG: edi = 0xffc
libsaproc DEBUG: eip = 0xffffe410
libsaproc DEBUG: Note header with n_type = 2 and n_descsz = 108
libsaproc DEBUG: Note header with n_type = 1189489535 and n_descsz = 512
libsaproc DEBUG: Note header with n_type = 1 and n_descsz = 144
libsaproc DEBUG: got integer regset for lwp 23863
libsaproc DEBUG: integer regset
libsaproc DEBUG: eax = 0xfffffffc
libsaproc DEBUG: ebx = 0x818ba8c
libsaproc DEBUG: ecx = 0x0
libsaproc DEBUG: edx = 0x289
libsaproc DEBUG: esp = 0x34485de0
libsaproc DEBUG: ebp = 0x34485de0
libsaproc DEBUG: esi = 0x0
libsaproc DEBUG: edi = 0x289
libsaproc DEBUG: eip = 0xffffe410
libsaproc DEBUG: Note header with n_type = 2 and n_descsz = 108
libsaproc DEBUG: Note header with n_type = 1189489535 and n_descsz = 512
libsaproc DEBUG: Note header with n_type = 1 and n_descsz = 144
libsaproc DEBUG: got integer regset for lwp 23862
libsaproc DEBUG: integer regset
libsaproc DEBUG: eax = 0xfffffffc
libsaproc DEBUG: ebx = 0x81887d4
libsaproc DEBUG: ecx = 0x0
libsaproc DEBUG: edx = 0x2b3
libsaproc DEBUG: esp = 0x344d6c90
libsaproc DEBUG: ebp = 0x344d6c90
libsaproc DEBUG: esi = 0x0
libsaproc DEBUG: edi = 0x2b3
libsaproc DEBUG: eip = 0xffffe410
libsaproc DEBUG: Note header with n_type = 2 and n_descsz = 108
libsaproc DEBUG: Note header with n_type = 1189489535 and n_descsz = 512
libsaproc DEBUG: Note header with n_type = 1 and n_descsz = 144
libsaproc DEBUG: got integer regset for lwp 23861
libsaproc DEBUG: integer regset
libsaproc DEBUG: eax = 0xfffffffc
libsaproc DEBUG: ebx = 0x31e0548c
libsaproc DEBUG: ecx = 0x0
libsaproc DEBUG: edx = 0x3
libsaproc DEBUG: esp = 0x345580d8
libsaproc DEBUG: ebp = 0x345580d8
libsaproc DEBUG: esi = 0x345580ec
libsaproc DEBUG: edi = 0x3
libsaproc DEBUG: eip = 0xffffe410
libsaproc DEBUG: Note header with n_type = 2 and n_descsz = 108
libsaproc DEBUG: Note header with n_type = 1189489535 and n_descsz = 512
libsaproc DEBUG: Note header with n_type = 1 and n_descsz = 144
libsaproc DEBUG: got integer regset for lwp 23860
libsaproc DEBUG: integer regset
libsaproc DEBUG: eax = 0xfffffffc
libsaproc DEBUG: ebx = 0x8096674
libsaproc DEBUG: ecx = 0x0
libsaproc DEBUG: edx = 0x161e9b
libsaproc DEBUG: esp = 0x34784f68
libsaproc DEBUG: ebp = 0x34784f68
libsaproc DEBUG: esi = 0x0
libsaproc DEBUG: edi = 0x161e9b
libsaproc DEBUG: eip = 0xffffe410
libsaproc DEBUG: Note header with n_type = 2 and n_descsz = 108
libsaproc DEBUG: Note header with n_type = 1189489535 and n_descsz = 512
libsaproc DEBUG: Note header with n_type = 1 and n_descsz = 144
libsaproc DEBUG: got integer regset for lwp 23859
libsaproc DEBUG: integer regset
libsaproc DEBUG: eax = 0xfffffffc
libsaproc DEBUG: ebx = 0x8096674
libsaproc DEBUG: ecx = 0x0
libsaproc DEBUG: edx = 0x161e9a
libsaproc DEBUG: esp = 0x34805fe8
libsaproc DEBUG: ebp = 0x34805fe8
libsaproc DEBUG: esi = 0x0
libsaproc DEBUG: edi = 0x161e9a
libsaproc DEBUG: eip = 0xffffe410
libsaproc DEBUG: Note header with n_type = 2 and n_descsz = 108
libsaproc DEBUG: Note header with n_type = 1189489535 and n_descsz = 512
libsaproc DEBUG: Note header with n_type = 1 and n_descsz = 144
libsaproc DEBUG: got integer regset for lwp 23858
libsaproc DEBUG: integer regset
libsaproc DEBUG: eax = 0xfffffffc
libsaproc DEBUG: ebx = 0x8096674
libsaproc DEBUG: ecx = 0x0
libsaproc DEBUG: edx = 0x161e9c
libsaproc DEBUG: esp = 0x34886e68
libsaproc DEBUG: ebp = 0x34886e68
libsaproc DEBUG: esi = 0x0
libsaproc DEBUG: edi = 0x161e9c
libsaproc DEBUG: eip = 0xffffe410
libsaproc DEBUG: Note header with n_type = 2 and n_descsz = 108
libsaproc DEBUG: Note header with n_type = 1189489535 and n_descsz = 512
libsaproc DEBUG: Note header with n_type = 1 and n_descsz = 144
libsaproc DEBUG: got integer regset for lwp 23857
libsaproc DEBUG: integer regset
libsaproc DEBUG: eax = 0xfffffffc
libsaproc DEBUG: ebx = 0x8096674
libsaproc DEBUG: ecx = 0x0
libsaproc DEBUG: edx = 0x161e99
libsaproc DEBUG: esp = 0x34907ee8
libsaproc DEBUG: ebp = 0x34907ee8
libsaproc DEBUG: esi = 0x0
libsaproc DEBUG: edi = 0x161e99
libsaproc DEBUG: eip = 0xffffe410
libsaproc DEBUG: Note header with n_type = 2 and n_descsz = 108
libsaproc DEBUG: Note header with n_type = 1189489535 and n_descsz = 512
libsaproc DEBUG: Note header with n_type = 1 and n_descsz = 144
libsaproc DEBUG: got integer regset for lwp 23856
libsaproc DEBUG: integer regset
libsaproc DEBUG: eax = 0xfffffffc
libsaproc DEBUG: ebx = 0x8096674
libsaproc DEBUG: ecx = 0x0
libsaproc DEBUG: edx = 0x161e98
libsaproc DEBUG: esp = 0x34989168
libsaproc DEBUG: ebp = 0x34989168
libsaproc DEBUG: esi = 0x0
libsaproc DEBUG: edi = 0x161e98
libsaproc DEBUG: eip = 0xffffe410
libsaproc DEBUG: Note header with n_type = 2 and n_descsz = 108
libsaproc DEBUG: Note header with n_type = 1189489535 and n_descsz = 512
libsaproc DEBUG: Note header with n_type = 1 and n_descsz = 144
libsaproc DEBUG: got integer regset for lwp 23855
libsaproc DEBUG: integer regset
libsaproc DEBUG: eax = 0xfffffffc
libsaproc DEBUG: ebx = 0x8096674
libsaproc DEBUG: ecx = 0x0
libsaproc DEBUG: edx = 0x161e97
libsaproc DEBUG: esp = 0x34a0a1e8
libsaproc DEBUG: ebp = 0x34a0a1e8
libsaproc DEBUG: esi = 0x0
libsaproc DEBUG: edi = 0x161e97
libsaproc DEBUG: eip = 0xffffe410
libsaproc DEBUG: Note header with n_type = 2 and n_descsz = 108
libsaproc DEBUG: Note header with n_type = 1189489535 and n_descsz = 512
libsaproc DEBUG: Note header with n_type = 1 and n_descsz = 144
libsaproc DEBUG: got integer regset for lwp 23854
libsaproc DEBUG: integer regset
libsaproc DEBUG: eax = 0xfffffffc
libsaproc DEBUG: ebx = 0x8096674
libsaproc DEBUG: ecx = 0x0
libsaproc DEBUG: edx = 0x161e96
libsaproc DEBUG: esp = 0x34a8b068
libsaproc DEBUG: ebp = 0x34a8b068
libsaproc DEBUG: esi = 0x0
libsaproc DEBUG: edi = 0x161e96
libsaproc DEBUG: eip = 0xffffe410
libsaproc DEBUG: Note header with n_type = 2 and n_descsz = 108
libsaproc DEBUG: Note header with n_type = 1189489535 and n_descsz = 512
libsaproc DEBUG: Note header with n_type = 1 and n_descsz = 144
libsaproc DEBUG: got integer regset for lwp 23853
libsaproc DEBUG: integer regset
libsaproc DEBUG: eax = 0xfffffffc
libsaproc DEBUG: ebx = 0x8096674
libsaproc DEBUG: ecx = 0x0
libsaproc DEBUG: edx = 0x161e95
libsaproc DEBUG: esp = 0x34b0c0e8
libsaproc DEBUG: ebp = 0x34b0c0e8
libsaproc DEBUG: esi = 0x0
libsaproc DEBUG: edi = 0x161e95
libsaproc DEBUG: eip = 0xffffe410
libsaproc DEBUG: Note header with n_type = 2 and n_descsz = 108
libsaproc DEBUG: Note header with n_type = 1189489535 and n_descsz = 512
libsaproc DEBUG: Note header with n_type = 1 and n_descsz = 144
libsaproc DEBUG: got integer regset for lwp 23852
libsaproc DEBUG: integer regset
libsaproc DEBUG: eax = 0xfffffffc
libsaproc DEBUG: ebx = 0x33e5e19c
libsaproc DEBUG: ecx = 0x0
libsaproc DEBUG: edx = 0x1
libsaproc DEBUG: esp = 0xf7fde228
libsaproc DEBUG: ebp = 0xf7fde228
libsaproc DEBUG: esi = 0x0
libsaproc DEBUG: edi = 0x1
libsaproc DEBUG: eip = 0xffffe410
libsaproc DEBUG: Note header with n_type = 2 and n_descsz = 108
libsaproc DEBUG: Note header with n_type = 1189489535 and n_descsz = 512
libsaproc DEBUG: Note header with n_type = 1 and n_descsz = 144
libsaproc DEBUG: got integer regset for lwp 23850
libsaproc DEBUG: integer regset
libsaproc DEBUG: eax = 0xfffffffc
libsaproc DEBUG: ebx = 0xf7fdebd8
libsaproc DEBUG: ecx = 0x0
libsaproc DEBUG: edx = 0x5d2c
libsaproc DEBUG: esp = 0xffb93630
libsaproc DEBUG: ebp = 0xffb93630
libsaproc DEBUG: esi = 0x0
libsaproc DEBUG: edi = 0x7a8ff4
libsaproc DEBUG: eip = 0xffffe410
libsaproc DEBUG: Note header with n_type = 2 and n_descsz = 108
libsaproc DEBUG: Note header with n_type = 1189489535 and n_descsz = 512
libsaproc DEBUG: ELF interpreter /lib/ld-linux.so.2
libsaproc DEBUG: address of _DYNAMIC is 0x8052548
libsaproc DEBUG: ---- sorted virtual address map ----
libsaproc DEBUG: base = 0x64f000 size = 4096
libsaproc DEBUG: base = 0x650000 size = 4096
libsaproc DEBUG: base = 0x78d000 size = 8192
libsaproc DEBUG: base = 0x78f000 size = 4096
libsaproc DEBUG: base = 0x790000 size = 12288
libsaproc DEBUG: base = 0x7a8000 size = 4096
libsaproc DEBUG: base = 0x7a9000 size = 4096
libsaproc DEBUG: base = 0x7aa000 size = 8192
libsaproc DEBUG: base = 0x7b0000 size = 4096
libsaproc DEBUG: base = 0x7b1000 size = 4096
libsaproc DEBUG: base = 0x879000 size = 4096
libsaproc DEBUG: base = 0x87a000 size = 4096
libsaproc DEBUG: base = 0x884000 size = 4096
libsaproc DEBUG: base = 0x885000 size = 4096
libsaproc DEBUG: base = 0xc37000 size = 16384
libsaproc DEBUG: base = 0xc3b000 size = 4096
libsaproc DEBUG: base = 0xc3c000 size = 24576
libsaproc DEBUG: base = 0xd38000 size = 4096
libsaproc DEBUG: base = 0x6000000 size = 5898240
libsaproc DEBUG: base = 0x65a0000 size = 241664
libsaproc DEBUG: base = 0x65db000 size = 4329472
libsaproc DEBUG: base = 0x8048000 size = 38100
libsaproc DEBUG: base = 0x8052000 size = 4096
libsaproc DEBUG: base = 0x8053000 size = 14032896
libsaproc DEBUG: base = 0x30f00000 size = 1007616
libsaproc DEBUG: base = 0x31100000 size = 1048576
libsaproc DEBUG: base = 0x312a0000 size = 12288
libsaproc DEBUG: base = 0x312a3000 size = 319488
libsaproc DEBUG: base = 0x3133a000 size = 16384
libsaproc DEBUG: base = 0x31344000 size = 753664
libsaproc DEBUG: base = 0x313fc000 size = 16384
libsaproc DEBUG: base = 0x31400000 size = 929792
libsaproc DEBUG: base = 0x31500000 size = 1028096
libsaproc DEBUG: base = 0x31600000 size = 966656
libsaproc DEBUG: base = 0x31700000 size = 1028096
libsaproc DEBUG: base = 0x31800000 size = 991232
libsaproc DEBUG: base = 0x31900000 size = 1044480
libsaproc DEBUG: base = 0x31a00000 size = 1032192
libsaproc DEBUG: base = 0x31b00000 size = 1032192
libsaproc DEBUG: base = 0x31c00000 size = 1003520
libsaproc DEBUG: base = 0x31d51000 size = 319488
libsaproc DEBUG: base = 0x31df9000 size = 28672
libsaproc DEBUG: base = 0x31e00000 size = 1048576
libsaproc DEBUG: base = 0x31f03000 size = 552960
libsaproc DEBUG: base = 0x31f8a000 size = 20480
libsaproc DEBUG: base = 0x31f90000 size = 331776
libsaproc DEBUG: base = 0x31fe1000 size = 8192
libsaproc DEBUG: base = 0x31ffa000 size = 12288
libsaproc DEBUG: base = 0x31ffd000 size = 1040384
libsaproc DEBUG: base = 0x320fb000 size = 12288
libsaproc DEBUG: base = 0x320fe000 size = 1040384
libsaproc DEBUG: base = 0x321fc000 size = 12288
libsaproc DEBUG: base = 0x321ff000 size = 1040384
libsaproc DEBUG: base = 0x322fd000 size = 12288
libsaproc DEBUG: base = 0x32300000 size = 1040384
libsaproc DEBUG: base = 0x323fe000 size = 12288
libsaproc DEBUG: base = 0x32401000 size = 1040384
libsaproc DEBUG: base = 0x324ff000 size = 12288
libsaproc DEBUG: base = 0x32502000 size = 1957888
libsaproc DEBUG: base = 0x32700000 size = 1024000
libsaproc DEBUG: base = 0x32800000 size = 2072576
libsaproc DEBUG: base = 0x32a00000 size = 1040384
libsaproc DEBUG: base -
Weblogic crash without a trace (core dump, hs_err_pid, stracktrace, logs)
We have a weblogic 9 cluster where a node crash/shutdown with no trace. Sometimes its node 2 and sometimes node 3, but not at the same time.
We can't find any core dump, hs_err_pid or any stracktrace in the logs or std out/err.
Specifying where hs_err files goes with -XX:ErrorFile should not be necessary as it should write in current directory or if not possible due to permissions etc, in the OS tmp dir.
Are there any Weblogic specific JVM or system property we can specify to force some kind of trace when the process just seem to crash?
We see this in the log from time to time, perhaps its related:
<2012-jun-08 kl 13:53 CEST> <Error> <Security> <BEA-090060> <The AccessDecision class "weblogic.security.providers.realmadapter.AuthorizationProviderImpl" returned an error: java.lang.SecurityException: Realm Adapter ACL Mapping Failed.>
Can the above hide a possible out of memory error trace to appear in the logs?
SERVER: Weblogic 9.2.3 with some additional patches (and compatibility mode)
OS: HP-UX B.11.23 U ia64
JAVA: Java(TM) 2 Runtime Environment, Standard Edition (build 1.5.0.20-_28_apr_2010_03_15)
Java HotSpot(TM) Server VM (build 1.5.0.20 jinteg:04.28.10-02:28 IA64, mixed mode)http://docs.oracle.com/cd/B28359_01/java.111/b31224/instclnt.htm gives some info about the used libraries (libocijdbc11.so)
Could you check the environment variable - http://docs.oracle.com/cd/B28359_01/java.111/b31224/getsta.htm#i1005378
"On Sun Solaris or Linux, set the LD_LIBRARY_PATH environment variable as follows:
ORACLE_HOME/lib
This directory contains the libocijdbc11.so shared object library.
Note:
If you are running a 32-bit Java Virtual Machine (JVM) against a 64-bit client or database, then you must also add ORACLE_HOME/lib32 to the LD_LIBRARY_PATH environment variable." -
Core dump (WL - 4.5 and Solaris 7)
We are using WebLogic 4.5 on Solaris 7. Some times the WebLogic dumps core and exits. There is no pattern for it. I am attaching the core generated:
Could there be a solution some one knows of.
Thanks.
-manish
kghalo bad size 0x15330128
********** Internal heap ERROR KGHALO2 addr=0x0 *********
HEAP DUMP heap name="Alloc environm" desc=0x37083f4
extent sz=0x1024 alt=32 het=32767 rec=0 flg=3 opc=2
parent=0 owner=0 nex=0 xsz=0x17a0
EXTENT 0
Chunk 3daff00 sz= 6040 free " "
EXTENT 1
Chunk 4a857b8 sz= 12040 free " "
EXTENT 2
Chunk 3eaac98 sz= 6372 free " "
EXTENT 3
Chunk 3dacfe8 sz= 12040 free " "
EXTENT 4
Chunk 37567a0 sz= 4660 free " "
Chunk 37579d4 sz= 4144 recreate "Alloc statemen " latch=0
ds 3758d70 sz= 4144 ct= 1
Chunk 3758a04 sz= 1080 freeable assoc with mark prv=0 nxt=0
Chunk 3758e3c sz= 4144 recreate "Alloc statemen " latch=0
ds 375a1d8 sz= 4144 ct= 1
Chunk 3759e6c sz= 1080 freeable assoc with mark prv=0 nxt=0
Chunk 375a2a4 sz= 28 freeable assoc with mark prv=0 nxt=0
Chunk 375a2c0 sz= 5224 free " "
Chunk 375b728 sz= 20 freeable assoc with mark prv=0 nxt=0
Chunk 375b73c sz= 20 freeable assoc with mark prv=0 nxt=0
Chunk 375b750 sz= 256 freeable assoc with mark prv=0 nxt=0
EXTENT 5
Chunk 404b50 sz= 13328 freeable "Alloc server h " ds=3709408
EXTENT 6
Chunk 3708980 sz= 40 perm "perm " alo=40
Chunk 37089a8 sz= 2212 recreate "Alloc server h " latch=0
ds 3709408 sz= 15540 ct= 2
404b50 sz= 13328
Chunk 370924c sz= 104 freeable assoc with mark prv=0 nxt=0
Chunk 37092b4 sz= 444 freeable assoc with mark prv=0 nxt=0
Chunk 3709470 sz= 1308 freeable assoc with mark prv=0 nxt=0
Total heap size = 74584
FREE LISTS:
Bucket 0 size=272
Bucket 1 size=528
Bucket 2 size=1040
Chunk 37567a0 sz= 4660 free " "
Chunk 3dacfe8 sz= 12040 free " "
Chunk 3eaac98 sz= 6372 free " "
Chunk 4a857b8 sz= 12040 free " "
Chunk 3daff00 sz= 6040 free " "
Chunk 375a2c0 sz= 5224 free " "
Total free space = 46376
UNPINNED RECREATABLE CHUNKS (lru first):
PERMANENT CHUNKS:
Chunk 3708980 sz= 40 perm "perm " alo=40
Permanent space = 40
Hla: 0
kgepop: no error frame to pop to for error 0
Segmentation Fault
si_signo [11]: Segmentation Fault
si_errno [0]: Error 0
si_code [1]: SEGV_MAPERR [addr: 0x0]
stackpointer=F9FBFC50
"SSLListenThread" (TID:0x3a8b58c, sys_thread_t:0x3a8b510, state:R, thread_t: t@30, threadID:0xf8d91dc8, stack_bottom:0xf8d92000, sta
ck_size:0x20000) prio=5
[1] java.net.PlainSocketImpl.socketAccept(Native Method)
[2] java.net.PlainSocketImpl.accept(PlainSocketImpl.java:406)
[3] java.net.ServerSocket.implAccept(ServerSocket.java:241)
[4] java.net.ServerSocket.accept(ServerSocket.java:224)
[5] weblogic.security.SSL.SSLServerSocket.acceptNoHandshake(SSLServerSocket.java:121)
[6] weblogic.security.SSL.SSLServerSocket.accept(SSLServerSocket.java:112)
[7] weblogic.t3.srvr.ListenThread.run(ListenThread.java:277)
"ListenThread" (TID:0x3a7b294, sys_thread_t:0x3a7b218, state:R, thread_t: t@29, threadID:0xf8e41dc8, stack_bottom:0xf8e42000, stack_
size:0x20000) prio=5
[1] java.net.PlainSocketImpl.socketAccept(Native Method)
[2] java.net.PlainSocketImpl.accept(PlainSocketImpl.java:406)
[3] java.net.ServerSocket.implAccept(ServerSocket.java:241)
[4] java.net.ServerSocket.accept(ServerSocket.java:224)
[5] weblogic.t3.srvr.ListenThread.run(ListenThread.java:277)
"ExecuteThread-14" (TID:0x54e104, sys_thread_t:0x54e088, state:MW, thread_t: t@25, threadID:0xf8eb1dc8, stack_bottom:0xf8eb2000, sta
ck_size:0x20000) prio=5
[1] weblogic.socket.PosixSocketMuxer.processSockets(PosixSocketMuxer.java:269)
[2] weblogic.socket.SocketReaderRequest.execute(SocketReaderRequest.java:23)
[3] weblogic.kernel.ExecuteThread.run(ExecuteThread.java:120)
"ExecuteThread-13" (TID:0x59c504, sys_thread_t:0x59c488, state:R, thread_t: t@24, threadID:0xf8ee1dc8, stack_bottom:0xf8ee2000, stac
k_size:0x20000) prio=5
[1] weblogic.socket.PosixSocketMuxer.poll(Native Method)
[2] weblogic.socket.PosixSocketMuxer.processSockets(PosixSocketMuxer.java:270)
[3] weblogic.socket.SocketReaderRequest.execute(SocketReaderRequest.java:23)
[4] weblogic.kernel.ExecuteThread.run(ExecuteThread.java:120)
"ExecuteThread-12" (TID:0x5ba504, sys_thread_t:0x5ba488, state:MW, thread_t: t@23, threadID:0xf8f11dc8, stack_bottom:0xf8f12000, sta
ck_size:0x20000) prio=5
[1] weblogic.socket.PosixSocketMuxer.processSockets(PosixSocketMuxer.java:269)
[2] weblogic.socket.SocketReaderRequest.execute(SocketReaderRequest.java:23)
[3] weblogic.kernel.ExecuteThread.run(ExecuteThread.java:120)
"ExecuteThread-11" (TID:0x4f62ec, sys_thread_t:0x4f6270, state:CW, thread_t: t@22, threadID:0xf8f41dc8, stack_bottom:0xf8f42000, sta
ck_size:0x20000) prio=5
[1] java.lang.Object.wait(Native Method)
[2] java.lang.Object.wait(Object.java:424)
[3] weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:90)
[4] weblogic.kernel.ExecuteThread.run(ExecuteThread.java:117)
"ExecuteThread-10" (TID:0x52810c, sys_thread_t:0x528090, state:CW, thread_t: t@21, threadID:0xf8f71dc8, stack_bottom:0xf8f72000, sta
ck_size:0x20000) prio=5
[1] java.lang.Object.wait(Native Method)
[2] java.lang.Object.wait(Object.java:424)
[3] weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:90)
[4] weblogic.kernel.ExecuteThread.run(ExecuteThread.java:117)
"ExecuteThread-9" (TID:0x53050c, sys_thread_t:0x530490, state:CW, thread_t: t@20, threadID:0xf9171dc8, stack_bottom:0xf9172000, stac
k_size:0x20000) prio=5
[1] java.lang.Object.wait(Native Method)
[2] java.lang.Object.wait(Object.java:424)
[3] weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:90)
[4] weblogic.kernel.ExecuteThread.run(ExecuteThread.java:117)
"ExecuteThread-8" (TID:0x53210c, sys_thread_t:0x532090, state:CW, thread_t: t@19, threadID:0xf9e61dc8, stack_bottom:0xf9e62000, stac
k_size:0x20000) prio=5
[1] java.lang.Object.wait(Native Method)
[2] java.lang.Object.wait(Object.java:424)
[3] weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:90)
[4] weblogic.kernel.ExecuteThread.run(ExecuteThread.java:117)
"ExecuteThread-7" (TID:0x55ed3c, sys_thread_t:0x55ecc0, state:CW, thread_t: t@18, threadID:0xf9e91dc8, stack_bottom:0xf9e92000, stac
k_size:0x20000) prio=5
[1] java.lang.Object.wait(Native Method)
[2] java.lang.Object.wait(Object.java:424)
[3] weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:90)
[4] weblogic.kernel.ExecuteThread.run(ExecuteThread.java:117)
"ExecuteThread-6" (TID:0x5c750c, sys_thread_t:0x5c7490, state:CW, thread_t: t@17, threadID:0xf9ec1dc8, stack_bottom:0xf9ec2000, stac
k_size:0x20000) prio=5
[1] java.lang.Object.wait(Native Method)
[2] java.lang.Object.wait(Object.java:424)
[3] weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:90)
[4] weblogic.kernel.ExecuteThread.run(ExecuteThread.java:117)
"ExecuteThread-5" (TID:0x5cc514, sys_thread_t:0x5cc498, state:CW, thread_t: t@16, threadID:0xf9ef1dc8, stack_bottom:0xf9ef2000, stac
k_size:0x20000) prio=5
[1] java.lang.Object.wait(Native Method)
[2] java.lang.Object.wait(Object.java:424)
[3] weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:90)
[4] weblogic.kernel.ExecuteThread.run(ExecuteThread.java:117)
"ExecuteThread-4" (TID:0x5d091c, sys_thread_t:0x5d08a0, state:R, thread_t: t@15, threadID:0xf9fc1dc8, stack_bottom:0xf9fc2000, stack
_size:0x20000) prio=5 current thread
[1] weblogic.db.oci.OciCursor.exec(Native Method)
[2] weblogic.db.oci.OciCursor.oci_exec(OciCursor.java:1823)
[3] weblogic.jdbcbase.oci.Statement.executeUpdate(Statement.java:846)
[4] weblogic.jdbcbase.oci.Statement.execute(Statement.java:1361)
[5] weblogic.jdbc20.pool.PreparedStatement.execute(PreparedStatement.java:27)
[6] weblogic.jdbc20.rmi.internal.PreparedStatementImpl.execute(PreparedStatementImpl.java:288)
[7] weblogic.jdbc20.rmi.SerialPreparedStatement.execute(SerialPreparedStatement.java:401)
[8] com.ebd.oss.isp.model.ISPModel.getContactInfo(ISPModel.java:242)
[9] com.ebd.oss.isp.model.ISPModel.getISPInfoByID(ISPModel.java:634)
[10] jsp_servlet._ruUpdateContact._jspService(_ruUpdateContact.java:110)
[11] weblogic.servlet.jsp.JspBase.service(JspBase.java:27)
[12] weblogic.servlet.internal.ServletStubImpl.invokeServlet(ServletStubImpl.java:105)
[13] weblogic.servlet.internal.RequestDispatcherImpl.include(RequestDispatcherImpl.java:240)
[14] weblogic.servlet.internal.RequestDispatcherImpl.include(RequestDispatcherImpl.java:161)
[15] jsp_servlet._Template._jspService(_Template.java:106)
[16] weblogic.servlet.jsp.JspBase.service(JspBase.java:27)
[17] weblogic.servlet.internal.ServletStubImpl.invokeServlet(ServletStubImpl.java:105)
[18] weblogic.servlet.internal.RequestDispatcherImpl.forward(RequestDispatcherImpl.java:143)
[19] jsp_servlet._Main._jspService(_Main.java:204)
[20] weblogic.servlet.jsp.JspBase.service(JspBase.java:27)
[21] weblogic.servlet.internal.ServletStubImpl.invokeServlet(ServletStubImpl.java:105)
[22] weblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletContextImpl.java:742)
[23] weblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletContextImpl.java:686)
[24] weblogic.servlet.internal.ServletContextManager.invokeServlet(ServletContextManager.java:247)
[25] weblogic.socket.MuxableSocketHTTP.invokeServlet(MuxableSocketHTTP.java:361)
[26] weblogic.socket.MuxableSocketHTTP.execute(MuxableSocketHTTP.java:261)
[27] weblogic.kernel.ExecuteThread.run(ExecuteThread.java:120)
"ExecuteThread-3" (TID:0x5c7934, sys_thread_t:0x5c78b8, state:CW, thread_t: t@14, threadID:0xf9ff1dc8, stack_bottom:0xf9ff2000, stac
k_size:0x20000) prio=5
[1] java.lang.Object.wait(Native Method)
[2] java.lang.Object.wait(Object.java:424)
[3] weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:90)
[4] weblogic.kernel.ExecuteThread.run(ExecuteThread.java:117)
"ExecuteThread-2" (TID:0x5cb534, sys_thread_t:0x5cb4b8, state:CW, thread_t: t@13, threadID:0xfe041dc8, stack_bottom:0xfe042000, stac
k_size:0x20000) prio=5
[1] java.lang.Object.wait(Native Method)
[2] java.lang.Object.wait(Object.java:424)
[3] weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:90)
[4] weblogic.kernel.ExecuteThread.run(ExecuteThread.java:117)
"ExecuteThread-1" (TID:0x5d1534, sys_thread_t:0x5d14b8, state:CW, thread_t: t@12, threadID:0xfe071dc8, stack_bottom:0xfe072000, stac
k_size:0x20000) prio=5
[1] java.lang.Object.wait(Native Method)
[2] java.lang.Object.wait(Object.java:424)
[3] weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:90)
[4] weblogic.kernel.ExecuteThread.run(ExecuteThread.java:117)
"ExecuteThread-0" (TID:0x5d1a2c, sys_thread_t:0x5d19b0, state:CW, thread_t: t@11, threadID:0xfe0a1dc8, stack_bottom:0xfe0a2000, stac
k_size:0x20000) prio=5
[1] java.lang.Object.wait(Native Method)
[2] java.lang.Object.wait(Object.java:424)
[3] weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:90)
[4] weblogic.kernel.ExecuteThread.run(ExecuteThread.java:117)
"TimeEventGenerator" (TID:0x599694, sys_thread_t:0x599618, state:CW, thread_t: t@10, threadID:0xfe0d1dc8, stack_bottom:0xfe0d2000, s
tack_size:0x20000) prio=5
[1] java.lang.Object.wait(Native Method)
[2] weblogic.time.common.internal.TimeTable.snooze(TimeTable.java:252)
[3] weblogic.time.common.internal.TimeEventGenerator.run(TimeEventGenerator.java:141)
[4] java.lang.Thread.run(Thread.java:485)
"SpinnerRandomSource" (TID:0x55f2a4, sys_thread_t:0x55f228, state:CW, thread_t: t@8, threadID:0xfec41dc8, stack_bottom:0xfec42000, s
tack_size:0x20000) prio=5
[1] java.lang.Object.wait(Native Method)
[2] java.lang.Object.wait(Object.java:424)
[3] weblogic.security.SpinnerThread.stopSpinning(SpinnerRandomBitsSource.java:104)
[4] weblogic.security.SpinnerThread.run(SpinnerRandomBitsSource.java:121)
Exiting Thread (sys_thread_t:0xff2cace0) : no stack
"Finalizer" (TID:0x172e84, sys_thread_t:0x172e08, state:CW, thread_t: t@6, threadID:0xfed31dc8, stack_bottom:0xfed32000, stack_size:
0x20000) prio=8
[1] java.lang.Object.wait(Native Method)
[2] java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:113)
[3] java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:128)
[4] java.lang.ref.Finalizer$FinalizerThread.run(Finalizer.java:175)
"Reference Handler" (TID:0x16ed54, sys_thread_t:0x16ecd8, state:CW, thread_t: t@5, threadID:0xfed61dc8, stack_bottom:0xfed62000, sta
ck_size:0x20000) prio=10
[1] java.lang.Object.wait(Native Method)
[2] java.lang.Object.wait(Object.java:424)
[3] java.lang.ref.Reference$ReferenceHandler.run(Reference.java:115)
"Signal dispatcher" (TID:0x14e1e4, sys_thread_t:0x14e168, state:MW, thread_t: t@4, threadID:0xfed91dc8, stack_bottom:0xfed92000, sta
ck_size:0x20000) prio=10
"main" (TID:0x39974, sys_thread_t:0x398f8, state:CW, thread_t: t@1, threadID:0x24ac8, stack_bottom:0xffbf0000, stack_size:0x20000) p
rio=5
[1] java.lang.Object.wait(Native Method)
[2] java.lang.Object.wait(Object.java:424)
[3] weblogic.t3.srvr.T3Srvr.waitForDeath(T3Srvr.java:1791)
[4] java.lang.reflect.Method.invoke(Native Method)
[5] weblogic.Server.startServerDynamically(Server.java:107)
[6] weblogic.Server.main(Server.java:65)
[7] weblogic.Server.main(Server.java:55)
Abort - core dumpedThe current thread shows JVM has core dumped on a native OCI call.
Type-2 drivers need to make OCI calls to connect to the Database server and since OCI calls are in C,
there is a possibility that C code is causing JVM to crash.
I would recommend you to give it a try with type-4 driver and see if you can get rid of core dumps.
Kumar
manish wrote:
We are using WebLogic 4.5 on Solaris 7. Some times the WebLogic dumps core and exits. There is no pattern for it. I am attaching the core generated:
Could there be a solution some one knows of.
Thanks.
-manish
kghalo bad size 0x15330128
********** Internal heap ERROR KGHALO2 addr=0x0 *********
HEAP DUMP heap name="Alloc environm" desc=0x37083f4
extent sz=0x1024 alt=32 het=32767 rec=0 flg=3 opc=2
parent=0 owner=0 nex=0 xsz=0x17a0
EXTENT 0
Chunk 3daff00 sz= 6040 free " "
EXTENT 1
Chunk 4a857b8 sz= 12040 free " "
EXTENT 2
Chunk 3eaac98 sz= 6372 free " "
EXTENT 3
Chunk 3dacfe8 sz= 12040 free " "
EXTENT 4
Chunk 37567a0 sz= 4660 free " "
Chunk 37579d4 sz= 4144 recreate "Alloc statemen " latch=0
ds 3758d70 sz= 4144 ct= 1
Chunk 3758a04 sz= 1080 freeable assoc with mark prv=0 nxt=0
Chunk 3758e3c sz= 4144 recreate "Alloc statemen " latch=0
ds 375a1d8 sz= 4144 ct= 1
Chunk 3759e6c sz= 1080 freeable assoc with mark prv=0 nxt=0
Chunk 375a2a4 sz= 28 freeable assoc with mark prv=0 nxt=0
Chunk 375a2c0 sz= 5224 free " "
Chunk 375b728 sz= 20 freeable assoc with mark prv=0 nxt=0
Chunk 375b73c sz= 20 freeable assoc with mark prv=0 nxt=0
Chunk 375b750 sz= 256 freeable assoc with mark prv=0 nxt=0
EXTENT 5
Chunk 404b50 sz= 13328 freeable "Alloc server h " ds=3709408
EXTENT 6
Chunk 3708980 sz= 40 perm "perm " alo=40
Chunk 37089a8 sz= 2212 recreate "Alloc server h " latch=0
ds 3709408 sz= 15540 ct= 2
404b50 sz= 13328
Chunk 370924c sz= 104 freeable assoc with mark prv=0 nxt=0
Chunk 37092b4 sz= 444 freeable assoc with mark prv=0 nxt=0
Chunk 3709470 sz= 1308 freeable assoc with mark prv=0 nxt=0
Total heap size = 74584
FREE LISTS:
Bucket 0 size=272
Bucket 1 size=528
Bucket 2 size=1040
Chunk 37567a0 sz= 4660 free " "
Chunk 3dacfe8 sz= 12040 free " "
Chunk 3eaac98 sz= 6372 free " "
Chunk 4a857b8 sz= 12040 free " "
Chunk 3daff00 sz= 6040 free " "
Chunk 375a2c0 sz= 5224 free " "
Total free space = 46376
UNPINNED RECREATABLE CHUNKS (lru first):
PERMANENT CHUNKS:
Chunk 3708980 sz= 40 perm "perm " alo=40
Permanent space = 40
Hla: 0
kgepop: no error frame to pop to for error 0
Segmentation Fault
si_signo [11]: Segmentation Fault
si_errno [0]: Error 0
si_code [1]: SEGV_MAPERR [addr: 0x0]
stackpointer=F9FBFC50
"SSLListenThread" (TID:0x3a8b58c, sys_thread_t:0x3a8b510, state:R, thread_t: t@30, threadID:0xf8d91dc8, stack_bottom:0xf8d92000, sta
ck_size:0x20000) prio=5
[1] java.net.PlainSocketImpl.socketAccept(Native Method)
[2] java.net.PlainSocketImpl.accept(PlainSocketImpl.java:406)
[3] java.net.ServerSocket.implAccept(ServerSocket.java:241)
[4] java.net.ServerSocket.accept(ServerSocket.java:224)
[5] weblogic.security.SSL.SSLServerSocket.acceptNoHandshake(SSLServerSocket.java:121)
[6] weblogic.security.SSL.SSLServerSocket.accept(SSLServerSocket.java:112)
[7] weblogic.t3.srvr.ListenThread.run(ListenThread.java:277)
"ListenThread" (TID:0x3a7b294, sys_thread_t:0x3a7b218, state:R, thread_t: t@29, threadID:0xf8e41dc8, stack_bottom:0xf8e42000, stack_
size:0x20000) prio=5
[1] java.net.PlainSocketImpl.socketAccept(Native Method)
[2] java.net.PlainSocketImpl.accept(PlainSocketImpl.java:406)
[3] java.net.ServerSocket.implAccept(ServerSocket.java:241)
[4] java.net.ServerSocket.accept(ServerSocket.java:224)
[5] weblogic.t3.srvr.ListenThread.run(ListenThread.java:277)
"ExecuteThread-14" (TID:0x54e104, sys_thread_t:0x54e088, state:MW, thread_t: t@25, threadID:0xf8eb1dc8, stack_bottom:0xf8eb2000, sta
ck_size:0x20000) prio=5
[1] weblogic.socket.PosixSocketMuxer.processSockets(PosixSocketMuxer.java:269)
[2] weblogic.socket.SocketReaderRequest.execute(SocketReaderRequest.java:23)
[3] weblogic.kernel.ExecuteThread.run(ExecuteThread.java:120)
"ExecuteThread-13" (TID:0x59c504, sys_thread_t:0x59c488, state:R, thread_t: t@24, threadID:0xf8ee1dc8, stack_bottom:0xf8ee2000, stac
k_size:0x20000) prio=5
[1] weblogic.socket.PosixSocketMuxer.poll(Native Method)
[2] weblogic.socket.PosixSocketMuxer.processSockets(PosixSocketMuxer.java:270)
[3] weblogic.socket.SocketReaderRequest.execute(SocketReaderRequest.java:23)
[4] weblogic.kernel.ExecuteThread.run(ExecuteThread.java:120)
"ExecuteThread-12" (TID:0x5ba504, sys_thread_t:0x5ba488, state:MW, thread_t: t@23, threadID:0xf8f11dc8, stack_bottom:0xf8f12000, sta
ck_size:0x20000) prio=5
[1] weblogic.socket.PosixSocketMuxer.processSockets(PosixSocketMuxer.java:269)
[2] weblogic.socket.SocketReaderRequest.execute(SocketReaderRequest.java:23)
[3] weblogic.kernel.ExecuteThread.run(ExecuteThread.java:120)
"ExecuteThread-11" (TID:0x4f62ec, sys_thread_t:0x4f6270, state:CW, thread_t: t@22, threadID:0xf8f41dc8, stack_bottom:0xf8f42000, sta
ck_size:0x20000) prio=5
[1] java.lang.Object.wait(Native Method)
[2] java.lang.Object.wait(Object.java:424)
[3] weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:90)
[4] weblogic.kernel.ExecuteThread.run(ExecuteThread.java:117)
"ExecuteThread-10" (TID:0x52810c, sys_thread_t:0x528090, state:CW, thread_t: t@21, threadID:0xf8f71dc8, stack_bottom:0xf8f72000, sta
ck_size:0x20000) prio=5
[1] java.lang.Object.wait(Native Method)
[2] java.lang.Object.wait(Object.java:424)
[3] weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:90)
[4] weblogic.kernel.ExecuteThread.run(ExecuteThread.java:117)
"ExecuteThread-9" (TID:0x53050c, sys_thread_t:0x530490, state:CW, thread_t: t@20, threadID:0xf9171dc8, stack_bottom:0xf9172000, stac
k_size:0x20000) prio=5
[1] java.lang.Object.wait(Native Method)
[2] java.lang.Object.wait(Object.java:424)
[3] weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:90)
[4] weblogic.kernel.ExecuteThread.run(ExecuteThread.java:117)
"ExecuteThread-8" (TID:0x53210c, sys_thread_t:0x532090, state:CW, thread_t: t@19, threadID:0xf9e61dc8, stack_bottom:0xf9e62000, stac
k_size:0x20000) prio=5
[1] java.lang.Object.wait(Native Method)
[2] java.lang.Object.wait(Object.java:424)
[3] weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:90)
[4] weblogic.kernel.ExecuteThread.run(ExecuteThread.java:117)
"ExecuteThread-7" (TID:0x55ed3c, sys_thread_t:0x55ecc0, state:CW, thread_t: t@18, threadID:0xf9e91dc8, stack_bottom:0xf9e92000, stac
k_size:0x20000) prio=5
[1] java.lang.Object.wait(Native Method)
[2] java.lang.Object.wait(Object.java:424)
[3] weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:90)
[4] weblogic.kernel.ExecuteThread.run(ExecuteThread.java:117)
"ExecuteThread-6" (TID:0x5c750c, sys_thread_t:0x5c7490, state:CW, thread_t: t@17, threadID:0xf9ec1dc8, stack_bottom:0xf9ec2000, stac
k_size:0x20000) prio=5
[1] java.lang.Object.wait(Native Method)
[2] java.lang.Object.wait(Object.java:424)
[3] weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:90)
[4] weblogic.kernel.ExecuteThread.run(ExecuteThread.java:117)
"ExecuteThread-5" (TID:0x5cc514, sys_thread_t:0x5cc498, state:CW, thread_t: t@16, threadID:0xf9ef1dc8, stack_bottom:0xf9ef2000, stac
k_size:0x20000) prio=5
[1] java.lang.Object.wait(Native Method)
[2] java.lang.Object.wait(Object.java:424)
[3] weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:90)
[4] weblogic.kernel.ExecuteThread.run(ExecuteThread.java:117)
"ExecuteThread-4" (TID:0x5d091c, sys_thread_t:0x5d08a0, state:R, thread_t: t@15, threadID:0xf9fc1dc8, stack_bottom:0xf9fc2000, stack
_size:0x20000) prio=5 current thread
[1] weblogic.db.oci.OciCursor.exec(Native Method)
[2] weblogic.db.oci.OciCursor.oci_exec(OciCursor.java:1823)
[3] weblogic.jdbcbase.oci.Statement.executeUpdate(Statement.java:846)
[4] weblogic.jdbcbase.oci.Statement.execute(Statement.java:1361)
[5] weblogic.jdbc20.pool.PreparedStatement.execute(PreparedStatement.java:27)
[6] weblogic.jdbc20.rmi.internal.PreparedStatementImpl.execute(PreparedStatementImpl.java:288)
[7] weblogic.jdbc20.rmi.SerialPreparedStatement.execute(SerialPreparedStatement.java:401)
[8] com.ebd.oss.isp.model.ISPModel.getContactInfo(ISPModel.java:242)
[9] com.ebd.oss.isp.model.ISPModel.getISPInfoByID(ISPModel.java:634)
[10] jsp_servlet._ruUpdateContact._jspService(_ruUpdateContact.java:110)
[11] weblogic.servlet.jsp.JspBase.service(JspBase.java:27)
[12] weblogic.servlet.internal.ServletStubImpl.invokeServlet(ServletStubImpl.java:105)
[13] weblogic.servlet.internal.RequestDispatcherImpl.include(RequestDispatcherImpl.java:240)
[14] weblogic.servlet.internal.RequestDispatcherImpl.include(RequestDispatcherImpl.java:161)
[15] jsp_servlet._Template._jspService(_Template.java:106)
[16] weblogic.servlet.jsp.JspBase.service(JspBase.java:27)
[17] weblogic.servlet.internal.ServletStubImpl.invokeServlet(ServletStubImpl.java:105)
[18] weblogic.servlet.internal.RequestDispatcherImpl.forward(RequestDispatcherImpl.java:143)
[19] jsp_servlet._Main._jspService(_Main.java:204)
[20] weblogic.servlet.jsp.JspBase.service(JspBase.java:27)
[21] weblogic.servlet.internal.ServletStubImpl.invokeServlet(ServletStubImpl.java:105)
[22] weblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletContextImpl.java:742)
[23] weblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletContextImpl.java:686)
[24] weblogic.servlet.internal.ServletContextManager.invokeServlet(ServletContextManager.java:247)
[25] weblogic.socket.MuxableSocketHTTP.invokeServlet(MuxableSocketHTTP.java:361)
[26] weblogic.socket.MuxableSocketHTTP.execute(MuxableSocketHTTP.java:261)
[27] weblogic.kernel.ExecuteThread.run(ExecuteThread.java:120)
"ExecuteThread-3" (TID:0x5c7934, sys_thread_t:0x5c78b8, state:CW, thread_t: t@14, threadID:0xf9ff1dc8, stack_bottom:0xf9ff2000, stac
k_size:0x20000) prio=5
[1] java.lang.Object.wait(Native Method)
[2] java.lang.Object.wait(Object.java:424)
[3] weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:90)
[4] weblogic.kernel.ExecuteThread.run(ExecuteThread.java:117)
"ExecuteThread-2" (TID:0x5cb534, sys_thread_t:0x5cb4b8, state:CW, thread_t: t@13, threadID:0xfe041dc8, stack_bottom:0xfe042000, stac
k_size:0x20000) prio=5
[1] java.lang.Object.wait(Native Method)
[2] java.lang.Object.wait(Object.java:424)
[3] weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:90)
[4] weblogic.kernel.ExecuteThread.run(ExecuteThread.java:117)
"ExecuteThread-1" (TID:0x5d1534, sys_thread_t:0x5d14b8, state:CW, thread_t: t@12, threadID:0xfe071dc8, stack_bottom:0xfe072000, stac
k_size:0x20000) prio=5
[1] java.lang.Object.wait(Native Method)
[2] java.lang.Object.wait(Object.java:424)
[3] weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:90)
[4] weblogic.kernel.ExecuteThread.run(ExecuteThread.java:117)
"ExecuteThread-0" (TID:0x5d1a2c, sys_thread_t:0x5d19b0, state:CW, thread_t: t@11, threadID:0xfe0a1dc8, stack_bottom:0xfe0a2000, stac
k_size:0x20000) prio=5
[1] java.lang.Object.wait(Native Method)
[2] java.lang.Object.wait(Object.java:424)
[3] weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:90)
[4] weblogic.kernel.ExecuteThread.run(ExecuteThread.java:117)
"TimeEventGenerator" (TID:0x599694, sys_thread_t:0x599618, state:CW, thread_t: t@10, threadID:0xfe0d1dc8, stack_bottom:0xfe0d2000, s
tack_size:0x20000) prio=5
[1] java.lang.Object.wait(Native Method)
[2] weblogic.time.common.internal.TimeTable.snooze(TimeTable.java:252)
[3] weblogic.time.common.internal.TimeEventGenerator.run(TimeEventGenerator.java:141)
[4] java.lang.Thread.run(Thread.java:485)
"SpinnerRandomSource" (TID:0x55f2a4, sys_thread_t:0x55f228, state:CW, thread_t: t@8, threadID:0xfec41dc8, stack_bottom:0xfec42000, s
tack_size:0x20000) prio=5
[1] java.lang.Object.wait(Native Method)
[2] java.lang.Object.wait(Object.java:424)
[3] weblogic.security.SpinnerThread.stopSpinning(SpinnerRandomBitsSource.java:104)
[4] weblogic.security.SpinnerThread.run(SpinnerRandomBitsSource.java:121)
Exiting Thread (sys_thread_t:0xff2cace0) : no stack
"Finalizer" (TID:0x172e84, sys_thread_t:0x172e08, state:CW, thread_t: t@6, threadID:0xfed31dc8, stack_bottom:0xfed32000, stack_size:
0x20000) prio=8
[1] java.lang.Object.wait(Native Method)
[2] java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:113)
[3] java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:128)
[4] java.lang.ref.Finalizer$FinalizerThread.run(Finalizer.java:175)
"Reference Handler" (TID:0x16ed54, sys_thread_t:0x16ecd8, state:CW, thread_t: t@5, threadID:0xfed61dc8, stack_bottom:0xfed62000, sta
ck_size:0x20000) prio=10
[1] java.lang.Object.wait(Native Method)
[2] java.lang.Object.wait(Object.java:424)
[3] java.lang.ref.Reference$ReferenceHandler.run(Reference.java:115)
"Signal dispatcher" (TID:0x14e1e4, sys_thread_t:0x14e168, state:MW, thread_t: t@4, threadID:0xfed91dc8, stack_bottom:0xfed92000, sta
ck_size:0x20000) prio=10
"main" (TID:0x39974, sys_thread_t:0x398f8, state:CW, thread_t: t@1, threadID:0x24ac8, stack_bottom:0xffbf0000, stack_size:0x20000) p
rio=5
[1] java.lang.Object.wait(Native Method)
[2] java.lang.Object.wait(Object.java:424)
[3] weblogic.t3.srvr.T3Srvr.waitForDeath(T3Srvr.java:1791)
[4] java.lang.reflect.Method.invoke(Native Method)
[5] weblogic.Server.startServerDynamically(Server.java:107)
[6] weblogic.Server.main(Server.java:65)
[7] weblogic.Server.main(Server.java:55)
Abort - core dumped
Maybe you are looking for
-
It seems that everytime Apple releases an update to IOS, the App Store behaves differently! My iPad 1 is currently at 4.3.3 and nearly everytime I select an app in the app store to read about, when I return, I'm back at #1. This has become an issue
-
Hi experts, We have a Proxy to SOAP scenario and we have the same issue mentioned in this post and in note 1522630, the version is SAP PI 7.31 (AEX). We configured 2 XSLT mappings and we use the MessageTransformBean (Transform.ContentType=text/xml;ch
-
Problem with Cross Tab in Live Office Connectivity
Hi Experts, I am using Live Office Connectivity to build a Xcelsius Dashboard. The webi Report has data in 4 cross tabs which comes to Xcelsius as 4 LO Connections. The size of the Xcelsius Doc is around 900K. I am getting "Xcelcius has stopped worki
-
Hi, I have problem (can I call it hunt on ghost?) with MSI G4Ti4200 128MB. Graphic is freeze every 2sec on 0.3sec! I try to update drivers/bios/all other SW, change IRQ, change Bios settings, Detonator settings, VIA chipset drivers, 4x reinstall Win
-
Include report header for every new page.
Hi expert, I have create a report with two buttons, 'previous page' and 'next page'. when i click the buttons, my report will go to another new page. I am using NEW-PAGE in my report. My problem now is, how can i include TOP-OF-PAGE for every new pag