Debugging core files with dbx

Here are a few questions one of our developers asked me
to post:
There are some things I don't understand about these core files.
(I get this dbx message examining the core file: dbx: internal warning: writable memory segment 0xfe750000[188416] of size 0 in core)
Here are the threads:
(dbx) threads
> t@1 a l@1 ?() LWP suspended in elflookup_filtee()
t@2 a l@2 ?() LWP suspended in __open()
t@4 b l@4 kaiocleanup_thread() LWP suspended in kaio()
o t@5 a l@5 ?() signal SIGSEGV in runThreadFunction()
t@6 a l@6 ?() sleep on (unknown) in __lwp_park()
t@7 a l@7 ?() sleep on (unknown) in __lwp_park()
(dbx)
Here's thread 1:
(dbx) where
current thread: t@1
=>[1] elflookup_filtee(0xffbff29c, 0xffbff32c, 0xffbff328, 0x5af8f2f, 0x184, 0xff1208d8), at 0xff3b8e3c
[2] lookup_sym_interpose(0xffbff330, 0xffbff32c, 0xffbff328, 0x5af8f2f, 0x0, 0xff3c2bcc), at 0xff3b6a2c
[3] tls_report_modules(0xff3ec0f0, 0xfea905d0, 0x2380c, 0xff3ec0f0, 0xff3ee67c, 0x0), at 0xff3caeac
[4] rtboot(0x2380c, 0xff000000, 0x0, 0xfe8b6448, 0x0, 0xfe8e9c44), at 0xff3b378c
[5] 0x4aee0(0x4bfd8, 0x0, 0xff000000, 0x0, 0x0, 0xfe7f2000), at 0x4aedf
[6] 0x2380c(0x1, 0x1084, 0xfe797cc0, 0x0, 0xfe7f2000, 0x1000), at 0x2380b
[7] _exithandle(0xfe8e9b80, 0xfe797c00, 0xfe8e8bc0, 0x1, 0x4b104, 0xfc00), at 0xfe83e608
[8] exit(0x0, 0x1, 0x77c20, 0x4d000, 0xfe7974c0, 0xfe797500), at 0xfe82cf28
And here's thread 5:
(dbx) where -h
current thread: t@5
=>[1] DataWriter::runThreadFunction(0xffbff1a0, 0x0, 0x431bde83, 0x15a758, 0x0, 0x9f3e), at 0x1eba8
[2] 0xfeee5724(0xffbff1ac, 0xfe47c000, 0x0, 0x0, 0xffbff1a0, 0x4bb1c), at 0xfeee5723
(dbx)
What I dont understand:
1. Why is where on thread 5 not reporting the SEGV?
2. Why is thread 1 in the exit handle when some threads have not yet exited?
3. Why is thread 1 not showing any stack above the exit call?
How do I get information on these questions?
Thanks in advance.
-- prasad

which version of dbx are you using?
A message about "size 0" can sometimes mean that
your core file was truncated by a core limit that is set
too low. That can cause missing information.
1. Why is where on thread 5 not reporting the SEGV?I don't know. This seems like a bug, but not a serious one.
You know there is a seg fault from the "threads" command.
2. Why is thread 1 in the exit handle when some threads have not yet exited?The program can call exit() whenever it wants to. At that
point the cleanup handlers will be called. If you want the
system to wait for all threads to exit, then call thr_exit() instead
of exit().
3. Why is thread 1 not showing any stack above the exit call?I don't know the answer. Sometimes stack trace information
in the process is a little but unreliable. It's only 100% reliable if you
compile with -g and do not use the optimizer. Even in those cases,
it is 99% reliable.

Similar Messages

  • Debugging core file with dbx

    I am trying to debug a core file with dbx. My first problem was a core mismatch. I copied the libraries from production to a directory in my development environment, set core_lo_pathmap to on, and used the pathmap command to get the files from the new location. The files I copied include ld.so and ld.so.1 - based on an article I read. I am not getting the core mismatch anymore but this is the result I am getting now:
    Reading libdec.so
    Reading libhpsnls.so
    Reading libc_psr.so.1
    Reading libthread.so.1
    Reading nss_files.so.1
    Reading GMOG1.dll
    Reading vogn2405.dll
    Reading libiiapi.1.so
    detected a multithreaded program
    t@1 (l@1) terminated by signal SEGV (no mapping at the fault address)
    0xff311c5c: fflushu_iops+0x004c: ldub [%i4 + 0xc], %o0
    I am unsure of the next step and any advice would be appreciated.

    If all you're looking for is a stack trace, run pstack on the core file on the
    production system where the core was created.
    tim

  • Debugging core file

    Hi ,
    While debugging a core file on a Solarix box , i find a peculiar problem.
    if i write dbx - /tmp/core , it gives the following error
    dbx: File `/tmp/core' is not ELF executable
    if howevere i use `file /tmp/core ` it gives
    --- tmp/core: ELF 64-bit MSB core file........
    I'm not able to find the root cause of the problem. As i need to debug the core file
    to understand the main cause of the issue. Could you please help me or correct me if i'm doing something
    wrong. I had even tried to do the forcefull load of the core file, but its of no help.
    Regards

    KabhiNahin wrote:
    Hi ,
    I have already tried the changes suggested by you . i.e chnage the permissions and also to replace the
    executable name instead of the "-" . No, I was not suggesting to change permissions, it was actually a bad example, something that you shouldn't do to debug a core. Anyway, changing permissions doesn't hurt; it just doesn't help.
    KabhiNahin wrote:
    But the problem still persists.
    When i do the pstack of the core file, it doesn't provide any informative description.What does pstack print? Also, what does
    $ dbx a.out /tmp/coreprint exactly?

  • Pstack from core file with no usable info

    One of our applications is coring and the customer is sending a pstack from the core file that looks like:
    core 'core' of 16879: /path/to/executable
    ----------------------------- lwp# 1 --------------
    ffffffff7a50711c ???????? (6, 0, ffffffff7dfffff90, 0, 0, 0)
    ---------------------------- lwp# 2 --------------------------------------
    ** zombie (exited, not detached, not yet joined) **
    ------------------------------ lwp# 4 -----------------------------------
    ffffffff620db950 ???????? (0, 0, 0, 0, ffffffff70f01ac0, ffffffff6224a240)
    ----------------------------- lwp# 11 ------------------------------------------
    ffffffff620d7410 ???????? (ffffffff63aec0a0, ffffffff6caec080, ffffffff5b1fbba0, 4, 16df10, ffffffff6eb0be00)
    The customer says they are generating the pstack from the core on the same computer and OS it was generated on.
    Could this be an indication of a corrupted stack?
    An incomplete core file?
    Can mdb be used to get additional info from the core?
    What else can I have the customer do with the core file so they can provide more information?
    I cannot get access to the actual core file.
    The core is generated from a system running Solaris 10, Studio 11 C++ code.
    David.

    There is a utility on Solaris, coreadm(9), which provides tremenduous flexibility in controlling
    how much stuff gets put into a corefile. Could it be that the customer site has used coreadm
    to really throttle down what's in the corefile?

  • Signal ILL trying to debug java process with dbx

    Hello,
    I'm trying to debug a java process to find an error in JNI code. I get this message when dbx stops in a C breakpoint:
    t@18 (l@19) signal ILL (illegal trap) in (unknown) t@18 (l@19) signal ILL (illegal trap) in (unknown) at 0xf848ed28
    0xf848ed28:     tne     0x12This signal is not launched when running application without debugger, and after launching this exception and exiting dbx, the java process generates a core.
    I've tried to find out unsuccessfully whether my dbx version is compatible with my Java version, but it seems this could be the problem.
    This is my current configuration:
    java �version:
    java version "1.5.0_06"
    Java(TM) 2 Runtime Environment, Standard Edition (build 1.5.0_06-b05)
    Java HotSpot(TM) Server VM (build 1.5.0_06-b05, mixed mode)
    opt/SUNWspro/bin/version:
    Machine hardware:   sun4u
    OS version:         5.8
    Processor type:     sparc
    Hardware:           SUNW,Sun-Blade-2500
    The following components are installed on your system:
    Forte C++ 6 update 2
            Sun WorkShop 6 update 2 Compilers C    
            Sun WorkShop 6 update 2 Compilers C++
            Sun WorkShop 6 update 2 Tools.h++ 7.1
            Sun WorkShop 6 update 2 Standard 64-bit Class Library for C++
            Sun WorkShop 6 update 2 Memory Monitor for C++
            Sun WorkShop 6 update 2 Visual
            Sun WorkShop 6 update 2 Development Environment
            Sun WorkShop 6 update 2 TeamWare
            Sun WorkShop 6 update 2 FileMerge
            Sun WorkShop 6 update 2 DBX Debugging Tools
            Sun WorkShop 6 update 2 Performance Analyzer
            Sun WorkShop 6 update 2 LockLint
            XEmacs 20.4 Source Distribution
            Sun WorkShop 6 update 2 Documentation Set
    Sun WorkShop 6 update 2 Building SoftwareAnd this is how I launch java application:
    java -Djava.compiler=NONE -Xdebug -Xnoagent -Xrundbx_agent -jar jarname.jar -mainOptionsDid I miss something important? Does anyone know if it is possible debugging with this configuration?
    Best Regards,
    Alberto

    - Native code has been compiled with -g option.
    - It fails in my code, but only when debugging.
    - Stack trace (executing "where" in dbx):
    (dbx) where
    current thread: t@18
      [1] 0xf848ef68(0xf01537d8, 0xf443b7b0, 0x0, 0xf84181b0, 0x21e9, 0xef581050), at 0xf848ef68
      [2] 0xf8458354(0xf15faea8, 0xf01537d8, 0xf0151a88, 0xf8419368, 0x21e8, 0x0), at 0xf8458354
      [3] 0xf848c9a0(0xf15faea8, 0xf01537d8, 0xf0151a58, 0xf0151a38, 0xf0153830, 0x0), at 0xf848c9a0
      [4] 0xf84577c8(0xf15faea8, 0xb6, 0x0, 0xf84181b0, 0xf0158f80, 0xef581118), at 0xf84577c8
      [5] 0xf8405764(0xf15faea8, 0xb6, 0x0, 0xf8419320, 0xf0158f80, 0xef5811c8), at 0xf8405764
      [6] 0xf8405764(0xf15faea8, 0xb6, 0x0, 0xf84195a0, 0xf0158f80, 0xef581250), at 0xf8405764
      [7] 0xf8405764(0xf0151a38, 0xb8, 0x0, 0xf8419320, 0xf0125258, 0xef5812d8), at 0xf8405764
      [8] 0xf8405874(0xf15fb6c8, 0xb8, 0x0, 0xf8419720, 0xf0125258, 0xef581360), at 0xf8405874
      [9] 0xf8405764(0xf15fae98, 0xb6, 0x0, 0xf8419770, 0xf00f0088, 0xef5813f0), at 0xf8405764
      [10] 0xf8405874(0xf15fae98, 0xb6, 0x0, 0xf8419320, 0x1465, 0xef581478), at 0xf8405874
      [11] 0xf8405874(0xf16315b0, 0xb6, 0x0, 0xf8419320, 0xf00f0088, 0xef581500), at 0xf8405874
      [12] 0xf8405764(0xf16315b0, 0xf45744c0, 0x0, 0xf8419320, 0xf45744c0, 0xef581588), at 0xf8405764
      [13] 0xf8405c2c(0xf16315d0, 0xb7, 0x0, 0xf84198a0, 0xf00f0088, 0xef581618), at 0xf8405c2c
      [14] 0xf8405764(0xf009c018, 0xf402c8b8, 0x0, 0xf84195a0, 0x8800, 0xef5816a8), at 0xf8405764
      [15] 0xf8405c2c(0x2000, 0x2, 0x0, 0xf84198f0, 0xef50e0f8, 0xef581720), at 0xf8405c2c
      [16] 0xf8400218(0xef581808, 0xef581a08, 0xa, 0xf402dae8, 0xf840ba20, 0xef581920), at 0xf8400218
      [17] JavaCalls::call_helper(0x1, 0x65d188, 0xef581918, 0xef581818, 0x4, 0xef581a08), at 0xfdd9a808
      [18] JavaCalls::call_virtual(0x7a9c, 0x65d188, 0x3570f8, 0x357104, 0x357100, 0xf00bc770), at 0xfdec319c
      [19] thread_entry(0xf402fc58, 0x65d188, 0x3574e4, 0xfe424640, 0xfe424710, 0xfe424130), at 0xfdee2700
      [20] JavaThread::run(0x65d188, 0x18, 0xfe40c790, 0x6c00, 0x7dd4, 0x7c00), at 0xfdede29c
      [21] _start(0x65d188, 0x3b62, 0xfe3be000, 0x0, 0x4f24, 0x4c00), at 0xfe264240 - Stack trace (obtained from core generated after ILL signal):
    -----------------  lwp# 19 / thread# 18  --------------------
    ff3791f0 __sigprocmask (ff37b7f4, 0, 0, ef581d98, ff38c000, 0) + 8
    ff36dd0c _sigon   (ef581d98, ff3938a8, 6, ef58083c, ef581d98, ff39321c) + d0
    ff370d4c _thrp_kill (0, 12, 6, ff38c000, 12, ff2c0458) + f8
    ff24bce0 raise    (6, 0, 0, ffffffff, ff2c03c4, 8400) + 40
    ff235984 abort    (ff2bc008, fe3be000, fe26a8e0, fe4133c4, 0, 331c8) + 100
    fe264724 __1cCosFabort6Fi_v_ (1, 0, fe3f2614, fe3be000, 73b4, 7000) + 58
    fe2f08f0 __1cHVMErrorOreport_and_die6M_v_ (0, fe419ad8, fe41339c, 1, fe268a14, fe41339c) + c84
    fde76878 JVM_handle_solaris_signal (4, ef580fd8, ef580d20, 7800, 11, 65d188) + aac
    ff37b118 __sighndlr (4, ef580fd8, ef580d20, fde75d94, ef581e40, ef581e30) + c
    ff37811c sigacthandler (4, ef581d98, 0, 0, 0, ff38c000) + 708
    --- called from signal handler with signal 4 (SIGILL) ---
    f848ef68 ???????? (f15faea8, f01537d8, f0151a88, f8419368, 21e8, 0)
    f848c9a0 ???????? (f15faea8, f01537d8, f0151a58, f0151a38, f0153830, 0)
    f84577c8 ???????? (f15faea8, b6, 0, f84181b0, f0158f80, ef581118)
    f8405764 ???????? (f15faea8, b6, 0, f8419320, f0158f80, ef5811c8)
    f8405764 ???????? (f15faea8, b6, 0, f84195a0, f0158f80, ef581250)
    f8405764 ???????? (f0151a38, b8, 0, f8419320, f0125258, ef5812d8)
    f8405874 ???????? (f15fb6c8, b8, 0, f8419720, f0125258, ef581360)
    f8405764 ???????? (f15fae98, b6, 0, f8419770, f00f0088, ef5813f0)
    f8405874 ???????? (f15fae98, b6, 0, f8419320, 1465, ef581478)
    f8405874 ???????? (f16315b0, b6, 0, f8419320, f00f0088, ef581500)
    f8405764 ???????? (f16315b0, f45744c0, 0, f8419320, f45744c0, ef581588)
    f8405c2c ???????? (f16315d0, b7, 0, f84198a0, f00f0088, ef581618)
    f8405764 ???????? (f009c018, f402c8b8, 0, f84195a0, 8800, ef5816a8)
    f8405c2c ???????? (2000, 2, 0, f84198f0, ef50e0f8, ef581720)
    f8400218 ???????? (ef581808, ef581a08, a, f402dae8, f840ba20, ef581920)
    fdd9a808 __1cJJavaCallsLcall_helper6FpnJJavaValue_pnMmethodHandle_pnRJavaCallArguments_pnGThread__v_ (1, 65d188, ef581918, ef581818, 4, ef581a08) + 5a0
    fdec319c __1cJJavaCallsMcall_virtual6FpnJJavaValue_nGHandle_nLKlassHandle_nMsymbolHandle_5pnGThread__v_ (7a9c, 65d188, 3570f8, 357104, 357100, f00bc770) + 188
    fdee2700 __1cMthread_entry6FpnKJavaThread_pnGThread__v_ (f402fc58, 65d188, 3574e4, fe424640, fe424710, fe424130) + 134
    fdede29c __1cKJavaThreadDrun6M_v_ (65d188, 18, fe40c790, 6c00, 7dd4, 7c00) + 1d8
    fe264240 __1cG_start6Fpv_0_ (65d188, 3b62, fe3be000, 0, 4f24, 4c00) + 208
    ff37b01c _thread_start (65d188, 0, 0, 0, 0, 0) + 40
    -----------------  lwp# 20 / thread# 19  --------------------
    ff29f474 _lwp_sema_wait (ff3934c8, ff392e40, 0, 1, 0, 0) + c
    ff371c2c thr_yield (0, 0, 0, 0, 0, 0) + 8c
    -----------------  lwp# 21  --------------------------------
    ff379200 private___lwp_cond_wait (fa5a3d98, ff38cd6c, ff38c000, 3, ff38c000, 1) + 8
    ff36a358 _lwp_start (fa5a3d98, 0, 4000, fb28162c, 0, 0) + 18
    ff371c2c thr_yield (0, 0, 0, 0, 0, 0) + 8c
    -----------------  lwp# 22  --------------------------------
    ff379200 private___lwp_cond_wait (fa4d3d98, ff38cd6c, ff38c000, 3, ff38c000, 1) + 8
    ff36a358 _lwp_start (fa4d3d98, 0, 4000, fb28162c, 0, 0) + 18
    ff371c2c thr_yield (0, 0, 0, 0, 0, 0) + 8c
    -----------------  lwp# 23  --------------------------------
    ff379200 private___lwp_cond_wait (fa4c3d98, ff38cd6c, ff38c000, 3, ff38c000, 1) + 8
    ff36a358 _lwp_start (fa4c3d98, 0, 4000, fb28162c, 0, 0) + 18
    ff371c2c thr_yield (0, 0, 0, 0, 0, 0) + 8c
    -----------------  lwp# 24  --------------------------------
    ff379200 private___lwp_cond_wait (fa493d98, ff38cd6c, ff38c000, 3, ff38c000, 1) + 8
    ff36a358 _lwp_start (fa493d98, 0, 4000, fb28162c, 0, 0) + 18
    ff371c2c thr_yield (0, 0, 0, 0, 0, 0) + 8c
    -----------------  lwp# 25  --------------------------------
    ff379200 private___lwp_cond_wait (fa483d98, ff38cd6c, ff38c000, 3, ff38c000, 1) + 8
    ff36a358 _lwp_start (fa483d98, 0, 4000, fb28162c, 0, 0) + 18
    ff371c2c thr_yield (0, 0, 0, 0, 0, 0) + 8c
    -----------------  lwp# 26  --------------------------------
    ff379200 private___lwp_cond_wait (fa473d98, ff38cd6c, ff38c000, 3, ff38c000, 1) + 8
    ff36a358 _lwp_start (fa473d98, 0, 4000, fb28162c, 0, 0) + 18
    ff371c2c thr_yield (0, 0, 0, 0, 0, 0) + 8c
    -----------------  lwp# 1 / thread# 1  --------------------
    ff29d600 _poll    (fe4124d8, 0, 1, 18e, 37020, fe3be000) + 8
    fdd90cd0 __1cCosFsleep6FpnGThread_xi_i_ (6e58, 6c00, fdf04534, 1, 7, 4) + 25c
    fdf0ca4c JVM_Sleep (1c08, fe406e44, 37020, fe412d84, 38680, fe3be000) + 260
    f840e22c ???????? (b9, ffbee73c, ffbee6b8, ffffff80, 0, 0)
    f840e1d0 ???????? (0, b8, 0, 8, f402fc58, ffbee6d0)
    f8405764 ???????? (f15996c8, fe4163d4, 0, f8419770, 8800, ffbee768)
    f8405764 ???????? (f01778f8, fe4163d4, 0, f8419370, 8800, ffbee820)
    f8405764 ???????? (2000, 2, 0, f8419320, ffb7c110, ffbee8b8)
    f8400218 ???????? (ffbee9a0, ffbeeb00, a, f41c4038, f840ba20, ffbeea88)
    fdd9a808 __1cJJavaCallsLcall_helper6FpnJJavaValue_pnMmethodHandle_pnRJavaCallArguments_pnGThread__v_ (1, 37020, ffbeea80, ffbee9b0, 4, ffbeeb00) + 5a0
    fdedea14 jni_CallStaticVoidMethod (fe412d84, 381ec, 36750, 37020, 36748, 37cb8) + 500
    000121fc main     (38648, 1e7fa2, fe40a630, 1d8, fded413c, 1) + 115c
    00011088 _start   (0, 0, 0, 0, 0, 0) + 108
    -----------------  lwp# 2 / thread# 2  --------------------
    ff29edc4 _signotifywait (ff38c000, 0, 0, 0, 0, 0) + 8
    ff371c2c thr_yield (0, 0, 0, 0, 0, 0) + 8c
    -----------------  lwp# 3  --------------------------------
    ff379200 private___lwp_cond_wait (ff325d98, ff38cd6c, ff38c000, 0, 0, 4) + 8
    ff29c9c0 _door_return (ff325cd8, ff36a358, 0, 0, 0, 0) + 68
    -----------------  lwp# 4 / thread# 4  --------------------
    ff29f428 ___lwp_cond_wait (35d68, 35d50, fdb81978, 0, 0, fdb81970) + 8
    ff296a7c _lwp_cond_timedwait (2958790, 44b36755, fdb81a50, 35d50, 35d68, a95a) + 98
    fddc3258 __1cHMonitorEwait6Mil_i_ (35cf8, 11dce0, fff0bc00, fe3be000, 6000, 35d28) + 328
    fdf6b4fc __1cIVMThreadDrun6M_v_ (fe4124d8, fe420c84, 0, fe420c70, fe420c80, 1) + 1b4
    fe264240 __1cG_start6Fpv_0_ (11dce0, 3b62, fe3be000, 0, 4f24, 4c00) + 208
    ff37b01c _thread_start (11dce0, 0, 0, 0, 0, 0) + 40
    -----------------  lwp# 5  --------------------------------
    ff29c968 _door_return (4, ff38d658, ff38d670, 3, ff38c000, 1) + 10
    ff36a358 _lwp_start (fe785d98, 0, 6000, ff325b9c, 0, 0) + 18
    ff371c2c thr_yield (0, 0, 0, 0, 0, 0) + 8c
    -----------------  lwp# 6 / thread# 5  --------------------
    ff29f428 ___lwp_cond_wait (120148, 120130, 0, ff2968f0, 0, 1) + 8
    fdeb4768 __1cNObjectMonitorEwait6MxipnGThread__v_ (120370, 9408, 8c00, fe3be000, 11fdc0, 120390) + 59c
    fdeb5978 __1cSObjectSynchronizerEwait6FnGHandle_xpnGThread__v_ (120372, 86d4, 0, 11fdc0, 8400, fe3be000) + e8
    fdeb5628 JVM_MonitorWait (0, e7a14, 11fdc0, fe412d84, 0, 1) + 31c
    f840e22c ???????? (51, fda816ec, fda81670, ffffff80, fdd2e808, 0)
    f840e1d0 ???????? (f15817e0, b6, 0, c, 0, fda81688)
    f8405764 ???????? (f15817e0, b6, 0, f8419354, 80000000, fda81708)
    f8405764 ???????? (0, fe411508, 0, f8419770, 7bac, fda817a0)
    f8400218 ???????? (fda81888, fda81a88, a, f40901d0, f840ba20, fda819a0)
    fdd9a808 __1cJJavaCallsLcall_helper6FpnJJavaValue_pnMmethodHandle_pnRJavaCallArguments_pnGThread__v_ (1, 11fdc0, fda81998, fda81898, 4, fda81a88) + 5a0
    fdec319c __1cJJavaCallsMcall_virtual6FpnJJavaValue_nGHandle_nLKlassHandle_nMsymbolHandle_5pnGThread__v_ (7a9c, 11fdc0, e7a00, e7a0c, e7a08, f0000760) + 188
    fdee2700 __1cMthread_entry6FpnKJavaThread_pnGThread__v_ (f402fc58, 11fdc0, e7dec, fe424640, fe424710, fe424130) + 134
    fdede29c __1cKJavaThreadDrun6M_v_ (11fdc0, 0, fe40c790, 6c00, 7dd4, 7c00) + 1d8
    fe264240 __1cG_start6Fpv_0_ (11fdc0, 3b62, fe3be000, 0, 4f24, 4c00) + 208
    ff37b01c _thread_start (11fdc0, 0, 0, 0, 0, 0) + 40
    -----------------  lwp# 7 / thread# 6  --------------------
    ff29f428 ___lwp_cond_wait (121cc8, 121cb0, 0, ff2968f0, 0, 1) + 8
    fdeb4768 __1cNObjectMonitorEwait6MxipnGThread__v_ (1203b8, 9408, 8c00, fe3be000, 121530, 1203d8) + 59c
    fdeb5978 __1cSObjectSynchronizerEwait6FnGHandle_xpnGThread__v_ (1203ba, 86d4, 0, 121530, 8400, fe3be000) + e8
    fdeb5628 JVM_MonitorWait (0, 121714, 121530, fe412d84, 0, 1) + 31c
    f840e22c ???????? (59, fb3817ec, fb381768, ffffff80, 0, 0)
    f840e1d0 ???????? (f1581760, b6, 0, c, 80000000, fb381780)
    f8405764 ???????? (f1581768, b6, 0, f8419354, 8800, fb381820)
    f8405874 ???????? (f1581768, b6, 0, f8419354, f402af58, fb3818a0)
    f8405874 ???????? (0, fe411508, 0, f8419720, 7bac, fb381920)
    f8400218 ???????? (fb381a08, fb381c08, a, f4090ab8, f840ba20, fb381b20)
    fdd9a808 __1cJJavaCallsLcall_helper6FpnJJavaValue_pnMmethodHandle_pnRJavaCallArguments_pnGThread__v_ (1, 121530, fb381b18, fb381a18, 4, fb381c08) + 5a0
    fdec319c __1cJJavaCallsMcall_virtual6FpnJJavaValue_nGHandle_nLKlassHandle_nMsymbolHandle_5pnGThread__v_ (7a9c, 121530, 121700, 12170c, 121708, f0000858) + 188
    fdee2700 __1cMthread_entry6FpnKJavaThread_pnGThread__v_ (f402fc58, 121530, 121aec, fe424640, fe424710, fe424130) + 134
    fdede29c __1cKJavaThreadDrun6M_v_ (121530, 0, fe40c790, 6c00, 7dd4, 7c00) + 1d8
    fe264240 __1cG_start6Fpv_0_ (121530, 3b62, fe3be000, 0, 4f24, 4c00) + 208
    ff37b01c _thread_start (121530, 0, 0, 0, 0, 0) + 40
    -----------------  lwp# 8 / thread# 7  --------------------
    ff29f428 ___lwp_cond_wait (1b65f0, 1b65d8, fb281890, ff296918, ff29691c, fb281888) + 8
    ff296a7c _lwp_cond_timedwait (2964ae0, 44b36756, fb281910, 1b65d8, 1b65f0, 153180) + 98
    fe2606e0 __1cCosHSolarisFEventEpark6Mx_i_ (1b65b0, 6a60, fe4238d8, 1b65f0, fe406ef0, fb281910) + 1bc
    fe25ff28 __1cNObjectMonitorIraw_wait6MxipnGThread__i_ (1b65b0, fe214b70, 7bac, 0, 1b59e8, 12a188) + 20c
    fe1f4b8c __1cIJvmtiEnvORawMonitorWait6MpnPJvmtiRawMonitor_x_nKjvmtiError__ (fb2, 12a188, 0, 7d0, 4, 1b59e8) + a8
    fe7d87ec process_next_event (fe40b864, 10000, fe7f24a0, fe7f4b90, fe7f25f0, fe7f25ec) + 108
    fe7c7630 agent_bar (1b5aa4, fe7f2ae8, ff38c000, fe7f24c8, 0, 0) + 1c
    fe7c7bc4 jvmti_debug_agent (fe7f2400, 1b5aa4, 0, 1678, 1, fe7f252c) + d4
    fe211c74 __1cQJvmtiAgentThreadTcall_start_function6M_v_ (1b59e8, 7800, 8c94, fe3be000, fe4123c4, fe4163d4) + 150
    fdede29c __1cKJavaThreadDrun6M_v_ (1b59e8, 18, fe40c790, 6c00, 7dd4, 7c00) + 1d8
    fe264240 __1cG_start6Fpv_0_ (1b59e8, 3b62, fe3be000, 0, 4f24, 4c00) + 208
    ff37b01c _thread_start (1b59e8, 0, 0, 0, 0, 0) + 40
    -----------------  lwp# 9 / thread# 8  --------------------
    ff29f474 _lwp_sema_wait (fb181e60, ff38c000, 0, fb181d98, 0, 0) + c
    ff3690d8 _swtch   (fb181d98, ffffffff, ff38c000, 5, 1000, fe4170c4) + 158
    ff36c860 sema_wait (fe4217e8, ff39785c, 5000, 10000, 534d, 1) + bc
    fdf61dc0 __1cVcheck_pending_signals6Fi_i_ (1, fe4124d8, fe4123c0, 1b6ab8, fe3be000, a) + 254
    fdf58ec8 __1cTsignal_thread_entry6FpnKJavaThread_pnGThread__v_ (7428, 1b6ab8, 1b7088, fe3be000, 4ff61c, 1b7080) + 34
    fdede29c __1cKJavaThreadDrun6M_v_ (1b6ab8, 18, fe40c790, 6c00, 7dd4, 7c00) + 1d8
    fe264240 __1cG_start6Fpv_0_ (1b6ab8, 3b62, fe3be000, 0, 4f24, 4c00) + 208
    ff37b01c _thread_start (1b6ab8, 0, 0, 0, 0, 0) + 40
    -----------------  lwp# 10 / thread# 9  --------------------
    ff29f428 ___lwp_cond_wait (36548, 36530, fe423d60, 0, 0, ff29695c) + 8
    fddc33ec __1cHMonitorEwait6Mil_i_ (364d8, 1b7998, 1b8510, fe3be000, 1b7998, 36508) + 4bc
    fdf35d00 __1cNCompileBrokerUcompiler_thread_loop6F_v_ (fe4124d8, 1b54c0, 1b7998, fe407360, 8c00, 364d8) + 22c
    fdede29c __1cKJavaThreadDrun6M_v_ (1b7998, 18, fe40c790, 6c00, 7dd4, 7c00) + 1d8
    fe264240 __1cG_start6Fpv_0_ (1b7998, 3b62, fe3be000, 0, 4f24, 4c00) + 208
    ff37b01c _thread_start (1b7998, 0, 0, 0, 0, 0) + 40
    -----------------  lwp# 11 / thread# 10  --------------------
    fdd0c200 __1cENodeSremove_dead_region6MpnIPhaseGVN_i_i_ (9132d4, fa6809f4, 1, 9132d4, 9132f4, 68ad00) + 2c
    fdd3332c __1cHMemNodeMIdeal_common6MpnIPhaseGVN_i_pnENode__ (fa6809f4, fa6809f4, 1, 800, 9132d4, 9132f4) + 3c
    fdd68a78 __1cJStoreNodeFIdeal6MpnIPhaseGVN_i_pnENode__ (9132d4, fa6809f4, 1, 0, fdd4be74, fe3fbb44) + c
    fdcf887c __1cMPhaseIterGVNNtransform_old6MpnENode__2_ (fa6809f4, 9132d4, 89e938, fdd68a6c, 20000000, c7) + 28
    fdde3b98 __1cMPhaseIterGVNIoptimize6M_v_ (fa6809f4, 14, 9132d4, 0, fa680b44, ffffffff) + ac
    fde048d8 __1cOPhaseIdealLoop2t6MrnMPhaseIterGVN_pk0i_v_ (fa68087c, ffffffff, fa680fb0, 2, 0, fa680880) + c34
    fde7fb28 __1cHCompileIOptimize6M_v_ (fa680fb0, 1b55b0, 0, 0, fe3be000, 1000) + 200
    fde82740 __1cHCompile2t6MpnFciEnv_pnKC2Compiler_pnIciMethod_ii_v_ (fa680fb0, 0, 36ee0, 0, fe3384f8, fa680fb0) + be8
    fde786f8 __1cKC2CompilerOcompile_method6MpnFciEnv_pnIciMethod_i_v_ (fa6818ac, fe324608, 9269b8, ffffffff, 36ee0, 1000001) + b0
    fde793b4 __1cNCompileBrokerZinvoke_compiler_on_method6FpnLCompileTask__v_ (597690, 1b8eb4, 1b55b0, 1b88d8, fe338ea7, fa6818ac) + 4cc
    fdf35f20 __1cNCompileBrokerUcompiler_thread_loop6F_v_ (fe4124d8, 1b5550, 1b88d8, f4368380, 1b8eb0, 0) + 44c
    fdede29c __1cKJavaThreadDrun6M_v_ (1b88d8, 18, fe40c790, 6c00, 7dd4, 7c00) + 1d8
    fe264240 __1cG_start6Fpv_0_ (1b88d8, 3b62, fe3be000, 0, 4f24, 4c00) + 208
    ff37b01c _thread_start (1b88d8, 0, 0, 0, 0, 0) + 40
    -----------------  lwp# 12 / thread# 11  --------------------
    ff29f428 ___lwp_cond_wait (365d8, 365c0, fe423d60, 0, 0, ff29695c) + 8
    fddc33ec __1cHMonitorEwait6Mil_i_ (36568, 1b9818, 1ba390, fe3be000, 1b9818, 36598) + 4bc
    fdf35d00 __1cNCompileBrokerUcompiler_thread_loop6F_v_ (fe4124d8, 1b5550, 1b9818, fe407360, 1b9df0, 36568) + 22c
    fdede29c __1cKJavaThreadDrun6M_v_ (1b9818, 18, fe40c790, 6c00, 7dd4, 7c00) + 1d8
    fe264240 __1cG_start6Fpv_0_ (1b9818, 3b62, fe3be000, 0, 4f24, 4c00) + 208
    ff37b01c _thread_start (1b9818, 0, 0, 0, 0, 0) + 40
    -----------------  lwp# 13 / thread# 12  --------------------
    ff29f428 ___lwp_cond_wait (34858, 34840, 1, 0, 1, 1bb248) + 8
    fddc309c __1cHMonitorEwait6Mil_i_ (347e8, 1bb1a0, fff0bc00, fe3be000, f4000, 34818) + 16c
    fdf64b44 __1cRLowMemoryDetectorbGlow_memory_detector_thread_entry6FpnKJavaThread_pnGThread__v_ (1bb1a0, 347e8, 9000, fe411604, fe3be000, 1) + 2ec
    fdede29c __1cKJavaThreadDrun6M_v_ (1bb1a0, 18, fe40c790, 6c00, 7dd4, 7c00) + 1d8
    fe264240 __1cG_start6Fpv_0_ (1bb1a0, 3b62, fe3be000, 0, 4f24, 4c00) + 208
    ff37b01c _thread_start (1bb1a0, 0, 0, 0, 0, 0) + 40
    -----------------  lwp# 14 / thread# 13  --------------------
    ff29d600 _poll    (fe4124d8, 32, 0, 0, 8400, fe3be000) + 8
    fdd90cd0 __1cCosFsleep6FpnGThread_xi_i_ (6e58, 6c00, 1, 0, 2, 4) + 25c
    fdfa5194 __1cNWatcherThreadDrun6M_v_ (1bc4c8, 1b5460, 32, fe3be000, fe417db8, 0) + e8
    fe264240 __1cG_start6Fpv_0_ (1bc4c8, 3b62, fe3be000, 0, 4f24, 4c00) + 208
    ff37b01c _thread_start (1bc4c8, 0, 0, 0, 0, 0) + 40
    -----------------  lwp# 15 / thread# 14  --------------------
    ff29d600 _poll    (fe4124d8, 0, 1, f1, 3baea0, fe3be000) + 8
    fdd90cd0 __1cCosFsleep6FpnGThread_xi_i_ (6e58, 6c00, fdf04534, 1, 7, 4) + 25c
    fdf0ca4c JVM_Sleep (ba8, fe406e44, 3baea0, fe412d84, 3bb180, fe3be000) + 260
    f840e22c ???????? (c9, eff818f4, eff81870, ffffff80, f00e5250, 0)
    f840e1d0 ???????? (0, b8, 0, 8, f00e5250, eff81888)
    f8405764 ???????? (2000, 2, 0, f8419754, eff0e110, eff81920)
    f8400218 ???????? (eff81a08, eff81c08, a, f423b868, f840ba20, eff81b20)
    fdd9a808 __1cJJavaCallsLcall_helper6FpnJJavaValue_pnMmethodHandle_pnRJavaCallArguments_pnGThread__v_ (1, 3baea0, eff81b18, eff81a18, 4, eff81c08) + 5a0
    fdec319c __1cJJavaCallsMcall_virtual6FpnJJavaValue_nGHandle_nLKlassHandle_nMsymbolHandle_5pnGThread__v_ (7a9c, 3baea0, 254948, 254954, 254950, f01aaaf8) + 188
    fdee2700 __1cMthread_entry6FpnKJavaThread_pnGThread__v_ (f402fc58, 3baea0, 254d34, fe424640, fe424710, fe424130) + 134
    fdede29c __1cKJavaThreadDrun6M_v_ (3baea0, 18, fe40c790, 6c00, 7dd4, 7c00) + 1d8
    fe264240 __1cG_start6Fpv_0_ (3baea0, 3b62, fe3be000, 0, 4f24, 4c00) + 208
    ff37b01c _thread_start (3baea0, 0, 0, 0, 0, 0) + 40
    -----------------  lwp# 16 / thread# 15  --------------------
    ff29d600 _poll    (fe4124d8, 0, 1, f0, 358da0, fe3be000) + 8
    fdd90cd0 __1cCosFsleep6FpnGThread_xi_i_ (6e58, 6c00, fdf04534, 1, 7, 4) + 25c
    fdf0ca4c JVM_Sleep (368, fe406e44, 358da0, fe412d84, 358f98, fe3be000) + 260
    f840e22c ???????? (91, efe81874, efe817f0, ffffff80, f00dfeb0, 0)
    f840e1d0 ???????? (0, b8, 0, 8, f00dfeb0, efe81808)
    f8405764 ???????? (2000, 2, 0, f8419754, efe0e110, efe818a0)
    f8400218 ???????? (efe81988, efe81b88, a, f423b868, f840ba20, efe81aa0)
    fdd9a808 __1cJJavaCallsLcall_helper6FpnJJavaValue_pnMmethodHandle_pnRJavaCallArguments_pnGThread__v_ (1, 358da0, efe81a98, efe81998, 4, efe81b88) + 5a0
    fdec319c __1cJJavaCallsMcall_virtual6FpnJJavaValue_nGHandle_nLKlassHandle_nMsymbolHandle_5pnGThread__v_ (7a9c, 358da0, 254d48, 254d54, 254d50, f01b4270) + 188
    fdee2700 __1cMthread_entry6FpnKJavaThread_pnGThread__v_ (f402fc58, 358da0, 255134, fe424640, fe424710, fe424130) + 134
    fdede29c __1cKJavaThreadDrun6M_v_ (358da0, 18, fe40c790, 6c00, 7dd4, 7c00) + 1d8
    fe264240 __1cG_start6Fpv_0_ (358da0, 3b62, fe3be000, 0, 4f24, 4c00) + 208
    ff37b01c _thread_start (358da0, 0, 0, 0, 0, 0) + 40
    -----------------  lwp# 17 / thread# 16  --------------------
    ff29d600 _poll    (fe4124d8, 0, 1, f5, 3dd8a8, fe3be000) + 8
    fdd90cd0 __1cCosFsleep6FpnGThread_xi_i_ (6e58, 6c00, fdf04534, 1, 7, 4) + 25c
    fdf0ca4c JVM_Sleep (1628, fe406e44, 3dd8a8, fe412d84, 3c5f98, fe3be000) + 260
    f840e22c ???????? (c1, efb015fc, efb01570, ffffff80, efb, 0)
    f840e1d0 ???????? (0, b8, 0, 8, 8800, efb01588)
    f8405764 ???????? (2000, 2, 0, f8419770, efa8e110, efb01620)
    f8400218 ???????? (efb01708, efb01908, a, f422e650, f840ba20, efb01820)
    fdd9a808 __1cJJavaCallsLcall_helper6FpnJJavaValue_pnMmethodHandle_pnRJavaCallArguments_pnGThread__v_ (1, 3dd8a8, efb01818, efb01718, 4, efb01908) + 5a0
    fdec319c __1cJJavaCallsMcall_virtual6FpnJJavaValue_nGHandle_nLKlassHandle_nMsymbolHandle_5pnGThread__v_ (7a9c, 3dd8a8, 3568f8, 356904, 356900, f007a910) + 188
    fdee2700 __1cMthread_entry6FpnKJavaThread_pnGThread__v_ (f402fc58, 3dd8a8, 356ce4, fe424640, fe424710, fe424130) + 134
    fdede29c __1cKJavaThreadDrun6M_v_ (3dd8a8, 18, fe40c790, 6c00, 7dd4, 7c00) + 1d8
    fe264240 __1cG_start6Fpv_0_ (3dd8a8, 3b62, fe3be000, 0, 4f24, 4c00) + 208
    ff37b01c _thread_start (3dd8a8, 0, 0, 0, 0, 0) + 40
    -----------------  lwp# 18 / thread# 17  --------------------
    ff29f428 ___lwp_cond_wait (65b7a0, 65b788, ef681128, fe4123c4, ff2968f4, ef681120) + 8
    ff296a7c _lwp_cond_timedwait (2ea2b88, 44b36759, ef681248, 65b788, 65b7a0, ff2969e4) + 98
    fdeb4974 __1cNObjectMonitorEwait6MxipnGThread__v_ (120400, fe406ef0, fe4238d8, fe3be000, 65b550, 120420) + 7a8
    fdeb5978 __1cSObjectSynchronizerEwait6FnGHandle_xpnGThread__v_ (120402, 86d4, 0, 65b550, 8400, fe3be000) + e8
    fdeb5628 JVM_MonitorWait (0, 3dcdb4, 65b550, fe412d84, 0, 1) + 31c
    f840e22c ???????? (91, ef6814b4, ef681430, ffffff80, ef6, 0)
    f840e1d0 ???????? (f1631648, b6, 0, c, f00d7f28, ef681448)
    f8405764 ???????? (f007ea58, fe4163d4, 0, f8419354, 8800, ef681508)
    f8405764 ???????? (2000, 2, 0, f84195a0, ef60e110, ef6815a0)
    f8400218 ???????? (ef681688, ef681888, a, f456d6b8, f840ba20, ef6817a0)
    fdd9a808 __1cJJavaCallsLcall_helper6FpnJJavaValue_pnMmethodHandle_pnRJavaCallArguments_pnGThread__v_ (1, 65b550, ef681798, ef681698, 4, ef681888) + 5a0
    fdec319c __1cJJavaCallsMcall_virtual6FpnJJavaValue_nGHandle_nLKlassHandle_nMsymbolHandle_5pnGThread__v_ (7a9c, 65b550, 3dcda0, 3dcdac, 3dcda8, f007ea58) + 188
    fdee2700 __1cMthread_entry6FpnKJavaThread_pnGThread__v_ (f402fc58, 65b550, 3dd18c, fe424640, fe424710, fe424130) + 134
    fdede29c __1cKJavaThreadDrun6M_v_ (65b550, 18, fe40c790, 6c00, 7dd4, 7c00) + 1d8
    fe264240 __1cG_start6Fpv_0_ (65b550, 3b62, fe3be000, 0, 4f24, 4c00) + 208
    ff37b01c _thread_start (65b550, 0, 0, 0, 0, 0) + 40
    --------------------------  thread# 3  --------------------
    ff36d9b8 _reap_wait (ff390980, 1e924, 0, ff38c000, 0, 0) + 38
    ff36d710 _reaper  (ff38ce00, ff392708, ff390980, ff38cdd8, 1, fe400000) + 38
    ff37b01c _thread_start (0, 0, 0, 0, 0, 0) + 40

  • Debugging core file through disassemble code

    My program got cored and in the same frame I ran cmd given below and got the o/p
    dbx> dis
    0x0008a754: hellworld+0x0024: or %l1, %g0, %o2
    0x0008a758: hellworld+0x0028: st %g0, [%fp - 0x4]
    0x0008a75c: hellworld+0x002c: st %g0, [%fp - 0x8c]
    0x0008a760: hellworld+0x0030: stb %g0, [%fp - 0x8d]
    0x0008a764: hellworld+0x0034: stb %g0, [%fp - 0x8e]
    0x0008a768: hellworld+0x0038: stb %g0, [%fp - 0x8f]
    0x0008a76c: hellworld+0x003c: sth %g0, [%fp - 0x92]
    0x0008a770: hellworld+0x0040: add %fp, -0x80, %l0
    0x0008a774: hellworld+0x0044: st %l0, [%fp - 0x8c]
    How to find where the segmentation fault occur and why
    -Neo

    Neo12051 wrote:
    My program got cored and in the same frame I ran cmd given below and got the o/p
    How to find where the segmentation fault occur and why Dbx prints this information right after it loads all modules:
    $ dbx - core
    Reading ld.so.1
    Reading libm.so.2
    t@1 (l@1) program terminated by signal ABRT (Abort)
    0xfdda5067: _kill+0x0007:       jb       __cerror       [ 0xfdd20510, .-0x84b57 ]The last two lines describe reason (signal ABRT) and location (0xfdda5067) of the fault.
    High level reason for segmentation fault (SIGSEGV) is absence of mapped memory at certain location the process is trying to access. Most frequent reason is a variation of NULL pointer dereferece (address 0x0 and other close-to-zero addresses are always left unmapped for this very reason). When your program, for example, tries to write to a string ptr that it forgot to initialize properly, it ends up with something like this:
    0x00010e20: main+0x0010:        stb      %o1, [%o0](store byte from register %o1 into memory location addressed by register %o0) while value of %o0 points to unmapped memory:
    (dbx:main) print $o0
    $o0 = 20ULLAddress 20 is so close to zero that it suggest a bug like uninitialized array of characters, which 20th element is being assigned.
    The code you provided looks like initialization of a few small locals and can only fail if %fp (Frame Pointer) contains garbage. Therefore if location of SEGV is somewhere in that code (you didn't give this information, so I'm only guessing), I'd suggest looking for writing past array (string) bounds type of bug. If a function called from this one wrote past its local array bounds, it could've overwritten value of frame pointer saved on stack.
    It's hard to say more without knowing value of all relevant registers at location of failure (regs command will help with that).

  • Dbx uses 6GB (and counting) loading core file

    I'm trying to load a core file in dbx, but it just keeps using memory (I killed it after 6GB resident size). It sits at the prompt
    Reading conv
    where conv is the executable.
    The core file is 4.5M in size, the executable is 680kB. The program was compiled with gcc 3.4 as a 64-bit binary with debugging symbols - should dbx be able to load that? I've tried gdb from the sun.com Solaris Freeware page, however that seems unable to handle 64-bit programs.
    We're running on Solaris 10, using dbx 7.5 2005/10/13 from Sun Studio 11.

    Some questions:
    - what happens if you just debug the executable w/o a corefile?
    - Is the 680kB executable size a "text" size or "ls" size?
    - Is your gcc producing stabs or DWARF?

  • DBX and Core File

    HI,
    We just moved our product from Solaris 8 to Solaris 10. It did not have any problem running on Solaris 8. However it core dumped on Solaris 10 after running 2 weeks (bus error). What's confusing is that I can not even use dbx to look at the core file. DBX cored dumped on the core file. I have to use gdb.
    Does anyone else run into the problem? I am suspecting we have not set up some vary basic things right, or it's a known problem that dbx does not work on Solaris 10?
    Your help is very much appreciated,
    pam

    Hi Andrew,
    Again appreciate your help very much.
    Got the same result (core dumped) by7 looking at the core file on the same machine that the crash was generated.
    I found this one:
    http://blogs.sun.com/quenelle/entry/two_bad_solaris_bugs_that
    Bug 6283570 might be the cause. So we are all set here, if I am correct.
    Thanks again,
    pam

  • Selected file is not executable when loading core file

    Hello all
    im using sunstudio 12 on sun4u sparc using compiler version Sun C++ 5.9 SunOS_sparc Patch 124863-04 2008/04/16
    when i try to load core dump that is created from one of the executables with sunstudio 12 im getting this message
    "The Select file is not executable "
    and when i open the core file with command like dbx every thing is working fine

    here is all the output:
    Running "/opt/SUNWspro12/SUNWspro/bin/dmake  -f Makefile CONF=Debug" in /home/meiry/SunStudioProjects/Quote_1
    dmake: defaulting to parallel mode.
    See the man page dmake(1) for more information on setting up the .dmakerc file.
    sun8 --> 1 job
    /opt/SUNWspro12/SUNWspro/bin/dmake -f nbproject/Makefile-Debug.mk SUBPROJECTS= .build-conf
    sun8 --> 1 job
    mkdir -p build/Debug/Sun9-Solaris-Sparc
    CC    -c -g +w -o build/Debug/Sun9-Solaris-Sparc/disk.o disk.cc
    sun8 --> 2 jobs
    mkdir -p build/Debug/Sun9-Solaris-Sparc
    CC    -c -g +w -o build/Debug/Sun9-Solaris-Sparc/cpu.o cpu.cc
    sun8 --> Job output
    mkdir -p build/Debug/Sun9-Solaris-Sparc
    CC    -c -g +w -o build/Debug/Sun9-Solaris-Sparc/cpu.o cpu.cc
    (/home/meiry/SunStudioProjects/Quote_1)cpu.cc:
    "/opt/SUNWspro/prod/include/CC/Cstd/iostream.h", line 4: Error: istream is not a member of std.
    "/opt/SUNWspro/prod/include/CC/Cstd/iostream.h", line 5: Error: cin is not a member of std.
    "/opt/SUNWspro/prod/include/CC/Cstd/iostream.h", line 6: Error: ws is not a member of std.
    "/opt/SUNWspro/prod/include/CC/Cstd/./streambuf", line 64: Error: Type name expected instead of "locale".
    "/opt/SUNWspro/prod/include/CC/Cstd/./streambuf", line 185:     Where: While specializing "std::basic_streambuf<std::charT, std::traits>".
    "/opt/SUNWspro/prod/include/CC/Cstd/./streambuf", line 185:     Where: Specialized in non-template code.
    "/opt/SUNWspro/prod/include/CC/Cstd/./streambuf", line 65: Error: Type name expected instead of "locale".
    "/opt/SUNWspro/prod/include/CC/Cstd/./streambuf", line 185:     Where: While specializing "std::basic_streambuf<std::charT, std::traits>".
    "/opt/SUNWspro/prod/include/CC/Cstd/./streambuf", line 185:     Where: Specialized in non-template code.
    "/opt/SUNWspro/prod/include/CC/Cstd/./streambuf", line 68: Error: streamsize is not defined.
    "/opt/SUNWspro/prod/include/CC/Cstd/./streambuf", line 185:     Where: While specializing "std::basic_streambuf<std::charT, std::traits>".
    "/opt/SUNWspro/prod/include/CC/Cstd/./streambuf", line 185:     Where: Specialized in non-template code.
    "/opt/SUNWspro/prod/include/CC/Cstd/./streambuf", line 145: Error: Type name expected instead of "streamsize".
    "/opt/SUNWspro/prod/include/CC/Cstd/./streambuf", line 185:     Where: While specializing "std::basic_streambuf<std::charT, std::traits>".
    "/opt/SUNWspro/prod/include/CC/Cstd/./streambuf", line 185:     Where: Specialized in non-template code.
    "/opt/SUNWspro/prod/include/CC/Cstd/./streambuf", line 146: Error: Type name expected instead of "streamsize".
    "/opt/SUNWspro/prod/include/CC/Cstd/./streambuf", line 185:     Where: While specializing "std::basic_streambuf<std::charT, std::traits>".
    "/opt/SUNWspro/prod/include/CC/Cstd/./streambuf", line 185:     Where: Specialized in non-template code.
    "/opt/SUNWspro/prod/include/CC/Cstd/./streambuf", line 152: Error: Type name expected instead of "streamsize".
    "/opt/SUNWspro/prod/include/CC/Cstd/./streambuf", line 185:     Where: While specializing "std::basic_streambuf<std::charT, std::traits>".
    "/opt/SUNWspro/prod/include/CC/Cstd/./streambuf", line 185:     Where: Specialized in non-template code.
    "/opt/SUNWspro/prod/include/CC/Cstd/./streambuf", line 167: Error: Type name expected instead of "locale".
    "/opt/SUNWspro/prod/include/CC/Cstd/./streambuf", line 185:     Where: While specializing "std::basic_streambuf<std::charT, std::traits>".
    "/opt/SUNWspro/prod/include/CC/Cstd/./streambuf", line 185:     Where: Specialized in non-template code.
    "/opt/SUNWspro/prod/include/CC/Cstd/./streambuf", line 170: Error: Type name expected instead of "_RWSTDGuard".
    "/opt/SUNWspro/prod/include/CC/Cstd/./streambuf", line 185:     Where: While specializing "std::basic_streambuf<std::charT, std::traits>".
    "/opt/SUNWspro/prod/include/CC/Cstd/./streambuf", line 185:     Where: Specialized in non-template code.
    "/opt/SUNWspro/prod/include/CC/Cstd/./streambuf", line 236: Error: Templates can only declare classes or functions.
    "/opt/SUNWspro/prod/include/CC/Cstd/./streambuf", line 239: Error: Use ";" to terminate statements.
    "/opt/SUNWspro/prod/include/CC/Cstd/./streambuf", line 239: Error: A declaration was expected instead of "return".
    "/opt/SUNWspro/prod/include/CC/Cstd/./streambuf", line 239: Error: s is not defined.
    "/opt/SUNWspro/prod/include/CC/Cstd/./streambuf", line 248: Error: basic_streambuf is not defined.
    "/opt/SUNWspro/prod/include/CC/Cstd/./streambuf", line 248: Error: int_type is not defined.
    "/opt/SUNWspro/prod/include/CC/Cstd/./streambuf", line 249: Error: Templates can only declare classes or functions.
    "/opt/SUNWspro/prod/include/CC/Cstd/./streambuf", line 251: Error: Use ";" to terminate statements.
    "/opt/SUNWspro/prod/include/CC/Cstd/./streambuf", line 251: Error: A declaration was expected instead of "if".
    "/opt/SUNWspro/prod/include/CC/Cstd/./streambuf", line 251: Error: ")" expected instead of ">".
    "/opt/SUNWspro/prod/include/CC/Cstd/./streambuf", line 251: Error: Unexpected ")" -- Check for matching parenthesis.
    "/opt/SUNWspro/prod/include/CC/Cstd/./streambuf", line 251: Error: Operand expected instead of ")".
    "/opt/SUNWspro/prod/include/CC/Cstd/./streambuf", line 253: Error: The function "gbump" must have a prototype.
    "/opt/SUNWspro/prod/include/CC/Cstd/./streambuf", line 254: Error: traits is not defined.
    Compilation aborted, too many Error messages.
    :(/home/meiry/SunStudioProjects/Quote_1)cpu.cc
    *** Error code 1
    dmake: Fatal error: Command failed for target `build/Debug/Sun9-Solaris-Sparc/cpu.o'
    Current working directory /home/meiry/SunStudioProjects/Quote_1
    Waiting for 1 job to finish
    sun8 --> Job output
    mkdir -p build/Debug/Sun9-Solaris-Sparc
    CC    -c -g +w -o build/Debug/Sun9-Solaris-Sparc/disk.o disk.cc
    (/home/meiry/SunStudioProjects/Quote_1)disk.cc:
    "/opt/SUNWspro/prod/include/CC/Cstd/iostream.h", line 4: Error: istream is not a member of std.
    "/opt/SUNWspro/prod/include/CC/Cstd/iostream.h", line 5: Error: cin is not a member of std.
    "/opt/SUNWspro/prod/include/CC/Cstd/iostream.h", line 6: Error: ws is not a member of std.
    "/opt/SUNWspro/prod/include/CC/Cstd/./streambuf", line 64: Error: Type name expected instead of "locale".
    "/opt/SUNWspro/prod/include/CC/Cstd/./streambuf", line 185:     Where: While specializing "std::basic_streambuf<std::charT, std::traits>".
    "/opt/SUNWspro/prod/include/CC/Cstd/./streambuf", line 185:     Where: Specialized in non-template code.
    "/opt/SUNWspro/prod/include/CC/Cstd/./streambuf", line 65: Error: Type name expected instead of "locale".
    "/opt/SUNWspro/prod/include/CC/Cstd/./streambuf", line 185:     Where: While specializing "std::basic_streambuf<std::charT, std::traits>".
    "/opt/SUNWspro/prod/include/CC/Cstd/./streambuf", line 185:     Where: Specialized in non-template code.
    "/opt/SUNWspro/prod/include/CC/Cstd/./streambuf", line 68: Error: streamsize is not defined.
    "/opt/SUNWspro/prod/include/CC/Cstd/./streambuf", line 185:     Where: While specializing "std::basic_streambuf<std::charT, std::traits>".
    "/opt/SUNWspro/prod/include/CC/Cstd/./streambuf", line 185:     Where: Specialized in non-template code.
    "/opt/SUNWspro/prod/include/CC/Cstd/./streambuf", line 145: Error: Type name expected instead of "streamsize".
    "/opt/SUNWspro/prod/include/CC/Cstd/./streambuf", line 185:     Where: While specializing "std::basic_streambuf<std::charT, std::traits>".
    "/opt/SUNWspro/prod/include/CC/Cstd/./streambuf", line 185:     Where: Specialized in non-template code.
    "/opt/SUNWspro/prod/include/CC/Cstd/./streambuf", line 146: Error: Type name expected instead of "streamsize".
    "/opt/SUNWspro/prod/include/CC/Cstd/./streambuf", line 185:     Where: While specializing "std::basic_streambuf<std::charT, std::traits>".
    "/opt/SUNWspro/prod/include/CC/Cstd/./streambuf", line 185:     Where: Specialized in non-template code.
    "/opt/SUNWspro/prod/include/CC/Cstd/./streambuf", line 152: Error: Type name expected instead of "streamsize".
    "/opt/SUNWspro/prod/include/CC/Cstd/./streambuf", line 185:     Where: While specializing "std::basic_streambuf<std::charT, std::traits>".
    "/opt/SUNWspro/prod/include/CC/Cstd/./streambuf", line 185:     Where: Specialized in non-template code.
    "/opt/SUNWspro/prod/include/CC/Cstd/./streambuf", line 167: Error: Type name expected instead of "locale".
    "/opt/SUNWspro/prod/include/CC/Cstd/./streambuf", line 185:     Where: While specializing "std::basic_streambuf<std::charT, std::traits>".
    "/opt/SUNWspro/prod/include/CC/Cstd/./streambuf", line 185:     Where: Specialized in non-template code.
    "/opt/SUNWspro/prod/include/CC/Cstd/./streambuf", line 170: Error: Type name expected instead of "_RWSTDGuard".
    "/opt/SUNWspro/prod/include/CC/Cstd/./streambuf", line 185:     Where: While specializing "std::basic_streambuf<std::charT, std::traits>".
    "/opt/SUNWspro/prod/include/CC/Cstd/./streambuf", line 185:     Where: Specialized in non-template code.
    "/opt/SUNWspro/prod/include/CC/Cstd/./streambuf", line 236: Error: Templates can only declare classes or functions.
    "/opt/SUNWspro/prod/include/CC/Cstd/./streambuf", line 239: Error: Use ";" to terminate statements.
    "/opt/SUNWspro/prod/include/CC/Cstd/./streambuf", line 239: Error: A declaration was expected instead of "return".
    "/opt/SUNWspro/prod/include/CC/Cstd/./streambuf", line 239: Error: s is not defined.
    "/opt/SUNWspro/prod/include/CC/Cstd/./streambuf", line 248: Error: basic_streambuf is not defined.
    "/opt/SUNWspro/prod/include/CC/Cstd/./streambuf", line 248: Error: int_type is not defined.
    "/opt/SUNWspro/prod/include/CC/Cstd/./streambuf", line 249: Error: Templates can only declare classes or functions.
    "/opt/SUNWspro/prod/include/CC/Cstd/./streambuf", line 251: Error: Use ";" to terminate statements.
    "/opt/SUNWspro/prod/include/CC/Cstd/./streambuf", line 251: Error: A declaration was expected instead of "if".
    "/opt/SUNWspro/prod/include/CC/Cstd/./streambuf", line 251: Error: ")" expected instead of ">".
    "/opt/SUNWspro/prod/include/CC/Cstd/./streambuf", line 251: Error: Unexpected ")" -- Check for matching parenthesis.
    "/opt/SUNWspro/prod/include/CC/Cstd/./streambuf", line 251: Error: Operand expected instead of ")".
    "/opt/SUNWspro/prod/include/CC/Cstd/./streambuf", line 253: Error: The function "gbump" must have a prototype.
    "/opt/SUNWspro/prod/include/CC/Cstd/./streambuf", line 254: Error: traits is not defined.
    Compilation aborted, too many Error messages.
    :(/home/meiry/SunStudioProjects/Quote_1)disk.cc
    *** Error code 1
    dmake: Warning: Command failed for target `build/Debug/Sun9-Solaris-Sparc/disk.o'
    Current working directory /home/meiry/SunStudioProjects/Quote_1
    *** Error code 1
    dmake: Fatal error: Command failed for target `.build-impl'
    Build failed. Exit value 1.

  • Dbx - core file without symbolic info - from C++ app

    I have multiple core files, written by a C++ application (with C++ shared libs also) which has been 'strip'ed of all symbolic info. I have been able to determine that all cores happen in the same method, with the same stack trace showing for each. Using the mdb $m cmd I can track the location down to a particular shared library.
    Is there some way to now track it down further regarding where in the shared lib the event occured? Something like getting an offset map of the items in the shared lib, and using their offset into the library listing, match that against the offset of the address of the method which trapped as an offset from the process base address?
    I am at a loss as to how to proceed any further here. Can someone enlighten me as to the next steps I can take?
    Thx...

    compiler: Sun Workshop 6 - update 2
    OS: Solaris 5.8
    When I do pstack or dbx-->where cmd, I get:
    ----------------- lwp# 15315 / thread# 1 --------------------
    ffffffff7ec5653c ???????? (101d80ed0, 1, 6872b020c49ba5e3, 3fff9e353f7ced91, ffffffff7eca7db8, 0)
    ffffffff7ec55374 ???????? (10125fac0, 101d86d30, 101c8be60, 101da03f0, 101da03f0, ffffffff7edab9e0)
    ffffffff7ec47920 ???????? (101d86d30, ffffffff7fffe0e8, 101055900, 0, 1005cdca0, 1001dfd88)
    ffffffff7ec5ed94 ???????? (101b6f620, ffffffff7fffe0e8, ffffffff7fffe530, 1003cab90, 101052040, 0)
    ffffffff7e15a7c8 ???????? (1005cb2b0, 466, 1001e2710, ffffffff7fffe530, 1003cab90, 0)
    ffffffff7ec5d49c ???????? (ffffffff7fffe530, 1005cb308, 1001dfd88, 1003cab90, 1003cab90, 1005cb2b0)
    ffffffff7ec65ee4 ???????? (466, 1001e2710, ffffffff7fffe530, 1003cab90, 466, 1001e2740)
    0000000100029dd0 ???????? (1001e2745, 466, ffffffff7fffee20, 0, 0, 0)
    000000010002989c ???????? (0, 0, 0, 0, 0, 0)
    No symbolic information. But trap happened at 7ec5653c .
    Now if I do a dump -t on the process binary to dump the symbol table, I get a listing like:
    ffffffff7c200000 ffffffff7c2a8000 a8000 /usr/lib/sparcv9/libnsl.so.1
    ffffffff7c3a8000 ffffffff7c3b8000 10000 /usr/lib/sparcv9/libnsl.so.1
    ffffffff7c3b8000 ffffffff7c3c0000 8000 /usr/lib/sparcv9/libnsl.so.1
    ffffffff7c400000 ffffffff7cf1e000 b1e000 /ap/p/cc/oracle/product/9.2.0/lib/libclntsh.so.9.0
    ffffffff7d01c000 ffffffff7d0d0000 b4000
    ffffffff7d0d0000 ffffffff7d0e2000 12000
    ffffffff7d100000 ffffffff7d102000 2000
    ffffffff7d200000 ffffffff7d296000 96000 /ap/p/cc/tss/curr/lib/libwhatever1.so
    ffffffff7d394000 ffffffff7d39c000 8000
    ffffffff7d400000 ffffffff7d56c000 16c000 /ap/p/cc/tss/curr/lib/libwhatever2.so
    ffffffff7d66a000 ffffffff7da72000 408000
    ffffffff7db00000 ffffffff7db02000 2000 /usr/lib/sparcv9/libdl.so.1
    ffffffff7dc00000 ffffffff7dc02000 2000
    ffffffff7dd00000 ffffffff7dd02000 2000
    ffffffff7de00000 ffffffff7de8c000 8c000 /ap/p/cc/tss/applib/libapputility64.so
    ffffffff7df8a000 ffffffff7df92000 8000
    ffffffff7e000000 ffffffff7e18a000 18a000 /ap/p/cc/tss/applib/libwhatever364.so
    ffffffff7e288000 ffffffff7e296000 e000
    ffffffff7e296000 ffffffff7e47e000 1e8000
    ffffffff7e500000 ffffffff7e538000 38000 /ap/p/cc/tss/applib/libwhatever4.so
    ffffffff7e636000 ffffffff7e63a000 4000
    ffffffff7e700000 ffffffff7e71e000 1e000 /ap/p/cc/tss/applib/libdatabase64.so
    ffffffff7e81c000 ffffffff7e820000 4000
    ffffffff7e900000 ffffffff7e904000 4000 /ap/p/cc/tss/pcontrol/../bin/libtscalltcp014.so
    ffffffff7ea02000 ffffffff7ea04000 2000
    ffffffff7ea04000 ffffffff7ebec000 1e8000
    ffffffff7ec00000 ffffffff7ecac000 ac000 /ap/p/cc/tss/curr/lib/libthis_is_it.so
    --> note: happened in libthis_is_it.so at 7ec5653c
    ffffffff7edaa000 ffffffff7f028000 27e000
    ffffffff7f100000 ffffffff7f144000 44000 /ap/p/cc/tss/pcontrol/../bin/libwhatever5.so
    ffffffff7f242000 ffffffff7f24e000 c000
    ffffffff7f24e000 ffffffff7f258000 a000
    ffffffff7f300000 ffffffff7f302000 2000
    f
    I see a shared lib occupying from 7ec00000 to 7ecac000, and my trap address falls within that range. So I believe I can narrow the event to that particular shared lib based on that. Correct?
    Now I do a dump -t on that particular shared lib, and I wind up with another listing. Grep that listing for string values between 0x55 and 0x56, I find the unit within which the trap address falls, and I have my source location. Like so:
    grep -i 0x55 dump_new_symtbl.txt
    ================================
    [1621] 0x55020 24 1 0 0 0x9 ___const_seg_900000504
    [1632] 0x55ac0 24 1 0 0 0x9 ___const_seg_900000904
    [1634] 0x55f00 24 1 0 0 0x9 ___const_seg_900001102
    [2807] 0x55050 2668 2 1 0 0x9 __1cMangledName_1_here
    [2877] 0x55af0 1036 2 1 0 0x9 __1cMangledName_2_here
    [3017] 0x55f18 3060 2 1 0 0x9 __1cMangledName_3_here
    grep -i 0x56 dump_new_symtbl.txt
    ================================
    [1643] 0x56b10 24 1 0 0 0x9 ___const_seg_900001901
    [2584] 0x56b40 3656 2 1 0 0x9 __1cMangledName_4_here
    I don't really need C++filt in this case, I can discern what the mangled name refers to in the source code.
    So I think I have my problem area pin-pointed, I just want to make sure, and have someone knowledgable in this type of analysis to tell me that I an correct.
    Thanks for the response.
    -mc

  • Why dbx core dumps on input core file?

    Hi,
    We have a Solaris 10 machine, on which dbx always core dumps when input any core files to it. What would possibly wrong with this machine? Or where should we look to find some clues?
    Thanks a lot,
    pam

    Please create a perl script using the text below:
    #!/usr/bin/perl
    use File::Find;
    sub wanted {
      return unless -x && -f;
      return unless /.*\.so\.[0-9]$/;
      return unless `/bin/file $_ | grep 64-bit`;
      $out = `elfdump -e $_ | grep e_shoff`;
      $out =~ m/e_shoff:\s+(0x[0-9a-f]+)\s/;
      if ($1 =~ m/[4c]$/) {
         print "bad alignment in file: $File::Find::name\n";
    print "Looking for bad ELF section header table alignment in 64-bit files\n";
    find(\&wanted, ( "/lib", "/usr/lib" ));Then, make it executable and run it (does not need root permissions):
    any_user$  chmod +x check_library_alignment.pl
    any_user$  ./check_library_alignment.pl
    If the perl script reports mis-aligned libraries (elfsign modifies the alignment), this looks to be bug 6283299. If you are current on patches for Solaris as well as your SunStudio installation, you'll need to raise an SR requesting the fix. If you are not current on patches, you could start with SunStudio patches which was subsequently patched to address elfsign alignments.
    Source: http://technopark02.blogspot.com/2006/01/64-bit-dbx-internal-error-signal.html

  • CMS crash with core files and multiple report output generation

    Happy new year to everyone,
    Our BOXIR3.1SP6FP2 env has recently started behaving weirdly by triggering multiple output to users inbox and email notification out of scheduled reports. Also we have noticed the CMS crash with core file (almost 4GB) generation at the time of multiple report output.
    Most of the times, CMC crashes and recycles itself. At few times, CMS services alone went shut down.
    OS details: RHEL 5.5, 32 GB RAM, 8 core processor on each of the clustered node, Oracle 10GR2.4 CMS DB server, 11GR2.4 oracle reporting DB server and oracle 11.1.0.6 client.
    2015/01/21 23:54:37.946|>=| | |28123|1534131088|{|||||||||||||||DBQueue::Read
    2015/01/21 23:54:37.946|==| | |28123|1496185744|
    |||||||||||||||(OracleStatement.cpp:156) Prepare: SQL: SELECT ObjectID,
    Version, LastModifyTime, CRC, Properties FROM CMS_InfoObjects6 WHERE ObjectID
    IN (1004050) ORDER BY ObjectID
    2015/01/21 23:54:37.946|==| | |28123|1496185744| ||||||||||||||(OracleStatement.cpp:183) Prepared statement Execute
    2015/01/21 23:54:37.965|==| | |28123|1496451984| |||||||||||||||SResourceSource::LoadString 50293
    2015/01/21 23:54:37.966|==| | |28123|1496451984| |||||||||||||||SResourceSource::LoadString Unknown exception in database thread
    2015/01/21 23:54:37.967|==| | |28123|1496451984| |||||||||||||||SResourceSource::LoadString 33007
    2015/01/21 23:54:37.967|==| | |28123|1496451984| |||||||||||||||SResourceSource::LoadString CMS is unstable and will shut down immediately. Reason: %1...
    2015/01/21 23:54:38.506|==| | |28123|1496185744| |||||||||||||||(OracleStatement.cpp:156) Prepare: SQL: SELECT ObjectID,
    Version, LastModifyTime, CRC, Properties FROM CMS_InfoObjects6 WHERE ObjectID IN (1009213) ORDER BY ObjectID
    2015/01/21 23:54:38.506|==| | |28123|1496185744| |||||||||||||||(OracleStatement.cpp:183) Prepared statement Execute
    2015/01/21 23:54:38.512|==| | |28123|1455592672| |||||||||||||||(sidaemon.cpp:549) SUNIXDaemon::run: server restart flag is 1..
    2015/01/21 23:54:38.513|==| | |28123|1455592672| |||||||||||||||(sidaemon.cpp:552) SUNIXDaemon::run: in abort ...
    2015/01/21 23:54:38.513|==| | |28123|1455592672| |||||||||||||||(sidaemon.cpp:555) SUNIXDaemon::run: doing the WithAbort case ...
    2015/01/21 23:54:38.520|==| | |28123|1496185744| |||||||||||||||(dbq.cpp:1357) DBQ: Time required to read 1 objects: 20.000000 ms
    Thank you,
    Karthik

    Hi Denis,
    I'm trying my best for the last few weeks to understand the core issue along with SAP however it is still a mystery.
    >Ulimit -a
    core file size          (blocks, -c) 0
    data seg size           (kbytes, -d) unlimited
    scheduling priority             (-e) 0
    file size               (blocks, -f) unlimited
    pending signals                 (-i) 270335
    max locked memory       (kbytes, -l) 32
    max memory size         (kbytes, -m) unlimited
    open files                      (-n) 1024
    pipe size            (512 bytes, -p) 8
    POSIX message queues     (bytes, -q) 819200
    real-time priority              (-r) 0
    stack size              (kbytes, -s) 10240
    cpu time               (seconds, -t) unlimited
    max user processes              (-u) 270335
    virtual memory          (kbytes, -v) unlimited
    file locks                      (-x) unlimited
    Below is the observation as part of troubleshooting:
    1. CMS breaks at threshold of 3.9 G.
    2. CMS DB sits in a different Linux server than BOE server.
    3. All core files were generated by boe_cmsd process and are almost 4GB in size (same as max threshold which it breaks).
    4. Shell script which I've added in the BOE servers shows that the CMS DB is available/connecting at the time of CMS crash.
    5. SAP analysed the Core files and skeptical about the below lines.
         #3  0x58687b80 in skgesigCrash ()
          from /opt/oracle/product/11.1.0/client_1/lib32/libclntsh.so
         #4  0x58687e0d in skgesig_sigactionHandler ()
    I'll continue troubleshooting with a hope to fix it at the earliest.
    Thanks,
    Karthik

  • Core file creation in weblogic 10.3 with 1.6.0_24 ( Urgent )

    Hi ALL ,
    Recently we have migrated the java version from 1.6.0_16 to 1.6.0_24 in production environment . We are using weblogic 10.3 .
    Once from the migration the managed servers is going to unknown state at sometime which is configured as cluster configuration .
    We have two managed servers with cluster configration .
    When the servers is going to unknown state the core file is geting created .
    This is urgent can any body help on this ( prior thanks ) - why we are getting this and what is the sloution ?
    Attached the core file conntent from one managed servers
    Managed 1 server log name : hs_err_pid17198.log
    A fatal error has been detected by the Java Runtime Environment:
    SIGSEGV (0xb) at pc=0xa7bd8404, pid=17198, tid=2453
    JRE version: 6.0_24-b07
    Java VM: Java HotSpot(TM) Server VM (19.1-b02 mixed mode solaris-sparc )
    Problematic frame:
    C [pkcs11_softtoken.so.1+0x38404]
    If you would like to submit a bug report, please visit:
    http://java.sun.com/webapps/bugreport/crash.jsp
    The crash happened outside the Java Virtual Machine in native code.
    See problematic frame for where to report the bug.
    --------------- T H R E A D ---------------
    Current thread (0x024e6800): JavaThread "Thread-1144" daemon [_thread_in_native, id=2453, stack(0xa0800000,0xa0880000)]
    siginfo:si_signo=SIGSEGV: si_errno=0, si_code=1 (SEGV_MAPERR), si_addr=0x00000100
    Registers:
    O0=0xff000000 O1=0x00ffffff O2=0xff000000 O3=0x03364348
    O4=0xfc0059d0 O5=0x00fffc00 O6=0xa087cbc0 O7=0xff2bee44
    G1=0x00000004 G2=0x00000d00 G3=0x00000001 G4=0x00001ffc
    G5=0xfee3cf6c G6=0x00000000 G7=0xa6f40a00 Y=0x00000000
    PC=0xa7bd8404 nPC=0xa7bd8408
    Register to memory mapping:
    O0=0xff000000
    0xff000000: __libm__rem_pio2m+0xfe0 in /lib/libm.so.2 at 0xfef80000
    O1=0x00ffffff
    0x00ffffff is pointing to unknown location
    O2=0xff000000
    0xff000000: __libm__rem_pio2m+0xfe0 in /lib/libm.so.2 at 0xfef80000
    O3=0x03364348
    0x03364348 is pointing to unknown location
    O4=0xfc0059d0
    return entry points [0xfc0050c0, 0xfc0067e0] 5920 bytes
    O5=0x00fffc00
    0x00fffc00 is pointing to unknown location
    O6=0xa087cbc0
    0xa087cbc0 is pointing into the stack for thread: 0x024e6800
    "Thread-1144" daemon prio=3 tid=0x024e6800 nid=0x995 runnable [0xa087e000]
    java.lang.Thread.State: RUNNABLE
    O7=0xff2bee44
    0xff2bee44: thrschedctl+0xbf0 in /lib/libc.so.1 at 0xff200000
    G1=0x00000004
    0x00000004 is pointing to unknown location
    G2=0x00000d00
    0x00000d00 is pointing to unknown location
    G3=0x00000001
    0x00000001 is pointing to unknown location
    G4=0x00001ffc
    0x00001ffc is pointing to unknown location
    G5=0xfee3cf6c
    0xfee3cf6c: __1cHnmethodG__vtbl_+0xcc4 in /lapps/wls103/usr/local/oracle/wls103/jdk1.6.0_24/jre/lib/sparc/server/libjvm.so at 0xfe400000
    G6=0x00000000
    0x00000000 is pointing to unknown location
    G7=0xa6f40a00
    0xa6f40a00 is pointing to unknown location
    Top of Stack: (sp=0xa087cbc0)
    0xa087cbc0: 00000000 ed6a8fac ed6a8fb8 a087f0dc
    0xa087cbd0: ff3454c4 00000000 01000000 00001cc4
    0xa087cbe0: 00000000 00000012 a087dd50 00000012
    0xa087cbf0: a087cd4c a087dd50 a087cc20 a7bbf0b4
    0xa087cc00: a087fa70 024e540c 024e5414 024e5404
    0xa087cc10: 005572b9 a9fac000 00000000 fe53ec98
    0xa087cc20: 00000000 ecf00002 fffff841 00000111
    0xa087cc30: 00000001 fffff8c9 01000000 fffffff0
    Instructions: (pc=0xa7bd8404)
    0xa7bd83f4: 82 0f 20 07 80 90 60 00 02 80 00 20 b4 10 00 1d
    0xa7bd8404: e6 0e 21 00 80 a6 60 00 e4 0e 21 01 08 80 00 17
    Stack: [0xa0800000,0xa0880000], sp=0xa087cbc0, free space=498k
    Native frames: (J=compiled Java code, j=interpreted, Vv=VM code, C=native code)
    C [pkcs11_softtoken.so.1+0x38404]
    C [pkcs11_softtoken.so.1+0x1f0bc]
    C [pkcs11_softtoken.so.1+0x16360] C_EncryptUpdate+0x114
    C [libj2pkcs11.so+0x5ac4] Java_sun_security_pkcs11_wrapper_PKCS11_C_1EncryptUpdate+0x194
    j sun.security.pkcs11.wrapper.PKCS11.C_EncryptUpdate(JJ[BIIJ[BII)I+90984
    j sun.security.pkcs11.wrapper.PKCS11.C_EncryptUpdate(JJ[BIIJ[BII)I+0
    j sun.security.pkcs11.P11Cipher.implUpdate([BII[BII)I+57
    j sun.security.pkcs11.P11Cipher.engineUpdate([BII[BI)I+18
    j javax.crypto.Cipher.update([BII[BI)I+60
    j com.sun.net.ssl.internal.ssl.CipherBox.encrypt([BII)I+107
    j com.sun.net.ssl.internal.ssl.OutputRecord.encrypt(Lcom/sun/net/ssl/internal/ssl/CipherBox;)V+16
    j com.sun.net.ssl.internal.ssl.SSLSocketImpl.writeRecordInternal(Lcom/sun/net/ssl/internal/ssl/OutputRecord;)V+13
    j com.sun.net.ssl.internal.ssl.SSLSocketImpl.writeRecord(Lcom/sun/net/ssl/internal/ssl/OutputRecord;)V+294
    j com.sun.net.ssl.internal.ssl.SSLSocketImpl.sendAlert(BB)V+222
    j com.sun.net.ssl.internal.ssl.SSLSocketImpl.fatal(BLjava/lang/String;Ljava/lang/Throwable;)V+82
    j com.sun.net.ssl.internal.ssl.SSLSocketImpl.fatal(BLjava/lang/Throwable;)V+4
    j com.sun.net.ssl.internal.ssl.SSLSocketImpl.handleException(Ljava/lang/Exception;Z)V+112
    j com.sun.net.ssl.internal.ssl.SSLSocketImpl.handleException(Ljava/lang/Exception;)V+3
    j com.sun.net.ssl.internal.ssl.AppInputStream.read([BII)I+82
    j java.io.BufferedInputStream.fill()V+175
    j java.io.BufferedInputStream.read1([BII)I+44
    j java.io.BufferedInputStream.read([BII)I+49
    j com.sun.jndi.ldap.Connection.run()V+30
    j java.lang.Thread.run()V+11
    v ~StubRoutines::call_stub
    V [libjvm.so+0x16b1a4]
    V [libjvm.so+0x52e888]
    V [libjvm.so+0x1ff2cc]
    V [libjvm.so+0x212228]
    V [libjvm.so+0x858bf8]
    V [libjvm.so+0x77d894]
    Java frames: (J=compiled Java code, j=interpreted, Vv=VM code)
    j sun.security.pkcs11.wrapper.PKCS11.C_EncryptUpdate(JJ[BIIJ[BII)I+0
    j sun.security.pkcs11.P11Cipher.implUpdate([BII[BII)I+57
    j sun.security.pkcs11.P11Cipher.engineUpdate([BII[BI)I+18
    j javax.crypto.Cipher.update([BII[BI)I+60
    j com.sun.net.ssl.internal.ssl.CipherBox.encrypt([BII)I+107
    j com.sun.net.ssl.internal.ssl.OutputRecord.encrypt(Lcom/sun/net/ssl/internal/ssl/CipherBox;)V+16
    j com.sun.net.ssl.internal.ssl.SSLSocketImpl.writeRecordInternal(Lcom/sun/net/ssl/internal/ssl/OutputRecord;)V+13
    j com.sun.net.ssl.internal.ssl.SSLSocketImpl.writeRecord(Lcom/sun/net/ssl/internal/ssl/OutputRecord;)V+294
    j com.sun.net.ssl.internal.ssl.SSLSocketImpl.sendAlert(BB)V+222
    j com.sun.net.ssl.internal.ssl.SSLSocketImpl.fatal(BLjava/lang/String;Ljava/lang/Throwable;)V+82
    j com.sun.net.ssl.internal.ssl.SSLSocketImpl.fatal(BLjava/lang/Throwable;)V+4
    j com.sun.net.ssl.internal.ssl.SSLSocketImpl.handleException(Ljava/lang/Exception;Z)V+112
    j com.sun.net.ssl.internal.ssl.SSLSocketImpl.handleException(Ljava/lang/Exception;)V+3
    j com.sun.net.ssl.internal.ssl.AppInputStream.read([BII)I+82
    j java.io.BufferedInputStream.fill()V+175
    j java.io.BufferedInputStream.read1([BII)I+44
    j java.io.BufferedInputStream.read([BII)I+49
    j com.sun.jndi.ldap.Connection.run()V+30
    j java.lang.Thread.run()V+11
    v ~StubRoutines::call_stub
    --------------- P R O C E S S ---------------
    Java Threads: ( => current thread )
    =>0x024e6800 JavaThread "Thread-1144" daemon [_thread_in_native, id=2453, stack(0xa0800000,0xa0880000)]
    0x035be000 JavaThread "[STANDBY] ExecuteThread: '40' for queue: 'weblogic.kernel.Default (self-tuning)'" daemon [_thread_blocked, id=319, stack(0xa0a00000,0xa0a80000)]
    0x035bd800 JavaThread "[STANDBY] ExecuteThread: '39' for queue: 'weblogic.kernel.Default (self-tuning)'" daemon [_thread_blocked, id=318, stack(0xa0b00000,0xa0b80000)]
    0x0379d800 JavaThread "[STANDBY] ExecuteThread: '38' for queue: 'weblogic.kernel.Default (self-tuning)'" daemon [_thread_blocked, id=317, stack(0xa0c00000,0xa0c80000)]
    0x0379d400 JavaThread "[STANDBY] ExecuteThread: '37' for queue: 'weblogic.kernel.Default (self-tuning)'" daemon [_thread_blocked, id=316, stack(0xa0e80000,0xa0f00000)]
    0x014d9800 JavaThread "[STANDBY] ExecuteThread: '36' for queue: 'weblogic.kernel.Default (self-tuning)'" daemon [_thread_blocked, id=313, stack(0xa0f80000,0xa1000000)]
    0x012ff400 JavaThread "[STANDBY] ExecuteThread: '35' for queue: 'weblogic.kernel.Default (self-tuning)'" daemon [_thread_blocked, id=312, stack(0xa1080000,0xa1100000)]
    0x01301c00 JavaThread "[STANDBY] ExecuteThread: '34' for queue: 'weblogic.kernel.Default (self-tuning)'" daemon [_thread_blocked, id=311, stack(0xa1180000,0xa1200000)]
    0x0364a000 JavaThread "[STANDBY] ExecuteThread: '33' for queue: 'weblogic.kernel.Default (self-tuning)'" daemon [_thread_blocked, id=310, stack(0xa1280000,0xa1300000)]
    0x017cdc00 JavaThread "[ACTIVE] ExecuteThread: '32' for queue: 'weblogic.kernel.Default (self-tuning)'" daemon [_thread_blocked, id=309, stack(0xa1380000,0xa1400000)]
    0x017cd400 JavaThread "[STANDBY] ExecuteThread: '31' for queue: 'weblogic.kernel.Default (self-tuning)'" daemon [_thread_blocked, id=308, stack(0xa1480000,0xa1500000)]
    0x03d38800 JavaThread "[STANDBY] ExecuteThread: '30' for queue: 'weblogic.kernel.Default (self-tuning)'" daemon [_thread_blocked, id=307, stack(0xa1580000,0xa1600000)]
    0x03d38000 JavaThread "[ACTIVE] ExecuteThread: '29' for queue: 'weblogic.kernel.Default (self-tuning)'" daemon [_thread_blocked, id=306, stack(0xa1680000,0xa1700000)]
    0x01d2d800 JavaThread "[STANDBY] ExecuteThread: '28' for queue: 'weblogic.kernel.Default (self-tuning)'" daemon [_thread_blocked, id=305, stack(0xa1780000,0xa1800000)]
    0x01d2d400 JavaThread "[STANDBY] ExecuteThread: '27' for queue: 'weblogic.kernel.Default (self-tuning)'" daemon [_thread_blocked, id=304, stack(0xa1880000,0xa1900000)]
    0x01303800 JavaThread "[STANDBY] ExecuteThread: '26' for queue: 'weblogic.kernel.Default (self-tuning)'" daemon [_thread_blocked, id=281, stack(0xa1980000,0xa1a00000)]
    0x01936c00 JavaThread "[STANDBY] ExecuteThread: '25' for queue: 'weblogic.kernel.Default (self-tuning)'" daemon [_thread_blocked, id=279, stack(0xa1a80000,0xa1b00000)]
    0x0177b400 JavaThread "[STANDBY] ExecuteThread: '24' for queue: 'weblogic.kernel.Default (self-tuning)'" daemon [_thread_blocked, id=242, stack(0xa1c80000,0xa1d00000)]
    0x0177a400 JavaThread "[ACTIVE] ExecuteThread: '23' for queue: 'weblogic.kernel.Default (self-tuning)'" daemon [_thread_blocked, id=241, stack(0xa1d80000,0xa1e00000)]
    0x03a8f800 JavaThread "[STANDBY] ExecuteThread: '22' for queue: 'weblogic.kernel.Default (self-tuning)'" daemon [_thread_blocked, id=240, stack(0xa1b80000,0xa1c00000)]
    0x02538800 JavaThread "[ACTIVE] ExecuteThread: '21' for queue: 'weblogic.kernel.Default (self-tuning)'" daemon [_thread_blocked, id=224, stack(0xa1e80000,0xa1f00000)]
    0x03672000 JavaThread "[ACTIVE] ExecuteThread: '20' for queue: 'weblogic.kernel.Default (self-tuning)'" daemon [_thread_blocked, id=223, stack(0xa1f80000,0xa2000000)]
    0x033f3000 JavaThread "[ACTIVE] ExecuteThread: '19' for queue: 'weblogic.kernel.Default (self-tuning)'" daemon [_thread_blocked, id=222, stack(0xa2080000,0xa2100000)]
    0x02534800 JavaThread "[STANDBY] ExecuteThread: '18' for queue: 'weblogic.kernel.Default (self-tuning)'" daemon [_thread_blocked, id=221, stack(0xa2180000,0xa2200000)]
    0x03670000 JavaThread "[STANDBY] ExecuteThread: '17' for queue: 'weblogic.kernel.Default (self-tuning)'" daemon [_thread_blocked, id=220, stack(0xa2280000,0xa2300000)]
    0x016cc400 JavaThread "[STANDBY] ExecuteThread: '16' for queue: 'weblogic.kernel.Default (self-tuning)'" daemon [_thread_blocked, id=219, stack(0xa2380000,0xa2400000)]
    0x036df000 JavaThread "[STANDBY] ExecuteThread: '15' for queue: 'weblogic.kernel.Default (self-tuning)'" daemon [_thread_blocked, id=218, stack(0xa2480000,0xa2500000)]
    0x02560c00 JavaThread "[ACTIVE] ExecuteThread: '14' for queue: 'weblogic.kernel.Default (self-tuning)'" daemon [_thread_blocked, id=217, stack(0xa2580000,0xa2600000)]
    0x005aa000 JavaThread "[STANDBY] ExecuteThread: '13' for queue: 'weblogic.kernel.Default (self-tuning)'" daemon [_thread_blocked, id=216, stack(0xa2680000,0xa2700000)]
    0x005aec00 JavaThread "[STANDBY] ExecuteThread: '12' for queue: 'weblogic.kernel.Default (self-tuning)'" daemon [_thread_blocked, id=215, stack(0xa2780000,0xa2800000)]
    0x01e8f000 JavaThread "[ACTIVE] ExecuteThread: '11' for queue: 'weblogic.kernel.Default (self-tuning)'" daemon [_thread_blocked, id=214, stack(0xa2880000,0xa2900000)]
    0x02509400 JavaThread "[ACTIVE] ExecuteThread: '10' for queue: 'weblogic.kernel.Default (self-tuning)'" daemon [_thread_blocked, id=213, stack(0xa2980000,0xa2a00000)]
    0x025f2000 JavaThread "[STANDBY] ExecuteThread: '9' for queue: 'weblogic.kernel.Default (self-tuning)'" daemon [_thread_blocked, id=212, stack(0xa2a80000,0xa2b00000)]
    0x02562400 JavaThread "[ACTIVE] ExecuteThread: '8' for queue: 'weblogic.kernel.Default (self-tuning)'" daemon [_thread_blocked, id=211, stack(0xa2b80000,0xa2c00000)]
    0x02560400 JavaThread "[ACTIVE] ExecuteThread: '7' for queue: 'weblogic.kernel.Default (self-tuning)'" daemon [_thread_blocked, id=210, stack(0xa2d80000,0xa2e00000)]
    0x03d71c00 JavaThread "[STANDBY] ExecuteThread: '6' for queue: 'weblogic.kernel.Default (self-tuning)'" daemon [_thread_blocked, id=103, stack(0xa2e80000,0xa2f00000)]
    0x03422400 JavaThread "Timer-3" daemon [_thread_blocked, id=95, stack(0xa2f80000,0xa3000000)]
    0x0196c400 JavaThread "[STANDBY] ExecuteThread: '5' for queue: 'weblogic.kernel.Default (self-tuning)'" daemon [_thread_blocked, id=94, stack(0xa3080000,0xa3100000)]
    0x0196bc00 JavaThread "[STANDBY] ExecuteThread: '4' for queue: 'weblogic.kernel.Default (self-tuning)'" daemon [_thread_blocked, id=93, stack(0xa3180000,0xa3200000)]
    0x02450c00 JavaThread "[STANDBY] ExecuteThread: '3' for queue: 'weblogic.kernel.Default (self-tuning)'" daemon [_thread_blocked, id=92, stack(0xa3280000,0xa3300000)]
    0x0180ec00 JavaThread "DynamicListenThread[Default]" daemon [_thread_in_native, id=91, stack(0xa3380000,0xa3400000)]
    0x0180e400 JavaThread "[STANDBY] ExecuteThread: '2' for queue: 'weblogic.kernel.Default (self-tuning)'" daemon [_thread_blocked, id=90, stack(0xa3480000,0xa3500000)]
    0x0252cc00 JavaThread "weblogic.GCMonitor" daemon [_thread_blocked, id=89, stack(0xa3580000,0xa3600000)]
    0x0180bc00 JavaThread "weblogic.cluster.MessageReceiver" daemon [_thread_in_native, id=88, stack(0xa3680000,0xa3700000)]
    0x02e00800 JavaThread "Timer-2" daemon [_thread_blocked, id=87, stack(0xa3780000,0xa3800000)]
    0x03697800 JavaThread "Thread-12" daemon [_thread_blocked, id=86, stack(0xa3880000,0xa3900000)]
    0x01f1c400 JavaThread "Thread-11" daemon [_thread_blocked, id=85, stack(0xa3a80000,0xa3b00000)]
    0x0155d800 JavaThread "DoSManager" daemon [_thread_blocked, id=84, stack(0xa3980000,0xa3a00000)]
    0x01d05800 JavaThread "VDE Transaction Processor Thread" daemon [_thread_blocked, id=82, stack(0xa3b80000,0xa3c00000)]
    0x01d48400 JavaThread "ExecuteThread: '32' for queue: 'weblogic.socket.Muxer'" daemon [_thread_blocked, id=81, stack(0xa3c80000,0xa3d00000)]
    0x01d46c00 JavaThread "ExecuteThread: '31' for queue: 'weblogic.socket.Muxer'" daemon [_thread_blocked, id=80, stack(0xa3d80000,0xa3e00000)]
    0x01d45400 JavaThread "ExecuteThread: '30' for queue: 'weblogic.socket.Muxer'" daemon [_thread_blocked, id=79, stack(0xa3e80000,0xa3f00000)]
    0x01d40800 JavaThread "ExecuteThread: '29' for queue: 'weblogic.socket.Muxer'" daemon [_thread_blocked, id=78, stack(0xa3f80000,0xa4000000)]
    0x01d3f000 JavaThread "ExecuteThread: '28' for queue: 'weblogic.socket.Muxer'" daemon [_thread_blocked, id=77, stack(0xa4080000,0xa4100000)]
    0x01d8b400 JavaThread "ExecuteThread: '27' for queue: 'weblogic.socket.Muxer'" daemon [_thread_blocked, id=76, stack(0xa4180000,0xa4200000)]
    0x01d89c00 JavaThread "ExecuteThread: '26' for queue: 'weblogic.socket.Muxer'" daemon [_thread_blocked, id=75, stack(0xa4280000,0xa4300000)]
    0x01d85000 JavaThread "ExecuteThread: '25' for queue: 'weblogic.socket.Muxer'" daemon [_thread_blocked, id=74, stack(0xa4380000,0xa4400000)]
    0x01d83800 JavaThread "ExecuteThread: '24' for queue: 'weblogic.socket.Muxer'" daemon [_thread_blocked, id=73, stack(0xa4480000,0xa4500000)]
    0x01d82000 JavaThread "ExecuteThread: '23' for queue: 'weblogic.socket.Muxer'" daemon [_thread_blocked, id=72, stack(0xa4580000,0xa4600000)]
    0x01d80800 JavaThread "ExecuteThread: '22' for queue: 'weblogic.socket.Muxer'" daemon [_thread_blocked, id=71, stack(0xa4680000,0xa4700000)]
    0x01d7bc00 JavaThread "ExecuteThread: '21' for queue: 'weblogic.socket.Muxer'" daemon [_thread_blocked, id=70, stack(0xa4780000,0xa4800000)]
    0x0167a400 JavaThread "ExecuteThread: '20' for queue: 'weblogic.socket.Muxer'" daemon [_thread_blocked, id=69, stack(0xa4880000,0xa4900000)]
    0x01678c00 JavaThread "ExecuteThread: '19' for queue: 'weblogic.socket.Muxer'" daemon [_thread_blocked, id=68, stack(0xa4980000,0xa4a00000)]
    0x01677400 JavaThread "ExecuteThread: '18' for queue: 'weblogic.socket.Muxer'" daemon [_thread_blocked, id=67, stack(0xa4a80000,0xa4b00000)]
    0x01672400 JavaThread "ExecuteThread: '17' for queue: 'weblogic.socket.Muxer'" daemon [_thread_blocked, id=66, stack(0xa4b80000,0xa4c00000)]
    0x01670c00 JavaThread "ExecuteThread: '16' for queue: 'weblogic.socket.Muxer'" daemon [_thread_blocked, id=65, stack(0xa4c80000,0xa4d00000)]
    0x0166f400 JavaThread "ExecuteThread: '15' for queue: 'weblogic.socket.Muxer'" daemon [_thread_blocked, id=64, stack(0xa4d80000,0xa4e00000)]
    0x006ac000 JavaThread "ExecuteThread: '14' for queue: 'weblogic.socket.Muxer'" daemon [_thread_blocked, id=63, stack(0xa4e80000,0xa4f00000)]
    0x006aa800 JavaThread "ExecuteThread: '13' for queue: 'weblogic.socket.Muxer'" daemon [_thread_blocked, id=62, stack(0xa4f80000,0xa5000000)]
    0x006a9000 JavaThread "ExecuteThread: '12' for queue: 'weblogic.socket.Muxer'" daemon [_thread_blocked, id=61, stack(0xa5080000,0xa5100000)]
    0x0182ac00 JavaThread "ExecuteThread: '11' for queue: 'weblogic.socket.Muxer'" daemon [_thread_blocked, id=60, stack(0xa5180000,0xa5200000)]
    0x01829400 JavaThread "ExecuteThread: '10' for queue: 'weblogic.socket.Muxer'" daemon [_thread_blocked, id=59, stack(0xa5280000,0xa5300000)]
    0x01827c00 JavaThread "ExecuteThread: '9' for queue: 'weblogic.socket.Muxer'" daemon [_thread_blocked, id=58, stack(0xa5380000,0xa5400000)]
    0x01826400 JavaThread "ExecuteThread: '8' for queue: 'weblogic.socket.Muxer'" daemon [_thread_blocked, id=57, stack(0xa5480000,0xa5500000)]
    0x01824c00 JavaThread "ExecuteThread: '7' for queue: 'weblogic.socket.Muxer'" daemon [_thread_blocked, id=56, stack(0xa5580000,0xa5600000)]
    0x01cb7800 JavaThread "ExecuteThread: '6' for queue: 'weblogic.socket.Muxer'" daemon [_thread_blocked, id=55, stack(0xa5680000,0xa5700000)]
    0x01cb3000 JavaThread "ExecuteThread: '5' for queue: 'weblogic.socket.Muxer'" daemon [_thread_blocked, id=54, stack(0xa5780000,0xa5800000)]
    0x01cb1c00 JavaThread "ExecuteThread: '4' for queue: 'weblogic.socket.Muxer'" daemon [_thread_blocked, id=53, stack(0xa5880000,0xa5900000)]
    0x01cdbc00 JavaThread "ExecuteThread: '3' for queue: 'weblogic.socket.Muxer'" daemon [_thread_blocked, id=52, stack(0xa5980000,0xa5a00000)]
    0x01e70800 JavaThread "ExecuteThread: '2' for queue: 'weblogic.socket.Muxer'" daemon [_thread_blocked, id=51, stack(0xa5a80000,0xa5b00000)]
    0x01e70000 JavaThread "ExecuteThread: '1' for queue: 'weblogic.socket.Muxer'" daemon [_thread_blocked, id=50, stack(0xa5b80000,0xa5c00000)]
    0x00b68000 JavaThread "ExecuteThread: '0' for queue: 'weblogic.socket.Muxer'" daemon [_thread_in_native, id=49, stack(0xa5c80000,0xa5d00000)]
    0x018e7800 JavaThread "Thread-7" daemon [_thread_blocked, id=48, stack(0xa5d80000,0xa5e00000)]
    0x018d1400 JavaThread "[ACTIVE] ExecuteThread: '1' for queue: 'weblogic.kernel.Default (self-tuning)'" daemon [_thread_blocked, id=47, stack(0xa5e80000,0xa5f00000)]
    0x01896000 JavaThread "weblogic.timers.TimerThread" daemon [_thread_blocked, id=46, stack(0xa5f80000,0xa6000000)]
    0x00ad4c00 JavaThread "weblogic.time.TimeEventGenerator" daemon [_thread_blocked, id=45, stack(0xa6080000,0xa6100000)]
    0x00ad6800 JavaThread "[STANDBY] ExecuteThread: '0' for queue: 'weblogic.kernel.Default (self-tuning)'" daemon [_thread_blocked, id=44, stack(0xa6180000,0xa6200000)]
    0x01d38000 JavaThread "Timer-1" daemon [_thread_blocked, id=43, stack(0xa6280000,0xa6300000)]
    0x0194cc00 JavaThread "Timer-0" daemon [_thread_blocked, id=42, stack(0xa6380000,0xa6400000)]
    0x005e0000 JavaThread "Low Memory Detector" daemon [_thread_blocked, id=40, stack(0xa6880000,0xa6900000)]
    0x005dcc00 JavaThread "CompilerThread1" daemon [_thread_blocked, id=39, stack(0xa6980000,0xa6a00000)]
    0x005db000 JavaThread "CompilerThread0" daemon [_thread_blocked, id=38, stack(0xa6a80000,0xa6b00000)]
    0x005d9800 JavaThread "Signal Dispatcher" daemon [_thread_blocked, id=37, stack(0xa6b80000,0xa6c00000)]
    0x005d8400 JavaThread "Surrogate Locker Thread (CMS)" daemon [_thread_blocked, id=36, stack(0xa6c80000,0xa6d00000)]
    0x005c1800 JavaThread "Finalizer" daemon [_thread_blocked, id=35, stack(0xa6d80000,0xa6e00000)]
    0x005c0000 JavaThread "Reference Handler" daemon [_thread_blocked, id=34, stack(0xa6e80000,0xa6f00000)]
    0x00043000 JavaThread "main" [_thread_blocked, id=2, stack(0xfe300000,0xfe380000)]
    Other Threads:
    0x005bb800 VMThread [stack: 0xa6f80000,0xa7000000] [id=33]
    0x005ea400 WatcherThread [stack: 0xa6780000,0xa6800000] [id=41]
    VM state:not at safepoint (normal execution)
    VM Mutex/Monitor currently owned by a thread: None
    Heap
    par new generation total 31680K, used 7698K [0xaa800000, 0xaca50000, 0xb2800000)
    eden space 28224K, 24% used [0xaa800000, 0xaaec03c0, 0xac390000)
    from space 3456K, 22% used [0xac390000, 0xac4547c0, 0xac6f0000)
    to space 3456K, 0% used [0xac6f0000, 0xac6f0000, 0xaca50000)
    concurrent mark-sweep generation total 441048K, used 181900K [0xb2800000, 0xcd6b6000, 0xea800000)
    concurrent-mark-sweep perm gen total 206792K, used 124256K [0xea800000, 0xf71f2000, 0xfa800000)
    Dynamic libraries:
    0x00010000      /lapps/wls103/usr/local/oracle/wls103/jdk1.6.0_24/bin/java
    0xff3a0000      /lib/libthread.so.1
    0xff370000      /lapps/wls103/usr/local/oracle/wls103/jdk1.6.0_24/bin/../jre/lib/sparc/jli/libjli.so
    0xff350000      /lib/libdl.so.1
    0xff200000      /lib/libc.so.1
    0xff390000      /platform/SUNW,SPARC-Enterprise/lib/libc_psr.so.1
    0xfe400000      /lapps/wls103/usr/local/oracle/wls103/jdk1.6.0_24/jre/lib/sparc/server/libjvm.so
    0xff1d0000      /lib/libsocket.so.1
    0xff1f0000      /usr/lib/libsched.so.1
    0xff1b0000      /lib/libm.so.1
    0xff180000      /usr/lib/libCrun.so.1
    0xff160000      /lib/libdoor.so.1
    0xff080000      /lib/libnsl.so.1
    0xfef80000      /lib/libm.so.2
    0xff050000      /lib/libscf.so.1
    0xff140000      /lib/libuutil.so.1
    0xfef60000      /lib/libgen.so.1
    0xfef30000      /lib/libmd.so.1
    0xfef10000      /lib/libmp.so.2
    0xfee80000      /lapps/wls103/usr/local/oracle/wls103/jdk1.6.0_24/jre/lib/sparc/libverify.so
    0xfe3c0000      /lapps/wls103/usr/local/oracle/wls103/jdk1.6.0_24/jre/lib/sparc/libjava.so
    0xfee60000      /lapps/wls103/usr/local/oracle/wls103/jdk1.6.0_24/jre/lib/sparc/native_threads/libhpi.so
    0xfe2c0000      /lib/nss_files.so.1
    0xfe2a0000      /lib/nss_nis.so.1
    0xfe280000      /lapps/wls103/usr/local/oracle/wls103/jdk1.6.0_24/jre/lib/sparc/libzip.so
    0xfacd0000      /lapps/wls103/usr/local/oracle/wls103/jdk1.6.0_24/jre/lib/sparc/libnet.so
    0xfacb0000      /lib/nss_dns.so.1
    0xfaba0000      /lib/libresolv.so.2
    0xfac90000      /lapps/wls103/usr/local/oracle/wls103/jdk1.6.0_24/jre/lib/sparc/libmanagement.so
    0xaa790000      /lapps/wls103/usr/local/oracle/wls103/jdk1.6.0_24/jre/lib/sparc/libnio.so
    0xaa4e0000      /lib/librt.so.1
    0xaa2e0000      /lib/libaio.so.1
    0xaa2c0000      /usr/lib/libsendfile.so.1
    0xaa290000      /lapps/wls103/usr/local/oracle/wls103/jdk1.6.0_24/jre/lib/sparc/libj2pkcs11.so
    0xaa0d0000      /usr/lib/libpkcs11.so
    0xaa190000      /usr/lib/libcryptoutil.so.1
    0xa7ba0000      /usr/lib/security/pkcs11_softtoken.so
    0xaa0b0000      /lapps/wls103/usr/local/oracle/wls103/wlserver_10.3/server/native/solaris/sparc/libstackdump.so
    0xa7ae0000      /lapps/wls103/usr/local/oracle/wls103/wlserver_10.3/server/native/solaris/sparc/libwlfileio2.so
    0xa7ac0000      /lapps/wls103/usr/local/oracle/wls103/wlserver_10.3/server/native/solaris/sparc/libmuxer.so
    0xa7aa0000      /usr/ucblib/libucb.so.1
    0xa79d0000      /lib/libelf.so.1
    VM Arguments:
    jvm_args: -Dabat001 -Xms256m -Xmx1024m -XX:PermSize=64m -XX:MaxPermSize=256m -XX:GCTimeRatio=19 -XX:+UseParNewGC -XX:+UseConcMarkSweepGC -XX:+HeapDumpOnOutOfMemoryError -XX:+JavaMonitorsInStackTrace -XX:+PrintGCDetails -XX:+PrintGCTimeStamps -Xloggc:/sites/abat/site/live/wls103/../../common/logs/103_abat001/gc.log -Xverify:none -da -Dplatform.home=/lapps/wls103/usr/local/oracle/wls103/wlserver_10.3 -Dwls.home=/lapps/wls103/usr/local/oracle/wls103/wlserver_10.3/server -Dweblogic.home=/lapps/wls103/usr/local/oracle/wls103/wlserver_10.3/server -Ddomain.home=/sites/abat/site/live/wls103 -Dweblogic.security.SSL.enforceConstraints=off -Dlog4j.configuration=file:/sites/abat/site/live/wls103/properties/log4j.xml -Dweblogic.management.discover=false -Dweblogic.management.server=t3://vmcdaw70.naeng.gm.com:9803 -Dwlw.iterativeDev=false -Dwlw.testConsole=false -Dwlw.logErrorsToConsole= -Dweblogic.ext.dirs=/lapps/wls103/usr/local/oracle/wls103/patch_wlw1030/profiles/default/sysext_manifest_classpath:/lapps/wls103/usr/local/oracle/wls103/patch_wls1030/profiles/default/sysext_manifest_classpath:/lapps/wls103/usr/local/oracle/wls103/patch_cie660/profiles/default/sysext_manifest_classpath -Dweblogic.Name=abat001 -Djava.security.policy=/lapps/wls103/usr/local/oracle/wls103/wlserver_10.3/server/lib/weblogic.policy
    java_command: weblogic.Server
    Launcher Type: SUN_STANDARD
    Environment Variables:
    JAVA_HOME=/lapps/wls103/usr/local/oracle/wls103/currentjdk
    CLASSPATH=/sites/abat/site/live/wls103/properties:::/lapps/wls103/usr/local/oracle/wls103/patch_wlw1030/profiles/default/sys_manifest_classpath/weblogic_patch.jar:/lapps/wls103/usr/local/oracle/wls103/patch_wls1030/profiles/default/sys_manifest_classpath/weblogic_patch.jar:/lapps/wls103/usr/local/oracle/wls103/patch_cie660/profiles/default/sys_manifest_classpath/weblogic_patch.jar:/lapps/wls103/usr/local/oracle/wls103/currentjdk/lib/tools.jar:/lapps/wls103/usr/local/oracle/wls103/wlserver_10.3/server/lib/weblogic_sp.jar:/lapps/wls103/usr/local/oracle/wls103/wlserver_10.3/server/lib/weblogic.jar:/lapps/wls103/usr/local/oracle/wls103/modules/features/weblogic.server.modules_10.3.0.0.jar:/lapps/wls103/usr/local/oracle/wls103/wlserver_10.3/server/lib/webservices.jar:/lapps/wls103/usr/local/oracle/wls103/modules/org.apache.ant_1.6.5/lib/ant-all.jar:/lapps/wls103/usr/local/oracle/wls103/modules/net.sf.antcontrib_1.0.0.0_1-0b2/lib/ant-contrib.jar:::/lapps/wls103/usr/local/oracle/wls103/wlserver_10.3/server/lib/xqrl.jar::
    PATH=/lapps/wls103/usr/local/oracle/wls103/wlserver_10.3/server/bin:/lapps/wls103/usr/local/oracle/wls103/modules/org.apache.ant_1.6.5/bin:/lapps/wls103/usr/local/oracle/wls103/currentjdk/jre/bin:/lapps/wls103/usr/local/oracle/wls103/currentjdk/bin:/lapps/wls103/usr/local/oracle/wls103/wlserver_10.3/server/bin:/lapps/wls103/usr/local/oracle/wls103/modules/org.apache.ant_1.6.5/bin:/lapps/wls103/usr/local/oracle/wls103/currentjdk/jre/bin:/lapps/wls103/usr/local/oracle/wls103/currentjdk/bin:/usr/xpg4/bin:/usr/bin:/usr/sbin:/usr/ucb:/usr/openwin/bin:/common/site/scripts:/common/ce/scripts:/common/site/bin:/common/ce/bin:/common/gm/scripts:/common/gm/bin:/opt/EMCpower/bin:/etc
    LD_LIBRARY_PATH=/lapps/wls103/usr/local/oracle/wls103/jdk1.6.0_24/jre/lib/sparc/server:/lapps/wls103/usr/local/oracle/wls103/jdk1.6.0_24/jre/lib/sparc:/lapps/wls103/usr/local/oracle/wls103/jdk1.6.0_24/jre/../lib/sparc:/lapps/wls103/usr/local/oracle/wls103/patch_wlw1030/profiles/default/native:/lapps/wls103/usr/local/oracle/wls103/patch_wls1030/profiles/default/native:/lapps/wls103/usr/local/oracle/wls103/patch_cie660/profiles/default/native::/lapps/wls103/usr/local/oracle/wls103/wlserver_10.3/server/native/solaris/sparc:/lapps/wls103/usr/local/oracle/wls103/wlserver_10.3/server/native/solaris/sparc/oci920_8:/lapps/wls103/usr/local/oracle/wls103/wlserver_10.3/server/native/solaris/sparc:/lapps/wls103/usr/local/oracle/wls103/wlserver_10.3/server/native/solaris/sparc/oci920_8
    SHELL=/bin/ksh
    Signal Handlers:
    SIGSEGV: [libjvm.so+0x8b1aa0], sa_mask[0]=0xffbffeff, sa_flags=0x0000000c
    SIGBUS: [libjvm.so+0x8b1aa0], sa_mask[0]=0xffbffeff, sa_flags=0x0000000c
    SIGFPE: [libjvm.so+0x1d21a4], sa_mask[0]=0xffbffeff, sa_flags=0x0000000c
    SIGPIPE: [libjvm.so+0x1d21a4], sa_mask[0]=0xffbffeff, sa_flags=0x0000000c
    SIGXFSZ: [libjvm.so+0x1d21a4], sa_mask[0]=0xffbffeff, sa_flags=0x0000000c
    SIGILL: [libjvm.so+0x1d21a4], sa_mask[0]=0xffbffeff, sa_flags=0x0000000c
    SIGUSR1: SIG_DFL, sa_mask[0]=0x00000000, sa_flags=0x00000000
    SIGUSR2: SIG_DFL, sa_mask[0]=0x00000000, sa_flags=0x00000000
    SIGQUIT: [libjvm.so+0x78003c], sa_mask[0]=0xffbffeff, sa_flags=0x00000004
    SIGHUP: SIG_IGN, sa_mask[0]=0x00000000, sa_flags=0x00000000
    SIGINT: SIG_IGN, sa_mask[0]=0x00000000, sa_flags=0x00000000
    SIGTERM: [libjvm.so+0x78003c], sa_mask[0]=0xffbffeff, sa_flags=0x00000004
    SIG39: [libjvm.so+0x783744], sa_mask[0]=0x00000000, sa_flags=0x00000008
    SIG40: [libjvm.so+0x1d21a4], sa_mask[0]=0xffbffeff, sa_flags=0x0000000c
    --------------- S Y S T E M ---------------
    OS: Solaris 10 5/08 s10s_u5wos_10 SPARC
    Copyright 2008 Sun Microsystems, Inc. All Rights Reserved.
    Use is subject to license terms.
    Assembled 24 March 2008
    uname:SunOS 5.10 Generic_138888-06 sun4u (T2 libthread)
    rlimit: STACK 8192k, CORE infinity, NOFILE 65536, AS infinity
    load average:2.25 1.43 1.14
    CPU:total 32 has_v8, has_v9, popc, has_vis1, has_vis2, is_ultra3
    Memory: 8k page, physical 134217728k(72609456k free)
    vm_info: Java HotSpot(TM) Server VM (19.1-b02) for solaris-sparc JRE (1.6.0_24-b07), built on Feb 2 2011 17:17:59 by "" with Workshop 5.8
    time: Wed May 25 01:40:22 2011
    elapsed time: 263652 seconds
    Appreciate your help thanks :
    K.Vickram
    Edited by: Vickram on May 25, 2011 12:35 PM

    Hi Rohit Jaiswal
    Thanks rohit for the quick response
    just to understand
    You mean to say " It is not an JVM crash "
    Is that say JVM is having issue with Solaris OS. or crash in OS ?
    We are not using native code in our application .
    if possible elobrate the above .
    we are in process to raise an oracle case
    Reagards,
    K.Vickram

  • Finding open file handles from core file using mdb/dbx

    Is it possible to find open file handles from a core file? The env is Solaris 5.10 SPARC.
    regards
    becks

    Interesting question, but it's more about Solaris OS/libraries than about Sun Studio C++ compiler. While there's a chance of getting it answered here, I also recommend to post the same question on one of the OpenSolaris forums:
    http://www.opensolaris.org/jive/index.jspa?categoryID=1
    For example, mdb forum:
    http://www.opensolaris.org/jive/forum.jspa?forumID=4

  • Possible to get data from a partly optimized/stripped core file?

    Hello,
    This may not be possible, but I figured it was worth asking about.
    I've got a C/C++ GUI application compiled with Solaris Studio 12.3 that is experiencing an infrequent crash when compiled for production and running on production boxes.  This is on Solaris 10 for x86 running in 64-bit mode.  Most of the app is in libraries which are statically linked.
    I working on trying to replicate the issue in a development environment, but have not had luck yet. In any case, it would be interesting to know what kind of data can be gleaned postmortem from the core file I've got access to.
    The application is actually a small "main.c" file which is complied and linked in debug mode with "-g" and no optimization, but this thin wrapper calls into the main logic in statically linked libraries which are optimized and not built in debug mode.  (See the call stack below.)
    From the core file :
    1) For functions in the call stack that have names, can I get the value of one of the parameters?  I ask because several such functions take pointers to structs with data that should be very useful.
    2) For functions in the call stack that appear as ??????, is it possible to determine at least what .o or .a file they came from?  This could help narrow things down.
    Some basic Googling indicates that either of the above may not be trivial or even possible.  But I'm wondering if the fact that we've got a "main.c" debuggable wrapper might somehow help.
    As a related question, pstack produces sensible output, but dbx shows the error: "dbx: internal error: could not iterate over load objects -- link-maps are not initialized".  Is there some flag I need to supply to dbx?
    Thank you for any help,
    David
    Background info:
    I've been unable to replicate on non-production deployments, but the machines do differ a bit.   Eventually I will be able to borrow a production box to deploy an instrumented binary, but for now all I've got is a core file and access to source.
    The core was generated with gcore while the app was displaying a popup from it's SIGABRT cleanup handler.   The production build scripts do some binary stripping, but I'm not yet sure where it is getting done.
    Here is the (slightly cleaned up) output of pstack for the core file:
    fffffd7ffeb3244a nanosleep (fffffd7fffdfd4b0, 0)
    0000000000514485 ZWidget_ModalEventLoop () + 65
    00000000004f74a9 ZWidget_ShowPopup () + 4a9
    000000000049d2ab ???????? ()
    fffffd7ffeb2dd16 __sighndlr () + 6
    fffffd7ffeb225e2 call_user_handler () + 252
    fffffd7ffeb2280e sigacthandler (6, 0, fffffd7fffdfd640) + ee
    --- called from signal handler with signal 6 (SIGABRT) ---
    fffffd7ffeb3351a _lwp_kill () + a
    fffffd7ffead81b9 raise () + 19
    fffffd7ffeab6b4e abort () + 5e
    000000000052c3bc ZUtil_Query () + 3c
    000000000059b66e ZUtil_QueryString () + 3e
    00000000004a1e2a ???????? ()
    00000000004a0879 ???????? ()
    000000000058b303 ???????? ()
    000000000052d517 ZUtil_Set () + 767
    00000000004f4805 ZUtil_DBSet () + 35
    00000000005094b5 ZWidget_ProcessCallback () + 465
    0000000000516814 ???????? ()
    fffffd7fff242424 XtCallCallbackList () + 114
    fffffd7ffef84d2e ActivateCommon () + 126
    fffffd7ffef84b72 Activate () + 1e
    fffffd7fff244efa HandleActions () + 14a
    fffffd7fff24b1b7 HandleComplexState () + 177
    fffffd7fff243a9e _XtTranslateEvent () + 4e
    fffffd7fff24382a XtDispatchEventToWidget () + 2ea
    fffffd7fff2430ee _XtDefaultDispatcher () + 15e
    fffffd7fff242db6 XtDispatchEvent () + 106
    00000000005142df ZWidget_ProcessEvent () + ff
    0000000000514099 ZWidget_ProcessEvents () + 19
    00000000005ac67a ZEventLoop_ProcessEvents () + 5a
    00000000005ac528 ZEventLoop_Execute () + 48
    000000000049d133 Main () + c93
    000000000049bdf9 main () + 9
    000000000049bc7b ???????? ()

    Thanks for reporting this problem.
    >1) For functions in the call stack that have names, can I get the value of one of the parameters?  I ask because several such functions take pointers to structs with data that should be very useful.
    Use compiler option -preserve_argvalues={none|simple|complete} to preserve incoming argument values. Note that this feature was introduced in Oracle Solaris Studio 12.4.
    You may also be interested in a new option in Oracle Solaris Studio 12.4 which provides much finer-grained control over debug information, which allows you to choose how much information is provided and to reduce the amount of disk space needed for the executable. Dev Tip: How to Get Finer-Grained Control of Debugging Information.
    >2) For functions in the call stack that appear as ??????, is it possible to determine at least what .o or .a file they came from?  This could help narrow things down.
    The following 2 commands may help:
    where -l        
    # Include library name with function name.
    whereis -a <addr-of-?????> # Print location of an address expression
    >As a related question, pstack produces sensible output, but dbx shows the error: "dbx: internal error: could not iterate over load objects -- link-maps are not initialized".  Is there some flag I need to supply to dbx?
    This may be caused by corefile mismatch. See dbx online help: "help core mismatch" for suggestions.
    Hope this helps.

Maybe you are looking for

  • Problems with my new WRT54GH

    Hello everyone, Last week I bought my first Cisco/Linksys router, and unfortunately I have connection issues with it. When I connect directly to the modem I don't get any disconnects, but with the router installed the connection goes down every 1-6 h

  • Getting complete WSDL for the web services created in J2EE

    Hi, I have created a web service using Netweaver developer studio for a J2EE project (complete EJB, WEB and Appln Project) similar to CAR rental application. I also have tested the web service in web service perspective and it is working fine. Now i

  • Declaring array of T[] - possible bug?

    See the following code: class A {} class B {} public class Test {      public static void main(String[] args) {           A a = null;           foo(a);      public static <T> void foo(T a) {           T[] t = (T[]) new Object[10];           Object[]

  • Batch Programs

    Hi There, We're currently investigating compiling our Batch Runs for better performance. I'd be very interested to know how other people are handling their batch programs. Our server operating system is NT 4., and our forte version is v 2.0f. We deci

  • Is a switch from imovie to FCE HD with 10.3.9 OK? Or do I need Tiger?

    OK, finally looking to switch from imovie to FCE, but have reviewed many posts regarding compatibility with Panther vs. Tiger, and I've been through the QT7 upgrade mistake with 10.3.9, and then went back to QT 6.5.2 (this is my first post, as most o