Solaris 10 crashing

Hi,
My system is crashing with following error .. i tried to boot from the network and unencapsulated the root disk from SVM .. but still not able to boot the box , can any one point me to some direction .. i do not want to build the box new as of now just want to troubleshoot if possible..
Rebooting with command: boot
Boot device: /pci@10,600000/pci@0/pci@8/pci@0/scsi@1/disk@0,0:a File and args:
SunOS Release 5.10 Version Generic_120011-14 64-bit
Copyright 1983-2007 Sun Microsystems, Inc. All rights reserved.
Use is subject to license terms.
panic[cpu42]/thread=2a1003bdcc0: vmem_xalloc(): size == 0
000002a1003bd570 genunix:vmem_xalloc+8b0 (100, 0, 0, 0, 80000, 100)
%l0-3: 000003000191c2d8 ffffffffffffffff 000003000191ccc8 fffffffffffffff8
%l4-7: 0000000000000000 ffffffffffffffff 0000000000000008 0000000000000000
000002a1003bd6f0 genunix:vmem_alloc+100 (3000191c000, 0, 100, 0, 0, 100)

Hi
What is the memory size for this box?
Cheers
-- Andreas

Similar Messages

What happended to the Solaris Crash Analysis Tool 4.2 for Solaris 10?

What happended to the Solaris Crash Analysis Tool 4.2 for Solaris 10?
I'm trying to debug a kernel panic under Solaris 10 on sparcv9. I tried the SUNWscat 4.1 package but it core dumps on Solaris 10. I found a blog entry that described the problem and mentioned a version 4.2 fix. That was from May 2006, but I have not found any update sense then. Was 4.2 ever released or is their an alternative tool for Solaris 10 that I can use?

One problem is that those of us who develop Solaris CAT do so as a "hobby" as it's not part of our actual jobs. But he good news is that management gave us the time to get a release out and 5.0 is now available here . We're now planning 6 month releases so we don't have a 5 year delay between updates.
BTW, the Solaris Crash Analysis Tool supports Solaris 10, OpenSolaris/Solaris Nevada, sparc, and x86/x64.
There are so many enhancements and bug fixes that I'd recommend reading the release notes (SUNWscat/docs/index.html).
-- Dana

Solaris Crash Analysis Tool available any more?

I'm trying to locate the Solaris Crash Analysis Tool v.5.2. Is it even available any more? I tried dl'ing the Oracle Services Tools Bundle (STB) v.6.0 but that didn't contain SUNWscat. Any ideas? If it's not available I'd appreciate confirmation that it isn't...

Shalom, MikeW
Blessings may another prosper in the will and ways of Jesus.
About:
Whether The "Solaris Crash Analysis Tool" for x86 & Sparc is still available anymore and where to download it.
Downloaded the Solaris Crash Analysis Tool for x86 & Sparc version 5.1b On 08/15/2011 and other software.
From the following:
<non-Oracle link removed by moderator>
Which linked to the following:
<non-Oracle links removed by moderator>
Moderator Action:
Oracle owns the SCAT utility tool.and has decided that it only goes to paying customers.
If you, as a non-Oracle entity, give it away then you are legally liable to pay Oracle for each `giveaway`.
Your third-party links have been removed.
Do not do that. If you continue, your actions may be reported to the site Administratoirs and your privileges may be removed.
This is the second such edit that has been needed in this thread.
The thread is now locked.
Edited by: rukbat on Aug 15, 2011 5:21 AM

Outputs about the Solaris Crash Analysis Tool

Hello all.
I am new hear and would like to ask a question regarding to the Solaris Crash Analysis Tool.
We are analyzing the results of "thread summary" but not quite sure what the asterisk represents.
Following are the items that asterisk were attached.
50* threads sleeping on a semaphore (49 user, 1 kernel)
49* threads in biowait() (49 user, 0 kernel)
1* process with 19 pending and 0 done kaio
3* interrupt threads running (0 user, 3 kernel)
It would be helpful if someone in this forum can educate us
what does the asterisk mean.
Thanks,
Yu

In addition, is the value
"threads sleeping on a semaphore" and the "QNUM" in ipcs -q
the same?
It would be helpful if this question is also answered.
Thanks,
Yu

Solaris Crash Recovery and Fault Analysis

Can some one help me in Analysing this solaris Crash Core
Logs:
ama01# strings vmcore.1 | more
SunOS
ama01
Generic_108528-15
sun4u
SUNW,Ultra-80
[AFT1] errID 0x00001fd4.f59af34f UE Error(s)
See previous message(s) for details
.symtab
.strtab
.shstrtab
!}q|
"+q|
"^q|
Fq}
!(q|
!:q|
!\q|
!lq|
utsb_l512
sfmmu_map_prom_mappings
cl_comm_modname
swapgeneric_modname
setup_trap_table
intr_pri
mp_cpu_start
kcage_range_lock
prom_heartbeat
sfmmu_remap_kernel
disable_vec_intr
bop_map
flush_cnt
idle_stop_xcall
audit_closef
auxio_panic
conv_tnc
i_ddi_rnumber_to_regspec
cpu_sgn_func
prom_path_gettoken
cpc_level15_inum
strplumb
utsb_l31
cbe_enable
authkern_create_info
prom_starfire_move_cpu0
membar_stst_stld
utsb_l32
adj_ecache
fnd_mapping_sz
t_kspoll_info
page_iolock_init
prstep
stop_other_cpus
nexectype
caslong
memscrub_delete_span
ipsecah_modinfo
utsb_l34
startup_bop_gone
num_partitions
setgwins
have_pmc
svc_tli_kcreate
tune_t_flckrec
start_other_cpus
membar_memissue
specfind
hblk_add_panic1
conslist_mutex
mutex_owner
hblk_add_panic2
audit_stropen
khash_hit
mem_callbacks
current_thread_complete
atomic_add_32
tnf_modinfo
ddi_rep_putll
audit_falloc_info
prom_nextprop
empty_cpu
syscallfp
lm_nfs3_fhtovp_info
bind
prom_serengeti_attach_board
rce_ops
dvma_sync

SUNW,Ultra-80
[AFT1] errID 0x00001fd4.f59af34f UE Error(s)That indicates some sort of uncorrectable errrs (either memory or something else).
There should be more details logged in your /var/adm/messages.
Hope this helps.

Sun One 6.0 SP3 with JDK1.3.1_08 on Solaris crashing.

Hi,
We are using Sun One 6.0 SP3 with JDK 1.3.1_08 on Solaris 2.8. We are seeing these error messages in the log file.
[11/Sep/2003:17:41:16] catastrophe ( 436): Server crash detected (signal SIGSEGV)
[11/Sep/2003:17:41:16] info ( 436): Crash occurred in function __0fLPollManagerNAddConnectionR6KConnectionUi from module /package/iplanet60sp3/bin/https/lib/libns-httpd40.so
[11/Sep/2003:17:41:25] info ( 1671): successful server startup
[11/Sep/2003:17:41:25] info ( 1671): iPlanet-WebServer-Enterprise/6.0SP3 B05/18/2002 02:30
[11/Sep/2003:17:41:26] info ( 1672): Installing a new configuration
[18/Sep/2003:18:24:14] catastrophe ( 4209): Server crash detected (signal SIGSEGV)
[18/Sep/2003:18:24:14] info ( 4209): Crash occurred in function __0fLPollManagerNAddConnectionR6KConnectionUi from module /package/iplanet60sp3/bin/https/lib/libns-httpd40.so
[18/Sep/2003:18:35:24] info ( 4334): successful server startup
[18/Sep/2003:18:35:24] info ( 4334): iPlanet-WebServer-Enterprise/6.0SP3 B05/18/2002 02:30
[18/Sep/2003:18:35:25] info ( 4335): Installing a new configuration
[24/Sep/2003:09:04:02] catastrophe ( 5384): Server crash detected (signal SIGBUS)
[24/Sep/2003:09:04:02] info ( 5384): Crash occurred in NSAPI SAF NSServletService
[24/Sep/2003:09:04:02] info ( 5384): Crash occurred in function PListFindValue from module /package/iplanet60sp3/bin/https/lib/libns-httpd40.so
[24/Sep/2003:09:04:52] failure ( 5383): Child process admin thread is shutting down
[24/Sep/2003:09:04:54] info ( 5489): Installing a new configuration
[24/Sep/2003:09:59:42] catastrophe ( 5556): Server crash detected (signal SIGSEGV)
[24/Sep/2003:09:59:42] info ( 5556): Crash occurred in function PR_AtomicDecrement from module /package/iplanet60sp3/bin/https/lib/libatomic.so
[24/Sep/2003:09:59:55] info ( 5650): successful server startup
[24/Sep/2003:09:59:55] info ( 5650): iPlanet-WebServer-Enterprise/6.0SP3 B05/18/2002 02:30
[24/Sep/2003:09:59:56] info ( 5651): Installing a new configuration
[24/Sep/2003:10:11:16] catastrophe ( 5651): Server crash detected (signal SIGSEGV)
[24/Sep/2003:10:11:16] info ( 5651): Crash occurred in function __0fLPollManagerNAddConnectionR6KConnectionUi from module /package/iplanet60sp3/bin/https/lib/libns-httpd40.so
[24/Sep/2003:10:12:40] info ( 5697): successful server startup
[24/Sep/2003:10:12:40] info ( 5697): iPlanet-WebServer-Enterprise/6.0SP3 B05/18/2002 02:30
[24/Sep/2003:10:12:41] info ( 5698): Installing a new configuration
[25/Sep/2003:12:59:45] catastrophe ( 6666): Server crash detected (signal SIGSEGV)
[25/Sep/2003:12:59:45] info ( 6666): Crash occurred in function __0fLPollManagerNAddConnectionR6KConnectionUi from module /package/iplanet60sp3/bin/https/lib/libns-httpd40.so
[25/Sep/2003:12:59:56] info ( 7052): successful server startup
[25/Sep/2003:12:59:56] info ( 7052): iPlanet-WebServer-Enterprise/6.0SP3 B05/18/2002 02:30
[25/Sep/2003:12:59:58] info ( 7053): Installing a new configuration
[30/Sep/2003:09:27:22] catastrophe ( 8117): Server crash detected (signal SIGSEGV)
[30/Sep/2003:09:27:22] info ( 8117): Crash occurred in function __0fLPollManagerNAddConnectionR6KConnectionUi from module /package/iplanet60sp3/bin/https/lib/libns-httpd40.so
[30/Sep/2003:09:28:29] info ( 8135): successful server startup
[30/Sep/2003:09:28:29] info ( 8135): iPlanet-WebServer-Enterprise/6.0SP3 B05/18/2002 02:30
[30/Sep/2003:09:28:30] info ( 8136): Installing a new configuration
[30/Sep/2003:09:35:27] catastrophe ( 8136): Server crash detected (signal SIGSEGV)
[30/Sep/2003:09:35:27] info ( 8136): Crash occurred in function __0fLPollManagerNAddConnectionR6KConnectionUi from module /package/iplanet60sp3/bin/https/lib/libns-httpd40.so
[30/Sep/2003:09:39:08] info ( 8170): successful server startup
[30/Sep/2003:09:39:08] info ( 8170): iPlanet-WebServer-Enterprise/6.0SP3 B05/18/2002 02:30
[30/Sep/2003:09:39:09] info ( 8171): Installing a new configuration
[08/Oct/2003:09:20:37] catastrophe ( 9529): Server crash detected (signal SIGSEGV)
[08/Oct/2003:09:20:37] info ( 9529): Crash occurred in NSAPI SAF NSServletService
[08/Oct/2003:09:20:37] info ( 9529): Crash occurred in function PListFindValue from module /package/iplanet60sp3/bin/https/lib/libns-httpd40.so
[08/Oct/2003:09:21:33] failure ( 9528): Child process admin thread is shutting down
[08/Oct/2003:09:21:35] info (10419): Installing a new configuration
Any help will be highly appreciated.
Thnks
Jawwad.

Hi,
We are seeing these error messages in the server log file.
[02/Apr/2004:11:29:27] catastrophe (27585):      Server crash detected (signal SIGSEGV)
[02/Apr/2004:11:29:27] info (27585):      Crash occurred in function JVM_Close from module /usr/j2se/jre/lib/sparc/libjvm.so
[02/Apr/2004:11:29:28] failure (27578):      Child process admin thread is shutting down
[02/Apr/2004:11:29:33] info (28360):      Installing a new configuration
any one help this error..
how to solve this bug.
thanks
jeba

SUNW-MSG-ID: SUNOS-8000-0G - Solaris crash managing - newbie

Hello,
I am relatively newbie at Solaris OS and before day, my server goes unexpectedly down. After issue I got following messages from /var/adm/messages log:
May 9 03:29:13 server1 unix: [ID 836849 kern.notice]
May 9 03:29:13 server1 ^Mpanic[cpu7]/thread=fffffe800070ac60:
May 9 03:29:13 server1 genunix: [ID 843051 kern.info] NOTICE: SUNW-MSG-ID: SUNOS-8000-0G, TYPE: Error, VER: 1, SEVERITY: Major
May 9 03:29:13 server1 unix: [ID 836849 kern.notice]
May 9 03:29:13 server1 ^Mpanic[cpu2]/thread=fffffe80004fdc60:
May 9 03:29:13 server1 genunix: [ID 663943 kern.notice] Unrecoverable Machine-Check Exception
May 9 03:29:13 server1 unix: [ID 836849 kern.notice]
May 9 03:29:13 server1 ^Mpanic[cpu6]/thread=fffffe80006a5c60:
May 9 03:29:13 server1 unix: [ID 836849 kern.notice]
May 9 03:29:13 server1 ^Mpanic[cpu4]/thread=fffffe80005c7c60:
May 9 03:29:13 server1 unix: [ID 836849 kern.notice]
May 9 03:29:13 server1 ^Mpanic[cpu0]/thread=fffffe8000005c60:
May 9 03:29:13 server1 unix: [ID 836849 kern.notice]
May 9 03:29:13 server1 ^Mpanic[cpu1]/thread=fffffe800042ac60:
May 9 03:29:13 server1 genunix: [ID 663943 kern.notice] Unrecoverable Machine-Check Exception
May 9 03:29:13 server1 unix: [ID 100000 kern.notice]
May 9 03:29:13 server1 genunix: [ID 655072 kern.notice] fffffe800042aab0 unix:cmi_mca_panic+1e ()
May 9 03:29:13 server1 genunix: [ID 655072 kern.notice] fffffe800042aae0 unix:cmi_mca_trap+13d ()
May 9 03:29:13 server1 genunix: [ID 655072 kern.notice] fffffe800042aaf0 unix:mcetrap+17e ()
May 9 03:29:13 server1 genunix: [ID 655072 kern.notice] fffffe800042abe0 unix:i86_mwait+d ()
May 9 03:29:13 server1 genunix: [ID 655072 kern.notice] fffffe800042ac20 unix:cpu_idle_mwait+125 ()
May 9 03:29:13 server1 genunix: [ID 655072 kern.notice] fffffe800042ac40 unix:idle+89 ()
May 9 03:29:13 server1 genunix: [ID 655072 kern.notice] fffffe800042ac50 unix:thread_start+8 ()
May 9 03:29:13 server1 unix: [ID 100000 kern.notice]
May 9 03:29:13 server1 genunix: [ID 672855 kern.notice] syncing file systems...
May 9 03:29:14 server1 genunix: [ID 904073 kern.notice] done
May 9 03:29:15 server1 genunix: [ID 111219 kern.notice] dumping to /dev/zvol/dsk/rpool/dump, offset 65536, content: kernel
May 9 03:30:38 server1 genunix: [ID 100000 kern.notice]
May 9 03:30:38 server1 genunix: [ID 665016 kern.notice] ^M100% done: 656785 pages dumped,
May 9 03:30:38 server1 genunix: [ID 851671 kern.notice] dump succeeded
I don't know how to determine from mdb/logs/.... what cause server crash...
Could someone help me with this please?
info about my system:
platform: SUN FIRE X4150
SunOS 5.10 Generic_142910-17
Many thanks

Hi;
The Message ID: SUNOS-8000-0G indicates errors detected by the Solaris kernel required immediate reboot to preserve system integrity.
This error event could be caused by a hardware fault, such as a defective component or firmware incompatibility, or a software event, such as a bad patch, misconfiguration, or downrev device driver. This list is not an exhaustive list of possible reasons for the reboot, but merely some suggestions as to why it took place.
This box panick'd ::
May 9 03:29:13 server1 ^Mpanic[cpu1]/thread=fffffe800042ac60:
May 9 03:29:13 server1 genunix: [ID 663943 kern.notice] Unrecoverable Machine-Check Exception
May 9 03:29:13 server1 unix: [ID 100000 kern.notice]
May 9 03:29:13 server1 genunix: [ID 655072 kern.notice] fffffe800042aab0 unix:cmi_mca_panic+1e ()
May 9 03:29:13 server1 genunix: [ID 655072 kern.notice] fffffe800042aae0 unix:cmi_mca_trap+13d ()
May 9 03:29:13 server1 genunix: [ID 655072 kern.notice] fffffe800042aaf0 unix:mcetrap+17e ()
May 9 03:29:13 server1 genunix: [ID 655072 kern.notice] fffffe800042abe0 unix:i86_mwait+d ()
May 9 03:29:13 server1 genunix: [ID 655072 kern.notice] fffffe800042ac20 unix:cpu_idle_mwait+125 ()
May 9 03:29:13 server1 genunix: [ID 655072 kern.notice] fffffe800042ac40 unix:idle+89 ()
May 9 03:29:13 server1 genunix: [ID 655072 kern.notice] fffffe800042ac50 unix:thread_start+8 ()
May 9 03:29:13 server1 unix: [ID 100000 kern.notice]
May 9 03:29:13 server1 genunix: [ID 672855 kern.notice] syncing file systems...
May 9 03:29:14 server1 genunix: [ID 904073 kern.notice] done
May 9 03:29:15 server1 genunix: [ID 111219 kern.notice] dumping to /dev/zvol/dsk/rpool/dump, offset 65536, content: kernel
May 9 03:30:38 server1 genunix: [ID 100000 kern.notice]
May 9 03:30:38 server1 genunix: [ID 665016 kern.notice] ^M100% done: 656785 pages dumped,
May 9 03:30:38 server1 genunix: [ID 851671 kern.notice] dump succeeded
If you have Oracle Support, please open a Service Request and send the core file to Oracle Kernel Team for analysis.
Regards.
</SQ>

HELP! 64-bit JRE for JDK1.4/Solaris --crash and burn.

I'm trying to use the 64-bit version of Solaris j2se 1.4
I can't even run HelloWorld. I see:
# HotSpot Virtual Machine Error, Internal Error
# Please report this error at
# http://java.sun.com/cgi-bin/bugreport.cgi
# Java VM: Java HotSpot(TM) 64-Bit Server VM (1.4.0-beta3-b84 mixed mode)
# Error ID: 554E534146450E4350500263 FF
# Problematic Thread: prio=5 tid=0x10010e310 nid=0x1 runnable
I'm trying to run this as cleanly as possible.
* There are no extra security providers installed.
* The classpath is set to .
* The install was not completely successful.
I was forced to link
jre/lib/sparcv9/libjvm.so --> ./server/libjvm.so
because there is no "client" directory where the link
is set in the ordinary (lib/sparc) directory.

Followup:
What kernel / Jumbo patch level is required to run
the 64-bit jvm? I suspect that we are using a much-to-old version, but I would like this suspicion verified.
thanks,
peter

Solaris 9 panic

My solaris crash every week, one or two times.
# uname -a
SunOS venus 5.9 Generic_117171-02 sun4u sparc SUNW,Sun-Blade-100
#tail /var/adm/messages
Sep 9 12:08:55 venus unix: [ID 836849 kern.notice]
Sep 9 12:08:55 venus ^Mpanic[cpu0]/thread=30002de4aa0:
Sep 9 12:08:56 venus unix: [ID 799565 kern.notice] BAD TRAP: type=34 rp=2a1005bd2f0 addr=1 mmu_fsr=0
Sep 9 12:08:56 venus unix: [ID 100000 kern.notice]
Sep 9 12:08:56 venus unix: [ID 839527 kern.notice] Xsun:
Sep 9 12:08:56 venus unix: [ID 123557 kern.notice] alignment error:
Sep 9 12:08:56 venus unix: [ID 381800 kern.notice] addr=0x1
Sep 9 12:08:56 venus unix: [ID 101969 kern.notice] pid=345, pc=0x1128ee8, sp=0x2a1005bcb91, tstate=0x80001601, context=0x188
4
Sep 9 12:08:56 venus unix: [ID 743441 kern.notice] g1-g7: 1128ecc, 0, 30000603d70, 4, 3000077dc00, 0, 30002de4aa0
Sep 9 12:08:56 venus unix: [ID 100000 kern.notice]
Sep 9 12:08:56 venus genunix: [ID 723222 kern.notice] 000002a1005bd020 unix:die+a4 (34, 2a1005bd2f0, 1, 0, 159000, 0)
Sep 9 12:08:56 venus genunix: [ID 179002 kern.notice] %l0-3: 0000000000000000 00000000007f8090 0000000000000009 0000000001
499890
Sep 9 12:08:56 venus %l4-7: 0000000000000034 0000000003002250 000003000000b400 00000300011e6ac0
Sep 9 12:08:56 venus genunix: [ID 723222 kern.notice] 000002a1005bd100 unix:trap+59c (2a1005bd2f0, 0, 10000, 10200, 0, ff00)
Sep 9 12:08:57 venus genunix: [ID 179002 kern.notice] %l0-3: 0000000000000001 000000000080000f 0000030002dda050 0000000000
000034
Sep 9 12:08:57 venus %l4-7: 0000030002de23c8 000003000000b618 0000000000000000 0000000000000000
Sep 9 12:08:57 venus genunix: [ID 723222 kern.notice] 000002a1005bd240 unix:ktl0+48 (0, 1, 1, 2a1005bd448, 2a1005bd444, 0)
Sep 9 12:08:57 venus genunix: [ID 179002 kern.notice] %l0-3: 0000000000000002 0000000000001400 0000000080001601 0000000001
02cb04
Sep 9 12:08:57 venus %l4-7: 000003000000b618 0000030001677c80 0000000000000000 000002a1005bd2f0
Sep 9 12:08:57 venus genunix: [ID 723222 kern.notice] 000002a1005bd390 genunix:power_dev+224 (1, 2, 1, 0, 0, 1)
Sep 9 12:08:57 venus genunix: [ID 179002 kern.notice] %l0-3: 000003000028a758 0000000000000000 0000000000000001 0000000000
000001
Sep 9 12:08:57 venus %l4-7: 0000000000000002 0000000000000000 000003000028a758 0000000000000001
Sep 9 12:08:57 venus genunix: [ID 723222 kern.notice] 000002a1005bd470 genunix:pm_set_power+428 (58, 0, 2, 2, 3000060d000, 3
0000957dd0)
Sep 9 12:08:57 venus genunix: [ID 179002 kern.notice] %l0-3: 0000000000000002 000003000028a758 000003000028dd10 0000000000
000001
Sep 9 12:08:57 venus %l4-7: 0000000000000001 0000000000000000 0000000000000002 0000000000000000
Sep 9 12:08:58 venus genunix: [ID 723222 kern.notice] 000002a1005bd570 pm:pm_ioctl+1774 (1, 0, 0, 100003, 3000025fa48, 2a100
5bdaec)
Sep 9 12:08:58 venus genunix: [ID 179002 kern.notice] %l0-3: 000003000060d000 0000000000010000 000003000028a758 0000000001
496ca0
Sep 9 12:08:58 venus %l4-7: 0000000001492840 0000000001447000 0000030002de4aa0 0000000001447000
Sep 9 12:08:58 venus genunix: [ID 723222 kern.notice] 000002a1005bd9a0 genunix:ioctl+1f8 (e, 2c, 153160, e, 155ffc, ffbfeab0
Sep 9 12:08:58 venus genunix: [ID 179002 kern.notice] %l0-3: 000000000117e44c 000000000000002c 000000000000000e 0000000000
000023
Sep 9 12:08:58 venus %l4-7: 000003000094d9e0 0000000000000076 0000000000155ff4 0000000081010100
Sep 9 12:08:58 venus unix: [ID 100000 kern.notice]
Sep 9 12:08:58 venus genunix: [ID 672855 kern.notice] syncing file systems...
Sep 9 12:08:58 venus genunix: [ID 733762 kern.notice] 1
Sep 9 12:09:20 venus last message repeated 20 times
Sep 9 12:09:21 venus genunix: [ID 622722 kern.notice] done (not all i/o completed)
Sep 9 12:09:22 venus genunix: [ID 111219 kern.notice] dumping to /dev/dsk/c0t0d0s1, offset 107479040, content: kernel
Sep 9 12:09:29 venus genunix: [ID 409368 kern.notice] ^M100% done: 10959 pages dumped, compression ratio 3.26,
Sep 9 12:09:29 venus genunix: [ID 851671 kern.notice] dump succeeded
What is the problem? and how can I find the problem?
How can I fix the problem?
Any comments will be appreciated
Thanks in advance
Julxu

The easiest way is to get this core dump into a debugger and get the problem finalized. adb like debugger would do this. But you need to be an expert of memory addresses conventions and solaris internals. This is something that requires training. Another way is to see the problem step by step. Is there any script that runs that day otr a day before. Do you have some specific entry in your crontab. I see some ECC (error check control) ram problems. Some extra load on server cause CPU/RAM faults to be visible.

How to find reason for system crash?

Hello,
I have a test system running in VirtualBox environment and its crashing every now and then, sometimes two times a day but sometimes it lasts for 3 days before crash happens.
system info
root>cat /etc/*release*
Solaris 10 10/09 s10x_u8wos_08a X86
root>uname -a
SunOS 5.10 Generic_142910-17 i86pc i386 i86pc
dump files
root>ls -l vmdump.*
-rw-r--r-- 1 root root 116064256 Jan 13 05:35 vmdump.0
-rw-r--r-- 1 root root 108003328 Jan 13 10:15 vmdump.1
-rw-r--r-- 1 root root 112852992 Jan 14 18:53 vmdump.2
-rw-r--r-- 1 root root 129236992 Jan 17 08:41 vmdump.3
-rw-r--r-- 1 root root 122486784 Jan 17 16:39 vmdump.4
started to use mdb
root@cs5vs01>mdb -k unix.4 vmcore.4
Loading modules: [ unix krtld genunix specfs dtrace cpu.generic uppc pcplusmp ufs ipc ip hook neti sctp arp usba fctl nca lofs zfs nfs random md cpc fcip sppp ]
::stack
vpanic()
kadmin+0x517()
uadmin+0xc7()
sys_syscall+0x17b()
$C
fffffe800100ee60 vpanic()
fffffe800100eeb0 kadmin+0x517()
fffffe800100ef00 uadmin+0xc7()
fffffe800100ef10 sys_syscall+0x17b()I wonder how I can continue from this point? Any support would be greatly appreciated!
Anyone knows about a good step by step debug guide? For example how to logically track down the root cause, good example commands and so on?
Thank you!
BR
Daniel

We can see from the following stack that the panic was caused by someone or some app calling uadmin(1M)
$C
fffffe800100ee60 vpanic()
fffffe800100eeb0 kadmin+0x517()
fffffe800100ef00 uadmin+0xc7()
fffffe800100ef10 sys_syscall+0x17b()
So the question is who/what. ::ptree will give you the process tree and you should see from that the execname responsible. What apps do you have running in this VBOX environment? Oracle RAC uses the uadmin interface because it doesn't have a failfast driver of it's own. There are several other applications who also use the uadmin syscall for similar reasons. Normally they panic the node/system because something has timed out and they need to restore cluster/system stability and integrity.
With regards to the step-by-step guide, no such document exists because it's impossible to write one. Each crash dump is different, each person does things slightly differently. What you need to do is understand how to use the tools (typically mdb or scat) and then start poking about in crash dumps. In fact you may find scat (Solaris Crash Analysis Tool) more user friendly and easier to learn than mdb. SCAT can be downloaded from https://cds.sun.com/is-bin/INTERSHOP.enfinity/WFS/CDS-CDS_SMI-Site/en_US/-/USD/ViewProductDetail-Start?ProductRef=SCAT-5.2-G-F@CDS-CDS_SMI
There's some information for mdb in the man page and at the following locations:
http://dlc.sun.com/osol/docs/content/MODDEBUG/intro-1.html
http://download.oracle.com/docs/cd/E19253-01/816-5041/index.html
Unfortunately Crash Dump Analysis (CDA) isn't something that can easily be done via the forums. If you raise a service request it'll come to the Kernel group and we can then have a look for you.
Regards,
Steve

Solaris 10 CAT

I was looking for Solaris CAT for Solaris 10. Does anyone know where I can find it?
I read somewhere there was SCAT 4.1 which doesn't support Solaris 10 and Sun would come up
with 4.2 or 5.0 version.
Thanks in advance.
Edited by: Samurai_123 on Feb 29, 2008 8:51 AM

[http://developers.sun.com/solaris/articles/manage_core_dump.html|http://developers.sun.com/solaris/articles/manage_core_dump.html]
There is no other version available. References from above link:
References
* Man pages for signal(3HEAD) (base signals), coredmp(1M), dumpadm(1M), and proc(1)
* Sun Studio 12: Debugging a Program with dbx, on docs.sun.com
* Sun Info Doc number 13258 and Sun Info Doc number 15553 (Note: This content is available to registered SunSolve users with a valid Sun Service Plan.)
* Sun Studio web site
* Solaris Crash Analysis Tool download
* Greg Nakhimovsky's AppCrash blog
* AppCrash
* Solaris Dynamic Tracing Guide
* DTrace How To Guide
Worth a look. YMMV
Good Luck.

Concurrent accessing of a static method

Hi,
We have an online application, which has some methods in the middle tier that have been declared as "static".
Application is running fine with less number of users but when the load is increasing the application is crashing with a core dump.
The application is running on Solaris.
Can somebody give some inputs on what can be wrong in this scenario.
Thanks in advance..
Niranjan

Application is running fine with less number of
users but when the load is increasing the application
is crashing with a core dump.
The application is running on Solaris.Crashes with a core dump and no stack trace? Then your application does something very bad to the JVM, or the JVM is buggy. Maybe it's enougth to upgrade to the latest stable Java version.

Shutdown immediate won't work, Must abort to switch to SunCluster standby

Customer has a Solaris Clusterware, The customer sees the semtimedop() system call returning EAGAIN when running "shutdown immediate" on their database on one cluster node. This is expected when the shared resource that the semaphore is protecting is unavailable. The shared resource is only being used by Oracle processes, so we need to know what the resource is and what the other processes are doing with it. MOS doc 760968.1 isn't helpful. A Solaris crash dump taken when the database shutdown problem was occurring showed no signs of an OS issue so database assistance is needed.
We have tried to capture the following trace, but the trace is empty , and we 're stuck since then.
SQL> alter session set events '10046 trace name context forever,level 12';
SQL> alter session set events '10400 trace name context forever, level 1';
SQL> shutdown immediate;

don't you think it is about time you upgraded to something that hasn't been out of support since 2007 (almost 6 years ago...???). Hopefully you don't have any CC information stored in that db as there has not been any security updates since before it went to de-support.
What I would like to know is how did you even get 9i to install on Solaris 10? IIRC, that is not even a supported OS/Oracle version configuration. As for your current problem,
http://www.lmgtfy.com/?q=oracle+9i+suncluster+failover
http://docs.oracle.com/cd/E19787-01/820-2574/gctbk/index.html

Diagnostic tools

How can I tell what has caused the system to crash.
Cheers
hamm

If your system has crashed and has generated a crash dump (a vmcore and a unix file
located by default into /var/crash/`hostname`) then you need to analyse this crash dump.
The primary tool to do this analysis is mdb(1) (or adb(1) prior Solaris 8) but you usually
need to know a lot about Solaris kernel internals and processor assembly language.
Alternatively you can use the Solaris Crash Analysis Tool which is a bit easier to use:
http://wwws.sun.com/software/download/products/3fce7df0.html
If your system has crashed without generating a crash dump, then you have to look at any
messages printed on the console or in the message files before the systems has crashed.
Some hardware error can also be reported by the prtdiag(1m) command after the system
has rebooted.
In any case if your system has crashed and you want to find the root cause of the problem,
the simplest solution is to contact the Sun Support Services and they will investigate your
issue to determine what has happened.

W2100z power-on and keyboard issue

My w2100z is having power-on issue, probably due to mal-funtioning USB/keyboard.
Sometimes it stays at black window forever after power-on, when it does reach the bios screen, it reports keyboard error.
The keyboard doesn't receive any power from the box (no light).
Solaris crashes immediately during boot, reporting some kind of unrecoverable machine check error.
I supppose it's during attaching some device driver.
I tried different keyboard on each every USB port, same result.
Without USB/keybord, this $3000+ box is useless (OS can't boot, can't install new OS).
It is out of warranty now, that's why I am posting here, or can I buy new warranty for one year and get this fixed?
Please give me some idea, Thanks!

Michael,
I would recommend to re-post on the Solaris x86 yahoo
group.Just did that.
While is a hardware issue, there are far more Sun
employees that may be able (and willing) to "ask
around" among their colleagues.I hope so.
With a SPARC based Sun, one would just attach to the
(serial) console port and diagnose the system ....yes, yes.
Did you follow the Troubleshooting Procedures from
the User's Guide (e.g. reseating DIMMs/add-in boards,
booting from the Sun Java Workstation W1100z and
W2100z Supplemental CD to run the Pc-Check
Diagnostics) ?I did try to clean up the internals, make sure everthing is seated well.
As for the diag, the CD waits for keyboard input to choose from the top menu !
Thanks for your reply.
Tao

Report Engine crashing on Solaris when report with graph is given.

Hi,
We are using following environment:
Solaris 8
Oracle 9i Report Sevices.
When we try to execute reports having graphs then the report engine crashes with the following exception:
REP-0177: Error while running in remote server
REP-56048: Engine rwEng-0 crashed
The complete crash log is also appendend in the end of this mail.
When I remove the graph from the rdf then reports get exectued fine without any crash. The same rdg with graph works fine on windows NT.
If somebody can help on this, it will be great.
Thanks,
Ashish
The complete crash log is as follows:
An unexpected exception has been detected in native code outside the VM.
Unexpected Signal : 11 occurred at PC=0xf017b350
Function name=_Xm21FreeHashTable
Library=/usr/lib/libXm.so.4
Current Java thread:
     at sun.awt.motif.MWindowPeer.create(Native Method)
     at sun.awt.motif.MComponentPeer.init(MComponentPeer.java:169)
     at sun.awt.motif.MWindowPeer.init(MWindowPeer.java:86)
     at sun.awt.motif.MFramePeer.<init>(MFramePeer.java:53)
     at sun.awt.motif.MToolkit.createFrame(MToolkit.java:138)
     at java.awt.Frame.addNotify(Frame.java:353)
     at java.awt.Window.pack(Window.java:369)
     at tdg.Perspective.<init>(Perspective.java:478)
     at oracle.dss.graph.PFJ.<init>(PFJ.java:47)
     at oracle.dss.graph.Graph.createPFJ(Graph.java:1190)
     at oracle.dss.graph.Graph._setupGraphView(Graph.java:353)
     at oracle.dss.graph.Graph.<init>(Graph.java:164)
     at oracle.reports.chart.Chart.<init>(Chart.java:51)
     at oracle.reports.chart.ChartRunner.<init>(ChartRunner.java:46)
     at oracle.reports.engine.EngineImpl.CRunReport(Native Method)
     at oracle.reports.engine.EngineImpl.run(EngineImpl.java:289)
     at oracle.reports.engine.EngineClassPOATie.run(EngineClassPOATie.java:84)
     at oracle.reports.engine.EngineClassPOA._invoke(EngineClassPOA.java:117)
     at oracle.reports.engine.EngineClassPOA._invoke(EngineClassPOA.java:62)
     at com.inprise.vbroker.poa.POAImpl.invoke(POAImpl.java:2355)
     at com.inprise.vbroker.poa.ActivationRecord.invoke(ActivationRecord.java:104)
     at com.inprise.vbroker.GIOP.GiopProtocolAdapter.doRequest(GiopProtocolAdapter.java:492)
     at com.inprise.vbroker.IIOP.ServerProtocolAdapter.doRequest(ServerProtocolAdapter.java:64)
     at com.inprise.vbroker.GIOP.GiopProtocolAdapter.dispatchMessage(GiopProtocolAdapter.java:653)
     at com.inprise.vbroker.orb.TPDispatcherImpl$TPDispatcher.run(TPDispatcherImpl.java:99)
     at com.inprise.vbroker.orb.ThreadPool$PoolWorker.run(ThreadPool.java:76)
Dynamic libraries:
0x10000      /users/orarep9i/OraHome1/jdk/jre/bin/../bin/sparc/native_threads/java
0xff350000      /usr/lib/libthread.so.1
0xff390000      /usr/lib/libdl.so.1
0xff200000      /usr/lib/libc.so.1
0xff330000      /usr/platform/SUNW,Ultra-60/lib/libc_psr.so.1
0xfe480000      /users/orarep9i/OraHome1/jdk/jre/lib/sparc/client/libjvm.so
0xff2d0000      /usr/lib/libCrun.so.1
0xff1d0000      /usr/lib/libsocket.so.1
0xff100000      /usr/lib/libnsl.so.1
0xff0d0000      /usr/lib/libm.so.1
0xff310000      /usr/lib/libw.so.1
0xff0b0000      /usr/lib/libmp.so.2
0xff080000      /users/orarep9i/OraHome1/jdk/jre/lib/sparc/native_threads/libhpi.so
0xff040000      /users/orarep9i/OraHome1/jdk/jre/lib/sparc/libverify.so
0xfe440000      /users/orarep9i/OraHome1/jdk/jre/lib/sparc/libjava.so
0xfe410000      /users/orarep9i/OraHome1/jdk/jre/lib/sparc/libzip.so
0xf3be0000      /users/orarep9i/OraHome1/jdk/jre/lib/sparc/libnet.so
0xf3bc0000      /users/orarep9i/OraHome1/jdk/jre/lib/sparc/libioser12.so
0xf39e0000      /usr/lib/nss_nis.so.1
0xf2000000      /users/orarep9i/OraHome1/lib/librw90.so
0xf1d00000      /users/orarep9i/OraHome1/lib/libobx90.so.0
0xf36b0000      /users/orarep9i/OraHome1/lib/librws90.so.0
0xf2a80000      /users/orarep9i/OraHome1/lib/libde90.so.0
0xf2fc0000      /users/orarep9i/OraHome1/lib/libucol90.so.0
0xf39b0000      /users/orarep9i/OraHome1/lib/libuicc90.so.0
0xf2ea0000      /users/orarep9i/OraHome1/lib/libca90.so.0
0xf35e0000      /users/orarep9i/OraHome1/lib/libmma90.so.0
0xf2dc0000      /users/orarep9i/OraHome1/lib/libmmiw90.so.0
0xf3860000      /users/orarep9i/OraHome1/lib/libmmov90.so.0
0xf2f90000      /users/orarep9i/OraHome1/lib/libmmos90.so.0
0xf2cc0000      /users/orarep9i/OraHome1/lib/libmmoi90.so.0
0xf32e0000      /users/orarep9i/OraHome1/lib/libmmia90.so.0
0xf2da0000      /users/orarep9i/OraHome1/lib/libmmft90.so.0
0xf1fc0000      /users/orarep9i/OraHome1/lib/libmmcm90.so.0
0xf1c00000      /users/orarep9i/OraHome1/lib/libvgs90.so.0
0xf2ca0000      /users/orarep9i/OraHome1/lib/libuihx90.so.0
0xf1b90000      /users/orarep9i/OraHome1/lib/libuc90.so.0
0xf1b20000      /users/orarep9i/OraHome1/lib/libuipr90.so.0
0xf1900000      /users/orarep9i/OraHome1/lib/libuimotif90.so.0
0xf1ae0000      /users/orarep9i/OraHome1/lib/libot90.so.0
0xf18a0000      /users/orarep9i/OraHome1/lib/librem90.so.0
0xf1820000      /users/orarep9i/OraHome1/lib/libree90.so.0
0xf1fa0000      /users/orarep9i/OraHome1/lib/librec90.so.0
0xf17f0000      /users/orarep9i/OraHome1/lib/libuiimg90.so.0
0xf17b0000      /users/orarep9i/OraHome1/lib/libuia90.so.0
0xf2a60000      /users/orarep9i/OraHome1/lib/libtknqap90.so.0
0xf1780000      /users/orarep9i/OraHome1/lib/libutt90.so.0
0xf1750000      /users/orarep9i/OraHome1/lib/librod90.so.0
0xf1720000      /users/orarep9i/OraHome1/lib/libror90.so.0
0xf16f0000      /users/orarep9i/OraHome1/lib/libros90.so.0
0xf16c0000      /users/orarep9i/OraHome1/lib/libuat90.so.0
0xf16a0000      /users/orarep9i/OraHome1/lib/libdfc90.so.0
0xf1680000      /users/orarep9i/OraHome1/lib/libutc90.so.0
0xf1660000      /users/orarep9i/OraHome1/lib/libutj90.so.0
0xf1630000      /users/orarep9i/OraHome1/lib/libutl90.so.0
0xf1610000      /users/orarep9i/OraHome1/lib/libsl90.so.0
0xf0c00000      /users/orarep9i/OraHome1/lib/libclntsh.so.9.0
0xf15f0000      /users/orarep9i/OraHome1/lib/libwtc9.so
0xf15d0000      /usr/lib/libsched.so.1
0xf15b0000      /usr/lib/libaio.so.1
0xf0a00000      /usr/lib/libXm.so.3
0xf1540000      /usr/lib/libXt.so.4
0xf0900000      /usr/lib/libX11.so.4
0xf1520000      /usr/lib/libgen.so.1
0xf1500000      /usr/lib/librt.so.1
0xf14e0000      /usr/lib/libSM.so.6
0xf14b0000      /usr/lib/libICE.so.6
0xf1480000      /usr/lib/libXext.so.0
0xf0bd0000      /usr/openwin/lib/libdga.so.1
0xf0bb0000      /users/orarep9i/OraHome1/jdk/jre/lib/sparc/libawt.so
0xf0280000      /users/orarep9i/OraHome1/jdk/jre/lib/sparc/motif21/libmawt.so
0xf09b0000      /users/orarep9i/OraHome1/jdk/jre/bin/../lib/sparc/libmlib_image.so
0xf0000000      /usr/lib/libXm.so.4
0xf08e0000      /usr/openwin/lib/libXtst.so.1
0xeff00000      /users/orarep9i/OraHome1/jdk/jre/lib/sparc/libfontmanager.so
0xf07a0000      /usr/openwin/lib/libdps.so.5
Local Time = Fri Apr 18 09:22:09 2003
Elapsed Time = 110
# The exception above was detected in native code outside the VM
# Java VM: Java HotSpot(TM) Client VM (1.3.1_02-b02 mixed mode)

Please try the following
* Modify $ORACLE_HOME/bin/reports.sh, replace "classic"
with "server" in the LD_LIBRARY_PATH for the JVM
* Modify $ORACLE_HOME/bin/rwengine.sh, just before the exec
command, insert the following line:
export LD_PRELOAD=$ORACLE_HOME/jdk/jre/lib/i386/libawt.so
In Linux there was a similar problem and the above workaround worked . You can give this a try .
Thanks
The Oracle Reports Team

Solaris 10 crashing

Similar Messages

Maybe you are looking for