IPQoS panic: BAD TRAP in module "flowacct" due to NULL pointer.

I've recently started using IPQoS and the flowacct module to do some very simple tracking of bandwidth usage (along with one tokenmt action to meter traffic to and from one particular zone) on a host with multiple zones, running Solaris 10 x86, 118844-30. This host has been otherwise stable to date. A couple of hours ago, I got a kernel panic, apparently caused by flowacct:
Dec 21 07:31:46 sol genunix: [ID 335743 kern.notice] BAD TRAP: type=e (#pf Page fault) rp=d6e169a4 addr=8 occurred in module "flowacct" due to a NULL pointer dereference
Dec 21 07:31:46 sol unix: [ID 100000 kern.notice]
Dec 21 07:31:46 sol unix: [ID 839527 kern.notice] named:
Dec 21 07:31:46 sol unix: [ID 753105 kern.notice] #pf Page fault
Dec 21 07:31:46 sol unix: [ID 532287 kern.notice] Bad kernel fault at addr=0x8
Dec 21 07:31:46 sol unix: [ID 243837 kern.notice] pid=22655, pc=0xf7cad802, sp=0xd, eflags=0x10283
Dec 21 07:31:46 sol unix: [ID 211416 kern.notice] cr0: 8005003b<pg,wp,ne,et,ts,mp,pe> cr4: 6d8<xmme,fxsr,pge,mce,pse,de>
Dec 21 07:31:46 sol unix: [ID 936844 kern.notice] cr2: 8 cr3: ab02000
Dec 21 07:31:46 sol unix: [ID 537610 kern.notice]      gs: 1b0 fs: d6250000 es: d6e10160 ds: fe870160
Dec 21 07:31:46 sol unix: [ID 537610 kern.notice]      edi: d3b25938 esi: d3b26838 ebp: d6e16a18 esp: d6e169d4
Dec 21 07:31:46 sol unix: [ID 537610 kern.notice]      ebx: db0853b4 edx: d3b26828 ecx: 0 eax: 0
Dec 21 07:31:46 sol unix: [ID 537610 kern.notice]      trp: e err: 2 eip: f7cad802 cs: 158
Dec 21 07:31:46 sol unix: [ID 717149 kern.notice]      efl: 10283 usp: d ss: d65fd9c0
Dec 21 07:31:46 sol unix: [ID 100000 kern.notice]
Dec 21 07:31:46 sol genunix: [ID 353471 kern.notice] d6e16904 unix:die+a7 (e, d6e169a4, 8, 0)
Dec 21 07:31:46 sol genunix: [ID 353471 kern.notice] d6e16990 unix:trap+fc8 (d6e169a4, 8, 0)
Dec 21 07:31:46 sol genunix: [ID 353471 kern.notice] d6e169a4 unix:cmntrap+83 ()
Dec 21 07:31:46 sol genunix: [ID 353471 kern.notice] d6e16a18 flowacct:flowacct_update_flows_tbl+337 (d65fd9c0, d3b25000)
Dec 21 07:31:47 sol genunix: [ID 353471 kern.notice] d6e16a34 flowacct:flowacct_process+85 (d6e16a4c, d3b25000)
Dec 21 07:31:47 sol genunix: [ID 353471 kern.notice] d6e16a50 flowacct:flowacct_invoke_action+32 (d, dfa9cd00)
Dec 21 07:31:47 sol genunix: [ID 353471 kern.notice] d6e16a7c genunix:ipp_packet_process+fc (d6e16a94)
Dec 21 07:31:47 sol genunix: [ID 353471 kern.notice] d6e16a9c ip:ip_process+85 (2, d6e16ac8, 2)
Dec 21 07:31:47 sol genunix: [ID 353471 kern.notice] d6e16ac0 ip:ip_wput_attach_llhdr+92 (dccbf020, d92d61f8,)
Dec 21 07:31:47 sol genunix: [ID 353471 kern.notice] d6e16b50 ip:ip_wput_ire+1792 (d7196ee0, dccbf020,)
Dec 21 07:31:47 sol genunix: [ID 353471 kern.notice] d6e16ba8 ip:ip_output+70a (d7414e80, dccbf020,)
Dec 21 07:31:47 sol genunix: [ID 353471 kern.notice] d6e16bc0 ip:ip_wput+14 (d7196ee0, dccbf020)
Dec 21 07:31:47 sol genunix: [ID 353471 kern.notice] d6e16bf4 unix:putnext+1b7 (d7196ee0, dccbf020)
Dec 21 07:31:47 sol genunix: [ID 353471 kern.notice] d6e16c40 udp:udp_wput+380 (d5aabc98, dcf78360)
Dec 21 07:31:47 sol genunix: [ID 353471 kern.notice] d6e16c74 unix:putnext+1b7 (d5aabc98, dcf78360)
Dec 21 07:31:47 sol genunix: [ID 353471 kern.notice] d6e16d54 genunix:strput+16b (d9ad6138, dcf78360,)
Dec 21 07:31:47 sol genunix: [ID 353471 kern.notice] d6e16d90 genunix:kstrputmsg+1df (d5c24cc0, dcf12660,)
Dec 21 07:31:47 sol genunix: [ID 353471 kern.notice] d6e16e0c sockfs:sosend_dgram+1ca (d5c32d60, dc3504d0,)
Dec 21 07:31:47 sol genunix: [ID 353471 kern.notice] d6e16e50 sockfs:sotpi_sendmsg+3f1 (d5c32d60, d6e16ecc,)
Dec 21 07:31:47 sol genunix: [ID 353471 kern.notice] d6e16e90 sockfs:sendit+105 (16, d6e16ecc, d6e16)
Dec 21 07:31:47 sol genunix: [ID 353471 kern.notice] d6e16f8c sockfs:sendmsg+131 (16, ce4d5cc4, 8000,)
I had a single "kstat -m flowacct 90" running at the time, but the timing doesn't particularly coincide. My flowacct setting look like this:
action {
module flowacct
name zone1
params {
global_stats TRUE
timer 10000
timeout 10000
max_limit 2048
next_action continue
Pretty much a cut and paste from the Solaris 10 IPQoS documentation. This configuration didn't suffer any similar problems on a test host.
I've searched various places, not had any joy. Obviously, I'm down a while on kernel patching (ironically, I've been holding off to minimise downtime for users, and now this.) But, while 118855-19 does replace some of objects in question, I see no mention of any particular fix for this problem. I'm going to go ahead with patching to 118855-19 (and whatever else smpatch recommends) within the next few days, but I've disabled IPQoS. I'm a little nervous about switching it back on on a production server. Shame.
Anyone had any similar experiences with flowacct?
Cheers,
Chris.

Good news, everyone! A repeat on a test host that's patched up to date as of last week, including kernel 118855-19. I'd tell you what smpatch thinks is missing, but "Failure: Response code was 403".
Dec 23 09:43:14 crippen ^Mpanic[cpu0]/thread=d3275de0:
Dec 23 09:43:14 crippen genunix: [ID 335743 kern.notice] BAD TRAP: type=e (#pf Page fault) rp=d3275924 addr=8 occurred in module "flowacct" due to a NULL pointer dereference
Dec 23 09:43:14 crippen unix: [ID 100000 kern.notice]
Dec 23 09:43:14 crippen unix: [ID 839527 kern.notice] sched:
Dec 23 09:43:14 crippen unix: [ID 753105 kern.notice] #pf Page fault
Dec 23 09:43:14 crippen unix: [ID 532287 kern.notice] Bad kernel fault at addr=0x8
Dec 23 09:43:14 crippen unix: [ID 243837 kern.notice] pid=0, pc=0xf9a413ae, sp=0x6, eflags=0x10286
Dec 23 09:43:14 crippen unix: [ID 211416 kern.notice] cr0: 8005003b<pg,wp,ne,et,ts,mp,pe> cr4: 698<xmme,fxsr,pge,pse,de>
Dec 23 09:43:14 crippen unix: [ID 936844 kern.notice] cr2: 8 cr3: 4cdc000
Dec 23 09:43:14 crippen unix: [ID 537610 kern.notice] gs: fe8801b0 fs: fe830000 es: d4890160 ds: d4890160
Dec 23 09:43:14 crippen unix: [ID 537610 kern.notice] edi: d489b6a0 esi: d489b838 ebp: d32759a0 esp: d327595c
Dec 23 09:43:14 crippen unix: [ID 537610 kern.notice] ebx: d66187f4 edx: d489b828 ecx: 0 eax: 0
Dec 23 09:43:14 crippen unix: [ID 537610 kern.notice] trp: e err: 2 eip: f9a413ae cs: 158
Dec 23 09:43:14 crippen unix: [ID 717149 kern.notice] efl: 10286 usp: 6 ss: d6d35d80
Dec 23 09:43:14 crippen unix: [ID 100000 kern.notice]
Dec 23 09:43:14 crippen genunix: [ID 353471 kern.notice] d3275884 unix:die+a7 (e, d3275924, 8, 0)
Dec 23 09:43:14 crippen genunix: [ID 353471 kern.notice] d3275910 unix:trap+103f (d3275924, 8, 0)
Dec 23 09:43:14 crippen genunix: [ID 353471 kern.notice] d3275924 unix:cmntrap+9a (fe8801b0, fe830000,)
Dec 23 09:43:14 crippen genunix: [ID 353471 kern.notice] d32759a0 flowacct:flowacct_update_flows_tbl+337 (d6d35d80, d489a000)
Dec 23 09:43:14 crippen genunix: [ID 353471 kern.notice] d32759b8 flowacct:flowacct_process+85 (d32759d0, d489a000)
Dec 23 09:43:14 crippen genunix: [ID 353471 kern.notice] d32759d4 flowacct:flowacct_invoke_action+32 (6, d5441f80)
Dec 23 09:43:14 crippen genunix: [ID 353471 kern.notice] d3275a00 genunix:ipp_packet_process+fc (d3275a18)
Dec 23 09:43:14 crippen genunix: [ID 353471 kern.notice] d3275a20 ip:ip_process+85 (2, d3275a4c, 2)
Dec 23 09:43:14 crippen genunix: [ID 353471 kern.notice] d3275a44 ip:ip_wput_attach_llhdr+92 (d5e61fc0, d67b1ad0,)
Dec 23 09:43:14 crippen genunix: [ID 353471 kern.notice] d3275ad0 ip:ip_wput_ire+1aca (d4186c60, d5e61fc0,)
Dec 23 09:43:14 crippen genunix: [ID 353471 kern.notice] d3275b30 ip:ip_output+1715 (da1b7554, d5e61fc0,)
Dec 23 09:43:14 crippen genunix: [ID 353471 kern.notice] d3275b48 ip:ip_wput+14 (d4186c60, d5aaff80)
Dec 23 09:43:14 crippen genunix: [ID 353471 kern.notice] d3275b74 unix:put+164 (d4186c60, d5aaff80)
Dec 23 09:43:14 crippen genunix: [ID 353471 kern.notice] d3275bb0 ip:icmp_inbound+97e (d4186bd8, d5e61fc0,)
Dec 23 09:43:14 crippen genunix: [ID 353471 kern.notice] d3275c00 ip:ip_proto_input+8ae (d4186bd8, d5e61fc0,)
Dec 23 09:43:14 crippen genunix: [ID 353471 kern.notice] d3275c58 ip:ip_input+440 (da1b7554, 0, d5e61f)
Dec 23 09:43:14 crippen genunix: [ID 353471 kern.notice] d3275c80 ip:ip_rput+f7 (d4186bd8, d5e61fc0)
Dec 23 09:43:14 crippen genunix: [ID 353471 kern.notice] d3275cb0 unix:putnext+1b7 (d4186bd8, d5e61fc0)
Dec 23 09:43:14 crippen genunix: [ID 353471 kern.notice] d3275d40 gld:gld_recv_tagged+ed (d4188800, d5e61fc0,)
Dec 23 09:43:14 crippen genunix: [ID 353471 kern.notice] d3275d54 gld:ri_ste_def+2603276e (d4188800, d5e61fc0)
Dec 23 09:43:14 crippen genunix: [ID 353471 kern.notice] d3275d88 iprb:iprb_process_recv+1d4 (d4188800)
Dec 23 09:43:14 crippen genunix: [ID 353471 kern.notice] d3275da0 iprb:iprb_intr+61 (d4188800, d3275ddc,)
Dec 23 09:43:14 crippen genunix: [ID 353471 kern.notice] d3275dac gld:gld_intr+1e (d4188800, 0)
Dec 23 09:43:14 crippen unix: [ID 100000 kern.notice]
Dec 23 09:43:14 crippen genunix: [ID 672855 kern.notice] syncing file systems...
Dec 23 09:43:14 crippen genunix: [ID 733762 kern.notice] 4
Dec 23 09:43:15 crippen genunix: [ID 733762 kern.notice] 3
Dec 23 09:43:16 crippen genunix: [ID 904073 kern.notice] done
Dec 23 09:43:17 crippen genunix: [ID 111219 kern.notice] dumping to /dev/dsk/c0d0s1, offset 214695936, content: kernel
Dec 23 09:43:20 crippen genunix: [ID 409368 kern.notice] ^M100% done: 22636 pages dumped, compression ratio 2.72,
Dec 23 09:43:20 crippen genunix: [ID 851671 kern.notice] dump succeeded

Similar Messages

Kernel Panic: ...in module "ip" due to a NULL pointer dereference

I already had 2 panic-s in the IP module over the last 24 hours. I am running Solaris Express 11 - snv_151a - 2010.11.
I am trying to:
- decode which function is failing
- determine what's (who since its network) causing them
- find a bug fix for the problem
I have preserved both dumps via snapshots to be analyzed further as needed.
Here's the details:
unix: [ID 836849 kern.notice]
^Mpanic[cpu4]/thread=ffffff005c995c40:
genunix: [ID 335743 kern.notice] BAD TRAP: type=e (#pf Page fault) rp=ffffff005c995040 addr=20 occurred in module "ip" due to a NULL pointer dereference
unix: [ID 100000 kern.notice]
unix: [ID 839527 kern.notice] sched:
unix: [ID 753105 kern.notice] #pf Page fault
unix: [ID 532287 kern.notice] Bad kernel fault at addr=0x20
unix: [ID 243837 kern.notice] pid=0, pc=0xfffffffff7c3f005, sp=0xffffff005c995130, eflags=0x10246
unix: [ID 211416 kern.notice] cr0: 8005003b<pg,wp,ne,et,ts,mp,pe> cr4: 6f8<xmme,fxsr,pge,mce,pae,pse,de>
unix: [ID 624947 kern.notice] cr2: 20
unix: [ID 625075 kern.notice] cr3: 8c00000
unix: [ID 625715 kern.notice] cr8: c
unix: [ID 100000 kern.notice]
unix: [ID 592667 kern.notice] rdi: 0 rsi: ffffff0d5738c3a0 rdx: 1
unix: [ID 592667 kern.notice] rcx: 0 r8: ffffff005c995190 r9: ffffff005c99518c
unix: [ID 592667 kern.notice] rax: 0 rbx: ffffff0df67a1a54 rbp: ffffff005c9952a0
unix: [ID 592667 kern.notice] r10: 0 r11: 46 r12: ffffff0e29547a40
unix: [ID 592667 kern.notice] r13: ffffff0d5738c3a0 r14: 1 r15: ffffff0dbddf2a74
unix: [ID 592667 kern.notice] fsb: 0 gsb: ffffff0d35219080 ds: 4b
unix: [ID 592667 kern.notice] es: 4b fs: 0 gs: 1c3
unix: [ID 592667 kern.notice] trp: e err: 0 rip: fffffffff7c3f005
unix: [ID 592667 kern.notice] cs: 30 rfl: 10246 rsp: ffffff005c995130
unix: [ID 266532 kern.notice] ss: 38
unix: [ID 100000 kern.notice]
genunix: [ID 655072 kern.notice] ffffff005c994f20 unix:die+dd ()
genunix: [ID 655072 kern.notice] ffffff005c995030 unix:trap+1799 ()
genunix: [ID 655072 kern.notice] ffffff005c995040 unix:cmntrap+e6 ()
genunix: [ID 655072 kern.notice] ffffff005c9952a0 ip:tcp_input_data+38ad ()
genunix: [ID 655072 kern.notice] ffffff005c995330 ip:squeue_enter+440 ()
genunix: [ID 655072 kern.notice] ffffff005c995400 ip:ip_fanout_v4+48d ()
genunix: [ID 655072 kern.notice] ffffff005c995480 ip:ire_recv_local_v4+1ce ()
genunix: [ID 655072 kern.notice] ffffff005c995560 ip:ill_input_short_v4+69e ()
genunix: [ID 655072 kern.notice] ffffff005c995790 ip:ip_input+23b ()
genunix: [ID 655072 kern.notice] ffffff005c995820 mac:mac_rx_soft_ring_process+17a ()
genunix: [ID 655072 kern.notice] ffffff005c995960 mac:mac_rx_srs_proto_fanout+46f ()
genunix: [ID 655072 kern.notice] ffffff005c9959e0 mac:mac_rx_srs_drain+26e ()
genunix: [ID 655072 kern.notice] ffffff005c995a70 mac:mac_rx_srs_process+180 ()
genunix: [ID 655072 kern.notice] ffffff005c995ac0 mac:mac_rx_common+94 ()
genunix: [ID 655072 kern.notice] ffffff005c995b10 mac:mac_rx+ac ()
genunix: [ID 655072 kern.notice] ffffff005c995b50 mac:mac_rx_ring+4c ()
genunix: [ID 655072 kern.notice] ffffff005c995b90 igb:igb_intr_rx+5e ()
genunix: [ID 655072 kern.notice] ffffff005c995be0 unix:av_dispatch_autovect+7c ()
genunix: [ID 655072 kern.notice] ffffff005c995c20 unix:dispatch_hardint+33 ()
genunix: [ID 655072 kern.notice] ffffff005c965a10 unix:switch_sp_and_call+13 ()
genunix: [ID 655072 kern.notice] ffffff005c965a60 unix:do_interrupt+b1 ()
genunix: [ID 655072 kern.notice] ffffff005c965a70 unix:cmnint+ba ()
genunix: [ID 655072 kern.notice] ffffff005c965b60 unix:i86_mwait+d ()
genunix: [ID 655072 kern.notice] ffffff005c965bb0 unix:cpu_idle_mwait+f1 ()
genunix: [ID 655072 kern.notice] ffffff005c965be0 unix:cpu_acpi_idle+8d ()
genunix: [ID 655072 kern.notice] ffffff005c965bf0 unix:cpu_idle_adaptive+19 ()
genunix: [ID 655072 kern.notice] ffffff005c965c20 unix:idle+112 ()
genunix: [ID 655072 kern.notice] ffffff005c965c30 unix:thread_start+8 ()
unix: [ID 100000 kern.notice]
genunix: [ID 672855 kern.notice] syncing file systems...
genunix: [ID 904073 kern.notice] done
genunix: [ID 111219 kern.notice] dumping to /dev/zvol/dsk/rpool/dump, offset 65536, content: kernel
ahci: [ID 405573 kern.info] NOTICE: ahci0: ahci_tran_reset_dport port 0 reset port
ahci: [ID 405573 kern.info] NOTICE: ahci0: ahci_tran_reset_dport port 1 reset port

I'm not seeing any obvious bugs relating to the stack. There's something similar but it was fixed in b147. Can I suggest and recommend that you raise a Service Request so we can review the data and establish if this is a known or new bug. When creating the new service request it will need to go to the network team so the following will need to be used:
Product: Oracle Solaris Express
Component: Protocols and Routing
Sub-Component: IP - TCP/IP
Once the SR is raised, we'll need the crash dumps and explorer from the host in question.
If the crash dumps are of the form vmcore.n, then please gzip them
If the crash dumps are of the form vmdump.n then they are already in bzip2 format so please do not compress them.
Prefix the filenames with the SR number and upload them to https://supportfiles.sun.com and select "/cores" from the list of options in Step #2
Explorer will collect the configuration from the system which is useful for reviewing alongside the crash dump. It should live in /opt/SUNWexplo/bin/ and can be executed using /opt/SUNWexplo/bin/explorer. If it's not installed, please download it from Doc ID 6972175 - "Oracle Services Tools Bundle (STB) - Explorer, SNEEP, LWACT, RDA"
Regards,
Steve

Panic BAD TRAP errors

I get the following messages in /var/adm/messages after a crash on one of my Sun E450's. Does anyone know how to diagnose this correctly?
Apr 10 08:18:54 upgserver unix: [ID 836849 kern.notice]
Apr 10 08:18:54 upgserver ^Mpanic[cpu3]/thread=30001baba60:
Apr 10 08:18:54 upgserver unix: [ID 799565 kern.notice] BAD TRAP: type=31 rp=2a1
002d7470 addr=2b468050 mmu_fsr=0
Apr 10 08:18:54 upgserver unix: [ID 100000 kern.notice]
Apr 10 08:18:54 upgserver unix: [ID 839527 kern.notice] pageout:
Apr 10 08:18:54 upgserver unix: [ID 520581 kern.notice] trap type = 0x31
Apr 10 08:18:54 upgserver unix: [ID 381800 kern.notice] addr=0x2b468050
Apr 10 08:18:54 upgserver unix: [ID 101969 kern.notice] pid=2, pc=0x7835671c, sp
=0x2a1002d6d11, tstate=0x1180001603, context=0x0
Apr 10 08:18:54 upgserver unix: [ID 743441 kern.notice] g1-g7: 2a1002d77c8, 7000
1e1ef50, 70001e1d510, 2a1002d7688, 8500, 10, 30001baba60
Apr 10 08:18:54 upgserver unix: [ID 100000 kern.notice]
Apr 10 08:18:54 upgserver genunix: [ID 723222 kern.notice] 000002a1002d7190 unix
:die+a4 (31, 2a1002d7470, 2b468050, 0, 16, 60)
Apr 10 08:18:54 upgserver genunix: [ID 179002 kern.notice] %l0-3: 000000000000
0000 000000002b468000 000002a1002d7470 000002a1002d7360
Apr 10 08:18:54 upgserver %l4-7: 0000000000000031 0000000000000001 00000300002
d3b90 0000000000000000
Apr 10 08:18:54 upgserver genunix: [ID 723222 kern.notice] 000002a1002d7270 unix
:trap+8e4 (2a1002d7470, 0, 10000, 10200, 0, 60)
Apr 10 08:18:54 upgserver genunix: [ID 179002 kern.notice] %l0-3: 000000000000
0001 0000000000000000 0000030001baea20 0000000000000031

Just offhand I might guess divide by zero, but there could be other bad traps that will make you crash... divide by zero is a common one though.
The way to diagnose this of course would be examine the os core file with mdb, On sun solaris 10 (not sure if it is different on other platforms), do: mdb -k unix.n mvcore.n (where n=a number, for the core file of interest).
$C would list the stack trace of the process that kills the system, and if you found something of interest try
addressOfInterest::dis and look at the disasembled code and hopefully that would point you to the problem.
Cheers,
--Mordsith
Message was edited by:
Mordsith

BAD TRAP

Hello,
I tried to load my device driver with add_drv, then the system reboot itself and give me that message: reboot after panic: BAD TRAP: type=31 rp=2a1008dce10 addr=ff318a40 mmu_fsr=0.
I suspect an invalid memory access but I want to have some suggestions...
I develop on a Sunblade 1000 machine.
Thanks!!

Hello,
I tried to load my device driver with add_drv, then the system reboot itself and give me that message: reboot after panic: BAD TRAP: type=31 rp=2a1008dce10 addr=ff318a40 mmu_fsr=0.
I suspect an invalid memory access but I want to have some suggestions...
I develop on a Sunblade 1000 machine.
Thanks!!

ZFS on solaris10 panics HP Proliant server BAD TRAP page fault in kernel

When installing Solaris 9/10 on a HP Proliant DL 380 G5
the system resets when choosing ZFS as a root file system,
even after CPQary3 device driver has been installed.
The CPQary3 device driver is the latest version 2.3.0,is neccessary because of the presence of a HP Smart Array E200 Controller
and is installed sucessfully during the installation from DVD
When choosing UFS as a root file system, the OS installs fine.
But when zfs is used to configure a zps pool after the installation, the system resets again
Has anyone experienced the same problems ? knows how to solve this ?
Solaris installs fine when choosing UFS as a root file system.
After that, a second disk partition is created of type Other to hold a zfs pool with the following command:
zpool create datapool c0t0d0p2
After that the system PANICS: here is an extract from the /var/adm/messages files:
Mar 14 16:36:49 solarisintel ^Mpanic[cpu1]/thread=fffffe800069bc60:
Mar 14 16:36:49 solarisintel genunix: [ID 335743 kern.notice] BAD TRAP: type=e (#pf Page fault) rp=fffffe800069b940 addr=238 occurred in
module "unix" due to a NULL pointer dereference
Mar 14 16:36:49 solarisintel unix: [ID 100000 kern.notice]
Mar 14 16:36:49 solarisintel unix: [ID 839527 kern.notice] sched:
Mar 14 16:36:49 solarisintel unix: [ID 753105 kern.notice] #pf Page fault
Mar 14 16:36:49 solarisintel unix: [ID 532287 kern.notice] Bad kernel fault at addr=0x238
Mar 14 16:36:49 solarisintel unix: [ID 243837 kern.notice] pid=0, pc=0xfffffffffb8406fb, sp=0xfffffe800069ba38, eflags=0x10246
Mar 14 16:36:49 solarisintel unix: [ID 211416 kern.notice] cr0: 8005003b<pg,wp,ne,et,ts,mp,pe> cr4: 6f0<xmme,fxsr,pge,mce,pae,pse>
Mar 14 16:36:49 solarisintel unix: [ID 354241 kern.notice] cr2: 238 cr3: 11ada000 cr8: c
Mar 14 16:36:49 solarisintel unix: [ID 592667 kern.notice] rdi: 238 rsi: 4 rdx: fffffe800069bc60
Mar 14 16:36:49 solarisintel unix: [ID 592667 kern.notice] rcx: 14 r8: 0 r9: 0
Mar 14 16:36:49 solarisintel unix: [ID 592667 kern.notice] rax: 0 rbx: 238 rbp: fffffe800069ba60
Mar 14 16:36:49 solarisintel unix: [ID 592667 kern.notice] r10: 0 r11: 1 r12: 100000
Mar 14 16:36:49 solarisintel unix: [ID 592667 kern.notice] r13: 0 r14: 4 r15: ffffffffb3a61af0
Mar 14 16:36:49 solarisintel unix: [ID 592667 kern.notice] fsb: 0 gsb: ffffffff9b2ac800 ds: 43
Mar 14 16:36:49 solarisintel unix: [ID 592667 kern.notice] es: 43 fs: 0 gs: 1c3
Mar 14 16:36:49 solarisintel unix: [ID 592667 kern.notice] trp: e err: 2 rip: fffffffffb8406fb
Mar 14 16:36:49 solarisintel unix: [ID 592667 kern.notice] cs: 28 rfl: 10246 rsp: fffffe800069ba38
Mar 14 16:36:49 solarisintel unix: [ID 266532 kern.notice] ss: 30
Mar 14 16:36:49 solarisintel unix: [ID 100000 kern.notice]
Mar 14 16:36:49 solarisintel genunix: [ID 655072 kern.notice] fffffe800069b850 unix:die+da ()
Mar 14 16:36:49 solarisintel genunix: [ID 655072 kern.notice] fffffe800069b930 unix:trap+5e6 ()
Mar 14 16:36:49 solarisintel genunix: [ID 655072 kern.notice] fffffe800069b940 unix:cmntrap+140 ()
Mar 14 16:36:49 solarisintel genunix: [ID 655072 kern.notice] fffffe800069ba60 unix:mutex_enter+b ()
Mar 14 16:36:49 solarisintel genunix: [ID 655072 kern.notice] fffffe800069ba70 zfs:zio_buf_alloc+1d ()
Mar 14 16:36:49 solarisintel genunix: [ID 655072 kern.notice] fffffe800069baa0 zfs:zio_vdev_io_start+120 ()
Mar 14 16:36:49 solarisintel genunix: [ID 655072 kern.notice] fffffe800069bad0 zfs:zio_execute+7b ()
Mar 14 16:36:49 solarisintel genunix: [ID 655072 kern.notice] fffffe800069baf0 zfs:zio_nowait+1a ()
Mar 14 16:36:49 solarisintel genunix: [ID 655072 kern.notice] fffffe800069bb60 zfs:vdev_probe+f0 ()
Mar 14 16:36:49 solarisintel genunix: [ID 655072 kern.notice] fffffe800069bba0 zfs:vdev_open+2b1 ()
Mar 14 16:36:49 solarisintel genunix: [ID 655072 kern.notice] fffffe800069bbc0 zfs:vdev_open_child+21 ()
Mar 14 16:36:49 solarisintel genunix: [ID 655072 kern.notice] fffffe800069bc40 genunix:taskq_thread+295 ()
Mar 14 16:36:49 solarisintel genunix: [ID 655072 kern.notice] fffffe800069bc50 unix:thread_start+8 ()
Mar 14 16:36:49 solarisintel unix: [ID 100000 kern.notice]
Mar 14 16:36:49 solarisintel genunix: [ID 672855 kern.notice] syncing file systems...
Mar 14 16:36:49 solarisintel genunix: [ID 904073 kern.notice] done
Mar 14 16:36:50 solarisintel genunix: [ID 111219 kern.notice] dumping to /dev/dsk/c0t0d0s1, offset 108593152, content: kernel
Mar 14 16:36:54 solarisintel genunix: [ID 100000 kern.notice]
Mar 14 16:36:54 solarisintel genunix: [ID 665016 kern.notice] ^M100% done: 210699 pages dumped,
Mar 14 16:36:54 solarisintel genunix: [ID 851671 kern.notice] dump succeeded
Mar 14 16:38:21 solarisintel genunix: [ID 540533 kern.notice] ^MSunOS Release 5.10 Version Generic_142910-17 64-bit
I will try again now with solaris 10 5/09 (U7)
Chris.
Edited by: user5485639 on 14-Mar-2011 08:42

What do you mean after the driver is installed?
S10/U9 has the Compaq Array3 driver pre-installed. No more adding it to the jumpstart tree or "adding a driver" necessary.
I have setup several DL360 G3's and G4's which use the same controller.

Panic with Raw Socket-Page fault in module "ip" due to a NULL pointer deref

I see a panic when using raw sockets with Solaris 10 10/09 (u8). I included a sample program that can cause this issue (panic happens when a udp datagram is received on port 60000). This sample code works as expected with the previous version I was using - 5/08. If I bind with a port number of 0 I don't see the panic but I don't receive anything either.
I believe I have all the latest patches installed. I'd appreciate any assistance in resolving this. Thanks...
^Mpanic[cpu11]/thread=fffffe8000916c60:
BAD TRAP: type=e (#pf Page fault) rp=fffffe80009166c0 addr=83 occurred in module "ip" due to a NULL pointer dereference
sched:
#pf Page fault
Bad kernel fault at addr=0x83
pid=0, pc=0xffffffffedf86a10, sp=0xfffffe80009167b0, eflags=0x10246
cr0: 8005003b<pg,wp,ne,et,ts,mp,pe> cr4: 6f8<xmme,fxsr,pge,mce,pae,pse,de>
cr2: 83 cr3: 1a345000 cr8: c
rdi: ffffffffa7092808 rsi: ffffffffb0094e00 rdx: ffffffffa73c9d40
rcx: 0 r8: fffffe8000916878 r9: fffffe8000916880
rax: 0 rbx: ffffffffb0094e00 rbp: fffffe8000916800
r10: ffffffffa7c18840 r11: ffffffffa73c9d40 r12: fffffe8000916880
r13: ffffffff9b314000 r14: ffffffff9a70b000 r15: 0
fsb: ffffffff80000000 gsb: ffffffff9c52d800 ds: 43
es: 43 fs: 0 gs: 1c3
trp: e err: 0 rip: ffffffffedf86a10
cs: 28 rfl: 10246 rsp: fffffe80009167b0
ss: 30
fffffe80009165d0 unix:die+da ()
fffffe80009166b0 unix:trap+5e6 ()
fffffe80009166c0 unix:_cmntrap+140 ()
fffffe8000916800 ip:ip_udp_check+b0 ()
fffffe80009168b0 ip:ip_udp_input+15a ()
fffffe80009169d0 ip:ip_input+c7c ()
fffffe8000916aa0 dls:i_dls_link_rx+32e ()
fffffe8000916af0 mac:mac_rx+71 ()
fffffe8000916b90 bnx:bnx_recv_ring_recv+113 ()
fffffe8000916ba0 bnx:bnx_rxpkts_intr+17 ()
fffffe8000916bc0 bnx:bnx_intr_recv+58 ()
fffffe8000916bf0 bnx:bnx_intr_1lvl+120 ()
fffffe8000916c40 unix:av_dispatch_autovect+78 ()
fffffe8000916c50 unix:intr_thread+5f ()
EXAMPLE USED TO CAUSE ABOVE PANIC
#include        <unistd.h>
#include        <stdio.h>
#include        <stdlib.h>
#include        <sys/socket.h>
#include        <arpa/inet.h>
#define BUFFER_SIZE 2048
int main(int argc, char *argv[])
        int                     i, j, sd, iosize;
        char                    *ipbuffer;
        struct sockaddr_in      saddr, daddr;
        ipbuffer = calloc( 1, BUFFER_SIZE );
        //if ( ( sd = socket(PF_INET, SOCK_DGRAM, IPPROTO_UDP) ) < 0 ) {        // Works
        if ( ( sd = socket(PF_INET, SOCK_RAW, IPPROTO_UDP) ) < 0 ) {            // Fails
                perror("socket() error");
                exit(-1);
        saddr.sin_family = AF_INET;
        saddr.sin_addr.s_addr = inet_addr( "0.0.0.0" );
        saddr.sin_port = htons( 60000 );
        if ( bind( sd, (struct sockaddr *) &saddr, sizeof( saddr ) ) < 0 ) {
                perror("bind() error");
                exit(-1);
        printf( "Awaiting inbound datagrams...\n" );
        for ( i = 1; i <= 10; i++ ) {
                j = sizeof( daddr );
                iosize = recvfrom( sd, ipbuffer, BUFFER_SIZE, 0, (struct sockaddr *) &daddr, &j );
                printf( "Received %d bytes from %s\n", iosize, inet_ntoa( daddr.sin_addr ) );
        close( sd );
        return( 0 );
}------------------------------------------------------------------

This issue could be related. Recommend you open a call with support.
http://bugs.opensolaris.org/bugdatabase/view_bug.do?bug_id=6882984

Solaris10u6 panic while installation: BAD TRAP

Hello everyone,
I am trying to install Solaris 10u6 on my machine and am facing some problem.
The system is:
Intel E5420 QuadCore - 2 CPUs
Tyan Tempest i5400PW - http://www.tyan.com/product_board_spec.aspx?pid=560
16GB FB-DIMM
Maxtor 250GB SATA
DVD/CDROM
After i start the installation using the DVD disk, the machine reboots after displaying the initial banner. After connecting the machine to serial console and modifying GRUB to boot in verbose, i could see some messages (pastebin linked).
[http://pastebin.ca/1241723]
panic[cpu3]/thread=afd5bde0: BAD TRAP: type=e (#pf Page fault) rp=afd5bb0c addr=4e555358 occurred in module "unix" due to an illegal access to a user address
sched: #pf Page fault
Bad kernel fault at addr=0x4e555358
pid=0, pc=0xfe845e03, sp=0x2, eflags=0x10287
cr0: 8005003b cr4: 6f8
cr2: 4e555358 cr3: 24050000
gs: 1b0 fs: fec30000 es: afd50160 ds: feb00160
edi: 0 esi: 4e555359 ebp: afd5bbe0 esp: afd5bb44
ebx: 44 edx: 0 ecx: 4e555358 eax: b433dbe0
trp: e err: 2 eip: fe845e03 cs: 158
efl: 10287 usp: 2 ss: afd5bc84
Can someone help me find out what is the problem and how i can get over it. BTW, everything works well with OpenSolaris 200805 or Solaris 10 u5. I would really want to get this working on this machine and appreciate all your help.
Thanks in advance.
dot.yet
Edited by: [email protected] on Oct 31, 2008 7:38 PM

Hello everyone,
I am trying to install Solaris 10u6 on my machine and am facing some problem.
The system is:
Intel E5420 QuadCore - 2 CPUs
Tyan Tempest i5400PW - http://www.tyan.com/product_board_spec.aspx?pid=560
16GB FB-DIMM
Maxtor 250GB SATA
DVD/CDROM
After i start the installation using the DVD disk, the machine reboots after displaying the initial banner. After connecting the machine to serial console and modifying GRUB to boot in verbose, i could see some messages (pastebin linked).
[http://pastebin.ca/1241723]
panic[cpu3]/thread=afd5bde0: BAD TRAP: type=e (#pf Page fault) rp=afd5bb0c addr=4e555358 occurred in module "unix" due to an illegal access to a user address
sched: #pf Page fault
Bad kernel fault at addr=0x4e555358
pid=0, pc=0xfe845e03, sp=0x2, eflags=0x10287
cr0: 8005003b cr4: 6f8
cr2: 4e555358 cr3: 24050000
gs: 1b0 fs: fec30000 es: afd50160 ds: feb00160
edi: 0 esi: 4e555359 ebp: afd5bbe0 esp: afd5bb44
ebx: 44 edx: 0 ecx: 4e555358 eax: b433dbe0
trp: e err: 2 eip: fe845e03 cs: 158
efl: 10287 usp: 2 ss: afd5bc84
Can someone help me find out what is the problem and how i can get over it. BTW, everything works well with OpenSolaris 200805 or Solaris 10 u5. I would really want to get this working on this machine and appreciate all your help.
Thanks in advance.
dot.yet
Edited by: [email protected] on Oct 31, 2008 7:38 PM

Panic[cpu1]/thread=30002f12060: BAD TRAP: type=31

Sun V240 panic with t5he following output:
# tail -f /var/adm/messages
Sep 24 15:52:24 [10.64.47.16.183.179] agent[21415]: [ID 695539 daemon.alert] syslog   Sep 24 15:52:24 agent         *** aborting execution ***
Sep 24 15:52:24 [10.64.47.16.183.179] agent[21415]: [ID 695539 daemon.alert] syslog   Sep 24 15:52:24 agent         *** aborting execution ***
Sep 24 15:53:29 [10.64.47.16.183.179] agent[23844]: [ID 440145 daemon.alert] syslog   Sep 24 15:53:29 agent         syntax error in fscan+syslog.dat(1) at token '{'
Sep 24 15:53:29 [10.64.47.16.183.179] agent[23844]: [ID 440145 daemon.alert] syslog   Sep 24 15:53:29 agent         syntax error in fscan+syslog.dat(1) at token '{'
Sep 24 15:53:29 [10.64.47.16.183.179] agent[23844]: [ID 617052 daemon.alert] syslog   Sep 24 15:53:29 agent         *** aborting execution ***
Sep 24 15:53:29 [10.64.47.16.183.179] agent[23844]: [ID 617052 daemon.alert] syslog   Sep 24 15:53:29 agent         *** aborting execution ***
Sep 24 15:54:35 [10.64.47.16.183.179] agent[26272]: [ID 134417 daemon.alert] syslog   Sep 24 15:54:35 agent         syntax error in fscan+syslog.dat(1) at token '{'
Sep 24 15:54:35 [10.64.47.16.183.179] agent[26272]: [ID 134417 daemon.alert] syslog   Sep 24 15:54:35 agent         syntax error in fscan+syslog.dat(1) at token '{'
Sep 24 15:54:35 [10.64.47.16.183.179] agent[26272]: [ID 336262 daemon.alert] syslog   Sep 24 15:54:35 agent         *** aborting execution ***
Sep 24 15:54:35 [10.64.47.16.183.179] agent[26272]: [ID 336262 daemon.alert] syslog   Sep 24 15:54:35 agent         *** aborting execution ***
panic[cpu1]/thread=30002f12060: BAD TRAP: type=31 rp=2a100feac60 addr=20 mmu_fsr=0 occurred in module "md" due to a NULL pointer dereference
nfsd: trap type = 0x31
addr=0x20
pid=10465, pc=0x12e5de0, sp=0x2a100fea501, tstate=0x9980001603, context=0x751
g1-g7: 4, 2000, 1900000, 1fff, 1c00, 751, 30002f12060
000002a100fea980 unix:die+78 (31, 2a100feac60, 20, 0, 2a100feaa40, 107c400)
%l0-3: 00000000c0800000 0000000000000031 0000000001000000 0000000000002000
%l4-7: 000000000181a570 000000000181a400 0000000000000000 0000009980001603
000002a100feaa60 unix:trap+9d4 (2a100feac60, 0, 1fff, 5, 0, 1)
%l0-3: 0000000000000000 00000600084af8c0 0000000000000031 0000000000001c00
%l4-7: 0000000000000000 0000000000000001 ffffffffffffe000 0000000000000005
000002a100feabb0 unix:ktl0+48 (6, 0, 20, 70, 1905348, 1905000)
%l0-3: 0000000000000004 0000000000001400 0000009980001603 000000000101b304
%l4-7: 0000000000000000 0000000000000001 0000000000000000 000002a100feac60
000002a100fead00 7 (5500002004, 422, 0, ffffffff80200000, 1900000, 1)
%l0-3: 0000000000000004 0000000000000001 0000000000000008 0000000001904800
%l4-7: 000006000c4aadc0 000000000003ffff 000000000003fc00 0000000000000020
000002a100feadd0 specfs:spec_fsync+fc (6000c50a500, 10000, 60007e88fe0, 3, 0, 6000c50a000)
%l0-3: 000006000c18cb68 000006000c18cae0 0000000000002420 0000000000002000
%l4-7: 0000000000000000 000006000c4aadc0 0000000000000000 000006000c4aadc0
000002a100feafa0 genunix:fop_fsync+14 (6000c50a500, 10000, 60007e88fe0, f3, 0, 121cab0)
%l0-3: 0000060004a97580 0000000000002420 0000000000002000 0000000000000003
%l4-7: 0000060002234000 0000060004a97580 0000060004a97738 0000000000000062
000002a100feb050 nfssrv:rfs3_mknod+30c (2a100feb110, 2a100feb398, 600049e4840, 2a100feb3a0, 60007e88fe0, 2a100feb1a0)
%l0-3: 00000000ffffffff 0000060004ef8c00 ffffffffffffffff 0000000000002004
%l4-7: 0000000000000055 000002a100feb1a0 000002a100feb568 000002a100feb228
000002a100feb2b0 nfssrv:common_dispatch+444 (2a100feb698, 6000ac8fa80, 0, 600049e4840, 705a01b8, 7b32e4d4)
%l0-3: 0000000000001000 000000007059eb90 000000000000000b 000002a100feb398
%l4-7: 0000060007e88fe0 0000000000000000 0000000001901df8 000002a100feb398
000002a100feb5d0 rpcmod:svc_getreq+1c8 (6000ac8fa80, 60002324800, 6000b5501d0, 6000102dc80, 1902560, 6000b550040)
%l0-3: 0000000000000000 000006000b550040 0000000000000000 000006000ac8fad4
%l4-7: 0000060005218fc0 000000007b3271bc 0000000001872800 000006000b550360
000002a100feb720 rpcmod:svc_run+198 (6000b837980, 0, 0, 0, 6000b8379b8, 1)
%l0-3: 00000600084af8c0 000006000b8379c8 000006000ac8fa80 000006000102dc80
%l4-7: 0000000000000000 0000000000000000 000000000000000c 0000060002324800
000002a100feb7d0 nfs:nfssys+1c4 (c, 1, 7b2b3800, c, 1f8, 30)
%l0-3: 0000000000000000 0000000000000000 00000000cb050000 000000000000cb05
%l4-7: 0000000000000001 0000000000000000 0000000000000000 000000007b2b3938
syncing file systems... [1] 46 [1] 11 [1] 4 [1] 4 [1] 4 [1] 4 [1] 4 [1] 4 [1] 4 [1] 4 [1] 4 [1] 4 [1] 4 [1] 4 [1] 4 [1] 4 [1] 4 [1] 4 [1] 4 [1] 4 [1] 4 [1] 4 [1] 4 done (not all i/o completed)
dumping to /dev/md/dsk/d20, offset 859701248, content: kernel
100% done: 64894 pages dumped, compression ratio 5.02, dump succeeded
rebooting...
SC Alert: Host System has Reset
@(#)OBP 4.16.2 2004/10/04 18:22 Sun Fire V210/V240,Netra 240
Clearing TLBs
Loading Configuration
Membase: 0000.0012.0000.0000
MemSize: 0000.0000.4000.0000
Init CPU arrays Done
Init E$ tags Done
Setup TLB Done
MMUs ON
Scrubbing Tomatillo tags... 0 1
Block Scrubbing Done
Find dropin, Copying Done, Size 0000.0000.0000.6cb0
PC = 0000.07ff.f000.5ba8
PC = 0000.0000.0000.5c58
Find dropin, (copied), Decompressing Done, Size 0000.0000.0006.6870
Diagnostic console initialized
System Reset: CPU Reset
Probing system devices
jbus at 0,0 SUNW,UltraSPARC-IIIi (1503 MHz @ 9:1, 1 MB) memory-controller
jbus at 1,0 SUNW,UltraSPARC-IIIi (1503 MHz @ 9:1, 1 MB) memory-controller
jbus at 1f,0 pci
jbus at 1e,0 pci
jbus at 1c,0 pci
jbus at 1d,0 pci
Loading Support Packages: kbd-translator obp-tftp SUNW,i2c-ram-device SUNW,fru-device SUNW,asr
Loading onboard drivers:
/pci@1e,600000: Device 7 isa
/pci@1e,600000/isa@7: flashprom rtc i2c power serial serial serial rmc-comm
/pci@1e,600000/isa@7/i2c@0,320: i2c-bridge i2c-bridge motherboard-fru-prom chassis-fru-prom power-supply-fru-prom power-supply-fru-prom dimm-spd dimm-spd dimm-spd dimm-spd dimm-spd dimm-spd dimm-spd dimm-spd rscrtc nvram idprom gpio gpio gpio gpio gpio gpio
Probing memory
CPU 0 Bank 0 base          0 size 2048 MB
CPU 0 Bank 1 base 100000000 size 2048 MB
CPU 0 Bank 2 base 200000000 size 2048 MB
CPU 0 Bank 3 base 300000000 size 2048 MB
CPU 1 Bank 0 base 1000000000 size 1024 MB
CPU 1 Bank 2 base 1200000000 size 1024 MB
ChassisSerialNumber FN54050325
Probing I/O buses
/pci@1d,700000: Device 2 network network
/pci@1f,700000: Device 2 network network
/pci@1e,600000: Device 6 pmu i2c gpio
/pci@1e,600000/pmu@6/i2c@0,0:
/pci@1e,600000: Device a usb
/pci@1e,600000: Device d ide disk cdrom
/pci@1e,600000: Device 2 Nothing there
/pci@1e,600000: Device 3 SUNW,qlc fp disk
/pci@1c,600000: Device 2 scsi disk tape scsi disk tape
/pci@1c,600000: Device 1 Nothing there
/pci@1d,700000: Device 1 SUNW,qlc fp disk
BNZ - Bank of New Zealand
Rebooting with command: boot
Boot device: disk0:a File and args:
Loading ufs-file-system package 1.4 04 Aug 1995 13:02:54.
FCode UFS Reader 1.12 00/07/17 15:48:16.
Loading: /platform/SUNW,Sun-Fire-V240/ufsboot
Loading: /platform/sun4u/ufsboot
SunOS Release 5.10 Version Generic_127111-05 64-bit
Copyright 1983-2007 Sun Microsystems, Inc. All rights reserved.
Use is subject to license terms.
SC Alert: SC Request to send Break to host.
Type 'go' to resume
{1} ok
{1} okSystem can be boot into single user mode but fails when moved to multi-user mode.
Any ideas?
Cheers
--Andreas

This looks like it could be bug 6614416.
See [Sun Alert 241066|http://sunsolve.sun.com/search/document.do?assetkey=1-66-241066-1] .

BAD TRAP: type=31 rp=2a1002b75b0 addr=d10198 mmu_fsr=0 occurred in module "

Helllo,
My solaris recently encounter kernel panic and reboot.
I suspect it is hardware problem, but I am not sure, could anybody know this problem kindly give some suggestion?
Following are messages:
Nov 17 10:05:34 ASB_sim_1_1_5 unix: [ID 340138 kern.notice] BAD TRAP: type=31 rp=2a1002b75b0 addr=d10198 mmu_fsr=0 occurred in module "genunix" due to an illegal access to a user address
Nov 17 10:05:34 ASB_sim_1_1_5 unix: [ID 100000 kern.notice]
Nov 17 10:05:34 ASB_sim_1_1_5 unix: [ID 839527 kern.notice] fsck:
Nov 17 10:05:34 ASB_sim_1_1_5 unix: [ID 520581 kern.notice] trap type = 0x31
Nov 17 10:05:34 ASB_sim_1_1_5 unix: [ID 381800 kern.notice] addr=0xd10198
Nov 17 10:05:34 ASB_sim_1_1_5 unix: [ID 101969 kern.notice] pid=70, pc=0x1011c664, sp=0x2a1002b6e51, tstate=0x9900001601, context=0x100a
Nov 17 10:05:34 ASB_sim_1_1_5 unix: [ID 743441 kern.notice] g1-g7: d10000, 10149400, 3000079f5f8, 0, 30000fb0710, 0, 30000f3ede0
Nov 17 10:05:34 ASB_sim_1_1_5 unix: [ID 100000 kern.notice]
Nov 17 10:05:34 ASB_sim_1_1_5 genunix: [ID 723222 kern.notice] 000002a1002b71c0 unix:die+80 (31, d10198, 10415298, 0, 2a1002b75b0, f65e6000)
Nov 17 10:05:34 ASB_sim_1_1_5 genunix: [ID 179002 kern.notice] %l0-3: 0000000000000008 0000000000000000 00000000ff3dee48 000000000001ec58
Nov 17 10:05:34 ASB_sim_1_1_5 %l4-7: 00000000ff29f7ac 00000000ff3df9dc 00000000ff21bb60 0000000000000000
Nov 17 10:05:34 ASB_sim_1_1_5 genunix: [ID 723222 kern.notice] 000002a1002b72a0 unix:trap+8b8 (d10000, 1, 5, 0, 2a1002b75b0, 0)
Nov 17 10:05:34 ASB_sim_1_1_5 genunix: [ID 179002 kern.notice] %l0-3: 0000000000000001 0000000000000000 0000030001029538 0000000000000000
Nov 17 10:05:34 ASB_sim_1_1_5 %l4-7: 0000000000000031 0000030000f3ca58 0000000000010000 0000000000000000
Nov 17 10:05:34 ASB_sim_1_1_5 genunix: [ID 723222 kern.notice] 000002a1002b73e0 unix:sfmmu_tsb_miss+66c (10429b30, 0, 3000004df88, 0, 3000004df88, 19)
Nov 17 10:05:34 ASB_sim_1_1_5 genunix: [ID 179002 kern.notice] %l0-3: 0000000000d10000 0000000000000004 0000030000f3ca58 000003100003f160
Nov 17 10:05:34 ASB_sim_1_1_5 %l4-7: 0000000000d10000 0000000000000000 0000000000000000 0000000000c00003
Nov 17 10:05:35 ASB_sim_1_1_5 genunix: [ID 723222 kern.notice] 000002a1002b7500 unix:prom_rtt+0 (37, 370, 37, 0, 300000132c0, 3000079f5f8)
Nov 17 10:05:35 ASB_sim_1_1_5 genunix: [ID 179002 kern.notice] %l0-3: 0000000000000002 0000000000001400 0000009900001601 000000001001a8ac
Nov 17 10:05:35 ASB_sim_1_1_5 %l4-7: 0000000000000000 0000000000000001 000000000000000b 000002a1002b75b0
Nov 17 10:05:35 ASB_sim_1_1_5 genunix: [ID 562518 kern.notice] 000002a1002b7650 ffffffffffffffff (1046d620, d10198, 20, 0, 0, 30000fb0710)
Nov 17 10:05:35 ASB_sim_1_1_5 genunix: [ID 179002 kern.notice] %l0-3: 0000000000000000 0000008800000003 0000030000e880a0 0000000000000003
Nov 17 10:05:35 ASB_sim_1_1_5 %l4-7: 0000008800000003 0000030001229938 0000000000000000 0000000000000000
Nov 17 10:05:35 ASB_sim_1_1_5 genunix: [ID 723222 kern.notice] 000002a1002b7700 genunix:turnstile_block+20c (d10000, 0, 10410108, 30001029538, 0, 30000d1ade0)
Nov 17 10:05:35 ASB_sim_1_1_5 genunix: [ID 179002 kern.notice] %l0-3: 0000000010047a14 0000030000f3ca58 000003000079f5c8 0000000000000000
Nov 17 10:05:35 ASB_sim_1_1_5 %l4-7: 0000000010410108 0000000000000000 0000030000f3ede0 0000000000000000
Nov 17 10:05:35 ASB_sim_1_1_5 genunix: [ID 723222 kern.notice] 000002a1002b77d0 unix:mutex_vector_enter+374 (30000d1ade0, 10415fc8, 10424d10, 0, 1, 0)
Nov 17 10:05:35 ASB_sim_1_1_5 genunix: [ID 179002 kern.notice] %l0-3: fffffff078fd3246 0000030000d1ade0 000000001041c380 0000000000000000
Nov 17 10:05:35 ASB_sim_1_1_5 %l4-7: 0000000000d10000 0000000000d10000 0000030000f11330 0000030000fb0718
Nov 17 10:05:36 ASB_sim_1_1_5 genunix: [ID 723222 kern.notice] 000002a1002b7890 genunix:dnlc_purge_vfsp+9c (2a1002b7940, 1043ac64, 1046c3c8, 1042fa88, 0, 30000d1ade0)
Nov 17 10:05:36 ASB_sim_1_1_5 genunix: [ID 179002 kern.notice] %l0-3: 0000030000d1add0 0000000000000000 0000030000793908 0000000000000000
Nov 17 10:05:36 ASB_sim_1_1_5 %l4-7: 0000030000d19120 0000000000000000 0000030000d1adb8 00000000ff3dc890
Nov 17 10:05:36 ASB_sim_1_1_5 genunix: [ID 723222 kern.notice] 000002a1002b7980 genunix:dounmount+c (30000793908, 0, 300007a7f28, 30001228d78, 30000fb0710, 30000fb0818)
Nov 17 10:05:36 ASB_sim_1_1_5 genunix: [ID 179002 kern.notice] %l0-3: 0000000010099b7c 0000000000000000 00000000ff3dee48 000000000001ec58
Nov 17 10:05:36 ASB_sim_1_1_5 %l4-7: 00000000ff29f7ac 00000000ff3df9dc 00000000ff21bb60 0000000000000000
Nov 17 10:05:36 ASB_sim_1_1_5 genunix: [ID 723222 kern.notice] 000002a1002b7a30 genunix:umount2+130 (30000793908, 0, 1fbd8, 303ec, 3247c, 0)
Nov 17 10:05:36 ASB_sim_1_1_5 genunix: [ID 179002 kern.notice] %l0-3: 0000000000000000 0000000000000000 0000000000000000 0000000000000000
Nov 17 10:05:36 ASB_sim_1_1_5 %l4-7: 0000000000000000 0000000000000000 0000000000000000 0000000000000000
Nov 17 10:05:36 ASB_sim_1_1_5 unix: [ID 100000 kern.notice]
Nov 17 10:05:36 ASB_sim_1_1_5 genunix: [ID 672855 kern.notice] syncing file systems...
Nov 17 10:05:36 ASB_sim_1_1_5 genunix: [ID 904073 kern.notice] done
Nov 17 10:05:37 ASB_sim_1_1_5 genunix: [ID 353387 kern.notice] dumping to /dev/dsk/c0t0d0s1, offset 1048707072
Nov 17 10:05:42 ASB_sim_1_1_5 genunix: [ID 409368 kern.notice] ^M100% done: 8076 pages dumped, compression ratio 6.53,
Nov 17 10:05:42 ASB_sim_1_1_5 genunix: [ID 851671 kern.notice] dump succeeded
Nov 17 10:06:31 ASB_sim_1_1_5 genunix: [ID 540533 kern.notice] ^MSunOS Release 5.8 Version Generic_117350-07 64-bit
Nov 17 10:06:31 ASB_sim_1_1_5 genunix: [ID 913632 kern.notice] Copyright 1983-2003 Sun Microsystems, Inc. All rights reserved.

I debug the core file and got following info:
YJISSG1_sim_1_1_12 SIM009:> mdb -k unix.2 vmcore.2
Loading modules: [ unix krtld genunix ip usba ]
::statusdebugging crash dump vmcore.2 (64-bit) from ASB_sim_1_1_5
operating system: 5.8 Generic_117350-07 (sun4u)
panic message:
BAD TRAP: type=31 rp=2a1002b75b0 addr=d10198 mmu_fsr=0 occurred in module "genunix" due to an illegal access to a user address
$C000002a1002b6e51 turnstile_interlock+4(1046d620, d10198, 20, 0, 0, 30000fb0710)
000002a1002b6f01 turnstile_block+0x20c(d10000, 0, 10410108, 30001029538, 0,
30000d1ade0)
000002a1002b6fd1 mutex_vector_enter+0x374(30000d1ade0, 10415fc8, 10424d10, 0, 1, 0)
000002a1002b7091 dnlc_purge_vfsp+0x9c(2a1002b7940, 1043ac64, 1046c3c8, 1042fa88, 0, 30000d1ade0)
000002a1002b7181 dounmount+0xc(30000793908, 0, 300007a7f28, 30001228d78,
30000fb0710, 30000fb0818)
000002a1002b7231 umount2+0x130(30000793908, 0, 1fbd8, 303ec, 3247c, 0)
000002a1002b72f1 syscall_trap32+0xa8(32638, 0, 1fbd8, 303ec, 3247c, 0)

[ID 340138 kern.notice] BAD TRAP: type=31 rp=2a103985540 addr=4 mmu_fsr=0

Hi,
Solaris 10 running on Sun-Fire-V490 had a panic reboot with the following messages, any one aware of what kind of panic it was and what was the cause and resolution for this? Please help me.
Dec 14 15:35:33 ux5slv13.ops.storagenetworks.com ^Mpanic[cpu0]/thread=3000409f7a0:
Dec 14 15:35:33 ux5slv13.ops.storagenetworks.com unix: [ID 340138 kern.notice] BAD TRAP: type=31 rp=2a103985540 addr=4 mmu_fsr=0 occurred in mod
ule "qlog" due to a NULL pointer dereference
Dec 14 15:35:33 ux5slv13.ops.storagenetworks.com unix: [ID 100000 kern.notice]
Dec 14 15:35:33 ux5slv13.ops.storagenetworks.com unix: [ID 839527 kern.notice] fsck:
Dec 14 15:35:33 ux5slv13.ops.storagenetworks.com unix: [ID 520581 kern.notice] trap type = 0x31
Dec 14 15:35:33 ux5slv13.ops.storagenetworks.com unix: [ID 381800 kern.notice] addr=0x4
Dec 14 15:35:33 ux5slv13.ops.storagenetworks.com unix: [ID 101969 kern.notice] pid=15282, pc=0x7b292524, sp=0x2a103984de1, tstate=0x4414001601,
context=0x1de9
Dec 14 15:35:33 ux5slv13.ops.storagenetworks.com unix: [ID 743441 kern.notice] g1-g7: 700de800, 770, 18c7c00, 0, 0, 1de9, 3000409f7a0
Dec 14 15:35:33 ux5slv13.ops.storagenetworks.com unix: [ID 100000 kern.notice]
Dec 14 15:35:33 ux5slv13.ops.storagenetworks.com genunix: [ID 723222 kern.notice] 000002a103985260 unix:die+78 (31, 2a103985540, 4, 0, 2a1039853
Dec 14 15:35:33 ux5slv13.ops.storagenetworks.com %l4-7: 000000000181bea8 000000000181bc00 0000000000000000 0000000000000001
Dec 14 15:35:33 ux5slv13.ops.storagenetworks.com genunix: [ID 723222 kern.notice] 000002a103985340 unix:trap+9e0 (2a103985540, 0, 1fff, 5, 0, 1)
Dec 14 15:35:33 ux5slv13.ops.storagenetworks.com genunix: [ID 179002 kern.notice] %l0-3: 0000000000000000 0000060011cb9858 0000000000000031 00
00000000001c00
Dec 14 15:35:33 ux5slv13.ops.storagenetworks.com %l4-7: 0000000000000000 0000000000000001 ffffffffffffe000 0000000000000005
Dec 14 15:35:33 ux5slv13.ops.storagenetworks.com genunix: [ID 723222 kern.notice] 000002a103985490 unix:ktl0+48 (3000409f7a0, 6001dc88e00, 13, 0
, 0, 3000409f7a0)
Dec 14 15:35:33 ux5slv13.ops.storagenetworks.com genunix: [ID 179002 kern.notice] %l0-3: 0000000000000002 0000000000001400 0000004414001601 00
0000000101c030
Dec 14 15:35:33 ux5slv13.ops.storagenetworks.com %l4-7: 00000000000060b0 00000000018ca000 0000000000000000 000002a103985540
Dec 14 15:35:33 ux5slv13.ops.storagenetworks.com genunix: [ID 723222 kern.notice] 000002a1039855e0 qlog:ql_open+b0 (2a103985758, 2003, 0, 700de8
00, 0, 0)
Dec 14 15:35:33 ux5slv13.ops.storagenetworks.com genunix: [ID 179002 kern.notice] %l0-3: 0000000000000180 000006001b96d478 00000600215d5460 00
000000700dec00
Dec 14 15:35:33 ux5slv13.ops.storagenetworks.com %l4-7: 0000000000000000 000000ee00000000 000006001b96d478 0000000000000000
Dec 14 15:35:33 ux5slv13.ops.storagenetworks.com genunix: [ID 723222 kern.notice] 000002a1039856a0 specfs:spec_open+4f8 (2a103985930, 20, 300050
715c0, 201, 600215d5460, 0)
Dec 14 15:35:33 ux5slv13.ops.storagenetworks.com genunix: [ID 179002 kern.notice] %l0-3: 0000000000002003 000006001a10cac0 0000000000000000 00
00060024bb7940
Dec 14 15:35:33 ux5slv13.ops.storagenetworks.com %l4-7: 0000000000000004 0000000000008000 0000060011c02c88 000000ee00000000
Dec 14 15:35:33 ux5slv13.ops.storagenetworks.com genunix: [ID 723222 kern.notice] 000002a103985760 genunix:fop_open+78 (2a103985930, 2, 30005071
5c0, 2003, 6001a10cac0, 6001a10cac0)
Dec 14 15:35:33 ux5slv13.ops.storagenetworks.com genunix: [ID 179002 kern.notice] %l0-3: 0000030000c8f080 0000000000002000 0000000000000004 00
00060010058b00
Dec 14 15:35:33 ux5slv13.ops.storagenetworks.com %l4-7: 0000060010058080 0000060010058298 000000000061d636 0000000000000004
Dec 14 15:35:33 ux5slv13.ops.storagenetworks.com genunix: [ID 723222 kern.notice] 000002a103985810 genunix:vn_openat+500 (0, 0, 1, 0, 2003, 7fff
ffff)
Dec 14 15:35:33 ux5slv13.ops.storagenetworks.com genunix: [ID 179002 kern.notice] %l0-3: 0000000000000000 0000000000000002 0000000000000000 00
00000000000000
Dec 14 15:35:33 ux5slv13.ops.storagenetworks.com %l4-7: 0000000000000000 0000000000002000 0000000000000000 0000000000000000
Thanks
Mahalingam R.

System is panicking in the qlog (QuickLog driver) kernel module which is provided by Symantec/Veritas and not Sun.

Occurred in module "ip" due to a NULL pointer dereference

My solaris 10 x86 server would auto reboot 3 to 4 times at each day.
System Config:-
Dual Pentium III 1GHz
VIA Chips Set main board
512MB RAM
LGI SCSI Interface
Hitaichi 73GB SCSI HDD
Seagate 120GB IDE HDD
Intel VGA Display Card
3Com 3c905 Network Card
I removed all RPC and NFS function.
Installed gcc form Solaris CD pack.
And I compiled new Apache 2.0 + php + MySQL + FastCGI in server.
Base this error problem, I have try to install patch(119076-05) and try to re-compile apache. But the error cannot fix.
The BIG PROBLEM is the solaris 10 always auto reboot. Let my some files and MySQL database error.
And I checked /var/adm/message get the following error message. Anyone can help me
Jul 6 12:41:56 tophkweb unix: [ID 836849 kern.notice]
Jul 6 12:41:56 tophkweb ^Mpanic[cpu0]/thread=d45d3000:
Jul 6 12:41:56 tophkweb genunix: [ID 335743 kern.notice] BAD TRAP: type=e (#pf Page fault) rp=d4667acc addr=9d occurred in module "ip" due to a NULL pointer dereference
Jul 6 12:41:56 tophkweb unix: [ID 100000 kern.notice]
Jul 6 12:41:56 tophkweb unix: [ID 839527 kern.notice] httpd:
Jul 6 12:41:56 tophkweb unix: [ID 753105 kern.notice] #pf Page fault
Jul 6 12:41:56 tophkweb unix: [ID 532287 kern.notice] Bad kernel fault at addr=0x9d
Jul 6 12:41:56 tophkweb unix: [ID 243837 kern.notice] pid=271, pc=0xfeaa24b7, sp=0xd6048580, eflags=0x10202
Jul 6 12:41:56 tophkweb unix: [ID 211416 kern.notice] cr0: 8005003b<pg,wp,ne,et,ts,mp,pe> cr4: 6d8<xmme,fxsr,pge,mce,pse,de>
Jul 6 12:41:56 tophkweb unix: [ID 936844 kern.notice] cr2: 9d cr3: 14f02000
Jul 6 12:41:56 tophkweb unix: [ID 537610 kern.notice] gs: fea401b0 fs: fea80000 es: d4520160 ds: ffff0160
Jul 6 12:41:56 tophkweb unix: [ID 537610 kern.notice] edi: d57b43c0 esi: 0 ebp: d4667b18 esp: d4667afc
Jul 6 12:41:56 tophkweb unix: [ID 537610 kern.notice] ebx: d60486c0 edx: d528b900 ecx: 0 eax: a1
Jul 6 12:41:56 tophkweb unix: [ID 537610 kern.notice] trp: e err: 0 eip: feaa24b7 cs: 158
Jul 6 12:41:56 tophkweb unix: [ID 717149 kern.notice] efl: 10202 usp: d6048580 ss: d60486c0
Jul 6 12:41:56 tophkweb unix: [ID 100000 kern.notice]
Jul 6 12:41:56 tophkweb genunix: [ID 353471 kern.notice] d4667a2c unix:die+a7 (e, d4667acc, 9d, 0)
Jul 6 12:41:56 tophkweb genunix: [ID 353471 kern.notice] d4667ab8 unix:trap+f56 (d4667acc, 9d, 0)
Jul 6 12:41:56 tophkweb genunix: [ID 353471 kern.notice] d4667acc unix:cmntrap+83 ()
Jul 6 12:41:56 tophkweb genunix: [ID 353471 kern.notice] d4667b18 ip:tcp_unfuse+2b (d60486c0)
Jul 6 12:41:56 tophkweb genunix: [ID 353471 kern.notice] d4667bf4 ip:tcp_rput_data+4a (d6048580, d57b43c0,)
Jul 6 12:41:56 tophkweb genunix: [ID 353471 kern.notice] d4667c0c ip:tcp_input+39 (d6048580, d57b43c0,)
Jul 6 12:41:56 tophkweb genunix: [ID 353471 kern.notice] d4667c30 ip:squeue_enter+b5 (d3e85f40, d57b43c0,)
Jul 6 12:41:56 tophkweb genunix: [ID 353471 kern.notice] d4667c68 ip:ip_fanout_tcp+38e (d61cd438, d57b43c0,)
Jul 6 12:41:56 tophkweb genunix: [ID 353471 kern.notice] d4667cac ip:ip_wput_local+1bb (d61cd438, da979c54,)
Jul 6 12:41:56 tophkweb genunix: [ID 353471 kern.notice] d4667d48 ip:ip_wput_ire+1436 (d61cd438, d57b43c0,)
Jul 6 12:41:56 tophkweb genunix: [ID 353471 kern.notice] d4667da0 ip:ip_output+70a (d60489c0, d57b43c0,)
Jul 6 12:41:56 tophkweb genunix: [ID 353471 kern.notice] d4667de4 ip:tcp_send_data+5f9 (d6048b00, d61cd438,)
Jul 6 12:41:56 tophkweb genunix: [ID 353471 kern.notice] d4667e04 ip:tcp_xmit_end+88 (d6048b00)
Jul 6 12:41:56 tophkweb genunix: [ID 353471 kern.notice] d4667e20 ip:tcp_close_output+115 (d60489c0, d6048d10,)
Jul 6 12:41:56 tophkweb genunix: [ID 353471 kern.notice] d4667e44 ip:squeue_enter+1bf (d3e85f40, d6048d10,)
Jul 6 12:41:56 tophkweb genunix: [ID 353471 kern.notice] d4667e70 ip:tcp_close+6c (d61cd3b0, 83, dad03)
Jul 6 12:41:56 tophkweb genunix: [ID 353471 kern.notice] d4667e90 genunix:qdetach+8b (d61cd3b0, 1, 83, da)
Jul 6 12:41:56 tophkweb genunix: [ID 353471 kern.notice] d4667ec4 genunix:strclose+2e3 (d45cdcc0, 83, dad03)
Jul 6 12:41:56 tophkweb genunix: [ID 353471 kern.notice] d4667eec sockfs:socktpi_close+d7 (d45cdcc0, 83, 1, 0,)
Jul 6 12:41:56 tophkweb genunix: [ID 353471 kern.notice] d4667f1c genunix:fop_close+26 (d45cdcc0, 83, 1, 0,)
Jul 6 12:41:56 tophkweb genunix: [ID 353471 kern.notice] d4667f58 genunix:closef+56 (d5b7f180)
Jul 6 12:41:56 tophkweb genunix: [ID 353471 kern.notice] d4667f7c genunix:closeandsetf+2e7 (16, 0)
Jul 6 12:41:56 tophkweb genunix: [ID 353471 kern.notice] d4667f8c genunix:close+d (16, 3, fec1d444, d4)
Jul 6 12:41:56 tophkweb unix: [ID 100000 kern.notice]
Jul 6 12:41:56 tophkweb genunix: [ID 672855 kern.notice] syncing file systems...
Jul 6 12:41:56 tophkweb genunix: [ID 733762 kern.notice] 11
Jul 6 12:41:57 tophkweb genunix: [ID 733762 kern.notice] 9
Jul 6 12:41:58 tophkweb genunix: [ID 733762 kern.notice] 6
Jul 6 12:42:18 tophkweb last message repeated 20 times
Jul 6 12:42:19 tophkweb genunix: [ID 622722 kern.notice] done (not all i/o completed)
Jul 6 12:42:20 tophkweb genunix: [ID 111219 kern.notice] dumping to /dev/dsk/c2t0d0s0, offset 214695936, content: kernel
Jul 6 12:42:29 tophkweb genunix: [ID 409368 kern.notice] ^M100% done: 16280 pages dumped, compression ratio 3.06,
Jul 6 12:42:29 tophkweb genunix: [ID 851671 kern.notice] dump succeeded

I have a server suffering similar symptoms. In fact, it's crashed 16 times since the 29/07/2005! It's been getting worse with more use.
The server runs the latest Big Brother and Apache that shipped with Solaris 10.
The server has the latest patches (via smpatch)
-bash-3.00$ uname -a
SunOS <omitted> 5.10 Generic_118844-08 i86pc i386 i86pc
Jul 27 06:20:32 <omitted> unix: [ID 836849 kern.notice]
Jul 27 06:20:32 <omitted> ^Mpanic[cpu3]/thread=d3b0fa00:
Jul 27 06:20:32 <omitted> genunix: [ID 335743 kern.notice] BAD TRAP: type=e (#pf Page fault) rp=cfba4acc addr=9
d occurred in module "ip" due to a NULL pointer dereference
Jul 27 06:20:32 <omitted> unix: [ID 100000 kern.notice]
Jul 27 06:20:32 <omitted> unix: [ID 839527 kern.notice] bb:
Jul 27 06:20:32 <omitted> unix: [ID 753105 kern.notice] #pf Page fault
Jul 27 06:20:32 <omitted> unix: [ID 532287 kern.notice] Bad kernel fault at addr=0x9d
Jul 27 06:20:32 <omitted> unix: [ID 243837 kern.notice] pid=14256, pc=0xfeb06827, sp=0xd6d20580, eflags=0x10202
Jul 27 06:20:32 <omitted> unix: [ID 211416 kern.notice] cr0: 8005003b<pg,wp,ne,et,ts,mp,pe> cr4: 6d8<xmme,fxsr,
pge,mce,pse,de>
Jul 27 06:20:32 <omitted> unix: [ID 936844 kern.notice] cr2: 9d cr3: 691ea000
Jul 27 06:20:32 <omitted> unix: [ID 537610 kern.notice] gs: feab01b0 fs: feae0000 es: d0860160 ds: ffff
0160
Jul 27 06:20:32 <omitted> unix: [ID 537610 kern.notice] edi: cfd084c0 esi: 0 ebp: cfba4b18 esp: cfba
4afc
Jul 27 06:20:32 <omitted> unix: [ID 537610 kern.notice] ebx: d6d206c0 edx: d3025540 ecx: 0 eax:
81
Jul 27 06:20:32 <omitted> unix: [ID 537610 kern.notice] trp: e err: 0 eip: feb06827 cs:
158
Jul 27 06:20:32 <omitted> unix: [ID 717149 kern.notice] efl: 10202 usp: d6d20580 ss: d6d206c0
Jul 27 06:20:32 <omitted> unix: [ID 100000 kern.notice]
Jul 27 06:20:32 <omitted> genunix: [ID 353471 kern.notice] cfba4a2c unix:die+a7 (e, cfba4acc, 9d, 3)
Jul 27 06:20:32 <omitted> genunix: [ID 353471 kern.notice] cfba4ab8 unix:trap+f56 (cfba4acc, 9d, 3)
Jul 27 06:20:32 <omitted> genunix: [ID 353471 kern.notice] cfba4acc unix:cmntrap+83 ()
Jul 27 06:20:32 <omitted> genunix: [ID 353471 kern.notice] cfba4b18 ip:tcp_unfuse+2b (d6d206c0)
Jul 27 06:20:32 <omitted> genunix: [ID 353471 kern.notice] cfba4bf4 ip:tcp_rput_data+4a (d6d20580, cfd084c0,)
Jul 27 06:20:32 <omitted> genunix: [ID 353471 kern.notice] cfba4c0c ip:tcp_input+39 (d6d20580, cfd084c0,)
Jul 27 06:20:32 <omitted> genunix: [ID 353471 kern.notice] cfba4c30 ip:squeue_enter+b5 (cff74dc0, cfd084c0,)
Jul 27 06:20:32 <omitted> genunix: [ID 353471 kern.notice] cfba4c68 ip:ip_fanout_tcp+38e (d4d2e6b8, cfd084c0,)
Jul 27 06:20:32 <omitted> genunix: [ID 353471 kern.notice] cfba4cac ip:ip_wput_local+1bb (d4d2e6b8, d071f554,)
Jul 27 06:20:32 <omitted> genunix: [ID 353471 kern.notice] cfba4d48 ip:ip_wput_ire+1436 (d4d2e6b8, cfd084c0,)
Jul 27 06:20:32 <omitted> genunix: [ID 353471 kern.notice] cfba4da0 ip:ip_output+70a (d3fef140, cfd084c0,)
Jul 27 06:20:32 <omitted> genunix: [ID 353471 kern.notice] cfba4de4 ip:tcp_send_data+5f9 (d3fef280, d4d2e6b8,)
Jul 27 06:20:32 <omitted> genunix: [ID 353471 kern.notice] cfba4e04 ip:tcp_xmit_end+88 (d3fef280)
Jul 27 06:20:32 <omitted> genunix: [ID 353471 kern.notice] cfba4e20 ip:tcp_close_output+115 (d3fef140, d3fef490
Jul 27 06:20:32 <omitted> genunix: [ID 353471 kern.notice] cfba4e44 ip:squeue_enter+1bf (cff74dc0, d3fef490,)
Jul 27 06:20:32 <omitted> genunix: [ID 353471 kern.notice] cfba4e70 ip:tcp_close+6c (d4d2e630, 3, d156a7)
Jul 27 06:20:32 <omitted> genunix: [ID 353471 kern.notice] cfba4e90 genunix:qdetach+8b (d4d2e630, 1, 3, d15)
Jul 27 06:20:32 <omitted> genunix: [ID 353471 kern.notice] cfba4ec4 genunix:strclose+2e3 (d4c2acc0, 3, d156a7)
Jul 27 06:20:32 <omitted> genunix: [ID 353471 kern.notice] cfba4eec sockfs:socktpi_close+d7 (d4c2acc0, 3, 1, 0,
Jul 27 06:20:32 <omitted> genunix: [ID 353471 kern.notice] cfba4f1c genunix:fop_close+26 (d4c2acc0, 3, 1, 0, )
Jul 27 06:20:32 <omitted> genunix: [ID 353471 kern.notice] cfba4f58 genunix:closef+56 (d38bbbe0)
Jul 27 06:20:32 <omitted> genunix: [ID 353471 kern.notice] cfba4f7c genunix:closeandsetf+2e7 (3, 0)
Jul 27 06:20:32 <omitted> genunix: [ID 353471 kern.notice] cfba4f8c genunix:close+d (3, 5c, d027b0b8, cf)
Jul 27 06:20:32 <omitted> unix: [ID 100000 kern.notice]
Jul 27 06:20:32 <omitted> genunix: [ID 672855 kern.notice] syncing file systems...
Jul 27 06:21:01 <omitted> unix: [ID 836849 kern.notice]
Jul 27 06:21:01 <omitted> ^Mpanic[cpu3]/thread=d3b0fa00:

Bad trap: type = 0x31

Hi,
what's a trap type 0x31 (see below)? Couldn't find any information about this specific trap in the "SPARC_Architecture_Manual_Version_9".
panic[cpu0]/thread=30001820060: BAD TRAP: type=31 rp=2a10048b0c0 addr=ffffffff00000198
mmu_fsr=0
ttymon: trap type = 0x31
addr=0xffffffff00000198
cu,
Stefan

This trap type represents a "Data Access MMU miss".
This is a memory management error that can caused by bad memory or by corrupt OS. SOme Ultrasparc 400MHZ modules also had a general problem with this in 2.5.1 and 2.6 that was fixed by kernel jumbo patches.
HTH
SHridhar

BAD TRAP: type=31 rp=2a1038db1d0 addr=2a76a463fc4 mmu_fsr=0

Hi Team, My server is rebooting again and again with below Panic errors i didnt get any solution for that please help Apr 20 05:15:14 bovs1a unix: [ID 836849 kern.notice] Apr 20 05:15:14 bovs1a ^Mpanic[cpu1]/thread=3000d29fa60: Apr 20 05:15:14 bovs1a unix: [ID 799565 kern.notice] BAD TRAP: type=31 rp=2a103aa11d0 addr=2a759bbbfc4 mmu_fsr=0 Apr 20 05:15:15 bovs1a unix: [ID 100000 kern.notice] Apr 20 05:15:15 bovs1a unix: [ID 839527 kern.notice] oracle: Apr 20 05:15:15 bovs1a unix: [ID 520581 kern.notice] trap type = 0x31 Apr 20 05:15:15 bovs1a unix: [ID 381800 kern.notice] addr=0x2a759bbbfc4 Apr 20 05:15:15 bovs1a unix: [ID 101969 kern.notice] pid=5340, pc=0x12d6378, sp=0x2a103aa0a71, tstate=0x4480001601, context=0x1889 Apr 20 05:15:15 bovs1a unix: [ID 743441 kern.notice] g1-g7: 1fc0, ffffffff00001fff, ffffe000, 60030b62000, 60012134100, 1889, 3000d29fa60 Apr 20 05:15:15 bovs1a unix: [ID 100000 kern.notice] Apr 20 05:15:15 bovs1a genunix: [ID 723222 kern.notice] 000002a103aa0ef0 unix:die+9c (31, 2a103aa11d0, 2a759bbbfc4, 0, 2a103aa0fb0, f4162004) Apr 20 05:15:15 bovs1a genunix: [ID 179002 kern.notice] %l0-3: 0000000000001fff 0000000000000031 0000000001000000 0000000000002000 Apr 20 05:15:15 bovs1a %l4-7: 0000000000100000 000006001ac61a38 0000000000000000 00000000010a5c00 Apr 20 05:15:15 bovs1a genunix: [ID 723222 kern.notice] 000002a103aa0fd0 unix:trap+9e0 (2a103aa11d0, 0, 1fff, 503, 2a759bba000, 1) Apr 20 05:15:15 bovs1a genunix: [ID 179002 kern.notice] %l0-3: 0000000000000000 000006001ac61a38 0000000000000031 0000000000001c00 Apr 20 05:15:15 bovs1a %l4-7: 0000000000000000 0000000000000001 ffffffffffffe000 0000000000000003 Apr 20 05:15:15 bovs1a genunix: [ID 723222 kern.notice] 000002a103aa1120 unix:ktl0+48 (6002c2a38c0, 2a759bac000, ffc0, 3000ef50af8, 69, 1) Apr 20 05:15:15 bovs1a genunix: [ID 179002 kern.notice] %l0-3: 0000000000000002 0000000000001400 0000004480001601 000000000101c23c Apr 20 05:15:15 bovs1a %l4-7: 0000060030b62000 00000000000667f9 0000000000000000 000002a103aa11d0 Apr 20 05:15:15 bovs1a genunix: [ID 723222 kern.notice] 000002a103aa1270 ufs:ufs_dirlook+870 (2a759bbbfc0, 2a103aa1680, 3000db3d880, 36, ffc0, ffc0) Apr 20 05:15:16 bovs1a genunix: [ID 179002 kern.notice] %l0-3: 0000000000000000 0000000080000000 0000000000000001 000003000eb9c940 Apr 20 05:15:16 bovs1a %l4-7: 0000000000000000 0000000000000001 0000000000000000 000000000000000c Apr 20 05:15:16 bovs1a genunix: [ID 723222 kern.notice] 000002a103aa13b0 ufs:ufs_lookup+290 (3000eb9c940, 2a103aa1680, 2a103aa1678, 0, 0, 0) Apr 20 05:15:16 bovs1a genunix: [ID 179002 kern.notice] %l0-3: 0000000000000038 000006002b4bb290 0000000000000056 000003000db3d880 Apr 20 05:15:16 bovs1a %l4-7: 0000000080000000 0000000000000002 0000000000003006 0000000000000000 Apr 20 05:15:16 bovs1a genunix: [ID 723222 kern.notice] 000002a103aa1490 genunix:fop_lookup+28 (3000eb9c940, 2a103aa1680, 2a103aa1678, 12e6710, 0, 3000163e000) Apr 20 05:15:16 bovs1a genunix: [ID 179002 kern.notice] %l0-3: 0000000000000000 000006002fae5540 0000000000000004 0000000000000003 Apr 20 05:15:16 bovs1a %l4-7: 0000000006ecbf59 0000000006ecbf58 000006002f3291b8 000003000004cb80 Apr 20 05:15:16 bovs1a genunix: [ID 723222 kern.notice] 000002a103aa1550 genunix:lookuppnvp+354 (2a103aa1940, 0, 0, 2a103aa1678, 2a103aa1680, 600104b9a40) Apr 20 05:15:16 bovs1a genunix: [ID 179002 kern.notice] %l0-3: 00000000018b14a0 000003000eb9c940 0000000000000001 0000000000000000 Apr 20 05:15:16 bovs1a %l4-7: 000006002b4bb290 00000600104b9a40 0000000000000000 0000000000000002 Apr 20 05:15:17 bovs1a genunix: [ID 723222 kern.notice] 000002a103aa1790 genunix:lookuppnat+120 (600104b9a40, 0, 1, 0, 2a103aa1ad8, 0) Apr 20 05:15:17 bovs1a genunix: [ID 179002 kern.notice] %l0-3: 0000000000000095 000000000000002f 00000600104b9a40 0000000000000094 Apr 20 05:15:17 bovs1a %l4-7: 000000000000005d 0000000000000076 000006002b4bb290 000002a103aa1940 Apr 20 05:15:17 bovs1a genunix: [ID 723222 kern.notice] 000002a103aa1850 genunix:lookupnameat+a8 (0, 0, 1, 0, 2a103aa1ad8, 0) Apr 20 05:15:17 bovs1a genunix: [ID 179002 kern.notice] %l0-3: 000000000000000a 0000000109a2ce98 0000000000000000 00000001086ac000 Apr 20 05:15:17 bovs1a %l4-7: ffffffff7fff637c 000002a103aa1940 ffffffff7fff7e30 00000000018b1400 Apr 20 05:15:17 bovs1a genunix: [ID 723222 kern.notice] 000002a103aa1960 genunix:cstatat_getvp+198 (ffd19400, ffffffff7fff637c, 1, 1, 2a103aa1ad8, 0) Apr 20 05:15:17 bovs1a genunix: [ID 179002 kern.notice] %l0-3: ffffffffffd19553 0000000000000000 0000000000000000 0000000040000004 Apr 20 05:15:17 bovs1a %l4-7: 0000000000000000 00000000018b1400 000000001c000000 000006002b4bb290 Apr 20 05:15:17 bovs1a genunix: [ID 723222 kern.notice] 000002a103aa1a20 genunix:cstatat+40 (ffffffffffd19553, ffffffff7fff637c, 1000, ffffffff7fff62f0, 0, 10) Apr 20 05:15:17 bovs1a genunix: [ID 179002 kern.notice] %l0-3: 0000000000000000 000002a103aa1ad0 0000000000000001 0000000000000001 Apr 20 05:15:17 bovs1a %l4-7: 0000000000000000 000002a103aa1ad8 0000000000000000 0000000000000000 Apr 20 05:15:18 bovs1a unix: [ID 100000 kern.notice] Apr 20 05:15:18 bovs1a genunix: [ID 672855 kern.notice] syncing file systems... Apr 20 05:15:18 bovs1a genunix: [ID 733762 kern.notice] 36 Apr 20 05:15:20 bovs1a genunix: [ID 733762 kern.notice] 23 Apr 20 05:15:22 bovs1a genunix: [ID 733762 kern.notice] 1 Apr 20 05:15:50 bovs1a last message repeated 20 times Apr 20 05:15:51 bovs1a genunix: [ID 622722 kern.notice] done (not all i/o completed) Apr 20 05:15:52 bovs1a genunix: [ID 111219 kern.notice] dumping to /dev/md/dsk/d31, offset 859701248, content: kernel Apr 20 05:16:31 bovs1a genunix: [ID 100000 kern.notice] Apr 20 05:16:31 bovs1a genunix: [ID 665016 kern.notice] ^M100% done: 125520 pages dumped, Apr 20 05:16:31 bovs1a genunix: [ID 851671 kern.notice] dump succeeded Apr 20 05:18:23 bovs1a genunix: [ID 540533 kern.notice] ^MSunOS Release 5.10 Version Generic_147440-12 64-bit Apr 20 05:18:23 bovs1a genunix: [ID 459285 kern.notice] Copyright (c) 1983, 2012, Oracle and/or its affiliates. All rights reserved. Apr 20 05:18:23 bovs1a genunix: [ID 678236 kern.info] Ethernet address = 0:14:4f:37:eb:a5 Apr 20 05:18:23 bovs1a unix: [ID 673563 kern.info] NOTICE: Kernel Cage is ENABLED Apr 20 05:18:23 bovs1a unix: [ID 389951 kern.info] mem = 8388608K (0x200000000) Apr 20 05:18:23 bovs1a unix: [ID 930857 kern.info] avail mem = 8362508288 Apr 20 05:18:23 bovs1a rootnex: [ID 466748 kern.info] root nexus = Sun Fire V440 Apr 20 05:18:23 bovs1a rootnex: [ID 349649 kern.info] pseudo0 at root Apr 20 05:18:23 bovs1a genunix: [ID 936769 kern.info] pseudo0 is /pseudo Apr 20 05:18:23 bovs1a rootnex: [ID 349649 kern.info] scsi_vhci0 at root Apr 20 05:18:23 bovs1a genunix: [ID 936769 kern.info] scsi_vhci0 is /scsi_vhci Apr 20 05:18:23 bovs1a rootnex: [ID 349649 kern.info] pcisch3 at root: SAFARI 0x1f 0x700000 Apr 20 05:18:23 bovs1a genunix: [ID 936769 kern.info] pcisch3 is /pci@1f,700000 Apr 20 05:18:23 bovs1a scsi: [ID 365881 kern.info] /pci@1f,700000/scsi@2 (mpt0): Apr 20 05:18:23 bovs1a initiator SCSI ID now 7 Apr 20 05:18:23 bovs1a scsi: [ID 365881 kern.info] /pci@1f,700000/scsi@2 (mpt0): Apr 20 05:18:23 bovs1a Rev. 7 LSI, Inc. 1030 found. Apr 20 05:18:23 bovs1a scsi: [ID 365881 kern.info] /pci@1f,700000/scsi@2 (mpt0): Apr 20 05:18:23 bovs1a mpt0 supports power management. Apr 20 05:18:32 bovs1a scsi: [ID 365881 kern.info] /pci@1f,700000/scsi@2 (mpt0): Apr 20 05:18:32 bovs1a mpt0 Firmware version v1.3.30.22 (IM/IME) Apr 20 05:18:32 bovs1a scsi: [ID 365881 kern.info] /pci@1f,700000/scsi@2 (mpt0): Apr 20 05:18:32 bovs1a mpt0: IOC Operational. Apr 20 05:18:50 bovs1a pcisch: [ID 370704 kern.info] PCI-device: scsi@2, mpt0 Apr 20 05:18:50 bovs1a genunix: [ID 936769 kern.info] mpt0 is /pci@1f,700000/scsi@2 Apr 20 05:18:50 bovs1a scsi: [ID 583861 kern.info] sd1 at mpt0: unit-address 0,0: target 0 lun 0 Apr 20 05:18:50 bovs1a genunix: [ID 936769 kern.info] sd1 is /pci@1f,700000/scsi@2/sd@0,0 Apr 20 05:18:50 bovs1a genunix: [ID 408114 kern.info] /pci@1f,700000/scsi@2/sd@0,0 (sd1) online Apr 20 05:18:55 bovs1a swapgeneric: [ID 308332 kern.info] root on /pci@1f,700000/scsi@2/disk@0,0:a fstype ufs

Please format the error messages properly next time so that it is more readable.
Apr 20 05:15:14 bovs1a unix: [ID 836849 kern.notice]
Apr 20 05:15:14 bovs1a ^Mpanic[cpu1]/thread=3000d29fa60:
Apr 20 05:15:14 bovs1a unix: [ID 799565 kern.notice] BAD TRAP: type=31 rp=2a103aa11d0 addr=2a759bbbfc4 mmu_fsr=0
Apr 20 05:15:15 bovs1a unix: [ID 100000 kern.notice] Apr 20 05:15:15 bovs1a unix: [ID 839527 kern.notice] oracle:
Apr 20 05:15:15 bovs1a unix: [ID 520581 kern.notice] trap type = 0x31
Apr 20 05:15:15 bovs1a unix: [ID 381800 kern.notice] addr=0x2a759bbbfc4
Apr 20 05:15:15 bovs1a unix: [ID 101969 kern.notice] pid=5340, pc=0x12d6378, sp=0x2a103aa0a71, tstate=0x4480001601, context=0x1889
Apr 20 05:15:15 bovs1a unix: [ID 743441 kern.notice] g1-g7: 1fc0, ffffffff00001fff, ffffe000, 60030b62000, 60012134100, 1889, 3000d29fa60
Apr 20 05:15:15 bovs1a unix: [ID 100000 kern.notice]
Apr 20 05:15:15 bovs1a genunix: [ID 723222 kern.notice] 000002a103aa0ef0 unix:die+9c (31, 2a103aa11d0, 2a759bbbfc4, 0, 2a103aa0fb0, f4162004)
Apr 20 05:15:15 bovs1a genunix: [ID 179002 kern.notice] %l0-3: 0000000000001fff 0000000000000031 0000000001000000 0000000000002000
Apr 20 05:15:15 bovs1a %l4-7: 0000000000100000 000006001ac61a38 0000000000000000 00000000010a5c00
Apr 20 05:15:15 bovs1a genunix: [ID 723222 kern.notice] 000002a103aa0fd0 unix:trap+9e0 (2a103aa11d0, 0, 1fff, 503, 2a759bba000, 1)
Apr 20 05:15:15 bovs1a genunix: [ID 179002 kern.notice] %l0-3: 0000000000000000 000006001ac61a38 0000000000000031 0000000000001c00
Apr 20 05:15:15 bovs1a %l4-7: 0000000000000000 0000000000000001 ffffffffffffe000 0000000000000003
Apr 20 05:15:15 bovs1a genunix: [ID 723222 kern.notice] 000002a103aa1120 unix:ktl0+48 (6002c2a38c0, 2a759bac000, ffc0, 3000ef50af8, 69, 1)
Apr 20 05:15:15 bovs1a genunix: [ID 179002 kern.notice] %l0-3: 0000000000000002 0000000000001400 0000004480001601 000000000101c23c
Apr 20 05:15:15 bovs1a %l4-7: 0000060030b62000 00000000000667f9 0000000000000000 000002a103aa11d0
Apr 20 05:15:15 bovs1a genunix: [ID 723222 kern.notice] 000002a103aa1270 ufs:ufs_dirlook+870 (2a759bbbfc0, 2a103aa1680, 3000db3d880, 36, ffc0, ffc0)
Apr 20 05:15:16 bovs1a genunix: [ID 179002 kern.notice] %l0-3: 0000000000000000 0000000080000000 0000000000000001 000003000eb9c940
Apr 20 05:15:16 bovs1a %l4-7: 0000000000000000 0000000000000001 0000000000000000 000000000000000c
Apr 20 05:15:16 bovs1a genunix: [ID 723222 kern.notice] 000002a103aa13b0 ufs:ufs_lookup+290 (3000eb9c940, 2a103aa1680, 2a103aa1678, 0, 0, 0)
Apr 20 05:15:16 bovs1a genunix: [ID 179002 kern.notice] %l0-3: 0000000000000038 000006002b4bb290 0000000000000056 000003000db3d880
Apr 20 05:15:16 bovs1a %l4-7: 0000000080000000 0000000000000002 0000000000003006 0000000000000000
Apr 20 05:15:16 bovs1a genunix: [ID 723222 kern.notice] 000002a103aa1490 genunix:fop_lookup+28 (3000eb9c940, 2a103aa1680, 2a103aa1678, 12e6710, 0, 3000163e000)
Apr 20 05:15:16 bovs1a genunix: [ID 179002 kern.notice] %l0-3: 0000000000000000 000006002fae5540 0000000000000004 0000000000000003
Apr 20 05:15:16 bovs1a %l4-7: 0000000006ecbf59 0000000006ecbf58 000006002f3291b8 000003000004cb80
Apr 20 05:15:16 bovs1a genunix: [ID 723222 kern.notice] 000002a103aa1550 genunix:lookuppnvp+354 (2a103aa1940, 0, 0, 2a103aa1678, 2a103aa1680, 600104b9a40)
Apr 20 05:15:16 bovs1a genunix: [ID 179002 kern.notice] %l0-3: 00000000018b14a0 000003000eb9c940 0000000000000001 0000000000000000
Apr 20 05:15:16 bovs1a %l4-7: 000006002b4bb290 00000600104b9a40 0000000000000000 0000000000000002
Apr 20 05:15:17 bovs1a genunix: [ID 723222 kern.notice] 000002a103aa1790 genunix:lookuppnat+120 (600104b9a40, 0, 1, 0, 2a103aa1ad8, 0)
Apr 20 05:15:17 bovs1a genunix: [ID 179002 kern.notice] %l0-3: 0000000000000095 000000000000002f 00000600104b9a40 0000000000000094
Apr 20 05:15:17 bovs1a %l4-7: 000000000000005d 0000000000000076 000006002b4bb290 000002a103aa1940
Apr 20 05:15:17 bovs1a genunix: [ID 723222 kern.notice] 000002a103aa1850 genunix:lookupnameat+a8 (0, 0, 1, 0, 2a103aa1ad8, 0)
Apr 20 05:15:17 bovs1a genunix: [ID 179002 kern.notice] %l0-3: 000000000000000a 0000000109a2ce98 0000000000000000 00000001086ac000
Apr 20 05:15:17 bovs1a %l4-7: ffffffff7fff637c 000002a103aa1940 ffffffff7fff7e30 00000000018b1400
Apr 20 05:15:17 bovs1a genunix: [ID 723222 kern.notice] 000002a103aa1960 genunix:cstatat_getvp+198 (ffd19400, ffffffff7fff637c, 1, 1, 2a103aa1ad8, 0)
Apr 20 05:15:17 bovs1a genunix: [ID 179002 kern.notice] %l0-3: ffffffffffd19553 0000000000000000 0000000000000000 0000000040000004
Apr 20 05:15:17 bovs1a %l4-7: 0000000000000000 00000000018b1400 000000001c000000 000006002b4bb290
Apr 20 05:15:17 bovs1a genunix: [ID 723222 kern.notice] 000002a103aa1a20 genunix:cstatat+40 (ffffffffffd19553, ffffffff7fff637c, 1000, ffffffff7fff62f0, 0, 10)
Apr 20 05:15:17 bovs1a genunix: [ID 179002 kern.notice] %l0-3: 0000000000000000 000002a103aa1ad0 0000000000000001 0000000000000001
Apr 20 05:15:17 bovs1a %l4-7: 0000000000000000 000002a103aa1ad8 0000000000000000 0000000000000000
Apr 20 05:15:18 bovs1a unix: [ID 100000 kern.notice]
Apr 20 05:15:18 bovs1a genunix: [ID 672855 kern.notice] syncing file systems... Apr 20 05:15:18 bovs1a genunix: [ID 733762 kern.notice] 36
Apr 20 05:15:20 bovs1a genunix: [ID 733762 kern.notice] 23
Apr 20 05:15:22 bovs1a genunix: [ID 733762 kern.notice] 1 Apr 20 05:15:50 bovs1a last message repeated 20 times
Apr 20 05:15:51 bovs1a genunix: [ID 622722 kern.notice] done (not all i/o completed)
Apr 20 05:15:52 bovs1a genunix: [ID 111219 kern.notice] dumping to /dev/md/dsk/d31, offset 859701248, content: kernel
Apr 20 05:16:31 bovs1a genunix: [ID 100000 kern.notice] Apr 20 05:16:31 bovs1a genunix: [ID 665016 kern.notice] ^M100% done: 125520 pages dumped,
Apr 20 05:16:31 bovs1a genunix: [ID 851671 kern.notice] dump succeeded
Apr 20 05:18:23 bovs1a genunix: [ID 540533 kern.notice] ^MSunOS Release 5.10 Version Generic_147440-12 64-bit
Apr 20 05:18:23 bovs1a genunix: [ID 459285 kern.notice] Copyright (c) 1983, 2012, Oracle and/or its affiliates. All rights reserved.
Apr 20 05:18:23 bovs1a genunix: [ID 678236 kern.info] Ethernet address = 0:14:4f:37:eb:a5 Apr 20 05:18:23 bovs1a unix: [ID 673563 kern.info] NOTICE: Kernel Cage is ENABLED
Apr 20 05:18:23 bovs1a unix: [ID 389951 kern.info] mem = 8388608K (0x200000000)
Apr 20 05:18:23 bovs1a unix: [ID 930857 kern.info] avail mem = 8362508288
Apr 20 05:18:23 bovs1a rootnex: [ID 466748 kern.info] root nexus = Sun Fire V440
This look like a panic in UFS ufs_dirlook() in accessing fbuf structure.
There is a recent bug that was closed as not reproduceable whicvh is similar to this panic.
Bug 16818353 : PANIC IN UFS_DIRLOOK(): BAD TRAP 0X31 WRONG VALUE IN FBUF->FB_ADDR
I will recommend that you open a new Service Request with Oracle Support and provide explorer result along with
the crash dump to Oracle Support for further investigation. Thanks.

IMac G5 system hang - 2 bad 1GB memory modules?

I am experiencing intermittent system hangs, requiring power off / on to recover. Applications run fine for hours, then everything freezes; a few seconds later the fans spool up full bore. There seems to be no logic to the failure. It happens on many different applications, including Disk Utility. No new software has been added recently (other than Apple software updates). This has been occuring for several weeks.
I repair permissions & run disk verify. When disk utility runs completely without hanging (on verify), everything is ok.
Applecare had me trash the ~/Library/Caches & system caches. No joy. They recommended archive & install beginning with Panther. Reinstall went ok until downloading updates for 10.4.8, then hang (might this suggest a hardware prob?).
Rebooted in target firewire mode the cloned drive, then zero'ed the G5 HDD and restored from clone (SuperDuper!). Everything appeared ok for several days, then the same system hang reappeared. I should mention that in the course of sudying this one, I discovered Virex 7.5 was sucking the processing life from the G5; used the uninstaller to get rid of it & the iMac is quiet again!
I have run the Applecare version of Techtools and the Hardware Test Disk, everything passes.
I could do a clean install of Tiger, then use migration assistant to move data from the clone...if I felt it had a chance to solve it. On the other hand, maybe its a flaky hardware gremlin and I'm wasting my time doing reinstalls, and I should hustle it over to the local Apple store.
Update - took iMac for service at Apple store where it failed under stress test with my 2 GB of memory but ran for an extended period with Apple memory. In an attempt to isolate which of the two 1 GB modules was bad, removed one module. Identical failure after 24 hrs. Howver, swapping out that failing module with the second module, identical hand. That suggests either both 1 GB modules are bad (unikely), or some other hardware issue is the problem.
Problem seems to occur most often when starting playing iTunes, or running Disk Utility (repair permissions).
I suppose the next step is to buy 1 GB of memory from Apple and make it fail again. Any suggestions?

Thank you for your posts, I appreciate it.
Skip - I tried a spare keyboard & mouse. Still failed.
MGW - all software is up to date.
DaddyPaycheck - I downloaded memtestosx. It fails testing each 1GB memory module separately (in different sockets). I'm running in multiuser mode and when it fails the entire iMac freezes up (just like it always does), requiring power off / power on. Is this normal behavior when the memtestosx test fails?
I will plan to test in single user mode as the supplied doc states that if the onboard cache is failing it would pass singleuser (cache apparently disabled in singleuser mode) but fail multiuser. Maybe the onboard cache is bad?
Thanks.

BADI or function module for updating open purchase orders

Hi all,
Does anyone know of a BADI or function module which can be used for updating item prices in open purchase orders?
All helpful answers are highly appreciated!
Regards,
MV

1 ) execute this program in se38 .enter the input as transaction code for which you want list of User
Exit.
REPORT z_find_userexit NO STANDARD PAGE HEADING.
*& Enter the transaction code that you want to search through in order
*& to find which Standard SAP® User Exits exists.
*& Tables
TABLES : tstc,     "SAP® Transaction Codes
         tadir,    "Directory of Repository Objects
         modsapt, "SAP® Enhancements - Short Texts
         modact,   "Modifications
         trdir,    "System table TRDIR
         tfdir,    "Function Module
         enlfdir, "Additional Attributes for Function Modules
         tstct.    "Transaction Code Texts
*& Variables
DATA : jtab LIKE tadir OCCURS 0 WITH HEADER LINE.
DATA : field1(30).
DATA : v_devclass LIKE tadir-devclass.
*& Selection Screen Parameters
SELECTION-SCREEN BEGIN OF BLOCK a01 WITH FRAME TITLE text-001.
SELECTION-SCREEN SKIP.
PARAMETERS : p_tcode LIKE tstc-tcode OBLIGATORY.
SELECTION-SCREEN SKIP.
SELECTION-SCREEN END OF BLOCK a01.
*& Start of main program
START-OF-SELECTION.
Validate Transaction Code
SELECT SINGLE * FROM tstc
    WHERE tcode EQ p_tcode.
Find Repository Objects for transaction code
IF sy-subrc EQ 0.
    SELECT SINGLE * FROM tadir
       WHERE pgmid    = 'R3TR'
         AND object   = 'PROG'
         AND obj_name = tstc-pgmna.
    MOVE : tadir-devclass TO v_devclass.
    IF sy-subrc NE 0.
      SELECT SINGLE * FROM trdir
         WHERE name = tstc-pgmna.
      IF trdir-subc EQ 'F'.
        SELECT SINGLE * FROM tfdir
          WHERE pname = tstc-pgmna.
        SELECT SINGLE * FROM enlfdir
          WHERE funcname = tfdir-funcname.
        SELECT SINGLE * FROM tadir
          WHERE pgmid    = 'R3TR'
            AND object   = 'FUGR'
            AND obj_name = enlfdir-area.
        MOVE : tadir-devclass TO v_devclass.
      ENDIF.
    ENDIF.
Find SAP® Modifications
    SELECT * FROM tadir
      INTO TABLE jtab
      WHERE pgmid    = 'R3TR'
        AND object   = 'SMOD'
        AND devclass = v_devclass.
    SELECT SINGLE * FROM tstct
      WHERE sprsl EQ sy-langu
        AND tcode EQ p_tcode.
    FORMAT COLOR COL_POSITIVE INTENSIFIED OFF.
    WRITE:/(19) 'Transaction Code - ',
    20(20) p_tcode,
    45(50) tstct-ttext.
    SKIP.
    IF NOT jtab[] IS INITIAL.
      WRITE:/(95) sy-uline.
      FORMAT COLOR COL_HEADING INTENSIFIED ON.
      WRITE:/1 sy-vline,
      2 'Exit Name',
      21 sy-vline ,
      22 'Description',
      95 sy-vline.
      WRITE:/(95) sy-uline.
      LOOP AT jtab.
        SELECT SINGLE * FROM modsapt
        WHERE sprsl = sy-langu AND
        name = jtab-obj_name.
        FORMAT COLOR COL_NORMAL INTENSIFIED OFF.
        WRITE:/1 sy-vline,
        2 jtab-obj_name HOTSPOT ON,
        21 sy-vline ,
        22 modsapt-modtext,
        95 sy-vline.
      ENDLOOP.
      WRITE:/(95) sy-uline.
      DESCRIBE TABLE jtab.
      SKIP.
      FORMAT COLOR COL_TOTAL INTENSIFIED ON.
      WRITE:/ 'No of Exits:' , sy-tfill.
    ELSE.
      FORMAT COLOR COL_NEGATIVE INTENSIFIED ON.
      WRITE:/(95) 'No User Exit exists'.
    ENDIF.
ELSE.
    FORMAT COLOR COL_NEGATIVE INTENSIFIED ON.
    WRITE:/(95) 'Transaction Code Does Not Exist'.
ENDIF.
Take the user to SMOD for the Exit that was selected.
AT LINE-SELECTION.
GET CURSOR FIELD field1.
CHECK field1(4) EQ 'JTAB'.
SET PARAMETER ID 'MON' FIELD sy-lisel+1(10).
CALL TRANSACTION 'SMOD' AND SKIP FIRST SCREEN.
2) Second way is to go to transaction code SE93 .enter transaction code click on display.
There you will see the package. Copy that package name.
Go to transaction code se84
Enhancements -customer exits-enhancementsu2014enter package there and execute.
You will get list of exits.
3) BAPI for PO change is
BAPI_PO_CHANGE

IPQoS panic: BAD TRAP in module "flowacct" due to NULL pointer.

Similar Messages

Maybe you are looking for