Solaris TCP Tuning

If you are running Weblogic on Solaris you'll need to change some of the
default TCP configuration parameters.
Sun's default TCP settings are not correct for a web server.
We noticed the server was stalling during certain peak periods. netstat
showed that many sockets opened to port 80 were in CLOSE_WAIT or
FIN_WAIT_2.
The following url is a great resource for tuning Solaris TCP/IP
http://www.rvs.uni-hannover.de/people/voeckler/tune/EN/tune.html
Changing the following TCP params solved our stalling problem. Also make
sure you up the ulimit as stated in the weblogic doc.
# to display the TCP values.
ndd /dev/tcp tcp_close_wait_interval tcp_fin_wait_2_flush_interval
tcp_keepalive_interval
# set tcp_close_wait_interval from 2400000 to 60000
ndd -set /dev/tcp tcp_close_wait_interval 60000
# set tcp_fin_wait_2_flush_interval from 675000 to 67500
ndd -set /dev/tcp tcp_fin_wait_2_flush_interval 67500
#set tcp_keepalive_interval from 7200000 to 300000
ndd -set /dev/tcp tcp_keepalive_interval 300000

Hi Victor,
We are facing similar problems as you are while running load testing using Load runner simulating a load of 100 concurrent users.
We have Oracle 8.1.7.4 client running on WebLogic 6.1 SP4 on Solaris 2.6 connecting to Oracle OPS 8.1.7 running on Solaris 2.6. We are getting core dumps while running stress testing using Load Runner for 100 concurrent users. The performance is very good for a while in the beginning of the test with CPU and memory utilization low and all of a sudden we see requests for connections queueing up on the WLS and the server crashes.
If you have found a solution to your problem Please send us details of it. Also it will be very helpful if you can send us the fix applied.
You can send your reply to my email at [email protected]
Regards,
Raj

Similar Messages

  • TCP tuning for system recovery

    Hello everyone,
    I'm involved in a DRP exercise, and I'm trying to improve the performance of the restores from tape. I've got side-by-side Windows and Solaris 9/10 servers and the Solaris boxes are seeing about half the bandwidth of the Windows boxes.
    The systems are Gbe everywhere, including the backup server. The Solaris boxes are booted from CD/DVD and we then run the recovery software off an NFS share. My restores are maxing out at about 16Mbps on Gbe links. My enemy Windows servers are running at about 25-30Mbps, also rather slow, but better.
    I'm not looking for miraculous solutions, but if I can bring the data rate up a bit with some simple changes, that would be great. I was wondering whether any TCP parameters might help.
    Any pointers/tips would be appreciated.
    Thanks,
    Mark
    Edited by: MarkDrummond on 4-Jun-2009 9:01 PM

    Robert,
    Good point, I should be looking at disk performance. The recovery software takes over the console so I have no way to get back to the CLI. I'll have to investigate that.
    We did have some luck with one server, a V440. Hardcoding the switch port and the server port to 1000fdx, and setting a few TCP parameters did get this one server up to ~115Mbps, a dramatic improvement over previous results.
    tcp_max_buf
    tcp_cwnd_buf
    tcp_xmit_hiwat
    tcp_recv_hiwat
    In our data centre, we are copper Gbe everywhere, on Cisco gear, we leave all ports to autoconfig, don't do any TCP tuning, and I get about 700Mbps between servers. But our DRP partner insists that we should hardcode everything here at our DRP site. It's all Gbe and Cisco here too. Very strange, but auto causes a lot of grief around here.
    Thanks again,
    Mark

  • Solaris TCP settings

    Hi all,
    I remember there was a recommendation for the Solaris TCP settings like
    tcp_time_wait_interval and tcp_conn_req_max_q. I can't seem to find it now.
    Is it still relevant? If so where? I have heard that it is nolonger required
    for WLS5.1. Is this correct?
    thanks
    -lucio

    Lucio,
    If you are using Solaris - then I strongly recommend this document -
    http://www.rvs.uni-hannover.de/people/voeckler/tune/EN/tune.html in
    particular section 5.1
    regards,
    -Rob
    Robert Castaneda [email protected]
    CustomWare http://www.customware.com
    "Lucio Piccoli" <[email protected]> wrote in message
    news:[email protected]..
    Hi all,
    I remember there was a recommendation for the Solaris TCP settings like
    tcp_time_wait_interval and tcp_conn_req_max_q. I can't seem to find itnow.
    Is it still relevant? If so where? I have heard that it is nolongerrequired
    for WLS5.1. Is this correct?
    thanks
    -lucio

  • Solaris TCP/IP

    I tried to write program, that will listen to the opening new tcp connections in the Solaris system.
    Fot the target I try to overwrite the <code>pr_usrreq()</code> function from the <code>protosw<code>
    protocol switch table struct. The <code>pr_usrreq</code> function gets first parameter socket, according to the documentation from the include file /usr/include/sys/protosw.h, the parameter from the <code>struct socket</code> type. I cannot find the definition of the <code>struct socket </code> in the include files
    of the Solaris system. I cannot to pass the compilation of the my module.
    May be:
    Anyone tried to resolve the problem ?
    The protocol switch table is not relevanted in the Solaris system?
    The first parameter has another type ?
    The there is another solution ?
    Thanks in advance.
    P.S. I found the <code>struct sonode</code> type in the /usr/include/sys/socketvar.h file, that like to the <code>struct socket</code>.

    I tried to write program, that will listen to the
    opening new tcp connections in the Solaris system.
    Fot the target I try to overwrite the
    <code>pr_usrreq()</code> function from the
    <code>protosw<code>
    protocol switch table struct. The
    <code>pr_usrreq</code> function gets first parameter
    socket, according to the documentation from the
    include file /usr/include/sys/protosw.h, the parameter
    from the <code>struct socket</code> type. I cannot
    find the definition of the <code>struct socket </code>
    in the include files
    of the Solaris system. I cannot to pass the
    compilation of the my module.Solaris TCP/IP doesn't use pr_usrreq() or protosw struct. Can you describe in more detail
    what are you trying to achieve?

  • Kernel parameter tuning in Solaris 10

    Hi Guru's
    Can you any one help me to find the some good docs for Solaris kernel tuning. How to change the kernel parameter online?
    How to do kernel tuning in online and what is the purposre of /etc/system and sysdef command.
    How I can search for exisiting kernel value.
    Thanks in advance.
    Jimbe

    There is interesting info at [Solaris Internals|http://www.solarisinternals.com/wiki/index.php/Solaris_Internals] .
    have a good day,
    Glen

  • Tcp stack tuning

    recently I've been playing with TCP stack in the kernel, and found an option that could give the same low latency response as in windows (especially if you compare firefox on windows and on linux)
    sysctl net.ipv4.tcp_low_latency = 1
    now tcp connections seem to be established a bit faster
    do you also have some nice tips on tuning the TCP stack?

    I add the following tweaks to my linux boxes:
    echo 2097136 > /proc/sys/net/core/rmem_max
    echo 2097136 > /proc/sys/net/core/wmem_max
    echo 524284 > /proc/sys/net/core/rmem_default
    echo 524284 > /proc/sys/net/core/wmem_default
    echo "4096 87380 2097136" > /proc/sys/net/ipv4/tcp_rmem
    echo "4096 65536 2097136" > /proc/sys/net/ipv4/tcp_wmem
    echo 1 > /proc/sys/net/ipv4/tcp_low_latency
    Some information about tcp/ip tuning can be found here:
    http://www-didc.lbl.gov/TCP-tuning/linux.html
    and   
    http://ipsysctl-tutorial.frozentux.net/ … ables.html

  • What RFC:s are implemented in Solaris�s TCP stack?

    I am trying to find out wich of the following TCP related RFC:s are implemented in the Solaris TCP stack:
    RFC0793
    RFC1122
    RFC2581
    RFC1323
    RFC2081
    RFC1191
    RFC1981
    RFC2414
    RFC2481
    RFC2884

    Hi Jeny,
    refer this URL:
    http://www.rvs.uni-hannover.de/people/voeckler/tune/EN/tune.html
    Thanks.
    regards,
    senthilkumar
    SUN - DTS

  • Slow FTP throughput using solaris 9 and max window size question

    I am working on a solution where we are trying to FTP at a high rate across the WAN on OC-12 links. We have been doing some TCP tuning with consideration to the Bandwidth Delay Product. Ping results in a 90ms RTT.
    I have been told that we will not see any increase in performance above window sizes of 64k without certain patches for Solaris 9. I know that high speed transfers are possible if tuned up correctly with other operating systems.
    Does anyone have any knowledge or experiences that they could share with me?
    Thanks

    You will have to format your disk with the help of the WRT350N and after that you will have creat Share with same "Storage" tab on the linksys router.

  • How to extract the TCP Parameters?

    How do i extract the TCP/IP parameters set on a solaris 8 system?

    To get names of available tcp kernel parameter run the following:
    ndd -get /dev/tcp \?
    To get the value of a tcp kernel parameter:
    ndd -get /dev/tcp <parameter name>
    such as
    ndd -get /dev/tcp tcp_time_wait_interval
    For the meaning of different parameter consult Solaris kernel tuning reference (look on docs.sun.com)

  • Tcp_reass_timer in Solaris 11

    Hi,
    in Solaris 11 TCP code there is a timer for the reassembly queue (tcp_reass_timer). If out-of-order data sits in the reassembly queue for 100*SECONDS (default timeout value for tcp_reass_timeout) and no data is read from the reassembly queue during this period, all the out-of-order data and related SACK information is deleted (data reneging) using the tcp_reass_timer() function defined in common/inet/tcp/tcp_timers.c. Such a timer is not specified in TCP RFC and to my knowledge there is no other OS that implements such a timer. Could you please clarify why Solaris TCP stack have a reassembly queue timer? How does it help to the OS to delete successfully received out-of-order data?
    Regards,
    nasif ekiz

    tcp_reass_timeout was implemented as result of Bugfix for 6759500 which addressed TCP security vunerabilties

  • Solaris 10: shminfo_shmmax

    Hello,
    I�m an Oracle DBA trying to understand the impacts that shmmax can have in a Solaris 10 system.
    1. how does shminfo_shmmax setting affect the system performance (memory,paging,CPU) in Solaris 10?
    2. Our server has 8G of RAM and runs with shmsys:shminfo_shmmax=0xffffffffffffffff . Is this setting correct and why?
    3. What shmmax value do you suggest for our environment?
    Thanks for your help.
    Regards,
    Giuseppe Centioli

    Hi, My experience with Oracle from an SA's point-of-view is 1) set kernel params per Oracle's Install/Release notes and 2). increase from there as needed if you have the physical resources on the machine 3) don't exceed the system's resource capacity or not even the first instance of Oracle will be useful
    Sun's doc on kernel tuning which also describes each of the parameters in question:
    http://docs.sun.com/app/docs/doc/817-0404
    NOTE:  In Solaris10, setting kernel parameters in /etc/system is an obsolete method. Solaris 10 has a Resource Manager which is used to adjust these kernel params.
    Resource Manager Admin
    http://docs.sun.com/app/docs/doc/817-1592
    Sun Blueprint re: Solaris/Oracle Tuning ( from 2003)
    http://www.sun.com/blueprints/1003/817-3835.pdf
    Solaris 10 Tuning Artticle:
    http://www.unixadmintalk.com/f35/solaris-10-performance-tuning-recommendation-89335/
    HTH
    John

  • "Failed to Send the HTTP Message..." - HTTPSupport problem

    Hello,
    We're having a few difficulties when the HTTPServer in UDS5.0.3 running on Solaris 8. Basically, we have a pair of MS .NET servers using some XML Webservices that we reside on the UDS server.
    The symptoms of the problem are that a lot of "Failed to send the HTTP message..." messages are being seen in the log for the partition that contains instances of the HTTPServer. The reason given is a UsageException on the ExternalConnection - stating that the "Object is not open for I/O so it cannot be read or written" (ExternalConnection::Write at 1). This only occurs when a HTTP Response is to be sent back to the .NET server.
    Unfortunately, this exception appears to be occurring somewhere within the code held in the HTTPSupport library, so we can't easily trace the error. Worse still, we don't actually know what's causing the error.
    Does the error indicate a problem with comms between our UDS HTTPServer and the .NET servers? We've also noticed a large number of socket connections being left in a state of CLOSE_WAIT when this error occurs (which eventually block the port altogether resulting in the HTTPServer instances becoming unresponsive).
    As far as I can tell, the Solaris TCP/IP settings are all at the OS default.
    Many thanks for any assistance,
    Jason Bridgen.

    Hi Gordon,
    The problem was solved, the customer changed his ip adress on the server and it's OK now!
    Thank you !!
    Hilla.

  • Problems connecting to internet

    Hi all,
    I have recently installed Solaris 10 11/06 x86 and it appears to be running interference with my broadband
    router, I'm quite new to Solaris and Unix as a whole so am lost as to how to track and fix this problem
    (if it is fixable).
    Please help, Any assistance much appreciated.
    Kenny.
    ===============
    PC1
    Model: HP Workstation xw6000 dual Xeon
    Memory: 4GB
    OS: Solaris 10 11/06 x86 [Full Install + security and recommended patches]
    NIC: Intel PRO/1000 MT Desktop Adapter
    PC2
    Model: [Custom] Asus NCCH-DL Dual Xeon
    Memory: 2GB
    OS: Windows XP Pro 2002 SP2 [all security and critical patches installed]
    NIC: Intel PRO/1000 MT Dual Port Server Adapter
    Broadband Router
    Model: Vigor2600V series annex A, Firmware: v2.5.8.3_UK
    Problem:
    Solaris interferes with the router stopping all internet connections
    Observations:
    The fault seems to be caused by the interactions of the Solaris TCP/IP Stack and the Vigor Router.
    Same fault when PC2 had Windows 2003 Server R2 installed.
    Same fault when PC2 had Solaris 10 11/06 installed.
    The LAN appears unaffected, can SSH to PC1 from PC2 without any side effects.
    Every so often can connect to the internet from PC2 for some minutes before connection is lost.
    When connection is lost it remains down for some time, ADSL remains online.
    When connection is lost no part of the WAN is communicable, no ping, etc...
    When disconnecting PC1 from router, within 30-45 seconds everything returns to normal, I do not have to reboot router.
    Notes:
    Both PC's have IP addresses set statically, not via DHCP.
    The DNS address for both PC's references the router.
    Currently I have to physically disconnect the network cable to PC1 or shutdown the Solaris OS in order
    to use the internet from PC2.
    Even with all this I'm loving Solaris but will have to return to W2K3 Server if this issue cannot be
    resolved as it is unworkable, please help.
    Network
    10.32.0.0/16
    PC1: 10.32.0.2/16
    PC2: 10.32.5.1/16
    Router: 10.32.255.254/16
    # ifconfig -a
    lo0: flags=2001000849<UP,LOOPBACK,RUNNING,MULTICAST,IPv4,VIRTUAL> mtu 8232 index 1
    inet 127.0.0.1 netmask ff000000
    lo0:1: flags=2001000849<UP,LOOPBACK,RUNNING,MULTICAST,IPv4,VIRTUAL> mtu 8232 index 1
    zone amps-devel-01
    inet 127.0.0.1 netmask ff000000
    e1000g0: flags=1000843<UP,BROADCAST,RUNNING,MULTICAST,IPv4> mtu 1500 index 2
    inet 10.32.0.2 netmask ffff0000 broadcast 10.32.255.255
    ether 0:7:e9:18:d1:1a
    e1000g0:1: flags=1000843<UP,BROADCAST,RUNNING,MULTICAST,IPv4> mtu 1500 index 2
    zone amps-devel-01
    inet 10.32.26.20 netmask ffff0000 broadcast 10.32.255.255

    Hi again,
    I've just discovered that when PC2 stops connecting to the internet, if I ssh to PC1 and wget the same page I was just trying to retrieve from PC2 the transfer begins immediately and PC2 also starts working normally?
    go figure!
    anyway I'm just off to read the Developer Forums Code of Conduct, hopefully I haven't posted incorrectly or offended anyone in my haste.
    Kenny.
    PS: it can take up to 30 secs for PC2 to begin connecting to the internet again.
    So the problem appears now to be interference with the Windows XP machine and not the Router.
    Message was edited by:
    kstuart101

  • Available APIs for process and package management

    Hello All and welcome to my Hello All:
    Welcome to my inaugural post. I am a complete noob to Solaris (although I have been using Linux for 5+ years) and am in the process of trying to get a handle on what local C/C++ APIs (if any) are available for management. Specifically, I am looking to find out about process and package management.
    For process management, basically I would like to know is there some kind of interface to the the prstat application (ie. Memory and CPU utilization). Does something like this exist?
    For package management, I am looking for the ability to add, remove, and query the package �database�. Correct me if I am wrong, but the Solaris package �database� seems similar to that of a Debian system (at least from the perspective that the informational files are stored as plain text in a well-defined directory [ie /var/sadm/pkg/]).
    I have installed Solaris 10 on an x86 machine with a full installation; however, of the installed development kits (listed below) nothing jumped out at me.
    -bash-3.00# ls -1d /var/sadm/pkg/*devel
    /var/sadm/pkg/SUNWaspell-devel
    /var/sadm/pkg/SUNWevolution-devel
    /var/sadm/pkg/SUNWevolution-libs-devel
    /var/sadm/pkg/SUNWgnome-a11y-base-devel
    /var/sadm/pkg/SUNWgnome-a11y-libs-devel
    /var/sadm/pkg/SUNWgnome-a11y-reader-devel
    /var/sadm/pkg/SUNWgnome-a11y-speech-devel
    /var/sadm/pkg/SUNWgnome-audio-devel
    /var/sadm/pkg/SUNWgnome-base-libs-devel
    /var/sadm/pkg/SUNWgnome-camera-devel
    /var/sadm/pkg/SUNWgnome-common-devel
    /var/sadm/pkg/SUNWgnome-component-devel
    /var/sadm/pkg/SUNWgnome-config-devel
    /var/sadm/pkg/SUNWgnome-desktop-prefs-devel
    /var/sadm/pkg/SUNWgnome-file-mgr-devel
    /var/sadm/pkg/SUNWgnome-hex-editor-devel
    /var/sadm/pkg/SUNWgnome-img-editor-devel
    /var/sadm/pkg/SUNWgnome-libs-devel
    /var/sadm/pkg/SUNWgnome-media-devel
    /var/sadm/pkg/SUNWgnome-panel-devel
    /var/sadm/pkg/SUNWgnome-pilot-devel
    /var/sadm/pkg/SUNWgnome-print-devel
    /var/sadm/pkg/SUNWgnome-project-devel
    /var/sadm/pkg/SUNWgnome-terminal-devel
    /var/sadm/pkg/SUNWgnome-text-editor-devel
    /var/sadm/pkg/SUNWgnome-vfs-devel
    /var/sadm/pkg/SUNWgnome-wm-devel
    /var/sadm/pkg/SUNWgnutls-devel
    /var/sadm/pkg/SUNWjpg-devel
    /var/sadm/pkg/SUNWlibexif-devel
    /var/sadm/pkg/SUNWlibgcrypt-devel
    /var/sadm/pkg/SUNWlibpopt-devel
    /var/sadm/pkg/SUNWmozilla-devel
    /var/sadm/pkg/SUNWmoznspr-devel
    /var/sadm/pkg/SUNWmoznss-devel
    /var/sadm/pkg/SUNWogg-vorbis-devel
    /var/sadm/pkg/SUNWopenjade-devel
    /var/sadm/pkg/SUNWopensp-devel
    /var/sadm/pkg/SUNWpcsclite-devel
    /var/sadm/pkg/SUNWpng-devel
    /var/sadm/pkg/SUNWpostgr-devel
    /var/sadm/pkg/SUNWPython-devel
    /var/sadm/pkg/SUNWTiff-devel
    I've placed orders for Solaris Internals and Solaris Performance & Tuning (that should arrive tomorrow), but I was hoping that someone could give me a gentle push (or perhaps a swift kick) in a general direction. :)
    Thanks.

    For process management, basically I would like to
    know is there some kind of interface to the the
    prstat application (ie. Memory and CPU utilization).
    Does something like this exist?Not prstat (although you could 'truss' it and see some of what it's doing to collect the information). kstat is available with a C interface and through perl/shell. It has several CPU fields. It's certainly useful for monitoring, but read-only. I'm not sure what you're looking for in terms of "management".
    Also 'dtrace' can provide tons of dynamic information, but that's not necessarily what you're looking for.
    For package management, I am looking for the ability
    to add, remove, and query the package �database�.
    Correct me if I am wrong, but the Solaris package
    �database� seems similar to that of a Debian system
    (at least from the perspective that the
    informational files are stored as plain text in a
    well-defined directory [ie /var/sadm/pkg/]).Yes, although it's based on the SysV packaging system. I don't believe there's any API for it outside of the 'pkg*' utilities.
    Darren

  • Server Reset and refuse to boot

    Hello
    I have a V490 server that refuses to boot and resetting itself all the time,
    This is the output of our console, can you plz help investigate on this issue ????
    rsc>
    RSC Alert: Host System has Reset
    rsc> console
    WARNING: forceload of misc/md_trans failed
    WARNING: forceload of misc/md_raid failed
    WARNING: forceload of misc/md_hotspares failed
    WARNING: forceload of misc/md_sp failed
    configuring IPv4 interfaces: ce0 ce4.
    Hostname: smscd2
    Could not open /dev/rmt/0l to verify device id.
    No such device or address
    Booting as part of a cluster
    NOTICE: CMM: Node smscd1 (nodeid = 1) with votecount = 1 added.
    NOTICE: CMM: Node smscd2 (nodeid = 2) with votecount = 1 added.
    NOTICE: CMM: Quorum device 1 (/dev/did/rdsk/d4s2) added; votecount = 1, bitmask of nodes with configured paths = 0x3.
    NOTICE: clcomm: Adapter ce9 constructed
    NOTICE: clcomm: Path smscd2:ce9 - smscd1:ce9 being constructed
    NOTICE: clcomm: Adapter ce8 constructed
    NOTICE: clcomm: Path smscd2:ce8 - smscd1:ce8 being constructed
    NOTICE: clcomm: Adapter ce3 constructed
    NOTICE: clcomm: Path smscd2:ce3 - smscd1:ce7 being constructed
    NOTICE: clcomm: Adapter ce7 constructed
    NOTICE: clcomm: Path smscd2:ce7 - smscd1:ce3 being constructed
    NOTICE: CMM: Node smscd2: attempting to join cluster.
    NOTICE: clcomm: Path smscd2:ce9 - smscd1:ce9 being initiated
    NOTICE: clcomm: Path smscd2:ce7 - smscd1:ce3 being initiated
    NOTICE: clcomm: Path smscd2:ce8 - smscd1:ce8 being initiated
    NOTICE: clcomm: Path smscd2:ce3 - smscd1:ce7 being initiated
    NOTICE: CMM: Node smscd1 (nodeid: 1, incarnation #: 1212407740) has become reachable.
    NOTICE: clcomm: Path smscd2:ce9 - smscd1:ce9 online
    NOTICE: clcomm: Path smscd2:ce8 - smscd1:ce8 online
    NOTICE: clcomm: Path smscd2:ce7 - smscd1:ce3 online
    NOTICE: clcomm: Path smscd2:ce3 - smscd1:ce7 online
    WARNING: [AFT1] DUE Event detected by CPU0 at TL=0, errID 0x00000018.e4e41c48
    AFSR 0x00500002<DUE,PRIV,CE>.00000189 AFAR 0x000000a1.dfd14bd0
    Fault_PC 0x10b038c Esynd 0x0189 Slot A: J8100 J8101 J8201 J8200
    [AFT1] errID 0x00000018.e4e41c48 Two Bits were in error
    NOTICE: Scheduling clearing of error on page 0x000000a1.dfd14000
    NOTICE: CMM: Cluster has reached quorum.
    NOTICE: CMM: Node smscd1 (nodeid = 1) is up; new incarnation number = 1212407740.
    NOTICE: CMM: Node smscd2 (nodeid = 2) is up; new incarnation number = 1212561602.
    NOTICE: CMM: Cluster members: smscd1 smscd2.
    NOTICE: CMM: node reconfiguration #91 completed.
    NOTICE: CMM: Node smscd2: joined cluster.
    ip: joining multicasts failed (18) on clprivnet0 - will use link layer broadcasts for multicast
    Could not open /dev/rmt/0l to verify device id.
    No such device or address
    The system is coming up. Please wait.
    checking ufs filesystems
    /dev/md/rdsk/d230: is logging.
    Implementing Solaris Network Tuning.
    Adding static routes for use as IPMP targets
    add host 172.28.35.30: gateway 172.28.35.30
    add host 172.28.35.31: gateway 172.28.35.31
    add host 172.28.35.32: gateway 172.28.35.32
    add host 172.28.35.50: gateway 172.28.35.50
    starting rpc services: rpcbind done.
    Setting netmask of ce0 to 255.255.255.0
    Setting netmask of ce0:1 to 255.255.255.0
    Setting netmask of ce4 to 255.255.255.0
    Setting netmask of ce9 to 255.255.255.128
    Setting netmask of ce8 to 255.255.255.128
    Setting netmask of ce3 to 255.255.255.128
    Setting netmask of ce7 to 255.255.255.128
    Setting netmask of clprivnet0 to 255.255.255.0
    Setting default IPv4 interface for multicast: add net 224.0/4: gateway smscd2
    syslog service starting.
    obtaining access to all attached disks
    Jun 4 09:40:46 smscd2 savecore: saving system crash dump in /var/crash/smscd2/*.8
    Notifying cluster that this node is panicking
    WARNING: uncorrectable error detected by pci0 (safari id 00000000.00000009) during
    DVMA read transaction
    WARNING: uncorrectable error detected by pci0 (safari id 00000000.00000009) during
    DVMA read transaction
    WARNING: [AFT1] Corrected system bus (CE) Event detected by CPU3 at TL=0, errID 0x00000028.53eb168c
    AFSR 0x00000002<CE>.0000003d AFAR 0x000000a1.ffd197d0
    Fault_PC 0x0 Esynd 0x003d Slot A: J8200
    [AFT1] errID 0x00000028.53eb168c Data Bit 67 was in error and corrected
    panic[cpu1]/thread=2a10000bd40: Fatal PCI UE Error
    syncing file systems...
    panic[cpu1]/thread=2a10000bd40: BAD TRAP: type=31 rp=1437800 addr=30020402000 mmu_fsr=0
    dumping to /dev/dsk/c1t0d0s1, offset 65536, content: kernel
    100% done: 155922 pages dumped, compression ratio 8.07, dump succeeded
    rebooting...
    Resetting ...
    RSC Alert: Host System has Reset
    Software Reset
    Enabling system bus....... Done
    Initializing CPUs......... Done
    Initializing boot memory.. Done
    Initializing OpenBoot
    Probing system devices
    ChassisSerialNumber 0621AN1969
    Probing I/O buses
    Probing system devices
    ChassisSerialNumber 0621AN1969
    Probing I/O buses
    Sun Fire V490, No Keyboard
    Copyright 2005 Sun Microsystems, Inc. All rights reserved.
    OpenBoot 4.18.8, 16384 MB memory installed, Serial #69096519.
    Ethernet address 0:14:4f:1e:54:47, Host ID: 841e5447.
    Rebooting with command: boot
    Boot device: rootdisk File and args:
    SunOS Release 5.9 Version Generic_118558-28 64-bit
    Copyright 1983-2003 Sun Microsystems, Inc. All rights reserved.
    Use is subject to license terms.
    |
    panic[cpu3]/thread=140a000: [AFT1] errID 0x00000009.aa1cf044 UCU WDU Error(s)
    See previous message(s) for details
    0000000001408a40 SUNW,UltraSPARC-IV:cpu_aflt_log+66c (1408b4b, 1, 1408da8, 10, 1184e40, 1184e68)
    %l0-3: 0000000001408c88 0000000000000010 0000000000000003 0000000001408da8
    %l4-7: 0000000001184e40 0000000001184e68 0000000000000000 0000000001408afe
    0000000001408c90 SUNW,UltraSPARC-IV:cpu_fast_ecc_error+324 (1409710, 1, 0, 0, 0, 0)
    %l0-3: 0000000000000000 0000000000000000 000000a1ffd15be0 0010022000000189
    %l4-7: 0000000001409710 0000000000000001 0000022000000000 00000300003aaa90
    0000000001409660 unix:ktl0+48 (1000000, 30000d11bc8, 6, 0, 1438670, 300001cadb0)
    %l0-3: 0000000000000005 0000000000001400 0000000080001604 0000000001174d24
    %l4-7: 000003000001f408 00000300002909d8 000000000000000d 0000000001409710
    00000000014097b0 genunix:segmap_create+2ac (3000039ff38, 140991c, 75eb0000, 1, 140a004, 0)
    %l0-3: 0000030000d11bc8 0000000000000000 00000300003b30c0 0000000000000000
    %l4-7: 00000000014580e8 0000000001445400 0000000001458000 0000000001458000
    0000000001409860 unix:startup_vm+374 (ffffffffffffffff, 1413310, 14186a0, 103, 78004000, 1432000)
    %l0-3: 000000000142ac00 0000000000010000 00000000014386a0 0000000001438670
    %l4-7: 000002a750000000 000000000149a800 000000000142c000 000000000140c000
    0000000001409970 unix:startup+34 (1, 0, 0, 142e6b8, 1400000, 0)
    %l0-3: 0000000000000001 0000000000000003 00000000babecafe 0000000000000000
    %l4-7: 000000000142c000 000000000140e000 0000000001416208 0000000001439ca8
    0000000001409a20 genunix:main+4 (1409ba0, f006a410, 1409ec0, 39bc9f, 2000, 500)
    %l0-3: 000000000140b400 000000000140a000 0000000001413018 0000000000000000
    %l4-7: 0000000078002000 00000000003a4000 00000000014a3da0 0000000001067bf8
    skipping system dump - no dump device configured
    rebooting...
    Resetting ...
    RSC Alert: Host System has Reset
    Software Reset
    Enabling system bus....... Done
    Initializing CPUs......... Done
    Initializing boot memory.. Done
    Initializing OpenBoot
    Probing system devices
    ChassisSerialNumber 0621AN1969
    Probing I/O buses
    Probing system devices
    ChassisSerialNumber 0621AN1969
    Probing I/O buses
    Sun Fire V490, No Keyboard
    Copyright 2005 Sun Microsystems, Inc. All rights reserved.
    OpenBoot 4.18.8, 16384 MB memory installed, Serial #69096519.
    Ethernet address 0:14:4f:1e:54:47, Host ID: 841e5447.
    Rebooting with command: boot
    Boot device: rootdisk File and args:
    SunOS Release 5.9 Version Generic_118558-28 64-bit
    Copyright 1983-2003 Sun Microsystems, Inc. All rights reserved.
    Use is subject to license terms.
    |
    panic[cpu3]/thread=140a000: [AFT1] errID 0x00000009.945fefa4 UCU WDU Error(s)
    See previous message(s) for details
    0000000001408a40 SUNW,UltraSPARC-IV:cpu_aflt_log+66c (1408b4b, 1, 1408da8, 10, 1184e40, 1184e68)
    %l0-3: 0000000001408c88 0000000000000010 0000000000000003 0000000001408da8
    %l4-7: 0000000001184e40 0000000001184e68 0000000000000000 0000000001408afe
    0000000001408c90 SUNW,UltraSPARC-IV:cpu_fast_ecc_error+324 (1409710, 1, 0, 0, 0, 0)
    %l0-3: 0000000000000000 0000000000000000 000000a1ffd165e0 0010022000000189
    %l4-7: 0000000001409710 0000000000000001 0000022000000000 00000300003aaa90
    0000000001409660 unix:ktl0+48 (1000000, 30000d125d8, 6, 0, 1438670, 300001cadb0)
    %l0-3: 0000000000000005 0000000000001400 0000000080001604 0000000001174d24
    %l4-7: 000003000001f408 00000300002909d8 000000000000000d 0000000001409710
    00000000014097b0 genunix:segmap_create+2ac (3000039ff38, 140991c, 75eb0000, 1, 140a004, 0)
    %l0-3: 0000030000d125d8 0000000000000000 00000300003b30c0 0000000000000000
    %l4-7: 00000000014580e8 0000000001445400 0000000001458000 0000000001458000
    0000000001409860 unix:startup_vm+374 (ffffffffffffffff, 1413310, 14186a0, 103, 78004000, 1432000)
    %l0-3: 000000000142ac00 0000000000010000 00000000014386a0 0000000001438670
    %l4-7: 000002a750000000 000000000149a800 000000000142c000 000000000140c000
    0000000001409970 unix:startup+34 (1, 0, 0, 142e6b8, 1400000, 0)
    %l0-3: 0000000000000001 0000000000000003 00000000babecafe 0000000000000000
    %l4-7: 000000000142c000 000000000140e000 0000000001416208 0000000001439ca8
    0000000001409a20 genunix:main+4 (1409ba0, f006a410, 1409ec0, 39bc9f, 2000, 500)
    %l0-3: 000000000140b400 000000000140a000 0000000001413018 0000000000000000
    %l4-7: 0000000078002000 00000000003a4000 00000000014a3da0 0000000001067bf8
    skipping system dump - no dump device configured
    rebooting...
    Resetting ...
    RSC Alert: Host System has Reset
    Software Reset
    Enabling system bus....... Done
    Initializing CPUs......... Done
    Initializing boot memory.. Done
    Initializing OpenBoot
    Probing system devices
    ChassisSerialNumber 0621AN1969
    Probing I/O buses
    Probing system devices
    ChassisSerialNumber 0621AN1969
    Probing I/O buses
    Sun Fire V490, No Keyboard
    Copyright 2005 Sun Microsystems, Inc. All rights reserved.
    OpenBoot 4.18.8, 16384 MB memory installed, Serial #69096519.
    Ethernet address 0:14:4f:1e:54:47, Host ID: 841e5447.
    Rebooting with command: boot
    Boot device: rootdisk File and args:
    SunOS Release 5.9 Version Generic_118558-28 64-bit
    Copyright 1983-2003 Sun Microsystems, Inc. All rights reserved.
    Use is subject to license terms.
    |
    panic[cpu3]/thread=140a000: [AFT1] errID 0x00000009.9112b00c UCU WDU Error(s)
    See previous message(s) for details
    0000000001408a40 SUNW,UltraSPARC-IV:cpu_aflt_log+66c (1408b4b, 1, 1408da8, 10, 1184e40, 1184e68)
    %l0-3: 0000000001408c88 0000000000000010 0000000000000003 0000000001408da8
    %l4-7: 0000000001184e40 0000000001184e68 0000000000000000 0000000001408afe
    0000000001408c90 SUNW,UltraSPARC-IV:cpu_fast_ecc_error+324 (1409710, 1, 0, 0, 0, 0)
    %l0-3: 0000000000000000 0000000000000000 000000a1ffd15be0 0010022000000189
    %l4-7: 0000000001409710 0000000000000001 0000022000000000 00000300003aaa90
    0000000001409660 unix:ktl0+48 (1000000, 30000d11bc8, 6, 0, 1438670, 300001cadb0)
    %l0-3: 0000000000000005 0000000000001400 0000000080001604 0000000001174d24
    %l4-7: 000003000001f408 00000300002909d8 000000000000000d 0000000001409710
    00000000014097b0 genunix:segmap_create+2ac (3000039ff38, 140991c, 75eb0000, 1, 140a004, 0)
    %l0-3: 0000030000d11bc8 0000000000000000 00000300003b30c0 0000000000000000
    %l4-7: 00000000014580e8 0000000001445400 0000000001458000 0000000001458000
    0000000001409860 unix:startup_vm+374 (ffffffffffffffff, 1413310, 14186a0, 103, 78004000, 1432000)
    %l0-3: 000000000142ac00 0000000000010000 00000000014386a0 0000000001438670
    %l4-7: 000002a750000000 000000000149a800 000000000142c000 000000000140c000
    0000000001409970 unix:startup+34 (1, 0, 0, 142e6b8, 1400000, 0)
    %l0-3: 0000000000000001 0000000000000003 00000000babecafe 0000000000000000
    %l4-7: 000000000142c000 000000000140e000 0000000001416208 0000000001439ca8
    0000000001409a20 genunix:main+4 (1409ba0, f006a410, 1409ec0, 39bc9f, 2000, 500)
    %l0-3: 000000000140b400 000000000140a000 0000000001413018 0000000000000000
    %l4-7: 0000000078002000 00000000003a4000 00000000014a3da0 0000000001067bf8
    skipping system dump - no dump device configured
    rebooting...
    Resetting ...
    RSC Alert: Host System has Reset
    Software Reset
    Enabling system bus....... Done
    Initializing CPUs......... Done
    Initializing boot memory.. Done
    Initializing OpenBoot
    Probing system devices
    ChassisSerialNumber 0621AN1969
    Probing I/O buses
    Probing system devices
    ChassisSerialNumber 0621AN1969
    Probing I/O buses
    Sun Fire V490, No Keyboard
    Copyright 2005 Sun Microsystems, Inc. All rights reserved.
    OpenBoot 4.18.8, 16384 MB memory installed, Serial #69096519.
    Ethernet address 0:14:4f:1e:54:47, Host ID: 841e5447.
    Rebooting with command: boot
    Boot device: rootdisk File and args:
    SunOS Release 5.9 Version Generic_118558-28 64-bit
    Copyright 1983-2003 Sun Microsystems, Inc. All rights reserved.
    Use is subject to license terms.
    |
    panic[cpu3]/thread=140a000: [AFT1] errID 0x00000009.b4ea03a4 UCU WDU Error(s)
    See previous message(s) for details
    0000000001408a40 SUNW,UltraSPARC-IV:cpu_aflt_log+66c (1408b4b, 1, 1408da8, 10, 1184e40, 1184e68)
    %l0-3: 0000000001408c88 0000000000000010 0000000000000003 0000000001408da8
    %l4-7: 0000000001184e40 0000000001184e68 0000000000000000 0000000001408afe
    0000000001408c90 SUNW,UltraSPARC-IV:cpu_fast_ecc_error+324 (1409710, 1, 0, 0, 0, 0)
    %l0-3: 0000000000000000 0000000000000000 000000a1ffd19be0 0010022000000189
    %l4-7: 0000000001409710 0000000000000001 0000022000000000 00000300003aaa90
    0000000001409660 unix:ktl0+48 (1000000, 30000d15be0, 6, 0, 1438670, 300001cadb0)
    %l0-3: 0000000000000005 0000000000001400 0000000080001604 0000000001174d24
    %l4-7: 000003000001f408 00000300002909d8 000000000000000d 0000000001409710
    00000000014097b0 genunix:segmap_create+2ac (3000039ff38, 140991c, 75eb0000, 1, 140a004, 0)
    %l0-3: 0000030000d15be0 0000000000000000 00000300003b30c0 0000000000000000
    %l4-7: 00000000014580e8 0000000001445400 0000000001458000 0000000001458000
    0000000001409860 unix:startup_vm+374 (ffffffffffffffff, 1413310, 14186a0, 103, 78004000, 1432000)
    %l0-3: 000000000142ac00 0000000000010000 00000000014386a0 0000000001438670
    %l4-7: 000002a750000000 000000000149a800 000000000142c000 000000000140c000
    0000000001409970 unix:startup+34 (1, 0, 0, 142e6b8, 1400000, 0)
    %l0-3: 0000000000000001 0000000000000003 00000000babecafe 0000000000000000
    %l4-7: 000000000142c000 000000000140e000 0000000001416208 0000000001439ca8
    0000000001409a20 genunix:main+4 (1409ba0, f006a410, 1409ec0, 39bc9f, 2000, 500)
    %l0-3: 000000000140b400 000000000140a000 0000000001413018 0000000000000000
    %l4-7: 0000000078002000 00000000003a4000 00000000014a3da0 0000000001067bf8
    skipping system dump - no dump device configured
    rebooting...
    Resetting ...
    RSC Alert: Host System has Reset
    Software Reset
    Enabling system bus....... Done
    Initializing CPUs......... Done
    Initializing boot memory.. Done
    Initializing OpenBoot
    Probing system devices
    ChassisSerialNumber 0621AN1969
    Probing I/O buses
    Probing system devices
    ChassisSerialNumber 0621AN1969
    Probing I/O buses
    Sun Fire V490, No Keyboard
    Copyright 2005 Sun Microsystems, Inc. All rights reserved.
    OpenBoot 4.18.8, 16384 MB memory installed, Serial #69096519.
    Ethernet address 0:14:4f:1e:54:47, Host ID: 841e5447.
    Rebooting with command: boot
    Boot device: rootdisk File and args:
    SunOS Release 5.9 Version Generic_118558-28 64-bit
    Copyright 1983-2003 Sun Microsystems, Inc. All rights reserved.
    Use is subject to license terms.
    |
    panic[cpu3]/thread=140a000: [AFT1] errID 0x00000009.72071748 UCU WDU Error(s)
    See previous message(s) for details
    0000000001408a40 SUNW,UltraSPARC-IV:cpu_aflt_log+66c (1408b4b, 1, 1408da8, 10, 1184e40, 1184e68)
    %l0-3: 0000000001408c88 0000000000000010 0000000000000003 0000000001408da8
    %l4-7: 0000000001184e40 0000000001184e68 0000000000000000 0000000001408afe
    0000000001408c90 SUNW,UltraSPARC-IV:cpu_fast_ecc_error+324 (1409710, 1, 0, 0, 0, 0)
    %l0-3: 0000000000000000 0000000000000000 000000a1ffd15bf0 0010022000000003
    %l4-7: 0000000001409710 0000000000000001 0000022000000000 00000000014095c0
    0000000001409660 unix:ktl0+48 (1000000, 30000d11bc8, 6, 0, 1438670, 300001cadb0)
    %l0-3: 0000000000000005 0000000000001400 0000000080001604 0000000001174d24
    %l4-7: 000003000001f408 00000300002909d8 000000000000000d 0000000001409710
    00000000014097b0 genunix:segmap_create+2ac (3000039ff38, 140991c, 75eb0000, 1, 140a004, 0)
    %l0-3: 0000030000d11bc8 0000000000000000 00000300003b30c0 0000000000000000
    %l4-7: 00000000014580e8 0000000001445400 0000000001458000 0000000001458000
    0000000001409860 unix:startup_vm+374 (ffffffffffffffff, 1413310, 14186a0, 103, 78004000, 1432000)
    %l0-3: 000000000142ac00 0000000000010000 00000000014386a0 0000000001438670
    %l4-7: 000002a750000000 000000000149a800 000000000142c000 000000000140c000
    0000000001409970 unix:startup+34 (1, 0, 0, 142e6b8, 1400000, 0)
    %l0-3: 0000000000000001 0000000000000003 00000000babecafe 0000000000000000
    %l4-7: 000000000142c000 000000000140e000 0000000001416208 0000000001439ca8
    0000000001409a20 genunix:main+4 (1409ba0, f006a410, 1409ec0, 39bc9f, 2000, 500)
    %l0-3: 000000000140b400 000000000140a000 0000000001413018 0000000000000000
    %l4-7: 0000000078002000 00000000003a4000 00000000014a3da0 0000000001067bf8
    skipping system dump - no dump device configured
    rebooting...
    Resetting ...
    RSC Alert: Host System has Reset
    Software Reset
    Enabling system bus....... Done
    Initializing CPUs......... Done
    Initializing boot memory.. Done
    Initializing OpenBoot
    Probing system devices
    ChassisSerialNumber 0621AN1969
    Probing I/O buses
    Probing system devices
    ChassisSerialNumber 0621AN1969
    Probing I/O buses
    Sun Fire V490, No Keyboard
    Copyright 2005 Sun Microsystems, Inc. All rights reserved.
    OpenBoot 4.18.8, 16384 MB memory installed, Serial #69096519.
    Ethernet address 0:14:4f:1e:54:47, Host ID: 841e5447.
    Rebooting with command: boot
    Boot device: rootdisk File and args:
    SunOS Release 5.9 Version Generic_118558-28 64-bit
    Copyright 1983-2003 Sun Microsystems, Inc. All rights reserved.
    Use is subject to license terms.
    |
    panic[cpu3]/thread=140a000: [AFT1] errID 0x00000009.57883e4c UCU WDU Error(s)
    See previous message(s) for details
    0000000001408a40 SUNW,UltraSPARC-IV:cpu_aflt_log+66c (1408b4b, 1, 1408da8, 10, 1184e40, 1184e68)
    %l0-3: 0000000001408c88 0000000000000010 0000000000000003 0000000001408da8
    %l4-7: 0000000001184e40 0000000001184e68 0000000000000000 0000000001408afe
    0000000001408c90 SUNW,UltraSPARC-IV:cpu_fast_ecc_error+324 (1409710, 1, 0, 0, 0, 0)
    %l0-3: 0000000000000000 0000000000000000 000000a1ffd15be0 0010022000000189
    %l4-7: 0000000001409710 0000000000000001 0000022000000000 00000300003aaa90
    0000000001409660 unix:ktl0+48 (1000000, 30000d11bc8, 6, 0, 1438670, 300001cadb0)
    %l0-3: 0000000000000005 0000000000001400 0000000080001604 0000000001174d24
    %l4-7: 000003000001f408 00000300002909d8 000000000000000d 0000000001409710
    00000000014097b0 genunix:segmap_create+2ac (3000039ff38, 140991c, 75eb0000, 1, 140a004, 0)
    %l0-3: 0000030000d11bc8 0000000000000000 00000300003b30c0 0000000000000000
    %l4-7: 00000000014580e8 0000000001445400 0000000001458000 0000000001458000
    0000000001409860 unix:startup_vm+374 (ffffffffffffffff, 1413310, 14186a0, 103, 78004000, 1432000)
    %l0-3: 000000000142ac00 0000000000010000 00000000014386a0 0000000001438670
    %l4-7: 000002a750000000 000000000149a800 000000000142c000 000000000140c000
    0000000001409970 unix:startup+34 (1, 0, 0, 142e6b8, 1400000, 0)
    %l0-3: 0000000000000001 0000000000000003 00000000babecafe 0000000000000000
    %l4-7: 000000000142c000 000000000140e000 0000000001416208 0000000001439ca8
    0000000001409a20 genunix:main+4 (1409ba0, f006a410, 1409ec0, 39bc9f, 2000, 500)
    %l0-3: 000000000140b400 000000000140a000 0000000001413018 0000000000000000
    %l4-7: 0000000078002000 00000000003a4000 00000000014a3da0 0000000001067bf8
    skipping system dump - no dump device configured
    rebooting...
    Resetting ...
    RSC Alert: Host System has Reset
    Software Reset
    Enabling system bus....... Done
    Initializing CPUs......... Done
    Initializing boot memory.. Done
    Initializing OpenBoot
    Probing system devices
    ChassisSerialNumber 0621AN1969
    Probing I/O buses
    Probing system devices
    ChassisSerialNumber 0621AN1969
    Probing I/O buses
    Sun Fire V490, No Keyboard
    Copyright 2005 Sun Microsystems, Inc. All rights reserved.
    OpenBoot 4.18.8, 16384 MB memory installed, Serial #69096519.
    Ethernet address 0:14:4f:1e:54:47, Host ID: 841e5447.
    Rebooting with command: boot
    Boot device: rootdisk File and args:
    SunOS Release 5.9 Version Generic_118558-28 64-bit
    Copyright 1983-2003 Sun Microsystems, Inc. All rights reserved.
    Use is subject to license terms.
    |
    panic[cpu3]/thread=140a000: [AFT1] errID 0x00000009.57dfd300 UCU WDU Error(s)
    See previous message(s) for details
    0000000001408a40 SUNW,UltraSPARC-IV:cpu_aflt_log+66c (1408b4b, 1, 1408da8, 10, 1184e40, 1184e68)
    %l0-3: 0000000001408c88 0000000000000010 0000000000000003 0000000001408da8
    %l4-7: 0000000001184e40 0000000001184e68 0000000000000000 0000000001408afe
    0000000001408c90 SUNW,UltraSPARC-IV:cpu_fast_ecc_error+324 (1409710, 1, 0, 0, 0, 0)
    %l0-3: 0000000000000000 0000000000000000 000000a1ffd15be0 0010022000000189
    %l4-7: 0000000001409710 0000000000000001 0000022000000000 00000300003aaa90
    0000000001409660 unix:ktl0+48 (1000000, 30000d11bc8, 6, 0, 1438670, 300001cadb0)
    %l0-3: 0000000000000005 0000000000001400 0000000080001604 0000000001174d24
    %l4-7: 000003000001f408 00000300002909d8 000000000000000d 0000000001409710
    00000000014097b0 genunix:segmap_create+2ac (3000039ff38, 140991c, 75eb0000, 1, 140a004, 0)
    %l0-3: 0000030000d11bc8 0000000000000000 00000300003b30c0 0000000000000000
    %l4-7: 00000000014580e8 0000000001445400 0000000001458000 0000000001458000
    0000000001409860 unix:startup_vm+374 (ffffffffffffffff, 1413310, 14186a0, 103, 78004000, 1432000)
    %l0-3: 000000000142ac00 0000000000010000 00000000014386a0 0000000001438670
    %l4-7: 000002a750000000 000000000149a800 000000000142c000 000000000140c000
    0000000001409970 unix:startup+34 (1, 0, 0, 142e6b8, 1400000, 0)
    %l0-3: 0000000000000001 0000000000000003 00000000babecafe 0000000000000000
    %l4-7: 000000000142c000 000000000140e000 0000000001416208 0000000001439ca8
    0000000001409a20 genunix:main+4 (1409ba0, f006a410, 1409ec0, 39bc9f, 2000, 500)
    %l0-3: 000000000140b400 000000000140a000 0000000001413018 0000000000000000
    %l4-7: 0000000078002000 00000000003a4000 00000000014a3da0 0000000001067bf8
    skipping system dump - no dump device configured
    rebooting...
    Resetting ...
    RSC Alert: Host System has Reset
    Software Reset
    Enabling system bus....... Done
    Initializing CPUs......... Done
    Initializing boot memory.. Done
    Initializing OpenBoot
    Probing system devices
    ChassisSerialNumber 0621AN1969
    Probing I/O buses
    Probing system devices
    ChassisSerialNumber 0621AN1969
    Probing I/O buses
    Sun Fire V490, No Keyboard
    Copyright 2005 Sun Microsystems, Inc. All rights reserved.
    OpenBoot 4.18.8, 16384 MB memory installed, Serial #69096519.
    Ethernet address 0:14:4f:1e:54:47, Host ID: 841e5447.
    Rebooting with command: boot
    Boot device: rootdisk File and args:
    SunOS Release 5.9 Version Generic_118558-28 64-bit
    Copyright 1983-2003 Sun Microsystems, Inc. All rights reserved.
    Use is subject to license terms.
    Hardware watchdog enabled
    WARNING: forceload of misc/md_trans failed
    WARNING: forceload of misc/md_raid failed
    WARNING: forceload of misc/md_hotspares failed
    WARNING: forceload of misc/md_sp failed
    configuring IPv4 interfaces: ce0 ce4.
    Hostname: smscd2
    Could not open /dev/rmt/0l to verify device id.
    No such device or address
    Booting as part of a cluster
    NOTICE: CMM: Node smscd1 (nodeid = 1) with votecount = 1 added.
    NOTICE: CMM: Node smscd2 (nodeid = 2) with votecount = 1 added.
    NOTICE: CMM: Quorum device 1 (/dev/did/rdsk/d4s2) added; votecount = 1, bitmask of nodes with configured paths = 0x3.
    NOTICE: clcomm: Adapter ce9 constructed
    NOTICE: clcomm: Path smscd2:ce9 - smscd1:ce9 being constructed
    NOTICE: clcomm: Adapter ce8 constructed
    NOTICE: clcomm: Path smscd2:ce8 - smscd1:ce8 being constructed
    NOTICE: clcomm: Adapter ce3 constructed
    NOTICE: clcomm: Path smscd2:ce3 - smscd1:ce7 being constructed
    NOTICE: clcomm: Adapter ce7 constructed
    NOTICE: clcomm: Path smscd2:ce7 - smscd1:ce3 being constructed
    NOTICE: CMM: Node smscd2: attempting to join cluster.
    NOTICE: clcomm: Path smscd2:ce8 - smscd1:ce8 being initiated
    NOTICE: clcomm: Path smscd2:ce9 - smscd1:ce9 being initiated
    NOTICE: clcomm: Path smscd2:ce7 - smscd1:ce3 being initiated
    NOTICE: clcomm: Path smscd2:ce3 - smscd1:ce7 being initiated
    NOTICE: CMM: Node smscd1 (nodeid: 1, incarnation #: 1212407740) has become reachable.
    NOTICE: clcomm: Path smscd2:ce8 - smscd1:ce8 online
    NOTICE: clcomm: Path smscd2:ce9 - smscd1:ce9 online
    NOTICE: clcomm: Path smscd2:ce7 - smscd1:ce3 online
    NOTICE: clcomm: Path smscd2:ce3 - smscd1:ce7 online
    NOTICE: CMM: Cluster has reached quorum.
    NOTICE: CMM: Node smscd1 (nodeid = 1) is up; new incarnation number = 1212407740.
    NOTICE: CMM: Node smscd2 (nodeid = 2) is up; new incarnation number = 1212562100.
    NOTICE: CMM: Cluster members: smscd1 smscd2.
    NOTICE: CMM: node reconfiguration #93 completed.
    NOTICE: CMM: Node smscd2: joined cluster.
    ip: joining multicasts failed (18) on clprivnet0 - will use link layer broadcasts for multicast
    Could not open /dev/rmt/0l to verify device id.
    No such device or address
    The system is coming up. Please wait.
    checking ufs filesystems
    /dev/md/rdsk/d230: is logging.
    Implementing Solaris Network Tuning.
    Adding static routes for use as IPMP targets
    add host 172.28.35.30: gateway 172.28.35.30
    add host 172.28.35.31: gateway 172.28.35.31
    add host 172.28.35.32: gateway 172.28.35.32
    add host 172.28.35.50: gateway 172.28.35.50
    starting rpc services: rpcbind done.
    Setting netmask of ce0 to 255.255.255.0
    Setting netmask of ce0:1 to 255.255.255.0
    Setting netmask of ce4 to 255.255.255.0
    Setting netmask of ce9 to 255.255.255.128
    Setting netmask of ce8 to 255.255.255.128
    Setting netmask of ce3 to 255.255.255.128
    Setting netmask of ce7 to 255.255.255.128
    Setting netmask of clprivnet0 to 255.255.255.0
    Setting default IPv4 interface for multicast: add net 224.0/4: gateway smscd2
    syslog service starting.
    obtaining access to all attached disks
    Jun 4 09:49:05 smscd2 savecore: saving system crash dump in /var/crash/smscd2/*.8
    Notifying cluster that this node is panicking
    WARNING: uncorrectable error detected by pci0 (safari id 00000000.00000009) during
    DVMA read transaction
    WARNING: uncorrectable error detected by pci0 (safari id 00000000.00000009) during
    DVMA read transaction
    WARNING: [AFT1] Corrected system bus (CE) Event detected by CPU3 at TL=0, errID 0x00000029.377bec28
    AFSR 0x00000002<CE>.0000003d AFAR 0x000000a1.ffd197d0
    Fault_PC 0x0 Esynd 0x003d Slot A: J8200
    [AFT1] errID 0x00000029.377bec28 Data Bit 67 was in error and corrected
    panic[cpu1]/thread=2a10000bd40: Fatal PCI UE Error
    syncing file systems... [2] 63 [2] 61 [2] 61 [2] 61 [2] 61 [2] 61 [2] 61 [2] 61 [2] 61 [2] 61 [2] 61 [2] 61 [2] 61 [2] 61 [2] 61 [2] 61 [2] 61 [2] 61 [2] 61 [2] 61 [2] 61 [2] 61 done (not all i/o completed)
    dumping to /dev/dsk/c1t0d0s1, offset 65536, content: kernel
    100% done: 155857 pages dumped, compression ratio 8.07, dump succeeded
    rebooting...
    Resetting ...
    RSC Alert: Host System has Reset
    Software Reset
    Enabling system bus....... Done
    Initializing CPUs.........rsc>
    rsc>
    rsc>
    rsc>
    rsc>
    rsc>
    rsc> poweroff
    Are you sure you want to turn your system power off (Yes/No)? Yes
    rsc>
    rsc>
    rsc>
    rsc>
    rsc>
    RSC Alert: Host system has shut down.
    rsc>
    rsc>
    rsc>
    rsc>
    rsc>
    rsc>
    rsc>
    rsc>

    cpu3 (which is on board B) is doing most of the barking at you.
    You likely have a bad DIMM.
    Use your service contract and open a support case with Sun.
    They'll be able to analyze the details of the panic events and will arrange to have the system serviced.

Maybe you are looking for

  • Creating a database with Sun Java Application Server 9

    I am using a slightly outdated reference book on J2EE programming. It gives 2 methods of creating a database used in its casestudies. The first is an ANT script that gives the following output: D:\original\CaseStudy-2-5\CaseStudy\Day02\exercise>asant

  • I need a sample excel data for practicing Dashboards

    Hi Experts ,                     I am new to SAP  BO  Dashboards. i need sample excel data for practicing and designing a dash boards . kindly help me to get sample excel files from any where .Please suggest me where i can get sample excel files. Reg

  • Ipad already sync'd with other iTunes Library

    We recently upgraded our PC to Windows 7 and now when I go to sync my iPad I get an error message that my Ipad is sync'd with another iTunes Library. I have read a few disucssions on this but am still not clear on what to do. Before we upgraded I did

  • DB connection using Tomcat

    Hi, Can I know how to get connected to DB using Tomcat. Any souce code of one sample prog. will be helpful. Uma

  • Information required about ESS MSS forms

    Please let me know following points:- 1.As per my understanding HCM Processes and Forms ( Hiring, Transfer ,Maternity leave ,Termination ) needs Hr administrator Role it  not present in portal box so please let me know if we need it?. 2.It belongs to