Grid Infrastructure Does Not Start Cluster Resources

Hello Gurus,
I configured a 2 node RAC cluster using VirtualBox.It has been running fine all along and each time I started one of the nodes, I will definitely see all of other Cluster Resources will be started eventually.
However, after I left it untouched for a month (VM is stopped), I found out that after starting up the machine, only local resource which is ONLINE.
This is what I get:
[grid@oel6-112-rac1 bin]$ ./crsctl status resource -t
NAME           TARGET  STATE        SERVER                   STATE_DETAILS      
Local Resources
ora.CRS.dg
               ONLINE  ONLINE       oel6-112-rac1                               
ora.DATADG.dg
               ONLINE  ONLINE       oel6-112-rac1                               
ora.FRADG.dg
               ONLINE  ONLINE       oel6-112-rac1                               
ora.LISTENER.lsnr
               OFFLINE OFFLINE      oel6-112-rac1                               
ora.asm
               ONLINE  ONLINE       oel6-112-rac1            Started            
ora.gsd
               OFFLINE OFFLINE      oel6-112-rac1                               
ora.net1.network
               ONLINE  ONLINE       oel6-112-rac1                               
ora.ons
               ONLINE  ONLINE       oel6-112-rac1                               
Cluster Resources
ora.LISTENER_SCAN1.lsnr
      1        OFFLINE OFFLINE                                                  
ora.LISTENER_SCAN2.lsnr
      1        OFFLINE OFFLINE                                                  
ora.LISTENER_SCAN3.lsnr
      1        OFFLINE OFFLINE                                                  
ora.cvu
      1        OFFLINE OFFLINE                                                  
ora.oc4j
      1        OFFLINE OFFLINE                                                  
ora.oel6-112-rac1.vip
      1        OFFLINE OFFLINE                                                  
ora.oel6-112-rac2.vip
      1        OFFLINE OFFLINE                                                  
ora.racdb.db
      1        OFFLINE OFFLINE                               Instance Shutdown  
      2        OFFLINE OFFLINE                                                  
ora.scan1.vip
      1        OFFLINE OFFLINE                                                  
ora.scan2.vip
      1        OFFLINE OFFLINE                                                  
ora.scan3.vip
      1        OFFLINE OFFLINE                                               
and these are my other resources
[grid@oel6-112-rac1 bin]$ ./crsctl status resource -t -init
NAME           TARGET  STATE        SERVER                   STATE_DETAILS    
Cluster Resources
ora.asm
      1        ONLINE  ONLINE       oel6-112-rac1            Started          
ora.cluster_interconnect.haip
      1        ONLINE  ONLINE       oel6-112-rac1                             
ora.crf
      1        ONLINE  ONLINE       oel6-112-rac1                             
ora.crsd
      1        ONLINE  ONLINE       oel6-112-rac1                             
ora.cssd
      1        ONLINE  ONLINE       oel6-112-rac1                             
ora.cssdmonitor
      1        ONLINE  ONLINE       oel6-112-rac1                             
ora.ctssd
      1        ONLINE  ONLINE       oel6-112-rac1            ACTIVE:0         
ora.diskmon
      1        OFFLINE OFFLINE                                                
ora.evmd
      1        ONLINE  ONLINE       oel6-112-rac1                             
ora.gipcd
      1        ONLINE  ONLINE       oel6-112-rac1                             
ora.gpnpd
      1        ONLINE  ONLINE       oel6-112-rac1                             
ora.mdnsd
      1        ONLINE  ONLINE       oel6-112-rac1                       
Where do I supposed to check to see why the Cluster Resource like SCAN Listener, Database and etc not running?
I've been checking on the logs but I haven't figured out what I should be looking at.
Can some body help me?
Thank you in advanced,
Adhika

Hi Freddie,
I saw these lines on that Clusterware alert log:
2013-07-01 22:39:20.084
[crsd(3338)]CRS-1012:The OCR service started on node oel6-112-rac1.
2013-07-01 22:39:20.208
[evmd(3145)]CRS-1401:EVMD started on node oel6-112-rac1.
2013-07-01 22:39:21.549
[crsd(3338)]CRS-1201:CRSD started on node oel6-112-rac1.
2013-07-01 22:39:22.715
[/u01/app/11203/grid/bin/oraagent.bin(3450)]CRS-5016:Process "/u01/app/11203/grid/bin/lsnrctl" spawned by agent "/u01/app/11203/grid/bin/oraagent.bin" for action "check" failed: details at "(:CLSN00010:)" in "/u01/app/11203/grid/log/oel6-112-rac1/agent/crsd/oraagent_grid/oraagent_grid.log"
2013-07-01 22:39:22.728
[/u01/app/11203/grid/bin/oraagent.bin(3450)]CRS-5016:Process "/u01/app/11203/grid/bin/lsnrctl" spawned by agent "/u01/app/11203/grid/bin/oraagent.bin" for action "check" failed: details at "(:CLSN00010:)" in "/u01/app/11203/grid/log/oel6-112-rac1/agent/crsd/oraagent_grid/oraagent_grid.log"
2013-07-01 22:39:22.772
[/u01/app/11203/grid/bin/oraagent.bin(3450)]CRS-5016:Process "/u01/app/11203/grid/bin/lsnrctl" spawned by agent "/u01/app/11203/grid/bin/oraagent.bin" for action "check" failed: details at "(:CLSN00010:)" in "/u01/app/11203/grid/log/oel6-112-rac1/agent/crsd/oraagent_grid/oraagent_grid.log"
2013-07-01 22:39:22.811
[/u01/app/11203/grid/bin/oraagent.bin(3450)]CRS-5016:Process "/u01/app/11203/grid/bin/lsnrctl" spawned by agent "/u01/app/11203/grid/bin/oraagent.bin" for action "check" failed: details at "(:CLSN00010:)" in "/u01/app/11203/grid/log/oel6-112-rac1/agent/crsd/oraagent_grid/oraagent_grid.log"
2013-07-01 22:39:23.069
[/u01/app/11203/grid/bin/oraagent.bin(3450)]CRS-5016:Process "/u01/app/11203/grid/opmn/bin/onsctli" spawned by agent "/u01/app/11203/grid/bin/oraagent.bin" for action "check" failed: details at "(:CLSN00010:)" in "/u01/app/11203/grid/log/oel6-112-rac1/agent/crsd/oraagent_grid/oraagent_grid.log"
2013-07-01 22:39:23.567
[crsd(3338)]CRS-2772:Server 'oel6-112-rac1' has been assigned to pool 'Generic'.
2013-07-01 22:39:23.568
[crsd(3338)]CRS-2772:Server 'oel6-112-rac1' has been assigned to pool 'ora.racdb'.
The I started looking in the /u01/app/11203/grid/log/oel6-112-rac1/agent/crsd/oraagent_grid/oraagent_grid.log file and found out that at the same time (2013-07-01 22:39:22),
I saw the following lines:
2013-07-01 22:39:22.433: [ora.CRS.dg][1644160768] {1:13152:2} [check] DgpAgent::getConnxn connection failure 1
2013-07-01 22:39:22.433: [ora.CRS.dg][1644160768] {1:13152:2} [check] DgpAgent::getConnxn failed CRS-5000: Expected resource ora.asm does not exist in agent process
2013-07-01 22:39:22.434: [ora.CRS.dg][1644160768] {1:13152:2} [check] DgpAgent::getConnxn try getInstanceInforWhenASMFail
2013-07-01 22:39:22.434: [ora.CRS.dg][1644160768] {1:13152:2} [check] CrsCmd::ClscrsCmdData::stat entity 1 statflag 33 useFilter 0
But that does not prevent the asm from being started properly.
The only local resource that didn't start up automatically was the LISTENER.
The following command shows that the local LISTENER has hard dependency on ora.cluster_vip_net1.type which is the ora.oel6-112-rac1.vip
[grid@oel6-112-rac1 bin]$ ./crsctl status resource ora.LISTENER.lsnr -p | grep -ie dependencies
START_DEPENDENCIES=hard(type:ora.cluster_vip_net1.type) pullup(type:ora.cluster_vip_net1.type)
STOP_DEPENDENCIES=hard(intermediate:type:ora.cluster_vip_net1.type)
NAME=ora.oel6-112-rac1.vip
TYPE=ora.cluster_vip_net1.type
START_DEPENDENCIES=hard(ora.net1.network) pullup(ora.net1.network)
STOP_DEPENDENCIES=hard(ora.net1.network)
[grid@oel6-112-rac1 bin]$ ./crsctl status resource ora.net1.network -p | grep -ie dependencies
START_DEPENDENCIES=
STOP_DEPENDENCIES=
The ora.net1.network resource started properly and I didn't see that this prevent the ora.oel6-112-rac1.vip from starting up.
The following lines also show that the ora.asm resource is has a weak dependency only against the ora.LISTENER.lsnr
[grid@oel6-112-rac1 bin]$ ./crsctl status resource ora.racdb.db -p | grep -ie dependencies
START_DEPENDENCIES=hard(ora.DATADG.dg,ora.FRADG.dg) weak(type:ora.listener.type,global:type:ora.scan_listener.type,uniform:ora.ons,global:ora.gns) pullup(ora.DATADG.dg,ora.FRADG.dg)
STOP_DEPENDENCIES=hard(intermediate:ora.asm,shutdown:ora.DATADG.dg,shutdown:ora.FRADG.dg)
[grid@oel6-112-rac1 bin]$ ./crsctl status resource ora.CRS.dg -p | grep -ie dependenci
START_DEPENDENCIES=hard(ora.asm) pullup(ora.asm)
STOP_DEPENDENCIES=hard(intermediate:ora.asm)
[grid@oel6-112-rac1 bin]$ ./crsctl status resource ora.DATADG.dg -p | grep -ie dependencies
START_DEPENDENCIES=hard(ora.asm) pullup(ora.asm)
STOP_DEPENDENCIES=hard(intermediate:ora.asm)
[grid@oel6-112-rac1 bin]$ ./crsctl status resource ora.FRADG.dg -p | grep -ie dependencies
START_DEPENDENCIES=hard(ora.asm) pullup(ora.asm)
STOP_DEPENDENCIES=hard(intermediate:ora.asm)
[grid@oel6-112-rac1 bin]$ ./crsctl status resource ora.asm -p | grep -ie dependencies
START_DEPENDENCIES=weak(ora.LISTENER.lsnr)
STOP_DEPENDENCIES=
I'm a little lost here.
A suggestion would be very much appreciated.
Thank you,
Adhika

Similar Messages

  • CSSD does not start (Cluster Manager)

    Hi, All,
    I had installed Oracle 10.2.0 and I'm gone use ASM. But when I'm starting de CSSD nothing happens. No process are submited.
    The description :
    # ./localconfig reset $ORACLE_HOME
    Successfully accumulated necessary OCR keys.
    Creating OCR keys for user 'root', privgrp 'root'..
    Operation successful.
    Configuration for local CSS has been initialized
    Adding to inittab
    Startup will be queued to init within 90 seconds.
    Checking the status of new Oracle init process...
    Expecting the CRS daemons to be up within 600 seconds.
    Giving up: Oracle CSS stack appears NOT to be running.
    Oracle CSS service would not start as installed
    Automatic Storage Management(ASM) cannot be used until Oracle CSS service is started
    Can someone help me?
    **The host name are not in capital letter

    HI thanks for the reply,
    Following is the log generated:
    /u01/app/oracle/product/10.2.0/db_1/log/ldi/cssd>more ocssd.log
    Oracle Database 10g CRS Release 10.2.0.1.0 Production Copyright 1996, 2005 Oracle. All rights reserved.
    [    CSSD]2007-06-18 15:09:10.371 >USER: Oracle Database 10g CSS Release 10.2.0.1.0 Production Copyright 1996, 2004 Oracle.
    All rights reserved.
    [  clsdmt]Listening to (ADDRESS=(PROTOCOL=ipc)(KEY=ldiDBG_CSSD))
    [    CSSD]2007-06-18 15:09:10.371 >USER: CSS daemon log for node ldi, number 0, in cluster localhost
    [    CSSD]2007-06-18 15:09:10.418 [1] >TRACE: clssscmain: local-only set to true
    [    CSSD]2007-06-18 15:09:10.438 [1] >TRACE: clssnmReadNodeInfo: added node 0 (ldi) to cluster
    [    CSSD]2007-06-18 15:09:10.500 [5] >TRACE: clssnm_skgxnmon: skgxn init failed, rc 1
    [    CSSD]2007-06-18 15:09:10.501 [1] >TRACE: clssnm_skgxnonline: Using vacuous skgxn monitor
    [    CSSD]2007-06-18 15:09:10.502 [1] >TRACE: clssnmInitNMInfo: misscount set to 30
    [    CSSD]2007-06-18 15:09:10.508 [1] >TRACE: clssnmFatalInit: recognized localonly mode
    [    CSSD]2007-06-18 15:09:10.523 [6] >TRACE: clssnmconnect: connecting to node 0, flags 0x0001, connector 1
    [    CSSD]2007-06-18 15:09:10.557 [7] >TRACE: clsclisten: Permission denied for (ADDRESS=(PROTOCOL=ipc)(KEY=Oracle_CSS_LclLs
    tnr_localhost_0))
    [    CSSD]2007-06-18 15:09:10.558 [7] >ERROR: clssgmclientlsnr: listening failed for (ADDRESS=(PROTOCOL=ipc)(KEY=Oracle_CSS_
    LclLstnr_localhost_0)) (3)
    [    CSSD]2007-06-18 15:09:10.558 [7] >TRACE: clssgmclientlsnr: listening on (ADDRESS=(PROTOCOL=ipc)(KEY=Oracle_CSS_LclLstnr
    localhost0))
    [    CSSD]2007-06-18 15:09:10.558 [7] >TRACE: clssgmclientlsnr: listening on (ADDRESS=(PROTOCOL=ipc)(KEY=OCSSD_LL_ldi_localh
    ost))
    [    CSSD]2007-06-18 17:03:00.680 >USER: Oracle Database 10g CSS Release 10.2.0.1.0 Production Copyright 1996, 2004 Oracle.
    All rights reserved.
    [    CSSD]2007-06-18 17:03:00.680 >USER: CSS daemon log for node ldi, number 0, in cluster localhost
    [    CSSD]2007-06-18 17:03:00.691 [1] >TRACE: clssscmain: local-only set to true
    [  clsdmt]Listening to (ADDRESS=(PROTOCOL=ipc)(KEY=ldiDBG_CSSD))
    [    CSSD]2007-06-18 17:03:00.701 [1] >TRACE: clssnmReadNodeInfo: added node 0 (ldi) to cluster
    [    CSSD]2007-06-18 17:03:00.728 [5] >TRACE: clssnm_skgxnmon: skgxn init failed, rc 1
    [    CSSD]2007-06-18 17:03:00.728 [1] >TRACE: clssnm_skgxnonline: Using vacuous skgxn monitor
    [    CSSD]2007-06-18 17:03:00.729 [1] >TRACE: clssnmInitNMInfo: misscount set to 30
    [    CSSD]2007-06-18 17:03:00.729 [1] >TRACE: clssnmFatalInit: recognized localonly mode
    [    CSSD]2007-06-18 17:03:00.731 [6] >TRACE: clssnmconnect: connecting to node 0, flags 0x0001, connector 1
    [    CSSD]2007-06-18 17:03:00.774 [7] >TRACE: clsclisten: Permission denied for (ADDRESS=(PROTOCOL=ipc)(KEY=Oracle_CSS_LclLs
    tnr_localhost_0))
    [    CSSD]2007-06-18 17:03:00.774 [7] >ERROR: clssgmclientlsnr: listening failed for (ADDRESS=(PROTOCOL=ipc)(KEY=Oracle_CSS_
    LclLstnr_localhost_0)) (3)
    [    CSSD]2007-06-18 17:03:00.775 [7] >TRACE: clssgmclientlsnr: listening on (ADDRESS=(PROTOCOL=ipc)(KEY=Oracle_CSS_LclLstnr
    localhost0))
    [    CSSD]2007-06-18 17:03:00.775 [7] >TRACE: clssgmclientlsnr: listening on (ADDRESS=(PROTOCOL=ipc)(KEY=OCSSD_LL_ldi_localh
    ost))
    Do we need to configure listener or any thing else also???

  • VIPCA does not start from root.sh

    Hi all,
    I've a problem in installing RAC 10g on ia64 architecture.
    S.O.: RH Enterprise Linux AS 2.1
    Oracle CRS install completed successfully.
    The problems came up during DB installation when I need to run root.sh script that should automatically invoke VIPCA.
    Here's what I see when I execute root.sh. :
    [root@rx5670 root]# /u01/app/oracle/product/10.1.0/db_1/root.sh
    Running Oracle10 root.sh script...
    \nThe following environment variables are set as:
    ORACLE_OWNER= oracle
    ORACLE_HOME= /u01/app/oracle/product/10.1.0/db_1
    Enter the full pathname of the local bin directory: [usr/local/bin]:
    Copying dbhome to /usr/local/bin ...
    Copying oraenv to /usr/local/bin ...
    Copying coraenv to /usr/local/bin ...
    \nCreating /etc/oratab file...
    Adding entry to /etc/oratab file...
    Entries will be added to the /etc/oratab file as needed by
    Database Configuration Assistant when a database is created
    Finished running generic part of root.sh script.
    Now product-specific root actions will be performed.
    Exception in thread "main" java.lang.UnsatisfiedLinkError: allocHASContext
    at oracle.ops.mgmt.has.HASContextNative.allocHASContext(Native
    Method)
    at oracle.ops.mgmt.has.HASContext.<init>(HASContext.java:93)
    at oracle.ops.mgmt.has.HASContext.getInstance(HASContext.java:223)
    at oracle.ops.mgmt.has.ClusterUtil.<init>(ClusterUtil.java:46)
    at
    oracle.ops.mgmt.cluster.GetActiveNodes.<init>(GetActiveNodes.java:164
    at
    oracle.ops.mgmt.cluster.GetActiveNodes.create(GetActiveNodes.java:213
    at oracle.ops.mgmt.cluster.Cluster.getNodes(Cluster.java:267)
    at oracle.ops.vipca.VipCA.getNodeList(VipCA.java:532)
    at oracle.ops.vipca.VipCA.processGUIArgs(VipCA.java:242)
    at oracle.ops.vipca.VipCA.runApplication(VipCA.java:2141)
    at oracle.ops.vipca.VipCA.main(VipCA.java:2423)
    [root@rx5670 root]#
    Thanks a lot,
    Simone

    CSSD does not start (Cluster Manager)
    CSSD does not start (Cluster Manager)

  • CSSD does not start during root.sh execution

    hi,
    I am using oracle10gR2 on solaris 9 sparc.
    when i start root.sh script it stops at following point.
    Running Oracle10 root.sh script...
    The following environment variables are set as:
    ORACLE_OWNER= oracle
    ORACLE_HOME= /u01/app/oracle/product/10.2.0/Db_1
    Enter the full pathname of the local bin directory: [usr/local/bin]:
    Copying dbhome to /usr/local/bin ...
    Copying oraenv to /usr/local/bin ...
    Copying coraenv to /usr/local/bin ...
    Creating /etc/oratab file...
    Adding entry to /etc/oratab file...
    Entries will be added to the /etc/oratab file as needed by
    Database Configuration Assistant when a database is created
    Finished running generic part of root.sh script.
    Now product-specific root actions will be performed.
    but i think this is not the complete run by root.sh script because complete execution of this script perform following tasks also.
    /var/opt/oracle does not exist. Creating it now.
    /etc/oracle does not exist. Creating it now.
    Successfully accumulated necessary OCR keys.
    Creating OCR keys for user 'root', privgrp 'root'..
    Operation successful.
    Oracle Cluster Registry for cluster has been initialized
    Adding to inittab
    Checking the status of Oracle init process...
    Expecting the CRS daemons to be up within 600 seconds.
    CSS is active on these nodes.
    mars
    CSS is active on all nodes.
    Oracle CSS service is installed and running under init(1M)
    I have tried to use the localconfig reset command but still it is giving same error.
    I have searched through this forum but still no solution.
    I have tried metalink note 314173.1 also but error is still there.
    Any solution for this????

    CSSD does not start (Cluster Manager)
    CSSD does not start (Cluster Manager)

  • Cluster resource does not start automatically

    Hello,
    I have a strange issue. last saterday i replaced the motherboards of three HP DL380G6 servers, there is an HW issue with the production date of this hardware.
    After change of the HW, the cluster resources does not start automatically, when booting the servers. The resources come in state 'offline'(except the master IP resource). When start manually, the cluster resources works fine. I checked the eDirectory , and changed also the startup parameter of the cluster (autostart-manually-autostart) but with no results.
    When i create a new (simple) CL-resource, i have the same issue with this resource. Only the master ip CL-resource starts automatically??
    Does anyone have an answer for this problem....
    Thanks in advanced
    3-node SLES9sp3 SLES/OES1 cluster (i know its old...)
    - iSCSI connection to an SLES11-SAN

    Originally Posted by changju
    The state is stored in eDir, so your problem is most likely caused by an eDir issue.
    Please check the attribute "NCS:CRM Failover Mode" of the resource object in eDir. If its value is an odd number, it means the resource will load automatically. If it's not, add 1 to the number and save the new value.
    Then, you need to check file "/var/opt/novell/ncs/resources.xml". Find the section for the resource, and check "nCSCRMFailoverMode" to make sure it matches what you have in eDir. If not, please run command "/opt/novell/ncs/bin/ncs-configd.py -init" to try to update it.
    If the problem persists after all the above, please contact NTS. We will have it resolved.
    Best regards,
    Changju

  • 11gR2 Cluster node does not start, start of ora.gipcd fails

    Hi
    I have a clusert node which just does not start, and i do know understand what the problem is.
    Does anyone have an idea what the problem cound be?
    I am using Oracle 11.2.0.1.0 on OEL.
    I appreciate any help, thank you.
    Regards Bernhard
    NAME           TARGET  STATE        SERVER                   STATE_DETAILS      
    Cluster Resources
    ora.asm
          1        ONLINE  OFFLINE                                                  
    ora.crsd
          1        ONLINE  INTERMEDIATE node001                             
    ora.cssd
          1        ONLINE  OFFLINE                                                  
    ora.cssdmonitor
          1        ONLINE  OFFLINE                                                  
    ora.ctssd
          1        ONLINE  OFFLINE                                                  
    ora.diskmon
          1        ONLINE  OFFLINE                                                  
    ora.drivers.acfs
          1        ONLINE  ONLINE       node001                             
    ora.evmd
          1        ONLINE  OFFLINE                                                  
    ora.gipcd
          1        ONLINE  OFFLINE                                                  
    ora.gpnpd
          1        ONLINE  OFFLINE                                                  
    ora.mdnsd
          1        ONLINE  ONLINE       node001                              alertnode001.log
    Oracle Database 11g Clusterware Release 11.2.0.1.0 - Production Copyright 1996, 2009 Oracle. All rights reserved.
    2012-06-29 08:43:52.511
    [/opt/grid/product/11gR2/grid/bin/cssdmonitor(5144)]CRS-5822:Agent '/opt/grid/product/11gR2/grid/bin/cssdmonitor_root' disconnected from server. Details at (:CRSAGF00117:) in /opt/grid/product/11gR2/grid/log/node001/agent/ohasd/oracssdmonitor_root/oracssdmonitor_root.log.
    2012-06-29 08:48:49.713
    [ohasd(4346)]CRS-2112:The OLR service started on node node001.
    2012-06-29 08:48:50.010
    [ohasd(4346)]CRS-8017:location: /etc/oracle/lastgasp has 50 reboot advisory log files, 0 were announced and 0 errors occurred
    2012-06-29 08:48:55.134
    [ohasd(4346)]CRS-2772:Server 'node001' has been assigned to pool 'Free'.
    [client(4634)]CRS-10001:ACFS-9327: Verifying ADVM/ACFS devices.
    [client(4652)]CRS-10001:ACFS-9322: done.
    2012-06-29 08:50:59.362
    [ohasd(4346)]CRS-2757:Command 'Start' timed out waiting for response from the resource 'ora.gipcd'. Details at (:CRSPE00111:) in /opt/grid/product/11gR2/grid/log/node001/ohasd/ohasd.log.oracssdmonitor_root.log
    Oracle Database 11g Clusterware Release 11.2.0.1.0 - Production Copyright 1996, 2009 Oracle. All rights reserved.
    2012-06-29 08:48:51.003: [    AGFW][1810312288] Starting the agent: /opt/grid/product/11gR2/grid/log/node001/agent/ohasd/oracssdmonitor_root/
    2012-06-29 08:48:51.003: [   AGENT][1810312288] Agent framework initialized, Process Id = 4414
    2012-06-29 08:48:51.003: [ USRTHRD][1810312288] to enter agent main
    2012-06-29 08:48:54.939: [ USRTHRD][1810312288] clsncssd_main: setting priority to 4
    2012-06-29 08:48:54.939: [ USRTHRD][1810312288]  *** Agent Framework Started ***
    2012-06-29 08:48:54.939: [ USRTHRD][1810312288] clsncssd_vmondisv: Compatible vendor clusterware not in use
    2012-06-29 08:48:54.939: [ USRTHRD][1810312288] clsncssd_thrdspawn: spawn OMON succ
    2012-06-29 08:48:54.939: [ USRTHRD][1810312288] clsncssd_main: spawn omon succ
    2012-06-29 08:48:54.939: [ USRTHRD][1098914112] clsnomon_main: default values for omon, initrate 1000, pollrate 500.
    2012-06-29 08:48:54.939: [ USRTHRD][1098914112] clsnomon_main: starting omon
    2012-06-29 08:48:54.942: [ CSSCLNT][1098914112]clssscConnect: gipc request failed with 29 (0x16)
    2012-06-29 08:48:54.942: [ CSSCLNT][1098914112]clsssInitNative: connect failed, rc 29
    2012-06-29 08:48:55.041: [    AGFW][1810312288] SERVER IPC CONNECT STR: (ADDRESS=(PROTOCOL=IPC)(KEY=OHASD_IPC_SOCKET_11))
    2012-06-29 08:48:55.041: [CLSFRAME][1810312288] Inited lsf context 0x1ae1cdd0
    2012-06-29 08:48:55.041: [CLSFRAME][1810312288] Initing CLS Framework messaging
    2012-06-29 08:48:55.041: [CLSFRAME][1810312288] New Framework state: 2
    2012-06-29 08:48:55.041: [CLSFRAME][1810312288] M2M is starting...
    2012-06-29 08:48:55.047: [ CRSCOMM][1810312288] m_pClscCtx=0x1ae21d70m_pUgblm=0x1ae754b0
    2012-06-29 08:48:55.047: [ CRSCOMM][1810312288] Starting send thread
    2012-06-29 08:48:55.052: [ CRSCOMM][1119893824] clsIpc: sendWork thread started.
    2012-06-29 08:48:55.057: [ CRSCOMM][1130383680] IPC Client thread started listening
    2012-06-29 08:48:55.057: [ CRSCOMM][1130383680] init data sent from server
    2012-06-29 08:48:55.057: [CLSFRAME][1810312288] New IPC Member:{Relative|Node:0|Process:0|Type:2}:OHASD:node001
    2012-06-29 08:48:55.058: [CLSFRAME][1810312288] New process connected to us ID:{Relative|Node:0|Process:0|Type:2} Info:OHASD:node001
    2012-06-29 08:48:55.066: [CLSFRAME][1810312288] Starting thread model named: MultiThread
    2012-06-29 08:48:55.073: [CLSFRAME][1810312288] Starting thread model named: SingleThread
    2012-06-29 08:48:55.076: [CLSFRAME][1810312288] Starting thread model named: SingleThreadT
    2012-06-29 08:48:55.080: [CLSFRAME][1810312288] New Framework state: 3
    2012-06-29 08:48:55.080: [    AGFW][1810312288] Agent Framework started successfully
    2012-06-29 08:48:55.080: [    AGFW][1182832960] Agfw engine module has enabled...
    2012-06-29 08:48:55.080: [CLSFRAME][1182832960] Module Enabling is complete
    2012-06-29 08:48:55.080: [CLSFRAME][1182832960] New Framework state: 6
    2012-06-29 08:48:55.080: [    AGFW][1182832960] Agent is started with userid: root , expected user: root
    2012-06-29 08:48:55.081: [    AGFW][1182832960] Agent sending message to PE: AGENT_HANDSHAKE[Proxy] ID 20484:14
    2012-06-29 08:48:55.088: [    AGFW][1182832960] Agent received the message: RESTYPE_ADD[ora.cssdmonitor.type] ID 8196:299
    2012-06-29 08:48:55.089: [    AGFW][1182832960] Added new restype: ora.cssdmonitor.type
    2012-06-29 08:48:55.089: [    AGFW][1182832960] Agent sending last reply for: RESTYPE_ADD[ora.cssdmonitor.type] ID 8196:299
    2012-06-29 08:48:55.090: [    AGFW][1182832960] Agent received the message: RESOURCE_ADD[ora.cssdmonitor 1 1] ID 4356:301
    2012-06-29 08:48:55.090: [    AGFW][1182832960] Added new resource: ora.cssdmonitor 1 1 to the agfw
    2012-06-29 08:48:55.091: [    AGFW][1182832960] Agent sending last reply for: RESOURCE_ADD[ora.cssdmonitor 1 1] ID 4356:301
    2012-06-29 08:48:55.091: [    AGFW][1182832960] Agent received the message: RESOURCE_PROBE[ora.cssdmonitor 1 1] ID 4097:302
    2012-06-29 08:48:55.091: [    AGFW][1182832960] Preparing CHECK command for: ora.cssdmonitor 1 1
    2012-06-29 08:48:55.096: [    AGFW][1172343104] Executing command: check for resource: ora.cssdmonitor 1 1
    2012-06-29 08:48:55.096: [ora.cssdmonitor][1172343104] [check] clsncssd_getattr: attr OMON_INITRATE, value 1000
    2012-06-29 08:48:55.096: [ora.cssdmonitor][1172343104] [check] clsncssd_getattr: attr OMON_POLLRATE, value 500
    2012-06-29 08:48:55.096: [ora.cssdmonitor][1172343104] [check] clsncssd_getattr: attr ORA_OPROCD_MODE, value
    2012-06-29 08:48:55.096: [ora.cssdmonitor][1172343104] [check] clsncssd_getattr: attr PROCD_TIMEOUT, value 1000
    2012-06-29 08:48:55.096: [ora.cssdmonitor][1172343104] [check] clsncssd_getattr: attr LOGGING_LEVEL, value 1
    2012-06-29 08:48:55.096: [    AGFW][1172343104] check for resource: ora.cssdmonitor 1 1 completed with status: OFFLINE
    2012-06-29 08:48:55.096: [CRSTIMER][1203812672] Timer Thread Starting.
    2012-06-29 08:48:55.096: [    AGFW][1182832960] ora.cssdmonitor 1 1 state changed from: UNKNOWN to: OFFLINE
    2012-06-29 08:48:55.096: [    AGFW][1182832960] Agent sending last reply for: RESOURCE_PROBE[ora.cssdmonitor 1 1] ID 4097:302
    2012-06-29 08:48:55.096: [    AGFW][1182832960] Agent has no resources to be monitored.Sending suicide request.
    2012-06-29 08:48:55.096: [    AGFW][1182832960] Agent sending message to PE: AGENT_SUICIDE[Proxy] ID 20486:28
    2012-06-29 08:48:55.100: [    AGFW][1182832960] Agent received the message: RESOURCE_DELETE[ora.cssdmonitor 1 1] ID 4358:317
    2012-06-29 08:48:55.100: [    AGFW][1182832960] Agent sending last reply for: RESOURCE_DELETE[ora.cssdmonitor 1 1] ID 4358:317
    2012-06-29 08:48:55.100: [    AGFW][1182832960] Agent has no resources to be monitored.Sending suicide request.
    2012-06-29 08:48:55.100: [    AGFW][1182832960] Agent sending message to PE: AGENT_SUICIDE[Proxy] ID 20486:34
    2012-06-29 08:48:55.101: [    AGFW][1182832960] ora.cssdmonitor 1 1 marked as deleted.
    2012-06-29 08:48:55.101: [    AGFW][1182832960] Deleting the resource: ora.cssdmonitor 1 1
    2012-06-29 08:48:55.101: [    AGFW][1182832960] Agent is commiting suicide.
    2012-06-29 08:48:55.101: [ USRTHRD][1182832960] clsncssd_exit: CSSD Agent was asked to exit with exit code 1
    2012-06-29 08:48:55.101: [ USRTHRD][1182832960] clsncssd_becomeactive: Signaling active state
    2012-06-29 08:48:55.101: [ USRTHRD][1182832960] clsncssd_term: still threads up (1)
    2012-06-29 08:48:55.101: [ USRTHRD][1182832960] clsncssd_exit: Agent is done.
    2012-06-29 08:48:55.101: [    AGFW][1182832960] Agent is exiting with exit code: 1
    2012-06-29 08:48:55.947: [ CSSCLNT][1098914112]clssscConnect: gipc request failed with 29 (0x16)
    2012-06-29 08:48:55.947: [ CSSCLNT][1098914112]clsssInitNative: connect failed, rc 29
    2012-06-29 08:48:56.952: [ CSSCLNT][1098914112]clssscConnect: gipc request failed with 29 (0x16)
    2012-06-29 08:48:56.952: [ CSSCLNT][1098914112]clsssInitNative: connect failed, rc 29Edited by: Bernhard W on 03-Jul-2012 02:14

    I am really getting desperate about this.
    The ASM persmissions are on both nodes the same, so this should not be the problem and i can not find any problem on the network.
    The log files of the healthy node do not say anything about the node which does not startup now, the last log entry was from 6 months ago, when i shut that node down. There seems to be no communication between the two nodes now.
    I tried to manually start the ora.cssd but somehow ora.gipcd just does not start and i can not find the problem.
    [oracle@dmrs11srvcla001 ~]$ crsctl stat res -t -init
    NAME           TARGET  STATE        SERVER                   STATE_DETAILS      
    Cluster Resources
    ora.asm
          1        ONLINE  OFFLINE                                                  
    ora.crsd
          1        ONLINE  INTERMEDIATE dmrs11srvcla001                             
    ora.cssd
          1        ONLINE  OFFLINE                                                  
    ora.cssdmonitor
          1        ONLINE  ONLINE       dmrs11srvcla001                             
    ora.ctssd
          1        ONLINE  OFFLINE                                                  
    ora.diskmon
          1        OFFLINE OFFLINE                                                  
    ora.drivers.acfs
          1        ONLINE  ONLINE       dmrs11srvcla001                             
    ora.evmd
          1        ONLINE  OFFLINE                                                  
    ora.gipcd
          1        ONLINE  OFFLINE                                                  
    ora.gpnpd
          1        ONLINE  OFFLINE                                                  
    ora.mdnsd
          1        ONLINE  ONLINE       dmrs11srvcla001                             
    [oracle@dmrs11srvcla001 ~]$ crsctl start res ora.cssd -init
    CRS-2672: Attempting to start 'ora.gipcd' on 'dmrs11srvcla001'
    Start action for daemon aborted
    CRS-2674: Start of 'ora.gipcd' on 'dmrs11srvcla001' failed
    CRS-2679: Attempting to clean 'ora.gipcd' on 'dmrs11srvcla001'
    CRS-2681: Clean of 'ora.gipcd' on 'dmrs11srvcla001' succeeded
    CRS-2672: Attempting to start 'ora.gpnpd' on 'dmrs11srvcla001'
    Start action for daemon aborted
    CRS-2674: Start of 'ora.gpnpd' on 'dmrs11srvcla001' failed
    CRS-2679: Attempting to clean 'ora.gpnpd' on 'dmrs11srvcla001'
    CRS-2681: Clean of 'ora.gpnpd' on 'dmrs11srvcla001' succeeded
    CRS-2672: Attempting to start 'ora.cssd' on 'dmrs11srvcla001'
    CRS-2672: Attempting to start 'ora.diskmon' on 'dmrs11srvcla001'
    CRS-2676: Start of 'ora.diskmon' on 'dmrs11srvcla001' succeededalertnode001.log
    [ohasd(4351)]CRS-2757:Command 'Start' timed out waiting for response from the resource 'ora.gipcd'. Details at (:CRSPE00111:) in /opt/grid/product/11gR2/grid/log/node001/ohasd/ohasd.log.
    2012-07-02 17:11:40.789
    [ohasd(4351)]CRS-2757:Command 'Start' timed out waiting for response from the resource 'ora.gpnpd'. Details at (:CRSPE00111:) in /opt/grid/product/11gR2/grid/log/node001/ohasd/ohasd.log.
    2012-07-02 17:11:41.654
    [ohasd(4351)]CRS-2765:Resource 'ora.mdnsd' has failed on server 'node001'.
    2012-07-02 17:11:43.404
    [cssd(4997)]CRS-1713:CSSD daemon is started in clustered mode
    2012-07-02 17:11:46.634
    [cssd(4997)]CRS-2302:Cannot get GPnP profile. Error CLSGPNP_NO_DAEMON (GPNPD daemon is not running).
    2012-07-02 17:11:46.745
    [ohasd(4351)]CRS-2765:Resource 'ora.cssdmonitor' has failed on server 'node001'.
    2012-07-02 17:12:42.384
    [/opt/grid/product/11gR2/grid/bin/orarootagent.bin(4488)]CRS-5818:Aborted command 'start for resource: ora.diskmon 1 1' for resource 'ora.diskmon'. Details at (:CRSAGF00113:) in /opt/grid/product/11gR2/grid/log/node001/agent/ohasd/orarootagent_root/orarootagent_root.log.
    2012-07-02 17:12:46.390
    [ohasd(4351)]CRS-2757:Command 'Start' timed out waiting for response from the resource 'ora.diskmon'. Details at (:CRSPE00111:) in /opt/grid/product/11gR2/grid/log/node001/ohasd/ohasd.log.
    2012-07-02 17:14:50.768
    [ohasd(4351)]CRS-2757:Command 'Start' timed out waiting for response from the resource 'ora.gipcd'. Details at (:CRSPE00111:) in /opt/grid/product/11gR2/grid/log/node001/ohasd/ohasd.log.
    2012-07-02 17:16:55.819
    [ohasd(4351)]CRS-2757:Command 'Start' timed out waiting for response from the resource 'ora.gpnpd'. Details at (:CRSPE00111:) in /opt/grid/product/11gR2/grid/log/node001/ohasd/ohasd.log.
    2012-07-02 17:16:58.354
    [cssd(5137)]CRS-1713:CSSD daemon is started in clustered mode
    2012-07-02 17:16:58.425
    [cssd(5137)]CRS-2302:Cannot get GPnP profile. Error CLSGPNP_NO_DAEMON (GPNPD daemon is not running).
    2012-07-02 17:25:23.194
    [ohasd(4351)]CRS-2765:Resource 'ora.diskmon' has failed on server 'node001'.
    2012-07-02 17:25:23.200
    [ohasd(4351)]CRS-2767:Target resource 'ora.diskmon' is offline, will not recover.
    2012-07-02 17:26:57.384
    [/opt/grid/product/11gR2/grid/bin/cssdagent(5116)]CRS-5818:Aborted command 'start for resource: ora.cssd 1 1' for resource 'ora.cssd'. Details at (:CRSAGF00113:) in /opt/grid/product/11gR2/grid/log/node001/agent/ohasd/oracssdagent_root/oracssdagent_root.log.
    2012-07-02 17:27:02.514
    [ohasd(4351)]CRS-2757:Command 'Start' timed out waiting for response from the resource 'ora.cssd'. Details at (:CRSPE00111:) in /opt/grid/product/11gR2/grid/log/node001/ohasd/ohasd.log.
    2012-07-02 17:37:11.971
    [ohasd(4351)]CRS-2757:Command 'Start' timed out waiting for response from the resource 'ora.evmd'. Details at (:CRSPE00111:) in /opt/grid/product/11gR2/grid/log/node001/ohasd/ohasd.log.
    [ohasd(4351)]CRS-2765:Resource 'ora.crsd' has failed on server 'node001'.
    2012-07-03 02:13:57.821
    [ohasd(4351)]CRS-2765:Resource 'ora.crsd' has failed on server 'node001'.
    2012-07-03 05:14:37.915
    [ohasd(4351)]CRS-2765:Resource 'ora.crsd' has failed on server 'node001'.
    2012-07-03 05:44:44.630
    [ohasd(4351)]CRS-2765:Resource 'ora.crsd' has failed on server 'node001'.
    2012-07-03 06:14:51.303
    [ohasd(4351)]CRS-2765:Resource 'ora.crsd' has failed on server 'node001'.
    2012-07-03 06:44:57.981
    [ohasd(4351)]CRS-2765:Resource 'ora.crsd' has failed on server 'node001'.
    2012-07-03 07:15:04.655
    [ohasd(4351)]CRS-2765:Resource 'ora.crsd' has failed on server 'node001'.
    2012-07-03 07:42:45.015
    [ohasd(4351)]CRS-2757:Command 'Start' timed out waiting for response from the resource 'ora.gipcd'. Details at (:CRSPE00111:) in /opt/grid/product/11gR2/grid/log/node001/ohasd/ohasd.log.
    2012-07-03 07:44:50.068
    [ohasd(4351)]CRS-2757:Command 'Start' timed out waiting for response from the resource 'ora.gpnpd'. Details at (:CRSPE00111:) in /opt/grid/product/11gR2/grid/log/node001/ohasd/ohasd.log.
    2012-07-03 07:44:52.369
    [cssd(10209)]CRS-1713:CSSD daemon is started in clustered mode
    2012-07-03 07:44:52.434
    [cssd(10209)]CRS-2302:Cannot get GPnP profile. Error CLSGPNP_NO_DAEMON (GPNPD daemon is not running).
    2012-07-03 07:45:11.331
    [ohasd(4351)]CRS-2765:Resource 'ora.crsd' has failed on server 'node001'.
    2012-07-03 07:53:17.222
    [ohasd(4351)]CRS-2765:Resource 'ora.diskmon' has failed on server 'node001'.
    2012-07-03 07:53:17.222
    [ohasd(4351)]CRS-2767:Target resource 'ora.diskmon' is offline, will not recover.
    2012-07-03 07:54:51.401
    [/opt/grid/product/11gR2/grid/bin/cssdagent(10188)]CRS-5818:Aborted command 'start for resource: ora.cssd 1 1' for resource 'ora.cssd'. Details at (:CRSAGF00113:) in /opt/grid/product/11gR2/grid/log/node001/agent/ohasd/oracssdagent_root/oracssdagent_root.log.
    2012-07-03 07:54:56.524
    [ohasd(4351)]CRS-2757:Command 'Start' timed out waiting for response from the resource 'ora.cssd'. Details at (:CRSPE00111:) in /opt/grid/product/11gR2/grid/log/node001/ohasd/ohasd.log.ohasd.log
    2012-07-03 07:45:11.330: [    AGFW][1347250496] Agfw Proxy Server received the message: RESOURCE_STATUS[Proxy] ID 20481:24919
    2012-07-03 07:45:11.330: [    AGFW][1347250496] Received state change for ora.crsd 1 1 [old state = PARTIAL, new state = OFFLINE]
    2012-07-03 07:45:11.330: [    AGFW][1347250496] Agfw Proxy Server sending message to PE, Contents = [MIDTo:2|OpID:3|FromA:{Invalid|Node:0|Process:0|Type:0}|ToA:{Invalid|Node:-1|Process:-1|Type:-1}|MIDFrom:0|Type:4|Pri2|Id:23258]
    2012-07-03 07:45:11.330: [    AGFW][1347250496] Agfw Proxy Server replying to the message: RESOURCE_STATUS[Proxy] ID 20481:24919
    2012-07-03 07:45:11.330: [   CRSPE][1357756736] State change received from node001 for ora.crsd 1 1
    2012-07-03 07:45:11.331: [   CRSPE][1357756736] Processing PE command id=139. Description: [Resource State Change (ora.crsd 1 1) : 0x1c284d40]
    2012-07-03 07:45:11.331: [   CRSPE][1357756736] RI [ora.crsd 1 1] new external state [OFFLINE] old value: [INTERMEDIATE] on node001 label = []
    2012-07-03 07:45:11.331: [   CRSPE][1357756736] Resource Resource Instance ID[ora.crsd 1 1]. Values:
    STATE=OFFLINE
    TARGET=ONLINE
    LAST_SERVER=node001
    CURRENT_RCOUNT=1
    LAST_RESTART=1341292505
    FAILURE_COUNT=0
    FAILURE_HISTORY=
    STATE_DETAILS=
    INCARNATION=29
    STATE_CHANGE_VERS=29
    LAST_FAULT=1341292504
    DEGREE_ID=1
    ID=ora.crsd 1 1
    CARDINALITY_ID=1
    Lock Info:
    Write Locks:none
    ReadLocks:|STATE INITED||INITIAL CHECK DONE| has failed!
    2012-07-03 07:45:11.331: [   CRSPE][1357756736] Processing unplanned state change for [ora.crsd 1 1]
    2012-07-03 07:45:11.331: [   CRSPE][1357756736] ora.crsd 1 1: uptime exceeds uptime threshold , resetting restart count
    2012-07-03 07:45:11.331: [   CRSPE][1357756736] Local Recovery picked for [ora.crsd 1 1]
    2012-07-03 07:45:11.333: [   CRSPE][1357756736] Sending message to agfw: id = 23260
    2012-07-03 07:45:11.333: [    AGFW][1347250496] Agfw Proxy Server received the message: RESOURCE_START[ora.crsd 1 1] ID 4098:23260
    2012-07-03 07:45:11.333: [   CRSPE][1357756736] CRS-2672: Attempting to start 'ora.crsd' on 'node001'
    2012-07-03 07:45:11.333: [    AGFW][1347250496] Agfw Proxy Server forwarding the message: RESOURCE_START[ora.crsd 1 1] ID 4098:23260 to the agent /opt/grid/product/11gR2/grid/bin/orarootagent_root
    2012-07-03 07:45:12.349: [    AGFW][1347250496] Received the reply to the message: RESOURCE_START[ora.crsd 1 1] ID 4098:23261 from the agent /opt/grid/product/11gR2/grid/bin/orarootagent_root
    2012-07-03 07:45:12.350: [    AGFW][1347250496] Agfw Proxy Server sending the reply to PE for message:RESOURCE_START[ora.crsd 1 1] ID 4098:23260
    2012-07-03 07:45:12.350: [   CRSPE][1357756736] Received reply to action [Start] message ID: 23260
    2012-07-03 07:45:12.350: [    AGFW][1347250496] Received the reply to the message: RESOURCE_START[ora.crsd 1 1] ID 4098:23261 from the agent /opt/grid/product/11gR2/grid/bin/orarootagent_root
    2012-07-03 07:45:12.350: [    AGFW][1347250496] Agfw Proxy Server sending the last reply to PE for message:RESOURCE_START[ora.crsd 1 1] ID 4098:23260
    2012-07-03 07:45:12.350: [   CRSPE][1357756736] Received reply to action [Start] message ID: 23260
    2012-07-03 07:45:12.351: [   CRSPE][1357756736] RI [ora.crsd 1 1] new external state [INTERMEDIATE] old value: [OFFLINE] on node001 label = []
    2012-07-03 07:45:12.351: [   CRSPE][1357756736] CRS-2676: Start of 'ora.crsd' on 'node001' succeeded
    2012-07-03 07:45:12.351: [   CRSPE][1357756736] PE Command [ Resource State Change (ora.crsd 1 1) : 0x1c284d40 ] has completed
    2012-07-03 07:45:12.351: [    AGFW][1347250496] Agfw Proxy Server received the message: CMD_COMPLETED[Proxy] ID 20482:23269
    2012-07-03 07:45:12.351: [    AGFW][1347250496] Agfw Proxy Server replying to the message: CMD_COMPLETED[Proxy] ID 20482:23269
    2012-07-03 07:45:12.351: [    AGFW][1347250496] Agfw received reply from PE for resource state change for ora.crsd 1 1
    2012-07-03 07:53:17.220: [    AGFW][1347250496] Agfw Proxy Server received the message: RESOURCE_STATUS[Proxy] ID 20481:25353
    2012-07-03 07:53:17.221: [    AGFW][1347250496] Received state change for ora.diskmon 1 1 [old state = ONLINE, new state = PLANNED_OFFLINE]
    2012-07-03 07:53:17.221: [    AGFW][1347250496] Agfw Proxy Server sending message to PE, Contents = [MIDTo:2|OpID:3|FromA:{Invalid|Node:0|Process:0|Type:0}|ToA:{Invalid|Node:-1|Process:-1|Type:-1}|MIDFrom:0|Type:4|Pri2|Id:23497]
    2012-07-03 07:53:17.221: [    AGFW][1347250496] Agfw Proxy Server replying to the message: RESOURCE_STATUS[Proxy] ID 20481:25353
    2012-07-03 07:53:17.221: [   CRSPE][1357756736] State change received from node001 for ora.diskmon 1 1
    2012-07-03 07:53:17.221: [   CRSPE][1357756736] Processing PE command id=140. Description: [Resource State Change (ora.diskmon 1 1) : 0x2aaab00318a0]
    2012-07-03 07:53:17.221: [   CRSPE][1357756736] RI [ora.diskmon 1 1] new external state [OFFLINE] old value: [ONLINE] on node001 label = []
    2012-07-03 07:53:17.221: [   CRSPE][1357756736] RI [ora.diskmon 1 1] new target state: [OFFLINE] old value: [ONLINE]
    2012-07-03 07:53:17.222: [  CRSOCR][1351452992] Multi Write Batch processing...
    2012-07-03 07:53:17.222: [   CRSPE][1357756736] Resource Resource Instance ID[ora.diskmon 1 1]. Values:
    STATE=OFFLINE
    TARGET=OFFLINE
    LAST_SERVER=node001
    CURRENT_RCOUNT=0
    LAST_RESTART=1341294297
    FAILURE_COUNT=0
    FAILURE_HISTORY=
    STATE_DETAILS=
    INCARNATION=2
    STATE_CHANGE_VERS=5
    LAST_FAULT=1341242723
    DEGREE_ID=1
    ID=ora.diskmon 1 1
    CARDINALITY_ID=1
    Lock Info:
    Write Locks:START of [ora.cssd 1 1] on [node001] : 0x2aaab000ba10
    ReadLocks:|STATE INITED| has failed!
    2012-07-03 07:53:17.222: [   CRSPE][1357756736] Processing unplanned state change for [ora.diskmon 1 1]
    2012-07-03 07:53:17.222: [   CRSPE][1357756736] Target is not ONLINE, not recovering [ora.diskmon 1 1]
    2012-07-03 07:53:17.222: [   CRSPE][1357756736] PE Command [ Resource State Change (ora.diskmon 1 1) : 0x2aaab00318a0 ] has completed
    2012-07-03 07:53:17.222: [    AGFW][1347250496] Agfw Proxy Server received the message: CMD_COMPLETED[Proxy] ID 20482:23501
    2012-07-03 07:53:17.222: [    AGFW][1347250496] Agfw Proxy Server replying to the message: CMD_COMPLETED[Proxy] ID 20482:23501
    2012-07-03 07:53:17.223: [    AGFW][1347250496] Agfw received reply from PE for resource state change for ora.diskmon 1 1
    2012-07-03 07:53:17.223: [  CRSOCR][1351452992] Multi Write Batch done.
    2012-07-03 07:54:56.523: [    AGFW][1347250496] Received the reply to the message: RESOURCE_START[ora.cssd 1 1] ID 4098:23242 from the agent /opt/grid/product/11gR2/grid/bin/cssdagent_root
    2012-07-03 07:54:56.523: [    AGFW][1347250496] Agfw Proxy Server sending the reply to PE for message:RESOURCE_START[ora.cssd 1 1] ID 4098:23220
    2012-07-03 07:54:56.524: [   CRSPE][1357756736] Received reply to action [Start] message ID: 23220
    2012-07-03 07:54:56.524: [    AGFW][1347250496] Received the reply to the message: RESOURCE_START[ora.cssd 1 1] ID 4098:23242 from the agent /opt/grid/product/11gR2/grid/bin/cssdagent_root
    2012-07-03 07:54:56.524: [   CRSPE][1357756736]Created alert : (:CRSPE00111:) :  Start action timed out!
    2012-07-03 07:54:56.524: [   CRSPE][1357756736] Start action failed with error code: 3
    2012-07-03 07:54:56.524: [    AGFW][1347250496] Agfw Proxy Server sending the last reply to PE for message:RESOURCE_START[ora.cssd 1 1] ID 4098:23220
    2012-07-03 07:54:56.524: [   CRSPE][1357756736] Received reply to action [Start] message ID: 23220
    2012-07-03 07:54:56.524: [    AGFW][1347250496] Agfw Proxy Server received the message: AGENT_SUICIDE[Proxy] ID 20486:34
    2012-07-03 07:54:56.524: [    AGFW][1347250496] Suicide request received from /opt/grid/product/11gR2/grid/bin/cssdagent_root
    2012-07-03 07:54:56.524: [    AGFW][1347250496] Agfw Proxy Server replying to the message: AGENT_SUICIDE[Proxy] ID 20486:34
    2012-07-03 07:54:56.524: [   CRSPE][1357756736] CRS-2674: Start of 'ora.cssd' on 'node001' failed
    2012-07-03 07:54:56.525: [UiServer][1361959232] Container [ Name: ORDER
         MESSAGE:
         TextMessage[CRS-2674: Start of 'ora.cssd' on 'node001' failed]
         MSGTYPE:
         TextMessage[1]
         OBJID:
         TextMessage[ora.cssd]
         WAIT:
         TextMessage[0]
    2012-07-03 07:54:56.525: [   CRSPE][1357756736] Sending message to agfw: id = 23555
    2012-07-03 07:54:56.525: [   CRSPE][1357756736] CRS-2679: Attempting to clean 'ora.cssd' on 'node001'
    2012-07-03 07:54:56.525: [    AGFW][1347250496] Agfw Proxy Server received the message: RESOURCE_CLEAN[ora.cssd 1 1] ID 4100:23555
    2012-07-03 07:54:56.525: [    AGFW][1347250496] Agent: /opt/grid/product/11gR2/grid/bin/cssdagent with user id root is being stopped. Will be restarted when agent stops completly
    2012-07-03 07:54:56.525: [    AGFW][1347250496] Could not forward message [RESOURCE_CLEAN[ora.cssd 1 1] ID 4100:23555] to agent. /opt/grid/product/11gR2/grid/bin/cssdagent_root is not running
    2012-07-03 07:54:56.525: [    AGFW][1347250496] Can not start Agent: /opt/grid/product/11gR2/grid/bin/cssdagent with user id root is waiting to be restarted.
    2012-07-03 07:54:56.525: [UiServer][1361959232] Container [ Name: ORDER
         MESSAGE:
         TextMessage[CRS-2679: Attempting to clean 'ora.cssd' on 'node001']
         MSGTYPE:
         TextMessage[3]
         OBJID:
         TextMessage[ora.cssd]
         WAIT:
         TextMessage[0]
    2012-07-03 07:55:01.627: [ CRSCOMM][1340946752][FFAIL] Couldnt clscreceive message, no message: 11
    2012-07-03 07:55:01.627: [ CRSCOMM][1340946752] Client disconnected.
    2012-07-03 07:55:01.627: [ CRSCOMM][1340946752][FFAIL] Listener got clsc error 11 for memNum. 14
    2012-07-03 07:55:01.628: [ CRSCOMM][1340946752] IPC listener connection to member 14 has been removed
    2012-07-03 07:55:01.628: [CLSFRAME][1340946752] Removing IPC Member:{Relative|Node:0|Process:14|Type:3}
    2012-07-03 07:55:01.628: [CLSFRAME][1340946752] Disconnected from AGENT process: {Relative|Node:0|Process:14|Type:3}
    2012-07-03 07:55:01.628: [   CRSPE][1357756736] Disconnected from server:
    2012-07-03 07:55:01.628: [    AGFW][1347250496] Agfw Proxy Server received process disconnected notification, count=1
    2012-07-03 07:55:01.628: [    AGFW][1347250496] /opt/grid/product/11gR2/grid/bin/cssdagent_root disconnected.
    2012-07-03 07:55:01.628: [    AGFW][1347250496] Restarting the agent /opt/grid/product/11gR2/grid/bin/cssdagent_root
    2012-07-03 07:55:01.628: [    AGFW][1347250496] Agent /opt/grid/product/11gR2/grid/bin/cssdagent_root[10188] stopped!
    2012-07-03 07:55:01.628: [ CRSCOMM][1347250496] removeConnection: Member 14 does not exist.
    2012-07-03 07:55:01.628: [    AGFW][1347250496] Starting the agent: /opt/grid/product/11gR2/grid/bin/cssdagent with user id: root and incarnation:7
    2012-07-03 07:55:01.632: [    AGFW][1347250496] Starting the HB [Interval =  30000, misscount = 10kill allowed=0] for agent: /opt/grid/product/11gR2/grid/bin/cssdagent_root
    2012-07-03 07:55:01.819: [CLSFRAME][1340946752] New IPC Member:{Relative|Node:0|Process:15|Type:3}:AGENT
    2012-07-03 07:55:01.819: [CLSFRAME][1340946752] New process connected to us ID:{Relative|Node:0|Process:15|Type:3} Info:AGENT
    2012-07-03 07:55:01.837: [    AGFW][1347250496] Agfw Proxy Server received the message: AGENT_HANDSHAKE[Proxy] ID 20484:14
    2012-07-03 07:55:01.837: [    AGFW][1347250496] Agent /opt/grid/product/11gR2/grid/bin/cssdagent_root with pid:10530 connected to server.
    2012-07-03 07:55:01.837: [    AGFW][1347250496] Agfw Proxy Server sending message: RESTYPE_ADD[ora.cssd.type] ID 8196:23591 to the agent /opt/grid/product/11gR2/grid/bin/cssdagent_root
    2012-07-03 07:55:01.838: [    AGFW][1347250496] Agfw Proxy Server sending message: RESOURCE_ADD[ora.cssd 1 1] ID 4356:23593 to the agent /opt/grid/product/11gR2/grid/bin/cssdagent_root
    2012-07-03 07:55:01.838: [    AGFW][1347250496] Agfw Proxy Server forwarding the message: RESOURCE_CLEAN[ora.cssd 1 1] ID 4100:23555 to the agent /opt/grid/product/11gR2/grid/bin/cssdagent_root
    2012-07-03 07:55:01.839: [    AGFW][1347250496] Agfw Proxy Server replying to the message: AGENT_HANDSHAKE[Proxy] ID 20484:14
    2012-07-03 07:55:01.851: [    AGFW][1347250496] Received the reply to the message: RESTYPE_ADD[ora.cssd.type] ID 8196:23591 from the agent /opt/grid/product/11gR2/grid/bin/cssdagent_root
    2012-07-03 07:55:01.854: [    AGFW][1347250496] Received the reply to the message: RESOURCE_ADD[ora.cssd 1 1] ID 4356:23593 from the agent /opt/grid/product/11gR2/grid/bin/cssdagent_root
    2012-07-03 07:55:01.861: [    AGFW][1347250496] Received the reply to the message: RESOURCE_CLEAN[ora.cssd 1 1] ID 4100:23594 from the agent /opt/grid/product/11gR2/grid/bin/cssdagent_root
    2012-07-03 07:55:01.862: [    AGFW][1347250496] Agfw Proxy Server sending the reply to PE for message:RESOURCE_CLEAN[ora.cssd 1 1] ID 4100:23555
    2012-07-03 07:55:01.862: [    AGFW][1347250496] Received the reply to the message: RESOURCE_CLEAN[ora.cssd 1 1] ID 4100:23594 from the agent /opt/grid/product/11gR2/grid/bin/cssdagent_root
    2012-07-03 07:55:01.862: [   CRSPE][1357756736] Received reply to action [Clean] message ID: 23555
    2012-07-03 07:55:01.862: [    AGFW][1347250496] Agfw Proxy Server sending the last reply to PE for message:RESOURCE_CLEAN[ora.cssd 1 1] ID 4100:23555
    2012-07-03 07:55:01.863: [    AGFW][1347250496] Agfw Proxy Server received the message: AGENT_SUICIDE[Proxy] ID 20486:34
    2012-07-03 07:55:01.863: [   CRSPE][1357756736] Received reply to action [Clean] message ID: 23555
    2012-07-03 07:55:01.863: [    AGFW][1347250496] Suicide request received from /opt/grid/product/11gR2/grid/bin/cssdagent_root
    2012-07-03 07:55:01.863: [    AGFW][1347250496] Agfw Proxy Server replying to the message: AGENT_SUICIDE[Proxy] ID 20486:34
    2012-07-03 07:55:01.863: [   CRSPE][1357756736] CRS-2681: Clean of 'ora.cssd' on 'node001' succeeded
    2012-07-03 07:55:01.863: [   CRSPE][1357756736] Sequencer for [ora.cssd 1 1] has completed with error: CRS-0215: Could not start resource 'ora.cssd'.
    2012-07-03 07:55:01.863: [UiServer][1361959232] Container [ Name: ORDER
         MESSAGE:
         TextMessage[CRS-2681: Clean of 'ora.cssd' on 'node001' succeeded]
         MSGTYPE:
         TextMessage[3]
         OBJID:
         TextMessage[ora.cssd]
         WAIT:
         TextMessage[0]
    2012-07-03 07:55:01.864: [   CRSPE][1357756736] PE Command [ Start Resource : 0x2aaab0009d00 ] has completed
    2012-07-03 07:55:01.864: [    AGFW][1347250496] Agfw Proxy Server received the message: CMD_COMPLETED[Proxy] ID 20482:23606
    2012-07-03 07:55:01.864: [   CRSPE][1357756736] UI Command [Start Resource : 0x2aaab0009d00] is replying to sender.
    2012-07-03 07:55:01.864: [    AGFW][1347250496] Agfw Proxy Server replying to the message: CMD_COMPLETED[Proxy] ID 20482:23606
    2012-07-03 07:55:01.864: [UiServer][1361959232] Container [ Name: UI_DATA
         ora.cssd:
         TextMessage[215]
    2012-07-03 07:55:01.864: [UiServer][1361959232] Done for ctx=0x2aaab004ece0
    2012-07-03 07:55:01.869: [UiServer][1364060480] Closed: remote end failed/disc.
    2012-07-03 07:55:03.791: [ CRSCOMM][1340946752][FFAIL] Couldnt clscreceive message, no message: 11
    2012-07-03 07:55:03.791: [ CRSCOMM][1340946752] Client disconnected.
    2012-07-03 07:55:03.791: [ CRSCOMM][1340946752][FFAIL] Listener got clsc error 11 for memNum. 15
    2012-07-03 07:55:03.791: [ CRSCOMM][1340946752] IPC listener connection to member 15 has been removed
    2012-07-03 07:55:03.791: [CLSFRAME][1340946752] Removing IPC Member:{Relative|Node:0|Process:15|Type:3}
    2012-07-03 07:55:03.791: [CLSFRAME][1340946752] Disconnected from AGENT process: {Relative|Node:0|Process:15|Type:3}
    2012-07-03 07:55:03.792: [   CRSPE][1357756736] Disconnected from server:
    2012-07-03 07:55:03.792: [    AGFW][1347250496] Agfw Proxy Server received process disconnected notification, count=1
    2012-07-03 07:55:03.792: [    AGFW][1347250496] /opt/grid/product/11gR2/grid/bin/cssdagent_root disconnected.
    2012-07-03 07:55:03.792: [    AGFW][1347250496] Agent /opt/grid/product/11gR2/grid/bin/cssdagent_root[10530] stopped!
    2012-07-03 07:55:03.792: [ CRSCOMM][1347250496] removeConnection: Member 15 does not exist.

  • Migrating Standalone Grid Infrastructure Servers to a Cluster 11.2.0.1 Linux 5.9

    Hey guys! Hope you all are doing good
    I am kinda confused migrating my 11.2.0.1 Oracle Restart installation to a RAC two node (aim is to add a second node along with migrating the existing one to the cluster pool).
    Running on OEL 5.9 x86_64
    I see that we can switch the RAC mode from 'off' to 'on' and use the existing clusterware binaries. I am trying to follow the below Oracle documentation for linux
    6.2 Migrating Standalone Grid Infrastructure Servers to a Cluster
    http://docs.oracle.com/cd/E11882_01/install.112/e41961/rem_orcl.htm#CWLIN347
    In this document, I have completed step 5 which is de-configuring Oracle Restart. All smooth.
    The problem starts here. Next step 6 says
    Prepare the server for Oracle Clusterware configuration, as described in this document. In addition, choose if you want to install Oracle Grid Infrastructure for a Cluster in the same location as Oracle Restart, or in a different location:
    You would have noticed that there's a note which says that the process uses config wizard which is available with rel 11.2.0.2 or later. Mine's 11.2.0.1.
    From the doc
    Note:
    This procedure uses Oracle Clusterware Configuration Wizard, available with release 11.2.0.2 and later.
    So how do I proceed from here? Can the existing binaries be used? If yes, how? Can't find much information. Thanks for your valuable time.
    I hope I am not missing anything..
    Warm Regards
    Abhishek

    Hello,
    Then why to they say for example here the following:
    The Oracle GSD (Global Service Daemon) process, ora.gsd, is typically offline. You must enable Oracle GSD manually if you plan to use an Oracle 9i Real Application Clusters database on the Oracle Clusterware 11g release 2 (11.2) cluster.
    ???

  • Node does not join cluster upon reboot

    Hi Guys,
    I have two servers [Sun Fire X4170] clustered together using Solaris cluster 3.3 for Oracle Database. They are connected to a shared storage which is Dell Equallogic [iSCSI]. Lately, I have ran into a weird kind of a problem where as both nodes come up fine and join the cluster upon reboot; however, when I reboot one of nodes then any of them does not join cluster and shows following errors:
    This is happening on both the nodes [if I reboot only one node at a time]. But if I reboot both the nodes at the same time then they successfully join the cluster and everything runs fine.
    Below is the output from one node which I rebooted and it did not join the cluster and puked out following errors. The other node is running fine will all the services.
    In order to get out of this situation, I have to reboot both the nodes together.
    # dmesg output #
    Apr 23 17:37:03 srvhqon11 ixgbe: [ID 611667 kern.info] NOTICE: ixgbe2: link down
    Apr 23 17:37:12 srvhqon11 iscsi: [ID 933263 kern.notice] NOTICE: iscsi connection(5) unable to connect to target SENDTARGETS_DISCOVERY
    Apr 23 17:37:12 srvhqon11 iscsi: [ID 114404 kern.notice] NOTICE: iscsi discovery failure - SendTargets (010.010.017.104)
    Apr 23 17:37:13 srvhqon11 iscsi: [ID 240218 kern.notice] NOTICE: iscsi session(9) iqn.2001-05.com.equallogic:0-8a0906-96cf73708-ef30000005e50a1b-sblprdbk online
    Apr 23 17:37:13 srvhqon11 scsi: [ID 583861 kern.info] sd11 at scsi_vhci0: unit-address g6090a0887073cf961b0ae505000030ef: g6090a0887073cf961b0ae505000030ef
    Apr 23 17:37:13 srvhqon11 genunix: [ID 936769 kern.info] sd11 is /scsi_vhci/disk@g6090a0887073cf961b0ae505000030ef
    Apr 23 17:37:13 srvhqon11 scsi: [ID 243001 kern.info] /scsi_vhci (scsi_vhci0):
    Apr 23 17:37:13 srvhqon11 /scsi_vhci/disk@g6090a0887073cf961b0ae505000030ef (sd11): Command failed to complete (3) on path iscsi0/[email protected]:0-8a0906-96cf73708-ef30000005e50a1b-sblprdbk0001,0
    Apr 23 17:46:54 srvhqon11 svc.startd[11]: [ID 122153 daemon.warning] svc:/network/iscsi/initiator:default: Method or service exit timed out. Killing contract 41.
    Apr 23 17:46:54 srvhqon11 svc.startd[11]: [ID 636263 daemon.warning] svc:/network/iscsi/initiator:default: Method "/lib/svc/method/iscsid start" failed due to signal KILL.
    Apr 23 17:46:54 srvhqon11 svc.startd[11]: [ID 748625 daemon.error] network/iscsi/initiator:default failed repeatedly: transitioned to maintenance (see 'svcs -xv' for details)
    Apr 24 14:50:16 srvhqon11 svc.startd[11]: [ID 694882 daemon.notice] instance svc:/system/console-login:default exited with status 1
    root@srvhqon11 # svcs -xv
    svc:/system/cluster/loaddid:default (Oracle Solaris Cluster loaddid)
    State: offline since Tue Apr 23 17:46:54 2013
    Reason: Start method is running.
    See: http://sun.com/msg/SMF-8000-C4
    See: /var/svc/log/system-cluster-loaddid:default.log
    Impact: 49 dependent services are not running:
    svc:/system/cluster/bootcluster:default
    svc:/system/cluster/cl_execd:default
    svc:/system/cluster/zc_cmd_log_replay:default
    svc:/system/cluster/sc_zc_member:default
    svc:/system/cluster/sc_rtreg_server:default
    svc:/system/cluster/sc_ifconfig_server:default
    svc:/system/cluster/initdid:default
    svc:/system/cluster/globaldevices:default
    svc:/system/cluster/gdevsync:default
    svc:/milestone/multi-user:default
    svc:/system/boot-config:default
    svc:/system/cluster/cl-svc-enable:default
    svc:/milestone/multi-user-server:default
    svc:/application/autoreg:default
    svc:/system/basicreg:default
    svc:/system/zones:default
    svc:/system/cluster/sc_zones:default
    svc:/system/cluster/scprivipd:default
    svc:/system/cluster/cl-svc-cluster-milestone:default
    svc:/system/cluster/sc_svtag:default
    svc:/system/cluster/sckeysync:default
    svc:/system/cluster/rpc-fed:default
    svc:/system/cluster/rgm-starter:default
    svc:/application/management/common-agent-container-1:default
    svc:/system/cluster/scsymon-srv:default
    svc:/system/cluster/sc_syncsa_server:default
    svc:/system/cluster/scslmclean:default
    svc:/system/cluster/cznetd:default
    svc:/system/cluster/scdpm:default
    svc:/system/cluster/rpc-pmf:default
    svc:/system/cluster/pnm:default
    svc:/system/cluster/sc_pnm_proxy_server:default
    svc:/system/cluster/cl-event:default
    svc:/system/cluster/cl-eventlog:default
    svc:/system/cluster/cl-ccra:default
    svc:/system/cluster/ql_upgrade:default
    svc:/system/cluster/mountgfs:default
    svc:/system/cluster/clusterdata:default
    svc:/system/cluster/ql_rgm:default
    svc:/system/cluster/scqdm:default
    svc:/application/stosreg:default
    svc:/application/sthwreg:default
    svc:/application/graphical-login/cde-login:default
    svc:/application/cde-printinfo:default
    svc:/system/cluster/scvxinstall:default
    svc:/system/cluster/sc_failfast:default
    svc:/system/cluster/clexecd:default
    svc:/system/cluster/sc_pmmd:default
    svc:/system/cluster/clevent_listenerd:default
    svc:/application/print/server:default (LP print server)
    State: disabled since Tue Apr 23 17:36:44 2013
    Reason: Disabled by an administrator.
    See: http://sun.com/msg/SMF-8000-05
    See: man -M /usr/share/man -s 1M lpsched
    Impact: 2 dependent services are not running:
    svc:/application/print/rfc1179:default
    svc:/application/print/ipp-listener:default
    svc:/network/iscsi/initiator:default (?)
    State: maintenance since Tue Apr 23 17:46:54 2013
    Reason: Restarting too quickly.
    See: http://sun.com/msg/SMF-8000-L5
    See: /var/svc/log/network-iscsi-initiator:default.log
    Impact: This service is not running.
    ######## Cluster Status from working node ############
    root@srvhqon10 # cluster status
    === Cluster Nodes ===
    --- Node Status ---
    Node Name Status
    srvhqon10 Online
    srvhqon11 Offline
    === Cluster Transport Paths ===
    Endpoint1 Endpoint2 Status
    srvhqon10:igb3 srvhqon11:igb3 faulted
    srvhqon10:igb2 srvhqon11:igb2 faulted
    === Cluster Quorum ===
    --- Quorum Votes Summary from (latest node reconfiguration) ---
    Needed Present Possible
    2 2 3
    --- Quorum Votes by Node (current status) ---
    Node Name Present Possible Status
    srvhqon10 1 1 Online
    srvhqon11 0 1 Offline
    --- Quorum Votes by Device (current status) ---
    Device Name Present Possible Status
    d2 1 1 Online
    === Cluster Device Groups ===
    --- Device Group Status ---
    Device Group Name Primary Secondary Status
    --- Spare, Inactive, and In Transition Nodes ---
    Device Group Name Spare Nodes Inactive Nodes In Transistion Nodes
    --- Multi-owner Device Group Status ---
    Device Group Name Node Name Status
    === Cluster Resource Groups ===
    Group Name Node Name Suspended State
    ora-rg srvhqon10 No Online
    srvhqon11 No Offline
    nfs-rg srvhqon10 No Online
    srvhqon11 No Offline
    backup-rg srvhqon10 No Online
    srvhqon11 No Offline
    === Cluster Resources ===
    Resource Name Node Name State Status Message
    ora-listener srvhqon10 Online Online
    srvhqon11 Offline Offline
    ora-server srvhqon10 Online Online
    srvhqon11 Offline Offline
    ora-stor srvhqon10 Online Online
    srvhqon11 Offline Offline
    ora-lh srvhqon10 Online Online - LogicalHostname online.
    srvhqon11 Offline Offline
    nfs-rs srvhqon10 Online Online - Service is online.
    srvhqon11 Offline Offline
    nfs-stor-rs srvhqon10 Online Online
    srvhqon11 Offline Offline
    nfs-lh-rs srvhqon10 Online Online - LogicalHostname online.
    srvhqon11 Offline Offline
    backup-stor srvhqon10 Online Online
    srvhqon11 Offline Offline
    cluster: (C383355) No response from daemon on node "srvhqon11".
    === Cluster DID Devices ===
    Device Instance Node Status
    /dev/did/rdsk/d1 srvhqon10 Ok
    /dev/did/rdsk/d2 srvhqon10 Ok
    srvhqon11 Unknown
    /dev/did/rdsk/d3 srvhqon10 Ok
    srvhqon11 Unknown
    /dev/did/rdsk/d4 srvhqon10 Ok
    /dev/did/rdsk/d5 srvhqon10 Fail
    srvhqon11 Unknown
    /dev/did/rdsk/d6 srvhqon11 Unknown
    /dev/did/rdsk/d7 srvhqon11 Unknown
    /dev/did/rdsk/d8 srvhqon10 Ok
    srvhqon11 Unknown
    /dev/did/rdsk/d9 srvhqon10 Ok
    srvhqon11 Unknown
    === Zone Clusters ===
    --- Zone Cluster Status ---
    Name Node Name Zone HostName Status Zone Status
    Regards.

    check if your global devices are mounted properly
    #cat /etc/mnttab | grep -i global
    check if proper entries are there on both systems
    #cat /etc/vfstab | grep -i global
    give output for quoram devices .
    #scstat -q
    or
    #clquorum list -v
    also check why your scsi initiator service is going offline unexpectedly
    #vi /var/svc/log/network-iscsi-initiator:default.log

  • Yellow status does not start  j2E server0

    Hi Gurus,
    Everything was working fine until today.  SDM and dispatcher green light but server0 yellow status for about for  1 hour now and still does not start.
    Status starting framework... your help is greatly appreciated.
    defaultTrace.1.trc below:
    <!LOGHEADER[START]/>
    <!HELP[Manual modification of the header may cause parsing problem!]/>
    <!LOGGINGVERSION[1.5.3.7185 - 630]/>
    <!NAME[./log/defaultTrace.trc]/>
    <!PATTERN[defaultTrace.trc]/>
    <!FORMATTER[com.sap.tc.logging.ListFormatter]/>
    <!ENCODING[Cp1252]/>
    <!FILESET[1, 3, 10485760]/>
    <!PREVIOUSFILE[defaultTrace.0.trc]/>
    <!NEXTFILE[defaultTrace.2.trc]/>
    <!LOGHEADER[END]/>
    #1.5#00059A3C780000130000037700000A6C0004186851F664F0#1152736237546#com.sap.caf.eu.cc.content.svc.CCServiceFrame##com.sap.caf.eu.cc.content.svc.CCServiceFrame#######SAPEngine_System_Thread[impl:5]_23##0#0#Error#1#/System/Server#Plain###Object not found in lookup of GPService.#
    #1.5#00059A3C780000130000037900000A6C000418685205A7F4#1152736238546#com.sap.caf.eu.cc.content.svc.CCServiceFrame##com.sap.caf.eu.cc.content.svc.CCServiceFrame#######SAPEngine_System_Thread[impl:5]_23##0#0#Error#1#/System/Server#Plain###Object not found in lookup of GPService.#
    #1.5#00059A3C780000130000037B00000A6C000418685214EAEB#1152736239546#com.sap.caf.eu.cc.content.svc.CCServiceFrame##com.sap.caf.eu.cc.content.svc.CCServiceFrame#######SAPEngine_System_Thread[impl:5]_23##0#0#Error#1#/System/Server#Plain###Object not found in lookup of GPService.#
    #1.5#00059A3C7800004D0000002300000A6C00041868521D86ED#1152736240109#com.sap.engine.core.locking.impl3.LockingManagerImpl##com.sap.engine.core.locking.impl3.LockingManagerImpl.jenqulib#######Thread[SAPEngine_EnquReader,5,main]##0#0#Error#1#/System/Server#Plain###Encomi: failed to connect to W2VZ9YDX01/3200/Connection refused: connect)#
    #1.5#00059A3C780000130000037D00000A6C0004186852242E7E#1152736240546#com.sap.caf.eu.cc.content.svc.CCServiceFrame##com.sap.caf.eu.cc.content.svc.CCServiceFrame#######SAPEngine_System_Thread[impl:5]_23##0#0#Error#1#/System/Server#Plain###Object not found in lookup of GPService.#
    #1.5#00059A3C780000130000037F00000A6C00041868523370E4#1152736241546#com.sap.caf.eu.cc.content.svc.CCServiceFrame##com.sap.caf.eu.cc.content.svc.CCServiceFrame#######SAPEngine_System_Thread[impl:5]_23##0#0#Error#1#/System/Server#Plain###Object not found in lookup of GPService.#
    #1.5#00059A3C780000130000038100000A6C000418685242B3BF#1152736242546#com.sap.caf.eu.cc.content.svc.CCServiceFrame##com.sap.caf.eu.cc.content.svc.CCServiceFrame#######SAPEngine_System_Thread[impl:5]_23##0#0#Error#1#/System/Server#Plain###Object not found in lookup of GPService.#
    #1.5#00059A3C7800004D0000002500000A6C00041868524A90A4#1152736243062#com.sap.engine.core.locking.impl3.LockingManagerImpl##com.sap.engine.core.locking.impl3.LockingManagerImpl.jenqulib#######Thread[SAPEngine_EnquReader,5,main]##0#0#Error#1#/System/Server#Plain###Encomi: failed to connect to W2VZ9YDX01/3200/Connection refused: connect)#
    #1.5#00059A3C780000130000038300000A6C000418685251F6D9#1152736243546#com.sap.caf.eu.cc.content.svc.CCServiceFrame##com.sap.caf.eu.cc.content.svc.CCServiceFrame#######SAPEngine_System_Thread[impl:5]_23##0#0#Error#1#/System/Server#Plain###Object not found in lookup of GPService.#
    #1.5#00059A3C780000130000038500000A6C00041868526139D5#1152736244546#com.sap.caf.eu.cc.content.svc.CCServiceFrame##com.sap.caf.eu.cc.content.svc.CCServiceFrame#######SAPEngine_System_Thread[impl:5]_23##0#0#Error#1#/System/Server#Plain###Object not found in lookup of GPService.#
    #1.5#00059A3C780000130000038700000A6C0004186852707CCB#1152736245546#com.sap.caf.eu.cc.content.svc.CCServiceFrame##com.sap.caf.eu.cc.content.svc.CCServiceFrame#######SAPEngine_System_Thread[impl:5]_23##0#0#Error#1#/System/Server#Plain###Object not found in lookup of GPService.#
    #1.5#00059A3C7800004D0000002700000A6C000418685277A44B#1152736246015#com.sap.engine.core.locking.impl3.LockingManagerImpl##com.sap.engine.core.locking.impl3.LockingManagerImpl.jenqulib#######Thread[SAPEngine_EnquReader,5,main]##0#0#Error#1#/System/Server#Plain###Encomi: failed to connect to W2VZ9YDX01/3200/Connection refused: connect)#
    #1.5#00059A3C780000130000038900000A6C0004186852802FB3#1152736246562#com.sap.caf.eu.cc.content.svc.CCServiceFrame##com.sap.caf.eu.cc.content.svc.CCServiceFrame#######SAPEngine_System_Thread[impl:5]_23##0#0#Error#1#/System/Server#Plain###Object not found in lookup of GPService.#
    #1.5#00059A3C780000130000038B00000A6C00041868528F3F05#1152736247562#com.sap.caf.eu.cc.content.svc.CCServiceFrame##com.sap.caf.eu.cc.content.svc.CCServiceFrame#######SAPEngine_System_Thread[impl:5]_23##0#0#Error#1#/System/Server#Plain###Object not found in lookup of GPService.#
    #1.5#00059A3C780000130000038D00000A6C00041868529E81E7#1152736248562#com.sap.caf.eu.cc.content.svc.CCServiceFrame##com.sap.caf.eu.cc.content.svc.CCServiceFrame#######SAPEngine_System_Thread[impl:5]_23##0#0#Error#1#/System/Server#Plain###Object not found in lookup of GPService.#
    #1.5#00059A3C7800004D0000002900000A6C0004186852A4B40E#1152736248968#com.sap.engine.core.locking.impl3.LockingManagerImpl##com.sap.engine.core.locking.impl3.LockingManagerImpl.jenqulib#######Thread[SAPEngine_EnquReader,5,main]##0#0#Error#1#/System/Server#Plain###Encomi: failed to connect to W2VZ9YDX01/3200/Connection refused: connect)#
    #1.5#00059A3C780000130000038F00000A6C0004186852ADC4E5#1152736249562#com.sap.caf.eu.cc.content.svc.CCServiceFrame##com.sap.caf.eu.cc.content.svc.CCServiceFrame#######SAPEngine_System_Thread[impl:5]_23##0#0#Error#1#/System/Server#Plain###Object not found in lookup of GPService.#
    #1.5#00059A3C780000130000039100000A6C0004186852BD08CC#1152736250562#com.sap.caf.eu.cc.content.svc.CCServiceFrame##com.sap.caf.eu.cc.content.svc.CCServiceFrame#######SAPEngine_System_Thread[impl:5]_23##0#0#Error#1#/System/Server#Plain###Object not found in lookup of GPService.#
    #1.5#00059A3C780000130000039300000A6C0004186852CC4B04#1152736251562#com.sap.caf.eu.cc.content.svc.CCServiceFrame##com.sap.caf.eu.cc.content.svc.CCServiceFrame#######SAPEngine_System_Thread[impl:5]_23##0#0#Error#1#/System/Server#Plain###Object not found in lookup of GPService.#
    #1.5#00059A3C7800004D0000002B00000A6C0004186852D1C7F5#1152736251921#com.sap.engine.core.locking.impl3.LockingManagerImpl##com.sap.engine.core.locking.impl3.LockingManagerImpl.jenqulib#######Thread[SAPEngine_EnquReader,5,main]##0#0#Error#1#/System/Server#Plain###Encomi: failed to connect to W2VZ9YDX01/3200/Connection refused: connect)#
    #1.5#00059A3C780000130000039500000A6C0004186852DB8DDD#1152736252562#com.sap.caf.eu.cc.content.svc.CCServiceFrame##com.sap.caf.eu.cc.content.svc.CCServiceFrame#######SAPEngine_System_Thread[impl:5]_23##0#0#Error#1#/System/Server#Plain###Object not found in lookup of GPService.#
    #1.5#00059A3C780000130000039700000A6C0004186852EAD11D#1152736253562#com.sap.caf.eu.cc.content.svc.CCServiceFrame##com.sap.caf.eu.cc.content.svc.CCServiceFrame#######SAPEngine_System_Thread[impl:5]_23##0#0#Error#1#/System/Server#Plain###Object not found in lookup of GPService.#
    #1.5#00059A3C780000130000039900000A6C0004186852FA1433#1152736254562#com.sap.caf.eu.cc.content.svc.CCServiceFrame##com.sap.caf.eu.cc.content.svc.CCServiceFrame#######SAPEngine_System_Thread[impl:5]_23##0#0#Error#1#/System/Server#Plain###Object not found in lookup of GPService.#
    #1.5#00059A3C7800004D0000002D00000A6C0004186852FED7CD#1152736254875#com.sap.engine.core.locking.impl3.LockingManagerImpl##com.sap.engine.core.locking.impl3.LockingManagerImpl.jenqulib#######Thread[SAPEngine_EnquReader,5,main]##0#0#Error#1#/System/Server#Plain###Encomi: failed to connect to W2VZ9YDX01/3200/Connection refused: connect)#
    #1.5#00059A3C780000130000039B00000A6C00041868530956D2#1152736255562#com.sap.caf.eu.cc.content.svc.CCServiceFrame##com.sap.caf.eu.cc.content.svc.CCServiceFrame#######SAPEngine_System_Thread[impl:5]_23##0#0#Error#1#/System/Server#Plain###Object not found in lookup of GPService.#
    #1.5#00059A3C780000130000039D00000A6C0004186853189991#1152736256562#com.sap.caf.eu.cc.content.svc.CCServiceFrame##com.sap.caf.eu.cc.content.svc.CCServiceFrame#######SAPEngine_System_Thread[impl:5]_23##0#0#Error#1#/System/Server#Plain###Object not found in lookup of GPService.#
    #1.5#00059A3C780000130000039F00000A6C000418685327DE41#1152736257562#com.sap.caf.eu.cc.content.svc.CCServiceFrame##com.sap.caf.eu.cc.content.svc.CCServiceFrame#######SAPEngine_System_Thread[impl:5]_23##0#0#Error#1#/System/Server#Plain###Object not found in lookup of GPService.#
    #1.5#00059A3C7800004D0000002F00000A6C00041868532BEB8B#1152736257828#com.sap.engine.core.locking.impl3.LockingManagerImpl##com.sap.engine.core.locking.impl3.LockingManagerImpl.jenqulib#######Thread[SAPEngine_EnquReader,5,main]##0#0#Error#1#/System/Server#Plain###Encomi: failed to connect to W2VZ9YDX01/3200/Connection refused: connect)#
    #1.5#00059A3C78000013000003A100000A6C0004186853371F8B#1152736258562#com.sap.caf.eu.cc.content.svc.CCServiceFrame##com.sap.caf.eu.cc.content.svc.CCServiceFrame#######SAPEngine_System_Thread[impl:5]_23##0#0#Error#1#/System/Server#Plain###Object not found in lookup of GPService.#
    #1.5#00059A3C78000013000003A300000A6C00041868534662B8#1152736259562#com.sap.caf.eu.cc.content.svc.CCServiceFrame##com.sap.caf.eu.cc.content.svc.CCServiceFrame#######SAPEngine_System_Thread[impl:5]_23##0#0#Error#1#/System/Server#Plain###Object not found in lookup of GPService.#
    #1.5#00059A3C78000013000003A500000A6C000418685355A71D#1152736260562#com.sap.caf.eu.cc.content.svc.CCServiceFrame##com.sap.caf.eu.cc.content.svc.CCServiceFrame#######SAPEngine_System_Thread[impl:5]_23##0#0#Error#1#/System/Server#Plain###Object not found in lookup of GPService.#
    #1.5#00059A3C7800004D0000003100000A6C00041868535AA66D#1152736260890#com.sap.engine.core.locking.impl3.LockingManagerImpl##com.sap.engine.core.locking.impl3.LockingManagerImpl.jenqulib#######Thread[SAPEngine_EnquReader,5,main]##0#0#Error#1#/System/Server#Plain###Encomi: failed to connect to W2VZ9YDX01/3200/Connection refused: connect)#
    #1.5#00059A3C78000013000003A700000A6C000418685364E8A3#1152736261562#com.sap.caf.eu.cc.content.svc.CCServiceFrame##com.sap.caf.eu.cc.content.svc.CCServiceFrame#######SAPEngine_System_Thread[impl:5]_23##0#0#Error#1#/System/Server#Plain###Object not found in lookup of GPService.#
    #1.5#00059A3C78000013000003A900000A6C0004186853742CB4#1152736262562#com.sap.caf.eu.cc.content.svc.CCServiceFrame##com.sap.caf.eu.cc.content.svc.CCServiceFrame#######SAPEngine_System_Thread[impl:5]_23##0#0#Error#1#/System/Server#Plain###Object not found in lookup of GPService.#
    #1.5#00059A3C78000013000003AB00000A6C0004186853836E98#1152736263562#com.sap.caf.eu.cc.content.svc.CCServiceFrame##com.sap.caf.eu.cc.content.svc.CCServiceFrame#######SAPEngine_System_Thread[impl:5]_23##0#0#Error#1#/System/Server#Plain###Object not found in lookup of GPService.#
    #1.5#00059A3C7800004D0000003300000A6C000418685389636E#1152736263953#com.sap.engine.core.locking.impl3.LockingManagerImpl##com.sap.engine.core.locking.impl3.LockingManagerImpl.jenqulib#######Thread[SAPEngine_EnquReader,5,main]##0#0#Error#1#/System/Server#Plain###Encomi: failed to connect to W2VZ9YDX01/3200/Connection refused: connect)#
    #1.5#00059A3C7800004D0000003500000A6C000418685389641F#1152736263953#com.sap.engine.core.locking.impl3.LockingManagerImpl##com.sap.engine.core.locking.impl3.LockingManagerImpl.jenqulib#######Thread[SAPEngine_EnquReader,5,main]##0#0#Error#1#/System/Server#Plain###ReadRunnable: failed to connect to server 21 times#
    #1.5#00059A3C78000013000003AD00000A6C000418685392B1E1#1152736264562#com.sap.caf.eu.cc.content.svc.CCServiceFrame##com.sap.caf.eu.cc.content.svc.CCServiceFrame#######SAPEngine_System_Thread[impl:5]_23##0#0#Error#1#/System/Server#Plain###Object not found in lookup of GPService.#
    #1.5#00059A3C78000013000003AF00000A6C0004186853A1F4BA#1152736265562#com.sap.caf.eu.cc.content.svc.CCServiceFrame##com.sap.caf.eu.cc.content.svc.CCServiceFrame#######SAPEngine_System_Thread[impl:5]_23##0#0#Error#1#/System/Server#Plain###Object not found in lookup of GPService.#
    #1.5#00059A3C78000013000003B100000A6C0004186853B13738#1152736266562#com.sap.caf.eu.cc.content.svc.CCServiceFrame##com.sap.caf.eu.cc.content.svc.CCServiceFrame#######SAPEngine_System_Thread[impl:5]_23##0#0#Error#1#/System/Server#Plain###Object not found in lookup of GPService.#
    #1.5#00059A3C7800004D0000003700000A6C0004186853B67544#1152736266906#com.sap.engine.core.locking.impl3.LockingManagerImpl##com.sap.engine.core.locking.impl3.LockingManagerImpl.jenqulib#######Thread[SAPEngine_EnquReader,5,main]##0#0#Error#1#/System/Server#Plain###Encomi: failed to connect to W2VZ9YDX01/3200/Connection refused: connect)#
    #1.5#00059A3C78000013000003B300000A6C0004186853C07B45#1152736267562#com.sap.caf.eu.cc.content.svc.CCServiceFrame##com.sap.caf.eu.cc.content.svc.CCServiceFrame#######SAPEngine_System_Thread[impl:5]_23##0#0#Error#1#/System/Server#Plain###Object not found in lookup of GPService.#
    #1.5#00059A3C78000013000003B500000A6C0004186853CFC170#1152736268562#com.sap.caf.eu.cc.content.svc.CCServiceFrame##com.sap.caf.eu.cc.content.svc.CCServiceFrame#######SAPEngine_System_Thread[impl:5]_23##0#0#Error#1#/System/Server#Plain###Object not found in lookup of GPService.#
    #1.5#00059A3C78000013000003B700000A6C0004186853DF0070#1152736269562#com.sap.caf.eu.cc.content.svc.CCServiceFrame##com.sap.caf.eu.cc.content.svc.CCServiceFrame#######SAPEngine_System_Thread[impl:5]_23##0#0#Error#1#/System/Server#Plain###Object not found in lookup of GPService.#
    #1.5#00059A3C7800004D0000003900000A6C0004186853E38ABE#1152736269859#com.sap.engine.core.locking.impl3.LockingManagerImpl##com.sap.engine.core.locking.impl3.LockingManagerImpl.jenqulib#######Thread[SAPEngine_EnquReader,5,main]##0#0#Error#1#/System/Server#Plain###Encomi: failed to connect to W2VZ9YDX01/3200/Connection refused: connect)#
    #1.5#00059A3C78000013000003B900000A6C0004186853EE4570#1152736270562#com.sap.caf.eu.cc.content.svc.CCServiceFrame##com.sap.caf.eu.cc.content.svc.CCServiceFrame#######SAPEngine_System_Thread[impl:5]_23##0#0#Error#1#/System/Server#Plain###Object not found in lookup of GPService.#
    #1.5#00059A3C78000013000003BB00000A6C0004186853FD86C9#1152736271562#com.sap.caf.eu.cc.content.svc.CCServiceFrame##com.sap.caf.eu.cc.content.svc.CCServiceFrame#######SAPEngine_System_Thread[impl:5]_23##0#0#Error#1#/System/Server#Plain###Object not found in lookup of GPService.#
    #1.5#00059A3C78000013000003BD00000A6C00041868540CC99B#1152736272562#com.sap.caf.eu.cc.content.svc.CCServiceFrame##com.sap.caf.eu.cc.content.svc.CCServiceFrame#######SAPEngine_System_Thread[impl:5]_23##0#0#Error#1#/System/Server#Plain###Object not found in lookup of GPService.#
    #1.5#00059A3C7800004D0000003B00000A6C0004186854109898#1152736272812#com.sap.engine.core.locking.impl3.LockingManagerImpl##com.sap.engine.core.locking.impl3.LockingManagerImpl.jenqulib#######Thread[SAPEngine_EnquReader,5,main]##0#0#Error#1#/System/Server#Plain###Encomi: failed to connect to W2VZ9YDX01/3200/Connection refused: connect)#
    #1.5#00059A3C78000013000003BF00000A6C00041868541C0C88#1152736273562#com.sap.caf.eu.cc.content.svc.CCServiceFrame##com.sap.caf.eu.cc.content.svc.CCServiceFrame#######SAPEngine_System_Thread[impl:5]_23##0#0#Error#1#/System/Server#Plain###Object not found in lookup of GPService.#
    #1.5#00059A3C78000013000003C100000A6C00041868542B4F6F#1152736274562#com.sap.caf.eu.cc.content.svc.CCServiceFrame##com.sap.caf.eu.cc.content.svc.CCServiceFrame#######SAPEngine_System_Thread[impl:5]_23##0#0#Error#1#/System/Server#Plain###Object not found in lookup of GPService.#
    #1.5#00059A3C78000013000003C300000A6C00041868543A95FD#1152736275562#com.sap.caf.eu.cc.content.svc.CCServiceFrame##com.sap.caf.eu.cc.content.svc.CCServiceFrame#######SAPEngine_System_Thread[impl:5]_23##0#0#Error#1#/System/Server#Plain###Object not found in lookup of GPService.#
    #1.5#00059A3C7800004D0000003D00000A6C00041868543DAAEC#1152736275765#com.sap.engine.core.locking.impl3.LockingManagerImpl##com.sap.engine.core.locking.impl3.LockingManagerImpl.jenqulib#######Thread[SAPEngine_EnquReader,5,main]##0#0#Error#1#/System/Server#Plain###Encomi: failed to connect to W2VZ9YDX01/3200/Connection refused: connect)#
    #1.5#00059A3C78000013000003C500000A6C000418685449D531#1152736276562#com.sap.caf.eu.cc.content.svc.CCServiceFrame##com.sap.caf.eu.cc.content.svc.CCServiceFrame#######SAPEngine_System_Thread[impl:5]_23##0#0#Error#1#/System/Server#Plain###Object not found in lookup of GPService.#
    #1.5#00059A3C78000013000003C700000A6C0004186854591BCF#1152736277562#com.sap.caf.eu.cc.content.svc.CCServiceFrame##com.sap.caf.eu.cc.content.svc.CCServiceFrame#######SAPEngine_System_Thread[impl:5]_23##0#0#Error#1#/System/Server#Plain###Object not found in lookup of GPService.#
    #1.5#00059A3C78000013000003C900000A6C0004186854685BFC#1152736278562#com.sap.caf.eu.cc.content.svc.CCServiceFrame##com.sap.caf.eu.cc.content.svc.CCServiceFrame#######SAPEngine_System_Thread[impl:5]_23##0#0#Error#1#/System/Server#Plain###Object not found in lookup of GPService.#
    #1.5#00059A3C7800004D0000003F00000A6C00041868546ABE24#1152736278718#com.sap.engine.core.locking.impl3.LockingManagerImpl##com.sap.engine.core.locking.impl3.LockingManagerImpl.jenqulib#######Thread[SAPEngine_EnquReader,5,main]##0#0#Error#1#/System/Server#Plain###Encomi: failed to connect to W2VZ9YDX01/3200/Connection refused: connect)#
    #1.5#00059A3C78000013000003CB00000A6C000418685477A230#1152736279562#com.sap.caf.eu.cc.content.svc.CCServiceFrame##com.sap.caf.eu.cc.content.svc.CCServiceFrame#######SAPEngine_System_Thread[impl:5]_23##0#0#Error#1#/System/Server#Plain###Object not found in lookup of GPService.#
    #1.5#00059A3C78000013000003CD00000A6C000418685486E284#1152736280562#com.sap.caf.eu.cc.content.svc.CCServiceFrame##com.sap.caf.eu.cc.content.svc.CCServiceFrame#######SAPEngine_System_Thread[impl:5]_23##0#0#Error#1#/System/Server#Plain###Object not found in lookup of GPService.#
    #1.5#00059A3C78000013000003CF00000A6C0004186854962501#1152736281562#com.sap.caf.eu.cc.content.svc.CCServiceFrame##com.sap.caf.eu.cc.content.svc.CCServiceFrame#######SAPEngine_System_Thread[impl:5]_23##0#0#Error#1#/System/Server#Plain###Object not found in lookup of GPService.#
    #1.5#00059A3C7800004D0000004100000A6C000418685497D00B#1152736281671#com.sap.engine.core.locking.impl3.LockingManagerImpl##com.sap.engine.core.locking.impl3.LockingManagerImpl.jenqulib#######Thread[SAPEngine_EnquReader,5,main]##0#0#Error#1#/System/Server#Plain###Encomi: failed to connect to W2VZ9YDX01/3200/Connection refused: connect)#
    #1.5#00059A3C78000013000003D100000A6C0004186854A56798#1152736282562#com.sap.caf.eu.cc.content.svc.CCServiceFrame##com.sap.caf.eu.cc.content.svc.CCServiceFrame#######SAPEngine_System_Thread[impl:5]_23##0#0#Error#1#/System/Server#Plain###Object not found in lookup of GPService.#
    #1.5#00059A3C78000013000003D300000A6C0004186854B4AA9C#1152736283562#com.sap.caf.eu.cc.content.svc.CCServiceFrame##com.sap.caf.eu.cc.content.svc.CCServiceFrame#######SAPEngine_System_Thread[impl:5]_23##0#0#Error#1#/System/Server#Plain###Object not found in lookup of GPService.#
    #1.5#00059A3C78000013000003D500000A6C0004186854C3EDE9#1152736284562#com.sap.caf.eu.cc.content.svc.CCServiceFrame##com.sap.caf.eu.cc.content.svc.CCServiceFrame#######SAPEngine_System_Thread[impl:5]_23##0#0#Error#1#/System/Server#Plain###Object not found in lookup of GPService.#
    #1.5#00059A3C7800004D0000004300000A6C0004186854C4E1A8#1152736284625#com.sap.engine.core.locking.impl3.LockingManagerImpl##com.sap.engine.core.locking.impl3.LockingManagerImpl.jenqulib#######Thread[SAPEngine_EnquReader,5,main]##0#0#Error#1#/System/Server#Plain###Encomi: failed to connect to W2VZ9YDX01/3200/Connection refused: connect)#
    #1.5#00059A3C78000013000003D700000A6C0004186854D330D1#1152736285562#com.sap.caf.eu.cc.content.svc.CCServiceFrame##com.sap.caf.eu.cc.content.svc.CCServiceFrame#######SAPEngine_System_Thread[impl:5]_23##0#0#Error#1#/System/Server#Plain###Object not found in lookup of GPService.#
    #1.5#00059A3C78000013000003D900000A6C0004186854E27477#1152736286562#com.sap.caf.eu.cc.content.svc.CCServiceFrame##com.sap.caf.eu.cc.content.svc.CCServiceFrame#######SAPEngine_System_Thread[impl:5]_23##0#0#Error#1#/System/Server#Plain###Object not found in lookup of GPService.#
    #1.5#00059A3C78000013000003DB00000A6C0004186854F1B67B#1152736287562#com.sap.caf.eu.cc.content.svc.CCServiceFrame##com.sap.caf.eu.cc.content.svc.CCServiceFrame#######SAPEngine_System_Thread[impl:5]_23##0#0#Error#1#/System/Server#Plain###Object not found in lookup of GPService.#
    #1.5#00059A3C7800004D0000004500000A6C0004186854F39F30#1152736287687#com.sap.engine.core.locking.impl3.LockingManagerImpl##com.sap.engine.core.locking.impl3.LockingManagerImpl.jenqulib#######Thread[SAPEngine_EnquReader,5,main]##0#0#Error#1#/System/Server#Plain###Encomi: failed to connect to W2VZ9YDX01/3200/Connection refused: connect)#
    #1.5#00059A3C78000013000003DD00000A6C000418685500F98F#1152736288562#com.sap.caf.eu.cc.content.svc.CCServiceFrame##com.sap.caf.eu.cc.content.svc.CCServiceFrame#######SAPEngine_System_Thread[impl:5]_23##0#0#Error#1#/System/Server#Plain###Object not found in lookup of GPService.#
    #1.5#00059A3C78000013000003DF00000A6C0004186855104D91#1152736289562#com.sap.caf.eu.cc.content.svc.CCServiceFrame##com.sap.caf.eu.cc.content.svc.CCServiceFrame#######SAPEngine_System_Thread[impl:5]_23##0#0#Error#1#/System/Server#Plain###Object not found in lookup of GPService.#
    #1.5#00059A3C78000013000003E100000A6C00041868551F8202#1152736290562#com.sap.caf.eu.cc.content.svc.CCServiceFrame##com.sap.caf.eu.cc.content.svc.CCServiceFrame#######SAPEngine_System_Thread[impl:5]_23##0#0#Error#1#/System/Server#Plain###Object not found in lookup of GPService.#
    #1.5#00059A3C7800004D0000004700000A6C0004186855225A79#1152736290750#com.sap.engine.core.locking.impl3.LockingManagerImpl##com.sap.engine.core.locking.impl3.LockingManagerImpl.jenqulib#######Thread[SAPEngine_EnquReader,5,main]##0#0#Error#1#/System/Server#Plain###Encomi: failed to connect to W2VZ9YDX01/3200/Connection refused: connect)#
    #1.5#00059A3C78000013000003E300000A6C00041868552EC25E#1152736291562#com.sap.caf.eu.cc.content.svc.CCServiceFrame##com.sap.caf.eu.cc.content.svc.CCServiceFrame#######SAPEngine_System_Thread[impl:5]_23##0#0#Error#1#/System/Server#Plain###Object not found in lookup of GPService.#
    #1.5#00059A3C78000013000003E500000A6C00041868553E05B6#1152736292562#com.sap.caf.eu.cc.content.svc.CCServiceFrame##com.sap.caf.eu.cc.content.svc.CCServiceFrame#######SAPEngine_System_Thread[impl:5]_23##0#0#Error#1#/System/Server#Plain###Object not found in lookup of GPService.#
    #1.5#00059A3C78000013000003E700000A6C00041868554D485C#1152736293562#com.sap.caf.eu.cc.content.svc.CCServiceFrame##com.sap.caf.eu.cc.content.svc.CCServiceFrame#######SAPEngine_System_Thread[impl:5]_23##0#0#Error#1#/System/Server#Plain###Object not found in lookup of GPService.#
    #1.5#00059A3C7800004D0000004900000A6C00041868554F6BA7#1152736293703#com.sap.engine.core.locking.impl3.LockingManagerImpl##com.sap.engine.core.locking.impl3.LockingManagerImpl.jenqulib#######Thread[SAPEngine_EnquReader,5,main]##0#0#Error#1#/System/Server#Plain###Encomi: failed to connect to W2VZ9YDX01/3200/Connection refused: connect)#
    #1.5#00059A3C7800004D0000004B00000A6C00041868554F6C57#1152736293703#com.sap.engine.core.locking.impl3.LockingManagerImpl##com.sap.engine.core.locking.impl3.LockingManagerImpl.jenqulib#######Thread[SAPEngine_EnquReader,5,main]##0#0#Error#1#/System/Server#Plain###ReadRunnable: failed to connect to server 31 times#
    #1.5#00059A3C78000013000003E900000A6C00041868555C8B5C#1152736294562#com.sap.caf.eu.cc.content.svc.CCServiceFrame##com.sap.caf.eu.cc.content.svc.CCServiceFrame#######SAPEngine_System_Thread[impl:5]_23##0#0#Error#1#/System/Server#Plain###Object not found in lookup of GPService.#
    #1.5#00059A3C78000013000003EB00000A6C00041868556BCE69#1152736295562#com.sap.caf.eu.cc.content.svc.CCServiceFrame##com.sap.caf.eu.cc.content.svc.CCServiceFrame#######SAPEngine_System_Thread[impl:5]_23##0#0#Error#1#/System/Server#Plain###Object not found in lookup of GPService.#
    #1.5#00059A3C78000013000003ED00000A6C00041868557B112C#1152736296562#com.sap.caf.eu.cc.content.svc.CCServiceFrame##com.sap.caf.eu.cc.content.svc.CCServiceFrame#######SAPEngine_System_Thread[impl:5]_23##0#0#Error#1#/System/Server#Plain###Object not found in lookup of GPService.#
    #1.5#00059A3C7800004D0000004D00000A6C00041868557C7DA9#1152736296656#com.sap.engine.core.locking.impl3.LockingManagerImpl##com.sap.engine.core.locking.impl3.LockingManagerImpl.jenqulib#######Thread[SAPEngine_EnquReader,5,main]##0#0#Error#1#/System/Server#Plain###Encomi: failed to connect to W2VZ9YDX01/3200/Connection refused: connect)#
    #1.5#00059A3C78000013000003EF00000A6C00041868558A5436#1152736297562#com.sap.caf.eu.cc.content.svc.CCServiceFrame##com.sap.caf.eu.cc.content.svc.CCServiceFrame#######SAPEngine_System_Thread[impl:5]_23##0#0#Error#1#/System/Server#Plain###Object not found in lookup of GPService.#
    #1.5#00059A3C78000013000003F100000A6C0004186855999723#1152736298562#com.sap.caf.eu.cc.content.svc.CCServiceFrame##com.sap.caf.eu.cc.content.svc.CCServiceFrame#######SAPEngine_System_Thread[impl:5]_23##0#0#Error#1#/System/Server#Plain###Object not found in lookup of GPService.#
    #1.5#00059A3C78000013000003F300000A6C0004186855A8DA71#1152736299562#com.sap.caf.eu.cc.content.svc.CCServiceFrame##com.sap.caf.eu.cc.content.svc.CCServiceFrame#######SAPEngine_System_Thread[impl:5]_23##0#0#Error#1#/System/Server#Plain###Object not found in lookup of GPService.#
    #1.5#00059A3C7800004D0000004F00000A6C0004186855A98F54#1152736299609#com.sap.engine.core.locking.impl3.LockingManagerImpl##com.sap.engine.core.locking.impl3.LockingManagerImpl.jenqulib#######Thread[SAPEngine_EnquReader,5,main]##0#0#Error#1#/System/Server#Plain###Encomi: failed to connect to W2VZ9YDX01/3200/Connection refused: connect)#
    #1.5#00059A3C78000013000003F500000A6C0004186855B83230#1152736300562#com.sap.caf.eu.cc.content.svc.CCServiceFrame##com.sap.caf.eu.cc.content.svc.CCServiceFrame#######SAPEngine_System_Thread[impl:5]_23##0#0#Error#1#/System/Server#Plain###Object not found in lookup of GPService.#
    #1.5#00059A3C78000013000003F700000A6C0004186855C75FEC#1152736301562#com.sap.caf.eu.cc.content.svc.CCServiceFrame##com.sap.caf.eu.cc.content.svc.CCServiceFrame#######SAPEngine_System_Thread[impl:5]_23##0#0#Error#1#/System/Server#Plain###Object not found in lookup of GPService.#
    #1.5#00059A3C7800004D0000005100000A6C0004186855D6A15C#1152736302562#com.sap.engine.core.locking.impl3.LockingManagerImpl##com.sap.engine.core.locking.impl3.LockingManagerImpl.jenqulib#######Thread[SAPEngine_EnquReader,5,main]##0#0#Error#1#/System/Server#Plain###Encomi: failed to connect to W2VZ9YDX01/3200/Connection refused: connect)#
    #1.5#00059A3C78000013000003F900000A6C0004186855D6AB90#1152736302562#com.sap.caf.eu.cc.content.svc.CCServiceFrame##com.sap.caf.eu.cc.content.svc.CCServiceFrame#######SAPEngine_System_Thread[impl:5]_23##0#0#Error#1#/System/Server#Plain###Object not found in lookup of GPService.#
    #1.5#00059A3C78000013000003FB00000A6C0004186855E5E61D#1152736303562#com.sap.caf.eu.cc.content.svc.CCServiceFrame##com.sap.caf.eu.cc.content.svc.CCServiceFrame#######SAPEngine_System_Thread[impl:5]_23##0#0#Error#1#/System/Server#Plain###Object not found in lookup of GPService.#
    #1.5#00059A3C78000013000003FD00000A6C0004186855F52B15#1152736304562#com.sap.caf.eu.cc.content.svc.CCServiceFrame##com.sap.caf.eu.cc.content.svc.CCServiceFrame#######SAPEngine_System_Thread[impl:5]_23##0#0#Error#1#/System/Server#Plain###Object not found in lookup of GPService.#
    #1.5#00059A3C7800004D0000005300000A6C000418685603B31E#1152736305515#com.sap.engine.core.locking.impl3.LockingManagerImpl##com.sap.engine.core.locking.impl3.LockingManagerImpl.jenqulib#######Thread[SAPEngine_EnquReader,5,main]##0#0#Error#1#/System/Server#Plain###Encomi: failed to connect to W2VZ9YDX01/3200/Connection refused: connect)#
    #1.5#00059A3C78000013000003FF00000A6C0004186856046BD7#1152736305562#com.sap.caf.eu.cc.content.svc.CCServiceFrame##com.sap.caf.eu.cc.content.svc.CCServiceFrame#######SAPEngine_System_Thread[impl:5]_23##0#0#Error#1#/System/Server#Plain###Object not found in lookup of GPService.#
    #1.5#00059A3C780000130000040100000A6C000418685613AF49#1152736306562#com.sap.caf.eu.cc.content.svc.CCServiceFrame##com.sap.caf.eu.cc.content.svc.CCServiceFrame#######SAPEngine_System_Thread[impl:5]_23##0#0#Error#1#/System/Server#Plain###Object not found in lookup of GPService.#
    #1.5#00059A3C780000130000040300000A6C000418685622F1E0#1152736307562#com.sap.caf.eu.cc.content.svc.CCServiceFrame##com.sap.caf.eu.cc.content.svc.CCServiceFrame#######SAPEngine_System_Thread[impl:5]_23##0#0#Error#1#/System/Server#Plain###Object not found in lookup of GPService.#
    #1.5#00059A3C7800004D0000005500000A6C000418685630C4ED#1152736308468#com.sap.engine.core.locking.impl3.LockingManagerImpl##com.sap.engine.core.locking.impl3.LockingManagerImpl.jenqulib#######Thread[SAPEngine_EnquReader,5,main]##0#0#Error#1#/System/Server#Plain###Encomi: failed to connect to W2VZ9YDX01/3200/Connection refused: connect)#
    #1.5#00059A3C780000130000040500000A6C00041868563234C9#1152736308562#com.sap.caf.eu.cc.content.svc.CCServiceFrame##com.sap.caf.eu.cc.content.svc.CCServiceFrame#######SAPEngine_System_Thread[impl:5]_23##0#0#Error#1#/System/Server#Plain###Object not found in lookup of GPService.#
    #1.5#00059A3C780000130000040700000A6C00041868564177D5#1152736309562#com.sap.caf.eu.cc.content.svc.CCServiceFrame##com.sap.caf.eu.cc.content.svc.CCServiceFrame#######SAPEngine_System_Thread[impl:5]_23##0#0#Error#1#/System/Server#Plain###Object not found in lookup of GPService.#
    #1.5#00059A3C780000130000040900000A6C000418685650BB84#1152736310562#com.sap.caf.eu.cc.content.svc.CCServiceFrame##com.sap.caf.eu.cc.content.svc.CCServiceFrame#######SAPEngine_System_Thread[impl:5]_23##0#0#Error#1#/System/Server#Plain###Object not found in lookup of GPService.#
    #1.5#00059A3C7800004D0000005700000A6C00041868565DD655#1152736311421#com.sap.engine.core.locking.impl3.LockingManagerImpl##com.sap.engine.core.locking.impl3.LockingManagerImpl.jenqulib#######Thread[SAPEngine_EnquReader,5,main]##0#0#Error#1#/System/Server#Plain###Encomi: failed to connect to W2VZ9YDX01/3200/Connection refused: connect)#
    #1.5#00059A3C780000130000040B00000A6C00041868565FFFEB#1152736311562#com.sap.caf.eu.cc.content.svc.CCServiceFrame##com.sap.caf.eu.cc.content.svc.CCServiceFrame#######SAPEngine_System_Thread[impl:5]_23##0#0#Error#1#/System/Server#Plain###Object not found in lookup of GPService.#
    #1.5#00059A3C780000130000040D00000A6C00041868566F46AB#1152736312562#com.sap.caf.eu.cc.content.svc.CCServiceFrame##com.sap.caf.eu.cc.content.svc.CCServiceFrame#######SAPEngine_System_Thread[impl:5]_23##0#0#Error#1#/System/Server#Plain###Object not found in lookup of GPService.#
    #1.5#00059A3C780000130000040F00000A6C00041868567E83E1#1152736313562#com.sap.caf.eu.cc.content.svc.CCServiceFrame##com.sap.caf.eu.cc.content.svc.CCServiceFrame#######SAPEngine_System_Thread[impl:5]_23##0#0#Error#1#/System/Server#Plain###Object not found in lookup of GPService.#
    #1.5#00059A3C7800004D0000005900000A6C00041868568AE813#1152736314375#com.sap.engine.core.locking.impl3.LockingManagerImpl##com.sap.engine.core.locking.impl3.LockingManagerImpl.jenqulib#######Thread[SAPEngine_EnquReader,5,main]##0#0#Error#1#/System/Server#Plain###Encomi: failed to connect to W2VZ9YDX01/3200/Connection refused: connect)#
    #1.5#00059A3C780000130000041100000A6C00041868568DC724#1152736314562#com.sap.caf.eu.cc.content.svc.CCServiceFrame##com.sap.caf.eu.cc.content.svc.CCServiceFrame#######SAPEngine_System_Thread[impl:5]_23##0#0#Error#1#/System/Server#Plain###Object not found in lookup of GPService.#
    #1.5#00059A3C780000130000041300000A6C00041868569D09C1#1152736315562#com.sap.caf.eu.cc.content.svc.CCServiceFrame##com.sap.caf.eu.cc.content.svc.CCServiceFrame#######SAPEngine_System_Thread[impl:5]_23##0#0#Error#1#/System/Server#Plain###Object not found in lookup of GPService.#
    #1.5#00059A3C780000130000041500000A6C0004186856AC4E14#1152736316562#com.sap.caf.eu.cc.content.svc.CCServiceFrame##com.sap.caf.eu.cc.content.svc.CCServiceFrame#######SAPEngine_System_Thread[impl:5]_23##0#0#Error#1#/System/Server#Plain###Object not found in lookup of GPService.#
    #1.5#00059A3C7800004D0000005B00000A6C0004186856B7FA16#1152736317328#com.sap.engine.core.locking.impl3.LockingManagerImpl##com.sap.engine.core.locking.impl3.LockingManagerImpl.jenqulib#######Thread[SAPEngine_EnquReader,5,main]##0#0#Error#1#/System/Server#Plain###Encomi: failed to connect to W2VZ9YDX01/3200/Connection refused: connect)#
    #1.5#00059A3C780000130000041700000A6C0004186856BB8FD9#1152736317562#com.sap.caf.eu.cc.content.svc.CCServiceFrame##com.sap.caf.eu.cc.content.svc.CCServiceFrame#######SAPEngine_System_Thread[impl:5]_23##0#0#Error#1#/System/Server#Plain###Object not found in lookup of GPService.#
    #1.5#00059A3C780000130000041900000A6C0004186856CAD2A3#1152736318562#com.sap.caf.eu.cc.content.svc.CCServiceFrame##com.sap.caf.eu.cc.content.svc.CCServiceFrame#######SAPEngine_System_Thread[impl:5]_23##0#0#Error#1#/System/Server#Plain###Object not found in lookup of GPService.#
    #1.5#00059A3C780000130000041B00000A6C0004186856DA15C5#1152736319562#com.sap.caf.eu.cc.content.svc.CCServiceFrame##com.sap.caf.eu.cc.content.svc.CCServiceFrame#######SAPEngine_System_Thread[impl:5]_23##0#0#Error#1#/System/Server#Plain###Object not found in lookup of GPService.#
    #1.5#00059A3C7800004D0000005D00000A6C0004186856E6B8BB#1152736320390#com.sap.engine.core.locking.impl3.LockingManagerImpl##com.sap.engine.core.locking.impl3.LockingManagerImpl.jenqulib#######Thread[SAPEngine_EnquReader,5,main]##0#0#Error#1#/System/Server#Plain###Encomi: failed to connect to W2VZ9YDX01/3200/Connection refused: connect)#
    #1.5#00059A3C780000130000041D00000A6C0004186856E959EC#1152736320562#com.sap.caf.eu.cc.content.svc.CCServiceFrame##com.sap.caf.eu.cc.content.svc.CCServiceFrame#######SAPEngine_System_Thread[impl:5]_23##0#0#Error#1#/System/Server#Plain###Object not found in lookup of GPService.#
    #1.5#00059A3C780000130000041F00000A6C0004186856F8A0A5#1152736321562#com.sap.caf.eu.cc.content.svc.CCServiceFrame##com.sap.caf.eu.cc.content.svc.CCServiceFrame#######SAPEngine_System_Thread[impl:5]_23##0#0#Error#1#/System/Server#Plain###Object not found in lookup of GPService.#
    #1.5#00059A3C780000130000042100000A6C000418685707E177#1152736322562#com.sap.caf.eu.cc.content.svc.CCServiceFrame##com.sap.caf.eu.cc.content.svc.CCServiceFrame#######SAPEngine_System_Thread[impl:5]_23##0#0#Error#1#/System/Server#Plain###Object not found in lookup of GPService.#
    #1.5#00059A3C7800004D0000005F00000A6C00041868571574B0#1152736323453#com.sap.engine.core.locking.impl3.LockingManagerImpl##com.sap.engine.core.locking.impl3.LockingManagerImpl.jenqulib#######Thread[SAPEngine_EnquReader,5,main]##0#0#Error#1#/System/Server#Plain###Encomi: failed to connect to W2VZ9YDX01/3200/Connection refused: connect)#
    #1.5#00059A3C7800004D0000006100000A6C0004186857157562#1152736323453#com.sap.engine.core.locking.impl3.LockingManagerImpl##com.sap.engine.core.locking.impl3.LockingManagerImpl.jenqulib#######Thread[SAPEngine_EnquReader,5,main]##0#0#Error#1#/System/Server#Plain###ReadRunnable: failed to connect to server 41 times#
    #1.5#00059A3C780000130000042300000A6C0004186857172471#1152736323562#com.sap.caf.eu.cc.content.svc.CCServiceFrame##com.sap.caf.eu.cc.content.svc.CCServiceFrame#######SAPEngine_System_Thread[impl:5]_23##0#0#Error#1#/System/Server#Plain###Object not found in lookup of GPService.#
    #1.5#00059A3C7800000100000001000013B00004186874253A2B#1152736811298#com.sap.engine.core.locking.impl3.LockingManagerImpl##com.sap.engine.core.locking.impl3.LockingManagerImpl.jenqulib#######Thread[SAPEngine_EnquReader,5,main]##0#0#Error#1#/System/Server#Plain###Encomi: receive failed (Connection reset): close connection#
    #1.5#00059A3C7800000100000003000013B00004186874253F3B#1152736811314#com.sap.engine.core.locking.impl3.LockingManagerImpl##com.sap.engine.core.locking.impl3.LockingManagerImpl.jenqulib#######Thread[SAPEngine_EnquReader,5,main]##0#0#Error#1#/System/Server#Plain###ReadRunnable: receive failed (Encomi: receive failed (Connection reset): close connection -1), flush pending responses#
    #1.5#00059A3C7800000200000000000013B000041868742548F7#1152736811314#com.sap.engine.core.cluster.impl6.ms.MSRawConnection##com.sap.engine.core.cluster.impl6.ms.MSRawConnection.receiveRawMessage()#######SAP J2EE Engine|MS Socket Listener##0#0#Error##Plain###java.net.SocketException: Connection reset#
    #1.5#00059A3C7800000200000001000013B00004186874254995#1152736811314#com.sap.engine.core.cluster.impl6.ms.MSRawConnection##com.sap.engine.core.cluster.impl6.ms.MSRawConnection.receiveRawMessage()#######SAP J2EE Engine|MS Socket Listener##0#0#Error##Plain###java.net.SocketException: Connection reset
         at java.net.SocketInputStream.read(SocketInputStream.java:168)
         at java.io.BufferedInputStream.fill(BufferedInputStream.java:183)
         at java.io.BufferedInputStream.read1(BufferedInputStream.java:222)
         at java.io.BufferedInputStream.read(BufferedInputStream.java:277)
         at com.sap.engine.core.cluster.impl6.ms.MSMessageHeader.read(MSMessageHeader.java:440)
         at com.sap.engine.core.cluster.impl6.ms.MSMessageObjectImpl.readHeader(MSMessageObjectImpl.java:142)
         at com.sap.engine.core.cluster.impl6.ms.MSRawConnection.receiveRawMessage(MSRawConnection.java:1660)
         at com.sap.engine.core.cluster.impl6.ms.MSListener.run(MSListener.java:86)
         at com.sap.engine.frame.core.thread.Task.run(Task.java:64)
         at com.sap.engine.core.thread.impl5.SingleThread.execute(SingleThread.java:79)
         at com.sap.engine.core.thread.impl5.SingleThread.run(SingleThread.java:150)
    #1.5#00059A3C7800000000000016000013B00004186874A24D7C#1152736819501#com.sap.sql.jdbc.direct.DirectPreparedStatement##com.sap.sql.jdbc.direct.DirectPreparedStatement#######Thread[Thread-1,5,main]##0#0#Error#1#/System/Database/sql/jdbc/direct#Java#com.sap.sql_0003##SQL error occurred on connection W2VZ9YDX01.amer.corp.eds.com:J2E:SAPJ2EDB: code=-708, state="08000", message="[-708] Could not send data.";
    SQL statement is "SELECT "CPATH","CID","PARENTCID","CACHEMODE","CTYPE" FROM "J2EE_CONFIG" WHERE "PATHHASH" = ?".
    [EXCEPTION]
    #6#-708#08000#[-708] Could not send data.#W2VZ9YDX01.amer.corp.eds.com:J2E:SAPJ2EDB#SELECT "CPATH","CID","PARENTCID","CACHEMODE","CTYPE" FROM "J2EE_CONFIG" WHERE "PATHHASH" = ?#com.sap.dbtech.jdbc.exceptions.ConnectionException: [-708] Could not send data.
         at com.sap.dbtech.jdbc.ConnectionSapDB.execute(ConnectionSapDB.java:553)
         at com.sap.dbtech.jdbc.ConnectionSapDB.execute(ConnectionSapDB.java:433)
         at com.sap.dbtech.jdbc.CallableStatementSapDB.execute(CallableStatementSapDB.java:432)
         at com.sap.dbtech.jdbc.CallableStatementSapDB.execute(CallableStatementSapDB.java:303)
         at com.sap.dbtech.jdbc.CallableStatementSapDB.executeQuery(CallableStatementSapDB.java:728)
         at com.sap.sql.jdbc.direct.DirectPreparedStatement.executeQuery(DirectPreparedStatement.java:281)
         at com.sap.sql.jdbc.direct.DirectPreparedStatement.executeQuery(DirectPreparedStatement.java:248)
         at com.sap.engine.core.configuration.impl.persistence.rdbms.DBAccessDefault.getConfiguration(DBAccessDefault.java:578)
         at com.sap.engine.core.configuration.impl.persistence.rdbms.PersistenceHandler.readConfig(PersistenceHandler.java:102)
         at com.sap.engine.core.configuration.impl.cache.CachedConfiguration.<init>(CachedConfiguration.java:62)
         at com.sap.engine.core.configuration.impl.cache.ConfigurationCache.getCachedConfiguration(ConfigurationCache.java:848)
         at com.sap.engine.core.configuration.impl.cache.ConfigurationCache.getCachedConfiguration(ConfigurationCache.java:882)
         at com.sap.engine.core.configuration.impl.cache.ConfigurationCache.openConfiguration(ConfigurationCache.java:757)
         at com.sap.engine.core.configuration.impl.ConfigurationHandlerImpl.openConfiguration(ConfigurationHandlerImpl.java:734)
         at com.sap.engine.core.configuration.impl.ConfigurationHandlerImpl.openConfiguration(ConfigurationHandlerImpl.java:693)
         at com.sap.engine.core.cache.impl.spi.storage.DBStorage.<init>(DBStorage.java:64)
         at com.sap.engine.core.cache.impl.CacheManagerImpl.init(CacheManagerImpl.java:223)
         at com.sap.engine.core.Framework.loadSingleManager(Framework.java:556)
         at com.sap.engine.core.Framework.loadManagers(Framework.java:251)
         at com.sap.engine.core.Framework.start(Framework.java:185)
         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
         at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
         at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
         at java.lang.reflect.Method.invoke(Method.java:324)
         at com.sap.engine.boot.FrameThread.run(FrameThread.java:61)
         at java.lang.Thread.run(Thread.java:534)
    #1.5#00059A3C7800000000000018000013B00004186874A25141#1152736819501#com.sap.engine.core.configuration##com.sap.engine.core.configuration#######Thread[Thread-1,5,main]##0#0#Fatal#1#/System/Server#Plain###Error event: com.sap.dbtech.jdbc.exceptions.ConnectionException: [-708] Could not send data.#
    #1.5#00059A3C780000000000001A000013B00004186874A26FA9#1152736819517#com.sap.engine.core.configuration##com.sap.engine.core.configuration#######Thread[Thread-1,5,main]##0#0#Error#1#/System/Server#Plain###connectionErrorOccurred event in DBConnection.
    =======================================================
    com.sap.engine.frame.core.configuration.ConfigurationException: connectionErrorOccurred event in DBConnection.
         at com.sap.engine.core.configuration.impl.persistence.rdbms.DBConnection.connectionErrorOccurred(DBConnection.java:105)
         at com.sap.sql.jdbc.direct.DirectPooledConnection.connectionErrorOccurred(DirectPooledConnection.java:557)
         at com.sap.sql.jdbc.direct.DirectConnection.analyzeSQLException(DirectConnection.java:1115)
         at com.sap.sql.jdbc.direct.DirectPreparedStatement.processSQLException(DirectPreparedStatement.java:1192)
         at com.sap.sql.jdbc.direct.DirectPreparedStatement.executeQuery(DirectPreparedStatement.java:285)
         at com.sap.sql.jdbc.direct.DirectPreparedStatement.executeQuery(DirectPreparedStatement.java:248)
         at com.sap.engine.core.configuration.impl.persistence.rdbms.DBAccessDefault.getConfiguration(DBAccessDefault.java:578)
         at com.sap.engine.core.configuration.impl.persistence.rdbms.PersistenceHandler.readConfig(PersistenceHandler.java:102)
         at com.sap.engine.core.configuration.impl.cache.CachedConfiguration.<init>(CachedConfiguration.java:62)
         at com.sap.engine.core.configuration.impl.cache.ConfigurationCache.getCachedConfiguration(ConfigurationCache.java:848)
         at com.sap.engine.core.configuration.impl.cache.ConfigurationCache.getCachedConfiguration(ConfigurationCache.java:882)
         at com.sap.engine.core.configuration.impl.cache.ConfigurationCache.openConfiguration(ConfigurationCache.java:757)
         at com.sap.engine.core.configuration.impl.ConfigurationHandlerImpl.openConfiguration(ConfigurationHandlerImpl.java:734)
         at com.sap.engine.core.configuration.impl.ConfigurationHandlerImpl.openConfiguration(ConfigurationHandlerImpl.java:693)
         at com.sap.engine.core.cache.impl.spi.storage.DBStorage.<init>(DBStorage.java:64)
         at com.sap.engine.core.cache.impl.CacheManagerImpl.init(CacheManagerImpl.java:223)
         at com.sap.engine.core.Framework.loadSingleManager(Framework.java:556)
         at com.sap.engine.core.Framework.loadManagers(Framework.java:251)
         at com.sap.engine.core.Framework.start(Framework.java:185)
         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
         at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
         at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
         at java.lang.reflect.Method.invoke(Method.java:324)
         at com.sap.engine.boot.FrameThread.run(FrameThread.java:61)
         at java.lang.Thread.run(Thread.java:534)
    Caused by: com.sap.dbtech.jdbc.exceptions.ConnectionException: [-708] Could not send data.
         at com.sap.dbtech.jdbc.ConnectionSapDB.execute(ConnectionSapDB.java:553)
         at com.sap.dbtech.jdbc.ConnectionSapDB.execute(ConnectionSapDB.java:433)
         at com.sap.dbtech.jdbc.CallableStatementSapDB.execute(CallableStatementSapDB.java:432)
         at com.sap.dbtech.jdbc.CallableStatementSapDB.execute(CallableStatementSapDB.java:303)
         at com.sap.dbtech.jdbc.CallableStatementSapDB.executeQuery(CallableStatementSapDB.java:728)
         at com.sap.sql.jdbc.direct.DirectPreparedStatement.executeQuery(DirectPreparedStatement.java:281)
         ... 20 more
    #1.5#00059A3C780000000000001C000013B00004186874A431C1#1152736819626#com.sap.sql.jdbc.direct.DirectConnection##com.sap.sql.jdbc.direct.DirectConnection#######Thread[Thread-1,5,main]##0#0#Error#1#/System/Database/sql/jdbc/direct#Java#com.sap.sql_0003##SQL error occurred on connection W2VZ9YDX01.amer.corp.eds.com:J2E:SAPJ2EDB: code=-708, state="08000", message="[-708] Could not send data.";
    SQL statement is "ROLLBACK".
    [EXCEPTION]
    #6#-708#08000#[-708] Could not send data.#W2VZ9YDX01.amer.corp.eds.com:J2E:SAPJ2EDB#ROLLBACK#com.sap.dbtech.jdbc.exceptions.ConnectionException: [-708] Could not send data.
         at com.sap.dbtech.jdbc.ConnectionSapDB.execute(ConnectionSapDB.java:553)
         at com.sap.dbtech.jdbc.ConnectionSapDB.execute(ConnectionSapDB.java:433)
         at com.sap.dbtech.jdbc.ConnectionSapDB.executeSQLString(ConnectionSapDB.java:588)
         at com.sap.dbtech.jdbc.ConnectionSapDB.rollback(ConnectionSapDB.java:828)
         at com.sap.sql.jdbc.direct.DirectConnection.rollback(DirectConnection.java:525)
         at com.sap.engine.core.configuration.impl.persistence.rdbms.DBAccessDefault.rollback(DBAccessDefault.java:1276)
         at com.sap.engine.core.configuration.impl.persistence.rdbms.DBConnection.close(DBConnection.java:78)
         at com.sap.engine.core.configuration.impl.persistence.rdbms.DBConnection.connectionErrorOccurred(DBConnection.java:108)
         at com.sap.sql.jdbc.direct.DirectPooledConnection.connectionErrorOccurred(DirectPooledConnection.java:557)
         at com.sap.sql.jdbc.direct.DirectConnection.analyzeSQLException(DirectConnection.java:1115)
         at com.sap.sql.jdbc.direct.DirectPreparedStatement.processSQLException(DirectPreparedStatement.java:1192)
         at com.sap.sql.jdbc.direct.DirectPreparedStatement.executeQuery(DirectPreparedStatement.java:285)
         at com.sap.sql.jdbc.direct.DirectPreparedStatement.executeQuery(DirectPreparedStatement.java:248)
         at com.sap.engine.core.configuration.impl.persistence.rdbms.DBAccessDefault.getConfiguration(DBAccessDefault.java:578)
         at com.sap.engine.core.configuration.impl.persistence.rdbms.PersistenceHandler.readConfig(PersistenceHandler.java:102)
         at com.sap.engine.core.configuration.impl.cache.CachedConfiguration.<init>(CachedConfiguration.java:62)
         at com.sap.engine.core.configuration.impl.cache.ConfigurationCache.getCachedConfiguration(ConfigurationCache.java:848)
         at com.sap.engine.core.configuration.impl.cache.ConfigurationCache.getCachedConfiguration(ConfigurationCache.java:882)
         at com.sap.engine.core.configuration.impl.cache.ConfigurationCache.openConfiguration(ConfigurationCache.java:757)
         at com.sap.engine.core.configuration.impl.ConfigurationHandlerImpl.openConfiguration(ConfigurationHandlerImpl.java:734)
         at com.sap.engine.core.configuration.impl.ConfigurationHandlerImpl.openConfiguration(ConfigurationHandlerImpl.java:693)
         at com.sap.engine.core.cache.impl.spi.storage.DBStorage.<init>(DBStorage.java:64)
         at com.sap.engine.core.cache.impl.CacheManagerImpl.init(CacheManagerImpl.java:223)
         at com.sap.engine.core.Framework.loadSingleManager(Framework.java:556)
         at com.sap.engine.core.Framework.loadManagers(Framework.java:251)
         at com.sap.engine.core.Framework.start(Framework.java:185)
         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
         at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
         at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
         at java.lang.reflect.Method.invoke(Method.java:324)
         at com.sap.engine.boot.FrameThread.run(FrameThread.java:61)
         at java.lang.Thread.run(Thread.java:534)
    #1.5#00059A3C780000000000001E000013B00004186874A4498F#1152736819626#com.sap.sql.jdbc.direct.DirectConnection##com.sap.sql.jdbc.direct.DirectConnection#######Thread[Thread-1,5,main]##0#0#Error#1#/System/Database/sql/jdbc/direct#Java#com.sap.sql_0003##SQL error occurred on connection W2VZ9YDX01.amer.corp.eds.com:J2E:SAPJ2EDB: code=-708, state="08000", message="[-708] Could not send data.";
    SQL statement is "ROLLBACK".
    [EXCEPTION]
    #6#-708#08000#[-708] Could not send data.#W2VZ9YDX01.amer.corp.eds.com:J2E:SAPJ2EDB#ROLLBACK#com.sap.dbtech.jdbc.exceptions.ConnectionException: [-708] Could not send data.
         at com.sap.dbtech.jdbc.ConnectionSapDB.execute(ConnectionSapDB.java:553)
         at com.sap.dbtech.jdbc.ConnectionSapDB.execute(ConnectionSapDB.java:433)
         at com.sap.dbtech.jdbc.ConnectionSapDB.executeSQLString(ConnectionSapDB.java:588)
         at com.sap.dbtech.jdbc.ConnectionSapDB.rollback(ConnectionSapDB.java:828)
         at com.sap.sql.jdbc.direct.DirectConnection.rollback(DirectConnection.java:525)
         at com.sap.sql.jdbc.direct.DirectConnection.close(DirectConnection.java:574)
         at com.sap.sql.jdbc.direct.DirectPooledConnection.close(DirectPooledConnection.java:190)
         at com.sap.engine.core.configuration.impl.persistence.rdbms.DBConnection.close(DBConnection.java:84)
         at com.sap.engine.core.configuration.impl.persistence.rdbms.DBConnection.connectionErrorOccurred(DBConnection.java:108)
         at com.sap.sql.jdbc.direct.DirectPooledConnection.connectionErrorOccurred(DirectPooledConnection.java:557)
         at com.sap.sql.jdbc.direct.DirectConnection.analyzeSQLException(DirectConnection.java:1115)
         at com.sap.sql.jdbc.direct.DirectPreparedStatement.processSQLException(DirectPreparedStatement.java:1192)
         at com.sap.sql.jdbc.direct.DirectPreparedStatement.executeQuery(DirectPreparedStatement.java:285)
         at com.sap.sql.jdbc.direct.DirectPreparedStatement.executeQuery(DirectPreparedStatement.java:248)
         at com.sap.engine.core.configuration.impl.persistence.rdbms.DBAccessDefault.getConfiguration(DBAccessDefault.java:578)
         at com.sap.engine.core.configuration.impl.persistence.rdbms.PersistenceHandler.readConfig(PersistenceHandler.java:102)
         at com.sap.engine.core.configuration.impl.cache.CachedConfiguration.<init>(CachedConfiguration.java:62)
         at com.sap.engine.core.configuration.impl.cache.ConfigurationCache.getCachedConfiguration(ConfigurationCache.java:848)
         at com.sap.engine.core.configuration.impl.cache.ConfigurationCache.getCachedConfiguration(ConfigurationCache.java:882)
         at com.sap.engine.core.configuration.impl.cache.ConfigurationCache.openConfiguration(ConfigurationCache.java:757)
         at com.sap.engine.core.configuration.impl.ConfigurationHandlerImpl.openConfiguration(ConfigurationHandlerImpl.java:734)
         at com.sap.engine.core.configuration.impl.ConfigurationHandlerImpl.openConfiguration(ConfigurationHandlerImpl.java:693)
         at com.sap.engine.core.cache.impl.spi.storage.DBStorage.<init>(DBStorage.java:64)
         at com.sap.engine.core.cache.impl.CacheManagerImpl.init(CacheManagerImpl.java:223)
         at com.sap.engine.core.Framework.loadSingleManager(Framework.java:556)
         at com.sap.engine.core.Framework.loadManagers(Framework.java:251)
         at com.sap.engine.core.Framework.start(Framework.java:185)
         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
         at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
         at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
         at java.lang.reflect.Method.invoke(Method.java:324)
         at com.sap.engine.boot.FrameThread.run(FrameThread.java:61)
         at java.lang.Thread.run(Thread.java:534)
    #1.5#00059A3C7800000000000020000013B00004186874A7B7A1#1152736819860#com.sap.engine.core.configuration##com.sap.engine.core.configuration#######Thread[Thread-1,5,main]##0#0#Error#1#/System/Server#Plain###[-708] Could not send data.
    =======================================================
    com.sap.engine.frame.core.configuration.ConfigurationException: [-708] Could not send data.
         at com.sap.engine.core.configuration.impl.persistence.rdbms.DBConnection.close(DBConnection.java:81)
         at com.sap.engine.core.configuration.impl.persistence.rdbms.DBConnection.connectionErrorOccurred(DBConnection.java:108)
         at com.sap.sql.jdbc.direct.DirectPooledConnection.connectionErrorOccurred(DirectPooledConnection.java:557)
         at com.sap.sql.jdbc.direct.DirectConnection.analyzeSQLException(DirectConnection.java:1115)
         at com.sap.sql.jdbc.direct.DirectPreparedStatement.processSQLException(DirectPreparedStatement.java:1192)
         at com.sap.sql.jdbc.direct.DirectPreparedStatement.executeQuery(DirectPreparedStatement.java:285)
         at com.sap.sql.jdbc.direct.DirectPreparedStatement.executeQuery(DirectPreparedStatement.java:248)
         at com.sap.engine.core.configuration.impl.persistence.rdbms.DBAccessDefault.getConfiguration(DBAccessDefault.java:578)
         at com.sap.engine.core.configuration.impl.persistence.rdbms.PersistenceHandler.readConfig(PersistenceHandler.java:102)
         at com.sap.engine.core.configuration.impl.cache.CachedConfiguration.<init>(CachedConfiguration.java:62)
         at com.sap.engine.core.configuration.impl.cache.ConfigurationCache.getCachedConfiguration(ConfigurationCache.java:848)
         at com.sap.engine.core.configuration.impl.cache.ConfigurationCache.getCachedConfiguration(ConfigurationCache.java:882)
         at com.sap.engine.core.configuration.impl.cache.ConfigurationCache.openConfiguration(ConfigurationCache.java:757)
         at com.sap.engine.core.configuration.impl.ConfigurationHandlerImpl.openConfiguration(ConfigurationHandlerImpl.java:734)
         at com.sap.engine.core.configuration.impl.ConfigurationHandlerImpl.openConfiguration(ConfigurationHandlerImpl.java:693)
         at com.sap.engine.core.cache.impl.spi.storage.DBStorage.<init>(DBStorage.java:64)
         at com.sap.engine.core.cache.impl.CacheManagerImpl.init(CacheManagerImpl.java:223)
         at com.sap.engine.core.Framework.loadSingleManager(Framework.java:556)
         at com.sap.engine.core.Framework.loadManagers(Framework.java:251)
         at com.sap.engine.core.Framework.start(Framework.java:185)
         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
         at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
         at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
         at java.lang.reflect.Method.invoke(Method.java:324)
         at com.sap.engine.boot.FrameThread.run(FrameThread.java:61)
         at java.lang.Thread.run(Thread.java:534)
    Caused by: com.sap.dbtech.jdbc.exceptions.ConnectionException: [-708] Could not send data.
         at com.sap.dbtech.jdbc.ConnectionSapDB.execute(ConnectionSapDB.java:553)
         at com.sap.dbtech.jdbc.ConnectionSapDB.execute(ConnectionSapDB.java:433)
         at com.sap.dbtech.jdbc.ConnectionSapDB.executeSQLString(ConnectionSapDB.java:588)
         at com.sap.dbtech.jdbc.ConnectionSapDB.rollback(ConnectionSapDB.java:828)
         at com.sap.sql.jdbc.direct.DirectConnection.rollback(DirectConnection.java:525)
         at com.sap.engine.core.configuration.impl.persistence.rdbms.DBAccessDefault.rollback(DBAccessDefault.java:1276)
         at com.sap.engine.core.configuration.impl.persistence.rdbms.DBConnection.close(DBConnection.java:78)
         ... 25 more
    #1.5#00059A3C7800000000000022000013B00004186874A7BA35#1152736819860#com.sap.engine.core.configuration##com.sap.engine.core.configuration#######Thread[Thread-1,5,main]##0#0#Error#1#/System/Server#Plain###[-708] Could not send data.
    =======================================================
    com.sap.dbtech.jdbc.exceptions.ConnectionException: [-708] Could not send data.
         at com.sap.dbtech.jdbc.ConnectionSapDB.execute(ConnectionSapDB.java:553)
         at com.sap.dbtech.jdbc.ConnectionSapDB.execute(ConnectionSapDB.java:433)
         at com.sap.dbtech.jdbc.CallableStatementSapDB.execute(CallableStatementSapDB.java:432)
         at com.sap.dbtech.jdbc.CallableStatementSapDB.execute(CallableStatementSapDB.java:303)
         at com.sap.dbtech.jdbc.CallableStatementSapDB.executeQuery(CallableStatementSapDB.java:728)
         at com.sap.sql.jdbc.direct.DirectPreparedStatement.executeQuery(DirectPreparedStatement.java:281)
         at com.sap.sql.jdbc.direct.DirectPreparedStatement.executeQuery(DirectPreparedStatement.java:248)
         at com.sap.engine.core.configuration.impl.persistence.rdbms.DBAccessDefault.getConfiguration(DBAccessDefault.java:578)
         at com.sap.engine.core.configuration.impl.persistence.rdbms.PersistenceHandler.readConfig(PersistenceHandler.java:102)
         at com.sap.engine.core.configuration.impl.cache.CachedConfiguration.<init>(CachedConfiguration.java:62)
         at com.sap.engine.core.configuration.impl.cache.ConfigurationCache.getCachedConfiguration(ConfigurationCache.java:848)
         at com.sap.engine.core.configuration.impl.cache.ConfigurationCache.getCachedConfiguration(ConfigurationCache.java:882)
         at com.sap.engine.core.configuration.impl.cache.ConfigurationCache.openConfiguration(ConfigurationCache.java:757)
         at com.sap.engine.core.configuration.impl.ConfigurationHandlerImpl.openConfiguration(ConfigurationHandlerImpl.java:734)
         at com.sap.engine.core.configuration.impl.ConfigurationHandlerImpl.openConfiguration(ConfigurationHandlerImpl.java:693)
         at com.sap.engine.core.cache.impl.spi.storage.DBStorage.<init>(DBStorage.java:64)
         at com.sap.engine.core.cache.impl.CacheManagerImpl.init(CacheManagerImpl.java:223)
         at com.sap.engine.core.Framework.loadSingleManager(Framework.java:556)
         at com.sap.engine.core.Framework.loadManagers(Framework.java:251)
         at com.sap.engine.core.Framework.start(Framework.java:185)
         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
         at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
         at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
         at java.lang.reflect.Method.invoke(Method.java:324)
         at com.sap.engine.boot.FrameThread.run(FrameThread.java:61)
         at java.lang.Thread.run(Thread.java:534)
    #1.5#00059A3C7800000000000023000013B00004186874A7C130#1152736819860#System.err##System.err#######Thread[Thread-1,5,main]##0#0#Error##Plain###com.sap.engine.frame.core.configuration.ConfigurationException: Error occurred during DB access: cache_dbSpooling,
         at com.sap.engine.core.configuration.impl.persistence.rdbms.PersistenceHandler.readConfig(PersistenceHandler.java:108)
         at com.sap.engine.core.configuration.impl.cache.CachedConfiguration.<init>(CachedConfiguration.java:62)
         at com.sap.engine.core.configuration.impl.cache.ConfigurationCache.getCachedConfiguration(ConfigurationCache.java:848)
         at com.sap.engine.core.configuration.impl.cache.ConfigurationCache.getCachedConfiguration(ConfigurationCache.java:882)
         at com.sap.engine.core.configuration.impl.cache.ConfigurationCache.openConfiguration(ConfigurationCache.java:757)
         at com.sap.engine.core.configuration.impl.ConfigurationHandlerImpl.openConfiguration(ConfigurationHandlerImpl.java:734)
         at com.sap.engine.core.configuration.impl.ConfigurationHandlerImpl.openConfiguration(ConfigurationHandlerImpl.java:693)
         at com.sap.engine.core.cache.impl.spi.storage.DBStorage.<init>(DBStorage.java:64)
         at com.sap.engine.core.cache.impl.CacheManagerImpl.init(CacheManagerImpl.java:223)
         at com.sap.engine.core.Framework.loadSingleManager(Framework.java:556)
         at com.sap.engine.core.Framework.loadManagers(Framework.java:251)
         at com.sap.engine.core.Framework.start(Framework.java:185)
         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
         at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
         at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
         at java.lang.reflect.Method.invoke(Method.java:324)
         at com.sap.engine.boot.FrameThread.run(FrameThread.java:61)
         at java.lang.Thread.run(Thread.java:534)
    Caused by: com.sap.dbtech.jdbc.exceptions.ConnectionException: [-708] Could not send data.
         at com.sap.dbtech.jdbc.ConnectionSapDB.execute(ConnectionSapDB.java:553)
         at com.sap.dbtech.jdbc.ConnectionSapDB.execute(ConnectionSapDB.java:433)
         at com.sap.dbtech.jdbc.CallableStatementSapDB.execute(CallableStatementSapDB.java:432)
         at com.sap.dbtech.jdbc.CallableStatementSapDB.execute(CallableStatementSapDB.java:303)
         at com.sap.dbtech.jdbc.CallableStatementSapDB.executeQuery(CallableStatementSapDB.java:728)
         at com.sap.sql.jdbc.direct.DirectPreparedStatement.executeQuery(DirectPreparedStatement.java:281)
         at com.sap.sql.jdbc.direct.DirectPreparedStatement.executeQuery(DirectPreparedStatement.java:248)
         at com.sap.engine.core.configuration.impl.persistence.rdbms.DBAccessDefault.getConfiguration(DBAccessDefault.java:578)
         at com.sap.engine.core.configuration.impl.persistence.rdbms.PersistenceHandler.readConfig(PersistenceHandler.java:102)

    Thanks for everyone helps.
    I took your adviced and reinstalled the Portal but the problem still exist.
    Default.trc
    stdout/stderr redirect
    node name   : server0
    pid         : 5488
    system name : J2E
    system nr.  : 01
    started at  : Mon Jul 17 13:24:01 2006
    Reserved 1610612736 (0x60000000) bytes before loading DLLs.
    [Thr 4428] MtxInit: -2 0 0
    CompilerOracle: exclude com/sapportals/portal/pb/layout/taglib/ContainerTag addIviewResources
    CompilerOracle: exclude com/sap/engine/services/keystore/impl/security/CodeBasedSecurityConnector getApplicationDomain
    CompilerOracle: exclude com/sap/engine/services/rmi_p4/P4StubSkeletonGenerator generateStub
    CompilerOracle: exclude com/sapportals/portal/prt/util/StringUtils escapeToJS
    CompilerOracle: exclude com/sapportals/portal/prt/core/broker/PortalServiceItem startServices
    CompilerOracle: exclude com/sap/engine/services/webservices/server/deploy/WSConfigurationHandler downloadFile
    CompilerOracle: exclude com/sapportals/portal/prt/jndisupport/util/AbstractHierarchicalContext lookup
    CompilerOracle: exclude com/sapportals/portal/navigation/cache/CacheNavigationNode getAttributeValue
    CompilerOracle: exclude com/sapportals/portal/navigation/TopLevelNavigationiView PrintNode
    CompilerOracle: exclude com/sapportals/wcm/service/ice/wcm/ICEPropertiesCoder encode
    SAP J2EE Engine Version 7.00   PatchLevel is starting...
    Loading: LogManager ... 891 ms.
    Loading: PoolManager ... 0 ms.
    Loading: ApplicationThreadManager ... 282 ms.
    Loading: ThreadManager ... 93 ms.
    Loading: IpVerificationManager ... 63 ms.
    Loading: ClassLoaderManager ... 16 ms.
    Loading: ClusterManager ... 812 ms.
    Loading: LockingManager ... 750 ms.
    Loading: ConfigurationManager ... 9703 ms.
    Loading: LicensingManager ... 437 ms.
    Loading: CacheManager ... 625 ms.
    Loading: ServiceManager ...
    0.000: [GC 0.000: [DefNew: 87039K->4666K(130560K), 0.0573031 secs] 87039K->4666K(1000960K), 0.0574006 secs]
    Loading services.:
      Service memory started. (16 ms).
      Service timeout started. (16 ms).
      Service runtimeinfo started. (16 ms).
      Service cross started. (110 ms).
      Service file started. (328 ms).
      Service cafeucc~api started. (250 ms).
      Service p4 started. (500 ms).
      Service userstore started. (32 ms).
      Service jmx_notification started. (234 ms).
      Service classpath_resolver started. (625 ms).
    10.342: [GC 10.342: [DefNew: 91696K->10177K(130560K), 0.0837931 secs] 91696K->10177K(1000960K), 0.0838886 secs]
      Service log_configurator started. (11406 ms).
      Service locking started. (31 ms).
      Service naming started. (1344 ms).
      Service http started. (2234 ms).
      Service appclient started. (672 ms).
      Service failover started. (1063 ms).
      Service jmsconnector started. (1656 ms).
      Service connector started. (1813 ms).
      Service ts started. (2703 ms).
      Service licensing started. (141 ms).
      Service cafeugpmailcf started. (2719 ms).
      Service iiop started. (2984 ms).
      Service webservices started. (6141 ms).
    24.892: [GC 24.893: [DefNew: 97206K->15080K(130560K), 0.0903939 secs] 97206K->15080K(1000960K), 0.0904892 secs]
    30.016: [GC 30.017: [DefNew: 102120K->15319K(130560K), 0.0974602 secs] 102120K->15319K(1000960K), 0.0975568 secs]
      Service deploy started. (26515 ms).
      Service MigrationService started. (609 ms).
      Service bimmrdeployer started. (282 ms).
      Service configuration started. (1500 ms).
      Service dbpool started. (5297 ms).
      Service com.sap.security.core.ume.service started. (3469 ms).
    41.333: [GC 41.333: [DefNew: 102359K->19381K(130560K), 0.0968377 secs] 102359K->19381K(1000960K), 0.0969363 secs]
      Service security started. (2047 ms).
      Service classload started. (546 ms).
      Service cafeuodi~mnuacc started. (40016 ms).
      Service applocking started. (1406 ms).
      Service shell started. (1735 ms).
      Service tceCATTPingservice started. (593 ms).
      Service telnet started. (640 ms).
      Service ejb started. (4094 ms).
      Service webdynpro started. (1734 ms).
      Service servlet_jsp started. (5547 ms).
      Service cafummetadata~imp started. (484 ms).
      Service cafruntimeconnectivity~impl started. (45079 ms).
      Service developmentserver started. (4328 ms).
      Service keystore started. (3437 ms).
      Service ssl started. (156 ms).
      Service tcsecsecurestorage~service started. (594 ms).
      Service tcsecwssec~service started. (1016 ms).
      Service cafeugp~model started. (109 ms).
      Service tceujwfuiwizsvc started. (62 ms).
      Service tcsecdestinations~service started. (3453 ms).
      Service jmx started. (5938 ms).
      Service cafeuer~service started. (5656 ms).
      Service pmi started. (2297 ms).
      Service cafumrelgroups~imp started. (13563 ms).
      Service sld started. (19891 ms).
    72.521: [GC 72.521: [DefNew: 106421K->19563K(130560K), 0.1219901 secs] 106421K->19563K(1000960K), 0.1220862 secs]
      Service rfcengine started. (17047 ms).
      Service CUL started. (17563 ms).
      Service prtbridge started. (22157 ms).
      Service com.adobe~DataManagerService started. (19312 ms).
      Service basicadmin started. (19359 ms).
      Service com.adobe~LicenseService started. (672 ms).
      Service com.adobe~DocumentServicesConfiguration started. (11281 ms).
      Service adminadapter started. (15907 ms).
      Service com.adobe~DocumentServicesBinaries2 started. (15875 ms).
      Service com.adobe~DocumentServicesDestProtoService started. (15750 ms).
      Service tc.CBS.Service started. (46516 ms).
      Service com.sap.portal.pcd.gl started. (234 ms).
      Service com.adobe~TrustManagerService started. (1000 ms).
      Service com.adobe~DocumentServicesLicenseSupportService started. (18656 ms).
      Service jms_provider started. (51095 ms).
      service DQE ================= ERROR =================
    117.178: [GC 117.178: [DefNew: 106594K->23612K(130560K), 0.1458822 secs] 106594K->23612K(1000960K), 0.1459800 secs]
      Service com.adobe~FontManagerService started. (40641 ms).
      Service com.adobe~PDFManipulation started. (41500 ms).
      Service com.adobe~XMLFormService started. (10359 ms).
    ================================================================================
    getThreadDump : Mon Jul 17 13:29:34 2006
    Timed out services:
    Service com.sap.portal.prt.sapj2ee > hard reference to interface tcmonitoringapi.
    ================================================================================
    Full thread dump Java HotSpot(TM) Server VM (1.4.2_09-b05 mixed mode):
    "SAPEngine_Application_Thread[impl:3]_7" prio=5 tid=0x0b4a6ba0 nid=0xd3c in Object.wait() [9c3f000..9c3fd90]
         at java.lang.Object.wait(Native Method)
         - waiting on <0x11342770> (a com.sap.caf.eu.gp.model.fnd.impl.ServiceOperationProcessor)
         at java.lang.Object.wait(Object.java:429)
         at com.sap.caf.eu.gp.model.fnd.impl.ServiceOperationProcessor.run(ServiceOperationProcessor.java:70)
         - locked <0x11342770> (a com.sap.caf.eu.gp.model.fnd.impl.ServiceOperationProcessor)
         at com.sap.engine.core.thread.impl3.ActionObject.run(ActionObject.java:37)
         at java.security.AccessController.doPrivileged(Native Method)
         at com.sap.engine.core.thread.impl3.SingleThread.execute(SingleThread.java:100)
         at com.sap.engine.core.thread.impl3.SingleThread.run(SingleThread.java:124)
    "SAPEngine_Application_Thread[impl:3]_6" prio=5 tid=0x0b4b34f0 nid=0x1478 waiting on condition [9bff000..9bffd90]
         at java.lang.Thread.sleep(Native Method)
         at com.sap.caf.eu.gp.schedule.impl.ScheduleWorker.work(ScheduleWorker.java:87)
         at com.sap.caf.eu.gp.schedule.impl.ScheduleWorker.run(ScheduleWorker.java:59)
         at com.sap.engine.core.thread.impl3.ActionObject.run(ActionObject.java:37)
         at java.security.AccessController.doPrivileged(Native Method)
         at com.sap.engine.core.thread.impl3.SingleThread.execute(SingleThread.java:100)
         at com.sap.engine.core.thread.impl3.SingleThread.run(SingleThread.java:124)
    "SAPEngine_Application_Thread[impl:3]_5" prio=5 tid=0x0b4b3cf0 nid=0x137c waiting on condition [9bbf000..9bbfd90]
         at java.lang.Thread.sleep(Native Method)
         at com.sap.caf.eu.gp.schedule.impl.ScheduleWorker.work(ScheduleWorker.java:87)
         at com.sap.caf.eu.gp.schedule.impl.ScheduleWorker.run(ScheduleWorker.java:59)
         at com.sap.engine.core.thread.impl3.ActionObject.run(ActionObject.java:37)
         at java.security.AccessController.doPrivileged(Native Method)
         at com.sap.engine.core.thread.impl3.SingleThread.execute(SingleThread.java:100)
         at com.sap.engine.core.thread.impl3.SingleThread.run(SingleThread.java:124)
    "Thread-25" prio=5 tid=0x00f2f320 nid=0x3a0 waiting on condition [9b7f000..9b7fd90]
         at java.lang.Thread.sleep(Native Method)
         at com.sap.caf.eu.gp.model.context.impl.UserConfigCache$ValidationThread.run(UserConfigCache.java:148)
    "Thread-24" prio=5 tid=0x0b4327e0 nid=0x1190 waiting on condition [9b3f000..9b3fd90]
         at java.lang.Thread.sleep(Native Method)
         at com.sap.caf.eu.gp.model.fnd.cache.impl.ServerCacheManagerImpl$ValidationThread.run(ServerCacheManagerImpl.java:159)
    "CBS Request Orc" prio=10 tid=0x0b47fe90 nid=0x620 in Object.wait() [9aff000..9affd90]
         at java.lang.Object.wait(Native Method)
         - waiting on <0x17f900a8> (a java.lang.Thread)
         at com.sap.tc.cbs.server.rt.impl.CourteousTimer.run(CourteousTimer.java:121)
         - locked <0x17f900a8> (a java.lang.Thread)
         at java.lang.Thread.run(Thread.java:534)
    "CBS TCS-queue Reader" prio=10 tid=0x0b47fc00 nid=0xab4 waiting on condition [9abf000..9abfd90]
         at java.lang.Thread.sleep(Native Method)
         at com.sap.tc.cbs.server.rt.impl.TCSQueueOrc.run(TCSQueueOrc.java:104)
         at java.lang.Thread.run(Thread.java:534)
    "CBS AccessQueue Orchestrator" prio=10 tid=0x0b4793b0 nid=0xcf8 in Object.wait() [9a7f000..9a7fd90]
         at java.lang.Object.wait(Native Method)
         - waiting on <0x17f90138> (a java.lang.Thread)
         at com.sap.tc.cbs.server.rt.impl.AccessOrc.run(AccessOrc.java:84)
         - locked <0x17f90138> (a java.lang.Thread)
         at java.lang.Thread.run(Thread.java:534)
    "JarmCondense" daemon prio=10 tid=0x0b486040 nid=0xc30 in Object.wait() [9a3f000..9a3fd90]
         at java.lang.Object.wait(Native Method)
         - waiting on <0x17f91eb8> (a java.lang.Object)
         at com.sap.util.monitor.jarm.CondenseThread.threadShouldContinue(CondenseThread.java:217)
         - locked <0x17f91eb8> (a java.lang.Object)
         at com.sap.util.monitor.jarm.CondenseThread.run(CondenseThread.java:196)
         at java.lang.Thread.run(Thread.java:534)
    "CBS BSA Orc" prio=10 tid=0x0b476160 nid=0x17e4 in Object.wait() [99ff000..99ffd90]
         at java.lang.Object.wait(Native Method)
         - waiting on <0x17f91278> (a java.lang.Thread)
         at com.sap.tc.cbs.server.rt.impl.CourteousTimer.run(CourteousTimer.java:121)
         - locked <0x17f91278> (a java.lang.Thread)
         at java.lang.Thread.run(Thread.java:534)
    "CBS Resource Orc" prio=10 tid=0x0b471c80 nid=0x90c in Object.wait() [99bf000..99bfd90]
         at java.lang.Object.wait(Native Method)
         - waiting on <0x17f912c0> (a java.lang.Thread)
         at com.sap.tc.cbs.server.rt.impl.CourteousTimer.run(CourteousTimer.java:121)
         - locked <0x17f912c0> (a java.lang.Thread)
         at java.lang.Thread.run(Thread.java:534)
    "Thread-21" prio=5 tid=0x0b442740 nid=0x608 waiting on condition [98ef000..98efd90]
         at java.lang.Thread.sleep(Native Method)
         at com.sap.caf.eu.gp.base.caching.MemoryCache$ValidationThread.run(MemoryCache.java:152)
    "Thread-20" prio=10 tid=0x0b437d40 nid=0x159c in Object.wait() [996f000..996fd90]
         at java.lang.Object.wait(Native Method)
         - waiting on <0x17f91f20> (a com.sap.jmx.provider.ProviderConnectionTimer)
         at com.sap.jmx.provider.ProviderConnectionTimer.run(ProviderConnectionTimer.java:31)
         - locked <0x17f91f20> (a com.sap.jmx.provider.ProviderConnectionTimer)
         at java.lang.Thread.run(Thread.java:534)
    "Thread-19" prio=10 tid=0x0b435370 nid=0x1554 in Object.wait() [992f000..992fd90]
         at java.lang.Object.wait(Native Method)
         - waiting on <0x17f91f38> (a com.sap.jmx.provider.LazyMBeanLoader)
         at java.lang.Object.wait(Object.java:429)
         at com.sap.jmx.provider.LazyMBeanLoader.run(LazyMBeanLoader.java:133)
         - locked <0x17f91f38> (a com.sap.jmx.provider.LazyMBeanLoader)
         at java.lang.Thread.run(Thread.java:534)
    "Thread-18" prio=10 tid=0x0b42ce50 nid=0x1564 waiting on condition [98af000..98afd90]
         at java.lang.Thread.sleep(Native Method)
         at com.sap.caf.mp.base.caching.MemoryCache$ValidationThread.run(MemoryCache.java:144)
    "ConnectionSetCleaner Thread (UNMANAGED)." prio=10 tid=0x0a3ab070 nid=0x127c in Object.wait() [986f000..986fd90]
         at java.lang.Object.wait(Native Method)
         - waiting on <0x17f91d38> (a com.sap.engine.services.connector.jca.ConnectionHashSet$ConnectionSetCleaner)
         at com.sap.engine.services.connector.jca.ConnectionHashSet$ConnectionSetCleaner.run(ConnectionHashSet.java:682)
         - locked <0x17f91d38> (a com.sap.engine.services.connector.jca.ConnectionHashSet$ConnectionSetCleaner)
    "SAPEngine_System_Thread[impl:5]_49" prio=5 tid=0x00f742b0 nid=0xdb4 in Object.wait() [982f000..982fd90]
         at java.lang.Object.wait(Native Method)
         - waiting on <0x17f955a0> (a com.sap.engine.lib.util.WaitQueue)
         at java.lang.Object.wait(Object.java:429)
         at com.sap.engine.lib.util.WaitQueue.dequeue(WaitQueue.java:238)
         - locked <0x17f955a0> (a com.sap.engine.lib.util.WaitQueue)
         at com.sap.engine.core.thread.impl5.SingleThread.run(SingleThread.java:127)
    "SAPEngine_System_Thread[impl:5]_48" prio=5 tid=0x00f74590 nid=0x75c in Object.wait() [97ef000..97efd90]
         at java.lang.Object.wait(Native Method)
         - waiting on <0x17f955a0> (a com.sap.engine.lib.util.WaitQueue)
         at java.lang.Object.wait(Object.java:429)
         at com.sap.engine.lib.util.WaitQueue.dequeue(WaitQueue.java:238)
         - locked <0x17f955a0> (a com.sap.engine.lib.util.WaitQueue)
         at com.sap.engine.core.thread.impl5.SingleThread.run(SingleThread.java:127)
    "Timeout Service Internal Thread" prio=5 tid=0x00f706d0 nid=0xcd8 in Object.wait() [97af000..97afd90]
         at java.lang.Object.wait(Native Method)
         - waiting on <0x17f95600> (a java.lang.Object)
         at com.sap.engine.services.timeout.TimeoutManagerImpl.multiThreadRun(TimeoutManagerImpl.java:483)
         - locked <0x17f95600> (a java.lang.Object)
         at com.sap.engine.services.timeout.TimeoutManagerRunner.run(TimeoutManagerRunner.java:20)
         at com.sap.engine.frame.core.thread.Task.run(Task.java:64)
         at com.sap.engine.core.thread.impl5.SingleThread.execute(SingleThread.java:79)
         at com.sap.engine.core.thread.impl5.SingleThread.run(SingleThread.java:150)
    "SAPEngine_System_Thread[impl:5]_46" prio=5 tid=0x00f6f510 nid=0x17ec in Object.wait() [976f000..976fd90]
         at java.lang.Object.wait(Native Method)
         - waiting on <0x17f955a0> (a com.sap.engine.lib.util.WaitQueue)
         at java.lang.Object.wait(Object.java:429)
         at com.sap.engine.lib.util.WaitQueue.dequeue(WaitQueue.java:238)
         - locked <0x17f955a0> (a com.sap.engine.lib.util.WaitQueue)
         at com.sap.engine.core.thread.impl5.SingleThread.run(SingleThread.java:127)
    "SAPEngine_System_Thread[impl:5]_45" prio=5 tid=0x00f6e040 nid=0x1284 in Object.wait() [972f000..972fd90]
         at java.lang.Object.wait(Native Method)
         - waiting on <0x17f95728> (a java.lang.ref.ReferenceQueue$Lock)
         at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:111)
         - locked <0x17f95728> (a java.lang.ref.ReferenceQueue$Lock)
         at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:127)
         at com.sap.engine.lib.util.cache.CacheGroup.run(CacheGroup.java:76)
         at com.sap.engine.frame.core.thread.Task.run(Task.java:64)
         at com.sap.engine.core.thread.impl5.SingleThread.execute(SingleThread.java:79)
         at com.sap.engine.core.thread.impl5.SingleThread.run(SingleThread.java:150)
    "SAPEngine_System_Thread[impl:5]_44" prio=5 tid=0x00f6edb0 nid=0xe24 in Object.wait() [96ef000..96efd90]
         at java.lang.Object.wait(Native Method)
         - waiting on <0x17f955a0> (a com.sap.engine.lib.util.WaitQueue)
         at java.lang.Object.wait(Object.java:429)
         at com.sap.engine.lib.util.WaitQueue.dequeue(WaitQueue.java:238)
         - locked <0x17f955a0> (a com.sap.engine.lib.util.WaitQueue)
         at com.sap.engine.core.thread.impl5.SingleThread.run(SingleThread.java:127)
    "SAPEngine_System_Thread[impl:5]_43" prio=5 tid=0x00f6d960 nid=0x998 in Object.wait() [96af000..96afd90]
         at java.lang.Object.wait(Native Method)
         - waiting on <0x17f955a0> (a com.sap.engine.lib.util.WaitQueue)
         at java.lang.Object.wait(Object.java:429)
         at com.sap.engine.lib.util.WaitQueue.dequeue(WaitQueue.java:238)
         - locked <0x17f955a0> (a com.sap.engine.lib.util.WaitQueue)
         at com.sap.engine.core.thread.impl5.SingleThread.run(SingleThread.java:127)
    "SAPEngine_System_Thread[impl:5]_42" prio=5 tid=0x00f6c600 nid=0xc2c in Object.wait() [966f000..966fd90]
         at java.lang.Object.wait(Native Method)
         - waiting on <0x17f955a0> (a com.sap.engine.lib.util.WaitQueue)
         at java.lang.Object.wait(Object.java:429)
         at com.sap.engine.lib.util.WaitQueue.dequeue(WaitQueue.java:238)
         - locked <0x17f955a0> (a com.sap.engine.lib.util.WaitQueue)
         at com.sap.engine.core.thread.impl5.SingleThread.run(SingleThread.java:127)
    "SAPEngine_System_Thread[impl:5]_41" prio=5 tid=0x00f6b180 nid=0x1018 in Object.wait() [962f000..962fd90]
         at java.lang.Object.wait(Native Method)
         - waiting on <0x17f955a0> (a com.sap.engine.lib.util.WaitQueue)
         at java.lang.Object.wait(Object.java:429)
         at com.sap.engine.lib.util.WaitQueue.dequeue(WaitQueue.java:238)
         - locked <0x17f955a0> (a com.sap.engine.lib.util.WaitQueue)
         at com.sap.engine.core.thread.impl5.SingleThread.run(SingleThread.java:127)
    "SAPEngine_System_Thread[impl:5]_40" prio=5 tid=0x00f6be90 nid=0x6d8 in Object.wait() [95ef000..95efd90]
         at java.lang.Object.wait(Native Method)
         - waiting on <0x17f955a0> (a com.sap.engine.lib.util.WaitQueue)
         at java.lang.Object.wait(Object.java:429)
         at com.sap.engine.lib.util.WaitQueue.dequeue(WaitQueue.java:238)
         - locked <0x17f955a0> (a com.sap.engine.lib.util.WaitQueue)
         at com.sap.engine.core.thread.impl5.SingleThread.run(SingleThread.java:127)
    "SAPEngine_System_Thread[impl:5]_39" prio=5 tid=0x00f6a9f0 nid=0x3c4 in Object.wait() [95af000..95afd90]
         at java.lang.Object.wait(Native Method)
         - waiting on <0x17f955a0> (a com.sap.engine.lib.util.WaitQueue)
         at java.lang.Object.wait(Object.java:429)
         at com.sap.engine.lib.util.WaitQueue.dequeue(WaitQueue.java:238)
         - locked <0x17f955a0> (a com.sap.engine.lib.util.WaitQueue)
         at com.sap.engine.core.thread.impl5.SingleThread.run(SingleThread.java:127)
    "SAPEngine_System_Thread[impl:5]_38" prio=5 tid=0x00f69690 nid=0xdb8 in Object.wait() [956f000..956fd90]
         at java.lang.Object.wait(Native Method)
         - waiting on <0x17f955a0> (a com.sap.engine.lib.util.WaitQueue)
         at java.lang.Object.wait(Object.java:429)
         at com.sap.engine.lib.util.WaitQueue.dequeue(WaitQueue.java:238)
         - locked <0x17f955a0> (a com.sap.engine.lib.util.WaitQueue)
         at com.sap.engine.core.thread.impl5.SingleThread.run(SingleThread.java:127)
    "SAPEngine_System_Thread[impl:5]_37" prio=5 tid=0x00f682b0 nid=0x860 in Object.wait() [952f000..952fd90]
         at java.lang.Object.wait(Native Method)
         - waiting on <0x17f955a0> (a com.sap.engine.lib.util.WaitQueue)
         at java.lang.Object.wait(Object.java:429)
         at com.sap.engine.lib.util.WaitQueue.dequeue(WaitQueue.java:238)
         - locked <0x17f955a0> (a com.sap.engine.lib.util.WaitQueue)
         at com.sap.engine.core.thread.impl5.SingleThread.run(SingleThread.java:127)
    "Timeout Service Integrity Watcher Thread" prio=10 tid=0x00f27e90 nid=0x1500 in Object.wait() [94ef000..94efd90]
         at java.lang.Object.wait(Native Method)
         - waiting on <0x17f95870> (a com.sap.engine.services.timeout.TimeoutIntegrityWatcher)
         at com.sap.engine.services.timeout.TimeoutIntegrityWatcher.run(TimeoutIntegrityWatcher.java:69)
         - locked <0x17f95870> (a com.sap.engine.services.timeout.TimeoutIntegrityWatcher)
         at com.sap.engine.frame.core.thread.Task.run(Task.java:64)
         at com.sap.engine.core.thread.impl5.SingleThread.execute(SingleThread.java:79)
         at com.sap.engine.core.thread.impl5.SingleThread.run(SingleThread.java:150)
    "SAPEngine_System_Thread[impl:5]_35" prio=5 tid=0x00f66430 nid=0x10e8 in Object.wait() [94af000..94afd90]
         at java.lang.Object.wait(Native Method)
         - waiting on <0x17f955a0> (a com.sap.engine.lib.util.WaitQueue)
         at java.lang.Object.wait(Object.java:429)
         at com.sap.engine.lib.util.WaitQueue.dequeue(WaitQueue.java:238)
         - locked <0x17f955a0> (a com.sap.engine.lib.util.WaitQueue)
         at com.sap.engine.core.thread.impl5.SingleThread.run(SingleThread.java:127)
    "SAPEngine_System_Thread[impl:5]_34" prio=5 tid=0x00f651c0 nid=0x169c in Object.wait() [946f000..946fd90]
         at java.lang.Object.wait(Native Method)
         - waiting on <0x17f955a0> (a com.sap.engine.lib.util.WaitQueue)
         at java.lang.Object.wait(Object.java:429)
         at com.sap.engine.lib.util.WaitQueue.dequeue(WaitQueue.java:238)
         - locked <0x17f955a0> (a com.sap.engine.lib.util.WaitQueue)
         at com.sap.engine.core.thread.impl5.SingleThread.run(SingleThread.java:127)
    "SAPEngine_System_Thread[impl:5]_33" prio=5 tid=0x00f65d60 nid=0x1220 in Object.wait() [942f000..942fd90]
         at java.lang.Object.wait(Native Method)
         - waiting on <0x17f955a0> (a com.sap.engine.lib.util.WaitQueue)
         at java.lang.Object.wait(Object.java:429)
         at com.sap.engine.lib.util.WaitQueue.dequeue(WaitQueue.java:238)
         - locked <0x17f955a0> (a com.sap.engine.lib.util.WaitQueue)
         at com.sap.engine.core.thread.impl5.SingleThread.run(SingleThread.java:127)
    "SAPEngine_System_Thread[impl:5]_32" prio=5 tid=0x00f64a00 nid=0x7b8 in Object.wait() [93ef000..93efd90]
         at java.lang.Object.wait(Native Method)
         - waiting on <0x17f955a0> (a com.sap.engine.lib.util.WaitQueue)
         at java.lang.Object.wait(Object.java:429)
         at com.sap.engine.lib.util.WaitQueue.dequeue(WaitQueue.java:238)
         - locked <0x17f955a0> (a com.sap.engine.lib.util.WaitQueue)
         at com.sap.engine.core.thread.impl5.SingleThread.run(SingleThread.java:127)
    "SAPEngine_System_Thread[impl:5]_31" prio=5 tid=0x00f63550 nid=0x1204 in Object.wait() [93af000..93afd90]
         at java.lang.Object.wait(Native Method)
         - waiting on <0x17f955a0> (a com.sap.engine.lib.util.WaitQueue)
         at java.lang.Object.wait(Object.java:429)
         at com.sap.engine.lib.util.WaitQueue.dequeue(WaitQueue.java:238)
         - locked <0x17f955a0> (a com.sap.engine.lib.util.WaitQueue)
         at com.sap.engine.core.thread.impl5.SingleThread.run(SingleThread.java:127)
    "SAPEngine_System_Thread[impl:5]_30" prio=5 tid=0x00f62310 nid=0x600 in Object.wait() [936f000..936fd90]
         at java.lang.Object.wait(Native Method)
         - waiting on <0x17f955a0> (a com.sap.engine.lib.util.WaitQueue)
         at java.lang.Object.wait(Object.java:429)
         at com.sap.engine.lib.util.WaitQueue.dequeue(WaitQueue.java:238)
         - locked <0x17f955a0> (a com.sap.engine.lib.util.WaitQueue)
         at com.sap.engine.core.thread.impl5.SingleThread.run(SingleThread.java:127)
    "Timeout Service Synchronous Internal Thread" prio=5 tid=0x00f62df0 nid=0x1700 in Object.wait() [932f000..932fd90]
         at java.lang.Object.wait(Native Method)
         - waiting on <0x17f95980> (a java.lang.Object)
         at java.lang.Object.wait(Object.java:429)
         at com.sap.engine.services.timeout.TimeoutManagerImpl.singleThreadRun(TimeoutManagerImpl.java:589)
         - locked <0x17f95980> (a java.lang.Object)
         at com.sap.engine.services.timeout.TimeoutManagerRunner.run(TimeoutManagerRunner.java:18)
         at com.sap.engine.frame.core.thread.Task.run(Task.java:64)
         at com.sap.engine.core.thread.impl5.SingleThread.execute(SingleThread.java:79)
         at com.sap.engine.core.thread.impl5.SingleThread.run(SingleThread.java:150)
    "SAPEngine_System_Thread[impl:5]_28" prio=5 tid=0x00f61a90 nid=0x194 in Object.wait() [92ef000..92efd90]
         at java.lang.Object.wait(Native Method)
         - waiting on <0x17f955a0> (a com.sap.engine.lib.util.WaitQueue)
         at java.lang.Object.wait(Object.java:429)
         at com.sap.engine.lib.util.WaitQueue.dequeue(WaitQueue.java:238)
         - locked <0x17f955a0> (a com.sap.engine.lib.util.WaitQueue)
         at com.sap.engine.core.thread.impl5.SingleThread.run(SingleThread.java:127)
    "SAPEngine_System_Thread[impl:5]_27" prio=5 tid=0x00f606d0 nid=0x1040 in Object.wait() [92af000..92afd90]
         at java.lang.Object.wait(Native Method)
         - waiting on <0x17f955a0> (a com.sap.engine.lib.util.WaitQueue)
         at java.lang.Object.wait(Object.java:429)
         at com.sap.engine.lib.util.WaitQueue.dequeue(WaitQueue.java:238)
         - locked <0x17f955a0> (a com.sap.engine.lib.util.WaitQueue)
         at com.sap.engine.core.thread.impl5.SingleThread.run(SingleThread.java:127)
    "SAPEngine_System_Thread[impl:5]_26" prio=5 tid=0x00f17c00 nid=0x1580 in Object.wait() [926f000..926fd90]
         at java.lang.Object.wait(Native Method)
         - waiting on <0x17f955a0> (a com.sap.engine.lib.util.WaitQueue)
         at java.lang.Object.wait(Object.java:429)
         at com.sap.engine.lib.util.WaitQueue.dequeue(WaitQueue.java:238)
         - locked <0x17f955a0> (a com.sap.engine.lib.util.WaitQueue)
         at com.sap.engine.core.thread.impl5.SingleThread.run(SingleThread.java:127)
    "SAPEngine_System_Thread[impl:5]_25" prio=5 tid=0x00f055e0 nid=0xb64 in Object.wait() [922f000..922fd90]
         at java.lang.Object.wait(Native Method)
         - waiting on <0x17f955a0> (a com.sap.engine.lib.util.WaitQueue)
         at java.lang.Object.wait(Object.java:429)
         at com.sap.engine.lib.util.WaitQueue.dequeue(WaitQueue.java:238)
         - locked <0x17f955a0> (a com.sap.engine.lib.util.WaitQueue)
         at com.sap.engine.core.thread.impl5.SingleThread.run(SingleThread.java:127)
    "Timeout Service Integrity Watcher Thread" prio=10 tid=0x00f5f450 nid=0x1688 in Object.wait() [91ef000..91efd90]
         at java.lang.Object.wait(Native Method)
         - waiting on <0x17f96258> (a com.sap.engine.services.timeout.TimeoutIntegrityWatcher)
         at com.sap.engine.services.timeout.TimeoutIntegrityWatcher.run(TimeoutIntegrityWatcher.java:69)
         - locked <0x17f96258> (a com.sap.engine.services.timeout.TimeoutIntegrityWatcher)
         at com.sap.engine.frame.core.thread.Task.run(Task.java:64)
         at com.sap.engine.core.thread.impl5.SingleThread.execute(SingleThread.java:79)
         at com.sap.engine.core.thread.impl5.SingleThread.run(SingleThread.java:150)
    "SAPEngine_System_Thread[impl:5]_23" prio=5 tid=0x00f5d2f0 nid=0x9a8 in Object.wait() [91af000..91afd90]
         at java.lang.Object.wait(Native Method)
         - waiting on <0x17f955a0> (a com.sap.engine.lib.util.WaitQueue)
         at java.lang.Object.wait(Object.java:429)
         at com.sap.engine.lib.util.WaitQueue.dequeue(WaitQueue.java:238)
         - locked <0x17f955a0> (a com.sap.engine.lib.util.WaitQueue)
         at com.sap.engine.core.thread.impl5.SingleThread.run(SingleThread.java:127)
    "SAPEngine_System_Thread[impl:5]_22" prio=5 tid=0x00f5c080 nid=0xff0 in Object.wait() [916f000..916fd90]
         at java.lang.Object.wait(Native Method)
         - waiting on <0x17f955a0> (a com.sap.engine.lib.util.WaitQueue)
         at java.lang.Object.wait(Object.java:429)
         at com.sap.engine.lib.util.WaitQueue.dequeue(WaitQueue.java:238)
         - locked <0x17f955a0> (a com.sap.engine.lib.util.WaitQueue)
         at com.sap.engine.core.thread.impl5.SingleThread.run(SingleThread.java:127)
    "SAPEngine_System_Thread[impl:5]_21" prio=5 tid=0x00f5cb90 nid=0xd98 in Object.wait() [912f000..912fd90]
         at java.lang.Object.wait(Native Method)
         - waiting on <0x17f963d0> (a com.sap.engine.services.log_configurator.archive.Buffer)
         at java.lang.Object.wait(Object.java:429)
         at com.sap.engine.services.log_configurator.archive.Buffer.getTask(Buffer.java:38)
         - locked <0x17f963d0> (a com.sap.engine.services.log_configurator.archive.Buffer)
         at com.sap.engine.services.log_configurator.archive.ArchivingThread.run(ArchivingThread.java:34)
         at com.sap.engine.frame.core.thread.Task.run(Task.java:64)
         at com.sap.engine.core.thread.impl5.SingleThread.execute(SingleThread.java:79)
         at com.sap.engine.core.thread.impl5.SingleThread.run(SingleThread.java:150)
    "SAPEngine_System_Thread[impl:5]_20" prio=5 tid=0x00f5b920 nid=0x72c in Object.wait() [90ef000..90efd90]
         at java.lang.Object.wait(Native Method)
         - waiting on <0x17f955a0> (a com.sap.engine.lib.util.WaitQueue)
         at java.lang.Object.wait(Object.java:429)
         at com.sap.engine.lib.util.WaitQueue.dequeue(WaitQueue.java:238)
         - locked <0x17f955a0> (a com.sap.engine.lib.util.WaitQueue)
         at com.sap.engine.core.thread.impl5.SingleThread.run(SingleThread.java:127)
    "SAPEngine_System_Thread[impl:5]_19" prio=5 tid=0x00f5a460 nid=0x1264 in Object.wait() [90af000..90afd90]
         at java.lang.Object.wait(Native Method)
         - waiting on <0x17f955a0> (a com.sap.engine.lib.util.WaitQueue)
         at java.lang.Object.wait(Object.java:429)
         at com.sap.engine.lib.util.WaitQueue.dequeue(WaitQueue.java:238)
         - locked <0x17f955a0> (a com.sap.engine.lib.util.WaitQueue)
         at com.sap.engine.core.thread.impl5.SingleThread.run(SingleThread.java:127)
    "SAPEngine_System_Thread[impl:5]_18" prio=5 tid=0x00f59150 nid=0x8b8 in Object.wait() [906f000..906fd90]
         at java.lang.Object.wait(Native Method)
         - waiting on <0x17f955a0> (a com.sap.engine.lib.util.WaitQueue)
         at java.lang.Object.wait(Object.java:429)
         at com.sap.engine.lib.util.WaitQueue.dequeue(WaitQueue.java:238)
         - locked <0x17f955a0> (a com.sap.engine.lib.util.WaitQueue)
         at com.sap.engine.core.thread.impl5.SingleThread.run(SingleThread.java:127)
    "SAPEngine_System_Thread[impl:5]_17" prio=5 tid=0x00f59c60 nid=0x1588 in Object.wait() [902f000..902fd90]
         at java.lang.Object.wait(Native Method)
         - waiting on <0x17f955a0> (a com.sap.engine.lib.util.WaitQueue)
         at java.lang.Object.wait(Object.java:429)
         at com.sap.engine.lib.util.WaitQueue.dequeue(WaitQueue.java:238)
         - locked <0x17f955a0> (a com.sap.engine.lib.util.WaitQueue)
         at com.sap.engine.core.thread.impl5.SingleThread.run(SingleThread.java:127)
    "SAPEngine_System_Thread[impl:5]_16" prio=5 tid=0x00f588a0 nid=0x690 in Object.wait() [8fef000..8fefd90]
         at java.lang.Object.wait(Native Method)
         - waiting on <0x17f955a0> (a com.sap.engine.lib.util.WaitQueue)
         at java.lang.Object.wait(Object.java:429)
         at com.sap.engine.lib.util.WaitQueue.dequeue(WaitQueue.java:238)
         - locked <0x17f955a0> (a com.sap.engine.lib.util.WaitQueue)
         at com.sap.engine.core.thread.impl5.SingleThread.run(SingleThread.java:127)
    "SAPEngine_System_Thread[impl:5]_15" prio=5 tid=0x00f3b5a0 nid=0x12cc in Object.wait() [8faf000..8fafd90]
         at java.lang.Object.wait(Native Method)
         - waiting on <0x17f955a0> (a com.sap.engine.lib.util.WaitQueue)
         at java.lang.Object.wait(Object.java:429)
         at com.sap.engine.lib.util.WaitQueue.dequeue(WaitQueue.java:238)
         - locked <0x17f955a0> (a com.sap.engine.lib.util.WaitQueue)
         at com.sap.engine.core.thread.impl5.SingleThread.run(SingleThread.java:127)
    "SAPEngine_System_Thread[impl:5]_14" prio=5 tid=0x00f57690 nid=0x1750 in Object.wait() [8f6f000..8f6fd90]
         at java.lang.Object.wait(Native Method)
         - waiting on <0x17f955a0> (a com.sap.engine.lib.util.WaitQueue)
         at java.lang.Object.wait(Object.java:429)
         at com.sap.engine.lib.util.WaitQueue.dequeue(WaitQueue.java:238)
         - locked <0x17f955a0> (a com.sap.engine.lib.util.WaitQueue)
         at com.sap.engine.core.thread.impl5.SingleThread.run(SingleThread.java:127)
    "SAPEngine_System_Thread[impl:5]_13" prio=5 tid=0x00f566e0 nid=0xb58 in Object.wait() [8f2f000..8f2fd90]
         at java.lang.Object.wait(Native Method)
         - waiting on <0x17f99220> (a java.lang.Object)
         at java.lang.Object.wait(Object.java:429)
         at com.sap.jms.server.destinationcontainer.AgentThreadSystem.run(AgentThreadSystem.java:148)
         - locked <0x17f99220> (a java.lang.Object)
         at com.sap.engine.frame.core.thread.Task.run(Task.java:64)
         at com.sap.engine.core.thread.impl5.SingleThread.execute(SingleThread.java:79)
         at com.sap.engine.core.thread.impl5.SingleThread.run(SingleThread.java:150)
    "SAPEngine_System_Thread[impl:5]_12" prio=5 tid=0x00f56230 nid=0xc00 in Object.wait() [8eef000..8eefd90]
         at java.lang.Object.wait(Native Method)
         - waiting on <0x17f955a0> (a com.sap.engine.lib.util.WaitQueue)
         at java.lang.Object.wait(Object.java:429)
         at com.sap.engine.lib.util.WaitQueue.dequeue(WaitQueue.java:238)
         - locked <0x17f955a0> (a com.sap.engine.lib.util.WaitQueue)
         at com.sap.engine.core.thread.impl5.SingleThread.run(SingleThread.java:127)
    "SAPEngine_System_Thread[impl:5]_11" prio=5 tid=0x00f541e0 nid=0x104c in Object.wait() [8eaf000..8eafd90]
         at java.lang.Object.wait(Native Method)
         - waiting on <0x17f955a0> (a com.sap.engine.lib.util.WaitQueue)
         at java.lang.Object.wait(Object.java:429)
         at com.sap.engine.lib.util.WaitQueue.dequeue(WaitQueue.java:238)
         - locked <0x17f955a0> (a com.sap.engine.lib.util.WaitQueue)
         at com.sap.engine.core.thread.impl5.SingleThread.run(SingleThread.java:127)
    "SAPEngine_System_Thread[impl:5]_10" prio=5 tid=0x00f54590 nid=0x1518 in Object.wait() [8e6f000..8e6fd90]
         at java.lang.Object.wait(Native Method)
         - waiting on <0x17f955a0> (a com.sap.engine.lib.util.WaitQueue)
         at java.lang.Object.wait(Object.java:429)
         at com.sap.engine.lib.util.WaitQueue.dequeue(WaitQueue.java:238)
         - locked <0x17f955a0> (a com.sap.engine.lib.util.WaitQueue)
         at com.sap.engine.core.thread.impl5.SingleThread.run(SingleThread.java:127)
    "SAPJarResourceCloseTimeoutThread" daemon prio=5 tid=0x00f4f620 nid=0x15a4 in Object.wait() [8e2f000..8e2fd90]
         at java.lang.Object.wait(Native Method)
         - waiting on <0x17f911e0> (a com.sap.engine.frame.core.load.res.JarThread)
         at java.lang.Object.wait(Object.java:429)
         at com.sap.engine.frame.core.load.res.JarThread.run(JarThread.java:32)
         - locked <0x17f911e0> (a com.sap.engine.frame.core.load.res.JarThread)
    "Thread-14" daemon prio=5 tid=0x00f3ae90 nid=0x1664 in Object.wait() [8def000..8defd90]
         at java.lang.Object.wait(Native Method)
         - waiting on <0x17f993c8> (a java.lang.ref.ReferenceQueue$Lock)
         at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:111)
         - locked <0x17f993c8> (a java.lang.ref.ReferenceQueue$Lock)
         at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:127)
         at com.sap.engine.cache.util.ReferenceQueueRunnable.run(ReferenceQueueRunnable.java:43)
         at java.lang.Thread.run(Thread.java:534)
    "Background Jobs Internal Thread" daemon prio=5 tid=0x00f0f0c0 nid=0xce8 in Object.wait() [8daf000..8dafd90]
         at java.lang.Object.wait(Native Method)
         - waiting on <0x17f993f0> (a java.lang.Object)
         at com.sap.engine.cache.job.impl.BackgroundExactImpl.run(BackgroundExactImpl.java:134)
         - locked <0x17f993f0> (a java.lang.Object)
         at java.lang.Thread.run(Thread.java:534)
    "Timeout Service Integrity Watcher Thread" daemon prio=10 tid=0x00f00750 nid=0x15c0 in Object.wait() [8d6f000..8d6fd90]
         at java.lang.Object.wait(Native Method)
         - waiting on <0x17f99458> (a com.sap.engine.cache.job.impl.IntegrityWatcher)
         at com.sap.engine.cache.job.impl.IntegrityWatcher.run(IntegrityWatcher.java:54)
         - locked <0x17f99458> (a com.sap.engine.cache.job.impl.IntegrityWatcher)
         at java.lang.Thread.run(Thread.java:534)
    "Background Jobs Internal Thread" daemon prio=5 tid=0x00f22d30 nid=0xe3c in Object.wait() [8d2f000..8d2fd90]
         at java.lang.Object.wait(Native Method)
         - waiting on <0x17f99498> (a java.lang.Object)
         at java.lang.Object.wait(Object.java:429)
         at com.sap.engine.cache.job.impl.BackgroundExactImpl.run(BackgroundExactImpl.java:115)
         - locked <0x17f99498> (a java.lang.Object)
         at java.lang.Thread.run(Thread.java:534)
    "Timeout Service Integrity Watcher Thread" daemon prio=10 tid=0x00f1fe90 nid=0x724 in Object.wait() [8cef000..8cefd90]
         at java.lang.Object.wait(Native Method)
         - waiting on <0x17f994e0> (a com.sap.engine.cache.job.impl.IntegrityWatcher)
         at com.sap.engine.cache.job.impl.IntegrityWatcher.run(IntegrityWatcher.java:54)
         - locked <0x17f994e0> (a com.sap.engine.cache.job.impl.IntegrityWatcher)
         at java.lang.Thread.run(Thread.java:534)
    "SAPEngine_EnquReader" prio=5 tid=0x00f1cdf0 nid=0x14f4 runnable [8caf000..8cafd90]
         at java.net.SocketInputStream.socketRead0(Native Method)
         at java.net.SocketInputStream.read(SocketInputStream.java:129)
         at com.sap.bc.krn.enqu.EncomiHandle.ReceiveMessage(EncomiHandle.java:483)
         - locked <0x17f99560> (a java.lang.Object)
         at com.sap.bc.krn.enqu.EnccliMultiplexHandle.receive(EnccliMultiplexHandle.java:771)
         at com.sap.bc.krn.enqu.ReadRunnable.run(EnccliMultiplexHandle.java:958)
         at java.lang.Thread.run(Thread.java:534)
    "SAP J2EE Engine|MS Ping Thread" prio=5 tid=0x00f1bc80 nid=0x61c waiting on condition [8c6f000..8c6fd90]
         at java.lang.Thread.sleep(Native Method)
         at com.sap.engine.core.cluster.impl6.ms.MSRawConnection$MSPingRunner.run(MSRawConnection.java:2383)
         at java.lang.Thread.run(Thread.java:534)
    "SAPEngine_System_Thread[impl:5]_9" prio=5 tid=0x00f14e00 nid=0x7fc in Object.wait() [8c2f000..8c2fd90]
         at java.lang.Object.wait(Native Method)
         - waiting on <0x17f955a0> (a com.sap.engine.lib.util.WaitQueue)
         at java.lang.Object.wait(Object.java:429)
         at com.sap.engine.lib.util.WaitQueue.dequeue(WaitQueue.java:238)
         - locked <0x17f955a0> (a com.sap.engine.lib.util.WaitQueue)
         at com.sap.engine.core.thread.impl5.SingleThread.run(SingleThread.java:127)
    "SAPEngine_System_Thread[impl:5]_8" prio=10 tid=0x00f13a00 nid=0xb74 in Object.wait() [8bef000..8befd90]
         at java.lang.Object.wait(Native Method)
         - waiting on <0x17f99600> (a com.sap.engine.core.service630.container.InterfaceWrapper)
         at java.lang.Object.wait(Object.java:429)
         at com.sap.engine.core.service630.container.ServiceRunner.run(ServiceRunner.java:119)
         - locked <0x17f99600> (a com.sap.engine.core.service630.container.InterfaceWrapper)
         at com.sap.engine.frame.core.thread.Task.run(Task.java:64)
         at com.sap.engine.core.thread.impl5.SingleThread.execute(SingleThread.java:79)
         at com.sap.engine.core.thread.impl5.SingleThread.run(SingleThread.java:150)
    "SAPEngine_System_Thread[impl:5]_7" prio=5 tid=0x00f125d0 nid=0x5cc in Object.wait() [8baf000..8bafd90]
         at java.lang.Object.wait(Native Method)
         - waiting on <0x17f996e8> (a com.sap.engine.lib.util.WaitQueue)
         at java.lang.Object.wait(Object.java:429)
         at com.sap.engine.lib.util.WaitQueue.dequeue(WaitQueue.java:192)
         - locked <0x17f996e8> (a com.sap.engine.lib.util.WaitQueue)
         at com.sap.engine.core.configuration.impl.event.QueuedEventProcessor.run(QueuedEventProcessor.java:44)
         at com.sap.engine.frame.core.thread.Task.run(Task.java:64)
         at com.sap.engine.core.thread.impl5.SingleThread.execute(SingleThread.java:79)
         at com.sap.engine.core.thread.impl5.SingleThread.run(SingleThread.java:150)
    "SAPEngine_System_Thread[impl:5]_6" prio=5 tid=0x00f11180 nid=0x748 in Object.wait() [8b6f000..8b6fd90]
         at java.lang.Object.wait(Native Method)
         - waiting on <0x17f997a8> (a java.lang.ref.ReferenceQueue$Lock)
         at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:111)
         - locked <0x17f997a8> (a java.lang.ref.ReferenceQueue$Lock)
         at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:127)
         at com.sap.engine.lib.util.cache.CacheGroup.run(CacheGroup.java:76)
         at com.sap.engine.frame.core.thread.Task.run(Task.java:64)
         at com.sap.engine.core.thread.impl5.SingleThread.execute(SingleThread.java:79)
         at com.sap.engine.core.thread.impl5.SingleThread.run(SingleThread.java:150)
    "SAPEngine_System_Thread[impl:5]_5" prio=5 tid=0x00f11cc0 nid=0x1790 waiting on condition [8b2f000..8b2fd90]
         at java.lang.Thread.sleep(Native Method)
         at com.sap.engine.core.configuration.impl.persistence.rdbms.DBConnectionPool$IdleConnectionsChecker.run(DBConnectionPool.java:427)
         at com.sap.engine.frame.core.thread.Task.run(Task.java:64)
         at com.sap.engine.core.thread.impl5.SingleThread.execute(SingleThread.java:79)
         at com.sap.engine.core.thread.impl5.SingleThread.run(SingleThread.java:150)
    "OrderedChannel for service" prio=5 tid=0x00f078d0 nid=0x604 waiting on condition [8aef000..8aefd90]
         at java.lang.Thread.sleep(Native Method)
         at com.sap.caf.eu.gp.model.co.execute.impl.CallableObjectExecutorTimeoutProcessor.run(CallableObjectExecutorTimeoutProcessor.java:193)
         at com.sap.engine.frame.core.thread.Task.run(Task.java:64)
         at com.sap.engine.core.thread.impl5.SingleThread.execute(SingleThread.java:79)
         at com.sap.engine.core.thread.impl5.SingleThread.run(SingleThread.java:150)
    "Session Reader for cluster node 17114700" prio=5 tid=0x00ef0d20 nid=0xd70 runnable [8aaf000..8aafd90]
         at java.net.SocketInputStream.socketRead0(Native Method)
         at java.net.SocketInputStream.read(SocketInputStream.java:129)
         at java.io.BufferedInputStream.fill(BufferedInputStream.java:183)
         at java.io.BufferedInputStream.read1(BufferedInputStream.java:222)
         at java.io.BufferedInputStream.read(BufferedInputStream.java:277)
         - locked <0x17f9a130> (a java.io.BufferedInputStream)
         at com.sap.engine.core.cluster.impl6.session.Reader.run(Reader.java:83)
         at com.sap.engine.frame.core.thread.Task.run(Task.java:64)
         at com.sap.engine.core.thread.impl5.SingleThread.execute(SingleThread.java:79)
         at com.sap.engine.core.thread.impl5.SingleThread.run(SingleThread.java:150)
    "SAPEngine_System_Thread[impl:5]_2" prio=5 tid=0x00ef0e90 nid=0x13f0 runnable [8a6f000..8a6fd90]
         at java.net.PlainSocketImpl.socketAccept(Native Method)
         at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:353)
         - locked <0x17f9a218> (a java.net.PlainSocketImpl)
         at java.net.ServerSocket.implAccept(ServerSocket.java:448)
         at com.sap.engine.core.cluster.impl6.net.ClusterServerSocket.accept(ClusterServerSocket.java:51)
         at com.sap.engine.core.cluster.impl6.JoinPortListener.run(JoinPortListener.java:72)
         at com.sap.engine.frame.core.thread.Task.run(Task.java:64)
         at com.sap.engine.core.thread.impl5.SingleThread.execute(SingleThread.java:79)
         at com.sap.engine.core.thread.impl5.SingleThread.run(SingleThread.java:150)
    "SAP J2EE Engine|MS Socket Listener" prio=5 tid=0x00f0f230 nid=0xb94 runnable [8a2f000..8a2fd90]
         at java.net.SocketInputStream.socketRead0(Native Method)
         at java.net.SocketInputStream.read(SocketInputStream.java:129)
         at java.io.BufferedInputStream.fill(BufferedInputStream.java:183)
         at java.io.BufferedInputStream.read1(BufferedInputStream.java:222)
         at java.io.BufferedInputStream.read(BufferedInputStream.java:277)
         - locked <0x17f9abb0> (a java.io.BufferedInputStream)
         at com.sap.engine.core.cluster.impl6.ms.MSMessageHeader.read(MSMessageHeader.java:440)
         at com.sap.engine.core.cluster.impl6.ms.MSMessageObjectImpl.readHeader(MSMessageObjectImpl.java:142)
         at com.sap.engine.core.cluster.impl6.ms.MSRawConnection.receiveRawMessage(MSRawConnection.java:1660)
         at com.sap.engine.core.cluster.impl6.ms.MSListener.run(MSListener.java:86)
         at com.sap.engine.frame.core.thread.Task.run(Task.java:64)
         at com.sap.engine.core.thread.impl5.SingleThread.execute(SingleThread.java:79)
         at com.sap.engine.core.thread.impl5.SingleThread.run(SingleThread.java:150)
    "SAP J2EE Engine|MS Queue Listener" prio=5 tid=0x00f0f7a0 nid=0x1504 in Object.wait() [89ef000..89efd90]
         at java.lang.Object.wait(Native Method)
         - waiting on <0x17f9af48> (a com.sap.engine.lib.util.WaitQueue)
         at java.lang.Object.wait(Object.java:429)
         at com.sap.engine.lib.util.WaitQueue.dequeue(WaitQueue.java:192)
         - locked <0x17f9af48> (a com.sap.engine.lib.util.WaitQueue)
         at com.sap.engine.core.cluster.impl6.ms.MSListenerQueue.run(MSListenerQueue.java:67)
         at com.sap.engine.frame.core.thread.Task.run(Task.java:64)
         at com.sap.engine.core.thread.impl5.SingleThread.execute(SingleThread.java:79)
         at com.sap.engine.core.thread.impl5.SingleThread.run(SingleThread.java:150)
    "SAPEngine_System_Thread[impl:5]_ThreadManager Maintaining thread." prio=10 tid=0x00f0fe10 nid=0xb70 in Object.wait() [89af000..89afd90]
         at java.lang.Object.wait(Native Method)
         - waiting on <0x17f91ce0> (a com.sap.engine.core.thread.impl5.ExecutorThread)
         at java.lang.Object.wait(Object.java:429)
         at com.sap.engine.core.thread.impl5.ExecutorThread.run(ExecutorThread.java:70)
         - locked <0x17f91ce0> (a com.sap.engine.core.thread.impl5.ExecutorThread)
    "SAPEngine_Application_Thread[impl:3]_ThreadManager Maintaining thread." prio=10 tid=0x00f0c010 nid=0xbc8 in Object.wait() [896f000..896fd90]
         at java.lang.Object.wait(Native Method)
         - waiting on <0x17f90180> (a com.sap.engine.core.thread.impl3.RuntimeMaintainingThread)
         at com.sap.engine.core.thread.impl3.RuntimeMaintainingThread.run(RuntimeMaintainingThread.java:65)
         - locked <0x17f90180> (a com.sap.engine.core.thread.impl3.RuntimeMaintainingThread)
    "SAPEngine_Application_Thread[impl:3]_4" prio=5 tid=0x00f0c370 nid=0x11bc waiting on condition [892f000..892fd90]
         at java.lang.Thread.sleep(Native Method)
         at com.sap.caf.eu.gp.model.pfw.notification.NotificationQueueProcessor.run(NotificationQueueProcessor.java:352)
         at com.sap.engine.core.thread.impl3.ActionObject.run(ActionObject.java:37)
         at java.security.AccessController.doPrivileged(Native Method)
         at com.sap.engine.core.thread.impl3.SingleThread.execute(SingleThread.java:100)
         at com.sap.engine.core.thread.impl3.SingleThread.run(SingleThread.java:170)
    "SAPEngine_Application_Thread[impl:3]_3" prio=5 tid=0x00f0c9f0 nid=0x16d0 in Object.wait() [88ef000..88efd90]
         at java.lang.Object.wait(Native Method)
         - waiting on <0x10058488> (a com.sap.caf.eu.gp.model.pfw.wfc.local.impl.BackGroundActionProcessor)
         at java.lang.Object.wait(Object.java:429)
         at com.sap.caf.eu.gp.model.pfw.wfc.local.impl.BackGroundActionProcessor.run(BackGroundActionProcessor.java:121)
         - locked <0x10058488> (a com.sap.caf.eu.gp.model.pfw.wfc.local.impl.BackGroundActionProcessor)
         at com.sap.engine.core.thread.impl3.ActionObject.run(ActionObject.java:37)
         at java.security.AccessController.doPrivileged(Native Method)
         at com.sap.engine.core.thread.impl3.SingleThread.execute(SingleThread.java:100)
         at com.sap.engine.core.thread.impl3.SingleThread.run(SingleThread.java:170)
    "SAPEngine_Application_Thread[impl:3]_2" prio=5 tid=0x00f0a030 nid=0x1628 in Object.wait() [88af000..88afd90]
         at java.lang.Object.wait(Native Method)
         - waiting on <0x1005b0d8> (a com.sap.caf.eu.gp.model.pfw.wfc.local.impl.BackGroundActionProcessor)
         at java.lang.Object.wait(Object.java:429)
         at com.sap.caf.eu.gp.model.pfw.wfc.local.impl.BackGroundActionProcessor.run(BackGroundActionProcessor.java:121)
         - locked <0x1005b0d8> (a com.sap.caf.eu.gp.model.pfw.wfc.local.impl.BackGroundActionProcessor)
         at com.sap.engine.core.thread.impl3.ActionObject.run(ActionObject.java:37)
         at java.security.AccessController.doPrivileged(Native Method)
         at com.sap.engine.core.thread.impl3.SingleThread.execute(SingleThread.java:100)
         at com.sap.engine.core.thread.impl3.SingleThread.run(SingleThread.java:170)
    "SAPEngine_Application_Thread[impl:3]_1" prio=5 tid=0x00f0a2d0 nid=0xf24 waiting on condition [886f000..886fd90]
         at java.lang.Thread.sleep(Native Method)
         at com.sap.caf.eu.gp.schedule.impl.ScheduleWorker.work(ScheduleWorker.java:87)
         at com.sap.caf.eu.gp.schedule.impl.ScheduleWorker.run(ScheduleWorker.java:59)
         at com.sap.engine.core.thread.impl3.ActionObject.run(ActionObject.java:37)
         at java.security.AccessController.doPrivileged(Native Method)
         at com.sap.engine.core.thread.impl3.SingleThread.execute(SingleThread.java:100)
         at com.sap.engine.core.thread.impl3.SingleThread.run(SingleThread.java:170)
    "SAPEngine_Application_Thread[impl:3]_0" prio=5 tid=0x00f0a440 nid=0x1248 waiting on condition [882f000..882fd90]
         at java.lang.Thread.sleep(Native Method)
         at com.sap.caf.eu.gp.mail.cf.core.multithreading.TimerTask.run(TimerTask.java:41)
         at com.sap.engine.core.thread.impl3.ActionObject.run(ActionObject.java:37)
         at java.security.AccessController.doPrivileged(Native Method)
         at com.sap.engine.core.thread.impl3.SingleThread.execute(SingleThread.java:100)
         at com.sap.engine.core.thread.impl3.SingleThread.run(SingleThread.java:170)
    "Thread-1" prio=5 tid=0x00eea010 nid=0xf1c runnable [79df000..79dfd90]
         at com.sap.bc.proj.jstartup.JStartupFramework.nativeGetThreadDump(Native Method)
         at com.sap.bc.proj.jstartup.JStartupFramework.getThreadDump(JStartupFramework.java:507)
         at com.sap.engine.frame.ProcessEnvironment.sfGetThreadDump(ProcessEnvironment.java:95)
         at com.sap.engine.frame.ProcessEnvironment.getThreadDump(ProcessEnvironment.java:89)
         at com.sap.engine.core.service630.container.MemoryContainer.startServices(MemoryContainer.java:226)
         - locked <0x17f9b0f8> (a com.sap.engine.core.service630.container.MemoryContainer)
         at com.sap.engine.core.service630.container.MemoryContainer.start(MemoryContainer.java:156)
         - locked <0x17f9b180> (a java.lang.Object)
         at com.sap.engine.core.service630.container.AbstractServiceContainer.init(AbstractServiceContainer.java:109)
         at com.sap.engine.core.Framework.loadSingleManager(Framework.java:556)
         at com.sap.engine.core.Framework.loadManagers(Framework.java:251)
         at com.sap.engine.core.Framework.start(Framework.java:185)
         - locked <0x17f9b0b8> (a com.sap.engine.core.Framework)
         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
         at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
         at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
         at java.lang.reflect.Method.invoke(Method.java:324)
         at com.sap.engine.boot.FrameThread.run(FrameThread.java:61)
         at java.lang.Thread.run(Thread.java:534)
    "Signal Dispatcher" daemon prio=10 tid=0x00ee2cd0 nid=0x11b0 waiting on condition [0..0]
    "JDWP Event Helper Thread" daemon prio=5 tid=0x00ee0480 nid=0x10f0 runnable [0..0]

  • Message bean does not start automatically during application server startup

    I have a message bean that does not start up during application server startup. I am able to successfully start the application manually using the visual admin tool.I searched the logs and found the following error. The error references the "QueueConnectionFactory" is not deployed or is not started. I have check and the "QueueConnectiopnFactory" is deployed. Is this a problem with the application trying to start before the "QueueConnectionFactory"? Is thier a way to define a dependency on my application not to start until the "QueueConnectionFactory" has been started, if so can how would I define this dependency. Please provide and example.
    Thanks,
    Bill
    #1.5 #001CC4695AD8001A000000100000079C00045DB6C93D4DAD#1228939548538#com.sap.ip.mmr.tools.RunTask##com.sap.ip.mmr.tools.RunTask#Administrator#79423####d7c673d0c6f411dd92de001cc4695ad8#SAPEngine_Application_Thread[impl:3]_33##0#0#Info##Plain###Connecting Model Repository ...#
    #1.5 #001CC4695AD8001A000000110000079C00045DB6C93D4E1D#1228939548538#com.sap.ip.mmr.tools.RunTask##com.sap.ip.mmr.tools.RunTask#Administrator#79423####d7c673d0c6f411dd92de001cc4695ad8#SAPEngine_Application_Thread[impl:3]_33##0#0#Info##Plain###Checking source path: halliburton.com/hal~usrgrpap#
    #1.5 #001CC4695AD8001A000000120000079C00045DB6C93D4EAC#1228939548538#System.err##System.err#Administrator#79423####d7c673d0c6f411dd92de001cc4695ad8#SAPEngine_Application_Thread[impl:3]_33##0#0#Error##Plain###[RunTask] The source file/path doesn't exist: halliburton.com/hal~usrgrpap#
    #1.5 #001CC4695AD8001A000000130000079C00045DB6C93D4EF5#1228939548538#com.sap.ip.mmr.tools.RunTask##com.sap.ip.mmr.tools.RunTask#Administrator#79423####d7c673d0c6f411dd92de001cc4695ad8#SAPEngine_Application_Thread[impl:3]_33##0#0#Info##Plain###Opening connection to MMR ...#
    #1.5 #001CC4695AD8001A000000140000079C00045DB6C93D69D0#1228939548553#com.sap.ip.mmr.tools.RunTask##com.sap.ip.mmr.tools.RunTask#Administrator#79423####d7c673d0c6f411dd92de001cc4695ad8#SAPEngine_Application_Thread[impl:3]_33##0#0#Info##Plain###Start local transaction ...#
    #1.5 #001CC4695AD8001A000000150000079C00045DB6C93D6B5A#1228939548553#com.sap.ip.mmr.tools.RunTask##com.sap.ip.mmr.tools.RunTask#Administrator#79423####d7c673d0c6f411dd92de001cc4695ad8#SAPEngine_Application_Thread[impl:3]_33##0#0#Info##Plain###Commit ...#
    #1.5 #001CC4695AD8001A000000160000079C00045DB6C93D6C8B#1228939548553#com.sap.ip.mmr.tools.RunTask##com.sap.ip.mmr.tools.RunTask#Administrator#79423####d7c673d0c6f411dd92de001cc4695ad8#SAPEngine_Application_Thread[impl:3]_33##0#0#Info##Plain###Running task 'com.sap.ip.mmr.db.tasks.TaskUndeployFromDB' ...#
    #1.5 #001CC4695AD8001A000000170000079C00045DB6C93D8E6C#1228939548553#com.sap.ip.mmr.tools.RunTask##com.sap.ip.mmr.tools.RunTask#Administrator#79423####d7c673d0c6f411dd92de001cc4695ad8#SAPEngine_Application_Thread[impl:3]_33##0#0#Info##Plain###Close connection to Model Repository ...#
    #1.5 #001CC4695AD8001A000000180000079C00045DB6C93D8EE5#1228939548553#com.sap.ip.mmr.tools.RunTask##com.sap.ip.mmr.tools.RunTask#Administrator#79423####d7c673d0c6f411dd92de001cc4695ad8#SAPEngine_Application_Thread[impl:3]_33##0#0#Info##Plain###done.#
    #1.5 #001CC4695AD80018000000000000171400045DBBE9BCCED0#1228961568691#com.sap.engine.services.connector##com.sap.engine.services.connector######27cee540c72911ddb4ee001cc4695ad8#SAPEngine_System_Thread[impl:5]_25##0#0#Error##Plain###ResourceObjectFactory.getObjectInstance(), Error: com.sap.engine.services.connector.exceptions.BaseResourceException: ConnectionFactory "QueueConnectionFactory" does not exist. Possible reasons: the connector in which ConnectionFactory "QueueConnectionFactory" is defined is not deployed or not started.
                    at com.sap.engine.services.connector.ResourceObjectFactory.getObjectInstance(ResourceObjectFactory.java:207)
                    at com.sap.engine.system.naming.provider.ObjectFactoryBuilderImpl._getObjectInstance(ObjectFactoryBuilderImpl.java:72)
                    at com.sap.engine.system.naming.provider.ObjectFactoryBuilderImpl.access$100(ObjectFactoryBuilderImpl.java:31)
                    at com.sap.engine.system.naming.provider.ObjectFactoryBuilderImpl$DispatchObjectFactory.getObjectInstance(ObjectFactoryBuilderImpl.java:210)
                    at javax.naming.spi.NamingManager.getObjectInstance(NamingManager.java:280)
                    at com.sap.engine.services.jndi.implclient.ClientContext.lookup(ClientContext.java:414)
                    at com.sap.engine.services.jndi.implclient.ClientContext.lookup(ClientContext.java:639)
                    at javax.naming.InitialContext.lookup(InitialContext.java:347)
                    at javax.naming.InitialContext.lookup(InitialContext.java:347)
                    at com.sap.engine.services.ejb.message.JMSBridge.registerListener(JMSBridge.java:115)
                    at com.sap.engine.services.ejb.message.MessageContainer.load(MessageContainer.java:449)
                    at com.sap.engine.services.ejb.message.MessageContainer.init(MessageContainer.java:153)
                    at com.sap.engine.services.ejb.message.MessageContainerFP.init(MessageContainerFP.java:53)
                    at com.sap.engine.services.ejb.EJBAdmin.prepareLoad(EJBAdmin.java:1007)
                    at com.sap.engine.services.ejb.EJBAdmin.prepareStart(EJBAdmin.java:2443)
                    at com.sap.engine.services.deploy.server.application.StartTransaction.prepareCommon(StartTransaction.java:223)
                    at com.sap.engine.services.deploy.server.application.StartTransaction.prepareLocal(StartTransaction.java:176)
                    at com.sap.engine.services.deploy.server.application.ApplicationTransaction.makeAllPhasesLocal(ApplicationTransaction.java:365)
                    at com.sap.engine.services.deploy.server.application.ParallelAdapter.runInTheSameThread(ParallelAdapter.java:132)
                    at com.sap.engine.services.deploy.server.application.ParallelAdapter.makeAllPhasesLocalAndWait(ParallelAdapter.java:250)
                    at com.sap.engine.services.deploy.server.DeployServiceImpl.startApplicationLocalAndWait(DeployServiceImpl.java:4450)
                    at com.sap.engine.services.deploy.server.DeployServiceImpl.startApplicationsInitially(DeployServiceImpl.java:2610)
                    at com.sap.engine.services.deploy.server.DeployServiceImpl.clusterElementReady(DeployServiceImpl.java:2464)
                    at com.sap.engine.services.deploy.server.ClusterServicesAdapter.containerStarted(ClusterServicesAdapter.java:42)
                    at com.sap.engine.core.service630.container.ContainerEventListenerWrapper.processEvent(ContainerEventListenerWrapper.java:144)
                    at com.sap.engine.core.service630.container.AdminContainerEventListenerWrapper.processEvent(AdminContainerEventListenerWrapper.java:19)
                    at com.sap.engine.core.service630.container.ContainerEventListenerWrapper.run(ContainerEventListenerWrapper.java:102)
                    at com.sap.engine.frame.core.thread.Task.run(Task.java:64)
                    at com.sap.engine.core.thread.impl5.SingleThread.execute(SingleThread.java:79)
                    at com.sap.engine.core.thread.impl5.SingleThread.run(SingleThread.java:150)
    #1.5 #001CC4695AD80018000000010000171400045DBBE9BCE3CD#1228961568691#com.sap.engine.services.jndi##com.sap.engine.services.jndi######27cee540c72911ddb4ee001cc4695ad8#SAPEngine_System_Thread[impl:5]_25##0#0#Warning#1#/System/Audit#Java###Exception #1#com.sap.engine.services.jndi.persistent.exceptions.NamingException: Exception during lookup operation of object with name ejbContainer/mdb/halliburton.com/hal~usrgrpap/QueueConnectionFactory, cannot resolve object reference. [Root exception is com.sap.engine.services.connector.exceptions.BaseResourceException: ConnectionFactory "QueueConnectionFactory" does not exist. Possible reasons: the connector in which ConnectionFactory "QueueConnectionFactory" is defined is not deployed or not started.]
                    at com.sap.engine.services.jndi.implclient.ClientContext.lookup(ClientContext.java:529)
                    at com.sap.engine.services.jndi.implclient.ClientContext.lookup(ClientContext.java:639)
                    at javax.naming.InitialContext.lookup(InitialContext.java:347)
                    at javax.naming.InitialContext.lookup(InitialContext.java:347)
                    at com.sap.engine.services.ejb.message.JMSBridge.registerListener(JMSBridge.java:115)
                    at com.sap.engine.services.ejb.message.MessageContainer.load(MessageContainer.java:449)
                    at com.sap.engine.services.ejb.message.MessageContainer.init(MessageContainer.java:153)
                    at com.sap.engine.services.ejb.message.MessageContainerFP.init(MessageContainerFP.java:53)
                    at com.sap.engine.services.ejb.EJBAdmin.prepareLoad(EJBAdmin.java:1007)
                    at com.sap.engine.services.ejb.EJBAdmin.prepareStart(EJBAdmin.java:2443)
                    at com.sap.engine.services.deploy.server.application.StartTransaction.prepareCommon(StartTransaction.java:223)
                    at com.sap.engine.services.deploy.server.application.StartTransaction.prepareLocal(StartTransaction.java:176)
                    at com.sap.engine.services.deploy.server.application.ApplicationTransaction.makeAllPhasesLocal(ApplicationTransaction.java:365)
                    at com.sap.engine.services.deploy.server.application.ParallelAdapter.runInTheSameThread(ParallelAdapter.java:132)
                    at com.sap.engine.services.deploy.server.application.ParallelAdapter.makeAllPhasesLocalAndWait(ParallelAdapter.java:250)
                    at com.sap.engine.services.deploy.server.DeployServiceImpl.startApplicationLocalAndWait(DeployServiceImpl.java:4450)
                    at com.sap.engine.services.deploy.server.DeployServiceImpl.startApplicationsInitially(DeployServiceImpl.java:2610)
                    at com.sap.engine.services.deploy.server.DeployServiceImpl.clusterElementReady(DeployServiceImpl.java:2464)
                    at com.sap.engine.services.deploy.server.ClusterServicesAdapter.containerStarted(ClusterServicesAdapter.java:42)
                    at com.sap.engine.core.service630.container.ContainerEventListenerWrapper.processEvent(ContainerEventListenerWrapper.java:144)
                    at com.sap.engine.core.service630.container.AdminContainerEventListenerWrapper.processEvent(AdminContainerEventListenerWrapper.java:19)
                    at com.sap.engine.core.service630.container.ContainerEventListenerWrapper.run(ContainerEventListenerWrapper.java:102)
                    at com.sap.engine.frame.core.thread.Task.run(Task.java:64)
                    at com.sap.engine.core.thread.impl5.SingleThread.execute(SingleThread.java:79)
                    at com.sap.engine.core.thread.impl5.SingleThread.run(SingleThread.java:150)
    Caused by: com.sap.engine.services.connector.exceptions.BaseResourceException: ConnectionFactory "QueueConnectionFactory" does not exist. Possible reasons: the connector in which ConnectionFactory "QueueConnectionFactory" is defined is not deployed or not started.
                    at com.sap.engine.services.connector.ResourceObjectFactory.getObjectInstance(ResourceObjectFactory.java:207)
                    at com.sap.engine.system.naming.provider.ObjectFactoryBuilderImpl._getObjectInstance(ObjectFactoryBuilderImpl.java:72)
                    at com.sap.engine.system.naming.provider.ObjectFactoryBuilderImpl.access$100(ObjectFactoryBuilderImpl.java:31)
                    at com.sap.engine.system.naming.provider.ObjectFactoryBuilderImpl$DispatchObjectFactory.getObjectInstance(ObjectFactoryBuilderImpl.java:210)
                    at javax.naming.spi.NamingManager.getObjectInstance(NamingManager.java:280)
                    at com.sap.engine.services.jndi.implclient.ClientContext.lookup(ClientContext.java:414)
                    ... 24 more
    #1.5 #001CC4695AD80018000000030000171400045DBBE9BDBF4A#1228961568753#com.sap.engine.services.deploy##com.sap.engine.services.deploy######27cee540c72911ddb4ee001cc4695ad8#SAPEngine_System_Thread[impl:5]_25##0#0#Error#1#/System/Server#Java#deploy_5029##Exception in operation startApp with application halliburton.com/halusrgrpap.#2#startApp#halliburton.com/halusrgrpap#
    #1.5 #001CC4695AD80018000000040000171400045DBBE9BDC46C#1228961568753#com.sap.engine.services.deploy##com.sap.engine.services.deploy######27cee540c72911ddb4ee001cc4695ad8#SAPEngine_System_Thread[impl:5]_25##0#0#Error#1#/System/Audit#Java###Exception #1#com.sap.engine.services.deploy.exceptions.ServerDeploymentException: Exception in operation startApp with application halliburton.com/hal~usrgrpap.
                    at com.sap.engine.services.deploy.server.application.ApplicationTransaction.rollbackPart(ApplicationTransaction.java:394)
                    at com.sap.engine.services.deploy.server.application.ApplicationTransaction.makeAllPhasesLocal(ApplicationTransaction.java:367)
                    at com.sap.engine.services.deploy.server.application.ParallelAdapter.runInTheSameThread(ParallelAdapter.java:132)
                    at com.sap.engine.services.deploy.server.application.ParallelAdapter.makeAllPhasesLocalAndWait(ParallelAdapter.java:250)
                    at com.sap.engine.services.deploy.server.DeployServiceImpl.startApplicationLocalAndWait(DeployServiceImpl.java:4450)
                    at com.sap.engine.services.deploy.server.DeployServiceImpl.startApplicationsInitially(DeployServiceImpl.java:2610)
                    at com.sap.engine.services.deploy.server.DeployServiceImpl.clusterElementReady(DeployServiceImpl.java:2464)
                    at com.sap.engine.services.deploy.server.ClusterServicesAdapter.containerStarted(ClusterServicesAdapter.java:42)
                    at com.sap.engine.core.service630.container.ContainerEventListenerWrapper.processEvent(ContainerEventListenerWrapper.java:144)
                    at com.sap.engine.core.service630.container.AdminContainerEventListenerWrapper.processEvent(AdminContainerEventListenerWrapper.java:19)
                    at com.sap.engine.core.service630.container.ContainerEventListenerWrapper.run(ContainerEventListenerWrapper.java:102)
                    at com.sap.engine.frame.core.thread.Task.run(Task.java:64)
                    at com.sap.engine.core.thread.impl5.SingleThread.execute(SingleThread.java:79)
                    at com.sap.engine.core.thread.impl5.SingleThread.run(SingleThread.java:150)
    Caused by: com.sap.engine.services.ejb.exceptions.deployment.EJBDeploymentException: Exception during the initialization of container boot class com.halliburton.esg.eas.sec.prtusrgrpprocessing.MDBPrtUsrGrpProcBean0_0ContainerFP.
                    at com.sap.engine.services.ejb.EJBAdmin.prepareLoad(EJBAdmin.java:1013)
                    at com.sap.engine.services.ejb.EJBAdmin.prepareStart(EJBAdmin.java:2443)
                    at com.sap.engine.services.deploy.server.application.StartTransaction.prepareCommon(StartTransaction.java:223)
                    at com.sap.engine.services.deploy.server.application.StartTransaction.prepareLocal(StartTransaction.java:176)
                    at com.sap.engine.services.deploy.server.application.ApplicationTransaction.makeAllPhasesLocal(ApplicationTransaction.java:365)
                    ... 12 more
    Caused by: com.sap.engine.services.ejb.ContainerInitializationException: Cannot initialize message system bridge com.sap.engine.services.ejb.message.JMSBridgeFP.
                    at com.sap.engine.services.ejb.message.MessageContainer.load(MessageContainer.java:451)
                    at com.sap.engine.services.ejb.message.MessageContainer.init(MessageContainer.java:153)
                    at com.sap.engine.services.ejb.message.MessageContainerFP.init(MessageContainerFP.java:53)
                    at com.sap.engine.services.ejb.EJBAdmin.prepareLoad(EJBAdmin.java:1007)
                    ... 16 more
    Caused by: com.sap.engine.services.ejb.message.JMSBridgeException: Destination name PortalUserGroupProcessingQueue not found in the naming.
                    at com.sap.engine.services.ejb.message.JMSBridge.registerListener(JMSBridge.java:129)
                    at com.sap.engine.services.ejb.message.MessageContainer.load(MessageContainer.java:449)
                    ... 19 more
    Caused by: com.sap.engine.services.jndi.persistent.exceptions.NamingException: Exception during lookup operation of object with name ejbContainer/mdb/halliburton.com/hal~usrgrpap/QueueConnectionFactory, cannot resolve object reference. [Root exception is com.sap.engine.services.connector.exceptions.BaseResourceException: ConnectionFactory "QueueConnectionFactory" does not exist. Possible reasons: the connector in which ConnectionFactory "QueueConnectionFactory" is defined is not deployed or not started.]
                    at com.sap.engine.services.jndi.implclient.ClientContext.lookup(ClientContext.java:529)
                    at com.sap.engine.services.jndi.implclient.ClientContext.lookup(ClientContext.java:639)
                    at javax.naming.InitialContext.lookup(InitialContext.java:347)
                    at javax.naming.InitialContext.lookup(InitialContext.java:347)
                    at com.sap.engine.services.ejb.message.JMSBridge.registerListener(JMSBridge.java:115)
                    ... 20 more
    Caused by: com.sap.engine.services.connector.exceptions.BaseResourceException: ConnectionFactory "QueueConnectionFactory" does not exist. Possible reasons: the connector in which ConnectionFactory "QueueConnectionFactory" is defined is not deployed or not started.
                    at com.sap.engine.services.connector.ResourceObjectFactory.getObjectInstance(ResourceObjectFactory.java:207)
                    at com.sap.engine.system.naming.provider.ObjectFactoryBuilderImpl._getObjectInstance(ObjectFactoryBuilderImpl.java:72)
                    at com.sap.engine.system.naming.provider.ObjectFactoryBuilderImpl.access$100(ObjectFactoryBuilderImpl.java:31)
                    at com.sap.engine.system.naming.provider.ObjectFactoryBuilderImpl$DispatchObjectFactory.getObjectInstance(ObjectFactoryBuilderImpl.java:210)
                    at javax.naming.spi.NamingManager.getObjectInstance(NamingManager.java:280)
                    at com.sap.engine.services.jndi.implclient.ClientContext.lookup(ClientContext.java:414)
                    ... 24 more
    #1.5 #001CC4695AD80018000000060000171400045DBBE9BE0AF5#1228961568769#com.sap.engine.services.deploy##com.sap.engine.services.deploy######27cee540c72911ddb4ee001cc4695ad8#SAPEngine_System_Thread[impl:5]_25##0#0#Error#1#/System/Server#Plain###
    Operation startApp over application halliburton.com/hal~usrgrpap finished with errors on server 105677750. For more detailed information see traces of Deploy Service.#
    #1.5 #001CC4695AD80018000000080000171400045DBBE9BE27D1#1228961568769#com.sap.engine.services.ejb##com.sap.engine.services.ejb######27cee540c72911ddb4ee001cc4695ad8#SAPEngine_System_Thread[impl:5]_25##0#0#Error#1#/System/Server#Java#ejb_2119##Exception during the initialization of container boot class com.halliburton.esg.eas.sec.prtusrgrpprocessing.MDBPrtUsrGrpProcBean0_0ContainerFP.#1#com.halliburton.esg.eas.sec.prtusrgrpprocessing.MDBPrtUsrGrpProcBean0_0ContainerFP#
    #1.5 #001CC4695AD80018000000090000171400045DBBE9BE2842#1228961568769#com.sap.engine.services.ejb##com.sap.engine.services.ejb######27cee540c72911ddb4ee001cc4695ad8#SAPEngine_System_Thread[impl:5]_25##0#0#Error#1#/System/Audit#Java###Exception #1#com.sap.engine.services.ejb.exceptions.deployment.EJBDeploymentException: Exception during the initialization of container boot class com.halliburton.esg.eas.sec.prtusrgrpprocessing.MDBPrtUsrGrpProcBean0_0ContainerFP.
                    at com.sap.engine.services.ejb.EJBAdmin.prepareLoad(EJBAdmin.java:1013)
                    at com.sap.engine.services.ejb.EJBAdmin.prepareStart(EJBAdmin.java:2443)
                    at com.sap.engine.services.deploy.server.application.StartTransaction.prepareCommon(StartTransaction.java:223)
                    at com.sap.engine.services.deploy.server.application.StartTransaction.prepareLocal(StartTransaction.java:176)
                    at com.sap.engine.services.deploy.server.application.ApplicationTransaction.makeAllPhasesLocal(ApplicationTransaction.java:365)
                    at com.sap.engine.services.deploy.server.application.ParallelAdapter.runInTheSameThread(ParallelAdapter.java:132)
                    at com.sap.engine.services.deploy.server.application.ParallelAdapter.makeAllPhasesLocalAndWait(ParallelAdapter.java:250)
                    at com.sap.engine.services.deploy.server.DeployServiceImpl.startApplicationLocalAndWait(DeployServiceImpl.java:4450)
                    at com.sap.engine.services.deploy.server.DeployServiceImpl.startApplicationsInitially(DeployServiceImpl.java:2610)
                    at com.sap.engine.services.deploy.server.DeployServiceImpl.clusterElementReady(DeployServiceImpl.java:2464)
                    at com.sap.engine.services.deploy.server.ClusterServicesAdapter.containerStarted(ClusterServicesAdapter.java:42)
                    at com.sap.engine.core.service630.container.ContainerEventListenerWrapper.processEvent(ContainerEventListenerWrapper.java:144)
                    at com.sap.engine.core.service630.container.AdminContainerEventListenerWrapper.processEvent(AdminContainerEventListenerWrapper.java:19)
                    at com.sap.engine.core.service630.container.ContainerEventListenerWrapper.run(ContainerEventListenerWrapper.java:102)
                    at com.sap.engine.frame.core.thread.Task.run(Task.java:64)
                    at com.sap.engine.core.thread.impl5.SingleThread.execute(SingleThread.java:79)
                    at com.sap.engine.core.thread.impl5.SingleThread.run(SingleThread.java:150)
    Caused by: com.sap.engine.services.ejb.ContainerInitializationException: Cannot initialize message system bridge com.sap.engine.services.ejb.message.JMSBridgeFP.
                    at com.sap.engine.services.ejb.message.MessageContainer.load(MessageContainer.java:451)
                    at com.sap.engine.services.ejb.message.MessageContainer.init(MessageContainer.java:153)
                    at com.sap.engine.services.ejb.message.MessageContainerFP.init(MessageContainerFP.java:53)
                    at com.sap.engine.services.ejb.EJBAdmin.prepareLoad(EJBAdmin.java:1007)
                    ... 16 more
    Caused by: com.sap.engine.services.ejb.message.JMSBridgeException: Destination name PortalUserGroupProcessingQueue not found in the naming.
                    at com.sap.engine.services.ejb.message.JMSBridge.registerListener(JMSBridge.java:129)
                    at com.sap.engine.services.ejb.message.MessageContainer.load(MessageContainer.java:449)
                    ... 19 more
    Caused by: com.sap.engine.services.jndi.persistent.exceptions.NamingException: Exception during lookup operation of object with name ejbContainer/mdb/halliburton.com/hal~usrgrpap/QueueConnectionFactory, cannot resolve object reference. [Root exception is com.sap.engine.services.connector.exceptions.BaseResourceException: ConnectionFactory "QueueConnectionFactory" does not exist. Possible reasons: the connector in which ConnectionFactory "QueueConnectionFactory" is defined is not deployed or not started.]
                    at com.sap.engine.services.jndi.implclient.ClientContext.lookup(ClientContext.java:529)
                    at com.sap.engine.services.jndi.implclient.ClientContext.lookup(ClientContext.java:639)
                    at javax.naming.InitialContext.lookup(InitialContext.java:347)
                    at javax.naming.InitialContext.lookup(InitialContext.java:347)
                    at com.sap.engine.services.ejb.message.JMSBridge.registerListener(JMSBridge.java:115)
                    ... 20 more
    Caused by: com.sap.engine.services.connector.exceptions.BaseResourceException: ConnectionFactory "QueueConnectionFactory" does not exist. Possible reasons: the connector in which ConnectionFactory "QueueConnectionFactory" is defined is not deployed or not started.
                    at com.sap.engine.services.connector.ResourceObjectFactory.getObjectInstance(ResourceObjectFactory.java:207)
                    at com.sap.engine.system.naming.provider.ObjectFactoryBuilderImpl._getObjectInstance(ObjectFactoryBuilderImpl.java:72)
                    at com.sap.engine.system.naming.provider.ObjectFactoryBuilderImpl.access$100(ObjectFactoryBuilderImpl.java:31)
                    at com.sap.engine.system.naming.provider.ObjectFactoryBuilderImpl$DispatchObjectFactory.getObjectInstance(ObjectFactoryBuilderImpl.java:210)
                    at javax.naming.spi.NamingManager.getObjectInstance(NamingManager.java:280)
                    at com.sap.engine.services.jndi.implclient.ClientContext.lookup(ClientContext.java:414)
                    ... 24 more
    #1.5 #001CC4695AD80019000000000000171400045DBBEB38B908#1228961593581#com.sap.jpe.engine.impl.common.AnalyzerModel#sap.com/com.sapportals.supportplatform#com.sap.jpe.engine.impl.common.AnalyzerModel#Administrator#67####43c8e9d0c72911ddcedd001cc4695ad8#SAPEngine_Application_Thread[impl:3]_38##0#0#Error##Plain###Exception while loading class: com.sapportals.supportplatform.plugins.portal.connectors.ConnectorGatewayServiceCheck
    java.lang.NoClassDefFoundError: com/sapportals/portal/prt/resource/ResourceException
                    at java.lang.Class.getDeclaredConstructors0(Native Method)
                    at java.lang.Class.privateGetDeclaredConstructors(Class.java:1618)
                    at java.lang.Class.getConstructor0(Class.java:1930)
                    at java.lang.Class.newInstance0(Class.java:278)
                    at java.lang.Class.newInstance(Class.java:261)
                    at com.sap.jpe.engine.impl.pluginloading.PluginCollector.loadClass(PluginCollector.java:881)
                    at com.sap.jpe.engine.impl.pluginloading.PluginCollector.getPluginDescFromXMLFile(PluginCollector.java:387)
                    at com.sap.jpe.engine.impl.pluginloading.PluginCollector.getPluginDescFromXMLFile(PluginCollector.java:274)
                    at com.sap.jpe.engine.impl.pluginloading.PluginCollector.loadPluginsFromJarFile(PluginCollector.java:169)
                    at com.sap.jpe.engine.impl.pluginloading.PluginCollector.loadFromExtDirectory(PluginCollector.java:121)
                    at com.sap.jpe.engine.impl.common.AnalyzerModel.loadPlugins(AnalyzerModel.java:411)
                    at com.sap.jpe.engine.impl.common.AnalyzerModel.loadPlugins(AnalyzerModel.java:399)
                    at com.sapportals.supportplatform.SupportPlatform.init(SupportPlatform.java:81)
                    at com.sap.engine.services.servlets_jsp.server.security.PrivilegedActionImpl.run(PrivilegedActionImpl.java:59)
                    at java.security.AccessController.doPrivileged(Native Method)
                    at javax.security.auth.Subject.doAs(Subject.java:379)
                    at com.sap.engine.services.servlets_jsp.server.runtime.context.WebComponents.addServlet(WebComponents.java:141)
                    at com.sap.engine.services.servlets_jsp.server.container.ApplicationThreadInitializer.loadServlets(ApplicationThreadInitializer.java:386)
                    at com.sap.engine.services.servlets_jsp.server.container.ApplicationThreadInitializer.run(ApplicationThreadInitializer.java:110)
                    at com.sap.engine.core.thread.impl3.ActionObject.run(ActionObject.java:37)
                    at java.security.AccessController.doPrivileged(Native Method)
                    at com.sap.engine.core.thread.impl3.SingleThread.execute(SingleThread.java:100)
                    at com.sap.engine.core.thread.impl3.SingleThread.run(SingleThread.java:170)

    I though the same thing, but XE LISTENER is running on localhost and port 1522. On the other hand XE have local_listener explicitly set to the very same connection descriptor. Even XE installation was second on this server.
    I've could change that yes, but the startup script doesn't seemed to have this mind.
    Regards,
    Sve

  • Itunes does not start after update to 10.6.8

    Hi,
    Itunes creates problems and hangs and does not start....
    After trying to force quit, i get this report.
    Could someone help me please?
    Date/Time:       2012-12-05 06:47:07 +0100
    OS Version:      10.6.8 (Build 10K549)
    Architecture:    x86_64
    Report Version:  7
    Command:         iTunes
    Path:            /Applications/iTunes.app/Contents/MacOS/iTunes
    Version:         11.0 (11.0)
    Build Version:   1
    Project Name:    iTunes
    Source Version:  1100099063000000
    Parent:          launchd [220]
    PID:             6042
    Event:           hang
    Duration:        9.93s (sampling started after 2 seconds)
    Steps:           59 (100ms sampling interval)
    Pageins:         0
    Pageouts:        0
    Process:         iTunes [6042]
    Path:            /Applications/iTunes.app/Contents/MacOS/iTunes
    UID:             501
      Thread c55c       DispatchQueue 100
      User stack:
        59 ??? (in iTunes + 10645) [0x3995]
          59 ??? (in iTunes + 11030) [0x3b16]
            59 -[NSApplication run] + 821 (in AppKit) [0x9191c1f3]
              59 -[NSApplication nextEventMatchingMask:untilDate:inMode:dequeue:] + 156 (in AppKit) [0x91959dd6]
                59 _DPSNextEvent + 847 (in AppKit) [0x9195a595]
                  59 BlockUntilNextEventMatchingListInMode + 81 (in HIToolbox) [0x94268a3e]
                    59 ReceiveNextEventCommon + 158 (in HIToolbox) [0x94268af5]
                      59 RunCurrentEventLoopInMode + 392 (in HIToolbox) [0x94268e04]
                        59 CFRunLoopRunInMode + 97 (in CoreFoundation) [0x945951f1]
                          59 CFRunLoopRunSpecific + 452 (in CoreFoundation) [0x945953c4]
                            59 __CFRunLoopRun + 6523 (in CoreFoundation) [0x9459743b]
                              59 __CFMachPortPerform + 198 (in CoreFoundation) [0x9459b646]
                                59 _DASessionCallback + 339 (in DiskArbitration) [0x90d7f3ec]
                                  59 _DADispatchCallback + 260 (in DiskArbitration) [0x90d7f7c0]
                                    59 ??? (in iTunes + 318572) [0x4ec6c]
                                      59 CFURLGetFSRef + 34 (in CoreFoundation) [0x9459c412]
                                        59 _CFGetFSRefFromURL + 767 (in CoreFoundation) [0x9459c71f]
                                          59 __CFCarbonCore_FSPathMakeRef + 68 (in CoreFoundation) [0x9459c9d4]
                                            59 FSPathMakeRef + 47 (in CarbonCore) [0x9a967c20]
                                              59 FSPathMakeRefInternal(unsigned char const*, unsigned long, unsigned long, FSRef*, unsigned char*) + 134 (in CarbonCore) [0x9a967ca8]
                                                59 PathGetObjectInfo(char const*, unsigned long, unsigned long, short*, unsigned long*, unsigned long*, char*, unsigned long*, unsigned char*) + 250 (in CarbonCore) [0x9a967e68]
                                                  59 getattrlist$UNIX2003 + 10 (in libSystem.B.dylib) [0x979d7546]
      Kernel stack:
        59 lo_unix_scall + 280 [0x2a1fd8]
          59 unix_syscall + 579 [0x4f7f90]
            59 getattrlist + 127 [0x2cbaa2]
              59 namei + 1262 [0x2dba8a]
                59 lookup + 1392 [0x2daf2e]
                  59 vfs_busy + 121 [0x2e21be]
                    59 msleep + 157 [0x49149d]
                      59 wakeup + 334 [0x490daa]
                        59 lck_mtx_sleep + 87 [0x221d42]
                          59 thread_block + 33 [0x227654]
                            59 thread_block_reason + 331 [0x2275c6]
                              59 thread_dispatch + 1966 [0x227327]
                                59 machine_switch_context + 659 [0x2a9adb]
      Thread c561       DispatchQueue 1634545000
      User stack:
        59 start_wqthread + 30 (in libSystem.B.dylib) [0x979ce5c6]
          59 _pthread_wqthread + 390 (in libSystem.B.dylib) [0x979ce781]
            59 _dispatch_worker_thread2 + 240 (in libSystem.B.dylib) [0x979cecfe]
              59 _dispatch_queue_invoke + 163 (in libSystem.B.dylib) [0x979cef59]
                59 kevent + 10 (in libSystem.B.dylib) [0x979cf382]
      Kernel stack:
        59 kevent + 97 [0x47a699]
      Thread c565     
      User stack:
        59 thread_start + 34 (in libSystem.B.dylib) [0x979d60de]
          59 _pthread_start + 345 (in libSystem.B.dylib) [0x979d6259]
            59 ??? (in iTunes + 11491728) [0xaf6990]
              59 ??? (in iTunes + 33309) [0x921d]
                59 CFRunLoopRun + 84 (in CoreFoundation) [0x9459b304]
                  59 CFRunLoopRunSpecific + 452 (in CoreFoundation) [0x945953c4]
                    59 __CFRunLoopRun + 2079 (in CoreFoundation) [0x945962df]
                      59 mach_msg_trap + 10 (in libSystem.B.dylib) [0x979a8afa]
      Kernel stack:
        59 ipc_mqueue_receive_continue + 0 [0x210d84]
      Thread c56f     
      User stack:
        59 thread_start + 34 (in libSystem.B.dylib) [0x979d60de]
          59 _pthread_start + 345 (in libSystem.B.dylib) [0x979d6259]
            59 ??? (in iTunes + 11491728) [0xaf6990]
              59 ??? (in iTunes + 116755) [0x1d813]
                59 ??? (in iTunes + 117949) [0x1dcbd]
                  59 ??? (in iTunes + 33754) [0x93da]
                    59 pthread_cond_wait$UNIX2003 + 73 (in libSystem.B.dylib) [0x979d83f8]
                      59 __semwait_signal + 10 (in libSystem.B.dylib) [0x979d6aa2]
      Kernel stack:
        59 semaphore_wait_continue + 0 [0x22a88f]
      Thread c571     
      User stack:
        59 thread_start + 34 (in libSystem.B.dylib) [0x979d60de]
          59 _pthread_start + 345 (in libSystem.B.dylib) [0x979d6259]
            59 ??? (in iTunes + 11491728) [0xaf6990]
              59 ??? (in iTunes + 240485) [0x3bb65]
                59 CFRunLoopRun + 84 (in CoreFoundation) [0x9459b304]
                  59 CFRunLoopRunSpecific + 452 (in CoreFoundation) [0x945953c4]
                    59 __CFRunLoopRun + 2079 (in CoreFoundation) [0x945962df]
                      59 mach_msg_trap + 10 (in libSystem.B.dylib) [0x979a8afa]
      Kernel stack:
        59 ipc_mqueue_receive_continue + 0 [0x210d84]
      Binary Images:
          0x1000 -  0x1351fdf  com.apple.iTunes 11.0 (11.0) <A1FDDD7E-7FEA-32AE-B313-E12C5E54AA3E> /Applications/iTunes.app/Contents/MacOS/iTunes
      0x90d7d000 - 0x90d86ff7  com.apple.DiskArbitration 2.3 (2.3) <E9C40767-DA6A-6CCB-8B00-2D5706753000> /System/Library/Frameworks/DiskArbitration.framework/Versions/A/DiskArbitration
      0x91912000 - 0x921f5ff7  com.apple.AppKit 6.6.8 (1038.36) <A353465E-CFC9-CB75-949D-786F6F7732F6> /System/Library/Frameworks/AppKit.framework/Versions/C/AppKit
      0x94234000 - 0x94558fef  com.apple.HIToolbox 1.6.5 (???) <21164164-41CE-61DE-C567-32E89755CB34> /System/Library/Frameworks/Carbon.framework/Versions/A/Frameworks/HIToolbox.fra mework/Versions/A/HIToolbox
      0x94559000 - 0x946d4fe7  com.apple.CoreFoundation 6.6.6 (550.44) <F88C95CD-1264-782D-A1F5-204739847E93> /System/Library/Frameworks/CoreFoundation.framework/Versions/A/CoreFoundation
      0x979a8000 - 0x97b4fff7  libSystem.B.dylib ??? (???) <2DCD13E3-1BD1-6F25-119A-3863A3848B90> /usr/lib/libSystem.B.dylib
      0x9a957000 - 0x9ac77ff3  com.apple.CoreServices.CarbonCore 861.39 (861.39) <5C59805C-AF39-9010-B8B5-D673C9C38538> /System/Library/Frameworks/CoreServices.framework/Versions/A/Frameworks/CarbonC ore.framework/Versions/A/CarbonCore
    Process:         AirPort Base Station Agent [248]
    Path:            /System/Library/CoreServices/AirPort Base Station Agent.app/Contents/MacOS/AirPort Base Station Agent
    UID:             501
      Thread 3e8        DispatchQueue 1
      User stack:
        59 ??? (in AirPort Base Station Agent + 5692) [0x10000163c]
          59 NSApplicationMain + 364 (in AppKit) [0x7fff825273b0]
            59 -[NSApplication run] + 395 (in AppKit) [0x7fff8252e68f]
              59 -[NSApplication nextEventMatchingMask:untilDate:inMode:dequeue:] + 155 (in AppKit) [0x7fff82568801]
                59 _DPSNextEvent + 708 (in AppKit) [0x7fff82568eb2]
                  59 BlockUntilNextEventMatchingListInMode + 59 (in HIToolbox) [0x7fff83f314ac]
                    59 ReceiveNextEventCommon + 310 (in HIToolbox) [0x7fff83f315f3]
                      59 RunCurrentEventLoopInMode + 333 (in HIToolbox) [0x7fff83f317ee]
                        59 CFRunLoopRunSpecific + 575 (in CoreFoundation) [0x7fff86f1ad8f]
                          59 __CFRunLoopRun + 1698 (in CoreFoundation) [0x7fff86f1b902]
                            59 mach_msg_trap + 10 (in libSystem.B.dylib) [0x7fff8829ad7a]
      Kernel stack:
        59 ipc_mqueue_receive_continue + 0 [0x210d84]
      Thread 40f        DispatchQueue 2
      User stack:
        59 start_wqthread + 13 (in libSystem.B.dylib) [0x7fff882b4aa5]
          59 _pthread_wqthread + 353 (in libSystem.B.dylib) [0x7fff882b4c08]
            59 _dispatch_worker_thread2 + 252 (in libSystem.B.dylib) [0x7fff882b52de]
              59 _dispatch_queue_invoke + 185 (in libSystem.B.dylib) [0x7fff882b57b4]
                59 kevent + 10 (in libSystem.B.dylib) [0x7fff882b3c0a]
      Kernel stack:
        59 kevent + 97 [0x47a699]
      Thread 42f      
      User stack:
        59 thread_start + 13 (in libSystem.B.dylib) [0x7fff882d3e89]
          59 _pthread_start + 331 (in libSystem.B.dylib) [0x7fff882d3fd6]
            59 select$DARWIN_EXTSN + 10 (in libSystem.B.dylib) [0x7fff882de932]
      Kernel stack:
        59 sleep + 52 [0x49115a]
      Thread 430      
      User stack:
        59 thread_start + 13 (in libSystem.B.dylib) [0x7fff882d3e89]
          59 _pthread_start + 331 (in libSystem.B.dylib) [0x7fff882d3fd6]
            59 ??? (in AirPort Base Station Agent + 117988) [0x10001cce4]
              59 ??? (in AirPort Base Station Agent + 106856) [0x10001a168]
                59 ??? (in AirPort Base Station Agent + 118817) [0x10001d021]
                  59 __semwait_signal + 10 (in libSystem.B.dylib) [0x7fff882d5a6a]
      Kernel stack:
        59 semaphore_wait_continue + 0 [0x22a88f]
      Binary Images:
             0x100000000 -        0x100027fff  com.apple.AirPortBaseStationAgent 1.5.5 (155.2) <00010203-0405-0607-0809-0A0B0C0D0E0F> /System/Library/CoreServices/AirPort Base Station Agent.app/Contents/MacOS/AirPort Base Station Agent
          0x7fff82525000 -     0x7fff82f1fff7  com.apple.AppKit 6.6.8 (1038.36) <4CFBE04C-8FB3-B0EA-8DDB-7E7D10E9D251> /System/Library/Frameworks/AppKit.framework/Versions/C/AppKit
          0x7fff83f03000 -     0x7fff84201fff  com.apple.HIToolbox 1.6.5 (???) <AD1C18F6-51CB-7E39-35DD-F16B1EB978A8> /System/Library/Frameworks/Carbon.framework/Versions/A/Frameworks/HIToolbox.fra mework/Versions/A/HIToolbox
          0x7fff86ecf000 -     0x7fff87046fe7  com.apple.CoreFoundation 6.6.6 (550.44) <BB4E5158-E47A-39D3-2561-96CB49FA82D4> /System/Library/Frameworks/CoreFoundation.framework/Versions/A/CoreFoundation
          0x7fff8829a000 -     0x7fff8845bfef  libSystem.B.dylib ??? (???) <9AB4F1D1-89DC-0E8A-DC8E-A4FE4D69DB69> /usr/lib/libSystem.B.dylib
    Process:         ajaxserver [280]
    Path:            /Applications/Hotspot Shield.app/Contents/Resources/ajaxserver
    Rosetta:         Yes
    UID:             0
    Process:         AppleSpell [1315]
    Path:            /System/Library/Services/AppleSpell.service/Contents/MacOS/AppleSpell
    UID:             501
      Thread 24f3       DispatchQueue 1
      User stack:
        59 ??? (in AppleSpell + 4816) [0x1000012d0]
          59 ??? (in AppleSpell + 5472) [0x100001560]
            59 -[NSSpellServer run] + 72 (in Foundation) [0x7fff80fc30de]
              59 CFRunLoopRun + 70 (in CoreFoundation) [0x7fff86f1ab16]
                59 CFRunLoopRunSpecific + 575 (in CoreFoundation) [0x7fff86f1ad8f]
                  59 __CFRunLoopRun + 1698 (in CoreFoundation) [0x7fff86f1b902]
                    59 mach_msg_trap + 10 (in libSystem.B.dylib) [0x7fff8829ad7a]
      Kernel stack:
        59 ipc_mqueue_receive_continue + 0 [0x210d84]
      Thread 24f5       DispatchQueue 2
      User stack:
        59 start_wqthread + 13 (in libSystem.B.dylib) [0x7fff882b4aa5]
          59 _pthread_wqthread + 353 (in libSystem.B.dylib) [0x7fff882b4c08]
            59 _dispatch_worker_thread2 + 252 (in libSystem.B.dylib) [0x7fff882b52de]
              59 _dispatch_queue_invoke + 185 (in libSystem.B.dylib) [0x7fff882b57b4]
                59 kevent + 10 (in libSystem.B.dylib) [0x7fff882b3c0a]
      Kernel stack:
        59 kevent + 97 [0x47a699]
      Binary Images:
             0x100000000 -        0x1000a9fe7  com.apple.AppleSpell 1.6.2 (62.2) <B3C504CB-5E66-639E-9F2A-2F184565496A> /System/Library/Services/AppleSpell.service/Contents/MacOS/AppleSpell
          0x7fff80f44000 -     0x7fff811c6fff  com.apple.Foundation 6.6.8 (751.63) <E10E4DB4-9D5E-54A8-3FB6-2A82426066E4> /System/Library/Frameworks/Foundation.framework/Versions/C/Foundation
          0x7fff86ecf000 -     0x7fff87046fe7  com.apple.CoreFoundation 6.6.6 (550.44) <BB4E5158-E47A-39D3-2561-96CB49FA82D4> /System/Library/Frameworks/CoreFoundation.framework/Versions/A/CoreFoundation
          0x7fff8829a000 -     0x7fff8845bfef  libSystem.B.dylib ??? (???) <9AB4F1D1-89DC-0E8A-DC8E-A4FE4D69DB69> /usr/lib/libSystem.B.dylib
    Process:         autofsd [43]
    Path:            /usr/libexec/autofsd
    UID:             0
      Thread 10b        DispatchQueue 1
      User stack:
        59 ??? (in autofsd + 5340) [0x1000014dc]
          59 ??? (in autofsd + 6461) [0x10000193d]
            59 CFRunLoopRun + 70 (in CoreFoundation) [0x7fff86f1ab16]
              59 CFRunLoopRunSpecific + 575 (in CoreFoundation) [0x7fff86f1ad8f]
                59 __CFRunLoopRun + 1698 (in CoreFoundation) [0x7fff86f1b902]
                  59 mach_msg_trap + 10 (in libSystem.B.dylib) [0x7fff8829ad7a]
      Kernel stack:
        59 ipc_mqueue_receive_continue + 0 [0x210d84]
      Thread 11d        DispatchQueue 2
      User stack:
        59 start_wqthread + 13 (in libSystem.B.dylib) [0x7fff882b4aa5]
          59 _pthread_wqthread + 353 (in libSystem.B.dylib) [0x7fff882b4c08]
            59 _dispatch_worker_thread2 + 252 (in libSystem.B.dylib) [0x7fff882b52de]
              59 _dispatch_queue_invoke + 185 (in libSystem.B.dylib) [0x7fff882b57b4]
                59 kevent + 10 (in libSystem.B.dylib) [0x7fff882b3c0a]
      Kernel stack:
        59 kevent + 97 [0x47a699]
      Binary Images:
             0x100000000 -        0x100001ff7  autofsd ??? (???) <E07FB03F-038C-D995-51F3-FF8A686F645B> /usr/libexec/autofsd
          0x7fff86ecf000 -     0x7fff87046fe7  com.apple.CoreFoundation 6.6.6 (550.44) <BB4E5158-E47A-39D3-2561-96CB49FA82D4> /System/Library/Frameworks/CoreFoundation.framework/Versions/A/CoreFoundation
          0x7fff8829a000 -     0x7fff8845bfef  libSystem.B.dylib ??? (???) <9AB4F1D1-89DC-0E8A-DC8E-A4FE4D69DB69> /usr/lib/libSystem.B.dylib
    Process:         blued [42]
    Path:            /usr/sbin/blued
    UID:             0
      Thread 10a        DispatchQueue 1
      User stack:
        59 ??? (in blued + 8264) [0x100002048]
          59 ??? (in blued + 154586) [0x100025bda]
            59 -[NSRunLoop(NSRunLoop) run] + 77 (in Foundation) [0x7fff80f8fa53]
              59 -[NSRunLoop(NSRunLoop) runMode:beforeDate:] + 270 (in Foundation) [0x7fff80f8fb74]
                59 CFRunLoopRunSpecific + 575 (in CoreFoundation) [0x7fff86f1ad8f]
                  59 __CFRunLoopRun + 1698 (in CoreFoundation) [0x7fff86f1b902]
                    59 mach_msg_trap + 10 (in libSystem.B.dylib) [0x7fff8829ad7a]
      Kernel stack:
        59 ipc_mqueue_receive_continue + 0 [0x210d84]
      Thread 18c        DispatchQueue 2
      User stack:
        59 start_wqthread + 13 (in libSystem.B.dylib) [0x7fff882b4aa5]
          59 _pthread_wqthread + 353 (in libSystem.B.dylib) [0x7fff882b4c08]
            59 _dispatch_worker_thread2 + 252 (in libSystem.B.dylib) [0x7fff882b52de]
              59 _dispatch_queue_invoke + 185 (in libSystem.B.dylib) [0x7fff882b57b4]
                59 kevent + 10 (in libSystem.B.dylib) [0x7fff882b3c0a]
      Kernel stack:
        59 kevent + 97 [0x47a699]
      Binary Images:
             0x100000000 -        0x100048fff  blued ??? (???) <AF7DA385-DB49-5034-7277-16E1CE3C45D6> /usr/sbin/blued
          0x7fff80f44000 -     0x7fff811c6fff  com.apple.Foundation 6.6.8 (751.63) <E10E4DB4-9D5E-54A8-3FB6-2A82426066E4> /System/Library/Frameworks/Foundation.framework/Versions/C/Foundation
          0x7fff86ecf000 -     0x7fff87046fe7  com.apple.CoreFoundation 6.6.6 (550.44) <BB4E5158-E47A-39D3-2561-96CB49FA82D4> /System/Library/Frameworks/CoreFoundation.framework/Versions/A/CoreFoundation
          0x7fff8829a000 -     0x7fff8845bfef  libSystem.B.dylib ??? (???) <9AB4F1D1-89DC-0E8A-DC8E-A4FE4D69DB69> /usr/lib/libSystem.B.dylib
    Process:         CCacheServer [6027]
    Path:            /System/Library/CoreServices/CCacheServer.app/Contents/MacOS/CCacheServer
    UID:             501
      Thread c2db       DispatchQueue 2
      User stack:
        59 start_wqthread + 13 (in libSystem.B.dylib) [0x7fff882b4aa5]
          59 _pthread_wqthread + 353 (in libSystem.B.dylib) [0x7fff882b4c08]
            59 _dispatch_worker_thread2 + 252 (in libSystem.B.dylib) [0x7fff882b52de]
              59 _dispatch_queue_invoke + 185 (in libSystem.B.dylib) [0x7fff882b57b4]
                59 kevent + 10 (in libSystem.B.dylib) [0x7fff882b3c0a]
      Kernel stack:
        59 kevent + 97 [0x47a699]
      Thread c2dd       DispatchQueue 6
      User stack:
        59 start_wqthread + 13 (in libSystem.B.dylib) [0x7fff882b4aa5]
          59 _pthread_wqthread + 353 (in libSystem.B.dylib) [0x7fff882b4c08]
            59 _dispatch_worker_thread2 + 239 (in libSystem.B.dylib) [0x7fff882b52d1]
              59 __sigsuspend_nocancel + 10 (in libSystem.B.dylib) [0x7fff8830d9ba]
      Kernel stack:
        59 sleep + 52 [0x49115a]
      Thread c759     
      User stack:
        30 start_wqthread + 13 (in libSystem.B.dylib) [0x7fff882b4aa5]
          30 __workq_kernreturn + 10 (in libSystem.B.dylib) [0x7fff882b4a2a]
      Kernel stack:
        30 bsdthread_create + 1313 [0x4d4581]
      Binary Images:
          0x7fff8829a000 -     0x7fff8845bfef  libSystem.B.dylib ??? (???) <9AB4F1D1-89DC-0E8A-DC8E-A4FE4D69DB69> /usr/lib/libSystem.B.dylib
    Process:         ClipMenu [265]
    Path:            /Applications/ClipMenu.app/Contents/MacOS/ClipMenu
    UID:             501
    Process:         configd [13]
    Path:            /usr/libexec/configd
    UID:             0
      Thread ca         DispatchQueue 1
      User stack:
        59 start + 52 (in configd) [0x100000d04]
          59 main + 2051 (in configd) [0x10000151a]
            59 server_loop + 72 (in configd) [0x100001d70]
              59 CFRunLoopRunSpecific + 575 (in CoreFoundation) [0x7fff86f1ad8f]
                59 __CFRunLoopRun + 1698 (in CoreFoundation) [0x7fff86f1b902]
                  59 mach_msg_trap + 10 (in libSystem.B.dylib) [0x7fff8829ad7a]
      Kernel stack:
        59 ipc_mqueue_receive_continue + 0 [0x210d84]
      Thread cb         DispatchQueue 2
      User stack:
        59 start_wqthread + 13 (in libSystem.B.dylib) [0x7fff882b4aa5]
          59 _pthread_wqthread + 353 (in libSystem.B.dylib) [0x7fff882b4c08]
            59 _dispatch_worker_thread2 + 252 (in libSystem.B.dylib) [0x7fff882b52de]
              59 _dispatch_queue_invoke + 185 (in libSystem.B.dylib) [0x7fff882b57b4]
                59 kevent + 10 (in libSystem.B.dylib) [0x7fff882b3c0a]
      Kernel stack:
        59 kevent + 97 [0x47a699]
      Thread cd       
      User stack:
        59 thread_start + 13 (in libSystem.B.dylib) [0x7fff882d3e89]
          59 _pthread_start + 331 (in libSystem.B.dylib) [0x7fff882d3fd6]
            59 plugin_exec + 1440 (in configd) [0x1000034d7]
              59 CFRunLoopRun + 70 (in CoreFoundation) [0x7fff86f1ab16]
                59 CFRunLoopRunSpecific + 575 (in CoreFoundation) [0x7fff86f1ad8f]
                  59 __CFRunLoopRun + 1698 (in CoreFoundation) [0x7fff86f1b902]
                    59 mach_msg_trap + 10 (in libSystem.B.dylib) [0x7fff8829ad7a]
      Kernel stack:
        59 ipc_mqueue_receive_continue + 0 [0x210d84]
      Thread d5       
      User stack:
        59 thread_start + 13 (in libSystem.B.dylib) [0x7fff882d3e89]
          59 _pthread_start + 331 (in libSystem.B.dylib) [0x7fff882d3fd6]
            59 _io_pm_force_active_settings + 2271 (in PowerManagement) [0x1000ac3a1]
              59 CFRunLoopRun + 70 (in CoreFoundation) [0x7fff86f1ab16]
                59 CFRunLoopRunSpecific + 575 (in CoreFoundation) [0x7fff86f1ad8f]
                  59 __CFRunLoopRun + 1698 (in CoreFoundation) [0x7fff86f1b902]
                    59 mach_msg_trap + 10 (in libSystem.B.dylib) [0x7fff8829ad7a]
      Kernel stack:
        59 ipc_mqueue_receive_continue + 0 [0x210d84]
      Thread 1c5      
      User stack:
        59 thread_start + 13 (in libSystem.B.dylib) [0x7fff882d3e89]
          59 _pthread_start + 331 (in libSystem.B.dylib) [0x7fff882d3fd6]
            59 select$DARWIN_EXTSN + 10 (in libSystem.B.dylib) [0x7fff882de932]
      Kernel stack:
        59 sleep + 52 [0x49115a]
      Thread 1c6      
      User stack:
        59 thread_start + 13 (in libSystem.B.dylib) [0x7fff882d3e89]
          59 _pthread_start + 331 (in libSystem.B.dylib) [0x7fff882d3fd6]
            59 pppcntl_run_thread + 1595 (in PPPController) [0x1005958f5]
              59 CFRunLoopRun + 70 (in CoreFoundation) [0x7fff86f1ab16]
                59 CFRunLoopRunSpecific + 575 (in CoreFoundation) [0x7fff86f1ad8f]
                  59 __CFRunLoopRun + 1698 (in CoreFoundation) [0x7fff86f1b902]
                    59 mach_msg_trap + 10 (in libSystem.B.dylib) [0x7fff8829ad7a]
      Kernel stack:
        59 ipc_mqueue_receive_continue + 0 [0x210d84]
      Thread c74b     
      User stack:
        50 start_wqthread + 13 (in libSystem.B.dylib) [0x7fff882b4aa5]
          50 __workq_kernreturn + 10 (in libSystem.B.dylib) [0x7fff882b4a2a]
      Kernel stack:
        50 bsdthread_create + 1313 [0x4d4581]
      Binary Images:
             0x100000000 -        0x100026ff7  configd ??? (???) <754E7289-CEF0-F696-2A99-8F66310FF370> /usr/libexec/configd
             0x1000a9000 -        0x1000baff7  com.apple.SystemConfiguration.PowerManagement 160.0.0 (160.0.0) <20F4D79D-1834-14C9-650C-C4B588B9E1B9> /System/Library/SystemConfiguration/PowerManagement.bundle/Contents/MacOS/Power Management
             0x100583000 -        0x1005acfff  com.apple.SystemConfiguration.PPPController 1.5 (1.5) <7A34D8E1-6EE2-AFBE-CC7A-4D91276AF7EA> /System/Library/SystemConfiguration/PPPController.bundle/Contents/MacOS/PPPCont roller
          0x7fff86ecf000 -     0x7fff87046fe7  com.apple.CoreFoundation 6.6.6 (550.44) <BB4E5158-E47A-39D3-2561-96CB49FA82D4> /System/Library/Frameworks/CoreFoundation.framework/Versions/A/CoreFoundation
          0x7fff8829a000 -     0x7fff8845bfef  libSystem.B.dylib ??? (???) <9AB4F1D1-89DC-0E8A-DC8E-A4FE4D69DB69> /usr/lib/libSystem.B.dylib
    Process:         coreaudiod [129]
    Path:            /usr/sbin/coreaudiod
    UID:             202
      Thread 228        DispatchQueue 1
      User stack:
        59 ??? (in coreaudiod + 5796) [0x1000016a4]
          59 ??? (in coreaudiod + 29152) [0x1000071e0]
            59 CFRunLoopRunSpecific + 575 (in CoreFoundation) [0x7fff86f1ad8f]
              59 __CFRunLoopRun + 1698 (in CoreFoundation) [0x7fff86f1b902]
                59 mach_msg_trap + 10 (in libSystem.B.dylib) [0x7fff8829ad7a]
      Kernel stack:
        59 ipc_mqueue_receive_continue + 0 [0x210d84]
      Thread 22b        DispatchQueue 2
      User stack:
        59 start_wqthread + 13 (in libSystem.B.dylib) [0x7fff882b4aa5]
          59 _pthread_wqthread + 353 (in libSystem.B.dylib) [0x7fff882b4c08]
            59 _dispatch_worker_thread2 + 252 (in libSystem.B.dylib) [0x7fff882b52de]
              59 _dispatch_queue_invoke + 185 (in libSystem.B.dylib) [0x7fff882b57b4]
                59 kevent + 10 (in libSystem.B.dylib) [0x7fff882b3c0a]
      Kernel stack:
        59 kevent + 97 [0x47a699]
      Thread 22d      
      User stack:
        59 thread_start + 13 (in libSystem.B.dylib) [0x7fff882d3e89]
          59 _pthread_start + 331 (in libSystem.B.dylib) [0x7fff882d3fd6]
            59 CAPThread::Entry(CAPThread*) + 125 (in CoreAudio) [0x7fff8151a755]
              59 HALRunLoop::OwnThread(void*) + 152 (in CoreAudio) [0x7fff8152d786]
                59 CFRunLoopRunSpecific + 575 (in CoreFoundation) [0x7fff86f1ad8f]
                  59 __CFRunLoopRun + 1698 (in CoreFoundation) [0x7fff86f1b902]
                    59 mach_msg_trap + 10 (in libSystem.B.dylib) [0x7fff8829ad7a]
      Kernel stack:
        59 ipc_mqueue_receive_continue + 0 [0x210d84]
      Thread c752     
      User stack:
        50 start_wqthread + 13 (in libSystem.B.dylib) [0x7fff882b4aa5]
          50 __workq_kernreturn + 10 (in libSystem.B.dylib) [0x7fff882b4a2a]
      Kernel stack:
        50 bsdthread_create + 1313 [0x4d4581]
      Binary Images:
             0x100000000 -        0x100020ff7  coreaudiod ??? (???) <4EB80719-479B-D842-286B-8EE9B9762353> /usr/sbin/coreaudiod
          0x7fff814fc000 -     0x7fff8157bfe7  com.apple.audio.CoreAudio 3.2.6 (3.2.6) <79E256EB-43F1-C7AA-6436-124A4FFB02D0> /System/Library/Frameworks/CoreAudio.framework/Versions/A/CoreAudio
          0x7fff86ecf000 -     0x7fff87046fe7  com.apple.CoreFoundation 6.6.6 (550.44) <BB4E5158-E47A-39D3-2561-96CB49FA82D4> /System/Library/Frameworks/CoreFoundation.framework/Versions/A/CoreFoundation
          0x7fff8829a000 -     0x7fff8845bfef  libSystem.B.dylib ??? (???) <9AB4F1D1-89DC-0E8A-DC8E-A4FE4D69DB69> /usr/lib/libSystem.B.dylib
    Process:         coreservicesd [59]
    Path:            /System/Library/CoreServices/coreservicesd
    UID:             0
      Thread 14f        DispatchQueue 1
      User stack:
        59 ??? (in coreservicesd + 3756) [0x100000eac]
          59 _CoreServicesServerMain + 522 (in CarbonCore) [0x7fff81277a56]
            59 CFRunLoopRun + 70 (in CoreFoundation) [0x7fff86f1ab16]
              59 CFRunLoopRunSpecific + 575 (in CoreFoundation) [0x7fff86f1ad8f]
                59 __CFRunLoopRun + 1698 (in CoreFoundation) [0x7fff86f1b902]
                  59 mach_msg_trap + 10 (in libSystem.B.dylib) [0x7fff8829ad7a]
      Kernel stack:
        59 ipc_mqueue_receive_continue + 0 [0x210d84]
      Thread 150        DispatchQueue 2
      User stack:
        59 start_wqthread + 13 (in libSystem.B.dylib) [0x7fff882b4aa5]
          59 _pthread_wqthread + 353 (in libSystem.B.dylib) [0x7fff882b4c08]
            59 _dispatch_worker_thread2 + 252 (in libSystem.B.dylib) [0x7fff882b52de]
              59 _dispatch_queue_invoke + 185 (in libSystem.B.dylib) [0x7fff882b57b4]
                59 kevent + 10 (in libSystem.B.dylib) [0x7fff882b3c0a]
      Kernel stack:
        59 kevent + 97 [0x47a699]
      Thread 189      
      User stack:
        59 thread_start + 13 (in libSystem.B.dylib) [0x7fff882d3e89]
          59 _pthread_start + 331 (in libSystem.B.dylib) [0x7fff882d3fd6]
            59 fmodWatchConsumer + 347 (in CarbonCore) [0x7fff8122b5e8]
              59 __semwait_signal + 10 (in libSystem.B.dylib) [0x7fff882d5a6a]
      Kernel stack:
        59 semaphore_wait_continue + 0 [0x22a88f]
      Thread 18a      
      User stack:
        59 thread_start + 13 (in libSystem.B.dylib) [0x7fff882d3e89]
          59 _pthread_start + 331 (in libSystem.B.dylib) [0x7fff882d3fd6]
            59 read + 10 (in libSystem.B.dylib) [0x7fff882a5466]
      Kernel stack:
        59 lo64_unix_scall + 77 [0x2a251d]
          59 unix_syscall64 + 617 [0x4f82fb]
            59 read_nocancel + 158 [0x49fd75]
              59 write + 312 [0x49f5f9]
                59 get_pathbuff + 3054 [0x308c1f]
                  59 tsleep + 105 [0x491395]
                    59 wakeup + 786 [0x490f6e]
                      59 thread_block + 33 [0x227654]
                        59 thread_block_reason + 331 [0x2275c6]
                          59 thread_dispatch + 1966 [0x227327]
                            59 machine_switch_context + 659 [0x2a9adb]
      Thread c756     
      User stack:
        50 start_wqthread + 13 (in libSystem.B.dylib) [0x7fff882b4aa5]
          50 __workq_kernreturn + 10 (in libSystem.B.dylib) [0x7fff882b4a2a]
      Kernel stack:
        50 bsdthread_create + 1313 [0x4d4581]
      Binary Images:
             0x100000000 -        0x100000fff  coreservicesd ??? (???) <2A6BD0A0-7DA6-ABE6-3D55-E260EA69F56F> /System/Library/CoreServices/coreservicesd
          0x7fff811c7000 -     0x7fff814fbfef  com.apple.CoreServices.CarbonCore 861.39 (861.39) <1386A24D-DD15-5903-057E-4A224FAF580B> /System/Library/Frameworks/CoreServices.framework/Versions/A/Frameworks/CarbonC ore.framework/Versions/A/CarbonCore
          0x7fff86ecf000 -     0x7fff87046fe7  com.apple.CoreFoundation 6.6.6 (550.44) <BB4E5158-E47A-39D3-2561-96CB49FA82D4> /System/Library/Frameworks/CoreFoundation.framework/Versions/A/CoreFoundation
          0x7fff8829a000 -     0x7fff8845bfef  libSystem.B.dylib ??? (???) <9AB4F1D1-89DC-0E8A-DC8E-A4FE4D69DB69> /usr/lib/libSystem.B.dylib
    Process:         cupsd [6028]
    Path:            /usr/sbin/cupsd
    UID:             0
      Thread c330       DispatchQueue 1
      User stack:
        59 ??? (in cupsd + 3304) [0x15bb22ce8]
          59 ??? (in cupsd + 109253) [0x15bb3cac5]
            59 kevent + 10 (in libSystem.B.dylib) [0x7fff882b3c0a]
      Kernel stack:
        59 kevent + 97 [0x47a699]
      Thread c332       DispatchQueue 2
      User stack:
        59 start_wqthread + 13 (in libSystem.B.dylib) [0x7fff882b4aa5]
          59 _pthread_wqthread + 353 (in libSystem.B.dylib) [0x7fff882b4c08]
            59 _dispatch_worker_thread2 + 252 (in libSystem.B.dylib) [0x7fff882b52de]
              59 _dispatch_queue_invoke + 185 (in libSystem.B.dylib) [0x7fff882b57b4]
                59 kevent + 10 (in libSystem.B.dylib) [0x7fff882b3c0a]
      Kernel stack:
        59 kevent + 97 [0x47a699]
      Thread c331     
      User stack:
        59 thread_start + 13 (in libSystem.B.dylib) [0x7fff882d3e89]
          59 _pthread_start + 331 (in libSystem.B.dylib) [0x7fff882d3fd6]
            59 ??? (in cupsd + 277569) [0x15bb65c41]
              59 CFRunLoopRun + 70 (in CoreFoundation) [0x7fff86f1ab16]
                59 CFRunLoopRunSpecific + 575 (in CoreFoundation) [0x7fff86f1ad8f]
                  59 __CFRunLoopRun + 1698 (in CoreFoundation) [0x7fff86f1b902]
                    59 mach_msg_trap + 10 (in libSystem.B.dylib) [0x7fff8829ad7a]
      Kernel stack:
        59 ipc_mqueue_receive_continue + 0 [0x210d84]
      Binary Images:
             0x15bb22000 -        0x15bb7dff7  cupsd ??? (???) <F78EAEDD-49F5-0E55-24D9-F762455B7F39> /usr/sbin/cupsd
          0x7fff86ecf000 -     0x7fff87046fe7  com.apple.CoreFoundation 6.6.6 (550.44) <BB4E5158-E47A-39D3-2561-96CB49FA82D4> /System/Library/Frameworks/CoreFoundation.framework/Versions/A/CoreFoundation
          0x7fff8829a000 -     0x7fff8845bfef  libSystem.B.dylib ??? (???) <9AB4F1D1-89DC-0E8A-DC8E-A4FE4D69DB69> /usr/lib/libSystem.B.dylib
    Process:         cvmsServ [181]
    Path:            /System/Library/Frameworks/OpenGL.framework/Versions/A/Libraries/cvmsServ
    UID:             0
      Thread 30a        DispatchQueue 1
      User stack:
        59 ??? (in cvmsServ + 4100) [0x100001004]
          59 ??? (in cvmsServ + 23081) [0x100005a29]
            59 mach_msg_server + 597 (in libSystem.B.dylib) [0x7fff88317a98]
              59 mach_msg_trap + 10 (in libSystem.B.dylib) [0x7fff8829ad7a]
      Kernel stack:
        59 ipc_mqueue_receive_continue + 0 [0x210d84]
      Binary Images:
             0x100000000 -        0x100008fff  cvmsServ ??? (???) <41E2CF71-FA15-9083-56F0-F2E14A7E3886> /System/Library/Frameworks/OpenGL.framework/Versions/A/Libraries/cvmsServ
          0x7fff8829a000 -     0x7fff8845bfef  libSystem.B.dylib ??? (???) <9AB4F1D1-89DC-0E8A-DC8E-A4FE4D69DB69> /usr/lib/libSystem.B.dylib
    Process:         DirectoryService [15]
    Path:            /usr/sbin/DirectoryService
    UID:             0
      Thread d4         DispatchQueue 1
      User stack:
        59 start + 52 (in DirectoryService) [0x10000d694]
          59 main + 3061 (in DirectoryService) [0x10000e291]
            59 CFRunLoopRun + 70 (in CoreFoundation) [0x7fff86f1ab16]
              59 CFRunLoopRunSpecific + 575 (in CoreFoundation) [0x7fff86f1ad8f]
                59 __CFRunLoopRun + 1698 (in CoreFoundation) [0x7fff86f1b902]
                  59 mach_msg_trap + 10 (in libSystem.B.dylib) [0x7fff8829ad7a]
      Kernel stack:
        59 ipc_mqueue_receive_continue + 0 [0x210d84]
      Thread dc         DispatchQueue 2
      User stack:
        59 start_wqthread + 13 (in libSystem.B.dylib) [0x7fff882b4aa5]
          59 _pthread_wqthread + 353 (in libSystem.B.dylib) [0x7fff882b4c08]
            59 _dispatch_worker_thread2 + 252 (in libSystem.B.dylib) [0x7fff882b52de]
              59 _dispatch_queue_invoke + 185 (in libSystem.B.dylib) [0x7fff882b57b4]
                59 kevent + 10 (in libSystem.B.dylib) [0x7fff882b3c0a]
      Kernel stack:
        59 kevent + 97 [0x47a699]
      Thread d9         DispatchQueue 8
      User stack:
        59 start_wqthread + 13 (in libSystem.B.dylib) [0x7fff882b4aa5]
          59 _pthread_wqthread + 353 (in libSystem.B.dylib) [0x7fff882b4c08]
            59 _dispatch_worker_thread2 + 239 (in libSystem.B.dylib) [0x7fff882b52d1]
              59 _dispatch_call_block_and_release + 15 (in libSystem.B.dylib) [0x7fff882d6d64]
                59 syscall + 10 (in libSystem.B.dylib) [0x7fff882d7362]
      Kernel stack:
        59 sleep + 52 [0x49115a]
      Thread 12a        DispatchQueue 8
      User stack:
        59 start_wqthread + 13 (in libSystem.B.dylib) [0x7fff882b4aa5]
          59 _pthread_wqthread + 353 (in libSystem.B.dylib) [0x7fff882b4c08]
            59 _dispatch_worker_thread2 + 239 (in libSystem.B.dylib) [0x7fff882b52d1]
              59 _dispatch_call_block_and_release + 15 (in libSystem.B.dylib) [0x7fff882d6d64]
                59 ____StartKernelListener_block_invoke_8 + 33 (in DirectoryService) [0x100028d93]
                  59 semaphore_wait_trap + 10 (in libSystem.B.dylib) [0x7fff8829adb6]
      Kernel stack:
        59 semaphore_wait_continue + 0 [0x22a88f]
      Thread db       
      User stack:
        59 thread_start + 13 (in libSystem.B.dylib) [0x7fff882d3e89]
          59 _pthread_start + 331 (in libSystem.B.dylib) [0x7fff882d3fd6]
            59 DSLThread::_RunWrapper(void*) + 67 (in DirectoryServiceCore) [0x10017a34b]
              59 DSCThread::Run() + 36 (in DirectoryServiceCore) [0x10017a0ac]
                59 CPluginRunLoopThread::ThreadMain() + 150 (in DirectoryService) [0x10001ce2c]
                  59 CFRunLoopRun + 70 (in CoreFoundation) [0x7fff86f1ab16]
                    59 CFRunLoopRunSpecific + 575 (in CoreFoundation) [0x7fff86f1ad8f]
                      59 __CFRunLoopRun + 1698 (in CoreFoundation) [0x7fff86f1b902]
                        59 mach_msg_trap + 10 (in libSystem.B.dylib) [0x7fff8829ad7a]
      Kernel stack:
        59 ipc_mqueue_receive_continue + 0 [0x210d84]
      Thread c74c     
      User stack:
        50 start_wqthread + 13 (in libSystem.B.dylib) [0x7fff882b4aa5]
          50 __workq_kernreturn + 10 (in libSystem.B.dylib) [0x7fff882b4a2a]
      Kernel stack:
        50 bsdthread_create + 1313 [0x4d4581]
      Thread c75b     
      User stack:
        5 start_wqthread + 13 (in libSystem.B.dylib) [0x7fff882b4aa5]
          5 __workq_kernreturn + 10 (in libSystem.B.dylib) [0x7fff882b4a2a]
      Kernel stack:
        5 bsdthread_create + 1313 [0x4d4581]
      Binary Images:
             0x100000000 -        0x100121ff7  DirectoryService ??? (???) <624DBC48-320B-1EA9-C541-78603F012365> /usr/sbin/DirectoryService
             0x100172000 -        0x100183fff  com.apple.DirectoryServiceCore.Framework 3.6 (621.15) <8C766451-56FB-0942-443B-9B68B6B8274D> /System/Library/PrivateFrameworks/DirectoryServiceCore.framework/Versions/A/Dir ectoryServiceCore
          0x7fff86ecf000 -     0x7fff87046fe7  com.apple.CoreFoundation 6.6.6 (550.44) <BB4E5158-E47A-39D3-2561-96CB49FA82D4> /System/Library/Frameworks/CoreFoundation.framework/Versions/A/CoreFoundation
          0x7fff8829a000 -     0x7fff8845bfef  libSystem.B.dylib ??? (???) <9AB4F1D1-89DC-0E8A-DC8E-A4FE4D69DB69> /usr/lib/libSystem.B.dylib
    Process:         diskarbitrationd [12]
    Path:            /usr/sbin/diskarbitrationd
    UID:             0
      Thread c9         DispatchQueue 1
      User stack:
        59 ??? (in diskarbitrationd + 4064) [0x100000fe0]
          59 ??? (in diskarbitrationd + 32876) [0x10000806c]
            59 CFRunLoopRun + 70 (in CoreFoundation) [0x7fff86f1ab16]
              59 CFRunLoopRunSpecific + 575 (in CoreFoundation) [0x7fff86f1ad8f]
                59 __CFRunLoopRun + 1698 (in CoreFoundation) [0x7fff86f1b902]
                  59 mach_msg_trap + 10 (in libSystem.B.dylib) [0x7fff8829ad7a]
      Kernel stack:
        59 ipc_mqueue_receive_continue + 0 [0x210d84]
      Thread ce         DispatchQueue 2
      User stack:
        59 start_wqthread + 13 (in libSystem.B.dylib) [0x7fff882b4aa5]
          59 _pthread_wqthread + 353 (in libSystem.B.dylib) [0x7fff882b4c08]
            59 _dispatch_worker_thread2 + 252 (in libSystem.B.dylib) [0x7fff882b52de]
              59 _dispatch_queue_invoke + 185 (in libSystem.B.dylib) [0x7fff882b57b4]
                59 kevent + 10 (in libSystem.B.dylib) [0x7fff882b3c0a]
      Kernel stack:
        59 kevent + 97 [0x47a699]
      Binary Images:
             0x100000000 -        0x10001bfef  diskarbitrationd ??? (???) <E59D4CB3-3CC5-03AD-DE45-91F98CC6B2F2> /usr/sbin/diskarbitrationd
          0x7fff86ecf000 -     0x7fff87046fe7  com.apple.CoreFoundation 6.6.6 (550.44) <BB4E5158-E47A-39D3-2561-96CB49FA82D4> /System/Library/Frameworks/CoreFoundation.framework/Versions/A/CoreFoundation
          0x7fff8829a000 -     0x7fff8845bfef  libSystem.B.dylib ??? (???) <9AB4F1D1-89DC-0E8A-DC8E-A4FE4D69DB69> /usr/lib/libSystem.B.dylib
    Process:         distnoted [16]
    Path:            /usr/sbin/distnoted
    UID:             1
      Thread d6         DispatchQueue 1
      User stack:
        59 ??? (in distnoted + 3620) [0x100000e24]
          59 ??? (in distnoted + 3717) [0x100000e85]
            59 CFRunLoopRun + 70 (in CoreFoundation) [0x7fff86f1ab16]
              59 CFRunLoopRunSpecific + 575 (in CoreFoundation) [0x7fff86f1ad8f]
                59 __CFRunLoopRun + 1698 (in CoreFoundation) [0x7fff86f1b902]
                  59 mach_msg_trap + 10 (in libSystem.B.dylib) [0x7fff8829ad7a]
      Kernel stack:
        59 ipc_mqueue_receive_continue + 0 [0x210d84]
      Thread d7         DispatchQueue 2
      User stack:
        59 start_wqthread + 13 (in libSystem.B.dylib) [0x7fff882b4aa5]
          59 _pthread_wqthread + 353 (in libSystem.B.dylib) [0x7fff882b4c08]
            59 _dispatch_worker_thread2 + 252 (in libSystem.B.dylib) [0x7fff882b52de]
              59 _dispatch_queue_invoke + 185 (in libSystem.B.dylib) [0x7fff882b57b4]
                59 kevent + 10 (in libSystem.B.dylib) [0x7fff882b3c0a]
      Kernel stack:
        59 kevent + 97 [0x47a699]
      Thread c74e     
      User stack:
        50 start_wqthread + 13 (in libSystem.B.dylib) [0x7fff882b4aa5]
          50 __workq_kernreturn + 10 (in libSystem.B.dylib) [0x7fff882b4a2a]
      Kernel stack:
        50 bsdthread_create + 1313 [0x4d4581]
      Binary Images:
             0x100000000 -        0x100000fff  distnoted ??? (???) <3B32D984-5A24-D5D9-063E-534930CF02DA> /usr/sbin/distnoted
          0x7fff86ecf000 -     0x7fff87046fe7  com.apple.CoreFoundation 6.6.6 (550.44) <BB4E5158-E47A-39D3-2561-96CB49FA82D4> /System/Library/Frameworks/CoreFoundation.framework/Versions/A/CoreFoundation
          0x7fff8829a000 -     0x7fff8845bfef  libSystem.B.dylib ??? (???) <9AB4F1D1-89DC-0E8A-DC8E-A4FE4D69DB69> /usr/lib/libSystem.B.dylib
    Process:         Dock [224]
    Path:            /System/Library/CoreServices/Dock.app/Contents/MacOS/Dock
    UID:             501
      Thread 374        DispatchQueue 1
      User stack:
        59 ??? (in Dock + 17196) [0x10000432c]
          59 ??? (in Dock + 18292) [0x100004774]
            59 CFRunLoopRunSpecific + 575 (in CoreFoundation) [0x7fff86f1ad8f]
              59 __CFRunLoopRun + 1698 (in CoreFoundation) [0x7fff86f1b902]
                59 mach_msg_trap + 10 (in libSystem.B.dylib) [0x7fff8829ad7a]
      Kernel stack:
        59 ipc_mqueue_receive_continue + 0 [0x210d84]
      Thread 37c        DispatchQueue 2
      User stack:
        59 start_wqthread + 13 (in libSystem.B.dylib) [0x7fff882b4aa5]
          59 _pthread_wqthread + 353 (in libSystem.B.dylib) [0x7fff882b4c08]
            59 _dispatch_worker_thread2 + 252 (in libSystem.B.dylib) [0x7fff882b52de]
              59 _dispatch_queue_invoke + 185 (in libSystem.B.dylib) [0x7fff882b57b4]
                59 kevent + 10 (in libSystem.B.dylib) [0x7fff882b3c0a]
      Kernel stack:
        59 kevent + 97 [0x47a699]
      Thread 447      
      User stack:
        59 thread_start + 13 (in libSystem.B.dylib) [0x7fff882d3e89]
          59 _pthread_start + 331 (in libSystem.B.dylib) [0x7fff882d3fd6]
            57 ??? (in Dock + 87647) [0x10001565f]
              57 __semwait_signal + 10 (in libSystem.B.dylib) [0x7fff882d5a6a]
            2 clock_sleep_trap + 10 (in libSystem.B.dylib) [0x7fff8829ae6a]
      Kernel stack:
        57 semaphore_wait_continue + 0 [0x22a88f]
        2 lo64_mach_scall + 77 [0x2a256d]
          2 thread_setuserstack + 405 [0x295c57]
            2 clock_sleep_trap + 407 [0x21aa0e]
              2 thread_block + 33 [0x227654]
                2 thread_block_reason + 331 [0x2275c6]
                  2 thread_dispatch + 1966 [0x227327]
                    2 machine_switch_context + 659 [0x2a9adb]
      Binary Images:
             0x100000000 -        0x100177ff7  com.apple.dock 1.7 (769.18) <3DA7DDB3-CF52-8081-18E5-269BA048759D> /System/Library/CoreServices/Dock.app/Contents/MacOS/Dock
          0x7fff86ecf000 -     0x7fff87046fe7  com.apple.CoreFoundation 6.6.6 (550.44) <BB4E5158-E47A-39D3-2561-96CB49FA82D4> /System/Library/Frameworks/CoreFoundation.framework/Versions/A/CoreFoundation
          0x7fff8829a000 -     0x7fff8845bfef  libSystem.B.dylib ??? (???) <9AB4F1D1-89DC-0E8A-DC8E-A4FE4D69DB69> /usr/lib/libSystem.B.dylib
    Process:         dynamic_pager [36]
    Path:            /sbin/dynamic_pager
    UID:             0
      Thread 104        DispatchQueue 1
      User stack:
        59 ??? [0x1000013ec]
          59 ??? [0x1000023eb]
            59 ??? [0x100001cae]
              59 ??? [0x100001a30]
                59 ??? [0x10000198f]
                  59 ??? [0x7fff8829ad7a]
      Kernel stack:
        59 ipc_mqueue_receive_continue + 0 [0x210d84]
    Process:         Finder [226]
    Path:            /System/Library/CoreServices/Finder.app/Contents/MacOS/Finder
    UID:             501
      Thread 376        DispatchQueue 1
      User stack:
        59 ??? (in Finder + 20828) [0x10000515c]
          59 ??? (in Finder + 20889) [0x100005199]
            59 NSApplicationMain + 364 (in AppKit) [0x7fff825273b0]
              59 -[NSApplication run] + 395 (in AppKit) [0x7fff8252e68f]
                59 -[NSApplication nextEventMatchingMask:untilDate:inMode:dequeue:] + 155 (in AppKit) [0x7fff82568801]
                  59 _DPSNextEvent + 708 (in AppKit) [0x7fff82568eb2]
                    59 BlockUntilNextEventMatchingListInMode + 59 (in HIToolbox) [0x7fff83f314ac]
                      59 ReceiveNextEventCommon + 310 (in HIToolbox) [0x7fff83f315f3]
                        59

    I always recommend migration rather than upgrade installation, for any server when moving across major versions.
    That said, please post relevant error messages from your server logs (system and mail),
    which you can easily view via the "Console" utility (in Applications/Utilities on the server itself).

  • My database does not start automatically

    i am using windows 2000 server and oracle 9.0.1, my database does not start automatically when i am booting the system.
    in regedit autostart is there, my service is getting started automatically and i used startmode auto in my oradim command but still i have to manually log in to start the database, PLS help!!!
    another issue is that i want to startup/shutdown the database using a user other than sysdba, pls tell which permission shud i grant as dba, connect, resource permissions are not doing the required job

    spfile concept is introduced from Oracle 9i. You can call it system parameter file. Benefits of having spfile concept is that what ever changes u make to system through commands
    alter system set ??? = ????
    get automatically saved in the spfile???.ora which is managed by Oracle.
    Main idea behind that as thought by Oracle is that previously u needed to change that parameter in init.ora file then start the database again after shutdown. Now u are doing everything online. spfile???.ora takes priority in the new Oracle concept.
    If u delete spfile???.ora file, then it needs some specific init.ora which need to told to Oracle which can be through command like
    startup pfile='complete patah .............'
    Bansal

  • Adobe Reader for the BlackBerry PlayBook Showstopping Issue: App does not start

    Hello;
    I would like to report an issue with the Adobe Reader app for the BlackBerry PlayBook which renders the application fully unusable. This issue occurs everytime. This issue has been tested and verified to occur in two distinct BlackBerry PlayBook devices.
    Here is a screenshot stating what version (10.0.3.325) of the Adobe Reader app I have installed:
    This, I understand, is the latest version for my platform. Unfortunately, the application does not start. Attempting to run it results in a blank screen after showing the BlackBerry logo. The blank screen can be seen in the following screenshot:
    It is also strange that the application does not appear in the Application Permissions list, as seen in the following screenshot:
    Is there a fix for this showstopping issue? What steps should I take?

    Same issue here.  Playbook support knows about it, and referred to Adobe.  The Adobe forum has this comment.  Looks like our Playbooks are abandoned as a platform.
    "Mar 4, 2012 7:20 PM
    As the tablet market continues to evolve, we continue to evaluate how to best support the market and where to focus on our resources. Because of this,  Adobe has decided to end its support of the  RIM QNX Playbook devices in March 2012.  This means the ability to create new applications for submission to the RIM store will no longer be possible in Adobe Viewer Builder as well as the ability to rebuild existing targets for new releases of Digital Publishing Suite. Any existing QNX targets will be removed from the manage view inside Viewer Builder".

  • Safari 5.1.1 does not start anymore, keep crashing

    Safari 5.1.1 does not start anymore, keep crashing
    Process:         Safari [748]
    Path:            /Applications/Safari.app/Contents/MacOS/Safari
    Identifier:      com.apple.Safari
    Version:         5.1.1 (6534.51.22)
    Build Info:      WebBrowser-75345122~2
    Code Type:       X86-64 (Native)
    Parent Process:  launchd [210]
    Date/Time:       2011-10-29 15:14:09.055 +0200
    OS Version:      Mac OS X 10.6.8 (10K549)
    Report Version:  6
    Interval Since Last Report:          39377 sec
    Crashes Since Last Report:           17
    Per-App Crashes Since Last Report:   14
    Exception Type:  EXC_BREAKPOINT (SIGTRAP)
    Exception Codes: 0x0000000000000002, 0x0000000000000000
    Crashed Thread:  0
    Dyld Error Message:
      Symbol not found: __ZN3JSC15WeakHandleOwner26isReachableFromOpaqueRootsENS_6HandleINS_7UnknownEEE PvRNS_9MarkStackE
      Referenced from: /System/Library/PrivateFrameworks/WebKit2.framework/Versions/A/WebKit2
      Expected in: /System/Library/Frameworks/JavaScriptCore.framework/Versions/A/JavaScriptCore
    in /System/Library/PrivateFrameworks/WebKit2.framework/Versions/A/WebKit2
    Binary Images:
           0x100000000 -        0x100000fff  com.apple.Safari 5.1.1 (6534.51.22) <D2BE27EF-F983-092E-8583-DA49B9E12CCC> /Applications/Safari.app/Contents/MacOS/Safari
           0x100004000 -        0x100831fe7  com.apple.Safari.framework 6534 (6534.51.22) <9D32968F-37A7-B36E-5ED2-1E784DA684E7> /System/Library/PrivateFrameworks/Safari.framework/Versions/A/Safari
           0x100b58000 -        0x100de2fff  com.apple.JavaScriptCore 6534.51 (6534.51.21) <848CAF7C-CDC4-A280-378C-24A701BA6F1A> /System/Library/Frameworks/JavaScriptCore.framework/Versions/A/JavaScriptCore
           0x100e67000 -        0x100f6bff7  com.apple.PubSub 1.0.5 (65.28) <D54898F3-D940-2044-3404-11C2636C8331> /System/Library/Frameworks/PubSub.framework/Versions/A/PubSub
           0x100fda000 -        0x100febfff  SyndicationUI ??? (???) <3103A2AD-75D7-A90E-90ED-B03D645A1D45> /System/Library/PrivateFrameworks/SyndicationUI.framework/Versions/A/Syndicatio nUI
           0x100ffa000 -        0x101197fe7  com.apple.WebKit 6534.51 (6534.51.22) <957BAD21-4FC4-9A9D-6E8F-644F474D7E30> /System/Library/Frameworks/WebKit.framework/Versions/A/WebKit
           0x101281000 -        0x101429fff  com.apple.WebKit2 7534 (7534.48.3) <9F8CD6D9-3123-3F53-BAC3-D770B0812C25> /System/Library/PrivateFrameworks/WebKit2.framework/Versions/A/WebKit2
           0x101550000 -        0x102581ff7  com.apple.WebCore 6534.51 (6534.51.22) <7B51D5D9-55E4-610C-0FBD-E04C9D3F87BA> /System/Library/Frameworks/WebKit.framework/Versions/A/Frameworks/WebCore.frame work/Versions/A/WebCore
        0x7fff5fc00000 -     0x7fff5fc3be0f  dyld 132.1 (???) <29DECB19-0193-2575-D838-CF743F0400B2> /usr/lib/dyld
        0x7fff80003000 -     0x7fff80003ff7  com.apple.vecLib 3.6 (vecLib 3.6) <96FB6BAD-5568-C4E0-6FA7-02791A58B584> /System/Library/Frameworks/vecLib.framework/Versions/A/vecLib
        0x7fff80004000 -     0x7fff80012ff7  libkxld.dylib ??? (???) <8145A534-95CC-9F3C-B78B-AC9898F38C6F> /usr/lib/system/libkxld.dylib
        0x7fff80065000 -     0x7fff801a3fff  com.apple.CoreData 102.1 (251) <9DFE798D-AA52-6A9A-924A-DA73CB94D81A> /System/Library/Frameworks/CoreData.framework/Versions/A/CoreData
        0x7fff801a4000 -     0x7fff80254fff  edu.mit.Kerberos 6.5.11 (6.5.11) <085D80F5-C9DC-E252-C21B-03295E660C91> /System/Library/Frameworks/Kerberos.framework/Versions/A/Kerberos
        0x7fff80255000 -     0x7fff8027cff7  libJPEG.dylib ??? (???) <46A413EA-4FD1-A050-2EF0-6279F3EAD581> /System/Library/Frameworks/ApplicationServices.framework/Versions/A/Frameworks/ ImageIO.framework/Versions/A/Resources/libJPEG.dylib
        0x7fff8027d000 -     0x7fff80288fff  com.apple.CrashReporterSupport 10.6.7 (258) <A2CBB18C-BD1C-8650-9091-7687E780E689> /System/Library/PrivateFrameworks/CrashReporterSupport.framework/Versions/A/Cra shReporterSupport
        0x7fff8030b000 -     0x7fff80321fef  libbsm.0.dylib ??? (???) <0321D32C-9FE1-3919-E03E-2530A0C1191B> /usr/lib/libbsm.0.dylib
        0x7fff807a7000 -     0x7fff80ea3ff7  com.apple.CoreGraphics 1.545.0 (???) <58D597B1-EB3B-710E-0B8C-EC114D54E11B> /System/Library/Frameworks/ApplicationServices.framework/Versions/A/Frameworks/ CoreGraphics.framework/Versions/A/CoreGraphics
        0x7fff8111f000 -     0x7fff81169ff7  com.apple.Metadata 10.6.3 (507.15) <2EF19055-D7AE-4D77-E589-7B71B0BC1E59> /System/Library/Frameworks/CoreServices.framework/Versions/A/Frameworks/Metadat a.framework/Versions/A/Metadata
        0x7fff8116a000 -     0x7fff8116cfff  libRadiance.dylib ??? (???) <A9DB4D5D-4072-971B-DEF6-DDE645F415EA> /System/Library/Frameworks/ApplicationServices.framework/Versions/A/Frameworks/ ImageIO.framework/Versions/A/Resources/libRadiance.dylib
        0x7fff811b0000 -     0x7fff811b0ff7  com.apple.ApplicationServices 38 (38) <0E2FC75E-2BE2-D04D-CA78-76E38A89DD30> /System/Library/Frameworks/ApplicationServices.framework/Versions/A/Application Services
        0x7fff81202000 -     0x7fff812c3fff  libFontParser.dylib ??? (???) <A00BB0A7-E46C-1D07-1391-194745566C7E> /System/Library/Frameworks/ApplicationServices.framework/Versions/A/Frameworks/ ATS.framework/Versions/A/Resources/libFontParser.dylib
        0x7fff812c4000 -     0x7fff812e5fff  libresolv.9.dylib 41.0.0 (compatibility 1.0.0) <9F322F47-0584-CB7D-5B73-9EBD670851CD> /usr/lib/libresolv.9.dylib
        0x7fff812e6000 -     0x7fff81320fff  libcups.2.dylib 2.8.0 (compatibility 2.0.0) <539EBFDD-96D6-FB07-B128-40232C408757> /usr/lib/libcups.2.dylib
        0x7fff81323000 -     0x7fff81323ff7  com.apple.Accelerate.vecLib 3.6 (vecLib 3.6) <4CCE5D69-F1B3-8FD3-1483-E0271DB2CCF3> /System/Library/Frameworks/Accelerate.framework/Versions/A/Frameworks/vecLib.fr amework/Versions/A/vecLib
        0x7fff81565000 -     0x7fff81566ff7  com.apple.audio.units.AudioUnit 1.6.7 (1.6.7) <53299948-2554-0F8F-7501-04B34E49F6CF> /System/Library/Frameworks/AudioUnit.framework/Versions/A/AudioUnit
        0x7fff81567000 -     0x7fff8157bff7  com.apple.speech.synthesis.framework 3.10.35 (3.10.35) <574C1BE0-5E5E-CCAF-06F8-92A69CB2892D> /System/Library/Frameworks/ApplicationServices.framework/Versions/A/Frameworks/ SpeechSynthesis.framework/Versions/A/SpeechSynthesis
        0x7fff8177b000 -     0x7fff8189afe7  libcrypto.0.9.8.dylib 0.9.8 (compatibility 0.9.8) <14115D29-432B-CF02-6B24-A60CC533A09E> /usr/lib/libcrypto.0.9.8.dylib
        0x7fff818cf000 -     0x7fff81939fe7  libvMisc.dylib 268.0.1 (compatibility 1.0.0) <AF0EA96D-000F-8C12-B952-CB7E00566E08> /System/Library/Frameworks/Accelerate.framework/Versions/A/Frameworks/vecLib.fr amework/Versions/A/libvMisc.dylib
        0x7fff8197a000 -     0x7fff819c9ff7  com.apple.DirectoryService.PasswordServerFramework 6.1 (6.1) <0731C40D-71EF-B417-C83B-54C3527A36EA> /System/Library/PrivateFrameworks/PasswordServer.framework/Versions/A/PasswordS erver
        0x7fff81a07000 -     0x7fff81da4fe7  com.apple.QuartzCore 1.6.3 (227.37) <16DFF6CD-EA58-CE62-A1D7-5F6CE3D066DD> /System/Library/Frameworks/QuartzCore.framework/Versions/A/QuartzCore
        0x7fff81de3000 -     0x7fff81e24fef  com.apple.QD 3.36 (???) <5DC41E81-32C9-65B2-5528-B33E934D5BB4> /System/Library/Frameworks/ApplicationServices.framework/Versions/A/Frameworks/ QD.framework/Versions/A/QD
        0x7fff81e25000 -     0x7fff81e3aff7  com.apple.LangAnalysis 1.6.6 (1.6.6) <1AE1FE8F-2204-4410-C94E-0E93B003BEDA> /System/Library/Frameworks/ApplicationServices.framework/Versions/A/Frameworks/ LangAnalysis.framework/Versions/A/LangAnalysis
        0x7fff81e8e000 -     0x7fff81e9dfff  com.apple.NetFS 3.2.2 (3.2.2) <7CCBD70E-BF31-A7A7-DB98-230687773145> /System/Library/Frameworks/NetFS.framework/Versions/A/NetFS
        0x7fff81e9e000 -     0x7fff81ee7fef  libGLU.dylib ??? (???) <1C050088-4AB2-2BC2-62E6-C969F925A945> /System/Library/Frameworks/OpenGL.framework/Versions/A/Libraries/libGLU.dylib
        0x7fff81ee8000 -     0x7fff81f23fff  com.apple.AE 496.5 (496.5) <208DF391-4DE6-81ED-C697-14A2930D1BC6> /System/Library/Frameworks/CoreServices.framework/Versions/A/Frameworks/AE.fram ework/Versions/A/AE
        0x7fff81f6b000 -     0x7fff8200bfff  com.apple.LaunchServices 362.3 (362.3) <B90B7C31-FEF8-3C26-BFB3-D8A48BD2C0DA> /System/Library/Frameworks/CoreServices.framework/Versions/A/Frameworks/LaunchS ervices.framework/Versions/A/LaunchServices
        0x7fff8228a000 -     0x7fff825befef  com.apple.CoreServices.CarbonCore 861.39 (861.39) <1386A24D-DD15-5903-057E-4A224FAF580B> /System/Library/Frameworks/CoreServices.framework/Versions/A/Frameworks/CarbonC ore.framework/Versions/A/CarbonCore
        0x7fff825bf000 -     0x7fff82736fe7  com.apple.CoreFoundation 6.6.6 (550.44) <BB4E5158-E47A-39D3-2561-96CB49FA82D4> /System/Library/Frameworks/CoreFoundation.framework/Versions/A/CoreFoundation
        0x7fff82737000 -     0x7fff8276dff7  com.apple.framework.Apple80211 6.2.5 (625.6) <B67C7A65-E4FB-4419-3F31-4482E17EF203> /System/Library/PrivateFrameworks/Apple80211.framework/Versions/A/Apple80211
        0x7fff8278f000 -     0x7fff82791fff  com.apple.print.framework.Print 6.1 (237.1) <CA8564FB-B366-7413-B12E-9892DA3C6157> /System/Library/Frameworks/Carbon.framework/Versions/A/Frameworks/Print.framewo rk/Versions/A/Print
        0x7fff82835000 -     0x7fff8284cfff  com.apple.ImageCapture 6.1 (6.1) <79AB2131-2A6C-F351-38A9-ED58B25534FD> /System/Library/Frameworks/Carbon.framework/Versions/A/Frameworks/ImageCapture. framework/Versions/A/ImageCapture
        0x7fff8284d000 -     0x7fff82902fe7  com.apple.ink.framework 1.3.3 (107) <8C36373C-5473-3A6A-4972-BC29D504250F> /System/Library/Frameworks/Carbon.framework/Versions/A/Frameworks/Ink.framework /Versions/A/Ink
        0x7fff82917000 -     0x7fff8291cfff  libGFXShared.dylib ??? (???) <1D0D3531-9561-632C-D620-1A8652BEF5BC> /System/Library/Frameworks/OpenGL.framework/Versions/A/Libraries/libGFXShared.d ylib
        0x7fff8291d000 -     0x7fff82a34fef  libxml2.2.dylib 10.3.0 (compatibility 10.0.0) <1B27AFDD-DF87-2009-170E-C129E1572E8B> /usr/lib/libxml2.2.dylib
        0x7fff82e31000 -     0x7fff82e91fe7  com.apple.framework.IOKit 2.0 (???) <2D2A51AA-4021-0F64-BE58-B0ED5388D899> /System/Library/Frameworks/IOKit.framework/Versions/A/IOKit
        0x7fff82eff000 -     0x7fff82f18fff  com.apple.CFOpenDirectory 10.6 (10.6) <401557B1-C6D1-7E1A-0D7E-941715C37BFA> /System/Library/Frameworks/OpenDirectory.framework/Versions/A/Frameworks/CFOpen Directory.framework/Versions/A/CFOpenDirectory
        0x7fff82f63000 -     0x7fff82f80ff7  libPng.dylib ??? (???) <6D8E515B-E0A2-2BA1-9CAC-8CB8A8B35879> /System/Library/Frameworks/ApplicationServices.framework/Versions/A/Frameworks/ ImageIO.framework/Versions/A/Resources/libPng.dylib
        0x7fff82fb1000 -     0x7fff82fb6fff  libGIF.dylib ??? (???) <201B8077-B5CC-11AA-E1B0-1D057ABE416A> /System/Library/Frameworks/ApplicationServices.framework/Versions/A/Frameworks/ ImageIO.framework/Versions/A/Resources/libGIF.dylib
        0x7fff830bc000 -     0x7fff8327afff  libicucore.A.dylib 40.0.0 (compatibility 1.0.0) <4274FC73-A257-3A56-4293-5968F3428854> /usr/lib/libicucore.A.dylib
        0x7fff8327b000 -     0x7fff8328cff7  libz.1.dylib 1.2.3 (compatibility 1.0.0) <97019C74-161A-3488-41EC-A6CA8738418C> /usr/lib/libz.1.dylib
        0x7fff83331000 -     0x7fff83331ff7  com.apple.CoreServices 44 (44) <DC7400FB-851E-7B8A-5BF6-6F50094302FB> /System/Library/Frameworks/CoreServices.framework/Versions/A/CoreServices
        0x7fff83362000 -     0x7fff83393fff  libGLImage.dylib ??? (???) <7F102A07-E4FB-9F52-B2F6-4E2D2383CA13> /System/Library/Frameworks/OpenGL.framework/Versions/A/Libraries/libGLImage.dyl ib
        0x7fff834d8000 -     0x7fff834fbfff  com.apple.opencl 12.3.6 (12.3.6) <42FA5783-EB80-1168-4015-B8C68F55842F> /System/Library/Frameworks/OpenCL.framework/Versions/A/OpenCL
        0x7fff8372e000 -     0x7fff837bafef  SecurityFoundation ??? (???) <3F1F2727-C508-3630-E2C1-38361841FCE4> /System/Library/Frameworks/SecurityFoundation.framework/Versions/A/SecurityFoun dation
        0x7fff837bb000 -     0x7fff83840ff7  com.apple.print.framework.PrintCore 6.3 (312.7) <CDFE82DD-D811-A091-179F-6E76069B432D> /System/Library/Frameworks/ApplicationServices.framework/Versions/A/Frameworks/ PrintCore.framework/Versions/A/PrintCore
        0x7fff83841000 -     0x7fff83896ff7  com.apple.framework.familycontrols 2.0.2 (2020) <8807EB96-D12D-8601-2E74-25784A0DE4FF> /System/Library/PrivateFrameworks/FamilyControls.framework/Versions/A/FamilyCon trols
        0x7fff839c0000 -     0x7fff83c42fff  com.apple.Foundation 6.6.8 (751.63) <E10E4DB4-9D5E-54A8-3FB6-2A82426066E4> /System/Library/Frameworks/Foundation.framework/Versions/C/Foundation
        0x7fff83c43000 -     0x7fff83c4ffff  libbz2.1.0.dylib 1.0.5 (compatibility 1.0.0) <9AB864FA-9197-5D48-A0EC-EC8330D475FC> /usr/lib/libbz2.1.0.dylib
        0x7fff83c50000 -     0x7fff83c50ff7  com.apple.Cocoa 6.6 (???) <C69E895A-1C66-3DA9-5F63-8BE85DB9C4E1> /System/Library/Frameworks/Cocoa.framework/Versions/A/Cocoa
        0x7fff83dec000 -     0x7fff83e34ff7  libvDSP.dylib 268.0.1 (compatibility 1.0.0) <98FC4457-F405-0262-00F7-56119CA107B6> /System/Library/Frameworks/Accelerate.framework/Versions/A/Frameworks/vecLib.fr amework/Versions/A/libvDSP.dylib
        0x7fff83e35000 -     0x7fff8463ffe7  libBLAS.dylib 219.0.0 (compatibility 1.0.0) <2F26CDC7-DAE9-9ABE-6806-93BBBDA20DA0> /System/Library/Frameworks/Accelerate.framework/Versions/A/Frameworks/vecLib.fr amework/Versions/A/libBLAS.dylib
        0x7fff84640000 -     0x7fff84644ff7  libmathCommon.A.dylib 315.0.0 (compatibility 1.0.0) <95718673-FEEE-B6ED-B127-BCDBDB60D4E5> /usr/lib/system/libmathCommon.A.dylib
        0x7fff84719000 -     0x7fff848dafef  libSystem.B.dylib 125.2.11 (compatibility 1.0.0) <9AB4F1D1-89DC-0E8A-DC8E-A4FE4D69DB69> /usr/lib/libSystem.B.dylib
        0x7fff848db000 -     0x7fff848f1fe7  com.apple.MultitouchSupport.framework 207.11 (207.11) <8233CE71-6F8D-8B3C-A0E1-E123F6406163> /System/Library/PrivateFrameworks/MultitouchSupport.framework/Versions/A/Multit ouchSupport
        0x7fff84e38000 -     0x7fff84e43fff  com.apple.corelocation 12.3 (12.3) <A6CFB410-2333-8BE3-658B-75A93C90A9CC> /System/Library/Frameworks/CoreLocation.framework/Versions/A/CoreLocation
        0x7fff84e44000 -     0x7fff84f21fff  com.apple.vImage 4.1 (4.1) <C3F44AA9-6F71-0684-2686-D3BBC903F020> /System/Library/Frameworks/Accelerate.framework/Versions/A/Frameworks/vImage.fr amework/Versions/A/vImage
        0x7fff84f22000 -     0x7fff84f71fef  libTIFF.dylib ??? (???) <1E2593D1-A7F6-84C6-DF8F-0B46AE445926> /System/Library/Frameworks/ApplicationServices.framework/Versions/A/Frameworks/ ImageIO.framework/Versions/A/Resources/libTIFF.dylib
        0x7fff84f72000 -     0x7fff84f73fff  liblangid.dylib ??? (???) <D0666597-B331-C43C-67BB-F2E754079A7A> /usr/lib/liblangid.dylib
        0x7fff84f74000 -     0x7fff84fb7fef  libtidy.A.dylib ??? (???) <2F4273D3-418B-668C-F488-7E659D3A8C23> /usr/lib/libtidy.A.dylib
        0x7fff85064000 -     0x7fff850b0fff  libauto.dylib ??? (???) <F7221B46-DC4F-3153-CE61-7F52C8C293CF> /usr/lib/libauto.dylib
        0x7fff850b1000 -     0x7fff850b4ff7  com.apple.securityhi 4.0 (36638) <AEF55AF1-54D3-DB8D-27A7-E16192E0045A> /System/Library/Frameworks/Carbon.framework/Versions/A/Frameworks/SecurityHI.fr amework/Versions/A/SecurityHI
        0x7fff850bf000 -     0x7fff850c5ff7  com.apple.CommerceCore 1.0 (9.1) <3691E9BA-BCF4-98C7-EFEC-78DA6825004E> /System/Library/PrivateFrameworks/CommerceKit.framework/Versions/A/Frameworks/C ommerceCore.framework/Versions/A/CommerceCore
        0x7fff850c6000 -     0x7fff850c7ff7  com.apple.TrustEvaluationAgent 1.1 (1) <5952A9FA-BC2B-16EF-91A7-43902A5C07B6> /System/Library/PrivateFrameworks/TrustEvaluationAgent.framework/Versions/A/Tru stEvaluationAgent
        0x7fff851d3000 -     0x7fff85251ff7  com.apple.CoreText 151.10 (???) <54961997-55D8-DC0F-2634-674E452D5A8E> /System/Library/Frameworks/ApplicationServices.framework/Versions/A/Frameworks/ CoreText.framework/Versions/A/CoreText
        0x7fff85268000 -     0x7fff8526dff7  com.apple.CommonPanels 1.2.4 (91) <8B088D78-E508-6622-E477-E34C22CF2F67> /System/Library/Frameworks/Carbon.framework/Versions/A/Frameworks/CommonPanels. framework/Versions/A/CommonPanels
        0x7fff85553000 -     0x7fff855cfff7  com.apple.ISSupport 1.9.7 (55) <BAE839AB-9DBD-FB23-F1F1-39445F04D8DA> /System/Library/PrivateFrameworks/ISSupport.framework/Versions/A/ISSupport
        0x7fff855d0000 -     0x7fff855d0ff7  com.apple.Accelerate 1.6 (Accelerate 1.6) <15DF8B4A-96B2-CB4E-368D-DEC7DF6B62BB> /System/Library/Frameworks/Accelerate.framework/Versions/A/Accelerate
        0x7fff855d1000 -     0x7fff855d7ff7  IOSurface ??? (???) <8E302BB2-0704-C6AB-BD2F-C2A6C6A2E2C3> /System/Library/Frameworks/IOSurface.framework/Versions/A/IOSurface
        0x7fff855d8000 -     0x7fff8570dfff  com.apple.audio.toolbox.AudioToolbox 1.6.7 (1.6.7) <E5D7DBDB-6DDF-E6F9-C71C-86F4520EE5A3> /System/Library/Frameworks/AudioToolbox.framework/Versions/A/AudioToolbox
        0x7fff8570e000 -     0x7fff85755ff7  com.apple.coreui 2 (114) <923E33CC-83FC-7D35-5603-FB8F348EE34B> /System/Library/PrivateFrameworks/CoreUI.framework/Versions/A/CoreUI
        0x7fff857a1000 -     0x7fff857a4ff7  libCoreVMClient.dylib ??? (???) <E03D7C81-A3DA-D44A-A88A-DDBB98AF910B> /System/Library/Frameworks/OpenGL.framework/Versions/A/Libraries/libCoreVMClien t.dylib
        0x7fff857a5000 -     0x7fff8583ffff  com.apple.ApplicationServices.ATS 275.19 (???) <FBC907AF-C3EF-CAF1-3705-13DC91B29114> /System/Library/Frameworks/ApplicationServices.framework/Versions/A/Frameworks/ ATS.framework/Versions/A/ATS
        0x7fff85840000 -     0x7fff858bdfef  libstdc++.6.dylib 7.9.0 (compatibility 7.0.0) <35ECA411-2C08-FD7D-11B1-1B7A04921A5C> /usr/lib/libstdc++.6.dylib
        0x7fff85900000 -     0x7fff8597ffe7  com.apple.audio.CoreAudio 3.2.6 (3.2.6) <79E256EB-43F1-C7AA-6436-124A4FFB02D0> /System/Library/Frameworks/CoreAudio.framework/Versions/A/CoreAudio
        0x7fff85980000 -     0x7fff8598ffef  com.apple.opengl 1.6.13 (1.6.13) <516098B3-4517-8A55-64BB-195CDAA5334D> /System/Library/Frameworks/OpenGL.framework/Versions/A/OpenGL
        0x7fff85990000 -     0x7fff85993fff  com.apple.help 1.3.2 (41.1) <BD1B0A22-1CB8-263E-FF85-5BBFDE3660B9> /System/Library/Frameworks/Carbon.framework/Versions/A/Frameworks/Help.framewor k/Versions/A/Help
        0x7fff85994000 -     0x7fff85a68fe7  com.apple.CFNetwork 454.12.4 (454.12.4) <C83E2BA1-1818-B3E8-5334-860AD21D1C80> /System/Library/Frameworks/CoreServices.framework/Versions/A/Frameworks/CFNetwo rk.framework/Versions/A/CFNetwork
        0x7fff85b78000 -     0x7fff85c31fff  libsqlite3.dylib 9.6.0 (compatibility 9.0.0) <2C5ED312-E646-9ADE-73A9-6199A2A43150> /usr/lib/libsqlite3.dylib
        0x7fff85ca4000 -     0x7fff860e7fef  libLAPACK.dylib 219.0.0 (compatibility 1.0.0) <57D38705-6F21-2A82-F3F6-03CFFF214775> /System/Library/Frameworks/Accelerate.framework/Versions/A/Frameworks/vecLib.fr amework/Versions/A/libLAPACK.dylib
        0x7fff860e8000 -     0x7fff86371ff7  com.apple.security 6.1.2 (55002) <4419AFFC-DAE7-873E-6A7D-5C9A5A4497A6> /System/Library/Frameworks/Security.framework/Versions/A/Security
        0x7fff86372000 -     0x7fff8638dff7  com.apple.openscripting 1.3.1 (???) <9D50701D-54AC-405B-CC65-026FCB28258B> /System/Library/Frameworks/Carbon.framework/Versions/A/Frameworks/OpenScripting .framework/Versions/A/OpenScripting
        0x7fff8638e000 -     0x7fff864a8fef  libGLProgrammability.dylib ??? (???) <8A4B86E3-0FA7-8684-2EF2-C5F8079428DB> /System/Library/Frameworks/OpenGL.framework/Versions/A/Libraries/libGLProgramma bility.dylib
        0x7fff864ae000 -     0x7fff867acfff  com.apple.HIToolbox 1.6.5 (???) <AD1C18F6-51CB-7E39-35DD-F16B1EB978A8> /System/Library/Frameworks/Carbon.framework/Versions/A/Frameworks/HIToolbox.fra mework/Versions/A/HIToolbox
        0x7fff867ad000 -     0x7fff8686afff  com.apple.CoreServices.OSServices 359.2 (359.2) <BBB8888E-18DE-5D09-3C3A-F4C029EC7886> /System/Library/Frameworks/CoreServices.framework/Versions/A/Frameworks/OSServi ces.framework/Versions/A/OSServices
        0x7fff8686b000 -     0x7fff8688bff7  com.apple.DirectoryService.Framework 3.6 (621.12) <A4685F06-5881-35F5-764D-C380304C1CE8> /System/Library/Frameworks/DirectoryService.framework/Versions/A/DirectoryServi ce
        0x7fff8688c000 -     0x7fff86942ff7  libobjc.A.dylib 227.0.0 (compatibility 1.0.0) <03140531-3B2D-1EBA-DA7F-E12CC8F63969> /usr/lib/libobjc.A.dylib
        0x7fff86943000 -     0x7fff8696eff7  libxslt.1.dylib 3.24.0 (compatibility 3.0.0) <8AB4CA9E-435A-33DA-7041-904BA7FA11D5> /usr/lib/libxslt.1.dylib
        0x7fff869b3000 -     0x7fff869f4ff7  com.apple.SystemConfiguration 1.10.9 (1.10.2) <642854D8-F4EF-4685-42A6-E48A1904D885> /System/Library/Frameworks/SystemConfiguration.framework/Versions/A/SystemConfi guration
        0x7fff8718a000 -     0x7fff8719efff  libGL.dylib ??? (???) <2ECE3B0F-39E1-3938-BF27-7205C6D0358B> /System/Library/Frameworks/OpenGL.framework/Versions/A/Libraries/libGL.dylib
        0x7fff87300000 -     0x7fff87349ff7  com.apple.securityinterface 4.0.1 (40418) <77FDB498-B502-050C-6AF4-1DAB17F64B6F> /System/Library/Frameworks/SecurityInterface.framework/Versions/A/SecurityInter face
        0x7fff8734a000 -     0x7fff87372fff  com.apple.DictionaryServices 1.1.2 (1.1.2) <E9269069-93FA-2B71-F9BA-FDDD23C4A65E> /System/Library/Frameworks/CoreServices.framework/Versions/A/Frameworks/Diction aryServices.framework/Versions/A/DictionaryServices
        0x7fff8783d000 -     0x7fff878cdfff  com.apple.SearchKit 1.3.0 (1.3.0) <45BA1053-9196-3C2F-2421-AFF5E09627CC> /System/Library/Frameworks/CoreServices.framework/Versions/A/Frameworks/SearchK it.framework/Versions/A/SearchKit
        0x7fff878ce000 -     0x7fff882c8ff7  com.apple.AppKit 6.6.8 (1038.36) <4CFBE04C-8FB3-B0EA-8DDB-7E7D10E9D251> /System/Library/Frameworks/AppKit.framework/Versions/C/AppKit
        0x7fff88319000 -     0x7fff88328fff  libxar.1.dylib ??? (???) <CBAF862A-3C77-6446-56C2-9C4461631AAF> /usr/lib/libxar.1.dylib
        0x7fff88329000 -     0x7fff88330fff  com.apple.OpenDirectory 10.6 (10.6) <4FF6AD25-0916-B21C-9E88-2CC42D90EAC7> /System/Library/Frameworks/OpenDirectory.framework/Versions/A/OpenDirectory
        0x7fff88331000 -     0x7fff88343fe7  libsasl2.2.dylib 3.15.0 (compatibility 3.0.0) <30FE378B-99FE-8C7C-06D0-A3AA0A0A70D4> /usr/lib/libsasl2.2.dylib
        0x7fff8834b000 -     0x7fff88351ff7  com.apple.DiskArbitration 2.3.1 (2.3.1) <FD5CF2E6-E5FF-1E2A-37E0-304722DA15E1> /System/Library/Frameworks/DiskArbitration.framework/Versions/A/DiskArbitration
        0x7fff88414000 -     0x7fff8841fff7  com.apple.speech.recognition.framework 3.11.1 (3.11.1) <3D65E89B-FFC6-4AAF-D5CC-104F967C8131> /System/Library/Frameworks/Carbon.framework/Versions/A/Frameworks/SpeechRecogni tion.framework/Versions/A/SpeechRecognition
        0x7fff884b3000 -     0x7fff884b3ff7  com.apple.Carbon 150 (152) <23704665-E9F4-6B43-1115-2E69F161FC45> /System/Library/Frameworks/Carbon.framework/Versions/A/Carbon
        0x7fff884b4000 -     0x7fff884f1ff7  libssl.0.9.8.dylib 0.9.8 (compatibility 0.9.8) <F743389F-F25A-A77D-4FCA-D6B01AF2EE6D> /usr/lib/libssl.0.9.8.dylib
        0x7fff89620000 -     0x7fff89673ff7  com.apple.HIServices 1.8.3 (???) <F6E0C7A7-C11D-0096-4DDA-2C77793AA6CD> /System/Library/Frameworks/ApplicationServices.framework/Versions/A/Frameworks/ HIServices.framework/Versions/A/HIServices
        0x7fff89674000 -     0x7fff89735fef  com.apple.ColorSync 4.6.6 (4.6.6) <BB2C5813-C61D-3CBA-A8F7-0E59E46EBEE8> /System/Library/Frameworks/ApplicationServices.framework/Versions/A/Frameworks/ ColorSync.framework/Versions/A/ColorSync
        0x7fff897bd000 -     0x7fff8997bff7  com.apple.ImageIO.framework 3.0.4 (3.0.4) <0A4F51A1-4502-767B-8A4E-F14C6214EF88> /System/Library/Frameworks/ApplicationServices.framework/Versions/A/Frameworks/ ImageIO.framework/Versions/A/ImageIO
        0x7fff89b4a000 -     0x7fff89c2ffef  com.apple.DesktopServices 1.5.11 (1.5.11) <39FAA3D2-6863-B5AB-AED9-92D878EA2438> /System/Library/PrivateFrameworks/DesktopServicesPriv.framework/Versions/A/Desk topServicesPriv
        0x7fff89c88000 -     0x7fff89cadff7  com.apple.CoreVideo 1.6.2 (45.6) <E138C8E7-3CB6-55A9-0A2C-B73FE63EA288> /System/Library/Frameworks/CoreVideo.framework/Versions/A/CoreVideo
        0x7fffffe00000 -     0x7fffffe01fff  libSystem.B.dylib ??? (???) <9AB4F1D1-89DC-0E8A-DC8E-A4FE4D69DB69> /usr/lib/libSystem.B.dylib

    You could try to delete your plugins first and then try this.
    First I Reset Safari, then close Safari then navigate to:
    Home/Library/Preferences and look for and then remove
    com.apple.Safari.plist
    com.apple.Safari.RSS.plist
    Also:
    Home/Library/Safari/ folder and remove the following two files:
    history.plist
    lastsession.plist
    And
    Go to Home/Library/Caches/Metadata/Safari/ and remove the contents of that folder.
    (These are just  webhistory files and are not required for Safari to run. However, similar to preference files, problems can arise if they have become corrupt.)
    Locate the cookies.plist file that's located in the Home/Library/Cookies/ folder and remove it.
    They will all be recreated next time you launch Safari.

  • Cssd does not start in non-RAC environment Thus we can not bring up ASM

    Non-RAC environment
    ASM version = 11.1.0.7
    HP-UX Itanium 11.23
    After power outage, CSSD does not start on non-RAC environment
    Running as root "/sbin/init.d/init.cssd start" does not start cssd
    Oracle support tried "$ASM_HOME/bin/localconfig delete" and "$ASM_HOME/bin/localconfig add"
    but it did not start CSS
    Oracle support tried "$ASM_HOME/bin/localconfig reset $ASM_HOME"
    It started the CSSD and the "crsctl check css" came back with CSS is healthy
    But around 1 minute later it rebooted the server and when it came up again CSS does not start.
    They checked /etc/inittab and it looked fine.
    Before the reboot we saw this message in the /var/adm/syslog/OLDsyslog.log:
    Cluster Ready Services completed waiting on dependencies
    Again it is a NON-RAC environment. We only need CSSD for ASM. We do not have CRS installed on this server.
    Our test system has been down for a week and we did not get the resolution from Oracle support yet !
    Any pointers are greately appriciated.
    Thanks,
    Dzung

    Here is the message in $ASM_HOME/log/<hostname>/alert<hostname>.log :
    2010-07-16 09:42:02.956
    [client(11930)]CRS-1006:The OCR location /db/app/oracle/product/11.1/cdata/localhost/local.ocr is inacce
    ssible. Details in /db/app/oracle/product/11.1/log/rmodbd01/client/clscfg10.log.
    2010-07-16 09:42:02.971
    [client(11930)]CRS-1006:The OCR location /db/app/oracle/product/11.1/cdata/localhost/local.ocr is inacce
    ssible. Details in /db/app/oracle/product/11.1/log/rmodbd01/client/clscfg10.log.
    2010-07-16 09:42:03.054
    [client(11930)]CRS-1013:The OCR at /db/app/oracle/product/11.1/cdata/localhost/local.ocr was successfull
    y formatted using version 2. Ignore earlier CRS-1006 messages if any.
    2010-07-16 09:42:46.379
    [cssd(12297)]CRS-1601:CSSD Reconfiguration complete. Active nodes are rmodbd01 .
    Here is the message in $ASM_HOME/log/<hostname>/cssd/cssdOUT.log:
    setsid: failed with -1/1
    s0clssscGetEnvOracleUser: calling getpwnam_r for user oracle
    s0clssscGetEnvOracleUser: info for user oracle complete
    07/16/10 09:42:36: CSSD starting
    Here is the message in $ASM_HOME/log/<hostname>/cssd/ocssd.log:
    [    CSSD]2010-07-16 09:42:46.378 [18] >TRACE: clssgmCompareSwapEventValue: changed CmInfo State val 7, from 6, changes 6
    [    CSSD]2010-07-16 09:42:46.378 [18] >TRACE: clssgmSetVersions: properties common to all peers: 1,2,3,4,5,6,7
    [    CSSD]2010-07-16 09:42:46.378 [18] >TRACE: clssgmEstablishMasterNode: MASTER for 174732166 is node(0) birth(174732166)
    [    CSSD]2010-07-16 09:42:46.378 [18] >TRACE: clssgmChangeMasterNode: requeued 0 RPCs
    [    CSSD]2010-07-16 09:42:46.378 [18] >TRACE: clssgmCompareSwapEventValue: changed CmInfo State val 8, from 7, changes 7
    [    CSSD]2010-07-16 09:42:46.378 [18] >TRACE: clssgmMasterCMSync: Synchronizing group/lock status
    [    CSSD]2010-07-16 09:42:46.378 [18] >TRACE: clssgmMasterSendDBDone: group/lock status synchronization complete
    [    CSSD]2010-07-16 09:42:46.378 [18] >TRACE: clssgmCompareSwapEventValue: changed CmInfo State val 9, from 8, changes 8
    [    CSSD]2010-07-16 09:42:46.378 [18] >TRACE: clssgmCompareSwapEventValue: changed CmInfo State val 10, from 9, changes 9
    [    CSSD]CLSS-3000: reconfiguration successful, incarnation 174732166 with 1 nodes
    [    CSSD]CLSS-3001: local node number 0, master node number 0
    [    CSSD]2010-07-16 09:42:46.378 [18] >TRACE: clssscSAGEInitFenceCompl: Completing kgzf fence initialization
    [    CSSD]2010-07-16 09:42:46.394 [12] >TRACE: clssgmUpdateEventValue: Client listener incarn val 174732166, changes 1
    [    CSSD]2010-07-16 09:42:46.395 [12] >TRACE: clssgmAllocProc: (60000000003c7120) allocated
    [    CSSD]2010-07-16 09:42:46.395 [12] >TRACE: clssgmAllocProc: (60000000003c73a0) allocated
    [    CSSD]2010-07-16 09:42:46.396 [14] >TRACE: Connect request from user oracle
    [    CSSD]2010-07-16 09:42:46.396 [14] >TRACE: Connect request from user root
    [    CSSD]2010-07-16 09:42:46.397 [12] >TRACE: clssgmClientConnectMsg: properties of cmProc 60000000003c7120 - 1,2,3
    [    CSSD]2010-07-16 09:42:46.397 [12] >TRACE: clssgmClientConnectMsg: Connect from con(60000000003b2810) proc(60000000003c7120) pid(12350) version 11:1:1:4
    [    CSSD]2010-07-16 09:42:46.397 [12] >TRACE: clssgmClientConnectMsg: properties of cmProc 60000000003c73a0 - 1,2,3
    [    CSSD]2010-07-16 09:42:46.397 [12] >TRACE: clssgmClientConnectMsg: Connect from con(60000000003b2990) proc(60000000003c73a0) pid(12131) version 11:1:1:4
    [    CSSD]2010-07-16 09:42:46.402 [12] >TRACE: clssgmRegisterClient: proc(1/60000000003c7120), client(1/600000000096e7c0)
    [    CSSD]2010-07-16 09:42:46.402 [12] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (600000000096e7c0)
    [    CSSD]2010-07-16 09:42:46.402 [12] >TRACE: clssgmJoinGrock: local grock CSS_INTERNAL_NODE_GROUP new client 600000000096e7c0 with con 60000000003b2b10, requested num 0
    [    CSSD]2010-07-16 09:42:46.402 [12] >TRACE: clssgmAddNodeGrpMember: member (60000000009e0030) added
    [    CSSD]2010-07-16 09:42:46.403 [12] >TRACE: clssgmGroupState: requested group state of group localhost_NG, member count 0
    [    CSSD]2010-07-16 09:42:46.403 [12] >TRACE: clssgmGroupState: requested group state of group localhost_NG, member count 0
    [    CSSD]2010-07-16 09:42:46.404 [12] >TRACE: clssgmDeadProc: proc 60000000003c73a0
    [    CSSD]2010-07-16 09:42:46.404 [12] >TRACE: clssgmDestroyProc: cleaning up proc(60000000003c73a0) con(60000000003b2990) skgpid ospid 12131 with 0 clients, refcount 0
    [    CSSD]2010-07-16 09:42:46.425 [12] >TRACE: clssgmGroupState: requested group state of unknown group MASTER#DISKMON#GROUP
    [    CSSD]2010-07-16 09:42:46.425 [12] >TRACE: clssgmGroupState: requested group state of group MASTER#DISKMON#GROUP, member count 0
    [    CSSD]2010-07-16 09:42:46.425 [18] >TRACE: KGZF: context successfully initialized, API version 1.4, using pipe default
    [    CSSD]2010-07-16 09:42:46.425 [18] >TRACE: clssscSAGEInitFenceCompl: kgzf fence initialization successfully completed
    [    CSSD]2010-07-16 09:42:46.425 [18] >TRACE: clssgmReconfigThread: CSS/GM open for global group registrations
    [    CSSD]2010-07-16 09:42:46.425 [18] >TRACE: clssgmReconfigThread: completed for reconfig(174732166), with status(1)
    [    CSSD]2010-07-16 09:42:46.425 [18] >TRACE: clssgmUpdateEventValue: Reconfig Event val 2, changes 2
    [    CSSD]2010-07-16 09:42:46.425 [1] >TRACE: clssgmWaitOnEventValue: after Reconfig Event val 2, eval 2 waited 47
    [    CSSD]2010-07-16 09:42:46.425 [12] >TRACE: clssgmRegisterClient: proc(1/60000000003c7120), client(2/600000000096e870)
    [    CSSD]2010-07-16 09:42:46.425 [1] >TRACE: clssgmUpdateEventValue: Reconfig Event val 0, changes 3
    [    CSSD]2010-07-16 09:42:46.425 [1] >TRACE: clssgmStartNMMon: previous reconfig complete, incarnation(174732166)
    [    CSSD]2010-07-16 09:42:46.425 [12] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 2 (600000000096e870)
    [    CSSD]2010-07-16 09:42:46.425 [12] >TRACE: clssgmJoinGrock: global grock MASTER#DISKMON#GROUP#MX new client 600000000096e870 with con 60000000003b2990, requested num -1
    [    CSSD]2010-07-16 09:42:46.425 [12] >TRACE: clssgmAddGrockMember: adding member to grock MASTER#DISKMON#GROUP#MX
    [    CSSD]2010-07-16 09:42:46.425 [12] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(0) grock (6000000000989e50/MASTER#DISKMON#GROUP#MX)
    [    CSSD]2010-07-16 09:42:46.425 [12] >TRACE: clssgmQueueGrockEvent: lockName(MASTER#DISKMON#GROUP#MX) type(3) count (1/1) xwaiters(1) event(1) to memberNo(0)
    [    CSSD]2010-07-16 09:42:46.425 [12] >TRACE: clssgmCommonAddMember: global lock grock MASTER#DISKMON#GROUP#MX member(0/Local) node(0) flags 0x2 0x2
    [    CSSD]2010-07-16 09:42:46.425 [12] >TRACE: clssgmRegisterClient: proc(1/60000000003c7120), client(3/600000000096e920)
    [    CSSD]2010-07-16 09:42:46.425 [12] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 3 (600000000096e920)
    [    CSSD]2010-07-16 09:42:46.425 [12] >TRACE: clssgmJoinGrock: global grock MASTER#DISKMON#GROUP new client 600000000096e920 with con 60000000003b2bd0, requested num 0
    [    CSSD]2010-07-16 09:42:46.425 [12] >TRACE: clssgmAddGrockMember: adding member to grock MASTER#DISKMON#GROUP
    [    CSSD]2010-07-16 09:42:46.425 [12] >TRACE: clssgmAddMember: new master 0 for group(MASTER#DISKMON#GROUP)
    [    CSSD]2010-07-16 09:42:46.426 [12] >TRACE: clssgmAddMember: Adding fencing for member 0, group MASTER#DISKMON#GROUP, death 1, SAGE 0
    [    CSSD]2010-07-16 09:42:46.426 [12] >TRACE: clssgmAddMember: member (0/60000000009e0230) added. pbsz(72) prsz(0) flags 0x0 to grock (600000000098a170/MASTER#DISKMON#GROUP)
    [    CSSD]2010-07-16 09:42:46.426 [12] >TRACE: clssgmQueueGrockEvent: groupName(MASTER#DISKMON#GROUP) count(1) master(0) event(1), incarn 1, mbrc 1, to member 0, events 0x78, state 0x0
    [    CSSD]2010-07-16 09:42:46.426 [12] >TRACE: clssgmCommonAddMember: global group grock MASTER#DISKMON#GROUP member(0/Local) node(0) flags 0x0 0x1e00
    [    CSSD]2010-07-16 09:42:46.426 [12] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 2 (600000000096e870)
    [    CSSD]2010-07-16 09:42:46.426 [12] >TRACE: clssgmExitGrock: client 2 (600000000096e870), grock MASTER#DISKMON#GROUP#MX, member 0
    [    CSSD]2010-07-16 09:42:46.426 [12] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (60000000009e0130) in global grock MASTER#DISKMON#GROUP#MX
    [    CSSD]2010-07-16 09:42:46.426 [12] >TRACE: clssgmRemoveMember: grock MASTER#DISKMON#GROUP#MX, member number 0 (60000000009e0130) node number 0 state 0x14 member refcnt 0 grock type 3
    [    CSSD]2010-07-16 09:42:48.405 [8] >TRACE: clssnmSendingThread: sending status msg to all nodes
    [    CSSD]2010-07-16 09:42:48.405 [8] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes
    [    CSSD]2010-07-16 09:42:52.444 [8] >TRACE: clssnmSendingThread: sending status msg to all nodes
    [    CSSD]2010-07-16 09:42:52.444 [8] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes
    [    CSSD]2010-07-16 09:42:56.484 [8] >TRACE: clssnmSendingThread: sending status msg to all nodes
    [    CSSD]2010-07-16 09:42:56.484 [8] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes
    [    CSSD]2010-07-16 09:43:00.516 [8] >TRACE: clssnmSendingThread: sending status msg to all nodes
    [    CSSD]2010-07-16 09:43:00.516 [8] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes
    [    CSSD]2010-07-16 09:43:04.563 [8] >TRACE: clssnmSendingThread: sending status msg to all nodes
    [    CSSD]2010-07-16 09:43:04.563 [8] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes
    [    CSSD]2010-07-16 09:43:08.603 [8] >TRACE: clssnmSendingThread: sending status msg to all nodes
    [    CSSD]2010-07-16 09:43:08.603 [8] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes
    [    CSSD]2010-07-16 09:43:12.643 [8] >TRACE: clssnmSendingThread: sending status msg to all nodes
    [    CSSD]2010-07-16 09:43:12.643 [8] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes
    [    CSSD]2010-07-16 09:43:16.676 [8] >TRACE: clssnmSendingThread: sending status msg to all nodes
    [    CSSD]2010-07-16 09:43:16.676 [8] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes
    [    CSSD]2010-07-16 09:43:20.723 [8] >TRACE: clssnmSendingThread: sending status msg to all nodes
    [    CSSD]2010-07-16 09:43:20.723 [8] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes
    [    CSSD]2010-07-16 09:43:24.762 [8] >TRACE: clssnmSendingThread: sending status msg to all nodes
    [    CSSD]2010-07-16 09:43:24.762 [8] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes
    [    CSSD]2010-07-16 09:43:28.802 [8] >TRACE: clssnmSendingThread: sending status msg to all nodes
    [    CSSD]2010-07-16 09:43:28.802 [8] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes
    [    CSSD]2010-07-16 09:43:32.842 [8] >TRACE: clssnmSendingThread: sending status msg to all nodes
    [    CSSD]2010-07-16 09:43:32.842 [8] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes
    [    CSSD]2010-07-16 09:43:36.882 [8] >TRACE: clssnmSendingThread: sending status msg to all nodes
    [    CSSD]2010-07-16 09:43:36.882 [8] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes
    [    CSSD]2010-07-16 09:43:40.922 [8] >TRACE: clssnmSendingThread: sending status msg to all nodes
    [    CSSD]2010-07-16 09:43:40.922 [8] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes
    [    CSSD]2010-07-16 09:43:44.964 [8] >TRACE: clssnmSendingThread: sending status msg to all nodes
    [    CSSD]2010-07-16 09:43:44.964 [8] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes
    [    CSSD]2010-07-16 09:43:49.002 [8] >TRACE: clssnmSendingThread: sending status msg to all nodes
    [    CSSD]2010-07-16 09:43:49.002 [8] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes
    [    CSSD]2010-07-16 09:43:53.043 [8] >TRACE: clssnmSendingThread: sending status msg to all nodes
    [    CSSD]2010-07-16 09:43:53.043 [8] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes
    [    CSSD]2010-07-16 09:43:57.085 [8] >TRACE: clssnmSendingThread: sending status msg to all nodes
    [    CSSD]2010-07-16 09:43:57.085 [8] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes
    [    CSSD]2010-07-16 09:43:58.354 [12] >TRACE: clssgmAllocProc: (60000000003c7ee0) allocated
    [    CSSD]2010-07-16 09:43:58.355 [14] >TRACE: Connect request from user oracle
    [    CSSD]2010-07-16 09:43:58.356 [12] >TRACE: clssgmClientConnectMsg: properties of cmProc 60000000003c7ee0 - 1,2,3
    [    CSSD]2010-07-16 09:43:58.356 [12] >TRACE: clssgmClientConnectMsg: Connect from con(60000000003b2990) proc(60000000003c7ee0) pid(13157) version 11:1:1:4
    [    CSSD]2010-07-16 09:43:58.360 [12] >TRACE: clssgmRegisterClient: proc(2/60000000003c7ee0), client(1/600000000096e870)
    [    CSSD]2010-07-16 09:43:58.360 [12] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (600000000096e870)
    [    CSSD]2010-07-16 09:43:58.360 [12] >TRACE: clssgmJoinGrock: global grock CLSSSCHECK_GROUP new client 600000000096e870 with con 60000000003b2c90, requested num -1
    [    CSSD]2010-07-16 09:43:58.360 [12] >TRACE: clssgmAddGrockMember: adding member to grock CLSSSCHECK_GROUP
    [    CSSD]2010-07-16 09:43:58.360 [12] >TRACE: clssgmAddMember: new master 0 for group(CLSSSCHECK_GROUP)
    [    CSSD]2010-07-16 09:43:58.360 [12] >TRACE: clssgmAddMember: Adding fencing for member 0, group CLSSSCHECK_GROUP, death 1, SAGE 0
    [    CSSD]2010-07-16 09:43:58.360 [12] >TRACE: clssgmAddMember: member (0/60000000009e0130) added. pbsz(8) prsz(8) flags 0x0 to grock (6000000000989e50/CLSSSCHECK_GROUP)
    [    CSSD]2010-07-16 09:43:58.360 [12] >TRACE: clssgmQueueGrockEvent: groupName(CLSSSCHECK_GROUP) count(1) master(0) event(1), incarn 1, mbrc 1, to member 0, events 0x0, state 0x0
    [    CSSD]2010-07-16 09:43:58.360 [12] >TRACE: clssgmCommonAddMember: global group grock CLSSSCHECK_GROUP member(0/Local) node(0) flags 0x0 0x0
    [    CSSD]2010-07-16 09:43:58.361 [12] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (600000000096e870)
    [    CSSD]2010-07-16 09:43:58.361 [12] >TRACE: clssgmExitGrock: client 1 (600000000096e870), grock CLSSSCHECK_GROUP, member 0
    [    CSSD]2010-07-16 09:43:58.361 [12] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (60000000009e0130) in global grock CLSSSCHECK_GROUP
    [    CSSD]2010-07-16 09:43:58.361 [12] >TRACE: clssgmRemoveMember: grock CLSSSCHECK_GROUP, member number 0 (60000000009e0130) node number 0 state 0x14 member refcnt 0 grock type 2
    [    CSSD]2010-07-16 09:43:58.361 [12] >TRACE: clssgmRegisterClient: proc(2/60000000003c7ee0), client(2/600000000096e870)
    [    CSSD]2010-07-16 09:43:58.361 [12] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 2 (600000000096e870)
    [    CSSD]2010-07-16 09:43:58.361 [12] >TRACE: clssgmJoinGrock: global grock CLSSSCHECK_LOCK new client 600000000096e870 with con 60000000003b2c90, requested num -1
    [    CSSD]2010-07-16 09:43:58.361 [12] >TRACE: clssgmAddGrockMember: adding member to grock CLSSSCHECK_LOCK
    [    CSSD]2010-07-16 09:43:58.361 [12] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(0) grock (6000000000989e50/CLSSSCHECK_LOCK)
    [    CSSD]2010-07-16 09:43:58.361 [12] >TRACE: clssgmQueueGrockEvent: lockName(CLSSSCHECK_LOCK) type(3) count (1/1) xwaiters(1) event(1) to memberNo(0)
    [    CSSD]2010-07-16 09:43:58.361 [12] >TRACE: clssgmCommonAddMember: global lock grock CLSSSCHECK_LOCK member(0/Local) node(0) flags 0x2 0x2
    [    CSSD]2010-07-16 09:43:58.361 [12] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 2 (600000000096e870)
    [    CSSD]2010-07-16 09:43:58.361 [12] >TRACE: clssgmExitGrock: client 2 (600000000096e870), grock CLSSSCHECK_LOCK, member 0
    [    CSSD]2010-07-16 09:43:58.361 [12] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (60000000009e0130) in global grock CLSSSCHECK_LOCK
    [    CSSD]2010-07-16 09:43:58.361 [12] >TRACE: clssgmRemoveMember: grock CLSSSCHECK_LOCK, member number 0 (60000000009e0130) node number 0 state 0x14 member refcnt 0 grock type 3
    [    CSSD]2010-07-16 09:43:58.362 [12] >TRACE: clssgmDeadProc: proc 60000000003c7ee0
    [    CSSD]2010-07-16 09:43:58.362 [12] >TRACE: clssgmDestroyProc: cleaning up proc(60000000003c7ee0) con(60000000003b2990) skgpid ospid 13157 with 0 clients, refcount 0
    [    CSSD]2010-07-16 09:44:01.125 [8] >TRACE: clssnmSendingThread: sending status msg to all nodes
    [    CSSD]2010-07-16 09:44:01.125 [8] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes
    [    CSSD]2010-07-16 09:44:05.164 [8] >TRACE: clssnmSendingThread: sending status msg to all nodes
    [    CSSD]2010-07-16 09:44:05.164 [8] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes
    [    CSSD]2010-07-16 09:44:09.196 [8] >TRACE: clssnmSendingThread: sending status msg to all nodes
    [    CSSD]2010-07-16 09:44:09.196 [8] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes
    [    CSSD]2010-07-16 09:44:13.236 [8] >TRACE: clssnmSendingThread: sending status msg to all nodes
    [    CSSD]2010-07-16 09:44:13.236 [8] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes
    [    CSSD]2010-07-16 09:44:17.284 [8] >TRACE: clssnmSendingThread: sending status msg to all nodes
    [    CSSD]2010-07-16 09:44:17.284 [8] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes
    [    CSSD]2010-07-16 09:44:21.322 [8] >TRACE: clssnmSendingThread: sending status msg to all nodes
    [    CSSD]2010-07-16 09:44:21.322 [8] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes
    [    CSSD]2010-07-16 09:44:25.316 [8] >TRACE: clssnmSendingThread: sending status msg to all nodes
    [    CSSD]2010-07-16 09:44:25.316 [8] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes
    [    CSSD]2010-07-16 09:44:30.333 [8] >TRACE: clssnmSendingThread: sending status msg to all nodes
    [    CSSD]2010-07-16 09:44:30.333 [8] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes
    [    CSSD]2010-07-16 09:44:34.324 [8] >TRACE: clssnmSendingThread: sending status msg to all nodes
    [    CSSD]2010-07-16 09:44:34.324 [8] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes
    Here is the message in $ASM_HOME/log/<hostname>/diskmon/client.log:
    [ DISKMON] 07/16/2010 18:33:32.050 dskm_send_command: process 23246 sending command 8 to master diskmon listening on default pipe
    [ DISKMON] 07/16/2010 18:33:32.080 dskm_send_command3: skgznp_connect failed with error 56815
    [ DISKMON] 07/16/2010 18:33:32.080 dskm_send_command3: error 56815 at location skgznpcon6 - connect() - Connection refused
    Here is the message in $ASM_HOME/log/<hostname>/diskmon/diskmonOUT.log:
    setsid: failed with -1/1
    dskm_getenv_oracle_user: calling getpwnam_r for user oracle
    dskm_getenv_oracle_user: info for user oracle complete
    07/16/10 18:33:31: Master Diskmon starting
    Here is the message in $ASM_HOME/log/<hostname>/diskmon/diskmon.log:
    [ DISKMON] 07/16/2010 09:42:35.573 dskm main: starting up
    [ DISKMON] 07/16/2010 09:42:35.588 [12350:3] dskm_rac_thrd_main: running
    [ DISKMON] 07/16/2010 09:42:35.588 [12350:1] dskm_rac_thrd_creat2: got the post from the css event handling thread
    [ DISKMON] 07/16/2010 09:42:35.589 [12350:1] dskm main: startup complete
    [ DISKMON] 07/16/2010 09:42:35.589 [12350:1] listening on -> default pipe
    [ DISKMON] 07/16/2010 09:42:35.792 clsc_connect: (6000000000700420) no listener at (ADDRESS=(PROTOCOL=ipc)(KEY=OCSSD_LL_rmodbd01_))
    [ DISKMON] 07/16/2010 09:42:36.385 clsc_connect: (6000000000700420) no listener at (ADDRESS=(PROTOCOL=ipc)(KEY=OCSSD_LL_rmodbd01_))
    [ DISKMON] 07/16/2010 09:42:36.906 clsc_connect: (6000000000700420) no listener at (ADDRESS=(PROTOCOL=ipc)(KEY=OCSSD_LL_rmodbd01_))
    [ DISKMON] 07/16/2010 09:42:37.426 clsc_connect: (6000000000700420) no listener at (ADDRESS=(PROTOCOL=ipc)(KEY=OCSSD_LL_rmodbd01_))
    [ DISKMON] 07/16/2010 09:42:37.945 clsc_connect: (6000000000700420) no listener at (ADDRESS=(PROTOCOL=ipc)(KEY=OCSSD_LL_rmodbd01_))
    [ DISKMON] 07/16/2010 09:42:38.465 clsc_connect: (6000000000700420) no listener at (ADDRESS=(PROTOCOL=ipc)(KEY=OCSSD_LL_rmodbd01_))
    [ DISKMON] 07/16/2010 09:42:46.376 [12350:1] dskm_slave_thrd_creat: thread created
    [ DISKMON] 07/16/2010 09:42:46.376 [12350:11] dskm_slave_thrd_main1: slave 0 running
    [ DISKMON] 07/16/2010 09:42:46.376 [12350:11] dskm_process_msg5: received msg type KGZM_IDENTIFY (0x0001)
    [ DISKMON] 07/16/2010 09:42:46.389 [12350:11] dskm_proc_identify8: client kgzf/12297, version 0x01020000, slave 0, reid cid=3e0391f05e06cfafbf7419d7cf085a44,icin=174732166,nmn=0,lnid=174732166,gid=0,gin=0,gmn=0,umemid=0,opid=0,opsn=0,lvl=node
    [ DISKMON] 07/16/2010 09:42:46.389 [12350:11] dskm_send_version1:
    [ DISKMON] 07/16/2010 09:42:46.389 [12350:11] dskm_send_version4: done
    [ DISKMON] 07/16/2010 09:42:46.389 [12350:11] dskm_process_msg7: processed msg 0 type KGZM_IDENTIFY (0x0001), retcode 0
    [ DISKMON] 07/16/2010 09:42:46.389 [12350:11] dskm_process_msg5: received msg type KGZM_KGZF_HANDSHAKE (0x0010)
    [ DISKMON] 07/16/2010 09:42:46.389 [12350:11] dskm_proc_kgzf_handshake3: client kgzf/12297, kgzf version 0x00010004, slave 0
    [ DISKMON] 07/16/2010 09:42:46.401 [12350:3] dskm_clss_ini2: successful clsssinit(), clssvers 2.1
    [ DISKMON] 07/16/2010 09:42:46.402 [12350:3] dskm_clss_ini12: node rmodbd01 (0) registered in cluster
    [ DISKMON] 07/16/2010 09:42:46.403 [12350:3] dskm_reid_ini12: diskmon reid cid=3e0391f05e06cfafbf7419d7cf085a44,icin=174732166,nmn=0,lnid=174732166,gid=-1,gin=-1,gmn=-1,umemid=-1,opid=12350,opsn=1279291355,lvl=process
    [ DISKMON] 07/16/2010 09:42:46.424 [12350:3] dskm_sage_config: CELL storage configuration file cellinit.ora not found
    [ DISKMON] 07/16/2010 09:42:46.425 [12350:3] dskm_nfy_kgzf1: notified thread kgzf enabled
    [ DISKMON] 07/16/2010 09:42:46.425 [12350:11] dskm_proc_kgzf_handshake5: got the post from the hb thread
    [ DISKMON] 07/16/2010 09:42:46.425 [12350:11] dskm_proc_kgzf_handshake9: done, kgzf enabled
    [ DISKMON] 07/16/2010 09:42:46.425 [12350:11] dskm_process_msg7: processed msg 0 type KGZM_KGZF_HANDSHAKE (0x0010), retcode 0
    [ DISKMON] 07/16/2010 09:42:46.426 [12350:3] dskm_rac_ini22: CELL storage not configured in the cluster; registered in group MASTER#DISKMON#GROUP as memno 0 (GSDGRPSZ 512)

Maybe you are looking for