CSSD does not start (Cluster Manager)

Hi, All,
I had installed Oracle 10.2.0 and I'm gone use ASM. But when I'm starting de CSSD nothing happens. No process are submited.
The description :
# ./localconfig reset $ORACLE_HOME
Successfully accumulated necessary OCR keys.
Creating OCR keys for user 'root', privgrp 'root'..
Operation successful.
Configuration for local CSS has been initialized
Adding to inittab
Startup will be queued to init within 90 seconds.
Checking the status of new Oracle init process...
Expecting the CRS daemons to be up within 600 seconds.
Giving up: Oracle CSS stack appears NOT to be running.
Oracle CSS service would not start as installed
Automatic Storage Management(ASM) cannot be used until Oracle CSS service is started
Can someone help me?
**The host name are not in capital letter

HI thanks for the reply,
Following is the log generated:
/u01/app/oracle/product/10.2.0/db_1/log/ldi/cssd>more ocssd.log
Oracle Database 10g CRS Release 10.2.0.1.0 Production Copyright 1996, 2005 Oracle. All rights reserved.
[    CSSD]2007-06-18 15:09:10.371 >USER: Oracle Database 10g CSS Release 10.2.0.1.0 Production Copyright 1996, 2004 Oracle.
All rights reserved.
[  clsdmt]Listening to (ADDRESS=(PROTOCOL=ipc)(KEY=ldiDBG_CSSD))
[    CSSD]2007-06-18 15:09:10.371 >USER: CSS daemon log for node ldi, number 0, in cluster localhost
[    CSSD]2007-06-18 15:09:10.418 [1] >TRACE: clssscmain: local-only set to true
[    CSSD]2007-06-18 15:09:10.438 [1] >TRACE: clssnmReadNodeInfo: added node 0 (ldi) to cluster
[    CSSD]2007-06-18 15:09:10.500 [5] >TRACE: clssnm_skgxnmon: skgxn init failed, rc 1
[    CSSD]2007-06-18 15:09:10.501 [1] >TRACE: clssnm_skgxnonline: Using vacuous skgxn monitor
[    CSSD]2007-06-18 15:09:10.502 [1] >TRACE: clssnmInitNMInfo: misscount set to 30
[    CSSD]2007-06-18 15:09:10.508 [1] >TRACE: clssnmFatalInit: recognized localonly mode
[    CSSD]2007-06-18 15:09:10.523 [6] >TRACE: clssnmconnect: connecting to node 0, flags 0x0001, connector 1
[    CSSD]2007-06-18 15:09:10.557 [7] >TRACE: clsclisten: Permission denied for (ADDRESS=(PROTOCOL=ipc)(KEY=Oracle_CSS_LclLs
tnr_localhost_0))
[    CSSD]2007-06-18 15:09:10.558 [7] >ERROR: clssgmclientlsnr: listening failed for (ADDRESS=(PROTOCOL=ipc)(KEY=Oracle_CSS_
LclLstnr_localhost_0)) (3)
[    CSSD]2007-06-18 15:09:10.558 [7] >TRACE: clssgmclientlsnr: listening on (ADDRESS=(PROTOCOL=ipc)(KEY=Oracle_CSS_LclLstnr
localhost0))
[    CSSD]2007-06-18 15:09:10.558 [7] >TRACE: clssgmclientlsnr: listening on (ADDRESS=(PROTOCOL=ipc)(KEY=OCSSD_LL_ldi_localh
ost))
[    CSSD]2007-06-18 17:03:00.680 >USER: Oracle Database 10g CSS Release 10.2.0.1.0 Production Copyright 1996, 2004 Oracle.
All rights reserved.
[    CSSD]2007-06-18 17:03:00.680 >USER: CSS daemon log for node ldi, number 0, in cluster localhost
[    CSSD]2007-06-18 17:03:00.691 [1] >TRACE: clssscmain: local-only set to true
[  clsdmt]Listening to (ADDRESS=(PROTOCOL=ipc)(KEY=ldiDBG_CSSD))
[    CSSD]2007-06-18 17:03:00.701 [1] >TRACE: clssnmReadNodeInfo: added node 0 (ldi) to cluster
[    CSSD]2007-06-18 17:03:00.728 [5] >TRACE: clssnm_skgxnmon: skgxn init failed, rc 1
[    CSSD]2007-06-18 17:03:00.728 [1] >TRACE: clssnm_skgxnonline: Using vacuous skgxn monitor
[    CSSD]2007-06-18 17:03:00.729 [1] >TRACE: clssnmInitNMInfo: misscount set to 30
[    CSSD]2007-06-18 17:03:00.729 [1] >TRACE: clssnmFatalInit: recognized localonly mode
[    CSSD]2007-06-18 17:03:00.731 [6] >TRACE: clssnmconnect: connecting to node 0, flags 0x0001, connector 1
[    CSSD]2007-06-18 17:03:00.774 [7] >TRACE: clsclisten: Permission denied for (ADDRESS=(PROTOCOL=ipc)(KEY=Oracle_CSS_LclLs
tnr_localhost_0))
[    CSSD]2007-06-18 17:03:00.774 [7] >ERROR: clssgmclientlsnr: listening failed for (ADDRESS=(PROTOCOL=ipc)(KEY=Oracle_CSS_
LclLstnr_localhost_0)) (3)
[    CSSD]2007-06-18 17:03:00.775 [7] >TRACE: clssgmclientlsnr: listening on (ADDRESS=(PROTOCOL=ipc)(KEY=Oracle_CSS_LclLstnr
localhost0))
[    CSSD]2007-06-18 17:03:00.775 [7] >TRACE: clssgmclientlsnr: listening on (ADDRESS=(PROTOCOL=ipc)(KEY=OCSSD_LL_ldi_localh
ost))
Do we need to configure listener or any thing else also???

Similar Messages

  • CSSD does not start during root.sh execution

    hi,
    I am using oracle10gR2 on solaris 9 sparc.
    when i start root.sh script it stops at following point.
    Running Oracle10 root.sh script...
    The following environment variables are set as:
    ORACLE_OWNER= oracle
    ORACLE_HOME= /u01/app/oracle/product/10.2.0/Db_1
    Enter the full pathname of the local bin directory: [usr/local/bin]:
    Copying dbhome to /usr/local/bin ...
    Copying oraenv to /usr/local/bin ...
    Copying coraenv to /usr/local/bin ...
    Creating /etc/oratab file...
    Adding entry to /etc/oratab file...
    Entries will be added to the /etc/oratab file as needed by
    Database Configuration Assistant when a database is created
    Finished running generic part of root.sh script.
    Now product-specific root actions will be performed.
    but i think this is not the complete run by root.sh script because complete execution of this script perform following tasks also.
    /var/opt/oracle does not exist. Creating it now.
    /etc/oracle does not exist. Creating it now.
    Successfully accumulated necessary OCR keys.
    Creating OCR keys for user 'root', privgrp 'root'..
    Operation successful.
    Oracle Cluster Registry for cluster has been initialized
    Adding to inittab
    Checking the status of Oracle init process...
    Expecting the CRS daemons to be up within 600 seconds.
    CSS is active on these nodes.
    mars
    CSS is active on all nodes.
    Oracle CSS service is installed and running under init(1M)
    I have tried to use the localconfig reset command but still it is giving same error.
    I have searched through this forum but still no solution.
    I have tried metalink note 314173.1 also but error is still there.
    Any solution for this????

    CSSD does not start (Cluster Manager)
    CSSD does not start (Cluster Manager)

  • Cssd does not start in non-RAC environment Thus we can not bring up ASM

    Non-RAC environment
    ASM version = 11.1.0.7
    HP-UX Itanium 11.23
    After power outage, CSSD does not start on non-RAC environment
    Running as root "/sbin/init.d/init.cssd start" does not start cssd
    Oracle support tried "$ASM_HOME/bin/localconfig delete" and "$ASM_HOME/bin/localconfig add"
    but it did not start CSS
    Oracle support tried "$ASM_HOME/bin/localconfig reset $ASM_HOME"
    It started the CSSD and the "crsctl check css" came back with CSS is healthy
    But around 1 minute later it rebooted the server and when it came up again CSS does not start.
    They checked /etc/inittab and it looked fine.
    Before the reboot we saw this message in the /var/adm/syslog/OLDsyslog.log:
    Cluster Ready Services completed waiting on dependencies
    Again it is a NON-RAC environment. We only need CSSD for ASM. We do not have CRS installed on this server.
    Our test system has been down for a week and we did not get the resolution from Oracle support yet !
    Any pointers are greately appriciated.
    Thanks,
    Dzung

    Here is the message in $ASM_HOME/log/<hostname>/alert<hostname>.log :
    2010-07-16 09:42:02.956
    [client(11930)]CRS-1006:The OCR location /db/app/oracle/product/11.1/cdata/localhost/local.ocr is inacce
    ssible. Details in /db/app/oracle/product/11.1/log/rmodbd01/client/clscfg10.log.
    2010-07-16 09:42:02.971
    [client(11930)]CRS-1006:The OCR location /db/app/oracle/product/11.1/cdata/localhost/local.ocr is inacce
    ssible. Details in /db/app/oracle/product/11.1/log/rmodbd01/client/clscfg10.log.
    2010-07-16 09:42:03.054
    [client(11930)]CRS-1013:The OCR at /db/app/oracle/product/11.1/cdata/localhost/local.ocr was successfull
    y formatted using version 2. Ignore earlier CRS-1006 messages if any.
    2010-07-16 09:42:46.379
    [cssd(12297)]CRS-1601:CSSD Reconfiguration complete. Active nodes are rmodbd01 .
    Here is the message in $ASM_HOME/log/<hostname>/cssd/cssdOUT.log:
    setsid: failed with -1/1
    s0clssscGetEnvOracleUser: calling getpwnam_r for user oracle
    s0clssscGetEnvOracleUser: info for user oracle complete
    07/16/10 09:42:36: CSSD starting
    Here is the message in $ASM_HOME/log/<hostname>/cssd/ocssd.log:
    [    CSSD]2010-07-16 09:42:46.378 [18] >TRACE: clssgmCompareSwapEventValue: changed CmInfo State val 7, from 6, changes 6
    [    CSSD]2010-07-16 09:42:46.378 [18] >TRACE: clssgmSetVersions: properties common to all peers: 1,2,3,4,5,6,7
    [    CSSD]2010-07-16 09:42:46.378 [18] >TRACE: clssgmEstablishMasterNode: MASTER for 174732166 is node(0) birth(174732166)
    [    CSSD]2010-07-16 09:42:46.378 [18] >TRACE: clssgmChangeMasterNode: requeued 0 RPCs
    [    CSSD]2010-07-16 09:42:46.378 [18] >TRACE: clssgmCompareSwapEventValue: changed CmInfo State val 8, from 7, changes 7
    [    CSSD]2010-07-16 09:42:46.378 [18] >TRACE: clssgmMasterCMSync: Synchronizing group/lock status
    [    CSSD]2010-07-16 09:42:46.378 [18] >TRACE: clssgmMasterSendDBDone: group/lock status synchronization complete
    [    CSSD]2010-07-16 09:42:46.378 [18] >TRACE: clssgmCompareSwapEventValue: changed CmInfo State val 9, from 8, changes 8
    [    CSSD]2010-07-16 09:42:46.378 [18] >TRACE: clssgmCompareSwapEventValue: changed CmInfo State val 10, from 9, changes 9
    [    CSSD]CLSS-3000: reconfiguration successful, incarnation 174732166 with 1 nodes
    [    CSSD]CLSS-3001: local node number 0, master node number 0
    [    CSSD]2010-07-16 09:42:46.378 [18] >TRACE: clssscSAGEInitFenceCompl: Completing kgzf fence initialization
    [    CSSD]2010-07-16 09:42:46.394 [12] >TRACE: clssgmUpdateEventValue: Client listener incarn val 174732166, changes 1
    [    CSSD]2010-07-16 09:42:46.395 [12] >TRACE: clssgmAllocProc: (60000000003c7120) allocated
    [    CSSD]2010-07-16 09:42:46.395 [12] >TRACE: clssgmAllocProc: (60000000003c73a0) allocated
    [    CSSD]2010-07-16 09:42:46.396 [14] >TRACE: Connect request from user oracle
    [    CSSD]2010-07-16 09:42:46.396 [14] >TRACE: Connect request from user root
    [    CSSD]2010-07-16 09:42:46.397 [12] >TRACE: clssgmClientConnectMsg: properties of cmProc 60000000003c7120 - 1,2,3
    [    CSSD]2010-07-16 09:42:46.397 [12] >TRACE: clssgmClientConnectMsg: Connect from con(60000000003b2810) proc(60000000003c7120) pid(12350) version 11:1:1:4
    [    CSSD]2010-07-16 09:42:46.397 [12] >TRACE: clssgmClientConnectMsg: properties of cmProc 60000000003c73a0 - 1,2,3
    [    CSSD]2010-07-16 09:42:46.397 [12] >TRACE: clssgmClientConnectMsg: Connect from con(60000000003b2990) proc(60000000003c73a0) pid(12131) version 11:1:1:4
    [    CSSD]2010-07-16 09:42:46.402 [12] >TRACE: clssgmRegisterClient: proc(1/60000000003c7120), client(1/600000000096e7c0)
    [    CSSD]2010-07-16 09:42:46.402 [12] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (600000000096e7c0)
    [    CSSD]2010-07-16 09:42:46.402 [12] >TRACE: clssgmJoinGrock: local grock CSS_INTERNAL_NODE_GROUP new client 600000000096e7c0 with con 60000000003b2b10, requested num 0
    [    CSSD]2010-07-16 09:42:46.402 [12] >TRACE: clssgmAddNodeGrpMember: member (60000000009e0030) added
    [    CSSD]2010-07-16 09:42:46.403 [12] >TRACE: clssgmGroupState: requested group state of group localhost_NG, member count 0
    [    CSSD]2010-07-16 09:42:46.403 [12] >TRACE: clssgmGroupState: requested group state of group localhost_NG, member count 0
    [    CSSD]2010-07-16 09:42:46.404 [12] >TRACE: clssgmDeadProc: proc 60000000003c73a0
    [    CSSD]2010-07-16 09:42:46.404 [12] >TRACE: clssgmDestroyProc: cleaning up proc(60000000003c73a0) con(60000000003b2990) skgpid ospid 12131 with 0 clients, refcount 0
    [    CSSD]2010-07-16 09:42:46.425 [12] >TRACE: clssgmGroupState: requested group state of unknown group MASTER#DISKMON#GROUP
    [    CSSD]2010-07-16 09:42:46.425 [12] >TRACE: clssgmGroupState: requested group state of group MASTER#DISKMON#GROUP, member count 0
    [    CSSD]2010-07-16 09:42:46.425 [18] >TRACE: KGZF: context successfully initialized, API version 1.4, using pipe default
    [    CSSD]2010-07-16 09:42:46.425 [18] >TRACE: clssscSAGEInitFenceCompl: kgzf fence initialization successfully completed
    [    CSSD]2010-07-16 09:42:46.425 [18] >TRACE: clssgmReconfigThread: CSS/GM open for global group registrations
    [    CSSD]2010-07-16 09:42:46.425 [18] >TRACE: clssgmReconfigThread: completed for reconfig(174732166), with status(1)
    [    CSSD]2010-07-16 09:42:46.425 [18] >TRACE: clssgmUpdateEventValue: Reconfig Event val 2, changes 2
    [    CSSD]2010-07-16 09:42:46.425 [1] >TRACE: clssgmWaitOnEventValue: after Reconfig Event val 2, eval 2 waited 47
    [    CSSD]2010-07-16 09:42:46.425 [12] >TRACE: clssgmRegisterClient: proc(1/60000000003c7120), client(2/600000000096e870)
    [    CSSD]2010-07-16 09:42:46.425 [1] >TRACE: clssgmUpdateEventValue: Reconfig Event val 0, changes 3
    [    CSSD]2010-07-16 09:42:46.425 [1] >TRACE: clssgmStartNMMon: previous reconfig complete, incarnation(174732166)
    [    CSSD]2010-07-16 09:42:46.425 [12] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 2 (600000000096e870)
    [    CSSD]2010-07-16 09:42:46.425 [12] >TRACE: clssgmJoinGrock: global grock MASTER#DISKMON#GROUP#MX new client 600000000096e870 with con 60000000003b2990, requested num -1
    [    CSSD]2010-07-16 09:42:46.425 [12] >TRACE: clssgmAddGrockMember: adding member to grock MASTER#DISKMON#GROUP#MX
    [    CSSD]2010-07-16 09:42:46.425 [12] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(0) grock (6000000000989e50/MASTER#DISKMON#GROUP#MX)
    [    CSSD]2010-07-16 09:42:46.425 [12] >TRACE: clssgmQueueGrockEvent: lockName(MASTER#DISKMON#GROUP#MX) type(3) count (1/1) xwaiters(1) event(1) to memberNo(0)
    [    CSSD]2010-07-16 09:42:46.425 [12] >TRACE: clssgmCommonAddMember: global lock grock MASTER#DISKMON#GROUP#MX member(0/Local) node(0) flags 0x2 0x2
    [    CSSD]2010-07-16 09:42:46.425 [12] >TRACE: clssgmRegisterClient: proc(1/60000000003c7120), client(3/600000000096e920)
    [    CSSD]2010-07-16 09:42:46.425 [12] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 3 (600000000096e920)
    [    CSSD]2010-07-16 09:42:46.425 [12] >TRACE: clssgmJoinGrock: global grock MASTER#DISKMON#GROUP new client 600000000096e920 with con 60000000003b2bd0, requested num 0
    [    CSSD]2010-07-16 09:42:46.425 [12] >TRACE: clssgmAddGrockMember: adding member to grock MASTER#DISKMON#GROUP
    [    CSSD]2010-07-16 09:42:46.425 [12] >TRACE: clssgmAddMember: new master 0 for group(MASTER#DISKMON#GROUP)
    [    CSSD]2010-07-16 09:42:46.426 [12] >TRACE: clssgmAddMember: Adding fencing for member 0, group MASTER#DISKMON#GROUP, death 1, SAGE 0
    [    CSSD]2010-07-16 09:42:46.426 [12] >TRACE: clssgmAddMember: member (0/60000000009e0230) added. pbsz(72) prsz(0) flags 0x0 to grock (600000000098a170/MASTER#DISKMON#GROUP)
    [    CSSD]2010-07-16 09:42:46.426 [12] >TRACE: clssgmQueueGrockEvent: groupName(MASTER#DISKMON#GROUP) count(1) master(0) event(1), incarn 1, mbrc 1, to member 0, events 0x78, state 0x0
    [    CSSD]2010-07-16 09:42:46.426 [12] >TRACE: clssgmCommonAddMember: global group grock MASTER#DISKMON#GROUP member(0/Local) node(0) flags 0x0 0x1e00
    [    CSSD]2010-07-16 09:42:46.426 [12] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 2 (600000000096e870)
    [    CSSD]2010-07-16 09:42:46.426 [12] >TRACE: clssgmExitGrock: client 2 (600000000096e870), grock MASTER#DISKMON#GROUP#MX, member 0
    [    CSSD]2010-07-16 09:42:46.426 [12] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (60000000009e0130) in global grock MASTER#DISKMON#GROUP#MX
    [    CSSD]2010-07-16 09:42:46.426 [12] >TRACE: clssgmRemoveMember: grock MASTER#DISKMON#GROUP#MX, member number 0 (60000000009e0130) node number 0 state 0x14 member refcnt 0 grock type 3
    [    CSSD]2010-07-16 09:42:48.405 [8] >TRACE: clssnmSendingThread: sending status msg to all nodes
    [    CSSD]2010-07-16 09:42:48.405 [8] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes
    [    CSSD]2010-07-16 09:42:52.444 [8] >TRACE: clssnmSendingThread: sending status msg to all nodes
    [    CSSD]2010-07-16 09:42:52.444 [8] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes
    [    CSSD]2010-07-16 09:42:56.484 [8] >TRACE: clssnmSendingThread: sending status msg to all nodes
    [    CSSD]2010-07-16 09:42:56.484 [8] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes
    [    CSSD]2010-07-16 09:43:00.516 [8] >TRACE: clssnmSendingThread: sending status msg to all nodes
    [    CSSD]2010-07-16 09:43:00.516 [8] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes
    [    CSSD]2010-07-16 09:43:04.563 [8] >TRACE: clssnmSendingThread: sending status msg to all nodes
    [    CSSD]2010-07-16 09:43:04.563 [8] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes
    [    CSSD]2010-07-16 09:43:08.603 [8] >TRACE: clssnmSendingThread: sending status msg to all nodes
    [    CSSD]2010-07-16 09:43:08.603 [8] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes
    [    CSSD]2010-07-16 09:43:12.643 [8] >TRACE: clssnmSendingThread: sending status msg to all nodes
    [    CSSD]2010-07-16 09:43:12.643 [8] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes
    [    CSSD]2010-07-16 09:43:16.676 [8] >TRACE: clssnmSendingThread: sending status msg to all nodes
    [    CSSD]2010-07-16 09:43:16.676 [8] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes
    [    CSSD]2010-07-16 09:43:20.723 [8] >TRACE: clssnmSendingThread: sending status msg to all nodes
    [    CSSD]2010-07-16 09:43:20.723 [8] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes
    [    CSSD]2010-07-16 09:43:24.762 [8] >TRACE: clssnmSendingThread: sending status msg to all nodes
    [    CSSD]2010-07-16 09:43:24.762 [8] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes
    [    CSSD]2010-07-16 09:43:28.802 [8] >TRACE: clssnmSendingThread: sending status msg to all nodes
    [    CSSD]2010-07-16 09:43:28.802 [8] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes
    [    CSSD]2010-07-16 09:43:32.842 [8] >TRACE: clssnmSendingThread: sending status msg to all nodes
    [    CSSD]2010-07-16 09:43:32.842 [8] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes
    [    CSSD]2010-07-16 09:43:36.882 [8] >TRACE: clssnmSendingThread: sending status msg to all nodes
    [    CSSD]2010-07-16 09:43:36.882 [8] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes
    [    CSSD]2010-07-16 09:43:40.922 [8] >TRACE: clssnmSendingThread: sending status msg to all nodes
    [    CSSD]2010-07-16 09:43:40.922 [8] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes
    [    CSSD]2010-07-16 09:43:44.964 [8] >TRACE: clssnmSendingThread: sending status msg to all nodes
    [    CSSD]2010-07-16 09:43:44.964 [8] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes
    [    CSSD]2010-07-16 09:43:49.002 [8] >TRACE: clssnmSendingThread: sending status msg to all nodes
    [    CSSD]2010-07-16 09:43:49.002 [8] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes
    [    CSSD]2010-07-16 09:43:53.043 [8] >TRACE: clssnmSendingThread: sending status msg to all nodes
    [    CSSD]2010-07-16 09:43:53.043 [8] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes
    [    CSSD]2010-07-16 09:43:57.085 [8] >TRACE: clssnmSendingThread: sending status msg to all nodes
    [    CSSD]2010-07-16 09:43:57.085 [8] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes
    [    CSSD]2010-07-16 09:43:58.354 [12] >TRACE: clssgmAllocProc: (60000000003c7ee0) allocated
    [    CSSD]2010-07-16 09:43:58.355 [14] >TRACE: Connect request from user oracle
    [    CSSD]2010-07-16 09:43:58.356 [12] >TRACE: clssgmClientConnectMsg: properties of cmProc 60000000003c7ee0 - 1,2,3
    [    CSSD]2010-07-16 09:43:58.356 [12] >TRACE: clssgmClientConnectMsg: Connect from con(60000000003b2990) proc(60000000003c7ee0) pid(13157) version 11:1:1:4
    [    CSSD]2010-07-16 09:43:58.360 [12] >TRACE: clssgmRegisterClient: proc(2/60000000003c7ee0), client(1/600000000096e870)
    [    CSSD]2010-07-16 09:43:58.360 [12] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (600000000096e870)
    [    CSSD]2010-07-16 09:43:58.360 [12] >TRACE: clssgmJoinGrock: global grock CLSSSCHECK_GROUP new client 600000000096e870 with con 60000000003b2c90, requested num -1
    [    CSSD]2010-07-16 09:43:58.360 [12] >TRACE: clssgmAddGrockMember: adding member to grock CLSSSCHECK_GROUP
    [    CSSD]2010-07-16 09:43:58.360 [12] >TRACE: clssgmAddMember: new master 0 for group(CLSSSCHECK_GROUP)
    [    CSSD]2010-07-16 09:43:58.360 [12] >TRACE: clssgmAddMember: Adding fencing for member 0, group CLSSSCHECK_GROUP, death 1, SAGE 0
    [    CSSD]2010-07-16 09:43:58.360 [12] >TRACE: clssgmAddMember: member (0/60000000009e0130) added. pbsz(8) prsz(8) flags 0x0 to grock (6000000000989e50/CLSSSCHECK_GROUP)
    [    CSSD]2010-07-16 09:43:58.360 [12] >TRACE: clssgmQueueGrockEvent: groupName(CLSSSCHECK_GROUP) count(1) master(0) event(1), incarn 1, mbrc 1, to member 0, events 0x0, state 0x0
    [    CSSD]2010-07-16 09:43:58.360 [12] >TRACE: clssgmCommonAddMember: global group grock CLSSSCHECK_GROUP member(0/Local) node(0) flags 0x0 0x0
    [    CSSD]2010-07-16 09:43:58.361 [12] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (600000000096e870)
    [    CSSD]2010-07-16 09:43:58.361 [12] >TRACE: clssgmExitGrock: client 1 (600000000096e870), grock CLSSSCHECK_GROUP, member 0
    [    CSSD]2010-07-16 09:43:58.361 [12] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (60000000009e0130) in global grock CLSSSCHECK_GROUP
    [    CSSD]2010-07-16 09:43:58.361 [12] >TRACE: clssgmRemoveMember: grock CLSSSCHECK_GROUP, member number 0 (60000000009e0130) node number 0 state 0x14 member refcnt 0 grock type 2
    [    CSSD]2010-07-16 09:43:58.361 [12] >TRACE: clssgmRegisterClient: proc(2/60000000003c7ee0), client(2/600000000096e870)
    [    CSSD]2010-07-16 09:43:58.361 [12] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 2 (600000000096e870)
    [    CSSD]2010-07-16 09:43:58.361 [12] >TRACE: clssgmJoinGrock: global grock CLSSSCHECK_LOCK new client 600000000096e870 with con 60000000003b2c90, requested num -1
    [    CSSD]2010-07-16 09:43:58.361 [12] >TRACE: clssgmAddGrockMember: adding member to grock CLSSSCHECK_LOCK
    [    CSSD]2010-07-16 09:43:58.361 [12] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(0) grock (6000000000989e50/CLSSSCHECK_LOCK)
    [    CSSD]2010-07-16 09:43:58.361 [12] >TRACE: clssgmQueueGrockEvent: lockName(CLSSSCHECK_LOCK) type(3) count (1/1) xwaiters(1) event(1) to memberNo(0)
    [    CSSD]2010-07-16 09:43:58.361 [12] >TRACE: clssgmCommonAddMember: global lock grock CLSSSCHECK_LOCK member(0/Local) node(0) flags 0x2 0x2
    [    CSSD]2010-07-16 09:43:58.361 [12] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 2 (600000000096e870)
    [    CSSD]2010-07-16 09:43:58.361 [12] >TRACE: clssgmExitGrock: client 2 (600000000096e870), grock CLSSSCHECK_LOCK, member 0
    [    CSSD]2010-07-16 09:43:58.361 [12] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (60000000009e0130) in global grock CLSSSCHECK_LOCK
    [    CSSD]2010-07-16 09:43:58.361 [12] >TRACE: clssgmRemoveMember: grock CLSSSCHECK_LOCK, member number 0 (60000000009e0130) node number 0 state 0x14 member refcnt 0 grock type 3
    [    CSSD]2010-07-16 09:43:58.362 [12] >TRACE: clssgmDeadProc: proc 60000000003c7ee0
    [    CSSD]2010-07-16 09:43:58.362 [12] >TRACE: clssgmDestroyProc: cleaning up proc(60000000003c7ee0) con(60000000003b2990) skgpid ospid 13157 with 0 clients, refcount 0
    [    CSSD]2010-07-16 09:44:01.125 [8] >TRACE: clssnmSendingThread: sending status msg to all nodes
    [    CSSD]2010-07-16 09:44:01.125 [8] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes
    [    CSSD]2010-07-16 09:44:05.164 [8] >TRACE: clssnmSendingThread: sending status msg to all nodes
    [    CSSD]2010-07-16 09:44:05.164 [8] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes
    [    CSSD]2010-07-16 09:44:09.196 [8] >TRACE: clssnmSendingThread: sending status msg to all nodes
    [    CSSD]2010-07-16 09:44:09.196 [8] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes
    [    CSSD]2010-07-16 09:44:13.236 [8] >TRACE: clssnmSendingThread: sending status msg to all nodes
    [    CSSD]2010-07-16 09:44:13.236 [8] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes
    [    CSSD]2010-07-16 09:44:17.284 [8] >TRACE: clssnmSendingThread: sending status msg to all nodes
    [    CSSD]2010-07-16 09:44:17.284 [8] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes
    [    CSSD]2010-07-16 09:44:21.322 [8] >TRACE: clssnmSendingThread: sending status msg to all nodes
    [    CSSD]2010-07-16 09:44:21.322 [8] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes
    [    CSSD]2010-07-16 09:44:25.316 [8] >TRACE: clssnmSendingThread: sending status msg to all nodes
    [    CSSD]2010-07-16 09:44:25.316 [8] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes
    [    CSSD]2010-07-16 09:44:30.333 [8] >TRACE: clssnmSendingThread: sending status msg to all nodes
    [    CSSD]2010-07-16 09:44:30.333 [8] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes
    [    CSSD]2010-07-16 09:44:34.324 [8] >TRACE: clssnmSendingThread: sending status msg to all nodes
    [    CSSD]2010-07-16 09:44:34.324 [8] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes
    Here is the message in $ASM_HOME/log/<hostname>/diskmon/client.log:
    [ DISKMON] 07/16/2010 18:33:32.050 dskm_send_command: process 23246 sending command 8 to master diskmon listening on default pipe
    [ DISKMON] 07/16/2010 18:33:32.080 dskm_send_command3: skgznp_connect failed with error 56815
    [ DISKMON] 07/16/2010 18:33:32.080 dskm_send_command3: error 56815 at location skgznpcon6 - connect() - Connection refused
    Here is the message in $ASM_HOME/log/<hostname>/diskmon/diskmonOUT.log:
    setsid: failed with -1/1
    dskm_getenv_oracle_user: calling getpwnam_r for user oracle
    dskm_getenv_oracle_user: info for user oracle complete
    07/16/10 18:33:31: Master Diskmon starting
    Here is the message in $ASM_HOME/log/<hostname>/diskmon/diskmon.log:
    [ DISKMON] 07/16/2010 09:42:35.573 dskm main: starting up
    [ DISKMON] 07/16/2010 09:42:35.588 [12350:3] dskm_rac_thrd_main: running
    [ DISKMON] 07/16/2010 09:42:35.588 [12350:1] dskm_rac_thrd_creat2: got the post from the css event handling thread
    [ DISKMON] 07/16/2010 09:42:35.589 [12350:1] dskm main: startup complete
    [ DISKMON] 07/16/2010 09:42:35.589 [12350:1] listening on -> default pipe
    [ DISKMON] 07/16/2010 09:42:35.792 clsc_connect: (6000000000700420) no listener at (ADDRESS=(PROTOCOL=ipc)(KEY=OCSSD_LL_rmodbd01_))
    [ DISKMON] 07/16/2010 09:42:36.385 clsc_connect: (6000000000700420) no listener at (ADDRESS=(PROTOCOL=ipc)(KEY=OCSSD_LL_rmodbd01_))
    [ DISKMON] 07/16/2010 09:42:36.906 clsc_connect: (6000000000700420) no listener at (ADDRESS=(PROTOCOL=ipc)(KEY=OCSSD_LL_rmodbd01_))
    [ DISKMON] 07/16/2010 09:42:37.426 clsc_connect: (6000000000700420) no listener at (ADDRESS=(PROTOCOL=ipc)(KEY=OCSSD_LL_rmodbd01_))
    [ DISKMON] 07/16/2010 09:42:37.945 clsc_connect: (6000000000700420) no listener at (ADDRESS=(PROTOCOL=ipc)(KEY=OCSSD_LL_rmodbd01_))
    [ DISKMON] 07/16/2010 09:42:38.465 clsc_connect: (6000000000700420) no listener at (ADDRESS=(PROTOCOL=ipc)(KEY=OCSSD_LL_rmodbd01_))
    [ DISKMON] 07/16/2010 09:42:46.376 [12350:1] dskm_slave_thrd_creat: thread created
    [ DISKMON] 07/16/2010 09:42:46.376 [12350:11] dskm_slave_thrd_main1: slave 0 running
    [ DISKMON] 07/16/2010 09:42:46.376 [12350:11] dskm_process_msg5: received msg type KGZM_IDENTIFY (0x0001)
    [ DISKMON] 07/16/2010 09:42:46.389 [12350:11] dskm_proc_identify8: client kgzf/12297, version 0x01020000, slave 0, reid cid=3e0391f05e06cfafbf7419d7cf085a44,icin=174732166,nmn=0,lnid=174732166,gid=0,gin=0,gmn=0,umemid=0,opid=0,opsn=0,lvl=node
    [ DISKMON] 07/16/2010 09:42:46.389 [12350:11] dskm_send_version1:
    [ DISKMON] 07/16/2010 09:42:46.389 [12350:11] dskm_send_version4: done
    [ DISKMON] 07/16/2010 09:42:46.389 [12350:11] dskm_process_msg7: processed msg 0 type KGZM_IDENTIFY (0x0001), retcode 0
    [ DISKMON] 07/16/2010 09:42:46.389 [12350:11] dskm_process_msg5: received msg type KGZM_KGZF_HANDSHAKE (0x0010)
    [ DISKMON] 07/16/2010 09:42:46.389 [12350:11] dskm_proc_kgzf_handshake3: client kgzf/12297, kgzf version 0x00010004, slave 0
    [ DISKMON] 07/16/2010 09:42:46.401 [12350:3] dskm_clss_ini2: successful clsssinit(), clssvers 2.1
    [ DISKMON] 07/16/2010 09:42:46.402 [12350:3] dskm_clss_ini12: node rmodbd01 (0) registered in cluster
    [ DISKMON] 07/16/2010 09:42:46.403 [12350:3] dskm_reid_ini12: diskmon reid cid=3e0391f05e06cfafbf7419d7cf085a44,icin=174732166,nmn=0,lnid=174732166,gid=-1,gin=-1,gmn=-1,umemid=-1,opid=12350,opsn=1279291355,lvl=process
    [ DISKMON] 07/16/2010 09:42:46.424 [12350:3] dskm_sage_config: CELL storage configuration file cellinit.ora not found
    [ DISKMON] 07/16/2010 09:42:46.425 [12350:3] dskm_nfy_kgzf1: notified thread kgzf enabled
    [ DISKMON] 07/16/2010 09:42:46.425 [12350:11] dskm_proc_kgzf_handshake5: got the post from the hb thread
    [ DISKMON] 07/16/2010 09:42:46.425 [12350:11] dskm_proc_kgzf_handshake9: done, kgzf enabled
    [ DISKMON] 07/16/2010 09:42:46.425 [12350:11] dskm_process_msg7: processed msg 0 type KGZM_KGZF_HANDSHAKE (0x0010), retcode 0
    [ DISKMON] 07/16/2010 09:42:46.426 [12350:3] dskm_rac_ini22: CELL storage not configured in the cluster; registered in group MASTER#DISKMON#GROUP as memno 0 (GSDGRPSZ 512)

  • The CSSD does not start automatically on Non-RAC - AIX 5L

    Hi all,
    Database: Oracle 10.2.0.4
    O.S AIX 5.3 TL 10
    I am facing a problem with the CSSD Non-RAC/Clusterware.
    When we restarted the server the service CSSD does not start automatically and there is no relevant messages in the log files of CSSD.
    Running the "localconfig reset $ORACLE_HOME", execute successfully but does not start the CSSD.
    Running "/etc/init.cssd start" - does not work, nothing happens when we run it
    I manually ran "/etc/ init.cssd run" and the service CSSD (ossd.bin) was started without errors.
    No errors on errpt from AIX.
    I've opened a SR but I am waiting for response from Oracle.

    Hi,
    I believe this problem is not with Oracle, but in AIX.It may be that one process that is starting on boot is holding the other process. You need to identify what is process/application.
    Check the process on inittab that are already active and which are inactive they should be active.
    One clue: Is very common process that is initiated in wait mode hold the boot server.
    wait
    When the init command enters the run level that matches the entry's run level,
    start the process and wait for its termination.
    All subsequent reads of the /etc/inittab file while the init
    command is in the same run level will cause the init command to ignore this entry.http://publib.boulder.ibm.com/infocenter/aix/v6r1/index.jsp?topic=/com.ibm.aix.files/doc/aixfiles/inittab.htm
    Regards,
    Levi Pereira

  • Grid Infrastructure Does Not Start Cluster Resources

    Hello Gurus,
    I configured a 2 node RAC cluster using VirtualBox.It has been running fine all along and each time I started one of the nodes, I will definitely see all of other Cluster Resources will be started eventually.
    However, after I left it untouched for a month (VM is stopped), I found out that after starting up the machine, only local resource which is ONLINE.
    This is what I get:
    [grid@oel6-112-rac1 bin]$ ./crsctl status resource -t
    NAME           TARGET  STATE        SERVER                   STATE_DETAILS      
    Local Resources
    ora.CRS.dg
                   ONLINE  ONLINE       oel6-112-rac1                               
    ora.DATADG.dg
                   ONLINE  ONLINE       oel6-112-rac1                               
    ora.FRADG.dg
                   ONLINE  ONLINE       oel6-112-rac1                               
    ora.LISTENER.lsnr
                   OFFLINE OFFLINE      oel6-112-rac1                               
    ora.asm
                   ONLINE  ONLINE       oel6-112-rac1            Started            
    ora.gsd
                   OFFLINE OFFLINE      oel6-112-rac1                               
    ora.net1.network
                   ONLINE  ONLINE       oel6-112-rac1                               
    ora.ons
                   ONLINE  ONLINE       oel6-112-rac1                               
    Cluster Resources
    ora.LISTENER_SCAN1.lsnr
          1        OFFLINE OFFLINE                                                  
    ora.LISTENER_SCAN2.lsnr
          1        OFFLINE OFFLINE                                                  
    ora.LISTENER_SCAN3.lsnr
          1        OFFLINE OFFLINE                                                  
    ora.cvu
          1        OFFLINE OFFLINE                                                  
    ora.oc4j
          1        OFFLINE OFFLINE                                                  
    ora.oel6-112-rac1.vip
          1        OFFLINE OFFLINE                                                  
    ora.oel6-112-rac2.vip
          1        OFFLINE OFFLINE                                                  
    ora.racdb.db
          1        OFFLINE OFFLINE                               Instance Shutdown  
          2        OFFLINE OFFLINE                                                  
    ora.scan1.vip
          1        OFFLINE OFFLINE                                                  
    ora.scan2.vip
          1        OFFLINE OFFLINE                                                  
    ora.scan3.vip
          1        OFFLINE OFFLINE                                               
    and these are my other resources
    [grid@oel6-112-rac1 bin]$ ./crsctl status resource -t -init
    NAME           TARGET  STATE        SERVER                   STATE_DETAILS    
    Cluster Resources
    ora.asm
          1        ONLINE  ONLINE       oel6-112-rac1            Started          
    ora.cluster_interconnect.haip
          1        ONLINE  ONLINE       oel6-112-rac1                             
    ora.crf
          1        ONLINE  ONLINE       oel6-112-rac1                             
    ora.crsd
          1        ONLINE  ONLINE       oel6-112-rac1                             
    ora.cssd
          1        ONLINE  ONLINE       oel6-112-rac1                             
    ora.cssdmonitor
          1        ONLINE  ONLINE       oel6-112-rac1                             
    ora.ctssd
          1        ONLINE  ONLINE       oel6-112-rac1            ACTIVE:0         
    ora.diskmon
          1        OFFLINE OFFLINE                                                
    ora.evmd
          1        ONLINE  ONLINE       oel6-112-rac1                             
    ora.gipcd
          1        ONLINE  ONLINE       oel6-112-rac1                             
    ora.gpnpd
          1        ONLINE  ONLINE       oel6-112-rac1                             
    ora.mdnsd
          1        ONLINE  ONLINE       oel6-112-rac1                       
    Where do I supposed to check to see why the Cluster Resource like SCAN Listener, Database and etc not running?
    I've been checking on the logs but I haven't figured out what I should be looking at.
    Can some body help me?
    Thank you in advanced,
    Adhika

    Hi Freddie,
    I saw these lines on that Clusterware alert log:
    2013-07-01 22:39:20.084
    [crsd(3338)]CRS-1012:The OCR service started on node oel6-112-rac1.
    2013-07-01 22:39:20.208
    [evmd(3145)]CRS-1401:EVMD started on node oel6-112-rac1.
    2013-07-01 22:39:21.549
    [crsd(3338)]CRS-1201:CRSD started on node oel6-112-rac1.
    2013-07-01 22:39:22.715
    [/u01/app/11203/grid/bin/oraagent.bin(3450)]CRS-5016:Process "/u01/app/11203/grid/bin/lsnrctl" spawned by agent "/u01/app/11203/grid/bin/oraagent.bin" for action "check" failed: details at "(:CLSN00010:)" in "/u01/app/11203/grid/log/oel6-112-rac1/agent/crsd/oraagent_grid/oraagent_grid.log"
    2013-07-01 22:39:22.728
    [/u01/app/11203/grid/bin/oraagent.bin(3450)]CRS-5016:Process "/u01/app/11203/grid/bin/lsnrctl" spawned by agent "/u01/app/11203/grid/bin/oraagent.bin" for action "check" failed: details at "(:CLSN00010:)" in "/u01/app/11203/grid/log/oel6-112-rac1/agent/crsd/oraagent_grid/oraagent_grid.log"
    2013-07-01 22:39:22.772
    [/u01/app/11203/grid/bin/oraagent.bin(3450)]CRS-5016:Process "/u01/app/11203/grid/bin/lsnrctl" spawned by agent "/u01/app/11203/grid/bin/oraagent.bin" for action "check" failed: details at "(:CLSN00010:)" in "/u01/app/11203/grid/log/oel6-112-rac1/agent/crsd/oraagent_grid/oraagent_grid.log"
    2013-07-01 22:39:22.811
    [/u01/app/11203/grid/bin/oraagent.bin(3450)]CRS-5016:Process "/u01/app/11203/grid/bin/lsnrctl" spawned by agent "/u01/app/11203/grid/bin/oraagent.bin" for action "check" failed: details at "(:CLSN00010:)" in "/u01/app/11203/grid/log/oel6-112-rac1/agent/crsd/oraagent_grid/oraagent_grid.log"
    2013-07-01 22:39:23.069
    [/u01/app/11203/grid/bin/oraagent.bin(3450)]CRS-5016:Process "/u01/app/11203/grid/opmn/bin/onsctli" spawned by agent "/u01/app/11203/grid/bin/oraagent.bin" for action "check" failed: details at "(:CLSN00010:)" in "/u01/app/11203/grid/log/oel6-112-rac1/agent/crsd/oraagent_grid/oraagent_grid.log"
    2013-07-01 22:39:23.567
    [crsd(3338)]CRS-2772:Server 'oel6-112-rac1' has been assigned to pool 'Generic'.
    2013-07-01 22:39:23.568
    [crsd(3338)]CRS-2772:Server 'oel6-112-rac1' has been assigned to pool 'ora.racdb'.
    The I started looking in the /u01/app/11203/grid/log/oel6-112-rac1/agent/crsd/oraagent_grid/oraagent_grid.log file and found out that at the same time (2013-07-01 22:39:22),
    I saw the following lines:
    2013-07-01 22:39:22.433: [ora.CRS.dg][1644160768] {1:13152:2} [check] DgpAgent::getConnxn connection failure 1
    2013-07-01 22:39:22.433: [ora.CRS.dg][1644160768] {1:13152:2} [check] DgpAgent::getConnxn failed CRS-5000: Expected resource ora.asm does not exist in agent process
    2013-07-01 22:39:22.434: [ora.CRS.dg][1644160768] {1:13152:2} [check] DgpAgent::getConnxn try getInstanceInforWhenASMFail
    2013-07-01 22:39:22.434: [ora.CRS.dg][1644160768] {1:13152:2} [check] CrsCmd::ClscrsCmdData::stat entity 1 statflag 33 useFilter 0
    But that does not prevent the asm from being started properly.
    The only local resource that didn't start up automatically was the LISTENER.
    The following command shows that the local LISTENER has hard dependency on ora.cluster_vip_net1.type which is the ora.oel6-112-rac1.vip
    [grid@oel6-112-rac1 bin]$ ./crsctl status resource ora.LISTENER.lsnr -p | grep -ie dependencies
    START_DEPENDENCIES=hard(type:ora.cluster_vip_net1.type) pullup(type:ora.cluster_vip_net1.type)
    STOP_DEPENDENCIES=hard(intermediate:type:ora.cluster_vip_net1.type)
    NAME=ora.oel6-112-rac1.vip
    TYPE=ora.cluster_vip_net1.type
    START_DEPENDENCIES=hard(ora.net1.network) pullup(ora.net1.network)
    STOP_DEPENDENCIES=hard(ora.net1.network)
    [grid@oel6-112-rac1 bin]$ ./crsctl status resource ora.net1.network -p | grep -ie dependencies
    START_DEPENDENCIES=
    STOP_DEPENDENCIES=
    The ora.net1.network resource started properly and I didn't see that this prevent the ora.oel6-112-rac1.vip from starting up.
    The following lines also show that the ora.asm resource is has a weak dependency only against the ora.LISTENER.lsnr
    [grid@oel6-112-rac1 bin]$ ./crsctl status resource ora.racdb.db -p | grep -ie dependencies
    START_DEPENDENCIES=hard(ora.DATADG.dg,ora.FRADG.dg) weak(type:ora.listener.type,global:type:ora.scan_listener.type,uniform:ora.ons,global:ora.gns) pullup(ora.DATADG.dg,ora.FRADG.dg)
    STOP_DEPENDENCIES=hard(intermediate:ora.asm,shutdown:ora.DATADG.dg,shutdown:ora.FRADG.dg)
    [grid@oel6-112-rac1 bin]$ ./crsctl status resource ora.CRS.dg -p | grep -ie dependenci
    START_DEPENDENCIES=hard(ora.asm) pullup(ora.asm)
    STOP_DEPENDENCIES=hard(intermediate:ora.asm)
    [grid@oel6-112-rac1 bin]$ ./crsctl status resource ora.DATADG.dg -p | grep -ie dependencies
    START_DEPENDENCIES=hard(ora.asm) pullup(ora.asm)
    STOP_DEPENDENCIES=hard(intermediate:ora.asm)
    [grid@oel6-112-rac1 bin]$ ./crsctl status resource ora.FRADG.dg -p | grep -ie dependencies
    START_DEPENDENCIES=hard(ora.asm) pullup(ora.asm)
    STOP_DEPENDENCIES=hard(intermediate:ora.asm)
    [grid@oel6-112-rac1 bin]$ ./crsctl status resource ora.asm -p | grep -ie dependencies
    START_DEPENDENCIES=weak(ora.LISTENER.lsnr)
    STOP_DEPENDENCIES=
    I'm a little lost here.
    A suggestion would be very much appreciated.
    Thank you,
    Adhika

  • OC4J does not start - OVM manager

    Hi
    Just finished installing OVM MANAGER. Oracle database sits on a different box.
    cat oc4j.log
    2012-03-01-03-30-08-AM
    Installing the oc4j package (rpm) ...
    Preparing... ##################################################
    oc4j ##################################################
    Done
    Starting OC4J ...Starting OC4J from /opt/oc4j/j2ee/home ...
    12/03/01 03:33:55 Exception in thread "OC4J Launcher" java.lang.NoClassDefFoundError
    12/03/01 03:33:55      at com.evermind.server.jms.XMLJMSServerConfig.postInit(XMLJMSServerConfig.java:497)
    12/03/01 03:33:55      at com.evermind.xml.XMLConfig.init(XMLConfig.java:206)
    12/03/01 03:33:55      at com.evermind.xml.XMLConfig.init(XMLConfig.java:113)
    12/03/01 03:33:55      at com.evermind.server.jms.XMLJMSServerConfig.init(XMLJMSServerConfig.java:113)
    12/03/01 03:33:55      at com.evermind.server.XMLApplicationServerConfig.getJMSServerConfig(XMLApplicationServerConfig.java:404)
    12/03/01 03:33:55      at com.evermind.server.ApplicationServer.initializeJMS(ApplicationServer.java:2417)
    12/03/01 03:33:55      at com.evermind.server.ApplicationServer.setConfig(ApplicationServer.java:989)
    12/03/01 03:33:55      at com.evermind.server.ApplicationServerLauncher.run(ApplicationServerLauncher.java:131)
    12/03/01 03:33:55      at java.lang.Thread.run(Thread.java:595)
    Failed.
    Please check the log in /var/log/ovm-manager/oc4j.log
    What can I do to start this service?
    lsb_release -a
    LSB Version:     :core-3.1-ia32:core-3.1-noarch:graphics-3.1-ia32:graphics-3.1-noarch
    Distributor ID:     OracleVMserver
    Description:     Oracle VM server release 2.2.2
    Release:     2.2.2
    Codename:     n/a

    Hi,
    You can start oc4j with the following command:
    $ oc4j -start
    Note: you must set ORACLE_HOME, JAVA_HOME and PATH environment variable before issueing this command.
    BoL,
    Sundar K

  • VIPCA does not start from root.sh

    Hi all,
    I've a problem in installing RAC 10g on ia64 architecture.
    S.O.: RH Enterprise Linux AS 2.1
    Oracle CRS install completed successfully.
    The problems came up during DB installation when I need to run root.sh script that should automatically invoke VIPCA.
    Here's what I see when I execute root.sh. :
    [root@rx5670 root]# /u01/app/oracle/product/10.1.0/db_1/root.sh
    Running Oracle10 root.sh script...
    \nThe following environment variables are set as:
    ORACLE_OWNER= oracle
    ORACLE_HOME= /u01/app/oracle/product/10.1.0/db_1
    Enter the full pathname of the local bin directory: [usr/local/bin]:
    Copying dbhome to /usr/local/bin ...
    Copying oraenv to /usr/local/bin ...
    Copying coraenv to /usr/local/bin ...
    \nCreating /etc/oratab file...
    Adding entry to /etc/oratab file...
    Entries will be added to the /etc/oratab file as needed by
    Database Configuration Assistant when a database is created
    Finished running generic part of root.sh script.
    Now product-specific root actions will be performed.
    Exception in thread "main" java.lang.UnsatisfiedLinkError: allocHASContext
    at oracle.ops.mgmt.has.HASContextNative.allocHASContext(Native
    Method)
    at oracle.ops.mgmt.has.HASContext.<init>(HASContext.java:93)
    at oracle.ops.mgmt.has.HASContext.getInstance(HASContext.java:223)
    at oracle.ops.mgmt.has.ClusterUtil.<init>(ClusterUtil.java:46)
    at
    oracle.ops.mgmt.cluster.GetActiveNodes.<init>(GetActiveNodes.java:164
    at
    oracle.ops.mgmt.cluster.GetActiveNodes.create(GetActiveNodes.java:213
    at oracle.ops.mgmt.cluster.Cluster.getNodes(Cluster.java:267)
    at oracle.ops.vipca.VipCA.getNodeList(VipCA.java:532)
    at oracle.ops.vipca.VipCA.processGUIArgs(VipCA.java:242)
    at oracle.ops.vipca.VipCA.runApplication(VipCA.java:2141)
    at oracle.ops.vipca.VipCA.main(VipCA.java:2423)
    [root@rx5670 root]#
    Thanks a lot,
    Simone

    CSSD does not start (Cluster Manager)
    CSSD does not start (Cluster Manager)

  • GoldenGate Manager Does not start  - Windows 7 64-bit, 11gR1 database

    Hi Experts,
    I ran into very tricky situation and seeking for clarification and if possible solution for the same, here how it goes: (This is a practice setup for my knowledge and not production)
    My environement:
    GGSCI (msheth-work) 18> versions
    Operating System:
    Version 6.1 (Build 7601: Service Pack 1)
    Database:
    Oracle Database 11g Enterprise Edition Release 11.2.0.1.0 - 64bit Production
    PL/SQL Release 11.2.0.1.0 - Production
    CORE 11.2.0.1.0 Production
    TNS for 64-bit Windows: Version 11.2.0.1.0 - Production
    NLSRTL Version 11.2.0.1.0 - Production
    I have two database installed called gg1, gg2 on the same local system.
    I have two goldengate installation at following location: C:\gg1 , C:\gg2
    I was successfully able to start Manager, Extract and Replicate process with out creating windows services for manager.
    I read in discussion forum that it is recommneded to have different manager name and create services for them if you have multiple Goldengate installation in the same system. (Oracle Golden Gate installation
    Now when I create services using INSTALL ADDSERVICE ADDEVENTS, manager process does not start and manager report log and event viewer from windows shows following error despite of providing correct login details in manager parameter file:
    2012-08-23 10:42:31 ERROR OGG-00664 Oracle GoldenGate Manager for Oracle, mgr.prm: OCI Error beginning session (status = 1017-ORA-01017: invalid username/password; logon denied).
    GGSCI (hostname) 19> DBLOGIN USERID ggs_owner, PASSWORD ggs_owner
    Successfully logged into database.
    Manager Parameter File:
    PORT 7810
    USERID ggs_owner, PASSWORD ggs_owner
    PURGEOLDEXTRACTS C:\gg2\dirdat\ex, USECHECKPOINTS
    Your explaination and help will be highly appreciated.
    Regards,
    Mitul Sheth
    Edited by: 954634 on Aug 23, 2012 11:46 AM

    Thanks all of you to responding to my post, although I have bad news that I tried everything but it did not work. let me show you what all I have done:
    1) Adding windows services for manager
    GGSCI (msheth-work) 4> edit params ./globals
    MGRSERVNAME MGR1
    GGSCI (msheth-work) 5> exit
    c:\gg1>install addservice addevents
    Oracle GoldenGate messages installed successfully.
    Service 'MGR1' created.
    Install program terminated normally.
    When I try to start manager service either from GGSCI or from services.msc it gives same login error as mentioned earlier in the post.
    2) Using tnsnames while login into database:
    GGSCI (msheth-work) 1> edit params mgr
    PORT 7809
    USERID ggs_owner@gg1, PASSWORD ggs_owner
    PURGEOLDEXTRACTS C:\gg1\dirdat\ex, USECHECKPOINTS
    Just to make sure username and password is fine I login into database using GGSCI command prompt as follows:
    GGSCI (msheth-work) 4> dblogin userid ggs_owner@gg1, password ggs_owner
    Successfully logged into database.
    Hence, after making sure on all your suggestion I could not get it started and still situation is the same. I would need manager login into database becuase I have implemented DDL replication.
    Also, just by removing manager service from windows, same configuration without any change works like a charm. It just that for evey goldengate process a new window is create and it can't be closed. (If closed process dies).

  • 11gR2 Cluster node does not start, start of ora.gipcd fails

    Hi
    I have a clusert node which just does not start, and i do know understand what the problem is.
    Does anyone have an idea what the problem cound be?
    I am using Oracle 11.2.0.1.0 on OEL.
    I appreciate any help, thank you.
    Regards Bernhard
    NAME           TARGET  STATE        SERVER                   STATE_DETAILS      
    Cluster Resources
    ora.asm
          1        ONLINE  OFFLINE                                                  
    ora.crsd
          1        ONLINE  INTERMEDIATE node001                             
    ora.cssd
          1        ONLINE  OFFLINE                                                  
    ora.cssdmonitor
          1        ONLINE  OFFLINE                                                  
    ora.ctssd
          1        ONLINE  OFFLINE                                                  
    ora.diskmon
          1        ONLINE  OFFLINE                                                  
    ora.drivers.acfs
          1        ONLINE  ONLINE       node001                             
    ora.evmd
          1        ONLINE  OFFLINE                                                  
    ora.gipcd
          1        ONLINE  OFFLINE                                                  
    ora.gpnpd
          1        ONLINE  OFFLINE                                                  
    ora.mdnsd
          1        ONLINE  ONLINE       node001                              alertnode001.log
    Oracle Database 11g Clusterware Release 11.2.0.1.0 - Production Copyright 1996, 2009 Oracle. All rights reserved.
    2012-06-29 08:43:52.511
    [/opt/grid/product/11gR2/grid/bin/cssdmonitor(5144)]CRS-5822:Agent '/opt/grid/product/11gR2/grid/bin/cssdmonitor_root' disconnected from server. Details at (:CRSAGF00117:) in /opt/grid/product/11gR2/grid/log/node001/agent/ohasd/oracssdmonitor_root/oracssdmonitor_root.log.
    2012-06-29 08:48:49.713
    [ohasd(4346)]CRS-2112:The OLR service started on node node001.
    2012-06-29 08:48:50.010
    [ohasd(4346)]CRS-8017:location: /etc/oracle/lastgasp has 50 reboot advisory log files, 0 were announced and 0 errors occurred
    2012-06-29 08:48:55.134
    [ohasd(4346)]CRS-2772:Server 'node001' has been assigned to pool 'Free'.
    [client(4634)]CRS-10001:ACFS-9327: Verifying ADVM/ACFS devices.
    [client(4652)]CRS-10001:ACFS-9322: done.
    2012-06-29 08:50:59.362
    [ohasd(4346)]CRS-2757:Command 'Start' timed out waiting for response from the resource 'ora.gipcd'. Details at (:CRSPE00111:) in /opt/grid/product/11gR2/grid/log/node001/ohasd/ohasd.log.oracssdmonitor_root.log
    Oracle Database 11g Clusterware Release 11.2.0.1.0 - Production Copyright 1996, 2009 Oracle. All rights reserved.
    2012-06-29 08:48:51.003: [    AGFW][1810312288] Starting the agent: /opt/grid/product/11gR2/grid/log/node001/agent/ohasd/oracssdmonitor_root/
    2012-06-29 08:48:51.003: [   AGENT][1810312288] Agent framework initialized, Process Id = 4414
    2012-06-29 08:48:51.003: [ USRTHRD][1810312288] to enter agent main
    2012-06-29 08:48:54.939: [ USRTHRD][1810312288] clsncssd_main: setting priority to 4
    2012-06-29 08:48:54.939: [ USRTHRD][1810312288]  *** Agent Framework Started ***
    2012-06-29 08:48:54.939: [ USRTHRD][1810312288] clsncssd_vmondisv: Compatible vendor clusterware not in use
    2012-06-29 08:48:54.939: [ USRTHRD][1810312288] clsncssd_thrdspawn: spawn OMON succ
    2012-06-29 08:48:54.939: [ USRTHRD][1810312288] clsncssd_main: spawn omon succ
    2012-06-29 08:48:54.939: [ USRTHRD][1098914112] clsnomon_main: default values for omon, initrate 1000, pollrate 500.
    2012-06-29 08:48:54.939: [ USRTHRD][1098914112] clsnomon_main: starting omon
    2012-06-29 08:48:54.942: [ CSSCLNT][1098914112]clssscConnect: gipc request failed with 29 (0x16)
    2012-06-29 08:48:54.942: [ CSSCLNT][1098914112]clsssInitNative: connect failed, rc 29
    2012-06-29 08:48:55.041: [    AGFW][1810312288] SERVER IPC CONNECT STR: (ADDRESS=(PROTOCOL=IPC)(KEY=OHASD_IPC_SOCKET_11))
    2012-06-29 08:48:55.041: [CLSFRAME][1810312288] Inited lsf context 0x1ae1cdd0
    2012-06-29 08:48:55.041: [CLSFRAME][1810312288] Initing CLS Framework messaging
    2012-06-29 08:48:55.041: [CLSFRAME][1810312288] New Framework state: 2
    2012-06-29 08:48:55.041: [CLSFRAME][1810312288] M2M is starting...
    2012-06-29 08:48:55.047: [ CRSCOMM][1810312288] m_pClscCtx=0x1ae21d70m_pUgblm=0x1ae754b0
    2012-06-29 08:48:55.047: [ CRSCOMM][1810312288] Starting send thread
    2012-06-29 08:48:55.052: [ CRSCOMM][1119893824] clsIpc: sendWork thread started.
    2012-06-29 08:48:55.057: [ CRSCOMM][1130383680] IPC Client thread started listening
    2012-06-29 08:48:55.057: [ CRSCOMM][1130383680] init data sent from server
    2012-06-29 08:48:55.057: [CLSFRAME][1810312288] New IPC Member:{Relative|Node:0|Process:0|Type:2}:OHASD:node001
    2012-06-29 08:48:55.058: [CLSFRAME][1810312288] New process connected to us ID:{Relative|Node:0|Process:0|Type:2} Info:OHASD:node001
    2012-06-29 08:48:55.066: [CLSFRAME][1810312288] Starting thread model named: MultiThread
    2012-06-29 08:48:55.073: [CLSFRAME][1810312288] Starting thread model named: SingleThread
    2012-06-29 08:48:55.076: [CLSFRAME][1810312288] Starting thread model named: SingleThreadT
    2012-06-29 08:48:55.080: [CLSFRAME][1810312288] New Framework state: 3
    2012-06-29 08:48:55.080: [    AGFW][1810312288] Agent Framework started successfully
    2012-06-29 08:48:55.080: [    AGFW][1182832960] Agfw engine module has enabled...
    2012-06-29 08:48:55.080: [CLSFRAME][1182832960] Module Enabling is complete
    2012-06-29 08:48:55.080: [CLSFRAME][1182832960] New Framework state: 6
    2012-06-29 08:48:55.080: [    AGFW][1182832960] Agent is started with userid: root , expected user: root
    2012-06-29 08:48:55.081: [    AGFW][1182832960] Agent sending message to PE: AGENT_HANDSHAKE[Proxy] ID 20484:14
    2012-06-29 08:48:55.088: [    AGFW][1182832960] Agent received the message: RESTYPE_ADD[ora.cssdmonitor.type] ID 8196:299
    2012-06-29 08:48:55.089: [    AGFW][1182832960] Added new restype: ora.cssdmonitor.type
    2012-06-29 08:48:55.089: [    AGFW][1182832960] Agent sending last reply for: RESTYPE_ADD[ora.cssdmonitor.type] ID 8196:299
    2012-06-29 08:48:55.090: [    AGFW][1182832960] Agent received the message: RESOURCE_ADD[ora.cssdmonitor 1 1] ID 4356:301
    2012-06-29 08:48:55.090: [    AGFW][1182832960] Added new resource: ora.cssdmonitor 1 1 to the agfw
    2012-06-29 08:48:55.091: [    AGFW][1182832960] Agent sending last reply for: RESOURCE_ADD[ora.cssdmonitor 1 1] ID 4356:301
    2012-06-29 08:48:55.091: [    AGFW][1182832960] Agent received the message: RESOURCE_PROBE[ora.cssdmonitor 1 1] ID 4097:302
    2012-06-29 08:48:55.091: [    AGFW][1182832960] Preparing CHECK command for: ora.cssdmonitor 1 1
    2012-06-29 08:48:55.096: [    AGFW][1172343104] Executing command: check for resource: ora.cssdmonitor 1 1
    2012-06-29 08:48:55.096: [ora.cssdmonitor][1172343104] [check] clsncssd_getattr: attr OMON_INITRATE, value 1000
    2012-06-29 08:48:55.096: [ora.cssdmonitor][1172343104] [check] clsncssd_getattr: attr OMON_POLLRATE, value 500
    2012-06-29 08:48:55.096: [ora.cssdmonitor][1172343104] [check] clsncssd_getattr: attr ORA_OPROCD_MODE, value
    2012-06-29 08:48:55.096: [ora.cssdmonitor][1172343104] [check] clsncssd_getattr: attr PROCD_TIMEOUT, value 1000
    2012-06-29 08:48:55.096: [ora.cssdmonitor][1172343104] [check] clsncssd_getattr: attr LOGGING_LEVEL, value 1
    2012-06-29 08:48:55.096: [    AGFW][1172343104] check for resource: ora.cssdmonitor 1 1 completed with status: OFFLINE
    2012-06-29 08:48:55.096: [CRSTIMER][1203812672] Timer Thread Starting.
    2012-06-29 08:48:55.096: [    AGFW][1182832960] ora.cssdmonitor 1 1 state changed from: UNKNOWN to: OFFLINE
    2012-06-29 08:48:55.096: [    AGFW][1182832960] Agent sending last reply for: RESOURCE_PROBE[ora.cssdmonitor 1 1] ID 4097:302
    2012-06-29 08:48:55.096: [    AGFW][1182832960] Agent has no resources to be monitored.Sending suicide request.
    2012-06-29 08:48:55.096: [    AGFW][1182832960] Agent sending message to PE: AGENT_SUICIDE[Proxy] ID 20486:28
    2012-06-29 08:48:55.100: [    AGFW][1182832960] Agent received the message: RESOURCE_DELETE[ora.cssdmonitor 1 1] ID 4358:317
    2012-06-29 08:48:55.100: [    AGFW][1182832960] Agent sending last reply for: RESOURCE_DELETE[ora.cssdmonitor 1 1] ID 4358:317
    2012-06-29 08:48:55.100: [    AGFW][1182832960] Agent has no resources to be monitored.Sending suicide request.
    2012-06-29 08:48:55.100: [    AGFW][1182832960] Agent sending message to PE: AGENT_SUICIDE[Proxy] ID 20486:34
    2012-06-29 08:48:55.101: [    AGFW][1182832960] ora.cssdmonitor 1 1 marked as deleted.
    2012-06-29 08:48:55.101: [    AGFW][1182832960] Deleting the resource: ora.cssdmonitor 1 1
    2012-06-29 08:48:55.101: [    AGFW][1182832960] Agent is commiting suicide.
    2012-06-29 08:48:55.101: [ USRTHRD][1182832960] clsncssd_exit: CSSD Agent was asked to exit with exit code 1
    2012-06-29 08:48:55.101: [ USRTHRD][1182832960] clsncssd_becomeactive: Signaling active state
    2012-06-29 08:48:55.101: [ USRTHRD][1182832960] clsncssd_term: still threads up (1)
    2012-06-29 08:48:55.101: [ USRTHRD][1182832960] clsncssd_exit: Agent is done.
    2012-06-29 08:48:55.101: [    AGFW][1182832960] Agent is exiting with exit code: 1
    2012-06-29 08:48:55.947: [ CSSCLNT][1098914112]clssscConnect: gipc request failed with 29 (0x16)
    2012-06-29 08:48:55.947: [ CSSCLNT][1098914112]clsssInitNative: connect failed, rc 29
    2012-06-29 08:48:56.952: [ CSSCLNT][1098914112]clssscConnect: gipc request failed with 29 (0x16)
    2012-06-29 08:48:56.952: [ CSSCLNT][1098914112]clsssInitNative: connect failed, rc 29Edited by: Bernhard W on 03-Jul-2012 02:14

    I am really getting desperate about this.
    The ASM persmissions are on both nodes the same, so this should not be the problem and i can not find any problem on the network.
    The log files of the healthy node do not say anything about the node which does not startup now, the last log entry was from 6 months ago, when i shut that node down. There seems to be no communication between the two nodes now.
    I tried to manually start the ora.cssd but somehow ora.gipcd just does not start and i can not find the problem.
    [oracle@dmrs11srvcla001 ~]$ crsctl stat res -t -init
    NAME           TARGET  STATE        SERVER                   STATE_DETAILS      
    Cluster Resources
    ora.asm
          1        ONLINE  OFFLINE                                                  
    ora.crsd
          1        ONLINE  INTERMEDIATE dmrs11srvcla001                             
    ora.cssd
          1        ONLINE  OFFLINE                                                  
    ora.cssdmonitor
          1        ONLINE  ONLINE       dmrs11srvcla001                             
    ora.ctssd
          1        ONLINE  OFFLINE                                                  
    ora.diskmon
          1        OFFLINE OFFLINE                                                  
    ora.drivers.acfs
          1        ONLINE  ONLINE       dmrs11srvcla001                             
    ora.evmd
          1        ONLINE  OFFLINE                                                  
    ora.gipcd
          1        ONLINE  OFFLINE                                                  
    ora.gpnpd
          1        ONLINE  OFFLINE                                                  
    ora.mdnsd
          1        ONLINE  ONLINE       dmrs11srvcla001                             
    [oracle@dmrs11srvcla001 ~]$ crsctl start res ora.cssd -init
    CRS-2672: Attempting to start 'ora.gipcd' on 'dmrs11srvcla001'
    Start action for daemon aborted
    CRS-2674: Start of 'ora.gipcd' on 'dmrs11srvcla001' failed
    CRS-2679: Attempting to clean 'ora.gipcd' on 'dmrs11srvcla001'
    CRS-2681: Clean of 'ora.gipcd' on 'dmrs11srvcla001' succeeded
    CRS-2672: Attempting to start 'ora.gpnpd' on 'dmrs11srvcla001'
    Start action for daemon aborted
    CRS-2674: Start of 'ora.gpnpd' on 'dmrs11srvcla001' failed
    CRS-2679: Attempting to clean 'ora.gpnpd' on 'dmrs11srvcla001'
    CRS-2681: Clean of 'ora.gpnpd' on 'dmrs11srvcla001' succeeded
    CRS-2672: Attempting to start 'ora.cssd' on 'dmrs11srvcla001'
    CRS-2672: Attempting to start 'ora.diskmon' on 'dmrs11srvcla001'
    CRS-2676: Start of 'ora.diskmon' on 'dmrs11srvcla001' succeededalertnode001.log
    [ohasd(4351)]CRS-2757:Command 'Start' timed out waiting for response from the resource 'ora.gipcd'. Details at (:CRSPE00111:) in /opt/grid/product/11gR2/grid/log/node001/ohasd/ohasd.log.
    2012-07-02 17:11:40.789
    [ohasd(4351)]CRS-2757:Command 'Start' timed out waiting for response from the resource 'ora.gpnpd'. Details at (:CRSPE00111:) in /opt/grid/product/11gR2/grid/log/node001/ohasd/ohasd.log.
    2012-07-02 17:11:41.654
    [ohasd(4351)]CRS-2765:Resource 'ora.mdnsd' has failed on server 'node001'.
    2012-07-02 17:11:43.404
    [cssd(4997)]CRS-1713:CSSD daemon is started in clustered mode
    2012-07-02 17:11:46.634
    [cssd(4997)]CRS-2302:Cannot get GPnP profile. Error CLSGPNP_NO_DAEMON (GPNPD daemon is not running).
    2012-07-02 17:11:46.745
    [ohasd(4351)]CRS-2765:Resource 'ora.cssdmonitor' has failed on server 'node001'.
    2012-07-02 17:12:42.384
    [/opt/grid/product/11gR2/grid/bin/orarootagent.bin(4488)]CRS-5818:Aborted command 'start for resource: ora.diskmon 1 1' for resource 'ora.diskmon'. Details at (:CRSAGF00113:) in /opt/grid/product/11gR2/grid/log/node001/agent/ohasd/orarootagent_root/orarootagent_root.log.
    2012-07-02 17:12:46.390
    [ohasd(4351)]CRS-2757:Command 'Start' timed out waiting for response from the resource 'ora.diskmon'. Details at (:CRSPE00111:) in /opt/grid/product/11gR2/grid/log/node001/ohasd/ohasd.log.
    2012-07-02 17:14:50.768
    [ohasd(4351)]CRS-2757:Command 'Start' timed out waiting for response from the resource 'ora.gipcd'. Details at (:CRSPE00111:) in /opt/grid/product/11gR2/grid/log/node001/ohasd/ohasd.log.
    2012-07-02 17:16:55.819
    [ohasd(4351)]CRS-2757:Command 'Start' timed out waiting for response from the resource 'ora.gpnpd'. Details at (:CRSPE00111:) in /opt/grid/product/11gR2/grid/log/node001/ohasd/ohasd.log.
    2012-07-02 17:16:58.354
    [cssd(5137)]CRS-1713:CSSD daemon is started in clustered mode
    2012-07-02 17:16:58.425
    [cssd(5137)]CRS-2302:Cannot get GPnP profile. Error CLSGPNP_NO_DAEMON (GPNPD daemon is not running).
    2012-07-02 17:25:23.194
    [ohasd(4351)]CRS-2765:Resource 'ora.diskmon' has failed on server 'node001'.
    2012-07-02 17:25:23.200
    [ohasd(4351)]CRS-2767:Target resource 'ora.diskmon' is offline, will not recover.
    2012-07-02 17:26:57.384
    [/opt/grid/product/11gR2/grid/bin/cssdagent(5116)]CRS-5818:Aborted command 'start for resource: ora.cssd 1 1' for resource 'ora.cssd'. Details at (:CRSAGF00113:) in /opt/grid/product/11gR2/grid/log/node001/agent/ohasd/oracssdagent_root/oracssdagent_root.log.
    2012-07-02 17:27:02.514
    [ohasd(4351)]CRS-2757:Command 'Start' timed out waiting for response from the resource 'ora.cssd'. Details at (:CRSPE00111:) in /opt/grid/product/11gR2/grid/log/node001/ohasd/ohasd.log.
    2012-07-02 17:37:11.971
    [ohasd(4351)]CRS-2757:Command 'Start' timed out waiting for response from the resource 'ora.evmd'. Details at (:CRSPE00111:) in /opt/grid/product/11gR2/grid/log/node001/ohasd/ohasd.log.
    [ohasd(4351)]CRS-2765:Resource 'ora.crsd' has failed on server 'node001'.
    2012-07-03 02:13:57.821
    [ohasd(4351)]CRS-2765:Resource 'ora.crsd' has failed on server 'node001'.
    2012-07-03 05:14:37.915
    [ohasd(4351)]CRS-2765:Resource 'ora.crsd' has failed on server 'node001'.
    2012-07-03 05:44:44.630
    [ohasd(4351)]CRS-2765:Resource 'ora.crsd' has failed on server 'node001'.
    2012-07-03 06:14:51.303
    [ohasd(4351)]CRS-2765:Resource 'ora.crsd' has failed on server 'node001'.
    2012-07-03 06:44:57.981
    [ohasd(4351)]CRS-2765:Resource 'ora.crsd' has failed on server 'node001'.
    2012-07-03 07:15:04.655
    [ohasd(4351)]CRS-2765:Resource 'ora.crsd' has failed on server 'node001'.
    2012-07-03 07:42:45.015
    [ohasd(4351)]CRS-2757:Command 'Start' timed out waiting for response from the resource 'ora.gipcd'. Details at (:CRSPE00111:) in /opt/grid/product/11gR2/grid/log/node001/ohasd/ohasd.log.
    2012-07-03 07:44:50.068
    [ohasd(4351)]CRS-2757:Command 'Start' timed out waiting for response from the resource 'ora.gpnpd'. Details at (:CRSPE00111:) in /opt/grid/product/11gR2/grid/log/node001/ohasd/ohasd.log.
    2012-07-03 07:44:52.369
    [cssd(10209)]CRS-1713:CSSD daemon is started in clustered mode
    2012-07-03 07:44:52.434
    [cssd(10209)]CRS-2302:Cannot get GPnP profile. Error CLSGPNP_NO_DAEMON (GPNPD daemon is not running).
    2012-07-03 07:45:11.331
    [ohasd(4351)]CRS-2765:Resource 'ora.crsd' has failed on server 'node001'.
    2012-07-03 07:53:17.222
    [ohasd(4351)]CRS-2765:Resource 'ora.diskmon' has failed on server 'node001'.
    2012-07-03 07:53:17.222
    [ohasd(4351)]CRS-2767:Target resource 'ora.diskmon' is offline, will not recover.
    2012-07-03 07:54:51.401
    [/opt/grid/product/11gR2/grid/bin/cssdagent(10188)]CRS-5818:Aborted command 'start for resource: ora.cssd 1 1' for resource 'ora.cssd'. Details at (:CRSAGF00113:) in /opt/grid/product/11gR2/grid/log/node001/agent/ohasd/oracssdagent_root/oracssdagent_root.log.
    2012-07-03 07:54:56.524
    [ohasd(4351)]CRS-2757:Command 'Start' timed out waiting for response from the resource 'ora.cssd'. Details at (:CRSPE00111:) in /opt/grid/product/11gR2/grid/log/node001/ohasd/ohasd.log.ohasd.log
    2012-07-03 07:45:11.330: [    AGFW][1347250496] Agfw Proxy Server received the message: RESOURCE_STATUS[Proxy] ID 20481:24919
    2012-07-03 07:45:11.330: [    AGFW][1347250496] Received state change for ora.crsd 1 1 [old state = PARTIAL, new state = OFFLINE]
    2012-07-03 07:45:11.330: [    AGFW][1347250496] Agfw Proxy Server sending message to PE, Contents = [MIDTo:2|OpID:3|FromA:{Invalid|Node:0|Process:0|Type:0}|ToA:{Invalid|Node:-1|Process:-1|Type:-1}|MIDFrom:0|Type:4|Pri2|Id:23258]
    2012-07-03 07:45:11.330: [    AGFW][1347250496] Agfw Proxy Server replying to the message: RESOURCE_STATUS[Proxy] ID 20481:24919
    2012-07-03 07:45:11.330: [   CRSPE][1357756736] State change received from node001 for ora.crsd 1 1
    2012-07-03 07:45:11.331: [   CRSPE][1357756736] Processing PE command id=139. Description: [Resource State Change (ora.crsd 1 1) : 0x1c284d40]
    2012-07-03 07:45:11.331: [   CRSPE][1357756736] RI [ora.crsd 1 1] new external state [OFFLINE] old value: [INTERMEDIATE] on node001 label = []
    2012-07-03 07:45:11.331: [   CRSPE][1357756736] Resource Resource Instance ID[ora.crsd 1 1]. Values:
    STATE=OFFLINE
    TARGET=ONLINE
    LAST_SERVER=node001
    CURRENT_RCOUNT=1
    LAST_RESTART=1341292505
    FAILURE_COUNT=0
    FAILURE_HISTORY=
    STATE_DETAILS=
    INCARNATION=29
    STATE_CHANGE_VERS=29
    LAST_FAULT=1341292504
    DEGREE_ID=1
    ID=ora.crsd 1 1
    CARDINALITY_ID=1
    Lock Info:
    Write Locks:none
    ReadLocks:|STATE INITED||INITIAL CHECK DONE| has failed!
    2012-07-03 07:45:11.331: [   CRSPE][1357756736] Processing unplanned state change for [ora.crsd 1 1]
    2012-07-03 07:45:11.331: [   CRSPE][1357756736] ora.crsd 1 1: uptime exceeds uptime threshold , resetting restart count
    2012-07-03 07:45:11.331: [   CRSPE][1357756736] Local Recovery picked for [ora.crsd 1 1]
    2012-07-03 07:45:11.333: [   CRSPE][1357756736] Sending message to agfw: id = 23260
    2012-07-03 07:45:11.333: [    AGFW][1347250496] Agfw Proxy Server received the message: RESOURCE_START[ora.crsd 1 1] ID 4098:23260
    2012-07-03 07:45:11.333: [   CRSPE][1357756736] CRS-2672: Attempting to start 'ora.crsd' on 'node001'
    2012-07-03 07:45:11.333: [    AGFW][1347250496] Agfw Proxy Server forwarding the message: RESOURCE_START[ora.crsd 1 1] ID 4098:23260 to the agent /opt/grid/product/11gR2/grid/bin/orarootagent_root
    2012-07-03 07:45:12.349: [    AGFW][1347250496] Received the reply to the message: RESOURCE_START[ora.crsd 1 1] ID 4098:23261 from the agent /opt/grid/product/11gR2/grid/bin/orarootagent_root
    2012-07-03 07:45:12.350: [    AGFW][1347250496] Agfw Proxy Server sending the reply to PE for message:RESOURCE_START[ora.crsd 1 1] ID 4098:23260
    2012-07-03 07:45:12.350: [   CRSPE][1357756736] Received reply to action [Start] message ID: 23260
    2012-07-03 07:45:12.350: [    AGFW][1347250496] Received the reply to the message: RESOURCE_START[ora.crsd 1 1] ID 4098:23261 from the agent /opt/grid/product/11gR2/grid/bin/orarootagent_root
    2012-07-03 07:45:12.350: [    AGFW][1347250496] Agfw Proxy Server sending the last reply to PE for message:RESOURCE_START[ora.crsd 1 1] ID 4098:23260
    2012-07-03 07:45:12.350: [   CRSPE][1357756736] Received reply to action [Start] message ID: 23260
    2012-07-03 07:45:12.351: [   CRSPE][1357756736] RI [ora.crsd 1 1] new external state [INTERMEDIATE] old value: [OFFLINE] on node001 label = []
    2012-07-03 07:45:12.351: [   CRSPE][1357756736] CRS-2676: Start of 'ora.crsd' on 'node001' succeeded
    2012-07-03 07:45:12.351: [   CRSPE][1357756736] PE Command [ Resource State Change (ora.crsd 1 1) : 0x1c284d40 ] has completed
    2012-07-03 07:45:12.351: [    AGFW][1347250496] Agfw Proxy Server received the message: CMD_COMPLETED[Proxy] ID 20482:23269
    2012-07-03 07:45:12.351: [    AGFW][1347250496] Agfw Proxy Server replying to the message: CMD_COMPLETED[Proxy] ID 20482:23269
    2012-07-03 07:45:12.351: [    AGFW][1347250496] Agfw received reply from PE for resource state change for ora.crsd 1 1
    2012-07-03 07:53:17.220: [    AGFW][1347250496] Agfw Proxy Server received the message: RESOURCE_STATUS[Proxy] ID 20481:25353
    2012-07-03 07:53:17.221: [    AGFW][1347250496] Received state change for ora.diskmon 1 1 [old state = ONLINE, new state = PLANNED_OFFLINE]
    2012-07-03 07:53:17.221: [    AGFW][1347250496] Agfw Proxy Server sending message to PE, Contents = [MIDTo:2|OpID:3|FromA:{Invalid|Node:0|Process:0|Type:0}|ToA:{Invalid|Node:-1|Process:-1|Type:-1}|MIDFrom:0|Type:4|Pri2|Id:23497]
    2012-07-03 07:53:17.221: [    AGFW][1347250496] Agfw Proxy Server replying to the message: RESOURCE_STATUS[Proxy] ID 20481:25353
    2012-07-03 07:53:17.221: [   CRSPE][1357756736] State change received from node001 for ora.diskmon 1 1
    2012-07-03 07:53:17.221: [   CRSPE][1357756736] Processing PE command id=140. Description: [Resource State Change (ora.diskmon 1 1) : 0x2aaab00318a0]
    2012-07-03 07:53:17.221: [   CRSPE][1357756736] RI [ora.diskmon 1 1] new external state [OFFLINE] old value: [ONLINE] on node001 label = []
    2012-07-03 07:53:17.221: [   CRSPE][1357756736] RI [ora.diskmon 1 1] new target state: [OFFLINE] old value: [ONLINE]
    2012-07-03 07:53:17.222: [  CRSOCR][1351452992] Multi Write Batch processing...
    2012-07-03 07:53:17.222: [   CRSPE][1357756736] Resource Resource Instance ID[ora.diskmon 1 1]. Values:
    STATE=OFFLINE
    TARGET=OFFLINE
    LAST_SERVER=node001
    CURRENT_RCOUNT=0
    LAST_RESTART=1341294297
    FAILURE_COUNT=0
    FAILURE_HISTORY=
    STATE_DETAILS=
    INCARNATION=2
    STATE_CHANGE_VERS=5
    LAST_FAULT=1341242723
    DEGREE_ID=1
    ID=ora.diskmon 1 1
    CARDINALITY_ID=1
    Lock Info:
    Write Locks:START of [ora.cssd 1 1] on [node001] : 0x2aaab000ba10
    ReadLocks:|STATE INITED| has failed!
    2012-07-03 07:53:17.222: [   CRSPE][1357756736] Processing unplanned state change for [ora.diskmon 1 1]
    2012-07-03 07:53:17.222: [   CRSPE][1357756736] Target is not ONLINE, not recovering [ora.diskmon 1 1]
    2012-07-03 07:53:17.222: [   CRSPE][1357756736] PE Command [ Resource State Change (ora.diskmon 1 1) : 0x2aaab00318a0 ] has completed
    2012-07-03 07:53:17.222: [    AGFW][1347250496] Agfw Proxy Server received the message: CMD_COMPLETED[Proxy] ID 20482:23501
    2012-07-03 07:53:17.222: [    AGFW][1347250496] Agfw Proxy Server replying to the message: CMD_COMPLETED[Proxy] ID 20482:23501
    2012-07-03 07:53:17.223: [    AGFW][1347250496] Agfw received reply from PE for resource state change for ora.diskmon 1 1
    2012-07-03 07:53:17.223: [  CRSOCR][1351452992] Multi Write Batch done.
    2012-07-03 07:54:56.523: [    AGFW][1347250496] Received the reply to the message: RESOURCE_START[ora.cssd 1 1] ID 4098:23242 from the agent /opt/grid/product/11gR2/grid/bin/cssdagent_root
    2012-07-03 07:54:56.523: [    AGFW][1347250496] Agfw Proxy Server sending the reply to PE for message:RESOURCE_START[ora.cssd 1 1] ID 4098:23220
    2012-07-03 07:54:56.524: [   CRSPE][1357756736] Received reply to action [Start] message ID: 23220
    2012-07-03 07:54:56.524: [    AGFW][1347250496] Received the reply to the message: RESOURCE_START[ora.cssd 1 1] ID 4098:23242 from the agent /opt/grid/product/11gR2/grid/bin/cssdagent_root
    2012-07-03 07:54:56.524: [   CRSPE][1357756736]Created alert : (:CRSPE00111:) :  Start action timed out!
    2012-07-03 07:54:56.524: [   CRSPE][1357756736] Start action failed with error code: 3
    2012-07-03 07:54:56.524: [    AGFW][1347250496] Agfw Proxy Server sending the last reply to PE for message:RESOURCE_START[ora.cssd 1 1] ID 4098:23220
    2012-07-03 07:54:56.524: [   CRSPE][1357756736] Received reply to action [Start] message ID: 23220
    2012-07-03 07:54:56.524: [    AGFW][1347250496] Agfw Proxy Server received the message: AGENT_SUICIDE[Proxy] ID 20486:34
    2012-07-03 07:54:56.524: [    AGFW][1347250496] Suicide request received from /opt/grid/product/11gR2/grid/bin/cssdagent_root
    2012-07-03 07:54:56.524: [    AGFW][1347250496] Agfw Proxy Server replying to the message: AGENT_SUICIDE[Proxy] ID 20486:34
    2012-07-03 07:54:56.524: [   CRSPE][1357756736] CRS-2674: Start of 'ora.cssd' on 'node001' failed
    2012-07-03 07:54:56.525: [UiServer][1361959232] Container [ Name: ORDER
         MESSAGE:
         TextMessage[CRS-2674: Start of 'ora.cssd' on 'node001' failed]
         MSGTYPE:
         TextMessage[1]
         OBJID:
         TextMessage[ora.cssd]
         WAIT:
         TextMessage[0]
    2012-07-03 07:54:56.525: [   CRSPE][1357756736] Sending message to agfw: id = 23555
    2012-07-03 07:54:56.525: [   CRSPE][1357756736] CRS-2679: Attempting to clean 'ora.cssd' on 'node001'
    2012-07-03 07:54:56.525: [    AGFW][1347250496] Agfw Proxy Server received the message: RESOURCE_CLEAN[ora.cssd 1 1] ID 4100:23555
    2012-07-03 07:54:56.525: [    AGFW][1347250496] Agent: /opt/grid/product/11gR2/grid/bin/cssdagent with user id root is being stopped. Will be restarted when agent stops completly
    2012-07-03 07:54:56.525: [    AGFW][1347250496] Could not forward message [RESOURCE_CLEAN[ora.cssd 1 1] ID 4100:23555] to agent. /opt/grid/product/11gR2/grid/bin/cssdagent_root is not running
    2012-07-03 07:54:56.525: [    AGFW][1347250496] Can not start Agent: /opt/grid/product/11gR2/grid/bin/cssdagent with user id root is waiting to be restarted.
    2012-07-03 07:54:56.525: [UiServer][1361959232] Container [ Name: ORDER
         MESSAGE:
         TextMessage[CRS-2679: Attempting to clean 'ora.cssd' on 'node001']
         MSGTYPE:
         TextMessage[3]
         OBJID:
         TextMessage[ora.cssd]
         WAIT:
         TextMessage[0]
    2012-07-03 07:55:01.627: [ CRSCOMM][1340946752][FFAIL] Couldnt clscreceive message, no message: 11
    2012-07-03 07:55:01.627: [ CRSCOMM][1340946752] Client disconnected.
    2012-07-03 07:55:01.627: [ CRSCOMM][1340946752][FFAIL] Listener got clsc error 11 for memNum. 14
    2012-07-03 07:55:01.628: [ CRSCOMM][1340946752] IPC listener connection to member 14 has been removed
    2012-07-03 07:55:01.628: [CLSFRAME][1340946752] Removing IPC Member:{Relative|Node:0|Process:14|Type:3}
    2012-07-03 07:55:01.628: [CLSFRAME][1340946752] Disconnected from AGENT process: {Relative|Node:0|Process:14|Type:3}
    2012-07-03 07:55:01.628: [   CRSPE][1357756736] Disconnected from server:
    2012-07-03 07:55:01.628: [    AGFW][1347250496] Agfw Proxy Server received process disconnected notification, count=1
    2012-07-03 07:55:01.628: [    AGFW][1347250496] /opt/grid/product/11gR2/grid/bin/cssdagent_root disconnected.
    2012-07-03 07:55:01.628: [    AGFW][1347250496] Restarting the agent /opt/grid/product/11gR2/grid/bin/cssdagent_root
    2012-07-03 07:55:01.628: [    AGFW][1347250496] Agent /opt/grid/product/11gR2/grid/bin/cssdagent_root[10188] stopped!
    2012-07-03 07:55:01.628: [ CRSCOMM][1347250496] removeConnection: Member 14 does not exist.
    2012-07-03 07:55:01.628: [    AGFW][1347250496] Starting the agent: /opt/grid/product/11gR2/grid/bin/cssdagent with user id: root and incarnation:7
    2012-07-03 07:55:01.632: [    AGFW][1347250496] Starting the HB [Interval =  30000, misscount = 10kill allowed=0] for agent: /opt/grid/product/11gR2/grid/bin/cssdagent_root
    2012-07-03 07:55:01.819: [CLSFRAME][1340946752] New IPC Member:{Relative|Node:0|Process:15|Type:3}:AGENT
    2012-07-03 07:55:01.819: [CLSFRAME][1340946752] New process connected to us ID:{Relative|Node:0|Process:15|Type:3} Info:AGENT
    2012-07-03 07:55:01.837: [    AGFW][1347250496] Agfw Proxy Server received the message: AGENT_HANDSHAKE[Proxy] ID 20484:14
    2012-07-03 07:55:01.837: [    AGFW][1347250496] Agent /opt/grid/product/11gR2/grid/bin/cssdagent_root with pid:10530 connected to server.
    2012-07-03 07:55:01.837: [    AGFW][1347250496] Agfw Proxy Server sending message: RESTYPE_ADD[ora.cssd.type] ID 8196:23591 to the agent /opt/grid/product/11gR2/grid/bin/cssdagent_root
    2012-07-03 07:55:01.838: [    AGFW][1347250496] Agfw Proxy Server sending message: RESOURCE_ADD[ora.cssd 1 1] ID 4356:23593 to the agent /opt/grid/product/11gR2/grid/bin/cssdagent_root
    2012-07-03 07:55:01.838: [    AGFW][1347250496] Agfw Proxy Server forwarding the message: RESOURCE_CLEAN[ora.cssd 1 1] ID 4100:23555 to the agent /opt/grid/product/11gR2/grid/bin/cssdagent_root
    2012-07-03 07:55:01.839: [    AGFW][1347250496] Agfw Proxy Server replying to the message: AGENT_HANDSHAKE[Proxy] ID 20484:14
    2012-07-03 07:55:01.851: [    AGFW][1347250496] Received the reply to the message: RESTYPE_ADD[ora.cssd.type] ID 8196:23591 from the agent /opt/grid/product/11gR2/grid/bin/cssdagent_root
    2012-07-03 07:55:01.854: [    AGFW][1347250496] Received the reply to the message: RESOURCE_ADD[ora.cssd 1 1] ID 4356:23593 from the agent /opt/grid/product/11gR2/grid/bin/cssdagent_root
    2012-07-03 07:55:01.861: [    AGFW][1347250496] Received the reply to the message: RESOURCE_CLEAN[ora.cssd 1 1] ID 4100:23594 from the agent /opt/grid/product/11gR2/grid/bin/cssdagent_root
    2012-07-03 07:55:01.862: [    AGFW][1347250496] Agfw Proxy Server sending the reply to PE for message:RESOURCE_CLEAN[ora.cssd 1 1] ID 4100:23555
    2012-07-03 07:55:01.862: [    AGFW][1347250496] Received the reply to the message: RESOURCE_CLEAN[ora.cssd 1 1] ID 4100:23594 from the agent /opt/grid/product/11gR2/grid/bin/cssdagent_root
    2012-07-03 07:55:01.862: [   CRSPE][1357756736] Received reply to action [Clean] message ID: 23555
    2012-07-03 07:55:01.862: [    AGFW][1347250496] Agfw Proxy Server sending the last reply to PE for message:RESOURCE_CLEAN[ora.cssd 1 1] ID 4100:23555
    2012-07-03 07:55:01.863: [    AGFW][1347250496] Agfw Proxy Server received the message: AGENT_SUICIDE[Proxy] ID 20486:34
    2012-07-03 07:55:01.863: [   CRSPE][1357756736] Received reply to action [Clean] message ID: 23555
    2012-07-03 07:55:01.863: [    AGFW][1347250496] Suicide request received from /opt/grid/product/11gR2/grid/bin/cssdagent_root
    2012-07-03 07:55:01.863: [    AGFW][1347250496] Agfw Proxy Server replying to the message: AGENT_SUICIDE[Proxy] ID 20486:34
    2012-07-03 07:55:01.863: [   CRSPE][1357756736] CRS-2681: Clean of 'ora.cssd' on 'node001' succeeded
    2012-07-03 07:55:01.863: [   CRSPE][1357756736] Sequencer for [ora.cssd 1 1] has completed with error: CRS-0215: Could not start resource 'ora.cssd'.
    2012-07-03 07:55:01.863: [UiServer][1361959232] Container [ Name: ORDER
         MESSAGE:
         TextMessage[CRS-2681: Clean of 'ora.cssd' on 'node001' succeeded]
         MSGTYPE:
         TextMessage[3]
         OBJID:
         TextMessage[ora.cssd]
         WAIT:
         TextMessage[0]
    2012-07-03 07:55:01.864: [   CRSPE][1357756736] PE Command [ Start Resource : 0x2aaab0009d00 ] has completed
    2012-07-03 07:55:01.864: [    AGFW][1347250496] Agfw Proxy Server received the message: CMD_COMPLETED[Proxy] ID 20482:23606
    2012-07-03 07:55:01.864: [   CRSPE][1357756736] UI Command [Start Resource : 0x2aaab0009d00] is replying to sender.
    2012-07-03 07:55:01.864: [    AGFW][1347250496] Agfw Proxy Server replying to the message: CMD_COMPLETED[Proxy] ID 20482:23606
    2012-07-03 07:55:01.864: [UiServer][1361959232] Container [ Name: UI_DATA
         ora.cssd:
         TextMessage[215]
    2012-07-03 07:55:01.864: [UiServer][1361959232] Done for ctx=0x2aaab004ece0
    2012-07-03 07:55:01.869: [UiServer][1364060480] Closed: remote end failed/disc.
    2012-07-03 07:55:03.791: [ CRSCOMM][1340946752][FFAIL] Couldnt clscreceive message, no message: 11
    2012-07-03 07:55:03.791: [ CRSCOMM][1340946752] Client disconnected.
    2012-07-03 07:55:03.791: [ CRSCOMM][1340946752][FFAIL] Listener got clsc error 11 for memNum. 15
    2012-07-03 07:55:03.791: [ CRSCOMM][1340946752] IPC listener connection to member 15 has been removed
    2012-07-03 07:55:03.791: [CLSFRAME][1340946752] Removing IPC Member:{Relative|Node:0|Process:15|Type:3}
    2012-07-03 07:55:03.791: [CLSFRAME][1340946752] Disconnected from AGENT process: {Relative|Node:0|Process:15|Type:3}
    2012-07-03 07:55:03.792: [   CRSPE][1357756736] Disconnected from server:
    2012-07-03 07:55:03.792: [    AGFW][1347250496] Agfw Proxy Server received process disconnected notification, count=1
    2012-07-03 07:55:03.792: [    AGFW][1347250496] /opt/grid/product/11gR2/grid/bin/cssdagent_root disconnected.
    2012-07-03 07:55:03.792: [    AGFW][1347250496] Agent /opt/grid/product/11gR2/grid/bin/cssdagent_root[10530] stopped!
    2012-07-03 07:55:03.792: [ CRSCOMM][1347250496] removeConnection: Member 15 does not exist.

  • Just installed Firefox 3.6. Firefox will not start and Firefox safemode does not start either. Using Task manager I do not see if started either. If I create a new profile and start from that window, Firefox starts up. I see no error windows/messages. I d

    Just installed Firefox 3.6. Firefox will not start and Firefox safemode does not start either. Using Task manager I do not see if started either. If I create a new profile and start from that window, Firefox starts up. I see no error windows/messages. I do have it listed in my Firewall as an exception program with Permit All. What is happening?
    == This happened ==
    Every time Firefox opened
    == After removing Firefox and Reinstalling it. ==
    == User Agent ==
    Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1; GTB6.4; .NET CLR 1.1.4322; .NET CLR 2.0.50727; .NET CLR 3.0.04506.30; .NET CLR 3.0.04506.648; MS-RTC LM 8)

    If that new profile works then you can transfer some files from the old profile to that new profile (be careful not to copy corrupted files)
    See http://kb.mozillazine.org/Transferring_data_to_a_new_profile_-_Firefox
    See also [[Basic Troubleshooting|#Make_a_new_profile|Basic Troubleshooting: Make a new profile]]

  • Enterprise Manager Console does not start

    Hi,
    I'm running a Windows 2000 PC with Oracle 9i Server on it.
    When I want to start the Enterprise Management Console
    (Start => Program...) there is only a short reaction on
    the Taskbar end when absolute nothing.
    I know this problem was already mentioned once here (OEM Console does not start but
    the answer there wasn't the right one for my problem.
    I could not change the oracle home directory with the ORACLE-HOME-Selector, because I have only one home directory (D:\Programme\oracle\ora92)
    My Path variable:
    D:\Programme\oracle\ora92\bin;C:\Programme\Oracle\jre\1.3.1\bin;C:\Programme\Oracle\jre\1.1.8\bin;C:\WINNT\MS\SMS\CORE\BIN;D:\Programme\Clementine7.2\BIN;C:\WINNT\system32;C:\WINNT;C:\WINNT\System32\Wbem;D:\PROGRA~1\IBM\SQLLIB\BIN;D:\PROGRA~1\IBM\SQLLIB\FUNCTION;D:\PROGRA~1\IBM\SQLLIB\SAMPLES\REPL;D:\Programme\IBM\DB2Extenders\bin;C:\Programme\Java\j2re1.4.2_02\bin
    And here is my oemapp.bat(It is located in D:\Programme\oracle\ora92\bin. I have already startet it manually with "oemapp.bat console" but there was only the reply ""The input line is too long.
    The syntax of the command is incorrect."
    @echo off
    REM #
    REM # Copyright (c) 1998,1999,2000,2001, 2002 Oracle Corporation. All rights reserved.
    REM #
    REM # PRODUCT
    REM #     Oracle Enterprise Manager, Version 9.2.0.0.0 Production
    REM #
    REM # FILENAME
    REM #     oemapp.bat
    REM #
    REM # DESCRIPTION
    REM #     This script is used to launch Applications of Oracle
    REM #     Enterprise Manager, Version 9
    REM #
    REM #
    if "%1%" == "recursive" goto startScript
    if Windows_NT == %OS% goto :ntSetup
    command.com /p /e:8196 /c oemapp recursive %1 %2 %3 %4 %5 %6 %7 %8 %9
    goto :end
    :ntSetup
    setlocal
    :startScript
    IF "%1%" == "trace" GOTO trace
    IF "%1%" == "TRACE" GOTO trace
    IF "%1%" == "debug" GOTO trace
    IF "%1%" == "DEBUG" GOTO trace
    GOTO start2
    :trace
    SHIFT
    SET ORACLE_OEM_CLIENTTRACE=TRUE
    SET TRACE= -DTRACING.LEVEL=2 -DTRACING.ENABLED=true
    :start2
    REM Make sure that our JRE is used for this invocation.
    if Windows_NT == %OS% SET PATH=C:\Programme\Oracle\jre\1.1.8\bin;%PATH%
    if not Windows_NT == %OS% SET PATH="C:\Programme\Oracle\jre\1.1.8\bin;%PATH%"
    SET CLASSROOT=D:\Programme\oracle\ora92/classes
    SET JLIBROOT=D:\Programme\oracle\ora92/jlib
    SET NETJLIBROOT=D:\Programme\oracle\ora92/network/jlib
    SET OEMCLASSES=%JLIBROOT%/oembase-9_2_0.jar;%JLIBROOT%/oemtools-9_2_0.jar
    SET BALICLASSES=%JLIBROOT%/swingall-1_1_1.jar;%JLIBROOT%/ewtcompat-3_3_15.jar;%JLIBROOT%/ewt3.jar;%JLIBROOT%/ewt3-nls.jar;%JLIBROOT%/share.jar;D:\Programme\oracle\ora92\sysman\jlib\master.jar;D:\Programme\oracle\ora92\sysman\jlib\master_de.jar
    SET AURORACLASSES=D:\Programme\oracle\ora92/lib/aurora_client.jar
    SET HELPCLASSES=%JLIBROOT%/help3.jar;%JLIBROOT%/help3-nls.jar;%JLIBROOT%/oracle_ice5.jar
    SET DBUICLASSES=%JLIBROOT%/dbui2.jar;%JLIBROOT%/dbui2-nls.jar
    SET KODIAKCLASSES=%JLIBROOT%/kodiak.jar
    SET JDBCCLASSES=D:\Programme\oracle\ora92/jdbc/lib/classes111.zip;D:\Programme\oracle\ora92/jdbc/lib/nls_charset11.zip
    SET NETCHARTSCLASS=D:\Programme\oracle\ora92/sysman/jlib/netchart360.jar
    SET ORBCLASSES=D:\Programme\oracle\ora92/lib/vbjorb.jar;D:\Programme\oracle\ora92/lib/vbjapp.jar
    SET SECURITYCLASSES=%JLIBROOT%/javax-ssl-1_1.jar;%JLIBROOT%/jssl-1_1.jar
    SET OSDNETCLASSES=%JLIBROOT%/netcfg.jar;%JLIBROOT%/o3logon.jar;%JLIBROOT%/verifier.jar
    SET OSDPKICLASSES=%JLIBROOT%/ewm-1_1.jar;%JLIBROOT%/ojpse_2_1_5.jar
    SET NETMGRCLASSES=%NETJLIBROOT%/netmgrm.jar;%NETJLIBROOT%/netmgr.jar;D:\Programme\oracle\ora92/network/tools
    SET XMLCLASSES=D:\Programme\oracle\ora92/lib/xmlparserv2.jar
    SET OLAPCLASSES=%JLIBROOT%/cvd.zip;%JLIBROOT%/jndi.jar;%JLIBROOT%/jewt4.jar;%JLIBROOT%/jewt4-nls.jar
    SET MISCCLASSES=D:\Programme\oracle\ora92/assistants/jlib/assistantsCommon.jar;D:\Programme\oracle\ora92/jlib/jle2.jar;D:\Programme\oracle\ora92/jle2-nls.jar
    SET QSMACLASSES=D:\Programme\oracle\ora92/rdbms/jlib/qsma.jar
    SET CLASSPATHADD=%CLASSROOT%;%OEMCLASSES%;%ORBCLASSES%;%BALICLASSES%;%HELPCLASSES%;%DBUICLASSES%;%JDBCCLASSES%;%KODIAKCLASSES%;%NETCHARTSCLASS%;%SECURITYCLASSES%;%OSDNETCLASSES%;%OSDPKICLASSES%;%NETMGRCLASSES%;%XMLCLASSES%;%AURORACLASSES%;%OLAPCLASSES%;%MISCCLASSES%;%QSMACLASSES%
    REM hook for classpath additions
    if not "%ORACLE_OEM_CLASSPATH%" == "" SET CLASSPATHADD=%ORACLE_OEM_CLASSPATH%;%CLASSPATHADD%
    REM # Oracle change manager requires the following for ocmtclsh.exe
    set GBP=
    if not exist %CLASSROOT%\oracle\sysman\vtt\vttz\VttzCmDragDropObject.class set GBP=true
    if "%ORACLE_OEM_JAVAMX%" == "" set ORACLE_OEM_JAVAMX=-mx128m
    REM if "%ORACLE_OEM_JAVAMS%" == "" set ORACLE_OEM_JAVAMS=-ms16m
    SET JRE=jrew -nojit %ORACLE_OEM_JAVAMX%
    SET NT_START=START
    if "%ORACLE_OEM_CLIENTTRACE%x" == "x" goto setup_cp
    SET JRE=jre -nojit %ORACLE_OEM_JAVAMX% %TRACE%
    SET NT_START=
    :setup_cp
    SET CLASSPATH_QUAL=cp
    if "%ORACLE_OEM_JAVARUNTIME%x" == "x" goto jreSetup
    SET JRE=%ORACLE_OEM_JAVARUNTIME%\bin\java %ORACLE_OEM_JAVAMX% %TRACE%
    SET CLASSPATH_QUAL=classpath
    SET CLASSPATHADD=%CLASSPATHADD%;%ORACLE_OEM_JAVARUNTIME%\lib\classes.zip
    :jreSetup
    SET ME=oemapp
    SET USAGE="Usage: %ME% <application_name>"
    if Windows_NT == %OS% goto ntCheckAppName
    if not "%2%" == "" goto start95
    @echo %USAGE%
    goto end
    :start95
    if "%GBP%" == "true" goto gbp
    %JRE% -DORACLE_HOME=D:\Programme\oracle\ora92 -DORBdisableLocator=true -Djdbc.backward_compatible_to_816=true %JREOPTIONS_STRING% -%CLASSPATH_QUAL% "%CLASSPATHADD%" oracle.sysman.vtx.vtxOemApp.OemApp %2 %3 %4 %5 %6 %7 %8 %9
    goto end
    :gbp
    %JRE% -DORACLE_HOME=D:\Programme\oracle\ora92 -DGENERAL_BUS_PACK="" -DORBdisableLocator=true -Djdbc.backward_compatible_to_816=true %JREOPTIONS_STRING% -%CLASSPATH_QUAL% "%CLASSPATHADD%" oracle.sysman.vtx.vtxOemApp.OemApp %2 %3 %4 %5 %6 %7 %8 %9
    goto end
    :ntCheckAppName
    if not "%1%" == "" goto startNT
    @echo %USAGE%
    goto end
    :startNT
    set ADMIN_WRL=D:\Programme\oracle\ora92\sysman\admin
    set GBP_PROP=
    if "%GBP%" == "true" set GBP_PROP=-DGENERAL_BUS_PACK=""
    %NT_START% %JRE% -DADMIN_WRL=%ADMIN_WRL% -DORACLE_HOME=D:\Programme\oracle\ora92 %GBP_PROP% -DORBdisableLocator=true -Djdbc.backward_compatible_to_816=true %JREOPTIONS_STRING% -%CLASSPATH_QUAL% "%CLASSPATHADD%" oracle.sysman.vtx.vtxOemApp.OemApp %1 %2 %3 %4 %5 %6 %7 %8 %9
    endLocal
    :end
    Thnaks for any help.
    Nice day

    Marcus,
    Is your machine connected to a Novell network? If so, edit the oemapp.bat file and change every reference of Windows_NT to WINNT. The issue is Novell does not set the Windows_NT variable, and uses the WINNT variable instead.
    Jim

  • Enterprise Manager Console does not start on Win 2000 Pro

    I have installed Oracle 9i Release 2 Enterprise Manager on Win 2000 Professional. But the Enterprise Manager console does not start. Also the EM Configuration Assistant does not start.
    I have installed many times, but it is never successfull.
    I was installing Enterprise Edition -> General Purpose database.
    Tried the following from command prompt:
    oemapp.bat I get this message : "Usage: oemapp <application_name>"
    oemapp consoleI get : "bad command or file name"
    oemapp console oem.loginmode=standaloneI get : "bad command or file name"
    Is there any post installation configurations that need to be done?
    When I read thru the oemapp.bat, "Usage: oemapp <application_name>" was under the jreSetup module.
    Under C:\Program Files\Oracle\jre I have the folders with following Names(versions) 1.1.8 and 1.3.1.
    In the environment variable also I have C:\Program Files\Oracle\jre\1.1.8\bin and C:\Program Files\Oracle\jre\1.3.1\bin
    Could some one help me with this.
    Thanks,
    Aruna

    Marcus,
    Is your machine connected to a Novell network? If so, edit the oemapp.bat file and change every reference of Windows_NT to WINNT. The issue is Novell does not set the Windows_NT variable, and uses the WINNT variable instead.
    Jim

  • Node Manager installed as service does not start managed servers. WLS 10.3

    Hi All,
    I have installed the node manager as a windows service. When the service starts up it does start the managed servers.
    In the nodemanager.log file it shows that the node manager is reading the startup.properties file for all of the managed servers.
    <Jul 24, 2009 6:38:13 AM> <INFO> <Loading domains file: C:\bea\WLSERV~1.3\common\NODEMA~1\nodemanager.domains>
    <Jul 24, 2009 6:38:13 AM> <INFO> <Loaded node manager configuration properties from 'C:\bea\WLSERV~1.3\common\nodemanager\nodemanager.properties'>
    <Jul 24, 2009 6:38:13 AM> <Info> <SalesIllustrationDomain> <IntegrationServer> <Startup configuration properties loaded from "C:\bea\user_projects\domains\SalesIllustrationDomain\servers\IntegrationServer\data\nodemanager\startup.properties">
    <Jul 24, 2009 6:38:13 AM> <Info> <SalesIllustrationDomain> <ProdBackupServer> <Startup configuration properties loaded from "C:\bea\user_projects\domains\SalesIllustrationDomain\servers\ProdBackupServer\data\nodemanager\startup.properties">
    <Jul 24, 2009 6:38:13 AM> <Info> <SalesIllustrationDomain> <QAServer> <Startup configuration properties loaded from "C:\bea\user_projects\domains\SalesIllustrationDomain\servers\QAServer\data\nodemanager\startup.properties">
    <Jul 24, 2009 6:38:13 AM> <INFO> <Plain socket listener started on port 5556, host localhost>
    The node manager properties file contains the following
    #Mon Apr 20 10:54:45 PDT 2009
    DomainsFile=C\:\\bea\\WLSERV~1.3\\common\\NODEMA~1\\nodemanager.domains
    LogLimit=0
    PropertiesVersion=10.3
    JavaHome=C\:\\bea\\JROCKI~1
    AuthenticationEnabled=false
    NodeManagerHome=C\:\\bea\\WLSERV~1.3\\common\\NODEMA~1
    LogLevel=INFO
    DomainsFileEnabled=true
    StartScriptEnabled=false
    StartScriptName=startWebLogic.cmd
    ListenAddress=localhost
    NativeVersionEnabled=true
    ListenPort=5556
    LogToStderr=true
    SecureListener=false
    LogCount=1
    StopScriptEnabled=false
    QuitEnabled=false
    LogAppend=true
    StateCheckInterval=500
    CrashRecoveryEnabled=true
    LogFile=C\:\\bea\\WLSERV~1.3\\common\\NODEMA~1\\nodemanager.log
    LogFormatter=weblogic.nodemanager.server.LogFormatter
    ListenBacklog=50
    The managed servers' boot.properties file and startup file are below
    boot.properties:
    #Thu Jul 23 13:48:26 PDT 2009
    CustomTrustKeyStoreFileName=C\:\\bea\\wlserver_10.3\\common\\ssl\\supportTrust2008.jks
    TrustKeyStore=CustomTrust
    password={3DES}mvtUK8oB8JEiQoVES4AQIQ\=\=
    CustomTrustKeyStorePassPhrase={3DES}34+15HRlP6qqpZX3bTPp+Q\=\=
    CustomTrustKeyStoreType=JKS
    username={3DES}P5mMHiWLnf2UtssZbQtezkDtIS0COiHW
    startup.properties:
    #Server startup properties
    #Thu Jul 23 13:48:27 PDT 2009
    Arguments=-Xms1024m -Xmx1024m -Xnohup
    JavaHome=C\:\\bea\\jrockit_160_05
    SSLArguments=-Dweblogic.security.SSL.ignoreHostnameVerification\=false -Dweblogic.ReverseDNSAllowed\=false
    RestartMax=2
    RestartDelaySeconds=0
    RestartInterval=3600
    BeaHome=C\:\\bea
    ClassPath=C\:\\bea\\user_projects\\domains\\SalesIllustrationDomain\\servers\\lib\\itext\\WEB-INF\\lib\\itext.jar;C\:\\bea\\wlserver_10.3\\server\\lib\\weblogic_sp.jar;C\:\\bea\\wlserver_10.3\\server\\lib\\weblogic.jar;C\:\\bea\\user_projects\\domains\\SalesIllustrationDomain\\servers\\ProdBackupServer\\applications\\massmutual\\WEB-INF\\classes\\;C\:\\bea\\user_projects\\domains\\SalesIllustrationDomain\\servers\\ProdBackupServer\\applications\\assuritylife\\WEB-INF\\classes\\;C\:\\bea\\user_projects\\domains\\SalesIllustrationDomain\\servers\\ProdBackupServer\\applications\\minnesotalife\\WEB-INF\\classes\\;C\:\\bea\\user_projects\\domains\\SalesIllustrationDomain\\servers\\ProdBackupServer\\lib\\ltclibrary\\WEB-INF\\classes\\
    AdminURL=http\://localhost\:7001
    JavaVendor=BEA
    AutoRestart=true
    AutoKillIfFailed=false
    I am wondering if I left out a parameter some where.
    Any help would be greatly appreciated.
    Thanks,
    Greg

    First of all, I assume you mean "... up it does NOT start ..."?
    It might be helpful to point out that the purpose of the NodeManager is not to start the servers, but to "control" the servers through remote commands. When the NodeManager starts back up, it tries to reset the servers to the last known state it set them to, based on remote commands.
    For instance, if your system was running and you stopped the servers through the admin console and then restarted the machine, the NodeManager would not start the servers on machine startup, because the last controlled state of the servers was down. If all of your WebLogic servers were running as a result of NodeManager commands, and you pulled the plug on the box, when you restarted the machine, the NodeManager probably would restart the servers.

  • Cluster resource does not start automatically

    Hello,
    I have a strange issue. last saterday i replaced the motherboards of three HP DL380G6 servers, there is an HW issue with the production date of this hardware.
    After change of the HW, the cluster resources does not start automatically, when booting the servers. The resources come in state 'offline'(except the master IP resource). When start manually, the cluster resources works fine. I checked the eDirectory , and changed also the startup parameter of the cluster (autostart-manually-autostart) but with no results.
    When i create a new (simple) CL-resource, i have the same issue with this resource. Only the master ip CL-resource starts automatically??
    Does anyone have an answer for this problem....
    Thanks in advanced
    3-node SLES9sp3 SLES/OES1 cluster (i know its old...)
    - iSCSI connection to an SLES11-SAN

    Originally Posted by changju
    The state is stored in eDir, so your problem is most likely caused by an eDir issue.
    Please check the attribute "NCS:CRM Failover Mode" of the resource object in eDir. If its value is an odd number, it means the resource will load automatically. If it's not, add 1 to the number and save the new value.
    Then, you need to check file "/var/opt/novell/ncs/resources.xml". Find the section for the resource, and check "nCSCRMFailoverMode" to make sure it matches what you have in eDir. If not, please run command "/opt/novell/ncs/bin/ncs-configd.py -init" to try to update it.
    If the problem persists after all the above, please contact NTS. We will have it resolved.
    Best regards,
    Changju

  • Xfce4-power-manager does not start, but after relogin - works

    Hi all.
    When I login after system start, xfce4-power-manager does not start and systemtray icon doesn't appear. But after relogin (not restart), the systemtray icon of xfce4-power-manager appears and power manager itself works correctly (if I don't relogin, notebook will shutdown after 10 minutes of downtime - that rule doesn't exist in xfce4-power-manager settings).
    Diff between two logs (before relogin and after, xfce4-power-manager --debug command)
    diff log_1 log_2
    35c35,36
    < TRACE[xfpm-battery.c:286] xfpm_battery_refresh_icon(): Battery state 0
    > TRACE[xfpm-battery.c:150] xfpm_battery_refresh_visible(): visible=TRUE: ((XfpmShowIcon) SHOW_ICON_WHEN_BATTERY_PRESENT)
    > TRACE[xfpm-battery.c:286] xfpm_battery_refresh_icon(): Battery state 4
    51d51
    < TRACE[xfpm-polkit.c:238] xfpm_polkit_free_data(): Destroying Polkit data
    System
    Linux gready 3.14.1-1-ARCH #1 SMP PREEMPT Mon Apr 14 20:40:47 CEST 2014 x86_64 GNU/Linux
    systemd 212-3
    xfce4-power-manager 1.2.0-6
    That bug start happening after one of last week updates. I don't have a package cache.
    Can anyone help me?
    p.s. sorry for a bad English.

    Yes, i'm actually running xfce4 (all other things from xfce4 group are installed).
    It starts from a login manager named LightDM.
    AcpiD installed as a dependency.
    logind.conf
    # This file is part of systemd.
    # systemd is free software; you can redistribute it and/or modify it
    # under the terms of the GNU Lesser General Public License as published by
    # the Free Software Foundation; either version 2.1 of the License, or
    # (at your option) any later version.
    # See logind.conf(5) for details
    [Login]
    #NAutoVTs=6
    #ReserveVT=6
    #KillUserProcesses=no
    #KillOnlyUsers=
    #KillExcludeUsers=root
    #InhibitDelayMaxSec=5
    HandlePowerKey=ignore
    HandleSuspendKey=ignore
    HandleHibernateKey=ignore
    HandleLidSwitch=ignore
    #PowerKeyIgnoreInhibited=no
    #SuspendKeyIgnoreInhibited=no
    #HibernateKeyIgnoreInhibited=no
    #LidSwitchIgnoreInhibited=yes
    #IdleAction=ignore
    #IdleActionSec=30min
    I turned off key handlers because I truly HATE when I press power button and a notebook doing shutdown after that.
    Last edited by theperfectblance (2014-04-17 06:57:32)

Maybe you are looking for

  • Closing the database connection after report in a server application

    I searched these forums and the internet for a definitive answer on asking the Crystal SDK for java to close the jdbc connection after it has generated a report.  We have been using the Crystal Report SDK to generate reports within our JEE applicatio

  • How can multiple Mac users have the same iTunes?

    I have a MacBook, and my wife and I have separate accounts on it. It's easier that way for separate Facebook accounts, email, etc. However, it's complicated when it comes to iTunes and applications. We both want to use the same iTunes library. We hav

  • HotSync Loop Even After Hard Reset

    My Treo755p decidedly to randomly go into a HotSync loop (even though I never set-up the HotSync to my laptop).  I did a hard-restart, lost all the data, and restarted and it still does the HotSync Loop....Am I just screwed...Of course, I just landed

  • Screen sharing is hit or miss

    Ever since replacing my 2007 iMac with a new Mac Mini in Dec. 2012, the ability to share the Mini's screen from my 2011 MBP is a hit or miss, same goes for rmounting the disk in the Mini.  I cannot recall this ever happening with the iMac. I usually

  • N96 Keyboard lock problem

    Hi everybody. With my old n95 when i closed the slide the keyboard was locked. when i opened it it was unlocked again. With my new N96 when i close the slide it doesn't lock. it locks itself in a certain amount of time (i put it on 10s), but i can't