Cluster resource does not start automatically

Hello,
I have a strange issue. last saterday i replaced the motherboards of three HP DL380G6 servers, there is an HW issue with the production date of this hardware.
After change of the HW, the cluster resources does not start automatically, when booting the servers. The resources come in state 'offline'(except the master IP resource). When start manually, the cluster resources works fine. I checked the eDirectory , and changed also the startup parameter of the cluster (autostart-manually-autostart) but with no results.
When i create a new (simple) CL-resource, i have the same issue with this resource. Only the master ip CL-resource starts automatically??
Does anyone have an answer for this problem....
Thanks in advanced
3-node SLES9sp3 SLES/OES1 cluster (i know its old...)
- iSCSI connection to an SLES11-SAN

Originally Posted by changju
The state is stored in eDir, so your problem is most likely caused by an eDir issue.
Please check the attribute "NCS:CRM Failover Mode" of the resource object in eDir. If its value is an odd number, it means the resource will load automatically. If it's not, add 1 to the number and save the new value.
Then, you need to check file "/var/opt/novell/ncs/resources.xml". Find the section for the resource, and check "nCSCRMFailoverMode" to make sure it matches what you have in eDir. If not, please run command "/opt/novell/ncs/bin/ncs-configd.py -init" to try to update it.
If the problem persists after all the above, please contact NTS. We will have it resolved.
Best regards,
Changju

Similar Messages

  • My database does not start automatically

    i am using windows 2000 server and oracle 9.0.1, my database does not start automatically when i am booting the system.
    in regedit autostart is there, my service is getting started automatically and i used startmode auto in my oradim command but still i have to manually log in to start the database, PLS help!!!
    another issue is that i want to startup/shutdown the database using a user other than sysdba, pls tell which permission shud i grant as dba, connect, resource permissions are not doing the required job

    spfile concept is introduced from Oracle 9i. You can call it system parameter file. Benefits of having spfile concept is that what ever changes u make to system through commands
    alter system set ??? = ????
    get automatically saved in the spfile???.ora which is managed by Oracle.
    Main idea behind that as thought by Oracle is that previously u needed to change that parameter in init.ora file then start the database again after shutdown. Now u are doing everything online. spfile???.ora takes priority in the new Oracle concept.
    If u delete spfile???.ora file, then it needs some specific init.ora which need to told to Oracle which can be through command like
    startup pfile='complete patah .............'
    Bansal

  • Tomcat5 still does not start automatically

    Hello,
    Novell-tomcat5 still does not start automatically at boot although it is set to do so.
    This is from beginning of the oes2/SBE2.5 installation (without simba).
    It is still the same behavior after applying OES2/SP2 and SLES10/SP3 patches.
    After booting at terminal console:
    /etc/init.d/novell-tomcat5 status shows unused
    /etc/init.d/novell-tomcat5 start starts tomcat5 without errors
    In my boot.msg I found the following error:
    ____START______
    <notice>'novell-nss start' exits with status 0
    <notice>novell-tomcat5 start
    Starting Tomcat (/var/opt/novell/tomcat5/)<notice>checkproc: /sbin/klogd 4842
    <notice>checkproc: /sbin/syslog-ng 4839
    <notice>checkproc: /sbin/klogd 4842
    <notice>checkproc: /sbin/syslog-ng 4839
    <notice>checkproc: /usr/sbin/slpd 7030
    <notice>checkproc: /usr/sbin/slpd 7030
    <notice>checkproc: /sbin/portmap 6200
    <notice>checkproc: /sbin/portmap 6200
    <notice>checkproc: /usr/sbin/sshd 6915
    <notice>checkproc: /usr/sbin/sshd 6915
    <notice>checkproc: /usr/sbin/nmbd 5530
    <notice>checkproc: /usr/sbin/nmbd 5530
    <notice>checkproc: /usr/sbin/smbd 6900
    <notice>checkproc: /usr/sbin/smbd 6900
    <notice>checkproc: /usr/sbin/namcd 8495
    <notice>checkproc: /usr/sbin/namcd 8495
    <notice>checkproc: /usr/sbin/ntpd 7000
    <notice>checkproc: /usr/sbin/ntpd 7000
    <notice>checkproc: /usr/sbin/slpd 7030
    <notice>checkproc: /usr/sbin/slpd 7030
    <notice>checkproc: /sbin/klogd 4842
    <notice>checkproc: /sbin/syslog-ng 4839
    <notice>checkproc: /sbin/klogd 4842
    <notice>checkproc: /sbin/syslog-ng 4839
    <notice>checkproc: /usr/sbin/slpd 7030
    <notice>checkproc: /usr/sbin/slpd 7030
    <notice>checkproc: /sbin/portmap 6200
    <notice>checkproc: /sbin/portmap 6200
    <notice>checkproc: /usr/sbin/sshd 6915
    <notice>checkproc: /usr/sbin/sshd 6915
    <notice>checkproc: /usr/sbin/nmbd 5530
    <notice>checkproc: /usr/sbin/nmbd 5530
    <notice>checkproc: /usr/sbin/smbd 6900
    <notice>checkproc: /usr/sbin/smbd 6900
    <notice>checkproc: /usr/sbin/namcd 8495
    <notice>checkproc: /usr/sbin/namcd 8495
    <notice>checkproc: /usr/sbin/ntpd 7000
    <notice>checkproc: /usr/sbin/ntpd 7000
    <notice>checkproc: /usr/sbin/slpd 7030
    <notice>checkproc: /usr/sbin/slpd 7030
    failed
    <notice>'novell-tomcat5 start' exits with status 7
    <notice>novell-xregd start
    Starting novell-xregd...done
    <notice>'novell-xregd start' exits with status 0 ....
    _______END______________
    Of course it es even a cosmetic problem I don't want to start tomcat manually everytime when booting up.
    Has anybody an idea what could be wrong?
    Yours sincerely
    OliverN

    Originally Posted by revilo
    Hello,
    Novell-tomcat5 still does not start automatically at boot although it is set to do so.
    This is from beginning of the oes2/SBE2.5 installation (without simba).
    It is still the same behavior after applying OES2/SP2 and SLES10/SP3 patches.
    After booting at terminal console:
    /etc/init.d/novell-tomcat5 status shows unused
    /etc/init.d/novell-tomcat5 start starts tomcat5 without errors
    Of course it es even a cosmetic problem I don't want to start tomcat manually everytime when booting up.
    Has anybody an idea what could be wrong?
    Yours sincerely
    OliverN
    Hi Oliver,
    If you are manually installing the component products then this is no longer a "NOWS SBE" installation. Any issues you encounter are related solely to the component products. OES Linux Installation questions should be directed to: OES-L: Install
    In the mean time, to see if it is configured to start automatically use "chkconfig". For instructions:
    Code:
    man chkconfig
    Is it configured to start automatically?
    Code:
    server:~ # chkconfig --list | grep novell-tomcat5
    novell-tomcat5 0:off 1:off 2:off 3:on 4:off 5:on 6:off
    The response from the above command shows that novell-tomcat5 should start automatically for runlevels 3 and 5.
    If it is not set to start automatically on your server, you can make it start by:
    Code:
    chkconfig novell-tomcat5 on
    I am by no means a Linux expert. If this doesn't resolve your issue, I suggest you post in the appropriate forum where you will find knowledgeable people willing to help.

  • MII UDS does not start automatically on server reset

    Hi,
    MII UDS does not start automatically on server reset, although it was set as automatically start.
    What could be the reason of this problem?
    Thanks.

    Hi,
    Is the runtime mode is set to service?
    Have you referred this document?
    [Programatically Starting and Stopping an SAP xMII UDS Executable Instance|http://www.sdn.sap.com/irj/scn/index?rid=/library/uuid/b0f460c3-7f92-2910-02af-b608f92977c3]
    Regards,
    Musarrat
    Edited by: Musarrat Husain on Jul 6, 2011 8:27 PM

  • EyeTV: Mac does not start automatically

    Mac does not start automatically for EyeTV recordings. I reinstalled EyeTV but it did not help.
    Any help appreciated.
    iMac i5, 2,7Ghz, OS X 10.7.4
    Kind reagards,
    Torsten

    I have to same problem: Bought Elgato Sat 3 years ago. Now I decided to install it in the living room and bought a new i5 Mac mini. EyeTV works fine but does not wake up Mountain Lion 10.8.2 sometimes.
    When I program wake up events manually via System Preferences or pmset command in the terminal, all works fine and my Mac wakes up. I tried everything, from clean reinstall to debugging AutoWake.plist and such.
    Annoying!

  • The CSSD does not start automatically on Non-RAC - AIX 5L

    Hi all,
    Database: Oracle 10.2.0.4
    O.S AIX 5.3 TL 10
    I am facing a problem with the CSSD Non-RAC/Clusterware.
    When we restarted the server the service CSSD does not start automatically and there is no relevant messages in the log files of CSSD.
    Running the "localconfig reset $ORACLE_HOME", execute successfully but does not start the CSSD.
    Running "/etc/init.cssd start" - does not work, nothing happens when we run it
    I manually ran "/etc/ init.cssd run" and the service CSSD (ossd.bin) was started without errors.
    No errors on errpt from AIX.
    I've opened a SR but I am waiting for response from Oracle.

    Hi,
    I believe this problem is not with Oracle, but in AIX.It may be that one process that is starting on boot is holding the other process. You need to identify what is process/application.
    Check the process on inittab that are already active and which are inactive they should be active.
    One clue: Is very common process that is initiated in wait mode hold the boot server.
    wait
    When the init command enters the run level that matches the entry's run level,
    start the process and wait for its termination.
    All subsequent reads of the /etc/inittab file while the init
    command is in the same run level will cause the init command to ignore this entry.http://publib.boulder.ibm.com/infocenter/aix/v6r1/index.jsp?topic=/com.ibm.aix.files/doc/aixfiles/inittab.htm
    Regards,
    Levi Pereira

  • Oracle service, Listener and http server does not start automatically

    Hello,
    I have Oracle 9i release 2 installed on Unix HP box if system restart in case of power failure the Oracle service, Listener and http server does not start automatically, is there any ready reference available to check what's wrong is happening(I don't have knowledge of Unix).
    Thanks, Khawar.

    Hi Rajesh,
    Thanks for reply, I will check this link and will be back if facing problem.
    Regards, Khawar.

  • Panel does not start automatically in Gnome 2.24.3

    Since Gnome 2.24.3, the Gnome Panel does not start automatically.
    I had to manualy add it to the startup group via "Sessions" in order to force it to start when login finishes.
    Does anybody has the same behavior?
    Should I report it as a bug?

    That may be true but it is a real pain since when it happens the only way to recover is to terminate all of the iTunes modules with task manager and start it manually. It also leaves the IPOD in a state that says do not disconnect. You can disconnect since nothing is really happening but there is no excuse for this not to start much faster. When you have multiple users it is a real pain. It ought to be able to either end when finished or better yet allow multiple users simultaneously updating from different libraries.
    I guess i will just have to get in the habit of treating it as a single user and start and stop it every time I need it and be suer not to let it run. Not nice because that means waiting for larger Podcast downloads instead of having there ready for me when I sign on my computer.

  • ITunes does not start automatically when I plug in my iPHONE.  When I start it manually it does not recognize my phone although the phone is visible in My Computer.

    Itunes does not start automatically when I plug in my iPhone.  When I start it manually, it never recognizes the phone although it does ask if I want to download pictures etc.  Many albums have no art work that use to.  iTunes completely unresponsive to the mouse.

    Hi billm1013,
    I'm sorry to hear you are having these issues with your iPhone. If your iPhone isn't being recognized in iTunes, and/or iTunes isn't responding to your mouse when the iPhone is connected, you may find the troubleshooting steps outlined in the following article helpful:
    If you don't see your connected device in iTunes for Mac - Apple Support
    Regards,
    - Brenden

  • Transport service does not start automatically after upgrade to exchange 2010 SP2 from Exchange 2010 SP1

    Hi,
    I am trying to upgrade Exchange 2010 SP2 from SP1, but Transport service does not start automatically.
    Tried manually start services, it started successfully but again goes down within few seconds automatically.
    Reboot server. but no luck.
    Any help.
    MD

    Hi,
    I recommend you use event viewer to check if there are any relate event logs. This may help us to find the cause.
    In addition, as Amit mentioned, Exchange 2010 SP2 isn't supported by Microsoft, I think upgrading to SP3 is a much more sensible approach.
    Thanks.
    Niko Cheng
    TechNet Community Support

  • After downloading mountain lion the internet does not start automatically after start or restart but if I use diagnostics it starts is there a simpler solution

    After downloading mountain lion the internet does not start automatically after start or restart but if I use diagnostics it starts is there a simpler solution?

    Extensions can sometimes be the cause of problems. If the problem does not occur in Safe Mode, then you can disable your extensions one-by-one until you find out which one is causing the problem. See [[Troubleshooting extensions and themes]]

  • When I connect the iphone does not start automatically Itunes Please help me

    when I connect the iphone does not start automatically Itunes
    Please help me
    How to solve this problem that I have

    i've had a few issues like this.
    I've found that it is an issue with items that are already on your phone.
    several troubleshoots. 
    1) uncheck everything from syncing (apps, music, tv shows, movies, podcasts, etc), try to perform a sync, it most likely will work.  Then, sync after checking each item individually (check the sync box for videos, then sync, check the sync box for podcasts, then sync, check the sync box for music, then sync, etc).  One of two things will happen, 1) you will fix the problem, or 2) you will identify exactly what part of the sync setup is the culprit.
    2) if the above doesn't work, I've found that it is likely an issue with files that are on your phone but your phone doesn't exaclty recognize (for example, I had copies of music on my phone that didn't show up in the music app, I went in on itunes and manually deleted those songs from my phone and that fixed the sync).  to do this, check the "manually manage music and videos" box at the bottom of "summary" while your phone is connected to itunes.  Then, go to the left hand pane in itunes and find your iphone device, click the drop-down arrow that shows all the categories for media on your iphone.  Go to the music category in your iphone on itunes and delete all the music that shows up.  Try to perform a sync - it likely will work.  After this, you can uncheck the manually manage music box and re-sync your phone as normal
    let me know if either works

  • HP ProOne 400 does not start automatically on a schedule

    HP ProOne 400 does not start automatically on a schedule. In the BIOS menu "means automatic switch BIOS" to select the desired day of the week and set the time, but Compute still does not start automatically. Please help.

    Hi,
    As I understand, you would like to use workflow to copy list items cross site collection.
    So far it is not supported with OOB workflow option, here is an codeplex workaround:
    https://spdactivities.codeplex.com/wikipage?title=Copy%20List%20Item%20Extended%20Activity
    Please check if it can be help.
    Regards,
    Rebecca Tu
    TechNet Community Support

  • Itunes does not start automaticly when connected although auto is thicked help?

    Itunes does not start automaticly when connected although autostart is thicked can anyone help?

    Hi,
    See this Discussion:
    https://discussions.apple.com/message/15693777#15693777
    Cheers,  

  • 11gR2 Cluster node does not start, start of ora.gipcd fails

    Hi
    I have a clusert node which just does not start, and i do know understand what the problem is.
    Does anyone have an idea what the problem cound be?
    I am using Oracle 11.2.0.1.0 on OEL.
    I appreciate any help, thank you.
    Regards Bernhard
    NAME           TARGET  STATE        SERVER                   STATE_DETAILS      
    Cluster Resources
    ora.asm
          1        ONLINE  OFFLINE                                                  
    ora.crsd
          1        ONLINE  INTERMEDIATE node001                             
    ora.cssd
          1        ONLINE  OFFLINE                                                  
    ora.cssdmonitor
          1        ONLINE  OFFLINE                                                  
    ora.ctssd
          1        ONLINE  OFFLINE                                                  
    ora.diskmon
          1        ONLINE  OFFLINE                                                  
    ora.drivers.acfs
          1        ONLINE  ONLINE       node001                             
    ora.evmd
          1        ONLINE  OFFLINE                                                  
    ora.gipcd
          1        ONLINE  OFFLINE                                                  
    ora.gpnpd
          1        ONLINE  OFFLINE                                                  
    ora.mdnsd
          1        ONLINE  ONLINE       node001                              alertnode001.log
    Oracle Database 11g Clusterware Release 11.2.0.1.0 - Production Copyright 1996, 2009 Oracle. All rights reserved.
    2012-06-29 08:43:52.511
    [/opt/grid/product/11gR2/grid/bin/cssdmonitor(5144)]CRS-5822:Agent '/opt/grid/product/11gR2/grid/bin/cssdmonitor_root' disconnected from server. Details at (:CRSAGF00117:) in /opt/grid/product/11gR2/grid/log/node001/agent/ohasd/oracssdmonitor_root/oracssdmonitor_root.log.
    2012-06-29 08:48:49.713
    [ohasd(4346)]CRS-2112:The OLR service started on node node001.
    2012-06-29 08:48:50.010
    [ohasd(4346)]CRS-8017:location: /etc/oracle/lastgasp has 50 reboot advisory log files, 0 were announced and 0 errors occurred
    2012-06-29 08:48:55.134
    [ohasd(4346)]CRS-2772:Server 'node001' has been assigned to pool 'Free'.
    [client(4634)]CRS-10001:ACFS-9327: Verifying ADVM/ACFS devices.
    [client(4652)]CRS-10001:ACFS-9322: done.
    2012-06-29 08:50:59.362
    [ohasd(4346)]CRS-2757:Command 'Start' timed out waiting for response from the resource 'ora.gipcd'. Details at (:CRSPE00111:) in /opt/grid/product/11gR2/grid/log/node001/ohasd/ohasd.log.oracssdmonitor_root.log
    Oracle Database 11g Clusterware Release 11.2.0.1.0 - Production Copyright 1996, 2009 Oracle. All rights reserved.
    2012-06-29 08:48:51.003: [    AGFW][1810312288] Starting the agent: /opt/grid/product/11gR2/grid/log/node001/agent/ohasd/oracssdmonitor_root/
    2012-06-29 08:48:51.003: [   AGENT][1810312288] Agent framework initialized, Process Id = 4414
    2012-06-29 08:48:51.003: [ USRTHRD][1810312288] to enter agent main
    2012-06-29 08:48:54.939: [ USRTHRD][1810312288] clsncssd_main: setting priority to 4
    2012-06-29 08:48:54.939: [ USRTHRD][1810312288]  *** Agent Framework Started ***
    2012-06-29 08:48:54.939: [ USRTHRD][1810312288] clsncssd_vmondisv: Compatible vendor clusterware not in use
    2012-06-29 08:48:54.939: [ USRTHRD][1810312288] clsncssd_thrdspawn: spawn OMON succ
    2012-06-29 08:48:54.939: [ USRTHRD][1810312288] clsncssd_main: spawn omon succ
    2012-06-29 08:48:54.939: [ USRTHRD][1098914112] clsnomon_main: default values for omon, initrate 1000, pollrate 500.
    2012-06-29 08:48:54.939: [ USRTHRD][1098914112] clsnomon_main: starting omon
    2012-06-29 08:48:54.942: [ CSSCLNT][1098914112]clssscConnect: gipc request failed with 29 (0x16)
    2012-06-29 08:48:54.942: [ CSSCLNT][1098914112]clsssInitNative: connect failed, rc 29
    2012-06-29 08:48:55.041: [    AGFW][1810312288] SERVER IPC CONNECT STR: (ADDRESS=(PROTOCOL=IPC)(KEY=OHASD_IPC_SOCKET_11))
    2012-06-29 08:48:55.041: [CLSFRAME][1810312288] Inited lsf context 0x1ae1cdd0
    2012-06-29 08:48:55.041: [CLSFRAME][1810312288] Initing CLS Framework messaging
    2012-06-29 08:48:55.041: [CLSFRAME][1810312288] New Framework state: 2
    2012-06-29 08:48:55.041: [CLSFRAME][1810312288] M2M is starting...
    2012-06-29 08:48:55.047: [ CRSCOMM][1810312288] m_pClscCtx=0x1ae21d70m_pUgblm=0x1ae754b0
    2012-06-29 08:48:55.047: [ CRSCOMM][1810312288] Starting send thread
    2012-06-29 08:48:55.052: [ CRSCOMM][1119893824] clsIpc: sendWork thread started.
    2012-06-29 08:48:55.057: [ CRSCOMM][1130383680] IPC Client thread started listening
    2012-06-29 08:48:55.057: [ CRSCOMM][1130383680] init data sent from server
    2012-06-29 08:48:55.057: [CLSFRAME][1810312288] New IPC Member:{Relative|Node:0|Process:0|Type:2}:OHASD:node001
    2012-06-29 08:48:55.058: [CLSFRAME][1810312288] New process connected to us ID:{Relative|Node:0|Process:0|Type:2} Info:OHASD:node001
    2012-06-29 08:48:55.066: [CLSFRAME][1810312288] Starting thread model named: MultiThread
    2012-06-29 08:48:55.073: [CLSFRAME][1810312288] Starting thread model named: SingleThread
    2012-06-29 08:48:55.076: [CLSFRAME][1810312288] Starting thread model named: SingleThreadT
    2012-06-29 08:48:55.080: [CLSFRAME][1810312288] New Framework state: 3
    2012-06-29 08:48:55.080: [    AGFW][1810312288] Agent Framework started successfully
    2012-06-29 08:48:55.080: [    AGFW][1182832960] Agfw engine module has enabled...
    2012-06-29 08:48:55.080: [CLSFRAME][1182832960] Module Enabling is complete
    2012-06-29 08:48:55.080: [CLSFRAME][1182832960] New Framework state: 6
    2012-06-29 08:48:55.080: [    AGFW][1182832960] Agent is started with userid: root , expected user: root
    2012-06-29 08:48:55.081: [    AGFW][1182832960] Agent sending message to PE: AGENT_HANDSHAKE[Proxy] ID 20484:14
    2012-06-29 08:48:55.088: [    AGFW][1182832960] Agent received the message: RESTYPE_ADD[ora.cssdmonitor.type] ID 8196:299
    2012-06-29 08:48:55.089: [    AGFW][1182832960] Added new restype: ora.cssdmonitor.type
    2012-06-29 08:48:55.089: [    AGFW][1182832960] Agent sending last reply for: RESTYPE_ADD[ora.cssdmonitor.type] ID 8196:299
    2012-06-29 08:48:55.090: [    AGFW][1182832960] Agent received the message: RESOURCE_ADD[ora.cssdmonitor 1 1] ID 4356:301
    2012-06-29 08:48:55.090: [    AGFW][1182832960] Added new resource: ora.cssdmonitor 1 1 to the agfw
    2012-06-29 08:48:55.091: [    AGFW][1182832960] Agent sending last reply for: RESOURCE_ADD[ora.cssdmonitor 1 1] ID 4356:301
    2012-06-29 08:48:55.091: [    AGFW][1182832960] Agent received the message: RESOURCE_PROBE[ora.cssdmonitor 1 1] ID 4097:302
    2012-06-29 08:48:55.091: [    AGFW][1182832960] Preparing CHECK command for: ora.cssdmonitor 1 1
    2012-06-29 08:48:55.096: [    AGFW][1172343104] Executing command: check for resource: ora.cssdmonitor 1 1
    2012-06-29 08:48:55.096: [ora.cssdmonitor][1172343104] [check] clsncssd_getattr: attr OMON_INITRATE, value 1000
    2012-06-29 08:48:55.096: [ora.cssdmonitor][1172343104] [check] clsncssd_getattr: attr OMON_POLLRATE, value 500
    2012-06-29 08:48:55.096: [ora.cssdmonitor][1172343104] [check] clsncssd_getattr: attr ORA_OPROCD_MODE, value
    2012-06-29 08:48:55.096: [ora.cssdmonitor][1172343104] [check] clsncssd_getattr: attr PROCD_TIMEOUT, value 1000
    2012-06-29 08:48:55.096: [ora.cssdmonitor][1172343104] [check] clsncssd_getattr: attr LOGGING_LEVEL, value 1
    2012-06-29 08:48:55.096: [    AGFW][1172343104] check for resource: ora.cssdmonitor 1 1 completed with status: OFFLINE
    2012-06-29 08:48:55.096: [CRSTIMER][1203812672] Timer Thread Starting.
    2012-06-29 08:48:55.096: [    AGFW][1182832960] ora.cssdmonitor 1 1 state changed from: UNKNOWN to: OFFLINE
    2012-06-29 08:48:55.096: [    AGFW][1182832960] Agent sending last reply for: RESOURCE_PROBE[ora.cssdmonitor 1 1] ID 4097:302
    2012-06-29 08:48:55.096: [    AGFW][1182832960] Agent has no resources to be monitored.Sending suicide request.
    2012-06-29 08:48:55.096: [    AGFW][1182832960] Agent sending message to PE: AGENT_SUICIDE[Proxy] ID 20486:28
    2012-06-29 08:48:55.100: [    AGFW][1182832960] Agent received the message: RESOURCE_DELETE[ora.cssdmonitor 1 1] ID 4358:317
    2012-06-29 08:48:55.100: [    AGFW][1182832960] Agent sending last reply for: RESOURCE_DELETE[ora.cssdmonitor 1 1] ID 4358:317
    2012-06-29 08:48:55.100: [    AGFW][1182832960] Agent has no resources to be monitored.Sending suicide request.
    2012-06-29 08:48:55.100: [    AGFW][1182832960] Agent sending message to PE: AGENT_SUICIDE[Proxy] ID 20486:34
    2012-06-29 08:48:55.101: [    AGFW][1182832960] ora.cssdmonitor 1 1 marked as deleted.
    2012-06-29 08:48:55.101: [    AGFW][1182832960] Deleting the resource: ora.cssdmonitor 1 1
    2012-06-29 08:48:55.101: [    AGFW][1182832960] Agent is commiting suicide.
    2012-06-29 08:48:55.101: [ USRTHRD][1182832960] clsncssd_exit: CSSD Agent was asked to exit with exit code 1
    2012-06-29 08:48:55.101: [ USRTHRD][1182832960] clsncssd_becomeactive: Signaling active state
    2012-06-29 08:48:55.101: [ USRTHRD][1182832960] clsncssd_term: still threads up (1)
    2012-06-29 08:48:55.101: [ USRTHRD][1182832960] clsncssd_exit: Agent is done.
    2012-06-29 08:48:55.101: [    AGFW][1182832960] Agent is exiting with exit code: 1
    2012-06-29 08:48:55.947: [ CSSCLNT][1098914112]clssscConnect: gipc request failed with 29 (0x16)
    2012-06-29 08:48:55.947: [ CSSCLNT][1098914112]clsssInitNative: connect failed, rc 29
    2012-06-29 08:48:56.952: [ CSSCLNT][1098914112]clssscConnect: gipc request failed with 29 (0x16)
    2012-06-29 08:48:56.952: [ CSSCLNT][1098914112]clsssInitNative: connect failed, rc 29Edited by: Bernhard W on 03-Jul-2012 02:14

    I am really getting desperate about this.
    The ASM persmissions are on both nodes the same, so this should not be the problem and i can not find any problem on the network.
    The log files of the healthy node do not say anything about the node which does not startup now, the last log entry was from 6 months ago, when i shut that node down. There seems to be no communication between the two nodes now.
    I tried to manually start the ora.cssd but somehow ora.gipcd just does not start and i can not find the problem.
    [oracle@dmrs11srvcla001 ~]$ crsctl stat res -t -init
    NAME           TARGET  STATE        SERVER                   STATE_DETAILS      
    Cluster Resources
    ora.asm
          1        ONLINE  OFFLINE                                                  
    ora.crsd
          1        ONLINE  INTERMEDIATE dmrs11srvcla001                             
    ora.cssd
          1        ONLINE  OFFLINE                                                  
    ora.cssdmonitor
          1        ONLINE  ONLINE       dmrs11srvcla001                             
    ora.ctssd
          1        ONLINE  OFFLINE                                                  
    ora.diskmon
          1        OFFLINE OFFLINE                                                  
    ora.drivers.acfs
          1        ONLINE  ONLINE       dmrs11srvcla001                             
    ora.evmd
          1        ONLINE  OFFLINE                                                  
    ora.gipcd
          1        ONLINE  OFFLINE                                                  
    ora.gpnpd
          1        ONLINE  OFFLINE                                                  
    ora.mdnsd
          1        ONLINE  ONLINE       dmrs11srvcla001                             
    [oracle@dmrs11srvcla001 ~]$ crsctl start res ora.cssd -init
    CRS-2672: Attempting to start 'ora.gipcd' on 'dmrs11srvcla001'
    Start action for daemon aborted
    CRS-2674: Start of 'ora.gipcd' on 'dmrs11srvcla001' failed
    CRS-2679: Attempting to clean 'ora.gipcd' on 'dmrs11srvcla001'
    CRS-2681: Clean of 'ora.gipcd' on 'dmrs11srvcla001' succeeded
    CRS-2672: Attempting to start 'ora.gpnpd' on 'dmrs11srvcla001'
    Start action for daemon aborted
    CRS-2674: Start of 'ora.gpnpd' on 'dmrs11srvcla001' failed
    CRS-2679: Attempting to clean 'ora.gpnpd' on 'dmrs11srvcla001'
    CRS-2681: Clean of 'ora.gpnpd' on 'dmrs11srvcla001' succeeded
    CRS-2672: Attempting to start 'ora.cssd' on 'dmrs11srvcla001'
    CRS-2672: Attempting to start 'ora.diskmon' on 'dmrs11srvcla001'
    CRS-2676: Start of 'ora.diskmon' on 'dmrs11srvcla001' succeededalertnode001.log
    [ohasd(4351)]CRS-2757:Command 'Start' timed out waiting for response from the resource 'ora.gipcd'. Details at (:CRSPE00111:) in /opt/grid/product/11gR2/grid/log/node001/ohasd/ohasd.log.
    2012-07-02 17:11:40.789
    [ohasd(4351)]CRS-2757:Command 'Start' timed out waiting for response from the resource 'ora.gpnpd'. Details at (:CRSPE00111:) in /opt/grid/product/11gR2/grid/log/node001/ohasd/ohasd.log.
    2012-07-02 17:11:41.654
    [ohasd(4351)]CRS-2765:Resource 'ora.mdnsd' has failed on server 'node001'.
    2012-07-02 17:11:43.404
    [cssd(4997)]CRS-1713:CSSD daemon is started in clustered mode
    2012-07-02 17:11:46.634
    [cssd(4997)]CRS-2302:Cannot get GPnP profile. Error CLSGPNP_NO_DAEMON (GPNPD daemon is not running).
    2012-07-02 17:11:46.745
    [ohasd(4351)]CRS-2765:Resource 'ora.cssdmonitor' has failed on server 'node001'.
    2012-07-02 17:12:42.384
    [/opt/grid/product/11gR2/grid/bin/orarootagent.bin(4488)]CRS-5818:Aborted command 'start for resource: ora.diskmon 1 1' for resource 'ora.diskmon'. Details at (:CRSAGF00113:) in /opt/grid/product/11gR2/grid/log/node001/agent/ohasd/orarootagent_root/orarootagent_root.log.
    2012-07-02 17:12:46.390
    [ohasd(4351)]CRS-2757:Command 'Start' timed out waiting for response from the resource 'ora.diskmon'. Details at (:CRSPE00111:) in /opt/grid/product/11gR2/grid/log/node001/ohasd/ohasd.log.
    2012-07-02 17:14:50.768
    [ohasd(4351)]CRS-2757:Command 'Start' timed out waiting for response from the resource 'ora.gipcd'. Details at (:CRSPE00111:) in /opt/grid/product/11gR2/grid/log/node001/ohasd/ohasd.log.
    2012-07-02 17:16:55.819
    [ohasd(4351)]CRS-2757:Command 'Start' timed out waiting for response from the resource 'ora.gpnpd'. Details at (:CRSPE00111:) in /opt/grid/product/11gR2/grid/log/node001/ohasd/ohasd.log.
    2012-07-02 17:16:58.354
    [cssd(5137)]CRS-1713:CSSD daemon is started in clustered mode
    2012-07-02 17:16:58.425
    [cssd(5137)]CRS-2302:Cannot get GPnP profile. Error CLSGPNP_NO_DAEMON (GPNPD daemon is not running).
    2012-07-02 17:25:23.194
    [ohasd(4351)]CRS-2765:Resource 'ora.diskmon' has failed on server 'node001'.
    2012-07-02 17:25:23.200
    [ohasd(4351)]CRS-2767:Target resource 'ora.diskmon' is offline, will not recover.
    2012-07-02 17:26:57.384
    [/opt/grid/product/11gR2/grid/bin/cssdagent(5116)]CRS-5818:Aborted command 'start for resource: ora.cssd 1 1' for resource 'ora.cssd'. Details at (:CRSAGF00113:) in /opt/grid/product/11gR2/grid/log/node001/agent/ohasd/oracssdagent_root/oracssdagent_root.log.
    2012-07-02 17:27:02.514
    [ohasd(4351)]CRS-2757:Command 'Start' timed out waiting for response from the resource 'ora.cssd'. Details at (:CRSPE00111:) in /opt/grid/product/11gR2/grid/log/node001/ohasd/ohasd.log.
    2012-07-02 17:37:11.971
    [ohasd(4351)]CRS-2757:Command 'Start' timed out waiting for response from the resource 'ora.evmd'. Details at (:CRSPE00111:) in /opt/grid/product/11gR2/grid/log/node001/ohasd/ohasd.log.
    [ohasd(4351)]CRS-2765:Resource 'ora.crsd' has failed on server 'node001'.
    2012-07-03 02:13:57.821
    [ohasd(4351)]CRS-2765:Resource 'ora.crsd' has failed on server 'node001'.
    2012-07-03 05:14:37.915
    [ohasd(4351)]CRS-2765:Resource 'ora.crsd' has failed on server 'node001'.
    2012-07-03 05:44:44.630
    [ohasd(4351)]CRS-2765:Resource 'ora.crsd' has failed on server 'node001'.
    2012-07-03 06:14:51.303
    [ohasd(4351)]CRS-2765:Resource 'ora.crsd' has failed on server 'node001'.
    2012-07-03 06:44:57.981
    [ohasd(4351)]CRS-2765:Resource 'ora.crsd' has failed on server 'node001'.
    2012-07-03 07:15:04.655
    [ohasd(4351)]CRS-2765:Resource 'ora.crsd' has failed on server 'node001'.
    2012-07-03 07:42:45.015
    [ohasd(4351)]CRS-2757:Command 'Start' timed out waiting for response from the resource 'ora.gipcd'. Details at (:CRSPE00111:) in /opt/grid/product/11gR2/grid/log/node001/ohasd/ohasd.log.
    2012-07-03 07:44:50.068
    [ohasd(4351)]CRS-2757:Command 'Start' timed out waiting for response from the resource 'ora.gpnpd'. Details at (:CRSPE00111:) in /opt/grid/product/11gR2/grid/log/node001/ohasd/ohasd.log.
    2012-07-03 07:44:52.369
    [cssd(10209)]CRS-1713:CSSD daemon is started in clustered mode
    2012-07-03 07:44:52.434
    [cssd(10209)]CRS-2302:Cannot get GPnP profile. Error CLSGPNP_NO_DAEMON (GPNPD daemon is not running).
    2012-07-03 07:45:11.331
    [ohasd(4351)]CRS-2765:Resource 'ora.crsd' has failed on server 'node001'.
    2012-07-03 07:53:17.222
    [ohasd(4351)]CRS-2765:Resource 'ora.diskmon' has failed on server 'node001'.
    2012-07-03 07:53:17.222
    [ohasd(4351)]CRS-2767:Target resource 'ora.diskmon' is offline, will not recover.
    2012-07-03 07:54:51.401
    [/opt/grid/product/11gR2/grid/bin/cssdagent(10188)]CRS-5818:Aborted command 'start for resource: ora.cssd 1 1' for resource 'ora.cssd'. Details at (:CRSAGF00113:) in /opt/grid/product/11gR2/grid/log/node001/agent/ohasd/oracssdagent_root/oracssdagent_root.log.
    2012-07-03 07:54:56.524
    [ohasd(4351)]CRS-2757:Command 'Start' timed out waiting for response from the resource 'ora.cssd'. Details at (:CRSPE00111:) in /opt/grid/product/11gR2/grid/log/node001/ohasd/ohasd.log.ohasd.log
    2012-07-03 07:45:11.330: [    AGFW][1347250496] Agfw Proxy Server received the message: RESOURCE_STATUS[Proxy] ID 20481:24919
    2012-07-03 07:45:11.330: [    AGFW][1347250496] Received state change for ora.crsd 1 1 [old state = PARTIAL, new state = OFFLINE]
    2012-07-03 07:45:11.330: [    AGFW][1347250496] Agfw Proxy Server sending message to PE, Contents = [MIDTo:2|OpID:3|FromA:{Invalid|Node:0|Process:0|Type:0}|ToA:{Invalid|Node:-1|Process:-1|Type:-1}|MIDFrom:0|Type:4|Pri2|Id:23258]
    2012-07-03 07:45:11.330: [    AGFW][1347250496] Agfw Proxy Server replying to the message: RESOURCE_STATUS[Proxy] ID 20481:24919
    2012-07-03 07:45:11.330: [   CRSPE][1357756736] State change received from node001 for ora.crsd 1 1
    2012-07-03 07:45:11.331: [   CRSPE][1357756736] Processing PE command id=139. Description: [Resource State Change (ora.crsd 1 1) : 0x1c284d40]
    2012-07-03 07:45:11.331: [   CRSPE][1357756736] RI [ora.crsd 1 1] new external state [OFFLINE] old value: [INTERMEDIATE] on node001 label = []
    2012-07-03 07:45:11.331: [   CRSPE][1357756736] Resource Resource Instance ID[ora.crsd 1 1]. Values:
    STATE=OFFLINE
    TARGET=ONLINE
    LAST_SERVER=node001
    CURRENT_RCOUNT=1
    LAST_RESTART=1341292505
    FAILURE_COUNT=0
    FAILURE_HISTORY=
    STATE_DETAILS=
    INCARNATION=29
    STATE_CHANGE_VERS=29
    LAST_FAULT=1341292504
    DEGREE_ID=1
    ID=ora.crsd 1 1
    CARDINALITY_ID=1
    Lock Info:
    Write Locks:none
    ReadLocks:|STATE INITED||INITIAL CHECK DONE| has failed!
    2012-07-03 07:45:11.331: [   CRSPE][1357756736] Processing unplanned state change for [ora.crsd 1 1]
    2012-07-03 07:45:11.331: [   CRSPE][1357756736] ora.crsd 1 1: uptime exceeds uptime threshold , resetting restart count
    2012-07-03 07:45:11.331: [   CRSPE][1357756736] Local Recovery picked for [ora.crsd 1 1]
    2012-07-03 07:45:11.333: [   CRSPE][1357756736] Sending message to agfw: id = 23260
    2012-07-03 07:45:11.333: [    AGFW][1347250496] Agfw Proxy Server received the message: RESOURCE_START[ora.crsd 1 1] ID 4098:23260
    2012-07-03 07:45:11.333: [   CRSPE][1357756736] CRS-2672: Attempting to start 'ora.crsd' on 'node001'
    2012-07-03 07:45:11.333: [    AGFW][1347250496] Agfw Proxy Server forwarding the message: RESOURCE_START[ora.crsd 1 1] ID 4098:23260 to the agent /opt/grid/product/11gR2/grid/bin/orarootagent_root
    2012-07-03 07:45:12.349: [    AGFW][1347250496] Received the reply to the message: RESOURCE_START[ora.crsd 1 1] ID 4098:23261 from the agent /opt/grid/product/11gR2/grid/bin/orarootagent_root
    2012-07-03 07:45:12.350: [    AGFW][1347250496] Agfw Proxy Server sending the reply to PE for message:RESOURCE_START[ora.crsd 1 1] ID 4098:23260
    2012-07-03 07:45:12.350: [   CRSPE][1357756736] Received reply to action [Start] message ID: 23260
    2012-07-03 07:45:12.350: [    AGFW][1347250496] Received the reply to the message: RESOURCE_START[ora.crsd 1 1] ID 4098:23261 from the agent /opt/grid/product/11gR2/grid/bin/orarootagent_root
    2012-07-03 07:45:12.350: [    AGFW][1347250496] Agfw Proxy Server sending the last reply to PE for message:RESOURCE_START[ora.crsd 1 1] ID 4098:23260
    2012-07-03 07:45:12.350: [   CRSPE][1357756736] Received reply to action [Start] message ID: 23260
    2012-07-03 07:45:12.351: [   CRSPE][1357756736] RI [ora.crsd 1 1] new external state [INTERMEDIATE] old value: [OFFLINE] on node001 label = []
    2012-07-03 07:45:12.351: [   CRSPE][1357756736] CRS-2676: Start of 'ora.crsd' on 'node001' succeeded
    2012-07-03 07:45:12.351: [   CRSPE][1357756736] PE Command [ Resource State Change (ora.crsd 1 1) : 0x1c284d40 ] has completed
    2012-07-03 07:45:12.351: [    AGFW][1347250496] Agfw Proxy Server received the message: CMD_COMPLETED[Proxy] ID 20482:23269
    2012-07-03 07:45:12.351: [    AGFW][1347250496] Agfw Proxy Server replying to the message: CMD_COMPLETED[Proxy] ID 20482:23269
    2012-07-03 07:45:12.351: [    AGFW][1347250496] Agfw received reply from PE for resource state change for ora.crsd 1 1
    2012-07-03 07:53:17.220: [    AGFW][1347250496] Agfw Proxy Server received the message: RESOURCE_STATUS[Proxy] ID 20481:25353
    2012-07-03 07:53:17.221: [    AGFW][1347250496] Received state change for ora.diskmon 1 1 [old state = ONLINE, new state = PLANNED_OFFLINE]
    2012-07-03 07:53:17.221: [    AGFW][1347250496] Agfw Proxy Server sending message to PE, Contents = [MIDTo:2|OpID:3|FromA:{Invalid|Node:0|Process:0|Type:0}|ToA:{Invalid|Node:-1|Process:-1|Type:-1}|MIDFrom:0|Type:4|Pri2|Id:23497]
    2012-07-03 07:53:17.221: [    AGFW][1347250496] Agfw Proxy Server replying to the message: RESOURCE_STATUS[Proxy] ID 20481:25353
    2012-07-03 07:53:17.221: [   CRSPE][1357756736] State change received from node001 for ora.diskmon 1 1
    2012-07-03 07:53:17.221: [   CRSPE][1357756736] Processing PE command id=140. Description: [Resource State Change (ora.diskmon 1 1) : 0x2aaab00318a0]
    2012-07-03 07:53:17.221: [   CRSPE][1357756736] RI [ora.diskmon 1 1] new external state [OFFLINE] old value: [ONLINE] on node001 label = []
    2012-07-03 07:53:17.221: [   CRSPE][1357756736] RI [ora.diskmon 1 1] new target state: [OFFLINE] old value: [ONLINE]
    2012-07-03 07:53:17.222: [  CRSOCR][1351452992] Multi Write Batch processing...
    2012-07-03 07:53:17.222: [   CRSPE][1357756736] Resource Resource Instance ID[ora.diskmon 1 1]. Values:
    STATE=OFFLINE
    TARGET=OFFLINE
    LAST_SERVER=node001
    CURRENT_RCOUNT=0
    LAST_RESTART=1341294297
    FAILURE_COUNT=0
    FAILURE_HISTORY=
    STATE_DETAILS=
    INCARNATION=2
    STATE_CHANGE_VERS=5
    LAST_FAULT=1341242723
    DEGREE_ID=1
    ID=ora.diskmon 1 1
    CARDINALITY_ID=1
    Lock Info:
    Write Locks:START of [ora.cssd 1 1] on [node001] : 0x2aaab000ba10
    ReadLocks:|STATE INITED| has failed!
    2012-07-03 07:53:17.222: [   CRSPE][1357756736] Processing unplanned state change for [ora.diskmon 1 1]
    2012-07-03 07:53:17.222: [   CRSPE][1357756736] Target is not ONLINE, not recovering [ora.diskmon 1 1]
    2012-07-03 07:53:17.222: [   CRSPE][1357756736] PE Command [ Resource State Change (ora.diskmon 1 1) : 0x2aaab00318a0 ] has completed
    2012-07-03 07:53:17.222: [    AGFW][1347250496] Agfw Proxy Server received the message: CMD_COMPLETED[Proxy] ID 20482:23501
    2012-07-03 07:53:17.222: [    AGFW][1347250496] Agfw Proxy Server replying to the message: CMD_COMPLETED[Proxy] ID 20482:23501
    2012-07-03 07:53:17.223: [    AGFW][1347250496] Agfw received reply from PE for resource state change for ora.diskmon 1 1
    2012-07-03 07:53:17.223: [  CRSOCR][1351452992] Multi Write Batch done.
    2012-07-03 07:54:56.523: [    AGFW][1347250496] Received the reply to the message: RESOURCE_START[ora.cssd 1 1] ID 4098:23242 from the agent /opt/grid/product/11gR2/grid/bin/cssdagent_root
    2012-07-03 07:54:56.523: [    AGFW][1347250496] Agfw Proxy Server sending the reply to PE for message:RESOURCE_START[ora.cssd 1 1] ID 4098:23220
    2012-07-03 07:54:56.524: [   CRSPE][1357756736] Received reply to action [Start] message ID: 23220
    2012-07-03 07:54:56.524: [    AGFW][1347250496] Received the reply to the message: RESOURCE_START[ora.cssd 1 1] ID 4098:23242 from the agent /opt/grid/product/11gR2/grid/bin/cssdagent_root
    2012-07-03 07:54:56.524: [   CRSPE][1357756736]Created alert : (:CRSPE00111:) :  Start action timed out!
    2012-07-03 07:54:56.524: [   CRSPE][1357756736] Start action failed with error code: 3
    2012-07-03 07:54:56.524: [    AGFW][1347250496] Agfw Proxy Server sending the last reply to PE for message:RESOURCE_START[ora.cssd 1 1] ID 4098:23220
    2012-07-03 07:54:56.524: [   CRSPE][1357756736] Received reply to action [Start] message ID: 23220
    2012-07-03 07:54:56.524: [    AGFW][1347250496] Agfw Proxy Server received the message: AGENT_SUICIDE[Proxy] ID 20486:34
    2012-07-03 07:54:56.524: [    AGFW][1347250496] Suicide request received from /opt/grid/product/11gR2/grid/bin/cssdagent_root
    2012-07-03 07:54:56.524: [    AGFW][1347250496] Agfw Proxy Server replying to the message: AGENT_SUICIDE[Proxy] ID 20486:34
    2012-07-03 07:54:56.524: [   CRSPE][1357756736] CRS-2674: Start of 'ora.cssd' on 'node001' failed
    2012-07-03 07:54:56.525: [UiServer][1361959232] Container [ Name: ORDER
         MESSAGE:
         TextMessage[CRS-2674: Start of 'ora.cssd' on 'node001' failed]
         MSGTYPE:
         TextMessage[1]
         OBJID:
         TextMessage[ora.cssd]
         WAIT:
         TextMessage[0]
    2012-07-03 07:54:56.525: [   CRSPE][1357756736] Sending message to agfw: id = 23555
    2012-07-03 07:54:56.525: [   CRSPE][1357756736] CRS-2679: Attempting to clean 'ora.cssd' on 'node001'
    2012-07-03 07:54:56.525: [    AGFW][1347250496] Agfw Proxy Server received the message: RESOURCE_CLEAN[ora.cssd 1 1] ID 4100:23555
    2012-07-03 07:54:56.525: [    AGFW][1347250496] Agent: /opt/grid/product/11gR2/grid/bin/cssdagent with user id root is being stopped. Will be restarted when agent stops completly
    2012-07-03 07:54:56.525: [    AGFW][1347250496] Could not forward message [RESOURCE_CLEAN[ora.cssd 1 1] ID 4100:23555] to agent. /opt/grid/product/11gR2/grid/bin/cssdagent_root is not running
    2012-07-03 07:54:56.525: [    AGFW][1347250496] Can not start Agent: /opt/grid/product/11gR2/grid/bin/cssdagent with user id root is waiting to be restarted.
    2012-07-03 07:54:56.525: [UiServer][1361959232] Container [ Name: ORDER
         MESSAGE:
         TextMessage[CRS-2679: Attempting to clean 'ora.cssd' on 'node001']
         MSGTYPE:
         TextMessage[3]
         OBJID:
         TextMessage[ora.cssd]
         WAIT:
         TextMessage[0]
    2012-07-03 07:55:01.627: [ CRSCOMM][1340946752][FFAIL] Couldnt clscreceive message, no message: 11
    2012-07-03 07:55:01.627: [ CRSCOMM][1340946752] Client disconnected.
    2012-07-03 07:55:01.627: [ CRSCOMM][1340946752][FFAIL] Listener got clsc error 11 for memNum. 14
    2012-07-03 07:55:01.628: [ CRSCOMM][1340946752] IPC listener connection to member 14 has been removed
    2012-07-03 07:55:01.628: [CLSFRAME][1340946752] Removing IPC Member:{Relative|Node:0|Process:14|Type:3}
    2012-07-03 07:55:01.628: [CLSFRAME][1340946752] Disconnected from AGENT process: {Relative|Node:0|Process:14|Type:3}
    2012-07-03 07:55:01.628: [   CRSPE][1357756736] Disconnected from server:
    2012-07-03 07:55:01.628: [    AGFW][1347250496] Agfw Proxy Server received process disconnected notification, count=1
    2012-07-03 07:55:01.628: [    AGFW][1347250496] /opt/grid/product/11gR2/grid/bin/cssdagent_root disconnected.
    2012-07-03 07:55:01.628: [    AGFW][1347250496] Restarting the agent /opt/grid/product/11gR2/grid/bin/cssdagent_root
    2012-07-03 07:55:01.628: [    AGFW][1347250496] Agent /opt/grid/product/11gR2/grid/bin/cssdagent_root[10188] stopped!
    2012-07-03 07:55:01.628: [ CRSCOMM][1347250496] removeConnection: Member 14 does not exist.
    2012-07-03 07:55:01.628: [    AGFW][1347250496] Starting the agent: /opt/grid/product/11gR2/grid/bin/cssdagent with user id: root and incarnation:7
    2012-07-03 07:55:01.632: [    AGFW][1347250496] Starting the HB [Interval =  30000, misscount = 10kill allowed=0] for agent: /opt/grid/product/11gR2/grid/bin/cssdagent_root
    2012-07-03 07:55:01.819: [CLSFRAME][1340946752] New IPC Member:{Relative|Node:0|Process:15|Type:3}:AGENT
    2012-07-03 07:55:01.819: [CLSFRAME][1340946752] New process connected to us ID:{Relative|Node:0|Process:15|Type:3} Info:AGENT
    2012-07-03 07:55:01.837: [    AGFW][1347250496] Agfw Proxy Server received the message: AGENT_HANDSHAKE[Proxy] ID 20484:14
    2012-07-03 07:55:01.837: [    AGFW][1347250496] Agent /opt/grid/product/11gR2/grid/bin/cssdagent_root with pid:10530 connected to server.
    2012-07-03 07:55:01.837: [    AGFW][1347250496] Agfw Proxy Server sending message: RESTYPE_ADD[ora.cssd.type] ID 8196:23591 to the agent /opt/grid/product/11gR2/grid/bin/cssdagent_root
    2012-07-03 07:55:01.838: [    AGFW][1347250496] Agfw Proxy Server sending message: RESOURCE_ADD[ora.cssd 1 1] ID 4356:23593 to the agent /opt/grid/product/11gR2/grid/bin/cssdagent_root
    2012-07-03 07:55:01.838: [    AGFW][1347250496] Agfw Proxy Server forwarding the message: RESOURCE_CLEAN[ora.cssd 1 1] ID 4100:23555 to the agent /opt/grid/product/11gR2/grid/bin/cssdagent_root
    2012-07-03 07:55:01.839: [    AGFW][1347250496] Agfw Proxy Server replying to the message: AGENT_HANDSHAKE[Proxy] ID 20484:14
    2012-07-03 07:55:01.851: [    AGFW][1347250496] Received the reply to the message: RESTYPE_ADD[ora.cssd.type] ID 8196:23591 from the agent /opt/grid/product/11gR2/grid/bin/cssdagent_root
    2012-07-03 07:55:01.854: [    AGFW][1347250496] Received the reply to the message: RESOURCE_ADD[ora.cssd 1 1] ID 4356:23593 from the agent /opt/grid/product/11gR2/grid/bin/cssdagent_root
    2012-07-03 07:55:01.861: [    AGFW][1347250496] Received the reply to the message: RESOURCE_CLEAN[ora.cssd 1 1] ID 4100:23594 from the agent /opt/grid/product/11gR2/grid/bin/cssdagent_root
    2012-07-03 07:55:01.862: [    AGFW][1347250496] Agfw Proxy Server sending the reply to PE for message:RESOURCE_CLEAN[ora.cssd 1 1] ID 4100:23555
    2012-07-03 07:55:01.862: [    AGFW][1347250496] Received the reply to the message: RESOURCE_CLEAN[ora.cssd 1 1] ID 4100:23594 from the agent /opt/grid/product/11gR2/grid/bin/cssdagent_root
    2012-07-03 07:55:01.862: [   CRSPE][1357756736] Received reply to action [Clean] message ID: 23555
    2012-07-03 07:55:01.862: [    AGFW][1347250496] Agfw Proxy Server sending the last reply to PE for message:RESOURCE_CLEAN[ora.cssd 1 1] ID 4100:23555
    2012-07-03 07:55:01.863: [    AGFW][1347250496] Agfw Proxy Server received the message: AGENT_SUICIDE[Proxy] ID 20486:34
    2012-07-03 07:55:01.863: [   CRSPE][1357756736] Received reply to action [Clean] message ID: 23555
    2012-07-03 07:55:01.863: [    AGFW][1347250496] Suicide request received from /opt/grid/product/11gR2/grid/bin/cssdagent_root
    2012-07-03 07:55:01.863: [    AGFW][1347250496] Agfw Proxy Server replying to the message: AGENT_SUICIDE[Proxy] ID 20486:34
    2012-07-03 07:55:01.863: [   CRSPE][1357756736] CRS-2681: Clean of 'ora.cssd' on 'node001' succeeded
    2012-07-03 07:55:01.863: [   CRSPE][1357756736] Sequencer for [ora.cssd 1 1] has completed with error: CRS-0215: Could not start resource 'ora.cssd'.
    2012-07-03 07:55:01.863: [UiServer][1361959232] Container [ Name: ORDER
         MESSAGE:
         TextMessage[CRS-2681: Clean of 'ora.cssd' on 'node001' succeeded]
         MSGTYPE:
         TextMessage[3]
         OBJID:
         TextMessage[ora.cssd]
         WAIT:
         TextMessage[0]
    2012-07-03 07:55:01.864: [   CRSPE][1357756736] PE Command [ Start Resource : 0x2aaab0009d00 ] has completed
    2012-07-03 07:55:01.864: [    AGFW][1347250496] Agfw Proxy Server received the message: CMD_COMPLETED[Proxy] ID 20482:23606
    2012-07-03 07:55:01.864: [   CRSPE][1357756736] UI Command [Start Resource : 0x2aaab0009d00] is replying to sender.
    2012-07-03 07:55:01.864: [    AGFW][1347250496] Agfw Proxy Server replying to the message: CMD_COMPLETED[Proxy] ID 20482:23606
    2012-07-03 07:55:01.864: [UiServer][1361959232] Container [ Name: UI_DATA
         ora.cssd:
         TextMessage[215]
    2012-07-03 07:55:01.864: [UiServer][1361959232] Done for ctx=0x2aaab004ece0
    2012-07-03 07:55:01.869: [UiServer][1364060480] Closed: remote end failed/disc.
    2012-07-03 07:55:03.791: [ CRSCOMM][1340946752][FFAIL] Couldnt clscreceive message, no message: 11
    2012-07-03 07:55:03.791: [ CRSCOMM][1340946752] Client disconnected.
    2012-07-03 07:55:03.791: [ CRSCOMM][1340946752][FFAIL] Listener got clsc error 11 for memNum. 15
    2012-07-03 07:55:03.791: [ CRSCOMM][1340946752] IPC listener connection to member 15 has been removed
    2012-07-03 07:55:03.791: [CLSFRAME][1340946752] Removing IPC Member:{Relative|Node:0|Process:15|Type:3}
    2012-07-03 07:55:03.791: [CLSFRAME][1340946752] Disconnected from AGENT process: {Relative|Node:0|Process:15|Type:3}
    2012-07-03 07:55:03.792: [   CRSPE][1357756736] Disconnected from server:
    2012-07-03 07:55:03.792: [    AGFW][1347250496] Agfw Proxy Server received process disconnected notification, count=1
    2012-07-03 07:55:03.792: [    AGFW][1347250496] /opt/grid/product/11gR2/grid/bin/cssdagent_root disconnected.
    2012-07-03 07:55:03.792: [    AGFW][1347250496] Agent /opt/grid/product/11gR2/grid/bin/cssdagent_root[10530] stopped!
    2012-07-03 07:55:03.792: [ CRSCOMM][1347250496] removeConnection: Member 15 does not exist.

Maybe you are looking for

  • Advice over Statspack Report

    Hi Guru's My DB Version:10.2.0.1.0 OS Version: Windows I want all your experienced advice over my statspack report,regarding the values of Load profile - Hard Parses,executions,transactions Instance Efficiency percentages: Soft Parse,Buffer Hit,Libra

  • I am planing to format my hard disk on my PC.

    I am planing to format my hard disk on my PC . I would like to know the needed preparation to sync my ipod again without losing my saved data.

  • Need to add 2 columns in query

    Hello, I have a query that I need to add 2 of the columns together, but I have been unsuccessful in my attempts to this point. I'm using Oracle SQL Developer 1.2.1 Here is the query: WITH group_by_4_column_results AS (SELECT m_atschunk.employee AS em

  • No option to install after right click on HV________.PFB font in Windows 8 64 bit

    I'm trying to install Helvetica on Windows 8.1 64 bit, every forum i read tells me to just right click on the font and hit the install...simple. Well when i right click i don't get the option to install, any ideas??

  • How to remove windows read only bit ( on  a mac)

    Before I bought my mac, I copied my files from my old windows machine to the mac. Now I cannot move or rename or delete these files. I have found out that windows puts a read only bit to all files which the windows explorer ignores. It seems possible