Services not starting after a node crash

hi
We have a 3 node cluster and one of the nodes crashed today, also the services did not get relocated to the other node and when we try to manullay stop/start/relocate the service we get the following error
srvctl stop service -d BCB -s BCB_J2EE -f
PRCD-1085 : Failed to stop service BCB_J2EE
PRCR-1065 : Failed to stop resource ora.BCB.BCB_j2ee.svc
CRS-2533: Server 'bcb528' is down. Unable to perform the operation on 'ora.BCB.BCB_j2ee.svc'
Would anyone has seen this before
Thx
JJ

this is what i can find in log
[   CRSPE][60] Server [bcb528] is unreachable. Stopping the sequencer for: bcbCRON 1 1
2011-02-28 08:15:21.778: [   CRSPE][60] Sequencer for [bcbCRON 1 1] has completed with error: CRS-2533: Server 'bcb528' is down. Unable to pe
rform the operation on 'bcbCRON'
2011-02-28 08:15:21.778: [   CRSPE][60] Required instruction failed in op: START of [bcbCRON 1 1] on [bcb529] : 105247290
2011-02-28 08:15:21.781: [UiServer][62] Container [ Name: ORDER
MESSAGE:
TextMessage[CRS-2533: Server 'bcb528' is down. Unable to perform the operation on 'bcbCRON']
MSGTYPE:
TextMessage[1]
OBJID:
TextMessage[bcbCRON 1 1]
WAIT:
TextMessage[0]

Similar Messages

  • Oracle and Instance Service Not Starting After Win2K Service Pack 4 Install

    Please help
    We are running Oracle 8.1.6 on Windows 2000 Server and everything ran fine. Our Network Admin installed Windows service pack 4 and now after a reboot we have to manually go in and start Oracle because it does not start automaticially.
    I've looked everywhere and cannot find any documented resolution to this problem.
    Regards,
    Andy

    If you completely patched your server then it might be related to the problems some of us are experiencing with a certain MS patch. Check this thread for more details:
    ORACLE NOT AVAILABLE..ORA 01034

  • HP dv3-2000 audio service not start after i run uniblue powersuite. event log says can't find path.

    after i run uniblue powersuite to clean up my registry, speedup my pc and update my drivers, I cannot start my dv3-2000 laptop. After I updated the BIOS, following the suggestion on the forum, I can get the vista start but no sound. I then checked the event log which says the audio service cannot start because it can't find the path specified. How can I solve this problem?

    If the printer is connected USB to the Windows 7 machine, what you can do is share it to the network (assuming the XP computer is also connected to the same network). This way the XP machine can see the printer on the Windows 7 computer and install it. The only drawback is that the Windows 7 computer will need to be powered on for the XP computer to be able to see and print to it. I have linked a third party site below for instructions on how to do this.
    http://www.howtogeek.com/howto/windows-7/share-fil​es-and-printers-between-windows-7-and-xp/
    Binary_Zen (worked at HP )
    Click the white Kudos star to say thanks
    Please mark Accept As Solution if it solves your problem

  • Listener service not starting after installation (10g on WinXP)

    Hi!
    I installed 10.2.0.1 on a Windows XP machine, but for some reason the listener service does not start up. If I start the service from the Windows service control panel I get:
    The service "OracleOraDB10g_home1TNSListener" on "Local Computer" could not be started. Error 3: The system could not find the specified path."
    The path for the servicing exe is "G:\oracle\product\10.2.0\db_1\BIN\TNSLSNR", which is the correct path.
    Executing "lsnrctl status" I get:
    {code}
    LSNRCTL for 32-bit Windows: Version 10.2.0.1.0 - Production on 27-MAI-2009 09:53:37
    Copyright (c) 1991, 2005, Oracle. All rights reserved.
    Anmeldung bei (DESCRIPTION=(ADDRESS=(PROTOCOL=TCP)(HOST=xpdeveloper)(PORT=1521)))
    TNS-12541: TNS: No Listener
    TNS-12560: TNS: Error with protocol adapter
    TNS-00511: No Listener
    32-bit Windows Error: 61: Unknown error
    {code}
    Executing "lsnrctl start" I get:
    {code}
    LSNRCTL for 32-bit Windows: Version 10.2.0.1.0 - Production on 27-MAI-2009 10:02:10
    Copyright (c) 1991, 2005, Oracle. All rights reserved.
    tnslsnr is getting started: Please wait...
    Failed to start service, error 3.
    TNS-12560: TNS: Error with protocol adapter
    TNS-00530: Error with protocol adapter
    {code}
    When I open a another command shell and run the servicing exe "G:\oracle\product\10.2.0\db_1\BIN\TNSLSNR" directly and executing "lsnrctl status" I get:
    {code}
    LSNRCTL for 32-bit Windows: Version 10.2.0.1.0 - Production on 27-MAI-2009 10:10:27
    Copyright (c) 1991, 2005, Oracle. All rights reserved.
    Anmeldung bei (DESCRIPTION=(ADDRESS=(PROTOCOL=TCP)(HOST=xpdeveloper)(PORT=1521)))
    STATUS des LISTENER
    Alias LISTENER
    Version TNSLSNR for 32-bit Windows: Version 10.2.0.1.0 - Produ
    ction
    Startdatum 27-MAI-2009 10:10:17
    Uptime 0 Tage 0 Std. 0 Min. 10 Sek.
    Trace-Ebene off
    Sicherheit ON: Local OS Authentication
    SNMP OFF
    Parameterdatei des Listener G:\oracle\product\10.2.0\db_1\network\admin\listener.ora
    Log-Datei des Listener G:\oracle\product\10.2.0\db_1\network\log\listener.log
    Zusammenfassung Listening-Endpunkte...
    (DESCRIPTION=(ADDRESS=(PROTOCOL=tcp)(HOST=xpdeveloper)(PORT=1521)))
    Der Listener unterst³tzt keine Services
    Der Befehl wurde erfolgreich ausgef³hrt.
    {code}
    I can also successfully tnsping the listener.
    Any ideas why the listener service fails to start?
    Thanks a lot for your help,
    Marcus

    Hi Florian,
    my understanding was that on Windows ORACLE_HOME is stored in the registry.
    I have a correct path to my Oracle home directory under "HKLM\Software\Oracle\KEY_OraDB10g_home1\ORACLE_HOME".
    Following your suggestion, I added a Windows environment variable "ORACLE_HOME" that points to the Oracle home directory, rebooted and tried to start the service again, but nothing changed.
    Marcus

  • Notebook does not start after BIOS Update crash

    Hi all,
    I just want to ask whether is a chance to reactivate my Satellite A300 after a BISO update crash without send it to the Toshiba service.
    I downloaded the new BISO and started it from the Windows menu. After a few seconds my PC crashed and everything was frozen.
    I switched off the PC.
    Now when I press the power button to start the Notebook the monitor is black and I can hear a sound brrr, brrr, brrr from the CD-Rom drive.
    Do you think it is possible to boot from a CD or something like that. Is it possible to reactivate my notebook?
    Your help would be really appreciated!
    Thanks a lot
    Best regards,
    Chotte

    Sorry but if the BIOS chip is damaged there is no much you can do about it. You must contact authorized Toshiba service provider.

  • Exchange replication service not starting after installing Rollup update 3 v3

    Hi,
    I have installed rollup update 3 v3 for exchange 2010 sp1 on my mailbox server. This mailbox server is a DAG member. After installing update rollup, Microsoft exchange replication service on this server attempts to start & show status started for couple
    of seconds & then gets stopped. This behaviuor continues untill i uninstall this rollup. I have installed the same rollup on other DAG member as well with no problem. The following errors are generated in the application logs,
    Event ID 4096: The Microsoft Exchange Replication service failed to start the Tcp Listener. Please review the Event Log for more information. The system will attempt to start the service again in 30 seconds.
    Event ID 2121: The Microsoft Exchange Replication service failed to start the TCP listener. Error: System.Net.Sockets.SocketException: Only one usage of each socket address (protocol/network address/port) is normally permitted
    at System.Net.Sockets.Socket.DoBind(EndPoint endPointSnapshot, SocketAddress socketAddress)
    at System.Net.Sockets.Socket.Bind(EndPoint localEP)
    at Microsoft.Exchange.Cluster.Replay.TcpListener.StartListening()
    Event ID 4999:
    Watson report about to be sent for process id: 6000, with parameters: E12, c-RTL-AMD64, 14.01.0289.001, msexchangerepl, M.E.Cluster.Replay, M.E.C.R.ReplicaInstance.TargetGetCopyStatus, System.MethodAccessException, a379, 14.01.0289.001.
    ErrorReportingEnabled: True
    Event ID 2060: The Microsoft Exchange Replication service encountered a transient error while attempting to start a replication instance for DB1\SRV-MBX2. The copy will be set to failed. Error:
    The NetworkManager has not yet been initialized. Check the event logs to determine the cause.
    Event ID 2060:
    The Microsoft Exchange Replication service encountered a transient error while attempting to start a replication instance for DB2\SRV-MBX2. The copy will be set to failed. Error: The NetworkManager has not yet been initialized.
    Check the event logs to determine the cause.
    Thanks
    in Advance!!

    I hope you are following the best practice to install rollup on DAG. 
    Suspend activation for the databases on the server being updated.
    Perform a server switchover so that all databases on the server are passive copies. There will be a brief interruption in service for the mailboxes hosted on the active databases during the switchover process.
    Install the update rollup.
    Resume activation for the databases on the updated server.
    Perform database switchovers as needed.
    http://blogs.technet.com/b/scottschnoll/archive/2009/12/10/installing-update-rollup-1-for-exchange-2010-on-dag-members.aspx
    Thanks Uday Kiran,
    Senior Consultant
    Cyquent Technology Consultants, Dubai
    Please Mark as answer if it helps you

  • Application Services Not Starting After Oracle Apps 11i Clone

    Hi All,
    Can any one help me out on this ........
    EBS: 11.5.9
    Database: 9.2.0.3.0
    After the cloning oracle Application Apache, Concurrent managers and other services are up and running perfectly but my forms and reports services are not coming up.
    It is showing time out when i tried to start the services. Please find the below
    Executing service control script:
    /disk1/oracle/dev1comn/admin/scripts/dev1_dataprepdev1/adfrmctl.sh start
    script returned:
    ERROR : Timed out: Interrupted Exception
    Command line may not be valid
    Executing service control script:
    /disk1/oracle/dev1comn/admin/scripts/dev1_dataprepdev1/adrepctl.sh start
    script returned:
    ERROR : Timed out: Interrupted Exception
    Command line may not be valid
    Executing service control script:
    /disk1/oracle/dev1comn/admin/scripts/dev1_dataprepdev1/adfmcctl.sh start
    script returned:
    ERROR : Timed out: Interrupted Exception
    Command line may not be valid
    Executing service control script:
    /disk1/oracle/dev1comn/admin/scripts/dev1_dataprepdev1/adfmsctl.sh start
    script returned:
    ERROR : Timed out: Interrupted Exception
    Command line may not be valid
    Thanks in advance...
    Sai

    976630 wrote:
    Hi Sir,
    The Issue get resolved
    i checked the dbc file and xml file for the password of Guest user it is same...
    But it is not default ORACLE. Checked in dbc , xml and fnd_user table. Changed it to default ORACLE in xml file and ran the adautocfg.sh
    The issue get resolved. Thanks for your help.Thanks for the update and for sharing the solution!
    Regards,
    Hussein

  • OBIEE 11.1.1.5 presentation service not started  after fresh installtion

    hi all,
    we have installing OBIEE 11.1.1.5 64bit in AIX machine. after fresh installation all the services are up and running.
    once we restart the OPMN services, all the services are up except presentation service..
    System Environment:
    OS : AIX 7.1 TL03 64bit
    OBIEE : OBIEE11.1.1.5 64bit
    Installation type : Enterprise
    DB : 11gR2
    kindly guide us to find out the root cause..
    thanks in advance.

    hi ,
    thanks for quick reply...
    we have already done what u suggest and reinstall whole OBIEE include DB also ...but still we are facing this issue..
    any other ways to start presentation service....
    Edited by: 855349 on Jul 1, 2011 4:12 AM
    Edited by: 855349 on Jul 1, 2011 4:12 AM

  • Services not starting after upgrading the secondary acs 4.0.1

    Hi
    I upgraded 2 ACS ver 3.3.2 servers to ver 4.0.1 the upgrade worked perfectly fine but when I restarted the secondary acs, the ACS services are on starting status and CSlogs service shows stopping.
    any idea why?
    thanks in advance.

    Hi,
    Seems link hitting CSCsc95237. You can check following link for further information.
    http://www.cisco.com/cgi-bin/Support/Bugtool/onebug.pl?bugid=CSCsc95237&Submit=Search
    -Parm

  • Why does it say can not open  iphone mobile device service not started after the udate fixes?

    can someone please help after i update my soft ware to fix sum bug issues now when i hook up my iphone to my laptop it say can not open iphone mobile device is not started

    Check the links listed in the More Like This box on the right of this window.

  • IPod service manager will not start after installing iTunes 10

    iPod service manger will not start after loading iTunes 10. iPhone will not connect. I've removed reinstalled, wiped the registry reinstalled and deauthorized, removed and reinstalled from several different downloads. I have full permissions fo rservices and am administrator.. We now have three other units in teh office with the same issue.
    now what do I do?

    Don't know about fixing PitStop. However, have you tried a simple repair on Acrobat. If Acrobat won't open you can do that from the Programs and Features menu (Add/Remove Programs in OS prior to Win7).

  • SQL Cluster services is not start in secound node.

    SQL Cluster services is not start in secound node.

    Start or Stop the Cluster Service on a Cluster Node
    https://technet.microsoft.com/en-us/library/cc771742.aspx
    Ahsan Kabir Please remember to click Mark as Answer and Vote as Helpful on posts that help you. This can be beneficial to other community members reading the thread. http://www.aktechforum.blogspot.com/

  • RAC does not start after trying to move storage

    Hello,
    We have a two nodes RAC Oracle 10g and ASM groups defined on one external storage.
    RAC does not start after we reformated the storage to RAID 10.
    What we did:
    1) deleted the database
    2) reformated the external storage to RAID 10 and defined needed volumes for OCR, VotingDisk and ASM
    3) on both nodes
    - recreated VotingDisk
    node1:root$ /u01/oracle/product/10gr2/crs/bin/crsctl add css votedisk /dev/rdsk/c0t600A0B8000347E7D00000EE74A5AF386d0s3 -force
    Now formatting voting disk: /dev/rdsk/c0t600A0B8000347E7D00000EE74A5AF386d0s3
    successful addition of votedisk /dev/rdsk/c0t600A0B8000347E7D00000EE74A5AF386d0s3.
    node2:root$ /u01/oracle/product/10gr2/crs/bin/crsctl add css votedisk /dev/rdsk/c0t600A0B8000347E7D00000EE74A5AF386d0s3 -force
    Now formatting voting disk: /dev/rdsk/c0t600A0B8000347E7D00000EE74A5AF386d0s3
    successful addition of votedisk /dev/rdsk/c0t600A0B8000347E7D00000EE74A5AF386d0s3.
    - tried to move OCR but was able only on one node:
    /u01/oracle/product/10gr2/crs/bin/ocrconfig -replace ocrmirror /dev/rdsk/c7t30d0s3
    /u01/oracle/product/10gr2/crs/bin/ocrconfig -replace ocr /dev/rdsk/c7t29d0s3
    /u01/oracle/product/10gr2/crs/bin/ocrconfig -replace ocr
    These return ok for both node1 and node2:
    node1:oracle$ cluvfy stage -post hwos -n node1
    node1:oracle$ cluvfy stage -post crsinst -n node1,node2 -verbose
    Performing post-checks for cluster services setup
    Checking node reachability...
    Check: Node reachability from node "node1"
    Destination Node                      Reachable?
    node1                                 yes
    node2                                 yes
    Result: Node reachability check passed from node "node1".
    Checking user equivalence...
    Check: User equivalence for user "oracle"
    Node Name                             Comment
    node2                                 passed
    node1                                 passed
    Result: User equivalence check passed for user "oracle".
    Checking Cluster manager integrity...
    Checking CSS daemon...
    Node Name                             Status
    node2                                 not running
    node1                                 not running
    Result: Daemon status check failed for "CSS daemon".
    Cluster manager integrity check failed.
    Checking cluster integrity...
    Cluster is divided into 2 partitions.
    Partition 1 consists of the following members:
    Node Name
    node1
    Partition 2 consists of the following members:
    Node Name
    node1
    node2
    Cluster integrity check failed. Cluster is divided into 2 partition(s).
    Checking OCR integrity...
    Checking the absence of a non-clustered configuration...
    WARNING:
    CSS is probably working with a non-clustered, local-only configuration on nodes:
    node1
    Verification will proceed with nodes:
    node2
    Uniqueness check for OCR device passed.
    Checking the version of OCR...
    OCR of correct Version "2" exists.
    Checking data integrity of OCR...
    Data integrity check for OCR passed.
    OCR integrity check failed.
    Checking CRS integrity...
    Checking daemon liveness...
    Check: Liveness for "CRS daemon"
    Node Name                             Running
    node2                                 no
    node1                                 yes
    Result: Liveness check failed for "CRS daemon".
    Checking daemon liveness...
    Check: Liveness for "CSS daemon"
    Node Name                             Running
    node2                                 no
    node1                                 no
    Result: Liveness check failed for "CSS daemon".
    Checking daemon liveness...
    Check: Liveness for "EVM daemon"
    Node Name                             Running
    node2                                 no
    node1                                 yes
    Result: Liveness check failed for "EVM daemon".
    Liveness of all the daemons
    Node Name     CRS daemon                CSS daemon                EVM daemon
    node2         no                        no                        no
    node1         yes                       no                        yes
    Checking CRS health...
    Check: Health of CRS
    Node Name                             CRS OK?
    node1                                 unknown
    Result: CRS health check failed.
    CRS integrity check failed.
    Post-check for cluster services setup was unsuccessful on all the nodes.
    Please help.

    Thanks for the answer.
    Problem is that the RAC is not healty, I know how to start it but now it doesn't start and I cannot find helpful logs.
    You can see that cluster is not healty from cluvfy output.
    When I tried to start crs whith crsctl start crs but:
    - on node2 none of the demons starts (CSS, CRS or EVM)
    - on node1 CSS and EVM demons start but CRS is not starting and I cannot find helpful logs
    Problem 2: Cannot change OCR location
    node2:root$ cat /var/opt/oracle/ocr.loc
    +#Device/file /dev/rdsk/c7t30d0s3 getting replaced by device /dev/rdsk/c7t30d0s3+
    ocrconfig_loc=/dev/rdsk/c7t30d0s3
    local_only=falsenode2:root$ ocrconfig -replace ocr /dev/rdsk/c0t600A0B8000347EAD00000F314A5AF5B8d0s3
    PROT-1: Failed to initialize ocrconfig
    node1:root$ cat /var/opt/oracle/ocr.loc
    ocrconfig_loc=/u01/oracle/product/10gr2/db/cdata/localhost/local.ocr
    local_only=TRUE
    node1:root$ ocrconfig -replace ocr /dev/rdsk/c0t600A0B8000347EAD00000F314A5AF5B8d0s3
    PROT-1: Failed to initialize ocrconfig
    Problem 3: On node 1 I wrongly issued a command
    node1:root$ /u01/oracle/product/10gr2/db/bin/localconfig reset
    Successfully accumulated necessary OCR keys.
    Creating OCR keys for user 'root', privgrp 'root'..
    Operation successful.
    Configuration for local CSS has been initialized
    Adding to inittab
    Startup will be queued to init within 30 seconds.
    Checking the status of new Oracle init process...
    Expecting the CRS daemons to be up within 600 seconds.
    Giving up: Oracle CSS stack appears NOT to be running.
    Oracle CSS service would not start as installed
    Automatic Storage Management(ASM) cannot be used until Oracle CSS service is started

  • SAP Service Not Starting in BI 7.0

    Hi All,
    Today morning my BI 7.0 server restarted twice automatically, then I started the server in last known good configuration after that when I tried to start the server from SAP MMC it didn't started and when i checked the sap service in services.msc it gives error <b>"Some services stop automatically when they have no work to do"</b>.and didn't get started.
    I found a thread similiar to this problem and following that I used sapstartsrv.exe in usr\sap\SID\......\exe directory. This didn't worked for me and by using this Both the services SAPEP2_00 and SAPEP2_01 got removed from services.msc.
    Now I have installed these service again and now I am at same status as in morning,
    In Event log
    For SAPEP2_00 and SAPEP2_01 the following error are avaliable:
    --Initialization failed. Service not started. [ntservmain.cpp 1269]
    --Unable to change to Directory
    gms40\saploc\EP2\DVEBMGS00\work. (Error 53 ERROR_BAD_NETPATH: The network path was not found. ) [ntservstart.cpp 966]
    If any one have gone through such situation please help me out from this, Its has became too critical for me now.
    Thanks in advance....
    Regards
    Vinay Paul

    Hi
    Service are started now but when I am trying to start the server, it is showing strdbs.cmd, sapcpe.exe in red status "could not be started".
    Regards
    Vinay Paul
    Message was edited by:
            Vinay Paul

  • Firefox will not start after I upgraded from Ubuntu 8.04 to Ubuntu 10.04.

    I was using Firefox without issue on Ubuntu 8.04. I then upgraded to Ubuntu 10.04. Firefox would not start after upgrade. Message said it was already running!
    I checked the System Monitor and saw it was "sleeping". I ended process. Firefox then would start, however..... I always have to go into System Monitor before I start Firefox to stop it from running (sleeping) even if I already just quit the program or after a fresh reboot.
    I do not use a firewall or virus program.
    My router has some sort of firewall hardware, and it is the same router I used with 8.04 with no problem.
    What is going on? Why is the program sleeping when I try to start it. Why do I always get the message that it is already running (and I have to shut it down) before I can start it.
    It is either a Ubuntu problem or a Firefox problem.
    Sonny.

    ''Crashes at startup can occur in Firefox 7 or above (but not Firefox 6 or earlier) if you are using a corporate login system such as IBM Tivoli Access Manager or Oracle Enterprise Single Sign On Manager ([https://bugzilla.mozilla.org/show_bug.cgi?id=680927 bug 680927]). '''See the bug report for a suggested workaround''' or downgrade to Firefox 3.6.xx (available [http://www.mozilla.org/firefox/all-older.html here]) which is still being maintained.''
    Ref: http://kb.mozillazine.org/Firefox_crashes#Crash_when_starting_Firefox
    The workaround for the crash is linked [https://bugzilla.mozilla.org/attachment.cgi?id=563484 HERE], under "Attachments" in the bug report. When you click that link it will show the contents of the .reg file (you can save the page as "ff7fix.reg" on your computer, and then merge it into the Windows registry, f you are comfortable doing that).

Maybe you are looking for

  • Data source CFMXBible.mdb could not be found.

    Hello I am following the book CFMXBible and I got it set up. but in the beginning of the tutorial there is a form that is suppose to sent the contents of my form to the db. After I press the submit button, I get this error' What is wrong here? What s

  • HP Laserjet toner 36A

    Hi, My printer has stopped working and I still have two boxes of HP Laserjet toner that have not been open, I was wondering if there was anyway of selling them or returning them to HP. It would be such a waste to throw them away, I just wanted to see

  • TOTAL NOOB!

    I've got a sweet flash template whose content I need to change - contact addy, some pictures, etc. Just five simple pages but I don't even know how to load the swf file in order to edit it! I just downloaded the 30 day trial of CS3 Flash Pro to see i

  • ACL Missing message in Disk Utility

    I changed my main HD on my MacPro and used Disk Utility to copy my System "Macintosh HD" to the new disk. Everything seems OK, I can start up, but when I did a "verify permissions" on the "new" system disk I get many "ACL missing on "System/Library/U

  • Can't add group contacts in ipad mail

    using g mail --I can compose an email using a buddy group. When I sync my ipad and use mail that group of buddy contact won't show up. what gives ken