He cluster resource host subsystem (RHS) stopped unexpectedly

i m getting following error on a daily at night , my all services got restarted.... Pls help 
Running windows 2008 r2 Enterprise 
The cluster resource host subsystem (RHS) stopped unexpectedly. An attempt will be made to restart it. This is usually due to a problem in a resource DLL. Please determine which resource DLL is causing the issue and report the problem to the resource vendor. 

Hi,
this hotfix contains the latest clusres.dll. Can you try it?
http://support.microsoft.com/kb/2854082
and check this list:
http://social.technet.microsoft.com/wiki/contents/articles/2008.list-of-cluster-hotfixes-for-windows-server-2008-r2.aspx
http://OpsMgr.ru/

Similar Messages

  • Resource Hosting Subsystem process crashes from KERNELBASE.dll

    Hi,
    I have 2 2013 Exchange servers in a DAG configuration. The passive member (I'll refer to it as EX02) is experiencing an issue where the Cluster Service crashes almost immediately after it is started. I've experienced this with this particular DAG before
    and ultimately ended up rebuilding the entire DAG from scratch to fix the issue, however it seems to have returned and now need a root cause analysis and fix. I've attached 4 Event Logs that have allowed me to drill down to the problem component but am at
    a loss on how to proceed next.  Initially, when checking the cluster using Failover Cluster Manager, the EX02 node goes back and forth between "Joining" and "Down". This is a result of the Cluster Service constantly crashing and restarting
    since it is set to auto restart after an unexpected termination.  
    Looking at the 1146 Event ID, I saw this points to the Resource Hosting Subsystem as part of the issue and that this process experienced an issue with a .dll it's using.  I then discovered this was the KERNELBASE.dll via the various other log entries
    I've included below. I haven't been able to find anyone else that's ran into this particular scenario and am not sure what needs to be done to correct this behavior. If anyone has any insight to this issue, it would be greatly appreciated. If any additional
    information is needed from me, please let me know as well. 
     Log Name:      System
    Source:        Microsoft-Windows-FailoverClustering
    Date:          3/3/2015 2:34:59 PM
    Event ID:      1146
    Task Category: Resource Control Manager
    Level:         Critical
    Keywords:      
    User:          SYSTEM
    Computer:      ****-EX02.****.com
    Description:
    The cluster Resource Hosting Subsystem (RHS) process was terminated and will be restarted. This is typically associated with cluster health detection and recovery of a resource. Refer to the System event log to determine which resource and resource DLL is causing the issue.
    Event Xml:
    <Event xmlns="http://schemas.microsoft.com/win/2004/08/events/event">
      <System>
        <Provider Name="Microsoft-Windows-FailoverClustering" Guid="{BAF908EA-3421-4CA9-9B84-6689B8C6F85F}" />
        <EventID>1146</EventID>
        <Version>0</Version>
        <Level>1</Level>
        <Task>3</Task>
        <Opcode>0</Opcode>
        <Keywords>0x8000000000000000</Keywords>
        <TimeCreated SystemTime="2015-03-03T20:34:59.261068900Z" />
        <EventRecordID>286364</EventRecordID>
        <Correlation />
        <Execution ProcessID="4716" ThreadID="4996" />
        <Channel>System</Channel>
        <Computer>****-EX02.****.com</Computer>
        <Security UserID="S-1-5-18" />
      </System>
      <EventData>
        <Data Name="NodeName">****-EX02</Data>
      </EventData>
    </Event>    
    Log Name:      Application
    Source:        Application Error
    Date:          3/3/2015 2:36:13 PM
    Event ID:      1000
    Task Category: (100)
    Level:         Error
    Keywords:      Classic
    User:          N/A
    Computer:      ****-EX02.****.com
    Description:
    Faulting application name: clussvc.exe, version: 6.3.9600.17396, time stamp: 0x5434db7b
    Faulting module name: KERNELBASE.dll, version: 6.3.9600.17415, time stamp: 0x54505737
    Exception code: 0x80000003
    Fault offset: 0x00000000000de002
    Faulting process id: 0x31c8
    Faulting application start time: 0x01d055f1a860f6f2
    Faulting application path: C:\Windows\Cluster\clussvc.exe
    Faulting module path: C:\Windows\system32\KERNELBASE.dll
    Report Id: ee64313c-c1e4-11e4-80da-005056010d14
    Faulting package full name: 
    Faulting package-relative application ID: 
    Event Xml:
    <Event xmlns="http://schemas.microsoft.com/win/2004/08/events/event">
      <System>
        <Provider Name="Application Error" />
        <EventID Qualifiers="0">1000</EventID>
        <Level>2</Level>
        <Task>100</Task>
        <Keywords>0x80000000000000</Keywords>
        <TimeCreated SystemTime="2015-03-03T20:36:13.000000000Z" />
        <EventRecordID>264219</EventRecordID>
        <Channel>Application</Channel>
        <Computer>****-EX02.****.com</Computer>
        <Security />
      </System>
      <EventData>
        <Data>clussvc.exe</Data>
        <Data>6.3.9600.17396</Data>
        <Data>5434db7b</Data>
        <Data>KERNELBASE.dll</Data>
        <Data>6.3.9600.17415</Data>
        <Data>54505737</Data>
        <Data>80000003</Data>
        <Data>00000000000de002</Data>
        <Data>31c8</Data>
        <Data>01d055f1a860f6f2</Data>
        <Data>C:\Windows\Cluster\clussvc.exe</Data>
        <Data>C:\Windows\system32\KERNELBASE.dll</Data>
        <Data>ee64313c-c1e4-11e4-80da-005056010d14</Data>
        <Data>
        </Data>
        <Data>
        </Data>
      </EventData>
    </Event>
    Log Name:      Application
    Source:        Windows Error Reporting
    Date:          3/3/2015 2:36:14 PM
    Event ID:      1001
    Task Category: None
    Level:         Information
    Keywords:      Classic
    User:          N/A
    Computer:      ****-EX02.****.com
    Description:
    Fault bucket , type 0
    Event Name: APPCRASH
    Response: Not available
    Cab Id: 0
    Problem signature:
    P1: clussvc.exe
    P2: 6.3.9600.17396
    P3: 5434db7b
    P4: KERNELBASE.dll
    P5: 6.3.9600.17415
    P6: 54505737
    P7: 80000003
    P8: 00000000000de002
    P9: 
    P10: 
    Attached files:
    These files may be available here:
    C:\ProgramData\Microsoft\Windows\WER\ReportQueue\AppCrash_clussvc.exe_fcdf2bbcddca922c916880dbb49ce3cd5175efef_f6feed2e_3a22d925
    Analysis symbol: 
    Rechecking for solution: 0
    Report Id: ee64313c-c1e4-11e4-80da-005056010d14
    Report Status: 4100
    Hashed bucket: 
    Event Xml:
    <Event xmlns="http://schemas.microsoft.com/win/2004/08/events/event">
      <System>
        <Provider Name="Windows Error Reporting" />
        <EventID Qualifiers="0">1001</EventID>
        <Level>4</Level>
        <Task>0</Task>
        <Keywords>0x80000000000000</Keywords>
        <TimeCreated SystemTime="2015-03-03T20:36:14.000000000Z" />
        <EventRecordID>264220</EventRecordID>
        <Channel>Application</Channel>
        <Computer>****-EX02.****.com</Computer>
        <Security />
      </System>
      <EventData>
        <Data>
        </Data>
        <Data>0</Data>
        <Data>APPCRASH</Data>
        <Data>Not available</Data>
        <Data>0</Data>
        <Data>clussvc.exe</Data>
        <Data>6.3.9600.17396</Data>
        <Data>5434db7b</Data>
        <Data>KERNELBASE.dll</Data>
        <Data>6.3.9600.17415</Data>
        <Data>54505737</Data>
        <Data>80000003</Data>
        <Data>00000000000de002</Data>
        <Data>
        </Data>
        <Data>
        </Data>
        <Data>
        </Data>
        <Data>C:\ProgramData\Microsoft\Windows\WER\ReportQueue\AppCrash_clussvc.exe_fcdf2bbcddca922c916880dbb49ce3cd5175efef_f6feed2e_3a22d925</Data>
        <Data>
        </Data>
        <Data>0</Data>
        <Data>ee64313c-c1e4-11e4-80da-005056010d14</Data>
        <Data>4100</Data>
        <Data>
        </Data>
      </EventData>
    </Event>
    Version=1
    EventType=APPCRASH
    EventTime=130698881964369580
    ReportType=2
    Consent=1
    ReportIdentifier=0d8e824c-c1e4-11e4-80da-005056010d14
    IntegratorReportIdentifier=0d8e824b-c1e4-11e4-80da-005056010d14
    NsAppName=clussvc.exe
    Response.type=4
    Sig[0].Name=Application Name
    Sig[0].Value=clussvc.exe
    Sig[1].Name=Application Version
    Sig[1].Value=6.3.9600.17396
    Sig[2].Name=Application Timestamp
    Sig[2].Value=5434db7b
    Sig[3].Name=Fault Module Name
    Sig[3].Value=KERNELBASE.dll
    Sig[4].Name=Fault Module Version
    Sig[4].Value=6.3.9600.17415
    Sig[5].Name=Fault Module Timestamp
    Sig[5].Value=54505737
    Sig[6].Name=Exception Code
    Sig[6].Value=80000003
    Sig[7].Name=Exception Offset
    Sig[7].Value=00000000000de002
    DynamicSig[1].Name=OS Version
    DynamicSig[1].Value=6.3.9600.2.0.0.272.7
    DynamicSig[2].Name=Locale ID
    DynamicSig[2].Value=1033
    DynamicSig[22].Name=Additional Information 1
    DynamicSig[22].Value=a80b
    DynamicSig[23].Name=Additional Information 2
    DynamicSig[23].Value=a80b5d7481362c8eeb76a77903fa82d6
    DynamicSig[24].Name=Additional Information 3
    DynamicSig[24].Value=a1f8
    DynamicSig[25].Name=Additional Information 4
    DynamicSig[25].Value=a1f83374660c205ca4489043b9691b2f
    UI[2]=C:\Windows\Cluster\clussvc.exe
    UI[5]=Check online for a solution (recommended)
    UI[6]=Check for a solution later (recommended)
    UI[7]=Close
    UI[8]=Microsoft Failover Cluster Service stopped working and was closed
    UI[9]=A problem caused the application to stop working correctly. Windows will notify you if a solution is available.
    UI[10]=&Close
    LoadedModule[0]=C:\Windows\Cluster\clussvc.exe
    LoadedModule[1]=C:\Windows\SYSTEM32\ntdll.dll
    LoadedModule[2]=C:\Windows\system32\KERNEL32.DLL
    LoadedModule[3]=C:\Windows\system32\KERNELBASE.dll
    LoadedModule[4]=C:\Windows\system32\msvcrt.dll
    LoadedModule[5]=C:\Windows\SYSTEM32\sechost.dll
    LoadedModule[6]=C:\Windows\system32\ADVAPI32.dll
    LoadedModule[7]=C:\Windows\SYSTEM32\CLUSAPI.dll
    LoadedModule[8]=C:\Windows\system32\CRYPT32.dll
    LoadedModule[9]=C:\Windows\SYSTEM32\dhcpcsvc.DLL
    LoadedModule[10]=C:\Windows\SYSTEM32\IPHLPAPI.DLL
    LoadedModule[11]=C:\Windows\SYSTEM32\NTDSAPI.dll
    LoadedModule[12]=C:\Windows\system32\ole32.dll
    LoadedModule[13]=C:\Windows\system32\OLEAUT32.dll
    LoadedModule[14]=C:\Windows\SYSTEM32\RESUTILS.dll
    LoadedModule[15]=C:\Windows\system32\RPCRT4.dll
    LoadedModule[16]=C:\Windows\SYSTEM32\SspiCli.dll
    LoadedModule[17]=C:\Windows\SYSTEM32\sscore.dll
    LoadedModule[18]=C:\Windows\system32\USER32.dll
    LoadedModule[19]=C:\Windows\SYSTEM32\VSSAPI.DLL
    LoadedModule[20]=C:\Windows\SYSTEM32\wevtapi.dll
    LoadedModule[21]=C:\Windows\system32\WS2_32.dll
    LoadedModule[22]=C:\Windows\system32\NSI.dll
    LoadedModule[23]=C:\Windows\SYSTEM32\WINNSI.DLL
    LoadedModule[24]=C:\Windows\SYSTEM32\FirewallAPI.dll
    LoadedModule[25]=C:\Windows\SYSTEM32\bcrypt.dll
    LoadedModule[26]=C:\Windows\SYSTEM32\NETAPI32.dll
    LoadedModule[27]=C:\Windows\SYSTEM32\FLTLIB.DLL
    LoadedModule[28]=C:\Windows\system32\SETUPAPI.dll
    LoadedModule[29]=C:\Windows\SYSTEM32\DEVOBJ.dll
    LoadedModule[30]=C:\Windows\SYSTEM32\fwpuclnt.dll
    LoadedModule[31]=C:\Windows\SYSTEM32\VirtDisk.dll
    LoadedModule[32]=C:\Windows\SYSTEM32\clfsw32.dll
    LoadedModule[33]=C:\Windows\SYSTEM32\DSPARSE.dll
    LoadedModule[34]=C:\Windows\SYSTEM32\cryptdll.dll
    LoadedModule[35]=C:\Windows\system32\MSASN1.dll
    LoadedModule[36]=C:\Windows\SYSTEM32\combase.dll
    LoadedModule[37]=C:\Windows\system32\GDI32.dll
    LoadedModule[38]=C:\Windows\SYSTEM32\VssTrace.DLL
    LoadedModule[39]=C:\Windows\SYSTEM32\DSROLE.dll
    LoadedModule[40]=C:\Windows\SYSTEM32\bcd.dll
    LoadedModule[41]=C:\Windows\SYSTEM32\netutils.dll
    LoadedModule[42]=C:\Windows\SYSTEM32\srvcli.dll
    LoadedModule[43]=C:\Windows\SYSTEM32\wkscli.dll
    LoadedModule[44]=C:\Windows\system32\CFGMGR32.dll
    LoadedModule[45]=C:\Windows\SYSTEM32\DPAPI.DLL
    LoadedModule[46]=C:\Windows\SYSTEM32\CRYPTBASE.dll
    LoadedModule[47]=C:\Windows\SYSTEM32\SAMCLI.DLL
    LoadedModule[48]=C:\Windows\SYSTEM32\bcryptPrimitives.dll
    LoadedModule[49]=C:\Windows\SYSTEM32\sscoreext.dll
    LoadedModule[50]=C:\Windows\SYSTEM32\mi.dll
    LoadedModule[51]=C:\Windows\SYSTEM32\miutils.dll
    LoadedModule[52]=C:\Windows\system32\wmidcom.dll
    LoadedModule[53]=C:\Windows\SYSTEM32\kernel.appcore.dll
    LoadedModule[54]=C:\Windows\SYSTEM32\ntmarta.dll
    LoadedModule[55]=C:\Windows\SYSTEM32\dhcpcsvc6.DLL
    LoadedModule[56]=C:\Windows\SYSTEM32\clbcatq.dll
    LoadedModule[57]=C:\Windows\system32\wbem\wbemprox.dll
    LoadedModule[58]=C:\Windows\SYSTEM32\wbemcomn.dll
    LoadedModule[59]=C:\Windows\SYSTEM32\CRYPTSP.dll
    LoadedModule[60]=C:\Windows\system32\rsaenh.dll
    LoadedModule[61]=C:\Windows\system32\wbem\wbemsvc.dll
    LoadedModule[62]=C:\Windows\system32\wbem\fastprox.dll
    LoadedModule[63]=C:\Windows\SYSTEM32\pcwum.dll
    LoadedModule[64]=C:\Windows\system32\mswsock.dll
    LoadedModule[65]=C:\Windows\system32\WINTRUST.dll
    LoadedModule[66]=C:\Windows\SYSTEM32\logoncli.dll
    LoadedModule[67]=C:\Windows\SYSTEM32\DNSAPI.dll
    LoadedModule[68]=C:\Windows\System32\rasadhlp.dll
    LoadedModule[69]=C:\Windows\system32\kerberos.DLL
    LoadedModule[70]=C:\Windows\SYSTEM32\SAMLIB.dll
    LoadedModule[71]=C:\Windows\system32\es.dll
    LoadedModule[72]=C:\Windows\system32\PROPSYS.dll
    LoadedModule[73]=C:\Windows\SYSTEM32\profapi.dll
    FriendlyEventName=Stopped working
    ConsentKey=APPCRASH
    AppName=Microsoft Failover Cluster Service
    AppPath=C:\Windows\Cluster\clussvc.exe
    NsPartner=windows
    NsGroup=windows8
    ApplicationIdentity=78F1110F74732BD871C9A3C553A667E4

    Got a window to reboot the EX02 machine and this seems to have solved the issue. Cluster Service is stable again and DAG is healthy. This issue can be marked as answered.
    I have this same issue, and it appears to manifest whenever there is a network disruption.  After network is restored, the cluster service repeatedly crashes until a reboot.  I'm not sure if a reboot is a real fix.  I'm curious whether
    yours returns if you unplug the network cable and plug it back in on your server, like mine.

  • Cluster resource SID.WORLD' (resource type '', DLL 'fsresodbs.dll') either crashed or deadlocked.

    Dear Friends,
    We are facing issue with our systems which is running on win2008 with oracle DB this is MSCS environment.
    Automatically some resource moved to node2 from node1 and database went down, in fail safe cluster management i can see error as below.
    Cluster resource 'SID.WORLD' (resource type '', DLL 'fsresodbs.dll') either crashed or deadlocked. The Resource Hosting Subsystem (RHS) process will now attempt to terminate, and the resource will be marked to run in a separate monitor.
    And
    The cluster resource host subsystem (RHS) stopped unexpectedly. An attempt will be made to restart it. This is usually due to a problem in a resource DLL. Please determine which resource DLL is causing the issue and report the problem to the resource vendor.
    Kindly help us to solve this issue.
    Thanks
    Basis

    Hi Deepak,
    Thanks for providing the link.
    I have seen the link and symptoms are same,  but only difference is, this link is talking about clusres.dll'  and we have issue with fsresodbs.dll'
    Our issue
    Cluster resource 'SID.WORLD' (resource type '', DLL 'fsresodbs.dll''') either crashed or deadlocked.
    and issue described in the Link
    Cluster resource 'SID.WORLD' (resource type '', DLL 'clusres.dll'') either crashed or deadlocked.
    Kindly guide.
    Thanks
    Basis

  • MS Cluster Resource Problem

    Dear Experts
    I am trying to do High Availability Installation  on MSCS , and im in the stage that trying to create Central Services Instance for ABAP (ASCS) , but when i did and im trying to start the FileServer resource i face the following error:
    Cluster resource 'SAPPRD' (resource type '', DLL 'clusres.dll') either crashed or deadlocked. The Resource Hosting Subsystem (RHS) process will now attempt to terminate, and the resource will be marked to run in a separate monitor.
    The cluster resource host subsystem (RHS) stopped unexpectedly. An attempt will be made to restart it. This is usually due to a problem in a resource DLL. Please determine which resource DLL is causing the issue and report the problem to the resource vendor.
    i have tried almost everything even destroying the cluster and the uninstallating the fail over cluster manager feature
    please advice what can i do??
    thanks
    Sameh Essa

    Hi Sameh,
    Have u rectified this issue.we are also facing the same problem.We have installed our BI cluster systems in Windows 2008 64bit enterprise and MS sql2008 R2.The cluster resource is getting crashed and failover to the second node.The windows error log as shown below.
    Log Name:      System
    Source:        Microsoft-Windows-FailoverClustering
    Date:          12/1/2011 2:29:48 AM
    Event ID:      1146
    Task Category: Resource Control Manager
    Level:         Critical
    Keywords:     
    User:          SYSTEM
    Computer:     
    Description:
    The cluster resource host subsystem (RHS) stopped unexpectedly. An attempt will be made to restart it. This is usually due to a problem in a resource DLL.
    Thanks
    Arun Padikkal

  • Cluster resource Hang

    Hi
    We have 3 Node Hyperv 2012 R2 Failover Cluster suddenly we face below error on one Node.
    A component on the server did not respond in a timely fashion. This caused the cluster resource 'Virtual Machine Configuration  (resource type 'Virtual Machine Configuration', DLL 'vmclusres.dll') to exceed its time-out threshold. As part of cluster
    health detection, recovery actions will be taken. The cluster will try to automatically recover by terminating and restarting the Resource Hosting Subsystem (RHS) process that is running this resource. Verify that the underlying infrastructure (such as storage,
    networking, or services) that are associated with the resource are functioning correctly.

    Hi jingoi,
    “Refer to the System event log to determine which resource and resource DLL is causing the issue” from the literal meaning of view we can get a cluster resource crash or not
    responding, since the current information we can not determine which component may crash you can get the cluster log to determine which cluster resource has issue first.
    Some folk meet this similar issue because they have not install the following update and got vmclusters.dll deadlock, please install them first then monitor this issue again.
    Recommended hotfixes and updates for Windows Server 2012 R2-based failover clusters
    https://social.technet.microsoft.com/Forums/windowsserver/en-US/fce9f196-0ac7-4456-87b3-f3de508231d7/cluster-resource-hang?forum=winserverClustering
    October 2014 update rollup for Windows RT 8.1, Windows 8.1, and Windows Server 2012 R2
    http://support.microsoft.com/en-us/kb/2995388
    More information:
    Get-ClusterLog
    https://technet.microsoft.com/en-us/library/ee461045.aspx?f=255&MSPPError=-2147217396
    I’m glad to be of help to you!
    Please remember to mark the replies as answers if they help and unmark them if they provide no help. If you have feedback for TechNet Support, contact [email protected]

  • One VM Cluster Resources Regularly Failing

    Hi All,
    We run hundreds of Windows and Linux VMs in clustered and non-clustered environments. However, we're having issues with one particular VM that regularly restarts itself. The environment the problem VM is running in is a Windows 2012 R2 cluster.
    The event log within the VM provides no BSOD information, the only entry of any note:
    The system has rebooted without cleanly shutting down first. This error could be caused if the system stopped responding, crashed, or lost power unexpectedly.
    Therefore, I don't believe that the actual OS within the VM (Windows 2008 R2) is crashing.
    The cluster log shows only a single entry:
    Cluster resource 'Virtual Machine vps.xxxxxx.com' of type 'Virtual Machine' in clustered role 'vps.xxxxxx.com' failed.
    Based on the failure policies for the resource and role, the cluster service may try to bring the resource online on this node or move the group to another node of the cluster and then restart it.  Check the resource and group state using Failover Cluster
    Manager or the Get-ClusterResource Windows PowerShell cmdlet.
    How can I debug this? I've added extra RAM to it, and moved it to other nodes and other storage but the problem continues to occur. 
    Thanks
    Will

    Hi,
    To such  issue, it is not an efficient way to work in this community since we may need more resources, for example memory (an application) dump or ETL trace, which is not appropriate to handle in the community. I’d like to suggest that you submit a
    service request to MS Professional tech support service so that a dedicated Support Professional can further assist with this request.
    Please visit the below link to see the various paid support options that are available to better meet your needs.
    http://support.microsoft.com/default.aspx?id=fh;en-us;offerprophone
    Best regards,
    We
    are trying to better understand customer views on social support experience, so your participation in this
    interview project would be greatly appreciated if you have time.
    Thanks for helping make community forums a great place.

  • The cluster resource 'SQL Server' could not be brought online error while in completion stage of sql server 2012 failover installation

    While installing sql server 2012 with failover clustering I got the following error:
    The cluster resource 'SQL Server' could not be brought online. Error: There was a failure to call cluster code from a provider. Exception message: Generic failure. Status code: 5942. Description: The resource failed to come online due to the failure of one
    or more provider resources.
    The two nodes of the sql server failover have been successfully prepared. The error came while running the advance cluster completion option.
    In the clustered events in failover cluster manager the following message is displayed:
    Cluster resource 'SQL Network Name (CPCTestSQLClus)' of type 'Network name' in clustered role 'SQL Server (MSSQLSERVER)' failed.
    I have done various checking and the issue remained. I tried to start the sql

    Please find below part of the content of the cluster log. I hope this is helpful in resolving the issue:
    00000998.000010e8::2013/05/08-20:45:00.233 INFO  [RES] Network Name <SQL Network Name (CPCTestSQLClus)>: Online called for resource SQL Network Name (CPCTestSQLClus)
    000005a4.0000050c::2013/05/08-20:45:00.233 INFO  [RCM] HandleMonitorReply: ONLINERESOURCE for 'SQL Network Name (CPCTestSQLClus)', gen(6) result 997/0.
    000005a4.0000050c::2013/05/08-20:45:00.233 INFO  [RCM] Res SQL Network Name (CPCTestSQLClus): OnlineCallIssued -> OnlinePending( StateUnknown )
    000005a4.0000050c::2013/05/08-20:45:00.233 INFO  [RCM] TransitionToState(SQL Network Name (CPCTestSQLClus)) OnlineCallIssued-->OnlinePending.
    00000998.000012f0::2013/05/08-20:45:00.233 INFO  [RES] Network Name <SQL Network Name (CPCTestSQLClus)>: Entering Online thread
    000005a4.0000050c::2013/05/08-20:45:00.233 INFO  [GEM] Sending 1 messages as a batched GEM message
    00000998.000012f0::2013/05/08-20:45:00.233 INFO  [RES] Network Name <SQL Network Name (CPCTestSQLClus)>: Initializing config info
    00000998.000012f0::2013/05/08-20:45:00.248 INFO  [RES] Network Name <SQL Network Name (CPCTestSQLClus)>: Skipping initialization of 'Identity' module because netname is not yet created
    00000998.000012f0::2013/05/08-20:45:00.248 INFO  [RES] Network Name <SQL Network Name (CPCTestSQLClus)>: Performing actual online of resource.
    00000998.000012f0::2013/05/08-20:45:00.248 INFO  [RES] Network Name <SQL Network Name (CPCTestSQLClus)>: Obtaining IP info for resource SQL IP Address 1 (CPCTestSQLClus)
    00000998.000012f0::2013/05/08-20:45:00.248 INFO  [RES] Network Name <SQL Network Name (CPCTestSQLClus)>: Using provider SQL IP Address 1 (CPCTestSQLClus), ip address 10.144.166.160, mask 255.255.255.0, prefix length 24
    00000998.000012f0::2013/05/08-20:45:00.248 INFO  [RES] Network Name <SQL Network Name (CPCTestSQLClus)>: Resource has 1 IPs
    00000998.000012f0::2013/05/08-20:45:00.248 INFO  [RES] Network Name <SQL Network Name (CPCTestSQLClus)>: IP: Type Ipv4, Address 10.144.166.160:~0~, Prefix 10.144.166.160/24, Online true, Transport \Device\NetBt_If3
    00000998.000012f0::2013/05/08-20:45:00.248 INFO  [RES] Network Name: Agent: Initializing (082d8ef5-62a8-4fee-acbc-e89b769e9181,Configuration)
    00000998.000012f0::2013/05/08-20:45:00.248 INFO  [RES] Network Name: Agent: Sending request Netname/InitializeIndirect to NN:Agent
    00000998.000010e8::2013/05/08-20:45:00.248 INFO  [RES] Network Name: Agent: OnInitialize (082d8ef5-62a8-4fee-acbc-e89b769e9181,Configuration)
    00000998.000010e8::2013/05/08-20:45:00.248 INFO  [RES] Network Name: Agent: CanModuleBeInitializedImp - Module can be initialized, current state Offline
    00000998.000010e8::2013/05/08-20:45:00.248 INFO  [RES] Network Name: Agent: Sending Initialize to module NN:082d8ef5-62a8-4fee-acbc-e89b769e9181:Configuration
    00000998.000010e8::2013/05/08-20:45:00.248 INFO  [RES] Network Name: Agent: Sending request Netname/Initialize to NN:082d8ef5-62a8-4fee-acbc-e89b769e9181:Configuration
    00000998.000010e8::2013/05/08-20:45:00.248 INFO  [RES] Network Name <SQL Network Name (CPCTestSQLClus)>: Configuration: Waiting for ongoing slow strand to complete (if any)
    00000998.000010e8::2013/05/08-20:45:00.248 INFO  [RES] Network Name <SQL Network Name (CPCTestSQLClus)>: Configuration: Signaling main strand to initialize module
    00000998.000010e8::2013/05/08-20:45:00.248 INFO  [RES] Network Name <SQL Network Name (CPCTestSQLClus)>: Configuration: Calling initialize of the configuration implementation
    000005a4.00001350::2013/05/08-20:45:00.248 INFO  [GEM] Sending 1 messages as a batched GEM message
    00000998.000010e8::2013/05/08-20:45:00.248 INFO  [RES] Network Name <SQL Network Name (CPCTestSQLClus)>: Configuration: Setting 'StatusKerberos' in clusdb returned status 0
    00000998.000010e8::2013/05/08-20:45:00.248 INFO  [RES] Network Name <SQL Network Name (CPCTestSQLClus)>: Configuration: Creating a New AD NetName (type Singleton)...
    00000998.000010e8::2013/05/08-20:45:00.248 INFO  [RES] Network Name: Agent: Initializing (082d8ef5-62a8-4fee-acbc-e89b769e9181,AccountAD)
    00000998.000010e8::2013/05/08-20:45:00.248 INFO  [RES] Network Name: Agent: Sending request Netname/InitializeIndirect to NN:Agent
    00000998.000010e8::2013/05/08-20:45:00.248 INFO  [RES] Network Name: Agent: OnInitialize (082d8ef5-62a8-4fee-acbc-e89b769e9181,AccountAD)
    00000998.000010e8::2013/05/08-20:45:00.248 INFO  [RES] Network Name: Agent: CanModuleBeInitializedImp - Module can be initialized, current state Closing
    00000998.000010e8::2013/05/08-20:45:00.248 INFO  [RES] Network Name: Agent: Sending Initialize to module NN:082d8ef5-62a8-4fee-acbc-e89b769e9181:AccountAD
    00000998.000010e8::2013/05/08-20:45:00.248 INFO  [RES] Network Name: Agent: Sending request Netname/Initialize to NN:082d8ef5-62a8-4fee-acbc-e89b769e9181:AccountAD
    00000998.000010e8::2013/05/08-20:45:00.248 INFO  [RES] Network Name <SQL Network Name (CPCTestSQLClus)>: AccountAD: Waiting for ongoing slow strand to complete (if any)
    00000998.000010e8::2013/05/08-20:45:00.248 INFO  [RES] Network Name <SQL Network Name (CPCTestSQLClus)>: AccountAD: Signaling main strand to initialize module
    00000998.000010e8::2013/05/08-20:45:00.248 INFO  [RES] Network Name <SQL Network Name (CPCTestSQLClus)>: AccountAD: Initializing Name: CPCTestSQLClus, NetbiosName: CPCTESTSQLCLUS, Type: Singleton, Created: false
    00000998.000010e8::2013/05/08-20:45:00.248 INFO  [RES] Network Name: [NNLIB] GetCreatingDC - name CPCTestSQLClus, lookup flags = 1
    00000998.000010e8::2013/05/08-20:45:00.452 INFO  [RES] Network Name: [NNLIB] GetDCWithFlags - using DC
    \\MY01DC03.Domain.net, domain name Domain.net, IsReadOnly 0, Object exists 0
    00000998.000010e8::2013/05/08-20:45:00.452 INFO  [RES] Network Name:  [NN] Setting crypto access members for encrypt. New container = false.
    000005a4.00001350::2013/05/08-20:45:00.452 INFO  [GEM] Sending 1 messages as a batched GEM message
    00000998.000010e8::2013/05/08-20:45:00.452 INFO  [RES] Network Name: Agent: Sending request Netname/LastDcChange to NN:082d8ef5-62a8-4fee-acbc-e89b769e9181:Configuration
    00000998.0000075c::2013/05/08-20:45:00.452 INFO  [RES] Network Name <SQL Network Name (CPCTestSQLClus)>: Configuration: LastDc Changed, configOnly: 1
    000005a4.00001350::2013/05/08-20:45:00.452 INFO  [GEM] Sending 1 messages as a batched GEM message
    00000998.0000075c::2013/05/08-20:45:00.468 INFO  [RES] Network Name <SQL Network Name (CPCTestSQLClus)>: Configuration: Setting last DC in clusdb returned status 0
    00000998.0000075c::2013/05/08-20:45:00.468 INFO  [RES] Network Name:  [NN] got sync reply: 0
    00000998.000010e8::2013/05/08-20:45:00.468 INFO  [RES] Network Name <SQL Network Name (CPCTestSQLClus)>: AccountAD: LastDc Changed (configOnly true), result: 0
    00000998.000010e8::2013/05/08-20:45:00.468 INFO  [RES] Network Name: Agent: Sending request Netname/PasswordChange to NN:082d8ef5-62a8-4fee-acbc-e89b769e9181:Configuration
    00000998.0000075c::2013/05/08-20:45:00.468 INFO  [RES] Network Name <SQL Network Name (CPCTestSQLClus)>: Configuration: Password Changed, configOnly: 1
    000005a4.00001350::2013/05/08-20:45:00.468 INFO  [GEM] Sending 1 messages as a batched GEM message
    00000998.0000075c::2013/05/08-20:45:00.468 INFO  [RES] Network Name <SQL Network Name (CPCTestSQLClus)>: Configuration: Setting password in clusdb returned status 0
    00000998.0000075c::2013/05/08-20:45:00.468 INFO  [RES] Network Name:  [NN] got sync reply: 0
    00000998.000010e8::2013/05/08-20:45:00.468 INFO  [RES] Network Name <SQL Network Name (CPCTestSQLClus)>: AccountAD: PasswordChanged (configOnly true), result: 0
    00000998.000010e8::2013/05/08-20:45:00.468 INFO  [RES] Network Name:  [NN] Setting crypto access members for decrypt. New container = false.
    00000998.00000ab8::2013/05/08-20:45:00.636 INFO  [RES] Network Name <SQL Network Name (CPCTestSQLClus)>: Getting Read/Write private properties
    00000998.00000ab8::2013/05/08-20:45:00.647 INFO  [RES] Network Name <SQL Network Name (CPCTestSQLClus)>: Getting Read only private properties
    00000998.0000075c::2013/05/08-20:45:00.784 INFO  [RES] Network Name <SQL Network Name (CPCTestSQLClus)>: Getting Read/Write private properties
    00000998.00000ab8::2013/05/08-20:45:00.815 INFO  [RES] Network Name <SQL Network Name (CPCTestSQLClus)>: Getting Read only private properties
    00000998.00000ab8::2013/05/08-20:45:00.815 INFO  [RES] Network Name <SQL Network Name (CPCTestSQLClus)>: Getting Read/Write private properties
    00000998.00000ab8::2013/05/08-20:45:00.830 INFO  [RES] Network Name <SQL Network Name (CPCTestSQLClus)>: Getting Read only private properties
    00000998.00000ab8::2013/05/08-20:45:00.830 INFO  [RES] Network Name <SQL Network Name (CPCTestSQLClus)>: Getting Read/Write private properties
    00000998.00000ab8::2013/05/08-20:45:00.830 INFO  [RES] Network Name <SQL Network Name (CPCTestSQLClus)>: Getting Read only private properties
    00000998.000010e8::2013/05/08-20:45:00.924 INFO  [RES] Network Name <SQL Network Name (CPCTestSQLClus)>: AccountAD: OU name for VCO is OU=NewComputers,OU=WORKSTATIONS,DC=Domain,DC=net
    00000998.000010e8::2013/05/08-20:45:00.924 INFO  [RES] Network Name: Agent: Sending request Netname/GetToken to NN:c03fb105-9a50-4d00-8bee-afaf693f7efc:Identity
    00000998.00000ab8::2013/05/08-20:45:00.924 INFO  [RES] Network Name <Cluster Name>: Identity: Module is not yet initialized. Trying to obtain a new token.
    00000998.0000075c::2013/05/08-20:45:00.924 INFO  [RES] Network Name <Cluster Name>: Identity: Obtaining new token
    00000998.0000075c::2013/05/08-20:45:00.924 INFO  [RES] Network Name:  [NN] Setting crypto access members for decrypt. New container = false.
    00000998.0000075c::2013/05/08-20:45:00.924 INFO  [RES] Network Name: [NNLIB] Priming local KDC cache to
    \\MY01DC02.Domain.net for domain Domain.net
    00000998.0000075c::2013/05/08-20:45:00.924 INFO  [RES] Network Name: [NNLIB] PopulateKerbKDCLookupCache - DC flags 0
    00000998.0000075c::2013/05/08-20:45:00.940 INFO  [RES] Network Name: [NNLIB] LsaCallAuthenticationPackage success with a request of size 94, result size 0 (status: 0, subStatus: 0)
    00000998.0000075c::2013/05/08-20:45:00.940 INFO  [RES] Network Name: [NNLIB] Priming local KDC cache to
    \\MY01DC02.Domain.net for domain label Domain
    00000998.0000075c::2013/05/08-20:45:00.940 INFO  [RES] Network Name: [NNLIB] LsaCallAuthenticationPackage success with a request of size 86, result size 0 (status: 0, subStatus: 0)
    00000998.0000075c::2013/05/08-20:45:01.018 WARN  [RES] Network Name: [NNLIB] LogonUserEx fails for user CPCTestWinClus$: 1326 (useSecondaryPassword: 0)
    00000998.0000075c::2013/05/08-20:45:01.096 WARN  [RES] Network Name: [NNLIB] LogonUserEx fails for user CPCTestWinClus$: 1326 (useSecondaryPassword: 1)
    00000998.0000075c::2013/05/08-20:45:01.096 INFO  [RES] Network Name: [NNLIB] Logon failed for user CPCTestWinClus$ (Error 1326), DC
    \\MY01DC02.Domain.net, domain Domain.net
    00000998.0000075c::2013/05/08-20:45:01.096 INFO  [RES] Network Name <Cluster Name>: Identity: Obtaining Windows Token for Name: CPCTestWinClus, SamName: CPCTestWinClus$, Type: Singleton, Result: 1326, LastDC:
    \\MY01DC02.Domain.net
    00000998.0000075c::2013/05/08-20:45:01.096 INFO  [RES] Network Name <Cluster Name>: Identity: Slow Operation, FinishWithReply: 1326
    00000998.0000075c::2013/05/08-20:45:01.096 INFO  [RES] Network Name <Cluster Name>: Identity: InternalReplyHandler with event: 1326
    00000998.0000075c::2013/05/08-20:45:01.096 INFO  [RES] Network Name <Cluster Name>: Identity: End of Slow Operation, state: Error/Idle, prevWorkState: Idle
    00000998.00000ab8::2013/05/08-20:45:01.096 WARN  [RES] Network Name <Cluster Name>: Identity: Get Token Request, currently doesnt have a token!
    00000998.00000ab8::2013/05/08-20:45:01.096 INFO  [RES] Network Name:  [NN] got sync reply: 0
    00000998.000010e8::2013/05/08-20:45:01.096 INFO  [RES] Network Name <SQL Network Name (CPCTestSQLClus)>: AccountAD: End of Slow Operation, state: Initializing/Writing, prevWorkState: Writing
    00000998.000010e8::2013/05/08-20:45:01.096 WARN  [RES] Network Name <SQL Network Name (CPCTestSQLClus)>: AccountAD: Slow operation has exception ERROR_INVALID_HANDLE(6)' because of '::ImpersonateLoggedOnUser( GetToken() )'
    00000998.000010e8::2013/05/08-20:45:01.096 INFO  [RES] Network Name: Agent: OnInitializeReply, Failure on (082d8ef5-62a8-4fee-acbc-e89b769e9181,AccountAD): 6
    00000998.000010e8::2013/05/08-20:45:01.096 INFO  [RES] Network Name <SQL Network Name (CPCTestSQLClus)>: Configuration: InitializeReplyCreation of NetName (type Singleton), result: 6, IsCanceled: false
    000005a4.00000cd8::2013/05/08-20:45:01.096 INFO  [GEM] Sending 1 messages as a batched GEM message
    00000998.00000ab8::2013/05/08-20:45:01.096 INFO  [RES] Network Name <SQL Network Name (CPCTestSQLClus)>: Getting Read/Write private properties
    00000998.000010e8::2013/05/08-20:45:01.096 INFO  [RES] Network Name <SQL Network Name (CPCTestSQLClus)>: Configuration: Setting 'StatusKerberos' in clusdb returned status 0
    00000998.000010e8::2013/05/08-20:45:01.096 INFO  [RES] Network Name <SQL Network Name (CPCTestSQLClus)>: Configuration: Deleting ResourceData, CreatingDC, ObjectGUID for a newly created netname from cluster database
    000005a4.00000cd8::2013/05/08-20:45:01.096 INFO  [GEM] Sending 1 messages as a batched GEM message
    000005a4.00000cd8::2013/05/08-20:45:01.112 INFO  [GEM] Sending 1 messages as a batched GEM message
    00000998.00000ab8::2013/05/08-20:45:01.112 INFO  [RES] Network Name <SQL Network Name (CPCTestSQLClus)>: Getting Read only private properties
    00000998.000010e8::2013/05/08-20:45:01.112 INFO  [RES] Network Name: Agent: OnInitializeReply, Failure on (082d8ef5-62a8-4fee-acbc-e89b769e9181,Configuration): 6
    00000998.000010e8::2013/05/08-20:45:01.112 INFO  [RES] Network Name <SQL Network Name (CPCTestSQLClus)>: SyncReplyHandler Configuration, result: 6
    00000998.000012f0::2013/05/08-20:45:01.112 INFO  [RES] Network Name <SQL Network Name (CPCTestSQLClus)>: PerformOnline - Initialization of Configuration module finished with result: 6
    00000998.000012f0::2013/05/08-20:45:01.112 ERR   [RES] Network Name <SQL Network Name (CPCTestSQLClus)>: Online thread Failed: ERROR_SUCCESS(0)' because of 'Initializing netname configuration for SQL Network Name (CPCTestSQLClus) failed with
    error 6.'
    00000998.000012f0::2013/05/08-20:45:01.112 INFO  [RES] Network Name <SQL Network Name (CPCTestSQLClus)>: All resources offline. Cleaning up.
    00000998.000012f0::2013/05/08-20:45:01.112 ERR   [RHS] Online for resource SQL Network Name (CPCTestSQLClus) failed.
    000005a4.0000050c::2013/05/08-20:45:01.112 WARN  [RCM] HandleMonitorReply: ONLINERESOURCE for 'SQL Network Name (CPCTestSQLClus)', gen(6) result 5018/0.
    000005a4.0000050c::2013/05/08-20:45:01.112 INFO  [RCM] Res SQL Network Name (CPCTestSQLClus): OnlinePending -> ProcessingFailure( StateUnknown )
    000005a4.0000050c::2013/05/08-20:45:01.112 INFO  [RCM] TransitionToState(SQL Network Name (CPCTestSQLClus)) OnlinePending-->ProcessingFailure.
    000005a4.0000050c::2013/05/08-20:45:01.112 ERR   [RCM] rcm::RcmResource::HandleFailure: (SQL Network Name (CPCTestSQLClus))
    000005a4.0000050c::2013/05/08-20:45:01.112 INFO  [RCM] resource SQL Network Name (CPCTestSQLClus): failure count: 6, restartAction: 2 persistentState: 1.
    000005a4.00000cd8::2013/05/08-20:45:01.112 INFO  [GEM] Sending 1 messages as a batched GEM message
    000005a4.0000050c::2013/05/08-20:45:01.112 INFO  [RCM] Greater than restartPeriod time has elapsed since first failure of SQL Network Name (CPCTestSQLClus), resetting failureTime and failureCount.
    000005a4.0000050c::2013/05/08-20:45:01.112 INFO  [RCM] Will queue immediate restart (500 milliseconds) of SQL Network Name (CPCTestSQLClus) after terminate is complete.
    000005a4.0000050c::2013/05/08-20:45:01.112 INFO  [RCM] Res SQL Network Name (CPCTestSQLClus): ProcessingFailure -> WaitingToTerminate( DelayRestartingResource )
    000005a4.0000050c::2013/05/08-20:45:01.112 INFO  [RCM] TransitionToState(SQL Network Name (CPCTestSQLClus)) ProcessingFailure-->[WaitingToTerminate to DelayRestartingResource].
    000005a4.0000050c::2013/05/08-20:45:01.112 INFO  [RCM] Res SQL Network Name (CPCTestSQLClus): [WaitingToTerminate to DelayRestartingResource] -> Terminating( DelayRestartingResource )
    000005a4.0000050c::2013/05/08-20:45:01.112 INFO  [RCM] TransitionToState(SQL Network Name (CPCTestSQLClus)) [WaitingToTerminate to DelayRestartingResource]-->[Terminating to DelayRestartingResource].
    00000998.00000ab8::2013/05/08-20:45:01.112 INFO  [RES] Network Name <SQL Network Name (CPCTestSQLClus)>: Terminate called for resource SQL Network Name (CPCTestSQLClus)
    00000998.00000ab8::2013/05/08-20:45:01.112 INFO  [RES] Network Name <SQL Network Name (CPCTestSQLClus)>: Entering Offline thread
    00000998.00000ab8::2013/05/08-20:45:01.112 INFO  [RES] Network Name <SQL Network Name (CPCTestSQLClus)>: Performing actual offline of resource.
    00000998.00000ab8::2013/05/08-20:45:01.112 INFO  [RES] Network Name: Agent: Closing (082d8ef5-62a8-4fee-acbc-e89b769e9181,AdminShare)
    00000998.00000ab8::2013/05/08-20:45:01.112 INFO  [RES] Network Name: Agent: Sending request Netname/CloseIndirect to NN:Agent
    00000998.000010e8::2013/05/08-20:45:01.112 INFO  [RES] Network Name: Agent: OnClose (082d8ef5-62a8-4fee-acbc-e89b769e9181,AdminShare)
    00000998.000010e8::2013/05/08-20:45:01.112 INFO  [RES] Network Name: Agent: Sending request Netname/Close to NN:082d8ef5-62a8-4fee-acbc-e89b769e9181:AdminShare
    00000998.000010e8::2013/05/08-20:45:01.112 ERR   [RES] Network Name <SQL Network Name (CPCTestSQLClus)>: AdminShare: OnCloseBase, Error Already Closing, previous state: Closing/Ending
    00000998.000010e8::2013/05/08-20:45:01.112 INFO  [RES] Network Name: Agent: OnCloseReply (082d8ef5-62a8-4fee-acbc-e89b769e9181,AdminShare) result: 1904
    00000998.000010e8::2013/05/08-20:45:01.112 INFO  [RES] Network Name <SQL Network Name (CPCTestSQLClus)>: SyncReplyHandler Configuration, result: 1904
    00000998.00000ab8::2013/05/08-20:45:01.112 INFO  [RES] Network Name: Agent: Closing (082d8ef5-62a8-4fee-acbc-e89b769e9181,Configuration)
    00000998.00000ab8::2013/05/08-20:45:01.112 INFO  [RES] Network Name: Agent: Sending request Netname/CloseIndirect to NN:Agent
    000005a4.00000cd8::2013/05/08-20:45:01.112 INFO  [RCM-rbtr] giving default token to group SQL Server (MSSQLSERVER)
    000005a4.00000cd8::2013/05/08-20:45:01.112 INFO  [RCM-rbtr] giving default token to group SQL Server (MSSQLSERVER)
    000005a4.00000cd8::2013/05/08-20:45:01.112 INFO  [RCM-rbtr] giving default token to group SQL Server (MSSQLSERVER)
    000005a4.00000cd8::2013/05/08-20:45:01.112 INFO  [RCM-rbtr] giving default token to group SQL Server (MSSQLSERVER)
    00000998.0000075c::2013/05/08-20:45:01.112 INFO  [RES] Network Name: Agent: OnClose (082d8ef5-62a8-4fee-acbc-e89b769e9181,Configuration)
    00000998.0000075c::2013/05/08-20:45:01.112 INFO  [RES] Network Name: Agent: Sending request Netname/Close to NN:082d8ef5-62a8-4fee-acbc-e89b769e9181:Configuration
    00000998.0000075c::2013/05/08-20:45:01.112 INFO  [RES] Network Name <SQL Network Name (CPCTestSQLClus)>: Configuration: Canceling work, state: Closing/Idle
    00000998.0000075c::2013/05/08-20:45:01.112 INFO  [RES] Network Name <SQL Network Name (CPCTestSQLClus)>: Configuration: OnCloseBase, previous state: Initializing/Idle
    00000998.0000075c::2013/05/08-20:45:01.112 INFO  [RES] Network Name <SQL Network Name (CPCTestSQLClus)>: Configuration: Closing... (PreviousState: Initializing, Created: false, Type: Singleton)
    00000998.0000075c::2013/05/08-20:45:01.112 INFO  [RES] Network Name: Agent: Closing (082d8ef5-62a8-4fee-acbc-e89b769e9181,AccountAD)
    00000998.0000075c::2013/05/08-20:45:01.112 INFO  [RES] Network Name: Agent: Sending request Netname/CloseIndirect to NN:Agent
    00000998.000010e8::2013/05/08-20:45:01.112 INFO  [RES] Network Name: Agent: OnClose (082d8ef5-62a8-4fee-acbc-e89b769e9181,AccountAD)
    00000998.000010e8::2013/05/08-20:45:01.112 INFO  [RES] Network Name: Agent: Sending request Netname/Close to NN:082d8ef5-62a8-4fee-acbc-e89b769e9181:AccountAD
    00000998.000010e8::2013/05/08-20:45:01.112 INFO  [RES] Network Name <SQL Network Name (CPCTestSQLClus)>: AccountAD: Canceling work, state: Closing/Idle
    00000998.000010e8::2013/05/08-20:45:01.112 INFO  [RES] Network Name <SQL Network Name (CPCTestSQLClus)>: AccountAD: OnCloseBase, previous state: Initializing/Idle
    00000998.000010e8::2013/05/08-20:45:01.112 INFO  [RES] Network Name: Agent: OnCloseReply (082d8ef5-62a8-4fee-acbc-e89b769e9181,AccountAD) result: 0
    00000998.000010e8::2013/05/08-20:45:01.112 INFO  [RES] Network Name <SQL Network Name (CPCTestSQLClus)>: Configuration: Finish Closing NetName (type Singleton) Module AccountAD, result 0, remaining... 0 (0)
    00000998.000010e8::2013/05/08-20:45:01.112 INFO  [RES] Network Name: Agent: -- listing 3 instances ---------------------------------------------
    00000998.000010e8::2013/05/08-20:45:01.112 INFO  [RES] Network Name: Agent: --- 7 modules for instance: 082d8ef5-62a8-4fee-acbc-e89b769e9181:
    00000998.000010e8::2013/05/08-20:45:01.112 INFO  [RES] Network Name: Agent: ---- Module: Configuration with states: Offline/Ending (BeingBorn)
    00000998.000010e8::2013/05/08-20:45:01.112 INFO  [RES] Network Name: Agent: ---- Module: AccountAD with states: Closing/Ending (BeingBorn)
    00000998.000010e8::2013/05/08-20:45:01.112 INFO  [RES] Network Name: Agent: ---- Module: Client with states: Offline/Idle (BeingBorn)
    00000998.0000075c::2013/05/08-20:45:01.112 INFO  [RES] Network Name <SQL Network Name (CPCTestSQLClus)>: Configuration: Closed
    00000998.000010e8::2013/05/08-20:45:01.112 INFO  [RES] Network Name: Agent: ---- Module: Identity with states: Offline/Idle (BeingBorn)
    00000998.000010e8::2013/05/08-20:45:01.112 INFO  [RES] Network Name: Agent: ---- Module: Dns with states: Offline/Idle (BeingBorn)
    00000998.0000075c::2013/05/08-20:45:01.112 INFO  [RES] Network Name: Agent: OnCloseReply (082d8ef5-62a8-4fee-acbc-e89b769e9181,Configuration) result: 0
    00000998.000010e8::2013/05/08-20:45:01.112 INFO  [RES] Network Name: Agent: ---- Module: Netbios with states: Offline/Idle (BeingBorn)
    00000998.0000075c::2013/05/08-20:45:01.112 INFO  [RES] Network Name <SQL Network Name (CPCTestSQLClus)>: SyncReplyHandler Configuration, result: 0
    00000998.000010e8::2013/05/08-20:45:01.112 INFO  [RES] Network Name: Agent: ---- Module: AdminShare with states: Closing/Ending (BeingBorn)
    00000998.000010e8::2013/05/08-20:45:01.112 INFO  [RES] Network Name: Agent: --- 7 modules for instance: 43dec41b-661c-42a8-ae23-b635d7ab11f5:
    00000998.000010e8::2013/05/08-20:45:01.112 INFO  [RES] Network Name: Agent: ---- Module: Configuration with states: Offline/Ending (BeingBorn)
    00000998.000010e8::2013/05/08-20:45:01.112 INFO  [RES] Network Name: Agent: ---- Module: AccountAD with states: Closing/Ending (BeingBorn)
    00000998.000010e8::2013/05/08-20:45:01.112 INFO  [RES] Network Name: Agent: ---- Module: Client with states: Offline/Idle (BeingBorn)
    00000998.000010e8::2013/05/08-20:45:01.112 INFO  [RES] Network Name: Agent: ---- Module: Identity with states: Offline/Idle (BeingBorn)
    00000998.000010e8::2013/05/08-20:45:01.112 INFO  [RES] Network Name: Agent: ---- Module: Dns with states: Offline/Idle (BeingBorn)
    00000998.000010e8::2013/05/08-20:45:01.112 INFO  [RES] Network Name: Agent: ---- Module: Netbios with states: Offline/Idle (BeingBorn)
    00000998.000010e8::2013/05/08-20:45:01.112 INFO  [RES] Network Name: Agent: ---- Module: AdminShare with states: Closing/Ending (BeingBorn)
    00000998.000010e8::2013/05/08-20:45:01.112 INFO  [RES] Network Name: Agent: --- 7 modules for instance: c03fb105-9a50-4d00-8bee-afaf693f7efc:
    00000998.000010e8::2013/05/08-20:45:01.112 INFO  [RES] Network Name: Agent: ---- Module: Configuration with states: Initialized/Idle (Alive)
    00000998.000010e8::2013/05/08-20:45:01.112 INFO  [RES] Network Name: Agent: ---- Module: AccountAD with states: Initializing/Idle (BeingBorn)
    00000998.000010e8::2013/05/08-20:45:01.112 INFO  [RES] Network Name: Agent: ---- Module: Client with states: Initialized/Idle (Alive)
    00000998.000010e8::2013/05/08-20:45:01.112 INFO  [RES] Network Name: Agent: ---- Module: Identity with states: Error/Idle (BeingBorn)
    00000998.000010e8::2013/05/08-20:45:01.112 INFO  [RES] Network Name: Agent: ---- Module: Dns with states: Initialized/Idle (Alive)
    00000998.000010e8::2013/05/08-20:45:01.112 INFO  [RES] Network Name: Agent: ---- Module: Netbios with states: Initialized/Idle (Alive)
    00000998.000010e8::2013/05/08-20:45:01.112 INFO  [RES] Network Name: Agent: ---- Module: AdminShare with states: Initialized/Idle (BeingBorn)
    00000998.000010e8::2013/05/08-20:45:01.112 INFO  [RES] Network Name: Agent: -- 0 Zombie modules
    000005a4.0000050c::2013/05/08-20:45:01.112 INFO  [RCM] HandleMonitorReply: TERMINATERESOURCE for 'SQL Network Name (CPCTestSQLClus)', gen(7) result 0/0.
    000005a4.0000050c::2013/05/08-20:45:01.112 INFO  [RCM] Res SQL Network Name (CPCTestSQLClus): [Terminating to DelayRestartingResource] -> DelayRestartingResource( StateUnknown )
    000005a4.0000050c::2013/05/08-20:45:01.112 INFO  [RCM] TransitionToState(SQL Network Name (CPCTestSQLClus)) [Terminating to DelayRestartingResource]-->DelayRestartingResource.
    000005a4.0000050c::2013/05/08-20:45:01.112 WARN  [RCM] Queueing immediate delay restart of resource SQL Network Name (CPCTestSQLClus) in 500 ms.
    000005a4.00001248::2013/05/08-20:45:01.112 INFO  [RCM-rbtr] giving default token to group SQL Server (MSSQLSERVER)
    000005a4.00001248::2013/05/08-20:45:01.112 INFO  [RCM-rbtr] giving default token to group SQL Server (MSSQLSERVER)
    000005a4.00001248::2013/05/08-20:45:01.112 INFO  [RCM-rbtr] giving default token to group SQL Server (MSSQLSERVER)
    000005a4.00001248::2013/05/08-20:45:01.112 INFO  [RCM-rbtr] giving default token to group SQL Server (MSSQLSERVER)
    000005a4.00001350::2013/05/08-20:45:01.112 INFO  [GEM] Sending 1 messages as a batched GEM message
    00000998.00000b78::2013/05/08-20:45:01.112 INFO  [RES] Network Name <SQL Network Name (CPCTestSQLClus)>: Getting Read/Write private properties
    000005a4.00001350::2013/05/08-20:45:01.112 INFO  [GEM] Sending 1 messages as a batched GEM message
    00000998.00000b78::2013/05/08-20:45:01.112 INFO  [RES] Network Name <SQL Network Name (CPCTestSQLClus)>: Getting Read only private properties
    00000998.00000b78::2013/05/08-20:45:01.127 INFO  [RES] Network Name <SQL Network Name (CPCTestSQLClus)>: Getting Read/Write private properties
    000005a4.00001350::2013/05/08-20:45:01.127 INFO  [GEM] Sending 1 messages as a batched GEM message
    00000998.00000b78::2013/05/08-20:45:01.127 INFO  [RES] Network Name <SQL Network Name (CPCTestSQLClus)>: Getting Read only private properties
    000005a4.00001350::2013/05/08-20:45:01.127 INFO  [GEM] Sending 1 messages as a batched GEM message
    000005a4.00001350::2013/05/08-20:45:01.127 INFO  [GEM] Sending 1 messages as a batched GEM message
    000005a4.00001350::2013/05/08-20:45:01.143 INFO  [GEM] Sending 1 messages as a batched GEM message
    00000998.00000b78::2013/05/08-20:45:01.252 INFO  [RES] Network Name: Agent: Sending request Netname/RecheckConfig to NN:c03fb105-9a50-4d00-8bee-afaf693f7efc:Netbios
    00000998.00000ab8::2013/05/08-20:45:01.252 INFO  [RES] Network Name <Cluster Name>: Netbios: Slow Operation, FinishWithReply: 0
    00000998.00000ab8::2013/05/08-20:45:01.252 INFO  [RES] Network Name:  [NN] got sync reply: 0
    00000998.00000ab8::2013/05/08-20:45:01.252 INFO  [RES] Network Name <Cluster Name>: Netbios: End of Slow Operation, state: Initialized/Idle, prevWorkState: Idle

  • Windows server 2012 failover cluster error: Cluster resource 'Virtual Machine Configuration ... of type 'Virtual machine configuration in clustered role ... failed.

    I have two windows 2012 host server that are clustered using windows failover cluster feature. Each server is hosting four VMs. When migrating from Host2 to Host1, the migration failed with the following error:
    Cluster resource 'Virtual Machine Configuration SCPCSQLSRV01' of type 'Virtual Machine Configuration' in clustered role 'SCPCSQLSRV01' failed. The error code was '0x569' ('Logon failure: the user has not been granted the requested logon type at this computer.').
    When this happens, the VM that I was migrating can no longer be started even on the original host. The only remedy is to restart the host server.
    Any suggestion on resolving this problem?
    Thanks
    Ikad

    Thanks. The article referred to above gives the solution to my issue. There is a group policy that is applied to the OU where the host servers were placed. Doing gpupdate /force temporarily removes the problem. Unfortunately the NT Virtual Machine\Virtual
    Machines account is a special account that cannot be added like other accounts and granted the log on as a service right. The thread
    http://social.technet.microsoft.com/Forums/en-US/winserverhyperv/thread/d56f2eae-726e-409a-8813-670a406593e8 contains how it can be added which is by creating a group and running the command
    Net localgroup VMTest “NT Virtual Machine\Virtual Machines” /add
    to add it to a local group VMTest. VMTest is then assigned the right to log on as a service.
    Ikad

  • Cluster resource 'Analysis Services' of type 'Generic Service' in clustered role 'SQL Server' failed.

    Windows Server 2012 R2
    SQL Server 2012
    After a recent cluster failover from node 1 to node 2, the Analysis Services role is in a failed state, with the service stopped. When attempting to start the service, there are two error messages captured in Failover Cluster Manager:
    Log Name:      System
    Source:        Microsoft-Windows-FailoverClustering
    Date:          4/10/2014 11:48:49 AM
    Event ID:      1042
    Task Category: Generic Service Resource
    Level:         Error
    Keywords:      
    User:          SYSTEM
    Computer:      HQ-HASQL-1.sbgnet.int
    Description:
    Generic service 'Analysis Services (HASQL)' failed with error '1067'. Please examine the application event log.
    Event Xml:
    <Event xmlns="http://schemas.microsoft.com/win/2004/08/events/event">
      <System>
        <Provider Name="Microsoft-Windows-FailoverClustering" Guid="{BAF908EA-3421-4CA9-9B84-6689B8C6F85F}" />
        <EventID>1042</EventID>
        <Version>0</Version>
        <Level>2</Level>
        <Task>16</Task>
        <Opcode>0</Opcode>
        <Keywords>0x8000000000000000</Keywords>
        <TimeCreated SystemTime="2014-04-10T15:48:49.752168200Z" />
        <EventRecordID>26212</EventRecordID>
        <Correlation />
        <Execution ProcessID="9036" ThreadID="14748" />
        <Channel>System</Channel>
        <Computer>HQ-HASQL-1.sbgnet.int</Computer>
        <Security UserID="S-1-5-18" />
      </System>
      <EventData>
        <Data Name="ResourceName">Analysis Services (HASQL)</Data>
        <Data Name="Status">1067</Data>
      </EventData>
    </Event>
    Log Name:      System
    Source:        Microsoft-Windows-FailoverClustering
    Date:          4/10/2014 11:48:49 AM
    Event ID:      1069
    Task Category: Resource Control Manager
    Level:         Error
    Keywords:      
    User:          SYSTEM
    Computer:      HQ-HASQL-1.sbgnet.int
    Description:
    Cluster resource 'Analysis Services (HASQL)' of type 'Generic Service' in clustered role 'SQL Server (HASQL)' failed.
    Based on the failure policies for the resource and role, the cluster service may try to bring the resource online on this node or move the group to another node of the cluster and then restart it.  Check the resource and group state using Failover Cluster
    Manager or the Get-ClusterResource Windows PowerShell cmdlet.
    Event Xml:
    <Event xmlns="http://schemas.microsoft.com/win/2004/08/events/event">
      <System>
        <Provider Name="Microsoft-Windows-FailoverClustering" Guid="{BAF908EA-3421-4CA9-9B84-6689B8C6F85F}" />
        <EventID>1069</EventID>
        <Version>1</Version>
        <Level>2</Level>
        <Task>3</Task>
        <Opcode>0</Opcode>
        <Keywords>0x8000000000000000</Keywords>
        <TimeCreated SystemTime="2014-04-10T15:48:49.752168200Z" />
        <EventRecordID>26213</EventRecordID>
        <Correlation />
        <Execution ProcessID="6464" ThreadID="9076" />
        <Channel>System</Channel>
        <Computer>HQ-HASQL-1.sbgnet.int</Computer>
        <Security UserID="S-1-5-18" />
      </System>
      <EventData>
        <Data Name="ResourceName">Analysis Services (HASQL)</Data>
        <Data Name="ResourceGroup">SQL Server (HASQL)</Data>
        <Data Name="ResTypeDll">Generic Service</Data>
      </EventData>
    </Event>
    With just these generic error messages being present, this has been difficult to diagnose. Some research has yielded possible resolutions of the Event Viewer log being full, .NET corruption, missing registry entries, but none of those seem to be the issue
    (Event Viewer logs cleared, Analysis services is working on the same physical servers in a different cluster, and the registry entries was only a supported issue for SQL Server 2008 and 2008 R2).
    Any help would be greatly appreciated.

    Bring up Configuration Manager, look at binary path for SSAS.  Make sure BOTH folders exist.  Sometimes with failovers mappings get screwed up.

  • The cluster resource could not be found-SAP ECC on Windows Server 2008 MSCS

    Hi,
    I'm installing SAP ECC 6.0 on Windows server 2008 MSCS Cluster. As mentioned in the guide, i've created a service and added a resource.
    I was able to successfully configure the DB installation and cluster configuration. But when I start the ASCS installation, the installation fails when it tries to create system folders with the following error.
    Error when sharing file system export (share) saploc : The cluster resource could not be found
    I'm using a user with domain admin access and also a member of the local administrators group. I've even tried to install using the domain administrator user but still the problem exists.
    Can anyone please let me know where am I going wrong ?
    NB: The host on which I'm installing is not a domain controller but it is a member of a domain.
    Regards,
    Varadharajan M

    Yes Krishna,
    I've not created any shared folders manually and I've used the "Use domain of current user" option.
    Actually SAPINST has created the usr and sap folder in the SAP drive (say E: drive) which is a clustered disk. The name of that clustered sidk is "Clustered Disk 1". I could able to open up the shared directories available in that SAP virtual host by issuing
    <SAPGRP>. I don't know where am I going wrong:( I've also opened a call with a SAP and waiting for their reply.
    Regards,
    Varadharajan M

  • Cluster Resource Failed in Clustered Role

    Hello All.
    We’re running our VMs on the Cluster of Hyper-V hosts of Windows Server 2012 R2.
    We frequently encounter the following error in the Cluster Events:
    “Cluster resource 'Virtual Machine VM123' of type 'Virtual Machine' in clustered role 'VM123' failed.
    Based on the failure policies for the resource and role, the cluster service may try to bring the resource online on this node or move the group to another node of the cluster and then restart
    it.  Check the resource and group state using Failover Cluster Manager or the Get-ClusterResource Windows PowerShell cmdlet.”
    VM123 is the hostname of VM. We encounter this error for most of the VMs, however the VMs keep running in the cluster.
    Anybody please guide me what this error mean.
    Please help and advise.
    Regards,
    Hasan Bin Hasib

    Hi Hasan Bin Hasib,
    Since in your description there don’t have others detail clue, in your current information we can get the VM123 resource at failed status, you can first run the cluster validation
    to verify whether your cluster configuration is correct and install the Recommended hotfixes and updates first.
    Recommended hotfixes and updates for Windows Server 2012 R2-based failover clusters
    https://support.microsoft.com/en-us/kb/2920151?wa=wsignin1.0
    Understanding how Failover Clustering Recovers from Unresponsive Resources
    http://blogs.msdn.com/b/clustering/archive/2013/01/24/10388009.aspx
    I’m glad to be of help to you!
    Please remember to mark the replies as answers if they help and unmark them if they provide no help. If you have feedback for TechNet Support, contact [email protected]

  • Cluster resource 'SQL Server' in Resource Group 'MSSQL' failed.

    Hi All,
    Last week we face problem on SQL server 2005 Cluster server.
    SQL cluster was down with below issue.
    Event 1069 : Cluster resource 'SQL Server' in Resource Group 'MSSQL' failed.  
    Event 19019 : [sqsrvres] CheckServiceAlive: Service is dead
    [sqsrvres] OnlineThread: service stopped while waiting for QP.
    [sqsrvres] OnlineThread: Error 1 bringing resource online
    Kindly any one provide resolution for my above issue.

    I have checked in event viewer Application error side error:  
    Event 19019 : [sqsrvres]
    CheckServiceAlive: Service is dead
    [sqsrvres] OnlineThread: service stopped while waiting for QP.
    [sqsrvres] OnlineThread: Error 1 bringing resource online
    System error :
    Event 1069 : Cluster resource 'SQL Server' in Resource
    Group 'MSSQL' failed.
    Before this no error is there in event viewer

  • Grid Infrastructure Does Not Start Cluster Resources

    Hello Gurus,
    I configured a 2 node RAC cluster using VirtualBox.It has been running fine all along and each time I started one of the nodes, I will definitely see all of other Cluster Resources will be started eventually.
    However, after I left it untouched for a month (VM is stopped), I found out that after starting up the machine, only local resource which is ONLINE.
    This is what I get:
    [grid@oel6-112-rac1 bin]$ ./crsctl status resource -t
    NAME           TARGET  STATE        SERVER                   STATE_DETAILS      
    Local Resources
    ora.CRS.dg
                   ONLINE  ONLINE       oel6-112-rac1                               
    ora.DATADG.dg
                   ONLINE  ONLINE       oel6-112-rac1                               
    ora.FRADG.dg
                   ONLINE  ONLINE       oel6-112-rac1                               
    ora.LISTENER.lsnr
                   OFFLINE OFFLINE      oel6-112-rac1                               
    ora.asm
                   ONLINE  ONLINE       oel6-112-rac1            Started            
    ora.gsd
                   OFFLINE OFFLINE      oel6-112-rac1                               
    ora.net1.network
                   ONLINE  ONLINE       oel6-112-rac1                               
    ora.ons
                   ONLINE  ONLINE       oel6-112-rac1                               
    Cluster Resources
    ora.LISTENER_SCAN1.lsnr
          1        OFFLINE OFFLINE                                                  
    ora.LISTENER_SCAN2.lsnr
          1        OFFLINE OFFLINE                                                  
    ora.LISTENER_SCAN3.lsnr
          1        OFFLINE OFFLINE                                                  
    ora.cvu
          1        OFFLINE OFFLINE                                                  
    ora.oc4j
          1        OFFLINE OFFLINE                                                  
    ora.oel6-112-rac1.vip
          1        OFFLINE OFFLINE                                                  
    ora.oel6-112-rac2.vip
          1        OFFLINE OFFLINE                                                  
    ora.racdb.db
          1        OFFLINE OFFLINE                               Instance Shutdown  
          2        OFFLINE OFFLINE                                                  
    ora.scan1.vip
          1        OFFLINE OFFLINE                                                  
    ora.scan2.vip
          1        OFFLINE OFFLINE                                                  
    ora.scan3.vip
          1        OFFLINE OFFLINE                                               
    and these are my other resources
    [grid@oel6-112-rac1 bin]$ ./crsctl status resource -t -init
    NAME           TARGET  STATE        SERVER                   STATE_DETAILS    
    Cluster Resources
    ora.asm
          1        ONLINE  ONLINE       oel6-112-rac1            Started          
    ora.cluster_interconnect.haip
          1        ONLINE  ONLINE       oel6-112-rac1                             
    ora.crf
          1        ONLINE  ONLINE       oel6-112-rac1                             
    ora.crsd
          1        ONLINE  ONLINE       oel6-112-rac1                             
    ora.cssd
          1        ONLINE  ONLINE       oel6-112-rac1                             
    ora.cssdmonitor
          1        ONLINE  ONLINE       oel6-112-rac1                             
    ora.ctssd
          1        ONLINE  ONLINE       oel6-112-rac1            ACTIVE:0         
    ora.diskmon
          1        OFFLINE OFFLINE                                                
    ora.evmd
          1        ONLINE  ONLINE       oel6-112-rac1                             
    ora.gipcd
          1        ONLINE  ONLINE       oel6-112-rac1                             
    ora.gpnpd
          1        ONLINE  ONLINE       oel6-112-rac1                             
    ora.mdnsd
          1        ONLINE  ONLINE       oel6-112-rac1                       
    Where do I supposed to check to see why the Cluster Resource like SCAN Listener, Database and etc not running?
    I've been checking on the logs but I haven't figured out what I should be looking at.
    Can some body help me?
    Thank you in advanced,
    Adhika

    Hi Freddie,
    I saw these lines on that Clusterware alert log:
    2013-07-01 22:39:20.084
    [crsd(3338)]CRS-1012:The OCR service started on node oel6-112-rac1.
    2013-07-01 22:39:20.208
    [evmd(3145)]CRS-1401:EVMD started on node oel6-112-rac1.
    2013-07-01 22:39:21.549
    [crsd(3338)]CRS-1201:CRSD started on node oel6-112-rac1.
    2013-07-01 22:39:22.715
    [/u01/app/11203/grid/bin/oraagent.bin(3450)]CRS-5016:Process "/u01/app/11203/grid/bin/lsnrctl" spawned by agent "/u01/app/11203/grid/bin/oraagent.bin" for action "check" failed: details at "(:CLSN00010:)" in "/u01/app/11203/grid/log/oel6-112-rac1/agent/crsd/oraagent_grid/oraagent_grid.log"
    2013-07-01 22:39:22.728
    [/u01/app/11203/grid/bin/oraagent.bin(3450)]CRS-5016:Process "/u01/app/11203/grid/bin/lsnrctl" spawned by agent "/u01/app/11203/grid/bin/oraagent.bin" for action "check" failed: details at "(:CLSN00010:)" in "/u01/app/11203/grid/log/oel6-112-rac1/agent/crsd/oraagent_grid/oraagent_grid.log"
    2013-07-01 22:39:22.772
    [/u01/app/11203/grid/bin/oraagent.bin(3450)]CRS-5016:Process "/u01/app/11203/grid/bin/lsnrctl" spawned by agent "/u01/app/11203/grid/bin/oraagent.bin" for action "check" failed: details at "(:CLSN00010:)" in "/u01/app/11203/grid/log/oel6-112-rac1/agent/crsd/oraagent_grid/oraagent_grid.log"
    2013-07-01 22:39:22.811
    [/u01/app/11203/grid/bin/oraagent.bin(3450)]CRS-5016:Process "/u01/app/11203/grid/bin/lsnrctl" spawned by agent "/u01/app/11203/grid/bin/oraagent.bin" for action "check" failed: details at "(:CLSN00010:)" in "/u01/app/11203/grid/log/oel6-112-rac1/agent/crsd/oraagent_grid/oraagent_grid.log"
    2013-07-01 22:39:23.069
    [/u01/app/11203/grid/bin/oraagent.bin(3450)]CRS-5016:Process "/u01/app/11203/grid/opmn/bin/onsctli" spawned by agent "/u01/app/11203/grid/bin/oraagent.bin" for action "check" failed: details at "(:CLSN00010:)" in "/u01/app/11203/grid/log/oel6-112-rac1/agent/crsd/oraagent_grid/oraagent_grid.log"
    2013-07-01 22:39:23.567
    [crsd(3338)]CRS-2772:Server 'oel6-112-rac1' has been assigned to pool 'Generic'.
    2013-07-01 22:39:23.568
    [crsd(3338)]CRS-2772:Server 'oel6-112-rac1' has been assigned to pool 'ora.racdb'.
    The I started looking in the /u01/app/11203/grid/log/oel6-112-rac1/agent/crsd/oraagent_grid/oraagent_grid.log file and found out that at the same time (2013-07-01 22:39:22),
    I saw the following lines:
    2013-07-01 22:39:22.433: [ora.CRS.dg][1644160768] {1:13152:2} [check] DgpAgent::getConnxn connection failure 1
    2013-07-01 22:39:22.433: [ora.CRS.dg][1644160768] {1:13152:2} [check] DgpAgent::getConnxn failed CRS-5000: Expected resource ora.asm does not exist in agent process
    2013-07-01 22:39:22.434: [ora.CRS.dg][1644160768] {1:13152:2} [check] DgpAgent::getConnxn try getInstanceInforWhenASMFail
    2013-07-01 22:39:22.434: [ora.CRS.dg][1644160768] {1:13152:2} [check] CrsCmd::ClscrsCmdData::stat entity 1 statflag 33 useFilter 0
    But that does not prevent the asm from being started properly.
    The only local resource that didn't start up automatically was the LISTENER.
    The following command shows that the local LISTENER has hard dependency on ora.cluster_vip_net1.type which is the ora.oel6-112-rac1.vip
    [grid@oel6-112-rac1 bin]$ ./crsctl status resource ora.LISTENER.lsnr -p | grep -ie dependencies
    START_DEPENDENCIES=hard(type:ora.cluster_vip_net1.type) pullup(type:ora.cluster_vip_net1.type)
    STOP_DEPENDENCIES=hard(intermediate:type:ora.cluster_vip_net1.type)
    NAME=ora.oel6-112-rac1.vip
    TYPE=ora.cluster_vip_net1.type
    START_DEPENDENCIES=hard(ora.net1.network) pullup(ora.net1.network)
    STOP_DEPENDENCIES=hard(ora.net1.network)
    [grid@oel6-112-rac1 bin]$ ./crsctl status resource ora.net1.network -p | grep -ie dependencies
    START_DEPENDENCIES=
    STOP_DEPENDENCIES=
    The ora.net1.network resource started properly and I didn't see that this prevent the ora.oel6-112-rac1.vip from starting up.
    The following lines also show that the ora.asm resource is has a weak dependency only against the ora.LISTENER.lsnr
    [grid@oel6-112-rac1 bin]$ ./crsctl status resource ora.racdb.db -p | grep -ie dependencies
    START_DEPENDENCIES=hard(ora.DATADG.dg,ora.FRADG.dg) weak(type:ora.listener.type,global:type:ora.scan_listener.type,uniform:ora.ons,global:ora.gns) pullup(ora.DATADG.dg,ora.FRADG.dg)
    STOP_DEPENDENCIES=hard(intermediate:ora.asm,shutdown:ora.DATADG.dg,shutdown:ora.FRADG.dg)
    [grid@oel6-112-rac1 bin]$ ./crsctl status resource ora.CRS.dg -p | grep -ie dependenci
    START_DEPENDENCIES=hard(ora.asm) pullup(ora.asm)
    STOP_DEPENDENCIES=hard(intermediate:ora.asm)
    [grid@oel6-112-rac1 bin]$ ./crsctl status resource ora.DATADG.dg -p | grep -ie dependencies
    START_DEPENDENCIES=hard(ora.asm) pullup(ora.asm)
    STOP_DEPENDENCIES=hard(intermediate:ora.asm)
    [grid@oel6-112-rac1 bin]$ ./crsctl status resource ora.FRADG.dg -p | grep -ie dependencies
    START_DEPENDENCIES=hard(ora.asm) pullup(ora.asm)
    STOP_DEPENDENCIES=hard(intermediate:ora.asm)
    [grid@oel6-112-rac1 bin]$ ./crsctl status resource ora.asm -p | grep -ie dependencies
    START_DEPENDENCIES=weak(ora.LISTENER.lsnr)
    STOP_DEPENDENCIES=
    I'm a little lost here.
    A suggestion would be very much appreciated.
    Thank you,
    Adhika

  • The cluster resource could not be brought online by the resource monitor.

    I'm installing Exchange 2007 CCR at a set of Windows server 2008 Virtual Machines.
    When I refer the doc to Configure the Node and File Share Majority Quorum, at the step 3 - 
    Bring the new File Share Witness resource online by running the following command:
    Cluster.exe res "File Share Witness (UNCPath)" /online
    I got the following error:
    System error 5018 has occurred (0x0000139a).
    The cluster resource could not be brought online by the resource monitor.
    How could I successfully Configure the Node and File Share Majority Quorum?

    Your link brings me back to this thread.  Not sure why, as I was able to find the article you reference with this link: 
    http://technet.microsoft.com/en-us/library/bb676490(v=EXCHG.80).aspx
    To ensure this works, you need to make sure the Exchange Servers group is in the Administrators group on the server hosting your FSW.
    FYI, Microsoft suggests that the FSW be hosted on a hub server.  This simplifies management, since the Exchange administrators will already be able to manage the server the FSW is hosted on, and all permissions are already in place for the messaging
    system.

  • Multiple Cluster Resource Names Possible?

    Scenario:
    We have 2003 R2 cluster resource groups that utilize multiple network name's per resource group to support legacy applications (and poor coding).  These must now be moved to a 2008 R2 Failover Cluster.  Is there a way to have only 1 IP address
    assigned, but have multiple network names to a 2008 R2 Resource Group?  The systems are already configured with the DisableStrictNameChecking and OptionalNames registry keys - but the cluster resource group is where I'm hitting a snag.
    Any way to accomplish this?  (Just add several names to the resource group using just the 1 IP)??
    Thanks!
    mark

    Hi Mark,
    I think we may have the following options to workaround this:
    1. Set several CNAMEs in DNS which point to the IP of your cluster.
    2. Edit Hosts file on clients so all different names are point to the same IP (the cluster). 
    If you have any feedback on our support, please send to [email protected]

Maybe you are looking for