Failover problem

Hi ,
On my test lab i am checking Failover to physical standby using sqlplus on 11202 .
I followed the example from : http://www.visi.com/~mseberg/resources.html
Its seems that i made somthing wrong since BOTH standby and primary currently shows:
SQL> select switchover_status,database_role from v$database;
SWITCHOVER_STATUS              DATABASE_ROLE
TO PRIMARY                     PHYSICAL STANDBYBelow are the steps i took:
Data Guard Failover Test using SQL
====================================
This failover will be to a Physical Standby.FRA is being used.
Things to check before beginning
===================================
1. Check if V$DATABASE for issues :
SQL> select switchover_status from v$database;
SWITCHOVER_STATUS
TO STANDBY2. Obtain the current sequence number on the primary :
SQL> select max(sequence#) from v$archived_log;
MAX(SEQUENCE#)
1163. Create a new user and add some data:
CREATE USER YOAV
  IDENTIFIED BY YOAV
  DEFAULT TABLESPACE USERS
  TEMPORARY TABLESPACE TEMP
  PROFILE DEFAULT
  ACCOUNT UNLOCK;
  GRANT CREATE SESSION TO YOAV;
  GRANT CONNECT TO YOAV;
  GRANT CREATE TABLE TO YOAV;
  create table yoav_test1
  (a number);
  insert into yoav_test1 values(10);
  insert into yoav_test1 values(20);
  insert into yoav_test1 values(30);
  commit;
SQL> select max(A) from yoav_test1;
    MAX(A)
        30
        4. Execute a shutdown immediate on the Primary
SQL> shutdown immediate
--> The following steps executed on the STNDBY
Failover to Physical Standby
============================
SQL> alter database recover managed standby database cancel;
Database altered.
SQL> alter database recover managed standby database finish;
Database altered.
SQL> alter database commit to switchover to primary with session shutdown;
Database altered.
SQL> alter database open;
alter database open
ERROR at line 1:
ORA-01531: a database already open by the instance
---------> This is beacuse it was already opened as read only  <-------------
SQL> shutdown immediate
Database closed.
Database dismounted.
ORACLE instance shut down.
SQL> startup
ORACLE instance started.
Total System Global Area 4710043648 bytes
Fixed Size                  2189112 bytes
Variable Size            2499807432 bytes
Database Buffers         2197815296 bytes
Redo Buffers               10231808 bytes
Database mounted.
Database opened.
SQL> select switchover_status from v$database;
SWITCHOVER_STATUS
TO PRIMARY--> I think at this point it should shows : TO STANDBY
For some reason i continue with the steps and execute:
SQL> SELECT TO_CHAR(STANDBY_BECAME_PRIMARY_SCN) FAILOVER_SCN FROM V$DATABASE;
FAILOVER_SCN
3357006--> The following stepes executed on the "old" primary:
/home/oracle:PRIMARY >sqlplus "/ as sysdba"
SQL> shutdown immediate
Database closed.
Database dismounted.
ORACLE instance shut down.
SQL> startup mount
ORACLE instance started.
Total System Global Area 4710043648 bytes
Fixed Size                  2189112 bytes
Variable Size            2550139080 bytes
Database Buffers         2147483648 bytes
Redo Buffers               10231808 bytes
Database mounted.
SQL> FLASHBACK DATABASE TO SCN 3357006;
Flashback complete.
SQL> ALTER DATABASE CONVERT TO PHYSICAL STANDBY;
Database altered.
SQL> SHUTDOWN IMMEDIATE;
ORA-01507: database not mounted
ORACLE instance shut down.
SQL> STARTUP MOUNT
ORACLE instance started.
SQL> alter database recover managed standby database using current logfile disconnect;
Database altered.
SQL> select switchover_status from v$database;
SWITCHOVER_STATUS
TO PRIMARYThanks

Yoav wrote:
Hi ,
Thanks for your help.
-- Originaly was the primary
SQL> select name,db_unique_name,database_role from v$database;
NAME                           DB_UNIQUE_NAME                 DATABASE_ROLE
DGTST                          DGTST                          PHYSICAL STANDBY
-- Originaly was the standby
SQL> select name,db_unique_name,database_role from v$database;
NAME                           DB_UNIQUE_NAME                 DATABASE_ROLE
DGTST                          DRTST                          PHYSICAL STANDBY
Now both are standby. None of the database is Primary
Here which database is Old Primary? is it DGTEST?
When you performing Failover on standby & Converting Primary as standby(manually)
Instead of that why you are not doing Switchover ?
If you want to perform manually & individually.
Then perform Falover from standby to primary as above mentioned commands.
SQL> ALTER DATABASE ACTIVATE STANDBY DATABASE;
or
SQL> ALTER DATABASE RECOVER MANAGED STANDBY DATABASE FINISH FORCE;
SQL> ALTER DATABASE COMMIT TO SWITCHOVER TO PRIMARY;
SQL> STARTUP MOUNT FORCE;

Similar Messages

  • Oracle RAC 11g R1 Release Connection Failover Problem

    Hi All,
    In our Architecture we are using Oracle RAC 11g R1. Below is the JDBC URL :
    JDBCURL = jdbc:oracle:thin:@(DESCRIPTION =(ADDRESS = (PROTOCOL = TCP)(HOST = Host1-vip)(PORT = 1521))(ADDRESS = (PROTOCOL = TCP)(HOST = Host2-vi
    p)(PORT = 1521))(LOAD_BALANCE = ON)(FAILOVER=ON)(CONNECT_DATA =(SERVER = DEDICATED)(SERVICE_NAME = <Service_name>)))
    We are using two node RAC. The problem is whenever we are rebooting a Node and rejoin the cluster, Application Servers are not able to recognize that.
    Suppose we have node1 and node2, I will take down node1 (freeze the cluster) and then reboot node1 and bring it back up( and join the cluster). At this point, My application servers are not able to recognize that some new DBserver(node1) had joined the cluster until I restart my application servers.
    Please Provide me a solution for this. Thanks alot to everyone in advance.
    Edited by: 877010 on Aug 4, 2011 2:00 PM
    Edited by: 877010 on Aug 8, 2011 10:19 AM

    Please try using this
    JDBCURL = jdbc:oracle:thin:@(DESCRIPTION =(ADDRESS = (PROTOCOL = TCP)(HOST = Host1-vip)(PORT = 1521))(ADDRESS = (PROTOCOL = TCP)(HOST = Host2-vi
    p)(PORT = 1521))(LOAD_BALANCE = YES)(FAILOVER=YES)(CONNECT_DATA =(SERVER = DEDICATED)(SERVICE_NAME = <Service_name>)))

  • ISE1.1.3 failover problems

    Hi guys
    I am going to write a short story and will try to explain the problem I have.
    Here is my setup. I have two ISE servers running I. Primary and secondary mode. Ise1 and ise2. Everything is configured and sync is complete. My access switch is a 2960 which has dot1x enabled and radius defined in the Config. It's using ISE 1 as primary and ise2 as secondary point of authentication. There are phones connected to switch and PCM behind the phone.
    The phones and pc authenticate using EAP-TLS which works fines when both servers are up and running. Printers use mab and video end points use EAP-PEAP. All good till here.
    When I shut down my primary server , phones printers and video endpoints authenticate without any problem. Pc is having issue and I am getting error message saying EAP timeout after120 seconds.
    Today just to test that ise servers are configured properly. I removed the primary server from 2960 Config. Now switch has only one radius server listed for authentication. Which is ISE 2. The authentication works fine. All of them. Then I shut down ise1 just for the sake of it. At this step I have ise2 running and 2960 switch has only one radius configured. Everything works fine here.
    The minute I add ISE 1 as primary radius server pc authentication fails and I get EAP time out message.
    Looks like I have to tweak some configuration on 2960 so that it failover to backup ISE ASAP. Has anyone seen that ?
    Thanks.
    Sent from Cisco Technical Support iPad App

    Do you have the following lines in your config?
    radius-server dead-criteria time 5 tries 3
    radius-server host auth-port 1812 acct-port 1813 test username radius-test key 7
    radius-server host auth-port 1812 acct-port 1813 test username radius-test key 7
    I could see a situation where you have the aaa server group configured, but not this, and your switch failed to identify the primary RADIUS server as down, forcing the issue of manual removal.

  • IOS NAT Load Balancing w/ Failover Problem

    Greetings, i am currently using the configuration below to provide failover between two DSL connections, all is working fine but i had expected outbound connections to be load balanced between the two DSL links on a round robin basis, however looking at the nat translations shows that only one of the links is being used, failover on the other hand works without issue.
    track 1 ip sla 1 reachability
    interface FastEthernet0/0
    ip address 10.50.1.254 255.255.255.0
    ip nat inside
    ip tcp adjust-mss 1452
    interface FastEthernet0/1
    ip address 192.168.1.6 255.255.255.0
    ip nat inside
    ip tcp adjust-mss 1452
    interface Dialer0
    description WAN Interface
    mtu 1492
    ip address **********
    no ip redirects
    no ip unreachables
    no ip proxy-arp
    ip nat outside
    encapsulation ppp
    dialer pool 1
    interface Dialer1
    description WAN Interface
    mtu 1492
    ip address **********
    no ip redirects
    no ip unreachables
    no ip proxy-arp
    ip nat outside
    encapsulation ppp
    dialer pool 2
    ip forward-protocol nd
    ip route 0.0.0.0 0.0.0.0 212.74.102.15 track 1
    ip route 0.0.0.0 0.0.0.0 213.246.177.200 10
    ip nat translation timeout 2
    ip nat translation tcp-timeout 2
    ip nat translation udp-timeout 2
    ip nat translation icmp-timeout 2
    ip nat inside source route-map opal interface Dialer1 overload oer
    ip nat inside source route-map pipex interface Dialer0 overload oer
    ip access-list extended dynamicNat
    permit ip 10.50.1.0 0.0.0.255 any
    permit ip 192.168.1.0 0.0.0.255 any
    deny ip any any
    ip sla 1
    icmp-echo 212.74.102.15
    frequency 5
    ip sla schedule 1 life forever start-time now
    route-map opal permit 10
    match ip address dynamicNat
    set ip next-hop 213.246.177.200
    route-map pipex permit 10
    match ip address dynamicNat
    set ip next-hop verify-availability 212.74.102.15 1 track 1
    Any assistance would be much appreciated.
    Regards

    Hi 
    Thank you for this post man ! this have been so useful. I experienced almost the same problem the router was load balancing well, but the failover was not occuring well between both equal default route.
    After using those command: ip nat translation timeout for tcp icmp and udp all the system has worked propertly.  yeah you need a Big bottle of Jack Daniel  :)    the funniest thing behind is that help me 5 years After......................!!!!

  • Cluster Disk failover problem

    Hi Everyone
    I have built a Windows 2008 R2 Failover Cluster. It is scheduled to be a HyperV cluster, but I have removed HyperV from the equation as I am having problems.
    Its a 2 node cluster connecting to a PS4000 via iscsi.
    Network config is
    Nic 1 - Host and Cluster Management - 10.160.19.x/24
    Nic 2 & 3 - icsci 10.160.46..x/24, MPIO,
    Nic 4 - CSV - 10.160.47/24
    Nic 5 - LiveMigration - 10.160.49.x/24
    Nic6 - VMSwitch - HyperV Virtual Machine "External" nic.
    The cluster ip is on 10.160.19.x.
    The Cluster validation passes sucessfully and so does creating the cluster and performing post creating validations. When I simulate failures of the Quorum disk, it fails over to the second node after requisites retrys on the first node...all good.
    However when I simulate failures on the second cluster disk, it just fails on the primary node. I can bring it online on same node or if I stop the cluster service on that node, everything successfully fails over to the second node. But automatic/simulating
    failover isn't working.
    When I dump out the cluster log(below)this is all the entries pertaining to the failover attempt. Sorry for the log dump.
    My analysis of the log, leads me in two directions, Is my nic assignment and config correct? Can I confirm the Cluster disk guids are identical between nodes?
    I appreciate any assistance. Apologies on the large log.
    Thanks
    [NM] Received request from client address 10.160.19.22.
    00000b18.00000f50::2011/01/13-16:10:32.005 ERR   [RHS] s_RhsRpcCreateResType: ERROR_NOT_READY(21)' because of 'Startup routine for ResType MSMQ returned 21.'
    00000730.00000d3c::2011/01/13-16:10:32.005 WARN  [RCM] Failed to load restype 'MSMQ': error 21.
    00000730.00000d3c::2011/01/13-16:10:32.005 WARN  [RCM] rcm::RcmApi::ResTypeControl: ResType MSMQ's DLL is not present on this node.  Attempting to find a good node...
    00000b18.00000f50::2011/01/13-16:10:32.005 ERR   [RHS] s_RhsRpcCreateResType: ERROR_NOT_READY(21)' because of 'Startup routine for ResType MSMQ returned 21.'
    00000730.00000d40::2011/01/13-16:10:32.005 WARN  [RCM] Failed to load restype 'MSMQ': error 21.
    00000b18.00000f50::2011/01/13-16:10:32.317 ERR   [RHS] s_RhsRpcCreateResType: ERROR_NOT_READY(21)' because of 'Startup routine for ResType MSMQTriggers returned 21.'
    00000730.00000d3c::2011/01/13-16:10:32.317 WARN  [RCM] Failed to load restype 'MSMQTriggers': error 21.
    00000730.00000d3c::2011/01/13-16:10:32.317 WARN  [RCM] rcm::RcmApi::ResTypeControl: ResType MSMQTriggers's DLL is not present on this node.  Attempting to find a good node...
    00000b18.00000f50::2011/01/13-16:10:32.317 ERR   [RHS] s_RhsRpcCreateResType: ERROR_NOT_READY(21)' because of 'Startup routine for ResType MSMQTriggers returned 21.'
    00000730.000005e0::2011/01/13-16:10:32.317 WARN  [RCM] Failed to load restype 'MSMQTriggers': error 21.
    00000b18.00000f50::2011/01/13-16:10:32.317 ERR   [RHS] s_RhsRpcCreateResType: ERROR_NOT_READY(21)' because of 'Startup routine for ResType MSMQ returned 21.'
    00000730.000005e0::2011/01/13-16:10:32.317 WARN  [RCM] Failed to load restype 'MSMQ': error 21.
    00000730.000005e0::2011/01/13-16:10:32.317 WARN  [RCM] rcm::RcmApi::ResTypeControl: ResType MSMQ's DLL is not present on this node.  Attempting to find a good node...
    00000b18.00000c1c::2011/01/13-16:10:32.317 ERR   [RHS] s_RhsRpcCreateResType: ERROR_NOT_READY(21)' because of 'Startup routine for ResType MSMQ returned 21.'
    00000730.00000d3c::2011/01/13-16:10:32.317 WARN  [RCM] Failed to load restype 'MSMQ': error 21.
    00000b18.00000c1c::2011/01/13-16:10:32.332 ERR   [RHS] s_RhsRpcCreateResType: ERROR_NOT_READY(21)' because of 'Startup routine for ResType MSMQTriggers returned 21.'
    00000730.00000d3c::2011/01/13-16:10:32.332 WARN  [RCM] Failed to load restype 'MSMQTriggers': error 21.
    00000730.00000d3c::2011/01/13-16:10:32.332 WARN  [RCM] rcm::RcmApi::ResTypeControl: ResType MSMQTriggers's DLL is not present on this node.  Attempting to find a good node...
    00000b18.00000c1c::2011/01/13-16:10:32.332 ERR   [RHS] s_RhsRpcCreateResType: ERROR_NOT_READY(21)' because of 'Startup routine for ResType MSMQTriggers returned 21.'
    00000730.00000d40::2011/01/13-16:10:32.332 WARN  [RCM] Failed to load restype 'MSMQTriggers': error 21.
    00000b18.00000c1c::2011/01/13-16:10:32.332 ERR   [RHS] s_RhsRpcCreateResType: ERROR_NOT_READY(21)' because of 'Startup routine for ResType MSMQ returned 21.'
    00000730.000005e0::2011/01/13-16:10:32.332 WARN  [RCM] Failed to load restype 'MSMQ': error 21.
    00000730.000005e0::2011/01/13-16:10:32.332 WARN  [RCM] rcm::RcmApi::ResTypeControl: ResType MSMQ's DLL is not present on this node.  Attempting to find a good node...
    00000b18.00000c1c::2011/01/13-16:10:32.332 ERR   [RHS] s_RhsRpcCreateResType: ERROR_NOT_READY(21)' because of 'Startup routine for ResType MSMQ returned 21.'
    00000730.00000d40::2011/01/13-16:10:32.332 WARN  [RCM] Failed to load restype 'MSMQ': error 21.
    00000b18.00000c1c::2011/01/13-16:10:32.332 ERR   [RHS] s_RhsRpcCreateResType: ERROR_NOT_READY(21)' because of 'Startup routine for ResType MSMQTriggers returned 21.'
    00000730.00000d3c::2011/01/13-16:10:32.332 WARN  [RCM] Failed to load restype 'MSMQTriggers': error 21.
    00000730.00000d3c::2011/01/13-16:10:32.332 WARN  [RCM] rcm::RcmApi::ResTypeControl: ResType MSMQTriggers's DLL is not present on this node.  Attempting to find a good node...
    00000b18.00000c1c::2011/01/13-16:10:32.332 ERR   [RHS] s_RhsRpcCreateResType: ERROR_NOT_READY(21)' because of 'Startup routine for ResType MSMQTriggers returned 21.'
    00000730.000005e0::2011/01/13-16:10:32.332 WARN  [RCM] Failed to load restype 'MSMQTriggers': error 21.
    00000730.00000d3c::2011/01/13-16:10:35.296 INFO  [RCM] rcm::RcmApi::FailResource: (VM1)
    00000730.00000d40::2011/01/13-16:10:35.296 INFO  [RCM] HandleMonitorReply: FAILURENOTIFICATION for 'VM1', gen(1) result 0.
    00000730.00000d40::2011/01/13-16:10:35.296 INFO  [RCM] TransitionToState(VM1) Online-->ProcessingFailure.
    00000730.00000d40::2011/01/13-16:10:35.296 INFO  [RCM] rcm::RcmGroup::UpdateStateIfChanged: (Available Storage, Online --> Failed)
    00000730.00000d40::2011/01/13-16:10:35.296 ERR   [RCM] rcm::RcmResource::HandleFailure: (VM1)
    00000730.00000d40::2011/01/13-16:10:35.296 INFO  [RCM] resource VM1: failure count: 1, restartAction: 2.
    00000730.00000d40::2011/01/13-16:10:35.296 INFO  [RCM] Will restart resource in 500 milliseconds.
    00000730.00000d40::2011/01/13-16:10:35.296 INFO  [RCM] TransitionToState(VM1) ProcessingFailure-->[WaitingToTerminate to DelayRestartingResource].
    00000730.00000d40::2011/01/13-16:10:35.296 INFO  [RCM] rcm::RcmGroup::UpdateStateIfChanged: (Available Storage, Failed --> Pending)
    00000730.00000d40::2011/01/13-16:10:35.296 INFO  [RCM] TransitionToState(VM1) [WaitingToTerminate to DelayRestartingResource]-->[Terminating to DelayRestartingResource].
    00000bd4.00000eb0::2011/01/13-16:10:35.296 INFO  [RES] Physical Disk <VM1>: Terminate request.
    00000bd4.00000eb0::2011/01/13-16:10:35.327 WARN  [RES] Physical Disk <VM1>: Terminate: Failed to offline volume \Device\Harddisk3\Partition1, Error 5
    00000b18.00000c1c::2011/01/13-16:10:35.343 ERR   [RHS] s_RhsRpcCreateResType: ERROR_NOT_READY(21)' because of 'Startup routine for ResType MSMQ returned 21.'
    00000730.00000d3c::2011/01/13-16:10:35.343 WARN  [RCM] Failed to load restype 'MSMQ': error 21.
    00000730.00000d3c::2011/01/13-16:10:35.343 WARN  [RCM] rcm::RcmApi::ResTypeControl: ResType MSMQ's DLL is not present on this node.  Attempting to find a good node...
    00000b18.00000c1c::2011/01/13-16:10:35.343 ERR   [RHS] s_RhsRpcCreateResType: ERROR_NOT_READY(21)' because of 'Startup routine for ResType MSMQ returned 21.'
    00000730.00000d30::2011/01/13-16:10:35.343 WARN  [RCM] Failed to load restype 'MSMQ': error 21.
    00000bd4.00000eb0::2011/01/13-16:10:35.343 INFO  [RES] Physical Disk <VM1>: HardDiskpCloseSVIHandles: Exit
    00000b18.00000c1c::2011/01/13-16:10:35.343 ERR   [RHS] s_RhsRpcCreateResType: ERROR_NOT_READY(21)' because of 'Startup routine for ResType MSMQTriggers returned 21.'
    00000730.00000d3c::2011/01/13-16:10:35.343 WARN  [RCM] Failed to load restype 'MSMQTriggers': error 21.
    00000730.00000d3c::2011/01/13-16:10:35.343 WARN  [RCM] rcm::RcmApi::ResTypeControl: ResType MSMQTriggers's DLL is not present on this node.  Attempting to find a good node...
    00000b18.00000c1c::2011/01/13-16:10:35.343 ERR   [RHS] s_RhsRpcCreateResType: ERROR_NOT_READY(21)' because of 'Startup routine for ResType MSMQTriggers returned 21.'
    00000730.00000d30::2011/01/13-16:10:35.343 WARN  [RCM] Failed to load restype 'MSMQTriggers': error 21.
    00000b18.00000c1c::2011/01/13-16:10:35.359 ERR   [RHS] s_RhsRpcCreateResType: ERROR_NOT_READY(21)' because of 'Startup routine for ResType MSMQ returned 21.'
    00000730.00000d3c::2011/01/13-16:10:35.359 WARN  [RCM] Failed to load restype 'MSMQ': error 21.
    00000730.00000d3c::2011/01/13-16:10:35.359 WARN  [RCM] rcm::RcmApi::ResTypeControl: ResType MSMQ's DLL is not present on this node.  Attempting to find a good node...
    00000b18.00000c1c::2011/01/13-16:10:35.359 ERR   [RHS] s_RhsRpcCreateResType: ERROR_NOT_READY(21)' because of 'Startup routine for ResType MSMQ returned 21.'
    00000730.00000d30::2011/01/13-16:10:35.359 WARN  [RCM] Failed to load restype 'MSMQ': error 21.
    00000b18.00000c1c::2011/01/13-16:10:35.359 ERR   [RHS] s_RhsRpcCreateResType: ERROR_NOT_READY(21)' because of 'Startup routine for ResType MSMQTriggers returned 21.'
    00000730.00000d3c::2011/01/13-16:10:35.359 WARN  [RCM] Failed to load restype 'MSMQTriggers': error 21.
    00000730.00000d3c::2011/01/13-16:10:35.359 WARN  [RCM] rcm::RcmApi::ResTypeControl: ResType MSMQTriggers's DLL is not present on this node.  Attempting to find a good node...
    00000b18.00000c1c::2011/01/13-16:10:35.359 ERR   [RHS] s_RhsRpcCreateResType: ERROR_NOT_READY(21)' because of 'Startup routine for ResType MSMQTriggers returned 21.'
    00000730.00000d30::2011/01/13-16:10:35.359 WARN  [RCM] Failed to load restype 'MSMQTriggers': error 21.
    00000b18.00000c1c::2011/01/13-16:10:35.437 ERR   [RHS] s_RhsRpcCreateResType: ERROR_NOT_READY(21)' because of 'Startup routine for ResType MSMQ returned 21.'
    00000730.00000d3c::2011/01/13-16:10:35.437 WARN  [RCM] Failed to load restype 'MSMQ': error 21.
    00000730.00000d3c::2011/01/13-16:10:35.437 WARN  [RCM] rcm::RcmApi::ResTypeControl: ResType MSMQ's DLL is not present on this node.  Attempting to find a good node...
    00000b18.00000c1c::2011/01/13-16:10:35.437 ERR   [RHS] s_RhsRpcCreateResType: ERROR_NOT_READY(21)' because of 'Startup routine for ResType MSMQ returned 21.'
    00000730.00000d30::2011/01/13-16:10:35.437 WARN  [RCM] Failed to load restype 'MSMQ': error 21.
    00000b18.00000c1c::2011/01/13-16:10:35.452 ERR   [RHS] s_RhsRpcCreateResType: ERROR_NOT_READY(21)' because of 'Startup routine for ResType MSMQTriggers returned 21.'
    00000730.00000d3c::2011/01/13-16:10:35.452 WARN  [RCM] Failed to load restype 'MSMQTriggers': error 21.
    00000730.00000d3c::2011/01/13-16:10:35.452 WARN  [RCM] rcm::RcmApi::ResTypeControl: ResType MSMQTriggers's DLL is not present on this node.  Attempting to find a good node...
    00000b18.00000c1c::2011/01/13-16:10:35.452 ERR   [RHS] s_RhsRpcCreateResType: ERROR_NOT_READY(21)' because of 'Startup routine for ResType MSMQTriggers returned 21.'
    00000730.00000d30::2011/01/13-16:10:35.452 WARN  [RCM] Failed to load restype 'MSMQTriggers': error 21.
    00000b18.00000c1c::2011/01/13-16:10:35.452 ERR   [RHS] s_RhsRpcCreateResType: ERROR_NOT_READY(21)' because of 'Startup routine for ResType MSMQ returned 21.'
    00000730.00000d3c::2011/01/13-16:10:35.452 WARN  [RCM] Failed to load restype 'MSMQ': error 21.
    00000730.00000d3c::2011/01/13-16:10:35.452 WARN  [RCM] rcm::RcmApi::ResTypeControl: ResType MSMQ's DLL is not present on this node.  Attempting to find a good node...
    00000b18.00000c1c::2011/01/13-16:10:35.452 ERR   [RHS] s_RhsRpcCreateResType: ERROR_NOT_READY(21)' because of 'Startup routine for ResType MSMQ returned 21.'
    00000730.00000d30::2011/01/13-16:10:35.452 WARN  [RCM] Failed to load restype 'MSMQ': error 21.
    00000b18.00000c1c::2011/01/13-16:10:35.452 ERR   [RHS] s_RhsRpcCreateResType: ERROR_NOT_READY(21)' because of 'Startup routine for ResType MSMQTriggers returned 21.'
    00000730.00000d3c::2011/01/13-16:10:35.452 WARN  [RCM] Failed to load restype 'MSMQTriggers': error 21.
    00000730.00000d3c::2011/01/13-16:10:35.452 WARN  [RCM] rcm::RcmApi::ResTypeControl: ResType MSMQTriggers's DLL is not present on this node.  Attempting to find a good node...
    00000b18.00000c1c::2011/01/13-16:10:35.452 ERR   [RHS] s_RhsRpcCreateResType: ERROR_NOT_READY(21)' because of 'Startup routine for ResType MSMQTriggers returned 21.'
    00000730.00000d30::2011/01/13-16:10:35.452 WARN  [RCM] Failed to load restype 'MSMQTriggers': error 21.
    00000bd4.00000eb0::2011/01/13-16:10:36.263 INFO  [RES] Physical Disk: ReleaseDisk: stop reserve succeeded on device 3 (sig 44423655)
    00000730.00000d30::2011/01/13-16:10:36.279 INFO  [RCM] HandleMonitorReply: TERMINATERESOURCE for 'VM1', gen(2) result 0.
    00000730.00000d30::2011/01/13-16:10:36.279 INFO  [RCM] TransitionToState(VM1) [Terminating to DelayRestartingResource]-->DelayRestartingResource.
    00000730.00000d3c::2011/01/13-16:10:36.794 INFO  [RCM] Delay-restarting VM1 and any waiting dependents.
    00000730.00000d3c::2011/01/13-16:10:36.794 INFO  [RCM] TransitionToState(VM1) DelayRestartingResource-->OnlineCallIssued.
    00000bd4.00000eb0::2011/01/13-16:10:36.794 INFO  [RES] Physical Disk <VM1>: Online request.
    00000730.00000298::2011/01/13-16:10:36.794 INFO  [RCM] HandleMonitorReply: ONLINERESOURCE for 'VM1', gen(2) result 997.
    00000730.00000298::2011/01/13-16:10:36.794 INFO  [RCM] TransitionToState(VM1) OnlineCallIssued-->OnlinePending.
    00000bd4.00000c04::2011/01/13-16:10:36.794 INFO  [RES] Physical Disk <VM1>: Arbitrate request: FastPath 0
    00000bd4.00000c04::2011/01/13-16:10:36.794 INFO  [RES] Physical Disk: Enter EnumerateDevices: EnumDevice 0
    00000bd4.00000c04::2011/01/13-16:10:36.809 INFO  [RES] Physical Disk: Exit EnumerateDevices: status 0
    00000bd4.00000c04::2011/01/13-16:10:36.841 INFO  [RES] Physical Disk: Successful reserve, disk is unowned, key 4daf7466734d
    00000bd4.00000c04::2011/01/13-16:10:36.841 INFO  [RES] Physical Disk: Update disk props returns 0
    00000bd4.00000c04::2011/01/13-16:10:36.841 INFO  [RES] Physical Disk <VM1>: Disk is offline
    00000730.00000298::2011/01/13-16:10:36.841 INFO  [GUM] Node 1: Processing RequestLock 1:42
    00000730.00000314::2011/01/13-16:10:36.841 INFO  [GUM] Node 1: Processing GrantLock to 1 (sent by 2 gumid: 566)
    00000bd4.00000c04::2011/01/13-16:10:36.841 WARN  [RES] Physical Disk <VM1>: OnlineThread: Failed to get volume guid for device
    \\?\GLOBALROOT\Device\Harddisk3\Partition1\. Error 3
    00000b18.00000c1c::2011/01/13-16:10:36.856 ERR   [RHS] s_RhsRpcCreateResType: ERROR_NOT_READY(21)' because of 'Startup routine for ResType MSMQ returned 21.'
    00000730.00000d3c::2011/01/13-16:10:36.856 WARN  [RCM] Failed to load restype 'MSMQ': error 21.
    00000730.00000d3c::2011/01/13-16:10:36.856 WARN  [RCM] rcm::RcmApi::ResTypeControl: ResType MSMQ's DLL is not present on this node.  Attempting to find a good node...
    00000bd4.00000bf8::2011/01/13-16:10:36.856 INFO  [RES] Physical Disk: PNP: Adding volume
    \\?\STORAGE#Volume#{73432ff7-18ee-11e0-aded-0026b93b46a0}#0000000000100000#{53f5630d-b6bf-11d0-94f2-00a0c91efb8b}
    00000bd4.00000f30::2011/01/13-16:10:36.856 INFO  [RES] Physical Disk <VM1>: Completed HardDiskpUpdateRegistryWorker (start time 16:10:36.841)
    00000bd4.00000bf8::2011/01/13-16:10:36.856 INFO  [RES] Physical Disk: PNP: Add Volume exit, status 0
    00000b18.00000c1c::2011/01/13-16:10:36.856 ERR   [RHS] s_RhsRpcCreateResType: ERROR_NOT_READY(21)' because of 'Startup routine for ResType MSMQ returned 21.'
    00000730.00000d40::2011/01/13-16:10:36.856 WARN  [RCM] Failed to load restype 'MSMQ': error 21.
    00000b18.00000c1c::2011/01/13-16:10:36.856 ERR   [RHS] s_RhsRpcCreateResType: ERROR_NOT_READY(21)' because of 'Startup routine for ResType MSMQTriggers returned 21.'
    00000730.00000d3c::2011/01/13-16:10:36.856 WARN  [RCM] Failed to load restype 'MSMQTriggers': error 21.
    00000730.00000d3c::2011/01/13-16:10:36.856 WARN  [RCM] rcm::RcmApi::ResTypeControl: ResType MSMQTriggers's DLL is not present on this node.  Attempting to find a good node...
    00000b18.00000c1c::2011/01/13-16:10:36.856 ERR   [RHS] s_RhsRpcCreateResType: ERROR_NOT_READY(21)' because of 'Startup routine for ResType MSMQTriggers returned 21.'
    00000730.00000d40::2011/01/13-16:10:36.856 WARN  [RCM] Failed to load restype 'MSMQTriggers': error 21.
    00000b18.00000c1c::2011/01/13-16:10:36.872 ERR   [RHS] s_RhsRpcCreateResType: ERROR_NOT_READY(21)' because of 'Startup routine for ResType MSMQ returned 21.'
    00000730.00000d3c::2011/01/13-16:10:36.872 WARN  [RCM] Failed to load restype 'MSMQ': error 21.
    00000730.00000d3c::2011/01/13-16:10:36.872 WARN  [RCM] rcm::RcmApi::ResTypeControl: ResType MSMQ's DLL is not present on this node.  Attempting to find a good node...
    00000b18.00000c1c::2011/01/13-16:10:36.872 ERR   [RHS] s_RhsRpcCreateResType: ERROR_NOT_READY(21)' because of 'Startup routine for ResType MSMQ returned 21.'
    00000730.00000d40::2011/01/13-16:10:36.872 WARN  [RCM] Failed to load restype 'MSMQ': error 21.
    00000b18.00000c1c::2011/01/13-16:10:36.872 ERR   [RHS] s_RhsRpcCreateResType: ERROR_NOT_READY(21)' because of 'Startup routine for ResType MSMQTriggers returned 21.'
    00000730.00000d3c::2011/01/13-16:10:36.872 WARN  [RCM] Failed to load restype 'MSMQTriggers': error 21.
    00000730.00000d3c::2011/01/13-16:10:36.872 WARN  [RCM] rcm::RcmApi::ResTypeControl: ResType MSMQTriggers's DLL is not present on this node.  Attempting to find a good node...
    00000b18.00000c1c::2011/01/13-16:10:36.872 ERR   [RHS] s_RhsRpcCreateResType: ERROR_NOT_READY(21)' because of 'Startup routine for ResType MSMQTriggers returned 21.'
    00000730.00000298::2011/01/13-16:10:36.872 WARN  [RCM] Failed to load restype 'MSMQTriggers': error 21.
    00000bd4.00000c04::2011/01/13-16:10:40.850 WARN  [RES] Physical Disk <VM1>: OnlineThread: Failed to set volguid \??\Volume{7343300a-18ee-11e0-aded-0026b93b46a0}. Error: 183.
    00000bd4.00000c04::2011/01/13-16:10:40.850 INFO  [RES] Physical Disk <VM1>: Found 2 mount points for device \Device\Harddisk3\Partition1
    00000bd4.00000c04::2011/01/13-16:10:40.850 INFO  [RES] Physical Disk <VM1>: VolumeIsNtfs: Volume
    \\?\GLOBALROOT\Device\Harddisk3\Partition1\ has FS type NTFS
    00000bd4.00000c04::2011/01/13-16:10:40.850 INFO  [RES] Physical Disk: Volume
    \\?\GLOBALROOT\Device\Harddisk3\Partition1\ has FS type NTFS
    00000bd4.00000c04::2011/01/13-16:10:40.850 INFO  [RES] Physical Disk: MountPoint V:\ points to volume
    \\?\Volume{7343300a-18ee-11e0-aded-0026b93b46a0}\
    00000bd4.00000c04::2011/01/13-16:10:40.850 DBG   [ClRtl] CaptureShareInfo: Share 0000000000000050, Server 0000000000000000, Path 0000000000000056 SD 0000000000000000 size 242
    00000bd4.00000c04::2011/01/13-16:10:40.850 WARN  [ClRtl] SsCoreShareAdd(): status = 2118 share = V$ server = (null)
    00000bd4.00000c04::2011/01/13-16:10:40.850 DBG   [ClRtl] CaptureShareInfo: Share 0000000000000050, Server 0000000000000000, Path 0000000000000056 SD 0000000000000000 size 242
    00000bd4.00000c04::2011/01/13-16:10:40.850 INFO  [RHS] Resource VM1 has come online. RHS is about to report status change to RCM
    00000730.00000d3c::2011/01/13-16:10:40.850 INFO  [RCM] HandleMonitorReply: ONLINERESOURCE for 'VM1', gen(2) result 0.
    00000730.00000d3c::2011/01/13-16:10:40.850 INFO  [RCM] TransitionToState(VM1) OnlinePending-->Online.
    00000730.00000d3c::2011/01/13-16:10:40.850 INFO  [RCM] rcm::RcmGroup::UpdateStateIfChanged: (Available Storage, Pending --> Online)
    00000bd4.00000c04::2011/01/13-16:10:40.850 INFO  [RES] Physical Disk: DriveLetter mask: 0x200000
    00000b18.00000c1c::2011/01/13-16:10:40.896 ERR   [RHS] s_RhsRpcCreateResType: ERROR_NOT_READY(21)' because of 'Startup routine for ResType MSMQ returned 21.'
    00000730.00000d30::2011/01/13-16:10:40.896 WARN  [RCM] Failed to load restype 'MSMQ': error 21.
    00000730.00000d30::2011/01/13-16:10:40.896 WARN  [RCM] rcm::RcmApi::ResTypeControl: ResType MSMQ's DLL is not present on this node.  Attempting to find a good node...
    00000b18.00000c1c::2011/01/13-16:10:40.896 ERR   [RHS] s_RhsRpcCreateResType: ERROR_NOT_READY(21)' because of 'Startup routine for ResType MSMQ returned 21.'
    00000730.000006d8::2011/01/13-16:10:40.896 WARN  [RCM] Failed to load restype 'MSMQ': error 21.
    00000b18.00000c1c::2011/01/13-16:10:40.912 ERR   [RHS] s_RhsRpcCreateResType: ERROR_NOT_READY(21)' because of 'Startup routine for ResType MSMQTriggers returned 21.'
    00000730.00000d30::2011/01/13-16:10:40.912 WARN  [RCM] Failed to load restype 'MSMQTriggers': error 21.
    00000730.00000d30::2011/01/13-16:10:40.912 WARN  [RCM] rcm::RcmApi::ResTypeControl: ResType MSMQTriggers's DLL is not present on this node.  Attempting to find a good node...
    00000b18.00000c1c::2011/01/13-16:10:40.912 ERR   [RHS] s_RhsRpcCreateResType: ERROR_NOT_READY(21)' because of 'Startup routine for ResType MSMQTriggers returned 21.'
    00000730.000006d8::2011/01/13-16:10:40.912 WARN  [RCM] Failed to load restype 'MSMQTriggers': error 21.
    00000b18.00000c1c::2011/01/13-16:10:40.912 ERR   [RHS] s_RhsRpcCreateResType: ERROR_NOT_READY(21)' because of 'Startup routine for ResType MSMQ returned 21.'
    00000730.00000d30::2011/01/13-16:10:40.912 WARN  [RCM] Failed to load restype 'MSMQ': error 21.
    00000730.00000d30::2011/01/13-16:10:40.912 WARN  [RCM] rcm::RcmApi::ResTypeControl: ResType MSMQ's DLL is not present on this node.  Attempting to find a good node...
    00000b18.00000c1c::2011/01/13-16:10:40.912 ERR   [RHS] s_RhsRpcCreateResType: ERROR_NOT_READY(21)' because of 'Startup routine for ResType MSMQ returned 21.'
    00000730.000006d8::2011/01/13-16:10:40.912 WARN  [RCM] Failed to load restype 'MSMQ': error 21.
    00000b18.00000c1c::2011/01/13-16:10:40.912 ERR   [RHS] s_RhsRpcCreateResType: ERROR_NOT_READY(21)' because of 'Startup routine for ResType MSMQTriggers returned 21.'
    00000730.00000d30::2011/01/13-16:10:40.912 WARN  [RCM] Failed to load restype 'MSMQTriggers': error 21.
    00000730.00000d30::2011/01/13-16:10:40.912 WARN  [RCM] rcm::RcmApi::ResTypeControl: ResType MSMQTriggers's DLL is not present on this node.  Attempting to find a good node...
    00000b18.00000c1c::2011/01/13-16:10:40.912 ERR   [RHS] s_RhsRpcCreateResType: ERROR_NOT_READY(21)' because of 'Startup routine for ResType MSMQTriggers returned 21.'
    00000730.000006d8::2011/01/13-16:10:40.912 WARN  [RCM] Failed to load restype 'MSMQTriggers': error 21.
    00000b18.00000c1c::2011/01/13-16:10:40.928 ERR   [RHS] s_RhsRpcCreateResType: ERROR_NOT_READY(21)' because of 'Startup routine for ResType MSMQ returned 21.'
    00000730.00000d30::2011/01/13-16:10:40.928 WARN  [RCM] Failed to load restype 'MSMQ': error 21.
    00000730.00000d30::2011/01/13-16:10:40.928 WARN  [RCM] rcm::RcmApi::ResTypeControl: ResType MSMQ's DLL is not present on this node.  Attempting to find a good node...
    00000b18.00000c1c::2011/01/13-16:10:40.928 ERR   [RHS] s_RhsRpcCreateResType: ERROR_NOT_READY(21)' because of 'Startup routine for ResType MSMQ returned 21.'
    00000730.000006d8::2011/01/13-16:10:40.928 WARN  [RCM] Failed to load restype 'MSMQ': error 21.
    00000b18.00000c1c::2011/01/13-16:10:40.928 ERR   [RHS] s_RhsRpcCreateResType: ERROR_NOT_READY(21)' because of 'Startup routine for ResType MSMQTriggers returned 21.'
    00000730.00000d30::2011/01/13-16:10:40.928 WARN  [RCM] Failed to load restype 'MSMQTriggers': error 21.
    00000730.00000d30::2011/01/13-16:10:40.928 WARN  [RCM] rcm::RcmApi::ResTypeControl: ResType MSMQTriggers's DLL is not present on this node.  Attempting to find a good node...
    00000b18.00000c1c::2011/01/13-16:10:40.928 ERR   [RHS] s_RhsRpcCreateResType: ERROR_NOT_READY(21)' because of 'Startup routine for ResType MSMQTriggers returned 21.'
    00000730.000006d8::2011/01/13-16:10:40.928 WARN  [RCM] Failed to load restype 'MSMQTriggers': error 21.
    00000b18.00000c1c::2011/01/13-16:10:40.943 ERR   [RHS] s_RhsRpcCreateResType: ERROR_NOT_READY(21)' because of 'Startup routine for ResType MSMQ returned 21.'
    00000730.00000d30::2011/01/13-16:10:40.943 WARN  [RCM] Failed to load restype 'MSMQ': error 21.
    00000730.00000d30::2011/01/13-16:10:40.943 WARN  [RCM] rcm::RcmApi::ResTypeControl: ResType MSMQ's DLL is not present on this node.  Attempting to find a good node...
    00000b18.00000c1c::2011/01/13-16:10:40.943 ERR   [RHS] s_RhsRpcCreateResType: ERROR_NOT_READY(21)' because of 'Startup routine for ResType MSMQ returned 21.'
    00000730.000006d8::2011/01/13-16:10:40.943 WARN  [RCM] Failed to load restype 'MSMQ': error 21.
    00000b18.00000c1c::2011/01/13-16:10:40.943 ERR   [RHS] s_RhsRpcCreateResType: ERROR_NOT_READY(21)' because of 'Startup routine for ResType MSMQTriggers returned 21.'
    00000730.00000d30::2011/01/13-16:10:40.943 WARN  [RCM] Failed to load restype 'MSMQTriggers': error 21.
    00000730.00000d30::2011/01/13-16:10:40.943 WARN  [RCM] rcm::RcmApi::ResTypeControl: ResType MSMQTriggers's DLL is not present on this node.  Attempting to find a good node...
    00000b18.00000c1c::2011/01/13-16:10:40.943 ERR   [RHS] s_RhsRpcCreateResType: ERROR_NOT_READY(21)' because of 'Startup routine for ResType MSMQTriggers returned 21.'
    00000730.000006d8::2011/01/13-16:10:40.943 WARN  [RCM] Failed to load restype 'MSMQTriggers': error 21.
    00000730.00000d30::2011/01/13-16:10:47.354 INFO  [RCM] rcm::RcmApi::FailResource: (VM1)
    00000730.00000d40::2011/01/13-16:10:47.354 INFO  [RCM] HandleMonitorReply: FAILURENOTIFICATION for 'VM1', gen(3) result 0.
    00000730.00000d40::2011/01/13-16:10:47.354 INFO  [RCM] TransitionToState(VM1) Online-->ProcessingFailure.
    00000730.00000d40::2011/01/13-16:10:47.354 INFO  [RCM] rcm::RcmGroup::UpdateStateIfChanged: (Available Storage, Online --> Failed)
    00000730.00000d40::2011/01/13-16:10:47.354 ERR   [RCM] rcm::RcmResource::HandleFailure: (VM1)
    00000730.00000d40::2011/01/13-16:10:47.354 INFO  [RCM] resource VM1: failure count: 2, restartAction: 2.
    00000730.00000d40::2011/01/13-16:10:47.354 INFO  [RCM] TransitionToState(VM1) ProcessingFailure-->[WaitingToTerminate to Failed].
    00000730.00000d40::2011/01/13-16:10:47.354 INFO  [RCM] rcm::RcmGroup::UpdateStateIfChanged: (Available Storage, Failed --> Pending)
    00000730.00000d40::2011/01/13-16:10:47.354 INFO  [RCM] TransitionToState(VM1) [WaitingToTerminate to Failed]-->[Terminating to Failed].
    00000bd4.00000eb0::2011/01/13-16:10:47.354 INFO  [RES] Physical Disk <VM1>: Terminate request.
    00000730.00000d40::2011/01/13-16:10:47.354 INFO  [RCM] Resource VM1 is causing group Available Storage to failover.  Posting worker thread.
    00000730.00000d40::2011/01/13-16:10:47.354 INFO  [RCM] rcm::RcmGroup::Failover: (Available Storage)
    00000bd4.00000eb0::2011/01/13-16:10:47.417 WARN  [RES] Physical Disk <VM1>: Terminate: Failed to offline volume \Device\Harddisk3\Partition1, Error 5
    00000b18.00000c1c::2011/01/13-16:10:47.432 ERR   [RHS] s_RhsRpcCreateResType: ERROR_NOT_READY(21)' because of 'Startup routine for ResType MSMQ returned 21.'
    00000730.0000076c::2011/01/13-16:10:47.432 WARN  [RCM] Failed to load restype 'MSMQ': error 21.
    00000730.0000076c::2011/01/13-16:10:47.432 WARN  [RCM] rcm::RcmApi::ResTypeControl: ResType MSMQ's DLL is not present on this node.  Attempting to find a good node...
    00000b18.00000c1c::2011/01/13-16:10:47.432 ERR   [RHS] s_RhsRpcCreateResType: ERROR_NOT_READY(21)' because of 'Startup routine for ResType MSMQ returned 21.'
    00000730.00000d30::2011/01/13-16:10:47.432 WARN  [RCM] Failed to load restype 'MSMQ': error 21.
    00000b18.00000c1c::2011/01/13-16:10:47.432 ERR   [RHS] s_RhsRpcCreateResType: ERROR_NOT_READY(21)' because of 'Startup routine for ResType MSMQTriggers returned 21.'
    00000730.0000076c::2011/01/13-16:10:47.432 WARN  [RCM] Failed to load restype 'MSMQTriggers': error 21.
    00000730.0000076c::2011/01/13-16:10:47.432 WARN  [RCM] rcm::RcmApi::ResTypeControl: ResType MSMQTriggers's DLL is not present on this node.  Attempting to find a good node...
    00000b18.00000c1c::2011/01/13-16:10:47.432 ERR   [RHS] s_RhsRpcCreateResType: ERROR_NOT_READY(21)' because of 'Startup routine for ResType MSMQTriggers returned 21.'
    00000730.00000d30::2011/01/13-16:10:47.432 WARN  [RCM] Failed to load restype 'MSMQTriggers': error 21.
    00000b18.00000c1c::2011/01/13-16:10:47.432 ERR   [RHS] s_RhsRpcCreateResType: ERROR_NOT_READY(21)' because of 'Startup routine for ResType MSMQ returned 21.'
    00000730.0000076c::2011/01/13-16:10:47.432 WARN  [RCM] Failed to load restype 'MSMQ': error 21.
    00000730.0000076c::2011/01/13-16:10:47.432 WARN  [RCM] rcm::RcmApi::ResTypeControl: ResType MSMQ's DLL is not present on this node.  Attempting to find a good node...
    00000b18.00000c1c::2011/01/13-16:10:47.448 ERR   [RHS] s_RhsRpcCreateResType: ERROR_NOT_READY(21)' because of 'Startup routine for ResType MSMQ returned 21.'
    00000730.00000d30::2011/01/13-16:10:47.448 WARN  [RCM] Failed to load restype 'MSMQ': error 21.
    00000b18.00000c1c::2011/01/13-16:10:47.448 ERR   [RHS] s_RhsRpcCreateResType: ERROR_NOT_READY(21)' because of 'Startup routine for ResType MSMQTriggers returned 21.'
    00000730.0000076c::2011/01/13-16:10:47.448 WARN  [RCM] Failed to load restype 'MSMQTriggers': error 21.
    00000730.0000076c::2011/01/13-16:10:47.448 WARN  [RCM] rcm::RcmApi::ResTypeControl: ResType MSMQTriggers's DLL is not present on this node.  Attempting to find a good node...
    00000b18.00000c1c::2011/01/13-16:10:47.448 ERR   [RHS] s_RhsRpcCreateResType: ERROR_NOT_READY(21)' because of 'Startup routine for ResType MSMQTriggers returned 21.'
    00000730.00000d30::2011/01/13-16:10:47.448 WARN  [RCM] Failed to load restype 'MSMQTriggers': error 21.
    00000bd4.00000eb0::2011/01/13-16:10:47.666 INFO  [RES] Physical Disk <VM1>: HardDiskpCloseSVIHandles: Exit
    00000bd4.00000eb0::2011/01/13-16:10:48.259 INFO  [RES] Physical Disk: ReleaseDisk: stop reserve succeeded on device 3 (sig 44423655)
    00000730.0000076c::2011/01/13-16:10:48.368 INFO  [RCM] HandleMonitorReply: TERMINATERESOURCE for 'VM1', gen(4) result 0.
    00000730.0000076c::2011/01/13-16:10:48.368 INFO  [RCM] TransitionToState(VM1) [Terminating to Failed]-->Failed.
    00000730.0000076c::2011/01/13-16:10:48.368 INFO  [RCM] rcm::RcmGroup::UpdateStateIfChanged: (Available Storage, Pending --> Failed)
    00000730.00000d40::2011/01/13-16:10:48.384 WARN  [RCM] Not failing over group Available Storage, failoverCount 1, failover threshold 0, nodeAvailCount 0.
    00000730.00000d40::2011/01/13-16:10:48.384 INFO  [RCM] Will retry online of VM1 in 3600000 milliseconds.
    00000b18.00000c1c::2011/01/13-16:10:48.384 ERR   [RHS] s_RhsRpcCreateResType: ERROR_NOT_READY(21)' because of 'Startup routine for ResType MSMQ returned 21.'
    00000730.00000d40::2011/01/13-16:10:48.384 WARN  [RCM] Failed to load restype 'MSMQ': error 21.
    00000730.00000d40::2011/01/13-16:10:48.384 WARN  [RCM] rcm::RcmApi::ResTypeControl: ResType MSMQ's DLL is not present on this node.  Attempting to find a good node...
    00000b18.00000c1c::2011/01/13-16:10:48.384 ERR   [RHS] s_RhsRpcCreateResType: ERROR_NOT_READY(21)' because of 'Startup routine for ResType MSMQ returned 21.'
    00000730.0000076c::2011/01/13-16:10:48.384 WARN  [RCM] Failed to load restype 'MSMQ': error 21.
    00000b18.00000c1c::2011/01/13-16:10:48.400 ERR   [RHS] s_RhsRpcCreateResType: ERROR_NOT_READY(21)' because of 'Startup routine for ResType MSMQTriggers returned 21.'
    00000730.00000d40::2011/01/13-16:10:48.400 WARN  [RCM] Failed to load restype 'MSMQTriggers': error 21.
    00000730.00000d40::2011/01/13-16:10:48.400 WARN  [RCM] rcm::RcmApi::ResTypeControl: ResType MSMQTriggers's DLL is not present on this node.  Attempting to find a good node...
    00000b18.00000c1c::2011/01/13-16:10:48.400 ERR   [RHS] s_RhsRpcCreateResType: ERROR_NOT_READY(21)' because of 'Startup routine for ResType MSMQTriggers returned 21.'
    00000730.0000076c::2011/01/13-16:10:48.400 WARN  [RCM] Failed to load restype 'MSMQTriggers': error 21.
    00000b18.00000c1c::2011/01/13-16:10:48.400 ERR   [RHS] s_RhsRpcCreateResType: ERROR_NOT_READY(21)' because of 'Startup routine for ResType MSMQ returned 21.'
    00000730.00000d40::2011/01/13-16:10:48.400 WARN  [RCM] Failed to load restype 'MSMQ': error 21.
    00000730.00000d40::2011/01/13-16:10:48.400 WARN  [RCM] rcm::RcmApi::ResTypeControl: ResType MSMQ's DLL is not present on this node.  Attempting to find a good node...
    00000b18.00000c1c::2011/01/13-16:10:48.400 ERR   [RHS] s_RhsRpcCreateResType: ERROR_NOT_READY(21)' because of 'Startup routine for ResType MSMQ returned 21.'
    00000730.0000076c::2011/01/13-16:10:48.400 WARN  [RCM] Failed to load restype 'MSMQ': error 21.
    00000b18.00000c1c::2011/01/13-16:10:48.400 ERR   [RHS] s_RhsRpcCreateResType: ERROR_NOT_READY(21)' because of 'Startup routine for ResType MSMQTriggers returned 21.'
    00000730.00000d40::2011/01/13-16:10:48.400 WARN  [RCM] Failed to load restype 'MSMQTriggers': error 21.
    00000730.00000d40::2011/01/13-16:10:48.400 WARN  [RCM] rcm::RcmApi::ResTypeControl: ResType MSMQTriggers's DLL is not present on this node.  Attempting to find a good node...
    00000b18.00000c1c::2011/01/13-16:10:48.400 ERR   [RHS] s_RhsRpcCreateResType: ERROR_NOT_READY(21)' because of 'Startup routine for ResType MSMQTriggers returned 21.'
    00000730.0000076c::2011/01/13-16:10:48.400 WARN  [RCM] Failed to load restype 'MSMQTriggers': error 21.

    Thanks Ramzan and Elden for your reply. :) :)
    Issue Faced:
    we have 3 cluster server(2008 enterprise R2). The cluster server gets rebooted and failover happens frequently.As a workaround,we use to unistall Network threat component(symantec) when the issue happens.
    The Cluster validation passes sucessfully for both storage and network.
    I dont find any logs apart from the below.
    00000d38.00000698::2011/04/15-20:04:38.452 ERR   [RHS] s_RhsRpcCreateResType: ERROR_NOT_READY(21)' because of 'Startup routine for ResType MSMQ returned 21.'
    00000984.00000d88::2011/04/15-20:04:38.452 WARN  [RCM] Failed to load restype 'MSMQ': error 21.
    00000d38.00000698::2011/04/15-20:04:38.467 ERR   [RHS] s_RhsRpcCreateResType: ERROR_NOT_READY(21)' because of 'Startup routine for ResType MSMQTriggers returned 21.'
    00000984.000012f0::2011/04/15-20:04:38.467 WARN  [RCM] Failed to load restype 'MSMQTriggers': error 21.
    00000984.000012f0::2011/04/15-20:04:38.467 WARN  [RCM] rcm::RcmApi::ResTypeControl: ResType MSMQTriggers's DLL is not present on this node. 
    Attempting to find a good node...
    We collected the bugcheck analysis report after the reboot. The report as follows
    MM_INTERNAL_CODE:  0
    DEFAULT_BUCKET_ID:  VISTA_DRIVER_FAULT
    BUGCHECK_STR:  0x50
    PROCESS_NAME:  svchost.exe
    CURRENT_IRQL:  0
    STACK_COMMAND:  kb
    FOLLOWUP_IP:
    srvnet!FillSessionInfoBuffer+a2
    fffff880`05472ed2 448b9c2480000000 mov     r11d,dword ptr [rsp+80h]
    SYMBOL_STACK_INDEX:  4
    SYMBOL_NAME:  srvnet!FillSessionInfoBuffer+a2
    FOLLOWUP_NAME:  MachineOwner
    MODULE_NAME: srvnet
    IMAGE_NAME:  srvnet.sys
    DEBUG_FLR_IMAGE_TIMESTAMP:  4c7732f4
    FAILURE_BUCKET_ID:  X64_0x50_srvnet!FillSessionInfoBuffer+a2
    BUCKET_ID:  X64_0x50_srvnet!FillSessionInfoBuffer+a2
    Followup: MachineOwner
    As per microsoft technet, we are planning to deploy the hotfix provided in the article
    http://support.microsoft.com/kb/980135
    Please let us know if another troubleshooting steps needs to be performed. Any solutions please let us know
    Thanks
    Dinesh

  • Unity 4.2(1) Failover Problems

    I was contacted about a Unity 4.2(1) problem someone was having last week.  From my initial investigation, it appears that failover is not working at all., due to the fact SQL replication is broken.  The event log is logging the error "SQL Server replication between the primary and secondary machines is inactive.  The subscription to UnityDbPublication is not active or pending.  Recreat the subscription and the publication snapshot to restore replication.
    When I go to the UnityDbPublication:UnityDB under Publications in SQL Server Enterprise Manager, I get the error "SQL Server replication does not support nicknames, such as "." or "(local)". as server names.  Delete the SQL Server registration for this server and register it using the actual server name..
    I found this article that appears to be the solution to that error:  http://www.cisco.com/en/US/products/sw/voicesw/ps2237/products_tech_note09186a0080943cb3.shtml#topic2
    In SQL Server Enterprise Manager, the server is named (local).  Deleting (local) will not delete the database, correct?  I don't want to crash the whole system.  Should I do this on both servers (both are named (local)). 
    Is this the best place to start to repair the replication between the 2 servers?  I ran DBWalker on both servers and the primary server only logged 5 errors while the secondary server logged 307 errors (mostly missing WAV files). 
    Any input would be appreciated.  Thanks!

    Dear
    Please find the below lik which wll help you to install failoveer , but please be carefull and stop the subscriber when you run failover on the publisher.
    http://www.cisco.com/image/gif/paws/26060/unity_failover_config.pdf
    thank you
    please rate if this will help

  • Oracle HA Failover problem

    Hi,
    Just want to know if anyone has encountered problem starting multiple oracle instance on the same node under sun cluster. It complains it can not start listener for the new instance. We used different listener port/name for the new instance.
    Any help would be greatly appreciated.
    Thanks.

    Hi,
    Just want to know if anyone has encountered problem starting multiple oracle instance on the same node under sun cluster. It complains it can not start listener for the new instance. We used different listener port/name for the new instance.
    Any help would be greatly appreciated.
    Thanks.

  • System font failover problem

    I have a Flex 3 application, where Burmese and Thai device fonts are rendering OK in Flex3 text controls (e.g. mx Label, TextInput), but not in FTE-based text controls (e.g. flashx TextLine).
    However, certain fonts including Chinese, Arabic and Hebrew all failover correctly in both types of text control.
    Are there known issues or specific font sets not supported for failover to system fomts?
    I'm currently testing with Player 10.3 on Mac in Safari/Chrome/FF.

    Hi Dave,
    Would you mind creating a jira bug for this?
    http://bugs.adobe.com/flashplayer/
    Thanks,
    Chris

  • Cisco ASA Active standby failover problem

    We have configured ASA Active standby failover with ASA5505 . When primary unit power off, secondary unit became active. when primary unit power on, then primary unit is becoming active again. i think for active standby setup there is no preemption. The real issue is when primary ASA became active after power on all the external connectivity getting down. Please see the below config,
    ASA01# show run
    ASA01# show running-config 
    : Saved
    ASA Version 8.2(5) 
    hostname ASA01
    enable password PVSASRJovmamnVkD encrypted
    passwd 2KFQnbNIdI.2KYOU encrypted
    names
    name 192.168.1.1 MPLS_Router description MPLS_Router 
    name 192.168.2.1 SCADA_Router description SCADA_Router
    interface Ethernet0/0
     switchport access vlan 2
    interface Ethernet0/1
    interface Ethernet0/2
     switchport access vlan 2
    interface Ethernet0/3
    interface Ethernet0/4
     switchport access vlan 3
    interface Ethernet0/5
    interface Ethernet0/6
    interface Ethernet0/7
    interface Vlan1
     nameif inside
     security-level 100
     ip address 192.168.3.8 255.255.255.0 standby 192.168.3.9 
    interface Vlan2
     nameif outside
     security-level 0
     ip address 192.168.1.8 255.255.255.0 standby 192.168.1.9 
    interface Vlan3
     description LAN Failover Interface
    ftp mode passive
    clock timezone AST 3
    access-list inside_access_in extended permit icmp any any 
    access-list inside_access_in extended permit ip any any 
    access-list inside_access_in extended permit ip any host MPLS_Router 
    access-list outside_access_in extended permit icmp any any 
    access-list outside_access_in extended permit ip any any 
    access-list outside_access_in extended permit ip any 192.168.2.0 255.255.255.0 
    pager lines 24
    logging enable
    logging asdm informational
    mtu inside 1500
    mtu outside 1500
    failover
    failover lan unit primary
    failover lan interface FAILOVER Vlan3
    failover key *****
    failover interface ip FAILOVER 10.1.1.1 255.255.255.0 standby 10.1.1.2
    icmp unreachable rate-limit 1 burst-size 1
    no asdm history enable
    arp timeout 14400
    global (outside) 1 interface
    nat (inside) 1 0.0.0.0 0.0.0.0
    access-group inside_access_in in interface inside
    access-group outside_access_in in interface outside
    route-map Route_Out permit 1
     match ip address inside_access_in outside_access_in
     match interface inside
    route outside 0.0.0.0 0.0.0.0 MPLS_Router 1
    timeout xlate 3:00:00
    timeout conn 1:00:00 half-closed 0:10:00 udp 0:02:00 icmp 0:00:02
    timeout sunrpc 0:10:00 h323 0:05:00 h225 1:00:00 mgcp 0:05:00 mgcp-pat 0:05:00
    timeout sip 0:30:00 sip_media 0:02:00 sip-invite 0:03:00 sip-disconnect 0:02:00
    timeout sip-provisional-media 0:02:00 uauth 0:05:00 absolute
    timeout tcp-proxy-reassembly 0:01:00
    timeout floating-conn 0:00:00
    dynamic-access-policy-record DfltAccessPolicy
    http server enable
    http 192.168.1.0 255.255.255.0 inside
    http 192.168.2.0 255.255.255.0 inside
    http authentication-certificate inside
    http authentication-certificate outside
    no snmp-server location
    no snmp-server contact
    snmp-server enable traps snmp authentication linkup linkdown coldstart
    crypto ipsec security-association lifetime seconds 28800
    crypto ipsec security-association lifetime kilobytes 4608000
    telnet 192.168.2.0 255.255.255.0 inside
    telnet 192.168.1.0 255.255.255.0 outside
    telnet timeout 5
    ssh timeout 5
    console timeout 0
    dhcpd auto_config outside
    threat-detection basic-threat
    threat-detection statistics access-list
    no threat-detection statistics tcp-intercept
    webvpn
    username admin password eY/fQXw7Ure8Qrz7 encrypted
    prompt hostname context 
    no call-home reporting anonymous
    call-home
     profile CiscoTAC-1
      no active
      destination address http https://tools.cisco.com/its/service/oddce/services/DDCEService
      destination address email [email protected]
      destination transport-method http
      subscribe-to-alert-group diagnostic
      subscribe-to-alert-group environment
      subscribe-to-alert-group inventory periodic monthly
      subscribe-to-alert-group configuration periodic monthly
      subscribe-to-alert-group telemetry periodic daily
    Cryptochecksum:1a8e46a787aa78502ffd881ab62d1c31
    : end

    I suggest removing the failover configuration on both units and then re-add them, and then test.
    Primary
    failover lan interface FAILOVER Vlan3
    failover interface ip FAILOVER 10.1.1.1 255.255.255.0 standby 10.1.1.2
    failover lan unit primary
    failover key KEY
    failover
    Secondary
    failover lan interface FAILOVER Vlan3
    failover interface ip FAILOVER 10.1.1.1 255.255.255.0 standby 10.1.1.2
    failover lan unit secondary
    failover key KEY
    failover
    Please remember to select a correct answer and rate helpful posts

  • Stateful Session Bean failover problem

              Hi,
              We have a WLS7.0 cluster with two managed servers. The problem we have in this
              environment is that when server one goes down and gets up and after that server
              two goes down our application gets an error "Unable to connect to Session Bean".
              HTTP session works OK, but Staful Session Bean is lost when these failovers happens.
              //Sami
              

              Hi,
              We have a WLS7.0 cluster with two managed servers. The problem we have in this
              environment is that when server one goes down and gets up and after that server
              two goes down our application gets an error "Unable to connect to Session Bean".
              HTTP session works OK, but Staful Session Bean is lost when these failovers happens.
              //Sami
              

  • ECC 6.0 failover problem

    Hi,
    I have also installed ecc 6.0 in Aix 5.3 with oracle 10G.
    We have 2 physical servers and in one server i have installed
    both the CI & DB instance and in another server i have installed the application server(dialog instance). and it is also a failover concept.
    When i stop my ci&db server all the mount points are comming into my application server thru hacmp clustering but i am not able to start my sap manually in my application server.
    Is there anything to be done so that the sap starts?
    Plz help me....if u can u can also mail me at [email protected]
    Regards
    Ashwin

    Hi,
    The cluster must have a mobile IP, and the IP must have a virtual hostname assigned (not the hostname of your server1 or server2). Then the tnsnames.ora, listener.ora must point to this virtual name.
    The Sap instance profiles must have the virtual name defined too (usually the profiles with the server hostnames are links to the one containing the virtual name). I mean something like that:
    lrwx------    START_DVEBMGS00_<server1> -> START_DVEBMGS00_<virtualname>
    lrwx------    <SID>_DVEBMGS00_<server1> -> <SID>_DVEBMGS00_<virtualname>
    lrwx------    START_DVEBMGS00_<server2> -> START_DVEBMGS00_<virtualname>
    lrwx------    <SID>_DVEBMGS00_<server2> -> <SID>_DVEBMGS00_<virtualname>
    -rw-rr    START_DVEBMGS00_<virtualname>
    -rw-rr    <SID>_DVEBMGS00_<virtualname>
    -rwxr-xr-x    DEFAULT.PFL
    Verify this. Hope this could help.
    Best Regards,
    JC Llanes.

  • Ignore my previous Q. Clearer descriprition of JMS FAilover problem

              I'm using weblogic700 .
              I have a cluster( say mycluster) and two weblogic servers ms1 and ms2 in this cluster.
              I have configured a connection factory and its target is assigned to my cluster.
              I have configured a JMS Server and its target is assigned to ms1.
              It has a destination myqueue.
              The listen address for ms1 and ms2 is host1
              The listen port for ms1 and ms2 are 7011 and 7021.
              Now I deploy a message driven bean to mycluster.
              I have a JMS client. Using it if I send a message with a PROVIDER_URL t3://host1:7011
              then the message is consumed.
              (the message is sent to myqueue and the message driven
              bean consumes messages at myqueue).
              Now what should I do If ms1 stops.How can I support failover( even it requires
              some manual steps.)
              So my Question is: How do use the facilty of migration of pinned services in
              this case?
              Also as in the case of servlet and jsp where I can get a common entry point(
              the host and port number of the proxy server which I got by configuring the HTTPClusterServlet)
              how can I get a common address which I will use in my client for sending my
              messages ?
              I feel I am not supposed to use individual server addresses in sending my messages
              to my message driven bean deployed in cluster.
              

              Be honest, the Weblogic document about multiple instances require you have multiple
              IPs (names) for the same machine and each IP refers to 1 instance,this way, you can
              always use the same port. I am not sure how to implement this concept. Grab your
              system and network administrator to help you.
              "Aniket karmakar" <[email protected]> wrote:
              >
              > Thanks Mr Wendy Zhang...I have successfully tested migration of pinned
              >services(
              >IN MY CASE JMS)
              > With your concept of the entry point (t3://s1,s2,s3:p)I could test the
              >migration.But
              >the only point which still itches me is that I
              >cannot have two clustered servers on the same machine.In that case I cannot
              >have
              >the same port number for both of them.
              >
              >"Wendy Zhang" <[email protected]> wrote:
              >>
              >>For the common address, please check the detail from Weblogic 7 JNDI document.
              >>The
              >>last paragraph has a simple description. The address is the address you
              >>put in the
              >>Cluster address, for example, if you use comma seperated addresses and
              >you
              >>have three
              >>servers s1,s2 and s3 with port p, the common address appeared in your JMS
              >>client
              >>is t3://s1,s2,s3:p. The Weblogic library used in your client knows how
              >to
              >>handle
              >>this address.
              >>
              >>
              >>"Aniket" <[email protected]> wrote:
              >>>
              >>> I'm using weblogic700 .
              >>>
              >>>I have a cluster( say mycluster) and two weblogic servers ms1 and ms2
              >>in
              >>>this cluster.
              >>> I have configured a connection factory and its target is assigned
              >to
              >>>my cluster.
              >>> I have configured a JMS Server and its target is assigned to ms1.
              >>> It has a destination myqueue.
              >>>
              >>> The listen address for ms1 and ms2 is host1
              >>> The listen port for ms1 and ms2 are 7011 and 7021.
              >>>
              >>> Now I deploy a message driven bean to mycluster.
              >>>
              >>> I have a JMS client. Using it if I send a message with a PROVIDER_URL
              >>>t3://host1:7011
              >>>then the message is consumed.
              >>>(the message is sent to myqueue and the message driven
              >>>bean consumes messages at myqueue).
              >>>
              >>> Now what should I do If ms1 stops.How can I support failover( even
              >>it
              >>>requires
              >>>some manual steps.)
              >>> So my Question is: How do use the facilty of migration of pinned services
              >>>in
              >>>this case?
              >>>
              >>> Also as in the case of servlet and jsp where I can get a common entry
              >>>point(
              >>>the host and port number of the proxy server which I got by configuring
              >>>the HTTPClusterServlet)
              >>>
              >>> how can I get a common address which I will use in my client for
              >sending
              >>>my
              >>>messages ?
              >>>
              >>> I feel I am not supposed to use individual server addresses in sending
              >>>my messages
              >>> to my message driven bean deployed in cluster.
              >>
              >
              

  • Failover problem on NT

    Hi All,
    I have IAS and IWS on 2 machines and a DNS Server on one of the
    machines.During instaling i gave the domain name as a.b.c(let's say) and the
    scluster name as Cluster1.
    Now in my DNS Manager i have IP entry for A and B machines.In my KRegedit in
    botth the machiens i can see the cluster name and in the sync also i have
    added the IP Addresses of both the machines with proper priority (used the
    IPlanet clustering document).
    I have made entry in the TCP/IP settings also for the domain.
    Now i am accessing the Web server of Machine A with
    url........MachineA'sName.a.b.c//NASApp/cluster-jsp/HaJsp.............i am
    able to get the jsp and am able to add data in the sessioon ...Then i stop
    Machine A and it gives me a Socket Closed Exception where i wanted the
    request to go to the other server B..
    Am i missing anything .....What should i give in the domain tag of my
    ias-web.xml, as of now it is b.c.
    Thankx nd Regards,
    Sanket

    Sanket,
    First check that the cluster is correcly configured. To check do the following
    -- start the first server and see in the kxs logs that it has started as a
    primary
    -- start the secomnd server and see in the kxs logs that it has started as a
    backup
    -- Then stop the first server and you should see in the logs of the second
    server the it has lost the connection to the primary and it is promoting itself
    as a primary.
    Then try to work with the example.
    thanks
    --shital
    Sanket wrote:
    Hi All,
    I have IAS and IWS on 2 machines and a DNS Server on one of the
    machines.During instaling i gave the domain name as a.b.c(let's say) and the
    scluster name as Cluster1.
    Now in my DNS Manager i have IP entry for A and B machines.In my KRegedit in
    botth the machiens i can see the cluster name and in the sync also i have
    added the IP Addresses of both the machines with proper priority (used the
    IPlanet clustering document).
    I have made entry in the TCP/IP settings also for the domain.
    Now i am accessing the Web server of Machine A with
    url........MachineA'sName.a.b.c//NASApp/cluster-jsp/HaJsp.............i am
    able to get the jsp and am able to add data in the sessioon ...Then i stop
    Machine A and it gives me a Socket Closed Exception where i wanted the
    request to go to the other server B..
    Am i missing anything .....What should i give in the domain tag of my
    ias-web.xml, as of now it is b.c.
    Thankx nd Regards,
    Sanket

  • Named Anchored Obj-Environment Failover

    Hi to all,
    We connect from EnvA to EnvB giving the user directory parameter as / and
    set the Environment Search Path
    as EnvA:EnvB. From both environments we start and register
    '/glob/obj1' named anchored objects with the same name.
    From a client we connect to EnvA and bind to'/glob/obj1' when we shutdown EnvA partition it fails-over to
    EnvB. And then we restart EnvA partition. We restart/rebind the client and
    try to use object. We see that it is using the EnvB object.
    Although we started the primary environment object again.
    It is not using the search path. Once we shutdown secondary environment
    it starts using primary environment object.
    When we try to use relative path when we are binding the object
    First parameter ('glob/obj1') No first slash. Trying 3rd parameter
    for bind function or just using environment search path, Is is not able to
    find the object. From nsls command I figured out that
    under the root directory
    /forte/UUID of ENVA/node
    /site
    /UUID of ENVB
    /glob/obj1
    names are available. When we use relative path (without slash)
    is it trying to find /glob/obj1 under the /forte/UUID of ENVA
    but we are registering the name under the root.
    What is the reason of this odd behaviour or is this a bug?
    Any answer will be appreciated,

    Hi Juliesmiley,
    According to your description, I recommend you check the conditions required for an automatic  failover.
      • Primary replica and secondary replica are both configured for syschronous-commit mode and set to AUTOMATIC failover.
      •  All availability databases that are defined in the availability group must be in a SYNCHRONIZED state between the primary replica and the secondary replica.
      • The Windows Server Failover Clustering (WSFC) cluster has quorum.
      • The primary replica has become unavailable.
    For more information, please review the following articles.
    Failover and Failover Modes (AlwaysOn Availability Groups)
    Troubleshooting automatic failover problems in SQL Server 2012 AlwaysOn environments
    Thanks,
    Lydia Zhang

  • Setting up failover in an RV042 V3

    I have a new (about 4 months old) RV042 V3 4.0.0.07 firmware that I am trying to use in failover mode.  I have a SOHO and I normally use cable Internet connection.  It is quite fast (15 megabit), but not super reliable.  I have added DSL (3.3 megabit) which is five nines (supposedly) but not so quick. 
    I have a Westell 7500 wireless DSL modem located in the basement, where the telephone lines enter the building.  This gives me a wireless link to the second floor server room through  a wireless router that connects to WAN 2 of the RV042.   The cable modem is in the server room and connects directly to the WAN 1 of the RV042.  The cable works, but when it goes down, the DSL link comes up but does not allow Internet traffic.  The RV042 is set up as a Bridge and I have set up port forwarding to get the cable to work and used similar firewall commands to route the traffic if the router switched over.  I suspect that the problem is in the port forwarding (port 80) or the firewall rules(which are pretty simple) because everything looks like it switches over, but it just doesn't work on WAN2. 
    Can anyone shed any light on this problem, which does not seem like it should exist?
    Thanks, Bob

    If you plug a PC into R2, do you have internet access? Yes, Ethernet works from R2 including DHCP to the plugged in PC
    What is the Default Gateway? See data below:
    Laptop plugged into R2
    Ethernet adapter Local Area Connection:
    Connection-specific DNS Suffix . : westell.com
    Description . . . . . . . . . . . : Realtek RTL8139/810x Family Fast Ethernet NIC
    Physical Address. . . . . . . . . : **Deleted**
    Dhcp Enabled. . . . . . . . . . . : Yes
    Autoconfiguration Enabled . . . . : Yes
    IP Address. . . . . . . . . . . . : 192.168.2.61
    Subnet Mask . . . . . . . . . . . : 255.255.255.0
    Default Gateway . . . . . . . . . : 192.168.2.22
    DHCP Server . . . . . . . . . . . : 192.168.2.1
    DNS Servers . . . . . . . . . . . : **Deleted**
    Route Test from Laptop via R2
    tracert google.com
    Tracing route to google.com over a maximum of 30 hops:
    1 <1 ms <1 ms <1 ms 192.168.2.22
    2 1 ms 1 ms 1 ms 192.168.2.1
    Router 2 IP Data:
    Local IP Address 192.168.2.22
    Subnet Mask 255.255.255.0
    Gateway 192.168.2.1
    Local DNS 192.168.2.1
    Default Gateway on WAN2: Initially DHCP value from R1, but I changed it to use a static IP setup as you suggested, but since a PC works on R2  I figured it was OK.  The DHCP numbers were the exact numbers that I assigned as static as suggested in the your next question.  Apparently this change makes WAN2 work.  Not sure if that was the only problem because I also gave R4 a static address of 192.168.10.2, figuring if one static was good, then two statics would be at least twice as good. 
    Have you tried giving WAN2 a static IP address and gateway that points to R1?
    I did as you suggested and put static WAN2 as 192.168.2.2. It makes it cleaner.  Please look at my firewall rules, I know that at least one is not right, and if I look at the SysLog I get lots of questions.  There is a web server at 192.168.10.11, which has always been there but not on the drawing.
    Default gateway on WAN1: From DHCP from cable company modem and it works as it is supposed to:
    IP Add. xx.xx.xx.71, Default Gate. xx.xx.xx.1, Dyndns enabled
    I have added an updated network drawing and some router configurations.  Note the stuff in the SysLog, which I can't get figured out.  The syslog concerns me that my firewall is not set up right.   I added the webserver to the drawing, which I have updated many times this weekend as work proceeded.
    *** Solution Comments ***
    As noted in the multiple edited section above, adding static addresses appears to have fixed my failover problem.  I had left the question open because I was seeing firewall log activity.  After several days of digging around I figured out what eth0 and eth1 were.   They are LAN and WAN1 respectively.  Since the system is operating with WAN2 connected and WAN1 blocked this is apparently normal operation since WAN1 is blocked by policy. 
    Since it appears to fail over after changing to static addresses, I guess this question was answered by mpyhala when he asked me if I was using static addresses.   I have always done that, and I cannot imagine why I didn't do it this time.  Thanks for getting me on the right track.
    As for the Log activity, it is to be expected  and the log activity appears to make sense, when you consider the traffic path.
    Thanks, for the help
    Message was edited by: Bob Lawson
    Message was edited by: Bob Lawson
    Message was edited by: Bob Lawson

Maybe you are looking for

  • Photo slideshow order problems

    Im using ATV2 withy mac. I have linked the ATV2 to my folder of digi photos via itunes (ie i am not sharing the photos via iphoto - prefer picasa!). On ATV when i try to play a photo slideshow the photos are played in filename order only. This is a m

  • Margin:auto doesn't work :/

    Hi! I have problems with centering a page on IE. Courios thing is that it displays ok when i click preview in browser and centering fails when i run the project. I have GroupPanel with style margin: 0 auto auto auto; padding: 5px 20px 20px 20px; back

  • HT2506 Preview is now opening full screen always.  Want it window size

    All of a sudden, Preview is opening images in Full Screen only.  It used to open in a window.  I have looked everywhere to change this back from full screen to window size.  I have checked the Preferences and Get Info.  Please help and tell Apple to

  • How much extra disk space should I have?

    Hello! So lately I have been having some disk space issues! I was wondering how many extra MB I should have free on my macbook that is 1 GB i believe! Thank you!

  • Thread access

    I am new to Thread. I am doing a following call and the only thing I wanted to do here is to sleep for a second. 101: try{ 102: Thread.currentThread().sleep(1000); 103: }catch (InterruptedException ie) { 104: System.out.println("InterruptedException