11gR2 Windows 2008 R2 node eviction issue

Hi
We are facing the cluster node eviction when the teamed network is down less than 5 seconds time. Is there any settings needs to be changed? Recently our network team is performing a firmware upgrade of all modules, they mentioned to us our HP blade servers and network is completely redundant. But still the node eviction happen to us, we tried with different scenarios by disabling the separate network cards. When ever we do disable and enable private teamed network even less than 2 seconds the node eviction is happening.
After reading this CSS Timeout Computation in Oracle Clusterware [ID 294430.1] at least it should wait till 30 seconds time but it is not.
I am attaching the log here this is node2 alert log..
[ctssd(5264)]CRS-2409:The clock on host shadbtestrac02 is not synchronous with the mean cluster time. No action has been taken as the Cluster Time Synchronization Service is running in observer mode.
2010-08-10 10:34:34.722
[ctssd(5264)]CRS-2409:The clock on host shadbtestrac02 is not synchronous with the mean cluster time. No action has been taken as the Cluster Time Synchronization Service is running in observer mode.
2010-08-10 10:35:15.485
[cssd(5124)]CRS-1612:Network communication with node shadbtestrac01 (1) missing for 50% of timeout interval. Removal of this node from cluster in 14.743 seconds
2010-08-10 10:35:23.331
[cssd(5124)]CRS-1611:Network communication with node shadbtestrac01 (1) missing for 75% of timeout interval. Removal of this node from cluster in 6.896 seconds
2010-08-10 10:35:27.387
[cssd(5124)]CRS-1610:Network communication with node shadbtestrac01 (1) missing for 90% of timeout interval. Removal of this node from cluster in 2.840 seconds
2010-08-10 10:35:30.242
[cssd(5132)]CRS-1609:This node is unable to communicate with other nodes in the cluster and is going down to preserve cluster integrity; details at (:CSSNM00008:) in C:\OracleGI\11.2.0\log\shadbtestrac02\cssd\ocssd.log.
2010-08-10 10:35:39.665
[cssd(4724)]CRS-1608:This node was evicted by node 1, shadbtestrac01; details at (:CSSNM00005:) in C:\OracleGI\11.2.0\log\shadbtestrac02\cssd\ocssd.log.
2010-08-10 10:35:39.665
[cssd(4548)]CRS-1608:This node was evicted by node 1, shadbtestrac01; details at (:CSSNM00005:) in C:\OracleGI\11.2.0\log\shadbtestrac02\cssd\ocssd.log.
2010-08-10 10:35:39.680
[cssd(3808)]CRS-1608:This node was evicted by node 1, shadbtestrac01; details at (:CSSNM00005:) in C:\OracleGI\11.2.0\log\shadbtestrac02\cssd\ocssd.log.
2010-08-10 10:35:39.712
[ctssd(5268)]CRS-2402:The Cluster Time Synchronization Service aborted on host shadbtestrac02. Details at (:ctsselect_mmg5_1: in C:\OracleGI\11.2.0\log\shadbtestrac02\ctssd\octssd.log.
2010-08-10 10:35:39.712
[C:\OracleGI\11.2.0\bin\oraagent.exe(5984)]CRS-5822:Agent 'C:\OracleGI\11.2.0\bin\oraagent.exe_system' disconnected from server. Details at (:CRSAGF00117:) in C:\OracleGI\11.2.0\log\shadbtestrac02\agent\crsd\oraagent\oraagent.log.
2010-08-10 10:35:39.712
[C:\OracleGI\11.2.0\bin\orarootagent.exe(5768)]CRS-5822:Agent 'C:\OracleGI\11.2.0\bin\orarootagent.exe_system' disconnected from server. Details at (:CRSAGF00117:) in C:\OracleGI\11.2.0\log\shadbtestrac02\agent\crsd\orarootagent\orarootagent.log.
Node1 alert log..
2010-08-10 09:13:28.642
[C:\OracleGI\11.2.0\bin\oraagent.exe(5652)]CRS-5011:Check of resource "CPCSR" failed: details at "(:CLSN00007:)" in "C:\OracleGI\11.2.0\log\shadbtestrac01\agent\crsd\oraagent\oraagent.log"
2010-08-10 09:13:29.828
[crsd(3104)]CRS-2765:Resource 'ora.cpcsr.db' has failed on server 'shadbtestrac01'.
2010-08-10 09:13:31.700
[crsd(3104)]CRS-2765:Resource 'ora.cpcsr.cpcsboa.dev.sha.svc' has failed on server 'shadbtestrac01'.
2010-08-10 09:13:31.700
[crsd(3104)]CRS-2771:Maximum restart attempts reached for resource 'ora.cpcsr.cpcsboa.dev.sha.svc'; will not restart.
2010-08-10 09:13:44.102
[crsd(3104)]CRS-2758:Resource 'ora.cpcsr.db' is in an unknown state.
2010-08-10 10:35:18.777
[cssd(4272)]CRS-1612:Network communication with node shadbtestrac02 (2) missing for 50% of timeout interval. Removal of this node from cluster in 14.697 seconds
2010-08-10 10:35:26.437
[cssd(4272)]CRS-1611:Network communication with node shadbtestrac02 (2) missing for 75% of timeout interval. Removal of this node from cluster in 7.037 seconds
2010-08-10 10:35:30.493
[cssd(4272)]CRS-1610:Network communication with node shadbtestrac02 (2) missing for 90% of timeout interval. Removal of this node from cluster in 2.981 seconds
2010-08-10 10:35:33.488
[cssd(4280)]CRS-1607:Node shadbtestrac02 is being evicted in cluster incarnation 173888169; details at (:CSSNM00007:) in C:\OracleGI\11.2.0\log\shadbtestrac01\cssd\ocssd.log.
2010-08-10 10:35:40.009
[ohasd(3320)]CRS-8011:reboot advisory message from host: shadbtestrac02, component: ag164619, with time stamp: L-2010-08-10-10:35:39.000
[ohasd(3320)]CRS-8013:reboot advisory message text: clsnomon_status: need to reboot, unexpected failure 8 received from CSS
2010-08-10 10:36:09.805
[cssd(12776)]CRS-1601:CSSD Reconfiguration complete. Active nodes are shadbtestrac01 .
2010-08-10 10:36:09.961
[crsd(3104)]CRS-5504:Node down event reported for node 'shadbtestrac02'.
2010-08-10 10:36:22.894
[crsd(3104)]CRS-2773:Server 'shadbtestrac02' has been removed from pool 'Generic'.
2010-08-10 10:36:22.894
[crsd(3104)]CRS-2773:Server 'shadbtestrac02' has been removed from pool 'ora.AHPSR'.
2010-08-10 10:36:22.894
[crsd(3104)]CRS-2773:Server 'shadbtestrac02' has been removed from pool 'ora.AHPSR_AHPSBC.TEST.SHA'.
2010-08-10 10:36:22.894
[crsd(3104)]CRS-2773:Server 'shadbtestrac02' has been removed from pool 'ora.APPOHDR'.
2010-08-10 10:36:22.894
[crsd(3104)]CRS-2773:Server 'shadbtestrac02' has been removed from pool 'ora.APPOITR'.
2010-08-10 10:36:22.894
[crsd(3104)]CRS-2773:Server 'shadbtestrac02' has been removed from pool 'ora.APPOITR_OREMS.DEV.SHA'.
2010-08-10 10:36:22.894
[crsd(3104)]CRS-2773:Server 'shadbtestrac02' has been removed from pool 'ora.CFSR'.
2010-08-10 10:36:22.894
[crsd(3104)]CRS-2773:Server 'shadbtestrac02' has been removed from pool 'ora.CFSR_CFS.DEV.SHA'.
2010-08-10 10:36:22.894
[crsd(3104)]CRS-2773:Server 'shadbtestrac02' has been removed from pool 'ora.CFSTESTR'.
2010-08-10 10:36:22.894
[crsd(3104)]CRS-2773:Server 'shadbtestrac02' has been removed from pool 'ora.CFSTESTR_CFSADS.TEST.SHA'.
2010-08-10 10:36:22.894
[crsd(3104)]CRS-2773:Server 'shadbtestrac02' has been removed from pool 'ora.CPCSR'.
2010-08-10 10:36:22.894
[crsd(3104)]CRS-2773:Server 'shadbtestrac02' has been removed from pool 'ora.CPCSR_CPCSBOA.DEV.SHA'.
2010-08-10 10:36:22.894
[crsd(3104)]CRS-2773:Server 'shadbtestrac02' has been removed from pool 'ora.FASTR'.
2010-08-10 10:36:22.894
[crsd(3104)]CRS-2773:Server 'shadbtestrac02' has been removed from pool 'ora.FASTR_FAST.DEV.SHA'.
2010-08-10 10:36:22.894
[crsd(3104)]CRS-2773:Server 'shadbtestrac02' has been removed from pool 'ora.FASTTRGR'.
2010-08-10 10:36:22.894
[crsd(3104)]CRS-2773:Server 'shadbtestrac02' has been removed from pool 'ora.FASTTRGR_FAST.TRNG.SHA'.
2010-08-10 10:36:22.894
[crsd(3104)]CRS-2773:Server 'shadbtestrac02' has been removed from pool 'ora.FASTTSTR'.
2010-08-10 10:36:22.894
[crsd(3104)]CRS-2773:Server 'shadbtestrac02' has been removed from pool 'ora.FASTTSTR_FAST.TEST.SHA'.
2010-08-10 10:36:22.894
[crsd(3104)]CRS-2773:Server 'shadbtestrac02' has been removed from pool 'ora.MAXIMOR'.
2010-08-10 10:36:22.894
[crsd(3104)]CRS-2773:Server 'shadbtestrac02' has been removed from pool 'ora.MAXIMOR_MAXIMO.DEV.SHA'.
2010-08-10 10:36:22.894
[crsd(3104)]CRS-2773:Server 'shadbtestrac02' has been removed from pool 'ora.MAXIMOR_MAXIMO.TEST.SHA'.
2010-08-10 10:36:22.894
[crsd(3104)]CRS-2773:Server 'shadbtestrac02' has been removed from pool 'ora.SHAPMSR'.
2010-08-10 10:36:22.894
[crsd(3104)]CRS-2773:Server 'shadbtestrac02' has been removed from pool 'ora.SHAPMSR_SHAPMS.DEV.SHA'.
2010-08-10 10:36:22.894
[crsd(3104)]CRS-2773:Server 'shadbtestrac02' has been removed from pool 'ora.TEPMSR'.
2010-08-10 10:36:22.894
[crsd(3104)]CRS-2773:Server 'shadbtestrac02' has been removed from pool 'ora.TEPMSR_TEPMS.DEV.SHA'.
2010-08-10 10:36:22.894
[crsd(3104)]CRS-2773:Server 'shadbtestrac02' has been removed from pool 'ora.WHAT1R'.
2010-08-10 10:36:22.894
[crsd(3104)]CRS-2773:Server 'shadbtestrac02' has been removed from pool 'ora.WHAT1R_WHAT1ADS.TEST.SHA'.
2010-08-10 10:36:22.894
[crsd(3104)]CRS-2773:Server 'shadbtestrac02' has been removed from pool 'ora.WHAT2R'.
2010-08-10 10:36:22.894
[crsd(3104)]CRS-2773:Server 'shadbtestrac02' has been removed from pool 'ora.WHAT2R_WHAT2ADS.TEST.SHA'.
2010-08-10 10:36:22.894
[crsd(3104)]CRS-2773:Server 'shadbtestrac02' has been removed from pool 'ora.WWWDBR'.
2010-08-10 10:36:22.894
[crsd(3104)]CRS-2773:Server 'shadbtestrac02' has been removed from pool 'ora.WWWDBR_PLC.DEV.SHA'.
2010-08-10 10:37:48.802
[C:\OracleGI\11.2.0\bin\orarootagent.exe(5092)]CRS-5818:Aborted command 'check for resource: ora.shadbtestrac02.vip 1 1' for resource 'ora.shadbtestrac02.vip'. Details at (:CRSAGF00113:) in C:\OracleGI\11.2.0\log\shadbtestrac01\agent\crsd\orarootagent\orarootagent.log.
2010-08-10 10:37:49.722
[C:\OracleGI\11.2.0\bin\orarootagent.exe(4540)]CRS-5818:Aborted command 'check for resource: ora.net1.network shadbtestrac01 1' for resource 'ora.net1.network'. Details at (:CRSAGF00113:) in C:\OracleGI\11.2.0\log\shadbtestrac01\agent\crsd\orarootagent\orarootagent.log.
2010-08-10 10:37:49.722
[C:\OracleGI\11.2.0\bin\orarootagent.exe(9064)]CRS-5818:Aborted command 'check for resource: ora.shadbtestrac01.vip 1 1' for resource 'ora.shadbtestrac01.vip'. Details at (:CRSAGF00113:) in C:\OracleGI\11.2.0\log\shadbtestrac01\agent\crsd\orarootagent\orarootagent.log.
2010-08-10 10:37:49.738
[C:\OracleGI\11.2.0\bin\orarootagent.exe(9448)]CRS-5818:Aborted command 'check for resource: ora.scan2.vip 1 1' for resource 'ora.scan2.vip'. Details at (:CRSAGF00113:) in C:\OracleGI\11.2.0\log\shadbtestrac01\agent\crsd\orarootagent\orarootagent.log.
2010-08-10 10:37:50.284
[C:\OracleGI\11.2.0\bin\orarootagent.exe(10020)]CRS-5818:Aborted command 'check for resource: ora.scan1.vip 1 1' for resource 'ora.scan1.vip'. Details at (:CRSAGF00113:) in C:\OracleGI\11.2.0\log\shadbtestrac01\agent\crsd\orarootagent\orarootagent.log.
2010-08-10 10:38:06.788
[C:\OracleGI\11.2.0\bin\orarootagent.exe(5300)]CRS-5818:Aborted command 'check for resource: ora.scan3.vip 1 1' for resource 'ora.scan3.vip'. Details at (:CRSAGF00113:) in C:\OracleGI\11.2.0\log\shadbtestrac01\agent\crsd\orarootagent\orarootagent.log.
2010-08-10 10:41:03.721
[C:\OracleGI\11.2.0\bin\orarootagent.exe(5484)]CRS-5818:Aborted command 'check for resource: ora.net1.network shadbtestrac01 1' for resource 'ora.net1.network'. Details at (:CRSAGF00113:) in C:\OracleGI\11.2.0\log\shadbtestrac01\agent\crsd\orarootagent\orarootagent.log.
2010-08-10 10:41:57.323
[crsd(3104)]CRS-2765:Resource 'ora.net1.network' has failed on server 'shadbtestrac01'.
2010-08-10 14:57:31.510
[C:\OracleGI\11.2.0\bin\oraagent.exe(5656)]CRS-5818:Aborted command 'check for resource: ora.LISTENER.lsnr shadbtestrac01 1' for resource 'ora.LISTENER.lsnr'. Details at (:CRSAGF00113:) in C:\OracleGI\11.2.0\log\shadbtestrac01\agent\crsd\oraagent\oraagent.log.
2010-08-10 14:57:32.648
[C:\OracleGI\11.2.0\bin\oraagent.exe(6416)]CRS-5014:Agent "C:\OracleGI\11.2.0\bin\oraagent.exe" timed out starting process "C:\OracleGI\11.2.0\bin\lsnrctl.exe" for action "check": details at "(:CLSN00009:)" in "C:\OracleGI\11.2.0\log\shadbtestrac01\agent\crsd\oraagent\oraagent.log"
2010-08-10 14:59:16.732
[C:\OracleGI\11.2.0\bin\oraagent.exe(12912)]CRS-5818:Aborted command 'check for resource: ora.LISTENER.lsnr shadbtestrac01 1' for resource 'ora.LISTENER.lsnr'. Details at (:CRSAGF00113:) in C:\OracleGI\11.2.0\log\shadbtestrac01\agent\crsd\oraagent\oraagent.log.
2010-08-10 15:00:57.289
[C:\OracleGI\11.2.0\bin\oraagent.exe(12676)]CRS-5818:Aborted command 'check for resource: ora.LISTENER.lsnr shadbtestrac01 1' for resource 'ora.LISTENER.lsnr'. Details at (:CRSAGF00113:) in C:\OracleGI\11.2.0\log\shadbtestrac01\agent\crsd\oraagent\oraagent.log.
2010-08-10 15:00:57.289
[C:\OracleGI\11.2.0\bin\oraagent.exe(13848)]CRS-5818:Aborted command 'check for resource: ora.LISTENER_SCAN1.lsnr 1 1' for resource 'ora.LISTENER_SCAN1.lsnr'. Details at (:CRSAGF00113:) in C:\OracleGI\11.2.0\log\shadbtestrac01\agent\crsd\oraagent\oraagent.log.
2010-08-10 15:02:55.802
[C:\OracleGI\11.2.0\bin\oraagent.exe(12580)]CRS-5818:Aborted command 'check for resource: ora.LISTENER.lsnr shadbtestrac01 1' for resource 'ora.LISTENER.lsnr'. Details at (:CRSAGF00113:) in C:\OracleGI\11.2.0\log\shadbtestrac01\agent\crsd\oraagent\oraagent.log.
2010-08-10 15:04:11.899
[C:\OracleGI\11.2.0\bin\oraagent.exe(3588)]CRS-5818:Aborted command 'check for resource: ora.LISTENER.lsnr shadbtestrac01 1' for resource 'ora.LISTENER.lsnr'. Details at (:CRSAGF00113:) in C:\OracleGI\11.2.0\log\shadbtestrac01\agent\crsd\oraagent\oraagent.log.
2010-08-10 15:05:23.207
[C:\OracleGI\11.2.0\bin\oraagent.exe(13996)]CRS-5818:Aborted command 'check for resource: ora.LISTENER.lsnr shadbtestrac01 1' for resource 'ora.LISTENER.lsnr'. Details at (:CRSAGF00113:) in C:\OracleGI\11.2.0\log\shadbtestrac01\agent\crsd\oraagent\oraagent.log.
2010-08-10 15:06:34.748
[C:\OracleGI\11.2.0\bin\oraagent.exe(12388)]CRS-5818:Aborted command 'check for resource: ora.LISTENER.lsnr shadbtestrac01 1' for resource 'ora.LISTENER.lsnr'. Details at (:CRSAGF00113:) in C:\OracleGI\11.2.0\log\shadbtestrac01\agent\crsd\oraagent\oraagent.log.
2010-08-10 15:06:37.291
[crsd(5112)]CRS-5831:Agent 'C:\OracleGI\11.2.0\bin\oraagent.exe' has exceeded maximum failures and has been disabled. Details at (:CRSAGF00129:) in C:\OracleGI\11.2.0\log\shadbtestrac01\crsd\crsd.log.
2010-08-10 15:08:35.243
[ohasd(3948)]CRS-2765:Resource 'ora.crsd' has failed on server 'shadbtestrac01'.
2010-08-10 15:08:36.569
[C:\OracleGI\11.2.0\bin\orarootagent.exe(5076)]CRS-5822:Agent 'C:\OracleGI\11.2.0\bin\orarootagent.exe_system' disconnected from server. Details at (:CRSAGF00117:) in C:\OracleGI\11.2.0\log\shadbtestrac01\agent\crsd\orarootagent\orarootagent.log.
2010-08-10 15:08:53.744
[crsd(4420)]CRS-1012:The OCR service started on node shadbtestrac01.
2010-08-10 15:09:06.630
[crsd(4420)]CRS-1201:CRSD started on node shadbtestrac01.
If anyone facing similar issue. Please share your inputs.
Thanks
Rao

Hi Rao,
have you disabled Media Sense?
http://support.microsoft.com/default.aspx?scid=kb;en-us;239924
Because if media sense is not disabled, Windows will report a unplugged/unlinked network card. This will immediately tell the cluster that network is down. In this case, Oracle does not wait. Since the network is down a reboot is initiated (need need to wait for a heartbeat down).
Sebastian

Similar Messages

  • Windows 2008 R2 Failover Clustering Issue - The operation returned because the timeout period expired.

    I am trying to get a new Windows 2008 R2 cluster to work on two VMware servers (VMware ESXi 5.0.3) and am experiencing some form of timeout issue during the creation of the cluster according to the logs.
    All validation checks pass successfully, whether trying to create a single node or dual node cluster, but the same error message is seen when creating the cluster. I have tried various suggestions found but none of them have made a difference. In an effort
    to further diagnose the issue I enabled the following diagnostic logs:
     - FailoverClustering
     - FailoverClustering-Manager
     - FailoverClustering-Client
    The only useful error I can find is in the FailoverClustering-Client log which reports an error 'Couldn't resolve tcp binding to cluster' for each physical node to be part of the cluster.
    In order to further diagnose the cause of the issue, I am looking for any options for increasing logging when attempting to create the cluster. Is there a way to increase the logging to see what the actual timeout is occurring with?
    Alex.

    Sorry, I should have been more clear ...The servers I am attempting to create a cluster with are Virtual Servers running on a VMware ESXi (5.0.3). They have access to two shared disks (connected to each VM using a separate SCSI Controller from that for the
    disk used to install the OS) with Virtual SCSI Bus Sharing set within VMware.
    Each Virtual Server has two NICs configured (with static IPs) - one for internal (domain connectivity) and the other for heartbeat connectivity. The servers can ping each other via both interfaces, as expected, but only domain connectivity works via the
    internal NIC.
    I have tried creating a single node or dual node cluster and get the same error each time. When the cluster is attempting to be created I can see the new computer object is created in Active Directory (which is then deleted when the cluster creation fails)
    and I have also tried pre-creating the computer object and specifically setting permissions on it.
    When creating the cluster I have tried via the GUI and via PowerShell (both with and without the option to attach the shared storage) but always get the same type of timeout error message. I am hoping there are further debugging options that can be used
    to provide a better output as to what the timeout is occurring with.

  • Windows 2008 R2 NFS setup issues...

    Hi all,
    Server is a domain controller and is the only server in it's domain.
    Windows 2008 Enterprise R2 fully updated and is a new install.
    I can only install NFS client not NFS server (only from CLI using Ocsetup, from Server Manager / Roles NFS does not install at all).
    Errors logged are:
    The Windows component "ServicesForNFS-ServerAndClient;ServerForNFS-Infrastructure;NFS-Administration;ClientForNFS-Infrastructure" could not be configured. 
    The component installer returned an error: 3017 "The requested operation failed. A system reboot is required to roll back changes made." (Command line: "Ocsetup 
    ServicesForNFS-ServerAndClient;ServerForNFS-Infrastructure;NFS-Administration;ClientForNFS-Infrastructure")
    AND:
    Update CoreFileServer of package FileServer-All failed to be turned on. Status: 0x80070bc9.
    Update ClientForNFS-Infrastructure of package NFS-Full failed to be turned on. Status: 0x80070bc9.
    Update NFS-Administration of package NFS-Full failed to be turned on. Status: 0x80070bc9.
    Update ServerForNFS-Infrastructure of package NFS-Full failed to be turned on. Status: 0x80070bc9.
    The component setup program encountered an error: 0x643. Fatal error during installation
    ... anyone had the same experience... really need NFS server installed to use User Name Mapping service!
    Thanks.

    Hi Lex,
    I will try to follow your setup steps and see if I can hit the same issue. Here is what I am going to try
    1) New Install of Windows 2008 Enterprise Edition R2
    2) Turn on automatic updating and install all updates
    3) Install AD Services and promote server to DC (new domain in new forest, functional level Windows 2003)
    4) Do you have DNS or any other selection besides this ?
    After this I will run
    Ocsetup 
    ServicesForNFS-ServerAndClient;ServerForNFS-Infrastructure;NFS-Administration;ClientForNFS-Infrastructure
    I see that you mentioned "really need NFS server installed to use User Name Mapping service!" Are you planning to run User Name Mapping Service on this machine ? User
    name mapping service is no longer shipped from Windows 2008 Server onwards.
    Thanks,
    Frank

  • Windows 2008 R2 RDS Licensing Issue

    I have Citrix Presentation Server 4.5 farm (with all of the application servers running Windows 2003) and I have just migrated from using a Windows 2003 server for the terminal services licensing to a Windows 2008 R2 RDS server for the licensing. We have
    a number of thin-clients that connect to the Citrix farm and provide a kiosk for users. We have 85 per device licenses however we are only using 15 of those licenses (plans were made but never implemented to use the rest), so we have 70 available licenses.
    The licenses are configured per device and as Windows Server 2003 licenses.
    After the migration to 2008 R2, the thin-clients connected to the new licensing server without any trouble at all. As I monitored the licenses on the new server, each thin-client was given a temporary license first and then at the
    next connection they got a permanent license. All of this I have been able to confirm through the event logs on the server.
    However, what I get in the event logs of the new 2008 R2 licensing server an event with event ID 21 that says:
    The Remote Desktop license server "ServerName" does not have any remaining permanent Remote Desktop Services client access licenses (RDS CALs) of the type "Windows Server 2003 - TS Per Device CAL". As a result, the Remote Desktop license server cannot issue
    RDS CALs of the type "Windows Server 2003 - TS Per Device CAL" to the Remote Desktop Session Host server "vvv.xxx.yyy.zzz". To resolve this problem, verify that the Remote Desktop licensing mode configured on the RD Session Host server matches the type of
    RDS CALs installed on the Remote Desktop license server. If required, purchase and install additional RDS CALs as needed for this Remote Desktop license server.
    (Note I have removed the server name and IP address due to company policy.) I have confirmed that every server in my Citrix farm has its terminal services configuration set for "per device" licensing and I have also specified the name of the 2008
    R2 server rather than allow the servers to automatically find the licensing server. I have confirmed that my 2008 R2 server is configured for "per device" licensing.
    The IP addresses I have seen in the event log messages are the IP addresses of a Citrix server rather than one of the thin-clients, and so far every Citrix server we have has appeared in one of these event log messages. I have been able
    to determine that this event does not occur when a thin-client is connecting up nor does this event occur when I remotely log into the server.
    As I noted above we only have 15 thin-clients using the 85 licenses so we have 70 available licenses for the Citrix servers so why are we out of licenses? What is this message trying to tell me?
    Thanks
    Brent

    Hi Bent,
    According the Event ID 21, I think you might have the license connection issues with RDS CALs. I suggest you analyze some relative services and
    make sure your network without any misconfiguration.
    Hopefully, there is an article describes how to troubleshoot this license issue on the terminal server.
    Event ID 21 — Terminal Services Client Access License (TS CAL)
    http://technet.microsoft.com/en-US/library/A98D84AC-B824-4F00-BF58-3CFF23493BF9.aspx
    By the way, the license of Windows Server 2003 does not support to assign CAL to allow user to access the Windows Server 2008. You should buy a
    new Windows Server 2008 license to meet the requirement above if necessary.
    Hope this helps.

  • Windows 2008 R2 RRAS VPN Issue

    Hello,
        I have a Windows 2008 R2 server configured with RRAS.  I have several persistent connections set up to do remote data backups.  After a while, the connections get disconnected and if I try to reconnect, I get an error message
    that states:
    An error occurred during connection of the interface.  A connection to the remote computer could not be established.  You might need to change the network settings for this connection.
    If I restart the RRAS service, then I can reconnect them all.  And they work fine until they get disconnected again.  The server is a standalone server, not part of a domain or anything.
    I previously had these connections set up on a 2003 server, and they worked pretty flawlessly.  It's only since I changed to this new server that these issues started.  Anyone know what the issue could be?
    Thanks.

    Is that Event ID 20167?
    Is there a DHCP Relay Agent configured?
    I assume the DHCP server has enough free IPs to hand out to RRAS when needed. RRAS grabs a block of 10 IPs from DHCP at a time to use for connections.
    How long is the lease?
    References:
    Event ID 20167 — RRAS IPCP Negotiation - Resolution
    http://technet.microsoft.com/en-us/library/dd315994(v=ws.10).aspx
    Not enough IPs in DHCP Scope:
    http://www.eventid.net/display.asp?eventid=20167&eventno=5288&source=RemoteAccess&phase=1
    Routing and Remote Access VPN DHCP error - DHCP lease too short
    http://social.technet.microsoft.com/Forums/windowsserver/en-US/58e62df7-ce40-4814-b522-6785e230c869/routing-and-remote-access-vpn-dhcp-error?forum=winserver8gen
    Ace Fekay
    MVP, MCT, MCSE 2012, MCITP EA & MCTS Windows 2008/R2, Exchange 2013, 2010 EA & 2007, MCSE & MCSA 2003/2000, MCSA Messaging 2003
    Microsoft Certified Trainer
    Microsoft MVP - Directory Services
    Complete List of Technical Blogs: http://www.delawarecountycomputerconsulting.com/technicalblogs.php
    This posting is provided AS-IS with no warranties or guarantees and confers no rights.

  • Windows 2008 R2 Screen Lock Issue (GPO)

    Scenario: We will be deploying POS machines at our stores that will have Windows 2008 R2 as the preferred OS. The function of this POS machine is for POS administration and not for ringing up sales. The machines have been configured to autologin a specific
    user via GPO for POS functions. Also, a specific POS desktop environment shell has been configured to launch instead of Explorer (explorer.exe) shell environment at autologon.
    Everything seems to be working as expected except for the session of the user locking. Since the POS environment needs to be up at all times with the specific user profile, we do not want the OS to lock the user session. I've timed it and it seems to lock
    the screen (not log off) at approximately 15 minutes of inactivity, we do not want this.
    So far, these are the GPOs I have configured that have not fixed the issue:
    Computer Configuration>Policies>Windows Settings>Security Settings>Local Policies>Security Options>Microsoft Network Server: Amount of idle time required before suspending session = 99999 minutes
    Computer Configuration>Policies>Administrative Templates>System>Power Management>Sleep Settings>Allow applications to prevent automatic sleep (plugged in) = Enabled
    Computer Configuration>Policies>Administrative Templates>System>Power Management>Sleep Settings>Require a password when a computer wakes (plugged in) = Disabled
    Computer Configuration>Policies>Administrative Templates>System>Power Management>Sleep Settings>Turn off hybrid sleep (plugged in) = Enabled
    Computer Configuration>Policies>Administrative Templates>System>Power Management>Sleep Settings>Turn on the ability for applications to prevent sleep transitions (plugged in) = Enabled
    Computer Configuration>Policies>Administrative Templates>System>Power Management>Video and Display Settings>Turn off the display (plugged in) = Enabled = 99999 seconds
    User Configuration>Policies>Administrative Templates>Control Panel>Personalization>Enable screen saver = Disabled
    User Configuration>Policies>Administrative Templates>Control Panel>Personalization>Password protect the screen saver = Disabled
    User Configuration>Policies>Administrative Templates>System>Ctrl+Alt+Del Options>Remove Lock Computer = Enabled
    User Configuration>Preferences>Windows Settings>Registry>HKCU>Control Panel>Desktop>ScreenSaveActive = 0
    What are we doing wrong? How do I configure the OS to not lock the user session but keep it active at all times?
    As a side note: We have Windows 7 POS machines also that will be ringing up sales that we do not have the screen lock issue.

    Hi,
    >>Please see my setting indicated in my original post. We have Turn Off the Display set to 99999 seconds.
    I understand that we have set the Turn Off the Display for this amount of time. However, just for double check, we can go to the power plan we are using to check if the setting has been applied successfully. If the setting has been applied successfully,
    it should be grayed out. Or, we can run command gpresult/h gpreport.html
    with admin privileges to collect group policy result report to check this.
    Besides, do we use other third party software to protect our computer? We can try to clean boot the server to see if the situation persists.
    Regarding how to perform a clean boot, the following article can be referred to for more information.
    How to perform a clean boot in Windows
    http://support.microsoft.com/KB/929135
    TechNet Subscriber Support
    If you are TechNet Subscription user and have any feedback on our support quality, please send your feedback here.
    Best regards,
    Frank Shen

  • Windows 2008 and Tiger SMB Issues

    I've been pulling hair out all morning over this one.
    We have a new Windows 2008 server for file sharing. We are trying to connect to it via SMB on our network (with AD domain). Works great on PC, works on Leopard, does not work on Tiger.
    From connect I type “smb://xxxxxxxx” after a few minutes I get an error: “could not connect to the server because the name or password is not correct” which is odd because I haven’t entered any login credentials to begin with.
    I’ve been pouring over Google, Microsoft KB and anything else I can come across with no luck. Things I’ve tried.
    -Clearing keychain passwords for the server
    -Setting the digital signing on the server to disable (most cited fix, but no go for me)
    -Setting Sharing and Security model to “Classic – local users authenticate themselves”
    -Setting LAN Manager authentication to “Send LM & NTLM – use NTLMv2 session security if negotiated”
    -Editing the smb.conf file on the mac to no security
    -Created the nsmb.conf file on the mac with minauth=none.
    -Used Directory access on the mac to add the mac and bind it to the domain.
    -Many Many restarts of the server and clients (and running gpupdate.exe on the server)
    One thing that DOES work is a trial of ADmitmac… but this is not realistic for us if we have guest users needing to access the share.
    I’ve been able to use smb before with tiger and windows xp and windows 2003… but the mac is throwing a fit over the new windows 2008. Also, we can’t upgrade all of our machines to Leopard (which does work) because it will break Quark 6.5.

    Any relevant looking log messages if you browse in Console?
    - cfr

  • Node eviction issue in Windows 10.2.0.4 RAC

    Hi,
    In one of my windows 10.2.0.4 RAC setup, the 2nd node is frequently getting evicted.
    Following are the contents of OCSD.log taken from the 1st node (as the 2nd node is down and not able to access)
    [    CSSD]2012-12-18 16:27:01.084 [5624] >WARNING: clssnmPollingThread: node ushdc5606 (2) at 50 3.774662e-321artbeat fatal, eviction in 29.860 seconds seedhbimpd 0
    [    CSSD]2012-12-18 16:27:01.084 [5624] >TRACE: clssnmPollingThread: node ushdc5606 (2) is impending reconfig, flag 1037, misstime 30140
    [    CSSD]2012-12-18 16:27:01.084 [5624] >TRACE: clssnmPollingThread: diskTimeout set to (57000)ms impending reconfig status(1)
    [    CSSD]2012-12-18 16:27:02.084 [5624] >WARNING: clssnmPollingThread: node ushdc5606 (2) at 50 3.804305e-321artbeat fatal, eviction in 28.860 seconds seedhbimpd 1
    [    CSSD]2012-12-18 16:27:14.240 [5548] >TRACE: clsc_send_msg: (00000000044DE190) NS err (12571, 12560), transport (530, 54, 0)
    [    CSSD]2012-12-18 16:27:14.240 [5748] >TRACE: clscreceive: (00000000030AC4B0) Connection not active
    [    CSSD]2012-12-18 16:27:14.240 [5748] >WARNING: clssnmeventhndlr: Receive failure with node 2 (ushdc5606), state 3, con(00000000030AC4B0), probe(0000000000000000), rc=6
    [    CSSD]2012-12-18 16:27:14.240 [5748] >TRACE: clssnmDiscHelper: ushdc5606, node(2) connection failed, con (00000000030AC4B0), probe(0000000000000000)
    [    CSSD]2012-12-18 16:27:14.240 [5748] >WARNING: clssnmeventhndlr: Send failure con (00000000030AC4B0), rc=3
    [    CSSD]2012-12-18 16:27:16.786 [5624] >WARNING: clssnmPollingThread: node ushdc5606 (2) at 75 3.932763e-321artbeat fatal, eviction in 14.157 seconds seedhbimpd 1
    [    CSSD]2012-12-18 16:27:25.786 [5624] >WARNING: clssnmPollingThread: node ushdc5606 (2) at 90 3.982169e-321artbeat fatal, eviction in 5.157 seconds seedhbimpd 1
    [    CSSD]2012-12-18 16:27:26.786 [5624] >WARNING: clssnmPollingThread: node ushdc5606 (2) at 90 3.992050e-321artbeat fatal, eviction in 4.157 seconds seedhbimpd 1
    [    CSSD]2012-12-18 16:27:27.786 [5624] >WARNING: clssnmPollingThread: node ushdc5606 (2) at 90 4.001932e-321artbeat fatal, eviction in 3.157 seconds seedhbimpd 1
    [    CSSD]2012-12-18 16:27:28.786 [5624] >WARNING: clssnmPollingThread: node ushdc5606 (2) at 90 4.011813e-321artbeat fatal, eviction in 2.157 seconds seedhbimpd 1
    [    CSSD]2012-12-18 16:27:29.786 [5624] >WARNING: clssnmPollingThread: node ushdc5606 (2) at 90 4.041457e-321artbeat fatal, eviction in 1.157 seconds seedhbimpd 1
    [    CSSD]2012-12-18 16:27:30.786 [5624] >WARNING: clssnmPollingThread: node ushdc5606 (2) at 90 4.051338e-321artbeat fatal, eviction in 0.157 seconds seedhbimpd 1
    [    CSSD]2012-12-18 16:27:30.958 [5624] >TRACE: clssnmPollingThread: Eviction started for node ushdc5606 (2), flags 0x0001, state 3, wt4c 0 seedhbimpd 1
    [    CSSD]2012-12-18 16:27:30.958 [5780] >TRACE: clssnmDoSyncUpdate: Initiating sync 7
    [    CSSD]2012-12-18 16:27:30.958 [5780] >TRACE: clssnmDoSyncUpdate: diskTimeout set to (57000)ms
    [    CSSD]2012-12-18 16:27:30.958 [5780] >TRACE: clssnmSetupAckWait: Ack message type (11)
    [    CSSD]2012-12-18 16:27:30.958 [5780] >TRACE: clssnmSetupAckWait: node(1) is ALIVE
    [    CSSD]2012-12-18 16:27:30.958 [5780] >TRACE: clssnmSendSync: syncSeqNo(7)
    [    CSSD]2012-12-18 16:27:30.958 [5780] >TRACE: clssnmWaitForAcks: Ack message type(11), ackCount(1)
    [    CSSD]2012-12-18 16:27:30.958 [5748] >TRACE: clssnmHandleSync: diskTimeout set to (57000)ms
    [    CSSD]2012-12-18 16:27:30.958 [5780] >TRACE: clssnmCheckDskCohort: node 2, ushdc5606, state 5 with leader 2 has smaller cluster size 1; my cluster size 1 with leader 1
    [    CSSD]2012-12-18 16:27:30.958 [5748] >TRACE: clssnmHandleSync: Acknowledging sync: src[1] srcName[ushdc5605] seq[9] sync[7]
    [    CSSD]2012-12-18 16:27:30.958 [7052] >USER: NMEVENT_SUSPEND [00][00][00][06]
    [    CSSD]2012-12-18 16:27:30.958 [5780] >TRACE: clssnmWaitForAcks: done, msg type(11)
    [    CSSD]2012-12-18 16:27:30.958 [5780] >TRACE: clssnmDoSyncUpdate: Terminating node 2, ushdc5606, misstime(60015) state(5), seedhbimpd(1)
    [    CSSD]2012-12-18 16:27:30.958 [5780] >TRACE: clssnmSetupAckWait: Ack message type (13)
    [    CSSD]2012-12-18 16:27:30.958 [5780] >TRACE: clssnmSetupAckWait: node(1) is ACTIVE
    [    CSSD]2012-12-18 16:27:30.958 [5780] >TRACE: clssnmWaitForAcks: Ack message type(13), ackCount(1)
    [    CSSD]2012-12-18 16:27:30.958 [5748] >TRACE: clssnmSendVoteInfo: node(1) syncSeqNo(7)
    [    CSSD]2012-12-18 16:27:30.958 [5780] >TRACE: clssnmWaitForAcks: done, msg type(13)
    [    CSSD]2012-12-18 16:27:30.958 [5780] >TRACE: clssnmCheckDskInfo: Checking disk info...
    [    CSSD]2012-12-18 16:27:30.958 [5780] >TRACE: clssnmCheckDskCohort: node 2, ushdc5606, state 5 with leader 2 has smaller cluster size 1; my cluster size 1 with leader 1
    [    CSSD]2012-12-18 16:27:30.958 [5780] >TRACE: clssnmEvict: Start
    [    CSSD]2012-12-18 16:27:30.958 [5780] >TRACE: clssnmEvict: Evicting node 2, ushdc5606, birth 6, death 7, impendingrcfg 1, stateflags 0x1
    [    CSSD]2012-12-18 16:27:30.958 [5780] >TRACE: clssnmWaitOnEvictions: Start
    [    CSSD]2012-12-18 16:27:30.958 [5780] >TRACE: clssnmWaitOnEvictions: node 2, undead 1
    [    CSSD]2012-12-18 16:27:31.458 [5780] >TRACE: clssnmWaitOnEvictions: node 2, undead 1
    [    CSSD]2012-12-18 16:27:31.458 [7120] >TRACE: clssnmReadDskHeartbeat: node(2) is down. rcfg(7) wrtcnt(1783066) LATS(2748066390) Disk lastSeqNo(1783066)
    [    CSSD]2012-12-18 16:27:31.458 [7112] >TRACE: clssnmReadDskHeartbeat: node(2) is down. rcfg(7) wrtcnt(1783066) LATS(2748066390) Disk lastSeqNo(1783066)
    [    CSSD]2012-12-18 16:27:31.458 [7116] >TRACE: clssnmReadDskHeartbeat: node(2) is down. rcfg(7) wrtcnt(1783066) LATS(2748066390) Disk lastSeqNo(1783066)
    [    CSSD]2012-12-18 16:27:31.958 [5780] >TRACE: clssnmWaitOnEvictions: node 2, undead 1
    [    CSSD]2012-12-18 16:27:32.458 [5780] >TRACE: clssnmWaitOnEvictions: node 2, undead 1
    [    CSSD]2012-12-18 16:27:32.958 [5780] >TRACE: clssnmWaitOnEvictions: node 2, undead 1
    [    CSSD]2012-12-18 16:27:33.458 [5780] >TRACE: clssnmWaitOnEvictions: node 2, undead 1
    [    CSSD]2012-12-18 16:27:33.958 [5780] >TRACE: clssnmWaitOnEvictions: node 2, undead 1
    [    CSSD]2012-12-18 16:27:34.458 [5780] >TRACE: clssnmWaitOnEvictions: node 2, undead 1
    [    CSSD]2012-12-18 16:27:34.958 [5780] >TRACE: clssnmWaitOnEvictions: node 2, undead 1
    [    CSSD]2012-12-18 16:27:35.458 [5780] >TRACE: clssnmWaitOnEvictions: node 2, undead 1
    [    CSSD]2012-12-18 16:27:35.958 [5780] >TRACE: clssnmWaitOnEvictions: node 2, undead 1
    [    CSSD]2012-12-18 16:27:36.458 [5780] >TRACE: clssnmWaitOnEvictions: node 2, undead 1
    [    CSSD]2012-12-18 16:27:36.958 [5780] >TRACE: clssnmWaitOnEvictions: node 2, undead 1
    [    CSSD]2012-12-18 16:27:37.458 [5780] >TRACE: clssnmWaitOnEvictions: node 2, undead 1
    [    CSSD]2012-12-18 16:27:37.958 [5780] >TRACE: clssnmWaitOnEvictions: node 2, undead 1
    [    CSSD]2012-12-18 16:27:38.458 [5780] >TRACE: clssnmWaitOnEvictions: node 2, undead 1
    [    CSSD]2012-12-18 16:27:38.958 [5780] >TRACE: clssnmWaitOnEvictions: node 2, undead 1
    [    CSSD]2012-12-18 16:27:39.458 [5780] >TRACE: clssnmWaitOnEvictions: node 2, undead 1
    [    CSSD]2012-12-18 16:27:39.958 [5780] >TRACE: clssnmWaitOnEvictions: node 2, undead 1
    [    CSSD]2012-12-18 16:27:40.457 [5780] >TRACE: clssnmWaitOnEvictions: node 2, undead 1
    [    CSSD]2012-12-18 16:27:40.957 [5780] >TRACE: clssnmWaitOnEvictions: node 2, undead 1
    [    CSSD]2012-12-18 16:27:41.457 [5780] >TRACE: clssnmWaitOnEvictions: node 2, undead 1
    [    CSSD]2012-12-18 16:27:41.957 [5780] >TRACE: clssnmWaitOnEvictions: node 2, undead 1
    [    CSSD]2012-12-18 16:27:42.457 [5780] >TRACE: clssnmWaitOnEvictions: node 2, undead 1
    [    CSSD]2012-12-18 16:27:42.957 [5780] >TRACE: clssnmWaitOnEvictions: node 2, undead 1
    [    CSSD]2012-12-18 16:27:43.457 [5780] >TRACE: clssnmWaitOnEvictions: node 2, undead 1
    [    CSSD]2012-12-18 16:27:43.957 [5780] >TRACE: clssnmWaitOnEvictions: node 2, undead 1
    [    CSSD]2012-12-18 16:27:44.457 [5780] >TRACE: clssnmWaitOnEvictions: node 2, undead 1
    [    CSSD]2012-12-18 16:27:44.957 [5780] >TRACE: clssnmWaitOnEvictions: node 2, undead 1
    [    CSSD]2012-12-18 16:27:45.457 [5780] >TRACE: clssnmWaitOnEvictions: node 2, undead 1
    [    CSSD]2012-12-18 16:27:45.957 [5780] >TRACE: clssnmWaitOnEvictions: node 2, undead 1
    [    CSSD]2012-12-18 16:27:46.457 [5780] >TRACE: clssnmWaitOnEvictions: node 2, undead 1
    [    CSSD]2012-12-18 16:27:46.957 [5780] >TRACE: clssnmWaitOnEvictions: node 2, undead 1
    [    CSSD]2012-12-18 16:27:47.457 [5780] >TRACE: clssnmWaitOnEvictions: node 2, undead 1
    [    CSSD]2012-12-18 16:27:47.957 [5780] >TRACE: clssnmWaitOnEvictions: node 2, undead 1
    [    CSSD]2012-12-18 16:27:48.457 [5780] >TRACE: clssnmWaitOnEvictions: node 2, undead 1
    [    CSSD]2012-12-18 16:27:48.957 [5780] >TRACE: clssnmWaitOnEvictions: node 2, undead 1
    [    CSSD]2012-12-18 16:27:49.457 [5780] >TRACE: clssnmWaitOnEvictions: node 2, undead 1
    [    CSSD]2012-12-18 16:27:49.957 [5780] >TRACE: clssnmWaitOnEvictions: node 2, undead 1
    [    CSSD]2012-12-18 16:27:50.457 [5780] >TRACE: clssnmWaitOnEvictions: node 2, undead 1
    [    CSSD]2012-12-18 16:27:50.957 [5780] >TRACE: clssnmWaitOnEvictions: node 2, undead 1
    [    CSSD]2012-12-18 16:27:51.457 [5780] >TRACE: clssnmWaitOnEvictions: node 2, undead 1
    [    CSSD]2012-12-18 16:27:51.957 [5780] >TRACE: clssnmWaitOnEvictions: node 2, undead 1
    [    CSSD]2012-12-18 16:27:52.457 [5780] >TRACE: clssnmWaitOnEvictions: node 2, undead 1
    [    CSSD]2012-12-18 16:27:52.957 [5780] >TRACE: clssnmWaitOnEvictions: node 2, undead 1
    [    CSSD]2012-12-18 16:27:53.457 [5780] >TRACE: clssnmWaitOnEvictions: node 2, undead 1
    [    CSSD]2012-12-18 16:27:53.957 [5780] >TRACE: clssnmWaitOnEvictions: node 2, undead 1
    [    CSSD]2012-12-18 16:27:54.457 [5780] >TRACE: clssnmWaitOnEvictions: node 2, undead 1
    [    CSSD]2012-12-18 16:27:54.957 [5780] >TRACE: clssnmWaitOnEvictions: node 2, undead 1
    [    CSSD]2012-12-18 16:27:55.457 [5780] >TRACE: clssnmWaitOnEvictions: node 2, undead 1
    [    CSSD]2012-12-18 16:27:55.957 [5780] >TRACE: clssnmWaitOnEvictions: node 2, undead 1
    [    CSSD]2012-12-18 16:27:56.457 [5780] >TRACE: clssnmWaitOnEvictions: node 2, undead 1
    [    CSSD]2012-12-18 16:27:56.957 [5780] >TRACE: clssnmWaitOnEvictions: node 2, undead 1
    [    CSSD]2012-12-18 16:27:57.457 [5780] >TRACE: clssnmWaitOnEvictions: node 2, undead 1
    [    CSSD]2012-12-18 16:27:57.957 [5780] >TRACE: clssnmWaitOnEvictions: node 2, undead 1
    [    CSSD]2012-12-18 16:27:58.457 [5780] >TRACE: clssnmWaitOnEvictions: node 2, undead 1
    [    CSSD]2012-12-18 16:27:58.957 [5780] >TRACE: clssnmWaitOnEvictions: node 2, undead 1
    [    CSSD]2012-12-18 16:27:59.457 [5780] >TRACE: clssnmWaitOnEvictions: node 2, undead 1
    [    CSSD]2012-12-18 16:27:59.957 [5780] >TRACE: clssnmWaitOnEvictions: node 2, undead 1
    [    CSSD]2012-12-18 16:28:00.457 [5780] >TRACE: clssnmWaitOnEvictions: node 2, undead 1
    [    CSSD]2012-12-18 16:28:00.957 [5780] >TRACE: clssnmWaitOnEvictions: node 2, undead 1
    [    CSSD]2012-12-18 16:28:01.457 [5780] >TRACE: clssnmWaitOnEvictions: node 2, undead 1
    [    CSSD]2012-12-18 16:28:01.957 [5780] >TRACE: clssnmWaitOnEvictions: node 2, undead 1
    [    CSSD]2012-12-18 16:28:02.457 [5780] >TRACE: clssnmWaitOnEvictions: node 2, undead 1
    [    CSSD]2012-12-18 16:28:02.957 [5780] >TRACE: clssnmWaitOnEvictions: node 2, undead 1
    [    CSSD]2012-12-18 16:28:03.457 [5780] >TRACE: clssnmWaitOnEvictions: node 2, undead 1
    [    CSSD]2012-12-18 16:28:03.957 [5780] >TRACE: clssnmWaitOnEvictions: node 2, undead 1
    [    CSSD]2012-12-18 16:28:04.457 [5780] >TRACE: clssnmWaitOnEvictions: node 2, undead 1
    [    CSSD]2012-12-18 16:28:04.957 [5780] >TRACE: clssnmWaitOnEvictions: node 2, undead 1
    [    CSSD]2012-12-18 16:28:05.457 [5780] >TRACE: clssnmWaitOnEvictions: node 2, undead 1
    [    CSSD]2012-12-18 16:28:05.957 [5780] >TRACE: clssnmWaitOnEvictions: node 2, undead 1
    [    CSSD]2012-12-18 16:28:06.457 [5780] >TRACE: clssnmWaitOnEvictions: node 2, undead 1
    [    CSSD]2012-12-18 16:28:06.957 [5780] >TRACE: clssnmWaitOnEvictions: node 2, undead 1
    [    CSSD]2012-12-18 16:28:07.457 [5780] >TRACE: clssnmWaitOnEvictions: node 2, undead 1
    [    CSSD]2012-12-18 16:28:07.957 [5780] >TRACE: clssnmWaitOnEvictions: node 2, undead 1
    [    CSSD]2012-12-18 16:28:08.457 [5780] >TRACE: clssnmWaitOnEvictions: node 2, undead 1
    [    CSSD]2012-12-18 16:28:08.957 [5780] >TRACE: clssnmWaitOnEvictions: node 2, undead 1
    [    CSSD]2012-12-18 16:28:09.457 [5780] >TRACE: clssnmWaitOnEvictions: node 2, undead 1
    [    CSSD]2012-12-18 16:28:09.957 [5780] >TRACE: clssnmWaitOnEvictions: node 2, undead 1
    [    CSSD]2012-12-18 16:28:10.457 [5780] >TRACE: clssnmWaitOnEvictions: node 2, undead 1
    [    CSSD]2012-12-18 16:28:10.957 [5780] >TRACE: clssnmWaitOnEvictions: node 2, undead 1
    [    CSSD]2012-12-18 16:28:11.457 [5780] >TRACE: clssnmWaitOnEvictions: node 2, undead 1
    [    CSSD]2012-12-18 16:28:11.956 [5780] >TRACE: clssnmWaitOnEvictions: node 2, undead 1
    [    CSSD]2012-12-18 16:28:12.456 [5780] >TRACE: clssnmWaitOnEvictions: node 2, undead 1
    [    CSSD]2012-12-18 16:28:12.956 [5780] >TRACE: clssnmWaitOnEvictions: node 2, undead 1
    [    CSSD]2012-12-18 16:28:13.456 [5780] >TRACE: clssnmWaitOnEvictions: node 2, undead 1
    [    CSSD]2012-12-18 16:28:13.956 [5780] >TRACE: clssnmWaitOnEvictions: node 2, undead 1
    [    CSSD]2012-12-18 16:28:14.456 [5780] >TRACE: clssnmWaitOnEvictions: node 2, undead 1
    [    CSSD]2012-12-18 16:28:14.956 [5780] >TRACE: clssnmWaitOnEvictions: node 2, undead 1
    [    CSSD]2012-12-18 16:28:15.456 [5780] >TRACE: clssnmWaitOnEvictions: node 2, undead 1
    [    CSSD]2012-12-18 16:28:15.956 [5780] >TRACE: clssnmWaitOnEvictions: node 2, undead 1
    [    CSSD]2012-12-18 16:28:16.456 [5780] >TRACE: clssnmWaitOnEvictions: node 2, undead 1
    [    CSSD]2012-12-18 16:28:16.956 [5780] >TRACE: clssnmWaitOnEvictions: node 2, undead 1
    [    CSSD]2012-12-18 16:28:17.456 [5780] >TRACE: clssnmWaitOnEvictions: node 2, undead 1
    [    CSSD]2012-12-18 16:28:17.956 [5780] >TRACE: clssnmWaitOnEvictions: node 2, undead 1
    [    CSSD]2012-12-18 16:28:18.456 [5780] >TRACE: clssnmWaitOnEvictions: node 2, undead 1
    [    CSSD]2012-12-18 16:28:18.956 [5780] >TRACE: clssnmWaitOnEvictions: node 2, undead 1
    [    CSSD]2012-12-18 16:28:19.456 [5780] >TRACE: clssnmWaitOnEvictions: node 2, undead 1
    [    CSSD]2012-12-18 16:28:19.956 [5780] >TRACE: clssnmWaitOnEvictions: node 2, undead 1
    [    CSSD]2012-12-18 16:28:20.456 [5780] >TRACE: clssnmWaitOnEvictions: node 2, undead 1
    [    CSSD]2012-12-18 16:28:20.956 [5780] >TRACE: clssnmWaitOnEvictions: node 2, undead 1
    [    CSSD]2012-12-18 16:28:21.456 [5780] >TRACE: clssnmWaitOnEvictions: node 2, undead 1
    [    CSSD]2012-12-18 16:28:21.956 [5780] >TRACE: clssnmWaitOnEvictions: node 2, undead 1
    [    CSSD]2012-12-18 16:28:22.456 [5780] >TRACE: clssnmWaitOnEvictions: node 2, undead 1
    [    CSSD]2012-12-18 16:28:22.956 [5780] >TRACE: clssnmWaitOnEvictions: node 2, undead 1
    [    CSSD]2012-12-18 16:28:23.456 [5780] >TRACE: clssnmWaitOnEvictions: node 2, undead 1
    [    CSSD]2012-12-18 16:28:23.956 [5780] >TRACE: clssnmWaitOnEvictions: node 2, undead 1
    [    CSSD]2012-12-18 16:28:24.456 [5780] >TRACE: clssnmWaitOnEvictions: node 2, undead 1
    [    CSSD]2012-12-18 16:28:24.956 [5780] >TRACE: clssnmWaitOnEvictions: node 2, undead 1
    [    CSSD]2012-12-18 16:28:25.456 [5780] >TRACE: clssnmWaitOnEvictions: node 2, undead 1
    [    CSSD]2012-12-18 16:28:25.956 [5780] >TRACE: clssnmWaitOnEvictions: node 2, undead 1
    [    CSSD]2012-12-18 16:28:26.456 [5780] >TRACE: clssnmWaitOnEvictions: node 2, undead 1
    [    CSSD]2012-12-18 16:28:26.956 [5780] >TRACE: clssnmWaitOnEvictions: node 2, undead 1
    [    CSSD]2012-12-18 16:28:27.456 [5780] >TRACE: clssnmWaitOnEvictions: node 2, undead 1
    [    CSSD]2012-12-18 16:28:27.956 [5780] >TRACE: clssnmWaitOnEvictions: node 2, undead 1
    [    CSSD]2012-12-18 16:28:28.456 [5780] >TRACE: clssnmWaitOnEvictions: node 2, undead 1
    [    CSSD]2012-12-18 16:28:28.956 [5780] >TRACE: clssnmWaitOnEvictions: node 2, undead 1
    [    CSSD]2012-12-18 16:28:29.456 [5780] >TRACE: clssnmWaitOnEvictions: node 2, undead 1
    [    CSSD]2012-12-18 16:28:29.956 [5780] >TRACE: clssnmWaitOnEvictions: node 2, undead 1
    [    CSSD]2012-12-18 16:28:30.456 [5780] >TRACE: clssnmWaitOnEvictions: node 2, undead 1
    [    CSSD]2012-12-18 16:28:30.956 [5780] >TRACE: clssnmWaitOnEvictions: node 2, undead 1
    [    CSSD]2012-12-18 16:28:31.456 [5780] >TRACE: clssnmWaitOnEvictions: node 2, undead 1
    [    CSSD]2012-12-18 16:28:31.456 [5780] >TRACE: clssnmCheckKillStatus: Node 2, ushdc5606, down, LATS(2748066390),timeout(60000)
    [    CSSD]2012-12-18 16:28:31.456 [5780] >TRACE: clssnmSetupAckWait: Ack message type (15)
    [    CSSD]2012-12-18 16:28:31.456 [5780] >TRACE: clssnmSetupAckWait: node(1) is ACTIVE
    [    CSSD]2012-12-18 16:28:31.456 [5780] >TRACE: clssnmSendUpdate: syncSeqNo(7)
    [    CSSD]2012-12-18 16:28:31.456 [5780] >TRACE: clssnmWaitForAcks: Ack message type(15), ackCount(1)
    [    CSSD]2012-12-18 16:28:31.456 [5748] >TRACE: clssnmUpdateNodeState: node 0, state (0/0) unique (0/0) prevConuni(0) birth (0/0) (old/new)
    [    CSSD]2012-12-18 16:28:31.456 [5748] >TRACE: clssnmUpdateNodeState: node 1, state (3/3) unique (1353121921/1353121921) prevConuni(0) birth (4/4) (old/new)
    [    CSSD]2012-12-18 16:28:31.456 [5748] >TRACE: clssnmUpdateNodeState: node 2, state (5/0) unique (1354086612/1354086612) prevConuni(1354086612) birth (6/6) (old/new)
    [    CSSD]2012-12-18 16:28:31.456 [5748] >TRACE: clssnmDeactivateNode: node 2 (ushdc5606) left cluster
    [    CSSD]2012-12-18 16:28:31.456 [5748] >USER: clssnmHandleUpdate: SYNC(7) from node(1) completed
    [    CSSD]2012-12-18 16:28:31.456 [5748] >USER: clssnmHandleUpdate: NODE 1 (ushdc5605) IS ACTIVE MEMBER OF CLUSTER
    [    CSSD]2012-12-18 16:28:31.456 [5748] >TRACE: clssnmHandleUpdate: diskTimeout set to (200000)ms
    [    CSSD]2012-12-18 16:28:31.456 [5780] >TRACE: clssnmWaitForAcks: done, msg type(15)
    [    CSSD]2012-12-18 16:28:31.456 [5780] >TRACE: clssnmDoSyncUpdate: Sync 7 complete!
    [    CSSD]2012-12-18 16:28:31.456 [7092] >TRACE: clssgmReconfigThread: started for reconfig (7)
    [    CSSD]2012-12-18 16:28:31.456 [7092] >USER: NMEVENT_RECONFIG [00][00][00][02]
    [    CSSD]2012-12-18 16:28:31.456 [7092] >TRACE: clssgmCleanupGrocks: cleaning up grock crs_version type 2
    [    CSSD]2012-12-18 16:28:31.456 [7092] >TRACE: clssgmCleanupOrphanMembers: cleaning up remote mbr(0) grock(crs_version) birth(6/6)
    [    CSSD]2012-12-18 16:28:31.456 [7092] >TRACE: clssgmCleanupGrocks: cleaning up grock DB+ASM type 2
    [    CSSD]2012-12-18 16:28:31.456 [7092] >TRACE: clssgmCleanupOrphanMembers: cleaning up remote mbr(1) grock(DB+ASM) birth(6/6)
    [    CSSD]2012-12-18 16:28:31.456 [7092] >TRACE: clssgmCleanupGrocks: cleaning up grock DG+ASM type 2
    [    CSSD]2012-12-18 16:28:31.456 [7092] >TRACE: clssgmCleanupOrphanMembers: cleaning up remote mbr(1) grock(DG+ASM) birth(6/6)
    [    CSSD]2012-12-18 16:28:31.456 [7092] >TRACE: clssgmCleanupGrocks: cleaning up grock DG_DG1 type 2
    [    CSSD]2012-12-18 16:28:31.456 [7092] >TRACE: clssgmCleanupOrphanMembers: cleaning up remote mbr(0) grock(DG_DG1) birth(6/6)
    [    CSSD]2012-12-18 16:28:31.456 [7092] >TRACE: clssgmCleanupOrphanMembers: cleaning up remote mbr(1) grock(DG_DG1) birth(6/6)
    [    CSSD]2012-12-18 16:28:31.456 [7092] >TRACE: clssgmCleanupGrocks: cleaning up grock DG_DG2 type 2
    [    CSSD]2012-12-18 16:28:31.456 [7092] >TRACE: clssgmCleanupOrphanMembers: cleaning up remote mbr(0) grock(DG_DG2) birth(6/6)
    [    CSSD]2012-12-18 16:28:31.456 [7092] >TRACE: clssgmCleanupOrphanMembers: cleaning up remote mbr(1) grock(DG_DG2) birth(6/6)
    [    CSSD]2012-12-18 16:28:31.456 [7092] >TRACE: clssgmCleanupGrocks: cleaning up grock ORA_CLSRD_1_opera type 2
    [    CSSD]2012-12-18 16:28:31.456 [7092] >TRACE: clssgmCleanupGrocks: cleaning up grock ORA_CLSRD_1_opera type 3
    [    CSSD]2012-12-18 16:28:31.456 [7092] >TRACE: clssgmCleanupGrocks: cleaning up grock ORA_CLSRD_2_opera type 2
    [    CSSD]2012-12-18 16:28:31.456 [7092] >TRACE: clssgmCleanupOrphanMembers: cleaning up remote mbr(0) grock(ORA_CLSRD_2_opera) birth(6/6)
    [    CSSD]2012-12-18 16:28:31.456 [7092] >TRACE: clssgmCleanupGrocks: cleaning up grock ORA_CLSRD_2_opera type 3
    [    CSSD]2012-12-18 16:28:31.456 [7092] >TRACE: clssgmCleanupOrphanMembers: cleaning up remote mbr(0) grock(ORA_CLSRD_2_opera) birth(6/6)
    [    CSSD]2012-12-18 16:28:31.456 [7092] >TRACE: clssgmCleanupGrocks: cleaning up grock DBOPERA type 2
    [    CSSD]2012-12-18 16:28:31.456 [7092] >TRACE: clssgmCleanupOrphanMembers: cleaning up remote mbr(1) grock(DBOPERA) birth(6/6)
    [    CSSD]2012-12-18 16:28:31.456 [7092] >TRACE: clssgmCleanupGrocks: cleaning up grock DGOPERA type 2
    [    CSSD]2012-12-18 16:28:31.456 [7092] >TRACE: clssgmCleanupOrphanMembers: cleaning up remote mbr(1) grock(DGOPERA) birth(6/6)
    [    CSSD]2012-12-18 16:28:31.456 [7092] >TRACE: clssgmCleanupGrocks: cleaning up grock OSM_ALL type 2
    [    CSSD]2012-12-18 16:28:31.456 [7092] >TRACE: clssgmCleanupOrphanMembers: cleaning up remote mbr(0) grock(OSM_ALL) birth(6/6)
    [    CSSD]2012-12-18 16:28:31.456 [7092] >TRACE: clssgmCleanupGrocks: cleaning up grock DAALL_DB type 2
    [    CSSD]2012-12-18 16:28:31.456 [7092] >TRACE: clssgmCleanupOrphanMembers: cleaning up remote mbr(0) grock(DAALL_DB) birth(6/6)
    [    CSSD]2012-12-18 16:28:31.456 [7092] >TRACE: clssgmCleanupOrphanMembers: cleaning up remote mbr(1) grock(DAALL_DB) birth(6/6)
    [    CSSD]2012-12-18 16:28:31.456 [7092] >TRACE: clssgmCleanupGrocks: cleaning up grock EVMDMAIN type 2
    [    CSSD]2012-12-18 16:28:31.456 [7092] >TRACE: clssgmCleanupOrphanMembers: cleaning up remote mbr(2) grock(EVMDMAIN) birth(6/6)
    [    CSSD]2012-12-18 16:28:31.456 [7092] >TRACE: clssgmCleanupGrocks: cleaning up grock CRSDMAIN type 2
    [    CSSD]2012-12-18 16:28:31.456 [7092] >TRACE: clssgmCleanupOrphanMembers: cleaning up remote mbr(2) grock(CRSDMAIN) birth(6/6)
    [    CSSD]2012-12-18 16:28:31.456 [7092] >TRACE: clssgmCleanupGrocks: cleaning up grock IGOPERAALL type 2
    [    CSSD]2012-12-18 16:28:31.456 [7092] >TRACE: clssgmCleanupOrphanMembers: cleaning up remote mbr(2) grock(IGOPERAALL) birth(6/6)
    [    CSSD]2012-12-18 16:28:31.456 [7092] >TRACE: clssgmCleanupGrocks: cleaning up grock ocr_QA_crs type 2
    [    CSSD]2012-12-18 16:28:31.456 [7092] >TRACE: clssgmCleanupOrphanMembers: cleaning up remote mbr(2) grock(ocr_QA_crs) birth(6/6)
    [    CSSD]2012-12-18 16:28:31.456 [7092] >TRACE: clssgmCleanupGrocks: cleaning up grock ORACRS_MEMBER_ushdc5605 type 3
    [    CSSD]2012-12-18 16:28:31.456 [7092] >TRACE: clssgmCleanupGrocks: cleaning up grock ORACRS_MEMBER_ushdc5606 type 3
    [    CSSD]2012-12-18 16:28:31.456 [7092] >TRACE: clssgmCleanupOrphanMembers: cleaning up remote mbr(0) grock(_ORA_CRS_MEMBER_ushdc5606) birth(6/6)
    [    CSSD]2012-12-18 16:28:31.456 [7092] >TRACE: clssgmEstablishConnections: 1 nodes in cluster incarn 7
    [    CSSD]2012-12-18 16:28:31.456 [992] >TRACE: clssgmPeerDeactivate: node 2 (ushdc5606), death 7, state 0x80000000 connstate 0xf
    [    CSSD]2012-12-18 16:28:31.456 [992] >TRACE: clssgmPeerListener: connects done (1/1)
    [    CSSD]2012-12-18 16:28:31.456 [7092] >TRACE: clssgmEstablishMasterNode: MASTER for 7 is node(1) birth(4)
    [    CSSD]2012-12-18 16:28:31.456 [7092] >TRACE: clssgmMasterCMSync: Synchronizing group/lock status
    [    CSSD]2012-12-18 16:28:31.456 [7092] >TRACE: clssgmMasterSendDBDone: group/lock status synchronization complete
    [    CSSD]CLSS-3000: reconfiguration successful, incarnation 7 with 1 nodes
    [    CSSD]CLSS-3001: local node number 1, master node number 1
    [    CSSD]2012-12-18 16:28:31.456 [7092] >TRACE: clssgmReconfigThread: completed for reconfig(7), with status(1)
    From the above log file content I am suspecting that the 2nd node was evicted because of the interconnect/NIC card issue in between the nodes.
    Please help me whether the eviction is due to the n/w or anything else?
    Thanks in advance,
    Mahi

    Mahi wrote:
    Hi,
    I am not sure about the cable. But the system was working fine from the time of setup to till yesterday, from yesterday only I am seeing the issue. I think it is not the issue with cable, if it was then I should have get the same issue from the time of setup.
    Also, just curious about the cables. Oracle's recommended is cross cable right? you are telling to use the cross cable?
    Thanks,
    MahiNo Crosscable Not recommend by Oracle for interconnect . What changed Last night ?

  • Node Eviction and SGA

    Hello All,
    We have a 6 node RAC on 10g rel 2 / windows 2003 64 bit. It was working well from all aspects.
    About 3 weeks back ( 3 days before i was to go for my vacation) SA needed to add more power modules, so the entire system (including SAN) was powered down and then brought back up. DB m/c by themselves have undergone a complete reboot before without any issues. This time it was the entire IT system.
    Two days after that, all out of sudden, we starting witnessing node eviction issues. Every day one node would get evicted but the m/c would not go down. The typical messages seen were (below is the message from ocssd.log on node 2 ) ..
    [    CSSD]2008-07-27 16:04:14.605 [5540] >WARNING: clssnmPollingThread: node serv-db01 (1) at 50% heartbeat fatal, eviction in 29.125 seconds
    [    CSSD]2008-07-27 16:04:29.605 [5540] >WARNING: clssnmPollingThread: node serv-db01 (1) at 75% heartbeat fatal, eviction in 14.125 seconds
    [    CSSD]2008-07-27 16:04:38.606 [5540] >WARNING: clssnmPollingThread: node serv-db01 (1) at 90% heartbeat fatal, eviction in 5.125 seconds
    [    CSSD]2008-07-27 16:04:39.606 [5540] >WARNING: clssnmPollingThread: node serv-db01 (1) at 90% heartbeat fatal, eviction in 4.125 seconds
    [    CSSD]2008-07-27 16:04:40.606 [5540] >TRACE: clssnmPollingThread: node serv-db01 (1) is impending reconfig
    [    CSSD]2008-07-27 16:04:40.606 [5540] >WARNING: clssnmPollingThread: node serv-db01 (1) at 90% heartbeat fatal, eviction in 3.125 seconds
    [    CSSD]2008-07-27 16:04:40.606 [5540] >TRACE: clssnmPollingThread: diskTimeout set to (57000)ms impending reconfig status(1)
    [    CSSD]2008-07-27 16:04:41.606 [5540] >TRACE: clssnmPollingThread: node serv-db01 (1) is impending reconfig
    [    CSSD]2008-07-27 16:04:41.606 [5540] >WARNING: clssnmPollingThread: node serv-db01 (1) at 90% heartbeat fatal, eviction in 2.125 seconds
    [    CSSD]2008-07-27 16:04:42.606 [5540] >TRACE: clssnmPollingThread: node serv-db01 (1) is impending reconfig
    [    CSSD]2008-07-27 16:04:42.606 [5540] >WARNING: clssnmPollingThread: node serv-db01 (1) at 90% heartbeat fatal, eviction in 1.125 seconds
    [    CSSD]2008-07-27 16:04:43.606 [5540] >TRACE: clssnmPollingThread: node serv-db01 (1) is impending reconfig
    [    CSSD]2008-07-27 16:04:43.606 [5540] >WARNING: clssnmPollingThread: node serv-db01 (1) at 90% heartbeat fatal, eviction in 0.125 seconds
    [    CSSD]2008-07-27 16:04:43.731 [5540] >TRACE: clssnmPollingThread: node serv-db01 (1) is impending reconfig
    [    CSSD]2008-07-27 16:04:43.731 [5540] >TRACE: clssnmPollingThread: Eviction started for node serv-db01 (1), flags 0x000f, state 3, wt4c 0
    [    CSSD]2008-07-27 16:04:43.731 [5640] >TRACE: clssnmDoSyncUpdate: Initiating sync 8
    [    CSSD]2008-07-27 16:04:43.731 [5640] >TRACE: clssnmDoSyncUpdate: diskTimeout set to (57000)ms
    [    CSSD]2008-07-27 16:04:43.731 [5640] >TRACE: clssnmSetupAckWait: Ack message type (11)
    [    CSSD]2008-07-27 16:04:43.731 [5640] >TRACE: clssnmSetupAckWait: node(1) is ALIVE
    [    CSSD]2008-07-27 16:04:43.731 [5640] >TRACE: clssnmSetupAckWait: node(2) is ALIVE
    [    CSSD]2008-07-27 16:04:43.731 [5640] >TRACE: clssnmSetupAckWait: node(3) is ALIVE
    [    CSSD]2008-07-27 16:04:43.731 [5640] >TRACE: clssnmSetupAckWait: node(4) is ALIVE
    [    CSSD]2008-07-27 16:04:43.731 [5640] >TRACE: clssnmSetupAckWait: node(5) is ALIVE
    [    CSSD]2008-07-27 16:04:43.731 [5640] >TRACE: clssnmSendSync: syncSeqNo(8)
    [    CSSD]2008-07-27 16:04:43.731 [5648] >TRACE: clssnmHandleSync: Acknowledging sync: src[2] srcName[serv-db02] seq[1] sync[8]
    [    CSSD]2008-07-27 16:04:43.731 [5648] >TRACE: clssnmHandleSync: diskTimeout set to (57000)ms
    [    CSSD]2008-07-27 16:04:43.731 [4340] >USER: NMEVENT_SUSPEND [00][00][00][3e]
    [    CSSD]2008-07-27 16:04:43.731 [5640] >TRACE: clssnmWaitForAcks: Ack message type(11), ackCount(4)
    [    CSSD]2008-07-27 16:04:43.731 [5640] >TRACE: clssnmWaitForAcks: node(1) is expiring, msg type(11)
    [    CSSD]2008-07-27 16:04:43.731 [5640] >TRACE: clssnmWaitForAcks: done, msg type(11)
    [    CSSD]2008-07-27 16:04:43.731 [5640] >TRACE: clssnmDoSyncUpdate: Terminating node 1, serv-db01, misstime(60000) state(3)
    [    CSSD]2008-07-27 16:04:43.731 [5640] >TRACE: clssnmSetupAckWait: Ack message type (13)
    No information was written to the alert logs on all the nodes.
    . We contacted oracle support and they were saying its a n/w issue etc,. But my SA was adament that its an oracle problem. Anyway i went for my vacation. There was a suggestion (SA had an oracle contact) that SGA needs to be increased. It was at 800 mb per node. My junoir dba was forced to raise it to 2 gb on each node based on SA's suggestion. Then all of a sudden from the next day, node eviction stopped.
    I cannot still beleive that increasing the SGA has got anything to do with node eviction. I told my upper mgmt that node eviction has nothing to do with the SGA. But the consensus in my IT dept is SGA increase solved the issue. Does anybdy think there is any connection between increase in SGA and node eviction. ?. I have read the node eviction papers in metalink and they do not mention about SGA at all.
    I would really appriciate any help in this regard.
    Thank You,
    Sat

    WARNING: clssnmPollingThread: node servAs you know that the above warning message because of the network delay which causes the node evictions. If a node doesn't send a network heartbeat for <misscount> (times in seconds) then the node will be evicted from the cluster. Have you check from your network team about any glitches in the around the node eviction time?
    I have read the node eviction papers in metalink and they do not mention about SGA at all. One of the other prime reason for node eviction is lack of resource on the server. I am not sure increasing the SGA might have resolved the node eviction issue. Why don't you produce a test case and submit oracle support for more clarification?
    Jaffar

  • Oracle RAC 11g on Windows 2008 64 bit - blue screen error on both nodes

    Hi Everyone,
    I installed Oracle RAC 11g on Windows 2008 64 bit, The installation was successfull and crs_state -t shows all services in two nodes are online.
    When executed a select query with 100 sessions( For performance evaluation using Transaction generator ) ,the machine got crashed and blue screen is appeared on two nodes. I restrated the machines and and starts the same evaluation ,bt the same bug is repeating.
    Can anyone suggest a solution to solve this issue? Is our hardware is not sufficient ? Shall we need to perform any
    specific settings in Oracle RAC setup for performance evaluations?
    Is our settings for load balancing is not enough? ( We added "Load Balancing= On" on tnsnames.ora on client for load
    balancing)
    The following machine configuration is used for Oracle RAC setup
    Intel Core 2 Duo 2.66 GHz,
    Ram :4GB.
    OS : windows 2008 Server 64 Bit
    Oracle RAC 11g , Clusterware 11g R2 , ASM with 5 raw disk ( 1- votting disk ,1- ocr files and 3 disk files)
    Edited by: user2033016 on Jun 29, 2011 10:02 PM

    user2033016 wrote:
    Hi Everyone,
    I installed Oracle RAC 11g on Windows 2008 64 bit, The installation was successfull crs_state -t executed successfully.
    Bt the machine got crashed ,when executed a select query with 100 sessions( For performance evaluation using TG). A blue screen is appeared on two nodes. So i am not able to evaluate the performance.
    Can you please tell any suggesstions to solve this issue? Is our hardware is not sufficient? Or any software settings has to be done?. I tried most of hte technique ,bt the problem still exists.
    The following machine configuration is used for Oracle RAC setup
    Intel Core 2 Duo 2.66 GHz,
    Ram :4GB.
    OS : windows 2008 Server 64 Bit
    Oracle RAC , Clusterware 11g R2 64 Bit.i guess you have installed/configured RAC using VMware. i guess, the problem is with your RAM size. how much disk space and RAM size you have allocated for each machine?
    which documentation you have followed?

  • Oracle 11gR2 on Windows 2008 R2 - access denied error

    I just installed 11gR2 on a Windows 2008 R2. When I tried to unsecure the dbconsole I noticed that an "Access is denied" error is returned, so I am not able to use the stop/start/unsecure command from emctl.
    I am able to log in into the db and asm, but if I try to perform an imp/exp operation an create a log file from the operation I get an error EXP-00028: failed to open <log file name> for write.
    I have already turned off the firewall, but the problem persists.
    I know that Windows 2008 R2 has a lot of security enhancements that could cause issues, but I don't know what else I can turn off to deal with this situation.
    BTW, I am logged with an account part of the Local Admins. and it belongs to the group ora_dba.
    Thanks,
    Alberto

    This may be a little late but did you run the command line using the Run As Administrator option? Windows 2008 will return that error when trying to do certain privileged operations under regular user rights.

  • Which account is used to failover to passive node of Windows 2008 R2 2-node cluster?

    When I set up drive letter for shared drives in Windows 2008 R2 2-node cluster, I accidentally used a drive letter which has already mapped automatically due to the login I used.   After I run the cluster validation tests, all the drive letters
    for shared drives are changed.   I fixed this issue by disconnecting the automatic mapped drive and reassigned all the drive letters.  
    However, I wonder whether CNO is used to perform the failover so such issue will not occur actually.  Also, what happen if someone is logged on the passive node when the failover occur and any of the drive letters assigned for the shared drives
    is already mapped due to that person's login. 

    Hi Sebastian,
    Let me clarify my question.  For example, there are clustered drives W:, M:, and L:.   Active Directory Group Policy has policy for some users to have mapped drive M:.
    What will happen if failover occurs when one of the users having that policy is still logged on the passive node?
    What will happen if failover occurs but that user has already logged off the passive node?
    AKAIK, mapped drives are tied to the current logon user not for all users.  
    I don't know which account is actually used for the failover process.  CNO, VNO, the domain user account used to create the windows cluster, or ?
    Thanks.

  • Domain migration of Oracle RAC nodes on windows 2008

    Hello masters,
    We are planning to migrate servers from old domain to a new domain due to company name change. That is, our DB servers named like db-node-x.old-domain.com will be migrated to db-node-x.new-domain.com. The servers are all on Windows 2008 R2 and Oracle RAC 11g2. As dba, i have no idea about what will happen to DBs. Please let me know any possible solutions?
    Thanks in advance.

    user2033016 wrote:
    Hi Everyone,
    I installed Oracle RAC 11g on Windows 2008 64 bit, The installation was successfull crs_state -t executed successfully.
    Bt the machine got crashed ,when executed a select query with 100 sessions( For performance evaluation using TG). A blue screen is appeared on two nodes. So i am not able to evaluate the performance.
    Can you please tell any suggesstions to solve this issue? Is our hardware is not sufficient? Or any software settings has to be done?. I tried most of hte technique ,bt the problem still exists.
    The following machine configuration is used for Oracle RAC setup
    Intel Core 2 Duo 2.66 GHz,
    Ram :4GB.
    OS : windows 2008 Server 64 Bit
    Oracle RAC , Clusterware 11g R2 64 Bit.i guess you have installed/configured RAC using VMware. i guess, the problem is with your RAM size. how much disk space and RAM size you have allocated for each machine?
    which documentation you have followed?

  • Remote desktop connection issue with an RDP client while connecting to some of windows 2008 and 2003 operating system flavors and not receiving SDin value choice 26 from DomainMCSPDU

    Hi Team
    We have our RDP client and i came across with one issue "Expected data got 3" with this client.
    This issue is getting while connecting some of below operating system flavors.
    Microsoft Windows 2008 Enterprise edition
    Microsoft Windows 2008 Standard edition
    Microsoft Windows 2003 servers
    When we are trying to get RDP to those servers with our client, getting "Expected data got 3" error. One more main thing here is the specified error is not getting for all the servers of same operating system in above list.
    Able to get the RDP console for those servers using mstsc client.
    When i read the [MS-RDPBCGR] specification, i found the below points
    mcsSDin (variable): Variable-length PER-encoded MCS Domain PDU (DomainMCSPDU) which encapsulates an MCS Send Data Indication structure (SDin, choice 26 from DomainMCSPDU), as specified in [T125] section 11.33 (the ASN.1 structure definitions
    are given in [T125] section 7, parts 7 and 10). The userData field of the MCS Send Data Indication contains a Security Header and a Valid Client License Data (section 2.2.1.12.1) structure.
    In my code i am not getting SDin value as 26. Is it the problem with Remote desktop Licensing in RDP servers as specified in the specification like "The userData field of the MCS Send Data Indication contains a Security Header and a Valid
    Client License Data (section 2.2.1.12.1) structure."
    Could you please explain me is this issue is happening due to Licence configuration in RDP server and please provide support with server side configuration if any because our code works for other servers ?
    Thanks & Regards,
    Pavan G.

    Hello Pavan -
    Thanks for contacting Microsoft Support. I'm researching this for you and request you to please send me mail at dochelp @ Microsoft dot com so that I can share tools and techniques to collect some traces and analyze.
    Thanks.
    Tarun Chopra | Escalation Engineer | Open Specifications Support Team

  • Windows Server 2008 r2 as Windows XP Pro 2.0 (Issue: 1)

    Windows Server 2008 r2 as Windows XP Pro 2.0 (Issue: 1)
    Flabbergasted at the sheer level of idiocy required to use Windows 7 Ultimate or Windows 8.1 Pro I remain a stead fast winXPro user to this day (mid-2014) and beyond. My i3-3225 XP machine turns 2000+ Passmark system scores and excels at everything the
    way we all use to, before Microsoft's policy of operating systems built for idiots, by idiots came to pass. Then as a sheer act of desperation I tried Server 2008 r2... is it the OS I have dreamed of? Short of an XP Theme conversion kit I have questions...
    Problem 1) Windows Explorer: In the folder directory left pane... the little [+] box next to the folder names flash on and off each time I use the right window pane. Can I by any and all means make them not do this, remain visible, sit still; like XP used
    to do?
    Problem 2) Start Menu: This popup is a double wide window pane, two columns of annoyance. Can I reduce this to a single wide by removing the right pane entirely by any and all means. I have removed every button from the right pane, but it still exists, it still
    has a default picture user icon and says Administrator.
    Problem 3) If specific programs/drivers are unavailable for this OS 2008 r2, I presume win 7 x64 by default work.
    Problem 4) Passmark benchmarking software tested my system, with windows 8.1 I had a processor score of 9,400, but server 2008 r2 put out only 8,100 in repetitive tests. Why the slowdown? I only use this as an XP like os, no actual server stuff, should i disable
    something?

    Windows Server is not intended to replace Windows XP. i would advice to try Windows 7 or 8 instead.
    1) I cannot picture what you mean. ther is a setting to define wheter the left pane should follow if you browse in the right one. Tools- folder options- general 'navigation pane'
    2)Windows vista/2008 is the last version that had a (optional) single pane start menu. if you don't like the current one, ther is third party software available to replace the start menu
    3) yes, these will be ok
    4) 2008 R2 is a server OS and is out-of-the bow not optimized for foreground applications. Windows 8.1 on the other hand is a newer and more performant OS optimized for client usage. in both cases a lot of performance gain is to be expected by selecting
    the right drivers, disabling or unisntalling unneeded software and windows features, disabling unneeded services. I would recommend to (a least) go to computer properties -advanced settigns- advanced and set 'adjust for best perfomance of" to programs (instead
    of background services)
    MCP/MCSA/MCTS/MCITP

Maybe you are looking for

  • TABLE for finding PTAX CITY

    Hi Experts,     I need a help .    In HR module .     Can u provide me the table  where i can take the PROFESSIONAL TAX CITY field.??     Is there any infotype for this field.     Kindly Mention the Key fields.    Thanks a lot

  • Mpeg Streamclip DVD settings for FCP...trying to preserve quality

    I'm very new at editing, so please bear with me! I am creating a director's reel for myself using footage on DVD. I'm ripping the DVDs with MPEG Streamclip to DV NTSC then importing to FCP and finally exporting to DVD. My problem is--there is an egre

  • Reg. Getting Operation timed out

    I have SQL servers configured with AlwaysOn. But when connecting to Databases in SQL Server 2014, I am getting operation timed out and SQL queries are also  taking unusually long time. The network connectivity is fine. Because of this the application

  • Network Question: How Do I See the Macs from the PC?

    I'm a PC-to-Mac switcher. I'm trying to move all my activites to the Mac platform, so at the moment I'm sort've one foot in each world. One problem I have encountered is transferring files from the PC to the Macs over my network. When I'm on the Mac,

  • Flex 4

    Are there any plans to support flex 4 in the creative suite sdk? I can't find any information about it. Would make life easier... . Right now my projects contains some libraries compiled with 3.4 and some parts with 4.1: 1. A core library compiled in