11gR2 2 node RAC/ASM hanging

Hi,
I am attempting to install 11gR2 on two nodes.
Things seem to be going quite well from the first node, including running of root.sh
On the second node however, when running root.sh it hangs at this point :
==================================================
[root@vore /]# /u01/app/11.2.0/grid/root.sh
Running Oracle 11g root script...
The following environment variables are set as:
ORACLE_OWNER= oracle
ORACLE_HOME= /u01/app/11.2.0/grid
Enter the full pathname of the local bin directory: [usr/local/bin]:
The contents of "dbhome" have not changed. No need to overwrite.
The contents of "oraenv" have not changed. No need to overwrite.
The contents of "coraenv" have not changed. No need to overwrite.
Entries will be added to the /etc/oratab file as needed by
Database Configuration Assistant when a database is created
Finished running generic part of root script.
Now product-specific root actions will be performed.
Using configuration parameter file: /u01/app/11.2.0/grid/crs/install/crsconfig_params
==================================================================
It doesnt budge (I left it there for 3 hours at one point)
Any ideas where I should look?
Thanks
jm
Edited by: 871764 on Jul 12, 2011 2:00 PM

Thanks
Here is the output (the last part of it anyways..)
++ '[' -f /u01/app/11.2.0/grid/install/oratab ']'
++ /bin/chown oracle:oinstall /etc/oratab
++ /bin/chmod 664 /etc/oratab
+++ /bin/grep '^*:/u01/app/11.2.0/grid:' /etc/oratab
++ FOUND_OLD=
++ '[' -n '' ']'
++ echo 'Entries will be added to the /etc/oratab file as needed by'
++ /usr/bin/tee -a /u01/app/11.2.0/grid/install/root_vore.supnet.local_2011-07-11_16-31-14.log
Entries will be added to the /etc/oratab file as needed by
++ echo 'Database Configuration Assistant when a database is created'
++ /usr/bin/tee -a /u01/app/11.2.0/grid/install/root_vore.supnet.local_2011-07-11_16-31-14.log
Database Configuration Assistant when a database is created
++ '[' -f /u01/app/11.2.0/grid/install/oratab -a true = true ']'
++ echo 'Finished running generic part of root script.'
++ /usr/bin/tee -a /u01/app/11.2.0/grid/install/root_vore.supnet.local_2011-07-11_16-31-14.log
Finished running generic part of root script.
++ echo 'Now product-specific root actions will be performed.'
++ /usr/bin/tee -a /u01/app/11.2.0/grid/install/root_vore.supnet.local_2011-07-11_16-31-14.log
Now product-specific root actions will be performed.
+ /u01/app/11.2.0/grid/network/install/sqlnet/setowner.sh
+ /u01/app/11.2.0/grid/rdbms/install/rootadd_rdbms.sh
+ /u01/app/11.2.0/grid/rdbms/install/rootadd_filemap.sh
+ /u01/app/11.2.0/grid/crs/config/rootconfig.sh
Using configuration parameter file: /u01/app/11.2.0/grid/crs/install/crsconfig_params

Similar Messages

  • Updgrade from 11.2.0.1 to 11.2.0.3 on 2 node Rac -ASM ON windows 2008 r2

    Hi Guys,
    We are going to upgrade our 24x7 system (2 node RAC ASM On windows 2008 R2) from 11.2.0.1 to 11.2.0.3. I appreciate if any one let me know the oracle my support document no. or step by step guide.
    Regards,

    Hi,
    You can check the id for upgrade
    Doc ID 1276368.1
    Doc ID 837570.1
    HTH

  • Oracle 11gR2 (2 node) RAC Architecture requirements for ASM implementation

    My architect is the following:
    * RAC1 server of Red Hat Linux Enterprise 5.5 64bit
    * RAC2 server of Red Hat Linux Enterprise 5.5 64bit
    * NFS Server (SAN) with Red Hat Linux Enterprise 5.5 64bit
    - Exported files systems for Shared Data, OCR and Voting Disks to nodes RAC1 and RAC2
    I've installed the ASM packages on to my NFS Server (SAN) and then realized that I still need a way to share the storage. It is my understanding that Oracle ASM for Red Hat Linux Enterprise 5.5 64bit DOES NOT PROVIDE Shared Storage to the other nodes (RAC1 and RAC2). It seems that I need something else???
    I've implemented Oracle RAC 11gR2 using NFS and wanted to try building Oracle RAC using ASM in my playground (home server's).
    Does anyone have any ideas on how I might be able to use ASM with out having a true network shared storage. I'm using NFS because it is part of the Red Hat Enterprise 5.5.
    Any ideas are appreciated !!!

    Hi,
    I would't recommend NFS for RAC in a enterprise solution. However if you are doing this for your playpan, then this is what you can do.
    Once the NFS shares are presented to the servers, you need to mount your filesystems on the RAC servers to access the NFS shares.
    e.g, If the the following NFS shares are presented to rac nodes:
    /mnt/disk1
    /mnt/disk2
    And let say you want to have your ocr and voting disks on /mnt/disk1 and database on /mnt/disk2.
    Firstly, you need to mount the shared on one of the rac nodes as follows. I will mount /mnt/disk1 as /u01/shared for my ocr and voting disks and /mnt/disk2 as /u01/asmdata by updating my fstab file as follows:
    nfs_server:/mnt/DISK1 /u01/shared nfs rw,bg,hard,nointr,rsize=32768,wsize=32768,tcp,noac,vers=3,timeo=600 0 0
    nfs_server:/mnt/DISK2 /u01/asmdata nfs rw,bg,hard,nointr,rsize=32768,wsize=32768,tcp,actimeo=0,vers=3,timeo=600 0 0
    Mount the FS on both servers and then create the block devices into each filesystem. You don't need to run oracleasm to create disks on it but rather change your ASM discovery path to the location where you have the block devices created and mount your asm diskgroups.
    That is how I got my 11g RAC setup.
    Hope that helps.
    Pranilesh

  • How to open the second VM in Oracle 11gR2 2-nodes RAC system ?

    Folks,
    Hello. I have been installing Oracle Database 11gR2 RAC system using 2 nodes that are 2 Virtual Machines (rac1 and rac2) on the top of VMPLayer 3.
    I follow the tutorial http://appsdbaworkshop.blogspot.com/2011/10/11gr2-rac-on-linux-56-using-vmware.html to do.
    The original Virtual Machine rac1 has run correctly. I configure rac1 network (eth0 and eth1) by opening VM rac1 and using command "[root@rac1\] #neat" as root user to invoke the network configuration.
    For the second Virtual Machine rac2, I simply copy all files in "C:\VM\rac1" into "C:\VM\rac2". Then I have done the following:
    1) In the directory "C:\VM\rac2", rename "rac1.vmx" to "rac2.vmx".
    2) Change display name from "rac1" to "rac2" in the file "rac2.vmx".
    The next thing to do for rac2 is to open the Virtual Machine rac2 and configure its network (eth0 and eth1) by using the command "[root@rac2\]#neat" as root user.
    But by this step, I don't understand how to open the Virtual Machine rac2 so that can configure its network (eth0 and eth1).
    Can any folk tell me how to open the VM rac2 to configure its network by this step ?

    Hi,
    But by this step, I don't understand how to open the Virtual Machine rac2 so that can configure its network (eth0 and eth1)."rac2" is a new virtual machine after you copied and changed the display name and you need to add this in the vmware enventory (I am talking about vmware server and vmware player should have the same way as it is supposed to run multiple vritual machines on your PC). Then it will be visible it to you. Now start this new machine and edit the network configuration.
    Salman

  • How to check the load balancing in Oracle 11gR2 2 node RAC

    Dear All,
    Can any one please assist me how to check whether the incoming connections are evenly distributing across the nodes..?
    We have two nodes, when we check the sessions counts in both nodes, Most of the time we could see node -1 has more no of sessions than node-2..? So just wanted to know whether load balancing is happening or not ...? If not how to enable it and distribute the incoming connections evenly..?
    Oracle 11gR2 / RHEL5

    SQL> select inst_id,count(*) from gv$session where username is not null group by inst_id;
    INST_ID COUNT(*)
    1 43
    2 40
    Not sure how to check the users are connecting through scan or not ..? But below are scan setttings...
    SQL> !srvctl config scan_listener
    SCAN Listener LISTENER_SCAN1 exists. Port: TCP:1521
    SCAN Listener LISTENER_SCAN2 exists. Port: TCP:1521
    SCAN Listener LISTENER_SCAN3 exists. Port: TCP:1521
    SQL> !srvctl status scan_listener
    SCAN Listener LISTENER_SCAN1 is enabled
    SCAN listener LISTENER_SCAN1 is running on node za-rac-prd-02
    SCAN Listener LISTENER_SCAN2 is enabled
    SCAN listener LISTENER_SCAN2 is running on node za-rac-prd-01
    SCAN Listener LISTENER_SCAN3 is enabled
    SCAN listener LISTENER_SCAN3 is running on node za-rac-prd-01
    SQL> !srvctl config scan
    SCAN name: rac_prd.abc.local, Network: 1/10.100.130.0/255.255.255.192/eth6.64
    SCAN VIP name: scan1, IP: /rac_prd.abc.local/10.100.130.55
    SCAN VIP name: scan2, IP: /rac_prd.abc.local/10.100.130.54
    SCAN VIP name: scan3, IP: /rac_prd.abc.local/10.100.130.53
    SQL>

  • One node RAC pause/hang/block on other node shutdown

    Hi,
    We have a Java application running on Linux servers connecting to a 10.2.0.1 RAC cluster, also Linux. When the application starts it opens up a pool of connections to the databsae, and these are used throughout the life time of the application. One server connects to one RAC node.
    AppA - DBA
    AppB - DBB
    When we shutdown one node, the application connecting to that node stops, which is what we would expect in this configuration.
    What is strange is that the other application blocks for 63 seconds and then continues. So it is like the database is blocking, or the database connections are blocking.
    We are not using TAF, FAN, FCN, LB, VIPs or any special features, just simple lightweight JDBC from one server to one database. In fact I do not thing we are unwittingly using any of these features, we have them switched off.
    john

    user1788323 wrote:
    What is strange is that the other application blocks for 63 seconds and then continues. So it is like the database is blocking, or the database connections are blocking.How have you determined/diagnosed the 63s blocking? (more details in this regard may shed some light on the problem)
    Assuming that the block is server side, then two basic reasons comes to mind.
    Networking issue - the CRS on the surviving node has to perform certain functions, like switching the VIP of the node that left the cluster to a surviving cluster node. The listener may need to re-register services. A local firewall may need to be dynamically reconfigured for supporting the new failed-over VIP. Etc.
    Thus these could result in some kind of delay or issue in the network layer that you are seeing from the client side.
    Infrastructure issue. If the actual client request via JDBC reaches the server process, and it is slow in responding, then that is not a network issue - instead some underlying service or s/w layer that the server process needs to use to perform the client request is busy for those 63s.
    This could be related to the Interconnect, the shared I/O storage layer or something along those lines. For example, how does the Interconnect and/or SAN switch re-act when a server node is powered down or rebooted?
    There's not really sufficient information to make anything but a guesses.. You will need to isolate the problem with further testing.
    I have seen similar problems with 10.1.0.3 CRS and RAC when a node is evicted from the cluster. In this case the "hung" period was in excess of 15 minutes and only for new connections (Listener unable to hand off to dedicated servers or dispatchers). Existing connections worked fine however and were unaware of any problems. But part of the issue in this case was a poor (outdated) driver layer - and also the last time we used proprietary binary drivers (kernel modules) from 3rd party vendors that results in a tainted (and very fixed and rigid) Linux kernel. Today we're sticking with an OpenSource driver layer only for Linux.

  • Oracle 11gR2 2 node RAC on Oracle Linux - can't discover

    Hi folks,
    My rac1 can't discover iscis targets on openfiler, please assist/help/guide, been stuck for quite some time :-(
    [root@rac1 send_targets]#
    [root@rac1 send_targets]# iscsiadm -m discovery -t sendtargets -p openfiler
    [root@rac1 send_targets]# ping openfiler
    PING openfiler (192.168.1.11) 56(84) bytes of data.
    64 bytes from openfiler (192.168.1.11): icmp_seq=1 ttl=64 time=0.284 ms
    64 bytes from openfiler (192.168.1.11): icmp_seq=2 ttl=64 time=0.224 ms
    64 bytes from openfiler (192.168.1.11): icmp_seq=3 ttl=64 time=0.226 ms
    64 bytes from openfiler (192.168.1.11): icmp_seq=4 ttl=64 time=0.211 ms
    ^C
    --- openfiler ping statistics ---
    4 packets transmitted, 4 received, 0% packet loss, time 3000ms
    rtt min/avg/max/mdev = 0.211/0.236/0.284/0.030 ms
    [root@rac1 send_targets]# iscsiadm -m discovery -t sendtargets -p 192.168.1.11
    [root@rac1 send_targets]# service iscsid status
    iscsid (pid  2446) is running...
    [root@rac1 send_targets]# uname -a
    Linux rac1.mydomain 2.6.32-100.26.2.el5 #1 SMP Tue Jan 18 20:11:49 EST 2011 x86_64 x86_64 x86_64 GNU/Linux
    [root@rac1 send_targets]#
    If possible to just direct me to some link, I'm following this: http://www.oracle.com/technetwork/articles/hunter-rac11gr2-iscsi-088677.html#8
    But it is not telling, if it doesn't discover ... then what?
    Thanks in advance.

    Hi ,
    Did you install the iscsi-initiator-utils rpm package in all nodes? we must install this package in all rac nodes, and then discover the LUN in all nodes.
    Also try giving the ip address of openfiler instead of giving the hostname
    Regards,

  • Cross - Post help Please with RAC/ASM on 2nd node

    Hi
    I originally posted this in the DB Installation area, but after getting a better feel for the Forums, it probably should have been posted here.
    Here is the link to the original post:
    11gR2 2 node RAC/ASM hanging
    "Hi,
    I am attempting to install 11gR2 on two nodes.
    Things seem to be going quite well from the first node, including running of root.sh
    On the second node however, when running root.sh it hangs at this point :
    ==================================================
    [root@volt /]# /u01/app/11.2.0/grid/root.sh
    Running Oracle 11g root script...
    The following environment variables are set as:
    ORACLE_OWNER= oracle
    ORACLE_HOME= /u01/app/11.2.0/grid
    Enter the full pathname of the local bin directory: [usr/local/bin]:
    The contents of "dbhome" have not changed. No need to overwrite.
    The contents of "oraenv" have not changed. No need to overwrite.
    The contents of "coraenv" have not changed. No need to overwrite.
    Entries will be added to the /etc/oratab file as needed by
    Database Configuration Assistant when a database is created
    Finished running generic part of root script.
    Now product-specific root actions will be performed.
    Using configuration parameter file: /u01/app/11.2.0/grid/crs/install/crsconfig_params
    ==================================================================
    It doesnt budge (I left it there for 3 hours at one point)
    Any ideas where I should look? Do you need more information?
    Thanks
    jm"
    Edited by: 871764 on Jul 12, 2011 1:59 PM

    here is the log file
    2011-07-11 14:39:49.355
    [client(2341)]CRS-2101:The OLR was formatted using version 3.
    2011-07-11 14:39:52.673
    [client(2343)]CRS-2302:Cannot get GPnP profile. Error CLSGPNP_NO_DAEMON (GPNPD daemon is not running).
    2011-07-11 14:46:03.054
    [client(2838)]CRS-2302:Cannot get GPnP profile. Error CLSGPNP_NO_DAEMON (GPNPD daemon is not running).
    2011-07-11 14:48:07.596
    [client(2944)]CRS-2302:Cannot get GPnP profile. Error CLSGPNP_NO_DAEMON (GPNPD daemon is not running).
    2011-07-11 14:48:07.597
    [client(2944)]CRS-1013:The OCR location in an ASM disk group is inaccessible. Details in /u01/app/11.2.0/grid/log/vore/client/ocrcheck_2944.log.
    2011-07-11 15:41:00.831
    [client(5685)]CRS-2101:The OLR was formatted using version 3.
    2011-07-11 15:41:03.947
    [client(5687)]CRS-2302:Cannot get GPnP profile. Error CLSGPNP_NO_DAEMON (GPNPD daemon is not running).
    [client(5910)]CRS-10001:11-Jul-11 15:44 ACFS-9459: ADVM/ACFS is not supported on this OS version: '2.6.32-100.36.1.el5uek
    [client(5912)]CRS-10001:11-Jul-11 15:44 ACFS-9201: Not Supported
    2011-07-11 15:46:00.961
    [client(6535)]CRS-2101:The OLR was formatted using version 3.
    2011-07-11 15:46:04.077
    [client(6537)]CRS-2302:Cannot get GPnP profile. Error CLSGPNP_NO_DAEMON (GPNPD daemon is not running).
    2011-07-11 16:31:25.910
    [client(8741)]CRS-2101:The OLR was formatted using version 3.
    2011-07-11 16:31:29.026
    [client(8743)]CRS-2302:Cannot get GPnP profile. Error CLSGPNP_NO_DAEMON (GPNPD daemon is not running).
    2011-07-11 16:43:09.953
    [client(9636)]CRS-2101:The OLR was formatted using version 3.
    2011-07-11 16:43:24.763
    [client(10075)]CRS-2101:The OLR was formatted using version 3.
    2011-07-11 16:43:27.883
    [client(10077)]CRS-2302:Cannot get GPnP profile. Error CLSGPNP_NO_DAEMON (GPNPD daemon is not running).
    2011-07-11 16:45:10.354
    [client(10779)]CRS-2101:The OLR was formatted using version 3.
    2011-07-11 16:45:13.470
    [client(10781)]CRS-2302:Cannot get GPnP profile. Error CLSGPNP_NO_DAEMON (GPNPD daemon is not running).
    2011-07-11 17:22:49.580
    [client(16978)]CRS-2101:The OLR was formatted using version 3.
    2011-07-11 17:22:52.722
    [client(16980)]CRS-2302:Cannot get GPnP profile. Error CLSGPNP_NO_DAEMON (GPNPD daemon is not running).
    2011-07-11 17:28:51.431
    [client(17644)]CRS-2101:The OLR was formatted using version 3.
    2011-07-11 17:28:54.547
    [client(17646)]CRS-2302:Cannot get GPnP profile. Error CLSGPNP_NO_DAEMON (GPNPD daemon is not running).
    2011-07-12 10:40:53.984
    [client(32239)]CRS-2302:Cannot get GPnP profile. Error CLSGPNP_NO_DAEMON (GPNPD daemon is not running).
    2011-07-12 10:40:53.985
    [client(32239)]CRS-1013:The OCR location in an ASM disk group is inaccessible. Details in /u01/app/11.2.0/grid/log/vore/client/crsctl_oracle.log.
    2011-07-12 10:40:57.595
    [client(32289)]CRS-2302:Cannot get GPnP profile. Error CLSGPNP_NO_DAEMON (GPNPD daemon is not running).
    2011-07-12 10:40:57.596
    [client(32289)]CRS-1013:The OCR location in an ASM disk group is inaccessible. Details in /u01/app/11.2.0/grid/log/vore/client/crsctl_oracle.log.
    2011-07-12 10:41:03.082
    [client(32468)]CRS-2302:Cannot get GPnP profile. Error CLSGPNP_NO_DAEMON (GPNPD daemon is not running).
    2011-07-12 10:41:03.083
    [client(32468)]CRS-1013:The OCR location in an ASM disk group is inaccessible. Details in /u01/app/11.2.0/grid/log/vore/client/crsctl_oracle.log.
    2011-07-12 10:42:12.982
    [client(3526)]CRS-2101:The OLR was formatted using version 3.
    2011-07-12 10:42:16.115
    [client(3528)]CRS-2302:Cannot get GPnP profile. Error CLSGPNP_NO_DAEMON (GPNPD daemon is not running).
    [client(3631)]CRS-10001:12-Jul-11 10:43 ACFS-9459: ADVM/ACFS is not supported on this OS version: '2.6.32-100.36.1.el5uek
    [client(3633)]CRS-10001:12-Jul-11 10:43 ACFS-9201: Not Supported
    2011-07-12 10:44:06.369
    [client(4269)]CRS-2101:The OLR was formatted using version 3.
    2011-07-12 10:44:09.486
    [client(4271)]CRS-2302:Cannot get GPnP profile. Error CLSGPNP_NO_DAEMON (GPNPD daemon is not running).
    2011-07-12 10:44:22.589
    [client(4319)]CRS-2302:Cannot get GPnP profile. Error CLSGPNP_NO_DAEMON (GPNPD daemon is not running).
    2011-07-12 10:44:22.590
    [client(4319)]CRS-1013:The OCR location in an ASM disk group is inaccessible. Details in /u01/app/11.2.0/grid/log/vore/client/crsctl_oracle.log.
    2011-07-12 10:44:26.271
    [client(4371)]CRS-2302:Cannot get GPnP profile. Error CLSGPNP_NO_DAEMON (GPNPD daemon is not running).
    2011-07-12 10:44:26.272
    [client(4371)]CRS-1013:The OCR location in an ASM disk group is inaccessible. Details in /u01/app/11.2.0/grid/log/vore/client/crsctl_oracle.log.
    2011-07-12 10:44:31.907
    [client(4555)]CRS-2302:Cannot get GPnP profile. Error CLSGPNP_NO_DAEMON (GPNPD daemon is not running).
    2011-07-12 10:44:31.908
    [client(4555)]CRS-1013:The OCR location in an ASM disk group is inaccessible. Details in /u01/app/11.2.0/grid/log/vore/client/crsctl_oracle.log.
    2011-07-12 10:48:37.599
    [client(6395)]CRS-2302:Cannot get GPnP profile. Error CLSGPNP_NO_DAEMON (GPNPD daemon is not running).
    2011-07-12 10:48:37.600
    [client(6395)]CRS-1013:The OCR location in an ASM disk group is inaccessible. Details in /u01/app/11.2.0/grid/log/vore/client/crsctl_oracle.log.
    2011-07-12 10:48:41.175
    [client(6427)]CRS-2302:Cannot get GPnP profile. Error CLSGPNP_NO_DAEMON (GPNPD daemon is not running).
    2011-07-12 10:48:41.176
    [client(6427)]CRS-1013:The OCR location in an ASM disk group is inaccessible. Details in /u01/app/11.2.0/grid/log/vore/client/crsctl_oracle.log.
    2011-07-12 10:48:46.675
    [client(6609)]CRS-2302:Cannot get GPnP profile. Error CLSGPNP_NO_DAEMON (GPNPD daemon is not running).
    2011-07-12 10:48:46.676
    [client(6609)]CRS-1013:The OCR location in an ASM disk group is inaccessible. Details in /u01/app/11.2.0/grid/log/vore/client/crsctl_oracle.log.
    2011-07-12 10:49:34.297
    [client(8211)]CRS-2302:Cannot get GPnP profile. Error CLSGPNP_NO_DAEMON (GPNPD daemon is not running).
    2011-07-12 10:49:34.298
    [client(8211)]CRS-1013:The OCR location in an ASM disk group is inaccessible. Details in /u01/app/11.2.0/grid/log/vore/client/crsctl_oracle.log.
    2011-07-12 10:49:37.975
    [client(8243)]CRS-2302:Cannot get GPnP profile. Error CLSGPNP_NO_DAEMON (GPNPD daemon is not running).
    2011-07-12 10:49:37.977
    [client(8243)]CRS-1013:The OCR location in an ASM disk group is inaccessible. Details in /u01/app/11.2.0/grid/log/vore/client/crsctl_oracle.log.
    [client(9564)]CRS-10001:12-Jul-11 11:09 ACFS-9459: ADVM/ACFS is not supported on this OS version: '2.6.32-100.36.1.el5uek
    [client(9566)]CRS-10001:12-Jul-11 11:09 ACFS-9201: Not Supported
    2011-07-12 11:36:08.480
    [client(7676)]CRS-2101:The OLR was formatted using version 3.
    2011-07-12 11:36:12.780
    [client(7678)]CRS-2302:Cannot get GPnP profile. Error CLSGPNP_NO_DAEMON (GPNPD daemon is not running).
    2011-07-12 11:49:42.690
    [client(8521)]CRS-2302:Cannot get GPnP profile. Error CLSGPNP_NO_DAEMON (GPNPD daemon is not running).
    2011-07-12 11:49:42.691
    [client(8521)]CRS-1013:The OCR location in an ASM disk group is inaccessible. Details in /u01/app/11.2.0/grid/log/vore/client/crsctl_oracle.log.
    2011-07-12 11:49:46.726
    [client(8553)]CRS-2302:Cannot get GPnP profile. Error CLSGPNP_NO_DAEMON (GPNPD daemon is not running).
    2011-07-12 11:49:46.728
    [client(8553)]CRS-1013:The OCR location in an ASM disk group is inaccessible. Details in /u01/app/11.2.0/grid/log/vore/client/crsctl_oracle.log.
    2011-07-12 11:50:03.893
    [client(8616)]CRS-2302:Cannot get GPnP profile. Error CLSGPNP_NO_DAEMON (GPNPD daemon is not running).
    2011-07-12 11:50:03.895
    [client(8616)]CRS-1013:The OCR location in an ASM disk group is inaccessible. Details in /u01/app/11.2.0/grid/log/vore/client/crsctl_oracle.log.
    2011-07-12 11:50:07.571
    [client(8650)]CRS-2302:Cannot get GPnP profile. Error CLSGPNP_NO_DAEMON (GPNPD daemon is not running).
    2011-07-12 11:50:07.572
    [client(8650)]CRS-1013:The OCR location in an ASM disk group is inaccessible. Details in /u01/app/11.2.0/grid/log/vore/client/crsctl_oracle.log.
    2011-07-12 11:50:13.950
    [client(8838)]CRS-2302:Cannot get GPnP profile. Error CLSGPNP_NO_DAEMON (GPNPD daemon is not running).
    2011-07-12 11:50:13.951
    [client(8838)]CRS-1013:The OCR location in an ASM disk group is inaccessible. Details in /u01/app/11.2.0/grid/log/vore/client/crsctl_oracle.log.
    2011-07-12 11:58:31.714
    [client(9229)]CRS-2302:Cannot get GPnP profile. Error CLSGPNP_NO_DAEMON (GPNPD daemon is not running).
    2011-07-12 11:58:31.716
    [client(9229)]CRS-1013:The OCR location in an ASM disk group is inaccessible. Details in /u01/app/11.2.0/grid/log/vore/client/crsctl_oracle.log.
    2011-07-12 11:58:35.389
    [client(9279)]CRS-2302:Cannot get GPnP profile. Error CLSGPNP_NO_DAEMON (GPNPD daemon is not running).
    2011-07-12 11:58:35.390
    [client(9279)]CRS-1013:The OCR location in an ASM disk group is inaccessible. Details in /u01/app/11.2.0/grid/log/vore/client/crsctl_oracle.log.
    2011-07-12 11:58:39.694
    [client(9336)]CRS-2302:Cannot get GPnP profile. Error CLSGPNP_NO_DAEMON (GPNPD daemon is not running).
    2011-07-12 11:58:39.695
    [client(9336)]CRS-1013:The OCR location in an ASM disk group is inaccessible. Details in /u01/app/11.2.0/grid/log/vore/client/crsctl_oracle.log.
    2011-07-12 12:08:19.342
    [client(6429)]CRS-2302:Cannot get GPnP profile. Error CLSGPNP_NO_DAEMON (GPNPD daemon is not running).
    2011-07-12 12:08:19.343
    [client(6429)]CRS-1013:The OCR location in an ASM disk group is inaccessible. Details in /u01/app/11.2.0/grid/log/vore/client/crsctl_oracle.log.
    2011-07-12 12:08:22.969
    [client(6461)]CRS-2302:Cannot get GPnP profile. Error CLSGPNP_NO_DAEMON (GPNPD daemon is not running).
    2011-07-12 12:08:22.971
    [client(6461)]CRS-1013:The OCR location in an ASM disk group is inaccessible. Details in /u01/app/11.2.0/grid/log/vore/client/crsctl_oracle.log.
    2011-07-12 12:08:27.220
    [client(6518)]CRS-2302:Cannot get GPnP profile. Error CLSGPNP_NO_DAEMON (GPNPD daemon is not running).
    2011-07-12 12:08:27.221
    [client(6518)]CRS-1013:The OCR location in an ASM disk group is inaccessible. Details in /u01/app/11.2.0/grid/log/vore/client/crsctl_oracle.log.
    2011-07-12 12:08:50.438
    [client(6576)]CRS-2302:Cannot get GPnP profile. Error CLSGPNP_NO_DAEMON (GPNPD daemon is not running).
    2011-07-12 12:08:50.439
    [client(6576)]CRS-1013:The OCR location in an ASM disk group is inaccessible. Details in /u01/app/11.2.0/grid/log/vore/client/crsctl_oracle.log.
    2011-07-12 12:08:54.014
    [client(6608)]CRS-2302:Cannot get GPnP profile. Error CLSGPNP_NO_DAEMON (GPNPD daemon is not running).
    2011-07-12 12:08:54.015
    [client(6608)]CRS-1013:The OCR location in an ASM disk group is inaccessible. Details in /u01/app/11.2.0/grid/log/vore/client/crsctl_oracle.log.
    2011-07-12 12:08:59.658
    [client(6691)]CRS-2302:Cannot get GPnP profile. Error CLSGPNP_NO_DAEMON (GPNPD daemon is not running).
    2011-07-12 12:08:59.659
    [client(6691)]CRS-1013:The OCR location in an ASM disk group is inaccessible. Details in /u01/app/11.2.0/grid/log/vore/client/crsctl_oracle.log.
    2011-07-12 12:16:19.181
    [client(7016)]CRS-2302:Cannot get GPnP profile. Error CLSGPNP_NO_DAEMON (GPNPD daemon is not running).
    2011-07-12 12:16:19.182
    [client(7016)]CRS-1013:The OCR location in an ASM disk group is inaccessible. Details in /u01/app/11.2.0/grid/log/vore/client/crsctl_oracle.log.
    2011-07-12 12:16:22.859
    [client(7048)]CRS-2302:Cannot get GPnP profile. Error CLSGPNP_NO_DAEMON (GPNPD daemon is not running).
    2011-07-12 12:16:22.861
    [client(7048)]CRS-1013:The OCR location in an ASM disk group is inaccessible. Details in /u01/app/11.2.0/grid/log/vore/client/crsctl_oracle.log.
    2011-07-12 12:16:28.761
    [client(7132)]CRS-2302:Cannot get GPnP profile. Error CLSGPNP_NO_DAEMON (GPNPD daemon is not running).
    2011-07-12 12:16:28.762
    [client(7132)]CRS-1013:The OCR location in an ASM disk group is inaccessible. Details in /u01/app/11.2.0/grid/log/vore/client/crsctl_oracle.log.
    2011-07-12 15:01:48.083
    [client(13914)]CRS-2101:The OLR was formatted using version 3.
    2011-07-12 15:01:51.202
    [client(13916)]CRS-2302:Cannot get GPnP profile. Error CLSGPNP_NO_DAEMON (GPNPD daemon is not running).

  • Single node file system to 3 node rac and asm migration

    hi,
    we have several utl_file and external table applications running on 10.2 single node veritas file system. and we want to migrate to 3 node RAC ASM environment. what is the best practices in order to succeed this migration during this migration. thanks.

    1. Patch to 10.2.0.3 or 10.2.0.4 if not already there.
    2. Dump Veritas from any future consideration.
    3. Build and validate the new RAC environment and then plug in your data using transportable tablespaces.
    Do not expect the first part of step 3 to work perfectly the first time if you do not have experience building RAC clusters.
    This means have appropriate hardware in place for perfecting your skills.
    Be sure, too, that you are not trying to do this with blade or 1U servers. You need a minimum of 2U servers to be able
    to plug in sufficient hardware to have redundant paths to storage and for cache fusion and public access (a minimum of 6 ports).
    And don't let any network admin try to convince you that they can virtualize the network paths: They can not do so successfully
    for RAC.

  • Error while running root.sh in 11GR2 2 node cluster

    Hi Friends,
    I am trying to setup 11gR2 2 node RAC on RHEL 4.7. The cluvfy script shows everything as passed and grid infrastructure installation completes fine until I ran root.sh script. The root.sh script when run on node 1 exits with following error in console
    DOCRAC1-N310 []:./root.sh
    Running Oracle 11g root.sh script...
    The following environment variables are set as:>ORACLE_OWNER= oracle
    >ORACLE_HOME= /app/oracle/grid
    >
    Enter the full pathname of the local bin directory: [usr/local/bin]:
    The file "dbhome" already exists in /usr/local/bin. Overwrite it? (y/n)
    [n]: y>Copying dbhome to /usr/local/bin ...
    The file "oraenv" already exists in /usr/local/bin. Overwrite it? (y/n)
    [n]: y>Copying oraenv to /usr/local/bin ...
    The file "coraenv" already exists in /usr/local/bin. Overwrite it? (y/n)
    [n]: y>Copying coraenv to /usr/local/bin ...
    >
    Entries will be added to the /etc/oratab file as needed by
    Database Configuration Assistant when a database is created
    Finished running generic part of root.sh script.
    Now product-specific root actions will be performed.
    2011-01-06 13:20:18: Parsing the host name
    2011-01-06 13:20:18: Checking for super user privileges
    2011-01-06 13:20:18: User has super user privileges
    Using configuration parameter file: /app/oracle/grid/crs/install/crsconfig_params
    PROTL-16: Internal Error
    Command return code of 41 (10496) from command: /app/oracle/grid/bin/ocrconfig -local -upgrade oracle oinstall
    Failed to create or upgrade OLRWhen I checked the logs in $GRID_HOME/log/<Node1>/client
    I can see errors in ocrconfig_12426.log as
    Oracle Database 11g Clusterware Release 11.2.0.1.0 - Production Copyright 1996, 2009 Oracle. All rights reserved.
    2011-01-06 13:20:19.133: [ OCRCONF][2564297536]ocrconfig starts...
    2011-01-06 13:20:19.134: [ default][2564297536]utgdv: Could not find occonfig_loc property or ocrconfig_loc pointing to nothing
    [ OCRCONF][2564297536]Error retrieving OCR configuration. Return [4]. procr_get_conf rc [41] error buffer [Error retrieving ocrconfig_loc property.]
    2011-01-06 13:20:19.134: [ OCRCONF][2564297536]Error [4] retrieving configuration type
    2011-01-06 13:20:19.134: [ OCRCONF][2564297536]Exiting [status=failed]...and in crsctl.log
    [  CRSCTL][2566642592]Command::initStatic: clsugetconf failed with return code 4, status 1
    2011-01-06 13:19:01.372: [  CRSCTL][2566642592]Command::checkConfig: clsugetconf returned unknown status
    2011-01-06 13:19:11.502: [ default][2566642592]utgdv: Could not find occonfig_loc property or ocrconfig_loc pointing to nothing
    [ default][2566642592]Error retrieving OCR configuration. Return [4]. procr_get_conf rc [41] error buffer [Error retrieving ocrconfig_loc property.]
    [  CRSCTL][2566642592]Command::initStatic: clsugetconf failed with return code 4, status 1
    2011-01-06 13:19:11.503: [  CRSCTL][2566642592]Command::checkConfig: clsugetconf returned unknown statusI have tried to deinstall, reconfigure , but still no luck. I will be trying to use Oracle Deinstall utlity now. Before that I would like to get comments from experts
    Thanks ,
    SSN.

    Consider moving this question to the Real Application Clusters forum.
    Confirm that +/app/oracle/grid/crs/install/crsconfig_params+ exists before running root.sh - if it does, please post contents using tags to encapsulate the config text data.
    Are you using ASM for managing voting and OCR disk storage, or are you manually setting these to specific block devices?                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                               

  • 11.2.0.3 RAC ASM Pri with Normal FileSys Active Standby Post Failover

    The architecture consist of two node rac asm primary and one normal filesystem active standby all on Oracle 11gR2 11.2.0.3. With basic Broker Configuration.
    Performed a managed broker switchover and not the Normal Filesystem has the primary role and the standby consist of the two node asm rac. I want to switchback, i.e., Former Primary -> Primary Role and Former Standby -> Standby Role.
    However my broker contains the following:
    DGMGRL> show configuration verbose;
    Configuration - DG_PRI_CFG
    Protection Mode: MaxPerformance
    Databases:
    STANDBY - Primary database
    Warning: ORA-16829: fast-start failover configuration is lagging
    KEMETRAC - (*) Physical standby database
    Error: ORA-16810: multiple errors or warnings detected for the database
    (*) Fast-Start Failover target
    Properties:
    FastStartFailoverThreshold = '95'
    OperationTimeout = '30'
    FastStartFailoverLagLimit = '95'
    CommunicationTimeout = '180'
    FastStartFailoverAutoReinstate = 'TRUE'
    FastStartFailoverPmyShutdown = 'TRUE'
    BystandersFollowRoleChange = 'ALL'
    Fast-Start Failover: ENABLED
    Threshold: 95 seconds
    Target: KEMETRAC
    Observer: emcc.respecti.com
    Lag Limit: 95 seconds
    Shutdown Primary: TRUE
    Auto-reinstate: TRUE
    Configuration Status:
    ERROR
    I've found a recommendation to increase the value of FastStartFailoverThreshold='90';
    Though I continue to encounter the above configuration error.
    Recommendations are appreciated!
    Edited by: 783527 on Mar 12, 2012 7:41 PM

    03/13/2012 13:13:22
    Data Guard Broker Status Summary:
    Type Name Severity Status
    Configuration DG_PRI_CFG Warning ORA-16607
    Primary Database STANDBY Warning ORA-16829
    Physical Standby Database KEMETRAC Error ORA-16810
    03/13/2012 13:14:22
    Data Guard Broker Status Summary:
    Type Name Severity Status
    Configuration DG_PRI_CFG Warning ORA-16607
    Primary Database STANDBY Warning ORA-16829
    Physical Standby Database KEMETRAC Error ORA-16810
    03/13/2012 13:15:22
    Data Guard Broker Status Summary:
    Type Name Severity Status
    Configuration DG_PRI_CFG Warning ORA-16607
    Primary Database STANDBY Warning ORA-16829
    Physical Standby Database KEMETRAC Error ORA-16810
    03/13/2012 13:16:22
    Data Guard Broker Status Summary:
    Type Name Severity Status
    Configuration DG_PRI_CFG Warning ORA-16607
    Primary Database STANDBY Warning ORA-16829
    Physical Standby Database KEMETRAC Error ORA-16810
    03/13/2012 13:17:22
    Data Guard Broker Status Summary:
    Type Name Severity Status
    Configuration DG_PRI_CFG Warning ORA-16607
    Primary Database STANDBY Warning ORA-16829
    Physical Standby Database KEMETRAC Error ORA-16810
    03/13/2012 13:18:22

  • Archivelogs deleted in RAC ASM Production for standby

    Hi,
    DB: 10.2.0.4
    OS: AIX 5.3 L
    This is 2 node RAC ASM database with single standby on ASM.
    I set the retention policy to 2 days for my Live database.While running the TAPE backup script, the archivelogs were deleted .The deleted archivelogs are generated just before /while the TAPE backup.Backup script has not considered the retention policy for Primary.All archivelogs , except generated after backup ,were deleted .
    Now my standby is waiting for deleted archivelogs.
    How do i can make sync of my standby with Primary ?.
    Please understand my position and request you to help me on this.
    Regards,
    Sunand
    Edited by: sunand on Jan 22, 2011 3:15 AM

    Hi Jean & Abhi,
    Thanks you very much for your reply.
    I came out the problem with following taking the backup of incremental from standby SCN value.
    Actually i did not have backup of deleted archivelog .Now my standby database is in sync with primary and working fine.
    About recovering of deleted archivelog from backup piece, If i run below script , whether it will recover the specified archivelogs to our archivelog destination or will recover to database ?.I never done this before.Could you explain me ,please.
    run
    allocate channel t1 type sbt.....;
    restore archivelog from sequence X until sequence Y thread 1;
    Also, my database is on ASM. Once we recover the archivelogs,how do i can move to standby?.I mean , moving them from ASM to file system and registering to standby database .
    Thank you very much,
    Regards,
    Sunand

  • DR create in RAC ASM

    DB : 10.2.0.4 ASM
    OS : AIX 5.2 L
    My setup is 2 node RAC ASM primary with single standby ASM.We are doing failover this week.After failover happened and tested , in recreating DR , i have few doubts.
    1) While recreating the DR, Already datafiles in ASM DR will be there .
    Shall i have to remove(asmcmd) / drop(DBCA)  those files before recreating DR ?.
    If i do create duplicate database without removing files in DR , will it override existing files and create standby DB ,right?.
    2) What about standby Redo logs.
    Shall i have to remove them before recreating DR ?.If i want to delete them, can delete from asmcmd , right?.
    What will be the best way to recreate the standby in ASM.
    Thanks,
    Sunand

    If i do create duplicate database without removing files in DR , will it override existing files and create standby DB ,right?.
    certainly you can do it, however its risky,if something goes wrong, again its big mess, avoid such a things, remove detafiles, create new files it must replicate Primary, then restore DB.
    Shall i have to remove them before recreating DR ?.If i want to delete them, can delete from asmcmd , right?.
    certainly yes, your not adding redo logs in standby, you're just adding redo and redo-standby logs in primary only, you can remove it.

  • Creating Standby for RAC ASM database using RMAN

    We are having a Primary Site of 3-Node RAC ASM and we takes daily RMAN backup with the following script
    run
    allocate channel c1 device type disk format 'g:\rmanbackup\%U';
    backup database;
    backup archivelog from time 'trunc(sysdate-1)' until time 'sysdate';
    We have configured 3-Node RAC Cluster in Standby site. We have copied the rman backup folder to one of the Nodes in the Standby site.
    Request your help to restore the RMAN backup. The backup size is around 200GB. We do not know how to use DUPLICATE DUPICATE option in RMAN as if it is restoring from the Primary Location, then transferring 200GB over the network will not be possible.
    We need a solution to restore it directly from the Backup folder available in the DR Server. We are not using catalog.
    OS : Windows IA 64-bit
    RDBMS : Oracle 10.2.0.4
    Storage : ASM
    DB Nodes at Primary Site, Node1, Node2, Node3
    DB instances at primary site : ORCL1, ORCL2, ORCL3
    DB Nodes at Standby Site, Node101, Node102, Node103
    DB instances at Standby site : ORCL1, ORCL2, ORCL3
    DB Name : ORCL on both the sites.

    When you create the standby, you can use catalogued backups, stored somewhere local to your standby servers.
    For that, they need to be copied to the standby server, or taken from production there, and after restoring the standby controlfile on the standby server, use rman to catalogue the backups to be used. Then, you can use DUPLICATE... and it will be reading your local backup files.
    The directory g:\rmanbackup of your rman script is local to standby servers ?
    The docs for this have a lot of details: http://download.oracle.com/docs/cd/B19306_01/server.102/b14239/rcmbackp.htm
    Regards.

  • ORA-01652 unable to extend temp segment in 11gR2 with ASM and 2 node RAC

    Hi ,
    I have a 11.2.0.1 system with 2 node RAC and ASM . We are hitting ORA-01652 very frequently
    and I can see space is available in TEMP .
    CREATE TEMPORARY TABLESPACE "TEMP" TEMPFILE
    SIZE 21474836480,
    SIZE 137437904896
    AUTOEXTEND ON NEXT 655360 MAXSIZE 131071M ( Will the next size ignored as the extent size is 1MB ?)
    EXTENT MANAGEMENT LOCAL UNIFORM SIZE 1048576
    And during the failure
    SELECT tablespace_name,
    total_blocks,
    used_blocks,
    free_blocks,
    total_blocks*32768/1024/1024 as total_MB,
    used_blocks*32768/1024/1024 as used_MB,
    free_blocks*32768/1024/1024 as free_MB
    FROM gv$sort_segment;
    TABLESPACE_NAME TOTAL_BLOCKS USED_BLOCKS FREE_BLOCKS TOTAL_MB USED_MB FREE_MB
    TEMP 4849568 2385728 2463840 151549 74554 76995
    TEMP 0 0 0 0 0 0
    Also when I checked from v$sort_usage I see only two session consuming space
    SQL> SELECT b.tablespace tablespace,
    2 -- b.segfile#,
    3 -- b.segblk#,
    4 b.blocks,
    5 b.blocks * (SELECT value FROM v$parameter WHERE name = 'db_block_size')/1024/1024 bytes,
    6 a.sid,
    7 a.username username,
    8 a.osuser osuser,
    9 a.inst_id,a.sid,a.serial#,a.module
    10 FROM gv$session a, gv$sort_usage b
    11 WHERE a.saddr = b.session_addr and
    12 b.blocks != 16 and
    13 a.inst_id = b.inst_id
    14 ORDER BY b.tablespace, b.blocks, bytes desc;
    BLOCKS BYTES SID USERNAME OSUSER INST_ID SID SERIAL# MODULE
    1,192,864 37277 381 CN obiqb 2 381 860 nqsserver@icmqapp01cdp (TNS V1
    1,192,864 37277 3952 CN obiqb 2 3952 1374 nqsserver@icmqapp01cdp (TNS V1
    2,385,728 74554 (mb)
    Wat is causing the 1652 ?

    877394 wrote:
    Thanks Srini,
    But I did try all that notes with no luck .
    I have a temporary tablespace with 150gb (130+20) datafiles .
    TABLESPACE_NAME FILE_NAME (BYTES/1024/1024)
    TEMP +DATA_01/tempfile/temp.314.743964            131071
    TEMP +DATA_01/tempfile/temp.312.757303             20480
    and the DDL is
    CREATE TEMPORARY TABLESPACE "TEMP" TEMPFILE
    SIZE 21474836480,
    SIZE 137437904896
    AUTOEXTEND ON NEXT 655360 MAXSIZE 131071M
    EXTENT MANAGEMENT LOCAL UNIFORM SIZE 1048576
    And on querying v$sort_usage
    SQL> SELECT b.tablespace tablespace,
    2 -- b.segfile#,
    3 -- b.segblk#,
    4 b.blocks,
    5 b.blocks * (SELECT value FROM v$parameter WHERE name = 'db_block_size')/1024/1024 bytes,
    6 a.sid,
    7 a.username username,
    8 a.osuser osuser,
    9 a.inst_id,a.sid,a.serial#,a.module
    10 FROM gv$session a, gv$sort_usage b
    11 WHERE a.saddr = b.session_addr and
    12 b.blocks != 16 and
    13 a.inst_id = b.inst_id
    14 ORDER BY b.tablespace, b.blocks, bytes desc;
    TABLESPACE BLOCKS BYTES SID OSUSER INST_ID SID SERIAL# MODULE
    TEMP 63,328 1,979 3952 CN 2 3952 1374
    TEMP 84,384 2,637 381 CN 2 381 860
    TEMP 433,184 13,537 381 CN 2 381 860
    TEMP 1,117,728 34,929 3952 CN 2 3952 1374
    sum 1,698,624 53,082 (mb)
    So the space utilization was less than 150gb and on querying v$sort_Segment
    SQL> SELECT tablespace_name,
    total_blocks,
    used_blocks,
    free_blocks,
    total_blocks*32768/1024/1024 as total_MB,
    used_blocks*32768/1024/1024 as used_MB,
    free_blocks*32768/1024/1024 as free_MB
    FROM gv$sort_segment;
    TABLESPACE_NAME TOTAL_BLOCKS USED_BLOCKS FREE_BLOCKS TOTAL_MB USED_MB FREE_MB inst
    TEMP 4849568 2311104 2538464 151549 72222 79327 2
    TEMP 0 0 0 0 0 0 1
    why for inst 1 it is showing 0 (which means no sort is happening in instance 1)
    But still we got the error
    ORA-1652: unable to extend temp segment by 32 in tablespace TEMP
    01652, 00000, "unable to extend temp segment by %s in tablespace %s"
    // *Cause:  Failed to allocate an extent of the required number of blocks for
    //          a temporary segment in the tablespace indicated.
    // *Action: Use ALTER TABLESPACE ADD DATAFILE statement to add one or more
    //          files to the tablespace indicated.

Maybe you are looking for