Oracle 11gR2 RAC: Running the script root.sh problem

Folks,
Hello. I am installing Oracle 11gR2 RAC using 2 Virtual Machines (rac1 and rac2 whose OS are Oracle Linux 5.6) in VMPlayer and according to the tutorial
http://appsdbaworkshop.blogspot.com/2011/10/11gr2-rac-on-linux-56-using-vmware.html
I have been installing Grid Infrastructure using runInstaller from step 1 to step 9 of 10 in both VM rac1 and rac2.
Now, I am running the script root.sh in VM rac1 and rac2 as below:
[root@rac1 /]# /u01/app/grid/root.sh
Output:
CRS-4123: ohasd is starting
FATAL: Module oracleoks not found
FATAL: Module oracleadvm not found
FATAL: Module oracleacfs not found
ACFS-9121: Failed to detect /dev/asm/.asm_ctl_spec
ACFS-9310: ADVM/ACFS installation failed.
ACFS-9311: not all components were detected after installation
'UpdateNodeList' was successful.
[root@rac1 /]#
[root@rac2 /]# /u01/app/grid/root.sh
Output:
CRS-4123: ohasd is starting
FATAL: Module oracleoks not found
FATAL: Module oracleadvm not found
FATAL: Module oracleacfs not found
ACFS-9121: Failed to detect /dev/asm/.asm_ctl_spec
ACFS-9310: ADVM/ACFS installation failed.
ACFS-9311: not all components were detected after installation
Start of resource "ora.asm_init" failed.
Failed to start ASM.
Failed to start Oracle Clusterware Stack.
[root@rac2 /]#
As we see the output above, rac1 and rac2 get the same problems. in addition, rac2 fails to start ASM and Clusterware stack. Thus, I have 2 questions:
First, the common problem for rac1 and rac2 :
1)Module "oracleoks, oracleadvm, oracleacfs" not found
2)/dev/asm/.asm_ctl_spec not detected
3)ADVM/ACFS installation failed
Do the above 3 factors affect Grid and DataBase Installation later ? If yes, how to solve these problems ?
Second, how to start ASM and Clusterware stack in rac2 ?
Thanks.

you have 2 options:
1. OEL 5.6 comes with 2 kernels, the original Red Hat, and Oracle UEK, you can choose not to use UEK
or the one i would recommend:
2. Upgrade Grid Infrastructure,
*11.2.0.3.1* (patch 13348650, released about a 1 month ago) supports ACFS on UEK (starting with 2.6.32.200 IIRC)

Similar Messages

The Script root.sh problem - ora.asm and ASM and Clusterware Stack failed

Folks,
Hello. I am installing Oracle 11gR2 RAC using 2 VMs (rac1 and rac2) whose OS are Oracle Linux 5.6 in VMPlayer according to the website http://appsdbaworkshop.blogspot.com/2011/10/11gr2-rac-on-linux-56-using-vmware.html
I am installing Grid infrastructure. On step 9 of 10 - execute script /u01/app/grid/root.sh for 2 VMs rac1 and rac2.
After run root.sh in rac1 successfully. I run root.sh in rac2 and get an error as below:
[root@rac2 grid]# ./root.sh
Running Oracle 11g root.sh script...
The following environment variables are set as:
ORACLE_OWNER= ora11g
ORACLE_HOME= /u01/app/grid
Enter the full pathname of the local bin directory: [usr/local/bin]: /usr/local/bin
Copying dbhome to /usr/local/bin ...
Copying oraenv to /usr/local/bin ...
Copying coraenv to /usr/local/bin ...
Creating /etc/oratab file...
Entries will be added to the /etc/oratab file as needed by
Database Configuration Assistant when a database is created
Finished running generic part of root.sh script.
Now product-specific root actions will be performed.
2012-03-05 16:32:52: Parsing the host name
2012-03-05 16:32:52: Checking for super user privileges
2012-03-05 16:32:52: User has super user privileges
Using configuration parameter file: /u01/app/grid/crs/install/crsconfig_params
Creating trace directory
LOCAL ADD MODE
Creating OCR keys for user 'root', privgrp 'root'..
Operation successful.
Adding daemon to inittab
CRS-4123: Oracle High Availability Services has been started.
ohasd is starting
CRS-4402: The CSS daemon was started in exclusive mode but found an active CSS daemon on node rac1, number 1, and is terminating
An active cluster was found during exclusive startup, restarting to join the cluster
CRS-2672: Attempting to start 'ora.mdnsd' on 'rac2'
CRS-2676: Start of 'ora.mdnsd' on 'rac2' succeeded
CRS-2672: Attempting to start 'ora.gipcd' on 'rac2'
CRS-2676: Start of 'ora.gipcd' on 'rac2' succeeded
CRS-2672: Attempting to start 'ora.gpnpd' on 'rac2'
CRS-2676: Start of 'ora.gpnpd' on 'rac2' succeeded
CRS-2672: Attempting to start 'ora.cssdmonitor' on 'rac2'
CRS-2676: Start of 'ora.cssdmonitor' on 'rac2' succeeded
CRS-2672: Attempting to start 'ora.cssd' on 'rac2'
CRS-2672: Attempting to start 'ora.diskmon' on 'rac2'
CRS-2676: Start of 'ora.diskmon' on 'rac2' succeeded
CRS-2676: Start of 'ora.cssd' on 'rac2' succeeded
CRS-2672: Attempting to start 'ora.ctssd' on 'rac2'
Start action for octssd aborted
CRS-2676: Start of 'ora.ctssd' on 'rac2' succeeded
CRS-2672: Attempting to start 'ora.drivers.acfs' on 'rac2'
CRS-2672: Attempting to start 'ora.asm' on 'rac2'
CRS-2676: Start of 'ora.drivers.acfs' on 'rac2' succeeded
CRS-2676: Start of 'ora.asm' on 'rac2' succeeded
CRS-2664: Resource 'ora.ctssd' is already running on 'rac2'
CRS-4000: Command Start failed, or completed with errors.
Command return code of 1 (256) from command: /u01/app/grid/bin/crsctl start resource ora.asm -init
Start of resource "ora.asm -init" failed
Failed to start ASM
Failed to start Oracle Clusterware stack
[root@rac2 grid]#
As we see the output above, at the end of the output
1) Start of resource ora.asm -init failed
2) Failed to start ASM
3) Failed to start Oracle Clusterware stack
The runInstaller is in the first VM rac1. My question is:
Do any folk understand how to solve the script root.sh in rac2 problem ( 3 fails of ora.asm, ASM and Clusterware stack as above) ?
Thanks.

Please check there is no firewall exist:
try this like:
root.sh fails on second node
MOS note:
11gR2 Grid: root.sh Fails to Start the Clusterware on the Second Node Due to Firewall on Private Network [ID 981357.1]
Grid Infrastructure 11.2.0.2 Installation or Upgrade may fail due to Multicasting Requirement [ID 1212703.1] (Most probabily this issue)

Oracle 11gR2 RAC : How to resume runInstaller to continue to install Grid ?

Folks,
Hello.
I am installing Oracle 11gR2 RAC using 2 Virtual Machines (rac1 and rac2 whose OS are Oracle Linux 5.6) in VMPlayer.
I have been installing Grid Infrastructure using runInstaller from step 1 to step 9 of 10 in both VM rac1 and rac2.
After finish running the script root.sh in VM rac1 and rac2, the Computer is shut down automaticall because I don't touch the keyboad for a long time. When I resume the Computer, runInstaller Wizard is gone. My question is:
How to resume runInstaller to continue to install Grid ?
Thanks.

Hi!
You can't resume runInstaller.
You must Clear you envinronment, and try again.

Grid Installer Wizard step 9 of 10 - execute script root.sh problem

Folks,
Hello. I am installing Oracle 11gR2 RAC using 2 Virtual Machines (rac1 and rac2 whose OS are Oracle Linux 5.6)
and according to the tutorial http://appsdbaworkshop.blogspot.com/2011/10/11gr2-rac-on-linux-56-using-vmware.html
The Virtual Disk for each VM is 20 GB whose raw device is /dev/sda (partition /dev/sda1 is the same size).
In order to install Grid Infrastructure, I add 5 Hard Disks into the first VM rac1 and 10GB for each Hard Disk.
Then create 5 ASM disks respectively as a Disk Group. Let me describe them as follows:
OS Phyysical file: C:\VM_RAC\sharerac\asmdisk1.vmdk (asmdisk2.vmdk asmdisk3.vmdk asmdisk4.vmdk asmdisk5.vmdk)
Corresponding raw devices: /dev/sdb (sdc sdd sde sdf)
Corresponding partition: /dev/sdb1 (sdc1 sdd1 sde1 sdf1)
Corresponding ASM disk: ASMDISK1 (ASMDISK2 ASMDISK3 ASMDISK4 ASMDISK5)
When I run Grid installer step 5 of 8, I select all of 5 ASMDISK as ASM disk group in the Wizard.
The clusterware files are supposed to be stored in the ASM disk group.
The 2 VMs rac1 and rac2 should use the same ASM disk group.
By here, I don't do anything regarding ASM disk group in the second VM rac2.
When run the Grid Installer step 9 of 10, execute script root.sh in the 2 VMs rac1 and rac2. The script root.sh runs in the first VM rac1 successfully. But when the script root.sh runs in the second VM rac2, the error message comes up as following:
ORA-15018: disk group cannot be created.
ORA-15031: disk specification 'ORCL:ASMDISK5' matches no disks.
ORA-15031: disk specification 'ORCL:ASMDISK4' matches no disks.
ORA-15031: disk specification 'ORCL:ASMDISK3' matches no disks.
ORA-15031: disk specification 'ORCL:ASMDISK2' matches no disks.
ORA-15031: disk specification 'ORCL:ASMDISK1' matches no disks.
Configuration of ASM failed.
Did not successfully configure and start ASM.
Initial cluster configuration failed.
From the above error message, it seems that we need to connect the second VM rac2 with the ASM disk group created in rac1 so that 2 VMs use the same set of the ASM disks.
But I don't see anything about doing ASM disk group in the second VM rac2 in the tutorial
http://appsdbaworkshop.blogspot.com/2011/10/11gr2-rac-on-linux-56-using-vmware.html.
My question is:
Do any folk understand how to solve ASM disks issue in the second VM rac2 when run the script root.sh in rac2 on step 9 of 10 in Installer Wizard ?
Thanks.

Hi,
One of mandatory requirement for RAC is shared storage. Check if you have shared storage across all nodes.
Run oracleasm listdisk on node2 to see if it can see the same disks on node 1. Otherwise you didn't follow that tutorial correctly
Cheers

Oracle 11gR2 RAC Root.sh Failed On The Second Node

Hello,
When i installing Oracle 11gR2 RAC on AIX 7.1 , root.sh succeeds on first node but fails on the second node:
I get error "Root.sh Failed On The Second Node With Error ORA-15018 ORA-15031 ORA-15025 ORA-27041 [ID 1459711.1]" within Oracle installation.
Applies to:
Oracle Server - 11gR2 RAC
EMC VNX 500
IBM AIX on POWER Systems (64-bit)
in /dev/rhdiskpower0 does not show in kfod output on second node. It is an EMC multipath disk device.
But the disk can be found with AIX command.
any help!!
Thanks

the soluation that uninstall "EMC solutitons enabler" but in the machine i just find "EMC migration enabler" and conn't remove without remove EMC Powerpath.

The best option to create a shared storage for Oracle 11gR2 RAC in OEL 5?

Hello,
Could you please tell me the best option to create a shared storage for Oracle 11gR2 RAC in Oracel Enterprise Linux 5? in production environment? And could you help to create shared storage? Because there is no additional step in Oracle installation guide. There are steps for only asm disk creation.
Thank you.

Here are names of partitions and permissions. Partitions which have 146 GB, 438 GB, 438 GB of capacity are my storage. Two of three disks which are 438 GB were configured as RAID 5 and remaining disk was configured as RAID 0. My storage is Dell MD 3000i and connected to nodes through ethernet.
Node 1
[root@rac1 home]# ll /dev/sd*
brw-r----- 1 root disk 8, 0 Aug 8 17:39 /dev/sda
brw-r----- 1 root disk 8, 1 Aug 8 17:40 /dev/sda1
brw-r----- 1 root disk 8, 16 Aug 8 17:39 /dev/sdb
brw-r----- 1 root disk 8, 17 Aug 8 17:39 /dev/sdb1
brw-r----- 1 root disk 8, 32 Aug 8 17:40 /dev/sdc
brw-r----- 1 root disk 8, 48 Aug 8 17:41 /dev/sdd
brw-r----- 1 root disk 8, 64 Aug 8 18:26 /dev/sde
brw-r----- 1 root disk 8, 65 Aug 8 18:43 /dev/sde1
brw-r----- 1 root disk 8, 80 Aug 8 18:34 /dev/sdf
brw-r----- 1 root disk 8, 81 Aug 8 18:43 /dev/sdf1
brw-r----- 1 root disk 8, 96 Aug 8 18:34 /dev/sdg
brw-r----- 1 root disk 8, 97 Aug 8 18:43 /dev/sdg1
[root@rac1 home]# fdisk -l
Disk /dev/sda: 72.7 GB, 72746008576 bytes
255 heads, 63 sectors/track, 8844 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Device Boot Start End Blocks Id System
/dev/sda1 * 1 8844 71039398+ 83 Linux
Disk /dev/sdb: 72.7 GB, 72746008576 bytes
255 heads, 63 sectors/track, 8844 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Device Boot Start End Blocks Id System
/dev/sdb1 * 1 4079 32764536 82 Linux swap / Solaris
Disk /dev/sdd: 20 MB, 20971520 bytes
1 heads, 40 sectors/track, 1024 cylinders
Units = cylinders of 40 * 512 = 20480 bytes
Device Boot Start End Blocks Id System
Disk /dev/sde: 146.2 GB, 146278449152 bytes
255 heads, 63 sectors/track, 17784 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Device Boot Start End Blocks Id System
/dev/sde1 1 17784 142849948+ 83 Linux
Disk /dev/sdf: 438.8 GB, 438835347456 bytes
255 heads, 63 sectors/track, 53352 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Device Boot Start End Blocks Id System
/dev/sdf1 1 53352 428549908+ 83 Linux
Disk /dev/sdg: 438.8 GB, 438835347456 bytes
255 heads, 63 sectors/track, 53352 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Device Boot Start End Blocks Id System
/dev/sdg1 1 53352 428549908+ 83 Linux
Node 2
[root@rac2 ~]# ll /dev/sd*
brw-r----- 1 root disk 8, 0 Aug 8 17:50 /dev/sda
brw-r----- 1 root disk 8, 1 Aug 8 17:51 /dev/sda1
brw-r----- 1 root disk 8, 2 Aug 8 17:50 /dev/sda2
brw-r----- 1 root disk 8, 16 Aug 8 17:51 /dev/sdb
brw-r----- 1 root disk 8, 32 Aug 8 17:52 /dev/sdc
brw-r----- 1 root disk 8, 33 Aug 8 18:54 /dev/sdc1
brw-r----- 1 root disk 8, 48 Aug 8 17:52 /dev/sdd
brw-r----- 1 root disk 8, 64 Aug 8 17:52 /dev/sde
brw-r----- 1 root disk 8, 65 Aug 8 18:54 /dev/sde1
brw-r----- 1 root disk 8, 80 Aug 8 17:52 /dev/sdf
brw-r----- 1 root disk 8, 81 Aug 8 18:54 /dev/sdf1
[root@rac2 ~]# fdisk -l
Disk /dev/sda: 145.4 GB, 145492017152 bytes
255 heads, 63 sectors/track, 17688 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Device Boot Start End Blocks Id System
/dev/sda1 * 1 8796 70653838+ 83 Linux
/dev/sda2 8797 12875 32764567+ 82 Linux swap / Solaris
Disk /dev/sdc: 146.2 GB, 146278449152 bytes
255 heads, 63 sectors/track, 17784 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Device Boot Start End Blocks Id System
/dev/sdc1 1 17784 142849948+ 83 Linux
Disk /dev/sdd: 20 MB, 20971520 bytes
1 heads, 40 sectors/track, 1024 cylinders
Units = cylinders of 40 * 512 = 20480 bytes
Device Boot Start End Blocks Id System
Disk /dev/sde: 438.8 GB, 438835347456 bytes
255 heads, 63 sectors/track, 53352 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Device Boot Start End Blocks Id System
/dev/sde1 1 53352 428549908+ 83 Linux
Disk /dev/sdf: 438.8 GB, 438835347456 bytes
255 heads, 63 sectors/track, 53352 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Device Boot Start End Blocks Id System
/dev/sdf1 1 53352 428549908+ 83 Linux
[root@rac2 ~]#
Thank you.
Edited by: user12144220 on Aug 10, 2011 1:10 AM
Edited by: user12144220 on Aug 10, 2011 1:11 AM
Edited by: user12144220 on Aug 10, 2011 1:13 AM

Oracle 11gR2 RAC: how to solve "user profile creation mask failed" ?

Folks,
Hello.
I am installing Oracle 11gR2 RAC using 2 Virtual Machines (rac1 and rac2 whose OS are Oracle Linux 5.6) in VMPlayer.
I am using Cluster Verification Utility (CVU) to test the 2 nodes for Grid installation as follows:
[ora11g@rac1 grid] $ ./runcluvfy.sh stage -pre crsinst -n all -r 11gR2 -orainv ora11g -fixup -fixupdir /mydir -verbose
All items for rac2 are passed. There is only one item for rac1 is not passed as follows:
Check default user profile creation mask:
Node Name: rac1
Available: 0002
Required: 0022
Comment: failed
There are 3 ways to solve this issue:
1) In the file /etc/bashrc, change the line "umask 0002" to "umask 0022".
2) In the file /etc/profile, add line "umask 0022" at the end of the file.
3) In the file /etc/csh.cshrc, change the line "umask 002" to "umask 0022".
In rac2, I got the same issue in the past. I just change the line "umask 0002" to "umask 0022" in the file /etc/bashrc and the issue is solved.
But in rac1, I have tried each of the 3 options and also combined 1) and 2), 1) and 3), 2) and 3), 1) and 2) and 3). Totally, that's 7 options. But all of 7 options cannot solve the issue.
The script runcluvfy.sh still tests rac1 user profile creation mask failed. My question is:
Do any folk understand how to solve VM rac1 user profile creation mask problem ?
Thanks.

Folks,
Hello. I follow the document "Oracle Grid Infrastructure Installation Guide 11g Release 2 (11.2) for Linux E22489-04" and do the following:
[root@rac1 /]#echo $SHELL
Output: /bin/bash
This means we need to edit Bash shell file .bash_profile.
[ora11g@rac1 ~]$vi /home/ora11g/.bash_profile
Add this line: umask 022
Then I save the file .bash_profile and reboot OS.
Then I run the following command:
[ora11g@rac1 grid] $ ./runcluvfy.sh stage -pre crsinst -n all -r 11gR2 -orainv ora11g -fixup -fixupdir /mydir -verbose
But the reusult is the same. The issue is not solved as follows:
Check default user profile creation mask:
Node Name: rac1
Available: 0002
Required: 0022
Comment: failed
Do any folk understand how to solve VM rac1 user profile creation mask problem ?
Thanks.

Oracle 11gR2 RAC in LDOM Network issue

Hi, Requesting your expert advise regarding this configuration.
We are implementing LDOM 2.2 on two SPARC T4-4 for Oracle 11gR2 RAC; Solaris 10 U10 on both control and guest domain. The setup for each primary/control domain is: Two 10g links aggregated and have four VLAN trunked on the aggregate. vSwitch created using the aggr as the device as following per T4-4:
NOTE: VLAN 1501 is for data connection and VLAN 10 is for heartbeat for one RAC cluster and VL 1601 and 11 is for another RAC. all together four LDOMS.
ldm add-vswitch vid=1501,1601,10,11 net-dev=aggr1 primary-vsw0 primary
ldm add-vnet pvid=1501 vnetprod primary-vsw0 guest1
ldm add-vnet pvid=10 vnethb primary-vsw0 guest1
ldm add-vnet pvid=1601 vnetprod primary-vsw0 guest2
ldm add-vnet pvid=11 vnethb primary-vsw0 guest2
vnet inside the LDOM are not tagged:
vnet1: flags=1000843<UP,BROADCAST,RUNNING,MULTICAST,IPv4> mtu 1500 index 3
inet 10.220.128.20 netmask ffffff80 broadcast 10.220.128.127
ether 0:14:4f:f9:ec:7f
vnet2: flags=1000843<UP,BROADCAST,RUNNING,MULTICAST,IPv4> mtu 1500 index 4
inet 192.168.2.11 netmask ffffff80 broadcast 192.168.2.127
ether 0:14:4f:fb:2b:8f
Here is the whole configuration:
root@gp-cpu-suh004 # ldm -V
Logical Domains Manager (v 2.2.0.0)
Hypervisor control protocol v 1.9
Using Hypervisor MD v 1.4
System PROM:
Hostconfig v. 1.2.0. @(#)Hostconfig 1.2.0.a 2012/05/11 07:34
Hypervisor v. 1.11.0. @(#)Hypervisor 1.11.0.a 2012/05/11 05:28
OpenBoot v. 4.34.0 @(#)OpenBoot 4.34.0 2012/04/30 14:26
root@gp-cpu-suh004 # ldm ls
NAME STATE FLAGS CONS VCPU MEMORY UTIL UPTIME
primary active -n-cv- UART 32 16G 2.5% 48m
oidrac1 active -n---- 5000 32 16G 0.0% 27m
root@gp-cpu-suh004 # ldm ls -l
NAME STATE FLAGS CONS VCPU MEMORY UTIL UPTIME
primary active -n-cv- UART 32 16G 3.1% 48m
SOFTSTATE
Solaris running
UUID
e73421fe-7003-e748-be7e-801fee5bfcc7
MAC
00:21:28:f1:95:26
HOSTID
0x85f19526
CONTROL
failure-policy=ignore
extended-mapin-space=off
cpu-arch=native
DEPENDENCY
master=
CORE
VCPU
MEMORY
RA PA SIZE
0x20000000 0x20000000 16G
CONSTRAINT
threading=max-throughput
VARIABLES
auto-boot-on-error?=true
auto-boot?=true
boot-device=/pci@400/pci@1/pci@0/pci@0/LSI,sas@0/disk@w5000cca0251e7a29,0:a
keyboard-layout=US-English
nvramrc=." ChassisSerialNumber 1207BDYFFE " cr
use-nvramrc?=true
IO
DEVICE PSEUDONYM OPTIONS
VCC
NAME PORT-RANGE
primary-vcc0 5000-5100
VSW
NAME MAC NET-DEV ID DEVICE LINKPROP DEFAULT-VLAN-ID PVID VID MTU MODE INTER-VNET-LINK
primary-vsw-mgmt 00:14:4f:fb:75:c0 igb1 0 switch@0 1 1 1500 on
primary-vsw0 00:14:4f:fa:33:8b aggr1 1 switch@1 1 1 1501,1601,10,11 1500 on
VDS
NAME VOLUME OPTIONS MPGROUP DEVICE
primary-vds0 rootoid /dev/dsk/c14t50060E8005BFAA04d1s2
data_oid /dev/dsk/c14t50060E8005BFAA04d2s2
ocr_oid /dev/dsk/c14t50060E8005BFAA04d3s2
VCONS
NAME SERVICE PORT
UART
NAME STATE FLAGS CONS VCPU MEMORY UTIL UPTIME
oidrac1 active -n---- 5000 32 16G 0.0% 27m
SOFTSTATE
Solaris running
UUID
0fcbbf21-14a2-eb21-f544-d4424212f3ef
MAC
00:14:4f:f9:1b:d4
HOSTID
0x84f91bd4
CONTROL
failure-policy=ignore
extended-mapin-space=off
cpu-arch=native
DEPENDENCY
master=
CORE
CID CPUSET
VCPU
VID PID CID UTIL STRAND
MEMORY
RA PA SIZE
0x20000000 0x420000000 16G
CONSTRAINT
threading=max-throughput
VARIABLES
auto-boot?=true
boot-device=disk:a
keyboard-layout=US-English
NETWORK
NAME SERVICE ID DEVICE MAC MODE PVID VID MTU LINKPROP
vnet1 primary-vsw-mgmt@primary 0 network@0 00:14:4f:fa:61:77 1 1500
vnetprod primary-vsw0@primary 1 network@1 00:14:4f:f9:ec:7f 1501 1500
vnethb primary-vsw0@primary 2 network@2 00:14:4f:fb:2b:8f 10 1500
DISK
NAME VOLUME TOUT ID DEVICE SERVER MPGROUP
oneidrootdisk rootoid@primary-vds0 0 disk@0 primary
oid_data data_oid@primary-vds0 1 disk@1 primary
oid_ocr ocr_oid@primary-vds0 2 disk@2 primary
VCONS
NAME SERVICE PORT
oidrac1 primary-vcc0@primary 5000
root@gp-cpu-suh004 # ldm ls-services
VCC
NAME LDOM PORT-RANGE
primary-vcc0 primary 5000-5100
VSW
NAME LDOM MAC NET-DEV ID DEVICE LINKPROP DEFAULT-VLAN-ID PVID VID MTU MODE INTER-VNET-LINK
primary-vsw-mgmt primary 00:14:4f:fb:75:c0 igb1 0 switch@0 1 1 1500 on
primary-vsw0 primary 00:14:4f:fa:33:8b aggr1 1 switch@1 1 1 1501,1601,10,11 1500 on
VDS
NAME LDOM VOLUME OPTIONS MPGROUP DEVICE
primary-vds0 primary rootoid /dev/dsk/c14t50060E8005BFAA04d1s2
data_oid /dev/dsk/c14t50060E8005BFAA04d2s2
ocr_oid /dev/dsk/c14t50060E8005BFAA04d3s2
root@gp-cpu-suh004 # dladm show-link
vsw0 type: non-vlan mtu: 1500 device: vsw0
vsw1 type: non-vlan mtu: 1500 device: vsw1
vsw1501001 type: vlan 1501 mtu: 1500 device: vsw1
igb0 type: non-vlan mtu: 1500 device: igb0
igb1 type: non-vlan mtu: 1500 device: igb1
qlge0 type: non-vlan mtu: 1500 device: qlge0
qlge1 type: non-vlan mtu: 1500 device: qlge1
qlge2 type: non-vlan mtu: 1500 device: qlge2
qlge3 type: non-vlan mtu: 1500 device: qlge3
aggr1 type: non-vlan mtu: 1500 aggregation: key 1
root@gp-cpu-suh004 # ifconfig -a
lo0: flags=2001000849<UP,LOOPBACK,RUNNING,MULTICAST,IPv4,VIRTUAL> mtu 8232 index 1
inet 127.0.0.1 netmask ff000000
igb0: flags=1000843<UP,BROADCAST,RUNNING,MULTICAST,IPv4> mtu 1500 index 2
inet 10.223.12.14 netmask ffffff00 broadcast 10.223.12.255
ether 0:21:28:f1:95:26
vsw1501001: flags=201000843<UP,BROADCAST,RUNNING,MULTICAST,IPv4,CoS> mtu 1500 index 3
inet 10.220.128.9 netmask ffffff80 broadcast 10.220.128.127
ether 0:14:4f:fa:33:8b
root@gp-cpu-suh004 # netstat -nr
Routing Table: IPv4
Destination Gateway Flags Ref Use Interface
default 10.220.128.1 UG 1 7
10.220.128.0 10.220.128.9 U 1 5 vsw1501001
10.223.0.0 10.223.12.1 UG 1 2
10.223.12.0 10.223.12.14 U 1 1 igb0
224.0.0.0 10.220.128.9 U 1 0 vsw1501001
127.0.0.1 127.0.0.1 UH 8 261 lo0

Yes, I can connect to the vswitch interface on the control domain. I didn't specify any PVID because my understanding is that PVID will tag any frame with the PVID VLAN by default. basically the PVID for this interface is 1.
Here's the VNET config for the other LDOM in the RAC cluster:
VSW
NAME MAC NET-DEV ID DEVICE LINKPROP DEFAULT-VLAN-ID PVID VID MTU MODE INTER-VNET-LINK
primary-vsw-mgmt 00:14:4f:f9:91:fa igb1 0 switch@0 1 1 1500 on
primary-vsw0 00:14:4f:fa:8e:cf aggr1 1 switch@1 1 1 1501,1601,10,11 1500 on
NETWORK
NAME SERVICE ID DEVICE MAC MODE PVID VID MTU LINKPROP
vnet1 primary-vsw-mgmt 0 00:14:4f:fb:65:6d 1
vnetprod primary-vsw0 1 00:14:4f:fa:2b:02 1501
vnethb primary-vsw0 2 00:14:4f:f8:12:c1 10
Thanks for reviewing my configuration.

Oracle 11gR2 RAC with Sun clsuter 3.3 clsetup not showing ASMDiskGroup RS

Hello,
I am installing Oracle 11gR2 RAC on Solaris cluster 3.3 with hardware RAID and ASM
I was able to register rac-famework-rg and crs-framework-rg.
Oracle RAC is up and running (confirmed from crs_stat -t -v)
However, while creating option 5. Automatic Storage Management (ASM) on clsetup, I was getting ERROR: ASM is either not installed or the installation is invalid!
I have created the asm-inst-rg with resource asm-inst-rs and asm-dg-rg with resources asm-dg-fra, asm-dg-data and asm-dg-crs using CLI. Please find the complete clrg and clrs status output below:
root@rac1 # clrg status
=== Cluster Resource Groups ===
Group Name Node Name Suspended Status
rac-framework-rg rac1 No Online
rac2 No Online
asm-inst-rg rac1 No Online
rac2 No Online
asm-dg-rg rac1 No Online
rac2 No Online
root@rac1 # clrs status
=== Cluster Resources ===
Resource Name Node Name State Status Message
crs_framework-rs rac1 Online Online
rac2 Online Online
rac-udlm-rs rac1 Online Online
rac2 Online Online
rac-framework-rs rac1 Online Online
rac2 Online Online
asm-inst-rs rac1 Online Online - +ASM1 is UP and ENABLED
rac2 Online Online - +ASM2 is UP and ENABLED
asm-dg-fra rac1 Online Online - Mounted: FRA
rac2 Online Online - Mounted: FRA
asm-dg-crs rac1 Online Online - Mounted: CRS
rac2 Online Online - Mounted: CRS
asm-dg-data rac1 Online Online - Mounted: DATA
rac2 Online Online - Mounted: DATA
Once I reach clsetup option 6: Resources for Oracle Real Application Clusters Database Instances, I was able to select cluster db name, oracle home, SID for both nodes, and it listed the asm-inst-rg and asm-inst-rs for selection of "Specify Oracle ASM Instance Resource".
The problem is the the next selection which is "Specify Oracle ASM Disk Group Resources" which does NOT list any asm-dg-rg or asm-dg-fra or anything, instead, it throws error "No existing disk-group resources available for selection. Run ASM subwizard create new resource(s) and come back to this panel for the selection."
Kindly guide me to create Resources for Oracle Real Application Clusters Database Instances either in CLI or clsetup
Thanks and Regards
Ushas Symon

Solaris Cluster 3.3 u1 solved the issue.
The problem right now I am facing is IPMP on the public interface.
When I remove the cable on the bge0, the ip on bge0 and the SCAN IP's are plumbed to bge1 which is in sc_ipmp0, but NOT the virtual IP!!! and the listeners on both nodes go offiline!!!
any inputs on the configuration will be highly appreciated..
Thanks and Regards
Ushas Symon

Install Oracle 11gR2 RAC : Cannot remove directory bootstrap under /tmp

Folks,
Hello. I am installing Oracle 11gR2 RAC using 2 Virtual Machines (rac1 and rac2 whose OS are Oracle Linux 5.6) in VMPlayer and according to the tutorial
http://appsdbaworkshop.blogspot.com/2011/10/11gr2-rac-on-linux-56-using-vmware.html
I am installing Grid infrastructure. I am on step 7 of 10 (verify Grid installation enviroment) and get this error:
"Free Space: Rac2: /tmp
Cause: Could not determine mount point for location specified.
Action: Ensure location specified is available.
Expected value: n/a
Actual value: n/a "
In order to fix the above error, I run "cluster verification utility" according to
http://docs.oracle.com/cd/E14072_01/rac.112/e10717/cvu.htm I run the following command:
[ora11g@rac1 \]$ /home_grid/runcluvfy.sh stage -pre crsinst -n rac1,rac2 -verbose
Output:
/bin/rm: cannot remove directory '/tmp/bootstrap': Operation not permitted
./runcluvfy.sh:line 99:/tmp/bootstrap/ouibootstrap.log: permission denied
From the above output, we can see the directory bootstrap under /tmp causes the problem. The solution is to remove the directory bootstrap. I run the 2 commands:
[ora11g@rac1 tmp]$ rmdir bootstrap
Output: Operation not permitted
[ora11g@rac1 tmp]$ rm -rf bootstrap
Output: cannot remove bootstrap: Operation not permitted.
[ora11g@rac2 tmp]$ ls
Output: there is no 'bootstrap' directory.
My questions are:
First, does "cannot remove boostrap in rac1" cause that /tmp in rac2 could not be determine mount point ?
Second, can any folk help to remove the directory bootstrap under /tmp ?
Thanks.

Folks,
Hello. Thanks a lot for replying. I have just run the 2 commands:
[root@rac2 \]# chown -R ora11g:dba /u01
[root@rac2 \]# chmod -R 775 /u01
ora11g is the user who installs the Grid and /u01 is the directory where Grid is installed and dba is the group.
I go back to Grid Installer Step 7 of 10 in rac1 and check again and see as below:
Free Space: Rac2 : /tmp
Cause: Could not determine mount point for location specified.
Action: Ensure location specified is available
Expected Value: n/a
Actual Value: n/a
The problem is not solved after run the above 2 commands in rac2.
In addition, I have run Cluster Verification Utility using the command:
[ora11g@rac1 grid]./runcluvfy.sh stage -pre crsinst -n rac1,rac2 -r 11gR2 -orainv ora11g -verbose
Output: All of items for rac2 are passed. There is only one item for rac1 is failed as below:
Check default user file creation mask:
NodeName: rac1
Available: 0002
Required: 0022
Comment: failed
As we see above, the result of CVU command is not the same with Grid Installer step 7 of 10 (Installation Environment Verification):
CVU command doesn't find /tmp mount point problem for rac2 that Grid Installer does.
Grid Installer step 7 of 10 doesn't find user file creation mask problem for rac1 that CVU command does.
I have tried to find out whether creation mask failed for rac1 causes /tmp problem for rac2. I have changed the line "umask 002" to "umask 0022" for rac1 in each of the 3 files below and run CVU command each time for each file:
rac1:
/etc/bashrc
/etc/profile
/etc/csh.cshrc
But chang the line "umask 002" to "umask 0022" for rac1 in each of the above 3 files does not solve the problem.
My questions are:
First, why is the result of CVU command not the same with that of Grid Installer step 7 of 10 ?
Second, why change the line "umask 002" to "umask 0022" in 3 files can't solve creation mask problem for rac1 ?
Third, how to solve /tmp problem for rac2 and creation mask problem for rac1 ?
Thanks.

Oracle 11gR2 RAC - R language integration

Hello,
We want statistical language R integration with oracle database. Does this come with default installation of oracle database Oracle 11gR2 RAC ?
OR it requires EXADATA - BIGDATA (oracle appliance)?
Kindly let us know steps for installation /enabling R language ? Basically we are looking for 3 options (transparency, In-database, embedded). Optimal option choice is done automatically depending on R language script (I think R script needs to have different calls?)
Thanks

Please do NOT duplicate your questions here.
R is a language. Oracle is a database. You store data in a database. You write programs [using a language such as R] to extract and manipulate data from the database.

Installing Oracle 11gR2 RAC Problem: ASM disks

Folks,
Hello. I am installing Oracle 11gR2 RAC using 2 Virtual Machines (rac1 and rac2 whose OS are Oracle Linux 5.6) in VMPlayer and according to the tutorial
http://appsdbaworkshop.blogspot.com/2011/10/11gr2-rac-on-linux-56-using-vmware.html
At the first time, I create VM rac1. While its OS Oracle Linux 5.6 is booting, initializing ASMLib Driver OK. I create 5 ASM disks successfully using the command:
[root@rac1 /]# /etc/init.d/oracleasm createdisk ASMDISK1 /dev/sdb1
Output: Marking disk "ASMDISK1" as an ASM disk: OK
Because the hard disk space of rac1 is not enough to install Database, I create VM rac1 again with bigger hard disk space (30GB). I do everything the same with that at the first time. But this time, While OS Oracle Linux 5.6 is booting, initializing ASMLib Driver failed. I create 5 ASM disks using the same command:
[root@rac1 /]# /etc/init.d/oracleasm createdisk ASMDISK1 /dev/sdb1
Output: Marking disk "ASMDISK1" as an ASM disk: failed
But when I use the command:
[root@rac1 /]# /etc/init.d/oracleasm listdisks
Output: ASMDISK1 ASMDISK2 ASMDISK3 ASMDISK4 ASMDISK5
My questions are:
First, can the 5 disks "ASMDISK1 ASMDISK2 ASMDISK3 ASMDISK4 ASMDISK5" be used correctly in spite of Marking disk "ASMDISK1(2 3 4 5)" as an ASM disk failed ?
Second, how to fix OS Oracle Linux 5.6 so that initializing ASMLib Driver OK while booting ?
Thanks.

Folks,
Hello. The issue is solved by myself. Thanks.

Oracle 11gR2 - RAC to RAC replication via SAN

Hi,
Anyone there experience before on Oracle 11gr2 RAC to RAC via EMC SRDF setup? Please share some information and also provide links if there is any white paper/technical paper.
Thanks
Edited by: 858013 on May 11, 2011 12:10 AM

In SAN replication, the database instance at the remote site cannot be started up and running as the SAN cannot allow read-write access to the filesystems.
When the primary site goes down, you simply issue a STARTUP at the remote site --- provided that the SAN replication has guaranteed write ordering, else you will have a corrupted database. That is why it is very important to talk to your SAN storage vendors to get the replication setup correctly.
(If the replication is correctly done, the STARTUP will "see" that the database files are fuzzy and that the onlin redo log files are available and attempt an Instance Recovery -- as if the instance / server had crashed or suffered a shutdown abort).
Hemant K Chitale

SCAN Name issue in Oracle 11gR2 RAC Installation

Hi,
I am trying to install Oracle 11gR2 RAC on VM ware and I got the INS-40922 (Invalid SCAN name). Do I need to create the SCAN name prior to the installation?
I have public,private, and VIP's. I am not sure how I create this SCAN Name. Please share your thoughts
Thanks

During installation of grid infrastructure SCAN will be automatically created. If you are using DNS then put the scan name and scan ip addresses entries in DNS . If you are not using dns/gns then put scanname and scan ipadress hosts file on each node in the cluster. Before installation, you should not be able to ping scan ipadresses.

Oracle 11gR2 RAC VM and SCAN and DNS and /etc/hosts (two) setup questions

Hi,
I am looking forward to setting up two Oracle 11gR2 RAC instances
on my Oracle VM test machine.
I plan on using the Oracle 11gR2 RAC VM template.
I want the final Oracle 11gR2 RAC instances to have SCAN that uses DNS.
The DNS will be pre-installed in the JeOS.
My first simple question about the setup is the following.
In my DNS name file, for example,
/var/named/chroot/var/named/milkyway.univ.db
do I need to provide the racnode1 and racnode2 information,
for example,
# DNS name file (snippet)
myjeos IN A 192.168.1.150
racnode1 IN A 192.168.1.161
racnode1-vip IN A 192.168.1.163
racnode2 IN A 192.168.1.162
racnode2-vip IN A 192.168.1.164
rac-scan IN A 192.168.1.131
rac-scan IN A 192.168.1.132
rac-scan IN A 192.168.1.133
Or, can I just provide only the rac-scan information
# DNS name file alternate (snippet)
myjeos IN A 192.168.1.150
rac-scan IN A 192.168.1.131
rac-scan IN A 192.168.1.132
rac-scan IN A 192.168.1.133
What I am getting at is the following.
Within the install process, will racnode1, racnode1-vip, racnode2,
and racnode2-vip host names and their IP address be written
to the RAC instances /etc/hosts files? (So I should not bother
to put them in the DNS name file like '# DNS name file alternate (snippet)'?)
Or, should I put the racnode and racnode-vip host names and IP addresses
in the DNS name file like '# DNS name file (snippet)'?
The second question is the following.
Are the cluster name and the scan name allowed to be different?
Currently, I would plan them to be different,
for example, rac-cluster and rac-scan.
Or, are they required to be the same,
for example, rac-cluster and rac-cluster.
Thank you.
AIM

AIM wrote:
do I need to provide the racnode1 and racnode2 information,
Or, can I just provide only the rac-scan information You need to provide all of it in DNS, because other hosts in your network will need to be able to resolve all of the normal, VIP and SCAN addresses for your RAC nodes. We write this data out to /etc/hosts just to reduce the amount of round-trip DNS requests the cluster nodes make for themselves.
Are the cluster name and the scan name allowed to be different?They can be different.

Oracle 11gR2 RAC: Running the script root.sh problem

Similar Messages

Maybe you are looking for