Oracle 10g RAC+ASM - Storage Issue

I’ve an issue related to Oracle 10g RAC.
I’ve 2 node cluster each being Dell 2850 Server with RHEL 4.0
I’ve EMC CX300 SAN storage with following partitions
/orasoft     10 Gb          OCFS2 File system
/oracrs          2 Gb          OCFS2 File system
/orabackup      100 Gb          OCFS2 File system
The datafiles are on ASM which is not directly visible in OS.
I’ve common Oracle Home installed in /orasoft/db_1 which is shared by both nodes in cluster.
I’ve faced an issue recently related to EMC storage.
The /orasoft partition displays 1.4 Gb space available using df command.
With both nodes sharing the common Oracle Home (/orasoft/db_1), when ever I try to touch a file I get an error as No Space left on device. I’m unable to start any service with the same reason.
Is this setup correct ??
Can anyone help me with this storage issue ??

Hi,
If you create a new diskgroup you may be to add the same diskgroup to parameter file or spfile and which will be needing down time.
sugestion: Instead of creating new diskgroup you should to add disk to existing group.if you add asm disk to existing group your all problem will be solved and Oracle itself will be managing all.And than i am sure no need to add entry in the parameter or spfile like +db_create_file_dest=.....
regards,
Sher khan

Similar Messages

Oracle 10g RAC + ASM

Hi,
We are installing Oracle10g RAC with Oracle clusterware with ASM on Solaris 10. Does anybody have a installation/configuration manual for this combination.
Thanks,
Murtuja

Murtuja,
Oracle Clusterware and Oracle Real Application Clusters Installation and Configuration Guide for Solaris Operating System (SPARC 64-Bit) has got all the information you would need to install Oracle RAC on Solaris 10. This guide is available from http://otn.oracle.com
Thanks & Regards

Create guaranteed restore point in oracle 10g RAC ASM

Hi DBAs,
In our production environment we have 2 node master RAC database (Oracle 10.2.0.5) (node1 name=master1 and node2 name=master2)
for which there is going to be a release tonight so want to create a guaranteed restore point for this RAC database.
I have googled many and found some ways, but before I implement it wanted a reviews from experts here.
Note: We already have db_recovery_file_dest set up in ASM...db_flashback_retention_target=1440 and db_recovery_file_dest_size=200GB with arch mode ON.
The steps are
STOP the RAC Database on Both Nodes...
Node1:
$srvctl stop database -d
$Srvctl stop database –d master1
Node2:
$srvctl stop database -d
$Srvctl stop database –d master2
And now start one instance only in mount state:
On node1:
SQL> startup mount
Now enable flashback on Node1...
SQL> alter database flashback on;
SQL> alter database open;
SQL>CREATE RESTORE POINT before_upgrade GUARANTEE FLASHBACK DATABASE;
Now start the second instance…
$srvctl start instance -d -i
$srvctl start instance –d master1 –d master2
Please let me know if there is something needs to be rectified.
Regards,
Ritz

The steps look fine.
Presumably you've already checked to see if the database is in flashback mode and it isn't...hence you putting it into flashbac mode?
Probably just typos but it looks like you have interchanged database names and instance names in your commands....you have the following commands. The srvctl commnds can be run from any node (ie you do not have to run it on node1 to shutdown instance1 and node2 to shutdown instance2).
Node1:    srvctl stop database –d master1
Node2:    srvctl stop database –d master2
You would run either:
Any node:    srvctl stop database -d master (assuming you database name is master...this will shut down both instances)
OR shutdown each instance individually
Any node:    srvctl stop instance -d master -i master1
Any node:    srvctl stop instance -d master -i master2
Same commnds as above to start using "srvctl start"...the following start commands do not look right to me:
srvctl start instance -d -i
srvctl start instance –d master1 –d master2

Oracle 10g RAC, ASM or GPFS ?

Dear all,
We are implementing RAC 10g R2 on AIX 5.3, two nodes, using ASM.
The question is, using ASM do we still need to configure GPFS ?
(I come from development side, so I need to ask this question..)
Thank you,
xtanto

Dear xtanto,
I have several environments using 10gR2+ASM+GFS and works great and they are very stable. I will recommend it.
Cheers,
Francisco Munoz Alvarez
http://www.oraclenz.com

Solaris 10 and Hitachi LUN mapping with Oracle 10g RAC and ASM?

Hi all,
I am working on an Oracle 10g RAC and ASM installation with Sun E6900 servers attached to a Hitachi SAN for shared storage with Sun Solaris 10 as the server OS. We are using Oracle 10g Release 2 (10.2.0.3) RAC clusterware
for the clustering software and raw devices for shared storage and Veritas VxFs 4.1 filesystem.
My question is this:
How do I map the raw devices and LUNs on the Hitachi SAN to Solaris 10 OS and Oracle 10g RAC ASM?
I am aware that with an Oracle 10g RAC and ASM instance, one needs to configure the ASM instance initialization parameter file to set the asm_diskstring setting to recognize the LUNs that are presented to the host.
I know that Sun Solaris 10 uses /dev/rdsk/CwTxDySz naming convention at the OS level for disks. However, how would I map this to Oracle 10g ASM settings?
I cannot find this critical piece of information ANYWHERE!!!!
Thanks for your help!

You don't seem to state categorically that you are using Solaris Cluster, so I'll assume it since this is mainly a forum about Solaris Cluster (and IMHO, Solaris Cluster with Clusterware is better than Clusterware on its own).
Clusterware has to see the same device names from all cluster nodes. This is why Solaris Cluster (SC) is a positive benefit over Clusterware because SC provides an automatically managed, consistent name space. Clusterware on its own forces you to manage either the symbolic links (or worse mknods) to create a consistent namespace!
So, given the SC consistent namespace you simple add the raw devices into the ASM configuration, i.e. /dev/did/rdsk/dXsY. If you are using Solaris Volume Manager, you would use /dev/md/<setname>/rdsk/dXXX and if you were using CVM/VxVM you would use /dev/vx/rdsk/<dg_name>/<dev_name>.
Of course, if you genuinely are using Clusterware on its own, then you have somewhat of a management issue! ... time to think about installing SC?
Tim
---

Oracle 10g RAC using ASM - Storage Issue

I’ve an issue related to Oracle 10g RAC.
I’ve 2 node cluster each being Dell 2850 Server with RHEL 4.0
I’ve EMC CX300 SAN storage with following partitions
/orasoft     10 Gb          OCFS2 File system
/oracrs          2 Gb          OCFS2 File system
/orabackup      100 Gb          OCFS2 File system
The datafiles are on ASM which is not directly visible in OS.
I’ve common Oracle Home installed in /orasoft/db_1 which is shared by both nodes in cluster.
I’ve faced an issue recently related to EMC storage.
The /orasoft partition displays 1.4 Gb space available using df command.
With both nodes sharing the common Oracle Home (/orasoft/db_1), when ever I try to touch a file I get an error as No Space left on device. I’m unable to start any service with the same reason.
Is this setup correct ??
Can anyone help me with this storage issue ??

Need a clarification here...what do you mean by "Storage System"...do you mean a server/node or the SAN storage system. If you are referring to a server/node's local storage, then it would NOT be possible for use by RAC, since the disk space has to be shared among the nodes.
Here is what you can do:
- Create two partitions/devices (for example Disk_1 and Disk_2) in the SAN storage
- Create a ASM disk group which would mirror Disk_1 to Disk_2.
Again, please note that the partitions have to be visible and be accessible read/write from both the nodes/servers.
HTH
Thanks
Chandra Pabba

Shared Storage allocation for Oracle 10g RAC

Hi,
I am about to implement a Two Node Oracle 10g RAC on Windows 2008 (32-Bit) servers. We are going to use EVA4400 storeage and we have 600 GB for Oracle RAC and database.
I intend to follow the steps given in RACGuides_Rac10gR2OnWindows.pdf mentioned in Note 811271.1 (RAC Assurance Support Team: RAC Starter Kit and Best Practices (Windows)).
I would like to know how should I allocated the storage for OCR,Vote, Database and Flash Recovery Area. Meaning how many LUNs and of what size to be created and presented to both the servers. To start with I need to create a 25 GB database. We will be using Raw Device for OCR and Vote and ASM for Database and Flash Recovery Area.
Please advice.
Thanks,
Thiru

I am about to implement a Two Node Oracle 10g RAC on Windows 2008 (32-Bit) servers. Oracle 10g on Windows 2008 is not supported. Anyway installing a cluster as of today i would use a 64-bit operating system together with a 64-bit database. Everything else is not state-of-the-art anymore.
As of today i would go with 11g Release 1 (11.1.0.7.0) plus latest patches for Clusterware and ASM. Because you are using Windows 2008 you must use 11g Release 1 for the database as well. Bear in mind that Windows 2008 R2 is at this point in time not supported for 11g R1 or 11g R2 either.
I would like to know how should I allocated the storage for OCR,Vote, Database and Flash Recovery Area. Meaning how many LUNs and of what size to be created and presented to both the servers. This is said in the installation documents. Rule of thumb: At least three LUNs of 2 GB for OCR and three LUNs of 2 GB for Voting disk.
To start with I need to create a 25 GB database. We will be using Raw Device for OCR and Vote and ASM for Database and Flash Recovery Area.According to Oracles recommendations: Two disk groups: one for database files, the other for the flashback area.
But your setup may be different (more disk groups,....)
Ronny Egner
My blog: http://ronnyegner.wordpress.com

Does managing Oracle 10g RAC with ASM require full root access?

We currently have three entirely separate support areas, Unix, Storage and DBA. We're now considering using Oracle 10g RAC with ASM and as part of the assessment trying to work out if we can still draw similar support boundaries. I know that installing RAC and configuring ASM requires root access but will DBA continue to need root access to manage & support RAC? If so, does anyone know if the commands they need can be RBAC'd or if we just need to share root access going forwards. I've had a look at a number of docs including http://download.oracle.com/docs/cd/B19306_01/rac.102/b14197/toc.htm. which is fairly informative but none of them seem to mention the requirement for root access on Solaris. I'm guessing they just assume that it's available, but that's not generally the case in our environment.
All advice / info welcome!

I would have thought that the only reason you would need root access once RAC and ASM had been set up would be to add more disks to the ASM configuration. This would be needed to change the ownership on the raw LUNs or to make additions to metasets (SVM/Oban) or diskgroups (VxVM/CVM). Beyond that, I can't imagine needing root access.
I'm sure others will chime in if they can think of other reasons!
Regards,
Tim
Edited by: Tim.Read on Jun 3, 2008 2:25 AM

Problem with Oracle 10g RAC VIP network setting at Solaris 9

Dear All,
I have tried to set up a Oracle 10g RAC Release 2.
With OS solaris 9, and 2 nodes.
The nodes setting as the following:
nodes 1:
Public address: 172.16.0.121
Private address: 192.168.0.121, 192.168.1.121 (dual path for heart beat)
nodes 2:
Public address: 172.16.0.122
Private address: 192.168.0.122, 192.168.1.122
And i have assigned two IP adress 172.16.0.131, 172.16.0.132 as the VIP address for the
RAC.
And the following is the /etc/hosts file:
root@shk01 # cat /etc/hosts
# Internet host table
127.0.0.1 localhost
# public address
172.16.0.121 shk01 loghost
172.16.0.122 shk02
# heart beat
192.168.0.121 shk01-priv1
192.168.1.121 shk01-priv2
192.168.0.122 shk02-priv1
192.168.1.122 shk02-priv2
# VIP address
172.16.1.131 vip-shk01
172.16.1.132 vip-shk02
But when i run the command "$ ./runcluvfy.sh comp nodecon -n shk01,shk02 -verbose"
it shows the error:
ERROR:
Could not find a suitable set of interfaces for VIPs.
Result: Node connectivity check failed.
I did try to add the VIP address on bge0:1, as i using bge0 for the public address.
Both nodes i did using the same interface name for it.
Anyone have idea for me to check out the error?
Also, I have other question about the raw device.
As there is option for setting for ASM or raw device. If choosing raw device, does it mean that it just need to
format the storage disk but without newfs it? And then the Oracle program will able to handle it?
Thanks,
Xentar

You don't seem to state categorically that you are using Solaris Cluster, so I'll assume it since this is mainly a forum about Solaris Cluster (and IMHO, Solaris Cluster with Clusterware is better than Clusterware on its own).
Clusterware has to see the same device names from all cluster nodes. This is why Solaris Cluster (SC) is a positive benefit over Clusterware because SC provides an automatically managed, consistent name space. Clusterware on its own forces you to manage either the symbolic links (or worse mknods) to create a consistent namespace!
So, given the SC consistent namespace you simple add the raw devices into the ASM configuration, i.e. /dev/did/rdsk/dXsY. If you are using Solaris Volume Manager, you would use /dev/md/<setname>/rdsk/dXXX and if you were using CVM/VxVM you would use /dev/vx/rdsk/<dg_name>/<dev_name>.
Of course, if you genuinely are using Clusterware on its own, then you have somewhat of a management issue! ... time to think about installing SC?
Tim
---

DO I need SFRAC for Oracle 10g RAC on Sun Solaris

My platform is SUN Solaris 10 64 bit on v490 server. On the backend side, we are using EMC CX500 storage. We will use Veritas File system and Veritas CFS.
I would like to ask, Do I must need SFRAC to configure Oracle 10g RAC or Can I just use only Oracle CRS. I do not want to use ASM.
Please advise
Thanks,
Sam..

The VCFS usually requires a Veritas Cluster, thus you would have to use the product combination that is bundled as SFRAC as mentioned before. Metalink in addition says:
10 10gR2 64-bit Veritas Storage Foundation for Oracle RAC 5.0 Certified
There is one exception to this rule: Linux.
Veritas and Oracle support a standalone version of the Veritas Cluster Files System (and only this component) on Linux. This does not hold true for Solaris.
Concluding, if you want to use the VCFS you would need to get a VCS, which then basically means using SFRAC.
However, in this case, as mentioned before, you would not need ASM.

Oracle 10g rac installation on IBM power server

Dear Gurus,
I am installing Oracle 10g RAC on IBM power server but while running CRS getting the following errors. Please help to resolve this issue.
OUTPUT from Installation log:
INFO: Start output from spawned process:
INFO: INFO:
INFO: /oracle/app/oracle/product/crs/bin/genclntsh
INFO: /usr/bin/ld: cannot find -lxl
INFO: collect2: ld returned 1 exit status
INFO: genclntsh: Failed to link libclntsh.so.10.1
INFO: make:
INFO: *** [client_sharedlib] Error 1
INFO: End output from spawned process.
INFO: INFO: Exception thrown from action: make
Exception Name: MakefileException
Exception String: Error in invoking target 'client_sharedlib' of makefile '/oracle/app/oracle/product/crs/network/lib/ins_net_client.mk'. See '/oracle/app/oracle/oraInventory/logs/installActions2011-12-26_04-40-48PM.log' for details.
Exception Severity: 1
INFO: Exception handling set to prompt user with options to Retry Ignore
SYSTEM:
IBM power server
Linux 5.3
I have already tried changing ORACLE_HOME,CRS_HOME,LD_LIBRARY_PATH but nothing worked.
Regards,
Prajash

Those errors remind me on errors I encountered when I was trying to do installation that was not certified,
so try to check if installation you are doing is actually supported.
In the meantime , visit metalink and read document [ID 460969.1] , */usr/bin/ld: Cannot Find -lxml10, Genclntsh: Failed To Link Libclntsh.so.10.1*

Oracle 10g RAC

Hi All,
I am a research student currently struggling to install Oracle 10g RAC on Windows OS.What i understand about a Oracle RAC database system is that it involves a configuration of multiple hosts or servers joined together with a clustering software and accessing the shared disk structures.What i also understand is that i need a CRS provided by Oracle for a Windows or Linux based RAC installation.
What i don't understand is for a Two node RAC system do i need a Third machine which has the shared storage device.If yes do i have to install a copy of Oracle 10g Enterprise Edition and CRS on the shared storage device moreover do i need to install a copy of Oracle 10g Enterprise edition on each of the nodes or just the clusterware is enough.

Hi Salil
No, you do not need a third machine. You can even setup RAC as a single node on one machine! What you do need is to have some sort of cluster aware file system. Try looking at OCFS on Windows in your case.
If you are interested in a Linux example please have a look at the examples at http://ocpdba.net/oracle9i_rac/cheaprac.html and http://ocpdba.net/oracle10g_rac for an OCFS implementation I am working on.
regards,
Ahbaid

Oracle 10G RAC - Public & Heartbeat on 1 NIC

Hello all,
actually I am installing Oracle 10G RAC on rhel 4 (4 node cluster). But the Cluster Verification Utility aborts with errors. I checked the configToolAllCommands and tried to run the failed commands manually:
#/opt/oracle/crs/bin/oifcfg setif -global eth0.100/172.18.0.0:cluster_interconnect eth0.728/172.16.128.0:public eth0.498/172.17.1.0:cluster_interconnect
PRIF-50: duplicate interface is given in the input
PRIF-50: duplicate interface is given in the input
PRIF-50: duplicate interface is given in the input
Question:
Is it possible to put Public & Heartbeat on one NIC (eth0.728 & eth0.498)
If not is their any workaround for that issue?
Output /etc/hosts
# that require network functionality will fail.
127.0.0.1 localhost.localdomain localhost
172.18.253.48 eu0266.[company].net cfmaster
172.16.128.11 eu0200.[company].net eu0200
172.16.128.12 eu0201.[company].net eu0201
172.16.128.13 eu0202.[company].net eu0202
172.16.128.14 eu0203.[company].net eu0203
172.18.13.11 eu0200m.[company].net eu0200m
172.18.13.12 eu0201m.[company].net eu0201m
172.18.13.13 eu0202m.[company].net eu0202m
172.18.13.14 eu0203m.[company].net eu0203m
# Private section
172.17.1.11 eu0200-priv.[company].net eu0200-priv
172.17.1.12 eu0201-priv.[company].net eu0201-priv
172.17.1.13 eu0202-priv.[company].net eu0202-priv
172.17.1.14 eu0203-priv.[company].net eu0203-priv
# Virtual section
172.16.128.16 eu0200-vip.[company].net eu0200-vip
172.16.128.17 eu0201-vip.l[company].net eu0201-vip
172.16.128.18 eu0202-vip.[company].net eu0202-vip
172.16.128.19 eu0203-vip.[company].net eu0203-vip
Output install log:
Checking existence of VIP node application (required)
Check failed.
Check failed on nodes:
eu0203,eu0202,eu0201,eu0200
Checking existence of ONS node application (optional)
Check ignored.
Checking existence of GSD node application (optional)
Check ignored.
Post-check for cluster services setup was unsuccessful on all the nodes.
Command = /opt/[company]/oracle/crs/bin/cluvfy has failed
INFO: Configuration assistant "Oracle Cluster Verification Utility" failed
*** Starting OUICA ***
Oracle Home set to /opt/[company]/oracle/crs
Configuration directory is set to /opt/[company]/oracle/crs/cfgtoollogs. All xml files under the directory will be processed
INFO: The "/opt/[company]/oracle/crs/cfgtoollogs/configToolFailedCommands" script contains all commands that failed, were skipped or were cancelled. This file may be used to run these configuration assistants outside of OUI. Note that you may have to update this script with passwords (if any) before executing the same.
SEVERE: OUI-25031:Some of the configuration assistants failed. It is strongly recommended that you retry the configuration assistants at this time. Not successfully running any "Recommended" assistants means your system will not be correctly configured.
1. Check the Details panel on the Configuration Assistant Screen to see the errors resulting in the failures.
2. Fix the errors causing these failures.
3. Select the failed assistants and click the 'Retry' button to retry them.
Thanks in advance for your help!
Regards

Tads wrote:
Hi all,
I have a question about Oracle RAC and network interface.
We're using Oracle 10gR2 RAC with two nodes on Linux Red Hat.
Let's assume that the public network interface goes down.
I would like to know what happens with existing connections
on node with network interface with problems.
Are connections frozen, actives?
Can the users continue to use theses existing connections using the another node of RAC?If the interface is down? what do you think? All connections to this node will die. How does your application handle fail-over, does it attempt to reconnect or just have a complete application failure?
You should spend some time in a test lab where you can test this stuff for yourself. Read the documentation and there are tons of sites out there that purport to have all of your RAC/TAF/FAN/FAF questions. - I would read and trust the documentation first.
>
I know that the listener goes down and any other connections is allowed.
Thank you very much!!!!

Oracle 10g RAC on Windows

Installed Oracle 10g RAC on Windows... Everything was
working fine, now when I install CRS it completed at 100% and then in the configuration it gives error
INFO: exitonly tools to be excuted passed: 0
INFO: Starting to execute configuration assistants
INFO: Command = C:\WINDOWS\system32\cmd /c call C:\oracle\product\10.2.0\crs/install/crssetup.config.bat
PROT-1: Failed to initialize ocrconfig
Step 1: checking status of CRS cluster
Step 2: creating directories (C:\oracle\product\10.2.0\crs)
Step 3: configuring OCR repository
ocr upgrade failed with (-1)
Execution of the plugin was aborted
INFO: Configuration assistant "Oracle Clusterware Configuration Assistant" was canceled.
*** Starting OUICA ***
Oracle Home set to C:\oracle\product\10.2.0\crs
Configuration directory is set to C:\oracle\product\10.2.0\crs\cfgtoollogs. All xml files under the directory will be processed
INFO: The "C:\oracle\product\10.2.0\crs\cfgtoollogs/configToolFailedCommands" script contains all commands that failed, were skipped or were cancelled. This file may be used to run these configuration assistants outside of OUI. Note that you may have to update this script with passwords (if any) before executing the same.
I am using VMware WorkStation 5
http://www.oracle-base.com/articles/10g/OracleDB10gR2RACInstallationOnWindows2003UsingVMware.php
I can see my disks from both machines. Open the "Computer Management" dialog (Start > All Programs > Administrative Tools > Computer Management
I use Windows XP SP2 as the host operating system
Any suggestion?
Message was edited by:
MEXMAN

You know its not certified?
My first thought when I read the subject of this thread, and before reading what you posted, is that you've either done no research on RAC or didn't understand what you've read.
You can create a RAC cluster using any operating system certified by Oracle.
But the operating system is the least important part of creating a cluster. The questions you need to be able to address are:
1. What is your solution to created shared storage?
2. What is your solution to create the cache fusion interconnect and VIPs?
If you don't have an answer to these questions you can not build a RAC cluster.

Oracle database not starting up in oracle 10g RAC

Hi!
Recently I came across one problem with one node oracle 10g RAC.When the Oracle database is started,while opening it is giving ORA-03113:End of file on communication channel error.When I saw the the alert trace file and other trace files I found Disk group is exhausted error and it is not able to create .dbf files.Actually it is not a production server and I gave archive log destination in SAN.Even the spfile(content of init_database.ora) is in SAN..
I tried Asmcmd utility to delete the archive log files.As the oracle is not available I am not able to asmcmd prompt.
How to change the destination of archive log and to remove the old archive log files(as it is a testing environment we can remove) from SAN?Please let me know.
Thanks & Regards
Srikanth MVS

keithrust wrote:
On VMware there's a known issue with Oracle databases on a Windows client not starting up properly all the time and a manual startup using oradim -start -sid <whatever> is required to get it fully running. Hmmm, doing it several time, and never seen such issue. Which "known issue" and by who are you talking about ?
I created a brand new Oracle VM Windows 2003 32-bit server, installed the Oracle drivers for paravirtualization, and whammo, the problem is still hereI'm sure, you miss something somewhere in the config. Right now, you're on supported configuration, you could either raise a SR to the support, or get help from your peer on Oracle Database General forum.
Ah, but it's not a Windows issue. On a non-VM Windows box the database starts just fine all the time. Again, this is a known issue acknowledged by Oracle on the VMware side, I'm just surprised it exists on the Oracle VM side.Again, give more details about this "known issue". Never heard about that, eventhough I've been around for years.
I was afraid you were going to ask that. I'll have to search for it again, but I think you can do the same as well....Well, I doubt you could find a Metalink note about Oracle on VMWare. So far, Oracle has always refused to support database on OS virtualized on VMWare (or any VM software other than Oracle VM). Based on that, you could be sure, your "known issue" is not an issue on Oracle VM.
If you want more help, again, give more details about your issue.
Nicolas.

Oracle 10g RAC+ASM - Storage Issue

Similar Messages

Maybe you are looking for