Adding Disks on ASM in RAC

Hello folks ?
I need to add a new disc in a RAC with ASM instance, there is a specific procedure?
Can i connect in any ASM instance with SQL-PLUS and execute the command ALTER DISKGROUP DADOS ADD DISK '/devices/disk*3', '/devices/disk*4';
Spaulonci

ASM instances in a RAC environment don't act independently, a diskgroup serving a RAC database is maintained by all participating ASM instances. So you don't add a disk to a particular instance. There's no need to shutdown ASM to add a disk, that's one of the ASM advantages.
Werner

Similar Messages

Adding Disks on ASM/RAC

Hi
I need to add new disks in my instances ASM1 and ASM2.
How do I do that?
Can I down the ASM2 node, add the disks on ASM1 and then, start the ASM2
If I do this, the ASM2, will see the new disks ?
Spaulonci

ASM instances in a RAC environment don't act independently, a diskgroup serving a RAC database is maintained by all participating ASM instances. So you don't add a disk to a particular instance. There's no need to shutdown ASM to add a disk, that's one of the ASM advantages.
Werner

Add disk in ASM

Hi,
on 11g R2 , UNIX, RAC
our ASM is in RAC, 4 instances.
I want to add a disk. My questions are :
-should I issu :
alter diskgroup data add disk 'D:\asmdisk\disk3';
on each instance ? Then four times ?
-should I restart :
startup mount
each instance (then four times) ?
Thank you.

before adding disk in asm,the status of disk(HEADER_STATUS) should be candidate.
means CANDIDATE - Disk is not part of a disk group and may be added to a disk group with the ALTER DISKGROUP statement.
and once its added then you can check the freespace in diskgroup as it should be increased by adding the disk and header_status changed to MEMBER;
Please close the thread if you feel you have the answer and keep the Oracle forum clean.
https://forums.oracle.com/forums/ann.jspa?annID=885

Backup and Restore OCR,Voting Disk and ASM Disks in new SAN-10g RAC

Dear Friends,
I am using 10g R2 RAC serup on Linux
My OCR,Voting Disk and ASM Disk for DBF Files are on a SAN box
Now i am reorganising SAN by scrapping the entire SAN and cretaing new LUN's (It's a must)
so pleae let me know
1) how do i take backup of OCR and Voting Disk from existing SAN and how do i restore it in new LUN's after SAN reorganisation
2) how do i take backup of existing Database's from existing SAN and how do i restore it in new LUN's after SAN reorganisation.
I will be doing it in Planned downtime only
Regards,
DB

For step 1 you should following metalink doc.
For step 2 here is simple backup command script.
I have done this in windows for you.
D:\app\ranjit\product\11.2.0\dbhome_1\BIN>rman target /
Recovery Manager: Release 11.2.0.1.0 - Production on Wed Feb 8 21:48:47 2012
Copyright (c) 1982, 2009, Oracle and/or its affiliates. All rights reserved.
connected to target database: ORCL (DBID=1299593730)
RMAN> run
+{+
allocate channel c1 device type disk format 'D:\app\ranjit\rman\%U';
allocate channel c2 device type disk format 'D:\app\ranjit\rman\%U';
backup database;
backup current controlfile format 'D:\app\ranjit\rman\%U';
+}+
Regards

Manual of adding the new node on RAC with ASM

Hello everbody
Someone have the manual of the adding a new node on RAC with ASM for Solaris ?
regards
Spaulonci

Go to http://www.oracle.com/technology/documentation/index.html, select your unknown database version and search for a manual named 'Oracle Clusterware and Oracle Real Application Clusters Administration and Deployment Guide'.
Werner

OCR and voting disks on ASM, problems in case of fail-over instances

Hi everybody
in case at your site you :
- have an 11.2 fail-over cluster using Grid Infrastructure (CRS, OCR, voting disks),
where you have yourself created additional CRS resources to handle single-node db instances,
their listener, their disks and so on (which are started only on one node at a time,
can fail from that node and restart to another);
- have put OCR and voting disks into an ASM diskgroup (as strongly suggested by Oracle);
then you might have problems (as we had) because you might:
- reach max number of diskgroups handled by an ASM instance (63 only, above which you get ORA-15068);
- experiment delays (especially in case of multipath), find fake CRS resources, etc.
whenever you dismount disks from one node and mount to another;
So (if both conditions are true) you might be interested in this story,
then please keep reading on for the boring details.
One step backward (I'll try to keep it simple).
Oracle Grid Infrastructure is mainly used by RAC db instances,
which means that any db you create usually has one instance started on each node,
and all instances access read / write the same disks from each node.
So, ASM instance on each node will mount diskgroups in Shared Mode,
because the same diskgroups are mounted also by other ASM instances on the other nodes.
ASM instances have a spfile parameter CLUSTER_DATABASE=true (and this parameter implies
that every diskgroup is mounted in Shared Mode, among other things).
In this context, it is quite obvious that Oracle strongly recommends to put OCR and voting disks
inside ASM: this (usually called CRS_DATA) will become diskgroup number 1
and ASM instances will mount it before CRS starts.
Then, additional diskgroup will be added by users, for DATA, REDO, FRA etc of each RAC db,
and will be mounted later when a RAC db instance starts on the specific node.
In case of fail-over cluster, where instances are not RAC type and there is
only one instance running (on one of the nodes) at any time for each db, it is different.
All diskgroups of db instances don't need to be mounted in Shared Mode,
because they are used by one instance only at a time
(on the contrary, they should be mounted in Exclusive Mode).
Yet, if you follow Oracle advice and put OCR and voting inside ASM, then:
- at installation OUI will start ASM instance on each node with CLUSTER_DATABASE=true;
- the first diskgroup, which contains OCR and votings, will be mounted Shared Mode;
- all other diskgroups, used by each db instance, will be mounted Shared Mode, too,
even if you'll take care that they'll be mounted by one ASM instance at a time.
At our site, for our three-nodes cluster, this fact has two consequences.
One conseguence is that we hit ORA-15068 limit (max 63 diskgroups) earlier than expected:
- none ot the instances on this cluster are Production (only Test, Dev, etc);
- we planned to have usually 10 instances on each node, each of them with 3 diskgroups (DATA, REDO, FRA),
so 30 diskgroups each node, for a total of 90 diskgroups (30 instances) on the cluster;
- in case one node failed, surviving two should get resources of the failing node,
in the worst case: one node with 60 diskgroups (20 instances), the other one with 30 diskgroups (10 instances)
- in case two nodes failed, the only node survived should not be able to mount additional diskgroups
(because of limit of max 63 diskgroup mounted by an ASM instance), so all other would remain unmounted
and their db instances stopped (they are not Production instances);
But it didn't worked, since ASM has parameter CLUSTER_DATABASE=true, so you cannot mount 90 diskgroups,
you can mount 62 globally (once a diskgroup is mounted on one node, it is given a number between 2 and 63,
and other diskgroups mounted on other nodes cannot reuse that number).
So as a matter of fact we can mount only 21 diskgroups (about 7 instances) on each node.
The second conseguence is that, every time our CRS handmade scripts dismount diskgroups
from one node and mount it to another, there are delays in the range of seconds (especially with multipath).
Also we found inside CRS log that, whenever we mounted diskgroups (on one node only), then
behind the scenes were created on the fly additional fake resources
of type ora*.dg, maybe to accomodate the fact that on other nodes those diskgroups were left unmounted
(once again, instances are single-node here, and not RAC type).
That's all.
Did anyone go into similar problems?
We opened a SR to Oracle asking about what options do we have here, and we are disappointed by their answer.
Regards
Oscar

Hi Klaas-Jan
- best practises require that also online redolog files are in a separate diskgroup, in case of ASM logical corruption (we are a little bit paranoid): in case DATA dg gets corrupted, you can restore Full backup plus Archived RedoLog plus Online Redolog (otherwise you will stop at the latest Archived).
So we have 3 diskgroups for each db instance: DATA, REDO, FRA.
- in case of fail-over cluster (active-passive), Oracle provide some templates of CRS scripts (in $CRS_HOME/crs/crs/public) that you edit and change at your will, also you might create additionale scripts in case of additional resources you might need (Oracle Agents, backups agent, file systems, monitoring tools, etc)
About our problem, the only solution is to move OCR and voting disks from ASM and change pfile af all ASM instance (parameter CLUSTER_DATABASE from true to false ).
Oracle aswers were a litlle bit odd:
- first they told us to use Grid Standalone (without CRS, OCR, voting at all), but we told them that we needed a Fail-over solution
- then they told us to use RAC Single Node, which actually has some better features, in csae of planned fail-over it might be able to migreate
client sessions without causing a reconnect (for SELECTs only, not in case of a running transaction), but we already have a few fail-over cluster, we cannot change them all
So we plan to move OCR and voting disks into block devices (we think that the other solution, which needs a Shared File System, will take longer).
Thanks Marko for pointing us to OCFS2 pros / cons.
We asked Oracle a confirmation that it supported, they said yes but it is discouraged (and also, doesn't work with OUI nor ASMCA).
Anyway that's the simplest approach, this is a non-Prod cluster, we'll start here and if everthing is fine, after a while we'll do it also on Prod ones.
- Note 605828.1, paragraph 5, Configuring non-raw multipath devices for Oracle Clusterware 11g (11.1.0, 11.2.0) on RHEL5/OL5
- Note 428681.1: OCR / Vote disk Maintenance Operations: (ADD/REMOVE/REPLACE/MOVE)
-"Grid Infrastructure Install on Linux", paragraph 3.1.6, Table 3-2
Oscar

New added disk in vm virtual box not shown in solaris

hi,
I have added new disk in VM virtual box to use it for asm, using storage tree in Vm virtual box i have added two new disks but after that when i start my OS (solaris 10) and use format command it only shows my one disk not the added disk which i add in storage. Any idea why the new added disks are not shown .
Thanks
Zeeshan

Navigate to the repository tab in OVMM and right-click on the storage repo, where you created/copied the vm disk image file. From the pop-up menu choose refresh repository.
That should scan you repository and make the new disk visible on OVMM.

Disk Layout for a RAC deployment on a shoe string

Hi, not sure if this is better placed under RAC or Linux group.
I am planning a demo RAC system using 2 linux servers and due to stingy managers, the smallest budget ever imagined !
I will have the 2 servers networked but am looking at a cheapo disk setup ( excluding virtualisation and SAN/NAS ). I currently have
Server A and Server B
Each has an Internal disk of 250 Gb – I am going to place the linux OS on here, the 11gR2 Oracle Grid Infrastructure Home and the 11gR2 Enterprise Edition Oracle Home
Q1. Since the local server is where the Oracle Instance runs – would I be correct in assuming this is where the SPFILE for the instance goes as well i.e. Server A and B will both hold an SPFILE in the 11gR2 ORACLE_HOME ?
Q2. What else should be stored on the local server – all the usual logs etc ( eg the instance alert log etc ) ? Is it normal to put a copy of the database control file on each local server ?
My plan was to carve up the 250 Gb disk into a root partition ( for Linux ) and a /u01 partition for the Oracle Grid Infrastructure Home and the Database Oracle Home
I was then going to use the remainder of the 250 Gb Disk in Server A as the shared disk ( for RAC ) between the Servers. I am going to attempt to NFS mount the remainder of the 250 Gb disk on Server A ( disgusted I have no budget for NAS ! ), so Server B will have access to it.
What I was not sure about is –
Q3. in regards to ASM Disk Groups, I wasn’t sure if ASM can discover disk space for use, once it has been mounted as a standard file system ( or in my case as an NFS mount ) ?
Q4. How does ASM interact with standard file system mounts ( if at all ) ?
Q5. If a physical disk has some standard filesystems mounted on it, can ASM use / discover any remaining part of a disk that has not been configured as a filesystem ?
Q6. I am assuming the FRA is better placed on the Shared Disk ( so both nodes have access to it ) ?
Any guidance would be appreciated,
Jim

This won't be a RAC, Jim.
What are you going to use as Interconnect? Do these machines have a 2nd physical NIC? You realise that crossover Ethernet cables are not supported. Is this Gigabit Ethernet? RAC Interconnect over a 10 or even 100 Mb/s Ethernet, is significantly below par.
Where are the OCR and Voting Disks going to reside?
ASM is in my view, mandatory. It makes no sense not using ASM for RAC. ASM needs raw devices to use. It does not run on cooked file systems. NFS shares the latter.
If NFS is used, over what IP layer is it going to run? The same as the Interconnect? Which would be an irony as the the RAC db cache is now using the same transport layer as it does for physical I/O - both are over slow Ethernet vying for the same bandwidth.
RAC is only as sound and as robust as the h/w it is build on. Stuff up with the hardware and you WILL have an inferior and unstable RAC. Accompanied with utter frustration as it will not work the way it should.
IMO - the ONLY way one can build a 2 server RAC without a SAN or NAS, is with Firewire. Using a shared Firewire 800 disk that supports 2 separate servers at the same time. And then use this Firewire disk as shared storage. This is not supported by Oracle for production use - but past support notes did say that this is a config that can be considered for a dev type RAC.
If the 2 servers do not support Firewire 800, then 2 x Firewire 800 PCI cards (and cables) are needed, in addition to the Firewire drive.

ASM wihout RAC

Oracle 10g - Solaris 64 bit SPARC.
What, if any are the advantages of utilizing ASM without RAC in a SAN environemnt?

ASM, RAC and Streams are three seperate components of Oracle Grid Computing that can be integraded at software level using ASM and clusterware softwares.
After Implementing ASM you will see that the data can be striped and balanced on multiple disks. There are no physical file system when you implement ASM the files are all logical and striped on multiple disks of the Disk groups. RMAN utility can only be used to take a back. You cannot take an image copy of your database as there are no physical files.
RAC is usually for high availability, load balancing, scalability of applications i.e. handle more workload, application partitioning using Services. etc.
For more details go though the following links.
http://www.oracle.com/technology/products/database/asm/index.html
AND
http://www.oracle.com/technology/products/database/clusterware/index.html

Single-Instance ASM to RAC ASM !!

At the moment i am in process to create a RAC ASM instance on two nodes. When i was creating ASM instance it gave me error that unable to connect to crsd on Node2.
So i manually added asm instance using srvctl on node2. It is registered with CRS but it is not online. I tried starting up by using crs_start or srvctl start asm but asm resource is down on both the nodes.
I have started up manually both the ASM instance and created some Diskgroups, Now i have to create a RAC enabled DB for which it is showing convert single-instance ASM to RAC ASM.
What needs to be done.

Hi
because the service ASM was added individually the crs stack is unable to recognise the clustering of ASM. In fact this has just made the ASM on two nodes function as two seperate ASM instances. They were never clustered. So i think convertion is one option. I came here while looking for one such doc. My 10.2.0.1 RAC install on windows 2003 went on a toss.. while dbca was trying to set up the clustered ASM and configure the instance, the primary node crashed and when it was recovered, i could notice the ASM instance is created on one node only.. When i try to invoke dbca again, neither am allowed to create an ASM instance for RAC/convert the existing one to RAC. Until now what I have found is that if such case arise, the quicker way is to revert everything back, clean up the server of clusterware and re install every thing... but before am looking for my options..
does any body have an idea? please share
sarat.

Dropping disk in asm

Hi! I have recently dropped a disk in asm
DISK_NUMBER HEADER_STATU STATE TOTAL_MB/1024 NAME FAILGROUP LABEL PATH
3 MEMBER DROPPING 16,7998047 PITSM0_DG_NODATOS_0003 FG_JC2 /dev/rdisk/disk613
But the operation generates an error. My asm instance and database are generating logfiles and I dont know how to stop the operation or fix it.
SQL> select * from v$asm_operation;
GROUP_NUMBER OPERA STAT POWER ACTUAL SOFAR EST_WORK EST_RATE EST_MINUTES ERROR_CODE
2 REBAL ERRS 1 ORA-15041
The asm traces don't show nothing concrete
$ cat +ASM1_ora_17509.trm
@2|2|czasf4QM1"17509|+ASM1|
M/czasf4QM1~O1O2
@2|2|44csf4QM1"17509|+ASM1|
6/Dybsf4QM1~09Z
3?t7~01
SQL> select NAME, FREE_MB, TOTAL_MB from v$asm_disk where NAME like 'PITSM0_DG_NODATOS_0003' ;
NAME FREE_MB TOTAL_MB
PITSM0_DG_NODATOS_0003 4714 17203
SQL> select NAME, GROUP_NUMBER, STATE, TOTAL_MB, FREE_MB, (FREE_MB /TOTAL_MB)*100 AS PORCENTAJEFREE from v$asm_diskgroup ;
NAME GROUP_NUMBER STATE TOTAL_MB FREE_MB PORCENTAJEFREE
PITSM0_DG_RECO 3 MOUNTED 185640 153200 82,5253178
PITSM0_DG_CLUSTER 1 MOUNTED 86015 84989 98,8071848
PITSM0_DG_DATOS 4 MOUNTED 3619980 2802044 77,404958
PITSM0_DG_NODATOS 2 MOUNTED 51609 26629 51,5975896
SQL> select NAME, FREE_MB, TOTAL_MB from v$asm_disk where NAME like 'PITSM0_DG_NODATOS_%';
NAME FREE_MB TOTAL_MB
PITSM0_DG_NODATOS_0000 10959 17203
PITSM0_DG_NODATOS_0006 10956 17203
PITSM0_DG_NODATOS_0003 4714 17203

Hi! thanks for answering
Oracle Database 11g Enterprise Edition Release 11.2.0.1.0 - 64bit
I dont see nothing in alerts since yesterday
RDBMS:
Additional information: 1
Writing to the above trSun Jan 15 22:08:38 2012
SUCCESS: disk PITSM0_DG_NODATOS_0001 (1.4042269599) dropped from diskgroup PITSM0_DG_NODATOS
SUCCESS: disk PITSM0_DG_NODATOS_0002 (2.4042269597) dropped from diskgroup PITSM0_DG_NODATOS
SUCCESS: disk PITSM0_DG_NODATOS_0004 (4.4042269595) dropped from diskgroup PITSM0_DG_NODATOS
SUCCESS: disk PITSM0_DG_NODATOS_0005 (5.4042269596) dropped from diskgroup PITSM0_DG_NODATOS
SUCCESS: disk PITSM0_DG_NODATOS_0007 (7.4042269598) dropped from diskgroup PITSM0_DG_NODATOS
SUCCESS: disk PITSM0_DG_NODATOS_0008 (8.4042269600) dropped from diskgroup PITSM0_DG_NODATOS
SUCCESS: disk PITSM0_DG_NODATOS_0009 (9.4042269594) dropped from diskgroup PITSM0_DG_NODATOS
Mon Jan 16 01:00:00 2012
Clearing Resource Manager plan via parameter
ASM:
Tue Jan 10 22:04:25 2012
Non critical error ORA-00001 caught while writing to trace file "/aplicaciones/oracle/trc_asm01/diag/asm/+asm/+ASM1/trace/+ASM1_ora_2795.trc"
Error message: HPUX-ia64 Error: 28: No space left on device
Additional information: 1
Writing to the above trace file is disabled for now on...
Tue Jan 10 22:08:25 2012
Non critical error DIA-00001 caught while writing to trace file "/aplicaciones/oracle/
My FS was full due to traces
ASM trace files have no sense except this one, with more information:
cat +ASM1_ora_28435.trc
Trace file /aplicaciones/oracle/trc_asm01/diag/asm/+asm/+ASM1/trace/+ASM1_ora_28435.trc
Oracle Database 11g Enterprise Edition Release 11.2.0.1.0 - 64bit Production
With the Real Application Clusters and Automatic Storage Management options
ORACLE_HOME = /productos/oracle/asm1120/11.2.0
System name: HP-UX
Node name: tghch01a
Release: B.11.31
Version: U
Machine: ia64
Instance name: +ASM1
Redo thread mounted by this instance: 0 <none>
Oracle process number: 0
Unix process pid: 28435, image: oracle@tghch01a
*** 2012-01-16 14:23:23.998
Ioctl ASYNC_CONFIG error, errno = 1
Ioctl ASYNC_CONFIG error, errno = 1

Converting single ASM to RAC ASM

How i can convert single ASM to RAC ASM?

ASM1 is the name of single and clustered names as ASM1 +ASM2, now what is suggestion? I can shutdown single instance ASM. If ASM Is up , it should not delet , right???

Dropping a Disk from ASM disk group

Hi Team,
I was dropping 10 disks from ASM , due to storage migration.
9 Disks I was dropped successfully, but 1 disk (/dev/oracleasm/disks/ST_OCR_VOTE02 ) was not able to recognize , it is part of which group..!!
That is not part of any group but still showing as member..!!! Please help . Not sure this is part of which group.
SQL> select GROUP_NUMBER,DISK_NUMBER,NAME,path,header_status,FAILGROUP from v$asm_disk where path='/dev/oracleasm/disks/ST_OCR_VOTE02';
GROUP_NUMBER DISK_NUMBER NAME                           PATH                                               HEADER_STATU FAILGROUP
           0           0                                /dev/oracleasm/disks/ST_OCR_VOTE02                 MEMBER
SQL>
           0          17                                NORMAL   FORMER       /dev/oracleasm/disks/STASM3_02                              0          0
           0           9                                NORMAL   FORMER       /dev/oracleasm/disks/STASM1_01                              0          0
           0          10                                NORMAL   FORMER       /dev/oracleasm/disks/STASM5_01                              0          0
           0          11                                NORMAL   FORMER       /dev/oracleasm/disks/STASM4_01                              0          0
           0          12                                NORMAL   FORMER       /dev/oracleasm/disks/STASM3_01                              0          0
           0          13                                NORMAL   FORMER       /dev/oracleasm/disks/STASM2_01                              0          0
           0          14                                NORMAL   FORMER       /dev/oracleasm/disks/STASM1_02                              0          0
           0          15                                NORMAL   FORMER       /dev/oracleasm/disks/STASM2_02                              0          0
           0          16                                NORMAL   FORMER       /dev/oracleasm/disks/STASM4_02                              0          0
           0           0                                NORMAL   MEMBER       /dev/oracleasm/disks/ST_OCR_VOTE02                          0          0
Thanks Manohar

Hi ,
As group_number of that disk is 0 ,it is not part of any mounted diskgroup in your system .
So,you cannot drop that disk .
May be sometime back due to some issue that disk was evicted ,but was not dropped properly ,so disk header still holds old diskgroup information.
kfed read <device_name>|egrep "kfbh.type|kfdhdb.hdrsts|kfdhdb.grpname"
above command will tell you the cause of MEMBER
To reuse that disk,
-- Validate same disk having similar status on all nodes of this cluster
-- if So,then to overwrite that disk header ,use FORCE option to create/add it into any existing diskgroup.
Regards,
Aritra

Advantage of having OCR and Voting disk on ASM

What are advantages of putting OCR and Voting disk on ASM from 11g

well, other than the sharing thing, you dont have to go RAIDing an additional shared disk either. If you have properly configured ASM, redundancy should be built in as well, either soft or hard.
not sure what other advantages you may need. Theres the IO thing with ASM, buit thats not really an advantage persay with ocr and vote. I may be contradicted by others but Ive never seen performance hit of any kind attributed to ocr and vote on non-ASM disk.

Adding disk to existing disk group in ASM on the windows 2003 server.

Guys,
Can someone please share some opinions of adding an extra disk to an existing disk group ( DG_FRA ) in ASM on a windows 2003 server ( like any issues when bringing db backup ). This is a production database and I want to be careful , so that I don't have any issues with the database. Existing DG_FRA is 550GB ( size of the image copy is 325GB ),recently we have been running heavy loads and this is filling up the archive logs and forcing us to take incremental backups couple of times before deleting the archive logs. As a result of this we decided to add an extra 200GB so that we don't have to do this backups frequently during the day. Storage is on EMC SAN and the database is in 11G.
Thanks for all your help.

There will not be any issues..
stamp the disk and then add the disk.
You can also follow this approach -
stamp the disk.
create a new group and then add a datafile in this new group for the existing tablespace.

Adding Disks on ASM in RAC

Similar Messages

Maybe you are looking for