ASM lun configuration

Hi, I'm was what would be the best configuration performance-wise for our ASM-instance with the Oracle database (we're using 11.2.0.3.0). The server is a T5140 and the storage array is a SUN 2540 with 12*600GB 15k rpm SAS disks and we're using external RAID ( through CAM) for the setup. The traffic pattern will most likely be composed of a high number of small inserts and large reads (50% small high freq writes, 50% large reads).
Basically I think we have two alternatives when we build the ASM-diskgroup, and these are:
Alternative 1: 2 Disk LUNs containing 6*600GB disks in RAID1 (2*6). So each LUN contains 6 disks. That means that the ASM will see 2 disks.
Alternative 2: 6 Disk LUNs containing 2* 600GB disks in RAID1 (6*2). So each LUN contains 2 disks. That means that the ASM will see 6 disks.
We'll have both controlfiles,redo and data-files on the same DG.
I'd appreciate any suggestions I can get.
Regards,
Lars

Hi Lars;
I suggest close your issue here as answered than move your issue Forum Home » Grid Computing » Automatic Storage Management which you can get more quick response and which is dedicated
Also check:
How to Configure LUNs for ASM Disks using WWID, DM-Multipathing, and ASMLIB on RHEL 5/OEL 5 [ID 1365511.1]
Oracle Sun Database Machine Setup/Configuration Best Practices [ID 1274318.1]
Regard
Helios

Similar Messages

What is the Best Practice for A1000 LUN Configuration

I have a fully populated 12 X 18GB A1000 array, What is the optimal LUN configuration for a A1000 Array
running RAID5 in a read intensive oracle financials environment.
1. 1 (10 X 18GB + 2 X 18GB HS ) (Use format to split at OS level) - Current Setting
2. 1 (10 X 18GB + 2 X 18GB HS ) (Use RM6 to split into 3 LUNS)
3. 3 (3 X 18GB + 3 X 18GB HS )
I would like to know if option 2 or 3 will buy me anything more than 3 queues?
Thanks
F.A

Well, natural combination of dimensions connected to the fact would be a natural primary key and it would be composite.
Having an artificial PK might simplify things a bit.
Having no PK leads to a major mess. Fact should represent a business transaction, or some general event. If you're loading data you want to be able to identify the records that are processed. Also without PK if you forget to make an unique key the access to this fact table will be slow. Plus, having no PK will mean that if you want to used different tools, like Data Modeller in Jbuilder or OWB insert / update functionality it won't function, since there's no PK. Defining a PK for every table is a good practice. Not defining PK is asking for a load of problems, from performance to functionality and data quality.
Edited by: Cortanamo on 16.12.2010 07:12

FAS2040 volume and LUN configuration

So, we've inherited down some badly configured NetApp FAS2040's and I'm in the process of upgrading them to Data ONTAP 8.0.5 from 7.3.4 (7-mode). We're contractors so these things change hands quite a bit and just getting access to NetApp support was something of a task. Anyways, I've been working on this issue since no one feels comfrtable at it and I've run into some snags. I want to maximize space since we have 4 of these 2040's (12 600g 15k SAS drives), a 2020, and a FAS2040 with the DS4xx something shelf unit. Working with one aggregate is fine as we don't think we'll need the added protection from having a root aggregate and aggregate for data volumes. What is best way to setup these volumes and LUN's? I've looked at it from both angles of having 1 volume and 2-3 LUNs, or by having multiple volumes with one LUN each. I think the single volume works good enough and we could take advantage of deduplication more efficiently. However, I'm confused on something. If I make 2x 1.75 TB or 2x 1.5 TB LUNs does that give me enough space for snapshots? I don't want to make snapshots, but I'm confused on how these things operate as I was under the impression that I should have Fractional Reserve @ 100% and snapshots at 0, but I was getting out of space alerts (everything is thick provisioned). I then proceeded to changing the FR to 0 (unchecking it in OnCommand) and the alert went away in vCenter plugin. I say I don't want snapshots because I thought that taking advantage of SnapVault would be a great idea since we are running an old 4.1 vmware infrastructure, can't use VDP, and have no ways of buying a backup/dr software. I figured allocating a 2040 to backups with SnapVault or using the netapp plugin in vcenter to do scheduled backups would be decent enough for now. So... I'm incredibly confused on how to design the volumes in respect to not running out of space with this fractional reserver and snapshots. Am I making my luns to large for my volumes? Is there some mathmatical formula I should use?

Hi, 1) The recommentations regarding the root volume, refer link Page #159 2)One LUN per volume is recommented for ease of management 2)fractional reserve is LUN over write reserve, these links may help you Considerations
Video Thanks

ASM best configuration disks on EMC storage in RAC

After reading ASM best practices, suggesting to use a disk group for all datafiles and a disk group for FRA I was wondering how to optimize I/O on storage.
I mean.. what about if I add also a disk group for the redologs of the two RAC instances?
Moreover... what are the best practices to use the several disks offered by the storage compared with the possibility to use different LUN on the same big disk of of the storage?
Example...
My storage has 2 disks of about 2TB each one:
1) I could partition one disk into two LUN and use this two LUN for the DG_DATA and DG_FRA asm disk groups. Every LUN should be partitioned in small units.
2) I could use two disks and use one disk for DG_DATA asm disk group and the other for DG_FRA asm disk group.
3) I could use two disk partitioned in two LUN (and so I have 4 LUN). Add to the DG_DATA disk group the LUN partitions physically based on two different disks, and the others two LUN for the DG_FRA disk group.
Hope you can solve my doubts,
thanks Marco

Here's a brief comment ....
There is not one answer that fits all. This is because it all depends on your SAN env and the storage architecture. Some configs are good for a system but disastrous for another.
Also, we must make a clear distinction between the terms LUNs vs. disks. Because DBA interact with storage at the host level, we use them synonymously which is understandable. However, for SAN and storage, they should not be and they are not.
These are some of the guidelines I learned ...
1) use small spindles with highest RPM for your disk arrays. Rarely we have control over that, but DBAs should at least understand and obtain these specs from SAN admins.
2) Understand your system's potential bottlenecks and load balance around them. For example, I've seen systems bottleneck at the HBA, DA, spindle, or even host level. This where you need to take caution when you layout DB storage. You do not want 2 IO intensive apps accessing same LUNs on same controller whereas the 2nd one remains semi-idle. Most systems should auto balance them, but at least these apps primary or preferred access path should be separated.
3) Use expected DB size to decide on your LUN size. You can not layout a TB database using 12GB LUNS nor can you use a 500GB LUN to layout a 50GB DB.
4) For most storage systems now, data separation occurs as a result of data protection, management convenience and to a lesser extent for performance reasons or IO type (random vs. sequential). Again, the accuracy of this statement varies from one system to another, but at least this is the trend.
5) always always, measure you IO metrics. There are simple, yet effective measures you or (SAN admin) can do to measure IP performance. Use metrics like service times and latency measures. Also, most application have typical IO profiles like PIO/sec, sequential vs. random reads.
6) On some systems, I have seen DBAs request LUNs carved from RAID10 arrays for redo logs and RAID5 for the remainder of the database, You can certainly exercise this option.
Hope this helps
Thank you

ASM and CONFIGURE RETENTION POLICY TO REDUNDANCY 1

I have a 11gR2 database in Linux. ALL the database files (including ARCHIVELOGs) are in ASM. I'm configuing and using RMAN in order to backup the DB & ArchiveLogs.
I have "CONFIGURE RETENTION POLICY TO REDUNDANCY 1" configured.
Please help me understand its meaning and function within ASM.
I thought that based on that configuation that my OBSOLETE ARCHIVELOG files within ASM would be automatically be deleted?
So once I completed my second set of backups, when I executed, "DELETE NOPROMPT OBSOLETE" & "DELETE NOPROMPT EXPIRED ARCHIVELOG ALL", that the first second of ARCHIVELOG backups would be deleted?
...thanks in advance

ASM has nothing to do with retention or deletion. You can find the definition of redundancy in the docs at http://tahiti.oracle.com

Add luns in asm instance...

Hi,
I need to configure Oracle ASM to include 5 additional new LUN . The oracle database is already up and running on an Oracle DB. The DB is already configured for 6 LUNs, but we need the DB updated to include the 5 new LUNs.
Already Configured disks:
/dev/rhdisk1 - 100 GB
/dev/rhdisk2 - 100 GB
/dev/rhdisk3 - 100 GB
/dev/rhdisk4 - 100 GB
/dev/rhdisk5 - 100 GB
/dev/rhdisk6 - 30 GB
New Disks to Configure:
/dev/rhdisk7
/dev/rhdisk8
/dev/rhdisk9sy
/dev/rhdisk10
/dev/rhdisk11
Please let me know steps how to do it and what all informance i need to do it..

oradba11 wrote:
I need to configure Oracle ASM to include 5 additional new LUN . Not necessary. ASM either sees these LUNs. Or not. There is no ASM side configuration needed to use/see these additional LUNs or make them visible.
The oracle database is already up and running on an Oracle DB. The DB is already configured for 6 LUNs, but we need the DB updated to include the 5 new LUNs.
Already Configured disks:
/dev/rhdisk1 - 100 GB
..snipped..
New Disks to Configure:
/dev/rhdisk7
..snipped..Which means the ASM disk discovery string should be "+/dev/rdisk*+". And implies that ASM will automatically see these LUNs when made available by the o/s.
No additional steps needed on the ASM side.
On the o/s side, the new devices need to have the proper permissions in order for ASM to see and use these devices. So permissions need to be set in order for ASM to see these new devices. Assuming that is done, ASM will see these new LUNs.. just as it sees the existing LUNs. (ASM does not know the difference until it checks the header of each LUN to determine whether it is a member disk, or a candidate disk).

Wheather ASM Disk need to be configured before Oracle 11gR2 Grid software

Hi All,
I have a confusion regarding ASM Disk configuration. Whether this need to be done before the grid software installation or shall we do it after grid software installation.
Kindly Advice over the same

vk82 wrote:
Hi All,
I have a confusion regarding ASM Disk configuration. Whether this need to be done before the grid software installation or shall we do it after grid software installation.
Kindly Advice over the same
ASM is going to be a storage option. The storage that would be used by the ASM instance must be available already. The installation of the GI would be on the file system of the node.
HTH
Aman....

Orion on windows with ASM configuration

Hello,
can someone tell how to run orion on Windows where we have ASM file configuration.
oracle version: 11gR2
windows 2008
I see in the documentation how to run orion from Linux, tried the same logic but didn't work.
could someone give an example?
Thanks a lot...

Hi Murali,
I am trying to configure ASM with ASMLib I/O.
As you told for modifying ASM_DISKSTRING,first asm instance should be installed right?
the steps i followed so far are,
i installed oracle 10g (software only)
installed asm packages
configured and created disks VOL1
disk ownership is changed to oracle user and oinstall group
# /etc/init.d/oracleasm createdisk VOL1 /dev/sdb1
etc
Now again i started universal installer for installing asm instance wher i am facing issues..Is the steps i folled is curruct..or can you you advice me some useful notes on this..

ASMCA needs Oracle Grid Infrastructure to configure ASM

Hi,
I am trying to install ASM 11gR2 on RHEL5. I am using VMWare Workstation for this.
I have already installed Oracle database software and Grid Infrastructure on this machine.While installing Grid Infrastructure, I chose install Grid Infrastructure software only.
Once this was successfull I am trying to create ASM instance using asmca.
Regarding the disks, I am using raw devices. I created a virtual disk which I have partitioned but haven't formatted it. Done this to create raw device
[root@localhost sysconfig]# /bin/raw /dev/raw/raw1 /dev/sdb
/dev/raw/raw1: bound to major 8, minor 16
and have added
ACTION=="add",KERNEL=="sdb",RUN+="/bin/raw /dev/raw/raw1 %N"
to /etc/udev/rules.d/60-raw.rules
Then I tried creating the disk but it failed. So I did the following steps to fix it
[root@dhcppc2 Softwares]# /etc/init.d/oracleasm createdisk VOL1 /dev/sdb
Marking disk "VOL1" as an ASM disk: [FAILED]
[oracle@oracle11gR2 grid]$ tail -f /var/log/oracleasm
Device "/dev/sdb" is not a partition
To fix this
[root@localhost ~]# /usr/sbin/asmtool -C -l /dev/oracleasm -n VOL1 -s /dev/sdb -a force=yes
asmtool: Device "/dev/sdb" is not a partition
asmtool: Continuing anyway
Now I am able to view the asmdisk through listdisks option.
Have set following environment variables before running asmca
[oracle@oracle11gR2 ~]$ export ORACLE_HOME=/u01/app/oracle/product/11.2.0/Grid
[oracle@oracle11gR2 ~]$ export PATH=/u01/app/oracle/product/11.2.0/Grid/bin:/usr/sbin:/usr/kerberos/bin:/usr/local/bin:/usr/bin:/bin:/usr/X11R6/bin:/home/oracle/bin
When I am running ASMCA I am facing this error - Oralce Grid Infrastrcture is not configured properly. ASMCA needs Oracle Grid Infrastructure to configure ASM
Any thoughts?

Hi Aman,
Thanks for the reply.
Is it possible to configure 11gR2 ASM on single instance databases ? I have done the config with 10g but I am struggling with the Grid Infrastructure. For eg: when I do deinstall of Grid Infrstructure
+[oracle@oracle11gR2 deinstall]$ ./deinstall -home /u01/app/oracle/product/11.2.0/Grid+
ORACLE_HOME = /u01/app/oracle/product/11.2.0/Grid
Location of logs /u01/Softwares/oracle11gR2/deinstall/logs/
+############ ORACLE DEINSTALL & DECONFIG TOOL START ############+
+######################## CHECK OPERATION START ########################+
Install check configuration START
Checking for existence of the Oracle home location /u01/app/oracle/product/11.2.0/Grid
Oracle Home type selected for de-install is: SIHA
Oracle Base selected for de-install is: /u01/app/oracle
Checking for existence of central inventory location /u01/app/oraInventory
Checking for existence of the Oracle Grid Infrastructure home
Install check configuration END
Traces log file: /u01/Softwares/oracle11gR2/deinstall/logs//crsdc.log
Network Configuration check config START
Network de-configuration trace file location: /u01/Softwares/oracle11gR2/deinstall/logs/netdc_check42401.log
Network Configuration check config END
Asm Check Configuration START
ASM de-configuration trace file location: /u01/Softwares/oracle11gR2/deinstall/logs/asmcadc_check42402.log
+ASM configuration was not detected in this Oracle home. Was ASM configured in this Oracle home (y|n) [n]:+
ASM was not detected in the Oracle Home
+######################### CHECK OPERATION END #########################+
+####################### CHECK OPERATION SUMMARY #######################+
Oracle Grid Infrastructure Home is:
The cluster node(s) on which the Oracle home exists are: (Please input nodes seperated by ",", eg: node1,node2,...)null
Oracle Home selected for de-install is: /u01/app/oracle/product/11.2.0/Grid
Inventory Location where the Oracle home registered is: /u01/app/oraInventory
ASM was not detected in the Oracle Home
+Do you want to continue (y - yes, n - no)? [n]: y+
A log of this session will be written to: '/u01/Softwares/oracle11gR2/deinstall/logs/deinstall_deconfig2010-08-07_01-31-49-PM.out'
Any error messages from this session will be written to: '/u01/Softwares/oracle11gR2/deinstall/logs/deinstall_deconfig2010-08-07_01-31-49-PM.err'
+######################## CLEAN OPERATION START ########################+
ASM de-configuration trace file location: /u01/Softwares/oracle11gR2/deinstall/logs/asmcadc_clean42403.log
ASM Clean Configuration END
Network Configuration clean config START
Network de-configuration trace file location: /u01/Softwares/oracle11gR2/deinstall/logs/netdc_clean42404.log
De-configuring backup files...
Backup files de-configured successfully.
The network configuration has been cleaned up successfully.
Network Configuration clean config END
---------------------------------------->
Press Enter after you finish running the above commands
+<----------------------------------------+
I don't see any commands to run but the deinstall blindly says that
"Press Enter after you finish running the above commands"
and while looking at the net I found out it might be something similar to this
/u01/Softwares/oracle11gR2/deinstall/perl/bin/perl -I/u01/Softwares/oracle11gR2/deinstall/perl/lib -I/u01/Softwares/oracle11gR2/deinstall/crs/install /u01/Softwares/oracle11gR2/deinstall/crs/install/rootcrs.pl -force -delete -paramfile /u01/Softwares/oracle11gR2/deinstall/response/deinstall_Ora11g_gridinfrahome1.rsp
Should I run the previous command as root.
Am I doing things in the right way or am I missing something here?

Looking for information on the below questions on ASM

Scenario: (Oracle 10g on Windows 2003 with EMC storage)
ASM Partition table crashed for LUN 20 on 18th July
DB was up and running till 23rd July (New LUN (LUN 36) was presented and the RMAN backup used to restore the data that were residing on the corrupt LUN)
End of the day everything screwed up and the complete grid (4 nodes) was rebuild.
Links:
As mentioned in the link: http://www.exforsys.com/forum/oracle-database/487-what-asm-instance-oracle.html
"The ASM instance is only involved during the creation or deletion of files and when disk configurations change (such as dropping or adding a disk). When these types
of changes occur, the ASM instance automatically rebalanced the disks and provides the necessary information to refresh the extent map in the SGA of the database
instance. Of course, this process requires that the ASM instance run concurrently with the database instance, and only shut down after the database instance is
closed."
As mentioned in the link: http://www.orafaq.com/wiki/ASM_FAQ#ASM_disk_header.2Fsuperblock_backups.3F
"ASM disk headers (super-blocks) cannot be backed up and restored in Oracle 10g. By implication, if you use EXTERNAL REDUNDANCY and a single disk's header is
accidentally overwritten, the entire disk group will have to be restored."
As mentioned in the link: http://www.datadisk.co.uk/html_docs/oracle/asm.htm
"ASM is a special instance that does not have any data files, there is only ASM instance one per server which manages all ASM files for each database. The instance
looks after the disk groups and allows access to the ASM files. Databases access the files directly but uses the ASM instance to locate them. If the ASM instance is
shutdown then the database will either be automatically shutdown or crash. "
With the above scenario and the documents provided in the links above, I am unable to get the complete picture of what went wrong. Will be great if some one could
through more light on the below questions. (Note: we have multiple vendor engaged managing different part of this outage and unable to get the real fact of what went
wrong)
1, The ASM had given the details of the disk to the DB, and the DB is managing the disk directly. Also the DB and the ASM instance were up and running till 23rd is
what i understand going by the details given in the above links, in this scenario how can we confirm that the partition table is corrupt / missing. Is their a way to
check the same?
2, ASM disk headers (super-blocks) cannot be backed up, that means that it can not be read directly. Then is it possible to say that the ASM disk header is corrupt /
missing?
3, If the ASM disk header / partition table of LUN 20 is corrupt on 18th, can the DB run till 23rd without any issue? will the ASM & DB does not crash?
4, ASM will strip the data across the available LUN's, will it not be able to rebuild the data on the newly presented LUN 36 instead of using RMAN backup to rebuild the
data? or is the ASM not configured as it should be done. (WE have multiple LUN's presented to this Grid)
Edited by: 880333 on Aug 19, 2011 12:35 AM

What relation with the Oracle Forms product ?
Francois

Need for multiple ASM disk groups on a SAN with RAID5??

Hello all,
I've successfully installed clusterware, and ASM on a 5 node system. I'm trying to use asmca (11Gr2 on RHEL5)....to configure the disk groups.
I have a SAN, which actually was previously used for a 10G ASM RAC setup...so, reusing the candidate volumes that ASM has found.
I had noticed on the previous incarnation....that several disk groups had been created, for example:
ASMCMD> ls
DATADG/
INDEXDG/
LOGDG1/
LOGDG2/
LOGDG3/
LOGDG4/
RECOVERYDG/
Now....this is all on a SAN....which basically has two pools of drives set up each in a RAID5 configuration. Pool 1 contains ASM volumes named ASM1 - ASM32. Each of these logical volumes is about 65 GB.
Pool #2...has ASM33 - ASM48 volumes....each of which is about 16GB in size.
I used ASM33 from pool#2...by itself to contain my cluster voting disk and OCR.
My question is....with this type setup...would doing so many disk groups as listed above really do any good for performance? I was thinking with all of this on a SAN, which logical volumes on top of a couple sets of RAID5 disks...the divisions on the disk group level with external redundancy would do anything?
I was thinking of starting with about half of the ASM1-ASM31 'disks'...to create one large DATADG disk group, which would house all of the database instances data, indexes....etc. I'd keep the remaining large candidate disks as needed for later growth.
I was going to start with the pool of the smaller disks (except the 1 already dedicated to cluster needs) to basically serve as a decently sized RECOVERYDG...to house logs, flashback area...etc. It appears this pool is separate from pool #1...so, possibly some speed benefits there.
But really...is there any need to separate the diskgroups, based on a SAN with two pools of RAID5 logical volumes?
If so, can someone give me some ideas why...links on this info...etc.
Thank you in advance,
cayenne

The best practice is to use 2 disk groups, one for data and the other for the flash/fast recovery area. There really is no need to have a disk group for each type of file, in fact the more disks in a disk group (to a point I've seen) the better for performance and space management. However, there are times when multiple disk groups are appropriate (not saying this is one of them only FYI), such as backup/recovery and life cycle management. Typically you will still get benefit from double stripping, i.e. having a SAN with RAID groups presenting multiple LUNs to ASM, and then having ASM use those LUNs in disk groups. I saw this in my own testing. Start off with a minimum of 4 LUNs per disk group, and add in pairs as this will provide optimal performance (at least it did in my testing). You should also have a set of standard LUN sizes to present to ASM so things are consistent across your enterprise, the sizing is typically done based on your database size. For example:
300GB LUN: database > 10TB
150GB LUN: database 1TB to 10 TB
50GB LUN: database < 1TB
As databases grow beyond the threshold the larger LUNs are swapped in and the previous ones are swapped out. With thin provisioning it is a little different since you only need to resize the ASM LUNs. I'd also recommend having at least 2 of each standard sized LUNs ready to go in case you need space in an emergency. Even with capacity management you never know when something just consumes space too quickly.
ASM is all about space savings, performance, and management :-).
Hope this helps.

OCR and ASM dependancy in 11.2

Grid Version: 11.2.0.2
Platform : Solaris 10
Question1.
Since ASM's configuration information is stored in OCR , if OCR is lost (for eg: due to a corrupt LUN in OCR's Disk group) , will ASM instance crash ?
Question2.
If ASM instance crashes (for eg: someone accidently killed an ASM mandatory process) , will OCR be accessible as OCR is stored in an ASM disk group ?
Question3.
What are the precautions I can take to protect OCR from failures ?

Tom wrote:
Hi Levi, Kuljeet
Because of OLR (Oracle local registry) , I was under the impression that ASM won't crash even if OCR is lost.
http://www.linkedin.com/groups/How-restore-OCR-in-11gR2-3156190.S.93908910
Hi Tom,
When Clusterware starts three files are involved.
OLR - Is the first to be read and opened. This file is local and this file contains information where is stored voting disk, and information to startup the ASM. (e.g ASM DiscoveryString)
VOTING DISK - This is the second file to be opened and read, to read the voting file only depend on the OLR be accessible. ASM start after CSSD or ASM does not start if CSSD is offline (i.e voting file missing)
OCR - Finally the ASM Instance starts and mount all Diskgroups, then Clusterware Deamon (CRSD) open and read the OCR which is stored on Diskgroup.
So, if ASM already started, ASM does not depend on OCR or OLR to be online. ASM depend on CSSD (Votedisk) to be online.
There is a exclusive mode to start ASM without CSSD (but it's to restore OCR or VOTE purposes)
Regards,
Levi Pereira

ASM and Multipathing

Hi
I have a 2node RAC Setup 10gR2.
I have three ASM Volumes configured, out of devices sdb2, sdb3, sdb4
/etc/init.d/oracleasm createdisk VOL1 /dev/sdb2
/etc/init.d/oracleasm createdisk VOL2 /dev/sdb3
/etc/init.d/oracleasm createdisk VOL3 /dev/sdb4.
where VOL1 & VOL2 belong to the Disk Group ORCL_DATA1 and Vol3 to the group FLASH_RECOVERY_AREA.
I want to use the multipath disks namely /dev/multipath/sdb2, /dev/multipath/sdb3 and /dev/multipath/sdb4 for asm volumes.
I created the multipath disks on node1 and edited the file /etc/sysconfig/oracleasm and set ORACLEASM_SCANORDER="multipath" and
ORACLEASM_SCANEXCLUDE="sdb2 sdb3 sdb4".
After a Reboot, the crs_stat shows
On Node1
Name Type Target State Host
ora....SM1.asm application ONLINE ONLINE linux1
ora....X1.lsnr application ONLINE ONLINE linux1
ora.linux1.gsd application ONLINE ONLINE linux1
ora.linux1.ons application ONLINE ONLINE linux1
ora.linux1.vip application ONLINE ONLINE linux1
ora....SM2.asm application ONLINE ONLINE linux2
ora....X2.lsnr application ONLINE ONLINE linux2
ora.linux2.gsd application ONLINE ONLINE linux2
ora.linux2.ons application ONLINE ONLINE linux2
ora.linux2.vip application ONLINE ONLINE linux2
ora.orcl.db application ONLINE ONLINE linux1
ora....l1.inst application ONLINE OFFLINE
ora....l2.inst application ONLINE ONLINE linux2
ora....test.cs application ONLINE ONLINE linux2
ora....cl1.srv application ONLINE OFFLINE
ora....cl2.srv application ONLINE ONLINE linux2
[oracle@linux1 ~]$ sqlplus "/ as sysdba"
SQL*Plus: Release 10.2.0.1.0 - Production on Tue Dec 8 12:04:53 2009
Copyright (c) 1982, 2005, Oracle. All rights reserved.
Connected to an idle instance.
SQL> select name, path from v$asm_disk;
select name, path from v$asm_disk
ERROR at line 1:
ORA-01034: ORACLE not available
I try to start the instance manually,
[oracle@linux1 ~]$ srvctl start instance -d orcl -i orcl1
PRKP-1001 : Error starting instance orcl1 on node linux1
CRS-0215: Could not start resource 'ora.orcl.orcl1.inst'.
Also from sql
SQL> startup
ORA-01078: failure in processing system parameters
ORA-01565: error in identifying file '+ORCL_DATA1/orcl/spfileorcl.ora'
ORA-17503: ksfdopn:2 Failed to open file +ORCL_DATA1/orcl/spfileorcl.ora
ORA-15077: could not locate ASM instance serving a required diskgroup
On Node2
[oracle@linux2 ~]$ sqlplus "/ as sysdba"
SQL*Plus: Release 10.2.0.1.0 - Production on Tue Dec 8 11:56:13 2009
Copyright (c) 1982, 2005, Oracle. All rights reserved.
Connected to:
Oracle Database 10g Enterprise Edition Release 10.2.0.1.0 - Production
With the Partitioning, Real Application Clusters, OLAP and Data Mining options
SQL> select name, path from v$asm_disk;
NAME
PATH
VOL1
ORCL:VOL1
VOL2
ORCL:VOL2
VOL3
ORCL:VOL3
Plz note, that I have the multipath devices only on one node currently.
I am new to the multipathing concept. Plz advise, on what (above) steps are wrong and what additional things are to be taken care of.
And the causes/solutions to the errors.
Edited by: whatis on Dec 7, 2009 11:47 PM

We use multipath extensively on our Linux clusters - but do not use ASM itself to blacklist and whitelist devices. And we use the actual multipath (logical) device as the device for ASM to use - not the physical device and not the multipath +/dev/dm+ devices.
The black and white listing of LUNs are done using multipath. The multipath config is duplicated on each node - and each node should see the exact same devices.
You can ensure consistency in device names across the cluster by using the ww identifier of the LUN. In +/etc/multipath.conf+, you can define a mpath device for a LUN as follows, e.g.
multipaths {
    multipath {
        wwid    36006048000028775044553594d303439
        alias   mpath0
    ..etc..
}For example, multipath will lists the following mpath devices:
root@dev3: /root> multipath -l
mpath9 (xxxxIBLUN5_5e3d014a9cb2f25eb1a38704) dm-3 xxxxIB,LUN5
[size=1000G][features=0][hwhandler=0][rw]
\_ round-robin 0 [prio=0][active]
\_ 10:0:0:4 sdad 65:208 [active][undef]
\_ 12:0:0:4 sdbx 68:176 [active][undef]
\_ 13:0:0:4 sdby 68:192 [active][undef]
\_ 11:0:0:4 sdz 65:144 [active][undef]
mpath8 (xxxxIBLUN1_5e3d014a9cb2f25e78ba1532) dm-13 xxxxIB,LUN1
[size=1000G][features=0][hwhandler=0][rw]
\_ round-robin 0 [prio=0][active]
\_ 12:0:0:0 sdbp 68:48 [active][undef]
\_ 13:0:0:0 sdbq 68:64 [active][undef]
\_ 10:0:0:0 sdk 8:160 [active][undef]
\_ 11:0:0:0 sdl 8:176 [active][undef]
..snipped.We then assign the mpath device to ASM, e.g. +/dev/mpath/mpath8+ and +/dev/mpath/mpath9+ are then used for creating (external redundancy) ASM disk groups.
So we basically stick to the o/s toolset provided for dealing with multipath devices and then use ASM on top of the logical multipath device. Our primary reason is that this is the same config and commands used by some of the largest clusters in the world - and if it works for these, then we will rather follow suite than use ASM features to do the same (such as black and white listing).

Please verify my RAC install with ASM procedure with a question.

Good morning.
My installation procedure on RAC with ASM (ASM will be on separate home from DB):
1. Install clusterware 10.2.0.1
2. Apply database patchset 6810189 upgrade clusterware to 10.2.0.4
3. Apply CRS patch bundle #4 8436582 to clusterware
4. Install oracle DB home 10.2.0.1
5. Apply database patchset 6810189 upgrade to 10.2.0.4
6. Apply DB PSU (patch# 8576156) 10.2.0.4.1 (includes CPUJUL2009) to the oracle home
(steps 7-9 are similar as step 4-5, except for ASM home. Or should I install ASM home before installing DB home? )
7. Install oracle DB home 10.2.0.1 for ASM and configure ASM
8. Apply database patchset 6810189 upgrade to 10.2.0.4 for ASM
9. Apply DB PSU (patch# 8576156) 10.2.0.4.1 (includes CPUJUL2009) to the oracle home for ASM
10. Run DBCA to create database.
Can I apply DB PSU (patch# 8576156) 10.2.0.4.1 (INCLUDES CPUJUL2009) to DB while the clusterware is 10.2.0.4, as I know DB version should not be higher than clusterware version? Or can I upgrade clusterware to 10.2.0.4.1?
Thanks for advice,

Hi,
Applying PSU (10.2.0.4.1) does not mean that you are moving to higher version of Oracle. Oracle releases will be like 10.2.0.4 , 10.2.0.5 like that.
10.2.0.4.1 is the PSU version for Jul 2009 PSU.
10.2.0.4.2 is the PSU version for Oct 2009 PST.
Like CPUs PSUs are also quarterly. It is not necessary oracle should release the PSU/CPU for every oracle home/CRS home every quarter.
For now, the PSU (Patch no: 8576156) is only applicable as shown below.
PSU 10.2.0.4.1 includes the following previously released bundle patches:
- Generic Recommended Bundle #4 (Patch 8362683)
- RAC Recommended Bundle #3 (Patch 8344348)
- Data Guard Broker Recommended Bundle #1 (Patch 7936793)
- Data Guard Physical/Recovery Recommended Bundle #1 (Patch 7936993)
- Data Guard Logical Recommended Bundle #1 (Patch 7937113)
Refer to the installation types of this patch (download README of this patch bundle).
Table 1 Installation Types and Security Content
Server homes - PSU 10.2.0.4.1
Client-Only Installations - None
Instant Client Installations - None
(The Instant Client installation is not the same as the client-only Installation.
For additional information about Instant Client installations, see Oracle Database Concepts.)
ASM (Automatic Storage - PSU 10.2.0.4.1
Management) homes
CRS (Cluster Ready Services) - None
homes
So, there is no PSU patch for this quarter for CRS Home. You may check the previous CPU/PSUs to make your home secured/updated with all patches.
Regards,
Vasu
Edited by: vasu77 on Sep 22, 2009 3:01 PM

10g w/ASM on RHEL4 with LDAP/AD db user

Hi folks,
I'm a bit green at all this Oracle stuff (though I'm pretty experienced with Linux) and I'm currently trying to install Oracle 10g on a 64-bit RHEL 4 AS box, using ASM. This box is currently also running 9i happily. I am running into a couple of problems which may or may not be related:
Firstly, I've installed the asmlib stuff and it will all run fine (pick up and configure disks on my SAN over fibrechannel etc.) apart from the service/interface configuration - for various reasons I need to have my oracle DB user authenticate against LDAP (active directory in this instance) like all my other users do (and this works fine in 9i) - I don't expect this is a problem for the DB install itself (though I've not gotten that far - I don't have a 10g DB installed yet.) but the config script for ASM will not accept any of my LDAP users as valid, and hence won't set the appropriate permissions on the /dev/oracleasm stuff etc (and doing so manually doesn't seem to solve problem 2) - is there a way around this? Is it a restriction just of the config script or can the service just not cope with non-local users?
The second problem is that even with ASM disks configured, when I go to do an install with runInstaller, and select the configuration of ASM, it can't find any disks to add regardless of what path I give it to look in. I assume this is related to the problems with ASM above, but perhaps there's something else going on?
Hope y'all can help.
Thanks,
-Nathan

There are no users for ASM per se. You don't connect as Fred/fred since no-one ever logs into it directly. It's only a storage subsystem.
the only time you would connect is if you needed to go in as the SYSDBA or SYSOPER role to start it up, shut it down or do maintenance.
When it is up and running and doesn't see your disks there is a good troubleshooting note
457369.1 which might help. usually diskstring needs to be set.

ASM lun configuration

Similar Messages

Maybe you are looking for