Shutting down ASM instance in 11.2 RAC

DB version : 11.2.0.2
Platform : Solaris 10 / AIX 6.1
2-node RAC
Since OCR and Voting Disks are stored in ASM Diskgroups (11.2) , is it OK to shutdown ASM instance in any or both of the nodes ? ie.
Will CRS in a node go down if you shutdown ASM instance in that Node ?

greeny wrote:
DB version : 11.2.0.2
Platform : Solaris 10 / AIX 6.1
2-node RAC
Since OCR and Voting Disks are stored in ASM Diskgroups (11.2) , is it OK to shutdown ASM instance in any or both of the nodes ? ie.
Will CRS in a node go down if you shutdown ASM instance in that Node ?Yes. You will have to first stop the Oracle Clusterware stack on the node on which you need to stop the Oracle ASM instance.
Either use "crsctl stop cluster -n node_name" or "crsctl stop crs" for this purpose.
Since you are using OCR and VOTING DISK on ASM, it's not possible stop only ASM and keep cluster running.
Regards,
Levi Pereira

Similar Messages

Proble shutting down ASM instance on Windows 2003 server.

Hi,
Before booting the windows 2003 server, I am trying to shutdown the ASM instance and it is just siiting there without any response. This is a 10g database and a 2003 server.
C:\Documents and Settings\Administrator>set oracle_sid=+ASM
C:\Documents and Settings\Administrator>sqlplus " / as sysdba"
Copyright (c) 1982, 2006, Oracle. All Rights Reserved.
Connected to:
Oracle Database 10g Enterprise Edition Release 10.2.0.3.0 - 64bit Production
With the Partitioning, OLAP and Data Mining options
SQL> shutdown immediate;
Thanks.

Thanks for your response. Yes I did stopped the database. I was having the same problem with the database ( as it was sitting there after I issued the shutdown immediate ). Finally I had to do shutdown abort, start up in restrict mode and do a shutdown again to stop the database gracefully

Is it possible to take a full backup without shutting down an instance?(10g

Hi. everyone.
Is it possible to take a full backup without shutting down an instance?
The db version is 10gr2.
As far as I know, in order to take a full backup of a database,
one need to shutdown a database.
Our db environment is a RAC environment which has two nodes.
Yesterday, I heard from a hardware vendor that we do not need to shutdown
instances(2-nodes) in order to take a full backup.
Best Regards.

Hi,
>>As far as I know, in order to take a full backup of a database, one need to shutdown a database.
In fact, a database operating in NOARCHIVELOG mode is necessary to shutdown the database in order to perform a full backup (Cold Backup), but otherwise a database that is operating in ARCHIVELOG mode, then is possible to perform a full database backup with the database in a open state. (Hot Backup)
For more information see if these links below can help you:
Oracle Backup and Recovery
http://www.oracle.com/technology/deploy/availability/htdocs/BR_Overview.htm
Oracle Backup and Recovery FAQ
http://orafaq.com/faqdbabr.htm
Cheers

Add logfile group without shutting down first? (10g R2)

Can I add a logfile group without first shutting down the instance? I don't see any clear statement about this in my Alapati 10g Admin book or any Oracle 10g R2 docs. Citations appreciated. Maybe this is one of those "too obvious to publish" things. My guess is that Oracle 10g R2 is smart enough to know not to write to new logfile group members until it is fully created and available for use.
Thanks.

Hello,
Is the presumption that any "ALTER DATABASE" operation can be done online in 10g? Not Any, but Some, Yes.
For instance, the ALTER DATABASE ARCHIVELOG statement cannot be done online ( the Database should be mount ).
However about the ALTER DATABASE ADD LOGFILE statement, as previously posted, it can be done online. I've already done it on a running Production Database.
Just be careful to set the same SIZE as for the other Logfile Members.
Hope this help.
Best regards,
Jean-Valentin

Shut down before full startup

I've read several posts with similar problems but with no avail.
My Dual G5 starts up with chimes, loads apple screen, but then shuts down. It works perfectly fine in Safe Boot, and Target Mode. The happened about a year ago and I replaced some memory and performed a clean installation. I don't know if the memory was bad or if the clean installation was the cure since I just added more memory and didn't replace any. Am I missing some thing? Why does it work flawlessly in both Safe Boot and Target Mode, but won't startup normally?
Any answers? This happened right after I did an update with manditory restart.
JB

I discovered an icon for the instance of the program that was running. I now realize that shutting down by clicking on the usual x doesn't really shut down the instance. By clicking on that icon the instance returned and I was able to sign out.

ASM Instance Creation

Hi,
I need to just create a new ASM instance on solaris without RAC,can anyone share docs of what are the pre-reuquiite and the details of creation of ASM Instance.
Regards,
Hussain

The ASM OS prereqs are the same as the DB prereqs - e.g kernel parameters, OS packages.
Really difficult to give advice if you won't say what version of the OS, what version of the database, what storage etc.
Some basic docs here :-
http://blogs.sun.com/pomah/entry/configuration_example_of_oracle_asm
http://www.oracle.com/technology/products/database/asm/pdf/asm-on-emc-5_3.pdf

ASM instance shutdown abort automatic on 10gr2 RAC

Hi all, I have a oracle 10gR2 RAC on solaris9 with three nodes.the node2 and node3 work right,but the ASM instance on node1 often shutdown abort automatic and no any erros in alertlog file.
why ?
Fri Nov 3 10:17:39 2006
Shutting down instance (abort)
License high water mark = 6
Instance terminated by USER, pid = 15327

Does anyone know ?

In 2 node RAC. After shutting down database not able to connect.

I have 2 node Oracle 10g RAC (RAC-1 and RAC-2) on Windows 2003 Server.
After shutting down instance on RAC-2
I am not able to connect to database from any node.
I did this on RAC-2 :
SQL>shutdown immediate;
Database went down smoothly.
SQL>conn sys/oracle@rac as sysdba
ERROR:
ORA-12514: TNS:listener does not currnetly know of services requested in connect descriptor.
My first node is running fine but I am not able to connect to database from first node or from client.
Any suggestion???
Regards:
Sushil

One question I want to ask, what should be the Listener Services startup mode in RAC? MANUAL or AUTOMATIC???Ideally, if you are instances and other oracle resources are set to autostart then there is no reason for you to set the listener to MANUAL. You may like to change it to AUTOMATIC so that on reboot it comes up without manual intervention.

Root.sh fails - asm won't shut down

I am trying to instal clusterware 11gR2 on Oracle Enterprise Linux 5. This is all running an Oracle Virtualbox environment, using ASM for the cluster disk in an openfiler. 32 bit installation, 1GB memory allocated to each node environment. I had to ignore errors for the following:
< 1.5 GB memory
small swap file
ncsd and ntpd processes not running (not connected to internet), I understand Oracle will install it's own timer service if this is not present
Running root.sh fails because asm won't shut down properly:
[root@odbn1 grid]# ./root.sh
Running Oracle 11g root.sh script...
The following environment variables are set as:
ORACLE_OWNER= oracle
ORACLE_HOME= /u01/app/grid
Enter the full pathname of the local bin directory: [usr/local/bin]:
Copying dbhome to /usr/local/bin ...
Copying oraenv to /usr/local/bin ...
Copying coraenv to /usr/local/bin ...
Creating /etc/oratab file...
Entries will be added to the /etc/oratab file as needed by
Database Configuration Assistant when a database is created
Finished running generic part of root.sh script.
Now product-specific root actions will be performed.
2010-08-24 14:46:44: Parsing the host name
2010-08-24 14:46:44: Checking for super user privileges
2010-08-24 14:46:44: User has super user privileges
Using configuration parameter file: /u01/app/grid/crs/install/crsconfig_params
Creating trace directory
LOCAL ADD MODE
Creating OCR keys for user 'root', privgrp 'root'..
Operation successful.
root wallet
root wallet cert
root cert export
peer wallet
profile reader wallet
pa wallet
peer wallet keys
pa wallet keys
peer cert request
pa cert request
peer cert
pa cert
peer root cert TP
profile reader root cert TP
pa root cert TP
peer pa cert TP
pa peer cert TP
profile reader pa cert TP
profile reader peer cert TP
peer user cert
pa user cert
Adding daemon to inittab
CRS-4123: Oracle High Availability Services has been started.
ohasd is starting
CRS-2672: Attempting to start 'ora.gipcd' on 'odbn1'
CRS-2672: Attempting to start 'ora.mdnsd' on 'odbn1'
CRS-2676: Start of 'ora.mdnsd' on 'odbn1' succeeded
CRS-2676: Start of 'ora.gipcd' on 'odbn1' succeeded
CRS-2672: Attempting to start 'ora.gpnpd' on 'odbn1'
CRS-2676: Start of 'ora.gpnpd' on 'odbn1' succeeded
CRS-2672: Attempting to start 'ora.cssdmonitor' on 'odbn1'
CRS-2676: Start of 'ora.cssdmonitor' on 'odbn1' succeeded
CRS-2672: Attempting to start 'ora.cssd' on 'odbn1'
CRS-2672: Attempting to start 'ora.diskmon' on 'odbn1'
CRS-2676: Start of 'ora.diskmon' on 'odbn1' succeeded
CRS-2676: Start of 'ora.cssd' on 'odbn1' succeeded
CRS-2672: Attempting to start 'ora.ctssd' on 'odbn1'
CRS-2676: Start of 'ora.ctssd' on 'odbn1' succeeded
ASM created and started successfully.
DiskGroup CLSVOL1 created successfully.
clscfg: -install mode specified
Successfully accumulated necessary OCR keys.
Creating OCR keys for user 'root', privgrp 'root'..
Operation successful.
CRS-2672: Attempting to start 'ora.crsd' on 'odbn1'
CRS-2676: Start of 'ora.crsd' on 'odbn1' succeeded
CRS-4256: Updating the profile
Successful addition of voting disk 502348953fc24f1cbf9c9f0fdf5cf2e0.
Successfully replaced voting disk group with +CLSVOL1.
CRS-4256: Updating the profile
CRS-4266: Voting file(s) successfully replaced
## STATE File Universal Id File Name Disk group
1. ONLINE 502348953fc24f1cbf9c9f0fdf5cf2e0 (/dev/oracleasm/disks/CRS) [CLSVOL1]
Located 1 voting disk(s).
CRS-2673: Attempting to stop 'ora.crsd' on 'odbn1'
CRS-2677: Stop of 'ora.crsd' on 'odbn1' succeeded
CRS-2673: Attempting to stop 'ora.asm' on 'odbn1'
ORA-15097: cannot SHUTDOWN ASM instance with connected client
CRS-2675: Stop of 'ora.asm' on 'odbn1' failed
CRS-4000: Command Stop failed, or completed with errors.
Command return code of 1 (256) from command: /u01/app/grid/bin/crsctl stop resource ora.asm -init
Stop of resource "ora.asm -init" failed
Failed to stop ASM
CRS-2673: Attempting to stop 'ora.ctssd' on 'odbn1'
CRS-2677: Stop of 'ora.ctssd' on 'odbn1' succeeded
CRS-2673: Attempting to stop 'ora.cssdmonitor' on 'odbn1'
CRS-2677: Stop of 'ora.cssdmonitor' on 'odbn1' succeeded
CRS-2529: Unable to act on 'ora.cssd' because that would require stopping or relocating 'ora.asm', but the force option was not specified
CRS-4000: Command Stop failed, or completed with errors.
Command return code of 1 (256) from command: /u01/app/grid/bin/crsctl stop resource ora.cssd -init
Failed to exit exclusive mode
Initial cluster configuration failed. See /u01/app/grid/cfgtoollogs/crsconfig/rootcrs_odbn1.log for details
[root@odbn1 grid]#
The rootcrs_odbn1.log shows the same error:
[root@odbn1 crsconfig]# tail -50 rootcrs_odbn1.log
2010-08-24 15:10:38: /bin/su successfully executed
2010-08-24 15:10:38: /u01/app/grid/gpnp/odbn1/wallets/prdr/cwallet.sso => /u01/app/grid/gpnp/wallets/prdr/cwallet.sso
2010-08-24 15:10:38: rmtcpy: /u01/app/grid/bin/cluutil -sourcefile /u01/app/grid/gpnp/odbn1/wallets/prdr/cwallet.sso -destfile /u01/app/grid/gpnp/wallets/prdr/cwallet.sso -nodelist odbn1,odbn2
2010-08-24 15:10:38: Running as user oracle: /u01/app/grid/bin/cluutil -sourcefile /u01/app/grid/gpnp/odbn1/wallets/prdr/cwallet.sso -destfile /u01/app/grid/gpnp/wallets/prdr/cwallet.sso -nodelist odbn1,odbn2
2010-08-24 15:10:38: s_run_as_user2: Running /bin/su oracle -c ' /u01/app/grid/bin/cluutil -sourcefile /u01/app/grid/gpnp/odbn1/wallets/prdr/cwallet.sso -destfile /u01/app/grid/gpnp/wallets/prdr/cwallet.sso -nodelist odbn1,odbn2 '
2010-08-24 15:11:20: Removing file /tmp/file1ye3x8
2010-08-24 15:11:21: Successfully removed file: /tmp/file1ye3x8
2010-08-24 15:11:21: /bin/su successfully executed
2010-08-24 15:11:21: /u01/app/grid/gpnp/odbn1/wallets/pa/cwallet.sso => /u01/app/grid/gpnp/wallets/pa/cwallet.sso
2010-08-24 15:11:21: rmtcpy: /u01/app/grid/bin/cluutil -sourcefile /u01/app/grid/gpnp/odbn1/wallets/pa/cwallet.sso -destfile /u01/app/grid/gpnp/wallets/pa/cwallet.sso -nodelist odbn1,odbn2
2010-08-24 15:11:21: Running as user oracle: /u01/app/grid/bin/cluutil -sourcefile /u01/app/grid/gpnp/odbn1/wallets/pa/cwallet.sso -destfile /u01/app/grid/gpnp/wallets/pa/cwallet.sso -nodelist odbn1,odbn2
2010-08-24 15:11:21: s_run_as_user2: Running /bin/su oracle -c ' /u01/app/grid/bin/cluutil -sourcefile /u01/app/grid/gpnp/odbn1/wallets/pa/cwallet.sso -destfile /u01/app/grid/gpnp/wallets/pa/cwallet.sso -nodelist odbn1,odbn2 '
2010-08-24 15:11:49: Removing file /tmp/filelEb5Lp
2010-08-24 15:11:49: Successfully removed file: /tmp/filelEb5Lp
2010-08-24 15:11:50: /bin/su successfully executed
2010-08-24 15:11:50: /u01/app/grid/gpnp/odbn1/wallets/root/b64certificate.txt => /u01/app/grid/gpnp/wallets/root/b64certificate.txt
2010-08-24 15:11:50: rmtcpy: /u01/app/grid/bin/cluutil -sourcefile /u01/app/grid/gpnp/odbn1/wallets/root/b64certificate.txt -destfile /u01/app/grid/gpnp/wallets/root/b64certificate.txt -nodelist odbn1,odbn2
2010-08-24 15:11:50: Running as user oracle: /u01/app/grid/bin/cluutil -sourcefile /u01/app/grid/gpnp/odbn1/wallets/root/b64certificate.txt -destfile /u01/app/grid/gpnp/wallets/root/b64certificate.txt -nodelist odbn1,odbn2
2010-08-24 15:11:50: s_run_as_user2: Running /bin/su oracle -c ' /u01/app/grid/bin/cluutil -sourcefile /u01/app/grid/gpnp/odbn1/wallets/root/b64certificate.txt -destfile /u01/app/grid/gpnp/wallets/root/b64certificate.txt -nodelist odbn1,odbn2 '
2010-08-24 15:12:26: Removing file /tmp/fileUQzFxE
2010-08-24 15:12:27: Successfully removed file: /tmp/fileUQzFxE
2010-08-24 15:12:27: /bin/su successfully executed
2010-08-24 15:12:27: /u01/app/grid/gpnp/odbn1/wallets/peer/cert.txt => /u01/app/grid/gpnp/wallets/peer/cert.txt
2010-08-24 15:12:27: rmtcpy: /u01/app/grid/bin/cluutil -sourcefile /u01/app/grid/gpnp/odbn1/wallets/peer/cert.txt -destfile /u01/app/grid/gpnp/wallets/peer/cert.txt -nodelist odbn1,odbn2
2010-08-24 15:12:27: Running as user oracle: /u01/app/grid/bin/cluutil -sourcefile /u01/app/grid/gpnp/odbn1/wallets/peer/cert.txt -destfile /u01/app/grid/gpnp/wallets/peer/cert.txt -nodelist odbn1,odbn2
2010-08-24 15:12:27: s_run_as_user2: Running /bin/su oracle -c ' /u01/app/grid/bin/cluutil -sourcefile /u01/app/grid/gpnp/odbn1/wallets/peer/cert.txt -destfile /u01/app/grid/gpnp/wallets/peer/cert.txt -nodelist odbn1,odbn2 '
2010-08-24 15:12:47: Removing file /tmp/filevnw3D8
2010-08-24 15:12:47: Successfully removed file: /tmp/filevnw3D8
2010-08-24 15:12:47: /bin/su successfully executed
2010-08-24 15:12:47: /u01/app/grid/gpnp/odbn1/wallets/pa/cert.txt => /u01/app/grid/gpnp/wallets/pa/cert.txt
2010-08-24 15:12:47: rmtcpy: /u01/app/grid/bin/cluutil -sourcefile /u01/app/grid/gpnp/odbn1/wallets/pa/cert.txt -destfile /u01/app/grid/gpnp/wallets/pa/cert.txt -nodelist odbn1,odbn2
2010-08-24 15:12:47: Running as user oracle: /u01/app/grid/bin/cluutil -sourcefile /u01/app/grid/gpnp/odbn1/wallets/pa/cert.txt -destfile /u01/app/grid/gpnp/wallets/pa/cert.txt -nodelist odbn1,odbn2
2010-08-24 15:12:47: s_run_as_user2: Running /bin/su oracle -c ' /u01/app/grid/bin/cluutil -sourcefile /u01/app/grid/gpnp/odbn1/wallets/pa/cert.txt -destfile /u01/app/grid/gpnp/wallets/pa/cert.txt -nodelist odbn1,odbn2 '
2010-08-24 15:13:19: Removing file /tmp/fileArkUFi
2010-08-24 15:13:20: Successfully removed file: /tmp/fileArkUFi
2010-08-24 15:13:20: /bin/su successfully executed
2010-08-24 15:13:20: Exiting exclusive mode
2010-08-24 15:13:41: Command return code of 1 (256) from command: /u01/app/grid/bin/crsctl stop resource ora.asm -init
2010-08-24 15:13:41: Stop of resource "ora.asm -init" failed
2010-08-24 15:13:41: Failed to stop ASM
2010-08-24 15:14:44: Command return code of 1 (256) from command: /u01/app/grid/bin/crsctl stop resource ora.cssd -init
2010-08-24 15:14:44: CSS shutdown failed
2010-08-24 15:14:44: Failed to exit exclusive mode
2010-08-24 15:14:44: Initial cluster configuration failed. See /u01/app/grid/cfgtoollogs/crsconfig/rootcrs_odbn1.log for details
[root@odbn1 crsconfig]#
Has anyone seen this before? All help greatly appreciated!

Hi Sebastian,
Thank you for your quick reply. Here's what I tried:
1. reset the install as you suggested, and tried running root.sh again. The exact same thing happened.
2. restored to an openfiler snapshots that were taken right before the failed upgrade. Increased memory on both VMs to 1280M as you suggested. Rebooted the virtual environment and ran the installation again. This time, the root.sh script froze my environment - not enough memory to support this.
3. restored the openfiler snapshots again. Increased memory on one node (odbn1) to 1500M. Ran the install for a single node cluster. It got past this error.
Thank you!!!
Also, thanks for the tip on the ntp.init file. That did eliminate the error for ntpd not running during the installation.

ASM instances on 2 node Oracle RAC 10g r2 on Red Hat 4 u1

Hi all
I'm experiencing a problem in configuring diskgroups under +ASM instances on a two node Oracle RAC.
I followed the official guide and also official documents from metalink site, but i'm stuck with the visibility of asm disks.
I created fake disks on nfs with Netapp certified storage binding them to block device with the usual trick "losetup /dev/loopX /nfs/disk1 " ,
run "oracleasm createdisk DISKX /dev/loopX" on one node and
"oracleasm scandisks" on the other one.
With "oracleasm listdisks" i can see the disks at OS level in both nodes , but , when i try to create and mount diskgroup in the ASM instances , on the instance on which i create the diskgroup all is well, but the other one doesn't see the disks at all, and diskgroup mount fails with :
ERROR: no PST quorum in group 1: required 2, found 0
Tue Sep 20 16:22:32 2005
NOTE: cache dismounting group 1/0x6F88595E (DG1)
NOTE: dbwr not being msg'd to dismount
ERROR: diskgroup DG1 was not mounted
any help would be appreciated
thanks a lot.
Antonello

I'm having this same problem. Did you ever find a solution?

Issue At the time of Creating ASM instance through DBCA For 11g RAC db :

Hi,
I have configured two node RAC with OEL5.
I have installed below software successfully under different home locations.
1) Clusterware :
2) ASM
3) Database
I want to run ASM instance under separate home but when i am executing dbca from ASM home location to create asm i am facing a problem which is not traceable by me. Please help me if any body has any idea on it.
Problem:
Sometime(displayed below) ASM instance is running from node 1 and some times from node 2. At a time ASM in both instance is not in online state. At the end dbca is displaying ORA-01034: ORACLE not available. Please let me know what may be the exact reason for this.
1) State 1
Name Type Target State Host
ora....SM1.asm application ONLINE ONLINE mac1
ora....C1.lsnr application ONLINE ONLINE mac1
ora.mac1.gsd application ONLINE ONLINE mac1
ora.mac1.ons application ONLINE ONLINE mac1
ora.mac1.vip application ONLINE ONLINE mac1
ora....SM2.asm application ONLINE OFFLINE
ora....C2.lsnr application ONLINE ONLINE mac2
ora.mac2.gsd application ONLINE ONLINE mac2
ora.mac2.ons application ONLINE ONLINE mac2
ora.mac2.vip application ONLINE ONLINE mac2
2)Name Type Target State Host
ora....SM1.asm application ONLINE OFFLINE
ora....C1.lsnr application ONLINE ONLINE mac1
ora.mac1.gsd application ONLINE ONLINE mac1
ora.mac1.ons application ONLINE ONLINE mac1
ora.mac1.vip application ONLINE ONLINE mac1
ora....SM2.asm application ONLINE ONLINE mac2
ora....C2.lsnr application ONLINE ONLINE mac2
ora.mac2.gsd application ONLINE ONLINE mac2
ora.mac2.ons application ONLINE ONLINE mac2
ora.mac2.vip application ONLINE ONLINE mac2
With Regards,
SNP

Yes you are right , I have to make to sure stock budget doesn't get credited.
If you remember in one of my other threads, i wanted to derive commitment item from Matl grp, it was for this purpose. I will derive commitment through matl group at the time of procurement / GR etc and assign a dummy commitment item to stock a/cs. Where as i will derive a consumption commiment item from consumption GLs.
Thank you
Chris

How does 1 ASM instance in a 10 node RAC cause all 10 ASM instance to hang

Linux RHEL4
11.2.0.1.0 GI
11.2.0.1.0 RDBMS
11.1.0.7.0 RDBMS
10.2.0.4.4 RDBMS
Yesterday we had one of the ASM instance on our 10-node cluster hang with a latch "ASM file allocation latch". Oracle support has stated we are hitting a bug with is fixed in the latest PSU.
What I am trying to understand is how a latch on one ASM instance caused all 10 ASM instances to hang?
Oracle Supports explanation still does not answer how all 10 ASM instance were affected other then the faulty code that the patch fixes. Bellow is info out of the SAR.
Data Guard Site:
================
ARC1 PID 21508 reports ORA-240 'control file enqueue held for more than 120 seconds' at Thu Oct 28 11:35:54 2010. This message means ARC1 PID 21508 was holding the enqueue past the maximum tine limit of 120 seconds.
Next ARC0 PID 17398 reports ORA-16146: 'control file enqueue unavailable' at Thu Oct 28 11:36:52 2010. This means ARC0 PID 17398 tried to access the controlfile and it could get the lock.
ARC1 PID 21508 is then killed at Thu Oct 28 11:49:57 2010.
Killing enqueue blocker (pid=21508) on resource CF-00000000-00000000 by (pid=23078) by killing session 5.3
We see that RSM has been restarted by Broker. This matches to the alert.log and messages showing RSM being restarted several time. i.e. RSM0 started with pid=84, OS id=27915
Since this started happening around 11:14, the problem may have really started then instead of w/ the CF enqueue block.
The primary appears to be shipping redo to the standby using asynchronous mode. Unless there was a gap, I do no know if ARC1 should have been doing any remote network I/O. Because a log switch to thread 1 sequence 5235 had just happened at 11:33am, I suspect it was a local disk I/O that was started at least. The ORA-240 is reported at 11:35, exactly 120 sec (or 2min) from this log switch. Notice also the entry to show the log thread 1 sequence 5234 was registered to the controlfile didn't happen yet.
ASM Side:
============
From the systemstate dump on ASM, multiple processes are waiting on 'ASM file allocation latch' and we are kind of stuck on stack:
ksedsts()+461<-ksdxfstk()+32<-ksdxcb()+1782<-sspuser()+112<-0000003218E0C5B0<-kfuhInsert()+175<-kffilCreate()+601<-kfnsUFG()+3691<-kfnsBackground()+4382<-kfnDispatch()+527<-opiodr()+1149<-ttcpip()+1251<-opitsk()+1633<-opiino()+958<-opiodr()+1149<-opidrv()+570<-sou2o()+103<-opimai_real()+133<-ssthrdmain()+214<-main()+201<-__libc_start_main()+219
This caused the hang on the ASM side and hence ASM was not responding to the database. The CF Enqueue issue on the database was a side effect of this.
This is a direct <BUG:9232266> which is a duplicate of <BUG:8974548>

Thanks Murali,
I was little reluctent to open a tar since my experince says that its better to troubleshoot the issue yourself instead of spending time with the Oracle support :)
Well, I got some more information on this : the sql for the process id of ASM instance is :
Alter Diskgroup mount all;
It looks like it is unable to mount the diskgroup and get hunged at that point , is it due to the new disk added to the system or do we missed something after adding the new disk.
Also, the ASM process can not be killed from unix box while the ASM is down.
Will appreciate your time if we can move in any directions from here ..
Thanks ,
Ankur

Asm, instance and service failing to start 10g rac redhat el5

hi,
i have been following a how to guide from oracle's website about implementing a 10g rac system using el5 (http://www.oracle.com/technology/pub/articles/hunter_rac10gr2_iscsi.html), by the end of the installation and setup I had both the nodes up and running and all services were up and running. Then under the root account I rebooted one of the nodes. now when I check the status of the services I get this:
[oracle@rac01 ~]$ crs_stat -t
Name           Type           Target    State     Host
ora.orcl.db    application    ONLINE    ONLINE    rac01
ora...._taf.cs application    ONLINE    ONLINE    rac02
ora....cl1.srv application    ONLINE    OFFLINE
ora....cl2.srv application    ONLINE    ONLINE    rac02
ora....l1.inst application    OFFLINE   OFFLINE
ora....l2.inst application    ONLINE    ONLINE    rac02
ora....SM1.asm application    OFFLINE   OFFLINE
ora....01.lsnr application    ONLINE    ONLINE    rac01
ora.rac01.gsd application    ONLINE    ONLINE    rac01
ora.rac01.ons application    ONLINE    ONLINE    rac01
ora.rac01.vip application    ONLINE    ONLINE    rac01
ora....SM2.asm application    ONLINE    ONLINE    rac02
ora....02.lsnr application    ONLINE    ONLINE    rac02
ora.rac02.gsd application    ONLINE    ONLINE    rac02
ora.rac02.ons application    ONLINE    ONLINE    rac02
ora.rac02.vip application    ONLINE    ONLINE    rac02though I can start the asm instance manually by
srvctl start asm -n rac01and it starts but the instance and service on the rebooted node still wont start. is there a log file which tells me what the error is when it tries to start the instance? what can I do to ensure that if a node is rebooted that all of the services get started correctly and the node automatically rejoins the cluster (i thought I had set all of this from the instructions of the guide I was following).
Regards
Martin.

Check ASM resource:
crs_stat -p "resource_name
$ crs_stat | grep NAME\= | grep ASM1
NAME=ora.rac01.ASM1.asm
$ crs_stat -p ora.rac01.ASM1.asm
NAME=ora.rac01.ASM1.asm
TYPE=application
ACTIVE_PLACEMENT=0
*AUTO_START*=1
CHECK_INTERVAL=600
DESCRIPTION=CRS application for ASM instance
What do you see AUTO_START?
if 1 = auto start:
or check error ASM while start... at ASM_HOME/log/rac01/racg/*
If AUTO_START=2
Oracle Clusterware is configured to start the VIP, listener, instance, ASM, database services and other resources during system boot. Starting with 10.1.0.4, it is possible to modify some resources to have their profile parameter AUTO_START set to the value 2. This means that after node reboot, or when Oracle Clusterware is started, resources with AUTO_START=2 will need to be started manually via srvctl. Please work with Oracle Support if you need to modify this attribute.
If AUTO_START=2 and need to change to 1:
Example:
$ crs_stat -p ora.rac01.ASM1.asm
NAME=ora.rac01.ASM1.asm
TYPE=application
ACTIVE_PLACEMENT=0
AUTO_START=2
$ crs_stat -p ora.rac01.ASM1.asm > ORA_CRS_HOME/crs/public/ora.rac01.ASM1.asm
$ crs_unregister ora.rac01.ASM1.asm
$ crs_stat -p ora.rac01.ASM1.asm
CRS-0210: Could not find resource 'ora.rac01.ASM1.asm
$ vi ORA_CRS_HOME/crs/public/ora.rac01.ASM1.asm.cap
AUTO_START=2
to
AUTO_START=1
$ crs_register ora.rac01.ASM1.asm
$ crs_stat -p ora.rac01.ASM1.asm
NAME=ora.rac01.ASM1.asm
TYPE=application
*AUTO_START=1*
Edited by: Surachart Opun (HunterX) on Jul 31, 2009 1:06 PM

Configure ASM Instance in RAC cluster - problem

Linux RH4 with Oracle 11.1.0.6
I previously had ASM working in a RAC environment, but have uninstalled on all 3 nodes following Oracle guidelines.
When I attempt to re-configure ASM it states that an ASM instance is located in nodes 2 and 3. Previous ASM software has been removed, and there are no entries in the /etc/oratab files on any of the nodes.
How do I locate and then remove these instances on nodes 2 and 3
Thanks

Steps in Note 311350.1 have been followed, and there are no occurances of ASM appearing in the crs_stat output. Also the fact that the ASM software has also been removed from all of the various, where are these ASM instances being started?
I am unable to proceed past the "Select Configuration Screen" which gives you the option to 1)Create Database, 2)Configure ASM or 3) Install Software only.
When I select option 2 and enter ASM SYS password, I get the error message that ASM instances are present in the other nodes.
Would appreciate any help in how I can progress past this stage.
Thanks

Rename asm instance in RAC

Hello,
ClusterWare 11.2.0.3 + RAC db same version .
I need to rename one of the ASM instances
How can this be done ?
the situation is as follows , I needed to take one of the server out of the cluster and then bring him back in .
when I have added him , he got a new ASM instance name (was ASM1 now it got ASM3 , 2 node rac) ,
thanks
S.

Sahar wrote:
ClusterWare 11.2.0.3 + RAC db same version .
I need to rename one of the ASM instancesNo you don't. Supply reasons and justification for wanting to changes the SID of an ASM instance,
the situation is as follows , I needed to take one of the server out of the cluster and then bring him back in .
when I have added him , he got a new ASM instance name (was ASM1 now it got ASM3 , 2 node rac) ,So? What is wrong with an instance called +ASM3 in a 2 node RAC? How does that now reduce and impair cluster functionality?

Shutting down ASM instance in 11.2 RAC

Similar Messages

Maybe you are looking for