RAC CRS problem

Hello All,
I'm using RAC on a 2 node cluster on Red Hat Linux AS4. Today when I started the cluster and gave
root@node7]#/cw/oracle/bin/crs_stat -t
NAME Type Target State Node
ora.node7.gsd application ONLINE UNKNOWN node7
ora.node7.ons application ONLINE UNKNOWN node7
ora.node7.vip application ONLINE ONLINE node7
ora.node8.gsd application ONLINE UNKNOWN node8
ora.node8.ons application ONLINE UNKNOWN node8
ora.node8.vip application ONLINE ONLINE node8
root@node7]#/cw/oracle/bin/crsctl check crs
CRS appears healthy
CSS appears healthy
EVM appears healthy
I'm a rookie to RAC. I don't understand if I can go ahead from the above mentioned.
Please guide me .
Regards,
Raj

Did you tried altering OCR or any other resouce permissions.
check OCR dump and see.
any how you can try starting the ons and gsd manually using onsctl and gsdctl.
see if they throw any error.
see the resource rac logs for any issues encountered during start by crs.

Similar Messages

10G RAC: CRS 설치 실패 후 정리 방법

제품 : ORACLE SERVER
작성날짜 : 2004-11-30
10G RAC: CRS 설치 실패 후 정리 방법
=====================================
PURPOSE
이 문서는, DBA와 기술 지원 엔지니어가 10g RAC의 CRS (Cluster Ready Services)
실패시, 일부 설치된 CRS를 제거하는데 필요한 정보를 제공하는 것을 목적으로 한다.
Explanation
설치에 실패한 CRS는 노드 리부팅과 같은 문제를 야기 시킬 수 있다.
실패한 CRS 설치본을 정리하기 위해서는 다음과 같은 절차를 따른다:
1. $ORA_CRS_HOME/install 디렉토리에서 rootdelete.sh 스크립트를 실행한 후 rootdeinstall.sh 스크립트를
실행시킨다. 만약 이 스크립트를 실행시키는데 문제가 있거나, 모든 콤포넌트가 성공적으로 제거되었는지
여부를 확인하려면 step 2로 간다:
2. 모든 노드로 부터 노드 애플리케이션을 중단시킨다:
srvctl stop nodeapps -n <node name>
3. 노드 부팅시 CRS가 구동되는 것을 예방한다. 이를 위해 root 계정에서 다음과 같은 작업을
수행한다 :
Sun:
rm /etc/init.d/init.cssd
rm /etc/init.d/init.crs
rm /etc/init.d/init.crsd
rm /etc/init.d/init.evmd
rm /etc/rc3.d/K96init.crs
rm /etc/rc3.d/S96init.crs
rm -Rf /var/opt/oracle/scls_scr
rm -Rf /var/opt/oracle/oprocd
rm /etc/inittab.crs
cp /etc/inittab.orig /etc/inittab
Linux:
rm -f /etc/init.d/init.cssd
rm -f /etc/init.d/init.crs
rm -f /etc/init.d/init.crsd
rm -f /etc/init.d/init.evmd
rm -f /etc/rc2.d/K96init.crs
rm -f /etc/rc2.d/S96init.crs
rm -f /etc/rc3.d/K96init.crs
rm -f /etc/rc3.d/S96init.crs
rm -f /etc/rc5.d/K96init.crs
rm -f /etc/rc5.d/S96init.crs
rm -Rf /etc/oracle/scls_scr
rm -f /etc/inittab.crs
cp /etc/inittab.orig /etc/inittab
HP-UX:
rm /sbin/init.d/init.cssd
rm /sbin/init.d/init.crs
rm /sbin/init.d/init.crsd
rm /sbin/init.d/init.evmd
rm /sbin/rc3.d/K960init.crs
rm /sbin/rc3.d/S960init.crs
rm -Rf /var/opt/oracle/scls_scr
rm -Rf /var/opt/oracle/oprocd
rm /etc/inittab.crs
cp /etc/inittab.orig /etc/inittab
HP Tru64:
rm /sbin/init.d/init.cssd
rm /sbin/init.d/init.crs
rm /sbin/init.d/init.crsd
rm /sbin/init.d/init.evmd
rm /sbin/rc3.d/K96init.crs
rm /sbin/rc3.d/S96init.crs
rm -Rf /var/opt/oracle/scls_scr
rm -Rf /var/opt/oracle/oprocd
rm /etc/inittab.crs
cp /etc/inittab.orig /etc/inittab
IBM AIX:
rm /etc/init.cssd
rm /etc/init.crs
rm /etc/init.crsd
rm /etc/init.evmd
rm /etc/rc.d/rc2.d/K96init.crs
rm /etc/rc.d/rc2.d/S96init.crs
rm -Rf /etc/oracle/scls_scr
rm -Rf /etc/oracle/oprocd
rm /etc/inittab.crs
cp /etc/inittab.orig /etc/inittab
4. 만약 프로세스가 살아 있다면 EVM, CRS 및 CRS 프로세스를 kill 시키거나
노드를 리부팅 한다:
ps -ef | grep crs
kill <crs pid>
ps -ef | grep evm
kill <evm pid>
ps -ef | grep css
kill <css pid>
5. CRS 설치 디렉토리를 제거한다:
rm -Rf <CRS Install Location>/*
6. Oracle Universal Installer에서 CRS home을 De-install 한다.
7. dd 명령으로 OCR 및 Voting File을 제거한다. 예 :
dd if=/dev/zero of=/dev/rdsk/V1064_vote_01_20m.dbf bs=8192 count=2560
dd if=/dev/zero of=/dev/rdsk/ocrV1064_100m.ora bs=8192 count=12800
만약 RDBMS 설치를 제거한다면, 사용중이던 ASM 디스크도 정리한다.
8. 만약 CRS를 재 설치하고자 하면, RAC 설치 매뉴얼에 기술된 순서대로 설치를 다시 진행한다.
Example
Reference Documents
<Note:239998.1> 10g RAC: How to Clean Up After a Failed CRS Install

RAC CRS not getting started

Hi,
We had installed RAC DB namely ORCL on a two-node cluster abcoracledb01 and abcoracledb02 with the OUI launched from db01 node. After installation, the NETCA is able to identify the RAC DB ORCL on both the nodes as well as the ORCL1 instance on db01 node and ORCL2 instance on db02 node. Now when I try to launch the DBCA from db01 node, it prompts me with the two normal options Real Applications Cluster database and normal database on its welcome screen as it detects the CRS running on this node. The problem is coming when Im trying to launch DBCA from the second node as it does not extends the RAC option in its welcome screen. I can understand that the CRS is not running on this db02 instance and and i verified this by running the OLSNODES -v command that gives me an error stating that the cluster interface is not getting started.
Will highly appreciate if anyone can help me to get some referenctial documentation or diagnostic information that may help me in troubsleshooting the exact reason behind the CRS not getting started.
Thanks,
Manoj ([email protected])

Ummm... Why are you trying to run the DBCA twice? The DBCA is really only there to give you a starter database configured for either OLTP, OLAP, or multi-purpose, but since both nodes will be attached to the same database, you shouldn't run the DBCA more than once. Once you have the database created with DBCA, attach the second node to it and go. Your problem is not with DBCA, it's in the cluster interconnect. Once that starts up, the second instance will attach to the database and go.

RAC resources problem

hi all,
before installing ASM instance i had the resources as follows:- C:\oracle\102\crs\BIN>crs_stat -t -v
Name Type R/RA F/FT Target State Host
ora....c11.gsd application 0/5 0/0 ONLINE ONLINE vmrac11
ora....c11.ons application 0/3 0/0 ONLINE ONLINE vmrac11
ora....c11.vip application 0/0 0/0 ONLINE ONLINE vmrac11
ora....c22.gsd application 0/5 0/0 ONLINE ONLINE vmrac22
ora....c22.ons application 0/3 0/0 ONLINE ONLINE vmrac22
ora....c22.vip application 0/0 0/0 ONLINE ONLINE vmrac22
AFTER ASM instance is installed the resources are:-
C:\oracle\102\crs\BIN>crs_stat -v -t
Name Type R/RA F/FT Target State Host
ora....SM1.asm application 0/5 0/0 ONLINE OFFLINE
ora....SM2.asm application 0/5 0/0 ONLINE ONLINE vmrac22
I have tried everything but could not solve the problem, i will be thankful to you for your valuable suggestions and solutions.
Thanks and Regards,
Aijaz

hi all,
I am back, RAC installation seems nightmare for me, I am getting the following error
node 1: vmrac11 vmrac11-priv vmrac11
node 2: vmrac22 vmrac22-priv vmrac22
Creating OCR keys for user 'administrator', privgrp ''..
Operation successful.
Now formatting voting device: \\.\votedsk1
Format of 1 voting devices complete.
Step 1: checking status of CRS cluster
Step 2: creating directories (C:\oracle\product\10.2.0\crs)
Step 3: configuring OCR repository
Step 4: configuring safe mode for CRS stack
Step 5: Starting up CRS stack on all nodes
vmrac11 service OracleCSService in improper PENDING state, err(0)
vmrac22 service OracleCSService in improper PENDING state, err(997)
i have already installed opmd.exe.
regards
Aijaz

RAC Installaton problem

Hi every one ,
I am installing oracle rac for two nodes , when I reach to the step of running root.sh
I got the folowing :
$./root.sh
WARNING: directory '/opt/oracle/product/10.2.0' is not owned by root
WARNING: directory '/opt/oracle/product' is not owned by root
WARNING: directory '/opt/oracle' is not owned by root
Checking to see if Oracle CRS stack is already configured
Setting the permissions on OCR backup directory
Setting up NS directories
Failed to upgrade Oracle Cluster Registry configuration
any one has an idea about this problem
thanks in advance.

$./root.sh
WARNING: directory '/opt/oracle/product/10.2.0' is not owned by root
WARNING: directory '/opt/oracle/product' is not owned by root
WARNING: directory '/opt/oracle' is not owned by root
Checking to see if Oracle CRS stack is already configured
Setting the permissions on OCR backup directory
Setting up NS directories
This part is normal but oracle cluster registry configuration should be successful.
Verify your cluster configuration.
Regards
Asif Kabir

RAC Installation Problem in End

Hi All
I am instaling RAC on Red Hat Linux 4. After installation of Clusterware I got the following on the rac01 node.........
[root@rac01 ~]# /u01/app/oracle/product/10.2/crs/bin/crs_stat -t
Name Type Target State Host
ora.rac01.gsd application ONLINE UNKNOWN rac01
ora.rac01.ons application ONLINE UNKNOWN rac01
ora.rac01.vip application ONLINE ONLINE rac01
ora.rac02.gsd application ONLINE UNKNOWN rac02
ora.rac02.ons application ONLINE UNKNOWN rac02
ora.rac02.vip application ONLINE ONLINE rac02
[root@rac01 ~]#
During the installation of the database during Oracle net configuration assistant, I got the error:
Problem in configuration: rac02: LISTENER_RAC02
Listener start failed. Listener may already be running.
CRS-0215: 'Could not start resource'ora.rac02.LISTENER_RAC02.lsnr'.
Any help will be appreciated
Regards

Also Listener is up on node "rac01" and I am installing from this node......
also the output:
[oracle@rac02 admin]$ srvctl status nodeapps -n rac01
VIP is running on node: rac01
GSD is not running on node: rac01
Listener is running on node: rac01
ONS daemon is not running on node: rac01
[oracle@rac02 admin]$ srvctl status nodeapps -n rac02
VIP is running on node: rac02
GSD is not running on node: rac02
Listener is not running on node: rac02
ONS daemon is not running on node: rac02
Here are the last few lines of the logfile:
Oracle Database 10g 10.2.0.1.0
Oracle Net Services 10.2.0.1.0
Oracle Enterprise Manager Console DB 10.2.0.1.0
Oracle OLAP 10.2.0.1.0
Oracle Spatial 10.2.0.1.0
Oracle Partitioning 10.2.0.1.0
Enterprise Edition Options 10.2.0.1.0
Oracle Database 10g 10.2.0.1.0
INFO: SaveInvWCCE JRE files in Scratch :590
INFO: Config Initialize JRE files in Scratch :590
INFO: stage loc: /tmp/OraInstall2007-06-12_05-00-28PM/
INFO: Copying Aggr XML for: HAS Common Files
INFO: stage loc: /tmp/OraInstall2007-06-12_05-00-28PM/
INFO: Copying Aggr XML for: iSQL*Plus
INFO: stage loc: /tmp/OraInstall2007-06-12_05-00-28PM/
INFO: Copying Aggr XML for: Oracle Net
INFO: stage loc: /tmp/OraInstall2007-06-12_05-00-28PM/
INFO: Copying Aggr XML for: Database Configuration and Upgrade Assistants
INFO: stage loc: /tmp/OraInstall2007-06-12_05-00-28PM/
INFO: Copying Aggr XML for: Oracle Enterprise Manager Console DB
INFO: stage loc: /tmp/OraInstall2007-06-12_05-00-28PM/
INFO: Copying Aggr XML for: Oracle Database 10g
INFO: Namespace prefix 'agg' used but not declared.
INFO: no. of tools to supress: 0 for comp: HAS Common Files
INFO: no. of tools to supress: 0 for comp: iSQL*Plus
INFO: processing tool: iSQL*Plus Configuration Assistant
INFO: removing plugin invocation for: iSQL*Plus Configuration Assistantas it doesnt support clone mode
INFO: removing plugin invocation for: iSQL*Plus Configuration Assistantas it doesnt support add node mode
INFO: Namespace prefix 'agg' used but not declared.
INFO: can't remove invocation for plugin: iSQL*Plus Configuration Assistant from Action: cloningdrastic
INFO: can't remove invocation for plugin: iSQL*Plus Configuration Assistant from Action: addingnode
INFO: no. of tools to supress: 0 for comp: Oracle Net
INFO: processing tool: Oracle Net Configuration Assistant
INFO: removing plugin invocation for: Oracle Net Configuration Assistantas it doesnt support clone mode
INFO: removing plugin invocation for: Oracle Net Configuration Assistantas it doesnt support add node mode
INFO: Namespace prefix 'agg' used but not declared.
INFO: processing tool: Oracle Net Configuration Assistant - Deinstall Script
INFO: removing plugin invocation for: Oracle Net Configuration Assistant - Deinstall Scriptas it doesnt support clone mode
INFO: removing plugin invocation for: Oracle Net Configuration Assistant - Deinstall Scriptas it doesnt support addnode mode
INFO: no. of tools to supress: 0 for comp: Database Configuration and Upgrade Assistants
INFO: processing tool: Oracle Database Configuration Assistant
INFO: removing plugin invocation for: Oracle Database Configuration Assistantas it doesnt support clone mode
INFO: removing plugin invocation for: Oracle Database Configuration Assistantas it doesnt support add node mode
INFO: Namespace prefix 'agg' used but not declared.
INFO: processing tool: Database Upgrade Assistant
INFO: removing plugin invocation for: Database Upgrade Assistantas it doesnt support clone mode
INFO: removing plugin invocation for: Database Upgrade Assistantas it doesnt support add node mode
INFO: Namespace prefix 'agg' used but not declared.
INFO: can't remove invocation for plugin: Database Upgrade Assistant from Action: cloningdrastic
INFO: can't remove invocation for plugin: Database Upgrade Assistant from Action: addingnode
INFO: no. of tools to supress: 0 for comp: Oracle Enterprise Manager Console DB
INFO: cf session will be created for OH: /u01/app/oracle/product/10.2.0/db_1/ TLAggr: oracle.server instancePath: inventory/ContentsXML/ConfigXML/
INFO: cf session for OH: /u01/app/oracle/product/10.2.0/db_1/ TL Aggr: [oracle.server] instancePath: inventory/ContentsXML/ConfigXML/
INFO: aggr ref length : 7
INFO: cf session hashcode: 8366806
INFO: cf session saved with key: OraDb10g_home1 oracle.server
INFO: cf session is ok
INFO: created and saved cf session for oh: OraDb10g_home1
INFO: passing params to cf
INFO: ORACLE_HOME is not settable, hence not setting the value
INFO: ORACLE_HOME is not settable, hence not setting the value
INFO: ORACLE_HOME is not settable, hence not setting the value
INFO: {Parameter:TOPLEVEL_COMPONENT in {Aggregate:OuiConfigVariables:1.0.0.0.0:common}}: Parameter data type is not compatible with the provided String Array.
INFO: passing params to cf done
INFO: done saving info by cf
INFO: Updating files in Oracle home '/u01/app/oracle/product/10.2.0/db_1' to remote nodes 'rac02'.
INFO: List of files to be excluded from:install/excludeFileList.txt
INFO: Exclude file list /tmp/OraInstall2007-06-12_05-00-28PM/installExcludeFile.lst does not exist or is empty. The file is ignored.
INFO: Saving Cluster Inventory
INFO: Running command '/tmp/OraInstall2007-06-12_05-00-28PM/oui/bin/runInstaller -jreLoc /tmp/OraInstall2007-06-12_05-00-28PM/jre/1.4.2 -paramFile /tmp/OraInstall2007-06-12_05-00-28PM/oui/clusterparam.ini -silent -ignoreSysPrereqs -attachHome -noClusterEnabled ORACLE_HOME=/u01/app/oracle/product/10.2.0/db_1 ORACLE_HOME_NAME=OraDb10g_home1 CLUSTER_NODES=rac01,rac02 "INVENTORY_LOCATION=/u01/app/oracle/oraInventory" LOCAL_NODE=rac02 -remoteInvocation -invokingNodeName rac01 -logFilePath "/u01/app/oracle/oraInventory/logs" -timestamp 2007-06-12_05-00-28PM' on the nodes 'rac02'.
INFO: Invoking OUI on cluster nodes rac02
INFO: /tmp/OraInstall2007-06-12_05-00-28PM/oui/bin/runInstaller -jreLoc /tmp/OraInstall2007-06-12_05-00-28PM/jre/1.4.2 -paramFile /tmp/OraInstall2007-06-12_05-00-28PM/oui/clusterparam.ini -silent -ignoreSysPrereqs -attachHome -noClusterEnabled ORACLE_HOME=/u01/app/oracle/product/10.2.0/db_1 ORACLE_HOME_NAME=OraDb10g_home1 CLUSTER_NODES=rac01,rac02 "INVENTORY_LOCATION=/u01/app/oracle/oraInventory" LOCAL_NODE=rac02 -remoteInvocation -invokingNodeName rac01 -logFilePath "/u01/app/oracle/oraInventory/logs" -timestamp 2007-06-12_05-00-28PM
INFO: cf session retrieved for key: OraDb10g_home1 oracle.server
INFO: cf session retrieved for key: OraDb10g_home1 oracle.server
INFO: cf session retrieved for key: OraDb10g_home1 oracle.server
INFO: RUN_RECOMMENDED_TOOLS FIRST is set to false
INFO: No of Recommended Tools2
INFO: plugin-list is created
INFO: pluginlist is updated for: Oracle Database 10g current size: 1
INFO: No of ExitOnly Tools in this session: 0
INFO: cf session for perform has hashcode: 8366806
INFO: detached tool list getting prepared fo comp: Oracle Database 10g
INFO: cfsession hashcode for exit only tools: 8366806
INFO: hashcode for action: 10258484
INFO: No of ExitOnly Tools: 0
INFO: saving exit only tools ...
INFO: no detached only tools in this session
INFO: exit-only tools are created in single installation
INFO: no. of sets of tools to be run: 1
INFO: ca page to be shown: true
INFO: exitonly tools to be excuted passed: 0
INFO: Starting to execute configuration assistants
INFO: Command = /u01/app/oracle/product/10.2.0/db_1/jdk/jre//bin/java -Duser.dir=/u01/app/oracle/product/10.2.0/db_1/network/jlib -classpath /u01/app/oracle/product/10.2.0/db_1/jdk/jre//lib/i18n.jar:/u01/app/oracle/product/10.2.0/db_1/jdk/jre//lib/rt.jar:/u01/app/oracle/product/10.2.0/db_1/jlib/ewt3.jar:/u01/app/oracle/product/10.2.0/db_1/jlib/ewtcompat-3_3_15.jar:/u01/app/oracle/product/10.2.0/db_1/jlib/netcfg.jar:/u01/app/oracle/product/10.2.0/db_1/network/jlib/netcam.jar:/u01/app/oracle/product/10.2.0/db_1/network/jlib/netca.jar:/u01/app/oracle/product/10.2.0/db_1/jlib/help4.jar:/u01/app/oracle/product/10.2.0/db_1/jlib/jewt4.jar:/u01/app/oracle/product/10.2.0/db_1/jlib/oracle_ice.jar:/u01/app/oracle/product/10.2.0/db_1/jlib/share.jar:/u01/app/oracle/product/10.2.0/db_1/jlib/swingall-1_1_1.jar:/u01/app/oracle/product/10.2.0/db_1/jlib/srvmhas.jar:/u01/app/oracle/product/10.2.0/db_1/jlib/srvm.jar:/u01/app/oracle/product/10.2.0/db_1/network/tools:/u01/app/oracle/product/10.2.0/db_1/jlib/ldapjclnt9.jar:/u01/app/oracle/product/10.2.0/db_1/jlib/ldapjclnt10.jar:/u01/app/oracle/product/10.2.0/db_1/oui/jlib/OraInstaller.jar:/u01/app/oracle/product/10.2.0/db_1/lib/xmlparserv2.jar oracle.net.ca.NetCA /orahome /u01/app/oracle/product/10.2.0/db_1 /orahnam OraDb10g_home1 /instype typical /inscomp client,oraclenet,javavm,server,ano /insprtcl tcp /cfg local /authadp NO_VALUE /nodeinfo rac01,rac02 /responseFile /u01/app/oracle/product/10.2.0/db_1/network/install/netca_typ.rsp
Parsing command line arguments:
Parameter "orahome" = /u01/app/oracle/product/10.2.0/db_1
Parameter "orahnam" = OraDb10g_home1
Parameter "instype" = typical
Parameter "inscomp" = client,oraclenet,javavm,server,ano
Parameter "insprtcl" = tcp
Parameter "cfg" = local
Parameter "authadp" = NO_VALUE
Parameter "nodeinfo" = rac01,rac02
Parameter "responsefile" = /u01/app/oracle/product/10.2.0/db_1/network/install/netca_typ.rsp
Done parsing command line arguments.
Oracle Net Services Configuration:
Profile configuration complete.
Profile configuration complete.
Listener started at port:1521
rac01...
rac02...
[oracle@rac01 ~]$
Message was edited by:
Bal

RAC -- CRS-0254: authorization failure

Hi,
i m trying to start 1 instance in rac env using srvctl command i m getting following error.
CRS-0254: authorization failure

Hi Pawell,
I am not sure whether your problem has been resolved or not.
But unfortunately even we are facing the same issue. Till today morning everything was fine. Suddenly users started complaining that they can't connect to the database.
When we tried log into database using sqlplus command it gave us TNS:protocol Adapter error which is weird. (every service relates to oracle and cluster are running from windows services and even when we checked crs_stat -t ==> all the services are up and running)
and when we tried to stop the services on the cluster level it gave us CRS-254 which is authorization failure.
Though restarting the server fixed the problem as of at this moment, We don't really know what caused that problem.
If your problem has been resolved can you give me some information in relates to this.
Regards
Balaji

Crs problem after rm -fr /etc/ora* fix and lastgasp files

newbie dba run this command our RAC NODE 2
rm -fr /etc/ora*
after this problem node2 CRS didnt work. so db instance didnt work too...
i copied /etc/ora* files from NODE1 to NODE2,
and replaced all rac1 with rac2, after reboot NODE 2.... CRS worked fine and db instance is working fine...
but ll lastgasp file names are the same with NODE1's,
node1 /etc/oracle/lastgasp
*==*
ag000852_kkrac1.lgl ag193150_kkrac1.lgl mo154244_kkrac1.lgl
ag001847_kkrac1.lgl ag214301_kkrac1.lgl mo171409_kkrac1.lgl
ag040319_kkrac1.lgl ag234646_kkrac1.lgl mo184502_kkrac1.lgl
ag152423_kkrac1.lgl mo000852_kkrac1.lgl mo193150_kkrac1.lgl
ag154038_kkrac1.lgl mo001847_kkrac1.lgl mo214301_kkrac1.lgl
ag154244_kkrac1.lgl mo040319_kkrac1.lgl mo234646_kkrac1.lgl
ag171409_kkrac1.lgl mo152423_kkrac1.lgl
ag184502_kkrac1.lgl mo154038_kkrac1.lgl
node2 /etc/oracle/lastgasp
*==*
ag000852_kkrac2.lgl ag193150_kkrac2.lgl mo154244_kkrac2.lgl
ag001847_kkrac2.lgl ag214301_kkrac2.lgl mo171409_kkrac2.lgl
ag040319_kkrac2.lgl ag234646_kkrac2.lgl mo184502_kkrac2.lgl
ag152423_kkrac2.lgl mo000852_kkrac2.lgl mo193150_kkrac2.lgl
ag154038_kkrac2.lgl mo001847_kkrac2.lgl mo214301_kkrac2.lgl
ag154244_kkrac2.lgl mo040319_kkrac2.lgl mo234646_kkrac2.lgl
ag171409_kkrac2.lgl mo152423_kkrac2.lgl
ag184502_kkrac2.lgl mo154038_kkrac2.lgl
what lastgasp files? how grid is using them?

I seem to have 8.1.7 creating a database with RH Linux 7.1 now. This was an important clue, since 7.1 hiccups 65% into the link phase of installation, thereby requiring the stubs patch to be run at that time, whereas 7.0 runs quite happily through the install & link without using the patch.
HOWEVER... before invoking dbassist to create the database under 7.1, you apparently need to export ASSUME_LD_LIBRARY = 2.2.5, etc., again, as you would do for the first time installing under RH 7.0.
null

RAC Instalation Problem (shared accross all the nodes in the cluster)

All experts
I am trying for installing Oracle 10.2.0 RAC on Redhat 4.7
reff : http://www.oracle-base.com/articles/10g/OracleDB10gR2RACInstallationOnLinux
All steps successfully completed on all nodes (rac1,rac2) every thing is okey for each node
on single node rac instalation successfull.
when i try to install on two nodes
on specify Oracle Cluster Registry (OCR) location showing error
the location /nfsmounta/crs.configuration is not shared accross all the nodes in the cluster. Specify a shared raw partation or cluster file system file that is visible by the same name on all nodes of the cluster.
I create shared disks on all nodes as:
1 First we need to set up some NFS shares. Create shared disks on NAS or a third server if you have one available. Otherwise create the following directories on the RAC1 node.
mkdir /nfssharea
mkdir /nfsshareb
2. Add the following lines to the /etc/exports file. (edit /etc/exports)
/nfssharea *(rw,sync,no_wdelay,insecure_locks,no_root_squash)
/nfsshareb *(rw,sync,no_wdelay,insecure_locks,no_root_squash)
3. Run the following command to export the NFS shares.
chkconfig nfs on
service nfs restart
4. On both RAC1 and RAC2 create some mount points to mount the NFS shares to.
mkdir /nfsmounta
mkdir /nfsmountb
5. Add the following lines to the "/etc/fstab" file. The mount options are suggestions from Kevin Closson.
nas:/nfssharea /nfsmounta nfs rw,bg,hard,nointr,tcp,vers=3,timeo=300,rsize=32768,wsize=32768,actimeo=0 0 0
nas:/nfsshareb /nfsmountb nfs rw,bg,hard,nointr,tcp,vers=3,timeo=300,rsize=32768,wsize=32768,actimeo=0 0 0
6. Mount the NFS shares on both servers.
mount /mount1
mount /mount2
7. Create the shared CRS Configuration and Voting Disk files.
touch /nfsmounta/crs.configuration
touch /nfsmountb/voting.disk
Please guide me what is wrong

I think you did not really mount it on the second server. what is the output of 'ls /nfsmounta'.
step 6 should be 'mount /nfsmounta', not 'mount 1'. I also don't know if simply creating a zero-size file is sufficient for ocr (i have always used raw devices, not nfs for this)

Can we have separate 10gR2 RAC CRS and 11gR2 RAC CRS homes on same Unix s

We'd like to test the upgrade of our 10gR2 RAC databases to 11gR2 RAC.
We have six databases on the same server and want to install a separate 11g RAC stack (11g CRS, 11g ASM, 11g RDBMS) and upgrade each 10g database from 10g RAC stack on same server (10g CRS, 10g ASM, 10g RDBMS) . Is it ok to have 10g CRS home and 11g CRS home same server? If not, how best to upgrade without buying more hardware?
Thanks in advance,
Lou

In more detail, the main issue/question is whether there can be 2 Oracle CRS homes on the same server i.e. separate 10gR2 and 11gR2 CRS homes residing on the same server for the purposes of (gradually) upgrading all Oracle RDBMS homes from 10g RAC to 11g RAC.
Can there be? What would be the implications for the OCR and voting disk? In our case 10g CRS has OCR and Voting Disk on raw devices. In 11gR2, these would need to be migrated/upgraded/stored in ASM, right?
We have 6 10g rdbms homes in addition to the one 10g CRS home and one 10g ASM home. To upgrade can we
- Install 11gR2 CRS in a separate home (this would now include ASM as well)
- Install 11gR2 RDBMS home
- Upgrade one of the 6 10g databases while leaving the others untouched as 10g databases in the separate 10g CRS, 10g ASM stack?
Any ideas, pointers greatly appreciated.
Thanks,
Lou

Oracle RAC crs无法启动的问题

这两个节点的RAC是做为DataGuard备库。
版本：Red Linux 5.6，Oracle 10.2.0.3.0
node1->$ crsctl check crs
CSS appears healthy
Cannot communicate with CRS
EVM appears healthy
node1->$ crsctl query css votedisk
0. 0 /dev/raw/raw1
located 1 votedisk(s).
node1->$ ocrcheck
Status of Oracle Cluster Registry is as follows :
Version : 2
Total space (kbytes) : 497744
Used space (kbytes) : 3820
Available space (kbytes) : 493924
ID : 1682116375
Device/File Name : /dev/raw/raw4
Device/File integrity check succeeded
Device/File not configured
Cluster registry integrity check succeeded
# *./oifcfg getif*
eth0 10.17.19.0 global cluster_interconnect
eth1 172.17.19.0 global public
# */etc/init.d/init.crs start*
node1->$ ps -ef|grep crs
root 5083 1 0 15:10 ? 00:00:00 /bin/su -l oracle -c sh -c 'ulimit -c unlimited; cd /app/oracle/product/10.2.0/crs_1/log/node1/evmd; exec /app/oracle/product/10.2.0/crs_1/bin/evmd '
oracle 17459 4769 0 16:09 pts/1 00:00:00 grep crs
oracle 26397 5083 0 15:51 ? 00:00:00 /app/oracle/product/10.2.0/crs_1/bin/evmd.bin
root 26619 26370 0 15:51 ? 00:00:00 /bin/su -l oracle -c /bin/sh -c 'cd /app/oracle/product/10.2.0/crs_1/log/node1/cssd/oclsomon; ulimit -c unlimited; /app/oracle/product/10.2.0/crs_1/bin/oclsomon || exit $?'
oracle 26626 26619 0 15:51 ? 00:00:00 /bin/sh -c cd /app/oracle/product/10.2.0/crs_1/log/node1/cssd/oclsomon; ulimit -c unlimited; /app/oracle/product/10.2.0/crs_1/bin/oclsomon || exit $?
oracle 26672 26626 0 15:51 ? 00:00:00 /app/oracle/product/10.2.0/crs_1/bin/oclsomon.bin
oracle 26691 26371 0 15:51 ? 00:00:00 /app/oracle/product/10.2.0/crs_1/bin/ocssd.bin
oracle 27094 26397 0 15:51 ? 00:00:00 /app/oracle/product/10.2.0/crs_1/bin/evmlogger.bin -o /app/oracle/product/10.2.0/crs_1/evm/log/evmlogger.info -l /app/oracle/product/10.2.0/crs_1/evm/log/evmlogger.log
alertnode1.log 文件部份内容：
2012-11-13 15:51:07.152
[cssd(26691)]CRS-1605:CSSD voting file is online: /dev/raw/raw1. Details in /app/oracle/product/10.2.0/crs_1/log/node1/cssd/ocssd.log.
2012-11-13 15:51:08.084
[cssd(26691)]CRS-1601:CSSD Reconfiguration complete. Active nodes are node1 node2 .
2012-11-13 15:51:08.320
[evmd(26397)]CRS-1401:EVMD started on node node1.
ocssd.log 文件内容：
[    CSSD]2012-11-13 15:51:05.037 >USER: Oracle Database 10g CSS Release 10.2.0.3.0 Production Copyright 1996, 2004 Oracle. All rights reserved.
[    CSSD]2012-11-13 15:51:05.037 >USER: CSS daemon log for node node1, number 1, in cluster crs
[    CSSD]2012-11-13 15:51:05.040 [2246605696] >TRACE: clssscmain: local-only set to false
[ clsdmt]Listening to (ADDRESS=(PROTOCOL=ipc)(KEY=node1DBG_CSSD))
[    CSSD]2012-11-13 15:51:05.065 [2246605696] >TRACE: clssnmReadNodeInfo: added node 1 (node1) to cluster
[    CSSD]2012-11-13 15:51:05.074 [2246605696] >TRACE: clssnmReadNodeInfo: added node 2 (node2) to cluster
[    CSSD]2012-11-13 15:51:05.077 [1120115008] >TRACE: clssnm_skgxnmon: skgxn init failed
[    CSSD]2012-11-13 15:51:05.077 [2246605696] >TRACE: clssnm_skgxnonline: Using vacuous skgxn monitor
[    CSSD]2012-11-13 15:51:05.079 [2246605696] >TRACE: clssnmNMInitialize: misscount set to (60), impending reconfig threshold set to (56000)
[    CSSD]2012-11-13 15:51:05.079 [2246605696] >TRACE: clssnmNMInitialize: diskShortTimeout set to (57000)ms
[    CSSD]2012-11-13 15:51:05.080 [2246605696] >TRACE: clssnmNMInitialize: diskLongTimeout set to (200000)ms
[    CSSD]2012-11-13 15:51:05.082 [2246605696] >TRACE: clssnmDiskStateChange: state from 1 to 2 disk (0//dev/raw/raw1)
[    CSSD]2012-11-13 15:51:05.082 [1120115008] >TRACE: clssnmvDPT: spawned for disk 0 (/dev/raw/raw1)
[    CSSD]2012-11-13 15:51:07.127 [1120115008] >TRACE: clssnmDiskStateChange: state from 2 to 4 disk (0//dev/raw/raw1)
[    CSSD]2012-11-13 15:51:07.153 [1130604864] >TRACE: clssnmvKillBlockThread: spawned for disk 0 (/dev/raw/raw1) initial sleep interval (1000)ms
[    CSSD]2012-11-13 15:51:07.161 [2246605696] >TRACE: clssnmFatalInit: fatal mode enabled
[    CSSD]2012-11-13 15:51:07.161 [1151584576] >TRACE: clssnmconnect: connecting to node 1, flags 0x0001, connector 1
[    CSSD]2012-11-13 15:51:07.161 [1120115008] >TRACE: clssnmReadDskHeartbeat: node(2) is down. rcfg(12) wrtcnt(78619) LATS(1830084) Disk lastSeqNo(78619)
[    CSSD]2012-11-13 15:51:07.162 [1151584576] >TRACE: clssnmClusterListener: Listening on (ADDRESS=(PROTOCOL=tcp)(HOST=node1-priv)(PORT=49895))
[    CSSD]2012-11-13 15:51:07.162 [1151584576] >TRACE: clssnmconnect: connecting to node 0, flags 0x0000, connector 1
[    CSSD]2012-11-13 15:51:07.162 [1151584576] >TRACE: clssnmClusterListener: Probing node 2, con (0x2aaaac10c320)
[    CSSD]2012-11-13 15:51:07.171 [1162074432] >TRACE: clssgmclientlsnr: listening on (ADDRESS=(PROTOCOL=ipc)(KEY=Oracle_CSS_LclLstnr_crs_1))
[    CSSD]2012-11-13 15:51:07.171 [1162074432] >TRACE: clssgmclientlsnr: listening on (ADDRESS=(PROTOCOL=ipc)(KEY=OCSSD_LL_node1_crs))
[    CSSD]2012-11-13 15:51:07.172 [1193544000] >TRACE: clssgmPeerListener: Listening on (ADDRESS=(PROTOCOL=tcp)(DEV=19)(HOST=10.17.19.20)(PORT=18701))
[    CSSD]2012-11-13 15:51:07.198 [1151584576] >TRACE: clssnmConnComplete: connected to node 2 (con 0x2aaaac163b50), state 3 birth 0, unique 1352712566/1352712566 prevConuni(0)
[    CSSD]2012-11-13 15:51:07.673 [1204033856] >TRACE: clssnmPollingThread: Connection complete
[    CSSD]2012-11-13 15:51:07.673 [1214523712] >TRACE: clssnmSendingThread: Connection complete
[    CSSD]2012-11-13 15:51:07.673 [1225013568] >TRACE: clssnmRcfgMgrThread: Connection complete
[    CSSD]2012-11-13 15:51:08.003 [1151584576] >TRACE: clssnmHandleSync: Acknowledging sync: src[2] srcName[node2] seq[45] sync[12]
[    CSSD]2012-11-13 15:51:08.003 [1151584576] >TRACE: clssnmHandleSync: diskTimeout set to (57000)ms
[    CSSD]2012-11-13 15:51:08.003 [1151584576] >TRACE: clssnmSendVoteInfo: node(2) syncSeqNo(12)
[    CSSD]2012-11-13 15:51:08.004 [1151584576] >TRACE: clssnmUpdateNodeState: node 0, state (0/0) unique (0/0) prevConuni(0) birth (0/0) (old/new)
[    CSSD]2012-11-13 15:51:08.004 [1151584576] >TRACE: clssnmDeactivateNode: node 0 () left cluster
[    CSSD]2012-11-13 15:51:08.004 [1151584576] >TRACE: clssnmUpdateNodeState: node 1, state (1/2) unique (1352793064/1352793064) prevConuni(0) birth (0/12) (old/new)
[    CSSD]2012-11-13 15:51:08.004 [1151584576] >TRACE: clssnmUpdateNodeState: node 2, state (4/3) unique (1352712566/1352712566) prevConuni(0) birth (0/1) (old/new)
[    CSSD]2012-11-13 15:51:08.004 [1151584576] >USER: clssnmHandleUpdate: SYNC(12) from node(2) completed
[    CSSD]2012-11-13 15:51:08.004 [1151584576] >USER: clssnmHandleUpdate: NODE 1 (node1) IS ACTIVE MEMBER OF CLUSTER
[    CSSD]2012-11-13 15:51:08.004 [1151584576] >USER: clssnmHandleUpdate: NODE 2 (node2) IS ACTIVE MEMBER OF CLUSTER
[    CSSD]2012-11-13 15:51:08.004 [1151584576] >TRACE: clssnmHandleUpdate: diskTimeout set to (200000)ms
[    CSSD]2012-11-13 15:51:08.081 [2246605696] >USER: NMEVENT_SUSPEND [00][00][00][00]
[    CSSD]2012-11-13 15:51:08.081 [1235503424] >TRACE: clssgmReconfigThread: started for reconfig (12)
[    CSSD]2012-11-13 15:51:08.081 [1235503424] >USER: NMEVENT_RECONFIG [00][00][00][06]
[    CSSD]2012-11-13 15:51:08.081 [1235503424] >TRACE: clssgmEstablishConnections: 2 nodes in cluster incarn 12
[    CSSD]2012-11-13 15:51:08.082 [1193544000] >TRACE: clssgmInitialRecv: (0xd9ae050) accepted a new connection from node 2 born at 1 active (2, 2), vers (10,3,1,2)
[    CSSD]2012-11-13 15:51:08.082 [1193544000] >TRACE: clssgmInitialRecv: conns done (2/2)
[    CSSD]2012-11-13 15:51:08.082 [1235503424] >TRACE: clssgmEstablishMasterNode: MASTER for 12 is node(2) birth(1)
[    CSSD]2012-11-13 15:51:08.082 [1235503424] >TRACE: clssgmChangeMasterNode: requeued 0 RPCs
[    CSSD]2012-11-13 15:51:08.083 [1193544000] >TRACE: clssgmHandleDBDone(): src/dest (2/65535) size(72) incarn 12
[    CSSD]CLSS-3000: reconfiguration successful, incarnation 12 with 2 nodes
[    CSSD]CLSS-3001: local node number 1, master node number 2
[    CSSD]2012-11-13 15:51:08.084 [1235503424] >TRACE: clssgmReconfigThread: completed for reconfig(12), with status(1)
[    CSSD]2012-11-13 15:51:08.268 [1162074432] >TRACE: clssgmClientConnectMsg: Connect from con(0xd9b4d50) proc(0xd9b9d50) pid() proto(10:2:1:1)
[    CSSD]2012-11-13 15:51:08.268 [1193544000] >TRACE: clssgmCommonAddMember: clsomon joined (1/0x1000000/#CSS_CLSSOMON)
[    CSSD]2012-11-13 15:51:08.269 [1162074432] >TRACE: clssgmClientConnectMsg: Connect from con(0xd9b7910) proc(0xd9ba0a0) pid() proto(10:2:1:1)
查看ocr，表决磁盘，存储，网络，裸设备权限，都没有发现问题，有时候执行/etc/init.d/init.crs start还会导致服务器重启，日志内容如下：
/var/log/message重启时的日志
Nov 13 15:51:03 node1 logger: Cluster Ready Services completed waiting on dependencies.
Nov 13 15:51:03 node1 logger: Cluster Ready Services completed waiting on dependencies.
Nov 13 16:10:54 node1 auditd[3667]: Audit daemon rotating log files
Nov 13 16:49:14 node1 auditd[3667]: Audit daemon rotating log files
Nov 13 16:50:37 node1 root: Cluster Ready Services completed waiting on dependencies.
Nov 13 16:52:07 node1 logger: Oracle CSS family monitor shutting down. 3
Nov 13 16:52:07 node1 root: Oracle CRSD 5797 set to stop
Nov 13 16:52:07 node1 root: Oracle CRSD 5797 shutdown completed
Nov 13 16:52:07 node1 root: Oracle EVMD set to stop
Nov 13 16:52:07 node1 root: Oracle CSSD being stopped
Nov 13 16:52:17 node1 root: Oracle CSSD being stopped
Nov 13 16:52:27 node1 root: Oracle EVMD set to stop
Nov 13 16:52:45 node1 root: Oracle CSSD being stopped
Nov 13 17:03:14 node1 root: Oracle CRSD 5797 set to stop
Nov 13 17:03:14 node1 root: Oracle CRSD 5797 shutdown completed
Nov 13 17:03:14 node1 root: Oracle EVMD set to stop
Nov 13 17:03:14 node1 root: Oracle CSSD being stopped
Nov 13 17:03:26 node1 root: Oracle Cluster Ready Services starting by user request.
Nov 13 17:03:35 node1 logger: Cluster Ready Services completed waiting on dependencies.
Nov 13 17:03:36 node1 logger: Oracle CSSD shell script failure. Duplicate CSSD.
Nov 13 17:03:36 node1 kernel: md: stopping all md devices.
Nov 13 17:21:49 node1 syslogd 1.4.1: restart.
Nov 13 17:21:49 node1 kernel: klogd 1.4.1, log source = /proc/kmsg started.
出现 Nov 13 17:03:36 node1 logger: Oracle CSSD shell script failure. Duplicate CSSD. 之后，服务器就重启了
在网上查了不少类似问题，其他网友无法启动CRS主要集中在几个方面：
1、/tmp权限不正确
2、删除/var/tmp/.oracle下的文件，再重启
3、oifcfg查看到网卡设置问题
但我遇到的问题，以上3项都是正常的，跟这个http://www.itpub.net/thread-1330782-1-1.html 问题类似。
请问这个问题是什么原因导致的？
帖子经 user1738965编辑过
帖子经 user1738965编辑过

关掉第1个节点，重启第2个节点，
crsd.log文件还是没有写入任何信息
alertnode2.log 部份日志
2012-11-14 12:57:53.568
[cssd(10296)]CRS-1605:CSSD voting file is online: /dev/raw/raw1. Details in /app/oracle/product/10.2.0/crs_1/log/node2/cssd/ocssd.log.
2012-11-14 13:01:13.616
[cssd(10296)]CRS-1601:CSSD Reconfiguration complete. Active nodes are node2 .
2012-11-14 13:01:13.776
[evmd(10080)]CRS-1401:EVMD started on node node2.
ocssd.log 部份日志
[    CSSD]2012-11-14 12:57:51.475 >USER: Oracle Database 10g CSS Release 10.2.0.3.0 Production Copyright 1996, 2004 Oracle. All rights reserved.
[ clsdmt]Listening to (ADDRESS=(PROTOCOL=ipc)(KEY=node2DBG_CSSD))
[    CSSD]2012-11-14 12:57:51.475 >USER: CSS daemon log for node node2, number 2, in cluster crs
[    CSSD]2012-11-14 12:57:51.482 [1618381696] >TRACE: clssscmain: local-only set to false
[    CSSD]2012-11-14 12:57:51.496 [1618381696] >TRACE: clssnmReadNodeInfo: added node 1 (node1) to cluster
[    CSSD]2012-11-14 12:57:51.500 [1618381696] >TRACE: clssnmReadNodeInfo: added node 2 (node2) to cluster
[    CSSD]2012-11-14 12:57:51.503 [1105389888] >TRACE: clssnm_skgxnmon: skgxn init failed
[    CSSD]2012-11-14 12:57:51.503 [1618381696] >TRACE: clssnm_skgxnonline: Using vacuous skgxn monitor
[    CSSD]2012-11-14 12:57:51.505 [1618381696] >TRACE: clssnmNMInitialize: misscount set to (60), impending reconfig threshold set to (56000)
[    CSSD]2012-11-14 12:57:51.505 [1618381696] >TRACE: clssnmNMInitialize: diskShortTimeout set to (57000)ms
[    CSSD]2012-11-14 12:57:51.506 [1618381696] >TRACE: clssnmNMInitialize: diskLongTimeout set to (200000)ms
[    CSSD]2012-11-14 12:57:51.508 [1618381696] >TRACE: clssnmDiskStateChange: state from 1 to 2 disk (0//dev/raw/raw1)
[    CSSD]2012-11-14 12:57:51.508 [1105389888] >TRACE: clssnmvDPT: spawned for disk 0 (/dev/raw/raw1)
[    CSSD]2012-11-14 12:57:53.552 [1105389888] >TRACE: clssnmDiskStateChange: state from 2 to 4 disk (0//dev/raw/raw1)
[    CSSD]2012-11-14 12:57:53.575 [1128057152] >TRACE: clssnmvKillBlockThread: spawned for disk 0 (/dev/raw/raw1) initial sleep interval (1000)ms
[    CSSD]2012-11-14 12:57:53.587 [1105389888] >TRACE: clssnmReadDskHeartbeat: node(1) is down. rcfg(15) wrtcnt(59321) LATS(3927324) Disk lastSeqNo(59321)
[    CSSD]2012-11-14 12:57:53.589 [1618381696] >TRACE: clssnmFatalInit: fatal mode enabled
[    CSSD]2012-11-14 12:57:53.589 [1149036864] >TRACE: clssnmconnect: connecting to node 2, flags 0x0001, connector 1
[    CSSD]2012-11-14 12:57:53.590 [1149036864] >TRACE: clssnmClusterListener: Listening on (ADDRESS=(PROTOCOL=tcp)(HOST=node2-priv)(PORT=49895))
[    CSSD]2012-11-14 12:57:53.590 [1149036864] >TRACE: clssnmconnect: connecting to node 0, flags 0x0000, connector 1
[    CSSD]2012-11-14 12:57:53.590 [1149036864] >TRACE: clssnmconnect: connecting to node 1, flags 0x0001, connector 0
[    CSSD]2012-11-14 12:57:53.595 [1149036864] >TRACE: clsc_send_msg: (0x108cf430) NS err (12571, 12560), transport (530, 111, 0)
[    CSSD]2012-11-14 12:57:53.600 [1159526720] >TRACE: clssgmclientlsnr: listening on (ADDRESS=(PROTOCOL=ipc)(KEY=Oracle_CSS_LclLstnr_crs_2))
[    CSSD]2012-11-14 12:57:53.600 [1159526720] >TRACE: clssgmclientlsnr: listening on (ADDRESS=(PROTOCOL=ipc)(KEY=OCSSD_LL_node2_crs))
[    CSSD]2012-11-14 12:57:53.601 [1190996288] >TRACE: clssgmPeerListener: Listening on (ADDRESS=(PROTOCOL=tcp)(DEV=19)(HOST=10.17.19.21)(PORT=52492))
[    CSSD]2012-11-14 12:57:53.601 [1201486144] >TRACE: clssnmPollingThread: Connection complete
[    CSSD]2012-11-14 12:57:53.601 [1211976000] >TRACE: clssnmSendingThread: Connection complete
[    CSSD]2012-11-14 12:57:53.601 [1222465856] >TRACE: clssnmRcfgMgrThread: Connection complete
[    CSSD]2012-11-14 12:58:00.616 [1222465856] >TRACE: clssnmRcfgMgrThread: Local Join
[    CSSD]2012-11-14 12:58:00.616 [1222465856] >TRACE: clssnmDoSyncUpdate: Initiating sync 1
[    CSSD]2012-11-14 12:58:00.616 [1222465856] >TRACE: clssnmDoSyncUpdate: diskTimeout set to (57000)ms
[    CSSD]2012-11-14 12:58:00.616 [1222465856] >TRACE: clssnmSetupAckWait: Ack message type (11)
[    CSSD]2012-11-14 12:58:00.616 [1222465856] >TRACE: clssnmSetupAckWait: node(2) is ALIVE
[    CSSD]2012-11-14 12:58:00.616 [1222465856] >TRACE: clssnmSendSync: syncSeqNo(1)
[    CSSD]2012-11-14 12:58:00.616 [1222465856] >TRACE: clssnmWaitForAcks: Ack message type(11), ackCount(1)
[    CSSD]2012-11-14 12:58:00.616 [1149036864] >TRACE: clssnmHandleSync: Acknowledging sync: src[2] srcName[node2] seq[1] sync[1]
[    CSSD]2012-11-14 12:58:00.616 [1149036864] >TRACE: clssnmHandleSync: diskTimeout set to (57000)ms
[    CSSD]2012-11-14 12:58:00.616 [1222465856] >TRACE: clssnmWaitForAcks: done, msg type(11)
[    CSSD]2012-11-14 12:58:00.616 [1222465856] >TRACE: clssnmSetupAckWait: Ack message type (13)
[    CSSD]2012-11-14 12:58:00.616 [1222465856] >TRACE: clssnmSetupAckWait: node(2) is ACTIVE
[    CSSD]2012-11-14 12:58:00.616 [1222465856] >TRACE: clssnmSendVote: syncSeqNo(1)
[    CSSD]2012-11-14 12:58:00.616 [1222465856] >TRACE: clssnmWaitForAcks: Ack message type(13), ackCount(1)
[    CSSD]2012-11-14 12:58:00.616 [1149036864] >TRACE: clssnmSendVoteInfo: node(2) syncSeqNo(1)
[    CSSD]2012-11-14 12:58:00.616 [1222465856] >TRACE: clssnmWaitForAcks: done, msg type(13)
[    CSSD]2012-11-14 12:58:00.616 [1222465856] >TRACE: clssnmCheckDskInfo: Checking disk info...
[    CSSD]2012-11-14 12:58:00.616 [1222465856] >TRACE: clssnmCheckDskInfo: diskTimeout set to (200000)ms
[    CSSD]2012-11-14 12:58:00.616 [1222465856] >TRACE: clssnmCheckDskInfo: node(1) timeout(7030) state_network(0) state_disk(3) misstime(3934354)
[    CSSD]2012-11-14 12:58:00.671 [1618381696] >USER: NMEVENT_SUSPEND [00][00][00][00]
[    CSSD]2012-11-14 12:58:01.616 [1222465856] >TRACE: clssnmCheckDskInfo: node(1) timeout(8030) state_network(0) state_disk(3) misstime(3934354)
[    CSSD]2012-11-14 12:58:02.618 [1222465856] >TRACE: clssnmCheckDskInfo: node(1) timeout(9030) state_network(0) state_disk(3) misstime(3935354)
[    CSSD]2012-11-14 12:58:03.619 [1222465856] >TRACE: clssnmCheckDskInfo: node(1) timeout(10030) state_network(0) state_disk(3) misstime(3936354)
[    CSSD]2012-11-14 12:58:04.620 [1222465856] >TRACE: clssnmCheckDskInfo: node(1) timeout(11030) state_network(0) state_disk(3) misstime(3937354)
[    CSSD]2012-11-14 12:58:05.620 [1222465856] >TRACE: clssnmCheckDskInfo: node(1) timeout(12030) state_network(0) state_disk(3) misstime(3938354)
[    CSSD]2012-11-14 12:58:06.621 [1222465856] >TRACE: clssnmCheckDskInfo: node(1) timeout(13030) state_network(0) state_disk(3) misstime(3939364)
[    CSSD]2012-11-14 12:58:07.622 [1222465856] >TRACE: clssnmCheckDskInfo: node(1) timeout(14030) state_network(0) state_disk(3) misstime(3940364)
中间这个clssnmCheckDskInfo日志有点多，超出回复字数限制，这里就去掉了一部份。
[    CSSD]2012-11-14 13:01:11.813 [1222465856] >TRACE: clssnmCheckDskInfo: node(1) timeout(198200) state_network(0) state_disk(3) misstime(4124704)
[    CSSD]2012-11-14 13:01:12.814 [1222465856] >TRACE: clssnmCheckDskInfo: node(1) timeout(199200) state_network(0) state_disk(3) misstime(4125704)
[    CSSD]2012-11-14 13:01:13.615 [1222465856] >TRACE: clssnmEvict: Start
[    CSSD]2012-11-14 13:01:13.615 [1222465856] >TRACE: clssnmWaitOnEvictions: Start
[    CSSD]2012-11-14 13:01:13.615 [1222465856] >TRACE: clssnmSetupAckWait: Ack message type (15)
[    CSSD]2012-11-14 13:01:13.615 [1222465856] >TRACE: clssnmSetupAckWait: node(2) is ACTIVE
[    CSSD]2012-11-14 13:01:13.615 [1222465856] >TRACE: clssnmSendUpdate: syncSeqNo(1)
[    CSSD]2012-11-14 13:01:13.615 [1222465856] >TRACE: clssnmWaitForAcks: Ack message type(15), ackCount(1)
[    CSSD]2012-11-14 13:01:13.615 [1149036864] >TRACE: clssnmUpdateNodeState: node 0, state (0/0) unique (0/0) prevConuni(0) birth (0/0) (old/new)
[    CSSD]2012-11-14 13:01:13.615 [1149036864] >TRACE: clssnmDeactivateNode: node 0 () left cluster
[    CSSD]2012-11-14 13:01:13.615 [1149036864] >TRACE: clssnmUpdateNodeState: node 1, state (0/0) unique (0/0) prevConuni(0) birth (0/0) (old/new)
[    CSSD]2012-11-14 13:01:13.615 [1149036864] >TRACE: clssnmDeactivateNode: node 1 (node1) left cluster
[    CSSD]2012-11-14 13:01:13.615 [1149036864] >TRACE: clssnmUpdateNodeState: node 2, state (2/2) unique (1352869071/1352869071) prevConuni(0) birth (1/1) (old/new)
[    CSSD]2012-11-14 13:01:13.615 [1149036864] >USER: clssnmHandleUpdate: SYNC(1) from node(2) completed
[    CSSD]2012-11-14 13:01:13.615 [1149036864] >USER: clssnmHandleUpdate: NODE 2 (node2) IS ACTIVE MEMBER OF CLUSTER
[    CSSD]2012-11-14 13:01:13.615 [1149036864] >TRACE: clssnmHandleUpdate: diskTimeout set to (200000)ms
[    CSSD]2012-11-14 13:01:13.615 [1222465856] >TRACE: clssnmWaitForAcks: done, msg type(15)
[    CSSD]2012-11-14 13:01:13.615 [1222465856] >TRACE: clssnmDoSyncUpdate: Sync Complete!
[    CSSD]2012-11-14 13:01:13.615 [1232955712] >TRACE: clssgmReconfigThread: started for reconfig (1)
[    CSSD]2012-11-14 13:01:13.615 [1232955712] >USER: NMEVENT_RECONFIG [00][00][00][04]
[    CSSD]2012-11-14 13:01:13.615 [1232955712] >TRACE: clssgmEstablishConnections: 1 nodes in cluster incarn 1
[    CSSD]2012-11-14 13:01:13.616 [1190996288] >TRACE: clssgmPeerListener: connects done (1/1)
[    CSSD]2012-11-14 13:01:13.616 [1232955712] >TRACE: clssgmEstablishMasterNode: MASTER for 1 is node(2) birth(1)
[    CSSD]2012-11-14 13:01:13.616 [1232955712] >TRACE: clssgmChangeMasterNode: requeued 0 RPCs
[    CSSD]2012-11-14 13:01:13.616 [1232955712] >TRACE: clssgmMasterCMSync: Synchronizing group/lock status
[    CSSD]2012-11-14 13:01:13.616 [1232955712] >TRACE: clssgmMasterSendDBDone: group/lock status synchronization complete
[    CSSD]CLSS-3000: reconfiguration successful, incarnation 1 with 1 nodes
[    CSSD]CLSS-3001: local node number 2, master node number 2
[    CSSD]2012-11-14 13:01:13.616 [1232955712] >TRACE: clssgmReconfigThread: completed for reconfig(1), with status(1)
[    CSSD]2012-11-14 13:01:13.732 [1159526720] >TRACE: clssgmClientConnectMsg: Connect from con(0x10a0b9a0) proc(0x10a10980) pid() proto(10:2:1:1)
[    CSSD]2012-11-14 13:01:13.732 [1159526720] >TRACE: clssgmClientConnectMsg: Connect from con(0x10a0e540) proc(0x10a10c50) pid() proto(10:2:1:1)
[    CSSD]2012-11-14 13:01:13.733 [1159526720] >TRACE: clssgmCommonAddMember: clsomon joined (2/0x1000000/#CSS_CLSSOMON)

10 G Rac reinstall problem,How to unregister VIP manully?

NODE NAME: rac1 rac2 rac3 .
I was removed rac3 from the cluster.
Now 2 nodes working and i'm trying to re-add the dropped one into the cluster.
I check crs_stat ,ifcfg ,olsnodes .There's no rac3 infomation any more.
But when i trying to run addNode.sh I got the problem
In step 2,"Specify Cluster Nodes to Add to Installtion"
I found rac3 in the Existing Node List ,*without* private-node-name and virtual host name!!!
well,i tried "srvctl modify nodeapps -node rac3 -A "to modify rac3 configuration. it works. rac 3 in the Existing Node List with a private-node-name and virtual host name now .
But when i go back to install page i must to Specify a new Node to go to next step....
So, could any one help me ?or tell me how to remove the residual information of VIP? I don't want to DD OCR ...
Thanks a lot;

I try to dump ocr and got something like this.I don't know is that help?
- <KEY>
<NAME>SYSTEM.evm.rmport.rac3</NAME>
<VALUE_TYPE>UNDEF</VALUE_TYPE>
- <VALUE>
- <![CDATA[
]]>
</VALUE>
- <KEY>
<NAME>DATABASE.ONS_HOSTS.rac3</NAME>
<VALUE_TYPE>ORATEXT</VALUE_TYPE>
- <VALUE>
- <![CDATA[ rac3
]]>
</VALUE>
<USER_PERMISSION>PROCR_ALL_ACCESS</USER_PERMISSION>
<GROUP_PERMISSION>PROCR_READ</GROUP_PERMISSION>
<OTHER_PERMISSION>PROCR_READ</OTHER_PERMISSION>
<USER_NAME>oracle</USER_NAME>
<GROUP_NAME>oinstall</GROUP_NAME>
- <KEY>
<NAME>DATABASE.ONS_HOSTS.rac3.PORT</NAME>
<VALUE_TYPE>ORATEXT</VALUE_TYPE>
- <VALUE>
- <![CDATA[
]]>
</VALUE>
<USER_PERMISSION>PROCR_ALL_ACCESS</USER_PERMISSION>
<GROUP_PERMISSION>PROCR_READ</GROUP_PERMISSION>
<OTHER_PERMISSION>PROCR_READ</OTHER_PERMISSION>
<USER_NAME>oracle</USER_NAME>
<GROUP_NAME>oinstall</GROUP_NAME>
</KEY>
</KEY>
</KEY>
</KEY>

Oracle RAC - network problem between nodes

Hi all,
I have the following configuration:
Two guests operation systems CentOS 4.8 (installed).
The host is Windows XP (where is installed the VMWare Server 2).
Oracle 10.2.0.1 and Oracle Clusterware (Not installed Yet, trying)
I've created two VMs (RAC1 and RAC2) on VMware Server2 for Oracle 10g RAC.
Each VM has 2 network adapters:
eth0: public
eth1: private
But, Into RAC1, when I try a ping to RAC2, I got the error destination host unreachable.
The subnet and the net mask is OK, I've set the /etc/hosts.
From my Host PC, I cannot to perform ping to RAC1 and RAC2 too.
I've tryed to set the ethernet to hostonly and bridged, but I got the same problem.
Is there any configuration we need to do?
thank you very much!!!!

From my Host PC, I cannot to perform ping to RAC1 and RAC2 too.Make sure you have both nodes in the network and must be under same subnet mask.
Is it mandatory the ethernet adapter of host is connect to a network?If its not in the network how you are going to access?

RAC - srvctl problem

We have two node Windows Advanced server 2000 RAC setup.
srvctl command show status of the database on first node.
whereas it is not showing any output on second node.
Even though all the services are running properly.
Can you let us how to solve this problem.
Thanks in Advance
-Prashant

Hi
as per u error it means it will fail to communicate with other node in cluster,and i think cluster is not properly working.
Try a test:-
shutdown the first node and check whether this node(where gsdctl show error)
are able to perform recovery of fail node ,check alert log file and post it here.
also check log file
$ORACLE_HOME/srvm/log
Thanks and Regards
Kuljeet Pal Singh

RAC Performance problem

Hi,
I configured 2-node RAC on Linux .But bench marks are surprising me.If i test the RAC with Loadbalace i'm getting 170 Transactions/sec.But,If i test the RAC with Single instance i'm getting 270 Transactions/sec.Could any one help me to solve this problem
Tx
Sarma

Hi,
Have you got the answer?
I have the same problem. Someone told me that RAC of Oracle8i was a hoax, he doubted Oracle9i improved RAC performance very much. I would rather not believe what he said, however, the test result of Oracle9i RAC on Compaq cl380 was so disappointed. I think there must be some bottlenecks that affect RAC performance. and I hope some technical guys from Oracle can come out to explain it.
Mike

RAC CRS problem

Similar Messages

Maybe you are looking for