OCR Problam init.cssd startcheck
Hi
After installing OCR it not run properly.
Follow some old post I tried some action – here the output
But I do not know what to do forward to fixed it ?
Some more question :
Way raw1 and raw2 permission is for user root and not oracle(by doing it I follow one of the guide) ?
What do the commend “dd if=/dev/zero of=votingdisk bs=1M count=256”
*[root@rac1 bin]# ps -ef|grep init.d*
root 4996 1 0 00:07 ? 00:00:00 /bin/sh /etc/init.d/init.evmd run
root 4997 1 0 00:07 ? 00:00:00 /bin/sh /etc/init.d/init.cssd fatal
root 4998 1 0 00:07 ? 00:00:00 /bin/sh /etc/init.d/init.crsd run
root 5044 4997 0 00:07 ? 00:00:00 /bin/sh /etc/init.d/init.cssd startcheck
root 5081 4996 0 00:07 ? 00:00:00 /bin/sh /etc/init.d/init.cssd startcheck
root 5237 4998 0 00:07 ? 00:00:00 /bin/sh /etc/init.d/init.cssd startcheck
root 25331 9511 0 09:37 pts/2 00:00:00 grep init.d
*[root@rac1 bin]# /etc/init.d/rawdevices status*
-bash: /etc/init.d/rawdevices: No such file or directory
*[root@rac1 bin]# ./crsctl check crs*
Failure 1 contacting CSS daemon
Cannot communicate with CRS
Cannot communicate with EVM
*[root@rac1 bin]# less /var/log/messages*
*[root@rac1 bin]# cat /tmp/crsctl.5081*
Failure -2 opening file handle for (raw2)
Failure 1 checking the CSS voting disk 'raw2'.
Not able to read adequate number of voting disks
*[root@rac1 bin]# cat /etc/oracle/ocr.loc*
ocrconfig_loc=/dev/raw/raw1
local_only=FALSE
*[root@rac1 bin]# ./crsctl query css votedisk*
0. 0 /dev/raw/raw2
located 1 votedisk(s).
*[root@rac1 bin]# ls -l /dev/raw*
total 0
crw-r----- 1 root oinstall 162, 1 Aug 18 11:21 raw1
crw-r----- 1 root oinstall 162, 2 Aug 18 11:21 raw2
crw-r--r-- 1 oracle oinstall 162, 3 Aug 18 11:21 raw3
crw-r--r-- 1 oracle oinstall 162, 4 Aug 18 11:21 raw4
crw-r--r-- 1 oracle oinstall 162, 5 Aug 18 11:21 raw5
*[root@rac1 bin]# raw -qa*
/dev/raw/raw1: bound to major 8, minor 17
/dev/raw/raw2: bound to major 8, minor 33
/dev/raw/raw3: bound to major 8, minor 49
/dev/raw/raw4: bound to major 8, minor 65
/dev/raw/raw5: bound to major 8, minor 81
AS Oracle User
*[oracle@rac1 crs]$ dd if=/dev/zero of=votingdisk bs=1M count=256*
256+0 records in
256+0 records out
268435456 bytes (268 MB) copied, 3.86209 seconds, 69.5 MB/s
refer:
http://oracleinstance.blogspot.com/2010/08/recover-corruptmissing-ocr-and-voting.html
http://download.oracle.com/docs/cd/B19306_01/rac.102/b28759/adminoc.htm#BJFJAJCI
if you metalink access, please refer
399482.1 How to recreate OCR/Voting disk accidentally deleted
358620.1 How to recreate OCR/Voting disk in 10gR1/R2 RAC
279793.1 How to Restore a Lost Voting Disk in 10g
source:http://www.juliandyke.com/References/Clusterware.html
Edited by: rajeysh on Aug 19, 2011 8:00 PM
Similar Messages
-
Init.cssd not found in /etc/init.cssd
Hi all.
I have installed 10g r 2 on my box [ linux ES 4 kernel 2.6.5... ].
Installation was successfull.
I want to configure ASM on this box. but I am not able to see any cssd deamon running.
and even init.cssd file is not in /etc/init.cssd.
Can you please suggest .. me ..
Ragards,
JSI want to use utl_file package and write a text file. I want that text file to be stored in my local machine. The init.ora parameter in the Oracle database server points to the Server path.Also Some 50 oraclients are installed for that DB server and each of us want to have our own local machine path for the text file to be created.Is there a way of doing this?
-
Do we need to edit init.cssd on oracle 10.2.0.1??
any metalink documentation on this??
For that you can just use "crsctl disable crs" as root. This will prevent CRS for starting on further reboots. Once you are ready to enable CRS auto-startup, you can use "crsctl enable crs"
Hope this is what you are looking for.
Thanks
Chandra -
Can't start CRS -- giving error about OCR device but ....?? Please help.
I am running CentOS 4.5 64-bit with kernel 2.6.9-55.EL on 2 AMD64 single CPU machines. Installed Oracle Clusterware 10.2.0.1 on both of these (pushing from node1). Then created RAC database using ASM. Everything worked fine & CRS/RAC were up (on both) for sometime. Then I stopped the resources & CRS/RAC. But, after sometime I can't start CRS on any of these! Getting error message (in /tmp/crsctl.pid):
OCR initialization failed accessing OCR device: PROC-26: Error while accessing the physical storage.
But I can see the FireWire drive/RAW partitions using "fdisk -l" and the permission/ownership are correct on the OCR/Voting Disk RAW partitions.
I also don't see any socket opened under /var/tmp/.oracle!
The is no other message in any other error/log file.
What is this & how to solve?
Thanks.Hi,
Pls refer to the following solution:
1. Please check the rights and owners of the ocr devices
2. Check if the ocrconfig_loc is pointing to the correct ocr in /var/opt/oracle/ocr.loc.
The ocrconfig_loc parameter specifies the location of the Oracle Cluster
Registry (OCR) used by the CSS daemon. The path up to the cdata directory is the Oracle home directory where the CSS daemon is running.
3. Reconfiguring Oracle Cluster Synchronization Services
a. $/u01/app/oracle/product/10G/bin/localconfig delete
Unexpected parameter: css
$
b - I killed init.cssd process
$ps -ef |grep css
root 1559 1 0.1 09:34:53 ?? 0:07.52 /sbin/init.d/init.cssd startcheck
root 16390 16070 0.0 12:33:53 pts/1 0:00.01 grep css
$kill -9 1559
$ps -ef |grep css
root 16407 16070 0.0 12:34:15 pts/1 0:00.01 grep css
c - Set up ORACLE_HOME
$export ORACLE_HOME=/u01/app/oracle/product/10G
$/u01/app/oracle/product/10G/bin/localconfig delete
Enter the following command to reconfigure the CSS daemon to run from this Oracle home:
# $ORACLE_HOME/bin/localconfig reset $ORACLE_HOME
The script stops the Oracle CSS daemon, reconfigures it in the new Oracle home, and then restarts it. When the system boots, the CSS daemon starts automatically from the new Oracle home.
Terry liu -
From root102.sh script = Startup will be queued to init within 30 seconds
Hi All,
I am trying to install RAC 10g[10.2.0.4] using Vmware (cent OS).
I am done with clusterware [10.2.0.1] instalaltion now I want to upgarde it to 10.2.0.4 so download patchset 3 and run the installer window...
it works fine but giving me message that needs to run "root102.sh" script [because I have not down the crsctl before start patch installer].
so when run the root102.sh ...it was working fine but suddenly network goes down. Now I dont know at which stage scrtip is running?
so I connect that node and run the "root102.sh" again but it stopeed at line "Startup will be queued to init within 30 seconds." since last 30 mins...
Anybody having any idea what would be the next step?
Thanks...hi,
this is the line where it stop...
+ /etc/init.d/init.crs start
Startup will be queued to init within 30 seconds.
+ /etc/init.d/init.cssd startcheck css
I can see the ps -ef | grep cssd
root 9915 9632 0 18:34 pts/1 00:00:00 /bin/sh /etc/init.d/init.cssd startcheck css
-- yes I can reboot this vm.
Also from second node I can see the below status of resources:
./crs_stat -t
Name Type Target State Host
ora....ac1.gsd application ONLINE OFFLINE
ora....ac1.ons application ONLINE OFFLINE
ora....ac1.vip application ONLINE ONLINE idcorarac2
ora....ac2.gsd application ONLINE ONLINE idcorarac2
ora....ac2.ons application ONLINE ONLINE idcorarac2
ora....ac2.vip application ONLINE ONLINE idcorarac2
Do I need to reinstall clusterware? or is there any way by just runnign some root script and comeout from this ?
Thanks...
Edited by: user12039625 on Sep 30, 2010 6:25 AM
Edited by: user12039625 on Sep 30, 2010 6:40 AM -
请给位帮忙看一下，如果有需要的资料，请留言，我上传给大家，谢谢了！
环境：
hp-ux 11.31
oracle 10.2.0.5
新增rac节点dt03，dt04
执行addNode脚本复制crs到新增节点成功后，执行root脚本报错如下：
root@dt04[] /u01/app/oracle/product/10.2.0/crs_1/root.sh
WARNING: directory '/u01/app/oracle/product/10.2.0' is not owned by root
WARNING: directory '/u01/app/oracle/product' is not owned by root
WARNING: directory '/u01/app/oracle' is not owned by root
WARNING: directory '/u01/app' is not owned by root
WARNING: directory '/u01' is not owned by root
No value set for the CRS parameter CRS_OCR_LOCATIONS. Using Values in paramfile.crs
Checking to see if Oracle CRS stack is already configured
Checking to see if any 9i GSD is up
/usr/lib/hpux64/dld.so: Unable to find library 'libnmapi2.so'.
9i GSD is running on node ''. Stop the GSD and rerun root.sh
检测脚本：
root@dt04[]sh -x /u01/app/oracle/product/10.2.0/crs_1/root.sh
+ /u01/app/oracle/product/10.2.0/crs_1/install/rootinstall
WARNING: directory '/u01/app/oracle/product/10.2.0' is not owned by root
WARNING: directory '/u01/app/oracle/product' is not owned by root
WARNING: directory '/u01/app/oracle' is not owned by root
WARNING: directory '/u01/app' is not owned by root
WARNING: directory '/u01' is not owned by root
+ /u01/app/oracle/product/10.2.0/crs_1/install/rootconfig
No value set for the CRS parameter CRS_OCR_LOCATIONS. Using Values in paramfile.crs
Checking to see if Oracle CRS stack is already configured
Checking to see if any 9i GSD is up
/usr/lib/hpux64/dld.so: Unable to find library 'libnmapi2.so'.
9i GSD is running on node ''. Stop the GSD and rerun root.sh
+ /u01/app/oracle/product/10.2.0/crs_1/install/rootconfig脚本如下：
#!/bin/sh
# rootconfig.sh for Oracle CRS homes
# This is run once per node during the Oracle CRS install.
# This script does the following:
# 1) Stop if any GSDs are running from 9.x oracle homes
# 2) Initialize new OCR device or upgrade the existing OCR device
# 3) Setup OCR for running CRS stack
# 4) Copy the CRS init script to init.d for init process to start
# 5) Start the CRS stack
# 6) Configure NodeApps if CRS is up and running on all nodes
# NOTE: Use sample paramfile in $ORA_CRS_HOME/srvm/admin/paramfile.sample for
# setting CRS parameters
# The following commands need to be run before Oracle Cluster Registry is
# populated.
# This is run during CRS installation and not during RAC
SILENT=false
ORA_CRS_HOME=/u01/app/oracle/product/10.2.0/crs_1
CRS_ORACLE_OWNER=oracle
CRS_DBA_GROUP=oinstall
CRS_VNDR_CLUSTER=false
CRS_OCR_LOCATIONS=
CRS_CLUSTER_NAME=
CRS_HOST_NAME_LIST=
CRS_NODE_NAME_LIST=dt01,dt02
CRS_PRIVATE_NAME_LIST=
CRS_LANGUAGE_ID=
CRS_VOTING_DISKS=
CRS_NODELIST=
CRS_NODEVIPS=
CRS_PARAMS="ORA_CRS_HOME CRS_ORACLE_OWNER CRS_DBA_GROUP CRS_VNDR_CLUSTER CRS_OCR_LOCATIONS CRS_CLUSTER_NAME CRS_HOST_NAME_LIST CRS_NODE_NAME_LIST CRS_PRIVATE_NAME_LIST CRS_LANGUAGE_ID CRS_VOTING_DISKS CRS_NODELIST CRS_NODEVIPS"
if [ -z "$CP" ]; then CP=/bin/cp; fi
if [ -z "$MV" ]; then MV=/bin/mv; fi
if [ -z "$CHOWN" ]; then CHOWN=/bin/chown; fi
if [ -z "$CHOWNH" ]; then CHOWNH="/bin/chown -h"; fi
if [ -z "$CHGRP" ]; then CHGRP=/bin/chgrp; fi
if [ -z "$CHMOD" ]; then CHMOD=/bin/chmod; fi
if [ -z "$ECHO" ]; then ECHO=/bin/echo; fi
if [ -z "$LS" ]; then LS=/bin/ls; fi
if [ -z "$KILL" ]; then KILL=/bin/kill; fi
if [ -z "$SLEEP" ]; then SLEEP=/bin/sleep; fi
if [ -z "$LN" ]; then LN=/bin/ln; fi
if [ -z "$LNS" ]; then LNS="/bin/ln -s"; fi
if [ -z "$RM" ]; then RM=/bin/rm; fi
if [ -z "$RMF" ]; then RMF="$RM -f"; fi
if [ -z "$CAT" ]; then CAT=/bin/cat; fi
if [ -z "$MKDIR" ]; then MKDIR="/bin/mkdir "; fi
if [ -z "$MKDIRP" ]; then MKDIRP="/bin/mkdir -p"; fi
if [ -z "$GREP" ]; then GREP=/bin/grep; fi
if [ -z "$CAT" ]; then CAT=/bin/cat; fi
if [ -z "$TOUCH" ]; then TOUCH=/bin/touch; fi
if [ -z "$AWK" ]; then AWK=/bin/awk; fi
if [ -z "$SYNC" ]; then SYNC=/bin/sync; fi
if [ -z "$ID" ]; then ID=/usr/bin/id; fi
if [ -z "$HOSTN" ]; then HOSTN=/bin/hostname; fi
if [ -z "$EXPRN" ]; then EXPRN=/usr/bin/expr; fi
if [ -z "$CUT" ]; then CUT=/usr/bin/cut; fi
if [ -z "$ISAINFOB" ]; then ISAINFOB="/usr/bin/isainfo -b"; fi
if [ -z "$TR" ]; then TR=/bin/tr;fi
#solaris on amd and SPARC has issue with /bin/tr
[ 'SunOS' = `/bin/uname` ] && TR=/usr/xpg4/bin/tr
#on linux tr is at /usr/bin/tr
[ 'Linux' = `/bin/uname` ] && TR=/usr/bin/tr
###Function for displaying usage of this script
usage()
printf "Usage:"
printf "$0 [-silent]\n"
printf " [-crshome <Oracle CRS home path>]\n"
printf " [-paramfile <Path of file specifying CRS parameter values>]\n"
##Function for parsing the command line arguments
parseArgs()
USER_ARGS=$*
while [ $# -gt 0 ];
do
if [ $1 = "-silent" ]; then
SILENT=1;
elif [ $1 = "-paramfile" ]; then
USE_FILE=true
if [ $# -ge 2 ]; then
CRS_ENV_FILE=$2;
shift;
else
usage;
exit 2
fi
elif [ $1 = "-crshome" ]; then
if [ $# -ge 2 ]; then
ORA_CRS_HOME=$2;
shift;
else
usage;
exit 2;
fi
else
usage;
exit 2
fi
shift;
done
##Function for reading CRS parameters from the given param file
readparamfile()
$ECHO "Reading $CRS_ENV_FILE.."
## Make sure that this input file has only "LHS=RHS" and empty lines
## Any other lines will be considered improper input for root script
awkOutput=`$AWK 'BEGIN { Ni=0 } \
/^#/ { next } \
/[A-Z]\=\`*\`/ { printf("\"%s\"\n", $0); next } \
/[A-Z_]\=/ { next } \
/^$/ { next } \
{ printf("\"%s\"\n", $0); next }' $CRS_ENV_FILE`
if [ "x$awkOutput" != "x" ]; then
$ECHO "The following unexpected input found in CRS parameter file: $awkOutput"
exit 1
fi
. $CRS_ENV_FILE
$ECHO "File ($CRS_ENV_FILE) is used for setting CRS variables."
$ECHO "CRS_ORACLE_OWNER=$CRS_ORACLE_OWNER"
$ECHO "CRS_DBA_GROUP=$CRS_DBA_GROUP"
$ECHO "CRS_VNDR_CLUSTER=$CRS_VNDR_CLUSTER"
$ECHO "CRS_OCR_LOCATIONS=$CRS_OCR_LOCATIONS"
$ECHO "CRS_CLUSTER_NAME=$CRS_CLUSTER_NAME"
$ECHO "CRS_HOST_NAME_LIST=$CRS_HOST_NAME_LIST"
$ECHO "CRS_NODE_NAME_LIST=$CRS_NODE_NAME_LIST"
$ECHO "CRS_PRIVATE_NAME_LIST=$CRS_PRIVATE_NAME_LIST"
$ECHO "CRS_LANGUAGE_ID=$CRS_LANGUAGE_ID"
$ECHO "CRS_VOTING_DISKS=$CRS_VOTING_DISKS"
$ECHO "CRS_NODELIST=$CRS_NODELIST"
$ECHO "CRS_NODEVIPS=$CRS_NODEVIPS"
validateInput()
##validates if any value is assigned to the script variables
for i in `echo $CRS_PARAMS`;
do
PARAM_NAME=$i
PARAM_VALUE=`eval echo \\$$i`
valid=`$ECHO $PARAM_VALUE | $AWK '/^%/ { print "false"; }'`
if [ "$valid" = "false" ];
then
$ECHO "No value set for the CRS parameter $PARAM_NAME. Use parameter file to set values";
usage;
return 1;
elif [ -z "$PARAM_VALUE" ]; then
echo "No value set for the CRS parameter $PARAM_NAME. Using Values in paramfile.crs";
. $CH/install/paramfile.crs
return 0;
fi
done
return 0;
validateVDisks()
#Checks for validity of voting disks
vDisks=`$ECHO $1 | $AWK -F',' '{ for(n=1;n<=NF;n++) print $n; }'`;
set `$ECHO $vDisks`;
ret=0;
while [ $# -gt 0 ];
do
vdisk=$1;
if [ ! -r $vdisk ]; then
$ECHO "\"$vdisk\" does not exist. Create it before proceeding."
$ECHO "Make sure that this file is shared across cluster nodes."
ret=1
else
$CHOWN $CRS_ORACLE_OWNER $vdisk || { $ECHO $?; exit 1; }
$CHGRP $CRS_DBA_GROUP $vdisk || { $ECHO $?; exit 1; }
$CHMOD 640 $vdisk || { $ECHO $?; exit 1; }
fi;
shift;
done;
return $ret;
validateOCRDisks()
if [ -f $OCR_SYNC_FILE ]; then
##Checking the OCR locations used by existing nodes in the cluster
NEW_OCR_FILE=`$AWK -F= '/ocrconfig_loc/ {print $2}' < $OCR_SYNC_FILE`
NEW_OCRMIRROR_FILE=`$AWK -F= '/ocrmirrorconfig_loc/ {print $2}' < $OCR_SYNC_FILE`
CRS_OCR_LOCATIONS=$NEW_OCR_FILE
if [ ! -z "$NEW_OCRMIRROR_FILE" ];
then
CRS_OCR_LOCATIONS=$CRS_OCR_LOCATIONS,$NEW_OCRMIRROR_FILE
fi
$ECHO "OCR LOCATIONS = " $CRS_OCR_LOCATIONS
else
##Syncing of OCR disks is not required
$ECHO ""
fi
return 0;
validateSICSS()
SICSS=false;
if [ -f "$OCRCONFIG" ]; then
# ocr.loc file exists and ocr location set here is
OCRCONFIG_LOC=`$AWK -F= '/ocrconfig_loc/ {print $2}' < $OCRCONFIG`
# ocr.loc already has a location specified. Check if it is used for
# single instance CSS/ASM
LOCAL_FLAG=`$AWK -F= '/local_only/ {print $2}' < $OCRCONFIG`
LOCAL_ONLY=`$ECHO $LOCAL_FLAG | $AWK '/[fF][aA][lL][sS][eE]/ { print "FALSE" }
/[tT][rR][uU][eE]/ { print "TRUE" }'`
# Previous installation of 10g single instance
if [ "$LOCAL_ONLY" = "TRUE" ];then
SICSS=true;
fi
fi
ret=0;
if $SICSS;
then
$ECHO "CSS is configured for single instance Oracle databases. Delete this configuration using the command 'localconfig delete' before proceeding with RAC configuration."
ret=1;
fi
return $ret;
NSSetup()
$ECHO "Setting up NS directories"
if [ ! -d /var/tmp/.oracle ];
then
$MKDIRP /var/tmp/.oracle || { return 1; };
fi
$CHMOD 01777 /var/tmp/.oracle || { return 1; }
$CHOWN root /var/tmp/.oracle || { return 1; }
if [ ! -d /tmp/.oracle ];
then
$MKDIRP /tmp/.oracle || { return 1; }
fi
$CHMOD 01777 /tmp/.oracle || { return 1; }
$CHOWN root /tmp/.oracle || { return 1; }
return 0;
还有一部分请见一楼信息接原文继续描述
# This script is intended to be run by root.
RUID=`$ID|$AWK -F\( '{print $2}'|$AWK -F\) '{print $1}'`
if [ ${RUID} != "root" ];then
$ECHO "You must be logged in as root to run $0."
$ECHO "Log in as root and restart $0 execution."
exit 1
fi
#If the hostname is an IP address, let hostname
#remain as IP address
HOST=`$HOSTN`
len1=`$EXPRN "$HOST" : '.*'`
len2=`$EXPRN match $HOST '[0-9]*\.[0-9]*\.[0-9]*\.[0-9]*'`
# Strip off domain name in case /bin/hostname returns
# FQDN hostname
if [ $len1 != $len2 ]; then
HOST=`$ECHO $HOST | cut -d'.' -f1`
fi
HOST=`$ECHO $HOST | $TR '[:upper:]' '[:lower:]'`
# File that $LOGMSG in init.cssd (and other places) will write
MSGFILE=/var/adm/messages
DISABLE_OPROCD=false;
USE_FILE=false
##Parse command line arguments passed to this script
parseArgs $*
if $USE_FILE;
then
if [ ! -f "$CRS_ENV_FILE" ]; then
$ECHO "The input file($CRS_ENV_FILE) specifying the parameter values for CRS variables is not found"
exit 1
fi
###Read CRS parameter values from param file
readparamfile
fi
ORACLE_HOME=$ORA_CRS_HOME
export ORA_CRS_HOME
export ORACLE_HOME
CH=$ORA_CRS_HOME
OCR_SYNC_FILE=$CH/srvm/admin/ocr.loc
##validating the parameter values
validateInput || { $ECHO $?; exit 1; }
CRSCTL=$CH/bin/crsctl
#make sure Voting disks exists
validateVDisks $CRS_VOTING_DISKS || { $ECHO $?; exit 1; }
# Definitions to Add/Remove inittab entries
ADDITAB="$CAT \$IT | $GREP -v init.evmd | $GREP -v init.cssd | $GREP -v init.crsd > \$IT.no_crs || { $ECHO $?; exit 1; } ; \
$CAT \$IT.no_crs $CH/crs/admin/inittab > \$IT.tmp || { $ECHO $?; exit 1; }; \
$CP \$IT.tmp \$IT.crs || { $ECHO $?; exit 1; }; \
\$SYNC ; \$SYNC ; \$SYNC ; \
$MV \$IT.tmp \$IT || { $ECHO $?; exit 1; };\
\$SYNC ; \$SYNC ; \$SYNC "
RMITAB="$CAT \$IT | $GREP -v init.evmd | $GREP -v init.cssd | $GREP -v init.crsd > \$IT.tmp || { $ECHO $?; exit 1; } ; \
$CP \$IT.tmp \$IT.no_crs || { $ECHO $?; exit 1; }; \
\$SYNC ; \$SYNC ; \$SYNC ; \
$MV \$IT.tmp \$IT || { $ECHO $?; exit 1; }; \
\$SYNC ; \$SYNC ; \$SYNC "
CLSCFG_MISCNT=""
UNAME=/bin/uname
PLATFORM=`$UNAME`
case $PLATFORM in
Linux) LD_LIBRARY_PATH=$ORA_CRS_HOME/lib
export LD_LIBRARY_PATH
SO_EXT=so
DIRNAME=/usr/bin/dirname
ID=/etc/init.d
RCSDIR="/etc/rc.d/rc3.d /etc/rc.d/rc5.d"
RCKDIR="/etc/rc.d/rc0.d /etc/rc.d/rc1.d /etc/rc.d/rc2.d /etc/rc.d/rc4.d /etc/rc.d/rc6.d"
RC_START=S96
RC_KILL=K96
IT=/etc/inittab
INIT=/sbin/init
OCRCONFIGDIR=/etc/oracle
SRVCONFIG=/var/opt/oracle/srvConfig.loc
OCRCONFIG=/etc/oracle/ocr.loc
OPROCDDIR=/etc/oracle/oprocd
SCRBASE=/etc/oracle/scls_scr
CLSCFG_MISCNT="-misscount 60"
HP-UX) MACH_HARDWARE=`/bin/uname -m`
if [ "$MACH_HARDWARE" = "ia64" ]; then
SO_EXT=so
NMAPIDIR_64=/opt/nmapi/nmapi2/lib/hpux64
NMAPIDIR_32=/opt/nmapi/nmapi2/lib/hpux32
else
SO_EXT=sl
NMAPIDIR_64=/opt/nmapi/nmapi2/lib/pa20_64
NMAPIDIR_32=/opt/nmapi/nmapi2/lib
fi
LD_LIBRARY_PATH=$ORA_CRS_HOME/lib:$NMAPIDIR_64:/usr/lib:$LD_LIBRARY_PATH
SHLIB_PATH=$ORA_CRS_HOME/lib32:$NMAPIDIR_32:$SHLIB_PATH
export LD_LIBRARY_PATH
export SHLIB_PATH
DIRNAME=/bin/dirname
ID=/sbin/init.d
RCSDIR="/sbin/rc3.d"
RCKDIR="/sbin/rc2.d"
RC_START=S960
RC_KILL=K001
IT=/etc/inittab
INIT=/sbin/init
if [ ! -f $ORA_CRS_HOME/lib/libskgxns.${SO_EXT} ]; then
$MV $ORA_CRS_HOME/lib/libskgxn2.${SO_EXT} $ORA_CRS_HOME/lib/libskgxns.${SO_EXT}
fi
if [ ! -f $ORA_CRS_HOME/lib32/libskgxns.${SO_EXT} ]; then
$MV $ORA_CRS_HOME/lib32/libskgxn2.${SO_EXT} $ORA_CRS_HOME/lib32/libskgxns.${SO_EXT}
fi
if [ -f ${NMAPIDIR_64}/libnmapi2.${SO_EXT} ]; then
$LN -sf ${NMAPIDIR_64}/libnmapi2.${SO_EXT} $ORA_CRS_HOME/lib/libskgxn2.${SO_EXT}
$LN -sf ${NMAPIDIR_32}/libnmapi2.${SO_EXT} $ORA_CRS_HOME/lib32/libskgxn2.${SO_EXT}
else
$LN -sf $ORA_CRS_HOME/lib/libskgxns.${SO_EXT} $ORA_CRS_HOME/lib/libskgxn2.${SO_EXT}
$LN -sf $ORA_CRS_HOME/lib32/libskgxns.${SO_EXT} $ORA_CRS_HOME/lib32/libskgxn2.${SO_EXT}
fi
$CHOWNH $CRS_ORACLE_OWNER $ORA_CRS_HOME/lib/libskgxn2.${SO_EXT}
$CHOWNH $CRS_ORACLE_OWNER $ORA_CRS_HOME/lib32/libskgxn2.${SO_EXT}
OCRCONFIGDIR=/var/opt/oracle
SRVCONFIG=/var/opt/oracle/srvConfig.loc
OCRCONFIG=/var/opt/oracle/ocr.loc
OPROCDDIR=/var/opt/oracle/oprocd
SCRBASE=/var/opt/oracle/scls_scr
SunOS) MACH_HARDWARE=`/bin/uname -i`
ARCH=""
case $MACH_HARDWARE in
i86pc)
CLUSTERDIR=/opt/ORCLcluster
LD_LIBRARY_PATH=$ORA_CRS_HOME/lib:$CLUSTERDIR/lib:/usr/lib:/usr/ucblib:$LD_LIBRARY_PATH
export LD_LIBRARY_PATH
ARCH=`$ISAINFOB`
if [ ! -d $ORA_CRS_HOME/lib32 ]; then
if [ "$ARCH" = "32" ];then
NO_SUNCLUSTER=true
fi
ARCH=32
fi
CLUSTERDIR=/opt/ORCLcluster
LD_LIBRARY_PATH=$ORA_CRS_HOME/lib32:$CLUSTERDIR/lib:/usr/lib:/usr/ucblib:$LD_LIBRARY_PATH
LD_LIBRARY_PATH_64=$ORA_CRS_HOME/lib:$CLUSTERDIR/lib:/usr/lib:/usr/ucblib:$LD_LIBRARY_PATH_64
export LD_LIBRARY_PATH
export LD_LIBRARY_PATH_64
esac
SO_EXT=so
DIRNAME=/bin/dirname
ID=/etc/init.d
RCSDIR="/etc/rc3.d"
RCKDIR="/etc/rc0.d /etc/rc1.d /etc/rc2.d /etc/rcS.d"
RC_START=S96
RC_KILL=K96
IT=/etc/inittab
INIT=/sbin/init
if [ "${MACH_HARDWARE}${ARCH}" != "i86pc32" ]; then
if [ ! -f $ORA_CRS_HOME/lib/libskgxns.${SO_EXT} ]; then
$MV $ORA_CRS_HOME/lib/libskgxn2.${SO_EXT} $ORA_CRS_HOME/lib/libskgxns.${SO_EXT}
fi
if [ ! -f $ORA_CRS_HOME/lib32/libskgxns.${SO_EXT} ]; then
$MV $ORA_CRS_HOME/lib32/libskgxn2.${SO_EXT} $ORA_CRS_HOME/lib32/libskgxns.${SO_EXT}
fi
# Bug 4624810 : libskgxn2 will be linked anyway. Remove them, to avoid stale link issue
# This issue happens only in solaris. ln -sf works in HP and AIX properly.
$RM -f $ORA_CRS_HOME/lib/libskgxn2.${SO_EXT} 2>/dev/null
$RM -f $ORA_CRS_HOME/lib32/libskgxn2.${SO_EXT} 2>/dev/null
if [ -f $CLUSTERDIR/lib/libskgxn2.${SO_EXT} ]; then
$LN -sf $CLUSTERDIR/lib/libskgxn2.${SO_EXT} $ORA_CRS_HOME/lib/libskgxn2.${SO_EXT}
$LN -sf $ORA_CRS_HOME/lib32/libskgxns.${SO_EXT} $ORA_CRS_HOME/lib32/libskgxn2.${SO_EXT}
else
$LN -sf $ORA_CRS_HOME/lib/libskgxns.${SO_EXT} $ORA_CRS_HOME/lib/libskgxn2.${SO_EXT}
$LN -sf $ORA_CRS_HOME/lib32/libskgxns.${SO_EXT} $ORA_CRS_HOME/lib32/libskgxn2.${SO_EXT}
fi
$CHOWNH $CRS_ORACLE_OWNER $ORA_CRS_HOME/lib/libskgxn2.${SO_EXT}
$CHOWNH $CRS_ORACLE_OWNER $ORA_CRS_HOME/lib32/libskgxn2.${SO_EXT}
else
if [ ! -f $ORA_CRS_HOME/lib/libskgxns.${SO_EXT} ]; then
$MV $ORA_CRS_HOME/lib/libskgxn2.${SO_EXT} $ORA_CRS_HOME/lib/libskgxns.${SO_EXT}
fi
$RM -f $ORA_CRS_HOME/lib/libskgxn2.${SO_EXT} 2>/dev/null
if [ "$NO_SUNCLUSTER" != "true" ] ; then
if [ -f $CLUSTERDIR/lib32/libskgxn2.${SO_EXT} ]; then
$LN -sf $CLUSTERDIR/lib32/libskgxn2.${SO_EXT} $ORA_CRS_HOME/lib/libskgxn2.${SO_EXT}
else
$LN -sf $ORA_CRS_HOME/lib/libskgxns.${SO_EXT} $ORA_CRS_HOME/lib/libskgxn2.${SO_EXT}
fi
else
$LN -sf $ORA_CRS_HOME/lib/libskgxns.${SO_EXT} $ORA_CRS_HOME/lib/libskgxn2.${SO_EXT}
fi
$CHOWNH $CRS_ORACLE_OWNER $ORA_CRS_HOME/lib/libskgxn2.${SO_EXT}
fi
OCRCONFIGDIR=/var/opt/oracle
SRVCONFIG=/var/opt/oracle/srvConfig.loc
OCRCONFIG=/var/opt/oracle/ocr.loc
OPROCDDIR=/var/opt/oracle/oprocd
SCRBASE=/var/opt/oracle/scls_scr
AIX) CLUSTERDIR=/opt/ORCLcluster
LIBPATH=$ORA_CRS_HOME/lib:$CLUSTERDIR/lib:$ORA_CRS_HOME/lib32:$CLUSTERDIR/lib32:/usr/lib:$LIBPATH
LD_LIBRARY_PATH=$LIBPATH:$LD_LIBRARY_PATH
export LIBPATH
export LD_LIBRARY_PATH
SO_EXT=so
SO_AR_EXT=a
DIRNAME=/bin/dirname
ID=/etc
RCSDIR="/etc/rc.d/rc2.d"
RCKDIR="/etc/rc.d/rc2.d"
RC_START=S96
RC_KILL=K96
IT=/etc/inittab
INIT=/usr/sbin/init
ADDITAB="$ECHO \"Adding daemons to inittab\";
while read line; \
do \
rflds=\`echo \$line | $CUT -d ':' -f 1-3\`; \
lfld=\`echo \$line | $CUT -d ':' -f 4-\`; \
mkitab \$rflds:\"\$lfld\"; \
done < $CH/crs/admin/inittab"
RMITAB="while read line; \
do \
identifier=\`echo \$line | $CUT -d ':' -f 1\`; \
rmitab \$identifier 2>/dev/null; \
done < $CH/crs/admin/inittab"
if [ ! -f $ORA_CRS_HOME/lib/libskgxns.${SO_AR_EXT} ]; then
$MV $ORA_CRS_HOME/lib/libskgxn2.${SO_EXT} $ORA_CRS_HOME/lib/libskgxns.${SO_EXT}
$MV $ORA_CRS_HOME/lib/libskgxn2.${SO_AR_EXT} $ORA_CRS_HOME/lib/libskgxns.${SO_AR_EXT}
fi
if [ ! -f $ORA_CRS_HOME/lib32/libskgxns.${SO_AR_EXT} ]; then
$MV $ORA_CRS_HOME/lib32/libskgxn2.${SO_EXT} $ORA_CRS_HOME/lib32/libskgxns.${SO_EXT}
$MV $ORA_CRS_HOME/lib32/libskgxn2.${SO_AR_EXT} $ORA_CRS_HOME/lib32/libskgxns.${SO_AR_EXT}
fi
if [ -f ${CLUSTERDIR}/lib/libskgxn2.${SO_AR_EXT} ]; then
$LN -sf ${CLUSTERDIR}/lib/libskgxn2.${SO_EXT} $ORA_CRS_HOME/lib/libskgxn2.${SO_EXT}
$LN -sf ${CLUSTERDIR}/lib/libskgxn2.${SO_AR_EXT} $ORA_CRS_HOME/lib/libskgxn2.${SO_AR_EXT}
$LN -sf ${CLUSTERDIR}/lib32/libskgxn2.${SO_EXT} $ORA_CRS_HOME/lib32/libskgxn2.${SO_EXT}
$LN -sf ${CLUSTERDIR}/lib32/libskgxn2.${SO_AR_EXT} $ORA_CRS_HOME/lib32/libskgxn2.${SO_AR_EXT}
else
$LN -sf $ORA_CRS_HOME/lib/libskgxns.${SO_EXT} $ORA_CRS_HOME/lib/libskgxn2.${SO_EXT}
$LN -sf $ORA_CRS_HOME/lib/libskgxns.${SO_AR_EXT} $ORA_CRS_HOME/lib/libskgxn2.${SO_AR_EXT}
$LN -sf $ORA_CRS_HOME/lib32/libskgxns.${SO_EXT} $ORA_CRS_HOME/lib32/libskgxn2.${SO_EXT}
$LN -sf $ORA_CRS_HOME/lib32/libskgxns.${SO_AR_EXT} $ORA_CRS_HOME/lib32/libskgxn2.${SO_AR_EXT}
fi
$CHOWNH $CRS_ORACLE_OWNER $ORA_CRS_HOME/lib/libskgxn2.${SO_EXT}
$CHOWNH $CRS_ORACLE_OWNER $ORA_CRS_HOME/lib/libskgxn2.${SO_AR_EXT}
$CHOWNH $CRS_ORACLE_OWNER $ORA_CRS_HOME/lib32/libskgxn2.${SO_EXT}
$CHOWNH $CRS_ORACLE_OWNER $ORA_CRS_HOME/lib32/libskgxn2.${SO_AR_EXT}
OCRCONFIGDIR=/etc/oracle
SRVCONFIG=/var/opt/oracle/srvConfig.loc
OCRCONFIG=/etc/oracle/ocr.loc
OPROCDDIR=/etc/oracle/oprocd
SCRBASE=/etc/oracle/scls_scr
OSF1) LD_LIBRARY_PATH=$ORA_CRS_HOME/lib:/shlib:/usr/lib
export LD_LIBRARY_PATH
SO_EXT=so
DIRNAME=/usr/bin/dirname
ID="/sbin/init.d"
RCSDIR="/sbin/rc3.d"
RCKDIR="/sbin/rc3.d"
RC_START=S96
RC_KILL=K96
IT=/etc/inittab
INIT=/sbin/init
if [ ! -f $ORA_CRS_HOME/lib/libskgxns.${SO_EXT} ]; then
$MV $ORA_CRS_HOME/lib/libskgxn2.${SO_EXT} $ORA_CRS_HOME/lib/libskgxns.${SO_EXT}
fi
if [ -f /shlib/libdlm.${SO_EXT} ]; then
$LN -sf /$ORA_CRS_HOME/lib/libskgxnr.${SO_EXT} $ORA_CRS_HOME/lib/libskgxn2.${SO_EXT}
else
$LN -sf $ORA_CRS_HOME/lib/libskgxns.${SO_EXT} $ORA_CRS_HOME/lib/libskgxn2.${SO_EXT}
fi
$CHOWNH $CRS_ORACLE_OWNER $ORA_CRS_HOME/lib/libskgxn2.${SO_EXT}
OCRCONFIGDIR=/var/opt/oracle
SRVCONFIG=/var/opt/oracle/srvConfig.loc
OCRCONFIG=/var/opt/oracle/ocr.loc
OPROCDDIR=/var/opt/oracle/oprocd
SCRBASE=/var/opt/oracle/scls_scr
DISABLE_OPROCD=true;
*) /bin/echo "ERROR: Unknown Operating System"
exit -1
esac
# Create CDSL for $IT files in Tru64
if [ ${PLATFORM} = "OSF1" ]; then
for file in $IT $IT.crs $IT.no_crs $IT.cssd $IT.no_cssd $IT.tmp $IT.orig \
$IT.prepatch $IT.nocrspatch
do
if [ ! -L $file ]; then
if [ -e $file ]; then
/usr/sbin/mkcdsl -fa $file
else
/usr/sbin/mkcdsl -f $file
fi
fi
done
fi
SCRDIR=$SCRBASE/$HOST
FATALFILE=$SCRDIR/$CRS_ORACLE_OWNER/cssfatal
OCR_CDATA_DIR=$ORA_CRS_HOME/cdata
OCR_BACKUP_DIR=$ORA_CRS_HOME/cdata/$CRS_CLUSTER_NAME
LOGDIR=$ORA_CRS_HOME/log/$HOST
CRS_LOGDIR=$ORA_CRS_HOME/log/$HOST/crsd
EVM_LOGDIR=$ORA_CRS_HOME/log/$HOST/evmd
CSS_LOGDIR=$ORA_CRS_HOME/log/$HOST/cssd
CLSMON_LOGDIR=$ORA_CRS_HOME/log/$HOST/cssd/oclsmon
OCR_LOGDIR=$ORA_CRS_HOME/log/$HOST/client
RES_LOGDIR=$ORA_CRS_HOME/log/$HOST/racg
RES_COREDIR1=$RES_LOGDIR/racgmain
RES_COREDIR2=$RES_LOGDIR/racgeut
RES_COREDIR3=$RES_LOGDIR/racgevtf
ADMIN_LOGDIR=$ORA_CRS_HOME/log/$HOST/admin
# some directories for OPROCD to store the domain
# sockets we use for client communication
OPROCDCHECKDIR=$OPROCDDIR/check
OPROCDSTOPDIR=$OPROCDDIR/stop
OPROCDFATALDIR=$OPROCDDIR/fatal
###Validate if single instance CSS is configured
validateSICSS || { $ECHO $?; exit 1; }
##Checking if CRS has already been configured
$ECHO "Checking to see if Oracle CRS stack is already configured"
if [ -f $FATALFILE ] && [ -f $OCRCONFIG ];
then
$ECHO "Oracle CRS stack is already configured and will be running under init(1M)"
exit 0
fi
LSDB=$ORA_CRS_HOME/bin/lsdb
# bug 4873212 : oracm is considered as non-vendor. Check it's existence in IA64
if [ "$CRS_VNDR_CLUSTER" != "true" ] ;
then
if [ "$PLATFORM" = "Linux" ];
then
$ORA_CRS_HOME/bin/lsnodes > /dev/null 2>&1
if [ "$?" = "0" ]; then
CRS_VNDR_CLUSTER=true;
fi
fi
fi
if $CRS_VNDR_CLUSTER;
then
$ECHO "Checking to see if any 9i GSD is up"
GSDNODE=`$LSDB -g`
GSDCHK_STATUS=$?
if [ $GSDCHK_STATUS != 0 ];then
$ECHO "9i GSD is running on node '$GSDNODE'. Stop the GSD and rerun root.sh"
exit 1
fi
fi
if [ ! -d "$OCRCONFIGDIR" ];then
$ECHO "$OCRCONFIGDIR does not exist. Creating it now."
$MKDIRP $OCRCONFIGDIR || { $ECHO $?; exit 1; }
fi
$CHOWN root $OCRCONFIGDIR || { $ECHO $?; exit 1; }
$CHGRP $CRS_DBA_GROUP $OCRCONFIGDIR || { $ECHO $?; exit 1; }
$CHMOD 755 $OCRCONFIGDIR || { $ECHO $?; exit 1; }
# create a number of subdirectories for use by OPROCD
# These should be owned by root and only allow for
# root and group access hence the 770 permissions
if [ "$DISABLE_OPROCD" = "false" ]
then
if [ ! -d "$OPROCDDIR" ]; then
$MKDIRP $OPROCDDIR || { $ECHO $?; exit 1; }
$MKDIRP $OPROCDCHECKDIR || { $ECHO $?; exit 1; }
$MKDIRP $OPROCDSTOPDIR || { $ECHO $?; exit 1; }
$MKDIRP $OPROCDFATALDIR || { $ECHO $?; exit 1; }
$CHOWN root $OPROCDDIR || { $ECHO $?; exit 1; }
$CHOWN root $OPROCDCHECKDIR || { $ECHO $?; exit 1; }
$CHOWN root $OPROCDSTOPDIR || { $ECHO $?; exit 1; }
$CHOWN root $OPROCDFATALDIR || { $ECHO $?; exit 1; }
$CHMOD 775 $OPROCDDIR || { $ECHO $?; exit 1; }
$CHMOD 770 $OPROCDCHECKDIR || { $ECHO $?; exit 1; }
$CHMOD 770 $OPROCDSTOPDIR || { $ECHO $?; exit 1; }
$CHMOD 770 $OPROCDFATALDIR || { $ECHO $?; exit 1; }
fi
fi # End "DISABLE_OPROCD=false"
## Copy reboot_toc to /var/opt/oracle/bin for HPUX
## Copy opriproc to /etc/oracle/bin for AIX
case $PLATFORM in
HP-UX)
$ECHO "Copying reboot_toc to /var/opt/oracle/bin for HPUX"
REBOOT_TOC_DIR=/var/opt/oracle/bin
REBOOT_TOC_FILE=reboot_toc
if [ ! -d $REBOOT_TOC_DIR ]; then
$MKDIRP $REBOOT_TOC_DIR
fi
if [ -f $REBOOT_TOC_DIR/$REBOOT_TOC_FILE ]; then
$CHMOD 644 $REBOOT_TOC_DIR/$REBOOT_TOC_FILE
fi
$CP $CH/bin/$REBOOT_TOC_FILE $REBOOT_TOC_DIR/$REBOOT_TOC_FILE
$CHOWN root $REBOOT_TOC_DIR
$CHMOD 555 $REBOOT_TOC_DIR/$REBOOT_TOC_FILE
AIX)
$ECHO "Copying opriproc to /etc/oracle/bin for AIX"
OPRIPROC_DIR=/etc/oracle/bin
OPRIPROC_FILE=opriproc
if [ ! -d $OPRIPROC_DIR ]; then
$MKDIRP $OPRIPROC_DIR
fi
# Reset permission to overwrite
if [ -f $OPRIPROC_DIR/$OPRIPROC_FILE ]; then
$CHMOD 644 $OPRIPROC_DIR/$OPRIPROC_FILE
fi
# Copy from CRSHOME and set the permission
$CP $CH/bin/$OPRIPROC_FILE $OPRIPROC_DIR/$OPRIPROC_FILE
$CHOWN root $OPRIPROC_DIR
$CHMOD 555 $OPRIPROC_DIR/$OPRIPROC_FILE
$CHMOD 500 $OPRIPROC_DIR
esac
# Create SCR Home dir, owned by root 755
$MKDIRP $SCRDIR || { $ECHO $?; exit 1; }
$CHOWN root $SCRBASE || { $ECHO $?; exit 1; }
$CHOWN root $SCRDIR || { $ECHO $?; exit 1; }
$CHMOD 755 $SCRBASE || { $ECHO $?; exit 1; }
$CHMOD 755 $SCRDIR || { $ECHO $?; exit 1; }
$CHMOD 644 $IT $IT.orig $IT.no_cssd $IT.cssd $IT.crs $IT.no_crs 2>/dev/null
# Create CRS log directories
for d in $LOGDIR $CRS_LOGDIR $EVM_LOGDIR $CSS_LOGDIR $OCR_LOGDIR $RES_LOGDIR $ADMIN_LOGDIR $RES_COREDIR1 $RES_COREDIR2 $RES_COREDIR3 $CLSMON_LOGDIR
do
$MKDIRP $d || { $ECHO $?; exit 1; }
done
for d in $LOGDIR $CRS_LOGDIR
do
$CHOWN root $d || { $ECHO $?; exit 1; }
$CHGRP $CRS_DBA_GROUP $d || { $ECHO $?; exit 1; }
done
for d in $EVM_LOGDIR $CSS_LOGDIR $OCR_LOGDIR $RES_LOGDIR $ADMIN_LOGDIR $RES_COREDIR1 $RES_COREDIR2 $RES_COREDIR3 $CLSMON_LOGDIR
do
$CHOWN $CRS_ORACLE_OWNER $d || { $ECHO $?; exit 1; }
$CHGRP $CRS_DBA_GROUP $d || { $ECHO $?; exit 1; }
done
$CHMOD 1755 $LOGDIR || { $ECHO $?; exit 1; }
$CHMOD 1775 $RES_LOGDIR || { $ECHO $?; exit 1; }
$CHMOD 1777 $RES_COREDIR1 || { $ECHO $?; exit 1; }
$CHMOD 1777 $RES_COREDIR2 || { $ECHO $?; exit 1; }
$CHMOD 1777 $RES_COREDIR3 || { $ECHO $?; exit 1; }
for d in $CRS_LOGDIR $EVM_LOGDIR $CSS_LOGDIR $OCR_LOGDIR $ADMIN_LOGDIR
do
$CHMOD 750 $d || { $ECHO $?; exit 1; }
done
#create EVM auth dir
$MKDIRP $CH/evm/auth
$CHOWN $CRS_ORACLE_OWNER $CH/evm/auth
$CHMOD 1755 $CH/evm/auth
# Create an empty alert log file
ALERTFILE=$LOGDIR/alert$HOST.log
$TOUCH $ALERTFILE
$CHMOD 664 $ALERTFILE
$CHGRP $CRS_DBA_GROUP $ALERTFILE
$CHOWN root $ALERTFILE
##Checking the repository location used by 9.x installations
SRVCONFIG_LOC=""
if [ -f "$SRVCONFIG" ]; then
# srvConfig.loc file exists and repository location is
SRVCONFIG_LOC=`$AWK -F= '/srvconfig_loc/ {print $2}' < $SRVCONFIG`
if [ "$SRVCONFIG_LOC" = "/dev/null" ]; then
# 9.x srvconfig_loc is already invalidated. So ignore it
# take the location entered by user to polulate ocr.loc
SRVCONFIG_LOC=""
fi
fi
##Checking the OCR locations used by 10gR1 or previous 10gR2 installations
OCRCONFIG_LOC=""
OCRMIRRORCONFIG_LOC=""
if [ -f "$OCRCONFIG" ]; then
# ocr.loc file exists and ocr location set here is
OCRCONFIG_LOC=`$AWK -F= '/ocrconfig_loc/ {print $2}' < $OCRCONFIG`
OCRMIRRORCONFIG_LOC=`$AWK -F= '/ocrmirrorconfig_loc/ {print $2}' < $OCRCONFIG`
fi
##If the ocrconfig_loc property is not set in ocr.loc then
##we will check if srvconfig_loc property is set in srvConfig.loc file.
##if set the we set ocrconfig_loc = srvconfig_loc
OCRFILE=$OCRCONFIG
if [ -z "$OCRCONFIG_LOC" ];
then
##ocrconfig_loc is empty
##Lets set this value to srvconfig_loc from 9.x if exists
if [ ! -z "$SRVCONFIG_LOC" ];
then
#set ocrconfig_loc = srvconfig_loc
OCRCONFIG_LOC=$SRVCONFIG_LOC
OCRFILE=$SRVCONFIG
fi
fi
validateOCRDisks || { $ECHO $?; exit 1; }
CRS_OCR_LOCATION=`$ECHO $CRS_OCR_LOCATIONS | awk -F',' '{print $1}'`
CRS_OCR_MIRROR_LOCATION=`$ECHO $CRS_OCR_LOCATIONS | awk -F',' '{print $2}'`
####Verify current OCR settings with user entered values
if [ ! -z "$OCRCONFIG_LOC" ];
then
if [ "$CRS_OCR_LOCATION" != "$OCRCONFIG_LOC" ];
then
$ECHO "Current Oracle Cluster Registry location '$OCRCONFIG_LOC' in '$OCRFILE' and '$CRS_OCR_LOCATION' does not match"
$ECHO "Update either '$OCRFILE' to use '$CRS_OCR_LOCATION' or variable CRS_OCR_LOCATIONS in rootconfig.sh with '$OCRCONFIG_LOC' then rerun rootconfig.sh"
exit 1
fi
else
#set ocrconfig_loc = CRS_OCR_LOCATION
OCRCONFIG_LOC=$CRS_OCR_LOCATION
fi
if [ ! -z "$OCRMIRRORCONFIG_LOC" ];
then
if [ "$CRS_OCR_MIRROR_LOCATION" != "$OCRMIRRORCONFIG_LOC" ];
then
$ECHO "Current Oracle Cluster Registry mirror location '$OCRMIRRORCONFIG_LOC' in '$OCRCONFIG' and '$CRS_OCR_MIRROR_LOCATION' does not match"
$ECHO "Update either '$OCRCONFIG' to use '$CRS_OCR_MIRROR_LOCATION' or variable CRS_OCR_LOCATIONS in rootconfig.sh with '$OCRMIRRORCONFIG_LOC' then rerun rootconfig.sh"
exit 1
fi
else
#set the mirror location = user entered value for CRS_OCR_MIRRROR_LOCATION
OCRMIRRORCONFIG_LOC=$CRS_OCR_MIRROR_LOCATION
fi
$ECHO ocrconfig_loc=$OCRCONFIG_LOC > $OCRCONFIG || { $ECHO $?; exit 1; }
if [ ! -z "$OCRMIRRORCONFIG_LOC" ];
then
$ECHO ocrmirrorconfig_loc=$OCRMIRRORCONFIG_LOC >> $OCRCONFIG || { $ECHO $?; exit 1; }
fi
$ECHO local_only=FALSE >> $OCRCONFIG || { $ECHO $?; exit 1; }
$CHOWN root $OCRCONFIG || { $ECHO $?; exit 1; }
$CHGRP $CRS_DBA_GROUP $OCRCONFIG || { $ECHO $?; exit 1; }
$CHMOD 644 $OCRCONFIG || { $ECHO $?; exit 1; }
if [ -f $OCR_SYNC_FILE ]; then
$RMF $OCR_SYNC_FILE
fi
# First Activate the Volume Groups containing Oracle Cluster Registry
# and the Voting disk.
$CH/css/admin/init.cssd activatevg
##if ocr file does not exist
if [ ! -f "$OCRCONFIG_LOC" ];then
$CP /dev/null $OCRCONFIG_LOC || { $ECHO $?; exit 1; }
fi
$CHOWN root $OCRCONFIG_LOC || { $ECHO $?; exit 1; }
$CHGRP $CRS_DBA_GROUP $OCRCONFIG_LOC || { $ECHO $?; exit 1; }
$CHMOD 640 $OCRCONFIG_LOC || { $ECHO $?; exit 1; }
if [ ! -z "$OCRMIRRORCONFIG_LOC" ];
then
##if ocr mirror file does not exist
if [ ! -f "$OCRMIRRORCONFIG_LOC" ];then
$CP /dev/null $OCRMIRRORCONFIG_LOC || { $ECHO $?; exit 1; }
fi
$CHOWN root $OCRMIRRORCONFIG_LOC || { $ECHO $?; exit 1; }
$CHGRP $CRS_DBA_GROUP $OCRMIRRORCONFIG_LOC || { $ECHO $?; exit 1; }
$CHMOD 640 $OCRMIRRORCONFIG_LOC || { $ECHO $?; exit 1; }
fi
if [ ! -d "$OCR_BACKUP_DIR" ];
then
$ECHO "OCR backup directory '$OCR_BACKUP_DIR' does not exist. Creating now"
$MKDIRP $OCR_BACKUP_DIR
fi
$ECHO "Setting the permissions on OCR backup directory"
$CHMOD 775 $OCR_CDATA_DIR || { $ECHO $?; exit 1; }
$CHMOD 775 $OCR_BACKUP_DIR || { $ECHO $?; exit 1; }
$CHOWN root $OCR_BACKUP_DIR || { $ECHO $?; exit 1; }
$CHGRP $CRS_DBA_GROUP $OCR_BACKUP_DIR || { $ECHO $?; exit 1; }
NSSetup || { $ECHO $?; exit 1; }
# GSD should be down when this script is called.
# 1. Calls ocrconfig -upgrade to upgrade Oracle Cluster Registry contents from 9.2 to 10i format.
if $CH/bin/ocrconfig -upgrade $CRS_ORACLE_OWNER $CRS_DBA_GROUP;
then
$ECHO "Oracle Cluster Registry configuration upgraded successfully"
else
$ECHO "Failed to upgrade Oracle Cluster Registry configuration"
exit 1
fi
##Invalidate the existing srvConfig.loc file if it was existing
if [ -f "$SRVCONFIG" ];then
$ECHO srvconfig_loc=/dev/null > $SRVCONFIG || { $ECHO $?; exit 1; }
$CHOWN root $SRVCONFIG || { $ECHO $?; exit 1; }
$CHGRP $CRS_DBA_GROUP $SRVCONFIG || { $ECHO $?; exit 1; }
$CHMOD 644 $SRVCONFIG || { $ECHO $?; exit 1; }
fi
# For all the files under bin, others should have only execute permission
$CHMOD o=x $CH/bin/*
# set ownership to root, but give execute permissions to all
$CHOWN root $CH/bin/crs*
$CHMOD 551 $CH/bin/crs*
# only owner(root) should ever invoke crsd
$CHMOD 741 $CH/bin/crsd
if [ ! -d $CH/crs/init ]; then
$MKDIRP $CH/crs/init
fi
for d in log racg/dump srvm/log
do
if [ ! -d $CH/$d ]; then
$MKDIRP $CH/$d
$CHOWN $CRS_ORACLE_OWNER $CH/$d
$CHGRP $CRS_DBA_GROUP $CH/$d
$CHMOD 775 $CH/$d
fi
done
for d in . lib bin crs crs/init crs/profile crs/script crs/template crs/auth
do
$CHOWN root $CH/$d
$CHMOD 755 $CH/$d
done
# These are writeable by all
for d in crs/public
do
$CHOWN $CRS_ORACLE_OWNER $CH/$d
$CHMOD 1777 $CH/$d
done
for d in evm evm/init
do
$CHMOD 750 $CH/$d
done
# Writable by the oinstall group but can only be deleted by the crshome owner
$CHMOD 1770 $CH/evm/log
$CHMOD 1750 $CH/crs/log
$CHMOD 1750 $CH/crs/trace
for d in css css/init css/log css/auth
do
$CHMOD 711 $CH/$d
done
# check directories above $CH are owned by root
# If any are not owned by root, then it allows root escalation
# by the owner of the directory.
d=$CH
while [ "$d" != "/" ]
do
d=`$DIRNAME $d`
set -$- `$LS -ld $d`
case $3 in
root) ;; # ok
*) $ECHO "WARNING: directory '$d' is not owned by root";;
esac
done
# Initialize the SCR settings.
$CRSCTL create scr $CRS_ORACLE_OWNER
if [ "$?" != "0" ]; then
$ECHO Failure initializing entries in $SCRDIR.
exit 1
fi
# Initialize the Oracle Cluster Registry the first time we come through the script.
# The invoker is required to run this script on the install node before the
# other cluster nodes.
CLSCFG_INIT=false
# clscfg - Initialize the Oracle Cluster Registry for the cluster. Should be
# done once per cluster install. Overwriting a configuration
# while any CRS daemon is running can cause serious issues.
HOSTNAMES_LIST=$CRS_HOST_NAME_LIST
if [ -z "$HOSTNAMES_LIST" ]; then
HOSTNAMES_ARGS=""
else
HOSTNAMES_ARGS="-hn $HOSTNAMES_LIST"
fi
$CH/bin/clscfg -install -nn $CRS_NODE_NAME_LIST -pn $CRS_PRIVATE_NAME_LIST \
$HOSTNAMES_ARGS -o $CH -c $CRS_CLUSTER_NAME -l "$CRS_LANGUAGE_ID" -q $CRS_VOTING_DISKS \
$CLSCFG_MISCNT
case $? in
0) CLSCFG_INIT=true;;
105) $ECHO "Oracle Cluster Registry for cluster has already been initialized";;
*) $ECHO "Failed to initialize Oracle Cluster Registry for cluster"; $ECHO $?; exit 1;;
esac
# basic copies first...
$CP $CH/evm/admin/init.evmd $ID/init.evmd || { $ECHO $?; exit 1; }
$CP $CH/css/admin/init.cssd $ID/init.cssd || { $ECHO $?; exit 1; }
$CP $CH/crs/admin/init.crsd $ID/init.crsd || { $ECHO $?; exit 1; }
$CP $CH/crs/admin/init.crs $ID/init.crs || { $ECHO $?; exit 1; }
# Create .proxyserv directory
case $PLATFORM in "Linux")
ARCH=`uname -m`
if [ $ARCH == "x86_64" ]; then
if [ -d $ORACLE_HOME/.proxysrv ]; then
$CHOWN -R $CRS_ORACLE_OWNER $ORACLE_HOME/.proxysrv
$CHMOD 755 $ORACLE_HOME/.proxysrv
else
$MKDIR $ORACLE_HOME/.proxysrv
$CHOWN -R $CRS_ORACLE_OWNER $ORACLE_HOME/.proxysrv
$CHMOD 755 $ORACLE_HOME/.proxysrv
fi
fi
esac
for rc in $RCSDIR
do
$RMF $rc/"$RC_START"init.crs
$LNS $ID/init.crs $rc/"$RC_START"init.crs || { $ECHO $?; exit 1; }
done
for rc in $RCKDIR
do
$RMF $rc/"$RC_KILL"init.crs
$LNS $ID/init.crs $rc/"$RC_KILL"init.crs || { $ECHO $?; exit 1; }
done
$CP $IT $IT.orig || { $ECHO $?; exit 1; }
# Prepare to start the daemons.
$ID/init.crs start
# Check to see if they are going to start.
$ID/init.cssd startcheck CSS
if [ "$?" != "0" ]; then
$ECHO CRS daemons not set to start. See $MSGFILE for details.
exit 1
fi
$ECHO "Adding daemons to inittab"
eval $RMITAB
$INIT q
$SLEEP 10
eval $ADDITAB
$INIT q
ALLDONE=false
# Wait until the daemons actually start up
$CRSCTL check install -wait 600
STATUS=$?
case $STATUS in
0)
# Complete success. This is the last node of the install.
works=false
# Wait for CRSD and EVMD to start up
for i in 5 10 15 20 25 30 35 40 45 50 55 60 65 70 75 80 85 90 95 100 105 110 115 120
do
if $CH/bin/crs_stat > /dev/null 2>&1
then
works=true
break
fi
$ECHO "Waiting for the Oracle CRSD and EVMD to start"
$SLEEP 5
done
if $works
then
$ECHO "Oracle CRS stack installed and running under init(1M)"
ALLDONE=true
else
$ECHO "Timed out waiting for the CRS stack to start."
exit 1
fi
2)
# Current node is successful so far. Some nodes are not yet installed.
# CRSCTL will have printed out the names of the remaining nodes.
$ECHO "Failure at final check of Oracle CRS stack."
$ECHO $STATUS
exit 1
esac
# Startup was successful. Continue with the remainder.
##VIPCA is run by the last node that joins the CSS groups
if $ALLDONE
then
CRS_PARAMS="CRS_NODEVIPS"
if validateInput > /dev/null 2>&1
then
LOCAL_NODE=`$ORA_CRS_HOME/bin/olsnodes -l`
$CH/bin/crs_stat ora.$LOCAL_NODE.vip > /dev/null
STATUS=$?
if [ "$STATUS" = "0" ];
then
# do nothing
$ECHO ""
else
$ECHO "Running vipca(silent) for configuring nodeapps"
$CH/bin/vipca -silent -nodelist $CRS_NODELIST -nodevips $CRS_NODEVIPS
if [ "$?" != "0" ]; then
$ECHO ""
exit 1
fi
fi
else
$ECHO "Run VIPCA for configuring nodeapps"
$ECHO "The command to use 'vipca -nodelist <list of cluster nodes>'"
fi
fi
exit 0
请大家帮忙看一下。
Edited by: 951276 on 2012-11-4 上午5:19 -
Cluster Ready Services installation stall
At the final step, when asked to execute:
/u02/oradata/orcl/root.sh
as the root user, I get the following output:
Adding daemons to inittab
Preparing Oracle cluster Ready Services (CRS):
At this point, the script hangs indefinitely. I ran the script with "sh -x ./root.sh" and found that the script actuall is STALLING at this step:
+ /etc/init.d/init.crs start
Preparing Oralce Cluster Ready Services (CRS):
+ /sbin/init q
+ /etc/init.d/init.cssd startcheck
I've attempted an install on 2 seperate computers running both WhiteBox Linux 3 as well as Centos OS 3.4 with no luck.
Any ideas would be GREATLY appreciated.I don't know, why this happens, I have only a kind of workaround.
If you don't use Real Application Cluster and/or ASM (Automatic Storage Management) , you don't need CRS. So you could modify root.sh to exclude all CRS configuration and start statements. -
Cssd does not start in non-RAC environment Thus we can not bring up ASM
Non-RAC environment
ASM version = 11.1.0.7
HP-UX Itanium 11.23
After power outage, CSSD does not start on non-RAC environment
Running as root "/sbin/init.d/init.cssd start" does not start cssd
Oracle support tried "$ASM_HOME/bin/localconfig delete" and "$ASM_HOME/bin/localconfig add"
but it did not start CSS
Oracle support tried "$ASM_HOME/bin/localconfig reset $ASM_HOME"
It started the CSSD and the "crsctl check css" came back with CSS is healthy
But around 1 minute later it rebooted the server and when it came up again CSS does not start.
They checked /etc/inittab and it looked fine.
Before the reboot we saw this message in the /var/adm/syslog/OLDsyslog.log:
Cluster Ready Services completed waiting on dependencies
Again it is a NON-RAC environment. We only need CSSD for ASM. We do not have CRS installed on this server.
Our test system has been down for a week and we did not get the resolution from Oracle support yet !
Any pointers are greately appriciated.
Thanks,
DzungHere is the message in $ASM_HOME/log/<hostname>/alert<hostname>.log :
2010-07-16 09:42:02.956
[client(11930)]CRS-1006:The OCR location /db/app/oracle/product/11.1/cdata/localhost/local.ocr is inacce
ssible. Details in /db/app/oracle/product/11.1/log/rmodbd01/client/clscfg10.log.
2010-07-16 09:42:02.971
[client(11930)]CRS-1006:The OCR location /db/app/oracle/product/11.1/cdata/localhost/local.ocr is inacce
ssible. Details in /db/app/oracle/product/11.1/log/rmodbd01/client/clscfg10.log.
2010-07-16 09:42:03.054
[client(11930)]CRS-1013:The OCR at /db/app/oracle/product/11.1/cdata/localhost/local.ocr was successfull
y formatted using version 2. Ignore earlier CRS-1006 messages if any.
2010-07-16 09:42:46.379
[cssd(12297)]CRS-1601:CSSD Reconfiguration complete. Active nodes are rmodbd01 .
Here is the message in $ASM_HOME/log/<hostname>/cssd/cssdOUT.log:
setsid: failed with -1/1
s0clssscGetEnvOracleUser: calling getpwnam_r for user oracle
s0clssscGetEnvOracleUser: info for user oracle complete
07/16/10 09:42:36: CSSD starting
Here is the message in $ASM_HOME/log/<hostname>/cssd/ocssd.log:
[ CSSD]2010-07-16 09:42:46.378 [18] >TRACE: clssgmCompareSwapEventValue: changed CmInfo State val 7, from 6, changes 6
[ CSSD]2010-07-16 09:42:46.378 [18] >TRACE: clssgmSetVersions: properties common to all peers: 1,2,3,4,5,6,7
[ CSSD]2010-07-16 09:42:46.378 [18] >TRACE: clssgmEstablishMasterNode: MASTER for 174732166 is node(0) birth(174732166)
[ CSSD]2010-07-16 09:42:46.378 [18] >TRACE: clssgmChangeMasterNode: requeued 0 RPCs
[ CSSD]2010-07-16 09:42:46.378 [18] >TRACE: clssgmCompareSwapEventValue: changed CmInfo State val 8, from 7, changes 7
[ CSSD]2010-07-16 09:42:46.378 [18] >TRACE: clssgmMasterCMSync: Synchronizing group/lock status
[ CSSD]2010-07-16 09:42:46.378 [18] >TRACE: clssgmMasterSendDBDone: group/lock status synchronization complete
[ CSSD]2010-07-16 09:42:46.378 [18] >TRACE: clssgmCompareSwapEventValue: changed CmInfo State val 9, from 8, changes 8
[ CSSD]2010-07-16 09:42:46.378 [18] >TRACE: clssgmCompareSwapEventValue: changed CmInfo State val 10, from 9, changes 9
[ CSSD]CLSS-3000: reconfiguration successful, incarnation 174732166 with 1 nodes
[ CSSD]CLSS-3001: local node number 0, master node number 0
[ CSSD]2010-07-16 09:42:46.378 [18] >TRACE: clssscSAGEInitFenceCompl: Completing kgzf fence initialization
[ CSSD]2010-07-16 09:42:46.394 [12] >TRACE: clssgmUpdateEventValue: Client listener incarn val 174732166, changes 1
[ CSSD]2010-07-16 09:42:46.395 [12] >TRACE: clssgmAllocProc: (60000000003c7120) allocated
[ CSSD]2010-07-16 09:42:46.395 [12] >TRACE: clssgmAllocProc: (60000000003c73a0) allocated
[ CSSD]2010-07-16 09:42:46.396 [14] >TRACE: Connect request from user oracle
[ CSSD]2010-07-16 09:42:46.396 [14] >TRACE: Connect request from user root
[ CSSD]2010-07-16 09:42:46.397 [12] >TRACE: clssgmClientConnectMsg: properties of cmProc 60000000003c7120 - 1,2,3
[ CSSD]2010-07-16 09:42:46.397 [12] >TRACE: clssgmClientConnectMsg: Connect from con(60000000003b2810) proc(60000000003c7120) pid(12350) version 11:1:1:4
[ CSSD]2010-07-16 09:42:46.397 [12] >TRACE: clssgmClientConnectMsg: properties of cmProc 60000000003c73a0 - 1,2,3
[ CSSD]2010-07-16 09:42:46.397 [12] >TRACE: clssgmClientConnectMsg: Connect from con(60000000003b2990) proc(60000000003c73a0) pid(12131) version 11:1:1:4
[ CSSD]2010-07-16 09:42:46.402 [12] >TRACE: clssgmRegisterClient: proc(1/60000000003c7120), client(1/600000000096e7c0)
[ CSSD]2010-07-16 09:42:46.402 [12] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (600000000096e7c0)
[ CSSD]2010-07-16 09:42:46.402 [12] >TRACE: clssgmJoinGrock: local grock CSS_INTERNAL_NODE_GROUP new client 600000000096e7c0 with con 60000000003b2b10, requested num 0
[ CSSD]2010-07-16 09:42:46.402 [12] >TRACE: clssgmAddNodeGrpMember: member (60000000009e0030) added
[ CSSD]2010-07-16 09:42:46.403 [12] >TRACE: clssgmGroupState: requested group state of group localhost_NG, member count 0
[ CSSD]2010-07-16 09:42:46.403 [12] >TRACE: clssgmGroupState: requested group state of group localhost_NG, member count 0
[ CSSD]2010-07-16 09:42:46.404 [12] >TRACE: clssgmDeadProc: proc 60000000003c73a0
[ CSSD]2010-07-16 09:42:46.404 [12] >TRACE: clssgmDestroyProc: cleaning up proc(60000000003c73a0) con(60000000003b2990) skgpid ospid 12131 with 0 clients, refcount 0
[ CSSD]2010-07-16 09:42:46.425 [12] >TRACE: clssgmGroupState: requested group state of unknown group MASTER#DISKMON#GROUP
[ CSSD]2010-07-16 09:42:46.425 [12] >TRACE: clssgmGroupState: requested group state of group MASTER#DISKMON#GROUP, member count 0
[ CSSD]2010-07-16 09:42:46.425 [18] >TRACE: KGZF: context successfully initialized, API version 1.4, using pipe default
[ CSSD]2010-07-16 09:42:46.425 [18] >TRACE: clssscSAGEInitFenceCompl: kgzf fence initialization successfully completed
[ CSSD]2010-07-16 09:42:46.425 [18] >TRACE: clssgmReconfigThread: CSS/GM open for global group registrations
[ CSSD]2010-07-16 09:42:46.425 [18] >TRACE: clssgmReconfigThread: completed for reconfig(174732166), with status(1)
[ CSSD]2010-07-16 09:42:46.425 [18] >TRACE: clssgmUpdateEventValue: Reconfig Event val 2, changes 2
[ CSSD]2010-07-16 09:42:46.425 [1] >TRACE: clssgmWaitOnEventValue: after Reconfig Event val 2, eval 2 waited 47
[ CSSD]2010-07-16 09:42:46.425 [12] >TRACE: clssgmRegisterClient: proc(1/60000000003c7120), client(2/600000000096e870)
[ CSSD]2010-07-16 09:42:46.425 [1] >TRACE: clssgmUpdateEventValue: Reconfig Event val 0, changes 3
[ CSSD]2010-07-16 09:42:46.425 [1] >TRACE: clssgmStartNMMon: previous reconfig complete, incarnation(174732166)
[ CSSD]2010-07-16 09:42:46.425 [12] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 2 (600000000096e870)
[ CSSD]2010-07-16 09:42:46.425 [12] >TRACE: clssgmJoinGrock: global grock MASTER#DISKMON#GROUP#MX new client 600000000096e870 with con 60000000003b2990, requested num -1
[ CSSD]2010-07-16 09:42:46.425 [12] >TRACE: clssgmAddGrockMember: adding member to grock MASTER#DISKMON#GROUP#MX
[ CSSD]2010-07-16 09:42:46.425 [12] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(0) grock (6000000000989e50/MASTER#DISKMON#GROUP#MX)
[ CSSD]2010-07-16 09:42:46.425 [12] >TRACE: clssgmQueueGrockEvent: lockName(MASTER#DISKMON#GROUP#MX) type(3) count (1/1) xwaiters(1) event(1) to memberNo(0)
[ CSSD]2010-07-16 09:42:46.425 [12] >TRACE: clssgmCommonAddMember: global lock grock MASTER#DISKMON#GROUP#MX member(0/Local) node(0) flags 0x2 0x2
[ CSSD]2010-07-16 09:42:46.425 [12] >TRACE: clssgmRegisterClient: proc(1/60000000003c7120), client(3/600000000096e920)
[ CSSD]2010-07-16 09:42:46.425 [12] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 3 (600000000096e920)
[ CSSD]2010-07-16 09:42:46.425 [12] >TRACE: clssgmJoinGrock: global grock MASTER#DISKMON#GROUP new client 600000000096e920 with con 60000000003b2bd0, requested num 0
[ CSSD]2010-07-16 09:42:46.425 [12] >TRACE: clssgmAddGrockMember: adding member to grock MASTER#DISKMON#GROUP
[ CSSD]2010-07-16 09:42:46.425 [12] >TRACE: clssgmAddMember: new master 0 for group(MASTER#DISKMON#GROUP)
[ CSSD]2010-07-16 09:42:46.426 [12] >TRACE: clssgmAddMember: Adding fencing for member 0, group MASTER#DISKMON#GROUP, death 1, SAGE 0
[ CSSD]2010-07-16 09:42:46.426 [12] >TRACE: clssgmAddMember: member (0/60000000009e0230) added. pbsz(72) prsz(0) flags 0x0 to grock (600000000098a170/MASTER#DISKMON#GROUP)
[ CSSD]2010-07-16 09:42:46.426 [12] >TRACE: clssgmQueueGrockEvent: groupName(MASTER#DISKMON#GROUP) count(1) master(0) event(1), incarn 1, mbrc 1, to member 0, events 0x78, state 0x0
[ CSSD]2010-07-16 09:42:46.426 [12] >TRACE: clssgmCommonAddMember: global group grock MASTER#DISKMON#GROUP member(0/Local) node(0) flags 0x0 0x1e00
[ CSSD]2010-07-16 09:42:46.426 [12] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 2 (600000000096e870)
[ CSSD]2010-07-16 09:42:46.426 [12] >TRACE: clssgmExitGrock: client 2 (600000000096e870), grock MASTER#DISKMON#GROUP#MX, member 0
[ CSSD]2010-07-16 09:42:46.426 [12] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (60000000009e0130) in global grock MASTER#DISKMON#GROUP#MX
[ CSSD]2010-07-16 09:42:46.426 [12] >TRACE: clssgmRemoveMember: grock MASTER#DISKMON#GROUP#MX, member number 0 (60000000009e0130) node number 0 state 0x14 member refcnt 0 grock type 3
[ CSSD]2010-07-16 09:42:48.405 [8] >TRACE: clssnmSendingThread: sending status msg to all nodes
[ CSSD]2010-07-16 09:42:48.405 [8] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes
[ CSSD]2010-07-16 09:42:52.444 [8] >TRACE: clssnmSendingThread: sending status msg to all nodes
[ CSSD]2010-07-16 09:42:52.444 [8] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes
[ CSSD]2010-07-16 09:42:56.484 [8] >TRACE: clssnmSendingThread: sending status msg to all nodes
[ CSSD]2010-07-16 09:42:56.484 [8] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes
[ CSSD]2010-07-16 09:43:00.516 [8] >TRACE: clssnmSendingThread: sending status msg to all nodes
[ CSSD]2010-07-16 09:43:00.516 [8] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes
[ CSSD]2010-07-16 09:43:04.563 [8] >TRACE: clssnmSendingThread: sending status msg to all nodes
[ CSSD]2010-07-16 09:43:04.563 [8] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes
[ CSSD]2010-07-16 09:43:08.603 [8] >TRACE: clssnmSendingThread: sending status msg to all nodes
[ CSSD]2010-07-16 09:43:08.603 [8] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes
[ CSSD]2010-07-16 09:43:12.643 [8] >TRACE: clssnmSendingThread: sending status msg to all nodes
[ CSSD]2010-07-16 09:43:12.643 [8] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes
[ CSSD]2010-07-16 09:43:16.676 [8] >TRACE: clssnmSendingThread: sending status msg to all nodes
[ CSSD]2010-07-16 09:43:16.676 [8] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes
[ CSSD]2010-07-16 09:43:20.723 [8] >TRACE: clssnmSendingThread: sending status msg to all nodes
[ CSSD]2010-07-16 09:43:20.723 [8] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes
[ CSSD]2010-07-16 09:43:24.762 [8] >TRACE: clssnmSendingThread: sending status msg to all nodes
[ CSSD]2010-07-16 09:43:24.762 [8] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes
[ CSSD]2010-07-16 09:43:28.802 [8] >TRACE: clssnmSendingThread: sending status msg to all nodes
[ CSSD]2010-07-16 09:43:28.802 [8] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes
[ CSSD]2010-07-16 09:43:32.842 [8] >TRACE: clssnmSendingThread: sending status msg to all nodes
[ CSSD]2010-07-16 09:43:32.842 [8] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes
[ CSSD]2010-07-16 09:43:36.882 [8] >TRACE: clssnmSendingThread: sending status msg to all nodes
[ CSSD]2010-07-16 09:43:36.882 [8] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes
[ CSSD]2010-07-16 09:43:40.922 [8] >TRACE: clssnmSendingThread: sending status msg to all nodes
[ CSSD]2010-07-16 09:43:40.922 [8] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes
[ CSSD]2010-07-16 09:43:44.964 [8] >TRACE: clssnmSendingThread: sending status msg to all nodes
[ CSSD]2010-07-16 09:43:44.964 [8] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes
[ CSSD]2010-07-16 09:43:49.002 [8] >TRACE: clssnmSendingThread: sending status msg to all nodes
[ CSSD]2010-07-16 09:43:49.002 [8] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes
[ CSSD]2010-07-16 09:43:53.043 [8] >TRACE: clssnmSendingThread: sending status msg to all nodes
[ CSSD]2010-07-16 09:43:53.043 [8] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes
[ CSSD]2010-07-16 09:43:57.085 [8] >TRACE: clssnmSendingThread: sending status msg to all nodes
[ CSSD]2010-07-16 09:43:57.085 [8] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes
[ CSSD]2010-07-16 09:43:58.354 [12] >TRACE: clssgmAllocProc: (60000000003c7ee0) allocated
[ CSSD]2010-07-16 09:43:58.355 [14] >TRACE: Connect request from user oracle
[ CSSD]2010-07-16 09:43:58.356 [12] >TRACE: clssgmClientConnectMsg: properties of cmProc 60000000003c7ee0 - 1,2,3
[ CSSD]2010-07-16 09:43:58.356 [12] >TRACE: clssgmClientConnectMsg: Connect from con(60000000003b2990) proc(60000000003c7ee0) pid(13157) version 11:1:1:4
[ CSSD]2010-07-16 09:43:58.360 [12] >TRACE: clssgmRegisterClient: proc(2/60000000003c7ee0), client(1/600000000096e870)
[ CSSD]2010-07-16 09:43:58.360 [12] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (600000000096e870)
[ CSSD]2010-07-16 09:43:58.360 [12] >TRACE: clssgmJoinGrock: global grock CLSSSCHECK_GROUP new client 600000000096e870 with con 60000000003b2c90, requested num -1
[ CSSD]2010-07-16 09:43:58.360 [12] >TRACE: clssgmAddGrockMember: adding member to grock CLSSSCHECK_GROUP
[ CSSD]2010-07-16 09:43:58.360 [12] >TRACE: clssgmAddMember: new master 0 for group(CLSSSCHECK_GROUP)
[ CSSD]2010-07-16 09:43:58.360 [12] >TRACE: clssgmAddMember: Adding fencing for member 0, group CLSSSCHECK_GROUP, death 1, SAGE 0
[ CSSD]2010-07-16 09:43:58.360 [12] >TRACE: clssgmAddMember: member (0/60000000009e0130) added. pbsz(8) prsz(8) flags 0x0 to grock (6000000000989e50/CLSSSCHECK_GROUP)
[ CSSD]2010-07-16 09:43:58.360 [12] >TRACE: clssgmQueueGrockEvent: groupName(CLSSSCHECK_GROUP) count(1) master(0) event(1), incarn 1, mbrc 1, to member 0, events 0x0, state 0x0
[ CSSD]2010-07-16 09:43:58.360 [12] >TRACE: clssgmCommonAddMember: global group grock CLSSSCHECK_GROUP member(0/Local) node(0) flags 0x0 0x0
[ CSSD]2010-07-16 09:43:58.361 [12] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (600000000096e870)
[ CSSD]2010-07-16 09:43:58.361 [12] >TRACE: clssgmExitGrock: client 1 (600000000096e870), grock CLSSSCHECK_GROUP, member 0
[ CSSD]2010-07-16 09:43:58.361 [12] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (60000000009e0130) in global grock CLSSSCHECK_GROUP
[ CSSD]2010-07-16 09:43:58.361 [12] >TRACE: clssgmRemoveMember: grock CLSSSCHECK_GROUP, member number 0 (60000000009e0130) node number 0 state 0x14 member refcnt 0 grock type 2
[ CSSD]2010-07-16 09:43:58.361 [12] >TRACE: clssgmRegisterClient: proc(2/60000000003c7ee0), client(2/600000000096e870)
[ CSSD]2010-07-16 09:43:58.361 [12] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 2 (600000000096e870)
[ CSSD]2010-07-16 09:43:58.361 [12] >TRACE: clssgmJoinGrock: global grock CLSSSCHECK_LOCK new client 600000000096e870 with con 60000000003b2c90, requested num -1
[ CSSD]2010-07-16 09:43:58.361 [12] >TRACE: clssgmAddGrockMember: adding member to grock CLSSSCHECK_LOCK
[ CSSD]2010-07-16 09:43:58.361 [12] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(0) grock (6000000000989e50/CLSSSCHECK_LOCK)
[ CSSD]2010-07-16 09:43:58.361 [12] >TRACE: clssgmQueueGrockEvent: lockName(CLSSSCHECK_LOCK) type(3) count (1/1) xwaiters(1) event(1) to memberNo(0)
[ CSSD]2010-07-16 09:43:58.361 [12] >TRACE: clssgmCommonAddMember: global lock grock CLSSSCHECK_LOCK member(0/Local) node(0) flags 0x2 0x2
[ CSSD]2010-07-16 09:43:58.361 [12] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 2 (600000000096e870)
[ CSSD]2010-07-16 09:43:58.361 [12] >TRACE: clssgmExitGrock: client 2 (600000000096e870), grock CLSSSCHECK_LOCK, member 0
[ CSSD]2010-07-16 09:43:58.361 [12] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (60000000009e0130) in global grock CLSSSCHECK_LOCK
[ CSSD]2010-07-16 09:43:58.361 [12] >TRACE: clssgmRemoveMember: grock CLSSSCHECK_LOCK, member number 0 (60000000009e0130) node number 0 state 0x14 member refcnt 0 grock type 3
[ CSSD]2010-07-16 09:43:58.362 [12] >TRACE: clssgmDeadProc: proc 60000000003c7ee0
[ CSSD]2010-07-16 09:43:58.362 [12] >TRACE: clssgmDestroyProc: cleaning up proc(60000000003c7ee0) con(60000000003b2990) skgpid ospid 13157 with 0 clients, refcount 0
[ CSSD]2010-07-16 09:44:01.125 [8] >TRACE: clssnmSendingThread: sending status msg to all nodes
[ CSSD]2010-07-16 09:44:01.125 [8] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes
[ CSSD]2010-07-16 09:44:05.164 [8] >TRACE: clssnmSendingThread: sending status msg to all nodes
[ CSSD]2010-07-16 09:44:05.164 [8] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes
[ CSSD]2010-07-16 09:44:09.196 [8] >TRACE: clssnmSendingThread: sending status msg to all nodes
[ CSSD]2010-07-16 09:44:09.196 [8] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes
[ CSSD]2010-07-16 09:44:13.236 [8] >TRACE: clssnmSendingThread: sending status msg to all nodes
[ CSSD]2010-07-16 09:44:13.236 [8] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes
[ CSSD]2010-07-16 09:44:17.284 [8] >TRACE: clssnmSendingThread: sending status msg to all nodes
[ CSSD]2010-07-16 09:44:17.284 [8] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes
[ CSSD]2010-07-16 09:44:21.322 [8] >TRACE: clssnmSendingThread: sending status msg to all nodes
[ CSSD]2010-07-16 09:44:21.322 [8] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes
[ CSSD]2010-07-16 09:44:25.316 [8] >TRACE: clssnmSendingThread: sending status msg to all nodes
[ CSSD]2010-07-16 09:44:25.316 [8] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes
[ CSSD]2010-07-16 09:44:30.333 [8] >TRACE: clssnmSendingThread: sending status msg to all nodes
[ CSSD]2010-07-16 09:44:30.333 [8] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes
[ CSSD]2010-07-16 09:44:34.324 [8] >TRACE: clssnmSendingThread: sending status msg to all nodes
[ CSSD]2010-07-16 09:44:34.324 [8] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes
Here is the message in $ASM_HOME/log/<hostname>/diskmon/client.log:
[ DISKMON] 07/16/2010 18:33:32.050 dskm_send_command: process 23246 sending command 8 to master diskmon listening on default pipe
[ DISKMON] 07/16/2010 18:33:32.080 dskm_send_command3: skgznp_connect failed with error 56815
[ DISKMON] 07/16/2010 18:33:32.080 dskm_send_command3: error 56815 at location skgznpcon6 - connect() - Connection refused
Here is the message in $ASM_HOME/log/<hostname>/diskmon/diskmonOUT.log:
setsid: failed with -1/1
dskm_getenv_oracle_user: calling getpwnam_r for user oracle
dskm_getenv_oracle_user: info for user oracle complete
07/16/10 18:33:31: Master Diskmon starting
Here is the message in $ASM_HOME/log/<hostname>/diskmon/diskmon.log:
[ DISKMON] 07/16/2010 09:42:35.573 dskm main: starting up
[ DISKMON] 07/16/2010 09:42:35.588 [12350:3] dskm_rac_thrd_main: running
[ DISKMON] 07/16/2010 09:42:35.588 [12350:1] dskm_rac_thrd_creat2: got the post from the css event handling thread
[ DISKMON] 07/16/2010 09:42:35.589 [12350:1] dskm main: startup complete
[ DISKMON] 07/16/2010 09:42:35.589 [12350:1] listening on -> default pipe
[ DISKMON] 07/16/2010 09:42:35.792 clsc_connect: (6000000000700420) no listener at (ADDRESS=(PROTOCOL=ipc)(KEY=OCSSD_LL_rmodbd01_))
[ DISKMON] 07/16/2010 09:42:36.385 clsc_connect: (6000000000700420) no listener at (ADDRESS=(PROTOCOL=ipc)(KEY=OCSSD_LL_rmodbd01_))
[ DISKMON] 07/16/2010 09:42:36.906 clsc_connect: (6000000000700420) no listener at (ADDRESS=(PROTOCOL=ipc)(KEY=OCSSD_LL_rmodbd01_))
[ DISKMON] 07/16/2010 09:42:37.426 clsc_connect: (6000000000700420) no listener at (ADDRESS=(PROTOCOL=ipc)(KEY=OCSSD_LL_rmodbd01_))
[ DISKMON] 07/16/2010 09:42:37.945 clsc_connect: (6000000000700420) no listener at (ADDRESS=(PROTOCOL=ipc)(KEY=OCSSD_LL_rmodbd01_))
[ DISKMON] 07/16/2010 09:42:38.465 clsc_connect: (6000000000700420) no listener at (ADDRESS=(PROTOCOL=ipc)(KEY=OCSSD_LL_rmodbd01_))
[ DISKMON] 07/16/2010 09:42:46.376 [12350:1] dskm_slave_thrd_creat: thread created
[ DISKMON] 07/16/2010 09:42:46.376 [12350:11] dskm_slave_thrd_main1: slave 0 running
[ DISKMON] 07/16/2010 09:42:46.376 [12350:11] dskm_process_msg5: received msg type KGZM_IDENTIFY (0x0001)
[ DISKMON] 07/16/2010 09:42:46.389 [12350:11] dskm_proc_identify8: client kgzf/12297, version 0x01020000, slave 0, reid cid=3e0391f05e06cfafbf7419d7cf085a44,icin=174732166,nmn=0,lnid=174732166,gid=0,gin=0,gmn=0,umemid=0,opid=0,opsn=0,lvl=node
[ DISKMON] 07/16/2010 09:42:46.389 [12350:11] dskm_send_version1:
[ DISKMON] 07/16/2010 09:42:46.389 [12350:11] dskm_send_version4: done
[ DISKMON] 07/16/2010 09:42:46.389 [12350:11] dskm_process_msg7: processed msg 0 type KGZM_IDENTIFY (0x0001), retcode 0
[ DISKMON] 07/16/2010 09:42:46.389 [12350:11] dskm_process_msg5: received msg type KGZM_KGZF_HANDSHAKE (0x0010)
[ DISKMON] 07/16/2010 09:42:46.389 [12350:11] dskm_proc_kgzf_handshake3: client kgzf/12297, kgzf version 0x00010004, slave 0
[ DISKMON] 07/16/2010 09:42:46.401 [12350:3] dskm_clss_ini2: successful clsssinit(), clssvers 2.1
[ DISKMON] 07/16/2010 09:42:46.402 [12350:3] dskm_clss_ini12: node rmodbd01 (0) registered in cluster
[ DISKMON] 07/16/2010 09:42:46.403 [12350:3] dskm_reid_ini12: diskmon reid cid=3e0391f05e06cfafbf7419d7cf085a44,icin=174732166,nmn=0,lnid=174732166,gid=-1,gin=-1,gmn=-1,umemid=-1,opid=12350,opsn=1279291355,lvl=process
[ DISKMON] 07/16/2010 09:42:46.424 [12350:3] dskm_sage_config: CELL storage configuration file cellinit.ora not found
[ DISKMON] 07/16/2010 09:42:46.425 [12350:3] dskm_nfy_kgzf1: notified thread kgzf enabled
[ DISKMON] 07/16/2010 09:42:46.425 [12350:11] dskm_proc_kgzf_handshake5: got the post from the hb thread
[ DISKMON] 07/16/2010 09:42:46.425 [12350:11] dskm_proc_kgzf_handshake9: done, kgzf enabled
[ DISKMON] 07/16/2010 09:42:46.425 [12350:11] dskm_process_msg7: processed msg 0 type KGZM_KGZF_HANDSHAKE (0x0010), retcode 0
[ DISKMON] 07/16/2010 09:42:46.426 [12350:3] dskm_rac_ini22: CELL storage not configured in the cluster; registered in group MASTER#DISKMON#GROUP as memno 0 (GSDGRPSZ 512) -
ASM Instance down in Solaris due to missing ocr.loc file
We had to restart our solaris machine due to a hardware failure.
When i tried to start to ASM instance, i got the error.
SQL> startup mount;
ORA-29701: unable to connect to Cluster Manager
The css daemons were not started. I checked it using
$ ps -ef | grep css
After logging in as ROOT and setting Oracle's bin directory in its path, i tried to run
#./localconfig . But i didn't succeed.
Then I came to know that you can start css by executing init.cssd script in ($ORACLE_HOME/css/admin)
/u01/oracle/10g/css/admin
$ ./init.cssd start
./init.cssd: /var/opt/oracle/ocr.loc: cannot open
There is no such file called ocr.loc in this location. I confirmed it by
So I looked for /var/opt/oracle/ocr.loc
$ file /var/opt/oracle/ocr.loc
/var/opt/oracle/ocr.loc: cannot open: No such file or directory
What do i do?Boutet,
Before you go ahead and restore the OCR, for that matter even to restore it successfully, you would need to restore/recreate the file /var/opt/oracle/ocr.loc. This file has the location of the OCR file, without this file, you will not be able to restore the OCR.
The contents of the ocr.loc file would be something like this (I am including this information so that you may like to use it to recreate the file, in case you lost the original one).
cat /etc/oracle/ocr.loc
ocrconfig_loc=/<path>/cdata/localhost/local.ocr
local_only=TRUE
Hope this help.
Thanks
Chandra Pabba -
The CSSD does not start automatically on Non-RAC - AIX 5L
Hi all,
Database: Oracle 10.2.0.4
O.S AIX 5.3 TL 10
I am facing a problem with the CSSD Non-RAC/Clusterware.
When we restarted the server the service CSSD does not start automatically and there is no relevant messages in the log files of CSSD.
Running the "localconfig reset $ORACLE_HOME", execute successfully but does not start the CSSD.
Running "/etc/init.cssd start" - does not work, nothing happens when we run it
I manually ran "/etc/ init.cssd run" and the service CSSD (ossd.bin) was started without errors.
No errors on errpt from AIX.
I've opened a SR but I am waiting for response from Oracle.Hi,
I believe this problem is not with Oracle, but in AIX.It may be that one process that is starting on boot is holding the other process. You need to identify what is process/application.
Check the process on inittab that are already active and which are inactive they should be active.
One clue: Is very common process that is initiated in wait mode hold the boot server.
wait
When the init command enters the run level that matches the entry's run level,
start the process and wait for its termination.
All subsequent reads of the /etc/inittab file while the init
command is in the same run level will cause the init command to ignore this entry.http://publib.boulder.ibm.com/infocenter/aix/v6r1/index.jsp?topic=/com.ibm.aix.files/doc/aixfiles/inittab.htm
Regards,
Levi Pereira -
Error while checking the status of Oracle Cluster ware
Hi
I was trying to install the database using dbca after setting up the grid and database software on LINUX x86-64 RHEL 5.7 machine. The database software version is 11.2.0.3. It throwing the error regarding the connectivity of clusterware. So I checked the status of clusterware.
-bash-3.2$ ./crsctl stat res -t
CRS-4535: Cannot communicate with Cluster Ready Services
CRS-4000: Command Status failed, or completed with errors.
-bash-3.2$
But when I ran below one:
-bash-3.2$ ./crsctl stat res -t -init
NAME TARGET STATE SERVER STATE_DETAILS
Cluster Resources
ora.asm
1 ONLINE ONLINE sfv9699 Started
ora.cluster_interconnect.haip
1 ONLINE ONLINE sfv9699
ora.crf
1 ONLINE ONLINE sfv9699
ora.crsd
1 ONLINE OFFLINE
ora.cssd
1 ONLINE ONLINE sfv9699
ora.cssdmonitor
1 ONLINE ONLINE sfv9699
ora.ctssd
1 ONLINE ONLINE sfv9699 OBSERVER
ora.diskmon
1 OFFLINE OFFLINE
ora.drivers.acfs
1 ONLINE ONLINE sfv9699
ora.evmd
1 ONLINE INTERMEDIATE sfv9699
ora.gipcd
1 ONLINE ONLINE sfv9699
ora.gpnpd
1 ONLINE ONLINE sfv9699
ora.mdnsd
1 ONLINE ONLINE sfv9699
So i saw that the crsd having some issue. I checked the alert log and crsd log. Below are the output.
Alert <server_name>.log
2012-10-20 15:37:51.408
[ohasd(3694)]CRS-2765:Resource 'ora.crsd' has failed on server 'sfv9699'.
2012-10-20 15:37:52.968
[crsd(5188)]CRS-1013:The OCR location in an ASM disk group is inaccessible. Details in /oracle2/app/11.2.0/grid/log/sfv9699/crsd/crsd.log.
2012-10-20 15:37:52.984
[crsd(5188)]CRS-0804:Cluster Ready Service aborted due to Oracle Cluster Registry error [PROC-26: Error while accessing the physical storage
ORA-27140: attach to post/wait facility failed
ORA-27300: OS system dependent operation:invalid_egid failed with status: 1
ORA-27301: OS failure message: Operation not permitted
ORA-27302: failure occurred at: skgpwinit6
ORA-27303: additional information: startup egid = 1000 (oinstall), current egid = 10002 (dba)
]. Details at (:CRSD00111:) in /oracle2/app/11.2.0/grid/log/sfv9699/crsd/crsd.log.
2012-10-20 15:37:53.471
[ohasd(3694)]CRS-2765:Resource 'ora.crsd' has failed on server 'sfv9699'.
2012-10-20 15:37:53.472
[ohasd(3694)]CRS-2771:Maximum restart attempts reached for resource 'ora.crsd'; will not restart.
CRSD.log
2012-10-20 15:37:52.456: [ CRSMAIN][3563381328] Checking the OCR device
2012-10-20 15:37:52.457: [ CRSMAIN][3563381328] Sync-up with OCR
2012-10-20 15:37:52.457: [ CRSMAIN][3563381328] Connecting to the CSS Daemon
2012-10-20 15:37:52.457: [ CRSMAIN][3563381328] Getting local node number
2012-10-20 15:37:52.459: [ CRSMAIN][3563381328] Initializing OCR
[ CLWAL][3563381328]clsw_Initialize: OLR initlevel [70000]
2012-10-20 15:37:52.897: [ OCRASM][3563381328]proprasmo: Error in open/create file in dg [DATA]
[ OCRASM][3563381328]SLOS : SLOS: cat=7, opn=kgfoAl06, dep=27140, loc=kgfokge
2012-10-20 15:37:52.898: [ OCRASM][3563381328]ASM Error Stack : ORA-27140: attach to post/wait facility failed
ORA-27300: OS system dependent operation:invalid_egid failed with status: 1
ORA-27301: OS failure message: Operation not permitted
ORA-27302: failure occurred at: skgpwinit6
ORA-27303: additional information: startup egid = 1000 (oinstall), current egid = 10002 (dba)
2012-10-20 15:37:52.967: [ OCRASM][3563381328]proprasmo: kgfoCheckMount returned [7]
2012-10-20 15:37:52.967: [ OCRASM][3563381328]proprasmo: The ASM instance is down
2012-10-20 15:37:52.968: [ OCRRAW][3563381328]proprioo: Failed to open [+DATA]. Returned proprasmo() with [26]. Marking location as UNAVAILABLE.
2012-10-20 15:37:52.968: [ OCRRAW][3563381328]proprioo: No OCR/OLR devices are usable
2012-10-20 15:37:52.968: [ OCRASM][3563381328]proprasmcl: asmhandle is NULL
2012-10-20 15:37:52.969: [ GIPC][3563381328] gipcCheckInitialization: possible incompatible non-threaded init from [prom.c : 690], original from [clsss.c : 5326]
2012-10-20 15:37:52.975: [ default][3563381328]clsvactversion:4: Retrieving Active Version from local storage.
2012-10-20 15:37:52.978: [ CSSCLNT][3563381328]clssgsgrppubdata: group (ocr_SFV9699-cluster) not found
2012-10-20 15:37:52.978: [ OCRRAW][3563381328]proprio_repairconf: Failed to retrieve the group public data. CSS ret code [20]
2012-10-20 15:37:52.981: [ OCRRAW][3563381328]proprioo: Failed to auto repair the OCR configuration.
2012-10-20 15:37:52.981: [ OCRRAW][3563381328]proprinit: Could not open raw device
2012-10-20 15:37:52.981: [ OCRASM][3563381328]proprasmcl: asmhandle is NULL
2012-10-20 15:37:52.983: [ OCRAPI][3563381328]a_init:16!: Backend init unsuccessful : [26]
2012-10-20 15:37:52.984: [ CRSOCR][3563381328] OCR context init failure. Error: PROC-26: Error while accessing the physical storage
ORA-27140: attach to post/wait facility failed
ORA-27300: OS system dependent operation:invalid_egid failed with status: 1
ORA-27301: OS failure message: Operation not permitted
ORA-27302: failure occurred at: skgpwinit6
ORA-27303: additional information: startup egid = 1000 (oinstall), current egid = 10002 (dba)
2012-10-20 15:37:52.984: [ CRSMAIN][3563381328] Created alert : (:CRSD00111:) : Could not init OCR, error: PROC-26: Error while accessing the physical storage
ORA-27140: attach to post/wait facility failed
ORA-27300: OS system dependent operation:invalid_egid failed with status: 1
ORA-27301: OS failure message: Operation not permitted
ORA-27302: failure occurred at: skgpwinit6
ORA-27303: additional information: startup egid = 1000 (oinstall), current egid = 10002 (dba)
2012-10-20 15:37:52.984: [ CRSD][3563381328][PANIC] CRSD exiting: Could not init OCR, code: 26
2012-10-20 15:37:52.984: [ CRSD][3563381328] Done.
=======================
I see in the above log that saying ASM instance is down and failed to open +DATA .
But the asm instance up and running
SQL> select instance_name,status from v$instance;
INSTANCE_NAME STATUS
+ASM1 STARTED
And we havent created any disk named DATA before the installation. We have created only below two disks
SQL> select name,header_status from v$asm_disk;
NAME HEADER_STATUS
ASM_DATA MEMBER
FLASH_RECOVERY MEMBER
But I am seeing a diskgroup in the v$asm_diskgroup which we havent created.
SQL> select name,state from v$asm_diskgroup;
NAME STATE
DATA MOUNTED
Ya this is a second time installtion. In the first installtion we created the asmdisk as DATA. But later everything (RAW device ) was formatted and this new disks has been created and installtion again started
[root@SFV9699 bin]# oracleasm listdisks
ASM_DATA
FLASH_RECOVERY
Seems like its trying to read the old disk DATA.
we have done asmscanning too with oracleasm scan disks. but no use.
Where I can remove the old entry of DATA disk.
It would be a great if a quick response get.
Thanks
SHIYAS MThe permission looks fine. If it was permission issue then y it is trying to read the DATA disk which I havent created this time at all ( But created in the first installation).
2012-10-20 15:37:52.459: [ CRSMAIN][3563381328] Initializing OCR
[ CLWAL][3563381328]clsw_Initialize: OLR initlevel [70000]
2012-10-20 15:37:52.897: [ OCRASM][3563381328]proprasmo: *Error in open/create file in dg [DATA]*[ OCRASM][3563381328]SLOS : SLOS: cat=7, opn=kgfoAl06, dep=27140, loc=kgfokge
2012-10-20 15:37:52.898: [ OCRASM][3563381328]ASM Error Stack : ORA-27140: attach to post/wait facility failed
ORA-27300: OS system dependent operation:invalid_egid failed with status: 1
ORA-27301: OS failure message: Operation not permitted
ORA-27302: failure occurred at: skgpwinit6
ORA-27303: additional information: startup egid = 1000 (oinstall), current egid = 10002 (dba)
2012-10-20 15:37:52.967: [ OCRASM][3563381328]proprasmo: kgfoCheckMount returned [7]
2012-10-20 15:37:52.967: [ OCRASM][3563381328]proprasmo: The ASM instance is down
2012-10-20 15:37:52.968: [ OCRRAW][3563381328]proprioo: *Failed to open [+DATA].* Returned proprasmo() with [26]. Marking location as UNAVAILABLE.
2012-10-20 15:37:52.968: [ OCRRAW][3563381328]proprioo: No OCR/OLR devices are usable
2012-10-20 15:37:52.968: [ OCRASM][3563381328]proprasmcl: asmhandle is NULL
The only disks created are
[root@SFV9699 dev]# oracleasm listdisks
ASM_DATA
FLASH_RECOVERY
And these disks are showing part of that group also.. Not quite sure how this happened..
what abt dropping this group.. will anything work. -
Failed root.sh on 1st Node of 11.2.0.2.0 RAC on HP-UX 11.31 Itanium 64
Started with 11.2.0.2.0 Grid Installation for 2 Node RAC on HP-UX 11.31 Itanium 64.
Copying Software to remote node & linking libraries were successfully without any issue (upto 76%). But got issue while executing root.sh on Node1
sph1erp:/oracle/11.2.0/grid #sh root.sh
Running Oracle 11g root script...
The following environment variables are set as:
ORACLE_OWNER= oracle
ORACLE_HOME= /oracle/11.2.0/grid
Enter the full pathname of the local bin directory: [usr/local/bin]:
Copying dbhome to /usr/local/bin ...
Copying oraenv to /usr/local/bin ...
Copying coraenv to /usr/local/bin ...
Creating /etc/oratab file...
Entries will be added to the /etc/oratab file as needed by
Database Configuration Assistant when a database is created
Finished running generic part of root script.
Now product-specific root actions will be performed.
Using configuration parameter file: /oracle/11.2.0/grid/crs/install/crsconfig_params
Creating trace directory
LOCAL ADD MODE
Creating OCR keys for user 'root', privgrp 'sys'..
Operation successful.
OLR initialization - successful
root wallet
root wallet cert
root cert export
peer wallet
profile reader wallet
pa wallet
peer wallet keys
pa wallet keys
peer cert request
pa cert request
peer cert
pa cert
peer root cert TP
profile reader root cert TP
pa root cert TP
peer pa cert TP
pa peer cert TP
profile reader pa cert TP
profile reader peer cert TP
peer user cert
pa user cert
Adding daemon to inittab
CRS-2672: Attempting to start 'ora.mdnsd' on 'sph1erp'
CRS-2676: Start of 'ora.mdnsd' on 'sph1erp' succeeded
CRS-2672: Attempting to start 'ora.gpnpd' on 'sph1erp'
CRS-2676: Start of 'ora.gpnpd' on 'sph1erp' succeeded
CRS-2672: Attempting to start 'ora.cssdmonitor' on 'sph1erp'
CRS-2672: Attempting to start 'ora.gipcd' on 'sph1erp'
CRS-2676: Start of 'ora.gipcd' on 'sph1erp' succeeded
CRS-2676: Start of 'ora.cssdmonitor' on 'sph1erp' succeeded
CRS-2672: Attempting to start 'ora.cssd' on 'sph1erp'
CRS-2672: Attempting to start 'ora.diskmon' on 'sph1erp'
CRS-2676: Start of 'ora.diskmon' on 'sph1erp' succeeded
CRS-2676: Start of 'ora.cssd' on 'sph1erp' succeeded
ASM created and started successfully.
Disk Group OCRVOTE created successfully.
clscfg: -install mode specified
Successfully accumulated necessary OCR keys.
Creating OCR keys for user 'root', privgrp 'sys'..
Operation successful.
CRS-4256: Updating the profile
Successful addition of voting disk ab847ed2b4f04f2dbfb875226d2bb194.
Successful addition of voting disk 85c05a5b30384f8dbff48cc069de7a7c.
Successful addition of voting disk 649196fbdd614f9cbf26a9a0e6670a6e.
Successful addition of voting disk 8815dfcee2e64f64bf00b9c76626ab41.
Successful addition of voting disk 8ce55fe5534f4f77bfa9f54187592707.
Successfully replaced voting disk group with +OCRVOTE.
CRS-4256: Updating the profile
CRS-4266: Voting file(s) successfully replaced
## STATE File Universal Id File Name Disk group
1. ONLINE ab847ed2b4f04f2dbfb875226d2bb194 (/dev/oracle/ocrvote1) [OCRVOTE]
2. ONLINE 85c05a5b30384f8dbff48cc069de7a7c (/dev/oracle/ocrvote2) [OCRVOTE]
3. ONLINE 649196fbdd614f9cbf26a9a0e6670a6e (/dev/oracle/ocrvote3) [OCRVOTE]
4. ONLINE 8815dfcee2e64f64bf00b9c76626ab41 (/dev/oracle/ocrvote4) [OCRVOTE]
5. ONLINE 8ce55fe5534f4f77bfa9f54187592707 (/dev/oracle/ocrvote5) [OCRVOTE]
Located 5 voting disk(s).
Start of resource "ora.cluster_interconnect.haip" failed
CRS-2672: Attempting to start 'ora.cluster_interconnect.haip' on 'sph1erp'
CRS-5017: The resource action "ora.cluster_interconnect.haip start" encountered the following error:
Start action for HAIP aborted
CRS-2674: Start of 'ora.cluster_interconnect.haip' on 'sph1erp' failed
CRS-2679: Attempting to clean 'ora.cluster_interconnect.haip' on 'sph1erp'
CRS-2681: Clean of 'ora.cluster_interconnect.haip' on 'sph1erp' succeeded
CRS-4000: Command Start failed, or completed with errors.
Failed to start Oracle Clusterware stack
Failed to start High Availability IP at /oracle/11.2.0/grid/crs/install/crsconfig_lib.pm line 1046.
*/oracle/11.2.0/grid/perl/bin/perl -I/oracle/11.2.0/grid/perl/lib -I/oracle/11.2.0/grid/crs/install /oracle/11.2.0/grid/crs/install/rootcrs.pl execution failed*
sph1erp:/oracle/11.2.0/grid #
Last few lines from CRS Log for node 1, where error came
[ctssd(6467)]CRS-2401:The Cluster Time Synchronization Service started on host sph1erp.
2011-02-25 23:04:16.491
[oracle/11.2.0/grid/bin/orarootagent.bin(6423)]CRS-5818:Aborted command 'start for resource: ora.cluster_interconnect.haip 1 1' for resource 'ora.cluster_int
erconnect.haip'. Details at (:CRSAGF00113:) {0:0:178} in */oracle/11.2.0/grid/log/sph1erp/agent/ohasd/orarootagent_root/orarootagent_root.log.*
2011-02-25 23:04:20.521
[ohasd(5513)]CRS-2757:Command 'Start' timed out waiting for response from the resource 'ora.cluster_interconnect.haip'. Details at (:CRSPE00111:) {0:0:178} in
*/oracle/11.2.0/grid/log/sph1erp/ohasd/ohasd.log.*
Few lines from */oracle/11.2.0/grid/log/sph1erp/agent/ohasd/orarootagent_root/orarootagent_root.log.*
=====================================================================================================
2011-02-25 23:04:16.823: [ USRTHRD][16] {0:0:178} Starting Probe for ip 169.254.74.54
2011-02-25 23:04:16.823: [ USRTHRD][16] {0:0:178} Transitioning to Probe State
2011-02-25 23:04:17.177: [ USRTHRD][15] {0:0:178} [NetHAMain] thread stopping
2011-02-25 23:04:17.177: [ USRTHRD][15] {0:0:178} Thread:[NetHAMain]isRunning is reset to false here
2011-02-25 23:04:17.178: [ USRTHRD][12] {0:0:178} Thread:[NetHAMain]stop }
2011-02-25 23:04:17.178: [ USRTHRD][12] {0:0:178} thread cleaning up
2011-02-25 23:04:17.178: [ USRTHRD][12] {0:0:178} pausing thread
2011-02-25 23:04:17.178: [ USRTHRD][12] {0:0:178} posting thread
2011-02-25 23:04:17.178: [ USRTHRD][12] {0:0:178} Thread:[NetHAWork]stop {
2011-02-25 23:04:17.645: [ USRTHRD][16] {0:0:178} [NetHAWork] thread stopping
2011-02-25 23:04:17.645: [ USRTHRD][16] {0:0:178} Thread:[NetHAWork]isRunning is reset to false here
2011-02-25 23:04:17.645: [ USRTHRD][12] {0:0:178} Thread:[NetHAWork]stop }
2011-02-25 23:04:17.645: [ USRTHRD][12] {0:0:178} Thread:[NetHAWork]stop {
2011-02-25 23:04:17.645: [ USRTHRD][12] {0:0:178} Thread:[NetHAWork]stop }
2011-02-25 23:04:17.891: [ora.cluster_interconnect.haip][12] {0:0:178} [start] Start of HAIP aborted
2011-02-25 23:04:17.892: [ AGENT][12] {0:0:178} UserErrorException: Locale is
2011-02-25 23:04:17.893: [ora.cluster_interconnect.haip][12] {0:0:178} [start] clsnUtils::error Exception type=2 string=
CRS-5017: The resource action "ora.cluster_interconnect.haip start" encountered the following error:
Start action for HAIP aborted
2011-02-25 23:04:17.893: [ AGFW][12] {0:0:178} sending status msg [CRS-5017: The resource action "ora.cluster_interconnect.haip start" encountered the foll
owing error:
Start action for HAIP aborted
] for start for resource: ora.cluster_interconnect.haip 1 1
2011-02-25 23:04:17.893: [ora.cluster_interconnect.haip][12] {0:0:178} [start] clsn_agent::start }
2011-02-25 23:04:17.894: [ AGFW][10] {0:0:178} Agent sending reply for: RESOURCE_START[ora.cluster_interconnect.haip 1 1] ID 4098:661
2011-02-25 23:04:18.552: [ora.diskmon][12] {0:0:154} [check] DiskmonAgent::check {
2011-02-25 23:04:18.552: [ora.diskmon][12] {0:0:154} [check] DiskmonAgent::check } - 0
2011-02-25 23:04:19.573: [ AGFW][10] {0:0:154} Agent received the message: AGENT_HB[Engine] ID 12293:669
2011-02-25 23:04:20.510: [ora.cluster_interconnect.haip][18] {0:0:178} [start] got lock
2011-02-25 23:04:20.511: [ora.cluster_interconnect.haip][18] {0:0:178} [start] tryActionLock }
2011-02-25 23:04:20.511: [ora.cluster_interconnect.haip][18] {0:0:178} [start] abort }
2011-02-25 23:04:20.511: [ora.cluster_interconnect.haip][18] {0:0:178} [start] clsn_agent::abort }
2011-02-25 23:04:20.511: [ AGFW][18] {0:0:178} Command: start for resource: ora.cluster_interconnect.haip 1 1 completed with status: TIMEDOUT
2011-02-25 23:04:20.512: [ora.cluster_interconnect.haip][8] {0:0:178} [check] NetworkAgent::init enter {
2011-02-25 23:04:20.513: [ora.cluster_interconnect.haip][8] {0:0:178} [check] NetworkAgent::init exit }
2011-02-25 23:04:20.517: [ AGFW][10] {0:0:178} Agent sending reply for: RESOURCE_START[ora.cluster_interconnect.haip 1 1] ID 4098:661
2011-02-25 23:04:20.519: [ USRTHRD][8] {0:0:178} Ocr Context init default level 23886304
2011-02-25 23:04:20.519: [ default][8]clsvactversion:4: Retrieving Active Version from local storage.
[ CLWAL][8]clsw_Initialize: OLR initlevel [70000]
Few lines from */oracle/11.2.0/grid/log/sph1erp/ohasd/ohasd.log.*
=====================================================================================================
2011-02-25 23:04:21.627: [UiServer][30] {0:0:180} Done for ctx=6000000002604ce0
2011-02-25 23:04:21.642: [UiServer][31] Closed: remote end failed/disc.
2011-02-25 23:04:26.139: [ CLSINET][33]Returning NETDATA: 1 interfaces
2011-02-25 23:04:26.139: [ CLSINET][33]# 0 Interface 'lan2',ip='10.10.16.50',mac='3c-4a-92-48-71-be',mask='255.255.255.240',net='10.10.16.48',use='cluster_int
erconnect'
2011-02-25 23:04:26.973: [UiServer][31] CS(60000000014b0790)set Properties ( root,60000000012e0260)
2011-02-25 23:04:26.973: [UiServer][31] SS(6000000001372270)Accepted client connection: saddr =(ADDRESS=(PROTOCOL=ipc)(DEV=92)(KEY=OHASD_UI_SOCKET))daddr = (A
DDRESS=(PROTOCOL=ipc)(KEY=OHASD_UI_SOCKET))
2011-02-25 23:04:26.992: [UiServer][30] {0:0:181} processMessage called
2011-02-25 23:04:26.993: [UiServer][30] {0:0:181} Sending message to PE. ctx= 6000000001b440f0
2011-02-25 23:04:26.993: [UiServer][30] {0:0:181} Sending command to PE: 67
2011-02-25 23:04:26.994: [ CRSPE][29] {0:0:181} Processing PE command id=173. Description: [Stat Resource : 600000000135f760]
2011-02-25 23:04:26.997: [UiServer][30] {0:0:181} Done for ctx=6000000001b440f0
2011-02-25 23:04:27.012: [UiServer][31] Closed: remote end failed/disc.
2011-02-25 23:04:31.135: [ CLSINET][33]Returning NETDATA: 1 interfaces
2011-02-25 23:04:31.135: [ CLSINET][33]# 0 Interface 'lan2',ip='10.10.16.50',mac='3c-4a-92-48-71-be',mask='255.255.255.240',net='10.10.16.48',use='cluster_int
erconnect'
2011-02-25 23:04:32.318: [UiServer][31] CS(60000000014b0790)set Properties ( root,60000000012e0260)
2011-02-25 23:04:32.318: [UiServer][31] SS(6000000001372270)Accepted client connection: saddr =(ADDRESS=(PROTOCOL=ipc)(DEV=92)(KEY=OHASD_UI_SOCKET))daddr = (A
DDRESS=(PROTOCOL=ipc)(KEY=OHASD_UI_SOCKET))
2011-02-25 23:04:32.332: [UiServer][30] {0:0:182} processMessage called
2011-02-25 23:04:32.333: [UiServer][30] {0:0:182} Sending message to PE. ctx= 6000000001b45ef0
2011-02-25 23:04:32.333: [UiServer][30] {0:0:182} Sending command to PE: 68
2011-02-25 23:04:32.334: [ CRSPE][29] {0:0:182} Processing PE command id=174. Description: [Stat Resource : 600000000135f760]
2011-02-25 23:04:32.338: [UiServer][30] {0:0:182} Done for ctx=6000000001b45ef0
2011-02-25 23:04:32.352: [UiServer][31] Closed: remote end failed/disc.
2011-02-25 23:04:36.155: [ CLSINET][33]Returning NETDATA: 1 interfaces
2011-02-25 23:04:36.155: [ CLSINET][33]# 0 Interface 'lan2',ip='10.10.16.50',mac='3c-4a-92-48-71-be',mask='255.255.255.240',net='10.10.16.48',use='cluster_int
erconnect'
2011-02-25 23:04:37.683: [UiServer][31] CS(60000000014b0790)set Properties ( root,60000000012e0260)
2011-02-25 23:04:37.683: [UiServer][31] SS(6000000001372270)Accepted client connection: saddr =(ADDRESS=(PROTOCOL=ipc)(DEV=92)(KEY=OHASD_UI_SOCKET))daddr = (A
DDRESS=(PROTOCOL=ipc)(KEY=OHASD_UI_SOCKET))
2011-02-25 23:04:37.702: [UiServer][30] {0:0:183} processMessage called
2011-02-25 23:04:37.703: [UiServer][30] {0:0:183} Sending message to PE. ctx= 6000000002604ce0
2011-02-25 23:04:37.703: [UiServer][30] {0:0:183} Sending command to PE: 69
2011-02-25 23:04:37.704: [ CRSPE][29] {0:0:183} Processing PE command id=175. Description: [Stat Resource : 600000000135f760]
2011-02-25 23:04:37.708: [UiServer][30] {0:0:183} Done for ctx=6000000002604ce0
2011-02-25 23:04:37.722: [UiServer][31] Closed: remote end failed/disc.
2011-02-25 23:04:41.156: [ CLSINET][33]Returning NETDATA: 1 interfaces
2011-02-25 23:04:41.156: [ CLSINET][33]# 0 Interface 'lan2',ip='10.10.16.50',mac='3c-4a-92-48-71-be',mask='255.255.255.240',net='10.10.16.48',use='cluster_int
erconnect'
What could be the issue ????
Experts Please help me. Doing setup for the PRoduction Env...
Do response ASAP...... Thanks
Regards,
ManishThanks Sebastian for your input.
yes. my lan2 is used for Cluster_interconnect which is having subnet 255.255.255.240.
Below are IPs used for RAC
Public
Node1: 10.10.1.173/255.255.240.0
Node2: 10.10.1.174/255.255.240.0
Private
Node1: 10.10.16.50/255.255.255.240
Node2: 10.10.16.51/255.255.255.240
Virtual
Node1: 10.10.1.191/255.255.240.0
Node2: 10.10.1.192/255.255.240.0
SCAN (Defined in DNS)
10.10.1.193/255.255.240.0
10.10.1.194/255.255.240.0
10.10.1.195/255.255.240.0
As you said, I will scrap GI Software again & will try with 255.255.255.0.
I Believe this Redundant Interconnect and ora.cluster_interconnect.haip present in 11.2.0.2.0 Version.
Oracle says:
Redundant Interconnect without any 3rd-party IP failover technology (bond, IPMP or similar) is supported natively by Grid Infrastructure starting from 11.2.0.2. Multiple private network adapters can be defined either during the installation phase or afterward using the oifcfg. Oracle Database, CSS, OCR, CRS, CTSS, and EVM components in 11.2.0.2 employ it automatically.
Grid Infrastructure can activate a maximum of four private network adapters at a time even if more are defined. The ora.cluster_interconnect.haip resource will start one to four link local HAIP on private network adapters for interconnect communication for Oracle RAC, Oracle ASM, and Oracle ACFS etc.
Grid automatically picks link local addresses from reserved 169.254.*.* subnet for HAIP, and it will not attempt to use any 169.254.*.* address if it's already in use for another purpose. With HAIP, by default, interconnect traffic will be load balanced across all active interconnect interfaces, and corresponding HAIP address will be failed over transparently to other adapters if one fails or becomes non-communicative. .
The number of HAIP addresses is decided by how many private network adapters are active when Grid comes up on the first node in the cluster . If there's only one active private network, Grid will create one; if two, Grid will create two; and if more than two, Grid will create four HAIPs. The number of HAIPs won't change even if more private network adapters are activated later, a restart of clusterware on all nodes is required for new adapters to become effective.
In my Setup, I am having Teaming for NIC's for Public & Private Interface. So I am thinking to break teaming of NICs because HAIP internally searching for next available NIC & not getting as all 4 are already in used with OS level NIC teaming.
My only Concern is, as I am going to change subnet for the Private IPs, should I change Private IP address ????
Thanks for the Support...
Regards,
Manish -
Failing all pre-requisite checks for 11.2.0.2.0 RAC on HP-UX Itanium 64
Hi Guys,
For Typical OR Advanced Grid Installation (GUI), all pre-requisites are failing on both nodes, like memory, swap, node reachability, groups, user & lot more.....
But when I try to check Pre-requisite from command line, everything seems to be ok.
This is what the output...
$ ./runcluvfy.sh stage -pre crsinst -n sph1erp,sph2erp -fixup -verbose
Performing pre-checks for cluster services setup
Checking node reachability...
Check: Node reachability from node "sph1erp"
Destination Node Reachable?
sph1erp yes
sph2erp yes
Result: Node reachability check passed from node "sph1erp"
Checking user equivalence...
Check: User equivalence for user "oracle"
Node Name Comment
sph2erp passed
sph1erp passed
Result: User equivalence check passed for user "oracle"
Checking node connectivity...
Checking hosts config file...
Node Name Status Comment
sph2erp passed
sph1erp passed
Verification of the hosts config file successful
Interface information for node "sph2erp"
Name IP Address Subnet Gateway Def. Gateway HW Address MTU
lan2 10.10.16.51 10.10.16.48 10.10.16.51 10.10.1.12 78:AC:C0:8A:07:76 1500
lan900 10.10.1.174 10.10.0.0 10.10.1.174 10.10.1.12 78:AC:C0:8A:07:6E 1500
Interface information for node "sph1erp"
Name IP Address Subnet Gateway Def. Gateway HW Address MTU
lan2 10.10.16.50 10.10.16.48 10.10.16.50 10.10.1.12 3C:4A:92:48:71:BE 1500
lan900 10.10.1.173 10.10.0.0 10.10.1.173 10.10.1.12 3C:4A:92:48:71:B6 1500
Check: Node connectivity of subnet "10.10.16.48"
Source Destination Connected?
sph2erp[10.10.16.51] sph1erp[10.10.16.50] yes
Result: Node connectivity passed for subnet "10.10.16.48" with node(s) sph2erp,sph1erp
Check: TCP connectivity of subnet "10.10.16.48"
Source Destination Connected?
sph1erp:10.10.16.50 sph2erp:10.10.16.51 passed
Result: TCP connectivity check passed for subnet "10.10.16.48"
Check: Node connectivity of subnet "10.10.0.0"
Source Destination Connected?
sph2erp[10.10.1.174] sph1erp[10.10.1.173] yes
Result: Node connectivity passed for subnet "10.10.0.0" with node(s) sph2erp,sph1erp
Check: TCP connectivity of subnet "10.10.0.0"
Source Destination Connected?
sph1erp:10.10.1.173 sph2erp:10.10.1.174 passed
Result: TCP connectivity check passed for subnet "10.10.0.0"
Interfaces found on subnet "10.10.0.0" that are likely candidates for VIP are:
sph2erp lan900:10.10.1.174
sph1erp lan900:10.10.1.173
Interfaces found on subnet "10.10.16.48" that are likely candidates for a private interconnect are:
sph2erp lan2:10.10.16.51
sph1erp lan2:10.10.16.50
Result: Node connectivity check passed
Check: Total memory
Node Name Available Required Comment
sph2erp 63.9GB (6.7004024E7KB) 4GB (4194304.0KB) passed
sph1erp 63.9GB (6.7004024E7KB) 4GB (4194304.0KB) passed
Result: Total memory check passed
Check: Available memory
Node Name Available Required Comment
sph2erp 53.3556GB (5.5947372E7KB) 50MB (51200.0KB) passed
sph1erp 52.2323GB (5.47695E7KB) 50MB (51200.0KB) passed
Result: Available memory check passed
Check: Swap space
Node Name Available Required Comment
sph2erp 188.7773GB (1.97947352E8KB) 4GB (4194304.0KB) passed
sph1erp 188.7773GB (1.97947352E8KB) 4GB (4194304.0KB) passed
Result: Swap space check passed
Check: Free disk space for "sph2erp:/var/tmp/"
Path Node Name Mount point Available Required Comment
/var/tmp/ sph2erp /var 13.8074GB 1GB passed
Result: Free disk space check passed for "sph2erp:/var/tmp/"
Check: Free disk space for "sph1erp:/var/tmp/"
Path Node Name Mount point Available Required Comment
/var/tmp/ sph1erp /var 13.8158GB 1GB passed
Result: Free disk space check passed for "sph1erp:/var/tmp/"
Check: User existence for "oracle"
Node Name Status Comment
sph2erp exists(199) passed
sph1erp exists(199) passed
Checking for multiple users with UID value 199
Result: Check for multiple users with UID value 199 passed
Result: User existence check passed for "oracle"
Check: Group existence for "oinstall"
Node Name Status Comment
sph2erp exists passed
sph1erp exists passed
Result: Group existence check passed for "oinstall"
Check: Group existence for "dba"
Node Name Status Comment
sph2erp exists passed
sph1erp exists passed
Result: Group existence check passed for "dba"
Check: Membership of user "oracle" in group "oinstall" [as Primary]
Node Name User Exists Group Exists User in Group Primary Comment
sph2erp yes yes yes yes passed
sph1erp yes yes yes yes passed
Result: Membership check for user "oracle" in group "oinstall" [as Primary] passed
Check: Membership of user "oracle" in group "dba"
Node Name User Exists Group Exists User in Group Comment
sph2erp yes yes yes passed
sph1erp yes yes yes passed
Result: Membership check for user "oracle" in group "dba" passed
Check: Run level
Node Name run level Required Comment
sph2erp 3 3 passed
sph1erp 3 3 passed
Result: Run level check passed
Check: Hard limits for "maximum open file descriptors"
Node Name Type Available Required Comment
sph2erp hard 63488 63488 passed
sph1erp hard 63488 63488 passed
Result: Hard limits check passed for "maximum open file descriptors"
Check: Soft limits for "maximum open file descriptors"
Node Name Type Available Required Comment
sph2erp soft 1024 1024 passed
sph1erp soft 63488 1024 passed
Result: Soft limits check passed for "maximum open file descriptors"
Check: Hard limits for "maximum user processes"
Node Name Type Available Required Comment
sph2erp hard 3687 3686 passed
sph1erp hard 3687 3686 passed
Result: Hard limits check passed for "maximum user processes"
Check: Soft limits for "maximum user processes"
Node Name Type Available Required Comment
sph2erp soft 3687 2047 passed
sph1erp soft 3687 2047 passed
Result: Soft limits check passed for "maximum user processes"
Check: System architecture
Node Name Available Required Comment
sph2erp ia64 ia64 passed
sph1erp ia64 ia64 passed
Result: System architecture check passed
Check: Kernel version
Node Name Available Required Comment
sph2erp HP-UX B.11.31 B.11.31 passed
sph1erp HP-UX B.11.31 B.11.31 passed
Result: Kernel version check passed
Check: Kernel parameter for "ksi_alloc_max"
Node Name Configured Required Comment
sph2erp 32768 32768 passed
sph1erp 32768 32768 passed
Result: Kernel parameter check passed for "ksi_alloc_max"
Check: Kernel parameter for "executable_stack"
Node Name Configured Required Comment
sph2erp 0 0 passed
sph1erp 0 0 passed
Result: Kernel parameter check passed for "executable_stack"
Check: Kernel parameter for "max_thread_proc"
Node Name Configured Required Comment
sph2erp 1024 1024 passed
sph1erp 1024 1024 passed
Result: Kernel parameter check passed for "max_thread_proc"
Check: Kernel parameter for "maxdsiz"
Node Name Configured Required Comment
sph2erp 1073741824 1073741824 passed
sph1erp 1073741824 1073741824 passed
Result: Kernel parameter check passed for "maxdsiz"
Check: Kernel parameter for "maxdsiz_64bit"
Node Name Configured Required Comment
sph2erp 2147483648 2147483648 passed
sph1erp 2147483648 2147483648 passed
Result: Kernel parameter check passed for "maxdsiz_64bit"
Check: Kernel parameter for "maxssiz"
Node Name Configured Required Comment
sph2erp 134217728 134217728 passed
sph1erp 134217728 134217728 passed
Result: Kernel parameter check passed for "maxssiz"
Check: Kernel parameter for "maxssiz_64bit"
Node Name Configured Required Comment
sph2erp 1073741824 1073741824 passed
sph1erp 1073741824 1073741824 passed
Result: Kernel parameter check passed for "maxssiz_64bit"
Check: Kernel parameter for "maxuprc"
Node Name Configured Required Comment
sph2erp 3686 3686 passed
sph1erp 3686 3686 passed
Result: Kernel parameter check passed for "maxuprc"
Check: Kernel parameter for "msgmni"
Node Name Configured Required Comment
sph2erp 4096 4096 passed
sph1erp 4096 4096 passed
Result: Kernel parameter check passed for "msgmni"
Check: Kernel parameter for "msgtql"
Node Name Configured Required Comment
sph2erp 4096 4096 passed
sph1erp 4096 4096 passed
Result: Kernel parameter check passed for "msgtql"
Check: Kernel parameter for "ncsize"
Node Name Configured Required Comment
sph2erp 35840 35840 passed
sph1erp 35840 35840 passed
Result: Kernel parameter check passed for "ncsize"
Check: Kernel parameter for "shmmax"
Node Name Configured Required Comment
sph2erp 1073741824 1073741824 passed
sph1erp 1073741824 1073741824 passed
Result: Kernel parameter check passed for "shmmax"
Check: Kernel parameter for "shmmni"
Node Name Configured Required Comment
sph2erp 4096 4096 passed
sph1erp 4096 4096 passed
Result: Kernel parameter check passed for "shmmni"
Check: Kernel parameter for "shmseg"
Node Name Configured Required Comment
sph2erp 512 512 passed
sph1erp 512 512 passed
Result: Kernel parameter check passed for "shmseg"
Check: Kernel parameter for "tcp_smallest_anon_port"
Node Name Configured Required Comment
sph2erp 9000 9000 passed
sph1erp 9000 9000 passed
Result: Kernel parameter check passed for "tcp_smallest_anon_port"
Check: Kernel parameter for "tcp_largest_anon_port"
Node Name Configured Required Comment
sph2erp 65500 65500 passed
sph1erp 65500 65500 passed
Result: Kernel parameter check passed for "tcp_largest_anon_port"
Check: Kernel parameter for "udp_smallest_anon_port"
Node Name Configured Required Comment
sph2erp 9000 9000 passed
sph1erp 9000 9000 passed
Result: Kernel parameter check passed for "udp_smallest_anon_port"
Check: Kernel parameter for "udp_largest_anon_port"
Node Name Configured Required Comment
sph2erp 65500 65500 passed
sph1erp 65500 65500 passed
Result: Kernel parameter check passed for "udp_largest_anon_port"
Check: Package existence for "OS-Core-B.11.31( ia64)"
Node Name Available Required Comment
sph2erp OS-Core-B.11.31-0 OS-Core-B.11.31( ia64) passed
sph1erp OS-Core-B.11.31-0 OS-Core-B.11.31( ia64) passed
Result: Package existence check passed for "OS-Core-B.11.31( ia64)"
Check: Operating system patch for "Patch PHKL_38938"
Node Name Applied Required Comment
sph2erp Patch PHKL_39646 Patch PHKL_38938 passed
sph1erp Patch PHKL_39646 Patch PHKL_38938 passed
Result: Operating system patch check passed for "Patch PHKL_38938"
Check: Operating system patch for "Patch PHKL_39351"
Node Name Applied Required Comment
sph2erp Patch PHKL_40207 Patch PHKL_39351 passed
sph1erp Patch PHKL_40207 Patch PHKL_39351 passed
Result: Operating system patch check passed for "Patch PHKL_39351"
Check: Operating system patch for "Patch PHSS_36354"
Node Name Applied Required Comment
sph2erp Patch PHSS_40546 Patch PHSS_36354 passed
sph1erp Patch PHSS_40546 Patch PHSS_36354 passed
Result: Operating system patch check passed for "Patch PHSS_36354"
Check: Operating system patch for "Patch PHSS_37042"
Node Name Applied Required Comment
sph2erp Patch PHSS_37042 Patch PHSS_37042 passed
sph1erp Patch PHSS_37042 Patch PHSS_37042 passed
Result: Operating system patch check passed for "Patch PHSS_37042"
Check: Operating system patch for "Patch PHSS_37959"
Node Name Applied Required Comment
sph2erp Patch PHSS_40804 Patch PHSS_37959 passed
sph1erp Patch PHSS_40804 Patch PHSS_37959 passed
Result: Operating system patch check passed for "Patch PHSS_37959"
Check: Operating system patch for "Patch PHSS_39094"
Node Name Applied Required Comment
sph2erp Patch PHSS_40538 Patch PHSS_39094 passed
sph1erp Patch PHSS_40538 Patch PHSS_39094 passed
Result: Operating system patch check passed for "Patch PHSS_39094"
Check: Operating system patch for "Patch PHSS_39100"
Node Name Applied Required Comment
sph2erp Patch PHSS_40540 Patch PHSS_39100 passed
sph1erp Patch PHSS_40540 Patch PHSS_39100 passed
Result: Operating system patch check passed for "Patch PHSS_39100"
Check: Operating system patch for "Patch PHSS_39102"
Node Name Applied Required Comment
sph2erp Patch PHSS_41496 Patch PHSS_39102 passed
sph1erp Patch PHSS_41496 Patch PHSS_39102 passed
Result: Operating system patch check passed for "Patch PHSS_39102"
Check: Operating system patch for "Patch PHSS_38141"
Node Name Applied Required Comment
sph2erp Patch PHSS_38141 Patch PHSS_38141 passed
sph1erp Patch PHSS_38141 Patch PHSS_38141 passed
Result: Operating system patch check passed for "Patch PHSS_38141"
Check: Operating system patch for "Patch PHCO_40381"
Node Name Applied Required Comment
sph2erp Patch PHCO_40381 Patch PHCO_40381 passed
sph1erp Patch PHCO_40381 Patch PHCO_40381 passed
Result: Operating system patch check passed for "Patch PHCO_40381"
Check: Operating system patch for "Patch PHKL_38038"
Node Name Applied Required Comment
sph2erp Patch PHKL_41005 Patch PHKL_38038 passed
sph1erp Patch PHKL_41005 Patch PHKL_38038 passed
Result: Operating system patch check passed for "Patch PHKL_38038"
Checking for multiple users with UID value 0
Result: Check for multiple users with UID value 0 passed
Check: Current group ID
Result: Current group ID check passed
Starting Clock synchronization checks using Network Time Protocol(NTP)...
NTP Configuration file check started...
Network Time Protocol(NTP) configuration file not found on any of the nodes. Oracle Cluster Time Synchronization Service(CTSS) can be used instead of NTP for time synchronization on the cluster nodes
No NTP Daemons or Services were found to be running
Result: Clock synchronization check using Network Time Protocol(NTP) passed
Checking Core file name pattern consistency...
Core file name pattern consistency check passed.
Checking to make sure user "oracle" is not in "root" group
Node Name Status Comment
sph2erp does not exist passed
sph1erp does not exist passed
Result: User "oracle" is not part of "root" group. Check passed
Check default user file creation mask
Node Name Available Required Comment
sph2erp 022 0022 passed
sph1erp 022 0022 passed
Result: Default user file creation mask check passed
Checking consistency of file "/etc/resolv.conf" across nodes
Node Name Status
sph2erp passed
sph1erp passed
The DNS response time for an unreachable node is within acceptable limit on all nodes
File "/etc/resolv.conf" is consistent across nodes
Check: Time zone consistency
Result: Time zone consistency check passed
Checking settings of device file "/dev/async"
Node Name Available Comment
sph2erp yes failed (incorrect setting for minor number.)
sph1erp yes failed (incorrect setting for minor number.)
Result: Check for settings of device file "/dev/async" failed.
Starting check for The SSH LoginGraceTime setting ...
WARNING:
PRVE-0038 : The SSH LoginGraceTime setting on node "sph2erp" may result in users being disconnected before login is completed
PRVE-0038 : The SSH LoginGraceTime setting on node "sph1erp" may result in users being disconnected before login is completed
Check for The SSH LoginGraceTime setting passed
Fixup information has been generated for following node(s):
sph2erp,sph1erp
Please run the following script on each node as "root" user to execute the fixups:
'/tmp/CVU_11.2.0.2.0_oracle/runfixup.sh'
Pre-check for cluster services setup was unsuccessful on all the nodes.
What could be the issue ????
Any help would be appreciated...
Regards,
ManishStarted with Grid Installation. Copying Software to remote node & linking libraries were successfully without any issue (upto 76%). But got issue while executing root.sh on Node1
sph1erp:/oracle/11.2.0/grid #sh root.sh
Running Oracle 11g root script...
The following environment variables are set as:
ORACLE_OWNER= oracle
ORACLE_HOME= /oracle/11.2.0/grid
Enter the full pathname of the local bin directory: [usr/local/bin]:
Copying dbhome to /usr/local/bin ...
Copying oraenv to /usr/local/bin ...
Copying coraenv to /usr/local/bin ...
Creating /etc/oratab file...
Entries will be added to the /etc/oratab file as needed by
Database Configuration Assistant when a database is created
Finished running generic part of root script.
Now product-specific root actions will be performed.
Using configuration parameter file: /oracle/11.2.0/grid/crs/install/crsconfig_params
Creating trace directory
LOCAL ADD MODE
Creating OCR keys for user 'root', privgrp 'sys'..
Operation successful.
OLR initialization - successful
root wallet
root wallet cert
root cert export
peer wallet
profile reader wallet
pa wallet
peer wallet keys
pa wallet keys
peer cert request
pa cert request
peer cert
pa cert
peer root cert TP
profile reader root cert TP
pa root cert TP
peer pa cert TP
pa peer cert TP
profile reader pa cert TP
profile reader peer cert TP
peer user cert
pa user cert
Adding daemon to inittab
CRS-2672: Attempting to start 'ora.mdnsd' on 'sph1erp'
CRS-2676: Start of 'ora.mdnsd' on 'sph1erp' succeeded
CRS-2672: Attempting to start 'ora.gpnpd' on 'sph1erp'
CRS-2676: Start of 'ora.gpnpd' on 'sph1erp' succeeded
CRS-2672: Attempting to start 'ora.cssdmonitor' on 'sph1erp'
CRS-2672: Attempting to start 'ora.gipcd' on 'sph1erp'
CRS-2676: Start of 'ora.gipcd' on 'sph1erp' succeeded
CRS-2676: Start of 'ora.cssdmonitor' on 'sph1erp' succeeded
CRS-2672: Attempting to start 'ora.cssd' on 'sph1erp'
CRS-2672: Attempting to start 'ora.diskmon' on 'sph1erp'
CRS-2676: Start of 'ora.diskmon' on 'sph1erp' succeeded
CRS-2676: Start of 'ora.cssd' on 'sph1erp' succeeded
ASM created and started successfully.
Disk Group OCRVOTE created successfully.
clscfg: -install mode specified
Successfully accumulated necessary OCR keys.
Creating OCR keys for user 'root', privgrp 'sys'..
Operation successful.
CRS-4256: Updating the profile
Successful addition of voting disk ab847ed2b4f04f2dbfb875226d2bb194.
Successful addition of voting disk 85c05a5b30384f8dbff48cc069de7a7c.
Successful addition of voting disk 649196fbdd614f9cbf26a9a0e6670a6e.
Successful addition of voting disk 8815dfcee2e64f64bf00b9c76626ab41.
Successful addition of voting disk 8ce55fe5534f4f77bfa9f54187592707.
Successfully replaced voting disk group with +OCRVOTE.
CRS-4256: Updating the profile
CRS-4266: Voting file(s) successfully replaced
## STATE File Universal Id File Name Disk group
1. ONLINE ab847ed2b4f04f2dbfb875226d2bb194 (/dev/oracle/ocrvote1) [OCRVOTE]
2. ONLINE 85c05a5b30384f8dbff48cc069de7a7c (/dev/oracle/ocrvote2) [OCRVOTE]
3. ONLINE 649196fbdd614f9cbf26a9a0e6670a6e (/dev/oracle/ocrvote3) [OCRVOTE]
4. ONLINE 8815dfcee2e64f64bf00b9c76626ab41 (/dev/oracle/ocrvote4) [OCRVOTE]
5. ONLINE 8ce55fe5534f4f77bfa9f54187592707 (/dev/oracle/ocrvote5) [OCRVOTE]
Located 5 voting disk(s).
Start of resource "ora.cluster_interconnect.haip" failed
CRS-2672: Attempting to start 'ora.cluster_interconnect.haip' on 'sph1erp'
CRS-5017: The resource action "ora.cluster_interconnect.haip start" encountered the following error:
Start action for HAIP aborted
CRS-2674: Start of 'ora.cluster_interconnect.haip' on 'sph1erp' failed
CRS-2679: Attempting to clean 'ora.cluster_interconnect.haip' on 'sph1erp'
CRS-2681: Clean of 'ora.cluster_interconnect.haip' on 'sph1erp' succeeded
CRS-4000: Command Start failed, or completed with errors.
Failed to start Oracle Clusterware stack
Failed to start High Availability IP at /oracle/11.2.0/grid/crs/install/crsconfig_lib.pm line 1046.
/oracle/11.2.0/grid/perl/bin/perl -I/oracle/11.2.0/grid/perl/lib -I/oracle/11.2.0/grid/crs/install /oracle/11.2.0/grid/crs/install/rootcrs.pl execution failed
sph1erp:/oracle/11.2.0/grid #
Last few lines from CRS Log for node 1, where error came
[ctssd(6467)]CRS-2401:The Cluster Time Synchronization Service started on host sph1erp.
2011-02-25 23:04:16.491
[oracle/11.2.0/grid/bin/orarootagent.bin(6423)]CRS-5818:Aborted command 'start for resource: ora.cluster_interconnect.haip 1 1' for resource 'ora.cluster_int
erconnect.haip'. Details at (:CRSAGF00113:) {0:0:178} in */oracle/11.2.0/grid/log/sph1erp/agent/ohasd/orarootagent_root/orarootagent_root.log.*
2011-02-25 23:04:20.521
[ohasd(5513)]CRS-2757:Command 'Start' timed out waiting for response from the resource 'ora.cluster_interconnect.haip'. Details at (:CRSPE00111:) {0:0:178} in
*/oracle/11.2.0/grid/log/sph1erp/ohasd/ohasd.log.*
Few lines from */oracle/11.2.0/grid/log/sph1erp/agent/ohasd/orarootagent_root/orarootagent_root.log.*
=====================================================================================================
2011-02-25 23:04:16.823: [ USRTHRD][16] {0:0:178} Starting Probe for ip 169.254.74.54
2011-02-25 23:04:16.823: [ USRTHRD][16] {0:0:178} Transitioning to Probe State
2011-02-25 23:04:17.177: [ USRTHRD][15] {0:0:178} [NetHAMain] thread stopping
2011-02-25 23:04:17.177: [ USRTHRD][15] {0:0:178} Thread:[NetHAMain]isRunning is reset to false here
2011-02-25 23:04:17.178: [ USRTHRD][12] {0:0:178} Thread:[NetHAMain]stop }
2011-02-25 23:04:17.178: [ USRTHRD][12] {0:0:178} thread cleaning up
2011-02-25 23:04:17.178: [ USRTHRD][12] {0:0:178} pausing thread
2011-02-25 23:04:17.178: [ USRTHRD][12] {0:0:178} posting thread
2011-02-25 23:04:17.178: [ USRTHRD][12] {0:0:178} Thread:[NetHAWork]stop {
2011-02-25 23:04:17.645: [ USRTHRD][16] {0:0:178} [NetHAWork] thread stopping
2011-02-25 23:04:17.645: [ USRTHRD][16] {0:0:178} Thread:[NetHAWork]isRunning is reset to false here
2011-02-25 23:04:17.645: [ USRTHRD][12] {0:0:178} Thread:[NetHAWork]stop }
2011-02-25 23:04:17.645: [ USRTHRD][12] {0:0:178} Thread:[NetHAWork]stop {
2011-02-25 23:04:17.645: [ USRTHRD][12] {0:0:178} Thread:[NetHAWork]stop }
2011-02-25 23:04:17.891: [ora.cluster_interconnect.haip][12] {0:0:178} [start] Start of HAIP aborted
2011-02-25 23:04:17.892: [ AGENT][12] {0:0:178} UserErrorException: Locale is
2011-02-25 23:04:17.893: [ora.cluster_interconnect.haip][12] {0:0:178} [start] clsnUtils::error Exception type=2 string=
CRS-5017: The resource action "ora.cluster_interconnect.haip start" encountered the following error:
Start action for HAIP aborted
2011-02-25 23:04:17.893: [ AGFW][12] {0:0:178} sending status msg [CRS-5017: The resource action "ora.cluster_interconnect.haip start" encountered the foll
owing error:
Start action for HAIP aborted
] for start for resource: ora.cluster_interconnect.haip 1 1
2011-02-25 23:04:17.893: [ora.cluster_interconnect.haip][12] {0:0:178} [start] clsn_agent::start }
2011-02-25 23:04:17.894: [ AGFW][10] {0:0:178} Agent sending reply for: RESOURCE_START[ora.cluster_interconnect.haip 1 1] ID 4098:661
2011-02-25 23:04:18.552: [ora.diskmon][12] {0:0:154} [check] DiskmonAgent::check {
2011-02-25 23:04:18.552: [ora.diskmon][12] {0:0:154} [check] DiskmonAgent::check } - 0
2011-02-25 23:04:19.573: [ AGFW][10] {0:0:154} Agent received the message: AGENT_HB[Engine] ID 12293:669
2011-02-25 23:04:20.510: [ora.cluster_interconnect.haip][18] {0:0:178} [start] got lock
2011-02-25 23:04:20.511: [ora.cluster_interconnect.haip][18] {0:0:178} [start] tryActionLock }
2011-02-25 23:04:20.511: [ora.cluster_interconnect.haip][18] {0:0:178} [start] abort }
2011-02-25 23:04:20.511: [ora.cluster_interconnect.haip][18] {0:0:178} [start] clsn_agent::abort }
2011-02-25 23:04:20.511: [ AGFW][18] {0:0:178} Command: start for resource: ora.cluster_interconnect.haip 1 1 completed with status: TIMEDOUT
2011-02-25 23:04:20.512: [ora.cluster_interconnect.haip][8] {0:0:178} [check] NetworkAgent::init enter {
2011-02-25 23:04:20.513: [ora.cluster_interconnect.haip][8] {0:0:178} [check] NetworkAgent::init exit }
2011-02-25 23:04:20.517: [ AGFW][10] {0:0:178} Agent sending reply for: RESOURCE_START[ora.cluster_interconnect.haip 1 1] ID 4098:661
2011-02-25 23:04:20.519: [ USRTHRD][8] {0:0:178} Ocr Context init default level 23886304
2011-02-25 23:04:20.519: [ default][8]clsvactversion:4: Retrieving Active Version from local storage.
[ CLWAL][8]clsw_Initialize: OLR initlevel [70000]
Few lines from */oracle/11.2.0/grid/log/sph1erp/ohasd/ohasd.log.*
=====================================================================================================
2011-02-25 23:04:21.627: [UiServer][30] {0:0:180} Done for ctx=6000000002604ce0
2011-02-25 23:04:21.642: [UiServer][31] Closed: remote end failed/disc.
2011-02-25 23:04:26.139: [ CLSINET][33]Returning NETDATA: 1 interfaces
2011-02-25 23:04:26.139: [ CLSINET][33]# 0 Interface 'lan2',ip='10.10.16.50',mac='3c-4a-92-48-71-be',mask='255.255.255.240',net='10.10.16.48',use='cluster_int
erconnect'
2011-02-25 23:04:26.973: [UiServer][31] CS(60000000014b0790)set Properties ( root,60000000012e0260)
2011-02-25 23:04:26.973: [UiServer][31] SS(6000000001372270)Accepted client connection: saddr =(ADDRESS=(PROTOCOL=ipc)(DEV=92)(KEY=OHASD_UI_SOCKET))daddr = (A
DDRESS=(PROTOCOL=ipc)(KEY=OHASD_UI_SOCKET))
2011-02-25 23:04:26.992: [UiServer][30] {0:0:181} processMessage called
2011-02-25 23:04:26.993: [UiServer][30] {0:0:181} Sending message to PE. ctx= 6000000001b440f0
2011-02-25 23:04:26.993: [UiServer][30] {0:0:181} Sending command to PE: 67
2011-02-25 23:04:26.994: [ CRSPE][29] {0:0:181} Processing PE command id=173. Description: [Stat Resource : 600000000135f760]
2011-02-25 23:04:26.997: [UiServer][30] {0:0:181} Done for ctx=6000000001b440f0
2011-02-25 23:04:27.012: [UiServer][31] Closed: remote end failed/disc.
2011-02-25 23:04:31.135: [ CLSINET][33]Returning NETDATA: 1 interfaces
2011-02-25 23:04:31.135: [ CLSINET][33]# 0 Interface 'lan2',ip='10.10.16.50',mac='3c-4a-92-48-71-be',mask='255.255.255.240',net='10.10.16.48',use='cluster_int
erconnect'
2011-02-25 23:04:32.318: [UiServer][31] CS(60000000014b0790)set Properties ( root,60000000012e0260)
2011-02-25 23:04:32.318: [UiServer][31] SS(6000000001372270)Accepted client connection: saddr =(ADDRESS=(PROTOCOL=ipc)(DEV=92)(KEY=OHASD_UI_SOCKET))daddr = (A
DDRESS=(PROTOCOL=ipc)(KEY=OHASD_UI_SOCKET))
2011-02-25 23:04:32.332: [UiServer][30] {0:0:182} processMessage called
2011-02-25 23:04:32.333: [UiServer][30] {0:0:182} Sending message to PE. ctx= 6000000001b45ef0
2011-02-25 23:04:32.333: [UiServer][30] {0:0:182} Sending command to PE: 68
2011-02-25 23:04:32.334: [ CRSPE][29] {0:0:182} Processing PE command id=174. Description: [Stat Resource : 600000000135f760]
2011-02-25 23:04:32.338: [UiServer][30] {0:0:182} Done for ctx=6000000001b45ef0
2011-02-25 23:04:32.352: [UiServer][31] Closed: remote end failed/disc.
2011-02-25 23:04:36.155: [ CLSINET][33]Returning NETDATA: 1 interfaces
2011-02-25 23:04:36.155: [ CLSINET][33]# 0 Interface 'lan2',ip='10.10.16.50',mac='3c-4a-92-48-71-be',mask='255.255.255.240',net='10.10.16.48',use='cluster_int
erconnect'
2011-02-25 23:04:37.683: [UiServer][31] CS(60000000014b0790)set Properties ( root,60000000012e0260)
2011-02-25 23:04:37.683: [UiServer][31] SS(6000000001372270)Accepted client connection: saddr =(ADDRESS=(PROTOCOL=ipc)(DEV=92)(KEY=OHASD_UI_SOCKET))daddr = (A
DDRESS=(PROTOCOL=ipc)(KEY=OHASD_UI_SOCKET))
2011-02-25 23:04:37.702: [UiServer][30] {0:0:183} processMessage called
2011-02-25 23:04:37.703: [UiServer][30] {0:0:183} Sending message to PE. ctx= 6000000002604ce0
2011-02-25 23:04:37.703: [UiServer][30] {0:0:183} Sending command to PE: 69
2011-02-25 23:04:37.704: [ CRSPE][29] {0:0:183} Processing PE command id=175. Description: [Stat Resource : 600000000135f760]
2011-02-25 23:04:37.708: [UiServer][30] {0:0:183} Done for ctx=6000000002604ce0
2011-02-25 23:04:37.722: [UiServer][31] Closed: remote end failed/disc.
2011-02-25 23:04:41.156: [ CLSINET][33]Returning NETDATA: 1 interfaces
2011-02-25 23:04:41.156: [ CLSINET][33]# 0 Interface 'lan2',ip='10.10.16.50',mac='3c-4a-92-48-71-be',mask='255.255.255.240',net='10.10.16.48',use='cluster_int
erconnect'
What could be the issue ????
Experts Please help me. Doing setup for the PRoduction Env...
Do response ASAP...... Thanks
Regards,
Manish -
제품 : ORACLE SERVER
작성날짜 : 2004-11-30
10G RAC: CRS 설치 실패 후 정리 방법
=====================================
PURPOSE
이 문서는, DBA와 기술 지원 엔지니어가 10g RAC의 CRS (Cluster Ready Services)
실패시, 일부 설치된 CRS를 제거하는데 필요한 정보를 제공하는 것을 목적으로 한다.
Explanation
설치에 실패한 CRS는 노드 리부팅과 같은 문제를 야기 시킬 수 있다.
실패한 CRS 설치본을 정리하기 위해서는 다음과 같은 절차를 따른다:
1. $ORA_CRS_HOME/install 디렉토리에서 rootdelete.sh 스크립트를 실행한 후 rootdeinstall.sh 스크립트를
실행시킨다. 만약 이 스크립트를 실행시키는데 문제가 있거나, 모든 콤포넌트가 성공적으로 제거되었는지
여부를 확인하려면 step 2로 간다:
2. 모든 노드로 부터 노드 애플리케이션을 중단시킨다:
srvctl stop nodeapps -n <node name>
3. 노드 부팅시 CRS가 구동되는 것을 예방한다. 이를 위해 root 계정에서 다음과 같은 작업을
수행한다 :
Sun:
rm /etc/init.d/init.cssd
rm /etc/init.d/init.crs
rm /etc/init.d/init.crsd
rm /etc/init.d/init.evmd
rm /etc/rc3.d/K96init.crs
rm /etc/rc3.d/S96init.crs
rm -Rf /var/opt/oracle/scls_scr
rm -Rf /var/opt/oracle/oprocd
rm /etc/inittab.crs
cp /etc/inittab.orig /etc/inittab
Linux:
rm -f /etc/init.d/init.cssd
rm -f /etc/init.d/init.crs
rm -f /etc/init.d/init.crsd
rm -f /etc/init.d/init.evmd
rm -f /etc/rc2.d/K96init.crs
rm -f /etc/rc2.d/S96init.crs
rm -f /etc/rc3.d/K96init.crs
rm -f /etc/rc3.d/S96init.crs
rm -f /etc/rc5.d/K96init.crs
rm -f /etc/rc5.d/S96init.crs
rm -Rf /etc/oracle/scls_scr
rm -f /etc/inittab.crs
cp /etc/inittab.orig /etc/inittab
HP-UX:
rm /sbin/init.d/init.cssd
rm /sbin/init.d/init.crs
rm /sbin/init.d/init.crsd
rm /sbin/init.d/init.evmd
rm /sbin/rc3.d/K960init.crs
rm /sbin/rc3.d/S960init.crs
rm -Rf /var/opt/oracle/scls_scr
rm -Rf /var/opt/oracle/oprocd
rm /etc/inittab.crs
cp /etc/inittab.orig /etc/inittab
HP Tru64:
rm /sbin/init.d/init.cssd
rm /sbin/init.d/init.crs
rm /sbin/init.d/init.crsd
rm /sbin/init.d/init.evmd
rm /sbin/rc3.d/K96init.crs
rm /sbin/rc3.d/S96init.crs
rm -Rf /var/opt/oracle/scls_scr
rm -Rf /var/opt/oracle/oprocd
rm /etc/inittab.crs
cp /etc/inittab.orig /etc/inittab
IBM AIX:
rm /etc/init.cssd
rm /etc/init.crs
rm /etc/init.crsd
rm /etc/init.evmd
rm /etc/rc.d/rc2.d/K96init.crs
rm /etc/rc.d/rc2.d/S96init.crs
rm -Rf /etc/oracle/scls_scr
rm -Rf /etc/oracle/oprocd
rm /etc/inittab.crs
cp /etc/inittab.orig /etc/inittab
4. 만약 프로세스가 살아 있다면 EVM, CRS 및 CRS 프로세스를 kill 시키거나
노드를 리부팅 한다:
ps -ef | grep crs
kill <crs pid>
ps -ef | grep evm
kill <evm pid>
ps -ef | grep css
kill <css pid>
5. CRS 설치 디렉토리를 제거한다:
rm -Rf <CRS Install Location>/*
6. Oracle Universal Installer에서 CRS home을 De-install 한다.
7. dd 명령으로 OCR 및 Voting File을 제거한다. 예 :
dd if=/dev/zero of=/dev/rdsk/V1064_vote_01_20m.dbf bs=8192 count=2560
dd if=/dev/zero of=/dev/rdsk/ocrV1064_100m.ora bs=8192 count=12800
만약 RDBMS 설치를 제거한다면, 사용중이던 ASM 디스크도 정리한다.
8. 만약 CRS를 재 설치하고자 하면, RAC 설치 매뉴얼에 기술된 순서대로 설치를 다시 진행한다.
Example
Reference Documents
<Note:239998.1> 10g RAC: How to Clean Up After a Failed CRS Install -
Error running root.sh at install time.
I tried to install the Oracle 11gR2 on two Linux virtual machines,
and got problems. I tried everything I found in the forums, but nothing helped.
The output from "uname -a" is
Linux fred0224.orarac.net 2.6.18-164.el5 #1 SMP Tue Aug 18 15:51:48 EDT 2009 x86_64 x86_64 x86_64 GNU/Linux
The problem is when running the root.sh on the first machine.
Changing permissions of /u01/app/oraInventory.
Adding read,write permissions for group.
Removing read,write,execute permissions for world.
Changing groupname of /u01/app/oraInventory to oinstall.
The execution of the script is complete.
[root@fred0224 oraInventory]# cd ../11.2.0/grid/
[root@fred0224 grid]# ./root.sh
Running Oracle 11g root.sh script...
The following environment variables are set as:
ORACLE_OWNER= oracle
ORACLE_HOME= /u01/app/11.2.0/grid
Enter the full pathname of the local bin directory: [usr/local/bin]:
The file "dbhome" already exists in /usr/local/bin. Overwrite it? (y/n)
[n]:
The file "oraenv" already exists in /usr/local/bin. Overwrite it? (y/n)
[n]:
The file "coraenv" already exists in /usr/local/bin. Overwrite it? (y/n)
[n]:
Creating /etc/oratab file...
Entries will be added to the /etc/oratab file as needed by
Database Configuration Assistant when a database is created
Finished running generic part of root.sh script.
Now product-specific root actions will be performed.
2010-06-23 13:25:11: Parsing the host name
2010-06-23 13:25:11: Checking for super user privileges
2010-06-23 13:25:11: User has super user privileges
Using configuration parameter file: /u01/app/11.2.0/grid/crs/install/crsconfig_params
Creating trace directory
LOCAL ADD MODE
Creating OCR keys for user 'root', privgrp 'root'..
Operation successful.
root wallet
root wallet cert
root cert export
peer wallet
profile reader wallet
pa wallet
peer wallet keys
pa wallet keys
peer cert request
pa cert request
peer cert
pa cert
peer root cert TP
profile reader root cert TP
pa root cert TP
peer pa cert TP
pa peer cert TP
profile reader pa cert TP
profile reader peer cert TP
peer user cert
pa user cert
Adding daemon to inittab
CRS-4123: Oracle High Availability Services has been started.
ohasd is starting
CRS-2672: Attempting to start 'ora.gipcd' on 'fred0224'
CRS-2672: Attempting to start 'ora.mdnsd' on 'fred0224'
CRS-2676: Start of 'ora.gipcd' on 'fred0224' succeeded
CRS-2676: Start of 'ora.mdnsd' on 'fred0224' succeeded
CRS-2672: Attempting to start 'ora.gpnpd' on 'fred0224'
CRS-2676: Start of 'ora.gpnpd' on 'fred0224' succeeded
CRS-2672: Attempting to start 'ora.cssdmonitor' on 'fred0224'
CRS-2676: Start of 'ora.cssdmonitor' on 'fred0224' succeeded
CRS-2672: Attempting to start 'ora.cssd' on 'fred0224'
CRS-2672: Attempting to start 'ora.diskmon' on 'fred0224'
CRS-2676: Start of 'ora.diskmon' on 'fred0224' succeeded
CRS-2676: Start of 'ora.cssd' on 'fred0224' succeeded
CRS-2672: Attempting to start 'ora.ctssd' on 'fred0224'
CRS-2676: Start of 'ora.ctssd' on 'fred0224' succeeded
ASM created and started successfully.
DiskGroup DATA created successfully.
clscfg: -install mode specified
Successfully accumulated necessary OCR keys.
Creating OCR keys for user 'root', privgrp 'root'..
Operation successful.
CRS-2672: Attempting to start 'ora.crsd' on 'fred0224'
CRS-2676: Start of 'ora.crsd' on 'fred0224' succeeded
CRS-4256: Updating the profile
Successful addition of voting disk 48c50205cbfd4f4fbfdcd387ccc5be77.
Successful addition of voting disk 73f5603b851b4fb4bf0c966c439e7c76.
Successful addition of voting disk 2dfa19116fa84f3fbf4b1b8f1057dcda.
Successfully replaced voting disk group with +DATA.
CRS-4256: Updating the profile
CRS-4266: Voting file(s) successfully replaced
## STATE File Universal Id File Name Disk group
1. ONLINE 48c50205cbfd4f4fbfdcd387ccc5be77 (ORCL:DISK1) [DATA]
2. ONLINE 73f5603b851b4fb4bf0c966c439e7c76 (ORCL:DISK2) [DATA]
3. ONLINE 2dfa19116fa84f3fbf4b1b8f1057dcda (ORCL:DISK3) [DATA]
Located 3 voting disk(s).
CRS-2673: Attempting to stop 'ora.crsd' on 'fred0224'
CRS-2677: Stop of 'ora.crsd' on 'fred0224' succeeded
CRS-2673: Attempting to stop 'ora.asm' on 'fred0224'
CRS-2677: Stop of 'ora.asm' on 'fred0224' succeeded
CRS-2673: Attempting to stop 'ora.ctssd' on 'fred0224'
CRS-2677: Stop of 'ora.ctssd' on 'fred0224' succeeded
CRS-2673: Attempting to stop 'ora.cssdmonitor' on 'fred0224'
CRS-2677: Stop of 'ora.cssdmonitor' on 'fred0224' succeeded
CRS-2673: Attempting to stop 'ora.cssd' on 'fred0224'
CRS-2677: Stop of 'ora.cssd' on 'fred0224' succeeded
CRS-2673: Attempting to stop 'ora.gpnpd' on 'fred0224'
CRS-2677: Stop of 'ora.gpnpd' on 'fred0224' succeeded
CRS-2673: Attempting to stop 'ora.gipcd' on 'fred0224'
CRS-2677: Stop of 'ora.gipcd' on 'fred0224' succeeded
CRS-2673: Attempting to stop 'ora.mdnsd' on 'fred0224'
CRS-2677: Stop of 'ora.mdnsd' on 'fred0224' succeeded
CRS-2672: Attempting to start 'ora.mdnsd' on 'fred0224'
CRS-2676: Start of 'ora.mdnsd' on 'fred0224' succeeded
CRS-2672: Attempting to start 'ora.gipcd' on 'fred0224'
CRS-2676: Start of 'ora.gipcd' on 'fred0224' succeeded
CRS-2672: Attempting to start 'ora.gpnpd' on 'fred0224'
CRS-2676: Start of 'ora.gpnpd' on 'fred0224' succeeded
CRS-2672: Attempting to start 'ora.cssdmonitor' on 'fred0224'
CRS-2676: Start of 'ora.cssdmonitor' on 'fred0224' succeeded
CRS-2672: Attempting to start 'ora.cssd' on 'fred0224'
CRS-2672: Attempting to start 'ora.diskmon' on 'fred0224'
CRS-2676: Start of 'ora.diskmon' on 'fred0224' succeeded
CRS-2676: Start of 'ora.cssd' on 'fred0224' succeeded
CRS-2672: Attempting to start 'ora.ctssd' on 'fred0224'
CRS-2676: Start of 'ora.ctssd' on 'fred0224' succeeded
CRS-2672: Attempting to start 'ora.asm' on 'fred0224'
CRS-2676: Start of 'ora.asm' on 'fred0224' succeeded
CRS-2672: Attempting to start 'ora.crsd' on 'fred0224'
CRS-2676: Start of 'ora.crsd' on 'fred0224' succeeded
CRS-2672: Attempting to start 'ora.evmd' on 'fred0224'
CRS-2676: Start of 'ora.evmd' on 'fred0224' succeeded
Timed out waiting for the CRS stack to start.
I am going thru all the logs in /u01/app and posting all the "fail" I got
oracle/diag/asm/+asm/+ASM1/trace/alert_+ASM1.log
SUCCESS: diskgroup DATA was mounted
SUCCESS: CREATE DISKGROUP DATA NORMAL REDUNDANCY DISK 'ORCL:DISK1',
'ORCL:DISK2',
'ORCL:DISK3' ATTRIBUTE 'compatible.asm'='11.2.0.0.0' /* ASMCA */
Wed Jun 23 13:27:44 2010
WARNING: failed to online diskgroup resource ora.DATA.dg (unable to communicate with CRSD/OHASD)
NOTE: cache deleting context for group DATA 1/-423277942
SUCCESS: ALTER DISKGROUP ALL DISMOUNT /* asm agent */
Wed Jun 23 13:28:06 2010
WARNING: failed to offline diskgroup resource ora.DATA.dg (unable to communicate with CRSD/OHASD)
oraInventory/logs/installActions2010-06-23_12-45-22PM.log
INFO: WARNING: Failed to load bean oracle.install.ivw.ha.bean.HAInstallSettings. Reason: [INS-07001] Value for property 'HAInstallSettings' not found in the bean store.
INFO: WARNING: Failed to load bean oracle.install.ivw.crs.bean.CRSInstallSettings. Reason: [INS-07001] Value for property 'CRSInstallSettings' not found in the bean store.
INFO: WARNING: Failed to load bean oracle.install.commons.net.support.SSHConnectivitySetupInfo. Reason: [INS-07001] Value for property 'SSHConnectivitySetupInfo' not found in the bean store.
INFO: WARNING: Failed to load bean oracle.install.library.util.cluster.ClusterConfig. Reason: [INS-07001] Value for property 'ClusterConfig' not found in the bean store.
INFO: INFO: Network Time Protocol (NTP): This task verifies cluster time synchronization on clusters that use Network Time Protocol (NTP).
INFO: INFO: Severity:CRITICAL
INFO: INFO: OverallStatus:VERIFICATION_FAILED
INFO: Install Phase 2 JRE files in Scratch :0
INFO: Checkpoint:Failed Checkpoint found returning it for getAllFailedCheckPoints.
INFO: Checkpoint:Failed Checkpoint found returning null for getLastFailedCheckPoint.
INFO: Checkpoint:Index file written and updated
SEVERE: occured inside verify methodPRCI-1108 : Failed to check CRS running state for CRS home /u01/app/11.2.0/grid on node fred0225
PRCT-1003 : Failed to run "crsctl" on node "fred0225"
11.2.0/grid/cfgtoollogs/crsconfig/rootcrs_fred0224.log
2010-06-23 13:25:50: Removing "/etc/rc.d/rc3.d/S96ohasd"
2010-06-23 13:25:50: Removing file /etc/rc.d/rc3.d/S96ohasd
2010-06-23 13:25:50: Failure with return code 1 from command rm /etc/rc.d/rc3.d/S96ohasd
2010-06-23 13:25:50: Failed to remove file:
2010-06-23 13:25:50: Creating a link "/etc/rc.d/rc3.d/S96ohasd" pointing to /etc/init.d/ohasd
11.2.0/grid/log/fred0224/alertfred0224.log
[cssd(20957)]CRS-1709:Lease acquisition failed for node fred0224 because no voting file has been configured; Details at (:CSSNM00031:) in /u01/app/11.2.0/grid/log/fred0224/cssd/ocssd.log
2010-06-23 13:27:01.900
[cssd(20957)]CRS-1601:CSSD Reconfiguration complete. Active nodes are fred0224
[client(21266)]CRS-1001:The OCR was formatted using version 3.
2010-06-23 13:27:52.824
[ohasd(19627)]CRS-2765:Resource 'ora.crsd' has failed on server 'fred0224'.
2010-06-23 13:27:54.360
[cssd(20957)]CRS-1605:CSSD voting file is online: ORCL:DISK1; details in /u01/app/11.2.0/grid/log/fred0224/cssd/ocssd.log.
2010-06-23 13:27:54.397
[cssd(20957)]CRS-1605:CSSD voting file is online: ORCL:DISK2; details in /u01/app/11.2.0/grid/log/fred0224/cssd/ocssd.log.
2010-06-23 13:27:54.463
[cssd(20957)]CRS-1605:CSSD voting file is online: ORCL:DISK3; details in /u01/app/11.2.0/grid/log/fred0224/cssd/ocssd.log.
2010-06-23 13:27:54.969
[cssd(20957)]CRS-1626:A Configuration change request completed successfully
[client(21266)]CRS-1006:The OCR location +DATA is inaccessible. Details in /u01/app/11.2.0/grid/log/fred0224/client/ocrconfig_21266.log.
2010-06-23 13:27:49.187
[client(21266)]CRS-1001:The OCR was formatted using version 3.
2010-06-23 13:27:52.824
[ohasd(19627)]CRS-2765:Resource 'ora.crsd' has failed on server 'fred0224'.
2010-06-23 13:27:54.360
[cssd(20957)]CRS-1605:CSSD voting file is online: ORCL:DISK1; details in /u01/app/11.2.0/grid/log/fred0224/cssd/ocssd.log.
2010-06-23 13:27:54.397
[cssd(20957)]CRS-1605:CSSD voting file is online: ORCL:DISK2; details in /u01/app/11.2.0/grid/log/fred0224/cssd/ocssd.log.
2010-06-23 13:27:54.463
[cssd(20957)]CRS-1605:CSSD voting file is online: ORCL:DISK3; details in /u01/app/11.2.0/grid/log/fred0224/cssd/ocssd.log.
2010-06-23 13:27:54.969
[cssd(20957)]CRS-1626:A Configuration change request completed successfully
2010-06-23 13:27:54.987
[cssd(20957)]CRS-1601:CSSD Reconfiguration complete. Active nodes are fred0224 .
2010-06-23 13:27:54.999
[ohasd(19627)]CRS-2765:Resource 'ora.crsd' has failed on server 'fred0224'.
2010-06-23 13:27:57.101
[ohasd(19627)]CRS-2765:Resource 'ora.crsd' has failed on server 'fred0224'.
2010-06-23 13:27:59.191
[ohasd(19627)]CRS-2765:Resource 'ora.crsd' has failed on server 'fred0224'.
2010-06-23 13:28:01.284
[ohasd(19627)]CRS-2765:Resource 'ora.crsd' has failed on server 'fred0224'.
2010-06-23 13:28:03.402
[ohasd(19627)]CRS-2765:Resource 'ora.crsd' has failed on server 'fred0224'.
2010-06-23 13:28:13.267
[ctssd(21023)]CRS-2405:The Cluster Time Synchronization Service on host fred0224 is shutdown by user
2010-06-23 13:28:25.144
[cssd(20957)]CRS-1603:CSSD on node fred0224 shutdown by user.
2010-06-23 13:28:25.183
[cssd(20957)]CRS-1625:Node fred0224, number 1, was manually shut down
2010-06-23 13:28:43.406
[cssd(21926)]CRS-1713:CSSD daemon is started in clustered mode
2010-06-23 13:30:08.067
[cssd(21926)]CRS-1707:Lease acquisition for node fred0224 number 1 completed
2010-06-23 13:30:08.084
[cssd(21926)]CRS-1605:CSSD voting file is online: ORCL:DISK3; details in /u01/app/11.2.0/grid/log/fred0224/cssd/ocssd.log.
2010-06-23 13:30:08.101
[cssd(21926)]CRS-1605:CSSD voting file is online: ORCL:DISK2; details in /u01/app/11.2.0/grid/log/fred0224/cssd/ocssd.log.
2010-06-23 13:30:08.142
[cssd(21926)]CRS-1605:CSSD voting file is online: ORCL:DISK1; details in /u01/app/11.2.0/grid/log/fred0224/cssd/ocssd.log.
2010-06-23 13:30:25.819
[cssd(21926)]CRS-1601:CSSD Reconfiguration complete. Active nodes are fred0224 .
2010-06-23 13:30:27.065
[ctssd(22150)]CRS-2403:The Cluster Time Synchronization Service on host fred0224 is in observer mode.
2010-06-23 13:30:27.072
[ctssd(22150)]CRS-2407:The new Cluster Time Synchronization Service reference node is host fred0224.
2010-06-23 13:30:28.064
[ctssd(22150)]CRS-2401:The Cluster Time Synchronization Service started on host fred0224.
2010-06-23 13:30:43.629
[ohasd(19627)]CRS-2765:Resource 'ora.crsd' has failed on server 'fred0224'.
2010-06-23 13:30:45.744
[ohasd(19627)]CRS-2765:Resource 'ora.crsd' has failed on server 'fred0224'.
2010-06-23 13:30:47.860
[ohasd(19627)]CRS-2765:Resource 'ora.crsd' has failed on server 'fred0224'.
2010-06-23 13:30:49.943
[ohasd(19627)]CRS-2765:Resource 'ora.crsd' has failed on server 'fred0224'.
2010-06-23 13:30:52.022
[ohasd(19627)]CRS-2765:Resource 'ora.crsd' has failed on server 'fred0224'.
2010-06-23 13:30:54.107
[ohasd(19627)]CRS-2765:Resource 'ora.crsd' has failed on server 'fred0224'.
2010-06-23 13:30:56.177
[ohasd(19627)]CRS-2765:Resource 'ora.crsd' has failed on server 'fred0224'.
2010-06-23 13:30:58.351
[ohasd(19627)]CRS-2765:Resource 'ora.crsd' has failed on server 'fred0224'.
2010-06-23 13:31:00.431
[ohasd(19627)]CRS-2765:Resource 'ora.crsd' has failed on server 'fred0224'.
2010-06-23 13:31:02.518
[ohasd(19627)]CRS-2765:Resource 'ora.crsd' has failed on server 'fred0224'.
2010-06-23 13:31:04.610
[ohasd(19627)]CRS-2765:Resource 'ora.crsd' has failed on server 'fred0224'.
2010-06-23 13:31:04.610
[ohasd(19627)]CRS-2771:Maximum restart attempts reached for resource 'ora.crsd'; will not restart.
11.2.0/grid/log/fred0224/client/ocrconfig_21266.log
2010-06-23 13:27:48.267: [ OCRRAW][329010704]proprioo: Failed to open [+DATA]. Returned proprasmo() with [26]. Marking location as UNAVAILABLE.
2010-06-23 13:27:48.267: [ OCRRAW][329010704]proprioo: No OCR/OLR devices are usable
2010-06-23 13:27:48.267: [ OCRASM][329010704]proprasmcl: asmhandle is NULL
2010-06-23 13:27:48.267: [ OCRRAW][329010704]proprinit: Could not open raw device
2010-06-23 13:27:48.267: [ OCRASM][329010704]proprasmcl: asmhandle is NULL
2010-06-23 13:27:48.268: [ default][329010704]a_init:7!: Backend init unsuccessful : [26]
2010-06-23 13:27:48.269: [ OCRCONF][329010704]Exporting OCR data to [OCRUPGRADEFILE]
2010-06-23 13:27:48.269: [ OCRAPI][329010704]a_init:7!: Backend init unsuccessful : [33]
2010-06-23 13:27:48.270: [ OCRCONF][329010704]There was no previous version of OCR. error:[PROC-33: Oracle Cluster Registry is not configured]
2010-06-23 13:27:48.418: [ OCRASM][329010704]proprasmo: kgfoCheckMount return [0]. Cannot proceed with dirty open.
2010-06-23 13:27:48.419: [ OCRASM][329010704]proprasmo: Error in open/create file in dg [DATA]
[ OCRASM][329010704]SLOS : [clsuSlosFormatDiag called with non-error slos.]
2010-06-23 13:27:48.490: [ OCRRAW][329010704]proprioo: Failed to open [+DATA]. Returned proprasmo() with [26]. Marking location as UNAVAILABLE.
2010-06-23 13:27:48.490: [ OCRRAW][329010704]proprioo: No OCR/OLR devices are usable
2010-06-23 13:27:48.490: [ OCRASM][329010704]proprasmcl: asmhandle is NULL
2010-06-23 13:27:48.490: [ OCRRAW][329010704]proprinit: Could not open raw device
2010-06-23 13:27:48.490: [ OCRASM][329010704]proprasmcl: asmhandle is NULL
2010-06-23 13:27:48.491: [ default][329010704]a_init:7!: Backend init unsuccessful : [26]
2010-06-23 13:27:48.908: [ OCRRAW][329010704]propriogid:1_2: INVALID FORMAT
2010-06-23 13:27:48.909: [ OCRRAW][329010704]proprior: Header check from OCR device 0 offset 0 failed (26).
2010-06-23 13:27:48.914: [ OCRRAW][329010704]ibctx: Failed to read the whole bootblock. Assumes invalid format.
2010-06-23 13:27:48.914: [ OCRRAW][329010704]proprinit:problem reading the bootblock or superbloc 22
2010-06-23 13:27:49.008: [ OCRRAW][329010704]propriogid:1_2: INVALID FORMAT
2010-06-23 13:27:49.186: [ OCRRAW][329010704]iniconfig:No 92 configuration
2010-06-23 13:27:49.348: [ OCRCONF][329010704]Initialized DATABASE keys
2010-06-23 13:27:49.353: [ OCRCONF][329010704]Successfully set skgfr block 0
2010-06-23 13:27:49.354: [ OCRCONF][329010704]Exiting [status=success]...
11.2.0/grid/log/fred0224/client/ocrconfig_19232.log
2010-06-23 13:25:12.749: [ OCROSD][2100141584]utread:3: Problem reading buffer 62af000 buflen 4096 retval 0 phy_offset 102400 retry 0
2010-06-23 13:25:12.749: [ OCROSD][2100141584]utread:3: Problem reading buffer 62af000 buflen 4096 retval 0 phy_offset 102400 retry 1
2010-06-23 13:25:12.749: [ OCROSD][2100141584]utread:3: Problem reading buffer 62af000 buflen 4096 retval 0 phy_offset 102400 retry 2
2010-06-23 13:25:12.749: [ OCROSD][2100141584]utread:3: Problem reading buffer 62af000 buflen 4096 retval 0 phy_offset 102400 retry 3
2010-06-23 13:25:12.749: [ OCROSD][2100141584]utread:3: Problem reading buffer 62af000 buflen 4096 retval 0 phy_offset 102400 retry 4
2010-06-23 13:25:12.749: [ OCROSD][2100141584]utread:3: Problem reading buffer 62af000 buflen 4096 retval 0 phy_offset 102400 retry 5
2010-06-23 13:25:12.749: [ OCRRAW][2100141584]propriogid:1_1: Failed to read the whole bootblock. Assumes invalid format.
2010-06-23 13:25:12.749: [ OCRRAW][2100141584]proprioini: all disks are not OCR/OLR formatted
2010-06-23 13:25:12.749: [ OCRRAW][2100141584]proprinit: Could not open raw device
2010-06-23 13:25:12.749: [ default][2100141584]a_init:7!: Backend init unsuccessful : [26]
2010-06-23 13:25:12.749: [ OCRCONF][2100141584]Exporting OCR data to [OCRUPGRADEFILE]
2010-06-23 13:25:12.750: [ OCRAPI][2100141584]a_init:7!: Backend init unsuccessful : [33]
2010-06-23 13:25:12.750: [ OCRCONF][2100141584]There was no previous version of OCR. error:[PROCL-33: Oracle Local Registry is not configured]
2010-06-23 13:25:12.750: [ OCROSD][2100141584]utread:3: Problem reading buffer 62b0000 buflen 4096 retval 0 phy_offset 102400 retry 0
2010-06-23 13:25:12.750: [ OCROSD][2100141584]utread:3: Problem reading buffer 62b0000 buflen 4096 retval 0 phy_offset 102400 retry 1
2010-06-23 13:25:12.750: [ OCROSD][2100141584]utread:3: Problem reading buffer 62b0000 buflen 4096 retval 0 phy_offset 102400 retry 2
2010-06-23 13:25:12.750: [ OCROSD][2100141584]utread:3: Problem reading buffer 62b0000 buflen 4096 retval 0 phy_offset 102400 retry 3
2010-06-23 13:25:12.750: [ OCROSD][2100141584]utread:3: Problem reading buffer 62b0000 buflen 4096 retval 0 phy_offset 102400 retry 4
2010-06-23 13:25:12.750: [ OCROSD][2100141584]utread:3: Problem reading buffer 62b0000 buflen 4096 retval 0 phy_offset 102400 retry 5
2010-06-23 13:25:12.750: [ OCRRAW][2100141584]propriogid:1_1: Failed to read the whole bootblock. Assumes invalid format.
11.2.0/grid/log/fred0224/client/crsctl.log
2010-06-23 13:27:54.326: [ GPnP][448580000]clsgpnp_profileGetSequenceRef: [at clsgpnp.c:841] Result: (0) CLSGPNP_OK. seq of p=0x8a77e80 is '5'=5
2010-06-23 13:27:54.329: [ CSSCLNT][448580000]clsssinit: error(32 PROC-32: Cluster Ready Services on the local node is not running Messaging error [9]) in OCR initialization
2010-06-23 13:27:54.329: [ CSSCLNT][448580000]clsssVoteDiskUpdate: failed to retrieve current configuration from OCR, return code 21
11.2.0/grid/log/fred0224/crsd/crsd.log
2010-06-23 13:27:51.885: [ CLSINET][1103303248] Failed to find interfaces to match required attribs
2010-06-23 13:27:51.885: [ OCRAPI][1103303248]clsu_get_private_ip_addresses: clsinet_GetNetData failed (). Return [7]
2010-06-23 13:27:51.885: [GIPCXCPT][1103303248] gipcShutdownF: skipping shutdown, count 2, from [ clsinet.c : 1732], ret gipcretSuccess (0)
2010-06-23 13:27:51.888: [GIPCXCPT][1103303248] gipcShutdownF: skipping shutdown, count 1, from [ clsgpnp0.c : 1021], ret gipcretSuccess (0)
[ OCRAPI][1103303248]a_init_clsss: failed to call clsu_get_private_ip_addr (7)
2010-06-23 13:27:51.891: [ OCRAPI][1103303248]a_init:13!: Clusterware init unsuccessful : [44]
2010-06-23 13:27:51.891: [ CRSOCR][1103303248] OCR context init failure. Error: PROC-44: Error in network address and interface operations Network address and interface operations error [7]
2010-06-23 13:27:51.891: [ CRSD][1103303248][PANIC] CRSD exiting: Could not init OCR, code: 44
11.2.0/grid/log/fred0224/gpnpd/gpnpd.log
2010-06-23 13:26:35.783: [ GPnP][1050106896]clsgpnpou_initocrcx: [at clsgpnpou.c:243] OCR is not ready yet - not trying to open at DEFAULT level
2010-06-23 13:26:35.783: [ GPnP][1050106896]clsgpnpou_initocrcx: GPnP api clsgpnpou_initocrcx failed
2010-06-23 13:26:35.783: [ GPnP][1050106896]clsgpnpou_initocrcx: GPnP error code : 59 (CLSGPNP_OCR_NOSRV)
2010-06-23 13:26:35.783: [ GPnP][1050106896]clsgpnpou_initocrcx: [at clsgpnpou.c:284] EXIT (59) CLSGPNP_OCR_NOSRV
2010-06-23 13:26:36.718: [ GPnP][1050106896]clsgpnpcf_readf: [at clsgpnpcf.c:525] SlfLengthn profile
Internal Error Information:
Category: SLF_NOENT(-5)
Operation: stat failed
Location: SlfStat1
Other:
Dep: 2
Dep Message: No such file or directory
11.2.0/grid/log/fred0224/agent/ohasd/oracssdmonitor_root/oracssdmonitor_root.log
2010-06-23 13:26:37.604: [ USRTHRD][1116006720] clsnomon_main: starting omon
2010-06-23 13:26:37.606: [ CSSCLNT][1116006720]clssscConnect: gipc request failed with 29 (0x16)
2010-06-23 13:26:37.606: [ CSSCLNT][1116006720]clsssInitNative: connect failed, rc 29
11.2.0/grid/log/fred0224/agent/ohasd/orarootagent_root/orarootagent_root.log
2010-06-23 13:27:52.802: [ AGFW][1159006528] Executing command: check for resource: ora.crsd 1 1
2010-06-23 13:27:52.802: [ COMMCRS][1159006528]clscsendx: (0xc186ae0) Physical connection (0xc1863e0) not active
[ clsdmc][1159006528]Failed to send meta message to connection [(ADDRESS=(PROTOCOL=ipc)(KEY=fred0224DBG_CRSD))][11]
2010-06-23 13:27:52.803: [ora.crsd][1159006528] [check] Error = error 11 encountered when sending messages to CRSD
2010-06-23 13:27:52.821: [ora.crsd][1159006528] [check] Calling PID check for daemon
2010-06-23 13:27:52.821: [ora.crsd][1159006528] [check] Trying to check PID = 21311
2010-06-23 13:27:52.821: [ COMMCRS][1159006528]clscsendx: (0xc186ae0) Connection not activeHi Fred,
What was network problem? I have same issue in 2 X SLES11 VM guest environment.
From crsd.log during Startup
2010-09-17 10:54:46.631: [ CRSMAIN][3460179712] Connecting to the CSS Daemon
2010-09-17 10:54:46.679: [ CRSMAIN][3460179712] Initializing OCR
2010-09-17 10:54:46.681: [ OCRAPI][3460179712]clsu_get_private_ip_addr: Calling clsu_get_private_ip_addresses to get first private ip
2010-09-17 10:54:46.681: [ OCRAPI][3460179712]Check namebufs
2010-09-17 10:54:46.681: [ OCRAPI][3460179712]Finished checking namebufs
2010-09-17 10:54:46.681: [ GIPC][3460179712] gipcCheckInitialization: possible incompatible non-threaded init from [clsinet.c : 3229], original from [clsss.c : 5011]
Thanks
Cheers Dusan
Maybe you are looking for
-
How can I enable TWAIN scanning on PE13 (running on Win 7 Pro)?
I've seen advice for this for earlier versions but they don't seem to map to PE13 on Win7 I have a WIA option but this is troublesome a) insufficient options b) asks to configuration on every use.
-
Can I password-protect a PDF file?
I'm trying to set up a site with a 'members-only' area that contains PDF files. Is there some way to password-protect the files themselves, or do I need to settle for a protected php page that links to the files. While it's unlikely that a non-member
-
I just switched fom CS4 to CS5 and now my PSD files no longer show me a preview of the images. I know it has nothing to do with the versions because I have saved CS5 PSDs and the icons still do not show the actual image, just the standard PS icon. Ho
-
Editable columns in table don't select the whole row
I am new to the forums and posted this to the wrong one the first time and I am not sure how to move it so I am just reposting it here. Sorry. I have a table with 7 columns. 2 of them are non-editable and the rest are either radio buttons or check bo
-
How can I stop QuickTime from streaming all internet videos?
HI When I updated my ITunes all the media file associations were changed to QuickTime. I want the Windows Media Player to keep the associations. What I did so far is: I have disabled all associations in QuickTime player options (except .mov) and turn