RAC on SunCluster 3.2 Solaris 10

Question

Hello all,
I am testing a new system build on two new servers with Solaris 10 running SunCluster 3.2. Oracle RAC and database 10.2.0.2.0 has been installed without any issue. Basic Oracle RAC tests were performed successfully. ie database balance, failover, failback. SunCluster was installed by Sun technicians and they didn´t get any issue installing it.
The system is still in testing but waiting to the outcome of next problem:
The system has four NICs each node 1 for public service, 1 for internal service (backups and monitor) and the last 2 for the cluster interconnect in an active/standby configuration. Everything works fine until we started to test the interconnect fail over. Whenever we unplug any of the interconnect cables the instance in node2 dies and this node reboot.
I have tried different combinations of configurations, even deleting all the private from the OCR to 'force' the RAC to use the public interface as interconnect and still getting the same behavior.
Has anyone faced a similar situation before???
If so could you please post examples of cluster configuration either RAC and SunCluster and how was this addressed and solved???
There is a SR currently open in support. Any successfully outcome I will let you know.
Thanks.

Answer 1

Here is another problem I am getting in the preproduction system.
I am testing to move the OCR to a new location and following the steps in the METALINK note 452486.1 I get an error on step 6:
# ./ocrconfig -replace ocr /dev/md/oracle-set/rdsk/d665
PROT-1: Failed to initialize ocrconfig
and the error reported in the $ORACLE_CRS_HOME/log/client/:
-bash-3.00$ more ocrconfig_27033.log
ocrconfig_27033.log: Permission denied
It seems some permissions on the raw partitions not being set correctly.
These are the current permissions assigned to vote (d601,d602 and d603) and ocr (d607 and d608) disks. The test I am trying to perform is to move the current OCR (d607) to a new raw partition (d665).
# ls -lLA
total 0
crw-r--r-- 1 oracle oinstall 85, 8793 Sep 28 10:52 d601
crw-r--r-- 1 oracle oinstall 85, 8794 Sep 28 10:52 d602
crw-r--r-- 1 oracle oinstall 85, 8795 Sep 28 10:52 d603
crw-r----- 1 root oinstall 85, 8799 Sep 28 10:52 d607
crw-r----- 1 root oinstall 85, 8800 Sep 28 10:52 d608
crw-r----- 1 root oinstall 85, 8857 Sep 28 10:50 d665
crw-r--r-- 1 oracle oinstall 85, 8858 Sep 28 10:51 d666
This text is comming from METALINK note 220970.1:
The Oracle Real Application Clusters install guide is correct. It describes the PRE INSTALL ownership/permission requirements for ocr and voting disk. This step is needed to make sure that the CRS install succeeds. Please don't use those values to determine what the ownership/permmission should be POST INSTALL. The root script will change the ownership/permission of ocr and voting disk as part of install. The POST INSTALL permissions will end up being : OCR - root:oinstall - 640 Voting Disk - oracle:oinstall - 644
From this note it seems to me permissions are correctly setup.
Can anyone clarify this???
Thanks.