Error 0(Native: listNetInterfaces:[3]) and error while loading shared libraries: libpthread.so.0: cannot open shared object file: No such file or directory

Question

Hi Gurus,
I'm trying to upgrade my test 9.2.0.8 rac to 10.1 rac. I cannot upgrade to 10.2 because of RAM limitations on my test RAC. 10.1 Clusterware software was successfully installed and the daemons are up with OCR and voting disk created. Then during the installation of RAC software at the end, root.sh needs to be run. When I run root.sh, it gave the error: while loading shared libraries: libpthread.so.0: cannot open shared object file: No such file or directory. I have libpthread.so.0 in /lib. I looked up on metalink and found Doc ID: 414163.1 . I unset the LD_ASSUME_KERNEL in vipca (unsetting of LD_ASSUME_KERNEL was not required in srvctl because there was no LD_ASSUME_KERNEL in srvctl). Then I tried to run vipca manually. I receive the following error: Error 0(Native: listNetInterfaces:[3]). I'm able to see xclock and xeyes. So its not a problem with x.
OS: OEL5 32 bit
oifcfg iflist
eth0 192.168.2.0
eth1 10.0.0.0
oifcfg getif
eth1 10.0.0.0 global cluster_interconnect
eth1 10.1.1.0 global cluster_interconnect
eth0 192.168.2.0 global public
cat /etc/hosts
192.168.2.3 sunny1pub.ezhome.com sunny1pub
192.168.2.4 sunny2pub.ezhome.com sunny2pub
192.168.2.33 sunny1vip.ezhome.com sunny1vip
192.168.2.44 sunny2vip.ezhome.com sunny2vip
10.1.1.1 sunny1prv.ezhome.com sunny1prv
10.1.1.2 sunny2prv.ezhome.com sunny2prv
My questions are:
should ping on sunny1vip and sunny2vip be already working? As of now they dont work.
if you look at oifcfg getif, I initially had eth1 10.0.0.0 global cluster_interconnect,eth0 192.168.2.0 global public then I created eth1 10.1.1.0 global cluster_interconnect with setif. Should it be 10.1.1.0 or 10.0.0.0. I looked at the subnet calculator and it says for 10.1.1.1, 10.0.0.0 is the subnet. In metalink they had used 10.10.10.0 and hence I used 10.1.1.0
Any ideas on resolving this issue would be very much appreciated. I had been searching on oracle forums, google, metalink but all of them refer to DOC Id 414163.1 but it does n't seem to work. Please help. Thanks in advance.
Edited by: ayyappa on Aug 20, 2009 10:13 AM
Edited by: ayyappa on Aug 20, 2009 10:14 AM
Edited by: ayyappa on Aug 20, 2009 10:15 AM

Answer 1

a step forward towards resolution but i need some help from the gurus.
root# cat /etc/hosts
127.0.0.1 localhost.localdomain localhost
::1 localhost6.localdomain6 localhost6
192.168.2.3 sunny1pub.ezhome.com sunny1pub
192.168.2.4 sunny2pub.ezhome.com sunny2pub
10.1.1.1 sunny1prv.ezhome.com sunny1prv
10.1.1.2 sunny2prv.ezhome.com sunny2prv
192.168.2.33 sunny1vip.ezhome.com sunny1vip
192.168.2.44 sunny2vip.ezhome.com sunny2vip
root# /u01/app/oracle/product/crs/bin/oifcfg iflist
eth1 10.0.0.0
eth0 192.168.2.0
root# /u01/app/oracle/product/crs/bin/oifcfg getif
eth1 10.0.0.0 global cluster_interconnect
eth0 191.168.2.0 global public
root# /u01/app/oracle/product/10.1.0/Db_1/bin/srvctl config nodeapps -n sunny1pub -a
****ORACLE_HOME environment variable not set!
ORACLE_HOME should be set to the main directory that contain oracle products. set and export ORACLE_HOME, then re-run.
root# export ORACLE_BASE=/u01/app/oracle
root# export ORACLE_HOME=/u01/app/oracle/product/10.1.0/Db_1
root# export ORA_CRS_HOME=/u01/app/oracle/product/crs
root# export PATH=$PATH:$ORACLE_HOME/bin
root# /u01/app/oracle/product/10.1.0/Db_1/bin/srvctl config nodeapps -n sunny1pub -a
VIP does not exist.
root# /u01/app/oracle/product/10.1.0/Db_1/bin/srvctl add nodeapps -n sunny1pub -o $ORACLE_HOME -A 192.168.2.33/255.255.255.0
root# /u01/app/oracle/product/10.1.0/Db_1/bin/srvctl add nodeapps -n sunny2pub -o $ORACLE_HOME -A 192.168.2.44/255.255.255.0
root# /u01/app/oracle/product/10.1.0/Db_1/bin/srvctl config nodeapps -n sunny1pub -a
VIP exists.: sunny1vip.ezhome.com/192.168.2.33/255.255.255.0
root# /u01/app/oracle/product/10.1.0/Db_1/bin/srvctl config nodeapps -n sunny2pub -a
VIP exists.: sunny2vip.ezhome.com/192.168.2.44/255.255.255.0
Once I execute the add nodeapps command as root on node 1, I was able to get vip exists for config nodeapps on node 2. The above 2 statements resulted me with same values on both nodes. After this I executed root.sh on both nodes, I did not receive any errors. It said CRS resources are already configured.
My questions to the gurus are as follows:
Should ping on vip work? It does not work now.
srvctl status nodeapps -n sunny1pub(same result for sunny2pub)
VIP is not running on node: sunny1pub
GSD is not running on node: sunny1pub
PRKO-2016 : Error in checking condition of listener on node: sunny1pub
ONS daemon is not running on node: sunny1pub
[root@sunny1pub ~]# /u01/app/oracle/product/crs/bin/crs_stat -t
Name Type Target State Host
ora....pub.gsd application OFFLINE OFFLINE
ora....pub.ons application OFFLINE OFFLINE
ora....pub.vip application OFFLINE OFFLINE
ora....pub.gsd application OFFLINE OFFLINE
ora....pub.ons application OFFLINE OFFLINE
ora....pub.vip application OFFLINE OFFLINE
Will crs_stat and srvctl status nodeapps -n sunny1pub work after I upgrade my database or should they be working now already? I just choose to install 10.1.0.3 software and after running root.sh on both nodes, I clicked ok and then the End of installation screen appeared. Under installed products, I see 9i home, 10g home, crs home. Under 10g home and crs home, I see cluster nodes(sunny1pub and sunny2pub) So it looks like the 10g software is installed.