RAC failover with HP-Serviceguard package over listener

Question

We have two nodes (lcsnew1 and lcsnew3) on which RAC is installed. We are using HP-Serviceguard and HP-SGeRAC in the co-existence model, where RAC derives cluster membership information from SG and SGeRAC.
We are using the dedicated server model, where each node has one listener. We have configured HP-SG packages over RAC listener so as to provide failover capability. The HP-SG packages monitor database listener and on node failure or listener failure, the package moves to the other node and attaches itself with the listener running on the adoptive node. So, the basic setup is
Initially:
lcsnew1 lcsnew3
pkg4 pkg5
On listener / node failure at lcsnew1:
lcsnew1 lcsnew3
Not Available pkg4, pkg5
On listener / node failure at lcsnew3:
lcsnew1 lcsnew3
pkg4, pkg5 Not Available
We want to connect to any of the pkg IP Address, and if it failsover to another node, the connectivity should still be maintained.
I have a small Test programme which uses JDBC connectivity (thin) to connect at pkg4 virtual IP Address. It is able to get a connection and run some queries in a loop on the same connection. Then pkg4 is moved from lcsnew1 to lcsnew3 (at this time the test programme is in sleep mode). On the same old connection, we expect the query to run successfully. But the behaviour we are observing is random. Sometimes, the test programme remains connected to pkg4 IP address even after failover, while sometimes it gives ConnectionError. However, on again connecting to pkg4 IP address (which by now is in adoptive node lcsnew3), it works. So, basically fresh connections always work but the old connections do not failover every time.
I am enclosing all the configuration files for RAC (listener.ora, tnsnames.ora) and package configuration files (config, control). Also, the hosts file is enclosed which gives the details of all names and IP addresses. The test programme is also enclosed.
Pls have a look and suggest what how to move forward.
The listener.ora looks like
==========================================================
# listener.ora.lcsnew1 Network Configuration File: /opt/app/oracle/product/10.2.0/db_1/network/admin/listener.ora.lcsnew1
# Generated by Oracle configuration tools.
LISTENER_LCSNEW1 =
(DESCRIPTION_LIST =
(DESCRIPTION =
(ADDRESS = (PROTOCOL = IPC)(KEY = EXTPROC1))
(ADDRESS = (PROTOCOL = TCP)(HOST = lcsnew1-vip)(PORT = 1521)(IP = FIRST))
(ADDRESS = (PROTOCOL = TCP)(HOST = lcsnew1)(PORT = 1521))
SID_LIST_LISTENER_LCSNEW1 =
(SID_LIST =
(SID_DESC =
(SID_NAME = PLSExtProc)
(ORACLE_HOME = /opt/app/oracle/product/10.2.0/db_1)
(PROGRAM = extproc)
=========================================================
The tnsnames.ora looks like
=========================================================
# tnsnames.ora.lcsnew1 Network Configuration File: /opt/app/oracle/product/10.2.0/db_1/network/admin/tnsnames.ora.lcsnew1
# Generated by Oracle configuration tools.
GMLCDB2 =
(DESCRIPTION =
(ADDRESS = (PROTOCOL = TCP)(HOST = lcsnew3-vip)(PORT = 1521))
(CONNECT_DATA =
(SERVER = DEDICATED)
(SERVICE_NAME = gmlcdb)
(INSTANCE_NAME = gmlcdb2)
GMLCDB1 =
(DESCRIPTION =
(ADDRESS = (PROTOCOL = TCP)(HOST = lcsnew1-vip)(PORT = 1521))
(CONNECT_DATA =
(SERVER = DEDICATED)
(SERVICE_NAME = gmlcdb)
(INSTANCE_NAME = gmlcdb1)
LISTENERS_GMLCDB =
(ADDRESS_LIST =
(ADDRESS = (PROTOCOL = TCP)(HOST = lcsnew3-vip)(PORT = 1521))
(ADDRESS = (PROTOCOL = TCP)(HOST = lcsnew1-vip)(PORT = 1521))
GMLCDB =
(DESCRIPTION =
(ADDRESS = (PROTOCOL = TCP)(HOST = lcsnew3-vip)(PORT = 1521))
(ADDRESS = (PROTOCOL = TCP)(HOST = lcsnew1-vip)(PORT = 1521))
(LOAD_BALANCE = yes)
(CONNECT_DATA =
(SERVER = DEDICATED)
(SERVICE_NAME = gmlcdb)
EXTPROC_CONNECTION_DATA =
(DESCRIPTION =
(ADDRESS_LIST =
(ADDRESS = (PROTOCOL = IPC)(KEY = EXTPROC1))
(CONNECT_DATA =
(SID = PLSExtProc)
(PRESENTATION = RO)
========================================================
The package configuration file looks like
========================================================
PACKAGE_NAME     pkg4
PACKAGE_TYPE               FAILOVER
FAILOVER_POLICY               CONFIGURED_NODE
FAILBACK_POLICY               MANUAL
NODE_NAME     lcsnew1
NODE_NAME     lcsnew3     
AUTO_RUN               YES
LOCAL_LAN_FAILOVER_ALLOWED     YES
NODE_FAIL_FAST_ENABLED          NO
RUN_SCRIPT               /etc/cmcluster/pkg4/pkg4.cntl     
RUN_SCRIPT_TIMEOUT          NO_TIMEOUT
HALT_SCRIPT               /etc/cmcluster/pkg4/pkg4.cntl
HALT_SCRIPT_TIMEOUT          NO_TIMEOUT
The package control file looks like
==========================================================
. ${SGCONFFILE:=/etc/cmcluster.conf}
PATH=$SGSBIN:/usr/bin:/usr/sbin:/etc:/bin
CVM_ACTIVATION_CMD="vxdg -g \$DiskGroup set activation=exclusivewrite"
DEACTIVATION_RETRY_COUNT=0
KILL_PROCESSES_ACCESSING_RAW_DEVICES="NO"
VXVOL="vxvol -g \$DiskGroup startall"
FS_UMOUNT_COUNT=1
FS_MOUNT_RETRY_COUNT=0
CONCURRENT_VGCHANGE_OPERATIONS=1
CONCURRENT_FSCK_OPERATIONS=1
CONCURRENT_MOUNT_AND_UMOUNT_OPERATIONS=1
IP[0]="10.3.10.170"
SUBNET[0]="10.3.10.0"

Answer 1

Why do you want to use the HP-serviceguard even when you are using RAC on 10g Rel 2.
Oracle itself provide facility of TAF and now in 10g the concept of Vip.
all this functionality will be available by using TAF.
Kuljeet