/usr/cluster/lib/amd64/libdsdev.so.1: symbol free_rpc_args: referenced symb

Question

We are running SC 3.2 on AMD 64 We keep getting this relocation error: file /usr/cluster/lib/amd64/libdsdev.so.1: symbol free_rpc_args: referenced symbol not found are we missing any patch.
Thanks a lot
bash-3.00# scswitch -e -j ms-server
ld.so.1: ims_svc_start: fatal: relocation error: file /usr/cluster/lib/amd64/libdsdev.so.1: symbol free_rpc_args: referenced symbol not found
Jan  2 07:46:08 pgimpy2 Cluster.RGM.rgmd: Method <ims_svc_start> on resource <ms-server> terminated due to receipt of signal <9>
Connecting to watcher ...
Warning: Cannot connect to the watcher process
job_controller server is not running
dispatcher server is not running
sched server is not running
http server is not running
pop server is not running
imap server is not running
purge server is not running
store server is not running
ld.so.1: ims_svc_stop: fatal: relocation error: file /usr/cluster/lib/amd64/libdsdev.so.1: symbol free_rpc_args: referenced symbol not found
Jan  2 07:46:09 pgimpy2 Cluster.RGM.rgmd: Method <ims_svc_stop> on resource <ms-server> terminated due to receipt of signal <9>
Jan  2 07:46:09 pgimpy2 ip: TCP_IOC_ABORT_CONN: local = 010.011.161.138:0, remote = 000.000.000.000:0, start = -2, end = 6
Jan  2 07:46:09 pgimpy2 ip: TCP_IOC_ABORT_CONN: aborted 0 connection
scswitch: (C969069) Request failed because resource group MS_RG_zones is in ERROR_STOP_FAILED state and requires operator attention
------------ snip --------------
10) Messages from '/var/adm/messages'
------------ snip --------------
Jan  2 07:46:08 pgimpy2 Cluster.RGM.rgmd: [ID 224900 daemon.notice] launching method <ims_svc_start> for resource <ms-server>, resource group <MS_RG_zones>, node <pgimpy2>, timeout <300> seconds
Jan  2 07:46:08 pgimpy2 Cluster.RGM.rgmd: [ID 751138 daemon.notice] 47 fe_rpc_command: cmd_type(enum):<1>:cmd=</opt/sun/comms/msg_scha/bin/ims_svc_start>:tag=<MS_RG_zones.ms-server.0>: Calling security_clnt_connect(..., host=<pgimpy2>, sec_type {0:WEAK, 1:STRONG, 2:DES} =<1>, ...)
Jan  2 07:46:08 pgimpy2 Cluster.RGM.rgmd: [ID 650825 daemon.error] Method <ims_svc_start> on resource <ms-server> terminated due to receipt of signal <9>
Jan  2 07:46:08 pgimpy2 Cluster.RGM.rgmd: [ID 224900 daemon.notice] launching method <hafoip_monitor_stop> for resource <ms-zones-gimpy-161-4a>, resource group <MS_RG_zones>, node <pgimpy2>, timeout <300> seconds
Jan  2 07:46:08 pgimpy2 Cluster.RGM.rgmd: [ID 224900 daemon.notice] launching method <hastorageplus_monitor_stop> for resource <ms-zones-hasp>, resource group <MS_RG_zones>, node <pgimpy2>, timeout <90> seconds
Jan  2 07:46:08 pgimpy2 Cluster.RGM.rgmd: [ID 224900 daemon.notice] launching method <ims_svc_stop> for resource <ms-server>, resource group <MS_RG_zones>, node <pgimpy2>, timeout <300> seconds
Jan  2 07:46:08 pgimpy2 Cluster.RGM.rgmd: [ID 268902 daemon.notice] 45 fe_rpc_command: cmd_type(enum):<1>:cmd=</usr/cluster/lib/rgm/rt/hafoip/hafoip_monitor_stop>:tag=<MS_RG_zones.ms-zones-gimpy-161-4a.8>: Calling security_clnt_connect(..., host=<pgimpy2>, sec_type {0:WEAK, 1:STRONG, 2:DES} =<1>, ...)
Jan  2 07:46:08 pgimpy2 Cluster.RGM.rgmd: [ID 751138 daemon.notice] 47 fe_rpc_command: cmd_type(enum):<1>:cmd=</opt/sun/comms/msg_scha/bin/ims_svc_stop>:tag=<MS_RG_zones.ms-server.1>: Calling security_clnt_connect(..., host=<pgimpy2>, sec_type {0:WEAK, 1:STRONG, 2:DES} =<1>, ...)
Jan  2 07:46:08 pgimpy2 Cluster.RGM.rgmd: [ID 510020 daemon.notice] 46 fe_rpc_command: cmd_type(enum):<1>:cmd=</usr/cluster/lib/rgm/rt/hastorageplus/hastorageplus_monitor_stop>:tag=<MS_RG_zones.ms-zones-hasp.8>: Calling security_clnt_connect(..., host=<pgimpy2>, sec_type {0:WEAK, 1:STRONG, 2:DES} =<1>, ...)
Jan  2 07:46:08 pgimpy2 Cluster.RGM.rgmd: [ID 515159 daemon.notice] method <hastorageplus_monitor_stop> completed successfully for resource <ms-zones-hasp>, resource group <MS_RG_zones>, node <pgimpy2>, time used: 0% of timeout <90 seconds>
Jan  2 07:46:08 pgimpy2 Cluster.RGM.rgmd: [ID 515159 daemon.notice] method <hafoip_monitor_stop> completed successfully for resource <ms-zones-gimpy-161-4a>, resource group <MS_RG_zones>, node <pgimpy2>, time used: 0% of timeout <300 seconds>
Jan  2 07:46:09 pgimpy2 Cluster.RGM.rgmd: [ID 650825 daemon.error] Method <ims_svc_stop> on resource <ms-server> terminated due to receipt of signal <9>
Jan  2 07:46:09 pgimpy2 Cluster.RGM.rgmd: [ID 224900 daemon.notice] launching method <hastorageplus_stop> for resource <ms-zones-hasp>, resource group <MS_RG_zones>, node <pgimpy2>, timeout <1800> seconds
Jan  2 07:46:09 pgimpy2 Cluster.RGM.rgmd: [ID 751138 daemon.notice] 47 fe_rpc_command: cmd_type(enum):<1>:cmd=</usr/cluster/lib/rgm/rt/hastorageplus/hastorageplus_stop>:tag=<MS_RG_zones.ms-zones-hasp.1>: Calling security_clnt_connect(..., host=<pgimpy2>, sec_type {0:WEAK, 1:STRONG, 2:DES} =<1>, ...)
Jan  2 07:46:09 pgimpy2 Cluster.RGM.rgmd: [ID 515159 daemon.notice] method <hastorageplus_stop> completed successfully for resource <ms-zones-hasp>, resource group <MS_RG_zones>, node <pgimpy2>, time used: 0% of timeout <1800 seconds>
Jan  2 07:46:09 pgimpy2 Cluster.RGM.rgmd: [ID 224900 daemon.notice] launching method <hafoip_stop> for resource <ms-zones-gimpy-161-4a>, resource group <MS_RG_zones>, node <pgimpy2>, timeout <300> seconds
Jan  2 07:46:09 pgimpy2 Cluster.RGM.rgmd: [ID 751138 daemon.notice] 47 fe_rpc_command: cmd_type(enum):<1>:cmd=</usr/cluster/lib/rgm/rt/hafoip/hafoip_stop>:tag=<MS_RG_zones.ms-zones-gimpy-161-4a.1>: Calling security_clnt_connect(..., host=<pgimpy2>, sec_type {0:WEAK, 1:STRONG, 2:DES} =<1>, ...)
Jan  2 07:46:09 pgimpy2 ip: [ID 678092 kern.notice] TCP_IOC_ABORT_CONN: local = 010.011.161.138:0, remote = 000.000.000.000:0, start = -2, end = 6
Jan  2 07:46:09 pgimpy2 in.routed[203]: [ID 970160 daemon.notice] unable to get interface flags for bge0:1: No such device or address
Jan  2 07:46:09 pgimpy2 in.routed[203]: [ID 472501 daemon.notice] bge0:1 has no ifIndex: No such device or address
Jan  2 07:46:09 pgimpy2 ip: [ID 302654 kern.notice] TCP_IOC_ABORT_CONN: aborted 0 connection
Jan  2 07:46:09 pgimpy2 Cluster.RGM.rgmd: [ID 515159 daemon.notice] method <hafoip_stop> completed successfully for resource <ms-zones-gimpy-161-4a>, resource group <MS_RG_zones>, node <pgimpy2>, time used: 0% of timeout <300 seconds>
Jan  2 07:46:09 pgimpy2 Cluster.RGM.rgmd: [ID 224900 daemon.notice] launching method <hastorageplus_postnet_stop> for resource <ms-zones-hasp>, resource group <MS_RG_zones>, node <pgimpy2>, timeout <1800> seconds
Jan  2 07:46:09 pgimpy2 Cluster.RGM.rgmd: [ID 751138 daemon.notice] 47 fe_rpc_command: cmd_type(enum):<1>:cmd=</usr/cluster/lib/rgm/rt/hastorageplus/hastorageplus_postnet_stop>:tag=<MS_RG_zones.ms-zones-hasp.11>: Calling security_clnt_connect(..., host=<pgimpy2>, sec_type {0:WEAK, 1:STRONG, 2:DES} =<1>, ...)
Jan  2 07:46:09 pgimpy2 Cluster.RGM.rgmd: [ID 515159 daemon.notice] method <hastorageplus_postnet_stop> completed successfully for resource <ms-zones-hasp>, resource group <MS_RG_zones>, node <pgimpy2>, time used: 0% of timeout <1800 seconds>
bash-3.00#

Answer 1

FYI:
This turns out to be caused by a Sun Studio Solaris linker bug which has now been fixed. Unfortunately the problem exists with the compiled agent. The recommended fix will be to use the version of the agent that comes out with the next release of the Solaris Cluster software as this will probably appear sooner than a patch would.
Regards,
Tim
---