No connect due to DbSl Load Lib Failure - During upgrade

Question

Hi,
  I am in the middle of performing PREPARE on a ECC 5.0 system to upgrade to ECC 6.0. During the phase PR_DBPAR the following error is coming:
SAPup> Starting subprocess 15413368 at 20080525190758
ENV <0x1105f2e90>: ORACLE_PSRV=DR5
ENV <0x1105f2ed0>: PATH=/oracle/DR5/102_64/bin:.:/home/dr5adm:/usr/sap/DR5/SYS/e
xe/runU:/usr/sap/DR5/SYS/exe/run:/usr/bin:/etc:/usr/sbin:/usr/ucb:/usr/bin/X11:/
sbin:/usr/java14_64/jre/bin:/usr/java14_64/bin
ENV <0x1105f3070>: NLS_LANG=AMERICAN_AMERICA.UTF8
ENV <0x1105f30d0>: ORACLE_BASE=/oracle
ENV <0x1105f3290>: dbs_ora_tnsname=DR5
ENV <0x1105f32d0>: ORACLE_SID=DR5
ENV <0x1105f34b0>: DIR_LIBRARY=/usr/sap/put/exe
ENV <0x1105f3670>: dbs_ora_schema=SAPDR2
ENV <0x1105f3830>: ORA_NLS33=/oracle/client/9208/ocommon/nls/admin/data
ENV <0x1105f3990>: ORACLE_HOME=/oracle/DR5/102_64
ENV <0x1105f3a70>: dbms_type=ORA
ENV <0x1105f3c30>: LIBPATH=/usr/sap/put/exe:/usr/sap/DR5/SYS/exe/run
ENV <0x1105f3d50>: auth_shadow_upgrade=0
EXECUTING /usr/sap/put/exe/tp (tp) pf=/usr/sap/put/bin/DEFAULT.TPP execdbscript
DR5 -x SQLDBSCRIPT.TQL
This is /usr/sap/put/exe/tp version 372.04.08 (release 700, unicode enabled)
ERROR: No connect due to DbSl Load Lib Failure
ERROR: The values set for DIR_LIBRARY ('/usr/sap/put/exe') or dbms_type ('ORA')
ERROR: Connect to DR5 failed (20080525190759).
Warning: Parameter INTERRUPT is no longer used.
Warning: Parameter DAYLIGHT_SHUTDOWN is no longer used.
Warning: Parameter WITH_TACOB is no longer used.
Warning: Parameter IMPDP_BY_EVENT is no longer used.
Warning: Parameter INTERRUPT is no longer used.
Warning: Parameter DAYLIGHT_SHUTDOWN is no longer used.
Warning: Parameter WITH_TACOB is no longer used.
Warning: Parameter IMPDP_BY_EVENT is no longer used.
Warning: Parameter DBCONFPATH is no longer used.
Warning: Parameter STARTDB is no longer used.
Warning: Parameter STOPDB is no longer used.
TRACE-INFO: 1:  [dev trc     ,00000]  Sun May 25 19:07:59 2008                 
                   4777  0.004777
TRACE-INFO: 2:  [dlux.c      ,00000]  *** ERROR => DlLoadLib: dlopen()=        
0509-130 Symbol resolution failed for /usr/sap/put/exe/dboraslib.o because:
TRACE-INFO: 3:                          0509-136   Symbol OCIClientVersion (numb
er 130) is not exported from
TRACE-INFO: 4:                                     dependent module /usr/sap/DR5
/SYS/exe/run/libclntsh.a[shr.o].
TRACE-INFO: 5:                          0509-022 Cannot load module /usr/sap/put
/exe/dboraslib.o.
TRACE-INFO: 6:                          0509-026 System error: Cannot run a file
that does not have a valid format.
TRACE-INFO: 7:                          0509-192 Examine .loader section symbols
with the             58  0.004835
TRACE-INFO: 8:                                   'dump -Tv' command. -> DLENOACC
ESS (8,Exec format error)
tp returncode summary:
TOOLS: Highest return code of single steps was: 0
ERRORS: Highest tp internal error was: 0249
tp finished with return code: 249
meaning:
  connect failed due to DbSL load lib failure
Process with ID 15413368 terminated with status 249
We are having oracle 10g on AIX 5.3.
I tried options like setting LIBPATH with /oracle/client/10x_64/instantclient (instead of the default /oracle/client/9208/lib) along with /usr/sap/DR5/SYS/exe/run and having LIBPATH only with /usr/sap/DR5/SYS/exe/run and having env variable DBS_LIBPATH_EXT=/oracle/client/10x_64/instantclient (as per note 836517)
but if i try to restart PREPARE again, it is picking up the changes happening in LIBPATH (but same error) and also it not picking up DBS_LIBPATH_EXT env variable at all (may be if i try to make it permanent using .sh file it will pick up but i dont want that)
With all the above said, anyone has any perfect idea to have this issue fixed and continue the prepare process ?
Thanks,
Murali.

Answer 1

Hi Markus,
  Thanks for your reply. The issue is as follows:
If i keep the current default value of the env variable LIBPATH which is
LIBPATH=/usr/lib:/lib:/usr/sap/DR5/SYS/exe/run:/usr/sap/DR5/SYS/exe/runU:/oracle
/client/9208/lib
and being in /usr/sap/SID/SYS/exe/run (which is 6.40 kernel ECC 5.0) if i execute
ldd dboraslib.o the following is the output:
dboraslib.o needs:
         /usr/sap/DR5/SYS/exe/run/libsapu16.so
         /usr/sap/DR5/SYS/exe/run/libclntsh.a(shr.o)
         /oracle/client/9208/lib/libwtc9.so
         /usr/lib/libc.a(shr_64.o)
         /usr/lib/libpthreads.a(shr_xpg5_64.o)
         /usr/lib/libdl.a(shr_64.o)
         /usr/lib/libodm.a(shr_64.o)
         /usr/lib/libc.a(aio_64.o)
         /unix
         /usr/lib/libcrypt.a(shr_64.o)
being in /usr/sap/put/exe (which is in the middle of PREPARE step for ECC 6.0 upgrade, so it put kernel 7.0 files), the following is the output:
dboraslib.o needs:
         /usr/lib/libc.a(shr_64.o)
         /usr/sap/DR5/SYS/exe/run/libclntsh.a(shr.o)
         /unix
         /usr/lib/libcrypt.a(shr_64.o)
         /usr/lib/libpthreads.a(shr_xpg5_64.o)
         /usr/lib/libdl.a(shr_64.o)
         /usr/lib/libodm.a(shr_64.o)
         /usr/lib/libc.a(aio_64.o)
But if i change the environment variable for LIBPATH as follows:
LIBPATH=/oracle/client/10x_64/instantclient:/usr/lib:/lib:/usr/sap/DR5/SYS/exe/run:
/usr/sap/DR5/SYS/exe/runU  (since we have already installed oracle 10g which is up and running and so we have already installed instant client also during that process)
  the following is what the output for both the path as mentioned earlier:
#[/usr/sap/put/exe]
#dr5adm@sapdr5-3d[DR5]> ldd dboraslib.o
dboraslib.o needs:
         /usr/lib/libc.a(shr_64.o)
         /oracle/client/10x_64/instantclient/libclntsh.a(shr.o)
         /unix
         /usr/lib/libcrypt.a(shr_64.o)
         /usr/lib/libpthreads.a(shr_xpg5_64.o)
         /usr/lib/libdl.a(shr_64.o)
         /usr/lib/libodm.a(shr_64.o)
         /usr/lib/libperfstat.a(shr_64.o)
         /usr/lib/libcfg.a(shr_64.o)
         /usr/lib/liblvm.a(shr_64.o)
#[/usr/sap/DR5/SYS/exe/run]
#dr5adm@sapdr5-3d[DR5]> ldd dboraslib.o
dboraslib.o needs:
         /usr/sap/DR5/SYS/exe/run/libsapu16.so
         /oracle/client/10x_64/instantclient/libclntsh.a(shr.o)
         /oracle/client/92x_64/lib/libwtc9.so
         /usr/lib/libc.a(shr_64.o)
         /usr/lib/libpthreads.a(shr_xpg5_64.o)
         /usr/lib/libdl.a(shr_64.o)
         /usr/lib/libodm.a(shr_64.o)
         /usr/lib/libperfstat.a(shr_64.o)
         /usr/lib/libc.a(aio_64.o)
         /unix
         /usr/lib/libcrypt.a(shr_64.o)
         /usr/lib/libcfg.a(shr_64.o)
         /usr/lib/liblvm.a(shr_64.o)
DIR_LIBRARY on both the cases and by default also is /usr/sap/SID/SYS/exe/run (pointing to running 6.40 kernel)
But if i try the PREPARE with or without this changes, the issue what i reported is what happening. Let me know your ideas on this.
Thanks,
Murali.