TMS server is getting crash while booting under tuxedo.

Question

Hi,
While booting the TMS server under tuxedo 9.1, the TMS is getting crash. Please see below the GDB output of the core. Any help on this will be appreciated.
Oracle 10G Enterprise Edition and Tuxedo 9
glibc-2.3.4-2(i386)
Machine details :
[mduser@gkp32gfw77iupq2 bin]$ uname -a
Linux gkp32gfw77iupq2 2.6.9-5.ELsmp #1 SMP Wed Jan 5 19:30:39 EST 2005 i686 i686 i386 GNU/Linux
exec BBL -A :
process id=3286 ... Started.
Booting server processes ...
exec TMS_ORA_MD -A :
CMDTUX_CAT:819: INFO: Process id=3287 Assume started (pipe).
exec TMS_ORA_MD -A :
CMDTUX_CAT:819: INFO: Process id=3290 Assume started (pipe).
We are getting a error , assume pipe started while booting the TMS server TMS_ORA_MD , it seems that the server is getting crashed and core file is created .
Check the output generated by gdb.
[mduser@gkp32gfw77iupq2 bin]$ gdb TMS_ORA_MD core.3287
GNU gdb Red Hat Linux (6.1post-1.20040607.62rh)
Copyright 2004 Free Software Foundation, Inc.
GDB is free software, covered by the GNU General Public License, and you are
welcome to change it and/or distribute copies of it under certain conditions.
Type "show copying" to see the conditions.
There is absolutely no warranty for GDB. Type "show warranty" for details.
This GDB was configured as "i386-redhat-linux-gnu"...(no debugging symbols found)...Using host libthread_db library "/lib/tls/i686/libthread_db.so.1".
Core was generated by `TMS_ORA_MD -C dom=devmdirect -g 1 -i 30001 -u gkp32gfw77iupq2 -U /home/mduser/m'.
Program terminated with signal 11, Segmentation fault.
Reading symbols from /home/tuxedo/lib/libtux.so...done.
Loaded symbols for /home/tuxedo/lib/libtux.so
Reading symbols from /home/tuxedo/lib/libbuft.so...done.
Loaded symbols for /home/tuxedo/lib/libbuft.so
Reading symbols from /home/oracle/product/10.1.0/db_1/lib/libclntsh.so.10.1...done.
Loaded symbols for /home/oracle/product/10.1.0/db_1/lib/libclntsh.so.10.1
Reading symbols from /home/tuxedo/lib/libfml.so...done.
Loaded symbols for /home/tuxedo/lib/libfml.so
Reading symbols from /home/tuxedo/lib/libfml32.so...done.
Loaded symbols for /home/tuxedo/lib/libfml32.so
Reading symbols from /home/tuxedo/lib/libengine.so...done.
Loaded symbols for /home/tuxedo/lib/libengine.so
Reading symbols from /lib/libdl.so.2...done.
Loaded symbols for /lib/libdl.so.2
Reading symbols from /lib/tls/i686/libpthread.so.0...done.
Loaded symbols for /lib/tls/i686/libpthread.so.0
Reading symbols from /usr/lib/libstdc++.so.6...done.
Loaded symbols for /usr/lib/libstdc++.so.6
Reading symbols from /lib/tls/i686/libm.so.6...done.
Loaded symbols for /lib/tls/i686/libm.so.6
Reading symbols from /lib/libgcc_s.so.1...done.
Loaded symbols for /lib/libgcc_s.so.1
Reading symbols from /lib/tls/i686/libc.so.6...done.
Loaded symbols for /lib/tls/i686/libc.so.6
Reading symbols from /home/tuxedo/lib/libutrace.so...done.
Loaded symbols for /home/tuxedo/lib/libutrace.so
Reading symbols from /home/tuxedo/lib/libgiconv.so...done.
Loaded symbols for /home/tuxedo/lib/libgiconv.so
Reading symbols from /home/tuxedo/lib/libusort.so...done.
Loaded symbols for /home/tuxedo/lib/libusort.so
Reading symbols from /home/oracle/product/10.1.0/db_1/lib/libnnz10.so...done.
Loaded symbols for /home/oracle/product/10.1.0/db_1/lib/libnnz10.so
Reading symbols from /lib/libnsl.so.1...done.
Loaded symbols for /lib/libnsl.so.1
Reading symbols from /lib/ld-linux.so.2...done.
Loaded symbols for /lib/ld-linux.so.2
Reading symbols from /home/tuxedo/lib/registry.so...done.
Loaded symbols for /home/tuxedo/lib/registry.so
Reading symbols from /lib/libnss_files.so.2...done.
Loaded symbols for /lib/libnss_files.so.2
#0 0x00b4479b in pthread_mutex_lock () from /lib/tls/i686/libpthread.so.0
(gdb) where
#0 0x00b4479b in pthread_mutex_lock () from /lib/tls/i686/libpthread.so.0
#1 0x01a99600 in sltsmna ()
from /home/oracle/product/10.1.0/db_1/lib/libclntsh.so.10.1
#2 0x01404229 in ztcrbh ()
from /home/oracle/product/10.1.0/db_1/lib/libclntsh.so.10.1
#3 0x01404159 in ztcrbp ()
from /home/oracle/product/10.1.0/db_1/lib/libclntsh.so.10.1
#4 0x01403c9a in ztcr2seed ()
from /home/oracle/product/10.1.0/db_1/lib/libclntsh.so.10.1
#5 0x01404bcf in ztvokg ()
from /home/oracle/product/10.1.0/db_1/lib/libclntsh.so.10.1
#6 0x011e0c8d in kpu8lgn ()
from /home/oracle/product/10.1.0/db_1/lib/libclntsh.so.10.1
#7 0x011daef1 in kpuauthxa ()
from /home/oracle/product/10.1.0/db_1/lib/libclntsh.so.10.1
#8 0x011daa2f in kpuauth ()
from /home/oracle/product/10.1.0/db_1/lib/libclntsh.so.10.1
#9 0x01268346 in OCISessionBegin ()
from /home/oracle/product/10.1.0/db_1/lib/libclntsh.so.10.1
#10 0x012a4def in xaolgn_help ()
from /home/oracle/product/10.1.0/db_1/lib/libclntsh.so.10.1
#11 0x012a5338 in xaolgn ()
from /home/oracle/product/10.1.0/db_1/lib/libclntsh.so.10.1
#12 0x0129f6ba in xaoopen_help ()
from /home/oracle/product/10.1.0/db_1/lib/libclntsh.so.10.1
#13 0x0129f7ce in xaoopen ()
from /home/oracle/product/10.1.0/db_1/lib/libclntsh.so.10.1
#14 0x00a17afe in tpopen () from /home/tuxedo/lib/libtux.so
#15 0x0804992b in tpsvrinit ()
#16 0x00a2eff6 in _tmmain () from /home/tuxedo/lib/libtux.so
#17 0x00a20436 in _tmstartserver () from /home/tuxedo/lib/libtux.so
#18 0x0804970f in main ()
(gdb)
We have oracle 10G installed on our Linux 4 Enterprise edition , see the uname –a command output below.
[mduser@gkp32gfw77iupq2 ~]$ uname -a
Linux gkp32gfw77iupq2 2.6.9-5.ELsmp #1 SMP Wed Jan 5 19:30:39 EST 2005 i686 i686 i386 GNU/Linux
Its seems that is crashing some where in /lib/tls/i686/libpthread.so.0.
Our xa open string is:
OPENINFO="Oracle_XA:oracle_xa+acc=p/scott/tiger+sestm=3600+LogDir=/home/mduser/mdsource/log"
RM file content are below.
TUXEDO/D:tuxd_switch:-lrms -lfs
TUXEDO/SQL:tuxsql_switch:-lsql -lusort -lrms -lfs
NONE:tmnull_switch:
TUXEDO/QM:tuxq_switch:-lqm –ltmib
Oracle_XA:xaosw:-L${ORACLE_HOME}/lib ${ORACLE_HOME}/lib/libserver10.a –
lclntsh ${ORACLE_HOME}/lib/libsql10.a –lm
command use to generate TMS is
[mduser@gkp32gfw77iupq2 bin]$ buildtms -r Oracle_XA -o TMS_ORA_MD
[mduser@gkp32gfw77iupq2 bin]$
Please let us know if you required any other information to resolve this issue .
Regards,
Rajesh Kanade

Answer 1

Please check the bash_profile file for user (oracle or root)
this entry should be there
LD_LIBRARY_PATH=$TUXDIR/lib;export LD_LIBRARY_PATH
thanks,
Mannan