Tuxedo8 core dumps when performing a tpcall in Solaris

Question

Hi all,
I'm installing a Tuxedo application on a Solaris OS:
SunOS 5.8 Generic_108528-13 sun4u sparc SUNW,Sun-Fire-280R
Tuxedo 8.0 compiled under 32bits libraries.
This application also runs correctly under a RedHat Linux 7.1 (kernel 2.4.9-31)
and on a Digital (OSF1 V4.0 878 alpha)
When running the application on Solaris, we always get a core dump when the service
performs a tpcall. Debugging the Tuxedo server we can see the core dump is produced
when the service gets de response from the tpcall, i.e: when the service called
performs the tpreturn.
Any clues will be appreciated, thanks!
Yol.

Answer 1

Oh, thanks very much, what a stupid mistake! sorry :(
We knew about the cast, but after looking for the problem in many ways we didn't
realize FLDLEN was a short!
Thank you all for your quick help!
Yol.
Scott Orshan <[email protected]> wrote:
FLDLEN nLongitud is a short. Casting its pointer to a long * does not
change the
fact that the return value will overwrite other memory. On Linux, the
alignment or
arrangement of the stack was different, so it didn't core dump. You need
to pass
the address of a real long for the return length.
     Scott Orshan
Yol. wrote:
Yes, that's what we thought at first sight, nevertheless remember itruns ok in
other OS.
Anyway here I give you 2 samples of code we've tried.
Any of this cases fail creating a core dump.
Case 1:
Src1 calls Src2:
Src1:
void SRC1(TPSVCINFO * BufferFml)
FLDLEN nLongitud;
FBFR *pBuffer;
pBuffer = (FBFR *) BufferFml->data;
if (tpcall("SRC2", (char *) pBuffer, 0, (char **) &pBuffer, (long*) &nLongitud,
0) == -1)
userlog("Error!!!!!!!!!!!!!!!!!");
tpreturn(TPSUCCESS, 0, (char *) pBuffer, 0L, 0);
Src2
void SRC2(TPSVCINFO * BufferFml)
FLDLEN nLongitud;
FBFR *pBuffer;
pBuffer = (FBFR *) BufferFml->data;
tpreturn(TPSUCCESS, 0, (char *) pBuffer, 0L, 0);
Case 2:
Src1 calls Src2:
Src1:
The same as in case 1
Src2:
void SRC2(TPSVCINFO * BufferFml)
tpreturn(TPSUCCESS, 0, NULL, 0L, 0);
Thanks anyway for your attention ;-)
Peter Holditch <[email protected]> wrote:
Yol,
My initial guess is that your code is not keeping track of the tpalloced
buffers correctly - in particular, the one that the reply is received
into.
If you post some code, maybe someone will see the error. Alternatively,
have you got purift or some other bounds checking software that might
help you track the problem?
Regards,
Peter.
Yol. wrote:
Hi all,
I'm installing a Tuxedo application on a Solaris OS:
SunOS 5.8 Generic_108528-13 sun4u sparc SUNW,Sun-Fire-280R
Tuxedo 8.0 compiled under 32bits libraries.
This application also runs correctly under a RedHat Linux 7.1 (kernel2.4.9-31)
and on a Digital (OSF1 V4.0 878 alpha)
When running the application on Solaris, we always get a core dumpwhen the service
performs a tpcall. Debugging the Tuxedo server we can see the coredump is produced
when the service gets de response from the tpcall, i.e: when the servicecalled
performs the tpreturn.
Any clues will be appreciated, thanks!
Yol.