WebLogic Server Hang

My WebLogic Server hang up sometime. The platform is IBM AIX, weblogic 8.1 with sp3
The following is the thread dump:
NULL ------------------------------------------------------------------------
0SECTION TITLE subcomponent dump routine
NULL ===============================
1TISIGINFO signal 3 received
1TIDATETIME Date: 2007/04/26 at 11:13:10
1TIFILENAME Javacore filename: /var/bea/domains/TazDomain/javacore524292.1177600390.txt
NULL ------------------------------------------------------------------------
0SECTION XHPI subcomponent dump routine
NULL ==============================
1XHTIME Thu Apr 26 11:13:10 2007
1XHSIGRECV SIGQUIT received at 0x0 in <unknown>.
1XHFULLVERSION J2RE 1.4.2 IBM AIX build ca142-20060421 (SR5)
NULL
1XHCURRENTTHD Current Thread Details
NULL ----------------------
2XHCURRSYSTHD "Signal dispatcher" sys_thread_t:0x74427A28
3XHNATIVESTACK Native Stack
NULL ------------
3XHSTACKLINEERR unavailable - stack address not valid
1XHOPENV Operating Environment
NULL ---------------------
2XHHOSTNAME Host : rcirs050:10.1.93.20
2XHOSLEVEL OS Level : AIX 5.3.0.0
2XHCPUS Processors -
3XHCPUARCH Architecture : POWER_PC (impl: unknown, ver: unknown)
3XHNUMCPUS How Many : 2
3XHCPUSENABLED Enabled : 2
NULL
1XHUSERLIMITS User Limits (in bytes except for NOFILE and NPROC) -
NULL -----------
2XHUSERLIMIT RLIMIT_FSIZE : 1073741312
2XHUSERLIMIT RLIMIT_DATA : 2147483645
2XHUSERLIMIT RLIMIT_STACK : 33554432
2XHUSERLIMIT RLIMIT_CORE : 1073741312
2XHUSERLIMIT RLIMIT_NOFILE : 1024
2XHLIMIT NPROC(max) : 128
NULL
1XHPAGESPACES Page Space (in blocks) -
NULL ----------
2XHPAGESPACE /dev/hd6: size=262144, free=261912
2XHPAGESPACE /dev/paging03: size=507904, free=507672
2XHPAGESPACE /dev/paging00: size=262144, free=261917
2XHPAGESPACE /dev/paging01: size=262144, free=261903
2XHPAGESPACE /dev/paging02: size=262144, free=261901
2XHPAGESPACE /dev/paging04: size=262144, free=260986
2XHPAGESPACE /dev/paging07: size=262144, free=261911
2XHPAGESPACE /dev/paging06: size=262144, free=261913
2XHPAGESPACE /dev/paging05: size=262144, free=261913
NULL
1XHSIGHANDLERS JVM Signal Handlers
NULL -------------------
2XHSIGHANDLER SIGHUP : ignored
2XHSIGHANDLER SIGINT : intrDispatchMD (libhpi.a)
2XHSIGHANDLER SIGQUIT : intrDispatchMD (libhpi.a)
2XHSIGHANDLER SIGILL : intrDispatchMD (libhpi.a)
2XHSIGHANDLER SIGTRAP : JITSigTrapHandler (libjitc.a)
2XHSIGHANDLER SIGABRT : intrDispatchMD (libhpi.a)
2XHSIGHANDLER SIGEMT : intrDispatchMD (libhpi.a)
2XHSIGHANDLER SIGFPE : intrDispatchMD (libhpi.a)
2XHSIGHANDLER SIGBUS : intrDispatchMD (libhpi.a)
2XHSIGHANDLER SIGSEGV : intrDispatchMD (libhpi.a)
2XHSIGHANDLER SIGSYS : intrDispatchMD (libhpi.a)
2XHSIGHANDLER SIGPIPE : ignored
2XHSIGHANDLER SIGTERM : intrDispatchMD (libhpi.a)
NULL
1XHSIGHANDLERS Chained Signal Handlers
NULL -----------------------
2XHSIGHANDLER SIGHUP : ignored
2XHSIGHANDLER SIGINT : intrDispatchMD (libhpi.a)
2XHSIGHANDLER SIGQUIT : intrDispatchMD (libhpi.a)
2XHSIGHANDLER SIGILL : intrDispatchMD (libhpi.a)
2XHSIGHANDLER SIGTRAP : JITSigTrapHandler (libjitc.a)
2XHSIGHANDLER SIGABRT : intrDispatchMD (libhpi.a)
2XHSIGHANDLER SIGEMT : intrDispatchMD (libhpi.a)
2XHSIGHANDLER SIGFPE : intrDispatchMD (libhpi.a)
2XHSIGHANDLER SIGBUS : intrDispatchMD (libhpi.a)
2XHSIGHANDLER SIGSEGV : intrDispatchMD (libhpi.a)
2XHSIGHANDLER SIGSYS : intrDispatchMD (libhpi.a)
2XHSIGHANDLER SIGPIPE : ignored
2XHSIGHANDLER SIGTERM : intrDispatchMD (libhpi.a)
NULL
1XHENVVARS Environment Variables
NULL ---------------------
2XHENVVAR _=/usr/java14/bin/java
2XHENVVAR JAVA_VENDOR=IBM
2XHENVVAR LANG=C
2XHENVVAR PRODUCTION_MODE=
2XHENVVAR LOGIN=qatadm
2XHENVVAR CLASSPATHSEP=:
2XHENVVAR VISUAL=vi
2XHENVVAR POINTBASE_HOME=/opt/bea/weblogic81/common/eval/pointbase
2XHENVVAR PATH=/opt/bea/weblogic81/server/bin:/usr/java14/jre/bin:/usr/java14/bin:/usr/bin:/etc:/usr/sbin:/usr/ucb:/home/qatadm/bin:/usr/bin/X11:/sbin:.:/usr/java14/bin
2XHENVVAR JAVA_VM=
2XHENVVAR LC__FASTMSG=true
2XHENVVAR POINTBASE_CLASSPATH=:/opt/bea/weblogic81/common/eval/pointbase/lib/pbserver44.jar:/opt/bea/weblogic81/common/eval/pointbase/lib/pbclient44.jar
2XHENVVAR CLASSPATH=/opt/bea/weblogic81/server/ext/jdbc/oracle/920/ojdbc14.jar:/usr/java14/lib/tools.jar:/opt/bea/weblogic81/server/lib/weblogic_sp.jar:/opt/bea/weblogic81/server/lib/weblogic.jar::/opt/bea/weblogic81/common/eval/pointbase/lib/pbserver44.jar:/opt/bea/weblogic81/common/eval/pointbase/lib/pbclient44.jar:/usr/java14/jre/lib/rt.jar:/opt/bea/weblogic81/server/lib/webservices.jar:
2XHENVVAR LOGNAME=qatadm
2XHENVVAR MAIL=/usr/spool/mail/qatadm
2XHENVVAR POINTBASE_TOOLS=/opt/bea/weblogic81/common/eval/pointbase/lib/pbtools44.jar
2XHENVVAR LOCPATH=/usr/lib/nls/loc
2XHENVVAR PS1=rcirs050:$PWD>
2XHENVVAR PATHSEP=:
2XHENVVAR USER=qatadm
2XHENVVAR AUTHSTATE=compat
2XHENVVAR BEA_HOME=/opt/bea
2XHENVVAR DCE_USE_WCHAR_NAMES=1
2XHENVVAR SHELL=/usr/bin/ksh
2XHENVVAR ODMDIR=/etc/objrepos
2XHENVVAR JAVA_HOME=/usr/java14
2XHENVVAR TIMEOUT=900
2XHENVVAR TMOUT=900
2XHENVVAR HOME=/home/qatadm
2XHENVVAR MEM_ARGS=-Xms512m -Xmx1024m
2XHENVVAR WEBLOGIC_CLASSPATH=/usr/java14/lib/tools.jar:/opt/bea/weblogic81/server/lib/weblogic_sp.jar:/opt/bea/weblogic81/server/lib/weblogic.jar
2XHENVVAR TERM=dtterm
2XHENVVAR MAILMSG=[YOU HAVE NEW MAIL]
2XHENVVAR PWD=/var/bea/domains/TazDomain
2XHENVVAR TZ=EST5EDT
2XHENVVAR WL_HOME=/opt/bea/weblogic81
2XHENVVAR AIXTHREAD_SCOPE=S
2XHENVVAR A__z=! LOGNAME="*TMOUT
2XHENVVAR _IBM_JAVA_PIPE_524292=
2XHENVVAR IBM_JVM_LIBPATH_OLD_VALUE=/opt/bea/weblogic81/server/lib/aix
2XHENVVAR IBM_JVM_LIBPATH_NEW_VALUE=/usr/java14/jre/bin:/usr/java14/jre/bin/classic:/usr/java14/jre/bin:/opt/bea/weblogic81/server/lib/aix
2XHENVVAR IBM_JVM_CHANGED_ENVVARS_524292=LIBPATH,LDR_CNTRL
2XHENVVAR IBM_JVM_LDR_CNTRL_NEW_VALUE=MAXDATA=0XA0000000@DSA
2XHENVVAR LDR_CNTRL=MAXDATA=0XA0000000@DSA
2XHENVVAR NLSPATH=/usr/lib/nls/msg/%L/%N:/usr/lib/nls/msg/%L/%N.cat
2XHENVVAR LIBPATH=/usr/java14/jre/bin:/usr/java14/jre/bin/classic:/usr/java14/jre/bin:/opt/bea/weblogic81/server/lib/aix
2XHENVVAR _IBM_ENV_INITIAL_524292=805345384
2XHENVVAR IBM_JAVA_COMMAND_LINE=/usr/java14/bin/java -Xms512m -Xmx1024m -Duser.timezone=America/New_York -Dweblogic.Name=TazServer -Dweblogic.ProductionModeEnabled= -Djava.security.policy=/opt/bea/weblogic81/server/lib/weblogic.policy weblogic.Server
NULL
1XHLOADEDLIBS Loaded Libraries (sizes in bytes)
NULL ---------------------------------
2XHLIBNAME /opt/bea/weblogic81/server/lib/aix/libmuxer.so
3XHLIBSIZE filesize : 20757
3XHLIBSTART text start : 0xD0B88000
3XHLIBLDSIZE text size : 0x282E
3XHLIBLDORG data start : 0xF0617CF4
3XHLIBLDDATASZ data size : 0x2AC
2XHLIBNAME /usr/java14/jre/bin/libnio.a
3XHLIBSIZE filesize : 64305
3XHLIBSTART text start : 0xD11F5000
3XHLIBLDSIZE text size : 0x8EF0
3XHLIBLDORG data start : 0xF0615AE0
3XHLIBLDDATASZ data size : 0x594
2XHLIBNAME /opt/bea/weblogic81/server/lib/aix/libweblogicunix1.so
3XHLIBSIZE filesize : 14536
3XHLIBSTART text start : 0xD0B86000
3XHLIBLDSIZE text size : 0x1B90
3XHLIBLDORG data start : 0xF0614484
3XHLIBLDDATASZ data size : 0xD8
2XHLIBNAME /usr/java14/jre/bin/libnet.a
3XHLIBSIZE filesize : 137885
3XHLIBSTART text start : 0xD15D7000
3XHLIBLDSIZE text size : 0x161FF
3XHLIBLDORG data start : 0xF05DE3D8
3XHLIBLDDATASZ data size : 0x968
2XHLIBNAME /usr/java14/jre/bin/libjitc.a
3XHLIBSIZE filesize : 2814544
3XHLIBSTART text start : 0xD252E000
3XHLIBLDSIZE text size : 0x23EE7B
3XHLIBLDORG data start : 0xF0962B68
3XHLIBLDDATASZ data size : 0x1A984
2XHLIBNAME /usr/lib/security/DCE
3XHLIBSIZE filesize : 27634
3XHLIBSTART text start : 0xD0B7A000
3XHLIBLDSIZE text size : 0x6BF2
3XHLIBLDORG data start : 0xF05CEA38
3XHLIBLDDATASZ data size : 0x2BA0
2XHLIBNAME /usr/java14/jre/bin/libzip.a
3XHLIBSIZE filesize : 109746
3XHLIBSTART text start : 0xD11E1000
3XHLIBLDSIZE text size : 0x135E2
3XHLIBLDORG data start : 0xF05DC468
3XHLIBLDDATASZ data size : 0x1918
2XHLIBNAME /usr/java14/jre/bin/classic/libcore.a
3XHLIBSIZE filesize : 136713
3XHLIBSTART text start : 0xD11CB000
3XHLIBLDSIZE text size : 0x15248
3XHLIBLDORG data start : 0xF05DA0E8
3XHLIBLDDATASZ data size : 0x1620
2XHLIBNAME /usr/java14/jre/bin/libjava.a
3XHLIBSIZE filesize : 221158
3XHLIBSTART text start : 0xD11AB000
3XHLIBLDSIZE text size : 0x1FEB2
3XHLIBLDORG data start : 0xF05D88F8
3XHLIBLDDATASZ data size : 0x16F8
2XHLIBNAME /usr/java14/jre/bin/libhpi.a
3XHLIBSIZE filesize : 205732
3XHLIBSTART text start : 0xD118C000
3XHLIBLDSIZE text size : 0x1EE0E
3XHLIBLDORG data start : 0xF06045A0
3XHLIBLDDATASZ data size : 0xF8D0
2XHLIBNAME /usr/java14/jre/bin/libxhpi.a
3XHLIBSIZE filesize : 14654
3XHLIBSTART text start : 0xD0B84000
3XHLIBLDSIZE text size : 0x1B52
3XHLIBLDORG data start : 0xF05D7290
3XHLIBLDDATASZ data size : 0x2C8
2XHLIBNAME /usr/java14/jre/bin/libdbgmalloc.a
3XHLIBSIZE filesize : 15267
3XHLIBSTART text start : 0xD0B81000
3XHLIBLDSIZE text size : 0x217C
3XHLIBLDORG data start : 0xF05D6988
3XHLIBLDDATASZ data size : 0x218
2XHLIBNAME /usr/java14/jre/bin/libjsig.a
3XHLIBSIZE filesize : 14412
3XHLIBSTART text start : 0xD07F8000
3XHLIBLDSIZE text size : 0x1B24
3XHLIBLDORG data start : 0xF05D54B0
3XHLIBLDDATASZ data size : 0x108
2XHLIBNAME /usr/java14/jre/bin/libute.a
3XHLIBSIZE filesize : 112768
3XHLIBSTART text start : 0xD1177000
3XHLIBLDSIZE text size : 0x14ED9
3XHLIBLDORG data start : 0xF05D43B0
3XHLIBLDDATASZ data size : 0x674
2XHLIBNAME /usr/lib/libdl.a
3XHLIBSIZE filesize : 5248
3XHLIBSTART text start : 0xD02E70F8
3XHLIBLDSIZE text size : 0x1E0
3XHLIBLDORG data start : 0xF03190F8
3XHLIBLDDATASZ data size : 0x0
2XHLIBNAME /usr/java14/jre/bin/sovvm/libjvm.a
3XHLIBSIZE filesize : 2857303
3XHLIBSTART text start : 0xD2335000
3XHLIBLDSIZE text size : 0x1F8E31
3XHLIBLDORG data start : 0xF0936290
3XHLIBLDDATASZ data size : 0x2AE10
2XHLIBNAME /usr/java14/jre/bin/classic/libjvm.a
3XHLIBSIZE filesize : 117748
3XHLIBSTART text start : 0xD1169000
3XHLIBLDSIZE text size : 0xD54B
3XHLIBLDORG data start : 0xF05D2A90
3XHLIBLDDATASZ data size : 0xF0C
2XHLIBNAME /usr/lib/libC.a
3XHLIBSIZE filesize : 7196428
3XHLIBSTART text start : 0xD01E7540
3XHLIBLDSIZE text size : 0x20F6D
3XHLIBLDORG data start : 0xF0381340
3XHLIBLDDATASZ data size : 0x6780
2XHLIBNAME /usr/lib/libC.a
3XHLIBSIZE filesize : 7196428
3XHLIBSTART text start : 0xD01CDBC0
3XHLIBLDSIZE text size : 0x186CC
3XHLIBLDORG data start : 0xF0377FC0
3XHLIBLDDATASZ data size : 0x84C9
2XHLIBNAME /usr/lib/libcrypt.a
3XHLIBSIZE filesize : 11019
3XHLIBSTART text start : 0xD01450F8
3XHLIBLDSIZE text size : 0x846
3XHLIBLDORG data start : 0xF0316508
3XHLIBLDDATASZ data size : 0x128
2XHLIBNAME /usr/lib/libiconv.a
3XHLIBSIZE filesize : 377727
3XHLIBSTART text start : 0xD05BF100
3XHLIBLDSIZE text size : 0x139C1
3XHLIBLDORG data start : 0xF0252C70
3XHLIBLDDATASZ data size : 0xA2E4
2XHLIBNAME /usr/lib/libbsd.a
3XHLIBSIZE filesize : 61862
3XHLIBSTART text start : 0xD02784C0
3XHLIBLDSIZE text size : 0x7D2F
3XHLIBLDORG data start : 0xF0213A30
3XHLIBLDDATASZ data size : 0x13D8
2XHLIBNAME /usr/lib/libpthreads.a
3XHLIBSIZE filesize : 1126171
3XHLIBSTART text start : 0xD010E000
3XHLIBLDSIZE text size : 0x365C4
3XHLIBLDORG data start : 0xF0370000
3XHLIBLDDATASZ data size : 0x4024
2XHLIBNAME /usr/lib/libpthreads.a
3XHLIBSIZE filesize : 1126171
3XHLIBSTART text start : 0xD010A000
3XHLIBLDSIZE text size : 0x3C52
3XHLIBLDORG data start : 0xF032D000
3XHLIBLDDATASZ data size : 0x424A8
2XHLIBNAME /usr/lib/libC.a
3XHLIBSIZE filesize : 7196428
3XHLIBSTART text start : 0xD01AD100
3XHLIBLDSIZE text size : 0x1FED1
3XHLIBLDORG data start : 0xF0388D00
3XHLIBLDDATASZ data size : 0x30F9
2XHLIBNAME /usr/lib/libc.a
3XHLIBSIZE filesize : 8270989
3XHLIBSTART text start : 0xD02F2240
3XHLIBLDSIZE text size : 0x251155
3XHLIBLDORG data start : 0xF0278BC0
3XHLIBLDDATASZ data size : 0x9D340
NULL
NULL ------------------------------------------------------------------------
0SECTION CI subcomponent dump routine
NULL ============================
1CIJAVAVERSION J2RE 1.4.2 IBM AIX build ca142-20060421 (SR5)
1CIRUNNINGAS Running as a standalone JVM
1CICMDLINE /usr/java14/bin/java -Xms512m -Xmx1024m -Duser.timezone=America/New_York -Dweblogic.Name=TazServer -Dweblogic.ProductionModeEnabled= -Djava.security.policy=/opt/bea/weblogic81/server/lib/weblogic.policy weblogic.Server
1CIJAVAHOMEDIR Java Home Dir: /usr/java14/jre
1CIJAVADLLDIR Java DLL Dir: /usr/java14/jre/bin
1CISYSCP Sys Classpath: /usr/java14/jre/lib/core.jar:/usr/java14/jre/lib/graphics.jar:/usr/java14/jre/lib/security.jar:/usr/java14/jre/lib/server.jar:/usr/java14/jre/lib/xml.jar:/usr/java14/jre/lib/charsets.jar:/usr/java14/jre/classes:/usr/java14/jre/lib/ibmcertpathprovider.jar:/usr/java14/jre/lib/ibmjaaslm.jar:/usr/java14/jre/lib/ibmjcefw.jar:/usr/java14/jre/lib/ibmjgssprovider.jar:/usr/java14/jre/lib/ibmjssefips.jar:/usr/java14/jre/lib/ibmjsseprovider.jar:/usr/java14/jre/lib/ibmorb.jar:/usr/java14/jre/lib/ibmorbapi.jar:/usr/java14/jre/lib/ibmpkcs.jar
1CIUSERARGS UserArgs:
2CIUSERARG vfprintf 0x30000D94
2CIUSERARG -Xms512m
2CIUSERARG -Xmx1024m
2CIUSERARG -Duser.timezone=America/New_York
2CIUSERARG -Dweblogic.Name=TazServer
2CIUSERARG -Dweblogic.ProductionModeEnabled=
2CIUSERARG -Djava.security.policy=/opt/bea/weblogic81/server/lib/weblogic.policy
2CIUSERARG -Dinvokedviajava
2CIUSERARG -Djava.class.path=/opt/bea/weblogic81/server/ext/jdbc/oracle/920/ojdbc14.jar:/usr/java14/lib/tools.jar:/opt/bea/weblogic81/server/lib/weblogic_sp.jar:/opt/bea/weblogic81/server/lib/weblogic.jar::/opt/bea/weblogic81/common/eval/pointbase/lib/pbserver44.jar:/opt/bea/weblogic81/common/eval/pointbase/lib/pbclient44.jar:/usr/java14/jre/lib/rt.jar:/opt/bea/weblogic81/server/lib/webservices.jar:
2CIUSERARG vfprintf
NULL
1CIJVMMI JVM Monitoring Interface (JVMMI)
NULL ------------------------
2CIJVMMIOFF No events are enabled.
NULL
NULL ------------------------------------------------------------------------
0SECTION DC subcomponent dump routine
NULL ============================
1DCHEADEREYE Header eye catcher DCST
1DCHEADERLEN Header length 24
1DCHEADERVER Header version 1
1DCHEADERMOD Header modification 0
1DCINTERFACE DC Interface at 0xF0947FDC with 15 entries
2DCINTERFACE 1 - dcCString2JavaString 0xF0944A90
2DCINTERFACE 2 - dcInt642CString 0xF0944A9C
2DCINTERFACE 3 - dcJavaString2NewCString 0xF0944AA8
2DCINTERFACE 4 - dcJavaString2CString 0xF0944AB4
2DCINTERFACE 5 - dcJavaString2NewPlatformString 0xF0944AC0
2DCINTERFACE 6 - dcJavaString2UTF 0xF0944ACC
2DCINTERFACE 7 - dcPlatformString2JavaString 0xF0944AE4
2DCINTERFACE 8 - dcUnicode2UTF 0xF0944AF0
2DCINTERFACE 9 - dcUnicode2UTFLength 0xF0944AFC
2DCINTERFACE 10 - dcUTF2JavaString 0xF0944B08
2DCINTERFACE 11 - dcUTFClassName2JavaString 0xF0944B14
2DCINTERFACE 12 - dcJavaString2ClassName 0xF0944AD8
2DCINTERFACE 13 - dcUTF2UnicodeNext 0xF0944B20
2DCINTERFACE 14 - dcVerifyUTF8 0xF0944B2C
2DCINTERFACE 15 - dcDumpRoutine 0xF0944B38
1DCARRAYINFO Array info at 0xF09384A0 with 16 entries
2DCARRAYINFO 1 - index 0 signature 0 name N/A factor 0
2DCARRAYINFO 2 - index 0 signature 0 name N/A factor 0
2DCARRAYINFO 3 - index 2 signature L name class[] factor 4
2DCARRAYINFO 4 - index 0 signature 0 name N/A factor 0
2DCARRAYINFO 5 - index 4 signature Z name bool[] factor 1
2DCARRAYINFO 6 - index 5 signature C name char[] factor 2
2DCARRAYINFO 7 - index 6 signature F name float[] factor 4
2DCARRAYINFO 8 - index 7 signature D name double[] factor 8
2DCARRAYINFO 9 - index 8 signature B name byte[] factor 1
2DCARRAYINFO 10 - index 9 signature S name short[] factor 2
2DCARRAYINFO 11 - index 10 signature I name int[] factor 4
2DCARRAYINFO 12 - index 11 signature J name long[] factor 8
2DCARRAYINFO 13 - index 0 signature 0 name uint[] factor 0
2DCARRAYINFO 14 - index 0 signature 0 name uint1[] factor 0
2DCARRAYINFO 15 - index 0 signature 0 name uint2[] factor 0
2DCARRAYINFO 16 - index 0 signature 0 name uint3[] factor 0
NULL ------------------------------------------------------------------------
0SECTION DG subcomponent dump routine
NULL ============================
1DGTRCENABLED Trace enabled: Yes
2DGTRCTYPE Trace: Internal
2DGTRCBUFFERS Buffer specification: 8k
2DGTRCBUFALLOC Buffers allocated: 0
2DGTRCBUFUSED Buffers in use: 0
1DGJDUMPBUFF Javadump buffer size (allocated): 2621440
NULL ------------------------------------------------------------------------
0SECTION ST subcomponent dump routine
NULL ============================
1STGCMODES Resettable GC: No
1STGCMODES Concurrent GC: No
1STCURHBASE Current Heap Base: 0x300601FC
1STCURHLIM Current Heap Limit: 0x5005FBFC
1STMWHBASE Middleware Heap Base: 0x300601FC
1STMWHLIM Middleware Heap Limit: 0x5005FBFC
1STGCHELPERS Number of GC Helper Threads: 1
1STJVMOPTS -Xconcurrentlevel: 0
1STJVMOPTS -Xconcurrentbackground: 0
1STGCCTR GC Counter: 42
1STAFCTR AF Counter: 42
1STHEAPFREE Bytes of Heap Space Free: 190d3b88
1STHEAPALLOC Bytes of Heap Space Allocated: 1ffffa00
1STSMBASE SM Base: 0x0
1STSMEND SM End: 0x0
1STPAMSTART PAM Start: 0x0
1STPAMEND PAM End: 0x0
1STCOMACTION Compact Action: 0
NULL ------------------------------------------------------------------------
0SECTION XE subcomponent dump routine
NULL ============================
1XETHRESHOLD MMI threshold for java methods is set to 1250
1XEJITINIT JIT is initialized
1XEJVMPIOFF JVMPI is not activated
1XEJNITHRESH MMI threshold for JNI methods is set to 0
1XETRCHIS Trace history length is set to 4
1XEJITDUMP JIT dump routine is not yet implemented.
NULL ------------------------------------------------------------------------
0SECTION LK subcomponent dump routine
NULL ============================
NULL
1LKPOOLINFO Monitor pool info:
2LKPOOLINIT Initial monitor count: 32
2LKPOOLEXPNUM Minimum number of free monitors before expansion: 5
2LKPOOLEXPBY Pool will next be expanded by: 81
2LKPOOLTOTAL Current total number of monitors: 162
2LKPOOLFREE Current number of free monitors: 42
NULL
1LKMONPOOLDUMP Monitor Pool Dump (flat & inflated object-monitors):
2LKMONINUSE sys_mon_t:0x3003EC78 infl_mon_t: 0x3003E6E8:
3LKMONOBJECT java.lang.ref.Reference$Lock@300E02B0/300E02B8: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "Reference Handler" (0x744B7D28)
2LKMONINUSE sys_mon_t:0x3003ED28 infl_mon_t: 0x3003E714:
3LKMONOBJECT java.lang.ref.ReferenceQueue$Lock@300DFFE8/300DFFF0: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "Finalizer" (0x745409A8)
2LKMONINUSE sys_mon_t:0x3003EDD8 infl_mon_t: 0x3003E740:
3LKMONOBJECT java.util.TaskQueue@311299D0/311299D8: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "Thread-1" (0x75F054A8)
2LKMONINUSE sys_mon_t:0x3003EE88 infl_mon_t: 0x3003E76C:
3LKMONOBJECT weblogic.kernel.ExecuteThread@300C9A60/300C9A68: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "ExecuteThread: '0' for queue: 'weblogic.kernel.Default'" (0x765659A8)
2LKMONINUSE sys_mon_t:0x3003EF38 infl_mon_t: 0x3003E798:
3LKMONOBJECT weblogic.kernel.ExecuteThread@300C99C0/300C99C8: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "ExecuteThread: '1' for queue: 'weblogic.kernel.Default'" (0x765693A8)
2LKMONINUSE sys_mon_t:0x3003EFE8 infl_mon_t: 0x3003E7C4:
3LKMONOBJECT weblogic.kernel.ExecuteThread@300C9920/300C9928: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "ExecuteThread: '2' for queue: 'weblogic.kernel.Default'" (0x76569928)
2LKMONINUSE sys_mon_t:0x3003F098 infl_mon_t: 0x3003E7F0:
3LKMONOBJECT weblogic.kernel.ExecuteThread@300C9880/300C9888: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "ExecuteThread: '3' for queue: 'weblogic.kernel.Default'" (0x76572BA8)
2LKMONINUSE sys_mon_t:0x3003F148 infl_mon_t: 0x3003E81C:
3LKMONOBJECT weblogic.kernel.ExecuteThread@300C97E0/300C97E8: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "ExecuteThread: '4' for queue: 'weblogic.kernel.Default'" (0x767971A8)
2LKMONINUSE sys_mon_t:0x3003F1F8 infl_mon_t: 0x3003E848:
3LKMONOBJECT weblogic.kernel.ExecuteThread@300C9740/300C9748: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "ExecuteThread: '5' for queue: 'weblogic.kernel.Default'" (0x7681EBA8)
2LKMONINUSE sys_mon_t:0x3003F2A8 infl_mon_t: 0x3003E874:
3LKMONOBJECT weblogic.kernel.ExecuteThread@300C96A0/300C96A8: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "ExecuteThread: '6' for queue: 'weblogic.kernel.Default'" (0x768A65A8)
2LKMONINUSE sys_mon_t:0x3003F358 infl_mon_t: 0x3003E8A0:
3LKMONOBJECT weblogic.kernel.ExecuteThread@300C9600/300C9608: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "ExecuteThread: '7' for queue: 'weblogic.kernel.Default'" (0x7692E028)
2LKMONINUSE sys_mon_t:0x3003F408 infl_mon_t: 0x3003E8CC:
3LKMONOBJECT weblogic.kernel.ExecuteThread@300C9560/300C9568: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "ExecuteThread: '8' for queue: 'weblogic.kernel.Default'" (0x769B5A28)
2LKMONINUSE sys_mon_t:0x3003F4B8 infl_mon_t: 0x3003E8F8:
3LKMONOBJECT weblogic.kernel.ExecuteThread@300C94C0/300C94C8: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "ExecuteThread: '9' for queue: 'weblogic.kernel.Default'" (0x76A3D4A8)
2LKMONINUSE sys_mon_t:0x3003F568 infl_mon_t: 0x3003E924:
3LKMONOBJECT weblogic.kernel.ExecuteThread@300C9420/300C9428: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "ExecuteThread: '10' for queue: 'weblogic.kernel.Default'" (0x76AC4EA8)
2LKMONINUSE sys_mon_t:0x3003F618 infl_mon_t: 0x3003E950:
3LKMONOBJECT weblogic.kernel.ExecuteThread@300C9380/300C9388: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "ExecuteThread: '11' for queue: 'weblogic.kernel.Default'" (0x76B4C8A8)
2LKMONINUSE sys_mon_t:0x3003F6C8 infl_mon_t: 0x3003E97C:
3LKMONOBJECT weblogic.kernel.ExecuteThread@300C92E0/300C92E8: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "ExecuteThread: '12' for queue: 'weblogic.kernel.Default'" (0x76BD4328)
2LKMONINUSE sys_mon_t:0x3003F778 infl_mon_t: 0x3003E9A8:
3LKMONOBJECT weblogic.kernel.ExecuteThread@300C9240/300C9248: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "ExecuteThread: '13' for queue: 'weblogic.kernel.Default'" (0x76C5BD28)
2LKMONINUSE sys_mon_t:0x3003F828 infl_mon_t: 0x3003E9D4:
3LKMONOBJECT weblogic.kernel.ExecuteThread@300C91A0/300C91A8: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "ExecuteThread: '14' for queue: 'weblogic.kernel.Default'" (0x76CE3728)
2LKMONINUSE sys_mon_t:0x3003F988 infl_mon_t: 0x3003EA2C:
3LKMONOBJECT weblogic.kernel.ExecuteThread@300C9060/300C9068: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "ExecuteThread: '1' for queue: 'weblogic.kernel.System'" (0x76DF2BA8)
2LKMONINUSE sys_mon_t:0x3003FA38 infl_mon_t: 0x3003EA58:
3LKMONOBJECT weblogic.kernel.ExecuteThread@300C8FC0/300C8FC8: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "ExecuteThread: '2' for queue: 'weblogic.kernel.System'" (0x76E7A628)
2LKMONINUSE sys_mon_t:0x3003FAE8 infl_mon_t: 0x3003EA84:
3LKMONOBJECT weblogic.kernel.ExecuteThread@300C8F20/300C8F28: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "ExecuteThread: '3' for queue: 'weblogic.kernel.System'" (0x76F02028)
2LKMONINUSE sys_mon_t:0x3003FB98 infl_mon_t: 0x3003EAB0:
3LKMONOBJECT weblogic.kernel.ExecuteThread@300C8E80/300C8E88: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "ExecuteThread: '4' for queue: 'weblogic.kernel.System'" (0x76F89A28)
2LKMONINUSE sys_mon_t:0x3003FC48 infl_mon_t: 0x3003EADC:
3LKMONOBJECT weblogic.time.common.internal.TimeTable@32EB9198/32EB91A0: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "weblogic.time.TimeEventGenerator" (0x77013D28)
2LKMONINUSE sys_mon_t:0x3003FCF8 infl_mon_t: 0x3003EB08:
3LKMONOBJECT java.lang.Object@32F56538/32F56540: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "weblogic.security.SpinnerRandomSource" (0x770CC3A8)
2LKMONINUSE sys_mon_t:0x3003FDA8 infl_mon_t: 0x3003EB34:
3LKMONOBJECT weblogic.kernel.ExecuteThread@300C8CD0/300C8CD8: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "ExecuteThread: '0' for queue: 'weblogic.admin.HTTP'" (0x770E4428)
2LKMONINUSE sys_mon_t:0x3003FE58 infl_mon_t: 0x3003EB60:
3LKMONOBJECT weblogic.kernel.ExecuteThread@300C8C30/300C8C38: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "ExecuteThread: '1' for queue: 'weblogic.admin.HTTP'" (0x770E4A28)
2LKMONINUSE sys_mon_t:0x3003FF08 infl_mon_t: 0x3003EB8C:
3LKMONOBJECT weblogic.kernel.ExecuteThread@300C8B90/300C8B98: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "ExecuteThread: '0' for queue: 'weblogic.admin.RMI'" (0x770E5028)
2LKMONINUSE sys_mon_t:0x770E3D38 infl_mon_t: 0x770F13D8:
3LKMONOBJECT weblogic.kernel.ExecuteThread@300C8AF0/300C8AF8: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "ExecuteThread: '1' for queue: 'weblogic.admin.RMI'" (0x770F1028)
2LKMONINUSE sys_mon_t:0x770E3DE8 infl_mon_t: 0x770F1404:
3LKMONOBJECT weblogic.kernel.ExecuteThread@300C8A50/300C8A58: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "ExecuteThread: '2' for queue: 'weblogic.admin.RMI'" (0x770F84A8)
2LKMONINUSE sys_mon_t:0x770E3E98 infl_mon_t: 0x770F1430:
3LKMONOBJECT [email protected]0/300C8928: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "VDE Transaction Processor Thread" (0x77531828)
2LKMONINUSE sys_mon_t:0x770F1758 infl_mon_t: 0x770F1488:
3LKMONOBJECT java.util.TaskQueue@30EECD38/30EECD40: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "Thread-5" (0x75CCD1A8)
2LKMONINUSE sys_mon_t:0x770F2F88 infl_mon_t: 0x770F1538:
3LKMONOBJECT weblogic.jms.backend.BETimerTree@33C6CFE0/33C6CFE8: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "ExecuteThread: '0' for queue: 'JMS.TimerTreePool'" (0x7893DD28)
2LKMONINUSE sys_mon_t:0x770F3038 infl_mon_t: 0x770F1564:
3LKMONOBJECT java.util.TaskQueue@34F10870/34F10878: <unowned>
3LKNOTIFYQ Waiting to be notified:
3LKWAITNOTIFY "Thread-7" (0x78DE09A8)
2LKMONINUSE sys_mon_t:0x770F30E8 infl_mon_t: 0x770F1590:
3LKMONOBJECT java.util.TaskQueue@3C4CB120/3C4CB128: <unowned>
3LKNOTIFYQ Waiting to be notifie

Similar Messages

Need help regarding Weblogic Server Hang up

We are facing a problem at the client’s place on the production environment.
The weblogic server is hanging up once every week. The application is running fine till then, but once the server is hung we need to restart the weblogic again.
Also after observing the behavior of the memory usage of the application in the weblogic admin console we came to know that the memory usage is gradually increasing day by day. We are not sure why this is happening.
We tested the application to check for any memory leaks using JProbe. We couldn’t find any memory leaks in the application. We even tested it onsite but couldn’t find any memory leaks.
I need some help on this issue as this is happening on the production environment and needs to be resolved as soon as possible.
The configuration we are having on the production environment is:
bea:8.1
JDK:1.41_02

1. You say its a hang, get multiple threadumps and see whats happening at the time of hang. this will give you a clue into the work thats going on and thats stuck.
2. are you seeing outofmemoryexception? If yes only then you will need to suspect the memory leak. First thing in such situation is try to increase the heap by about 1/3rd more (this is just a guestimate not a recommended practice) , that can potentially buy you time to analyze the problem.
3. you should also check if weblogic objects are leaking , check the jprobe snapshots if you have any to see if you find any weblogic object that are not getting garbage collected and growing continuously. there have been a few memory leak fixes since 8.1 release. if you find something contact support@bea and find out if any existing fix will help.

Weblogic Server hanging at high load!!!!!!!!!!!

Folks,
We have a weblogic server 9.2 which is running fine but after quiet a while at high load we observe that the server goes down and following exception is displayed in the server logs:
####<Nov 13, 2009 2:42:48 AM EST> <Error> <WebLogicServer> <ibmrxcptpnp-wb1> <AdminServer> <[ACTIVE] ExecuteThread: '2' for queue: 'weblogic.kernel.Default (self-tuning)'> <<WLS Kernel>> <> <> <1258098168215> <BEA-000337> <[STUCK] ExecuteThread: '9' for queue: 'weblogic.kernel.Default (self-tuning)' has been busy for "617" seconds working on the request "weblogic.work.ServerWorkManagerImpl$WorkAdapterImpl@1cec1cec", which is more than the configured time (StuckThreadMaxTime) of "600" seconds. Stack trace:
     java.net.SocketOutputStream.socketWrite0(Native Method)
     java.net.SocketOutputStream.socketWrite(SocketOutputStream.java:105)
     java.net.SocketOutputStream.write(SocketOutputStream.java:149)
     oracle.net.ns.DataPacket.send(Unknown Source)
     oracle.net.ns.NetOutputStream.flush(Unknown Source)
     oracle.net.ns.NetInputStream.getNextPacket(Unknown Source)
     oracle.net.ns.NetInputStream.read(Unknown Source)
     oracle.net.ns.NetInputStream.read(Unknown Source)
     oracle.net.ns.NetInputStream.read(Unknown Source)
     oracle.jdbc.driver.T4CMAREngine.unmarshalUB1(T4CMAREngine.java:1099)
     oracle.jdbc.driver.T4CMAREngine.unmarshalSB1(T4CMAREngine.java:1070)
     oracle.jdbc.driver.T4C8Oall.receive(T4C8Oall.java:478)
     oracle.jdbc.driver.T4CPreparedStatement.doOall8(T4CPreparedStatement.java:216)
     oracle.jdbc.driver.T4CPreparedStatement.executeForRows(T4CPreparedStatement.java:955)
     oracle.jdbc.driver.OracleStatement.executeMaybeDescribe(OracleStatement.java:1060)
     oracle.jdbc.driver.T4CPreparedStatement.executeMaybeDescribe(T4CPreparedStatement.java:839)
     oracle.jdbc.driver.OracleStatement.doExecuteWithTimeout(OracleStatement.java:1132)
     oracle.jdbc.driver.OraclePreparedStatement.executeInternal(OraclePreparedStatement.java:3316)
     oracle.jdbc.driver.OraclePreparedStatement.execute(OraclePreparedStatement.java:3422)
     weblogic.jdbc.common.internal.ConnectionEnv.test(ConnectionEnv.java:718)
     weblogic.jdbc.common.internal.ConnectionEnv.test(ConnectionEnv.java:460)
     weblogic.common.resourcepool.ResourcePoolImpl.checkResource(ResourcePoolImpl.java:1455)
     weblogic.common.resourcepool.ResourcePoolImpl.checkAndReturnResource(ResourcePoolImpl.java:1372)
     weblogic.common.resourcepool.ResourcePoolImpl.checkAndReturnResource(ResourcePoolImpl.java:1362)
     weblogic.common.resourcepool.ResourcePoolImpl.testUnusedResources(ResourcePoolImpl.java:1767)
     weblogic.common.resourcepool.ResourcePoolImpl.access$700(ResourcePoolImpl.java:37)
     weblogic.common.resourcepool.ResourcePoolImpl$ResourcePoolMaintanenceTask.timerExpired(ResourcePoolImpl.java:1935)
     weblogic.timers.internal.TimerImpl.run(TimerImpl.java:265)
     weblogic.work.ServerWorkManagerImpl$WorkAdapterImpl.run(ServerWorkManagerImpl.java:518)
     weblogic.work.ExecuteThread.execute(ExecuteThread.java:209)
     weblogic.work.ExecuteThread.run(ExecuteThread.java:181)
>
Any answers?????

Hi,
I have a similar issue on ODSI 10gR3 (WLS 10.3). I am having stuck threads - but, in my case it is clear that the database is down (not at the startup)
Here is some more info:
1. Test Connections On Reserve - Enabled
2. Default values for other parameters
Using Oracle thin driver for the connection pool "MyPool" -
./wlserver_10.3/server/lib/ojdbc6.jar
My question is:
1. How do I avoid the stuck thread caused when the database is down? During peak load, the stuck threads are causing some service requests to fail.
I did my homework and the closest option I could find is set the statementTimeout (which is set currently to the default value of -1 i.e. never timeout). Oracle documentation (http://www.oracle.com/technology/software/tech/java/sqlj_jdbc/htdocs/111070_readme.html) says that the ojdbc6.jar supports setQueryTimeout() method.
Is there any better way to attack this problem?
<Dec 21, 2009 12:11:18 AM EST> <Error> <JDBC> <BEA-001112> <Test "SELECT 1 FROM DUAL" set up for pool "MyPool" failed with exception: "java.sql.SQLRecoverableException: Io exception: Read failed: Connection timed out".>
<Dec 21, 2009 12:14:27 AM EST> <Warning> <JDBC> <BEA-001129> <Received exception while creating connection for pool "MyPool": Io exception: The Network Adapter could not establish the connection>
<Dec 21, 2009 12:18:38 AM EST> <Error> <WebLogicServer> <BEA-000337> <[STUCK] ExecuteThread: '8' for queue: 'weblogic.kernel.Default (self-tuning)' has been busy for "600" seconds working on the request "weblogic.work.SelfTuningWorkManagerImpl$WorkAdapterImpl@297ac2b", which is more than the configured time (StuckThreadMaxTime) of "600" seconds. Stack trace:
Thread-52 "[STUCK] ExecuteThread: '8' for queue: 'weblogic.kernel.Default (self-tuning)'" <alive, in native, suspended, waiting, priority=1, DAEMON> {
-- Waiting for notification on: javax.management.remote.rmi.RMIConnector$RMINotifClient@271498f[fat lock]
java.lang.Object.wait(Object.java:485)
com.sun.jmx.remote.internal.ClientNotifForwarder.postReconnection(ClientNotifForwarder.java:304)
javax.management.remote.rmi.RMIConnector$RMIClientCommunicatorAdmin.reconnectNotificationListeners(RMIConnector.java:1488)
javax.management.remote.rmi.RMIConnector$RMIClientCommunicatorAdmin.doStart(RMIConnector.java:1568)
com.sun.jmx.remote.internal.ClientCommunicatorAdmin.restart(ClientCommunicatorAdmin.java:72)
com.sun.jmx.remote.internal.ClientCommunicatorAdmin.gotIOException(ClientCommunicatorAdmin.java:34)
javax.management.remote.rmi.RMIConnector$RMIClientCommunicatorAdmin.gotIOException(RMIConnector.java:1420)
javax.management.remote.rmi.RMIConnector$RemoteMBeanServerConnection.getAttribute(RMIConnector.java:857)
weblogic.management.mbeanservers.domainruntime.internal.ManagedMBeanServerConnection.getAttribute(ManagedMBeanServerConnection.java:288)
javax.management.MBeanServerInvocationHandler.invoke(MBeanServerInvocationHandler.java:235)
weblogic.management.jmx.MBeanServerInvocationHandler.doInvoke(MBeanServerInvocationHandler.java:477)
weblogic.management.jmx.MBeanServerInvocationHandler.invoke(MBeanServerInvocationHandler.java:294)
$Proxy69.getServerRuntime(Unknown Source)
weblogic.management.mbeanservers.domainruntime.internal.DomainRuntimeServiceMBeanImpl.lookupServerRuntime(DomainRuntimeServiceMBeanImpl.java:242)
sun.reflect.GeneratedMethodAccessor1880.invoke(Unknown Source)
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
java.lang.reflect.Method.invoke(Method.java:575)
weblogic.management.jmx.modelmbean.WLSModelMBean.invoke(WLSModelMBean.java:355)
com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.invoke(DefaultMBeanServerInterceptor.java:831)
com.sun.jmx.mbeanserver.JmxMBeanServer.invoke(JmxMBeanServer.java:761)
weblogic.management.mbeanservers.domainruntime.internal.FederatedMBeanServerInterceptor.invoke(FederatedMBeanServerInterceptor.java:255)
weblogic.management.jmx.mbeanserver.WLSMBeanServerInterceptorBase$16.run(WLSMBeanServerInterceptorBase.java:447)
weblogic.management.jmx.mbeanserver.WLSMBeanServerInterceptorBase.invoke(WLSMBeanServerInterceptorBase.java:441)
weblogic.management.mbeanservers.internal.SecurityMBeanMgmtOpsInterceptor.invoke(SecurityMBeanMgmtOpsInterceptor.java:55)
weblogic.management.jmx.mbeanserver.WLSMBeanServerInterceptorBase$16.run(WLSMBeanServerInterceptorBase.java:447)
weblogic.management.jmx.mbeanserver.WLSMBeanServerInterceptorBase.invoke(WLSMBeanServerInterceptorBase.java:441)
weblogic.management.mbeanservers.internal.SecurityInterceptor.invoke(SecurityInterceptor.java:437)
weblogic.management.mbeanservers.internal.AuthenticatedSubjectInterceptor$10$1.run(AuthenticatedSubjectInterceptor.java:582)
weblogic.management.mbeanservers.internal.AuthenticatedSubjectInterceptor$10.run(AuthenticatedSubjectInterceptor.java:576)
weblogic.security.acl.internal.AuthenticatedSubject.doAs(AuthenticatedSubject.java:350)
weblogic.management.mbeanservers.internal.AuthenticatedSubjectInterceptor.invoke(AuthenticatedSubjectInterceptor.java:570)
weblogic.management.jmx.mbeanserver.WLSMBeanServer.invoke(WLSMBeanServer.java:305)
javax.management.remote.rmi.RMIConnectionImpl.doOperation(RMIConnectionImpl.java:1378)
javax.management.remote.rmi.RMIConnectionImpl.access$200(RMIConnectionImpl.java:72)
javax.management.remote.rmi.RMIConnectionImpl$PrivilegedOperation.run(RMIConnectionImpl.java:1264)
javax.management.remote.rmi.RMIConnectionImpl.doPrivilegedOperation(RMIConnectionImpl.java:1338)
javax.management.remote.rmi.RMIConnectionImpl.invoke(RMIConnectionImpl.java:761)
javax.management.remote.rmi.RMIConnectionImpl_WLSkel.invoke(Unknown Source)
weblogic.rmi.internal.ServerRequest.sendReceive(ServerRequest.java:136)
weblogic.rmi.internal.BasicRemoteRef.invoke(BasicRemoteRef.java:211)
javax.management.remote.rmi.RMIConnectionImpl_1030_WLStub.invoke(Unknown Source)
javax.management.remote.rmi.RMIConnector$RemoteMBeanServerConnection.invoke(RMIConnector.java:969)
com.bea.diagnostics.server.MBeanServerUtil.processRecordsFromArchive(MBeanServerUtil.java:177)
com.bea.diagnostics.server.MetricEarliestTimestampLocator$RecordProcessorDesc.identifyEarliestTimestamps(MetricEarliestTimestampLocator.java:261)
com.bea.diagnostics.server.MetricEarliestTimestampLocator.identifyEarliestTimestamps(MetricEarliestTimestampLocator.java:84)
com.bea.diagnostics.server.MetricEarliestTimestampLocator.timerExpired(MetricEarliestTimestampLocator.java:79)
weblogic.timers.internal.TimerImpl.run(TimerImpl.java:253)
weblogic.work.SelfTuningWorkManagerImpl$WorkAdapterImpl.run(SelfTuningWorkManagerImpl.java:516)
weblogic.work.ExecuteThread.execute(ExecuteThread.java:198)
weblogic.work.ExecuteThread.run(ExecuteThread.java:165)
<Dec 21, 2009 12:24:04 AM EST> <Error> <JDBC> <BEA-001112> <Test "SELECT 1 FROM DUAL" set up for pool "MyPool" failed with exception: "java.sql.SQLRecoverableException: Io exception: Connection reset".>
<Dec 21, 2009 12:24:04 AM EST> <Warning> <JDBC> <BEA-001129> <Received exception while creating connection for pool "MyPool": Io exception: The Network Adapter could not establish the connection>
<Dec 21, 2009 12:24:04 AM EST> <Warning> <JDBC> <BEA-001129> <Received exception while creating connection for pool "MyPool": Io exception: The Network Adapter could not establish the connection>
<Dec 21, 2009 12:24:05 AM EST> <Warning> <JDBC> <BEA-001129> <Received exception while creating connection for pool "MyPool": Io exception: The Network Adapter could not establish the connection>
<Dec 21, 2009 12:24:07 AM EST> <Warning> <JDBC> <BEA-001129> <Received exception while creating connection for pool "MyPool": Io exception: The Network Adapter could not establish the connection>
<Dec 21, 2009 12:24:12 AM EST> <Warning> <JDBC> <BEA-001129> <Received exception while creating connection for pool "MyPool": Io exception: The Network Adapter could not establish the connection>
<Dec 21, 2009 12:24:17 AM EST> <Warning> <JDBC> <BEA-001129> <Received exception while creating connection for pool "MyPool": Io exception: The Network Adapter could not establish the connection>
<Dec 21, 2009 12:24:22 AM EST> <Warning> <JDBC> <BEA-001129> <Received exception while creating connection for pool "MyPool": Io exception: The Network Adapter could not establish the connection>

Weblogic server hangs during stress-testing -- possibly EJB deadlocks

Hi
While running stress tests on our application, our WLS 4.5.1 hangs even at a
mere load of 20 users. We are running on a Solaris machine. Database: Oracle
8.1.5, running on the same machine. Using oracle.jdbc.driver.OracleDriver as
the JDBC driver, and using JTS as the transaction manager.
When we did a thread dump (complete lis at the end of this post) and
basically we are seeing a bunch of our entity beans in a "locked" state. A
common pattern we see in the thread dumps is that
[1] weblogic.ejb.internal.BaseEJBContext.lock(BaseEJBContext.java:180)
[2] weblogic.ejb.internal.StatefulEJBCache.bind(StatefulEJBCache.java:250)
[3]
weblogic.ejb.internal.StatefulEJBObject.getContextForInvoke(StatefulEJBObjec
t.java:88)
[4] weblogic.ejb.internal.BaseEJBObject.preInvoke(BaseEJBObject.java:164)
[5] com.nps.ers.ejb.organization.<Our Entiy Bean>EOImpl.<a get
method>(ERSSystemConfigurationBeanEOImpl.java:1539)
[6] com.nps.ers.ejb.awardnomination.<Our entity bean>.<some method>
After more thorough studying of EJB transactions, we changed the isolation
level of all our beans from TRANSACTION_SERIALIZED to
TRANSACTION_READ_COMMITTED and made sure all our beans say TX_REQUIRED for
their transactionAttribue. Still, this problem persists.
The basic scenario we are load testing is that of multiple users logging
into the system and trying to access a particular user's record, and right
now, this is causing deadlocks at 20 users.
What we fail to understand is that --
(a) even if a method is attempting a read-only access to the data, why would
it try to obtain a lock? or why would it matter that the data is locked?
Some of the locks we are seeing are actually on a bean that is used for
read-only purposes.
(b) if 2 or more processes are trying to access the same record, based on
whichever process got their first, shouldn't one succeed, and the other go
into a 'waiting' state?
We have also opened this issue with weblogic support, and the response so
far has been that there "may" be a bug in weblogic 4.5.1 itself that's
causing it, and they need to look into it further. Other similar posts in
the newsgroup haven't been resolved either -- hence this general plea for
help. Please advise if you've any suggestions. Thanks
Sandeep
---------------------------Complete Thread Dump Listing -------------------
"HighPriority TimeEventGenerator" (TID:0x1488278, sys_thread_t:0x14881b8,
state:CW, thread_t: t@46, threadID:0xd9271dc8, stack_bottom:0xd9272000,
stack_size:0x20000) prio=9
[1] weblogic.time.common.internal.TimeTable.snooze(TimeTable.java:249)
[2]
weblogic.time.common.internal.TimeEventGenerator.run(TimeEventGenerator.java
:143)
[3] java.lang.Thread.run(Thread.java:479)
"SSLListenThread" (TID:0x1588220, sys_thread_t:0x1588160, state:R, thread_t:
t@45, threadID:0xd9321dc8, stack_bottom:0xd9322000, stack_size:0x20000)
prio=5
[1] java.net.PlainSocketImpl.socketAccept(Native Method)
[2] java.net.PlainSocketImpl.accept(PlainSocketImpl.java:406)
[3] java.net.ServerSocket.implAccept(ServerSocket.java:240)
[4] java.net.ServerSocket.accept(ServerSocket.java:224)
[5]
weblogic.security.SSL.SSLServerSocket.acceptNoHandshake(SSLServerSocket.java
:121)
[6] weblogic.security.SSL.SSLServerSocket.accept(SSLServerSocket.java:112)
[7] weblogic.t3.srvr.ListenThread.run(ListenThread.java:230)
"ListenThread" (TID:0x15f7d48, sys_thread_t:0x15f7c88, state:R, thread_t:
t@44, threadID:0xd92a1dc8, stack_bottom:0xd92a2000, stack_size:0x20000)
prio=5
[1] java.net.PlainSocketImpl.socketAccept(Native Method)
[2] java.net.PlainSocketImpl.accept(PlainSocketImpl.java:406)
[3] java.net.ServerSocket.implAccept(ServerSocket.java:238)
[4] java.net.ServerSocket.accept(ServerSocket.java:223)
[5] weblogic.t3.srvr.ListenThread.run(ListenThread.java:230)
"ExecuteThread-29" (TID:0xad1c90, sys_thread_t:0xad1bd0, state:CW, thread_t:
t@40, threadID:0xd94e1dc8, stack_bottom:0xd94e2000, stack_size:0x20000)
prio=5
[1] weblogic.ejb.internal.BaseEJBContext.lock(BaseEJBContext.java:180)
[2] weblogic.ejb.internal.StatefulEJBCache.bind(StatefulEJBCache.java:250)
[3]
weblogic.ejb.internal.StatefulEJBObject.getContextForInvoke(StatefulEJBObjec
t.java:88)
[4] weblogic.ejb.internal.BaseEJBObject.preInvoke(BaseEJBObject.java:164)
[5] com.nps.ers.ejb.user.UserBeanEOImpl.display(UserBeanEOImpl.java:1384)
[6]
com.nps.ers.ejb.awardnomination.AwardNominationBean.updatePointsUsed(AwardNo
minationBean.java:1530)
[7]
com.nps.ers.ejb.awardnomination.AwardNominationBean.nominate(AwardNomination
Bean.java:1279)
[8]
com.nps.ers.ejb.awardnomination.AwardNominationBeanEOImpl.nominate(AwardNomi
nationBeanEOImpl.java:282)
[9]
com.nps.ers.ejb.awardnomination.AwardNominationBeanEOImpl_ServiceStub.nomina
te(AwardNominationBeanEOImpl_ServiceStub.java:811)
[10]
com.nps.ers.servlet.AwardNominationRequest.nominate(AwardNominationRequest.j
ava:1339)
[11]
com.nps.ers.servlet.AwardNominationRequest.processNextPage(AwardNominationRe
quest.java:276)
[12]
com.nps.ers.servlet.AwardNominationRequest.getNextPage(AwardNominationReques
t.java:109)
[13] com.nps.common.servlet.BaseServlet.handleRequest(BaseServlet.java:245)
[14] com.nps.common.servlet.BaseServlet.doPost(BaseServlet.java:184)
[15] javax.servlet.http.HttpServlet.service(HttpServlet.java:708)
[16] javax.servlet.http.HttpServlet.service(HttpServlet.java:835)
[17]
weblogic.servlet.internal.ServletStubImpl.invokeServlet(ServletStubImpl.java
:75)
[18]
weblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletContextImp
l.java:259)
[19]
weblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletContextImp
l.java:244)
[20]
weblogic.socket.MuxableSocketHTTP.invokeServlet(MuxableSocketHTTP.java:353)
[21] weblogic.socket.MuxableSocketHTTP.execute(MuxableSocketHTTP.java:247)
[22] weblogic.t3.srvr.ExecuteThread.run(ExecuteThread.java:94)
"ExecuteThread-28" (TID:0xad1a78, sys_thread_t:0xad19b8, state:CW, thread_t:
t@39, threadID:0xd9511dc8, stack_bottom:0xd9512000, stack_size:0x20000)
prio=5
[1] weblogic.ejb.internal.BaseEJBContext.lock(BaseEJBContext.java:180)
[2] weblogic.ejb.internal.StatefulEJBCache.bind(StatefulEJBCache.java:250)
[3]
weblogic.ejb.internal.StatefulEJBObject.getContextForInvoke(StatefulEJBObjec
t.java:88)
[4] weblogic.ejb.internal.BaseEJBObject.preInvoke(BaseEJBObject.java:164)
[5]
com.nps.ers.ejb.organization.ERSSystemConfigurationBeanEOImpl.getEMTRoleId(E
RSSystemConfigurationBeanEOImpl.java:1539)
[6]
com.nps.ers.ejb.awardnomination.ApproverSelectionBean.checkEMT(ApproverSelec
tionBean.java:473)
[7]
com.nps.ers.ejb.awardnomination.ApproverSelectionBeanEOImpl.checkEMT(Approve
rSelectionBeanEOImpl.java:71)
[8]
com.nps.ers.ejb.awardnomination.ApproverSelectionBeanEOImpl_ServiceStub.chec
kEMT(ApproverSelectionBeanEOImpl_ServiceStub.java:501)
[9]
com.nps.ers.servlet.NortelApproverSelection.updateApproverList(NortelApprove
rSelection.java:87)
[10]
com.nps.ers.servlet.NortelApproverSelection.getApproverList(NortelApproverSe
lection.java:62)
[11]
com.nps.ers.servlet.AwardNominationRequest.getApprovers(AwardNominationReque
st.java:1412)
[12]
com.nps.ers.servlet.AwardNominationRequest.previewNominate(AwardNominationRe
quest.java:1096)
[13]
com.nps.ers.servlet.AwardNominationRequest.processNextPage(AwardNominationRe
quest.java:276)
[14]
com.nps.ers.servlet.AwardNominationRequest.getNextPage(AwardNominationReques
t.java:109)
[15] com.nps.common.servlet.BaseServlet.handleRequest(BaseServlet.java:245)
[16] com.nps.common.servlet.BaseServlet.doPost(BaseServlet.java:184)
[17] javax.servlet.http.HttpServlet.service(HttpServlet.java:708)
[18] javax.servlet.http.HttpServlet.service(HttpServlet.java:835)
[19]
weblogic.servlet.internal.ServletStubImpl.invokeServlet(ServletStubImpl.java
:75)
[20]
weblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletContextImp
l.java:259)
[21]
weblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletContextImp
l.java:244)
[22]
weblogic.socket.MuxableSocketHTTP.invokeServlet(MuxableSocketHTTP.java:353)
[23] weblogic.socket.MuxableSocketHTTP.execute(MuxableSocketHTTP.java:247)
[24] weblogic.t3.srvr.ExecuteThread.run(ExecuteThread.java:94)
"ExecuteThread-27" (TID:0xad1678, sys_thread_t:0xad15b8, state:CW, thread_t:
t@38, threadID:0xd9541dc8, stack_bottom:0xd9542000, stack_size:0x20000)
prio=5
[1] weblogic.ejb.internal.BaseEJBContext.lock(BaseEJBContext.java:180)
[2] weblogic.ejb.internal.StatefulEJBCache.bind(StatefulEJBCache.java:250)
[3]
weblogic.ejb.internal.StatefulEJBObject.getContextForInvoke(StatefulEJBObjec
t.java:88)
[4] weblogic.ejb.internal.BaseEJBObject.preInvoke(BaseEJBObject.java:164)
[5]
com.nps.ers.ejb.organization.ERSSystemConfigurationBeanEOImpl.getEMTRoleId(E
RSSystemConfigurationBeanEOImpl.java:1539)
[6]
com.nps.ers.ejb.awardnomination.ApproverSelectionBean.checkEMT(ApproverSelec
tionBean.java:473)
[7]
com.nps.ers.ejb.awardnomination.ApproverSelectionBeanEOImpl.checkEMT(Approve
rSelectionBeanEOImpl.java:71)
[8]
com.nps.ers.ejb.awardnomination.ApproverSelectionBeanEOImpl_ServiceStub.chec
kEMT(ApproverSelectionBeanEOImpl_ServiceStub.java:501)
[9]
com.nps.ers.servlet.NortelApproverSelection.updateApproverList(NortelApprove
rSelection.java:87)
[10]
com.nps.ers.servlet.NortelApproverSelection.getApproverList(NortelApproverSe
lection.java:62)
[11]
com.nps.ers.servlet.AwardNominationRequest.getApprovers(AwardNominationReque
st.java:1412)
[12]
com.nps.ers.servlet.AwardNominationRequest.previewNominate(AwardNominationRe
quest.java:1096)
[13]
com.nps.ers.servlet.AwardNominationRequest.processNextPage(AwardNominationRe
quest.java:276)
[14]
com.nps.ers.servlet.AwardNominationRequest.getNextPage(AwardNominationReques
t.java:109)
[15] com.nps.common.servlet.BaseServlet.handleRequest(BaseServlet.java:245)
[16] com.nps.common.servlet.BaseServlet.doPost(BaseServlet.java:184)
[17] javax.servlet.http.HttpServlet.service(HttpServlet.java:708)
[18] javax.servlet.http.HttpServlet.service(HttpServlet.java:835)
[19]
weblogic.servlet.internal.ServletStubImpl.invokeServlet(ServletStubImpl.java
:75)
[20]
weblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletContextImp
l.java:259)
[21]
weblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletContextImp
l.java:244)
[22]
weblogic.socket.MuxableSocketHTTP.invokeServlet(MuxableSocketHTTP.java:353)
[23] weblogic.socket.MuxableSocketHTTP.execute(MuxableSocketHTTP.java:247)
[24] weblogic.t3.srvr.ExecuteThread.run(ExecuteThread.java:94)
"ExecuteThread-26" (TID:0xac84e8, sys_thread_t:0xac8428, state:CW, thread_t:
t@37, threadID:0xd9571dc8, stack_bottom:0xd9572000, stack_size:0x20000)
prio=5
[1] weblogic.common.internal.DynaQueue.getW(DynaQueue.java:219)
[2] weblogic.socket.JavaSocketMuxer.processSockets(JavaSocketMuxer.java:212)
[3] weblogic.socket.SocketReaderRequest.execute(SocketReaderRequest.java:19)
[4] weblogic.t3.srvr.ExecuteThread.run(ExecuteThread.java:94)
"ExecuteThread-25" (TID:0xab7d50, sys_thread_t:0xab7c90, state:CW, thread_t:
t@36, threadID:0xd95a1dc8, stack_bottom:0xd95a2000, stack_size:0x20000)
prio=5
[1] weblogic.ejb.internal.BaseEJBContext.lock(BaseEJBContext.java:180)
[2] weblogic.ejb.internal.StatefulEJBCache.bind(StatefulEJBCache.java:250)
[3]
weblogic.ejb.internal.StatefulEJBObject.getContextForInvoke(StatefulEJBObjec
t.java:88)
[4] weblogic.ejb.internal.BaseEJBObject.preInvoke(BaseEJBObject.java:164)
[5]
com.nps.ers.ejb.organization.ERSSystemConfigurationBeanEOImpl.getEMTRoleId(E
RSSystemConfigurationBeanEOImpl.java:1539)
[6]
com.nps.ers.ejb.awardnomination.ApproverSelectionBean.checkEMT(ApproverSelec
tionBean.java:473)
[7]
com.nps.ers.ejb.awardnomination.ApproverSelectionBeanEOImpl.checkEMT(Approve
rSelectionBeanEOImpl.java:71)
[8]
com.nps.ers.ejb.awardnomination.ApproverSelectionBeanEOImpl_ServiceStub.chec
kEMT(ApproverSelectionBeanEOImpl_ServiceStub.java:501)
[9]
com.nps.ers.servlet.NortelApproverSelection.updateApproverList(NortelApprove
rSelection.java:87)
[10]
com.nps.ers.servlet.NortelApproverSelection.getApproverList(NortelApproverSe
lection.java:62)
[11]
com.nps.ers.servlet.AwardNominationRequest.getApprovers(AwardNominationReque
st.java:1412)
[12]
com.nps.ers.servlet.AwardNominationRequest.previewNominate(AwardNominationRe
quest.java:1096)
[13]
com.nps.ers.servlet.AwardNominationRequest.processNextPage(AwardNominationRe
quest.java:276)
[14]
com.nps.ers.servlet.AwardNominationRequest.getNextPage(AwardNominationReques
t.java:109)
[15] com.nps.common.servlet.BaseServlet.handleRequest(BaseServlet.java:245)
[16] com.nps.common.servlet.BaseServlet.doPost(BaseServlet.java:184)
[17] javax.servlet.http.HttpServlet.service(HttpServlet.java:708)
[18] javax.servlet.http.HttpServlet.service(HttpServlet.java:835)
[19]
weblogic.servlet.internal.ServletStubImpl.invokeServlet(ServletStubImpl.java
:75)
[20]
weblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletContextImp
l.java:259)
[21]
weblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletContextImp
l.java:244)
[22]
weblogic.socket.MuxableSocketHTTP.invokeServlet(MuxableSocketHTTP.java:353)
[23] weblogic.socket.MuxableSocketHTTP.execute(MuxableSocketHTTP.java:247)
[24] weblogic.t3.srvr.ExecuteThread.run(ExecuteThread.java:94)
"ExecuteThread-24" (TID:0xab9b60, sys_thread_t:0xab9aa0, state:CW, thread_t:
t@35, threadID:0xd95d1dc8, stack_bottom:0xd95d2000, stack_size:0x20000)
prio=5
[1] weblogic.common.internal.DynaQueue.getW(DynaQueue.java:219)
[2] weblogic.socket.JavaSocketMuxer.processSockets(JavaSocketMuxer.java:212)
[3] weblogic.socket.SocketReaderRequest.execute(SocketReaderRequest.java:19)
[4] weblogic.t3.srvr.ExecuteThread.run(ExecuteThread.java:94)
"ExecuteThread-23" (TID:0xab9948, sys_thread_t:0xab9888, state:CW, thread_t:
t@34, threadID:0xd9601dc8, stack_bottom:0xd9602000, stack_size:0x20000)
prio=5
[1] weblogic.ejb.internal.BaseEJBContext.lock(BaseEJBContext.java:180)
[2] weblogic.ejb.internal.StatefulEJBCache.bind(StatefulEJBCache.java:250)
[3]
weblogic.ejb.internal.StatefulEJBObject.getContextForInvoke(StatefulEJBObjec
t.java:88)
[4] weblogic.ejb.internal.BaseEJBObject.preInvoke(BaseEJBObject.java:164)
[5] com.nps.ers.ejb.user.UserBeanEOImpl.getUserId(UserBeanEOImpl.java:182)
[6]
com.nps.ers.ejb.login.LoginSessionBean.getUserStatus(LoginSessionBean.java:1
61)
[7]
com.nps.ers.ejb.login.LoginSessionBeanEOImpl.getUserStatus(LoginSessionBeanE
OImpl.java:212)
[8]
com.nps.ers.ejb.login.LoginSessionBeanEOImpl_ServiceStub.getUserStatus(Login
SessionBeanEOImpl_ServiceStub.java:554)
[9]
com.nps.ers.servlet.LoginRequest.processLoginRequest(LoginRequest.java:248)
[10] com.nps.ers.servlet.LoginRequest.getNextPage(LoginRequest.java:90)
[11] com.nps.common.servlet.BaseServlet.handleRequest(BaseServlet.java:245)
[12] com.nps.common.servlet.BaseServlet.doGet(BaseServlet.java:124)
[13] javax.servlet.http.HttpServlet.service(HttpServlet.java:708)
[14] javax.servlet.http.HttpServlet.service(HttpServlet.java:835)
[15]
weblogic.servlet.internal.ServletStubImpl.invokeServlet(ServletStubImpl.java
:75)
[16]
weblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletContextImp
l.java:259)
[17]
weblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletContextImp
l.java:244)
[18]
weblogic.socket.MuxableSocketHTTP.invokeServlet(MuxableSocketHTTP.java:353)
[19] weblogic.socket.MuxableSocketHTTP.execute(MuxableSocketHTTP.java:247)
[20] weblogic.t3.srvr.ExecuteThread.run(ExecuteThread.java:94)
"ExecuteThread-22" (TID:0xabcc20, sys_thread_t:0xabcb60, state:CW, thread_t:
t@33, threadID:0xd9631dc8, stack_bottom:0xd9632000, stack_size:0x20000)
prio=5
[1] weblogic.ejb.internal.BaseEJBContext.lock(BaseEJBContext.java:180)
[2] weblogic.ejb.internal.StatefulEJBCache.bind(StatefulEJBCache.java:250)
[3]
weblogic.ejb.internal.StatefulEJBObject.getContextForInvoke(StatefulEJBObjec
t.java:88)
[4] weblogic.ejb.internal.BaseEJBObject.preInvoke(BaseEJBObject.java:164)
[5]
com.nps.ers.ejb.organization.ERSSystemConfigurationBeanEOImpl.getEMTRoleId(E
RSSystemConfigurationBeanEOImpl.java:1539)
[6]
com.nps.ers.ejb.awardnomination.ApproverSelectionBean.checkEMT(ApproverSelec
tionBean.java:473)
[7]
com.nps.ers.ejb.awardnomination.ApproverSelectionBeanEOImpl.checkEMT(Approve
rSelectionBeanEOImpl.java:71)
[8]
com.nps.ers.ejb.awardnomination.ApproverSelectionBeanEOImpl_ServiceStub.chec
kEMT(ApproverSelectionBeanEOImpl_ServiceStub.java:501)
[9]
com.nps.ers.servlet.NortelApproverSelection.updateApproverList(NortelApprove
rSelection.java:87)
[10]
com.nps.ers.servlet.NortelApproverSelection.getApproverList(NortelApproverSe
lection.java:62)
[11]
com.nps.ers.servlet.AwardNominationRequest.getApprovers(AwardNominationReque
st.java:1412)
[12]
com.nps.ers.servlet.AwardNominationRequest.previewNominate(AwardNominationRe
quest.java:1096)
[13]
com.nps.ers.servlet.AwardNominationRequest.processNextPage(AwardNominationRe
quest.java:276)
[14]
com.nps.ers.servlet.AwardNominationRequest.getNextPage(AwardNominationReques
t.java:109)
[15] com.nps.common.servlet.BaseServlet.handleRequest(BaseServlet.java:245)
[16] com.nps.common.servlet.BaseServlet.doPost(BaseServlet.java:184)
[17] javax.servlet.http.HttpServlet.service(HttpServlet.java:708)
[18] javax.servlet.http.HttpServlet.service(HttpServlet.java:835)
[19]
weblogic.servlet.internal.ServletStubImpl.invokeServlet(ServletStubImpl.java
:75)
[20]
weblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletContextImp
l.java:259)
[21]
weblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletContextImp
l.java:244)
[22]
weblogic.socket.MuxableSocketHTTP.invokeServlet(MuxableSocketHTTP.java:353)
[23] weblogic.socket.MuxableSocketHTTP.execute(MuxableSocketHTTP.java:247)
[24] weblogic.t3.srvr.ExecuteThread.run(ExecuteThread.java:94)
"ExecuteThread-21" (TID:0xa9ccf0, sys_thread_t:0xa9cc30, state:CW, thread_t:
t@32, threadID:0xd9661dc8, stack_bottom:0xd9662000, stack_size:0x20000)
prio=5
[1] weblogic.common.internal.DynaQueue.getW(DynaQueue.java:219)
[2] weblogic.socket.JavaSocketMuxer.processSockets(JavaSocketMuxer.java:212)
[3] weblogic.socket.SocketReaderRequest.execute(SocketReaderRequest.java:19)
[4] weblogic.t3.srvr.ExecuteThread.run(ExecuteThread.java:94)
"ExecuteThread-20" (TID:0xab2550, sys_thread_t:0xab2490, state:R, thread_t:
t@31, threadID:0xd9691dc8, stack_bottom:0xd9692000, stack_size:0x20000)
prio=5
[1] java.net.SocketInputStream.socketRead(Native Method)
[2] java.net.SocketInputStream.read(SocketInputStream.java:85)
[3] weblogic.socket.JavaSocketMuxer.processSockets(JavaSocketMuxer.java:212)
[4] weblogic.socket.SocketReaderRequest.execute(SocketReaderRequest.java:19)
[5] weblogic.t3.srvr.ExecuteThread.run(ExecuteThread.java:94)
"ExecuteThread-19" (TID:0xa640c0, sys_thread_t:0xa64000, state:CW, thread_t:
t@30, threadID:0xd96c1dc8, stack_bottom:0xd96c2000, stack_size:0x20000)
prio=5
[1] weblogic.ejb.internal.BaseEJBContext.lock(BaseEJBContext.java:180)
[2] weblogic.ejb.internal.StatefulEJBCache.bind(StatefulEJBCache.java:250)
[3]
weblogic.ejb.internal.StatefulEJBObject.getContextForInvoke(StatefulEJBObjec
t.java:88)
[4] weblogic.ejb.internal.BaseEJBObject.preInvoke(BaseEJBObject.java:164)
[5] com.nps.ers.ejb.user.UserBeanEOImpl.display(UserBeanEOImpl.java:1384)
[6]
com.nps.ers.ejb.awardnomination.AwardNominationBean.updatePointsUsed(AwardNo
minationBean.java:1530)
[7]
com.nps.ers.ejb.awardnomination.AwardNominationBean.nominate(AwardNomination
Bean.java:1279)
[8]
com.nps.ers.ejb.awardnomination.AwardNominationBeanEOImpl.nominate(AwardNomi
nationBeanEOImpl.java:282)
[9]
com.nps.ers.ejb.awardnomination.AwardNominationBeanEOImpl_ServiceStub.nomina
te(AwardNominationBeanEOImpl_ServiceStub.java:811)
[10]
com.nps.ers.servlet.AwardNominationRequest.nominate(AwardNominationRequest.j
ava:1339)
[11]
com.nps.ers.servlet.AwardNominationRequest.processNextPage(AwardNominationRe
quest.java:276)
[12]
com.nps.ers.servlet.AwardNominationRequest.getNextPage(AwardNominationReques
t.java:109)
[13] com.nps.common.servlet.BaseServlet.handleRequest(BaseServlet.java:245)
[14] com.nps.common.servlet.BaseServlet.doPost(BaseServlet.java:184)
[15] javax.servlet.http.HttpServlet.service(HttpServlet.java:708)
[16] javax.servlet.http.HttpServlet.service(HttpServlet.java:835)
[17]
weblogic.servlet.internal.ServletStubImpl.invokeServlet(ServletStubImpl.java
:75)
[18]
weblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletContextImp
l.java:259)
[19]
weblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletContextImp
l.java:244)
[20]
weblogic.socket.MuxableSocketHTTP.invokeServlet(MuxableSocketHTTP.java:353)
[21] weblogic.socket.MuxableSocketHTTP.execute(MuxableSocketHTTP.java:247)
[22] weblogic.t3.srvr.ExecuteThread.run(ExecuteThread.java:94)
"ExecuteThread-18" (TID:0xa502d8, sys_thread_t:0xa50218, state:CW, thread_t:
t@29, threadID:0xd96f1dc8, stack_bottom:0xd96f2000, stack_size:0x20000)
prio=5
[1] weblogic.ejb.internal.BaseEJBContext.lock(BaseEJBContext.java:180)
[2] weblogic.ejb.internal.StatefulEJBCache.bind(StatefulEJBCache.java:250)
[3]
weblogic.ejb.internal.StatefulEJBObject.getContextForInvoke(StatefulEJBObjec
t.java:88)
[4] weblogic.ejb.internal.BaseEJBObject.preInvoke(BaseEJBObject.java:164)
[5]
com.nps.ers.ejb.organization.ERSSystemConfigurationBeanEOImpl.getCashWithinD
ays(ERSSystemConfigurationBeanEOImpl.java:1231)
[6]
com.nps.ers.ejb.awardnomination.AwardNominationBean.getAwardNominationNotifi
cationStates(AwardNominationBean.java:772)
[7]
com.nps.ers.ejb.awardnomination.AwardNominationBeanEOImpl.getAwardNomination
NotificationStates(AwardNominationBeanEOImpl.java:247)
[8]
com.nps.ers.ejb.awardnomination.AwardNominationBeanEOImpl_ServiceStub.getAwa
rdNominationNotificationStates(AwardNominationBeanEOImpl_ServiceStub.java:41
5)
[9]
com.nps.ers.servlet.AwardNominationRequest.nominate(AwardNominationRequest.j
ava:1339)
[10]
com.nps.ers.servlet.AwardNominationRequest.processNextPage(AwardNominationRe
quest.java:276)
[11]
com.nps.ers.servlet.AwardNominationRequest.getNextPage(AwardNominationReques
t.java:109)
[12] com.nps.common.servlet.BaseServlet.handleRequest(BaseServlet.java:245)
[13] com.nps.common.servlet.BaseServlet.doPost(BaseServlet.java:184)
[14] javax.servlet.http.HttpServlet.service(HttpServlet.java:708)
[15] javax.servlet.http.HttpServlet.service(HttpServlet.java:835)
[16]
weblogic.servlet.internal.ServletStubImpl.invokeServlet(ServletStubImpl.java
:75)
[17]
weblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletContextImp
l.java:259)
[18]
weblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletContextImp
l.java:244)
[19]
weblogic.socket.MuxableSocketHTTP.invokeServlet(MuxableSocketHTTP.java:353)
[20] weblogic.socket.MuxableSocketHTTP.execute(MuxableSocketHTTP.java:247)
[21] weblogic.t3.srvr.ExecuteThread.run(ExecuteThread.java:94)
"ExecuteThread-17" (TID:0xa242d8, sys_thread_t:0xa24218, state:CW, thread_t:
t@28, threadID:0xd9721dc8, stack_bottom:0xd9722000, stack_size:0x20000)
prio=5
[1] weblogic.ejb.internal.BaseEJBContext.lock(BaseEJBContext.java:180)
[2] weblogic.ejb.internal.StatefulEJBCache.bind(StatefulEJBCache.java:250)
[3]
weblogic.ejb.internal.StatefulEJBObject.getContextForInvoke(StatefulEJBObjec
t.java:88)
[4] weblogic.ejb.internal.BaseEJBObject.preInvoke(BaseEJBObject.java:164)
[5]
com.nps.ers.ejb.user.UserBeanEOImpl.getUserStatusCode(UserBeanEOImpl.java:22
77)
[6]
com.nps.ers.ejb.awardnomination.ApproverSelectionBean.getApprovers(ApproverS
electionBean.java:352)
[7]
com.nps.ers.ejb.awardnomination.ApproverSelectionBeanEOImpl.getApprovers(App
roverSelectionBeanEOImpl.java:140)
[8]
com.nps.ers.ejb.awardnomination.ApproverSelectionBeanEOImpl_ServiceStub.getA
pprovers(ApproverSelectionBeanEOImpl_ServiceStub.java:554)
[9]
com.nps.ers.servlet.ApproverSelection.getApproverList(ApproverSelection.java
:81)
[10]
com.nps.ers.servlet.NortelApproverSelection.getApproverList(NortelApproverSe
lection.java:62)
[11]
com.nps.ers.servlet.AwardNominationRequest.getApprovers(AwardNominationReque
st.java:1412)
[12]
com.nps.ers.servlet.AwardNominationRequest.previewNominate(AwardNominationRe
quest.java:1096)
[13]
com.nps.ers.servlet.AwardNominationRequest.processNextPage(AwardNominationRe
quest.java:276)
[14]
com.nps.ers.servlet.AwardNominationRequest.getNextPage(AwardNominationReques
t.java:109)
[15] com.nps.common.servlet.BaseServlet.handleRequest(BaseServlet.java:245)
[16] com.nps.common.servlet.BaseServlet.doPost(BaseServlet.java:184)
[17] javax.servlet.http.HttpServlet.service(HttpServlet.java:708)
[18] javax.servlet.http.HttpServlet.service(HttpServlet.java:835)
[19]
weblogic.servlet.internal.ServletStubImpl.invokeServlet(ServletStubImpl.java
:75)
[20]
weblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletContextImp
l.java:259)
[21]
weblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletContextImp
l.java:244)
[22]
weblogic.socket.MuxableSocketHTTP.invokeServlet(MuxableSocketHTTP.java:353)
[23] weblogic.socket.MuxableSocketHTTP.execute(MuxableSocketHTTP.java:247)
[24] weblogic.t3.srvr.ExecuteThread.run(ExecuteThread.java:94)
"ExecuteThread-16" (TID:0xaa0ed8, sys_thread_t:0xaa0e18, state:CW, thread_t:
t@27, threadID:0xd9751dc8, stack_bottom:0xd9752000, stack_size:0x20000)
prio=5
[1] weblogic.common.internal.DynaQueue.getW(DynaQueue.java:219)
[2] weblogic.socket.JavaSocketMuxer.processSockets(JavaSocketMuxer.java:212)
[3] weblogic.socket.SocketReaderRequest.execute(SocketReaderRequest.java:19)
[4] weblogic.t3.srvr.ExecuteThread.run(ExecuteThread.java:94)
"ExecuteThread-15" (TID:0xad0220, sys_thread_t:0xad0160, state:CW, thread_t:
t@26, threadID:0xd9781dc8, stack_bottom:0xd9782000, stack_size:0x20000)
prio=5
[1] weblogic.ejb.internal.BaseEJBContext.lock(BaseEJBContext.java:180)
[2] weblogic.ejb.internal.StatefulEJBCache.bind(StatefulEJBCache.java:250)
[3]
weblogic.ejb.internal.StatefulEJBObject.getContextForInvoke(StatefulEJBObjec
t.java:88)
[4] weblogic.ejb.internal.BaseEJBObject.preInvoke(BaseEJBObject.java:164)
[5] com.nps.ers.ejb.user.UserBeanEOImpl.getUserId(UserBeanEOImpl.java:182)
[6]
com.nps.ers.ejb.login.LoginSessionBean.getUserStatus(LoginSessionBean.java:1
61)
[7]
com.nps.ers.ejb.login.LoginSessionBeanEOImpl.getUserStatus(LoginSessionBeanE
OImpl.java:212)
[8]
com.nps.ers.ejb.login.LoginSessionBeanEOImpl_ServiceStub.getUserStatus(Login
SessionBeanEOImpl_ServiceStub.java:554)
[9]
com.nps.ers.servlet.LoginRequest.processLoginRequest(LoginRequest.java:248)
[10] com.nps.ers.servlet.LoginRequest.getNextPage(LoginRequest.java:90)
[11] com.nps.common.servlet.BaseServlet.handleRequest(BaseServlet.java:245)
[12] com.nps.common.servlet.BaseServlet.doGet(BaseServlet.java:124)
[13] javax.servlet.http.HttpServlet.service(HttpServlet.java:708)
[14] javax.servlet.http.HttpServlet.service(HttpServlet.java:835)
[15]
weblogic.servlet.internal.ServletStubImpl.invokeServlet(ServletStubImpl.java
:75)
[16]
weblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletContextImp
l.java:259)
[17]
weblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletContextImp
l.java:244)
[18]
weblogic.socket.MuxableSocketHTTP.invokeServlet(MuxableSocketHTTP.java:353)
[19] weblogic.socket.MuxableSocketHTTP.execute(MuxableSocketHTTP.java:247)
[20] weblogic.t3.srvr.ExecuteThread.run(ExecuteThread.java:94)
"ExecuteThread-14" (TID:0xa8f4c0, sys_thread_t:0xa8f400, state:CW, thread_t:
t@25, threadID:0xd97b1dc8, stack_bottom:0xd97b2000, stack_size:0x20000)
prio=5
[1] weblogic.ejb.internal.BaseEJBContext.lock(BaseEJBContext.java:180)
[2] weblogic.ejb.internal.StatefulEJBCache.bind(StatefulEJBCache.java:250)
[3]
weblogic.ejb.internal.StatefulEJBObject.getContextForInvoke(StatefulEJBObjec
t.java:88)
[4] weblogic.ejb.internal.BaseEJBObject.preInvoke(BaseEJBObject.java:164)
[5]
com.nps.ers.ejb.organization.ERSSystemConfigurationBeanEOImpl.getCashWithinD
ays(ERSSystemConfigurationBeanEOImpl.java:1231)
[6]
com.nps.ers.ejb.awardnomination.AwardNominationBean.getAwardNominationNotifi
cationStates(AwardNominationBean.java:772)
[7]
com.nps.ers.ejb.awardnomination.AwardNominationBeanEOImpl.getAwardNomination
NotificationStates(AwardNominationBeanEOImpl.java:247)
[8]
com.nps.ers.ejb.awardnomination.AwardNominationBeanEOImpl_ServiceStub.getAwa
rdNominationNotificationStates(AwardNominationBeanEOImpl_ServiceStub.java:41
5)
[9]
com.nps.ers.servlet.AwardNominationRequest.nominate(AwardNominationRequest.j
ava:1339)
[10]
com.nps.ers.servlet.AwardNominationRequest.processNextPage(AwardNominationRe
quest.java:276)
[11]
com.nps.ers.servlet.AwardNominationRequest.getNextPage(AwardNominationReques
t.java:109)
[12] com.nps.common.servlet.BaseServlet.handleRequest(BaseServlet.java:245)
[13] com.nps.common.servlet.BaseServlet.doPost(BaseServlet.java:184)
[14] javax.servlet.http.HttpServlet.service(HttpServlet.java:708)
[15] javax.servlet.http.HttpServlet.service(HttpServlet.java:835)
[16]
weblogic.servlet.internal.ServletStubImpl.invokeServlet(ServletStubImpl.java
:75)
[17]
weblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletContextImp
l.java:259)
[18]
weblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletContextImp
l.java:244)
[19]
weblogic.socket.MuxableSocketHTTP.invokeServlet(MuxableSocketHTTP.java:353)
[20] weblogic.socket.MuxableSocketHTTP.execute(MuxableSocketHTTP.java:247)
[21] weblogic.t3.srvr.ExecuteThread.run(ExecuteThread.java:94)
"ExecuteThread-13" (TID:0xa194f0, sys_thread_t:0xa19430, state:CW, thread_t:
t@24, threadID:0xd97e1dc8, stack_bottom:0xd97e2000, stack_size:0x20000)
prio=5
[1] weblogic.common.internal.DynaQueue.getW(DynaQueue.java:219)
[2] weblogic.socket.JavaSocketMuxer.processSockets(JavaSocketMuxer.java:212)
[3] weblogic.socket.SocketReaderRequest.execute(SocketReaderRequest.java:19)
[4] weblogic.t3.srvr.E

Can you post details on this instrumentation?
I know in the past when we ran into this type of problem, it took us a while
to think through and identify the problems.
Thanks,
Gary
Rob Woollen <[email protected]> wrote in message
news:[email protected]...
Generally this indicates a deadlock in the order that you access your
entity beans. Please follow-up with [email protected]. There is
some instrumentation that you can turn on to help spot why this is
occurring.
-- Rob
Sandeep Giri wrote:
Hi
While running stress tests on our application, our WLS 4.5.1 hangs even
at a
mere load of 20 users. We are running on a Solaris machine. Database:Oracle
8.1.5, running on the same machine. Usingoracle.jdbc.driver.OracleDriver as
the JDBC driver, and using JTS as the transaction manager.
When we did a thread dump (complete lis at the end of this post) and
basically we are seeing a bunch of our entity beans in a "locked" state.A
common pattern we see in the thread dumps is that
[1] weblogic.ejb.internal.BaseEJBContext.lock(BaseEJBContext.java:180)
[2]weblogic.ejb.internal.StatefulEJBCache.bind(StatefulEJBCache.java:250)
[3]
weblogic.ejb.internal.StatefulEJBObject.getContextForInvoke(StatefulEJBObjec
t.java:88)
[4]weblogic.ejb.internal.BaseEJBObject.preInvoke(BaseEJBObject.java:164)
[5] com.nps.ers.ejb.organization.<Our Entiy Bean>EOImpl.<a get
method>(ERSSystemConfigurationBeanEOImpl.java:1539)
[6] com.nps.ers.ejb.awardnomination.<Our entity bean>.<some method>
After more thorough studying of EJB transactions, we changed theisolation
level of all our beans from TRANSACTION_SERIALIZED to
TRANSACTION_READ_COMMITTED and made sure all our beans say TX_REQUIREDfor
their transactionAttribue. Still, this problem persists.
The basic scenario we are load testing is that of multiple users logging
into the system and trying to access a particular user's record, andright
now, this is causing deadlocks at 20 users.
What we fail to understand is that --
(a) even if a method is attempting a read-only access to the data, whywould
it try to obtain a lock? or why would it matter that the data is locked?
Some of the locks we are seeing are actually on a bean that is used for
read-only purposes.
(b) if 2 or more processes are trying to access the same record, basedon
whichever process got their first, shouldn't one succeed, and the othergo
into a 'waiting' state?
We have also opened this issue with weblogic support, and the responseso
far has been that there "may" be a bug in weblogic 4.5.1 itself that's
causing it, and they need to look into it further. Other similar postsin
the newsgroup haven't been resolved either -- hence this general pleafor
help. Please advise if you've any suggestions. Thanks
Sandeep
---------------------------Complete Thread DumpListing -------------------
>>
"HighPriority TimeEventGenerator" (TID:0x1488278,sys_thread_t:0x14881b8,
state:CW, thread_t: t@46, threadID:0xd9271dc8, stack_bottom:0xd9272000,
stack_size:0x20000) prio=9
[1] weblogic.time.common.internal.TimeTable.snooze(TimeTable.java:249)
[2]
weblogic.time.common.internal.TimeEventGenerator.run(TimeEventGenerator.java
:143)
[3] java.lang.Thread.run(Thread.java:479)
"SSLListenThread" (TID:0x1588220, sys_thread_t:0x1588160, state:R,thread_t:
t@45, threadID:0xd9321dc8, stack_bottom:0xd9322000, stack_size:0x20000)
prio=5
[1] java.net.PlainSocketImpl.socketAccept(Native Method)
[2] java.net.PlainSocketImpl.accept(PlainSocketImpl.java:406)
[3] java.net.ServerSocket.implAccept(ServerSocket.java:240)
[4] java.net.ServerSocket.accept(ServerSocket.java:224)
[5]
weblogic.security.SSL.SSLServerSocket.acceptNoHandshake(SSLServerSocket.java
:121)
[6]weblogic.security.SSL.SSLServerSocket.accept(SSLServerSocket.java:112)
[7] weblogic.t3.srvr.ListenThread.run(ListenThread.java:230)
"ListenThread" (TID:0x15f7d48, sys_thread_t:0x15f7c88, state:R,thread_t:
t@44, threadID:0xd92a1dc8, stack_bottom:0xd92a2000, stack_size:0x20000)
prio=5
[1] java.net.PlainSocketImpl.socketAccept(Native Method)
[2] java.net.PlainSocketImpl.accept(PlainSocketImpl.java:406)
[3] java.net.ServerSocket.implAccept(ServerSocket.java:238)
[4] java.net.ServerSocket.accept(ServerSocket.java:223)
[5] weblogic.t3.srvr.ListenThread.run(ListenThread.java:230)
"ExecuteThread-29" (TID:0xad1c90, sys_thread_t:0xad1bd0, state:CW,thread_t:
t@40, threadID:0xd94e1dc8, stack_bottom:0xd94e2000, stack_size:0x20000)
prio=5
[1] weblogic.ejb.internal.BaseEJBContext.lock(BaseEJBContext.java:180)
[2]weblogic.ejb.internal.StatefulEJBCache.bind(StatefulEJBCache.java:250)
[3]
weblogic.ejb.internal.StatefulEJBObject.getContextForInvoke(StatefulEJBObjec
t.java:88)
[4]weblogic.ejb.internal.BaseEJBObject.preInvoke(BaseEJBObject.java:164)
[5]com.nps.ers.ejb.user.UserBeanEOImpl.display(UserBeanEOImpl.java:1384)
[6]
com.nps.ers.ejb.awardnomination.AwardNominationBean.updatePointsUsed(AwardNo
minationBean.java:1530)
[7]
com.nps.ers.ejb.awardnomination.AwardNominationBean.nominate(AwardNomination
Bean.java:1279)
[8]
com.nps.ers.ejb.awardnomination.AwardNominationBeanEOImpl.nominate(AwardNomi
nationBeanEOImpl.java:282)
[9]
com.nps.ers.ejb.awardnomination.AwardNominationBeanEOImpl_ServiceStub.nomina
te(AwardNominationBeanEOImpl_ServiceStub.java:811)
[10]
com.nps.ers.servlet.AwardNominationRequest.nominate(AwardNominationRequest.j
ava:1339)
[11]
com.nps.ers.servlet.AwardNominationRequest.processNextPage(AwardNominationRe
quest.java:276)
[12]
com.nps.ers.servlet.AwardNominationRequest.getNextPage(AwardNominationReques
t.java:109)
[13]com.nps.common.servlet.BaseServlet.handleRequest(BaseServlet.java:245)
[14] com.nps.common.servlet.BaseServlet.doPost(BaseServlet.java:184)
[15] javax.servlet.http.HttpServlet.service(HttpServlet.java:708)
[16] javax.servlet.http.HttpServlet.service(HttpServlet.java:835)
[17]
weblogic.servlet.internal.ServletStubImpl.invokeServlet(ServletStubImpl.java
:75)
[18]
weblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletContextImp
l.java:259)
[19]
weblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletContextImp
l.java:244)
[20]
weblogic.socket.MuxableSocketHTTP.invokeServlet(MuxableSocketHTTP.java:353)
[21]weblogic.socket.MuxableSocketHTTP.execute(MuxableSocketHTTP.java:247)
[22] weblogic.t3.srvr.ExecuteThread.run(ExecuteThread.java:94)
"ExecuteThread-28" (TID:0xad1a78, sys_thread_t:0xad19b8, state:CW,thread_t:
t@39, threadID:0xd9511dc8, stack_bottom:0xd9512000, stack_size:0x20000)
prio=5
[1] weblogic.ejb.internal.BaseEJBContext.lock(BaseEJBContext.java:180)
[2]weblogic.ejb.internal.StatefulEJBCache.bind(StatefulEJBCache.java:250)
[3]
weblogic.ejb.internal.StatefulEJBObject.getContextForInvoke(StatefulEJBObjec
t.java:88)
[4]weblogic.ejb.internal.BaseEJBObject.preInvoke(BaseEJBObject.java:164)
[5]
com.nps.ers.ejb.organization.ERSSystemConfigurationBeanEOImpl.getEMTRoleId(E
RSSystemConfigurationBeanEOImpl.java:1539)
[6]
com.nps.ers.ejb.awardnomination.ApproverSelectionBean.checkEMT(ApproverSelec
tionBean.java:473)
[7]
com.nps.ers.ejb.awardnomination.ApproverSelectionBeanEOImpl.checkEMT(Approve
rSelectionBeanEOImpl.java:71)
[8]
com.nps.ers.ejb.awardnomination.ApproverSelectionBeanEOImpl_ServiceStub.chec
kEMT(ApproverSelectionBeanEOImpl_ServiceStub.java:501)
[9]
com.nps.ers.servlet.NortelApproverSelection.updateApproverList(NortelApprove
rSelection.java:87)
[10]
com.nps.ers.servlet.NortelApproverSelection.getApproverList(NortelApproverSe
lection.java:62)
[11]
com.nps.ers.servlet.AwardNominationRequest.getApprovers(AwardNominationReque
st.java:1412)
[12]
com.nps.ers.servlet.AwardNominationRequest.previewNominate(AwardNominationRe
quest.java:1096)
[13]
com.nps.ers.servlet.AwardNominationRequest.processNextPage(AwardNominationRe
quest.java:276)
[14]
com.nps.ers.servlet.AwardNominationRequest.getNextPage(AwardNominationReques
t.java:109)
[15]com.nps.common.servlet.BaseServlet.handleRequest(BaseServlet.java:245)
[16] com.nps.common.servlet.BaseServlet.doPost(BaseServlet.java:184)
[17] javax.servlet.http.HttpServlet.service(HttpServlet.java:708)
[18] javax.servlet.http.HttpServlet.service(HttpServlet.java:835)
[19]
weblogic.servlet.internal.ServletStubImpl.invokeServlet(ServletStubImpl.java
:75)
[20]
weblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletContextImp
l.java:259)
[21]
weblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletContextImp
l.java:244)
[22]
weblogic.socket.MuxableSocketHTTP.invokeServlet(MuxableSocketHTTP.java:353)
[23]weblogic.socket.MuxableSocketHTTP.execute(MuxableSocketHTTP.java:247)
[24] weblogic.t3.srvr.ExecuteThread.run(ExecuteThread.java:94)
"ExecuteThread-27" (TID:0xad1678, sys_thread_t:0xad15b8, state:CW,thread_t:
t@38, threadID:0xd9541dc8, stack_bottom:0xd9542000, stack_size:0x20000)
prio=5
[1] weblogic.ejb.internal.BaseEJBContext.lock(BaseEJBContext.java:180)
[2]weblogic.ejb.internal.StatefulEJBCache.bind(StatefulEJBCache.java:250)
[3]
weblogic.ejb.internal.StatefulEJBObject.getContextForInvoke(StatefulEJBObjec
t.java:88)
[4]weblogic.ejb.internal.BaseEJBObject.preInvoke(BaseEJBObject.java:164)
[5]
com.nps.ers.ejb.organization.ERSSystemConfigurationBeanEOImpl.getEMTRoleId(E
RSSystemConfigurationBeanEOImpl.java:1539)
[6]
com.nps.ers.ejb.awardnomination.ApproverSelectionBean.checkEMT(ApproverSelec
tionBean.java:473)
[7]
com.nps.ers.ejb.awardnomination.ApproverSelectionBeanEOImpl.checkEMT(Approve
rSelectionBeanEOImpl.java:71)
[8]
com.nps.ers.ejb.awardnomination.ApproverSelectionBeanEOImpl_ServiceStub.chec
kEMT(ApproverSelectionBeanEOImpl_ServiceStub.java:501)
[9]
com.nps.ers.servlet.NortelApproverSelection.updateApproverList(NortelApprove
rSelection.java:87)
[10]
com.nps.ers.servlet.NortelApproverSelection.getApproverList(NortelApproverSe
lection.java:62)
[11]
com.nps.ers.servlet.AwardNominationRequest.getApprovers(AwardNominationReque
st.java:1412)
[12]
com.nps.ers.servlet.AwardNominationRequest.previewNominate(AwardNominationRe
quest.java:1096)
[13]
com.nps.ers.servlet.AwardNominationRequest.processNextPage(AwardNominationRe
quest.java:276)
[14]
com.nps.ers.servlet.AwardNominationRequest.getNextPage(AwardNominationReques
t.java:109)
[15]com.nps.common.servlet.BaseServlet.handleRequest(BaseServlet.java:245)
[16] com.nps.common.servlet.BaseServlet.doPost(BaseServlet.java:184)
[17] javax.servlet.http.HttpServlet.service(HttpServlet.java:708)
[18] javax.servlet.http.HttpServlet.service(HttpServlet.java:835)
[19]
weblogic.servlet.internal.ServletStubImpl.invokeServlet(ServletStubImpl.java
:75)
[20]
weblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletContextImp
l.java:259)
[21]
weblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletContextImp
l.java:244)
[22]
weblogic.socket.MuxableSocketHTTP.invokeServlet(MuxableSocketHTTP.java:353)
[23]weblogic.socket.MuxableSocketHTTP.execute(MuxableSocketHTTP.java:247)
[24] weblogic.t3.srvr.ExecuteThread.run(ExecuteThread.java:94)
"ExecuteThread-26" (TID:0xac84e8, sys_thread_t:0xac8428, state:CW,thread_t:
t@37, threadID:0xd9571dc8, stack_bottom:0xd9572000, stack_size:0x20000)
prio=5
[1] weblogic.common.internal.DynaQueue.getW(DynaQueue.java:219)
[2]weblogic.socket.JavaSocketMuxer.processSockets(JavaSocketMuxer.java:212)
[3]weblogic.socket.SocketReaderRequest.execute(SocketReaderRequest.java:19)
[4] weblogic.t3.srvr.ExecuteThread.run(ExecuteThread.java:94)
"ExecuteThread-25" (TID:0xab7d50, sys_thread_t:0xab7c90, state:CW,thread_t:
t@36, threadID:0xd95a1dc8, stack_bottom:0xd95a2000, stack_size:0x20000)
prio=5
[1] weblogic.ejb.internal.BaseEJBContext.lock(BaseEJBContext.java:180)
[2]weblogic.ejb.internal.StatefulEJBCache.bind(StatefulEJBCache.java:250)
[3]
weblogic.ejb.internal.StatefulEJBObject.getContextForInvoke(StatefulEJBObjec
t.java:88)
[4]weblogic.ejb.internal.BaseEJBObject.preInvoke(BaseEJBObject.java:164)
[5]
com.nps.ers.ejb.organization.ERSSystemConfigurationBeanEOImpl.getEMTRoleId(E
RSSystemConfigurationBeanEOImpl.java:1539)
[6]
com.nps.ers.ejb.awardnomination.ApproverSelectionBean.checkEMT(ApproverSelec
tionBean.java:473)
[7]
com.nps.ers.ejb.awardnomination.ApproverSelectionBeanEOImpl.checkEMT(Approve
rSelectionBeanEOImpl.java:71)
[8]
com.nps.ers.ejb.awardnomination.ApproverSelectionBeanEOImpl_ServiceStub.chec
kEMT(ApproverSelectionBeanEOImpl_ServiceStub.java:501)
[9]
com.nps.ers.servlet.NortelApproverSelection.updateApproverList(NortelApprove
rSelection.java:87)
[10]
com.nps.ers.servlet.NortelApproverSelection.getApproverList(NortelApproverSe
lection.java:62)
[11]
com.nps.ers.servlet.AwardNominationRequest.getApprovers(AwardNominationReque
st.java:1412)
[12]
com.nps.ers.servlet.AwardNominationRequest.previewNominate(AwardNominationRe
quest.java:1096)
[13]
com.nps.ers.servlet.AwardNominationRequest.processNextPage(AwardNominationRe
quest.java:276)
[14]
com.nps.ers.servlet.AwardNominationRequest.getNextPage(AwardNominationReques
t.java:109)
[15]com.nps.common.servlet.BaseServlet.handleRequest(BaseServlet.java:245)
[16] com.nps.common.servlet.BaseServlet.doPost(BaseServlet.java:184)
[17] javax.servlet.http.HttpServlet.service(HttpServlet.java:708)
[18] javax.servlet.http.HttpServlet.service(HttpServlet.java:835)
[19]
weblogic.servlet.internal.ServletStubImpl.invokeServlet(ServletStubImpl.java
:75)
[20]
weblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletContextImp
l.java:259)
[21]
weblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletContextImp
l.java:244)
[22]
weblogic.socket.MuxableSocketHTTP.invokeServlet(MuxableSocketHTTP.java:353)
[23]weblogic.socket.MuxableSocketHTTP.execute(MuxableSocketHTTP.java:247)
[24] weblogic.t3.srvr.ExecuteThread.run(ExecuteThread.java:94)
"ExecuteThread-24" (TID:0xab9b60, sys_thread_t:0xab9aa0, state:CW,thread_t:
t@35, threadID:0xd95d1dc8, stack_bottom:0xd95d2000, stack_size:0x20000)
prio=5
[1] weblogic.common.internal.DynaQueue.getW(DynaQueue.java:219)
[2]weblogic.socket.JavaSocketMuxer.processSockets(JavaSocketMuxer.java:212)
[3]weblogic.socket.SocketReaderRequest.execute(SocketReaderRequest.java:19)
[4] weblogic.t3.srvr.ExecuteThread.run(ExecuteThread.java:94)
"ExecuteThread-23" (TID:0xab9948, sys_thread_t:0xab9888, state:CW,thread_t:
t@34, threadID:0xd9601dc8, stack_bottom:0xd9602000, stack_size:0x20000)
prio=5
[1] weblogic.ejb.internal.BaseEJBContext.lock(BaseEJBContext.java:180)
[2]weblogic.ejb.internal.StatefulEJBCache.bind(StatefulEJBCache.java:250)
[3]
weblogic.ejb.internal.StatefulEJBObject.getContextForInvoke(StatefulEJBObjec
t.java:88)
[4]weblogic.ejb.internal.BaseEJBObject.preInvoke(BaseEJBObject.java:164)
[5]com.nps.ers.ejb.user.UserBeanEOImpl.getUserId(UserBeanEOImpl.java:182)
[6]
com.nps.ers.ejb.login.LoginSessionBean.getUserStatus(LoginSessionBean.java:1
61)
[7]
com.nps.ers.ejb.login.LoginSessionBeanEOImpl.getUserStatus(LoginSessionBeanE
OImpl.java:212)
[8]
com.nps.ers.ejb.login.LoginSessionBeanEOImpl_ServiceStub.getUserStatus(Login
SessionBeanEOImpl_ServiceStub.java:554)
[9]
com.nps.ers.servlet.LoginRequest.processLoginRequest(LoginRequest.java:248)
[10] com.nps.ers.servlet.LoginRequest.getNextPage(LoginRequest.java:90)
[11]com.nps.common.servlet.BaseServlet.handleRequest(BaseServlet.java:245)
[12] com.nps.common.servlet.BaseServlet.doGet(BaseServlet.java:124)
[13] javax.servlet.http.HttpServlet.service(HttpServlet.java:708)
[14] javax.servlet.http.HttpServlet.service(HttpServlet.java:835)
[15]
weblogic.servlet.internal.ServletStubImpl.invokeServlet(ServletStubImpl.java
:75)
[16]
weblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletContextImp
l.java:259)
[17]
weblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletContextImp
l.java:244)
[18]
weblogic.socket.MuxableSocketHTTP.invokeServlet(MuxableSocketHTTP.java:353)
[19]weblogic.socket.MuxableSocketHTTP.execute(MuxableSocketHTTP.java:247)
[20] weblogic.t3.srvr.ExecuteThread.run(ExecuteThread.java:94)
"ExecuteThread-22" (TID:0xabcc20, sys_thread_t:0xabcb60, state:CW,thread_t:
t@33, threadID:0xd9631dc8, stack_bottom:0xd9632000, stack_size:0x20000)
prio=5
[1] weblogic.ejb.internal.BaseEJBContext.lock(BaseEJBContext.java:180)
[2]weblogic.ejb.internal.StatefulEJBCache.bind(StatefulEJBCache.java:250)
[3]
weblogic.ejb.internal.StatefulEJBObject.getContextForInvoke(StatefulEJBObjec
t.java:88)
[4]weblogic.ejb.internal.BaseEJBObject.preInvoke(BaseEJBObject.java:164)
[5]
com.nps.ers.ejb.organization.ERSSystemConfigurationBeanEOImpl.getEMTRoleId(E
RSSystemConfigurationBeanEOImpl.java:1539)
[6]
com.nps.ers.ejb.awardnomination.ApproverSelectionBean.checkEMT(ApproverSelec
tionBean.java:473)
[7]
com.nps.ers.ejb.awardnomination.ApproverSelectionBeanEOImpl.checkEMT(Approve
rSelectionBeanEOImpl.java:71)
[8]
com.nps.ers.ejb.awardnomination.ApproverSelectionBeanEOImpl_ServiceStub.chec
kEMT(ApproverSelectionBeanEOImpl_ServiceStub.java:501)
[9]
com.nps.ers.servlet.NortelApproverSelection.updateApproverList(NortelApprove
rSelection.java:87)
[10]
com.nps.ers.servlet.NortelApproverSelection.getApproverList(NortelApproverSe
lection.java:62)
[11]
com.nps.ers.servlet.AwardNominationRequest.getApprovers(AwardNominationReque
st.java:1412)
[12]
com.nps.ers.servlet.AwardNominationRequest.previewNominate(AwardNominationRe
quest.java:1096)
[13]
com.nps.ers.servlet.AwardNominationRequest.processNextPage(AwardNominationRe
quest.java:276)
[14]
com.nps.ers.servlet.AwardNominationRequest.getNextPage(AwardNominationReques
t.java:109)
[15]com.nps.common.servlet.BaseServlet.handleRequest(BaseServlet.java:245)
[16] com.nps.common.servlet.BaseServlet.doPost(BaseServlet.java:184)
[17] javax.servlet.http.HttpServlet.service(HttpServlet.java:708)
[18] javax.servlet.http.HttpServlet.service(HttpServlet.java:835)
[19]
weblogic.servlet.internal.ServletStubImpl.invokeServlet(ServletStubImpl.java
:75)
[20]
weblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletContextImp
l.java:259)
[21]
weblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletContextImp
l.java:244)
[22]
weblogic.socket.MuxableSocketHTTP.invokeServlet(MuxableSocketHTTP.java:353)
[23]weblogic.socket.MuxableSocketHTTP.execute(MuxableSocketHTTP.java:247)
[24] weblogic.t3.srvr.ExecuteThread.run(ExecuteThread.java:94)
"ExecuteThread-21" (TID:0xa9ccf0, sys_thread_t:0xa9cc30, state:CW,thread_t:
t@32, threadID:0xd9661dc8, stack_bottom:0xd9662000, stack_size:0x20000)
prio=5
[1] weblogic.common.internal.DynaQueue.getW(DynaQueue.java:219)
[2]weblogic.socket.JavaSocketMuxer.processSockets(JavaSocketMuxer.java:212)
[3]weblogic.socket.SocketReaderRequest.execute(SocketReaderRequest.java:19)
[4] weblogic.t3.srvr.ExecuteThread.run(ExecuteThread.java:94)
"ExecuteThread-20" (TID:0xab2550, sys_thread_t:0xab2490, state:R,thread_t:
t@31, threadID:0xd9691dc8, stack_bottom:0xd9692000, stack_size:0x20000)
prio=5
[1] java.net.SocketInputStream.socketRead(Native Method)
[2] java.net.SocketInputStream.read(SocketInputStream.java:85)
[3]weblogic.socket.JavaSocketMuxer.processSockets(JavaSocketMuxer.java:212)
[4]weblogic.socket.SocketReaderRequest.execute(SocketReaderRequest.java:19)
[5] weblogic.t3.srvr.ExecuteThread.run(ExecuteThread.java:94)
"ExecuteThread-19" (TID:0xa640c0, sys_thread_t:0xa64000, state:CW,thread_t:
t@30, threadID:0xd96c1dc8, stack_bottom:0xd96c2000, stack_size:0x20000)
prio=5
[1] weblogic.ejb.internal.BaseEJBContext.lock(BaseEJBContext.java:180)
[2]weblogic.ejb.internal.StatefulEJBCache.bind(StatefulEJBCache.java:250)
[3]
weblogic.ejb.internal.StatefulEJBObject.getContextForInvoke(StatefulEJBObjec
t.java:88)
[4]weblogic.ejb.internal.BaseEJBObject.preInvoke(BaseEJBObject.java:164)
[5]com.nps.ers.ejb.user.UserBeanEOImpl.display(UserBeanEOImpl.java:1384)
[6]
com.nps.ers.ejb.awardnomination.AwardNominationBean.updatePointsUsed(AwardNo
minationBean.java:1530)
[7]
com.nps.ers.ejb.awardnomination.AwardNominationBean.nominate(AwardNomination
Bean.java:1279)
[8]
com.nps.ers.ejb.awardnomination.AwardNominationBeanEOImpl.nominate(AwardNomi
nationBeanEOImpl.java:282)
[9]
com.nps.ers.ejb.awardnomination.AwardNominationBeanEOImpl_ServiceStub.nomina
te(AwardNominationBeanEOImpl_ServiceStub.java:811)
[10]
com.nps.ers.servlet.AwardNominationRequest.nominate(AwardNominationRequest.j
ava:1339)
[11]
com.nps.ers.servlet.AwardNominationRequest.processNextPage(AwardNominationRe
quest.java:276)
[12]
com.nps.ers.servlet.AwardNominationRequest.getNextPage(AwardNominationReques
t.java:109)
[13]com.nps.common.servlet.BaseServlet.handleRequest(BaseServlet.java:245)
[14] com.nps.common.servlet.BaseServlet.doPost(BaseServlet.java:184)
[15] javax.servlet.http.HttpServlet.service(HttpServlet.java:708)
[16] javax.servlet.http.HttpServlet.service(HttpServlet.java:835)
[17]
weblogic.servlet.internal.ServletStubImpl.invokeServlet(ServletStubImpl.java
:75)
[18]
weblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletContextImp
l.java:259)
[19]
weblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletContextImp
l.java:244)
[20]
weblogic.socket.MuxableSocketHTTP.invokeServlet(MuxableSocketHTTP.java:353)
[21]weblogic.socket.MuxableSocketHTTP.execute(MuxableSocketHTTP.java:247)
[22] weblogic.t3.srvr.ExecuteThread.run(ExecuteThread.java:94)
"ExecuteThread-18" (TID:0xa502d8, sys_thread_t:0xa50218, state:CW,thread_t:
t@29, threadID:0xd96f1dc8, stack_bottom:0xd96f2000, stack_size:0x20000)
prio=5
[1] weblogic.ejb.internal.BaseEJBContext.lock(BaseEJBContext.java:180)
[2]weblogic.ejb.internal.StatefulEJBCache.bind(StatefulEJBCache.java:250)
[3]
weblogic.ejb.internal.StatefulEJBObject.getContextForInvoke(StatefulEJBObjec
t.java:88)
[4]weblogic.ejb.internal.BaseEJBObject.preInvoke(BaseEJBObject.java:164)
[5]
com.nps.ers.ejb.organization.ERSSystemConfigurationBeanEOImpl.getCashWithinD
ays(ERSSystemConfigurationBeanEOImpl.java:1231)
[6]
com.nps.ers.ejb.awardnomination.AwardNominationBean.getAwardNominationNotifi
cationStates(AwardNominationBean.java:772)
[7]
com.nps.ers.ejb.awardnomination.AwardNominationBeanEOImpl.getAwardNomination
NotificationStates(AwardNominationBeanEOImpl.java:247)
[8]
com.nps.ers.ejb.awardnomination.AwardNominationBeanEOImpl_ServiceStub.getAwa
>>
rdNominationNotificationStates(AwardNominationBeanEOImpl_ServiceStub.java:41
5)
[9]
com.nps.ers.servlet.AwardNominationRequest.nominate(AwardNominationRequest.j
ava:1339)
[10]
com.nps.ers.servlet.AwardNominationRequest.processNextPage(AwardNominationRe
quest.java:276)
[11]
com.nps.ers.servlet.AwardNominationRequest.getNextPage(AwardNominationReques
t.java:109)
[12]com.nps.common.servlet.BaseServlet.handleRequest(BaseServlet.java:245)
[13] com.nps.common.servlet.BaseServlet.doPost(BaseServlet.java:184)
[14] javax.servlet.http.HttpServlet.service(HttpServlet.java:708)
[15] javax.servlet.http.HttpServlet.service(HttpServlet.java:835)
[16]
weblogic.servlet.internal.ServletStubImpl.invokeServlet(ServletStubImpl.java
:75)
[17]
weblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletContextImp
l.java:259)
[18]
weblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletContextImp
l.java:244)
[19]
weblogic.socket.MuxableSocketHTTP.invokeServlet(MuxableSocketHTTP.java:353)
[20]weblogic.socket.MuxableSocketHTTP.execute(MuxableSocketHTTP.java:247)
[21] weblogic.t3.srvr.ExecuteThread.run(ExecuteThread.java:94)
"ExecuteThread-17" (TID:0xa242d8, sys_thread_t:0xa24218, state:CW,thread_t:
t@28, threadID:0xd9721dc8, stack_bottom:0xd9722000, stack_size:0x20000)
prio=5
[1] weblogic.ejb.internal.BaseEJBContext.lock(BaseEJBContext.java:180)
[2]weblogic.ejb.internal.StatefulEJBCache.bind(StatefulEJBCache.java:250)
[3]
weblogic.ejb.internal.StatefulEJBObject.getContextForInvoke(StatefulEJBObjec
t.java:88)
[4]weblogic.ejb.internal.BaseEJBObject.preInvoke(BaseEJBObject.java:164)
[5]
com.nps.ers.ejb.user.UserBeanEOImpl.getUserStatusCode(UserBeanEOImpl.java:22
77)
[6]
com.nps.ers.ejb.awardnomination.ApproverSelectionBean.getApprovers(ApproverS
electionBean.java:352)
[7]
com.nps.ers.ejb.awardnomination.ApproverSelectionBeanEOImpl.getApprovers(App
roverSelectionBeanEOImpl.java:140)
[8]
com.nps.ers.ejb.awardnomination.ApproverSelectionBeanEOImpl_ServiceStub.getA
pprovers(ApproverSelectionBeanEOImpl_ServiceStub.java:554)
[9]
com.nps.ers.servlet.ApproverSelection.getApproverList(ApproverSelection.java
:81)
[10]
com.nps.ers.servlet.NortelApproverSelection.getApproverList(NortelApproverSe
lection.java:62)
[11]
com.nps.ers.servlet.AwardNominationRequest.getApprovers(AwardNominationReque
st.java:1412)
[12]
com.nps.ers.servlet.AwardNominationRequest.previewNominate(AwardNominationRe
quest.java:1096)
[13]
com.nps.ers.servlet.AwardNominationRequest.processNextPage(AwardNominationRe
quest.java:276)
[14]
com.nps.ers.servlet.AwardNominationRequest.getNextPage(AwardNominationReques
t.java:109)
[15]com.nps.common.servlet.BaseServlet.handleRequest(BaseServlet.java:245)
[16] com.nps.common.servlet.BaseServlet.doPost(BaseServlet.java:184)
[17] javax.servlet.http.HttpServlet.service(HttpServlet.java:708)
[18] javax.servlet.http.HttpServlet.service(HttpServlet.java:835)
[19]
weblogic.servlet.internal.ServletStubImpl.invokeServlet(ServletStubImpl.java
:75)
[20]
weblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletContextImp
l.java:259)
[21]
weblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletContextImp
l.java:244)
[22]
weblogic.socket.MuxableSocketHTTP.invokeServlet(MuxableSocketHTTP.java:353)
[23]weblogic.socket.MuxableSocketHTTP.execute(MuxableSocketHTTP.java:247)
[24] weblogic.t3.srvr.ExecuteThread.run(ExecuteThread.java:94)
"ExecuteThread-16" (TID:0xaa0ed8, sys_thread_t:0xaa0e18, state:CW,thread_t:
t@27, threadID:0xd9751dc8, stack_bottom:0xd9752000, stack_size:0x20000)
prio=5
[1] weblogic.common.internal.DynaQueue.getW(DynaQueue.java:219)
[2]weblogic.socket.JavaSocketMuxer.processSockets(JavaSocketMuxer.java:212)
[3]weblogic.socket.SocketReaderRequest.execute(SocketReaderRequest.java:19)
[4] weblogic.t3.srvr.ExecuteThread.run(ExecuteThread.java:94)
"ExecuteThread-15" (TID:0xad0220, sys_thread_t:0xad0160, state:CW,thread_t:
t@26, threadID:0xd9781dc8, stack_bottom:0xd9782000, stack_size:0x20000)
prio=5
[1] weblogic.ejb.internal.BaseEJBContext.lock(BaseEJBContext.java:180)
[2]weblogic.ejb.internal.StatefulEJBCache.bind(StatefulEJBCache.java:250)
[3]
weblogic.ejb.internal.StatefulEJBObject.getContextForInvoke(StatefulEJBObjec
t.java:88)
[4]weblogic.ejb.internal.BaseEJBObject.preInvoke(BaseEJBObject.java:164)
[5]com.nps.ers.ejb.user.UserBeanEOImpl.getUserId(UserBeanEOImpl.java:182)
[6]
com.nps.ers.ejb.login.LoginSessionBean.getUserStatus(LoginSessionBean.java:1
61)
[7]
com.nps.ers.ejb.login.LoginSessionBeanEOImpl.getUserStatus(LoginSessionBeanE
OImpl.java:212)
[8]
com.nps.ers.ejb.login.LoginSessionBeanEOImpl_ServiceStub.getUserStatus(Login
SessionBeanEOImpl_ServiceStub.java:554)
[9]
com.nps.ers.servlet.LoginRequest.processLoginRequest(LoginRequest.java:248)
[10] com.nps.ers.servlet.LoginRequest.getNextPage(LoginRequest.java:90)
[11]com.nps.common.servlet.BaseServlet.handleRequest(BaseServlet.java:245)
[12] com.nps.common.servlet.BaseServlet.doGet(BaseServlet.java:124)
[13] javax.servlet.http.HttpServlet.service(HttpServlet.java:708)
[14

Weblogic server hanged

Hi all,
we are using WLS 5.1 sp10 to deploy our RMI objects.
Inside our objects, we have a lot of database transactions.
After kicking off the server and running a lot of
database transactions, the server soon did not run
and just hanged in a certain database transactions.
But still, we can see the WLS doing its GC through the
AdminMain page, reclaiming the heap memory.
What would be the possible reason for that?
thanks!
cheers,
ken

You need to take a couple of thread dumps about 30 seconds or so apart
so that you can see exactly what the threads are doing. If you need
help interpreting these dumps, please post them here.
Kenneth Yue wrote:
Hi all,
we are using WLS 5.1 sp10 to deploy our RMI objects.
Inside our objects, we have a lot of database transactions.
After kicking off the server and running a lot of
database transactions, the server soon did not run
and just hanged in a certain database transactions.
But still, we can see the WLS doing its GC through the
AdminMain page, reclaiming the heap memory.
What would be the possible reason for that?
thanks!
cheers,
ken

Weblogic 7.0 Server hangs on Sun Solaris 5.7

Hi,
We are facing a problem with weblogic server 7.0 SP2 running on jre 1.3.1_01
Hotspot Client VM. The operating system used is SunOS 5.7 .
Symptom : The weblogic server hangs after running for around 8 to 10 hours . the
log file contains messages which says 'Connection created for Oracle Pool'

Hello,
Could you take a thread dump at that state?
kill -3 <pid of WLS>
Whats the state of the client application
- Exception (PeerGone, No Router)
- or just hangs
Also, you could run WLS using the JRE that ships with it. AFAIK, its v1.3.1_06.
rgds
MS

Weblogic server alway hang

OS: AIX 5.3
weblogic :10.3
jdk: ibm jdk1.6sr14
when this case was happened, I hava do patch CR370915 but this issue still exists.
I change weblogic version to 10.3 that this issue still exists.
i hava to see the havacore, as follows
Memory Segment Analysis
Memory Type
# of Segments
Used Memory(bytes)
Used Memory(%)
Free Memory(bytes)
Free Memory(%)
Total Memory(bytes)
Internal
160
0
0
11,287,080
100
11,287,080
Object(reserved)
1
3,221,225,472
100
0
0
3,221,225,472
Class
1,291
65,529,828
94.66
3,694,784
5.34
69,224,612
JIT Code Cache
1
5,319,648
63.42
3,068,960
36.58
8,388,608
JIT Data Cache
1
2,852,232
34
5,536,376
66
8,388,608
Overall
1,454
3,294,927,180
99.29
23,587,200
0.71
3,318,514,380
I want to know Object(reserved) =100%,how to fix it

Hi ,
In order to debug weblogic server hang issues, we need to gather atleast 4 to 5 thread dumps of the wls server that is hanging , exactly during the time of issue.
This will show us as to which thread is causing the issue and will help us to fix it.
WebLogic Server Support Pattern: Generic Server Hang (Doc ID 1264286.1)
Please go through the above document which helps you to do this.
Thanks,
Sharmela

Weblogic cluster hang!

Hi,
          I am using two cluster weblogic server(WLS 5.1,sp5,redhat 6.2),
          when one weblogic server hang,the other one also hang,but when I restart one
          server,the other one can work without restart.
          And the two weblogic hang every day,who can help me?
          Thanks.
          Jason Shi([email protected])


Thread dump will help.
          Jason wrote:
          > Hi,
          >
          > I am using two cluster weblogic server(WLS 5.1,sp5,redhat 6.2),
          > when one weblogic server hang,the other one also hang,but when I restart one
          > server,the other one can work without restart.
          > And the two weblogic hang every day,who can help me?
          > Thanks.
          >
          > Jason Shi([email protected])
          Cheers
          - Prasad

Thread are gettin stuck causing the WebLogic server to hang

We are developing an application for an US client which inclueds the following technology.
- WebLogic 9.2 JMS (Foreign Server, Queue, Connection Factor, persistent Store)
- Oracle 10g & Oracle 9i
- J2EE (MDB)
Different application uses different databases.
After the server run for a few day it is getting a stuck thread and reported the same as a Hogging Thread in server -> monitoring -> thread. At this point the server hangs and stopped working with the status in 'warning' state (in the same page itself).
The problem remains until the managed server is restarted.
We have taken thread dump of different times and one of the error that we have got is attached below:
"[STUCK] ExecuteThread: '0' for queue: 'weblogic.kernel.Default (self-tuning)'" waiting for lock weblogic.rjvm.ResponseImpl@1279315 WAITING
     java.lang.Object.wait(Native Method)
     weblogic.rjvm.ResponseImpl.waitForData(ResponseImpl.java:82)
     weblogic.rjvm.ResponseImpl.getTxContext(ResponseImpl.java:109)
     weblogic.messaging.dispatcher.DispatcherProxy.unmarshalResponse(DispatcherProxy.java:238)
     weblogic.messaging.dispatcher.DispatcherProxy.dispatchSyncTranFuture(DispatcherProxy.java:131)
     weblogic.messaging.dispatcher.DispatcherWrapperState.dispatchSyncTran(DispatcherWrapperState.java:241)
     weblogic.messaging.dispatcher.DispatcherWrapperState.dispatchSyncNoTran(DispatcherWrapperState.java:266)
     weblogic.jms.dispatcher.DispatcherAdapter.dispatchSyncNoTran(DispatcherAdapter.java:59)
     weblogic.jms.client.JMSProducer.toFEProducer(JMSProducer.java:1061)
     weblogic.jms.client.JMSProducer.deliveryInternal(JMSProducer.java:670)
     weblogic.jms.client.JMSProducer.sendInternal(JMSProducer.java:455)
     weblogic.jms.client.JMSProducer.send(JMSProducer.java:337)
     weblogic.jms.client.WLProducerImpl.send(WLProducerImpl.java:966)
     com.ctb.dex.messagehost.InputMessageListener.onMessage(Unknown Source)
     weblogic.ejb.container.internal.MDListener.execute(MDListener.java:429)
     weblogic.ejb.container.internal.MDListener.transactionalOnMessage(MDListener.java:335)
     weblogic.ejb.container.internal.MDListener.onMessage(MDListener.java:291)
     weblogic.jms.client.JMSSession.onMessage(JMSSession.java:4072)
     weblogic.jms.client.JMSSession.execute(JMSSession.java:3962)
     weblogic.jms.client.JMSSession$UseForRunnable.run(JMSSession.java:4490)
     weblogic.work.ServerWorkManagerImpl$WorkAdapterImpl.run(ServerWorkManagerImpl.java:518)
     weblogic.work.ExecuteThread.execute(ExecuteThread.java:209)
     weblogic.work.ExecuteThread.run(ExecuteThread.java:181)
Any body has any idea why this is happening? Please let me know in case you need to know more about the problem. Mail me at [email protected].

Tom, we are experiencing the similar stuck thread max time out errors on our weblogic server(weblogic 8.1 sp5). Below is the thread dump:
Blocked lock chains
===================
Chain 4:
"ExecuteThread: '1' for queue: 'weblogic.socket.Muxer'" id=101 idx=0xca tid=19298 waiting for java/lang/String@0x9c1fb10 held by:
"ExecuteThread: '2' for queue: 'weblogic.socket.Muxer'" id=102 idx=0xcc tid=19299 in chain 3
Open lock chains
================
Chain 1:
"ExecuteThread: '33' for queue: 'weblogic.kernel.Default'" id=62 idx=0x80 tid=19223 waiting for java/lang/String@0xbd00b10 held by:
"ExecuteThread: '3' for queue: 'weblogic.kernel.Default'" id=32 idx=0x44 tid=19192 (waiting on notification)
Chain 2:
"ExecuteThread: '45' for queue: 'weblogic.kernel.Default'" id=74 idx=0x98 tid=19235 waiting for java/lang/String@0x1d1083a8 held by:
"ExecuteThread: '11' for queue: 'weblogic.kernel.Default'" id=40 idx=0x54 tid=19200 (waiting on notification)
Chain 3:
"ExecuteThread: '0' for queue: 'weblogic.socket.Muxer'" id=100 idx=0xc8 tid=19297 waiting for java/lang/String@0x9c1fb10 held by:
"ExecuteThread: '2' for queue: 'weblogic.socket.Muxer'" id=102 idx=0xcc tid=19299 (active)
Can you help us in resolving the issue? This causes the weblogic server to hung and eventually non responsive.
Below are our java version details:
java version "1.4.2_13"
Java(TM) 2 Runtime Environment, Standard Edition (build 1.4.2_13-b06)
Java HotSpot(TM) Client VM (build 1.4.2_13-b06, mixed mode)
Can you let me know how to proceed and what can be done to avoid this issue?
Thanks a bunch Tom.
Regards
RV

Server Hangs while compiling some EJB in Weblogic 6.1 SP5 on AIX 4.3.3

Hi,
Iam not able to deploy a J2EE application in WebLogic 6.1 SP5 on an AIX 4.3.3
box.
CMP is being used and my EJBs are not being compiled( though there are no errors
thrown).
Iam using IBM DB2 ver 8.0 DB as client and server.
While compiling, the server Hangs, displaying the message "<Info> <Management>
<Configuration changes for domain saved to the repository.>"
Is there any configuration Issues with weblogic 6.1 SP5 and AIX 4.3.3?
Because the same EAR works in SP3.
Please help ASAP.
Thanks in advance.
Nagesh

The only thing to do again with "hangs" is to take thread dumps. As for why
things are going wrong...... I am at a loss other than some AIX weirdness.
Cheers
mbg
"Deshpande" <[email protected]> wrote in message
news:[email protected]...
>
Hi Mark,
I tried it out ....I ran EJBC on all my EJB's and then tried to deploy myapplication.
Application got deployed and the server was up, but JSP's dosent getcompiled(
i.e when I want to run my application, my server hangs again).
I tried one more option.. I pointed my JAVAHOME in startweblogic.sh to anSP3
JDK .. and it worked!! Now with this JDK Iam able to deploy my entireapplication
( with out precompiled) also run through the application without anyproblems.
I then over wrote the existing JDK ( of SP5 ) with that of SP3 and thentried.
Which also works fentastically!!!
I can feel something fishy here ....
Any help in this regard is most welcome.
Thanks and Regards...
Nagesh
"Mark Griffith" <[email protected]> wrote:
Deshpande:
"Deshpande" <[email protected]> wrote in message
news:[email protected]...
Hi Mark,
Thanks again.
For
Q1> How much time was between the two dumps?
A1> There was a minute gap B/w the two dumps. ( since it took so longto
write
the Core)
Q2> How long have you waited with no progress seeming to be made?
A1> Over a whole night. ( appx 14 hours).
Now I believe you would have figured out what the problem is.Not sure if this is a statement saying you think I have figured it out,
or a
statement saying you think I should have figured it out but I haven't.
Anyway... Did you try running ejbc on the "app" first?
Meanwhile also it would be great, if you would tell me the proceduresto
get support
form the BEA and AIX to solve the Issue.
http://www.bea.com/framework.jsp?CNT=index.htm&FP=/content/services/custome
r_support/contacts/
>>
I would suggest sending as much detail as possible, including zips of
the
thread dumps and pointers to this newsgroup conversation [email protected]
>>
I do however suggest you first try running ejbc.
Cheers
mbg
Thanks in advance.
R
Deshpande.
"Mark Griffith" <[email protected]> wrote:
Nagesh:
Wow, AXI outputs some interesting thread dumps. ;)
So the interesting thread (and the problem) is:
"main" (TID:0x300C41D8, sys_thread_t:0x30010A60, state:CW, native
ID:0x1)
prio=5
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:429)
at java.lang.UNIXProcess.waitFor(UNIXProcess.java:130)
at weblogic.utils.Executable.exec(Executable.java(Compiled Code))
at weblogic.utils.Executable.exec(Executable.java(Inlined CompiledCode))
at
weblogic.utils.compiler.CompilerInvoker.compileMaybeExit(CompilerInvoker.j
a
v
a(Compiled Code))
at
weblogic.utils.compiler.CompilerInvoker.compile(CompilerInvoker.java(Inlin
e
d
Compiled Code))
at
weblogic.ejb20.ejbc.EJBCompiler.compileEJB(EJBCompiler.java(Compiled
Code))
at weblogic.ejb20.deployer.Deployer.runEJBC(Deployer.java(InlinedCompiled
Code))
at weblogic.ejb20.deployer.Deployer.compileEJB(Deployer.java(Compiled
Code))
at weblogic.ejb20.deployer.Deployer.deploy(Deployer.java(CompiledCode))
at weblogic.j2ee.EJBComponent.deploy(EJBComponent.java:33)
at weblogic.j2ee.Application.addComponent(Application.java:176)
at weblogic.j2ee.J2EEService.addDeployment(J2EEService.java:117)
at
weblogic.management.mbeans.custom.DeploymentTarget.addDeployment(Deploymen
t
T
arget.java(Compiled Code))
at
weblogic.management.mbeans.custom.DeploymentTarget.addDeployments(Deployme
n
t
Target.java:286)
at
weblogic.management.mbeans.custom.DeploymentTarget.updateServerDeployments
D
eploymentTarget.java:239)
at
weblogic.management.mbeans.custom.DeploymentTarget.updateDeployments(Deplo
y
m
entTarget.java:199)
at java.lang.reflect.Method.invoke(Native Method)
at
weblogic.management.internal.DynamicMBeanImpl.invokeLocally(DynamicMBeanIm
p
l
..java(Compiled Code))
at
weblogic.management.internal.DynamicMBeanImpl.invoke(DynamicMBeanImpl.java
C
ompiled Code))
at
weblogic.management.internal.ConfigurationMBeanImpl.invoke(ConfigurationMB
e
a
nImpl.java:374)
atcom.sun.management.jmx.MBeanServerImpl.invoke(MBeanServerImpl.java:1557)
atcom.sun.management.jmx.MBeanServerImpl.invoke(MBeanServerImpl.java:1525)
atweblogic.management.internal.MBeanProxy.invoke(MBeanProxy.java(Compiled
Code))
atweblogic.management.internal.MBeanProxy.invoke(MBeanProxy.java(Compiled
Code))
at $Proxy34.updateDeployments(Unknown Source)
at
weblogic.management.configuration.ServerMBean_CachingStub.updateDeployment
s
ServerMBean_CachingStub.java:3015)
at
weblogic.management.mbeans.custom.ApplicationManager.startConfigManager(Ap
p
l
icationManager.java:376)
at
weblogic.management.mbeans.custom.ApplicationManager.start(ApplicationMana
g
e
r.java:164)
at java.lang.reflect.Method.invoke(Native Method)
at
weblogic.management.internal.DynamicMBeanImpl.invokeLocally(DynamicMBeanIm
p
l
..java(Compiled Code))
at
weblogic.management.internal.DynamicMBeanImpl.invoke(DynamicMBeanImpl.java
C
ompiled Code))
at
weblogic.management.internal.ConfigurationMBeanImpl.invoke(ConfigurationMB
e
a
nImpl.java:374)
atcom.sun.management.jmx.MBeanServerImpl.invoke(MBeanServerImpl.java:1557)
atcom.sun.management.jmx.MBeanServerImpl.invoke(MBeanServerImpl.java:1525)
atweblogic.management.internal.MBeanProxy.invoke(MBeanProxy.java(Compiled
Code))
atweblogic.management.internal.MBeanProxy.invoke(MBeanProxy.java(Compiled
Code))
at $Proxy48.start(Unknown Source)
at
weblogic.management.configuration.ApplicationManagerMBean_CachingStub.star
t
ApplicationManagerMBean_CachingStub.java:480)
at weblogic.management.Admin.startApplicationManager(Admin.java:1309)
at weblogic.management.Admin.finish(Admin.java:650)
at weblogic.t3.srvr.T3Srvr.start(T3Srvr.java:547)
at weblogic.t3.srvr.T3Srvr.run(T3Srvr.java:214)
at weblogic.Server.main(Server.java:35)
So the Server never gets out of the Main thread to run, because theEJBC
compilation is "stuck", ejbc is running because either the EJB being
deployed was previously deployed on a different version of WLS orejbc
had
never been run on those beans. Either there is a problem on the AIX
VM
where execing processes are not returning, OR the ejb that ejbc isrunning
on is huge and is taking a REALLY long time. How much time was
between
the
two dumps? How long have you waited with no progress seeming to bemade?
Depending on the answers to these questions it maybe that there isa
VM bug
and you will need to contact BEA support to see the procedure forworking
with AIX to resolve the issue.
You maybe able to work around the problem by running EJBC on the ejb
in
question prior to starting the server.
http://edocs.bea.com/wls/docs61/ejb/EJB_utilities.html#1075296
Cheers
mbg
"deshpande" <[email protected]> wrote in message
news:[email protected]...
Hi, Mark,
Thanks for the early reply.
I have attached two consecutive dumps Zipped.
Pls look into the same and helpme out.
Thanks in advance.
Regards,
Nagesh
"Mark Griffith" <[email protected]> wrote:
When it hangs, you need to get thread dumps.
"kill -3 PID" is how this works on Solaris. Additionally if the
terminal/shell has focus that started the process you can do "CTRL
Break"
as
well. The thread dumps will go to std-out/err, so you'll have
to
redierect
std-out and err of the shell. (Make sure you don't nohup the
process
(if
AIX even supports that) since this prevents sigquits). When thehang
occurs
take a thread dump, wait 10 seconds and take another one, thenplease
zip
and attach the file in a post.
Cheers
mbg
"Deshpande" <[email protected]> wrote in message
news:[email protected]...
Hi,
Iam not able to deploy a J2EE application in WebLogic 6.1 SP5
on
an
AIX
4.3.3
box.
CMP is being used and my EJBs are not being compiled( though
there
are no
errors
thrown).
Iam using IBM DB2 ver 8.0 DB as client and server.
While compiling, the server Hangs, displaying the message "<Info><Management>
<Configuration changes for domain saved to the repository.>"
Is there any configuration Issues with weblogic 6.1 SP5 and AIX
4.3.3?
Because the same EAR works in SP3.
Please help ASAP.
Thanks in advance.
Nagesh

Hanging Weblogic Server

Hi,
we have a J2EE application using an Oracle 8.1.7
database, Oracle thin JDBC driver and WLS 5.1 running on
a Tru64 WLS cluster.
The entire Weblogic Server is hanging (!!!) after a database
reconnect.
The problem occurs when a EJB selects data from the database and
the database is going down and the application server is trying
to reconnect.
If there is no database activity in the moment of the database
reconnect, the application works fine
(the server is not hanging).
The application only reads (select) data from the database,
no inserts/updates/deletes.
We are using a database connect pool (initial 10, increment 10,
max 30 connections, testConnsOnReserve=true,
testConnsOnRelease=false, refreshTestMinutes=1).
The problem is independend from
a) The operating System
(We tested Tru64 UNIX V4.0e, V4.0f and W2K SP2.)
b) the java version
(We tested on Tru64 UNIX V1.2.2-6 with and without
Compaq fast VM V1.2.2-4, V1.3.1-1 and V1.3.1-2 with fast
VM, on W2K V1.2.2 and V1.3.1)
c) the Oracle thin driver
(We tested an older one and the current version
for Oracle V8.1.7 - downloaded last week from Oracle.
I dont know the detailled version.
All files are named
classes12.jar or classes12_01.jar)
d) the Oracle minor version
(We tested Oracle V8.1.7.0, V8.1.7.2 and V8.1.7.3)
e) WLS as a single server application or
and all combinations from a) b) c) d) and e)
(It was a lot of work to test it !!!)
But the problem depends on the Weblogic Server service pack.
a) With WLS SP7 we have no problem.
b) With WLS SP9 and SP11 the entire application server is
hanging.
But we need WLS SP9 or higher with the bugfixing for
CR 31604: Fixed a bug where EJBs with large Primary Keys
caused OutOfMemoryErrors.
Any Idea.
Thanks in Advance.
Regards
Uwe Seyfert

Hi. Are you sure you've editted the startWebLogic script
to add the latest oracle driver zip ahead of all the weblogic stuff
in the weblogic.classpath, not the java.classpath? Can we see
a thread dump of the server when it hangs?
thanks,
joe
Uwe Seyfert wrote:
Hi,
we have a J2EE application using an Oracle 8.1.7
database, Oracle thin JDBC driver and WLS 5.1 running on
a Tru64 WLS cluster.
The entire Weblogic Server is hanging (!!!) after a database
reconnect.
The problem occurs when a EJB selects data from the database and
the database is going down and the application server is trying
to reconnect.
If there is no database activity in the moment of the database
reconnect, the application works fine
(the server is not hanging).
The application only reads (select) data from the database,
no inserts/updates/deletes.
We are using a database connect pool (initial 10, increment 10,
max 30 connections, testConnsOnReserve=true,
testConnsOnRelease=false, refreshTestMinutes=1).
The problem is independend from
a) The operating System
(We tested Tru64 UNIX V4.0e, V4.0f and W2K SP2.)
b) the java version
(We tested on Tru64 UNIX V1.2.2-6 with and without
Compaq fast VM V1.2.2-4, V1.3.1-1 and V1.3.1-2 with fast
VM, on W2K V1.2.2 and V1.3.1)
c) the Oracle thin driver
(We tested an older one and the current version
for Oracle V8.1.7 - downloaded last week from Oracle.
I dont know the detailled version.
All files are named
classes12.jar or classes12_01.jar)
d) the Oracle minor version
(We tested Oracle V8.1.7.0, V8.1.7.2 and V8.1.7.3)
e) WLS as a single server application or
and all combinations from a) b) c) d) and e)
(It was a lot of work to test it !!!)
But the problem depends on the Weblogic Server service pack.
a) With WLS SP7 we have no problem.
b) With WLS SP9 and SP11 the entire application server is
hanging.
But we need WLS SP9 or higher with the bugfixing for
CR 31604: Fixed a bug where EJBs with large Primary Keys
caused OutOfMemoryErrors.
Any Idea.
Thanks in Advance.
Regards
Uwe Seyfert

Weblogic server 5.1 goes to hang within an hour

I have the problem with weblogic server 5.1 that it goes to hang within around
an hour. There is no obvious error or exceptions shown in the weblogic log.
But at the time the weblogic server is hanging, I just observed from the weblogic
console GUI that once a user logon to the web application (the web server is iPlanet
6.0), the number of bean in cache of the corresponding stateful session bean increases
one but does not drop. Every single logon makes an increment 1 to the # of the
bean in cache of the corresponding session bean but no dropping.
What the session bean does is actually obtain a connection from the weblogic server
and get data from database. I went down to the database (Sybase ASE 11.9) at
the hanging time but did not see any long-running process nor table blocking that
may hinder the database response time. I do not understand what the session bean
was waiting for.
The only hints that I have is the below error message which was found in the iPlanet
web server log. Anyone please help to tell me what the problem can be?
Error found in iPlanet web server
============================
[03/Jun/2003:02:51:26] failure ( 381): Error receiving connection (No process
is on the other end of the pipe.)

Thanks, Rob.
I will try and see if it helps. Thanks again.
Rob Woollen <[email protected]> wrote:
Thanks for the thread dump.
Yes, DriverManager is the problem. Unfortunately this class is
well-known for causing deadlocks.
You really do not ever want to use DriverManager.getConnection from
code that runs in the server. Instead, you should define a TxDataSource
for your connection pool and use DataSource.getConnection.
I would recommend you lookup the DataSource in your stateless session
bean's ejbCreate method and store the DataSource in a member variable.
Your methods can call DataSource.getConnection when they need a JDBC
connection.
-- Rob
Carol wrote:
Rob,
I got the same symptom with weblogic server 6.1 today and I got thethread dump
for it this time. I read through the log and I wonder if the methodcall from
"java.sql.DriverManager.println" led to the hanging problem.
I attach the thread dump for your reference.
Do you have any advice? Thanks in advance.
"Carol" <[email protected]> wrote:
Rob,
Thanks for your advice firstly.
I am not able to reproduce the problem at this moment so I do not have
the thread
dump for review. But I did take a look at the Queue Length in the
WL
console
GUI at the time hanging and I found it kept to be 0 or 1. Also, the
heap size
was just about 60%.
But I have missed out one thing in my previous post. Besides the stateful
session
bean, another stateless session bean was used at the time user logon.
And the
stateless session bean just behaved the same as what the stateful one
did at the
time the WL was hanging, i.e. its "bean in cache" increased one when
a user tried
to logon.
What else shall I look into in order to find out the root cause?
Rob Woollen <[email protected]> wrote:
Take a thread dump (or several) when the server is hung. If you can't
figure out the problem from that, post the thread dump here, and we'll
have a look.
-- Rob
Carol wrote:
I have the problem with weblogic server 5.1 that it goes to hang
within
around
an hour. There is no obvious error or exceptions shown in the weblogiclog.
But at the time the weblogic server is hanging, I just observed fromthe weblogic
console GUI that once a user logon to the web application (the webserver is iPlanet
6.0), the number of bean in cache of the corresponding stateful sessionbean increases
one but does not drop. Every single logon makes an increment 1 tothe # of the
bean in cache of the corresponding session bean but no dropping.
What the session bean does is actually obtain a connection from theweblogic server
and get data from database. I went down to the database (Sybase
ASE
11.9) at
the hanging time but did not see any long-running process nor tableblocking that
may hinder the database response time. I do not understand what
the
session bean
was waiting for.
The only hints that I have is the below error message which was foundin the iPlanet
web server log. Anyone please help to tell me what the problem canbe?
Error found in iPlanet web server
============================
[03/Jun/2003:02:51:26] failure ( 381): Error receiving connection(No process
is on the other end of the pipe.)
Full thread dump:
"HighPriority TimeEventGenerator" daemon prio=9 tid=0x6ef920 nid=0x77waiting on monitor [0xaf681000..0xaf6819d8]
     at java.lang.Object.wait(Native Method)
     at weblogic.time.common.internal.TimeTable.snooze(TimeTable.java:279)
     at weblogic.time.common.internal.TimeEventGenerator.run(TimeEventGenerator.java:138)
     at java.lang.Thread.run(Thread.java:484)
"SSLListenThread" prio=5 tid=0x88e860 nid=0x76 runnable [0xafd81000..0xafd819d8]
     at java.net.PlainSocketImpl.socketAccept(Native Method)
     at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:468)
     at java.net.ServerSocket.implAccept(ServerSocket.java:243)
     at java.net.ServerSocket.accept(ServerSocket.java:222)
     at weblogic.security.SSL.SSLServerSocket.acceptNoHandshake(SSLServerSocket.java:126)
     at weblogic.security.SSL.SSLServerSocket.accept(SSLServerSocket.java:117)
     at weblogic.t3.srvr.ListenThread.run(ListenThread.java:255)
"ListenThread" prio=5 tid=0x88e110 nid=0x75 runnable [0xaf781000..0xaf7819d8]
     at java.net.PlainSocketImpl.socketAccept(Native Method)
     at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:468)
     at java.net.ServerSocket.implAccept(ServerSocket.java:243)
     at java.net.ServerSocket.accept(ServerSocket.java:222)
     at weblogic.t3.srvr.ListenThread.run(ListenThread.java:255)
"GC Daemon" daemon prio=2 tid=0x724590 nid=0x72 waiting on monitor[0xaff81000..0xaff819d8]
     at java.lang.Object.wait(Native Method)
     at sun.misc.GC$Daemon.run(GC.java:103)
"RMI RenewClean-[127.0.0.1:55045]" daemon prio=5 tid=0x724460 nid=0x71waiting on monitor [0xb0581000..0xb05819d8]
     at java.lang.Object.wait(Native Method)
     at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:108)
     at sun.rmi.transport.DGCClient$EndpointEntry$RenewCleanThread.run(DGCClient.java:495)
     at java.lang.Thread.run(Thread.java:484)
"ExecuteThread: '14' for queue: 'JmsDispatcher'" daemon prio=5 tid=0xe9160nid=0x6e waiting on monitor [0xb0781000..0xb07819d8]
     at java.lang.Object.wait(Native Method)
     at java.lang.Object.wait(Object.java:420)
     at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:94)
     at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:118)
"ExecuteThread: '13' for queue: 'JmsDispatcher'" daemon prio=5 tid=0xe8678nid=0x6d waiting on monitor [0xb0881000..0xb08819d8]
     at java.lang.Object.wait(Native Method)
     at java.lang.Object.wait(Object.java:420)
     at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:94)
     at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:118)
"ExecuteThread: '12' for queue: 'JmsDispatcher'" daemon prio=5 tid=0xe7ca8nid=0x6c waiting on monitor [0xb0981000..0xb09819d8]
     at java.lang.Object.wait(Native Method)
     at java.lang.Object.wait(Object.java:420)
     at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:94)
     at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:118)
"ExecuteThread: '11' for queue: 'JmsDispatcher'" daemon prio=5 tid=0x3b6498nid=0x6b waiting on monitor [0xb0a81000..0xb0a819d8]
     at java.lang.Object.wait(Native Method)
     at java.lang.Object.wait(Object.java:420)
     at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:94)
     at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:118)
"ExecuteThread: '10' for queue: 'JmsDispatcher'" daemon prio=5 tid=0x3b59b0nid=0x6a waiting on monitor [0xb0b81000..0xb0b819d8]
     at java.lang.Object.wait(Native Method)
     at java.lang.Object.wait(Object.java:420)
     at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:94)
     at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:118)
"ExecuteThread: '9' for queue: 'JmsDispatcher'" daemon prio=5 tid=0x3b4ec8nid=0x69 waiting on monitor [0xb0c81000..0xb0c819d8]
     at java.lang.Object.wait(Native Method)
     at java.lang.Object.wait(Object.java:420)
     at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:94)
     at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:118)
"ExecuteThread: '8' for queue: 'JmsDispatcher'" daemon prio=5 tid=0x3b43e0nid=0x68 waiting on monitor [0xb0d81000..0xb0d819d8]
     at java.lang.Object.wait(Native Method)
     at java.lang.Object.wait(Object.java:420)
     at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:94)
     at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:118)
"ExecuteThread: '7' for queue: 'JmsDispatcher'" daemon prio=5 tid=0x3b38f8nid=0x67 waiting on monitor [0xb0e81000..0xb0e819d8]
     at java.lang.Object.wait(Native Method)
     at java.lang.Object.wait(Object.java:420)
     at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:94)
     at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:118)
"ExecuteThread: '6' for queue: 'JmsDispatcher'" daemon prio=5 tid=0x3b2e10nid=0x66 waiting on monitor [0xb0f81000..0xb0f819d8]
     at java.lang.Object.wait(Native Method)
     at java.lang.Object.wait(Object.java:420)
     at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:94)
     at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:118)
"ExecuteThread: '5' for queue: 'JmsDispatcher'" daemon prio=5 tid=0x3b10d8nid=0x65 waiting on monitor [0xb1081000..0xb10819d8]
     at java.lang.Object.wait(Native Method)
     at java.lang.Object.wait(Object.java:420)
     at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:94)
     at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:118)
"ExecuteThread: '4' for queue: 'JmsDispatcher'" daemon prio=5 tid=0x3b05f0nid=0x64 waiting on monitor [0xb1181000..0xb11819d8]
     at java.lang.Object.wait(Native Method)
     at java.lang.Object.wait(Object.java:420)
     at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:94)
     at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:118)
"ExecuteThread: '3' for queue: 'JmsDispatcher'" daemon prio=5 tid=0x3b1c50nid=0x63 waiting on monitor [0xb1281000..0xb12819d8]
     at java.lang.Object.wait(Native Method)
     at java.lang.Object.wait(Object.java:420)
     at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:94)
     at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:118)
"ExecuteThread: '2' for queue: 'JmsDispatcher'" daemon prio=5 tid=0x3b1aa8nid=0x62 waiting on monitor [0xb1381000..0xb13819d8]
     at java.lang.Object.wait(Native Method)
     at java.lang.Object.wait(Object.java:420)
     at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:94)
     at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:118)
"ExecuteThread: '1' for queue: 'JmsDispatcher'" daemon prio=5 tid=0x3b1900nid=0x61 waiting on monitor [0xb1481000..0xb14819d8]
     at java.lang.Object.wait(Native Method)
     at java.lang.Object.wait(Object.java:420)
     at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:94)
     at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:118)
"ExecuteThread: '0' for queue: 'JmsDispatcher'" daemon prio=5 tid=0x3b13d0nid=0x60 waiting on monitor [0xb1581000..0xb15819d8]
     at java.lang.Object.wait(Native Method)
     at java.lang.Object.wait(Object.java:420)
     at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:94)
     at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:118)
"ExecuteThread: '2' for queue: 'weblogic.transaction.AsyncQueue'" daemonprio=5 tid=0x2e9e18 nid=0x5f waiting on monitor [0xb1681000..0xb16819d8]
     at java.lang.Object.wait(Native Method)
     at java.lang.Object.wait(Object.java:420)
     at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:94)
     at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:118)
"ExecuteThread: '1' for queue: 'weblogic.transaction.AsyncQueue'" daemonprio=5 tid=0x2e8160 nid=0x5e waiting on monitor [0xb1781000..0xb17819d8]
     at java.lang.Object.wait(Native Method)
     at java.lang.Object.wait(Object.java:420)
     at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:94)
     at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:118)
"ExecuteThread: '0' for queue: 'weblogic.transaction.AsyncQueue'" daemonprio=5 tid=0x2e98e8 nid=0x5d waiting on monitor [0xb1881000..0xb18819d8]
     at java.lang.Object.wait(Native Method)
     at java.lang.Object.wait(Object.java:420)
     at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:94)
     at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:118)
"ExecuteThread: '9' for queue: '__weblogic_admin_rmi_queue'" daemonprio=5 tid=0x553848 nid=0x5c waiting on monitor [0xb1981000..0xb19819d8]
     at java.lang.Object.wait(Native Method)
     at java.lang.Object.wait(Object.java:420)
     at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:94)
     at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:118)
"ExecuteThread: '8' for queue: '__weblogic_admin_rmi_queue'" daemonprio=5 tid=0x552d60 nid=0x5b waiting on monitor [0xb1a81000..0xb1a819d8]
     at java.lang.Object.wait(Native Method)
     at java.lang.Object.wait(Object.java:420)
     at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:94)
     at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:118)
"ExecuteThread: '7' for queue: '__weblogic_admin_rmi_queue'" daemonprio=5 tid=0x5522f0 nid=0x5a waiting on monitor [0xb1b81000..0xb1b819d8]
     at java.lang.Object.wait(Native Method)
     at java.lang.Object.wait(Object.java:420)
     at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:94)
     at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:118)
"ExecuteThread: '6' for queue: '__weblogic_admin_rmi_queue'" daemonprio=5 tid=0x4f0150 nid=0x59 waiting on monitor [0xb1c81000..0xb1c819d8]
     at java.lang.Object.wait(Native Method)
     at java.lang.Object.wait(Object.java:420)
     at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:94)
     at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:118)
"ExecuteThread: '5' for queue: '__weblogic_admin_rmi_queue'" daemonprio=5 tid=0x4f0f18 nid=0x58 waiting on monitor [0xb1d81000..0xb1d819d8]
     at java.lang.Object.wait(Native Method)
     at java.lang.Object.wait(Object.java:420)
     at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:94)
     at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:118)
"ExecuteThread: '4' for queue: '__weblogic_admin_rmi_queue'" daemonprio=5 tid=0x4f0d48 nid=0x57 waiting on monitor [0xb1e81000..0xb1e819d8]
     at java.lang.Object.wait(Native Method)
     at java.lang.Object.wait(Object.java:420)
     at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:94)
     at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:118)
"ExecuteThread: '3' for queue: '__weblogic_admin_rmi_queue'" daemonprio=5 tid=0x541870 nid=0x56 waiting on monitor [0xb1f81000..0xb1f819d8]
     at java.lang.Object.wait(Native Method)
     at java.lang.Object.wait(Object.java:420)
     at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:94)
     at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:118)
"ExecuteThread: '2' for queue: '__weblogic_admin_rmi_queue'" daemonprio=5 tid=0x548ac8 nid=0x55 waiting on monitor [0xb2081000..0xb20819d8]
     at java.lang.Object.wait(Native Method)
     at java.lang.Object.wait(Object.java:420)
     at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:94)
     at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:118)
"ExecuteThread: '1' for queue: '__weblogic_admin_rmi_queue'" daemonprio=5 tid=0x547390 nid=0x54 waiting on monitor [0xb2181000..0xb21819d8]
     at java.lang.Object.wait(Native Method)
     at java.lang.Object.wait(Object.java:420)
     at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:94)
     at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:118)
"ExecuteThread: '0' for queue: '__weblogic_admin_rmi_queue'" daemonprio=5 tid=0x5414c8 nid=0x53 waiting on monitor [0xb2281000..0xb22819d8]
     at java.lang.Object.wait(Native Method)
     at java.lang.Object.wait(Object.java:420)
     at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:94)
     at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:118)
"ExecuteThread: '1' for queue: '__weblogic_admin_html_queue'" daemonprio=5 tid=0x4f3d60 nid=0x52 waiting on monitor [0xb2381000..0xb23819d8]
     at java.lang.Object.wait(Native Method)
     at java.lang.Object.wait(Object.java:420)
     at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:94)
     at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:118)
"ExecuteThread: '0' for queue: '__weblogic_admin_html_queue'" daemonprio=5 tid=0x5469c0 nid=0x51 waiting on monitor [0xb2481000..0xb24819d8]
     at java.lang.Object.wait(Native Method)
     at java.lang.Object.wait(Object.java:420)
     at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:94)
     at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:118)
"TimeEventGenerator" daemon prio=5 tid=0x4f0378 nid=0x50 waiting onmonitor [0xb2581000..0xb25819d8]
     at java.lang.Object.wait(Native Method)
     at weblogic.time.common.internal.TimeTable.snooze(TimeTable.java:279)
     at weblogic.time.common.internal.TimeEventGenerator.run(TimeEventGenerator.java:138)
     at java.lang.Thread.run(Thread.java:484)
"TimeEventGenerator" daemon prio=5 tid=0x542270 nid=0x4f waiting onmonitor [0xb2681000..0xb26819d8]
     at java.lang.Object.wait(Native Method)
     at weblogic.time.common.internal.TimeTable.snooze(TimeTable.java:279)
     at weblogic.time.common.internal.TimeEventGenerator.run(TimeEventGenerator.java:138)
     at java.lang.Thread.run(Thread.java:484)
"SpinnerRandomSource" daemon prio=5 tid=0x4f2ba0 nid=0x4e waiting onmonitor [0xb2781000..0xb27819d8]
     at java.lang.Object.wait(Native Method)
     at java.lang.Object.wait(Object.java:420)
     at weblogic.security.SpinnerRandomBitsSource.run(SpinnerRandomBitsSource.java:57)
     at java.lang.Thread.run(Thread.java:484)
"ExecuteThread: '64' for queue: 'default'" daemon prio=5 tid=0x4ee2c8nid=0x4d waiting for monitor entry [0xb2881000..0xb28819d8]
     at weblogic.jdbc.jts.Connection.internalRollback(Connection.java:673)
     at weblogic.jdbc.jts.Connection.rollback(Connection.java:431)
     at weblogic.transaction.internal.ServerResourceInfo.rollback(ServerResourceInfo.java:1226)
     at weblogic.transaction.internal.ServerResourceInfo.rollback(ServerResourceInfo.java:545)
     at weblogic.transaction.internal.ServerSCInfo.startRollback(ServerSCInfo.java:372)
     at weblogic.transaction.internal.ServerTransactionImpl.localRollback(ServerTransactionImpl.java:1419)
     at weblogic.transaction.internal.ServerTransactionImpl.globalRollback(ServerTransactionImpl.java:2012)
     at weblogic.transaction.internal.TransactionImpl$1.execute(TransactionImpl.java:1559)
     at weblogic.kernel.ExecuteThread.execute(ExecuteThread.java:137)
     at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:120)
"ExecuteThread: '63' for queue: 'default'" daemon prio=5 tid=0x4ed7e0nid=0x4c waiting for monitor entry [0xb2981000..0xb29819d8]
     at weblogic.socket.PosixSocketMuxer.processSockets(PosixSocketMuxer.java:371)
     at weblogic.socket.SocketReaderRequest.execute(SocketReaderRequest.java:24)
     at weblogic.kernel.ExecuteThread.execute(ExecuteThread.java:137)
     at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:120)
"ExecuteThread: '62' for queue: 'default'" daemon prio=5 tid=0x4eccf8nid=0x4b waiting for monitor entry [0xb2a80000..0xb2a819d8]
     at java.sql.DriverManager.getConnection(DriverManager.java:144)
     at com.xxxxx.infra.db.ejb.weblogic.DBAccess.<init>(DBAccess.java:79)
     at com.xxxxx.infra.db.ejb.weblogic.DBAccess.<init>(DBAccess.java:96)
     at com.xxxxx.infra.ffff.agent.ppppoo.ppppooBean.init(ppppooBean.java:141)
     at com.xxxxx.infra.ffff.agent.ppppoo.ppppooBean.ejbCreate(ppppooBean.java:121)
     at com.xxxxx.infra.ffff.agent.ppppoo.ppppooBean_9cncmc_Impl.ejbCreate(ppppooBean_9cncmc_Impl.java:112)
     at java.lang.reflect.Method.invoke(Native Method)
     at weblogic.ejb20.pool.StatelessSessionPool.createBean(StatelessSessionPool.java:148)
     at weblogic.ejb20.pool.StatelessSessionPool.getBean(StatelessSessionPool.java:112)
     at weblogic.ejb20.manager.StatelessManager.preInvoke(StatelessManager.java:160)
     at weblogic.ejb20.internal.BaseEJBObject.preInvoke(BaseEJBObject.java:117)
     at weblogic.ejb20.internal.StatelessEJBObject.preInvoke(StatelessEJBObject.java:63)
     at com.xxxxx.infra.ffff.agent.ppppoo.ppppooBean_9cncmc_EOImpl.startRequest(ppppooBean_9cncmc_EOImpl.java:26)
     at com.xxxxx.infra.ffff.agent.ffffShellRequest.ffffShellRequestBean.executeRequest(ffffShellRequestBean.java:326)
     at com.xxxxx.infra.ffff.agent.ffffShellRequest.ffffShellRequestBean.startRequest(ffffShellRequestBean.java:104)
     at com.xxxxx.infra.ffff.agent.ffffShellRequest.ffffShellRequestBean_7gya1w_EOImpl.startRequest(ffffShellRequestBean_7gya1w_EOImpl.java:37)
     at com.xxxxx.infra.ffff.agent.ffffShellRequest.ffffShellRequestBean_7gya1w_EOImpl_WLSkel.invoke(UnknownSource)
     at weblogic.rmi.internal.BasicServerRef.invoke(BasicServerRef.java:288)
     at weblogic.rmi.cluster.ReplicaAwareServerRef.invoke(ReplicaAwareServerRef.java:93)
     at weblogic.rmi.internal.BasicServerRef.handleRequest(BasicServerRef.java:257)
     at weblogic.rmi.internal.BasicExecuteRequest.execute(BasicExecuteRequest.java:22)
     at weblogic.kernel.ExecuteThread.execute(ExecuteThread.java:137)
     at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:120)
"ExecuteThread: '61' for queue: 'default'" daemon prio=5 tid=0x4eb3f8nid=0x4a runnable [0xb2b81000..0xb2b819d8]
     at weblogic.socket.PosixSocketMuxer.poll(Native Method)
     at weblogic.socket.PosixSocketMuxer.processSockets(PosixSocketMuxer.java:371)
     at weblogic.socket.SocketReaderRequest.execute(SocketReaderRequest.java:24)
     at weblogic.kernel.ExecuteThread.execute(ExecuteThread.java:137)
     at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:120)
"ExecuteThread: '60' for queue: 'default'" daemon prio=5 tid=0x4ea910nid=0x49 waiting for monitor entry [0xb2c81000..0xb2c819d8]
     at weblogic.jdbc.jts.Connection.internalRollback(Connection.java:673)
     at weblogic.jdbc.jts.Connection.rollback(Connection.java:431)
     at weblogic.transaction.internal.ServerResourceInfo.rollback(ServerResourceInfo.java:1226)
     at weblogic.transaction.internal.ServerResourceInfo.rollback(ServerResourceInfo.java:545)
     at weblogic.transaction.internal.ServerSCInfo.startRollback(ServerSCInfo.java:372)
     at weblogic.transaction.internal.ServerTransactionImpl.localRollback(ServerTransactionImpl.java:1419)
     at weblogic.transaction.internal.ServerTransactionImpl.globalRetryRollback(ServerTransactionImpl.java:2152)
     at weblogic.transaction.internal.ServerTransactionImpl.access$3(ServerTransactionImpl.java:2123)
     at weblogic.transaction.internal.ServerTransactionImpl$1.execute(ServerTransactionImpl.java:2291)
     at weblogic.kernel.ExecuteThread.execute(ExecuteThread.java:137)
     at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:120)
"ExecuteThread: '59' for queue: 'default'" daemon prio=5 tid=0x4e9e28nid=0x48 waiting for monitor entry [0xb2d81000..0xb2d819d8]
     at java.sql.DriverManager.getConnection(DriverManager.java:144)
     at com.xxxxx.infra.db.ejb.weblogic.DBAccess.<init>(DBAccess.java:79)
     at com.xxxxx.infra.db.ejb.weblogic.DBAccess.<init>(DBAccess.java:96)
     at com.xxxxx.apps.aaaa.ejb.uuuii.loaduuuii(uuuii.java:73)
     at com.xxxxx.apps.aaaa.ejb.uuuii.<init>(uuuii.java:63)
     at com.xxxxx.apps.aaaa.ejb.eeeeessBean.enInit(eeeeessBean.java:30)
     at com.xxxxx.apps.aaaa.ejb.eeeeessBean_2i6_EOImpl.enInit(eeeeessBean_2i6_EOImpl.java:221)
     at com.xxxxx.apps.aaaa.ejb.eeeeessBean_2i6_EOImpl_WLSkel.invoke(UnknownSource)
     at weblogic.rmi.internal.BasicServerRef.invoke(BasicServerRef.java:288)
     at weblogic.rmi.internal.BasicServerRef.handleRequest(BasicServerRef.java:257)
     at weblogic.rmi.internal.BasicExecuteRequest.execute(BasicExecuteRequest.java:22)
     at weblogic.kernel.ExecuteThread.execute(ExecuteThread.java:137)
     at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:120)
"ExecuteThread: '58' for queue: 'default'" daemon prio=5 tid=0x4e9340nid=0x47 waiting for monitor entry [0xb2e81000..0xb2e819d8]
     at weblogic.socket.PosixSocketMuxer.processSockets(PosixSocketMuxer.java:371)
     at weblogic.socket.SocketReaderRequest.execute(SocketReaderRequest.java:24)
     at weblogic.kernel.ExecuteThread.execute(ExecuteThread.java:137)
     at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:120)
"ExecuteThread: '57' for queue: 'default'" daemon prio=5 tid=0x4e8858nid=0x46 waiting for monitor entry [0xb2f81000..0xb2f819d8]
     at java.sql.DriverManager.getConnection(DriverManager.java:144)
     at com.xxxxx.infra.db.ejb.weblogic.DBAccess.<init>(DBAccess.java:79)
     at com.xxxxx.infra.db.ejb.weblogic.DBAccess.<init>(DBAccess.java:96)
     at com.xxxxx.apps.aaaa.ejb.uuuii.loaduuuii(uuuii.java:73)
     at com.xxxxx.apps.aaaa.ejb.uuuii.<init>(uuuii.java:63)
     at com.xxxxx.apps.aaaa.ejb.eeeeessBean.enInit(eeeeessBean.java:30)
     at com.xxxxx.apps.aaaa.ejb.eeeeessBean_2i6_EOImpl.enInit(eeeeessBean_2i6_EOImpl.java:221)
     at com.xxxxx.apps.aaaa.ejb.eeeeessBean_2i6_EOImpl_WLSkel.invoke(UnknownSource)
     at weblogic.rmi.internal.BasicServerRef.invoke(BasicServerRef.java:288)
     at weblogic.rmi.internal.BasicServerRef.handleRequest(BasicServerRef.java:257)
     at weblogic.rmi.internal.BasicExecuteRequest.execute(BasicExecuteRequest.java:22)
     at weblogic.kernel.ExecuteThread.execute(ExecuteThread.java:137)
     at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:120)
"ExecuteThread: '56' for queue: 'default'" daemon prio=5 tid=0x4e7d70nid=0x45 waiting for monitor entry [0xb3080000..0xb30819d8]
     at java.sql.DriverManager.getConnection(DriverManager.java:144)
     at com.xxxxx.infra.db.ejb.weblogic.DBAccess.<init>(DBAccess.java:79)
     at com.xxxxx.infra.db.ejb.weblogic.DBAccess.<init>(DBAccess.java:96)
     at com.xxxxx.infra.ffff.agent.ppppooII.ppppooBean.init(ppppooBean.java:164)
     at com.xxxxx.infra.ffff.agent.ppppooII.ppppooBean.ejbCreate(ppppooBean.java:142)
     at com.xxxxx.infra.ffff.agent.ppppooII.ppppooBean_sl938_Impl.ejbCreate(ppppooBean_sl938_Impl.java:112)
     at java.lang.reflect.Method.invoke(Native Method)
     at weblogic.ejb20.pool.StatelessSessionPool.createBean(StatelessSessionPool.java:148)
     at weblogic.ejb20.pool.StatelessSessionPool.getBean(StatelessSessionPool.java:112)
     at weblogic.ejb20.manager.StatelessManager.preInvoke(StatelessManager.java:160)
     at weblogic.ejb20.internal.BaseEJBObject.preInvoke(BaseEJBObject.java:117)
     at weblogic.ejb20.internal.StatelessEJBObject.preInvoke(StatelessEJBObject.java:63)
     at com.xxxxx.infra.ffff.agent.ppppooII.ppppooBean_sl938_EOImpl.startRequest(ppppooBean_sl938_EOImpl.java:26)
     at com.xxxxx.infra.ffff.agent.ppppooII.ppppooBean_sl938_EOImpl_WLSkel.invoke(UnknownSource)
     at weblogic.rmi.internal.BasicServerRef.invoke(BasicServerRef.java:288)
     at weblogic.rmi.cluster.ReplicaAwareServerRef.invoke(ReplicaAwareServerRef.java:93)
     at weblogic.rmi.internal.BasicServerRef.handleRequest(BasicServerRef.java:257)
     at weblogic.rmi.internal.BasicServerRef.dispatch(BasicServerRef.java:158)
     at weblogic.rmi.internal.ServerRequest.sendOneWayRaw(ServerRequest.java:92)
     at weblogic.rmi.internal.ServerRequest.sendReceive(ServerRequest.java:112)
     at weblogic.rmi.cluster.ReplicaAwareRemoteRef.invoke(ReplicaAwareRemoteRef.java:253)
     at weblogic.rmi.cluster.ReplicaAwareRemoteRef.invoke(ReplicaAwareRemoteRef.java:220)
     at weblogic.rmi.internal.ProxyStub.invoke(ProxyStub.java:35)
     at $Proxy222.startRequest(Unknown Source)
     at com.xxxxx.infra.ffff.agent.ffffShellRequest.ffffShellRequestBean.executeRequest(ffffShellRequestBean.java:326)
     at com.xxxxx.infra.ffff.agent.ffffShellRequest.ffffShellRequestBean.startRequest(ffffShellRequestBean.java:104)
     at com.xxxxx.infra.ffff.agent.ffffShellRequest.ffffShellRequestBean_7gya1w_EOImpl.startRequest(ffffShellRequestBean_7gya1w_EOImpl.java:37)
     at com.xxxxx.infra.ffff.agent.ffffShellRequest.ffffShellRequestBean_7gya1w_EOImpl_WLSkel.invoke(UnknownSource)
     at weblogic.rmi.internal.BasicServerRef.invoke(BasicServerRef.java:288)
     at weblogic.rmi.cluster.ReplicaAwareServerRef.invoke(ReplicaAwareServerRef.java:93)
     at weblogic.rmi.internal.BasicServerRef.handleRequest(BasicServerRef.java:257)
     at weblogic.rmi.internal.BasicExecuteRequest.execute(BasicExecuteRequest.java:22)
     at weblogic.kernel.ExecuteThread.execute(ExecuteThread.java:137)
     at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:120)
"ExecuteThread: '55' for queue: 'default'" daemon prio=5 tid=0x4e7280nid=0x44 waiting for monitor entry [0xb3180000..0xb31819d8]
     at weblogic.common.internal.ResourceAllocator.markBorrowed(ResourceAllocator.java:332)
     at weblogic.common.internal.ResourceAllocator.reserve(ResourceAllocator.java:446)
     at weblogic.common.internal.ResourceAllocator.reserve(ResourceAllocator.java:400)
     at weblogic.common.internal.ResourceAllocator.reserveNoWait(ResourceAllocator.java:368)
     at weblogic.jdbc.common.internal.ConnectionPool.reserve(ConnectionPool.java:166)
     at weblogic.jdbc.common.internal.ConnectionPool.reserveNoWait(ConnectionPool.java:127)
     at weblogic.jdbc.common.internal.RmiDataSource.getPoolConnection(RmiDataSource.java:194)
     at weblogic.jdbc.common.internal.RmiDataSource.getConnection(RmiDataSource.java:219)
     at weblogic.jdbc.common.internal.RmiDataSource_WLSkel.invoke(UnknownSource)
     at weblogic.rmi.internal.BasicServerRef.invoke(BasicServerRef.java:288)
     at weblogic.rmi.cluster.ReplicaAwareServerRef.invoke(ReplicaAwareServerRef.java:93)
     at weblogic.rmi.internal.BasicServerRef.handleRequest(BasicServerRef.java:257)
     at weblogic.rmi.internal.BasicE

Weblogic 6.0 : Server hangs while reading a https request

Hi,
I'm running WLS6.0 on Win2000. The server hangs for some requests sent over https,
unless it times out. It seems that the server is not able to read the complete request
from the socket. It somehow thinks that there is more data available and keeps on
waiting. Is this a bug?
Also, it works fine if i change the url from a https to a http one. So, is this
related to SSL implementation of weblogic?
Has any of faced a similar problem? Thanks in advance for any ideas/thoughts on this
problem,
Thakur.
The stacktrace is as follows :
Full thread dump Classic VM (1.3.0-C, native threads):
"tavant.bus.PurgeStaleDataTask" (TID:0x10ce268, sys_thread_t:0x9e73fc0, state:CW,
native ID:0
x728) prio=5
at java.lang.Thread.sleep(Native Method)
at tavant.bus.HouseKeepingTask.run(HouseKeepingTask.java:63)
at java.lang.Thread.run(Thread.java:484)
"tavant.bus.MsgHistTask" (TID:0x10cd3a0, sys_thread_t:0x9e73de8, state:CW, native
ID:0x10c) p
rio=5
at java.lang.Thread.sleep(Native Method)
at tavant.bus.HouseKeepingTask.run(HouseKeepingTask.java:63)
at java.lang.Thread.run(Thread.java:484)
"tavant.bus.MsgNotificationTask" (TID:0x10cd158, sys_thread_t:0x9fbda70, state:CW,
native ID:
0x514) prio=5
at java.lang.Thread.sleep(Native Method)
at tavant.bus.HouseKeepingTask.run(HouseKeepingTask.java:63)
at java.lang.Thread.run(Thread.java:484)
"SSLListenThread" (TID:0xc68510, sys_thread_t:0x9dc3b20, state:R, native ID:0x408)
prio=5
at java.net.PlainSocketImpl.socketAccept(Native Method)
at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:276)
at java.net.ServerSocket.implAccept(ServerSocket.java:241)
at java.net.ServerSocket.accept(ServerSocket.java:222)
at weblogic.security.SSL.SSLServerSocket.acceptNoHandshake(SSLServerSocket.java:123)
at weblogic.security.SSL.SSLServerSocket.accept(SSLServerSocket.java:114)
at weblogic.t3.srvr.ListenThread.run(ListenThread.java:244)
"ListenThread" (TID:0xc65ce0, sys_thread_t:0x9dc3960, state:R, native ID:0x2d8)
prio=5
at java.net.PlainSocketImpl.socketAccept(Native Method)
at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:276)
at java.net.ServerSocket.implAccept(ServerSocket.java:241)
at java.net.ServerSocket.accept(ServerSocket.java:222)
at weblogic.t3.srvr.ListenThread.run(ListenThread.java:244)
"Application Manager Thread" (TID:0xfaf738, sys_thread_t:0x9dd07a8, state:CW,
native ID:0x5a4
) prio=5
at java.lang.Thread.sleep(Native Method)
at weblogic.management.mbeans.custom.ApplicationManager$ApplicationPoller.run(Application
Manager.java:643)
"TimeEventGenerator" (TID:0xa68020, sys_thread_t:0x9070890, state:CW, native
ID:0x4e0) prio=5
at java.lang.Object.wait(Native Method)
at weblogic.time.common.internal.TimeTable.snooze(TimeTable.java:259)
at weblogic.time.common.internal.TimeEventGenerator.run(TimeEventGenerator.java:138)
at java.lang.Thread.run(Thread.java:484)
"TimeEventGenerator" (TID:0xa3e480, sys_thread_t:0x9071c10, state:CW, native
ID:0x138) prio=5
at java.lang.Object.wait(Native Method)
at weblogic.time.common.internal.TimeTable.snooze(TimeTable.java:259)
at weblogic.time.common.internal.TimeEventGenerator.run(TimeEventGenerator.java:138)
at java.lang.Thread.run(Thread.java:484)
"SpinnerRandomSource" (TID:0xa37340, sys_thread_t:0x9050ba0, state:CW, native
ID:0x594) prio=5
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:420)
at weblogic.security.SpinnerThread.stopSpinning(SpinnerRandomBitsSource.java:92)
at weblogic.security.SpinnerThread.run(SpinnerRandomBitsSource.java:109)
"ExecuteThread-14" (TID:0xa316e0, sys_thread_t:0x90502f0, state:CW, native ID:0x658)
prio=5
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:420)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:94)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:118)
"ExecuteThread-13" (TID:0xa317c0, sys_thread_t:0x9050180, state:CW, native ID:0x564)
prio=5
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:420)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:94)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:118)
"ExecuteThread-12" (TID:0xa315f0, sys_thread_t:0x9050010, state:R, native ID:0x52c)
prio=5
at java.net.SocketInputStream.socketRead(Native Method)
at java.net.SocketInputStream.read(SocketInputStream.java:42)
at java.net.SocketInputStream.read(SocketInputStream.java:59)
at weblogic.utils.io.ChunkedInputStream.read(ChunkedInputStream.java:130)
at weblogic.security.SSL.SSLSocket$WLPushbackInputStream.read(SSLSocket$WLPushbackInputStream.java:35)
at weblogic.security.Utils.inputByte(Utils.java:131)
at weblogic.security.SSL.ContentType.input(ContentType.java:50)
at weblogic.security.SSL.SSLCiphertext.input(SSLCiphertext.java:61)
at weblogic.security.SSL.SSLSocket.getRecord(SSLSocket.java:1002)
at weblogic.security.SSL.RecordInputStream.getData(RecordInputStream.java:109)
at weblogic.security.SSL.RecordInputStream.available(RecordInputStream.java:166)
at weblogic.servlet.internal.PostInputStream.available(PostInputStream.java:146)
at weblogic.servlet.internal.ServletInputStreamImpl.available(ServletInputStreamImpl.java:21)
at java.io.InputStreamReader.inReady(InputStreamReader.java:199)
at java.io.InputStreamReader.fill(InputStreamReader.java:171)
at java.io.InputStreamReader.read(InputStreamReader.java:249)
at java.io.BufferedReader.fill(BufferedReader.java:139)
at java.io.BufferedReader.read1(BufferedReader.java:187)
at java.io.BufferedReader.read(BufferedReader.java:261)
at weblogic.servlet.internal.ServletRequestImpl.mergePostParams(ServletRequestImpl.java:596)
at weblogic.servlet.internal.ServletRequestImpl.parseQueryParams(ServletRequestImpl.java:501)
at weblogic.servlet.internal.ServletRequestImpl.parseQueryParams(ServletRequestImpl.java:494)
at weblogic.servlet.internal.ServletRequestImpl.getParameterNames(ServletRequestImpl.java:649)
at tavant.web.URLGen.<init>(URLGen.java:51)
at tavant.web.MainServlet.processRequest(MainServlet.java:189)
at tavant.web.MainServlet.doPost(MainServlet.java:172)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:760)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:853)
at weblogic.servlet.internal.ServletStubImpl.invokeServlet(ServletStubImpl.java:208)
at weblogic.servlet.internal.WebAppServletContext.invokeServlet(WebAppServletContext.java:1127)
at weblogic.servlet.internal.ServletRequestImpl.execute(ServletRequestImpl.java:1529)
at weblogic.kernel.ExecuteThread.execute(ExecuteThread.java:137)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:120)
"ExecuteThread-11" (TID:0xa31520, sys_thread_t:0x9060b48, state:CW, native ID:0x718)
prio=5
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:420)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:94)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:118)
"ExecuteThread-10" (TID:0xa31500, sys_thread_t:0x90609d8, state:CW, native ID:0x768)
prio=5
at java.lang.Object.wait(Native Method)
at weblogic.common.internal.DynaQueue.getW(DynaQueue.java:228)
at weblogic.socket.JavaSocketMuxer.processSockets(JavaSocketMuxer.java:246)
at weblogic.socket.SocketReaderRequest.execute(SocketReaderRequest.java:23)
at weblogic.kernel.ExecuteThread.execute(ExecuteThread.java:137)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:120)
"ExecuteThread-9" (TID:0xa31330, sys_thread_t:0x9060868, state:CW, native ID:0x460)
prio=5
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:420)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:94)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:118)
"ExecuteThread-8" (TID:0xa31170, sys_thread_t:0x90606f8, state:CW, native ID:0x3a8)
prio=5
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:420)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:94)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:118)
"ExecuteThread-7" (TID:0xa31250, sys_thread_t:0x9060588, state:CW, native ID:0x754)
prio=5
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:420)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:94)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:118)
"ExecuteThread-6" (TID:0xa31080, sys_thread_t:0x90604a0, state:CW, native ID:0x600)
prio=5
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:420)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:94)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:118)
"ExecuteThread-5" (TID:0xa30eb0, sys_thread_t:0x8fd1638, state:CW, native ID:0x500)
prio=5
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:420)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:94)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:118)
"ExecuteThread-4" (TID:0xa30f98, sys_thread_t:0x8fd14c8, state:CW, native ID:0x5b8)
prio=5
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:420)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:94)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:118)
"ExecuteThread-3" (TID:0xa30dc8, sys_thread_t:0x8fd1358, state:CW, native ID:0x4b4)
prio=5
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:420)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:94)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:118)
"ExecuteThread-2" (TID:0xa30c00, sys_thread_t:0x901f8c8, state:CW, native ID:0x798)
prio=5
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:420)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:94)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:118)
"ExecuteThread-1" (TID:0xa30ce0, sys_thread_t:0x901f758, state:CW, native ID:0x88)
prio=5
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:420)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:94)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:118)
"ExecuteThread-0" (TID:0xa308d0, sys_thread_t:0x901f670, state:CW, native ID:0x3a0)
prio=5
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:420)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:94)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:118)
"Thread-0" (TID:0x85a238, sys_thread_t:0x8fb5088, state:CW, native ID:0x744)
prio=10
at java.lang.Thread.sleep(Native Method)
at weblogic.transaction.internal.TransactionManagerImpl$1.run(TransactionManagerImpl.java:737)
at java.lang.Thread.run(Thread.java:484)
"Finalizer" (TID:0x7b0528, sys_thread_t:0x89fa088, state:CW, native ID:0x5c4)
prio=8
at java.lang.Object.wait(Native Method)
at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:108)
at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:123)
at java.lang.ref.Finalizer$FinalizerThread.run(Finalizer.java:162)
"Reference Handler" (TID:0x7b0300, sys_thread_t:0x89f6148, state:CW, native ID:0x690)
prio=10
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:420)
at java.lang.ref.Reference$ReferenceHandler.run(Reference.java:110)
"Signal dispatcher" (TID:0x7b0330, sys_thread_t:0x89ef5f8, state:R, native ID:0x5ac)
prio=5
"main" (TID:0x7b01a0, sys_thread_t:0x235328, state:CW, native ID:0x788) prio=5
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:420)
at weblogic.t3.srvr.T3Srvr.waitForDeath(T3Srvr.java:498)
at weblogic.t3.srvr.T3Srvr.run(T3Srvr.java:171)
at weblogic.Server.main(Server.java:35)
Monitor Cache Dump:
weblogic.kernel.ExecuteThread@A316E0/22C7E48: <unowned>
Waiting to be notified:
"ExecuteThread-14" (0x90502f0)
weblogic.kernel.ExecuteThread@A30CE0/22C5268: <unowned>
Waiting to be notified:
"ExecuteThread-1" (0x901f758)
weblogic.kernel.ExecuteThread@A308D0/22C4DD0: <unowned>
Waiting to be notified:
"ExecuteThread-0" (0x901f670)
weblogic.kernel.ExecuteThread@A30EB0/22C6028: <unowned>
Waiting to be notified:
"ExecuteThread-5" (0x8fd1638)
weblogic.kernel.ExecuteThread@A31080/22C6398: <unowned>
Waiting to be notified:
"ExecuteThread-6" (0x90604a0)
weblogic.kernel.ExecuteThread@A31250/22C6708: <unowned>
Waiting to be notified:
"ExecuteThread-7" (0x9060588)
java.io.InputStreamReader@FEAB90/3DD57C8: owner "ExecuteThread-12" (0x9050010)
1 entry
weblogic.kernel.ExecuteThread@A30C00/22C55D8: <unowned>
Waiting to be notified:
"ExecuteThread-2" (0x901f8c8)
java.net.PlainSocketImpl@FB1FE8/25A91C0: owner "SSLListenThread" (0x9dc3b20)
1 entry
weblogic.time.common.internal.TimeTable@A68270/22FF4B0: <unowned>
Waiting to be notified:
"TimeEventGenerator" (0x9070890)
weblogic.kernel.ExecuteThread@A317C0/22C7B38: <unowned>
Waiting to be notified:
"ExecuteThread-13" (0x9050180)
weblogic.time.common.internal.TimeTable@A3E730/22CDA60: <unowned>
Waiting to be notified:
"TimeEventGenerator" (0x9071c10)
java.net.PlainSocketImpl@FB1DD0/25A9110: owner "ListenThread" (0x9dc3960) 1 entry
weblogic.kernel.ExecuteThread@A30DC8/22C5948: <unowned>
Waiting to be notified:
"ExecuteThread-3" (0x8fd1358)
weblogic.kernel.ExecuteThread@A30F98/22C5CB8: <unowned>
Waiting to be notified:
"ExecuteThread-4" (0x8fd14c8)
weblogic.common.internal.DynaQueue@FB97F8/25AB878: <unowned>
Waiting to be notified:
"ExecuteThread-10" (0x90609d8)
weblogic.kernel.ExecuteThread@A31170/22C6A78: <unowned>
Waiting to be notified:
"ExecuteThread-8" (0x90606f8)
java.lang.ref.ReferenceQueue$Lock@7B0540/214CA40: <unowned>
Waiting to be notified:
"Finalizer" (0x89fa088)
weblogic.t3.srvr.T3Srvr@7C4C08/2185000: <unowned>
Waiting to be notified:
"main" (0x235328)
weblogic.kernel.ExecuteThread@A31520/22C74C8: <unowned>
Waiting to be notified:
"ExecuteThread-11" (0x9060b48)
weblogic.security.SpinnerThread@A37340/22CAB60: <unowned>
Waiting to be notified:
"SpinnerRandomSource" (0x9050ba0)
weblogic.servlet.internal.ServletInputStreamImpl@FEB090/3DD28C8: owner "ExecuteThread-12"
(0x9050010) 1 entry
weblogic.kernel.ExecuteThread@A31330/22C6DE8: <unowned>
Waiting to be notified:
"ExecuteThread-9" (0x9060868)
java.lang.ref.Reference$Lock@7B0310/214C560: <unowned>
Waiting to be notified:
"Reference Handler" (0x89f6148)
Registered Monitor Dump:
utf8 hash table: <unowned>
JNI pinning lock: <unowned>
JNI global reference lock: <unowned>
BinClass lock: <unowned>
Class linking lock: <unowned>
System class loader lock: <unowned>
Code rewrite lock: <unowned>
Heap lock: <unowned>
Monitor cache lock: owner "Signal dispatcher" (0x89ef5f8) 1 entry
Thread queue lock: owner "Signal dispatcher" (0x89ef5f8) 1 entry
Monitor registry: owner "Signal dispatcher" (0x89ef5f8) 1 entry

Hi,
I'm running WLS6.0 on Win2000. The server hangs for some requests sent over https,
unless it times out. It seems that the server is not able to read the complete request
from the socket. It somehow thinks that there is more data available and keeps on
waiting. Is this a bug?
Also, it works fine if i change the url from a https to a http one. So, is this
related to SSL implementation of weblogic?
Has any of faced a similar problem? Thanks in advance for any ideas/thoughts on this
problem,
Thakur.
The stacktrace is as follows :
Full thread dump Classic VM (1.3.0-C, native threads):
"tavant.bus.PurgeStaleDataTask" (TID:0x10ce268, sys_thread_t:0x9e73fc0, state:CW,
native ID:0
x728) prio=5
at java.lang.Thread.sleep(Native Method)
at tavant.bus.HouseKeepingTask.run(HouseKeepingTask.java:63)
at java.lang.Thread.run(Thread.java:484)
"tavant.bus.MsgHistTask" (TID:0x10cd3a0, sys_thread_t:0x9e73de8, state:CW, native
ID:0x10c) p
rio=5
at java.lang.Thread.sleep(Native Method)
at tavant.bus.HouseKeepingTask.run(HouseKeepingTask.java:63)
at java.lang.Thread.run(Thread.java:484)
"tavant.bus.MsgNotificationTask" (TID:0x10cd158, sys_thread_t:0x9fbda70, state:CW,
native ID:
0x514) prio=5
at java.lang.Thread.sleep(Native Method)
at tavant.bus.HouseKeepingTask.run(HouseKeepingTask.java:63)
at java.lang.Thread.run(Thread.java:484)
"SSLListenThread" (TID:0xc68510, sys_thread_t:0x9dc3b20, state:R, native ID:0x408)
prio=5
at java.net.PlainSocketImpl.socketAccept(Native Method)
at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:276)
at java.net.ServerSocket.implAccept(ServerSocket.java:241)
at java.net.ServerSocket.accept(ServerSocket.java:222)
at weblogic.security.SSL.SSLServerSocket.acceptNoHandshake(SSLServerSocket.java:123)
at weblogic.security.SSL.SSLServerSocket.accept(SSLServerSocket.java:114)
at weblogic.t3.srvr.ListenThread.run(ListenThread.java:244)
"ListenThread" (TID:0xc65ce0, sys_thread_t:0x9dc3960, state:R, native ID:0x2d8)
prio=5
at java.net.PlainSocketImpl.socketAccept(Native Method)
at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:276)
at java.net.ServerSocket.implAccept(ServerSocket.java:241)
at java.net.ServerSocket.accept(ServerSocket.java:222)
at weblogic.t3.srvr.ListenThread.run(ListenThread.java:244)
"Application Manager Thread" (TID:0xfaf738, sys_thread_t:0x9dd07a8, state:CW,
native ID:0x5a4
) prio=5
at java.lang.Thread.sleep(Native Method)
at weblogic.management.mbeans.custom.ApplicationManager$ApplicationPoller.run(Application
Manager.java:643)
"TimeEventGenerator" (TID:0xa68020, sys_thread_t:0x9070890, state:CW, native
ID:0x4e0) prio=5
at java.lang.Object.wait(Native Method)
at weblogic.time.common.internal.TimeTable.snooze(TimeTable.java:259)
at weblogic.time.common.internal.TimeEventGenerator.run(TimeEventGenerator.java:138)
at java.lang.Thread.run(Thread.java:484)
"TimeEventGenerator" (TID:0xa3e480, sys_thread_t:0x9071c10, state:CW, native
ID:0x138) prio=5
at java.lang.Object.wait(Native Method)
at weblogic.time.common.internal.TimeTable.snooze(TimeTable.java:259)
at weblogic.time.common.internal.TimeEventGenerator.run(TimeEventGenerator.java:138)
at java.lang.Thread.run(Thread.java:484)
"SpinnerRandomSource" (TID:0xa37340, sys_thread_t:0x9050ba0, state:CW, native
ID:0x594) prio=5
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:420)
at weblogic.security.SpinnerThread.stopSpinning(SpinnerRandomBitsSource.java:92)
at weblogic.security.SpinnerThread.run(SpinnerRandomBitsSource.java:109)
"ExecuteThread-14" (TID:0xa316e0, sys_thread_t:0x90502f0, state:CW, native ID:0x658)
prio=5
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:420)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:94)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:118)
"ExecuteThread-13" (TID:0xa317c0, sys_thread_t:0x9050180, state:CW, native ID:0x564)
prio=5
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:420)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:94)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:118)
"ExecuteThread-12" (TID:0xa315f0, sys_thread_t:0x9050010, state:R, native ID:0x52c)
prio=5
at java.net.SocketInputStream.socketRead(Native Method)
at java.net.SocketInputStream.read(SocketInputStream.java:42)
at java.net.SocketInputStream.read(SocketInputStream.java:59)
at weblogic.utils.io.ChunkedInputStream.read(ChunkedInputStream.java:130)
at weblogic.security.SSL.SSLSocket$WLPushbackInputStream.read(SSLSocket$WLPushbackInputStream.java:35)
at weblogic.security.Utils.inputByte(Utils.java:131)
at weblogic.security.SSL.ContentType.input(ContentType.java:50)
at weblogic.security.SSL.SSLCiphertext.input(SSLCiphertext.java:61)
at weblogic.security.SSL.SSLSocket.getRecord(SSLSocket.java:1002)
at weblogic.security.SSL.RecordInputStream.getData(RecordInputStream.java:109)
at weblogic.security.SSL.RecordInputStream.available(RecordInputStream.java:166)
at weblogic.servlet.internal.PostInputStream.available(PostInputStream.java:146)
at weblogic.servlet.internal.ServletInputStreamImpl.available(ServletInputStreamImpl.java:21)
at java.io.InputStreamReader.inReady(InputStreamReader.java:199)
at java.io.InputStreamReader.fill(InputStreamReader.java:171)
at java.io.InputStreamReader.read(InputStreamReader.java:249)
at java.io.BufferedReader.fill(BufferedReader.java:139)
at java.io.BufferedReader.read1(BufferedReader.java:187)
at java.io.BufferedReader.read(BufferedReader.java:261)
at weblogic.servlet.internal.ServletRequestImpl.mergePostParams(ServletRequestImpl.java:596)
at weblogic.servlet.internal.ServletRequestImpl.parseQueryParams(ServletRequestImpl.java:501)
at weblogic.servlet.internal.ServletRequestImpl.parseQueryParams(ServletRequestImpl.java:494)
at weblogic.servlet.internal.ServletRequestImpl.getParameterNames(ServletRequestImpl.java:649)
at tavant.web.URLGen.<init>(URLGen.java:51)
at tavant.web.MainServlet.processRequest(MainServlet.java:189)
at tavant.web.MainServlet.doPost(MainServlet.java:172)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:760)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:853)
at weblogic.servlet.internal.ServletStubImpl.invokeServlet(ServletStubImpl.java:208)
at weblogic.servlet.internal.WebAppServletContext.invokeServlet(WebAppServletContext.java:1127)
at weblogic.servlet.internal.ServletRequestImpl.execute(ServletRequestImpl.java:1529)
at weblogic.kernel.ExecuteThread.execute(ExecuteThread.java:137)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:120)
"ExecuteThread-11" (TID:0xa31520, sys_thread_t:0x9060b48, state:CW, native ID:0x718)
prio=5
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:420)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:94)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:118)
"ExecuteThread-10" (TID:0xa31500, sys_thread_t:0x90609d8, state:CW, native ID:0x768)
prio=5
at java.lang.Object.wait(Native Method)
at weblogic.common.internal.DynaQueue.getW(DynaQueue.java:228)
at weblogic.socket.JavaSocketMuxer.processSockets(JavaSocketMuxer.java:246)
at weblogic.socket.SocketReaderRequest.execute(SocketReaderRequest.java:23)
at weblogic.kernel.ExecuteThread.execute(ExecuteThread.java:137)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:120)
"ExecuteThread-9" (TID:0xa31330, sys_thread_t:0x9060868, state:CW, native ID:0x460)
prio=5
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:420)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:94)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:118)
"ExecuteThread-8" (TID:0xa31170, sys_thread_t:0x90606f8, state:CW, native ID:0x3a8)
prio=5
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:420)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:94)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:118)
"ExecuteThread-7" (TID:0xa31250, sys_thread_t:0x9060588, state:CW, native ID:0x754)
prio=5
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:420)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:94)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:118)
"ExecuteThread-6" (TID:0xa31080, sys_thread_t:0x90604a0, state:CW, native ID:0x600)
prio=5
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:420)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:94)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:118)
"ExecuteThread-5" (TID:0xa30eb0, sys_thread_t:0x8fd1638, state:CW, native ID:0x500)
prio=5
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:420)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:94)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:118)
"ExecuteThread-4" (TID:0xa30f98, sys_thread_t:0x8fd14c8, state:CW, native ID:0x5b8)
prio=5
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:420)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:94)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:118)
"ExecuteThread-3" (TID:0xa30dc8, sys_thread_t:0x8fd1358, state:CW, native ID:0x4b4)
prio=5
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:420)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:94)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:118)
"ExecuteThread-2" (TID:0xa30c00, sys_thread_t:0x901f8c8, state:CW, native ID:0x798)
prio=5
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:420)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:94)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:118)
"ExecuteThread-1" (TID:0xa30ce0, sys_thread_t:0x901f758, state:CW, native ID:0x88)
prio=5
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:420)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:94)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:118)
"ExecuteThread-0" (TID:0xa308d0, sys_thread_t:0x901f670, state:CW, native ID:0x3a0)
prio=5
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:420)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:94)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:118)
"Thread-0" (TID:0x85a238, sys_thread_t:0x8fb5088, state:CW, native ID:0x744)
prio=10
at java.lang.Thread.sleep(Native Method)
at weblogic.transaction.internal.TransactionManagerImpl$1.run(TransactionManagerImpl.java:737)
at java.lang.Thread.run(Thread.java:484)
"Finalizer" (TID:0x7b0528, sys_thread_t:0x89fa088, state:CW, native ID:0x5c4)
prio=8
at java.lang.Object.wait(Native Method)
at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:108)
at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:123)
at java.lang.ref.Finalizer$FinalizerThread.run(Finalizer.java:162)
"Reference Handler" (TID:0x7b0300, sys_thread_t:0x89f6148, state:CW, native ID:0x690)
prio=10
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:420)
at java.lang.ref.Reference$ReferenceHandler.run(Reference.java:110)
"Signal dispatcher" (TID:0x7b0330, sys_thread_t:0x89ef5f8, state:R, native ID:0x5ac)
prio=5
"main" (TID:0x7b01a0, sys_thread_t:0x235328, state:CW, native ID:0x788) prio=5
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:420)
at weblogic.t3.srvr.T3Srvr.waitForDeath(T3Srvr.java:498)
at weblogic.t3.srvr.T3Srvr.run(T3Srvr.java:171)
at weblogic.Server.main(Server.java:35)
Monitor Cache Dump:
weblogic.kernel.ExecuteThread@A316E0/22C7E48: <unowned>
Waiting to be notified:
"ExecuteThread-14" (0x90502f0)
weblogic.kernel.ExecuteThread@A30CE0/22C5268: <unowned>
Waiting to be notified:
"ExecuteThread-1" (0x901f758)
weblogic.kernel.ExecuteThread@A308D0/22C4DD0: <unowned>
Waiting to be notified:
"ExecuteThread-0" (0x901f670)
weblogic.kernel.ExecuteThread@A30EB0/22C6028: <unowned>
Waiting to be notified:
"ExecuteThread-5" (0x8fd1638)
weblogic.kernel.ExecuteThread@A31080/22C6398: <unowned>
Waiting to be notified:
"ExecuteThread-6" (0x90604a0)
weblogic.kernel.ExecuteThread@A31250/22C6708: <unowned>
Waiting to be notified:
"ExecuteThread-7" (0x9060588)
java.io.InputStreamReader@FEAB90/3DD57C8: owner "ExecuteThread-12" (0x9050010)
1 entry
weblogic.kernel.ExecuteThread@A30C00/22C55D8: <unowned>
Waiting to be notified:
"ExecuteThread-2" (0x901f8c8)
java.net.PlainSocketImpl@FB1FE8/25A91C0: owner "SSLListenThread" (0x9dc3b20)
1 entry
weblogic.time.common.internal.TimeTable@A68270/22FF4B0: <unowned>
Waiting to be notified:
"TimeEventGenerator" (0x9070890)
weblogic.kernel.ExecuteThread@A317C0/22C7B38: <unowned>
Waiting to be notified:
"ExecuteThread-13" (0x9050180)
weblogic.time.common.internal.TimeTable@A3E730/22CDA60: <unowned>
Waiting to be notified:
"TimeEventGenerator" (0x9071c10)
java.net.PlainSocketImpl@FB1DD0/25A9110: owner "ListenThread" (0x9dc3960) 1 entry
weblogic.kernel.ExecuteThread@A30DC8/22C5948: <unowned>
Waiting to be notified:
"ExecuteThread-3" (0x8fd1358)
weblogic.kernel.ExecuteThread@A30F98/22C5CB8: <unowned>
Waiting to be notified:
"ExecuteThread-4" (0x8fd14c8)
weblogic.common.internal.DynaQueue@FB97F8/25AB878: <unowned>
Waiting to be notified:
"ExecuteThread-10" (0x90609d8)
weblogic.kernel.ExecuteThread@A31170/22C6A78: <unowned>
Waiting to be notified:
"ExecuteThread-8" (0x90606f8)
java.lang.ref.ReferenceQueue$Lock@7B0540/214CA40: <unowned>
Waiting to be notified:
"Finalizer" (0x89fa088)
weblogic.t3.srvr.T3Srvr@7C4C08/2185000: <unowned>
Waiting to be notified:
"main" (0x235328)
weblogic.kernel.ExecuteThread@A31520/22C74C8: <unowned>
Waiting to be notified:
"ExecuteThread-11" (0x9060b48)
weblogic.security.SpinnerThread@A37340/22CAB60: <unowned>
Waiting to be notified:
"SpinnerRandomSource" (0x9050ba0)
weblogic.servlet.internal.ServletInputStreamImpl@FEB090/3DD28C8: owner "ExecuteThread-12"
(0x9050010) 1 entry
weblogic.kernel.ExecuteThread@A31330/22C6DE8: <unowned>
Waiting to be notified:
"ExecuteThread-9" (0x9060868)
java.lang.ref.Reference$Lock@7B0310/214C560: <unowned>
Waiting to be notified:
"Reference Handler" (0x89f6148)
Registered Monitor Dump:
utf8 hash table: <unowned>
JNI pinning lock: <unowned>
JNI global reference lock: <unowned>
BinClass lock: <unowned>
Class linking lock: <unowned>
System class loader lock: <unowned>
Code rewrite lock: <unowned>
Heap lock: <unowned>
Monitor cache lock: owner "Signal dispatcher" (0x89ef5f8) 1 entry
Thread queue lock: owner "Signal dispatcher" (0x89ef5f8) 1 entry
Monitor registry: owner "Signal dispatcher" (0x89ef5f8) 1 entry

Weblogic Server 5.1 Hangs. Any Ideas?

I realize this must seem a tedious and out-of-date topic but we are still on 5.1 so...
We have a large application that will be going along fine for several hours or even days and then mysteriously just lock up. It can usually be resuscitated using kill -3. I have pasted in the thread dump below, and I can supply numerous more thread dumps if you are interested. Here are the particulars, first:
Weblogic Server 5.1 running SP 12
Running Java 1.3.1_10
Running on Dell Xeon servers (1650/2650) with a lot of RAM and running RedHat Linux (v. 9)
Talking to Oracle 9i database (9.2.0.4) using both the latest (9.2.0.5) and older (9.0.x) Oracle JDBC driver
We have examined every option we could find based on earlier postings, including adjusting the weblogic.system.executeThreadCount to match the # of JDBC connections (saw that somehwere) and also increasing the # in weblogic.system.jmsThreadCount above the default of zero.
It doesn't crash all the time, but just eliminating these once in a blue moon situations would be desirable.
27 Sep 2004 15:00:20,594 | DEBUG | log | AtmQueueAction | doGetData | [ExecuteThread-23] | no page in req params
Full thread dump:
"process forker" daemon prio=1 tid=0x8566ed8 nid=0x32c1 waiting on monitor [0xa4f7f000..0xa4f7fd3c]
at java.lang.Object.wait(Native Method)
at java.lang.UNIXProcessForker.run(Native Method)
at java.lang.Thread.run(Thread.java:479)
"process reaper" daemon prio=1 tid=0x826f610 nid=0x32c1 runnable [0xa477f000..0xa477fdbc]
at java.lang.UNIXProcessReaper.run(Native Method)
at java.lang.Thread.run(Thread.java:479)
"HighPriority TimeEventGenerator" daemon prio=1 tid=0x8283270 nid=0x32c1 waiting on monitor [0xa25fe000..0xa25feebc]
at java.lang.Object.wait(Native Method)
at weblogic.time.common.internal.TimeTable.snooze(TimeTable.java:279)
at weblogic.time.common.internal.TimeEventGenerator.run(TimeEventGenerator.java:141)
at java.lang.Thread.run(Thread.java:479)
"ListenThread" prio=1 tid=0xa2ba2108 nid=0x32c1 waiting for monitor entry [0xa3f7f000..0xa3f7fe3c]
at java.net.InetAddress.getHostAddress(InetAddress.java:217)
at java.net.ServerSocket.implAccept(ServerSocket.java:242)
at java.net.ServerSocket.accept(ServerSocket.java:217)
at weblogic.socket.WeblogicServerSocket.accept(WeblogicServerSocket.java:26)
at weblogic.t3.srvr.ListenThread.run(ListenThread.java:325)
"NBExecuteThread-1" daemon prio=1 tid=0x8e516c80 nid=0x32c1 waiting on monitor [0xa1dfe000..0xa1dfef3c]
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:415)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
"NBExecuteThread-0" daemon prio=1 tid=0x8e5169f0 nid=0x32c1 waiting on monitor [0xa15fe000..0xa15fefbc]
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:415)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
"ExecuteThread-34" daemon prio=1 tid=0x8e515f60 nid=0x32c1 waiting for monitor entry [0xa0dfe000..0xa0dff03c]
at weblogic.utils.collections.NumericHashtable.get(NumericHashtable.java:148)
at weblogic.socket.PosixSocketMuxer.processSockets(PosixSocketMuxer.java:322)
at weblogic.socket.SocketReaderRequest.execute(SocketReaderRequest.java:42)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:130)
"ExecuteThread-33" daemon prio=1 tid=0x8e5154d0 nid=0x32c1 waiting for monitor entry [0xa05fe000..0xa05ff0bc]
at weblogic.utils.collections.NumericHashtable.get(NumericHashtable.java:148)
at weblogic.socket.PosixSocketMuxer.processSockets(PosixSocketMuxer.java:322)
at weblogic.socket.SocketReaderRequest.execute(SocketReaderRequest.java:42)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:130)
"ExecuteThread-32" daemon prio=1 tid=0x8e514a40 nid=0x32c1 waiting for monitor entry [0x9fdfe000..0x9fdff13c]
at weblogic.utils.collections.NumericHashtable.get(NumericHashtable.java:148)
at weblogic.socket.PosixSocketMuxer.processSockets(PosixSocketMuxer.java:322)
at weblogic.socket.SocketReaderRequest.execute(SocketReaderRequest.java:42)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:130)
"ExecuteThread-31" daemon prio=1 tid=0x8e513fb0 nid=0x32c1 waiting on monitor [0x9f5ff000..0x9f5ff1bc]
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:415)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
"ExecuteThread-30" daemon prio=1 tid=0x8e513520 nid=0x32c1 waiting on monitor [0x9edff000..0x9edff23c]
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:415)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
"ExecuteThread-29" daemon prio=1 tid=0x8e512a90 nid=0x32c1 waiting for monitor entry [0x9e5ff000..0x9e5ff2bc]
at weblogic.rmi.internal.DGCClientHelper.getHeartBeats(DGCClientHelper.java:39)
at weblogic.rmi.internal.DGCClientImpl.mark(DGCClientImpl.java:159)
at weblogic.rmi.internal.DGCClientImpl.trigger(DGCClientImpl.java:145)
at weblogic.time.common.internal.ScheduledTrigger.executeLocally(ScheduledTrigger.java:209)
at weblogic.time.common.internal.ScheduledTrigger.execute(ScheduledTrigger.java:203)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:130)
"ExecuteThread-28" daemon prio=1 tid=0x8e512000 nid=0x32c1 waiting on monitor [0x9ddff000..0x9ddff33c]
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:415)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
"ExecuteThread-27" daemon prio=1 tid=0x8e511570 nid=0x32c1 waiting on monitor [0x9d5ff000..0x9d5ff3bc]
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:415)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
"ExecuteThread-26" daemon prio=1 tid=0x8e510ae0 nid=0x32c1 waiting for monitor entry [0x9cdff000..0x9cdff43c]
at weblogic.jms.server.JDBCStore.getConnectionNoTx(JDBCStore.java:1381)
at weblogic.jms.server.JDBCStore.purgeMessages(JDBCStore.java:1248)
at weblogic.jms.server.JDBCStore.trigger(JDBCStore.java:975)
at weblogic.time.common.internal.ScheduledTrigger.executeLocally(ScheduledTrigger.java:209)
at weblogic.time.common.internal.ScheduledTrigger.execute(ScheduledTrigger.java:203)
at weblogic.time.server.ScheduledTrigger.execute(ScheduledTrigger.java:60)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:130)
"ExecuteThread-25" daemon prio=1 tid=0x8e510050 nid=0x32c1 waiting for monitor entry [0x9c5fe000..0x9c5ff4bc]
at oracle.net.ns.Packet.createBuffer(Unknown Source)
at oracle.net.ns.Packet.receive(Unknown Source)
at oracle.net.ns.NetInputStream.getNextPacket(Unknown Source)
at oracle.net.ns.NetInputStream.read(Unknown Source)
at oracle.net.ns.NetInputStream.read(Unknown Source)
at oracle.net.ns.NetInputStream.read(Unknown Source)
at oracle.jdbc.ttc7.MAREngine.unmarshalUB1(MAREngine.java:733)
at oracle.jdbc.ttc7.MAREngine.unmarshalSB1(MAREngine.java:705)
at oracle.jdbc.ttc7.Oall7.receive(Oall7.java:373)
at oracle.jdbc.ttc7.TTC7Protocol.doOall7(TTC7Protocol.java:1477)
at oracle.jdbc.ttc7.TTC7Protocol.parseExecuteDescribe(TTC7Protocol.java:677)
at oracle.jdbc.driver.OracleStatement.doExecuteQuery(OracleStatement.java:2311)
at oracle.jdbc.driver.OracleStatement.doExecuteWithTimeout(OracleStatement.java:2554)
at oracle.jdbc.driver.OraclePreparedStatement.doScrollPstmtExecuteUpdate(OraclePreparedStatement.java:3815)
at oracle.jdbc.driver.OraclePreparedStatement.executeUpdate(OraclePreparedStatement.java:486)
at oracle.jdbc.driver.OraclePreparedStatement.executeQuery(OraclePreparedStatement.java:382)
at weblogic.jdbc20.pool.PreparedStatement.executeQuery(PreparedStatement.java:35)
at weblogic.jdbc20.rmi.internal.PreparedStatementImpl.executeQuery(PreparedStatementImpl.java:46)
at weblogic.jdbc20.rmi.SerialPreparedStatement.executeQuery(SerialPreparedStatement.java:40)
at com.solbright.ui.XsuQueueAccessor.createOracleXMLQuery(XsuQueueAccessor.java:35)
at com.solbright.ui.XsuQueueAccessor.<init>(XsuQueueAccessor.java:25)
at com.solbright.adtraffic.AtmPersistentQueueAccessor.<init>(AtmPersistentQueueAccessor.java:65)
at com.solbright.adtraffic.servlet.AtmQueueFrame.createNewQueueAccessor(AtmQueueFrame.java:113)
at com.solbright.adtraffic.servlet.AtmQueueFrame.doGetData(AtmQueueFrame.java:27)
at com.solbright.ui.servlet.AdSuiteMediatorServlet.doRequest(AdSuiteMediatorServlet.java:294)
at com.solbright.ui.servlet.AdSuiteMediatorServlet.doProcess(AdSuiteMediatorServlet.java:79)
at com.solbright.ui.servlet.AdSuiteMediatorServlet.doGet(AdSuiteMediatorServlet.java:47)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:740)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:865)
at weblogic.servlet.internal.ServletStubImpl.invokeServlet(ServletStubImpl.java:120)
at weblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletContextImpl.java:945)
at weblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletContextImpl.java:909)
at weblogic.servlet.internal.ServletContextManager.invokeServlet(ServletContextManager.java:269)
at weblogic.socket.MuxableSocketHTTP.invokeServlet(MuxableSocketHTTP.java:392)
at weblogic.socket.MuxableSocketHTTP.execute(MuxableSocketHTTP.java:274)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:130)
"ExecuteThread-24" daemon prio=1 tid=0x8e50f5c0 nid=0x32c1 waiting on monitor [0x9bdff000..0x9bdff53c]
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:415)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
"ExecuteThread-23" daemon prio=1 tid=0x8e50eb30 nid=0x32c1 waiting for monitor entry [0x9b5fe000..0x9b5ff5bc]
at java.lang.StringBuffer.expandCapacity(StringBuffer.java:197)
at java.lang.StringBuffer.append(StringBuffer.java:396)
at java.io.StringWriter.write(StringWriter.java:89)
at java.io.PrintWriter.newLine(PrintWriter.java:231)
at java.io.PrintWriter.println(PrintWriter.java:382)
at java.io.PrintWriter.println(PrintWriter.java:479)
at java.lang.Throwable.printStackTrace0(Native Method)
at java.lang.Throwable.printStackTrace(Throwable.java:204)
at org.log4j.LoggingEvent$LocationInfo.<init>(LoggingEvent.java:193)
at org.log4j.LoggingEvent.setLocationInformation(LoggingEvent.java:125)
at org.log4j.helpers.PatternParser$ClassNamePatternConverter.getFullyQualifiedName(PatternParser.java:474)
at org.log4j.helpers.PatternParser$NamedPatternConverter.convert(PatternParser.java:447)
at org.log4j.helpers.PatternConverter.format(PatternConverter.java:48)
at org.log4j.PatternLayout.format(PatternLayout.java:430)
at org.log4j.FileAppender.doAppend(FileAppender.java:202)
at org.log4j.Category.callAppenders(Category.java:147)
at org.log4j.Category.debug(Category.java:194)
at com.solbright.adtraffic.servlet.AtmQueueAction.doGetData(AtmQueueAction.java:36)
at com.solbright.ui.servlet.AdSuiteMediatorServlet.doRequest(AdSuiteMediatorServlet.java:294)
at com.solbright.ui.servlet.AdSuiteMediatorServlet.doProcess(AdSuiteMediatorServlet.java:79)
at com.solbright.ui.servlet.AdSuiteMediatorServlet.doGet(AdSuiteMediatorServlet.java:47)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:740)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:865)
at weblogic.servlet.internal.ServletStubImpl.invokeServlet(ServletStubImpl.java:120)
at weblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletContextImpl.java:945)
at weblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletContextImpl.java:909)
at weblogic.servlet.internal.ServletContextManager.invokeServlet(ServletContextManager.java:269)
at weblogic.socket.MuxableSocketHTTP.invokeServlet(MuxableSocketHTTP.java:392)
at weblogic.socket.MuxableSocketHTTP.execute(MuxableSocketHTTP.java:274)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:130)
"ExecuteThread-22" daemon prio=1 tid=0x8e50e0a0 nid=0x32c1 waiting on monitor [0x9adff000..0x9adff63c]
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:415)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
"ExecuteThread-21" daemon prio=1 tid=0x8e50d610 nid=0x32c1 waiting for monitor entry [0x9a5ff000..0x9a5ff6bc]
at java.lang.Object.clone(Native Method)
at java.util.Hashtable.clone(Hashtable.java:471)
at weblogic.t3.srvr.Scavenger.trigger(Scavenger.java:83)
at weblogic.time.common.internal.ScheduledTrigger.executeLocally(ScheduledTrigger.java:209)
at weblogic.time.common.internal.ScheduledTrigger.execute(ScheduledTrigger.java:203)
at weblogic.time.server.ScheduledTrigger.execute(ScheduledTrigger.java:60)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:130)
"ExecuteThread-20" daemon prio=1 tid=0x8e50cb80 nid=0x32c1 waiting for monitor entry [0x99dfe000..0x99dfe73c]
at java.lang.Object.clone(Native Method)
at weblogic.utils.collections.NumericHashtable.clone(NumericHashtable.java:267)
at weblogic.socket.PosixSocketMuxer.trigger(PosixSocketMuxer.java:153)
at weblogic.time.common.internal.ScheduledTrigger.executeLocally(ScheduledTrigger.java:209)
at weblogic.time.common.internal.ScheduledTrigger.execute(ScheduledTrigger.java:203)
at weblogic.time.server.ScheduledTrigger.execute(ScheduledTrigger.java:60)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:130)
"ExecuteThread-19" daemon prio=1 tid=0x8e50c0f0 nid=0x32c1 waiting on monitor [0x995fe000..0x995fe7bc]
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:415)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
"ExecuteThread-18" daemon prio=1 tid=0x8e50b660 nid=0x32c1 waiting on monitor [0x98dfe000..0x98dfe83c]
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:415)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
"ExecuteThread-17" daemon prio=1 tid=0x8e50abd0 nid=0x32c1 waiting on monitor [0x985fe000..0x985fe8bc]
at java.util.HashMap.put(HashMap.java:351)
at org.jdom.transform.JDOMSource$DocumentReader.<init>(JDOMSource.java:436)
at org.jdom.transform.JDOMSource.getXMLReader(JDOMSource.java:224)
at org.apache.xalan.transformer.TransformerImpl.transform(TransformerImpl.java:531)
at org.apache.xalan.transformer.TransformerImpl.transform(TransformerImpl.java:1174)
at com.solbright.ui.UiXslTransformer.transform(UiXslTransformer.java:39)
at com.solbright.ui.servlet.AdSuiteMediatorServlet.doShowViewImpl(AdSuiteMediatorServlet.java:419)
at com.solbright.ui.servlet.AdSuiteMediatorServlet.doShowView(AdSuiteMediatorServlet.java:394)
at com.solbright.adtraffic.servlet.AdTrafficMediatorServlet.doShowView(AdTrafficMediatorServlet.java:80)
at com.solbright.ui.servlet.AdSuiteMediatorServlet.doRequest(AdSuiteMediatorServlet.java:307)
at com.solbright.ui.servlet.AdSuiteMediatorServlet.doProcess(AdSuiteMediatorServlet.java:79)
at com.solbright.ui.servlet.AdSuiteMediatorServlet.doGet(AdSuiteMediatorServlet.java:47)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:740)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:865)
at weblogic.servlet.internal.ServletStubImpl.invokeServlet(ServletStubImpl.java:120)
at weblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletContextImpl.java:945)
at weblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletContextImpl.java:909)
at weblogic.servlet.internal.ServletContextManager.invokeServlet(ServletContextManager.java:269)
at weblogic.socket.MuxableSocketHTTP.invokeServlet(MuxableSocketHTTP.java:392)
at weblogic.socket.MuxableSocketHTTP.execute(MuxableSocketHTTP.java:274)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:130)
"ExecuteThread-16" daemon prio=1 tid=0x8e50a140 nid=0x32c1 waiting on monitor [0x97dfe000..0x97dfe93c]
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:415)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
"ExecuteThread-15" daemon prio=1 tid=0x8e5096b0 nid=0x32c1 waiting on monitor [0x975fe000..0x975fe9bc]
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:415)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
"ExecuteThread-14" daemon prio=1 tid=0x8e508c20 nid=0x32c1 waiting on monitor [0x96dfe000..0x96dfea3c]
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:415)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
"ExecuteThread-13" daemon prio=1 tid=0x8e508190 nid=0x32c1 waiting on monitor [0x965fe000..0x965feabc]
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:415)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
"ExecuteThread-12" daemon prio=1 tid=0x8e507700 nid=0x32c1 waiting for monitor entry [0x95dfe000..0x95dfeb3c]
at weblogic.utils.KeyTable.elements(KeyTable.java:79)
at weblogic.utils.SyncKeyTable.elements(SyncKeyTable.java:25)
at weblogic.rmi.internal.OIDManager.sweep(OIDManager.java:334)
at weblogic.rmi.internal.DGCServerImpl.trigger(DGCServerImpl.java:131)
at weblogic.time.common.internal.ScheduledTrigger.executeLocally(ScheduledTrigger.java:209)
at weblogic.time.common.internal.ScheduledTrigger.execute(ScheduledTrigger.java:203)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:130)
"ExecuteThread-11" daemon prio=1 tid=0x8e506c70 nid=0x32c1 waiting on monitor [0x955fe000..0x955febbc]
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:415)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
"ExecuteThread-10" daemon prio=1 tid=0x8e506218 nid=0x32c1 waiting for monitor entry [0x94dfe000..0x94dfec3c]
at java.util.Hashtable.getEnumeration(Hashtable.java:520)
at java.util.Hashtable.keys(Hashtable.java:215)
at weblogic.servlet.internal.session.MemorySessionContextImpl.getIds(MemorySessionContextImpl.java:21)
at weblogic.servlet.internal.session.SessionContext$SessionInvalidator.invalidateSessions(SessionContext.java:508)
at weblogic.servlet.internal.session.SessionContext$SessionInvalidator.trigger(SessionContext.java:491)
at weblogic.time.common.internal.ScheduledTrigger.executeLocally(ScheduledTrigger.java:209)
at weblogic.time.common.internal.ScheduledTrigger.execute(ScheduledTrigger.java:203)
at weblogic.time.server.ScheduledTrigger.execute(ScheduledTrigger.java:60)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:130)
"ExecuteThread-9" daemon prio=1 tid=0x8e503b10 nid=0x32c1 waiting for monitor entry [0x945fe000..0x945fecbc]
at java.lang.Class.newInstance0(Native Method)
at java.lang.Class.newInstance(Class.java:232)
at sun.io.Converters.newConverter(Converters.java:115)
at sun.io.Converters.newDefaultConverter(Converters.java:206)
at sun.io.CharToByteConverter.getDefault(CharToByteConverter.java:50)
at java.lang.String.getBytes(String.java:751)
at java.io.UnixFileSystem.list(Native Method)
at java.io.File.list(File.java:769)
at weblogic.ejb.internal.StatefulSessionSweeper.trigger(StatefulSessionSweeper.java:65)
at weblogic.time.common.internal.ScheduledTrigger.executeLocally(ScheduledTrigger.java:209)
at weblogic.time.common.internal.ScheduledTrigger.execute(ScheduledTrigger.java:203)
at weblogic.time.server.ScheduledTrigger.execute(ScheduledTrigger.java:60)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:130)
"ExecuteThread-8" daemon prio=1 tid=0x8e503178 nid=0x32c1 waiting on monitor [0x93dfe000..0x93dfed3c]
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:415)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
"ExecuteThread-7" daemon prio=1 tid=0x8e500ed8 nid=0x32c1 waiting on monitor [0x935fe000..0x935fedbc]
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:415)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
"ExecuteThread-6" daemon prio=1 tid=0x8e505330 nid=0x32c1 waiting on monitor [0x92dfe000..0x92dfee3c]
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:415)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
"ExecuteThread-5" daemon prio=1 tid=0x8e504dc0 nid=0x32c1 waiting on monitor [0x925fe000..0x925feebc]
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:415)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
"ExecuteThread-4" daemon prio=1 tid=0x8e504b98 nid=0x32c1 waiting on monitor [0x91dfe000..0x91dfef3c]
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:415)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
"ExecuteThread-3" daemon prio=1 tid=0x8e5049a0 nid=0x32c1 waiting on monitor [0x915fe000..0x915fefbc]
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:415)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
"ExecuteThread-2" daemon prio=1 tid=0x8e5016e0 nid=0x32c1 waiting on monitor [0x90dfe000..0x90dff03c]
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:415)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
"ExecuteThread-1" daemon prio=1 tid=0x8e502358 nid=0x32c1 waiting on monitor [0x905fe000..0x905ff0bc]
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:415)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
"ExecuteThread-0" daemon prio=1 tid=0x8e502190 nid=0x32c1 waiting on monitor [0x8fdff000..0x8fdff13c]
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:415)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
"TimeEventGenerator" daemon prio=1 tid=0x8e5057a8 nid=0x32c1 waiting on monitor [0x8f5ff000..0x8f5ff1bc]
at java.lang.Object.wait(Native Method)
at weblogic.time.common.internal.TimeTable.snooze(TimeTable.java:279)
at weblogic.time.common.internal.TimeEventGenerator.run(TimeEventGenerator.java:141)
at java.lang.Thread.run(Thread.java:479)
"SpinnerRandomSource" daemon prio=1 tid=0x8e501f48 nid=0x32c1 waiting on monitor [0x8edff000..0x8edff23c]
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:415)
at weblogic.security.SpinnerThread.stopSpinning(SpinnerRandomBitsSource.java:104)
at weblogic.security.SpinnerThread.run(SpinnerRandomBitsSource.java:121)
"Signal Dispatcher" daemon prio=1 tid=0x80bb128 nid=0x32c1 waiting on monitor [0..0]
"Finalizer" daemon prio=1 tid=0x80b42c0 nid=0x32c1 waiting on monitor [0x8993f000..0x8993f53c]
at java.lang.Object.wait(Native Method)
at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:103)
at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:118)
at java.lang.ref.Finalizer$FinalizerThread.run(Finalizer.java:157)
"Reference Handler" daemon prio=1 tid=0x80b3f98 nid=0x32c1 waiting on monitor [0x8913f000..0x8913f5bc]
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:415)
at java.lang.ref.Reference$ReferenceHandler.run(Reference.java:105)
"main" prio=1 tid=0x804eab0 nid=0x32c1 waiting on monitor [0xbfffb000..0xbfffbb04]
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:415)
at weblogic.t3.srvr.T3Srvr.waitForDeath(T3Srvr.java:1958)
at java.lang.reflect.Method.invoke(Native Method)
at weblogic.Server.startServerDynamically(Server.java:148)
at weblogic.Server.main(Server.java:97)
at weblogic.Server.main(Server.java:58)
"VM Thread" prio=1 tid=0x80b3710 nid=0x32c1 runnable
"VM Periodic Task Thread" prio=1 tid=0x80b9e10 nid=0x32c1 waiting on monitor
"Suspend Checker Thread" prio=1 tid=0x80ba728 nid=0x32c1 runnable

Warren,
If your server process exceeds maximum allowed number of open file handles,
you may see something like that. Try to run netstat/lsof to check if there are
runaway filehandles. If it's the case, set ulimit - n 4096 from your weblogic
startup script.
Regards,
Slava Imeshev
"Warren L. Habib" <[email protected]> wrote in message news:11980943.1096314065390.JavaMail.root@jserv5...
I realize this must seem a tedious and out-of-date topic but we are still on 5.1 so...
We have a large application that will be going along fine for several hours or even days and then mysteriously just lock up. Itcan usually be resuscitated using kill -3. I have pasted in the thread dump below, and I can supply numerous more thread dumps if
you are interested. Here are the particulars, first:
>
Weblogic Server 5.1 running SP 12
Running Java 1.3.1_10
Running on Dell Xeon servers (1650/2650) with a lot of RAM and running RedHat Linux (v. 9)
Talking to Oracle 9i database (9.2.0.4) using both the latest (9.2.0.5) and older (9.0.x) Oracle JDBC driver
We have examined every option we could find based on earlier postings, including adjusting the weblogic.system.executeThreadCountto match the # of JDBC connections (saw that somehwere) and also increasing the # in weblogic.system.jmsThreadCount above the
default of zero.
>
It doesn't crash all the time, but just eliminating these once in a blue moon situations would be desirable.
27 Sep 2004 15:00:20,594 | DEBUG | log | AtmQueueAction | doGetData | [ExecuteThread-23] | no page in req params
Full thread dump:
"process forker" daemon prio=1 tid=0x8566ed8 nid=0x32c1 waiting on monitor [0xa4f7f000..0xa4f7fd3c]
at java.lang.Object.wait(Native Method)
at java.lang.UNIXProcessForker.run(Native Method)
at java.lang.Thread.run(Thread.java:479)
"process reaper" daemon prio=1 tid=0x826f610 nid=0x32c1 runnable [0xa477f000..0xa477fdbc]
at java.lang.UNIXProcessReaper.run(Native Method)
at java.lang.Thread.run(Thread.java:479)
"HighPriority TimeEventGenerator" daemon prio=1 tid=0x8283270 nid=0x32c1 waiting on monitor [0xa25fe000..0xa25feebc]
at java.lang.Object.wait(Native Method)
at weblogic.time.common.internal.TimeTable.snooze(TimeTable.java:279)
at weblogic.time.common.internal.TimeEventGenerator.run(TimeEventGenerator.java:141)
at java.lang.Thread.run(Thread.java:479)
"ListenThread" prio=1 tid=0xa2ba2108 nid=0x32c1 waiting for monitor entry [0xa3f7f000..0xa3f7fe3c]
at java.net.InetAddress.getHostAddress(InetAddress.java:217)
at java.net.ServerSocket.implAccept(ServerSocket.java:242)
at java.net.ServerSocket.accept(ServerSocket.java:217)
at weblogic.socket.WeblogicServerSocket.accept(WeblogicServerSocket.java:26)
at weblogic.t3.srvr.ListenThread.run(ListenThread.java:325)
"NBExecuteThread-1" daemon prio=1 tid=0x8e516c80 nid=0x32c1 waiting on monitor [0xa1dfe000..0xa1dfef3c]
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:415)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
"NBExecuteThread-0" daemon prio=1 tid=0x8e5169f0 nid=0x32c1 waiting on monitor [0xa15fe000..0xa15fefbc]
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:415)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
"ExecuteThread-34" daemon prio=1 tid=0x8e515f60 nid=0x32c1 waiting for monitor entry [0xa0dfe000..0xa0dff03c]
at weblogic.utils.collections.NumericHashtable.get(NumericHashtable.java:148)
at weblogic.socket.PosixSocketMuxer.processSockets(PosixSocketMuxer.java:322)
at weblogic.socket.SocketReaderRequest.execute(SocketReaderRequest.java:42)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:130)
"ExecuteThread-33" daemon prio=1 tid=0x8e5154d0 nid=0x32c1 waiting for monitor entry [0xa05fe000..0xa05ff0bc]
at weblogic.utils.collections.NumericHashtable.get(NumericHashtable.java:148)
at weblogic.socket.PosixSocketMuxer.processSockets(PosixSocketMuxer.java:322)
at weblogic.socket.SocketReaderRequest.execute(SocketReaderRequest.java:42)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:130)
"ExecuteThread-32" daemon prio=1 tid=0x8e514a40 nid=0x32c1 waiting for monitor entry [0x9fdfe000..0x9fdff13c]
at weblogic.utils.collections.NumericHashtable.get(NumericHashtable.java:148)
at weblogic.socket.PosixSocketMuxer.processSockets(PosixSocketMuxer.java:322)
at weblogic.socket.SocketReaderRequest.execute(SocketReaderRequest.java:42)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:130)
"ExecuteThread-31" daemon prio=1 tid=0x8e513fb0 nid=0x32c1 waiting on monitor [0x9f5ff000..0x9f5ff1bc]
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:415)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
"ExecuteThread-30" daemon prio=1 tid=0x8e513520 nid=0x32c1 waiting on monitor [0x9edff000..0x9edff23c]
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:415)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
"ExecuteThread-29" daemon prio=1 tid=0x8e512a90 nid=0x32c1 waiting for monitor entry [0x9e5ff000..0x9e5ff2bc]
at weblogic.rmi.internal.DGCClientHelper.getHeartBeats(DGCClientHelper.java:39)
at weblogic.rmi.internal.DGCClientImpl.mark(DGCClientImpl.java:159)
at weblogic.rmi.internal.DGCClientImpl.trigger(DGCClientImpl.java:145)
at weblogic.time.common.internal.ScheduledTrigger.executeLocally(ScheduledTrigger.java:209)
at weblogic.time.common.internal.ScheduledTrigger.execute(ScheduledTrigger.java:203)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:130)
"ExecuteThread-28" daemon prio=1 tid=0x8e512000 nid=0x32c1 waiting on monitor [0x9ddff000..0x9ddff33c]
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:415)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
"ExecuteThread-27" daemon prio=1 tid=0x8e511570 nid=0x32c1 waiting on monitor [0x9d5ff000..0x9d5ff3bc]
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:415)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
"ExecuteThread-26" daemon prio=1 tid=0x8e510ae0 nid=0x32c1 waiting for monitor entry [0x9cdff000..0x9cdff43c]
at weblogic.jms.server.JDBCStore.getConnectionNoTx(JDBCStore.java:1381)
at weblogic.jms.server.JDBCStore.purgeMessages(JDBCStore.java:1248)
at weblogic.jms.server.JDBCStore.trigger(JDBCStore.java:975)
at weblogic.time.common.internal.ScheduledTrigger.executeLocally(ScheduledTrigger.java:209)
at weblogic.time.common.internal.ScheduledTrigger.execute(ScheduledTrigger.java:203)
at weblogic.time.server.ScheduledTrigger.execute(ScheduledTrigger.java:60)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:130)
"ExecuteThread-25" daemon prio=1 tid=0x8e510050 nid=0x32c1 waiting for monitor entry [0x9c5fe000..0x9c5ff4bc]
at oracle.net.ns.Packet.createBuffer(Unknown Source)
at oracle.net.ns.Packet.receive(Unknown Source)
at oracle.net.ns.NetInputStream.getNextPacket(Unknown Source)
at oracle.net.ns.NetInputStream.read(Unknown Source)
at oracle.net.ns.NetInputStream.read(Unknown Source)
at oracle.net.ns.NetInputStream.read(Unknown Source)
at oracle.jdbc.ttc7.MAREngine.unmarshalUB1(MAREngine.java:733)
at oracle.jdbc.ttc7.MAREngine.unmarshalSB1(MAREngine.java:705)
at oracle.jdbc.ttc7.Oall7.receive(Oall7.java:373)
at oracle.jdbc.ttc7.TTC7Protocol.doOall7(TTC7Protocol.java:1477)
at oracle.jdbc.ttc7.TTC7Protocol.parseExecuteDescribe(TTC7Protocol.java:677)
at oracle.jdbc.driver.OracleStatement.doExecuteQuery(OracleStatement.java:2311)
at oracle.jdbc.driver.OracleStatement.doExecuteWithTimeout(OracleStatement.java:2554)
at oracle.jdbc.driver.OraclePreparedStatement.doScrollPstmtExecuteUpdate(OraclePreparedStatement.java:3815)
at oracle.jdbc.driver.OraclePreparedStatement.executeUpdate(OraclePreparedStatement.java:486)
at oracle.jdbc.driver.OraclePreparedStatement.executeQuery(OraclePreparedStatement.java:382)
at weblogic.jdbc20.pool.PreparedStatement.executeQuery(PreparedStatement.java:35)
at weblogic.jdbc20.rmi.internal.PreparedStatementImpl.executeQuery(PreparedStatementImpl.java:46)
at weblogic.jdbc20.rmi.SerialPreparedStatement.executeQuery(SerialPreparedStatement.java:40)
at com.solbright.ui.XsuQueueAccessor.createOracleXMLQuery(XsuQueueAccessor.java:35)
at com.solbright.ui.XsuQueueAccessor.<init>(XsuQueueAccessor.java:25)
at com.solbright.adtraffic.AtmPersistentQueueAccessor.<init>(AtmPersistentQueueAccessor.java:65)
at com.solbright.adtraffic.servlet.AtmQueueFrame.createNewQueueAccessor(AtmQueueFrame.java:113)
at com.solbright.adtraffic.servlet.AtmQueueFrame.doGetData(AtmQueueFrame.java:27)
at com.solbright.ui.servlet.AdSuiteMediatorServlet.doRequest(AdSuiteMediatorServlet.java:294)
at com.solbright.ui.servlet.AdSuiteMediatorServlet.doProcess(AdSuiteMediatorServlet.java:79)
at com.solbright.ui.servlet.AdSuiteMediatorServlet.doGet(AdSuiteMediatorServlet.java:47)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:740)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:865)
at weblogic.servlet.internal.ServletStubImpl.invokeServlet(ServletStubImpl.java:120)
at weblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletContextImpl.java:945)
at weblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletContextImpl.java:909)
at weblogic.servlet.internal.ServletContextManager.invokeServlet(ServletContextManager.java:269)
at weblogic.socket.MuxableSocketHTTP.invokeServlet(MuxableSocketHTTP.java:392)
at weblogic.socket.MuxableSocketHTTP.execute(MuxableSocketHTTP.java:274)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:130)
"ExecuteThread-24" daemon prio=1 tid=0x8e50f5c0 nid=0x32c1 waiting on monitor [0x9bdff000..0x9bdff53c]
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:415)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
"ExecuteThread-23" daemon prio=1 tid=0x8e50eb30 nid=0x32c1 waiting for monitor entry [0x9b5fe000..0x9b5ff5bc]
at java.lang.StringBuffer.expandCapacity(StringBuffer.java:197)
at java.lang.StringBuffer.append(StringBuffer.java:396)
at java.io.StringWriter.write(StringWriter.java:89)
at java.io.PrintWriter.newLine(PrintWriter.java:231)
at java.io.PrintWriter.println(PrintWriter.java:382)
at java.io.PrintWriter.println(PrintWriter.java:479)
at java.lang.Throwable.printStackTrace0(Native Method)
at java.lang.Throwable.printStackTrace(Throwable.java:204)
at org.log4j.LoggingEvent$LocationInfo.<init>(LoggingEvent.java:193)
at org.log4j.LoggingEvent.setLocationInformation(LoggingEvent.java:125)
at org.log4j.helpers.PatternParser$ClassNamePatternConverter.getFullyQualifiedName(PatternParser.java:474)
at org.log4j.helpers.PatternParser$NamedPatternConverter.convert(PatternParser.java:447)
at org.log4j.helpers.PatternConverter.format(PatternConverter.java:48)
at org.log4j.PatternLayout.format(PatternLayout.java:430)
at org.log4j.FileAppender.doAppend(FileAppender.java:202)
at org.log4j.Category.callAppenders(Category.java:147)
at org.log4j.Category.debug(Category.java:194)
at com.solbright.adtraffic.servlet.AtmQueueAction.doGetData(AtmQueueAction.java:36)
at com.solbright.ui.servlet.AdSuiteMediatorServlet.doRequest(AdSuiteMediatorServlet.java:294)
at com.solbright.ui.servlet.AdSuiteMediatorServlet.doProcess(AdSuiteMediatorServlet.java:79)
at com.solbright.ui.servlet.AdSuiteMediatorServlet.doGet(AdSuiteMediatorServlet.java:47)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:740)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:865)
at weblogic.servlet.internal.ServletStubImpl.invokeServlet(ServletStubImpl.java:120)
at weblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletContextImpl.java:945)
at weblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletContextImpl.java:909)
at weblogic.servlet.internal.ServletContextManager.invokeServlet(ServletContextManager.java:269)
at weblogic.socket.MuxableSocketHTTP.invokeServlet(MuxableSocketHTTP.java:392)
at weblogic.socket.MuxableSocketHTTP.execute(MuxableSocketHTTP.java:274)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:130)
"ExecuteThread-22" daemon prio=1 tid=0x8e50e0a0 nid=0x32c1 waiting on monitor [0x9adff000..0x9adff63c]
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:415)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
"ExecuteThread-21" daemon prio=1 tid=0x8e50d610 nid=0x32c1 waiting for monitor entry [0x9a5ff000..0x9a5ff6bc]
at java.lang.Object.clone(Native Method)
at java.util.Hashtable.clone(Hashtable.java:471)
at weblogic.t3.srvr.Scavenger.trigger(Scavenger.java:83)
at weblogic.time.common.internal.ScheduledTrigger.executeLocally(ScheduledTrigger.java:209)
at weblogic.time.common.internal.ScheduledTrigger.execute(ScheduledTrigger.java:203)
at weblogic.time.server.ScheduledTrigger.execute(ScheduledTrigger.java:60)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:130)
"ExecuteThread-20" daemon prio=1 tid=0x8e50cb80 nid=0x32c1 waiting for monitor entry [0x99dfe000..0x99dfe73c]
at java.lang.Object.clone(Native Method)
at weblogic.utils.collections.NumericHashtable.clone(NumericHashtable.java:267)
at weblogic.socket.PosixSocketMuxer.trigger(PosixSocketMuxer.java:153)
at weblogic.time.common.internal.ScheduledTrigger.executeLocally(ScheduledTrigger.java:209)
at weblogic.time.common.internal.ScheduledTrigger.execute(ScheduledTrigger.java:203)
at weblogic.time.server.ScheduledTrigger.execute(ScheduledTrigger.java:60)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:130)
"ExecuteThread-19" daemon prio=1 tid=0x8e50c0f0 nid=0x32c1 waiting on monitor [0x995fe000..0x995fe7bc]
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:415)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
"ExecuteThread-18" daemon prio=1 tid=0x8e50b660 nid=0x32c1 waiting on monitor [0x98dfe000..0x98dfe83c]
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:415)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
"ExecuteThread-17" daemon prio=1 tid=0x8e50abd0 nid=0x32c1 waiting on monitor [0x985fe000..0x985fe8bc]
at java.util.HashMap.put(HashMap.java:351)
at org.jdom.transform.JDOMSource$DocumentReader.<init>(JDOMSource.java:436)
at org.jdom.transform.JDOMSource.getXMLReader(JDOMSource.java:224)
at org.apache.xalan.transformer.TransformerImpl.transform(TransformerImpl.java:531)
at org.apache.xalan.transformer.TransformerImpl.transform(TransformerImpl.java:1174)
at com.solbright.ui.UiXslTransformer.transform(UiXslTransformer.java:39)
at com.solbright.ui.servlet.AdSuiteMediatorServlet.doShowViewImpl(AdSuiteMediatorServlet.java:419)
at com.solbright.ui.servlet.AdSuiteMediatorServlet.doShowView(AdSuiteMediatorServlet.java:394)
at com.solbright.adtraffic.servlet.AdTrafficMediatorServlet.doShowView(AdTrafficMediatorServlet.java:80)
at com.solbright.ui.servlet.AdSuiteMediatorServlet.doRequest(AdSuiteMediatorServlet.java:307)
at com.solbright.ui.servlet.AdSuiteMediatorServlet.doProcess(AdSuiteMediatorServlet.java:79)
at com.solbright.ui.servlet.AdSuiteMediatorServlet.doGet(AdSuiteMediatorServlet.java:47)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:740)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:865)
at weblogic.servlet.internal.ServletStubImpl.invokeServlet(ServletStubImpl.java:120)
at weblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletContextImpl.java:945)
at weblogic.servlet.internal.ServletContextImpl.invokeServlet(ServletContextImpl.java:909)
at weblogic.servlet.internal.ServletContextManager.invokeServlet(ServletContextManager.java:269)
at weblogic.socket.MuxableSocketHTTP.invokeServlet(MuxableSocketHTTP.java:392)
at weblogic.socket.MuxableSocketHTTP.execute(MuxableSocketHTTP.java:274)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:130)
"ExecuteThread-16" daemon prio=1 tid=0x8e50a140 nid=0x32c1 waiting on monitor [0x97dfe000..0x97dfe93c]
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:415)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
"ExecuteThread-15" daemon prio=1 tid=0x8e5096b0 nid=0x32c1 waiting on monitor [0x975fe000..0x975fe9bc]
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:415)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
"ExecuteThread-14" daemon prio=1 tid=0x8e508c20 nid=0x32c1 waiting on monitor [0x96dfe000..0x96dfea3c]
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:415)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
"ExecuteThread-13" daemon prio=1 tid=0x8e508190 nid=0x32c1 waiting on monitor [0x965fe000..0x965feabc]
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:415)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
"ExecuteThread-12" daemon prio=1 tid=0x8e507700 nid=0x32c1 waiting for monitor entry [0x95dfe000..0x95dfeb3c]
at weblogic.utils.KeyTable.elements(KeyTable.java:79)
at weblogic.utils.SyncKeyTable.elements(SyncKeyTable.java:25)
at weblogic.rmi.internal.OIDManager.sweep(OIDManager.java:334)
at weblogic.rmi.internal.DGCServerImpl.trigger(DGCServerImpl.java:131)
at weblogic.time.common.internal.ScheduledTrigger.executeLocally(ScheduledTrigger.java:209)
at weblogic.time.common.internal.ScheduledTrigger.execute(ScheduledTrigger.java:203)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:130)
"ExecuteThread-11" daemon prio=1 tid=0x8e506c70 nid=0x32c1 waiting on monitor [0x955fe000..0x955febbc]
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:415)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
"ExecuteThread-10" daemon prio=1 tid=0x8e506218 nid=0x32c1 waiting for monitor entry [0x94dfe000..0x94dfec3c]
at java.util.Hashtable.getEnumeration(Hashtable.java:520)
at java.util.Hashtable.keys(Hashtable.java:215)
at weblogic.servlet.internal.session.MemorySessionContextImpl.getIds(MemorySessionContextImpl.java:21)
at weblogic.servlet.internal.session.SessionContext$SessionInvalidator.invalidateSessions(SessionContext.java:508)
at weblogic.servlet.internal.session.SessionContext$SessionInvalidator.trigger(SessionContext.java:491)
at weblogic.time.common.internal.ScheduledTrigger.executeLocally(ScheduledTrigger.java:209)
at weblogic.time.common.internal.ScheduledTrigger.execute(ScheduledTrigger.java:203)
at weblogic.time.server.ScheduledTrigger.execute(ScheduledTrigger.java:60)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:130)
"ExecuteThread-9" daemon prio=1 tid=0x8e503b10 nid=0x32c1 waiting for monitor entry [0x945fe000..0x945fecbc]
at java.lang.Class.newInstance0(Native Method)
at java.lang.Class.newInstance(Class.java:232)
at sun.io.Converters.newConverter(Converters.java:115)
at sun.io.Converters.newDefaultConverter(Converters.java:206)
at sun.io.CharToByteConverter.getDefault(CharToByteConverter.java:50)
at java.lang.String.getBytes(String.java:751)
at java.io.UnixFileSystem.list(Native Method)
at java.io.File.list(File.java:769)
at weblogic.ejb.internal.StatefulSessionSweeper.trigger(StatefulSessionSweeper.java:65)
at weblogic.time.common.internal.ScheduledTrigger.executeLocally(ScheduledTrigger.java:209)
at weblogic.time.common.internal.ScheduledTrigger.execute(ScheduledTrigger.java:203)
at weblogic.time.server.ScheduledTrigger.execute(ScheduledTrigger.java:60)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:130)
"ExecuteThread-8" daemon prio=1 tid=0x8e503178 nid=0x32c1 waiting on monitor [0x93dfe000..0x93dfed3c]
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:415)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
"ExecuteThread-7" daemon prio=1 tid=0x8e500ed8 nid=0x32c1 waiting on monitor [0x935fe000..0x935fedbc]
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:415)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
"ExecuteThread-6" daemon prio=1 tid=0x8e505330 nid=0x32c1 waiting on monitor [0x92dfe000..0x92dfee3c]
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:415)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
"ExecuteThread-5" daemon prio=1 tid=0x8e504dc0 nid=0x32c1 waiting on monitor [0x925fe000..0x925feebc]
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:415)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
"ExecuteThread-4" daemon prio=1 tid=0x8e504b98 nid=0x32c1 waiting on monitor [0x91dfe000..0x91dfef3c]
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:415)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
"ExecuteThread-3" daemon prio=1 tid=0x8e5049a0 nid=0x32c1 waiting on monitor [0x915fe000..0x915fefbc]
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:415)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
"ExecuteThread-2" daemon prio=1 tid=0x8e5016e0 nid=0x32c1 waiting on monitor [0x90dfe000..0x90dff03c]
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:415)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
"ExecuteThread-1" daemon prio=1 tid=0x8e502358 nid=0x32c1 waiting on monitor [0x905fe000..0x905ff0bc]
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:415)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
"ExecuteThread-0" daemon prio=1 tid=0x8e502190 nid=0x32c1 waiting on monitor [0x8fdff000..0x8fdff13c]
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:415)
at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:100)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:127)
"TimeEventGenerator" daemon prio=1 tid=0x8e5057a8 nid=0x32c1 waiting on monitor [0x8f5ff000..0x8f5ff1bc]
at java.lang.Object.wait(Native Method)
at weblogic.time.common.internal.TimeTable.snooze(TimeTable.java:279)
at weblogic.time.common.internal.TimeEventGenerator.run(TimeEventGenerator.java:141)
at java.lang.Thread.run(Thread.java:479)
"SpinnerRandomSource" daemon prio=1 tid=0x8e501f48 nid=0x32c1 waiting on monitor [0x8edff000..0x8edff23c]
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:415)
at weblogic.security.SpinnerThread.stopSpinning(SpinnerRandomBitsSource.java:104)
at weblogic.security.SpinnerThread.run(SpinnerRandomBitsSource.java:121)
"Signal Dispatcher" daemon prio=1 tid=0x80bb128 nid=0x32c1 waiting on monitor [0..0]
"Finalizer" daemon prio=1 tid=0x80b42c0 nid=0x32c1 waiting on monitor [0x8993f000..0x8993f53c]
at java.lang.Object.wait(Native Method)
at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:103)
at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:118)
at java.lang.ref.Finalizer$FinalizerThread.run(Finalizer.java:157)
"Reference Handler" daemon prio=1 tid=0x80b3f98 nid=0x32c1 waiting on monitor [0x8913f000..0x8913f5bc]
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:415)
at java.lang.ref.Reference$ReferenceHandler.run(Reference.java:105)
"main" prio=1 tid=0x804eab0 nid=0x32c1 waiting on monitor [0xbfffb000..0xbfffbb04]
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:415)
at weblogic.t3.srvr.T3Srvr.waitForDeath(T3Srvr.java:1958)
at java.lang.reflect.Method.invoke(Native Method)
at weblogic.Server.startServerDynamically(Server.java:148)
at weblogic.Server.main(Server.java:97)
at weblogic.Server.main(Server.java:58)
"VM Thread" prio=1 tid=0x80b3710 nid=0x32c1 runnable
"VM Periodic Task Thread" prio=1 tid=0x80b9e10 nid=0x32c1 waiting on monitor
"Suspend Checker Thread" prio=1 tid=0x80ba728 nid=0x32c1 runnable

Weblogic server is not responding when executing pl/sql procedure from jdev

Dear Sir,
i am using jdeveloper11g and oracle database with oracle spatial and i wrote procedure in database and executed perfect from sql plus
but same procedure when i am trying to execute from jdeveloper its like hanging and giving following error here i am posting my jdeveloper code
and error
public String cb1_action() {
// Add event code here...
String tbName = (String)FacesContext.getCurrentInstance().getApplication().createValueBinding("#{bindings.tb}").getValue(FacesContext.getCurrentInstance());
String colName = (String)FacesContext.getCurrentInstance().getApplication().createValueBinding("#{bindings.col}").getValue(FacesContext.getCurrentInstance());
try {
Context cnx = new InitialContext();
Class.forName("oracle.jdbc.OracleDriver");
RmiDataSource rds =
(RmiDataSource)cnx.lookup("java:comp/env/jdbc/db1DS");
//(RmiDataSource)cnx.lookup("env/jdbc/db1DS");
Connection cn = rds.getConnection();
System.out.println("table name " + tbName);
System.out.println("column name " + colName);
PreparedStatement delStmt = cn.prepareStatement("delete from geometry_errors");
delStmt.execute();
System.out.println("delStmt = " + delStmt);
cn.commit();
delStmt.close();
CallableStatement ps = cn.prepareCall("{call validate_geom(?,?)}");
ps.setString(1, tbName);
ps.setString(2, colName);
ps.execute();
ps.close();
cn.close();
cnx.close();
System.out.println("Done validating geom ....");
} catch (Exception sqle) {
sqle.printStackTrace();
BindingContainer bc = getBindings();
OperationBinding oper = bc.getOperationBinding("Execute");
oper.execute();
System.out.println("done.....");
return null;
Target URL -- http://127.0.0.1:7101/kabtest-ViewController1-context-root/faces/test1.jsp
table name JEDDAH_SECTORS_8307
column name GEOM
<Jul 29, 2010 1:22:49 PM AST> <Error> <WebLogicServer> <BEA-000337> <[STUCK] ExecuteThread: '5' for queue: 'weblogic.kernel.Default (self-tuning)' has been busy for "621" seconds working on the request "weblogic.servlet.internal.ServletRequestImpl@13a7ecf[
POST /kabtest-ViewController1-context-root/faces/test1.jsp?_adf.ctrl-state=xumczak86_4 HTTP/1.1
User-Agent: Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.2.8) Gecko/20100722 Firefox/3.6.8
Accept: text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8
Accept-Language: en-us,en;q=0.5
Accept-Encoding: gzip,deflate
Accept-Charset: ISO-8859-1,utf-8;q=0.7,*;q=0.7
Keep-Alive: 115
Connection: keep-alive
Referer: http://127.0.0.1:7101/kabtest-ViewController1-context-root/faces/test1.jsp?_afrLoop=1305015256967&_afrWindowMode=0&_adf.ctrl-state=xumczak86_4
Cookie: JSESSIONID=7qmnMRTWld4BzJDnLB4BF1hvxgl0NYTJrg9lT3VnWNYJpCmzGYJm!-1863071826
Content-Type: application/x-www-form-urlencoded
Content-Length: 247
]", which is more than the configured time (StuckThreadMaxTime) of "600" seconds. Stack trace:
     java.net.SocketInputStream.socketRead0(Native Method)
     java.net.SocketInputStream.read(SocketInputStream.java:129)
     oracle.net.ns.Packet.receive(Packet.java:293)
     oracle.net.ns.DataPacket.receive(DataPacket.java:92)
     oracle.net.ns.NetInputStream.getNextPacket(NetInputStream.java:174)
     oracle.net.ns.NetInputStream.read(NetInputStream.java:119)
     oracle.net.ns.NetInputStream.read(NetInputStream.java:94)
     oracle.net.ns.NetInputStream.read(NetInputStream.java:79)
     oracle.jdbc.driver.T4CSocketInputStreamWrapper.readNextPacket(T4CSocketInputStreamWrapper.java:122)
     oracle.jdbc.driver.T4CSocketInputStreamWrapper.read(T4CSocketInputStreamWrapper.java:78)
     oracle.jdbc.driver.T4CMAREngine.unmarshalUB1(T4CMAREngine.java:1040)
     oracle.jdbc.driver.T4CMAREngine.unmarshalSB1(T4CMAREngine.java:1016)
     oracle.jdbc.driver.T4C8Oall.receive(T4C8Oall.java:589)
     oracle.jdbc.driver.T4CPreparedStatement.doOall8(T4CPreparedStatement.java:194)
     oracle.jdbc.driver.T4CPreparedStatement.executeForRows(T4CPreparedStatement.java:953)
     oracle.jdbc.driver.OracleStatement.doExecuteWithTimeout(OracleStatement.java:1223)
     oracle.jdbc.driver.OraclePreparedStatement.executeInternal(OraclePreparedStatement.java:3386)
     oracle.jdbc.driver.OraclePreparedStatement.execute(OraclePreparedStatement.java:3487)
     oracle.jdbc.driver.OraclePreparedStatementWrapper.execute(OraclePreparedStatementWrapper.java:1374)
     weblogic.jdbc.wrapper.PreparedStatement.execute(PreparedStatement.java:98)
     view.backing.Test1.cb1_action(Test1.java:132)
     sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
     sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
     sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
     java.lang.reflect.Method.invoke(Method.java:597)
     com.sun.el.parser.AstValue.invoke(AstValue.java:157)
     com.sun.el.MethodExpressionImpl.invoke(MethodExpressionImpl.java:283)
     org.apache.myfaces.trinidad.component.MethodExpressionMethodBinding.invoke(MethodExpressionMethodBinding.java:46)
     com.sun.faces.application.ActionListenerImpl.processAction(ActionListenerImpl.java:102)
     org.apache.myfaces.trinidad.component.UIXCommand.broadcast(UIXCommand.java:190)
     javax.faces.component.UIViewRoot.broadcastEvents(UIViewRoot.java:475)
     javax.faces.component.UIViewRoot.processApplication(UIViewRoot.java:756)
     oracle.adfinternal.view.faces.lifecycle.LifecycleImpl._invokeApplication(LifecycleImpl.java:698)
     oracle.adfinternal.view.faces.lifecycle.LifecycleImpl._executePhase(LifecycleImpl.java:285)
     oracle.adfinternal.view.faces.lifecycle.LifecycleImpl.execute(LifecycleImpl.java:177)
     javax.faces.webapp.FacesServlet.service(FacesServlet.java:265)
     weblogic.servlet.internal.StubSecurityHelper$ServletServiceAction.run(StubSecurityHelper.java:227)
     weblogic.servlet.internal.StubSecurityHelper.invokeServlet(StubSecurityHelper.java:125)
     weblogic.servlet.internal.ServletStubImpl.execute(ServletStubImpl.java:292)
     weblogic.servlet.internal.TailFilter.doFilter(TailFilter.java:26)
     weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:56)
     oracle.adf.model.servlet.ADFBindingFilter.doFilter(ADFBindingFilter.java:191)
     weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:56)
     oracle.adfinternal.view.faces.webapp.rich.RegistrationFilter.doFilter(RegistrationFilter.java:97)
     org.apache.myfaces.trinidadinternal.webapp.TrinidadFilterImpl$FilterListChain.doFilter(TrinidadFilterImpl.java:420)
     oracle.adfinternal.view.faces.activedata.AdsFilter.doFilter(AdsFilter.java:60)
     org.apache.myfaces.trinidadinternal.webapp.TrinidadFilterImpl$FilterListChain.doFilter(TrinidadFilterImpl.java:420)
     org.apache.myfaces.trinidadinternal.webapp.TrinidadFilterImpl._doFilterImpl(TrinidadFilterImpl.java:247)
     org.apache.myfaces.trinidadinternal.webapp.TrinidadFilterImpl.doFilter(TrinidadFilterImpl.java:157)
     org.apache.myfaces.trinidad.webapp.TrinidadFilter.doFilter(TrinidadFilter.java:92)
     weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:56)
     oracle.security.jps.ee.http.JpsAbsFilter$1.run(JpsAbsFilter.java:94)
     java.security.AccessController.doPrivileged(Native Method)
     oracle.security.jps.util.JpsSubject.doAsPrivileged(JpsSubject.java:313)
     oracle.security.jps.ee.util.JpsPlatformUtil.runJaasMode(JpsPlatformUtil.java:413)
     oracle.security.jps.ee.http.JpsAbsFilter.doFilter(JpsAbsFilter.java:138)
     oracle.security.jps.ee.http.JpsFilter.doFilter(JpsFilter.java:70)
     weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:56)
     oracle.dms.wls.DMSServletFilter.doFilter(DMSServletFilter.java:326)
     weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:56)
     weblogic.servlet.internal.RequestEventsFilter.doFilter(RequestEventsFilter.java:27)
     weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:56)
     weblogic.servlet.internal.WebAppServletContext$ServletInvocationAction.run(WebAppServletContext.java:3592)
     weblogic.security.acl.internal.AuthenticatedSubject.doAs(AuthenticatedSubject.java:321)
     weblogic.security.service.SecurityManager.runAs(SecurityManager.java:121)
     weblogic.servlet.internal.WebAppServletContext.securedExecute(WebAppServletContext.java:2202)
     weblogic.servlet.internal.WebAppServletContext.execute(WebAppServletContext.java:2108)
     weblogic.servlet.internal.ServletRequestImpl.run(ServletRequestImpl.java:1432)
     weblogic.work.ExecuteThread.execute(ExecuteThread.java:201)
     weblogic.work.ExecuteThread.run(ExecuteThread.java:173)
>
<Jul 29, 2010 1:22:49 PM AST> <Notice> <Diagnostics> <BEA-320068> <Watch 'StuckThread' with severity 'Notice' on server 'DefaultServer' has triggered at Jul 29, 2010 1:22:49 PM AST. Notification details:
WatchRuleType: Log
WatchRule: (SEVERITY = 'Error') AND (MSGID = 'BEA-000337')
WatchData: DATE = Jul 29, 2010 1:22:49 PM AST SERVER = DefaultServer MESSAGE = [STUCK] ExecuteThread: '5' for queue: 'weblogic.kernel.Default (self-tuning)' has been busy for "621" seconds working on the request "weblogic.servlet.internal.ServletRequestImpl@13a7ecf[
POST /kabtest-ViewController1-context-root/faces/test1.jsp?_adf.ctrl-state=xumczak86_4 HTTP/1.1
User-Agent: Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.2.8) Gecko/20100722 Firefox/3.6.8
Accept: text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8
Accept-Language: en-us,en;q=0.5
Accept-Encoding: gzip,deflate
Accept-Charset: ISO-8859-1,utf-8;q=0.7,*;q=0.7
Keep-Alive: 115
Connection: keep-alive
Referer: http://127.0.0.1:7101/kabtest-ViewController1-context-root/faces/test1.jsp?_afrLoop=1305015256967&_afrWindowMode=0&_adf.ctrl-state=xumczak86_4
Cookie: JSESSIONID=7qmnMRTWld4BzJDnLB4BF1hvxgl0NYTJrg9lT3VnWNYJpCmzGYJm!-1863071826
Content-Type: application/x-www-form-urlencoded
Content-Length: 247
]", which is more than the configured time (StuckThreadMaxTime) of "600" seconds. Stack trace:
     java.net.SocketInputStream.socketRead0(Native Method)
     java.net.SocketInputStream.read(SocketInputStream.java:129)
     oracle.net.ns.Packet.receive(Packet.java:293)
     oracle.net.ns.DataPacket.receive(DataPacket.java:92)
     oracle.net.ns.NetInputStream.getNextPacket(NetInputStream.java:174)
     oracle.net.ns.NetInputStream.read(NetInputStream.java:119)
     oracle.net.ns.NetInputStream.read(NetInputStream.java:94)
     oracle.net.ns.NetInputStream.read(NetInputStream.java:79)
     oracle.jdbc.driver.T4CSocketInputStreamWrapper.readNextPacket(T4CSocketInputStreamWrapper.java:122)
     oracle.jdbc.driver.T4CSocketInputStreamWrapper.read(T4CSocketInputStreamWrapper.java:78)
     oracle.jdbc.driver.T4CMAREngine.unmarshalUB1(T4CMAREngine.java:1040)
     oracle.jdbc.driver.T4CMAREngine.unmarshalSB1(T4CMAREngine.java:1016)
     oracle.jdbc.driver.T4C8Oall.receive(T4C8Oall.java:589)
     oracle.jdbc.driver.T4CPreparedStatement.doOall8(T4CPreparedStatement.java:194)
     oracle.jdbc.driver.T4CPreparedStatement.executeForRows(T4CPreparedStatement.java:953)
     oracle.jdbc.driver.OracleStatement.doExecuteWithTimeout(OracleStatement.java:1223)
     oracle.jdbc.driver.OraclePreparedStatement.executeInternal(OraclePreparedStatement.java:3386)
     oracle.jdbc.driver.OraclePreparedStatement.execute(OraclePreparedStatement.java:3487)
     oracle.jdbc.driver.OraclePreparedStatementWrapper.execute(OraclePreparedStatementWrapper.java:1374)
     weblogic.jdbc.wrapper.PreparedStatement.execute(PreparedStatement.java:98)
     view.backing.Test1.cb1_action(Test1.java:132)
     sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
     sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
     sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
     java.lang.reflect.Method.invoke(Method.java:597)
     com.sun.el.parser.AstValue.invoke(AstValue.java:157)
     com.sun.el.MethodExpressionImpl.invoke(MethodExpressionImpl.java:283)
     org.apache.myfaces.trinidad.component.MethodExpressionMethodBinding.invoke(MethodExpressionMethodBinding.java:46)
     com.sun.faces.application.ActionListenerImpl.processAction(ActionListenerImpl.java:102)
     org.apache.myfaces.trinidad.component.UIXCommand.broadcast(UIXCommand.java:190)
     javax.faces.component.UIViewRoot.broadcastEvents(UIViewRoot.java:475)
     javax.faces.component.UIViewRoot.processApplication(UIViewRoot.java:756)
     oracle.adfinternal.view.faces.lifecycle.LifecycleImpl._invokeApplication(LifecycleImpl.java:698)
     oracle.adfinternal.view.faces.lifecycle.LifecycleImpl._executePhase(LifecycleImpl.java:285)
     oracle.adfinternal.view.faces.lifecycle.LifecycleImpl.execute(LifecycleImpl.java:177)
     javax.faces.webapp.FacesServlet.service(FacesServlet.java:265)
     weblogic.servlet.internal.StubSecurityHelper$ServletServiceAction.run(StubSecurityHelper.java:227)
     weblogic.servlet.internal.StubSecurityHelper.invokeServlet(StubSecurityHelper.java:125)
     weblogic.servlet.internal.ServletStubImpl.execute(ServletStubImpl.java:292)
     weblogic.servlet.internal.TailFilter.doFilter(TailFilter.java:26)
     weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:56)
     oracle.adf.model.servlet.ADFBindingFilter.doFilter(ADFBindingFilter.java:191)
     weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:56)
     oracle.adfinternal.view.faces.webapp.rich.RegistrationFilter.doFilter(RegistrationFilter.java:97)
     org.apache.myfaces.trinidadinternal.webapp.TrinidadFilterImpl$FilterListChain.doFilter(TrinidadFilterImpl.java:420)
     oracle.adfinternal.view.faces.activedata.AdsFilter.doFilter(AdsFilter.java:60)
     org.apache.myfaces.trinidadinternal.webapp.TrinidadFilterImpl$FilterListChain.doFilter(TrinidadFilterImpl.java:420)
     org.apache.myfaces.trinidadinternal.webapp.TrinidadFilterImpl._doFilterImpl(TrinidadFilterImpl.java:247)
     org.apache.myfaces.trinidadinternal.webapp.TrinidadFilterImpl.doFilter(TrinidadFilterImpl.java:157)
     org.apache.myfaces.trinidad.webapp.TrinidadFilter.doFilter(TrinidadFilter.java:92)
     weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:56)
     oracle.security.jps.ee.http.JpsAbsFilter$1.run(JpsAbsFilter.java:94)
     java.security.AccessController.doPrivileged(Native Method)
     oracle.security.jps.util.JpsSubject.doAsPrivileged(JpsSubject.java:313)
     oracle.security.jps.ee.util.JpsPlatformUtil.runJaasMode(JpsPlatformUtil.java:413)
     oracle.security.jps.ee.http.JpsAbsFilter.doFilter(JpsAbsFilter.java:138)
     oracle.security.jps.ee.http.JpsFilter.doFilter(JpsFilter.java:70)
     weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:56)
     oracle.dms.wls.DMSServletFilter.doFilter(DMSServletFilter.java:326)
     weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:56)
     weblogic.servlet.internal.RequestEventsFilter.doFilter(RequestEventsFilter.java:27)
     weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:56)
     weblogic.servlet.internal.WebAppServletContext$ServletInvocationAction.run(WebAppServletContext.java:3592)
     weblogic.security.acl.internal.AuthenticatedSubject.doAs(AuthenticatedSubject.java:321)
     weblogic.security.service.SecurityManager.runAs(SecurityManager.java:121)
     weblogic.servlet.internal.WebAppServletContext.securedExecute(WebAppServletContext.java:2202)
     weblogic.servlet.internal.WebAppServletContext.execute(WebAppServletContext.java:2108)
     weblogic.servlet.internal.ServletRequestImpl.run(ServletRequestImpl.java:1432)
     weblogic.work.ExecuteThread.execute(ExecuteThread.java:201)
     weblogic.work.ExecuteThread.run(ExecuteThread.java:173)
SUBSYSTEM = WebLogicServer USERID = <WLS Kernel> SEVERITY = Error THREAD = [ACTIVE] ExecuteThread: '2' for queue: 'weblogic.kernel.Default (self-tuning)' MSGID = BEA-000337 MACHINE = lpt09-mkabeer TXID = CONTEXTID = TIMESTAMP = 1280398969203
WatchAlarmType: AutomaticReset
WatchAlarmResetPeriod: 600000
>
<JMXWatchNotificationListener><handleNotification> failure creating incident from WLDF notification
oracle.dfw.incident.IncidentCreationException: DFW-40116: failure creating incident
Cause: DFW-40112: There was an error executing adrci commands; the following errors have been found "DIA-48415: Syntax error found in string [create home base=C:\\Documents and Settings\\mkabeer\\Application] at column [65]
DIA-48447: The input path [C:\\Documents and Settings\\mkabeer\\Application Data\\JDeveloper\\system11.1.1.2.36.55.36\\DefaultDomain\\servers\\DefaultServer\\adr] does not contain any ADR homes
DIA-48447: The input path [diag\ofm\defaultdomain\defaultserver] does not contain any ADR homes
DIA-48494: ADR home is not set, the corresponding operation cannot be done
Action: Ensure that command line tool "adrci" can be executed from the command line.
     at oracle.dfw.impl.incident.DiagnosticsDataExtractorImpl.createADRIncident(DiagnosticsDataExtractorImpl.java:708)
     at oracle.dfw.impl.incident.DiagnosticsDataExtractorImpl.createIncident(DiagnosticsDataExtractorImpl.java:246)
     at oracle.dfw.spi.weblogic.JMXWatchNotificationListener.handleNotification(JMXWatchNotificationListener.java:195)
     at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor$ListenerWrapper.handleNotification(DefaultMBeanServerInterceptor.java:1732)
     at javax.management.NotificationBroadcasterSupport.handleNotification(NotificationBroadcasterSupport.java:257)
     at javax.management.NotificationBroadcasterSupport$SendNotifJob.run(NotificationBroadcasterSupport.java:322)
     at javax.management.NotificationBroadcasterSupport$1.execute(NotificationBroadcasterSupport.java:307)
     at javax.management.NotificationBroadcasterSupport.sendNotification(NotificationBroadcasterSupport.java:229)
     at weblogic.management.jmx.modelmbean.WLSModelMBean.sendNotification(WLSModelMBean.java:824)
     at weblogic.diagnostics.watch.JMXNotificationProducer.postJMXNotification(JMXNotificationProducer.java:79)
     at weblogic.diagnostics.watch.JMXNotificationProducer.sendNotification(JMXNotificationProducer.java:104)
     at com.bea.diagnostics.notifications.JMXNotificationService.send(JMXNotificationService.java:122)
     at weblogic.diagnostics.watch.JMXNotificationListener.processWatchNotification(JMXNotificationListener.java:103)
     at weblogic.diagnostics.watch.Watch.performNotifications(Watch.java:621)
     at weblogic.diagnostics.watch.Watch.evaluateLogRuleWatch(Watch.java:546)
     at weblogic.diagnostics.watch.WatchManager.evaluateLogEventRulesAsync(WatchManager.java:765)
     at weblogic.diagnostics.watch.WatchManager.run(WatchManager.java:525)
     at weblogic.work.SelfTuningWorkManagerImpl$WorkAdapterImpl.run(SelfTuningWorkManagerImpl.java:516)
     at weblogic.work.ExecuteThread.execute(ExecuteThread.java:201)
     at weblogic.work.ExecuteThread.run(ExecuteThread.java:173)
Caused by: oracle.dfw.common.DiagnosticsException: DFW-40112: failed to execute the adrci commands "create home base=C:\\Documents and Settings\\mkabeer\\Application Data\\JDeveloper\\system11.1.1.2.36.55.36\\DefaultDomain\\servers\\DefaultServer\\adr product_type=ofm product_id=defaultdomain instance_id=defaultserver
set base C:\\Documents and Settings\\mkabeer\\Application Data\\JDeveloper\\system11.1.1.2.36.55.36\\DefaultDomain\\servers\\DefaultServer\\adr
set homepath diag\ofm\defaultdomain\defaultserver
create incident problem_key="BEA-337 [WebLogicServer]" error_facility="BEA" error_number=337 error_message="null" create_time="2010-07-29 13:22:49.219 +03:00" ecid="0000IcTiSfuEKQWzLwbQ8A1CKL6r00000V"
Cause: There was an error executing adrci commands; the following errors have been found "DIA-48415: Syntax error found in string [create home base=C:\\Documents and Settings\\mkabeer\\Application] at column [65]
DIA-48447: The input path [C:\\Documents and Settings\\mkabeer\\Application Data\\JDeveloper\\system11.1.1.2.36.55.36\\DefaultDomain\\servers\\DefaultServer\\adr] does not contain any ADR homes
DIA-48447: The input path [diag\ofm\defaultdomain\defaultserver] does not contain any ADR homes
DIA-48494: ADR home is not set, the corresponding operation cannot be done
Action: Ensure that command line tool "adrci" can be executed from the command line.
     at oracle.dfw.impl.incident.ADRHelper.invoke(ADRHelper.java:1052)
     at oracle.dfw.impl.incident.ADRHelper.createIncident(ADRHelper.java:786)
     at oracle.dfw.impl.incident.DiagnosticsDataExtractorImpl.createADRIncident(DiagnosticsDataExtractorImpl.java:688)
     ... 19 more
<Jul 29, 2010 1:23:49 PM AST> <Error> <WebLogicServer> <BEA-000337> <[STUCK] ExecuteThread: '5' for queue: 'weblogic.kernel.Default (self-tuning)' has been busy for "681" seconds working on the request "weblogic.servlet.internal.ServletRequestImpl@13a7ecf[
POST /kabtest-ViewController1-context-root/faces/test1.jsp?_adf.ctrl-state=xumczak86_4 HTTP/1.1
User-Agent: Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.2.8) Gecko/20100722 Firefox/3.6.8
Accept: text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8
Accept-Language: en-us,en;q=0.5
Accept-Encoding: gzip,deflate
Accept-Charset: ISO-8859-1,utf-8;q=0.7,*;q=0.7
Keep-Alive: 115
Connection: keep-alive
Referer: http://127.0.0.1:7101/kabtest-ViewController1-context-root/faces/test1.jsp?_afrLoop=1305015256967&_afrWindowMode=0&_adf.ctrl-state=xumczak86_4
Cookie: JSESSIONID=7qmnMRTWld4BzJDnLB4BF1hvxgl0NYTJrg9lT3VnWNYJpCmzGYJm!-1863071826
Content-Type: application/x-www-form-urlencoded
Content-Length: 247
]", which is more than the configured time (StuckThreadMaxTime) of "600" seconds. Stack trace:
     java.net.SocketInputStream.socketRead0(Native Method)
     java.net.SocketInputStream.read(SocketInputStream.java:129)
     oracle.net.ns.Packet.receive(Packet.java:293)
     oracle.net.ns.DataPacket.receive(DataPacket.java:92)
     oracle.net.ns.NetInputStream.getNextPacket(NetInputStream.java:174)
     oracle.net.ns.NetInputStream.read(NetInputStream.java:119)
     oracle.net.ns.NetInputStream.read(NetInputStream.java:94)
     oracle.net.ns.NetInputStream.read(NetInputStream.java:79)
     oracle.jdbc.driver.T4CSocketInputStreamWrapper.readNextPacket(T4CSocketInputStreamWrapper.java:122)
     oracle.jdbc.driver.T4CSocketInputStreamWrapper.read(T4CSocketInputStreamWrapper.java:78)
     oracle.jdbc.driver.T4CMAREngine.unmarshalUB1(T4CMAREngine.java:1040)
     oracle.jdbc.driver.T4CMAREngine.unmarshalSB1(T4CMAREngine.java:1016)
     oracle.jdbc.driver.T4C8Oall.receive(T4C8Oall.java:589)
     oracle.jdbc.driver.T4CPreparedStatement.doOall8(T4CPreparedStatement.java:194)
     oracle.jdbc.driver.T4CPreparedStatement.executeForRows(T4CPreparedStatement.java:953)
     oracle.jdbc.driver.OracleStatement.doExecuteWithTimeout(OracleStatement.java:1223)
     oracle.jdbc.driver.OraclePreparedStatement.executeInternal(OraclePreparedStatement.java:3386)
     oracle.jdbc.driver.OraclePreparedStatement.execute(OraclePreparedStatement.java:3487)
     oracle.jdbc.driver.OraclePreparedStatementWrapper.execute(OraclePreparedStatementWrapper.java:1374)
     weblogic.jdbc.wrapper.PreparedStatement.execute(PreparedStatement.java:98)
     view.backing.Test1.cb1_action(Test1.java:132)
     sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
     sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
     sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
     java.lang.reflect.Method.invoke(Method.java:597)
     com.sun.el.parser.AstValue.invoke(AstValue.java:157)
     com.sun.el.MethodExpressionImpl.invoke(MethodExpressionImpl.java:283)
     org.apache.myfaces.trinidad.component.MethodExpressionMethodBinding.invoke(MethodExpressionMethodBinding.java:46)
     com.sun.faces.application.ActionListenerImpl.processAction(ActionListenerImpl.java:102)
     org.apache.myfaces.trinidad.component.UIXCommand.broadcast(UIXCommand.java:190)
     javax.faces.component.UIViewRoot.broadcastEvents(UIViewRoot.java:475)
     javax.faces.component.UIViewRoot.processApplication(UIViewRoot.java:756)
     oracle.adfinternal.view.faces.lifecycle.LifecycleImpl._invokeApplication(LifecycleImpl.java:698)
     oracle.adfinternal.view.faces.lifecycle.LifecycleImpl._executePhase(LifecycleImpl.java:285)
     oracle.adfinternal.view.faces.lifecycle.LifecycleImpl.execute(LifecycleImpl.java:177)
     javax.faces.webapp.FacesServlet.service(FacesServlet.java:265)
     weblogic.servlet.internal.StubSecurityHelper$ServletServiceAction.run(StubSecurityHelper.java:227)
     weblogic.servlet.internal.StubSecurityHelper.invokeServlet(StubSecurityHelper.java:125)
     weblogic.servlet.internal.ServletStubImpl.execute(ServletStubImpl.java:292)
     weblogic.servlet.internal.TailFilter.doFilter(TailFilter.java:26)
     weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:56)
     oracle.adf.model.servlet.ADFBindingFilter.doFilter(ADFBindingFilter.java:191)
     weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:56)
     oracle.adfinternal.view.faces.webapp.rich.RegistrationFilter.doFilter(RegistrationFilter.java:97)
     org.apache.myfaces.trinidadinternal.webapp.TrinidadFilterImpl$FilterListChain.doFilter(TrinidadFilterImpl.java:420)
     oracle.adfinternal.view.faces.activedata.AdsFilter.doFilter(AdsFilter.java:60)
     org.apache.myfaces.trinidadinternal.webapp.TrinidadFilterImpl$FilterListChain.doFilter(TrinidadFilterImpl.java:420)
     org.apache.myfaces.trinidadinternal.webapp.TrinidadFilterImpl._doFilterImpl(TrinidadFilterImpl.java:247)
     org.apache.myfaces.trinidadinternal.webapp.TrinidadFilterImpl.doFilter(TrinidadFilterImpl.java:157)
     org.apache.myfaces.trinidad.webapp.TrinidadFilter.doFilter(TrinidadFilter.java:92)
     weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:56)
     oracle.security.jps.ee.http.JpsAbsFilter$1.run(JpsAbsFilter.java:94)
     java.security.AccessController.doPrivileged(Native Method)
     oracle.security.jps.util.JpsSubject.doAsPrivileged(JpsSubject.java:313)
     oracle.security.jps.ee.util.JpsPlatformUtil.runJaasMode(JpsPlatformUtil.java:413)
     oracle.security.jps.ee.http.JpsAbsFilter.doFilter(JpsAbsFilter.java:138)
     oracle.security.jps.ee.http.JpsFilter.doFilter(JpsFilter.java:70)
     weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:56)
     oracle.dms.wls.DMSServletFilter.doFilter(DMSServletFilter.java:326)
     weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:56)
     weblogic.servlet.internal.RequestEventsFilter.doFilter(RequestEventsFilter.java:27)
     weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:56)
     weblogic.servlet.internal.WebAppServletContext$ServletInvocationAction.run(WebAppServletContext.java:3592)
     weblogic.security.acl.internal.AuthenticatedSubject.doAs(AuthenticatedSubject.java:321)
     weblogic.security.service.SecurityManager.runAs(SecurityManager.java:121)
     weblogic.servlet.internal.WebAppServletContext.securedExecute(WebAppServletContext.java:2202)
     weblogic.servlet.internal.WebAppServletContext.execute(WebAppServletContext.java:2108)
     weblogic.servlet.internal.ServletRequestImpl.run(ServletRequestImpl.java:1432)
     weblogic.work.ExecuteThread.execute(ExecuteThread.java:201)
     weblogic.work.ExecuteThread.run(ExecuteThread.java:173)
please some one help me to solve this problem either this problem from java code or weblogic server... because i am sure about oracle database is
not having any problem because the same procedure i executed through the sql plus and its give me results just in time
Thanks
Kabeer

Hi, Nodex,
Avoid implicit conversions.
For example:
TO_CHAR(TRUNC(NEXT_DAY(ADD_MONTHS(substr(partition_name, -8, length(partition_name)), -3), 'MONDAY')-7), 'YYYYMMDD')ADD_MONTHS expects a DATE as its first argument.
SUBSTR returns a VARCHAR2, so you're calling ADD_MONTHS with a VARCHAR2 where it expects a DATE.
For good or ill, the system tries to avoid raising an error in this case by implicitly converting the VARCHAR2 to a DATE. Exactly how it does that depends on
(a) the tool you are using (SQL*Plus or Toad, for example),
(b) the version (Oracle 10 behaved quite different form Oracle 9),
(c) environmental settings (such as NLS_DATE_FORMAT), which in turn may depend on initialization parameneters, and
(d) who knows what else.
When you have to convert, do so explicitly.
You can convert a VARCHAR2 to a DATE using TO_DATE, like this:
TO_CHAR ( TRUNC ( NEXT_DAY ( ADD_MONTHS ( TO_DATE ( SUBSTR ( partition_name
                                                   , -8
                                      , LENGTH (partition_name)
                                 , 'YYYYMMDD'     -- or whatever
                         , -3
                  , 'MONDAY'
          - 7
     , 'YYYYMMDD'
     )

WebLogic Server Hang

Similar Messages

Maybe you are looking for