Java.lang.OutOfMemoryError:growableArray.cpp. Out of swap space?

Hello,
My Application(a Desktop application) through the following exception
Can any one please help me finding what are the possible reasons and solution for the below error?
https://forums.oracle.com/message/6443182#6443182
https://forums.oracle.com/message/6646295#6646295
I have seen in the above discussions that reducing the the heap size (Xmx) would give a solution, can any one please suggest me how much do I have to reduce my Xmx.
Here are my log details.
# An unexpected error has been detected by Java Runtime Environment:
# java.lang.OutOfMemoryError: requested 4096000 bytes for GrET in C:\BUILD_AREA\jdk6_12\hotspot\src\share\vm\utilities\growableArray.cpp. Out of swap space?
#  Internal Error (allocation.inline.hpp:42), pid=1508, tid=5848
#  Error: GrET in C:\BUILD_AREA\jdk6_12\hotspot\src\share\vm\utilities\growableArray.cpp
# Java VM: Java HotSpot(TM) Server VM (11.2-b01 mixed mode windows-x86)
# If you would like to submit a bug report, please visit:
#   http://java.sun.com/webapps/bugreport/crash.jsp
---------------  T H R E A D  ---------------
Current thread (0x070d0400):  VMThread [stack: 0x071b0000,0x072b0000] [id=5848]
Stack: [0x071b0000,0x072b0000]
[error occurred during error reporting (printing stack bounds), id 0xc0000005]
VM_Operation (0x0a21fae4): ParallelGCSystemGC, mode: safepoint, requested by thread 0x070e4800
---------------  P R O C E S S  ---------------
Java Threads: ( => current thread )
  0x0d1da400 JavaThread "RMI RenewClean-[NCOSJPEPRD02:56100]" daemon [_thread_blocked, id=6104, stack(0x45440000,0x454c0000)]
  0x0d1d9000 JavaThread "RMI RenewClean-[NCOSJPEPRD07:56100]" daemon [_thread_blocked, id=7312, stack(0x3abd0000,0x3ac50000)]
  0x0d1d9c00 JavaThread "RMI RenewClean-[NCOSJPEPRD04:56100]" daemon [_thread_blocked, id=7244, stack(0x38340000,0x383c0000)]
  0x17e82c00 JavaThread "RMI RenewClean-[NCOSJPEPRD06:56100]" daemon [_thread_blocked, id=4432, stack(0x0e210000,0x0e290000)]
  0x17e80800 JavaThread "RMI RenewClean-[NCOSJPEPRD05:56100]" daemon [_thread_blocked, id=4128, stack(0x00e40000,0x00ec0000)]
  0x17e7fc00 JavaThread "RMI RenewClean-[NCOSJPEPRD01:56100]" daemon [_thread_blocked, id=7472, stack(0x0b060000,0x0b0e0000)]
  0x17e81400 JavaThread "WGN ThreadPool Message Receiver(20826) (Inactive)" daemon [_thread_blocked, id=5036, stack(0x37bc0000,0x37c40000)]
  0x17e82800 JavaThread "RMI TCP Connection(261363)-10.22.91.38" daemon [_thread_blocked, id=5560, stack(0x0f460000,0x0f4e0000)]
  0x17e80400 JavaThread "RMI TCP Connection(idle)" daemon [_thread_blocked, id=6800, stack(0x0cbb0000,0x0cc30000)]
  0x17e7f800 JavaThread "RMI RenewClean-[NCOSJPEPRD03:56100]" daemon [_thread_blocked, id=7784, stack(0x097c0000,0x09840000)]
  0x17e81000 JavaThread "RMI TCP Connection(261367)-10.22.91.39" daemon [_thread_in_native, id=6972, stack(0x00dc0000,0x00e40000)]
  0x0d1d9800 JavaThread "WGN ThreadPool Message Receiver(20825) (Inactive)" daemon [_thread_blocked, id=7872, stack(0x1fe10000,0x1fe90000)]
  0x17e7f400 JavaThread "RMI TCP Connection(261366)-10.22.81.92" daemon [_thread_in_native, id=7948, stack(0x0e070000,0x0e0f0000)]
  0x17e82000 JavaThread "RMI TCP Connection(idle)" daemon [_thread_blocked, id=7672, stack(0x38440000,0x384c0000)]
  0x08eed400 JavaThread "RMI TCP Connection(261320)-10.22.91.39" daemon [_thread_in_native, id=5640, stack(0x37eb0000,0x37f30000)]
  0x17e81c00 JavaThread "RMI TCP Connection(261357)-10.22.81.92" daemon [_thread_in_native, id=8060, stack(0x22e90000,0x22f10000)]
  0x19dd3c00 JavaThread "RMI TCP Connection(261369)-10.22.91.38" daemon [_thread_in_native, id=1360, stack(0x73da0000,0x73e20000)]
  0x19dd3000 JavaThread "RMI TCP Connection(261360)-10.22.81.92" daemon [_thread_in_native, id=2144, stack(0x71d60000,0x71de0000)]
  0x070e8800 JavaThread "RMI TCP Connection(261368)-10.22.81.92" daemon [_thread_in_native, id=7188, stack(0x4dac0000,0x4db40000)]
  0x19dd0800 JavaThread "WGN ThreadPool Application Data Monitor(20737) (Inactive)" [_thread_blocked, id=6420, stack(0x0cd10000,0x0cd90000)]
  0x19dd0c00 JavaThread "WGN ThreadPool Application Data Monitor(20687) (Inactive)" [_thread_blocked, id=3504, stack(0x0a7a0000,0x0a820000)]
  0x19dd1800 JavaThread "WGN ThreadPool Application Data Monitor(20657) (Inactive)" [_thread_blocked, id=3084, stack(0x0b1e0000,0x0b260000)]
  0x0d1dcc00 JavaThread "WGN ThreadPool Application Data Monitor(20446) (Inactive)" [_thread_blocked, id=7352, stack(0x0ab60000,0x0abe0000)]
  0x08eecc00 JavaThread "RMI RenewClean-[VNCOSJCMSPRD:56102,[email protected]9b3ec]" daemon [_thread_blocked, id=1880, stack(0x0b8e0000,0x0b960000)]
  0x08eec800 JavaThread "RMI TCP Accept-0" daemon [_thread_in_native, id=5100, stack(0x0b820000,0x0b8a0000)]
  0x08eebc00 JavaThread "WGN filter validation thread" [_thread_blocked, id=6412, stack(0x0b6a0000,0x0b720000)]
  0x08eeb400 JavaThread "WGN ID cache(preloader thread)" [_thread_blocked, id=5280, stack(0x0b5e0000,0x0b660000)]
  0x08eeb000 JavaThread "WGN Username cache(preloader thread)" [_thread_blocked, id=6808, stack(0x0b520000,0x0b5a0000)]
  0x08eeac00 JavaThread "WGN Username cache(invalidator thread)" [_thread_blocked, id=3628, stack(0x0b460000,0x0b4e0000)]
  0x08eea400 JavaThread "WGN E-mail address cache(preloader thread)" [_thread_blocked, id=5548, stack(0x0b3a0000,0x0b420000)]
  0x08eea000 JavaThread "WGN E-mail address cache(invalidator thread)" [_thread_blocked, id=3844, stack(0x0b2e0000,0x0b360000)]
  0x08ee8800 JavaThread "WGN Lookup cancellation thread" [_thread_blocked, id=4296, stack(0x0afe0000,0x0b060000)]
  0x08ee8000 JavaThread "WGN RSRegister-FallbackMonitorThread" [_thread_blocked, id=4180, stack(0x0af20000,0x0afa0000)]
  0x08ee7c00 JavaThread "WGN NotifyScheduler (Scheduler)" [_thread_blocked, id=1712, stack(0x0ae60000,0x0aee0000)]
  0x08ee7800 JavaThread "WGN ThreadPool Application Data Monitor(0) - TPQE(NCOSJPEPRD03)" [_thread_blocked, id=6184, stack(0x0ada0000,0x0ae20000)]
  0x08ee7000 JavaThread "WGN DBManagement (Scheduler)" [_thread_blocked, id=3524, stack(0x0ace0000,0x0ad60000)]
  0x070e8c00 JavaThread "WGN Database Event Logging Queue Handler" daemon [_thread_blocked, id=2152, stack(0x0ac20000,0x0aca0000)]
  0x070e7000 JavaThread "RMI RenewClean-[VNCOSJCMSPRD:56101,wigan.infrastruct.serviceutil.ClientSocketFactory@f5d9b3ec]" daemon [_thread_blocked, id=5836, stack(0x0a720000,0x0a7a0000)]
  0x070e6c00 JavaThread "RMI TCP Accept-0" daemon [_thread_in_native, id=6704, stack(0x0a660000,0x0a6e0000)]
  0x070e5800 JavaThread "RMI RenewClean-[VNCOSJCMSPRD:56100]" daemon [_thread_blocked, id=5984, stack(0x0a420000,0x0a4a0000)]
  0x070e5400 JavaThread "RMI Scheduler(0)" daemon [_thread_blocked, id=6224, stack(0x0a360000,0x0a3e0000)]
  0x070e4800 JavaThread "GC Daemon" daemon [_thread_blocked, id=660, stack(0x0a1a0000,0x0a220000)]
  0x070e4400 JavaThread "RMI Reaper" [_thread_blocked, id=5084, stack(0x0a0e0000,0x0a160000)]
  0x070e3c00 JavaThread "RMI TCP Accept-0" daemon [_thread_in_native, id=4916, stack(0x0a060000,0x0a0e0000)]
  0x070e3800 JavaThread "WGN Ping (Ping Server)" [_thread_in_native, id=5112, stack(0x09ea0000,0x09f20000)]
  0x070e3000 JavaThread "RMI TCP Accept-56099" daemon [_thread_in_native, id=4548, stack(0x09d30000,0x09db0000)]
  0x070e2000 JavaThread "Low Memory Detector" daemon [_thread_blocked, id=1452, stack(0x07870000,0x078f0000)]
  0x070ed800 JavaThread "CompilerThread1" daemon [_thread_blocked, id=4024, stack(0x07730000,0x07830000)]
  0x070ed400 JavaThread "CompilerThread0" daemon [_thread_blocked, id=5480, stack(0x075f0000,0x076f0000)]
  0x070e1c00 JavaThread "Attach Listener" daemon [_thread_blocked, id=6908, stack(0x07530000,0x075b0000)]
  0x070e1400 JavaThread "Signal Dispatcher" daemon [_thread_blocked, id=5792, stack(0x07470000,0x074f0000)]
  0x070d4c00 JavaThread "Finalizer" daemon [_thread_blocked, id=4516, stack(0x073b0000,0x07430000)]
  0x070d2400 JavaThread "Reference Handler" daemon [_thread_blocked, id=5384, stack(0x072f0000,0x07370000)]
  0x017fb800 JavaThread "main" [_thread_blocked, id=4796, stack(0x01480000,0x01580000)]
Other Threads:
=>0x070d0400 VMThread [stack: 0x071b0000,0x072b0000] [id=5848]
  0x070f9800 WatcherThread [stack: 0x07930000,0x07a30000] [id=5408]
VM state:at safepoint (normal execution)
VM Mutex/Monitor currently owned by a thread:  ([mutex/lock_event])
[0x017f9a10] UNKNOWN - owner thread: 0x070d0400
[0x017f9e70] UNKNOWN - owner thread: 0x070e4800
Heap
PSYoungGen      total 173696K, used 8225K [0xdeaa0000, 0xe9f50000, 0xe9ff0000)
  eden space 162752K, 0% used [0xdeaa0000,0xdeaa0000,0xe8990000)
  from space 10944K, 75% used [0xe8990000,0xe9198528,0xe9440000)
  to   space 11136K, 0% used [0xe9470000,0xe9470000,0xe9f50000)
PSOldGen        total 470848K, used 221413K [0x83ff0000, 0xa0bc0000, 0xdeaa0000)
  object space 470848K, 47% used [0x83ff0000,0x918297a0,0xa0bc0000)
PSPermGen       total 20352K, used 20093K [0x7fff0000, 0x813d0000, 0x83ff0000)
  object space 20352K, 98% used [0x7fff0000,0x8138f528,0x813d0000)
Dynamic libraries:
0x00400000 - 0x004d0000 C:\Program Files (x86)\CA\CA DLP\system\wgninfra.exe
0x77800000 - 0x77980000 C:\Windows\SysWOW64\ntdll.dll
0x762d0000 - 0x763e0000 C:\Windows\syswow64\kernel32.dll
0x75ba0000 - 0x75be7000 C:\Windows\syswow64\KERNELBASE.dll
0x71c80000 - 0x71c92000 C:\Windows\system32\MPR.dll
0x75de0000 - 0x75ee0000 C:\Windows\syswow64\USER32.dll
0x758b0000 - 0x75940000 C:\Windows\syswow64\GDI32.dll
0x773f0000 - 0x773fa000 C:\Windows\syswow64\LPK.dll
0x75810000 - 0x758ad000 C:\Windows\syswow64\USP10.dll
0x77290000 - 0x7733c000 C:\Windows\syswow64\msvcrt.dll
0x77350000 - 0x773f0000 C:\Windows\syswow64\ADVAPI32.dll
0x75a50000 - 0x75a69000 C:\Windows\SysWOW64\sechost.dll
0x761e0000 - 0x762d0000 C:\Windows\syswow64\RPCRT4.dll
0x75250000 - 0x752b0000 C:\Windows\syswow64\SspiCli.dll
0x75240000 - 0x7524c000 C:\Windows\syswow64\CRYPTBASE.dll
0x75c80000 - 0x75ddc000 C:\Windows\syswow64\ole32.dll
0x759c0000 - 0x75a4f000 C:\Windows\syswow64\OLEAUT32.dll
0x735c0000 - 0x73647000 C:\Windows\WinSxS\x86_microsoft.vc80.crt_1fc8b3b9a1e18e3b_8.0.50727.6195_none_d09154e044272b9a\MSVCP80.dll
0x74ae0000 - 0x74b7b000 C:\Windows\WinSxS\x86_microsoft.vc80.crt_1fc8b3b9a1e18e3b_8.0.50727.6195_none_d09154e044272b9a\MSVCR80.dll
0x68600000 - 0x68645000 C:\Program Files (x86)\CA\CA DLP\system\infrahlp.dll
0x75ee0000 - 0x75f15000 C:\Windows\syswow64\WS2_32.dll
0x75c60000 - 0x75c66000 C:\Windows\syswow64\NSI.dll
0x76640000 - 0x7728a000 C:\Windows\syswow64\SHELL32.dll
0x75480000 - 0x754d7000 C:\Windows\syswow64\SHLWAPI.dll
0x71650000 - 0x7173b000 C:\Windows\system32\dbghelp.dll
0x75bf0000 - 0x75c50000 C:\Windows\system32\IMM32.DLL
0x75730000 - 0x757fc000 C:\Windows\syswow64\MSCTF.dll
0x68200000 - 0x68229000 C:\Program Files (x86)\CA\CA DLP\common\wgnprod.dll
0x734e0000 - 0x734e9000 C:\Windows\system32\VERSION.dll
0x10000000 - 0x1000d000 C:\Program Files (x86)\CA\CA DLP\common\wgnprod_en.dll
0x74ad0000 - 0x74adb000 C:\Windows\system32\profapi.dll
0x6db30000 - 0x6def4000 C:\Program Files (x86)\CA\CA DLP\system\jre160_12\bin\server\jvm.dll
0x717b0000 - 0x717e2000 C:\Windows\system32\WINMM.dll
0x7c340000 - 0x7c396000 C:\Program Files (x86)\CA\CA DLP\system\jre160_12\bin\MSVCR71.dll
0x71de0000 - 0x71e2c000 C:\Windows\system32\apphelp.dll
0x6d340000 - 0x6d348000 C:\Program Files (x86)\CA\CA DLP\system\jre160_12\bin\hpi.dll
0x777d0000 - 0x777d5000 C:\Windows\syswow64\PSAPI.DLL
0x6d860000 - 0x6d86c000 C:\Program Files (x86)\CA\CA DLP\system\jre160_12\bin\verify.dll
0x6d3e0000 - 0x6d3ff000 C:\Program Files (x86)\CA\CA DLP\system\jre160_12\bin\java.dll
0x6d8a0000 - 0x6d8af000 C:\Program Files (x86)\CA\CA DLP\system\jre160_12\bin\zip.dll
0x75ae0000 - 0x75b63000 C:\Windows\syswow64\CLBCatQ.DLL
0x72f20000 - 0x72f27000 C:\Windows\system32\msiltcfg.dll
0x72ba0000 - 0x72de0000 C:\Windows\system32\msi.dll
0x71d50000 - 0x71d53000 C:\Windows\SysWOW64\SFC.DLL
0x71600000 - 0x7160d000 C:\Windows\system32\sfc_os.DLL
0x68400000 - 0x6845e000 C:\Program Files (x86)\CA\CA DLP\common\WgnPerf.dll
0x6d840000 - 0x6d848000 C:\Program Files (x86)\CA\CA DLP\system\jre160_12\bin\sunmscapi.dll
0x76060000 - 0x76180000 C:\Windows\syswow64\CRYPT32.dll
0x76180000 - 0x7618c000 C:\Windows\syswow64\MSASN1.dll
0x73fb0000 - 0x73fc6000 C:\Windows\system32\CRYPTSP.dll
0x73f70000 - 0x73fab000 C:\Windows\system32\rsaenh.dll
0x72f40000 - 0x72f4e000 C:\Windows\system32\RpcRtRemote.dll
0x2d000000 - 0x2d070000 C:\Program Files (x86)\CA\CA DLP\system\wgnrdm.dll
0x71610000 - 0x71626000 C:\Windows\system32\MAPI32.dll
0x71370000 - 0x713c8000 C:\Windows\system32\WINHTTP.dll
0x70b50000 - 0x70b9f000 C:\Windows\system32\webio.dll
0x68000000 - 0x6802e000 C:\Program Files (x86)\CA\CA DLP\common\wgnps.dll
0x70f80000 - 0x70f97000 C:\Windows\system32\USERENV.dll
0x6d6c0000 - 0x6d6d3000 C:\Program Files (x86)\CA\CA DLP\system\jre160_12\bin\net.dll
0x73580000 - 0x735bc000 C:\Windows\system32\mswsock.dll
0x73560000 - 0x73566000 C:\Windows\System32\wship6.dll
0x73570000 - 0x73575000 C:\Windows\System32\wshtcpip.dll
0x72ed0000 - 0x72f14000 C:\Windows\system32\DNSAPI.dll
0x72e40000 - 0x72e5c000 C:\Windows\system32\IPHLPAPI.DLL
0x72e30000 - 0x72e37000 C:\Windows\system32\WINNSI.DLL
0x72e20000 - 0x72e26000 C:\Windows\system32\rasadhlp.dll
0x72de0000 - 0x72e18000 C:\Windows\System32\fwpuclnt.dll
0x6d7b0000 - 0x6d7b6000 C:\Program Files (x86)\CA\CA DLP\system\jre160_12\bin\rmi.dll
0x6d610000 - 0x6d619000 C:\Program Files (x86)\CA\CA DLP\system\jre160_12\bin\management.dll
0x24200000 - 0x24221000 C:\Program Files (x86)\CA\CA DLP\common\streams.dll
0x2e600000 - 0x2e682000 C:\Program Files (x86)\CA\CA DLP\common\smtputils.dll
0x0ce30000 - 0x0ce66000 C:\Program Files (x86)\CA\CA DLP\common\mimepp.dll
0x72f80000 - 0x72f90000 C:\Windows\system32\NLAapi.dll
0x72f30000 - 0x72f40000 C:\Windows\system32\napinsp.dll
0x72e60000 - 0x72e68000 C:\Windows\System32\winrnr.dll
0x71340000 - 0x7136e000 C:\Windows\system32\mlang.dll
0x6f780000 - 0x6f788000 C:\Windows\system32\credssp.dll
0x70650000 - 0x7068f000 C:\Windows\SysWOW64\schannel.dll
0x723c0000 - 0x723c8000 C:\Windows\system32\secur32.dll
0x70f20000 - 0x70f58000 C:\Windows\system32\ncrypt.dll
0x70f00000 - 0x70f17000 C:\Windows\system32\bcrypt.dll
0x70ec0000 - 0x70efd000 C:\Windows\SysWOW64\bcryptprimitives.dll
0x70f60000 - 0x70f76000 C:\Windows\system32\GPAPI.dll
0x24800000 - 0x2482e000 C:\Program Files (x86)\CA\CA DLP\common\wgnstore.dll
0x24600000 - 0x24660000 C:\Program Files (x86)\CA\CA DLP\common\emstore.dll
0x12330000 - 0x123ab000 C:\Program Files (x86)\CA\CA DLP\client\wgnemol.dll
VM Arguments:
jvm_args: -Dsun.net.inetaddr.ttl=10 vfprintf exit abort -Xms5242880 -Xmx1711276032 -XX:NewSize=2621440 -XX:MaxNewSize=855638016 -XX:+HeapDumpOnOutOfMemoryError -Dsun.rmi.dgc.server.gcInterval=60000 -Dsun.rmi.dgc.client.gcInterval=60000 -Djava.security.properties=wigan.java.security -Xss512K
java_command: <unknown>
Launcher Type: generic
Environment Variables:
PATH=C:\Oracle\Default\product\11.2.0\client_1;C:\Oracle\Default\product\11.2.0\client_1\bin;C:\Windows\system32;C:\Windows;C:\Windows\System32\Wbem;C:\Windows\System32\WindowsPowerShell\v1.0\;C:\Program Files (x86)\Microsoft SQL Server\100\Tools\Binn\VSShell\Common7\IDE\;C:\Program Files (x86)\Microsoft SQL Server\100\Tools\Binn\;C:\Program Files\Microsoft SQL Server\100\Tools\Binn\;C:\Program Files (x86)\Microsoft SQL Server\100\DTS\Binn\
USERNAME=osjapp
OS=Windows_NT
PROCESSOR_IDENTIFIER=Intel64 Family 6 Model 45 Stepping 7, GenuineIntel
---------------  S Y S T E M  ---------------
OS: Windows NT 6.1 Build 7601 Service Pack 1
CPU:total 24 (16 cores per cpu, 2 threads per core) family 6 model 13 stepping 7, cmov, cx8, fxsr, mmx, sse, sse2, sse3, ssse3, ht
Memory: 4k page, physical 4194303k(4194303k free), swap 4194303k(4194303k free)
vm_info: Java HotSpot(TM) Server VM (11.2-b01) for windows-x86 JRE (1.6.0_12-b04), built on Jan 17 2009 09:52:33 by "java_re" with MS VC++ 7.1

Hi
Out of memory they can result from different causes:
- The application is consuming too many resources inappropriately
- The application is opening and not enough threads are closing, leaving no space for the JVM
- You lose the connection with database, causing the connection pool is saturated, which makes the memory of the container is depleted and reaches its peak.
- The container does not have sufficient resources or is not tuned to meet the load generated. But would recommend to discard the above before using this option, because when using this option could work around the problem but could not really be attacking the cause.
bye

Similar Messages

  • Reg: java.lang.outOfMemoryError in Console alone

    Dear All,
    I was getting the trace, java.lang.outOfMemoryError. Even i have incresed the heap size of the JVM as
    java -Xrs -Xms1024m -Xmx1024m ReportServer
    But getting java.lang.outOfMemoryError in the command prompt.
    But it is not caught in the catch block of my application.
    HTML <-> Java Class <-> ReportServer Class <->DB
    Even that error message in not caught in the catch block of ReportServer Class.
    Please suggest me how can i trap that error message to the end user in the front end.
    Eraianban.

    The exception will throw a null value, if thrown in the following catch, we can throw a new user exception instead..
    catch(java.lang.OutOfMemoryError e)
                   System.out.println("Inside OutOfMemoryError");
                   try {
                        throw new UserException("System Exception OutOfMemoryError");//UserException extends Exception
                   } catch (UserException e1) {
                        System.out.println("USER EXCEPTION MESSAGE: " + e1.getErrormessage());
                        throw e1;
              }

  • Java.lang.OutOfMemoryError: requested 2904104 bytes for Chunk::new. Out of swap space?

    Can someone help me with this error?  At random times the application crashes and I get this error. 
    # An unexpected error has been detected by Java Runtime Environment:
    # java.lang.OutOfMemoryError: requested 2904104 bytes for Chunk::new. Out of swap space?
    #  Internal Error (allocation.cpp:218), pid=1904, tid=3532
    #  Error: Chunk::new
    # Java VM: Java HotSpot(TM) Server VM (10.0-b19 mixed mode windows-x86)
    # If you would like to submit a bug report, please visit:
    #   http://java.sun.com/webapps/bugreport/crash.jsp
    ---------------  T H R E A D  ---------------
    Current thread (0x003ec800):  GCTaskThread [stack: 0x675c0000,0x676c0000] [id=3532]
    Stack: [0x675c0000,0x676c0000]
    [error occurred during error reporting (printing stack bounds), id 0xc0000005]
    ---------------  P R O C E S S  ---------------
    Java Threads: ( => current thread )
      0x6a0cb400 JavaThread "Thread-1968" daemon [_thread_in_native, id=6032, stack(0x7fdf0000,0x7fef0000)]
      0x6a0db400 JavaThread "Thread-1967" daemon [_thread_in_native, id=5188, stack(0x7fcf0000,0x7fdf0000)]
      0x6a113400 JavaThread "Thread-1966" daemon [_thread_in_native, id=3000, stack(0x7fbf0000,0x7fcf0000)]
      0x6a11b400 JavaThread "Thread-1965" daemon [_thread_in_native, id=4460, stack(0x7faf0000,0x7fbf0000)]
      0x6a150400 JavaThread "Thread-1964" daemon [_thread_in_native, id=5068, stack(0x7f9f0000,0x7faf0000)]
      0x78522400 JavaThread "Thread-1963" daemon [_thread_in_native, id=3572, stack(0x7f8f0000,0x7f9f0000)]
      0x6e949400 JavaThread "Thread-1962" daemon [_thread_in_native, id=3368, stack(0x7f7f0000,0x7f8f0000)]
      0x6e483400 JavaThread "Thread-1961" daemon [_thread_in_native, id=2172, stack(0x7f580000,0x7f680000)]
      0x73b40400 JavaThread "Thread-1960" daemon [_thread_in_native, id=5684, stack(0x7f480000,0x7f580000)]
      0x6f8ae400 JavaThread "Thread-1959" daemon [_thread_in_native, id=4828, stack(0x7f380000,0x7f480000)]
      0x6e7ec400 JavaThread "Thread-1958" daemon [_thread_in_native, id=5912, stack(0x7f280000,0x7f380000)]
      0x6f1a0400 JavaThread "Thread-1957" daemon [_thread_in_native, id=6100, stack(0x7f180000,0x7f280000)]
      0x6fa8e400 JavaThread "Thread-1956" daemon [_thread_in_native, id=5428, stack(0x7f080000,0x7f180000)]
      0x6fa76400 JavaThread "Thread-1955" daemon [_thread_in_native, id=3496, stack(0x7ef80000,0x7f080000)]
      0x6f369400 JavaThread "Thread-1954" daemon [_thread_in_native, id=3516, stack(0x7ee80000,0x7ef80000)]
      0x69c5a400 JavaThread "Thread-1953" daemon [_thread_in_native, id=4120, stack(0x7ed80000,0x7ee80000)]
      0x6a064400 JavaThread "Thread-1952" daemon [_thread_in_native, id=5864, stack(0x7ec80000,0x7ed80000)]
      0x6f526400 JavaThread "Thread-1951" daemon [_thread_in_native, id=5968, stack(0x7eb80000,0x7ec80000)]
      0x780d2400 JavaThread "Thread-1950" daemon [_thread_in_native, id=900, stack(0x7ea80000,0x7eb80000)]
      0x6fabe400 JavaThread "Thread-1949" daemon [_thread_in_native, id=3480, stack(0x7e980000,0x7ea80000)]
      0x6f8f6400 JavaThread "Thread-1948" daemon [_thread_in_native, id=4740, stack(0x7e880000,0x7e980000)]
      0x6f6a3400 JavaThread "Thread-1947" daemon [_thread_in_native, id=1188, stack(0x7e780000,0x7e880000)]
      0x6f3b1400 JavaThread "Thread-1946" daemon [_thread_in_native, id=3340, stack(0x7e680000,0x7e780000)]
      0x6f1e8400 JavaThread "Thread-1945" daemon [_thread_in_native, id=4100, stack(0x7e580000,0x7e680000)]
      0x6ed6e400 JavaThread "Thread-1944" daemon [_thread_in_native, id=3172, stack(0x7e480000,0x7e580000)]
      0x6f2ed400 JavaThread "Thread-1943" daemon [_thread_in_native, id=1860, stack(0x7e380000,0x7e480000)]
      0x6fd0d400 JavaThread "Thread-1942" daemon [_thread_in_native, id=3432, stack(0x7e280000,0x7e380000)]
      0x78042400 JavaThread "Thread-1941" daemon [_thread_in_native, id=5040, stack(0x7e180000,0x7e280000)]
      0x6a32c400 JavaThread "Thread-1940" daemon [_thread_in_native, id=1828, stack(0x7e080000,0x7e180000)]
      0x6a162400 JavaThread "Thread-1939" daemon [_thread_in_native, id=3740, stack(0x7df80000,0x7e080000)]
      0x69df6400 JavaThread "Thread-1938" daemon [_thread_in_native, id=2544, stack(0x7de80000,0x7df80000)]
      0x6eebb400 JavaThread "Thread-1937" daemon [_thread_in_native, id=2032, stack(0x7dd80000,0x7de80000)]
      0x6a3d3400 JavaThread "Thread-1936" daemon [_thread_in_native, id=5240, stack(0x7dc80000,0x7dd80000)]
      0x69de9400 JavaThread "Thread-1935" daemon [_thread_in_native, id=1072, stack(0x7db80000,0x7dc80000)]
      0x6ef9c400 JavaThread "Thread-1934" daemon [_thread_in_native, id=4088, stack(0x7da80000,0x7db80000)]
      0x69cf8400 JavaThread "Thread-1933" daemon [_thread_in_native, id=2996, stack(0x7d980000,0x7da80000)]
      0x69edf400 JavaThread "Thread-1932" daemon [_thread_in_native, id=2752, stack(0x7d880000,0x7d980000)]
      0x6e352400 JavaThread "Thread-1931" daemon [_thread_in_native, id=976, stack(0x7d780000,0x7d880000)]
      0x69c25400 JavaThread "Thread-1930" daemon [_thread_in_native, id=2472, stack(0x7d680000,0x7d780000)]
      0x6e70f400 JavaThread "Thread-1929" daemon [_thread_in_native, id=2000, stack(0x7d580000,0x7d680000)]
      0x7944d400 JavaThread "Thread-1928" daemon [_thread_in_native, id=2444, stack(0x7d480000,0x7d580000)]
      0x69d5b400 JavaThread "Thread-1927" daemon [_thread_in_native, id=2516, stack(0x7d380000,0x7d480000)]
      0x69fc9400 JavaThread "Thread-1926" daemon [_thread_in_native, id=3856, stack(0x7d280000,0x7d380000)]
      0x69fd2400 JavaThread "Thread-1925" daemon [_thread_in_native, id=304, stack(0x7c6c0000,0x7c7c0000)]
      0x6f93e400 JavaThread "Thread-1924" daemon [_thread_in_native, id=4320, stack(0x7c5c0000,0x7c6c0000)]
      0x6f986400 JavaThread "Thread-1923" daemon [_thread_in_native, id=3896, stack(0x7c4c0000,0x7c5c0000)]
      0x6f733400 JavaThread "Thread-1922" daemon [_thread_in_native, id=4468, stack(0x7c3c0000,0x7c4c0000)]
      0x6f02c400 JavaThread "Thread-1921" daemon [_thread_in_native, id=3372, stack(0x7c250000,0x7c350000)]
      0x6ef03400 JavaThread "Thread-1920" daemon [_thread_in_native, id=3408, stack(0x7c150000,0x7c250000)]
      0x6fb06400 JavaThread "Thread-1919" daemon [_thread_in_native, id=5936, stack(0x7c050000,0x7c150000)]
      0x6a020400 JavaThread "Thread-1918" daemon [_thread_in_native, id=5504, stack(0x7bf50000,0x7c050000)]
      0x6f3f9400 JavaThread "Thread-1917" daemon [_thread_in_native, id=3544, stack(0x779b0000,0x77ab0000)]
      0x6f230400 JavaThread "Thread-1916" daemon [_thread_in_native, id=6084, stack(0x778b0000,0x779b0000)]
      0x6fd55400 JavaThread "Thread-1915" daemon [_thread_in_native, id=5404, stack(0x77530000,0x77630000)]
      0x69f73400 JavaThread "Thread-1914" daemon [_thread_in_native, id=3848, stack(0x77190000,0x77290000)]
      0x6f6eb400 JavaThread "Thread-1913" daemon [_thread_in_native, id=312, stack(0x77090000,0x77190000)]
      0x6f56e400 JavaThread "Thread-1912" daemon [_thread_in_native, id=2088, stack(0x76f90000,0x77090000)]
      0x6efe4400 JavaThread "Thread-1911" daemon [_thread_in_native, id=316, stack(0x76d80000,0x76e80000)]
      0x7808a400 JavaThread "Thread-1910" daemon [_thread_in_native, id=3192, stack(0x76c80000,0x76d80000)]
      0x69f24400 JavaThread "Thread-1909" daemon [_thread_in_native, id=5500, stack(0x76b80000,0x76c80000)]
      0x69e32400 JavaThread "Thread-1908" daemon [_thread_in_native, id=4204, stack(0x768b0000,0x769b0000)]
      0x6a34e400 JavaThread "Thread-1907" daemon [_thread_in_native, id=5752, stack(0x767b0000,0x768b0000)]
      0x69d74400 JavaThread "Thread-1906" daemon [_thread_in_native, id=2264, stack(0x766b0000,0x767b0000)]
      0x6fbf6400 JavaThread "Thread-1905" daemon [_thread_in_native, id=3600, stack(0x765b0000,0x766b0000)]
      0x6f9b7400 JavaThread "Thread-1904" daemon [_thread_in_native, id=484, stack(0x764b0000,0x765b0000)]
      0x69eb6400 JavaThread "Thread-1903" daemon [_thread_in_native, id=4752, stack(0x763b0000,0x764b0000)]
      0x69de4400 JavaThread "Thread-1902" daemon [_thread_in_native, id=4868, stack(0x762b0000,0x763b0000)]
      0x69d4b400 JavaThread "Thread-1901" daemon [_thread_in_native, id=3300, stack(0x76040000,0x76140000)]
      0x69fa3000 JavaThread "Thread-1900" daemon [_thread_in_native, id=328, stack(0x75f40000,0x76040000)]
      0x6b1c9800 JavaThread "Thread-1899" daemon [_thread_in_native, id=2104, stack(0x75e40000,0x75f40000)]
      0x6a016400 JavaThread "Thread-1898" daemon [_thread_in_native, id=5080, stack(0x75d40000,0x75e40000)]
      0x69f79400 JavaThread "Thread-1897" daemon [_thread_in_native, id=4980, stack(0x75c40000,0x75d40000)]
      0x69de5000 JavaThread "Thread-1896" daemon [_thread_in_native, id=4684, stack(0x75b40000,0x75c40000)]
      0x69ee0400 JavaThread "Thread-1895" daemon [_thread_in_native, id=3648, stack(0x739b0000,0x73ab0000)]
      0x6a1ab400 JavaThread "Thread-1894" daemon [_thread_in_native, id=3140, stack(0x738b0000,0x739b0000)]
      0x69e3ec00 JavaThread "Thread-1893" daemon [_thread_in_native, id=928, stack(0x736a0000,0x737a0000)]
      0x785c9c00 JavaThread "Thread-1892" daemon [_thread_in_native, id=1800, stack(0x735a0000,0x736a0000)]
      0x785c9400 JavaThread "Thread-1891" daemon [_thread_in_native, id=2748, stack(0x734a0000,0x735a0000)]
      0x78b5d800 JavaThread "Thread-1890" daemon [_thread_in_native, id=2564, stack(0x733a0000,0x734a0000)]
      0x6e83b800 JavaThread "Thread-1889" daemon [_thread_in_native, id=5772, stack(0x732a0000,0x733a0000)]
      0x6aa8ac00 JavaThread "Thread-1888" daemon [_thread_in_native, id=4548, stack(0x731a0000,0x732a0000)]
      0x6b2b0800 JavaThread "Thread-1805" daemon [_thread_in_native, id=3308, stack(0x72220000,0x72320000)]
      0x69ec9c00 JavaThread "jrpp-45" [_thread_in_native, id=1956, stack(0x6cdc0000,0x6cec0000)]
      0x6e178c00 JavaThread "jrpp-44" [_thread_in_native, id=4064, stack(0x69200000,0x69300000)]
      0x6a831c00 JavaThread "jrpp-43" [_thread_in_native, id=3924, stack(0x730a0000,0x731a0000)]
      0x6ad81400 JavaThread "jrpp-41" [_thread_blocked, id=1848, stack(0x6cf20000,0x6d020000)]
      0x69cf7c00 JavaThread "jrpp-40" [_thread_in_native, id=248, stack(0x729b0000,0x72ab0000)]
      0x6b0af800 JavaThread "jrpp-39" [_thread_in_native, id=1584, stack(0x70b80000,0x70c80000)]
      0x69dda800 JavaThread "jrpp-38" [_thread_in_native, id=3492, stack(0x72cb0000,0x72db0000)]
      0x685b8800 JavaThread "AWT-Windows" daemon [_thread_in_native, id=3696, stack(0x72ab0000,0x72bb0000)]
      0x6859cc00 JavaThread "jrpp-34" [_thread_in_native, id=5704, stack(0x72bb0000,0x72cb0000)]
      0x6eb7a400 JavaThread "scheduler-21" [_thread_blocked, id=2540, stack(0x728b0000,0x729b0000)]
      0x6b1c4400 JavaThread "jrpp-15" [_thread_in_native, id=6076, stack(0x72420000,0x72520000)]
      0x681b7c00 JavaThread "scheduler-3" [_thread_blocked, id=2064, stack(0x687b0000,0x688b0000)]
      0x6e894800 JavaThread "scheduler-2" [_thread_blocked, id=2216, stack(0x6d870000,0x6d970000)]
      0x6a323c00 JavaThread "SocketTimeout" daemon [_thread_blocked, id=4432, stack(0x727b0000,0x728b0000)]
      0x68165c00 JavaThread "scheduler-1" [_thread_blocked, id=3084, stack(0x70c80000,0x70d80000)]
      0x6a7de400 JavaThread "MySQL Statement Cancellation Timer" daemon [_thread_blocked, id=5724, stack(0x72120000,0x72220000)]
      0x003e6400 JavaThread "DestroyJavaVM" [_thread_blocked, id=980, stack(0x00030000,0x00130000)]
      0x6856e400 JavaThread "Timer-3" daemon [_thread_blocked, id=4992, stack(0x70a80000,0x70b80000)]
      0x685a2400 JavaThread "Java2D Disposer" daemon [_thread_blocked, id=1924, stack(0x72020000,0x72120000)]
      0x6a3f4c00 JavaThread "worker #4" daemon [_thread_blocked, id=332, stack(0x71f20000,0x72020000)]
      0x69ca0400 JavaThread "worker #3" daemon [_thread_blocked, id=5824, stack(0x71e20000,0x71f20000)]
      0x6dee9c00 JavaThread "worker #2" daemon [_thread_blocked, id=3732, stack(0x71d20000,0x71e20000)]
      0x68355400 JavaThread "worker #1" daemon [_thread_blocked, id=5104, stack(0x71c20000,0x71d20000)]
      0x6a1a8c00 JavaThread "worker #0" daemon [_thread_blocked, id=5932, stack(0x719b0000,0x71ab0000)]
      0x6aae0400 JavaThread "ServerThread" daemon [_thread_in_native, id=2504, stack(0x71780000,0x71880000)]
      0x6a223400 JavaThread "Thread-23" [_thread_blocked, id=3204, stack(0x71680000,0x71780000)]
      0x6a222800 JavaThread "Thread-22" [_thread_blocked, id=5164, stack(0x71580000,0x71680000)]
      0x69d65000 JavaThread "Thread-21" [_thread_blocked, id=3624, stack(0x71480000,0x71580000)]
      0x69d64400 JavaThread "Thread-20" [_thread_blocked, id=2480, stack(0x71380000,0x71480000)]
      0x68580000 JavaThread "Thread-19" [_thread_blocked, id=5984, stack(0x71280000,0x71380000)]
      0x69cbf400 JavaThread "Thread-18" [_thread_blocked, id=5064, stack(0x71180000,0x71280000)]
      0x68626800 JavaThread "Thread-17" [_thread_blocked, id=3832, stack(0x71080000,0x71180000)]
      0x68626000 JavaThread "Thread-16" [_thread_blocked, id=1980, stack(0x70f80000,0x71080000)]
      0x68625c00 JavaThread "Thread-15" [_thread_blocked, id=3864, stack(0x70e80000,0x70f80000)]
      0x6a070800 JavaThread "Thread-14" [_thread_blocked, id=4512, stack(0x70d80000,0x70e80000)]
      0x6845b800 JavaThread "Thread-10" [_thread_in_native, id=4780, stack(0x70980000,0x70a80000)]
      0x6ac15800 JavaThread "obj-skimmer" daemon [_thread_blocked, id=5672, stack(0x70880000,0x70980000)]
      0x6ac3d800 JavaThread "obj-skimmer" daemon [_thread_blocked, id=3268, stack(0x70780000,0x70880000)]
      0x6a3f5400 JavaThread "obj-skimmer" daemon [_thread_blocked, id=3400, stack(0x70680000,0x70780000)]
      0x6a225c00 JavaThread "obj-skimmer" daemon [_thread_blocked, id=5816, stack(0x70580000,0x70680000)]
      0x6acd0c00 JavaThread "obj-skimmer" daemon [_thread_blocked, id=3284, stack(0x70480000,0x70580000)]
      0x68581400 JavaThread "obj-skimmer" daemon [_thread_blocked, id=6020, stack(0x70380000,0x70480000)]
      0x6dfdac00 JavaThread "obj-skimmer" daemon [_thread_blocked, id=4536, stack(0x70280000,0x70380000)]
      0x6df85800 JavaThread "obj-skimmer" daemon [_thread_blocked, id=4912, stack(0x70180000,0x70280000)]
      0x6df81800 JavaThread "obj-skimmer" daemon [_thread_blocked, id=3700, stack(0x70080000,0x70180000)]
      0x6dfcec00 JavaThread "obj-skimmer" daemon [_thread_blocked, id=4272, stack(0x6ff80000,0x70080000)]
      0x6a225400 JavaThread "obj-skimmer" daemon [_thread_blocked, id=1748, stack(0x6fe80000,0x6ff80000)]
      0x6dfafc00 JavaThread "scheduler-0" [_thread_blocked, id=3052, stack(0x6d970000,0x6da70000)]
      0x6df02c00 JavaThread "Timer-2" daemon [_thread_blocked, id=2080, stack(0x6d4e0000,0x6d5e0000)]
      0x6b33f000 JavaThread "Timer-1" [_thread_blocked, id=1872, stack(0x6d3e0000,0x6d4e0000)]
      0x6ac8d800 JavaThread "Timer-0" [_thread_blocked, id=2828, stack(0x6d1c0000,0x6d2c0000)]
      0x6aaea800 JavaThread "scheduler-20" [_thread_blocked, id=6072, stack(0x6ccc0000,0x6cdc0000)]
      0x68649800 JavaThread "mipc-1" [_thread_in_native, id=988, stack(0x6cbc0000,0x6ccc0000)]
      0x6ac6d800 JavaThread "Thread-4" [_thread_blocked, id=2228, stack(0x6b5a0000,0x6b6a0000)]
      0x6ae4b400 JavaThread "clock" daemon [_thread_blocked, id=2548, stack(0x6a400000,0x6a500000)]
      0x68490000 JavaThread "scheduler-19" [_thread_blocked, id=3512, stack(0x6cac0000,0x6cbc0000)]
      0x6848f400 JavaThread "scheduler-18" [_thread_blocked, id=3220, stack(0x6c9c0000,0x6cac0000)]
      0x6848e400 JavaThread "scheduler-17" [_thread_blocked, id=3940, stack(0x6c8c0000,0x6c9c0000)]
      0x6848d800 JavaThread "scheduler-16" [_thread_blocked, id=4108, stack(0x6c7c0000,0x6c8c0000)]
      0x68570800 JavaThread "scheduler-15" [_thread_blocked, id=1772, stack(0x6c6c0000,0x6c7c0000)]
      0x6856fc00 JavaThread "scheduler-14" [_thread_blocked, id=1944, stack(0x6c5c0000,0x6c6c0000)]
      0x6856f400 JavaThread "scheduler-13" [_thread_blocked, id=776, stack(0x6c4c0000,0x6c5c0000)]
      0x69eecc00 JavaThread "scheduler-12" [_thread_blocked, id=2468, stack(0x6c3c0000,0x6c4c0000)]
      0x69eec000 JavaThread "scheduler-11" [_thread_blocked, id=4384, stack(0x6c2c0000,0x6c3c0000)]
      0x6aa81400 JavaThread "scheduler-10" [_thread_blocked, id=5628, stack(0x6c1c0000,0x6c2c0000)]
      0x6aa80800 JavaThread "scheduler-9" [_thread_blocked, id=2236, stack(0x6c0c0000,0x6c1c0000)]
      0x685d2800 JavaThread "scheduler-8" [_thread_blocked, id=4216, stack(0x6bfc0000,0x6c0c0000)]
      0x6a1a9800 JavaThread "scheduler-7" [_thread_blocked, id=4260, stack(0x6bec0000,0x6bfc0000)]
      0x69c68800 JavaThread "scheduler-6" [_thread_blocked, id=5120, stack(0x6bdc0000,0x6bec0000)]
      0x69c98800 JavaThread "scheduler-5" [_thread_blocked, id=4396, stack(0x6bcc0000,0x6bdc0000)]
      0x6a1db800 JavaThread "scheduler-4" [_thread_blocked, id=4328, stack(0x6bbc0000,0x6bcc0000)]
      0x69cf5800 JavaThread "scheduler-3" [_thread_blocked, id=2968, stack(0x6bac0000,0x6bbc0000)]
      0x68627400 JavaThread "scheduler-2" [_thread_blocked, id=5024, stack(0x6b9c0000,0x6bac0000)]
      0x69e23400 JavaThread "scheduler-1" [_thread_blocked, id=3208, stack(0x6b8c0000,0x6b9c0000)]
      0x6a123c00 JavaThread "scheduler-0" [_thread_blocked, id=4256, stack(0x6b7c0000,0x6b8c0000)]
      0x68466c00 JavaThread "Transaction Domain PrivateJmsDomain" [_thread_blocked, id=3484, stack(0x6b6c0000,0x6b7c0000)]
      0x68468000 JavaThread "Transaction Domain DefaultDomain" [_thread_blocked, id=320, stack(0x69b00000,0x69c00000)]
      0x68492800 JavaThread "tyrex.util.daemonMaster" daemon [_thread_blocked, id=4340, stack(0x69a00000,0x69b00000)]
      0x68465400 JavaThread "jndi-4" [_thread_in_native, id=5136, stack(0x69900000,0x69a00000)]
      0x6846e800 JavaThread "jndi-3" [_thread_blocked, id=4956, stack(0x69800000,0x69900000)]
      0x6846dc00 JavaThread "jndi-2" [_thread_blocked, id=2256, stack(0x69700000,0x69800000)]
      0x6845ac00 JavaThread "jndi-1" [_thread_blocked, id=396, stack(0x69600000,0x69700000)]
      0x6845a800 JavaThread "jndi-0" [_thread_blocked, id=2248, stack(0x69500000,0x69600000)]
      0x68461400 JavaThread "RMI Scheduler(0)" daemon [_thread_blocked, id=4240, stack(0x69300000,0x69400000)]
      0x68457800 JavaThread "jms-fifo-5" [_thread_blocked, id=5920, stack(0x69100000,0x69200000)]
      0x68456c00 JavaThread "jms-fifo-4" [_thread_blocked, id=3224, stack(0x68f10000,0x69010000)]
      0x68447c00 JavaThread "jms-fifo-3" [_thread_blocked, id=4164, stack(0x68e10000,0x68f10000)]
      0x68449800 JavaThread "jms-fifo-2" [_thread_blocked, id=1824, stack(0x68d10000,0x68e10000)]
      0x68449400 JavaThread "jms-fifo-1" [_thread_blocked, id=1436, stack(0x68c10000,0x68d10000)]
      0x6843a400 JavaThread "GC Daemon" daemon [_thread_blocked, id=4644, stack(0x68b10000,0x68c10000)]
      0x6838a800 JavaThread "RMI Reaper" [_thread_blocked, id=236, stack(0x68a10000,0x68b10000)]
      0x683aec00 JavaThread "RMI TCP Accept-0" daemon [_thread_in_native, id=1836, stack(0x68910000,0x68a10000)]
      0x6777c800 JavaThread "Low Memory Detector" daemon [_thread_blocked, id=3720, stack(0x67ec0000,0x67fc0000)]
      0x6777b000 JavaThread "CompilerThread1" daemon [_thread_blocked, id=5476, stack(0x67dc0000,0x67ec0000)]
      0x67775400 JavaThread "CompilerThread0" daemon [_thread_blocked, id=2280, stack(0x67cc0000,0x67dc0000)]
      0x67774400 JavaThread "Attach Listener" daemon [_thread_blocked, id=2188, stack(0x67bc0000,0x67cc0000)]
      0x67773000 JavaThread "Signal Dispatcher" daemon [_thread_blocked, id=2012, stack(0x67ac0000,0x67bc0000)]
      0x6775c000 JavaThread "Finalizer" daemon [_thread_blocked, id=1532, stack(0x679c0000,0x67ac0000)]
      0x67757c00 JavaThread "Reference Handler" daemon [_thread_blocked, id=3692, stack(0x678c0000,0x679c0000)]
    Other Threads:
      0x67754c00 VMThread [stack: 0x677c0000,0x678c0000] [id=4864]
      0x6777e000 WatcherThread [stack: 0x67fc0000,0x680c0000] [id=4592]
    =>0x003ec800 (exited) GCTaskThread [stack: 0x675c0000,0x676c0000] [id=3532]
    VM state:at safepoint (normal execution)
    VM Mutex/Monitor currently owned by a thread:  ([mutex/lock_event])
    [0x003e5950/0x000006f8] Threads_lock - owner thread: 0x67754c00
    [0x003e5af0/0x000006b8] Heap_lock - owner thread: 0x6ad81400
    Heap
    PSYoungGen      total 123008K, used 94255K [0x5d450000, 0x66f70000, 0x66fd0000)
      eden space 90752K, 100% used [0x5d450000,0x62cf0000,0x62cf0000)
      from space 32256K, 10% used [0x62cf0000,0x6305bc90,0x64c70000)
      to   space 31424K, 28% used [0x650c0000,0x65968d98,0x66f70000)
    PSOldGen        total 220864K, used 165707K [0x0f7d0000, 0x1cf80000, 0x5d450000)
      object space 220864K, 75% used [0x0f7d0000,0x199a2ef0,0x1cf80000)
    PSPermGen       total 74752K, used 72956K [0x037d0000, 0x080d0000, 0x0f7d0000)
      object space 74752K, 97% used [0x037d0000,0x07f0f370,0x080d0000)
    Dynamic libraries:
    0x00400000 - 0x00410000 C:\ColdFusion8\runtime\bin\jrun.exe
    0x7c800000 - 0x7c8c2000 C:\WINDOWS\system32\ntdll.dll
    0x77e40000 - 0x77f42000 C:\WINDOWS\system32\kernel32.dll
    0x7d1e0000 - 0x7d27c000 C:\WINDOWS\system32\ADVAPI32.dll
    0x77c50000 - 0x77cef000 C:\WINDOWS\system32\RPCRT4.dll
    0x76f50000 - 0x76f63000 C:\WINDOWS\system32\Secur32.dll
    0x77ba0000 - 0x77bfa000 C:\WINDOWS\system32\MSVCRT.dll
    0x6dac0000 - 0x6de7a000 C:\ColdFusion8\runtime\jre\bin\server\jvm.dll
    0x77380000 - 0x77411000 C:\WINDOWS\system32\USER32.dll
    0x77c00000 - 0x77c49000 C:\WINDOWS\system32\GDI32.dll
    0x76aa0000 - 0x76acd000 C:\WINDOWS\system32\WINMM.dll
    0x7c360000 - 0x7c3b6000 C:\WINDOWS\system32\MSVCR71.dll
    0x76290000 - 0x762ad000 C:\WINDOWS\system32\IMM32.DLL
    0x6d320000 - 0x6d328000 C:\ColdFusion8\runtime\jre\bin\hpi.dll
    0x76b70000 - 0x76b7b000 C:\WINDOWS\system32\PSAPI.DLL
    0x6d820000 - 0x6d82c000 C:\ColdFusion8\runtime\jre\bin\verify.dll
    0x6d3c0000 - 0x6d3df000 C:\ColdFusion8\runtime\jre\bin\java.dll
    0x6d860000 - 0x6d86f000 C:\ColdFusion8\runtime\jre\bin\zip.dll
    0x6d620000 - 0x6d633000 C:\ColdFusion8\runtime\jre\bin\net.dll
    0x71c00000 - 0x71c17000 C:\WINDOWS\system32\WS2_32.dll
    0x71bf0000 - 0x71bf8000 C:\WINDOWS\system32\WS2HELP.dll
    0x71b20000 - 0x71b61000 C:\WINDOWS\System32\mswsock.dll
    0x76ed0000 - 0x76efa000 C:\WINDOWS\system32\DNSAPI.dll
    0x76f70000 - 0x76f77000 C:\WINDOWS\System32\winrnr.dll
    0x76f10000 - 0x76f3e000 C:\WINDOWS\system32\WLDAP32.dll
    0x76f80000 - 0x76f85000 C:\WINDOWS\system32\rasadhlp.dll
    0x68740000 - 0x6874c000 C:\ColdFusion8\runtime\bin\portscan.dll
    0x68750000 - 0x687aa000 C:\WINDOWS\system32\hnetcfg.dll
    0x71ae0000 - 0x71ae8000 C:\WINDOWS\System32\wshtcpip.dll
    0x688b0000 - 0x688e5000 C:\WINDOWS\system32\rsaenh.dll
    0x7c8d0000 - 0x7d0cf000 C:\WINDOWS\system32\SHELL32.dll
    0x7d180000 - 0x7d1d2000 C:\WINDOWS\system32\SHLWAPI.dll
    0x77420000 - 0x77523000 C:\WINDOWS\WinSxS\x86_Microsoft.Windows.Common-Controls_6595b64144ccf1df_6.0.3790.3959_x-w w_D8713E55\comctl32.dll
    0x6d7c0000 - 0x6d7c6000 C:\ColdFusion8\runtime\jre\bin\rmi.dll
    0x6d800000 - 0x6d808000 C:\ColdFusion8\runtime\jre\bin\sunmscapi.dll
    0x761b0000 - 0x76243000 C:\WINDOWS\system32\CRYPT32.dll
    0x76190000 - 0x761a2000 C:\WINDOWS\system32\MSASN1.dll
    0x69010000 - 0x69090000 C:\ColdFusion8\lib\izmjniado.dll
    0x77670000 - 0x777a9000 C:\WINDOWS\system32\ole32.dll
    0x77d00000 - 0x77d8b000 C:\WINDOWS\system32\OLEAUT32.dll
    0x69090000 - 0x69098000 C:\ColdFusion8\lib\CFXNeo.dll
    0x690a0000 - 0x690b0000 C:\WINDOWS\system32\MSVCIRT.dll
    0x69400000 - 0x69465000 C:\WINDOWS\system32\MSVCP60.dll
    0x690b0000 - 0x690be000 C:\ColdFusion8\lib\cfregistry.dll
    0x690d0000 - 0x690e0000 C:\ColdFusion8\lib\PerfmonClient.dll
    0x71880000 - 0x719ae000 C:\ColdFusion8\runtime\jre\bin\awt.dll
    0x73070000 - 0x73097000 C:\WINDOWS\system32\WINSPOOL.DRV
    0x73860000 - 0x738ab000 C:\WINDOWS\system32\ddraw.dll
    0x73b30000 - 0x73b36000 C:\WINDOWS\system32\DCIMAN32.dll
    0x6d2c0000 - 0x6d313000 C:\ColdFusion8\runtime\jre\bin\fontmanager.dll
    0x69490000 - 0x69499000 C:\ColdFusion8\runtime\jre\bin\management.dll
    0x6a540000 - 0x6a549000 C:\ColdFusion8\runtime\jre\bin\nio.dll
    0x6a550000 - 0x6a573000 C:\ColdFusion8\runtime\jre\bin\dcpr.dll
    0x6a590000 - 0x6a597000 C:\ColdFusion8\lib\NeoUUID.dll
    0x6cec0000 - 0x6cf17000 C:\WINDOWS\system32\NETAPI32.dll
    0x6d020000 - 0x6d04f000 C:\ColdFusion8\runtime\jre\bin\cmm.dll
    0x6d050000 - 0x6d074000 C:\ColdFusion8\runtime\jre\bin\jpeg.dll
    0x6d080000 - 0x6d08b000 C:\ColdFusion8\lib\clib_jiio_util.dll
    0x72eb0000 - 0x72fbc000 C:\ColdFusion8\lib\clib_jiio_sse2.dll
    VM Arguments:
    jvm_args: -Xmx1400m -Dsun.io.useCanonCaches=false -XX:MaxPermSize=192m -XX:+UseParallelGC -Dcoldfusion.rootDir=C:\ColdFusion8\runtime/../ -Dcoldfusion.libPath=C:\ColdFusion8\runtime/../lib -Dcoldfusion.classPath=C:\ColdFusion8\runtime/../lib/updates,C:\ColdFusion8\runtime/../li b,C:\ColdFusion8\runtime/../gateway/lib/,C:\ColdFusion8\runtime/../wwwroot/WEB-INF/flex/ja rs,C:\ColdFusion8\runtime/../wwwroot/WEB-INF/cfform/jars,"C:\Program Files\Apache Software Foundation\Apache2.2\htdocs\InterWeb-Prod\includes\classes" -Djmx.invoke.getters=true
    java_command: <unknown>
    Launcher Type: generic
    Environment Variables:
    PATH=C:\ColdFusion8\runtime\..\lib;C:\ColdFusion8\runtime\..\jintegra\bin;C:\ColdFusion8\r untime\..\jintegra\bin\international;C:\ColdFusion8\verity\k2\_nti40\bin;C:\WINDOWS\system 32;C:\WINDOWS;C:\WINDOWS\System32\Wbem;C:\Program Files\TortoiseSVN\bin;C:\Program Files\Subversion\bin
    OS=Windows_NT
    PROCESSOR_IDENTIFIER=x86 Family 6 Model 26 Stepping 4, GenuineIntel
    ---------------  S Y S T E M  ---------------
    OS: Windows Server 2003 family Build 3790 Service Pack 2
    CPU:total 1 (1 cores per cpu, 1 threads per core) family 6 model 10 stepping 4, cmov, cx8, fxsr, mmx, sse, sse2, sse3, ssse3
    Memory: 4k page, physical 2097151k(2097151k free), swap 4194303k(4194303k free)
    vm_info: Java HotSpot(TM) Server VM (10.0-b19) for windows-x86 JRE (1.6.0_04-b12), built on Dec 14 2007 00:46:56 by "java_re" with MS VC++ 7.1
    time: Wed Jun 23 14:12:21 2010
    elapsed time: 14601 seconds

    Hello,
    Part of the HS_ERR_PID says:
    # Java VM: Java HotSpot(TM) Server VM (1.6.0_01-b06 mixed mode)
    Does that mean you are running CF8 without updater1 applied? If updater1 was there I would expect JVM 1.6.0_04. Give that is correct you could apply updater1 and once that is done even update the JVM to a more current version. I see Java Dev Kit 1.6.0_23 is current, I have successfully used CF8 with 1.6.0_22.
    There might be some interesting detail in the coldfusion-out.log file which likely is in [CF]\runtime\logs or [Jrun]\logs pending server or multiserver.
    HTH, Carl.

  • GrowableArray.cpp. Out of swap space?

    Hi,
    I need some help interpreting an error log (the complete log is pasted below)
    The application (JBoss 4.2.2) is started on win 2003 with -Xms256m -Xmx1400m -XX:MaxPermSize=256m
    the log shows the following memory usage:
    Heap
    PSYoungGen      total 141760K, used 13076K [0x61650000, 0x6b170000, 0x6b1d0000)
      eden space 124992K, 0% used [0x61650000,0x61650000,0x69060000)
      from space 16768K, 77% used [0x69060000,0x69d25230,0x6a0c0000)
      to   space 16448K, 0% used [0x6a160000,0x6a160000,0x6b170000)
    PSOldGen        total 1274368K, used 1246444K [0x139d0000, 0x61650000, 0x61650000)
      object space 1274368K, 97% used [0x139d0000,0x5fb0b398,0x61650000)
    PSPermGen       total 60032K, used 59667K [0x039d0000, 0x07470000, 0x139d0000)
      object space 60032K, 99% used [0x039d0000,0x07414c88,0x07470000)Some of the threads that I read about the "growableArray.cpp. Out of swap space?" problem indicated that the problem may not be related to my memory settings.
    However, the PSPermGen section is included under "Heap". I always thought the MaxPermsize is in addition to the heap size. Also the total of PSPermGen is significantly lower than specified in MaxPermSize while at the same time the usage is at 99%.
    At the moment I can not really pinpoint what situation exactly is causing the problem since the scenario is rather complex, pushing a lot of data into the system, a lot of clients in parallel running queries and requesting the data etc. But with this particular scenario we can reproduce this error within a couple of hours.
    Would it help to increase the virtual address space of windows to 3GB? Would the jvm actually take advantage of it?
    Here is the complete log
    # An unexpected error has been detected by Java Runtime Environment:
    # java.lang.OutOfMemoryError: requested 1024000 bytes for GrET in C:\BUILD_AREA\jdk6_02\hotspot\src\share\vm\utilities\growableArray.cpp. Out of swap space?
    #  Internal Error (414C4C4F434154494F4E0E494E4C494E450E4850500017), pid=4312, tid=11828
    # Java VM: Java HotSpot(TM) Server VM (1.6.0_02-b06 mixed mode)
    # If you would like to submit a bug report, please visit:
    #   http://java.sun.com/webapps/bugreport/crash.jsp
    ---------------  T H R E A D  ---------------
    Current thread (0x6ba32000):  VMThread [id=11828]
    Stack: [0x6bd80000,0x6bdd0000)
    [error occurred during error reporting, step 110, id 0xc0000005]
    VM_Operation (0x7363edd0): parallel gc failed allocation, mode: safepoint, requested by thread 0x6c291800
    ---------------  P R O C E S S  ---------------
    Java Threads: ( => current thread )
      0x77839c00 JavaThread "RMI TCP Connection(434)-172.16.9.236" daemon [_thread_in_native, id=5048]
      0x709ca400 JavaThread "JMS SessionPool Worker-728" daemon [_thread_blocked, id=8176]
      0x78d57400 JavaThread "JMS SessionPool Worker-727" daemon [_thread_blocked, id=15028]
      0x78df1400 JavaThread "JMS SessionPool Worker-726" daemon [_thread_blocked, id=6672]
      0x7b58f400 JavaThread "JMS SessionPool Worker-725" daemon [_thread_blocked, id=7920]
      0x78c1e400 JavaThread "JMS SessionPool Worker-724" daemon [_thread_blocked, id=6744]
      0x78dcd800 JavaThread "JMS SessionPool Worker-723" daemon [_thread_blocked, id=6576]
      0x78dcd400 JavaThread "JMS SessionPool Worker-722" daemon [_thread_blocked, id=7620]
      0x7b899800 JavaThread "JMS SessionPool Worker-721" daemon [_thread_blocked, id=7868]
      0x78e83c00 JavaThread "JMS SessionPool Worker-720" daemon [_thread_blocked, id=7948]
      0x78e0ac00 JavaThread "JMS SessionPool Worker-719" daemon [_thread_blocked, id=5928]
      0x78cbec00 JavaThread "JMS SessionPool Worker-718" daemon [_thread_blocked, id=16232]
      0x78d6ec00 JavaThread "JMS SessionPool Worker-717" daemon [_thread_blocked, id=7240]
      0x7b9d6c00 JavaThread "JMS SessionPool Worker-716" daemon [_thread_blocked, id=16828]
      0x78ad4c00 JavaThread "JMS SessionPool Worker-715" daemon [_thread_blocked, id=10300]
      0x78dd7c00 JavaThread "JMS SessionPool Worker-714" daemon [_thread_blocked, id=15012]
      0x78ec0c00 JavaThread "JMS SessionPool Worker-713" daemon [_thread_blocked, id=10888]
      0x7d6bdc00 JavaThread "JMS SessionPool Worker-712" daemon [_thread_blocked, id=5888]
      0x79f3e400 JavaThread "JMS SessionPool Worker-711" daemon [_thread_blocked, id=14468]
      0x7d6bec00 JavaThread "JMS SessionPool Worker-710" daemon [_thread_blocked, id=16032]
      0x7d6be400 JavaThread "JMS SessionPool Worker-709" daemon [_thread_blocked, id=14572]
      0x7fc30400 JavaThread "JMS SessionPool Worker-708" daemon [_thread_blocked, id=10932]
      0x7d6b8400 JavaThread "JMS SessionPool Worker-707" daemon [_thread_blocked, id=15264]
      0x7d666400 JavaThread "JMS SessionPool Worker-706" daemon [_thread_blocked, id=14580]
      0x7d6b1400 JavaThread "JMS SessionPool Worker-705" daemon [_thread_blocked, id=13996]
      0x78e50000 JavaThread "JMS SessionPool Worker-704" daemon [_thread_blocked, id=14964]
      0x7d6b2400 JavaThread "JMS SessionPool Worker-703" daemon [_thread_blocked, id=14852]
      0x7e981000 JavaThread "JMS SessionPool Worker-702" daemon [_thread_blocked, id=6548]
      0x79800800 JavaThread "JMS SessionPool Worker-701" daemon [_thread_blocked, id=11060]
      0x795b0400 JavaThread "JMS SessionPool Worker-700" daemon [_thread_blocked, id=9112]
      0x78de8800 JavaThread "JMS SessionPool Worker-699" daemon [_thread_blocked, id=4984]
      0x7bc3c800 JavaThread "JMS SessionPool Worker-698" daemon [_thread_blocked, id=6712]
      0x7d81a400 JavaThread "JMS SessionPool Worker-697" daemon [_thread_blocked, id=14808]
      0x7bcf2400 JavaThread "JMS SessionPool Worker-696" daemon [_thread_blocked, id=14660]
      0x7bbbb400 JavaThread "JMS SessionPool Worker-691" daemon [_thread_blocked, id=15036]
      0x7bcaa400 JavaThread "JMS SessionPool Worker-689" daemon [_thread_blocked, id=8568]
      0x788be400 JavaThread "JMS SessionPool Worker-688" daemon [_thread_blocked, id=7712]
      0x78fb0400 JavaThread "JMS SessionPool Worker-686" daemon [_thread_blocked, id=8676]
      0x79047400 JavaThread "JMS SessionPool Worker-685" daemon [_thread_blocked, id=11928]
      0x7bd35400 JavaThread "JMS SessionPool Worker-684" daemon [_thread_blocked, id=8348]
      0x792f9400 JavaThread "JMS SessionPool Worker-678" daemon [_thread_blocked, id=1732]
      0x7a0f8400 JavaThread "JMS SessionPool Worker-677" daemon [_thread_blocked, id=5932]
      0x7fa9b800 JavaThread "JMS SessionPool Worker-676" daemon [_thread_blocked, id=7300]
      0x79f2dc00 JavaThread "JMS SessionPool Worker-666" daemon [_thread_blocked, id=10304]
      0x79902400 JavaThread "JMS SessionPool Worker-653" daemon [_thread_blocked, id=10488]
      0x7f19d400 JavaThread "JMS SessionPool Worker-641" daemon [_thread_blocked, id=11020]
      0x79a83400 JavaThread "JMS SessionPool Worker-633" daemon [_thread_blocked, id=16852]
      0x79d5d800 JavaThread "JMS SessionPool Worker-601" daemon [_thread_blocked, id=12972]
      0x709a2400 JavaThread "WorkerThread#3[172.16.9.236:1441]" [_thread_blocked, id=15300]
      0x6f2fb400 JavaThread "http-172.16.9.236-8080-192" daemon [_thread_blocked, id=1908]
      0x78937400 JavaThread "http-172.16.9.236-8080-191" daemon [_thread_blocked, id=15528]
      0x788f9400 JavaThread "http-172.16.9.236-8080-190" daemon [_thread_blocked, id=14636]
      0x7889f400 JavaThread "http-172.16.9.236-8080-189" daemon [_thread_in_native, id=15664]
      0x7878f800 JavaThread "http-172.16.9.236-8080-188" daemon [_thread_blocked, id=15024]
      0x78ac0400 JavaThread "http-172.16.9.236-8080-187" daemon [_thread_blocked, id=14748]
      0x788f3c00 JavaThread "http-172.16.9.236-8080-186" daemon [_thread_blocked, id=4420]
      0x6f2cbc00 JavaThread "http-172.16.9.236-8080-185" daemon [_thread_blocked, id=14740]
      0x6f789800 JavaThread "http-172.16.9.236-8080-184" daemon [_thread_in_native, id=16184]
      0x788d7800 JavaThread "http-172.16.9.236-8080-183" daemon [_thread_blocked, id=15088]
      0x6f8f0400 JavaThread "http-172.16.9.236-8080-182" daemon [_thread_blocked, id=16208]
      0x6f878400 JavaThread "http-172.16.9.236-8080-181" daemon [_thread_in_native, id=12376]
      0x6f67b400 JavaThread "http-172.16.9.236-8080-180" daemon [_thread_blocked, id=15472]
      0x6f715800 JavaThread "http-172.16.9.236-8080-179" daemon [_thread_blocked, id=17320]
      0x6f808c00 JavaThread "http-172.16.9.236-8080-178" daemon [_thread_blocked, id=16268]
      0x6fd3dc00 JavaThread "http-172.16.9.236-8080-177" daemon [_thread_in_native, id=11148]
      0x6f981c00 JavaThread "http-172.16.9.236-8080-176" daemon [_thread_in_native, id=7184]
      0x6f861c00 JavaThread "http-172.16.9.236-8080-175" daemon [_thread_in_native, id=16180]
      0x6f9b3800 JavaThread "http-172.16.9.236-8080-174" daemon [_thread_blocked, id=16128]
      0x6f9b3400 JavaThread "http-172.16.9.236-8080-173" daemon [_thread_blocked, id=16176]
      0x6f445800 JavaThread "http-172.16.9.236-8080-172" daemon [_thread_in_native, id=6344]
      0x6f3e3800 JavaThread "http-172.16.9.236-8080-171" daemon [_thread_in_native, id=6496]
      0x6e3fa400 JavaThread "http-172.16.9.236-8080-170" daemon [_thread_in_native, id=5056]
      0x70dd3400 JavaThread "http-172.16.9.236-8080-169" daemon [_thread_in_native, id=8736]
      0x6eacf400 JavaThread "http-172.16.9.236-8080-168" daemon [_thread_in_native, id=8716]
      0x6cd32800 JavaThread "JMS SessionPool Worker-120" daemon [_thread_blocked, id=7368]
      0x790bf400 JavaThread "JMS SessionPool Worker-119" daemon [_thread_blocked, id=7596]
      0x7905fc00 JavaThread "JMS SessionPool Worker-118" daemon [_thread_blocked, id=7844]
      0x7905f400 JavaThread "JMS SessionPool Worker-117" daemon [_thread_blocked, id=5160]
      0x790ef400 JavaThread "JMS SessionPool Worker-116" daemon [_thread_blocked, id=936]
      0x7094a800 JavaThread "JMS SessionPool Worker-115" daemon [_thread_blocked, id=13688]
      0x6e5b2400 JavaThread "JMS SessionPool Worker-114" daemon [_thread_blocked, id=7404]
      0x6fa5d400 JavaThread "JMS SessionPool Worker-113" daemon [_thread_blocked, id=10112]
      0x6e66a400 JavaThread "JMS SessionPool Worker-86" daemon [_thread_blocked, id=16188]
      0x6e474400 JavaThread "http-172.16.9.236-8080-167" daemon [_thread_blocked, id=17304]
      0x6e43d400 JavaThread "http-172.16.9.236-8080-166" daemon [_thread_blocked, id=17124]
      0x6e3fe800 JavaThread "http-172.16.9.236-8080-165" daemon [_thread_in_native, id=17276]
      0x6e45bc00 JavaThread "http-172.16.9.236-8080-164" daemon [_thread_in_native, id=17188]
      0x6e45b400 JavaThread "http-172.16.9.236-8080-163" daemon [_thread_blocked, id=13100]
      0x6e483800 JavaThread "http-172.16.9.236-8080-162" daemon [_thread_blocked, id=17932]
      0x6e04ac00 JavaThread "http-172.16.9.236-8080-161" daemon [_thread_in_native, id=17344]
      0x7850e800 JavaThread "http-172.16.9.236-8080-160" daemon [_thread_in_native, id=12496]
      0x706da400 JavaThread "http-172.16.9.236-8080-159" daemon [_thread_in_native, id=12472]
      0x70814400 JavaThread "http-172.16.9.236-8080-158" daemon [_thread_blocked, id=17456]
      0x6e131800 JavaThread "http-172.16.9.236-8080-157" daemon [_thread_blocked, id=12644]
      0x6e105400 JavaThread "http-172.16.9.236-8080-156" daemon [_thread_in_native, id=17404]
      0x6e241400 JavaThread "http-172.16.9.236-8080-155" daemon [_thread_blocked, id=6608]
      0x6f88d400 JavaThread "http-172.16.9.236-8080-154" daemon [_thread_in_native, id=17396]
      0x6ccde800 JavaThread "http-172.16.9.236-8080-153" daemon [_thread_in_native, id=17400]
      0x7099f400 JavaThread "http-172.16.9.236-8080-152" daemon [_thread_in_native, id=12620]
      0x6e250c00 JavaThread "http-172.16.9.236-8080-151" daemon [_thread_blocked, id=17508]
      0x6e3eb400 JavaThread "http-172.16.9.236-8080-150" daemon [_thread_in_native, id=17468]
      0x6f7be800 JavaThread "http-172.16.9.236-8080-149" daemon [_thread_blocked, id=13412]
      0x70b87400 JavaThread "http-172.16.9.236-8080-148" daemon [_thread_blocked, id=17328]
      0x6e394400 JavaThread "http-172.16.9.236-8080-147" daemon [_thread_blocked, id=9076]
      0x6f73dc00 JavaThread "http-172.16.9.236-8080-146" daemon [_thread_blocked, id=12488]
      0x6f73d400 JavaThread "http-172.16.9.236-8080-145" daemon [_thread_blocked, id=12860]
      0x6e0b0400 JavaThread "http-172.16.9.236-8080-144" daemon [_thread_blocked, id=12660]
      0x6df10800 JavaThread "http-172.16.9.236-8080-143" daemon [_thread_blocked, id=17476]
      0x6de63800 JavaThread "http-172.16.9.236-8080-142" daemon [_thread_blocked, id=12540]
      0x6df33400 JavaThread "http-172.16.9.236-8080-141" daemon [_thread_blocked, id=12484]
      0x6c280800 JavaThread "http-172.16.9.236-8080-140" daemon [_thread_in_native, id=11688]
      0x6c236000 JavaThread "http-172.16.9.236-8080-139" daemon [_thread_blocked, id=13900]
      0x6dec1800 JavaThread "http-172.16.9.236-8080-138" daemon [_thread_in_native, id=4988]
      0x6df8d400 JavaThread "http-172.16.9.236-8080-137" daemon [_thread_in_native, id=12548]
      0x6df59400 JavaThread "http-172.16.9.236-8080-136" daemon [_thread_in_native, id=18416]
      0x6de5c800 JavaThread "http-172.16.9.236-8080-135" daemon [_thread_blocked, id=12536]
      0x6dea0400 JavaThread "http-172.16.9.236-8080-134" daemon [_thread_blocked, id=10492]
      0x6dfb0400 JavaThread "http-172.16.9.236-8080-133" daemon [_thread_in_native, id=12888]
      0x6e142800 JavaThread "http-172.16.9.236-8080-132" daemon [_thread_blocked, id=12700]
      0x6de75400 JavaThread "http-172.16.9.236-8080-131" daemon [_thread_in_native, id=12880]
      0x6de49400 JavaThread "http-172.16.9.236-8080-130" daemon [_thread_blocked, id=12608]
      0x6c2c5800 JavaThread "http-172.16.9.236-8080-129" daemon [_thread_blocked, id=12796]
      0x6cd22c00 JavaThread "http-172.16.9.236-8080-128" daemon [_thread_blocked, id=12820]
      0x6cd22400 JavaThread "http-172.16.9.236-8080-127" daemon [_thread_blocked, id=13676]
      0x6cc29c00 JavaThread "http-172.16.9.236-8080-126" daemon [_thread_in_native, id=13024]
      0x6cc29400 JavaThread "http-172.16.9.236-8080-125" daemon [_thread_in_native, id=12464]
      0x789bd800 JavaThread "http-172.16.9.236-8080-124" daemon [_thread_blocked, id=4788]
      0x6de77400 JavaThread "JMS SessionPool Worker-85" daemon [_thread_blocked, id=6556]
      0x6e367800 JavaThread "Thread-159" daemon [_thread_blocked, id=5536]
      0x6c85a800 JavaThread "http-172.16.9.236-8080-123" daemon [_thread_blocked, id=13124]
      0x6c245400 JavaThread "http-172.16.9.236-8080-122" daemon [_thread_in_native, id=5152]
      0x6de7d400 JavaThread "http-172.16.9.236-8080-121" daemon [_thread_blocked, id=13280]
      0x6c97e800 JavaThread "http-172.16.9.236-8080-120" daemon [_thread_blocked, id=13508]
      0x6ccd6400 JavaThread "http-172.16.9.236-8080-119" daemon [_thread_in_native, id=18184]
      0x6ccce400 JavaThread "http-172.16.9.236-8080-118" daemon [_thread_blocked, id=13264]
      0x7042b800 JavaThread "http-172.16.9.236-8080-117" daemon [_thread_blocked, id=9724]
      0x70752400 JavaThread "http-172.16.9.236-8080-116" daemon [_thread_in_native, id=10796]
      0x6cc61400 JavaThread "http-172.16.9.236-8080-115" daemon [_thread_blocked, id=9276]
      0x796e8c00 JavaThread "http-172.16.9.236-8080-114" daemon [_thread_blocked, id=10136]
      0x796e8400 JavaThread "http-172.16.9.236-8080-113" daemon [_thread_in_native, id=4692]
      0x796d0800 JavaThread "http-172.16.9.236-8080-112" daemon [_thread_blocked, id=13476]
      0x79710400 JavaThread "http-172.16.9.236-8080-111" daemon [_thread_in_native, id=1536]
      0x6caa0800 JavaThread "http-172.16.9.236-8080-110" daemon [_thread_in_native, id=13260]
      0x6caa0400 JavaThread "http-172.16.9.236-8080-109" daemon [_thread_blocked, id=8884]
      0x6ca0f800 JavaThread "http-172.16.9.236-8080-108" daemon [_thread_blocked, id=7036]
      0x6ca0f400 JavaThread "http-172.16.9.236-8080-107" daemon [_thread_blocked, id=13156]
      0x6c290400 JavaThread "http-172.16.9.236-8080-106" daemon [_thread_blocked, id=10184]
      0x795c9c00 JavaThread "http-172.16.9.236-8080-105" daemon [_thread_blocked, id=8280]
      0x6f15f800 JavaThread "http-172.16.9.236-8080-104" daemon [_thread_blocked, id=9880]
      0x6f15f400 JavaThread "http-172.16.9.236-8080-103" daemon [_thread_blocked, id=9344]
      0x795e9c00 JavaThread "http-172.16.9.236-8080-102" daemon [_thread_blocked, id=17808]
      0x6de80400 JavaThread "http-172.16.9.236-8080-101" daemon [_thread_in_native, id=14384]
      0x79251400 JavaThread "http-172.16.9.236-8080-100" daemon [_thread_in_native, id=6560]
      0x6cac0400 JavaThread "http-172.16.9.236-8080-99" daemon [_thread_in_native, id=5792]
      0x78d97400 JavaThread "http-172.16.9.236-8080-98" daemon [_thread_blocked, id=8936]
      0x709a6400 JavaThread "http-172.16.9.236-8080-97" daemon [_thread_blocked, id=9340]
      0x793d0c00 JavaThread "http-172.16.9.236-8080-96" daemon [_thread_in_native, id=13880]
      0x7943f800 JavaThread "http-172.16.9.236-8080-95" daemon [_thread_blocked, id=8248]
      0x7940f800 JavaThread "http-172.16.9.236-8080-94" daemon [_thread_in_native, id=9752]
      0x7941f800 JavaThread "http-172.16.9.236-8080-93" daemon [_thread_blocked, id=9212]
      0x6ca5a400 JavaThread "http-172.16.9.236-8080-92" daemon [_thread_blocked, id=8780]
      0x7942fc00 JavaThread "http-172.16.9.236-8080-91" daemon [_thread_in_native, id=18200]
      0x6f5cf400 JavaThread "http-172.16.9.236-8080-90" daemon [_thread_in_native, id=8748]
      0x78b16400 JavaThread "http-172.16.9.236-8080-89" daemon [_thread_blocked, id=9744]
      0x70919c00 JavaThread "http-172.16.9.236-8080-88" daemon [_thread_in_native, id=5564]
      0x6cc2a800 JavaThread "http-172.16.9.236-8080-87" daemon [_thread_blocked, id=16932]
      0x6debc400 JavaThread "JMS SessionPool Worker-84" daemon [_thread_blocked, id=13928]
      0x6cd26400 JavaThread "http-172.16.9.236-8080-86" daemon [_thread_blocked, id=1576]
      0x6de4d400 JavaThread "http-172.16.9.236-8080-85" daemon [_thread_in_native, id=4428]
      0x6de67800 JavaThread "http-172.16.9.236-8080-84" daemon [_thread_blocked, id=13876]
      0x6de67400 JavaThread "http-172.16.9.236-8080-83" daemon [_thread_blocked, id=11440]
      0x6de81c00 JavaThread "http-172.16.9.236-8080-82" daemon [_thread_blocked, id=276]
      0x6dea4c00 JavaThread "http-172.16.9.236-8080-81" daemon [_thread_in_native, id=13836]
      0x6df23800 JavaThread "http-172.16.9.236-8080-80" daemon [_thread_blocked, id=5280]
      0x6f160400 JavaThread "http-172.16.9.236-8080-79" daemon [_thread_blocked, id=17548]
      0x6df23400 JavaThread "http-172.16.9.236-8080-78" daemon [_thread_in_native, id=14276]
      0x6dee4c00 JavaThread "http-172.16.9.236-8080-77" daemon [_thread_blocked, id=5880]
      0x6ffc1800 JavaThread "http-172.16.9.236-8080-76" daemon [_thread_in_native, id=17908]
      0x7042fc00 JavaThread "http-172.16.9.236-8080-75" daemon [_thread_blocked, id=13536]
      0x6f043c00 JavaThread "http-172.16.9.236-8080-74" daemon [_thread_blocked, id=15312]
      0x7050b400 JavaThread "http-172.16.9.236-8080-73" daemon [_thread_in_native, id=4408]
      0x6cb96800 JavaThread "http-172.16.9.236-8080-72" daemon [_thread_blocked, id=4248]
      0x6cbf1400 JavaThread "http-172.16.9.236-8080-71" daemon [_thread_in_native, id=11844]
      0x6cbec800 JavaThread "http-172.16.9.236-8080-70" daemon [_thread_blocked, id=9644]
      0x6ca79800 JavaThread "http-172.16.9.236-8080-69" daemon [_thread_blocked, id=13672]
      0x6cb76c00 JavaThread "http-172.16.9.236-8080-68" daemon [_thread_blocked, id=14304]
      0x6cb97c00 JavaThread "http-172.16.9.236-8080-67" daemon [_thread_blocked, id=18396]
      0x6cb97400 JavaThread "http-172.16.9.236-8080-66" daemon [_thread_blocked, id=17604]
      0x6fea2400 JavaThread "http-172.16.9.236-8080-65" daemon [_thread_blocked, id=17816]
      0x6fea3800 JavaThread "http-172.16.9.236-8080-64" daemon [_thread_in_native, id=8612]
      0x6c8e7400 JavaThread "http-172.16.9.236-8080-63" daemon [_thread_blocked, id=14460]
      0x6c9af800 JavaThread "http-172.16.9.236-8080-62" daemon [_thread_blocked, id=13824]
      0x6c9adc00 JavaThread "http-172.16.9.236-8080-61" daemon [_thread_blocked, id=17972]
      0x6c9ad400 JavaThread "http-172.16.9.236-8080-60" daemon [_thread_blocked, id=740]
      0x6c8e7c00 JavaThread "http-172.16.9.236-8080-59" daemon [_thread_in_native, id=14112]
      0x6c8eb800 JavaThread "http-172.16.9.236-8080-58" daemon [_thread_blocked, id=15376]
      0x6c19b800 JavaThread "http-172.16.9.236-8080-57" daemon [_thread_blocked, id=14164]
      0x6c19c000 JavaThread "http-172.16.9.236-8080-56" daemon [_thread_blocked, id=13916]
      0x6c9dcc00 JavaThread "http-172.16.9.236-8080-55" daemon [_thread_in_native, id=17896]
      0x6c8e8800 JavaThread "http-172.16.9.236-8080-54" daemon [_thread_blocked, id=18364]
      0x6ca58400 JavaThread "http-172.16.9.236-8080-53" daemon [_thread_blocked, id=14104]
      0x6c8eac00 JavaThread "http-172.16.9.236-8080-52" daemon [_thread_in_native, id=18376]
      0x6c9ea800 JavaThread "http-172.16.9.236-8080-51" daemon [_thread_blocked, id=13764]
      0x6c9d1000 JavaThread "http-172.16.9.236-8080-50" daemon [_thread_blocked, id=14156]
      0x6c9ce400 JavaThread "http-172.16.9.236-8080-49" daemon [_thread_blocked, id=9156]
      0x6c8e9800 JavaThread "http-172.16.9.236-8080-48" daemon [_thread_blocked, id=11404]
      0x6c9b3c00 JavaThread "http-172.16.9.236-8080-47" daemon [_thread_blocked, id=18288]
      0x6c9b1000 JavaThread "http-172.16.9.236-8080-46" daemon [_thread_blocked, id=2028]
      0x6c352400 JavaThread "http-172.16.9.236-8080-45" daemon [_thread_in_native, id=14280]
      0x6c351000 JavaThread "http-172.16.9.236-8080-44" daemon [_thread_in_native, id=18280]
      0x6c85b000 JavaThread "http-172.16.9.236-8080-43" daemon [_thread_in_native, id=18152]
      0x6ed96400 JavaThread "http-172.16.9.236-8080-42" daemon [_thread_in_native, id=14260]
      0x6c294c00 JavaThread "http-172.16.9.236-8080-41" daemon [_thread_blocked, id=14144]
      0x6c44bc00 JavaThread "http-172.16.9.236-8080-40" daemon [_thread_blocked, id=8252]
      0x6c2acc00 JavaThread "http-172.16.9.236-8080-39" daemon [_thread_blocked, id=17992]
      0x6c70f000 JavaThread "http-172.16.9.236-8080-38" daemon [_thread_in_native, id=17860]
      0x6c70c000 JavaThread "http-172.16.9.236-8080-37" daemon [_thread_blocked, id=11664]
      0x6c6bf400 JavaThread "http-172.16.9.236-8080-36" daemon [_thread_blocked, id=18400]
      0x6c6bfc00 JavaThread "http-172.16.9.236-8080-35" daemon [_thread_blocked, id=17692]
      0x6c6c0800 JavaThread "http-172.16.9.236-8080-34" daemon [_thread_blocked, id=13640]
      0x6c70f800 JavaThread "http-172.16.9.236-8080-33" daemon [_thread_blocked, id=10276]
      0x6c6c2000 JavaThread "http-172.16.9.236-8080-32" daemon [_thread_in_native, id=13244]
      0x6c70d400 JavaThread "http-172.16.9.236-8080-31" daemon [_thread_in_native, id=17928]
      0x6c6c1000 JavaThread "http-172.16.9.236-8080-30" daemon [_thread_blocked, id=18208]
      0x6c34c400 JavaThread "http-172.16.9.236-8080-29" daemon [_thread_blocked, id=11952]
      0x6ed0a000 JavaThread "http-172.16.9.236-8080-28" daemon [_thread_blocked, id=13192]
      0x6ed09400 JavaThread "http-172.16.9.236-8080-27" daemon [_thread_blocked, id=18136]
      0x6c6bd800 JavaThread "http-172.16.9.236-8080-26" daemon [_thread_blocked, id=18252]
      0x6ed0b000 JavaThread "http-172.16.9.236-8080-25" daemon [_thread_in_native, id=18176]
      0x6c6bc400 JavaThread "http-172.16.9.236-8080-24" daemon [_thread_in_native, id=17676]
      0x6c246400 JavaThread "http-172.16.9.236-8080-23" daemon [_thread_in_native, id=18352]
      0x6c199400 JavaThread "http-172.16.9.236-8080-22" daemon [_thread_in_native, id=18264]
      0x6c6be400 JavaThread "http-172.16.9.236-8080-21" daemon [_thread_in_native, id=18372]
      0x6c247400 JavaThread "http-172.16.9.236-8080-20" daemon [_thread_in_native, id=18256]
      0x6c199c00 JavaThread "http-172.16.9.236-8080-19" daemon [_thread_in_native, id=17688]
      0x6c19f400 JavaThread "http-172.16.9.236-8080-18" daemon [_thread_blocked, id=9956]
      0x6c19e800 JavaThread "http-172.16.9.236-8080-17" daemon [_thread_blocked, id=18260]
      0x6c293400 JavaThread "http-172.16.9.236-8080-16" daemon [_thread_blocked, id=18324]
      0x6fe2b800 JavaThread "http-172.16.9.236-8080-15" daemon [_thread_blocked, id=17920]
      0x6c292000 JavaThread "http-172.16.9.236-8080-14" daemon [_thread_blocked, id=17672]
      0x6c13bc00 JavaThread "http-172.16.9.236-8080-13" daemon [_thread_blocked, id=18268]
      0x6c1ed400 JavaThread "http-172.16.9.236-8080-12" daemon [_thread_blocked, id=13008]
      0x6c1ed800 JavaThread "http-172.16.9.236-8080-11" daemon [_thread_blocked, id=12728]
      0x6c13b400 JavaThread "http-172.16.9.236-8080-10" daemon [_thread_blocked, id=11532]
      0x6c139000 JavaThread "http-172.16.9.236-8080-9" daemon [_thread_blocked, id=17852]
      0x6c138800 JavaThread "http-172.16.9.236-8080-8" daemon [_thread_blocked, id=5320]
      0x6c291000 JavaThread "http-172.16.9.236-8080-7" daemon [_thread_in_native, id=18276]
      0x6c353800 JavaThread "http-172.16.9.236-8080-6" daemon [_thread_blocked, id=18240]
      0x6c291800 JavaThread "http-172.16.9.236-8080-5" daemon [_thread_blocked, id=18328]
      0x6c13cc00 JavaThread "http-172.16.9.236-8080-4" daemon [_thread_blocked, id=18244]
      0x6bc76400 JavaThread "http-172.16.9.236-8080-3" daemon [_thread_blocked, id=17788]
      0x7092e400 JavaThread "JMS SessionPool Worker-83" daemon [_thread_blocked, id=14004]
      0x704c0800 JavaThread "http-172.16.9.236-8080-2" daemon [_thread_blocked, id=17784]
      0x6c0ea400 JavaThread "JMS SessionPool Worker-82" daemon [_thread_blocked, id=17988]
      0x70669400 JavaThread "JMS SessionPool Worker-81" daemon [_thread_blocked, id=18024]
      0x704e0400 JavaThread "JMS SessionPool Worker-79" daemon [_thread_blocked, id=12612]
      0x70d0e800 JavaThread "JMS SessionPool Worker-78" daemon [_thread_blocked, id=6032]
      0x6f507400 JavaThread "JMS SessionPool Worker-77" daemon [_thread_blocked, id=13400]
      0x7048b400 JavaThread "JMS SessionPool Worker-76" daemon [_thread_blocked, id=6996]
      0x6e5f6400 JavaThread "JMS SessionPool Worker-75" daemon [_thread_blocked, id=13004]
      0x78c63800 JavaThread "JMS SessionPool Worker-50" daemon [_thread_blocked, id=8452]
      0x7872e400 JavaThread "JMS SessionPool Worker-49" daemon [_thread_blocked, id=5824]
      0x6fb92400 JavaThread "JMS SessionPool Worker-48" daemon [_thread_blocked, id=11616]
      0x786d0800 JavaThread "JMS SessionPool Worker-47" daemon [_thread_blocked, id=13044]
      0x6f598400 JavaThread "RMI RenewClean-[172.16.9.236:1098]" daemon [_thread_blocked, id=6632]
      0x70c99800 JavaThread "http-172.16.9.236-8080-1" daemon [_thread_blocked, id=10280]
      0x6fb4fc00 JavaThread "JMS SessionPool Worker-28" daemon [_thread_blocked, id=13420]
      0x783ff400 JavaThread "Thread-35" daemon [_thread_blocked, id=11040]
      0x6f6ec000 JavaThread "Thread-34" [_thread_blocked, id=1952]
      0x6e491c00 JavaThread "Timer-11" daemon [_thread_blocked, id=11888]
      0x6fc3ac00 JavaThread "JMS SessionPool Worker-5" daemon [_thread_blocked, id=9332]
      0x6f17f000 JavaThread "JMS SessionPool Worker-4" daemon [_thread_blocked, id=11924]
      0x6f94c800 JavaThread "JMS SessionPool Worker-3" daemon [_thread_blocked, id=7360]
      0x6ec30400 JavaThread "JMS SessionPool Worker-2" daemon [_thread_blocked, id=11376]
      0x6fbaf000 JavaThread "JMS SessionPool Worker-1" daemon [_thread_blocked, id=11280]
      0x6ed46c00 JavaThread "JMS SessionPool Worker-0" daemon [_thread_blocked, id=8244]
      0x6de7ac00 JavaThread "Thread-32" [_thread_blocked, id=9876]
      0x6ef11800 JavaThread "WorkerThread#2[172.16.9.236:1579]" [_thread_blocked, id=9336]
      0x6e825800 JavaThread "WorkerThread#1[172.16.9.236:1686]" [_thread_blocked, id=10964]
      0x6eae0c00 JavaThread "WorkerThread#0[172.16.9.236:1489]" [_thread_blocked, id=11668]
      0x6fe80400 JavaThread "RMI Scheduler(0)" daemon [_thread_blocked, id=11976]
      0x6df8a800 JavaThread "Thread-5" [_thread_blocked, id=12840]
      0x7003a400 JavaThread "ajp-172.16.9.236-8009-Acceptor-0" daemon [_thread_in_native, id=12744]
      0x6f9c0400 JavaThread "http-172.16.9.236-8080-Acceptor-0" daemon [_thread_in_native, id=13788]
      0x6f185800 JavaThread "JBossLifeThread" [_thread_blocked, id=12000]
      0x6f7a9400 JavaThread "Timer-10" daemon [_thread_blocked, id=5576]
      0x6e4ff800 JavaThread "Timer-9" daemon [_thread_blocked, id=7876]
      0x6ded8400 JavaThread "QuartzScheduler_DeadlineScheduler-1_MisfireHandler" [_thread_blocked, id=13756]
      0x6c7ae400 JavaThread "DeadlineScheduler_QuartzSchedulerThread" [_thread_blocked, id=13948]
      0x6c451800 JavaThread "DeadlineScheduler_Worker-5" [_thread_blocked, id=13772]
      0x6c440800 JavaThread "DeadlineScheduler_Worker-4" [_thread_blocked, id=13752]
      0x6c3e9800 JavaThread "DeadlineScheduler_Worker-3" [_thread_blocked, id=13800]
      0x6c461800 JavaThread "DeadlineScheduler_Worker-2" [_thread_blocked, id=13428]
      0x6c607800 JavaThread "DeadlineScheduler_Worker-1" [_thread_blocked, id=13616]
      0x6fada400 JavaThread "Connection Consumer for dest JBossTopic[AuditTopic] id=6" [_thread_blocked, id=9500]
      0x6f5d0400 JavaThread "Thread-24" [_thread_blocked, id=10296]
      0x70472400 JavaThread "Connection Consumer for dest JBossTopic[AuditTopic] id=5" [_thread_blocked, id=8888]
      0x70007800 JavaThread "Thread-23" [_thread_blocked, id=10752]
      0x6fe43400 JavaThread "Connection Consumer for dest JBossTopic[ErrorTopic] id=4" [_thread_blocked, id=1920]
      0x6fe03400 JavaThread "Thread-22" [_thread_blocked, id=13844]
      0x6fdcb800 JavaThread "Connection Consumer for dest JBossTopic[AuditTopic] id=3" [_thread_blocked, id=13516]
      0x6ee22c00 JavaThread "Thread-21" [_thread_blocked, id=13704]
      0x7006e800 JavaThread "Connection Consumer for dest JBossQueue[ActiveActivityQueue] id=2" [_thread_blocked, id=17912]
      0x6f56d800 JavaThread "Thread-20" [_thread_blocked, id=14120]
      0x70294400 JavaThread "Connection Consumer for dest JBossTopic[FreeTextTopic] id=1" [_thread_blocked, id=7636]
      0x6fa6ac00 JavaThread "Thread-19" [_thread_blocked, id=12200]
      0x6edfa800 JavaThread "Timer-8" daemon [_thread_blocked, id=4388]
      0x6cc84400 JavaThread "Timer-7" daemon [_thread_blocked, id=16304]
      0x6bc77800 JavaThread "Timer-6" daemon [_thread_blocked, id=11292]
      0x6bc77400 JavaThread "Timer-5" daemon [_thread_blocked, id=5168]
      0x6dff5400 JavaThread "Timer-4" daemon [_thread_blocked, id=8232]
      0x6e5cc400 JavaThread "Thread-12" [_thread_blocked, id=12792]
      0x6c162800 JavaThread "ConnectionTable.Connection.Receiver [172.16.9.236:7900 - 172.16.9.236:59770]" daemon [_thread_in_native, id=7236]
      0x6c2dd800 JavaThread "ConnectionTable.Connection.Receiver [172.16.9.236:59770 - 172.16.9.236:7900]" daemon [_thread_in_native, id=13608]
      0x6c612c00 JavaThread "MERGE2.FindSubgroups thread (c                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                        

    uGohde wrote:
    Hi,
    Would it help to increase the virtual address space of windows to 3GB? Would the jvm actually take advantage of it?Forgot to mention this in my last post ...
    No, it wouldn't help. The JDK (VM + library native code) isn't linked with the /LARGEADDRESSAWARE option so windows won't give it a 3G address space. The JDK code has been tested in this mode and works, but the change was not made because it could break existing JNI code which is not expecting to addresses larger than 2G. See
    [bug 5061380|http://bugs.sun.com/bugdatabase/view_bug.do?bug_id=5061380]

  • Dbca errors out with java.lang.OutOfMemoryError: Java heap space

    hi gurus
    I am trying to use DBCA to create a 10.2.0.4 database on a HP platform.DBCA hangs at the step 6 and following message can be seen in the
    trace.log:
    java.lang.OutOfMemoryError: Java heap space
    I googled and modified the DBCA scripts content from
    # Run DBCA
    $JRE_DIR/bin/java -Dsun.java2d.font.DisableAlgorithmicStyles=true -DORACLE_HOME=$OH -DDISPLAY=$DISPLAY -DJDBC_PROTOCOL=thin -mx128m
    -classpath $CLASSPATH oracle.sysman.assistants.dbca.Dbca $ARGUMENTS
    to
    # Run DBCA
    $JRE_DIR/bin/java -Dsun.java2d.font.DisableAlgorithmicStyles=true -DORACLE_HOME=$OH -DDISPLAY=$DISPLAY -DJDBC_PROTOCOL=thin -mx256m
    -classpath $CLASSPATH oracle.sysman.assistants.dbca.Dbca $ARGUMENTS
    and rerun the DBCA and the problem still there.
    How to solve this problem?
    Thanks !
    Edited by: KevinMao on Mar 31, 2010 2:39 AM
    Edited by: KevinMao on Mar 31, 2010 2:42 AM

    hi gurus
    The problem has sovled.I supplyed the wrong file for the rawfile.conf,everything was fine after I provided the corrent one.
    Thanks for your time.

  • Java.lang.OutOfMemoryError Exception for data more than 20k rows

    Hi There,
    We are evaluating Coherence for our requirements and I am quite impressed with filtering, near cache, etc
    We are running on Windows XP, 3GB RAM, jdk1.6.0_04 and tests are simple – 2 cache instances and one instance of ExtendTcpCacheService sitting between client and distributed cache.
    It just fly’s when inserting/putting about 20k rows/objects in to cache but doesn’t seem to fly for more data.
    eg: with 200k objects/rows, we get the following exception
    java.lang.OutOfMemoryError: requested 4096000 bytes for GrET in C:\BUILD_AREA\jdk6_04\hotspot\src\share\vm\utilities\growableArray.cpp. Out of swap space?
    But, the exception is not consistent. We also get following
    2008-03-20 11:36:23.415 Oracle Coherence GE 3.3.1/389 <D5> (thread=Cluster, member=4): Service Cluster left the cluster
    2008-03-20 11:36:25.009 Oracle Coherence GE 3.3.1/389 <D5> (thread=DistributedCache, member=4): Service DistributedCache left the cluster
    2008-03-20 11:36:25.899 Oracle Coherence GE 3.3.1/389 <D5> (thread=ExtendTcpProxyServiceWorker:1, member=4): Repeating $PutAllRequest for 10000 out of 10000 items due to re-distribution
    2008-03-20 11:36:25.931 Oracle Coherence GE 3.3.1/389 <D5> (thread=ExtendTcpProxyServiceWorker:2, member=4): Repeating $PutAllRequest for 10000 out of 10000 items due to re-distribution
    2008-03-20 11:36:26.024 Oracle Coherence GE 3.3.1/389 <D5> (thread=ExtendTcpProxyServiceWorker:4, member=4): Repeating $PutAllRequest for 10000 out of 10000 items due to re-distribution
    2008-03-20 11:36:26.024 Oracle Coherence GE 3.3.1/389 <D5> (thread=ExtendTcpProxyServiceWorker:0, member=4): Repeating $PutAllRequest for 10000 out of 10000 items due to re-distribution
    2008-03-20 11:36:26.040 Oracle Coherence GE 3.3.1/389 <D5> (thread=ExtendTcpProxyServiceWorker:3, member=4): Repeating $PutAllRequest for 10000 out of 10000 items due to re-distribution
    2008-03-20 11:36:26.899 Oracle Coherence GE 3.3.1/389 <D5> (thread=Proxy:ExtendTcpProxyService, member=4): Stopped: TcpAcceptor
    2008-03-20 11:36:26.899 Oracle Coherence GE 3.3.1/389 <D4> (thread=Proxy:ExtendTcpProxyService, member=4): Exception occured during exiting:
    java.lang.NullPointerException
    at com.tangosol.coherence.component.util.daemon.queueProcessor.Service.isClusterThread(Service.CDB:1)
    at com.tangosol.coherence.component.util.daemon.queueProcessor.Service$EventDispatcher.drainOverflow(Service.CDB:7)
    at com.tangosol.coherence.component.util.daemon.queueProcessor.Service.post(Service.CDB:17)
    at com.tangosol.coherence.component.util.daemon.queueProcessor.Service.send(Service.CDB:1)
    at com.tangosol.coherence.component.util.daemon.queueProcessor.service.ClusterService.doServiceLeft(ClusterService.CDB:25)
    at com.tangosol.coherence.component.util.daemon.queueProcessor.Service.setServiceState(Service.CDB:65)
    at com.tangosol.coherence.component.util.daemon.queueProcessor.Service.onExit(Service.CDB:12)
    at com.tangosol.coherence.component.util.Daemon.run(Daemon.CDB:58)
    at java.lang.Thread.run(Thread.java:619)
    Would appreciate if someone can point me the right direction.
    Regards,
    K

    Hi Gene,
    Thanks for getting back.
    Tried with JDK 1.5 but no joy.
    I am trying to insert 200k POJO's each with 10 memebers/fields and have set 1GB memory. Here are the logs
    08-03-26 15:20:36.644 Oracle Coherence GE 3.3.1/389 <Error> (thread=DistributedCache, member=3): Error sending MapEvent to Channel(Id=1317419375, Connection=0x00000118EBA651F39101EDDBDC0FAA24C838BCE665617F8AC1064ADB4297F30E, Open=true): java.lang.OutOfMemoryError
         at sun.misc.Unsafe.allocateMemory(Native Method)
         at java.nio.DirectByteBuffer.<init>(DirectByteBuffer.java:99)
         at java.nio.ByteBuffer.allocateDirect(ByteBuffer.java:288)
         at com.tangosol.coherence.component.comm.connectionManager.acceptor.TcpAcceptor$ByteBufferPool.instantiateResource(TcpAcceptor.CDB:7)
         at com.tangosol.coherence.component.comm.connectionManager.acceptor.TcpAcceptor$ByteBufferPool.acquire(TcpAcceptor.CDB:26)
         at com.tangosol.coherence.component.comm.connectionManager.acceptor.TcpAcceptor$ByteBufferPool.allocate(TcpAcceptor.CDB:4)
         at com.tangosol.io.MultiBufferWriteBuffer.advance(MultiBufferWriteBuffer.java:870)
         at com.tangosol.io.MultiBufferWriteBuffer.<init>(MultiBufferWriteBuffer.java:32)
         at com.tangosol.coherence.component.comm.connectionManager.acceptor.TcpAcceptor$TcpConnection.allocateWriteBuffer(TcpAcceptor.CDB:3)
         at com.tangosol.coherence.component.comm.Connection.send(Connection.CDB:16)
         at com.tangosol.coherence.component.comm.Channel.doSend(Channel.CDB:4)
         at com.tangosol.coherence.component.comm.Channel.send(Channel.CDB:38)
         at com.tangosol.coherence.component.net.extend.proxy.MapListenerProxy.onMapEvent(MapListenerProxy.CDB:9)
         at com.tangosol.coherence.component.net.extend.proxy.MapListenerProxy.entryInserted(MapListenerProxy.CDB:1)
         at com.tangosol.util.MapEvent.dispatch(MapEvent.java:191)
         at com.tangosol.coherence.component.util.daemon.queueProcessor.service.DistributedCache$ViewMap$ProxyListener.dispatch(DistributedCache.CDB:22)
         at com.tangosol.coherence.component.util.daemon.queueProcessor.service.DistributedCache$ViewMap$ProxyListener.entryInserted(DistributedCache.CDB:1)
         at com.tangosol.util.MapListenerSupport$WrapperSynchronousListener.entryInserted(MapListenerSupport.java:856)
         at com.tangosol.util.MapEvent.dispatch(MapEvent.java:191)
         at com.tangosol.coherence.component.util.CacheEvent.dispatchSafe(CacheEvent.CDB:14)
         at com.tangosol.coherence.component.util.daemon.queueProcessor.service.DistributedCache$BinaryMap.dispatch(DistributedCache.CDB:86)
         at com.tangosol.coherence.component.util.daemon.queueProcessor.service.DistributedCache.onMapEvent(DistributedCache.CDB:31)
         at com.tangosol.coherence.component.util.daemon.queueProcessor.service.DistributedCache$MapEvent.onReceived(DistributedCache.CDB:3)
         at com.tangosol.coherence.component.util.daemon.queueProcessor.Service.onMessage(Service.CDB:9)
         at com.tangosol.coherence.component.util.daemon.queueProcessor.Service.onNotify(Service.CDB:123)
         at com.tangosol.coherence.component.util.daemon.queueProcessor.service.DistributedCache.onNotify(DistributedCache.CDB:3)
         at com.tangosol.coherence.component.util.Daemon.run(Daemon.CDB:35)
         at java.lang.Thread.run(Thread.java:619)
    # An unexpected error has been detected by Java Runtime Environment:
    # java.lang.OutOfMemoryError: requested 32756 bytes for ChunkPool::allocate. Out of swap space?
    # Internal Error (allocation.cpp:120), pid=4052, tid=6048
    # Error: ChunkPool::allocate
    # Java VM: Java HotSpot(TM) Server VM (10.0-b19 mixed mode windows-x86)
    # If you would like to submit a bug report, please visit:
    # http://java.sun.com/webapps/bugreport/crash.jsp
    # The crash happened outside the Java Virtual Machine in native code.
    # See problematic frame for where to report the bug.
    --------------- T H R E A D ---------------
    Current thread (0x65f21400): JavaThread "CompilerThread1" daemon [_thread_in_native, id=6048, stack(0x662d0000,0x66320000)]
    Stack: [0x662d0000,0x66320000]
    [error occurred during error reporting (printing stack bounds), id 0x80000001]
    Current CompileTask:
    C2:972 ! sun.nio.cs.SingleByteEncoder.encodeArrayLoop(Ljava/nio/CharBuffer;Ljava/nio/ByteBuffer;)Ljava/nio/charset/CoderResult; (475 bytes)
    --------------- P R O C E S S ---------------
    Java Threads: ( => current thread )
    0x66425400 JavaThread "DistributedCache:EventDispatcher" daemon [_thread_blocked, id=6024, stack(0x66b10000,0x66b60000)]
    0x665ca400 JavaThread "TcpAcceptor:TcpProcessor" daemon [_thread_blocked, id=1164, stack(0x66fc0000,0x67010000)]
    0x6656cc00 JavaThread "TcpAcceptor" daemon [_thread_blocked, id=5996, stack(0x66ed0000,0x66f20000)]
    0x666ee800 JavaThread "ExtendTcpProxyServiceWorker:4" daemon [_thread_blocked, id=5056, stack(0x66e80000,0x66ed0000)]
    0x666ee400 JavaThread "ExtendTcpProxyServiceWorker:3" daemon [_thread_blocked, id=3232, stack(0x66e30000,0x66e80000)]
    0x664d1000 JavaThread "ExtendTcpProxyServiceWorker:2" daemon [_thread_blocked, id=1932, stack(0x66de0000,0x66e30000)]
    0x66685000 JavaThread "ExtendTcpProxyServiceWorker:1" daemon [_thread_blocked, id=2496, stack(0x66d90000,0x66de0000)]
    0x6668c400 JavaThread "ExtendTcpProxyServiceWorker:0" daemon [_thread_blocked, id=2256, stack(0x66d40000,0x66d90000)]
    0x66595400 JavaThread "Cluster:EventDispatcher" daemon [_thread_blocked, id=6112, stack(0x66cf0000,0x66d40000)]
    0x66584400 JavaThread "Proxy:ExtendTcpProxyService" daemon [_thread_blocked, id=6132, stack(0x66ca0000,0x66cf0000)]
    0x666f7400 JavaThread "Proxy:ExtendTcpProxyService:EventDispatcher" daemon [_thread_blocked, id=852, stack(0x66c50000,0x66ca0000)]
    0x666fdc00 JavaThread "DistributedCache" daemon [_thread_blocked, id=5380, stack(0x66c00000,0x66c50000)]
    0x663da400 JavaThread "TcpRingListener" daemon [_thread_in_native, id=5576, stack(0x66b60000,0x66bb0000)]
    0x6651d400 JavaThread "Cluster" daemon [_thread_blocked, id=6084, stack(0x66ac0000,0x66b10000)]
    0x66419400 JavaThread "PacketSpeaker" daemon [_thread_blocked, id=4240, stack(0x66a70000,0x66ac0000)]
    0x6651f800 JavaThread "PacketPublisher" daemon [_thread_blocked, id=6088, stack(0x66a20000,0x66a70000)]
    0x6647e800 JavaThread "PacketReceiver" daemon [_thread_blocked, id=6080, stack(0x669d0000,0x66a20000)]
    0x6647e400 JavaThread "PacketListener1" daemon [_thread_in_native, id=6072, stack(0x66980000,0x669d0000)]
    0x6656d800 JavaThread "PacketListenerN" daemon [_thread_blocked, id=6076, stack(0x66930000,0x66980000)]
    0x664da800 JavaThread "Logger@9233091 3.3.1/389" daemon [_thread_blocked, id=4908, stack(0x66880000,0x668d0000)]
    0x65f23c00 JavaThread "Low Memory Detector" daemon [_thread_blocked, id=5580, stack(0x66320000,0x66370000)]
    =>0x65f21400 JavaThread "CompilerThread1" daemon [_thread_in_native, id=6048, stack(0x662d0000,0x66320000)]
    0x65f1c800 JavaThread "CompilerThread0" daemon [_thread_blocked, id=6040, stack(0x66280000,0x662d0000)]
    0x65f1b400 JavaThread "Attach Listener" daemon [_thread_blocked, id=6004, stack(0x66230000,0x66280000)]
    0x65f1ac00 JavaThread "Signal Dispatcher" daemon [_thread_blocked, id=6032, stack(0x661e0000,0x66230000)]
    0x65d4cc00 JavaThread "Finalizer" daemon [_thread_blocked, id=6020, stack(0x66190000,0x661e0000)]
    0x65f12800 JavaThread "Reference Handler" daemon [_thread_blocked, id=6036, stack(0x66140000,0x66190000)]
    0x00386000 JavaThread "main" [_thread_blocked, id=5040, stack(0x003a0000,0x003f0000)]
    Other Threads:
    0x65f11000 VMThread [stack: 0x660f0000,0x66140000] [id=5992]
    0x65f25400 WatcherThread [stack: 0x66370000,0x663c0000] [id=5492]
    VM state:at safepoint (normal execution)
    VM Mutex/Monitor currently owned by a thread: ([mutex/lock_event])
    [0x00385790/0x00002724] Safepoint_lock - owner thread: 0x65f11000
    [0x003857f0/0x00002714] Threads_lock - owner thread: 0x65f11000
    [0x00385990/0x000026d4] Heap_lock - owner thread: 0x666fdc00
    Heap
    PSYoungGen total 158464K, used 147632K [0x5af00000, 0x655a0000, 0x655a0000)
    eden space 146496K, 100% used [0x5af00000,0x63e10000,0x63e10000)
    from space 11968K, 9% used [0x63e10000,0x63f2c000,0x649c0000)
    to space 11712K, 0% used [0x64a30000,0x64a30000,0x655a0000)
    PSOldGen total 1365376K, used 1054407K [0x079a0000, 0x5af00000, 0x5af00000)
    object space 1365376K, 77% used [0x079a0000,0x47f51f70,0x5af00000)
    PSPermGen total 16384K, used 10909K [0x039a0000, 0x049a0000, 0x079a0000)
    object space 16384K, 66% used [0x039a0000,0x04447748,0x049a0000)
    Dynamic libraries:

  • Exception java.lang.OutOfMemoryError

    Hi ;
    Recently my netweaver 7.0 always restart its j2ee engine , i check the log
    it have a exception
    Exception java.lang.OutOfMemoryError: requested 131072000 bytes for GrET* in /export/jdk142-update/ws/fcs/hotspot/src/share/vm/utilities/growableArray.cpp. Out of swap space?
    no this file on my system!!!
    and then the Java VM crashes ,
    I have read the sap note 943602 mentioned in its log
    my java - version is
    java version "1.4.2_12"
    Java(TM) 2 Runtime Environment, Standard Edition (build 1.4.2_12-b03)
    Java HotSpot(TM) Client VM (build 1.4.2_12-b03, mixed mode)
    and
    jstartup/vm/home = <jdk home directory>.
    is in the right directory.
    so , can give me solution to solve this situation???

    Hi ,
    we have 4G memory , 2G swap ,
    my server is only for netweaver development without any application!!!
    below is my dev_server0 log about JVM arguments
    JHVM_LoadJavaVM: VM Arguments of node [server0]
    -> arg[ 9]: -XX:NewSize=171m
    -> arg[ 10]: -XX:MaxNewSize=171m
    -> arg[ 13]: -XX:MaxPermSize=256M
    -> arg[ 14]: -XX:PermSize=256M
    -> arg[ 20]: -Dmemory.manager=2048M
    -> arg[ 21]: -Xmx2048M
    -> arg[ 22]: -Xms1024M

  • PI 711 - "java.lang.OutOfMemoryError - Chunk::new" running JSPM

    Dears,
    we just installed the PI 711 but we are not able to run the JSPM ; it goes in crash with this error :
    An unexpected error has been detected by SAP Java Virtual Machine:
    java.lang.OutOfMemoryError: requested 131088 bytes for Chunk::new.
    Out of swap space or he
    ap resource limit exceeded (check with limits or ulimit)?
    Internal Error
    (/bas/sapjvm/51_REL/src/5/hotspot/src/share/vm/memory/allocation.cpp,
    193)
    , pid=483468, tid=4884
    Java VM: SAP Java 64-Bit Server VM (5.1.027 Dec 12 2008 04:31:57 -
    51_REL - optU - aix ppc
    64 - bas2:113000 (mixed mode))
    Error: Chunk::new
    We already replaced the Kernel; we check in in the Config Tool and the template in use is correct as for note 1248926 ( "Usage_Type_All_in_One ").
    How we can manage the J2EE parameters ?
    Regards

    Hello,
    Java engine from version 7.10 and above (711 in this case) uses a different approach for memory settings.
    All the memory parameters are calculated based on the template i.e when you select a particular template, the memory parameters are calulcated by itself based on the RAM. So just adjust your template and it should resolve your problem.
    It is also possible to change the memory parameters in 7.10 and above versions. In configtool, select particular node for which parameters needs to be changed. Select server node, and on the right side, you will see 4-5 different table. There you would be able to change the memory parameters.
    Thanks & Regards,
    Denish

  • XML Publisher Report  - java.lang.OutOfMemoryError

    Hi All,
    Apps - 11.5.10.2
    XML Publisher - 5.6.3
    When the request being run for huge data, its getting out of momory error.
    We have already tried the below options
    Modified the teo profiles and 3 Fo processing properties in both the template and the data definition as follows as given in the notes 563181.1 and 563945.1
    Error in OPP logs
    [12/30/09 2:49:05 AM] [STATEMENT] [GSMServiceController:2921265] Getting next event...
    Exception: java.lang.OutOfMemoryError
    [12/30/09 2:49:46 AM] [java.lang.OutOfMemoryError
    [12/30/09 2:54:24 AM] [STATEMENT] [OPPServiceThread1] 1 threads running
    [12/30/09 2:55:18 AM] [java.lang.OutOfMemoryErrorjava.lang.OutOfMemoryError
    java.lang.OutOfMemoryError
    And finally the request ended in warning and the OPP got terminated.
    [java.io.tmpdir] - Has about 3 G of free space
    [APPLTMP] - Has more than 50G of free space
    Please advice.
    Thanks & Regards,
    Rakesh

    Hi Hussein,
    Reviewed those notes.... initially we got errors like
    java.lang.reflect.InvocationTargetException
         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
         at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
         at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
         at java.lang.reflect.Method.invoke(Method.java:324)
         at oracle.apps.xdo.common.xml.XSLT10gR1.invokeProcessXSL(XSLT10gR1.java:624)
         at oracle.apps.xdo.common.xml.XSLT10gR1.transform(XSLT10gR1.java:421)
         at oracle.apps.xdo.common.xml.XSLT10gR1.transform(XSLT10gR1.java:233)
         at oracle.apps.xdo.common.xml.XSLTWrapper.transform(XSLTWrapper.java:177)
         at oracle.apps.xdo.template.fo.util.FOUtility.generateFO(FOUtility.java:1044)
         at oracle.apps.xdo.template.fo.util.FOUtility.generateFO(FOUtility.java:997)
         at oracle.apps.xdo.template.fo.util.FOUtility.generateFO(FOUtility.java:212)
         at oracle.apps.xdo.template.FOProcessor.createFO(FOProcessor.java:1657)
         at oracle.apps.xdo.template.FOProcessor.generate(FOProcessor.java:967)
         at oracle.apps.xdo.oa.schema.server.TemplateHelper.runProcessTemplate(TemplateHelper.java:5926)
         at oracle.apps.xdo.oa.schema.server.TemplateHelper.processTemplate(TemplateHelper.java:3458)
         at oracle.apps.xdo.oa.schema.server.TemplateHelper.processTemplate(TemplateHelper.java:3547)
         at oracle.apps.fnd.cp.opp.XMLPublisherProcessor.process(XMLPublisherProcessor.java:247)
         at oracle.apps.fnd.cp.opp.OPPRequestThread.run(OPPRequestThread.java:157)
    Caused by: java.lang.ThreadDeath
         at java.lang.Thread.stop(Thread.java:630)
         at oracle.apps.fnd.cp.opp.OPPRequestThreadManager.terminateThread(OPPRequestThreadManager.java:207)
         at oracle.apps.fnd.cp.opp.OPPTerminateCommand.execute(OPPTerminateCommand.java:45)
         at oracle.apps.fnd.cp.opp.OPPServiceThread.processMessage(OPPServiceThread.java:240)
         at oracle.apps.fnd.cp.opp.OPPServiceThread.waitForMessages(OPPServiceThread.java:227)
         at oracle.apps.fnd.cp.opp.OPPServiceThread.mainLoop(OPPServiceThread.java:128)
         at oracle.apps.fnd.cp.gsf.BaseServiceThread.run(BaseServiceThread.java:135)
    then....
    java.lang.ThreadDeath
    at java.lang.Thread.stop(Thread.java:630)
    at oracle.apps.fnd.cp.opp.OPPRequestThreadManager.terminateThread(OPPRequestThreadManager.java:207)
    at oracle.apps.fnd.cp.opp.OPPTerminateCommand.execute(OPPTerminateCommand.java:45)
    at oracle.apps.fnd.cp.opp.OPPServiceThread.processMessage(OPPServiceThread.java:240)
    at oracle.apps.fnd.cp.opp.OPPServiceThread.waitForMessages(OPPServiceThread.java:227)
    at oracle.apps.fnd.cp.opp.OPPServiceThread.mainLoop(OPPServiceThread.java:128)
    at oracle.apps.fnd.cp.gsf.BaseServiceThread.run(BaseServiceThread.java:135)
    then we have made these changes
    change the Profile option "Concurrent: OPP Process timeout" as 108000 and
    Use XML Publisher's XSLT processor: True
    Enable scalable feature of XSLT processor: False
    Enable XSLT runtime optimization: True
    now we are getting only a single line error in the opp log
    12/30/09 2:55:18 AM] java.lang.OutOfMemoryErrorjava.lang.OutOfMemoryError
    java.lang.OutOfMemoryError
    the request is running for more than 3.5 hrs and ending in warning.
    The concurrent manager has timed out waiting for the Output Post-processor to finish this request.
    Thansk & Regards,
    Rakesh

  • "java.lang.OutOfMemoryError: Java heap space"  while trying to read Excel.

    Hi Experts,
    Here is my query. I'm trying to upload excel data into database table. This excel contains more than 20000 records. I'm storing this data in a vector after reading it & passing this vector as a parameter to another method(not mentioned in the below code) which writes into the database. The code works for records <4000, but fails to read beyond that & throws exception as below.
    HTTP Status 500 -
    type Exception report
    message
    description The server encountered an internal error () that prevented it from fulfilling this request.
    exception
    org.apache.jasper.JasperException: Java heap space
         org.apache.jasper.servlet.JspServletWrapper.handleJspException(JspServletWrapper.java:433)
         org.apache.jasper.servlet.JspServletWrapper.service(JspServletWrapper.java:355)
         org.apache.jasper.servlet.JspServlet.serviceJspFile(JspServlet.java:329)
         org.apache.jasper.servlet.JspServlet.service(JspServlet.java:265)
         javax.servlet.http.HttpServlet.service(HttpServlet.java:803)
    root cause
    javax.servlet.ServletException: Java heap space
         org.apache.jasper.runtime.PageContextImpl.doHandlePageException(PageContextImpl.java:841)
         org.apache.jasper.runtime.PageContextImpl.handlePageException(PageContextImpl.java:774)
         org.apache.jsp.readexcelsap_jsp._jspService(readexcelsap_jsp.java:365)
         org.apache.jasper.runtime.HttpJspBase.service(HttpJspBase.java:98)
         javax.servlet.http.HttpServlet.service(HttpServlet.java:803)
         org.apache.jasper.servlet.JspServletWrapper.service(JspServletWrapper.java:331)
         org.apache.jasper.servlet.JspServlet.serviceJspFile(JspServlet.java:329)
         org.apache.jasper.servlet.JspServlet.service(JspServlet.java:265)
         javax.servlet.http.HttpServlet.service(HttpServlet.java:803)
    root cause
    java.lang.OutOfMemoryError: Java heap space
    Below is the code for reference. Kindly Help me in getting this heap space error rectified or suggest me alternate ways.
    I tried increasing Heap space as googled but in vain.
    <%!
    private Vector readExcelSheet(String uploadedFilePath, int sheetNo) throws IOException
         Vector allRowInfo = null;
            try
                HSSFSheet sheet= getWorkSheet(uploadedFilePath,sheetNo);
                //System.out.println(uploadedFilePath);
                //System.out.println(sheetNo);
                //System.out.println("--Sheet--"+sheet);
                //System.out.println("--Sheet--"+sheet.getLastRowNum());
                if(sheet!=null)
                allRowInfo = new Vector();
                for(int i=0;i<=sheet.getLastRowNum();i++)
                    HSSFRow row= sheet.getRow(i);
                    Vector eachRowInfo = new Vector();
                    for(short j=0;j<row.getLastCellNum();j++)
                        eachRowInfo.add(getCellContents(row.getCell(j)));
                        //System.out.println("--"+row.getCell(j));
                    allRowInfo.add(eachRowInfo);
                else
                     allRowInfo = null;
                //return allRowInfo;
            catch (FileNotFoundException ex)
                 System.out.println("-- Error in reading--getWorkSheet -- 1--"+ex);
                 allRowInfo = null;
            catch (IOException ex)
                 System.out.println("-- Error in reading--getWorkSheet-- 2 --"+ex);
                 allRowInfo = null;
            catch (IndexOutOfBoundsException ex)
                 System.out.println("-- Error in reading--getWorkSheet-- 2 --"+ex);
                 allRowInfo = null;
            catch (NullPointerException ex)
                 System.out.println("-- Error in reading--getWorkSheet --"+ex);
                 allRowInfo = null;
            catch(Exception e)
                System.out.println(e.getMessage());
                e.printStackTrace();
                 allRowInfo = null;
            return allRowInfo;
    %>
    <%!
    private HSSFSheet getWorkSheet(String uploadedFilePath, int sheetNo) throws IOException
            HSSFSheet sheet = null;
            try
                FileInputStream inputStream=new FileInputStream(uploadedFilePath);
                POIFSFileSystem poisFile=new POIFSFileSystem(inputStream);
                HSSFWorkbook workBook= new HSSFWorkbook(poisFile);
                sheet = workBook.getSheetAt(sheetNo);
            catch (FileNotFoundException ex)
                 System.out.println("-- Error in reading--getWorkSheet --"+ex);
                 sheet = null;
            catch (IOException ex)
                 System.out.println("-- Error in reading--getWorkSheet --"+ex);
                 sheet = null;
            catch (IndexOutOfBoundsException ex)
                 System.out.println("-- Error in reading--getWorkSheet --"+ex);
                 sheet = null;
            catch (NullPointerException ex)
                 System.out.println("-- Error in reading--getWorkSheet --"+ex);
                 sheet = null;
            catch(Exception e)
                System.out.println(e.getMessage());
                e.printStackTrace();
                sheet = null;
             return sheet;
    %>
    <%!
    public String getCellContents(HSSFCell cell)
            String cellValue="";
            String cellValue1="";
            if(cell!=null)
                 int cellType= cell.getCellType();
                if(cellType==HSSFCell.CELL_TYPE_NUMERIC)
                    cellValue=(float)cell.getNumericCellValue()+"";           
                if(cellType==HSSFCell.CELL_TYPE_STRING)
                     cellValue1=cell.getStringCellValue();
                     StringBuffer sb = new StringBuffer();
                     for(int i = 0; i < cellValue1.length(); i++)
                            sb.append(cellValue1.charAt(i));
                         if(cellValue1.charAt(i)=='\'')
                              sb.append('\'');
                     cellValue = sb.toString();
           return cellValue;
    %>
    <html>
    <body>
    <%
         String file_Name="Myexcel.xls";
         String path = "D://Test Upload//"+file_Name;
         Vector list = readExcelSheet(path,0);
    </html>
    </body>Regards
    Venky
    Edited by: Venky_86 on Jun 17, 2009 6:05 AM

    HOW did you increase the heap space? As that is the only solution you have in this case really.
    It is a known fact that POI can use up a lot of memory for big spreadsheets. If at all possible, I would try to switch to plain text comma separated files / tab delimited files. If you cannot do that, I would try to put a size restriction on the sheets that your application will process to get rid of the heap space risk. A sheet can contain 20000 records, or four sheets can contain 5000 records; in both cases you process the exact same data, but at only 25% of the total memory usage.

  • XML Publisher report failing with java.lang.outofmemoryerror.

    Hi,
    We have developed a custom Oracle report that produces an XML output file that is about 13M in size (about 18K rows from the database). When running report as concurrent request, post processing fails with java.lang.outofmemoryerror. The failure occurs when specifying output format as Excel, RTF or HTML. However, the process completes successfully when specifying output format as PDF. We have also noticed that Excel, RTF and HTML will complete successfully if the XML data file is smaller (around 3M).
    Is anyone aware of a restriction on the size of the XML data file when specifying output formats Excel, RTF or HTML? We have tried setting temp directory but that has not helped.
    Thanks.

    Hi
    I found this at metalink [Note:390968.1].. hope it helps =)
    Symptoms: When attempting to run an XML Publisher concurrent program the following error occurs:
    ERROR: Warning!!! Got out of memory exception, retrying with scalable option..
    Exception in thread "main" java.lang.OutOfMemoryError: Java heap space
    Oracle.apps.xdo.oa.cp.JCP4XDODataEngine
    Program exited with status 1
    Solution: To implement the solution, please execute the following steps:
    1. Login select the responsibility: System Administrator.
    2. Navigate to Concurrent > Program > Define.
    3. Query for concurrent program that is receiving the error.
    4. In the 'Options' field please enter -Xmx512M.
    5. Save the change and retest the issue.
    6. If the report still fails with the option set to -Xmx512M change the value to -Xmx1024M, save and try again
    7. Migrate the solution as appropriate to other environments.

  • Error getting while deploying the application (java.lang.OutOfMemoryError).

    Hi,
    I am trying to migrate an application from JBoss to SAP Netweaver WAS.
    I am getting an exception when i am trying to deploy the application from Netweaver developer studio as "<b>java.lang.OutOfMemoryError</b>". The portion of the stack is given below,
    <b>Caused by: com.sap.engine.services.ejb.exceptions.deployment.EJBFileGenerationException: Errors while compiling:
    The system is out of resources.
    Consult the following stack trace for details.
    java.lang.OutOfMemoryError
         at com.sap.engine.services.ejb.util.AdminUtils.compile(AdminUtils.java:476)
         at com.sap.engine.services.ejb.deploy.DeployAdmin.deploySingleJar(DeployAdmin.java:625)
         at com.sap.engine.services.ejb.deploy.DeltaDeployAdmin.makeUpdate(DeltaDeployAdmin.java:185)
         at com.sap.engine.services.ejb.EJBAdmin.makeUpdate(EJBAdmin.java:529)</b>
    I heard that by changing some configuration values, we can resolve the problem (like adjusting -Xms & - Xmx parameters as well as the Max threads). But i don't know in which script/ tool should i find these settings to change.
    Could you please share your knowledge in this regard,
    Best regards,
    Sudheesh...

    Hi
    You can change the XMX and thread  parameter in the Visual Administrator.
    Please refer to the link below:
    http://help.sap.com/saphelp_erp2005/helpdata/en/42/c98d6b11886babe10000000a1553f6/frameset.htm
    Hope this helps,
    Regards,
    Harish
    (Please award points for useful answers)

  • Getting error while executing workflow: java.lang.OutOfMemoryError.

    Hi,
    I am getting the below error while executing the unassigment workflow on AD resource having 160 user objects.
    java.lang.OutOfMemoryError.
    Please provid your inputs on this.
    Your help wolud be appriciated.
    Thanks
    Renuka.

    Well, if you're getting an out of memory exception then your memory settings are too low. Odds are there's a period of activity where the memory usage spikes above what you've configured for the VM.

  • Java.lang.OutOfMemoryError when running java concurrent program

    Hi,
    i had written a java concurrent program to create the content items into Oracle Content Manager (OCM). Process the records from interface table and create the content items into OCM by calling the API IBC_CITEM_ADMIN_GRP.upsert_item().
    I run the concurrent program with 2000 records in interface table, it's an one to one process, 563 records are processed and 563 content items are created successfully in OCM. After 563 records continuously throws the Exception
    EXCEPTION
    WHEN OTHERS THEN
    DBMS_OUTPUT.put_line('EX - bundle validation others--');
    x_return_status := FND_API.G_RET_STS_ERROR;
    FND_MESSAGE.Set_Name('IBC', 'A_BUNDLE_ERROR');
    FND_MESSAGE.set_token('SITUATION', 'VALIDATION');
    FND_MSG_PUB.ADD;
    IF IBC_DEBUG_PVT.debug_enabled THEN
    IBC_DEBUG_PVT.end_process(
    IBC_DEBUG_PVT.make_parameter_list(
    p_tag => 'OUTPUT',
    p_parms => JTF_VARCHAR2_TABLE_4000(
    'x_return_status', '*** EXCEPTION *** [' || SQLERRM || ']'
    END IF;
    in IBC_CITEM_ADMIN_GRP.validate_attribute_bundle() API.
    Again running the concurrent program it process another 563 records. Can any one help me to fix this issue?
    i figured out the exception. When debug the error, i got the actual error message like this
    ORA-29532: Java call terminated by uncaught Java exception: java.lang.OutOfMemoryError
    ORA-29532: Java call terminated by uncaught Java exception: java.lang.NullPointerException
    ORA-29532: Java call terminated by uncaught Java exception: java.lang.ArrayIndexOutOfBoundsException: -2048 < 0
    for this issue i increased the heap memory size up to 1024MB. Still i have the same issue. Can any one help to fix the issue?

    ORA-29532: Java call terminated by uncaught Java
    exception: java.lang.NullPointerException
    ORA-29532: Java call terminated by uncaught Java
    exception: java.lang.ArrayIndexOutOfBoundsException:
    -2048 < 0Aren't the null pointer and arrayindexoutofbounds, the ones which you get when you are trying to read beyond your array? (example: when your loop tries to access the 563rd element in your array, since your array index starts from 0)?
    May be if you can try to write out your elements in the array, you might see what it is croaking about.
    Thanks,
    Chiru

  • FB 4.7 AIR 3.6 Flex 4.9 iOS packing - Exception in thread "main" java.lang.OutOfMemoryError'

    I've got an error similar to Isaac_Sunkes' 'FB 4.7 iOS packaging - Exception in thread "main" java.lang.OutOfMemoryError',
    but the causes are not related to what he discovered, corrupt image or other files, I'd exclude bad archive contents in my project.
    I'm using Flash Builder 4.7 with Adobe AIR 3.6 set into an Apache Flex 4.9.1 SDK;
    HW system is:
    iMac,    2,7 GHz Intel Core i5,    8 GB 1600 MHz DDR3,    NVIDIA GeForce GT 640M 512 MB,    OS X 10.8.2 (12C3103)
    The Flash project consists in an application with a main SWF file which loads, via ActionScript methods, other SWF in cascade.
    I've formerly compiled and run the application on an iPad 1, IOS 5.0.1 (9A405), but got on the device the error alert:
    "Uncompiled ActionScript
    Your application is attempitng to run
    uncompiled ActionScript, probably
    due to the use of an embedded
    SWF. This is unsupported on iOS.
    See the Adobe Developer
    Connection website for more info."
    Then I changed the FB compiler switches, now are set to:
    -locale en_US
    -swf-version=19
    Please note that without the switch    -swf-version=19     the application is compiled correctly and the IPA is sent to the device
    and I can debug it, but iOS traps secondary SWF files and blocke the app usage, as previously told.
    they work on deploy of small applications,
    but, when I try to build a big IPA file either for an ad-hoc distribution, either for an debug on device, after some minutes long waiting, I get a Java stuck, with this trace:
    Error occurred while packaging the application:
    Exception in thread "main" java.lang.OutOfMemoryError: Java heap space
        at java.util.HashMap.addEntry(HashMap.java:753)
        at java.util.HashMap.put(HashMap.java:385)
        at java.util.HashSet.add(HashSet.java:200)
        at adobe.abc.Algorithms.addUses(Algorithms.java:165)
        at adobe.abc.Algorithms.findUses(Algorithms.java:187)
        at adobe.abc.GlobalOptimizer.sccp(GlobalOptimizer.java:4731)
        at adobe.abc.GlobalOptimizer.optimize(GlobalOptimizer.java:3615)
        at adobe.abc.GlobalOptimizer.optimize(GlobalOptimizer.java:2309)
        at adobe.abc.LLVMEmitter.optimizeABCs(LLVMEmitter.java:532)
        at adobe.abc.LLVMEmitter.generateBitcode(LLVMEmitter.java:341)
        at com.adobe.air.ipa.AOTCompiler.convertAbcToLlvmBitcodeImpl(AOTCompiler .java:599)
        at com.adobe.air.ipa.BitcodeGenerator.main(BitcodeGenerator.java:104)
    I've tried to change the Java settings on FB's eclipse.ini in MacOS folder,
    -vmargs
    -Xms(various settings up to)1024m
    -Xmx(various settings up to)1024m
    -XX:MaxPermSize=(various settings up to)512m
    -XX:PermSize=(various settings up to)256m
    but results are the same.
    Now settings are back as recommended:
    -vmargs
    -Xms256m
    -Xmx512m
    -XX:MaxPermSize=256m
    -XX:PermSize=64m
    I've changed the Flex build.properties
    jvm.args = ${local.d32} -Xms64m -Xmx1024m -ea -Dapple.awt.UIElement=true
    with no results; now I'n get back to the standard:
    jvm.args = ${local.d32} -Xms64m -Xmx384m -ea -Dapple.awt.UIElement=true
    and now I truely have no more ideas;
    could anyone give an help?
    many thanks in advance.

    I solved this. It turns out the app icons were corrupt. After removing them and replacing them with new files this error went away.

Maybe you are looking for

  • How  change NLS_NUMERIC_CHARACTERS parameter for load external table

    Hi, I use this version: OWB 11gR2 Database 11gR2 Parameter NLS_NUMERIC_CHARACTERS Database ., Instance ,. When I created database with wizard and in this moment I don't set spanish language, later I changed this parameters in instance parameters. Now

  • Delivered and confirmed quantity in COOISPI

    Hi all Iu2019m facing a Problem with confirm process ORDER, the process ORDER has been confirmed with quantity 800 PCS but when display process ORDER on T-Code: COOISPI the cnf qty is shown 0 PCS. Why does this happen? Thanks Edited by: obie villamos

  • Question about emailing within iPhoto '11

    Hi - I emailed (so I thought) some photos from within iPhoto using Share > Email. But the email does not show up in my Sent Folder in Mail. Is this correct? How can I verify that I actually sent the email? Thanks MtD

  • VC - Wrong Class Allocation

    Hello, a user has allocated the wrong variant class to a configurable material. Meanwhile 2 customer orders have been created using this wrong class allocation. Due to that I am no longer allowed to delete the allocation and change it to the correct

  • ICloud e-mail - stored drafts

    First post so go easy please! I've cleared all the e-mails on my iCloud account on my iPhone5, but when I use the search mechanism it shows there are e-mails effectively stored as drafts, and I don't understand where these are?  I want to delete ever