Trouble with RMI?

Question

We have during the last month started to get problems where the Vadis application
stops working. We can't figure out the cause of this.
Recent additions to the application is that we have started to use RMI for our
client communication - currently we are both using CORBA (OrbixWeb 3.1c) and RMI
- planning to get rid of CORBA. We have also some new features that increases
the amount of tasks to perform.
The system can hang both under heavy load and under off peak hours, when many
clients are connected or when nobody is using it!?! Strange...
This happens approximately once a week.
Today we managed to get a JRockit dump (with Ctrl-Break) - see attached file.
The main thread that should run all real tasks is Schemaläggare, but the stack
trace indicates a really weird place to stop. When looking at the code we can't
see how this could be either a deadlock or an infinite loop. Maybe you can make
some more out of the printout?
For example, we wonder what the timestamp row means. Almost all threads have a
timestamp of around 2200. But one thread has 1 and the other 346. What does this
mean?
We are using the following version of JRockit:
java version 1.3
Java(TM) 2 Runtime Environment, Standard Edition (build "1.3.1_CROSIS_20011213-1316")
JRockit Virtual Machine (build 3.0.1-CROSIS-2001213-1317)
with nativeThreads activated.
Do you know of any troubles with using RMI for this version. Or the combination
of RMI and CORBA/OrbixWeb?
Best regards,
Tomas L
[ProblemReport_JRockit.txt]

Answer 1

Really don't know the answer to that question. I haven't analyzed the
problem in detail. I know that a lot of issues has been fixed since
3.0.1, and if the problem is with the VM it is likely to have been fixed.
Regards,
/Staffan
TomasLiden wrote:
Alright,
However, before taking on the job of upgrading JRockit it would be nice to know
whether the problem is likely to be solved. Or put in other words: Do you think
the problem is in the JVM or in our application?
All the best,
/Tomas
Staffan Larsen <[email protected]> wrote:
Well, as you noted, NT4 isn't a supported platform for 7.0sp4, but we
are not aware of anything that would not work. Then again, 3.0.1 isn't
supported either...
You have two choices the way I see it: 1) Use 7.0sp4 on NT4 and
hopefully it solves your problem. 2) Upgrade to W2K (but I guess that
is
hard).
Regards,
/Staffan
TomasLiden wrote:
Hi,
I guessed you would answer something like that ;-) However, our serveris running
Windows NT4 (don't remember the service pack) and on your downloadsite it says
W2K for 7.0sp4. Will that work?
/T
Staffan Larsen <[email protected]> wrote:
Hi Tomas,
JRockit 3.0.1 is pretty old at this time, so I would strongly suggest
that you upgrade to JRockit 7.0sp4 (if you need 1.3.1 compatibility),
or
JRockit 1.4.2 (if you are ok with 1.4.2 compatibility). Both version
are
available for download at
http://commerce.bea.com/showallversions.jsp?family=WLJR
Regards,
/Staffan
TomasLiden wrote:
We have during the last month started to get problems where the Vadisapplication
stops working. We can't figure out the cause of this.
Recent additions to the application is that we have started to useRMI for our
client communication - currently we are both using CORBA (OrbixWeb3.1c) and RMI
- planning to get rid of CORBA. We have also some new features thatincreases
the amount of tasks to perform.
The system can hang both under heavy load and under off peak hours,when many
clients are connected or when nobody is using it!?! Strange...
This happens approximately once a week.
Today we managed to get a JRockit dump (with Ctrl-Break) - see attachedfile.
The main thread that should run all real tasks is Schemaläggare, butthe stack
trace indicates a really weird place to stop. When looking at the
code
we can't
see how this could be either a deadlock or an infinite loop. Maybeyou can make
some more out of the printout?
For example, we wonder what the timestamp row means. Almost all threadshave a
timestamp of around 2200. But one thread has 1 and the other 346.
What
does this
mean?
We are using the following version of JRockit:
java version 1.3
Java(TM) 2 Runtime Environment, Standard Edition (build "1.3.1_CROSIS_20011213-1316")
JRockit Virtual Machine (build 3.0.1-CROSIS-2001213-1317)
with nativeThreads activated.
Do you know of any troubles with using RMI for this version. Or thecombination
of RMI and CORBA/OrbixWeb?
Best regards,
Tomas L
Problem report.
Application hangs - deadlock or loop?
We have during the last month started to get problems where the Vadisapplication stops working. We can't figure out the cause of this.
Recent additions to the application is that we have started to useRMI for our client communication - currently we are both using CORBA
(OrbixWeb 3.1c) and RMI - planning to get rid of CORBA. We have also
some new features that increases the amount of tasks to perform.
The system can hang both under heavy load and under off peak hours,when many clients are connected or when nobody is using it!?! Strange...
This happens approximately once a week.
Today we managed to get a JRockit dump (with Ctrl-Break) - see below.The main thread that should run all real tasks is Schemaläggare, but
the stack trace indicates a really weird place to stop. When looking
at the code we can't see how this could be either a deadlock or aninfinite
loop. Maybe you can make some more out of the printout?
For example, we wonder what the timestamp row means. Almost all threadshave a timestamp of around 2200. But one thread has 1 and the other
346. What does this mean?
We are using the following version of JRockit:
java version 1.3
Java(TM) 2 Runtime Environment, Standard Edition (build "1.3.1_CROSIS_20011213-1316")
JRockit Virtual Machine (build 3.0.1-CROSIS-2001213-1317)
with nativeThreads activated.
Do you know of any troubles with using RMI for this version. Or thecombination of RMI and CORBA/OrbixWeb?
Best regards,
Tomas L
================== Ctrl-Break printout ====================
====== THREAD 00000080 == Noname
State: ACTIVE, DAEMON, GCABLE
Prio: 0 (5)
Timestamp: 2232 before current stamp
Stack: 0x00000000
Code: 0x00000000
LastJava: 0x7FF8FF08
ThreadID: 0x00000E7B
### Stacktrace:
--- End of stack trace
### End of stacktrace.
=====================
====== THREAD 00000100 == RMI TCP Connection(2191)-10.40.105.193
State: ACTIVE, DAEMON, GCABLE
Prio: 0 (5)
Timestamp: 1 before current stamp
Stack: 0x00000000
Code: 0x00000000
LastJava: 0x7FF4FC44
ThreadID: 0x000006F4
### Stacktrace:
at se.sj.otm.tillampning.systemProvider.gen.RVadisClientProviderImpl.doT
illgangligaVagnar(Compiled Code)@5f5f4fee
at se.sj.otm.tillampning.systemProvider.gen.RVadisClientProviderImpl_Ske
l.dispatch(Compiled Code)@5f5f5ad1
at sun.rmi.server.UnicastServerRef.oldDispatch(Compiled Code)@5d32d44c
at sun.rmi.server.UnicastServerRef.dispatch(Compiled Code)@5d32cfc8
at sun.rmi.transport.Transport$1.run(Compiled Code)@5d32cb3f
at java.security.AccessController.doPrivileged(Native Method)@5a091990
at sun.rmi.transport.Transport.serviceCall(Compiled Code)@5d32b02d
at sun.rmi.transport.tcp.TCPTransport.handleMessages(CompiledCode)@5d32
a9c8
at sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.run(CompiledCod
e)@5d3296db
at java.lang.Thread.run(Compiled Code)@59e3328e
at java.lang.Thread.startThreadFromVM(Compiled Code)@59e33134
--- End of stack trace
### End of stacktrace.
=====================
====== THREAD 00000180 == ObjyThread
State: WAITING, NONDAEMON, GCABLE
Prio: 0 (5)
Timestamp: 2226 before current stamp
Stack: 0x00000000
Code: 0x00000000
LastJava: 0x7FF3FED8
ThreadID: 0x00000B2F
### Stacktrace:
--- End of stack trace
### End of stacktrace.
=====================
====== THREAD 00000200 == Finalizer
State: WAITING, DAEMON, GCABLE
Prio: 0 (5)
Timestamp: 2231 before current stamp
Stack: 0x00000000
Code: 0x00000000
LastJava: 0x7FF2FEB8
ThreadID: 0x00000B7A
### Stacktrace:
at java.lang.Object.wait0(Compiled Code)@59e35860
at java.lang.ref.ReferenceQueue.remove(Optimized Code)@5f7742fe
at java.lang.ref.Finalizer$FinalizerThread.run(Compiled Code)@59e35379
at java.lang.Thread.startThreadFromVM(Compiled Code)@59e33134
--- End of stack trace
### End of stacktrace.
=====================
====== THREAD 00000280 == SignalHandler
State: ACTIVE, DAEMON, GCABLE
Prio: 0 (5)
Timestamp: 2230 before current stamp
Stack: 0x00000000
Code: 0x00000000
LastJava: 0x7FEFFEF0
ThreadID: 0x00000B3C
### Stacktrace:
at java.lang.Thread.run(Compiled Code)@59e3328e
at java.lang.Thread.startThreadFromVM(Compiled Code)@59e33134
--- End of stack trace
### End of stacktrace.
=====================
====== THREAD 00000300 == Hotspot Detector
State: ACTIVE, DAEMON, GCABLE
Prio: 0 (5)
Timestamp: 2229 before current stamp
Stack: 0x00000000
Code: 0x00000000
LastJava: 0x7FEEFEE0
ThreadID: 0x0000096C
### Stacktrace:
--- End of stack trace
### End of stacktrace.
=====================
====== THREAD 00000380 == Reference Handler
State: WAITING, DAEMON, GCABLE
Prio: 0 (5)
Timestamp: 2228 before current stamp
Stack: 0x00000000
Code: 0x00000000
LastJava: 0x7FEDFEE4
ThreadID: 0x00000E30
### Stacktrace:
at java.lang.ref.Reference$ReferenceHandler.run(Compiled Code)@5a090526
at java.lang.Thread.startThreadFromVM(Compiled Code)@59e33134
--- End of stack trace
### End of stacktrace.
=====================
====== THREAD 00000400 == Thread-0
State: ACTIVE, DAEMON, GCABLE
Prio: 0 (5)
Timestamp: 2232 before current stamp
Stack: 0x00000000
Code: 0x00000000
LastJava: 0x00A5B1E0
ThreadID: 0x00000D2A
### Stacktrace:
--- End of stack trace
### End of stacktrace.
=====================
====== THREAD 00000480 == RMI TCP Accept-1
State: ACTIVE, DAEMON, GCABLE
Prio: 0 (5)
Timestamp: 2225 before current stamp
Stack: 0x00000000
Code: 0x00000000
LastJava: 0x7FE8FEA4
ThreadID: 0x00000EA0
### Stacktrace:
at java.net.ServerSocket.implAccept(Compiled Code)@5a23b775
at java.net.ServerSocket.accept(Compiled Code)@5a23b57c
at sun.rmi.transport.tcp.TCPTransport.run(Compiled Code)@5a23a9f8
at java.lang.Thread.run(Compiled Code)@59e3328e
at java.lang.Thread.startThreadFromVM(Compiled Code)@59e33134
--- End of stack trace
### End of stacktrace.
=====================
====== THREAD 00000500 == OrbixWeb Server Listener thread
State: ACTIVE, NONDAEMON, GCABLE
Prio: 0 (5)
Timestamp: 2224 before current stamp
Stack: 0x00000000
Code: 0x00000000
LastJava: 0x7FE7FEA0
ThreadID: 0x0000008E
### Stacktrace:
at java.net.ServerSocket.implAccept(Compiled Code)@5a23b775
at java.net.ServerSocket.accept(Compiled Code)@5a23b57c
at IE.Iona.OrbixWeb.CORBA.Listener.acceptNewConnection(CompiledCode)@5a
2f429e
at IE.Iona.OrbixWeb.CORBA.Listener.run(Compiled Code)@5a2f3e37
at java.lang.Thread.run(Compiled Code)@59e3328e
at java.lang.Thread.startThreadFromVM(Compiled Code)@59e33134
--- End of stack trace
### End of stacktrace.
=====================
====== THREAD 00000580 == Request Processor
State: WAITING, NONDAEMON, GCABLE
Prio: 0 (5)
Timestamp: 2223 before current stamp
Stack: 0x00000000
Code: 0x00000000
LastJava: 0x7FE6FEA0
ThreadID: 0x00000E0E
### Stacktrace:
at IE.Iona.OrbixWeb.CORBA.EventHandler.nextRequest(CompiledCode)@5a2f78
fc
at IE.Iona.OrbixWeb.CORBA.BOAImpl.processOneEvent(CompiledCode)@5a2f763
b
at IE.Iona.OrbixWeb.CORBA.BOAImpl.processEvents(Compiled Code)@5a2f418b
at IE.Iona.OrbixWeb.CORBA.EventHandler.run(Compiled Code)@5a2f3c8d
at java.lang.Thread.run(Compiled Code)@59e3328e
at java.lang.Thread.startThreadFromVM(Compiled Code)@59e33134
--- End of stack trace
### End of stacktrace.
=====================
====== THREAD 00000600 == RMI TCP Accept-2
State: ACTIVE, DAEMON, GCABLE
Prio: 0 (5)
Timestamp: 2222 before current stamp
Stack: 0x00000000
Code: 0x00000000
LastJava: 0x7FE5FEA4
ThreadID: 0x00000680
### Stacktrace:
at java.net.ServerSocket.implAccept(Compiled Code)@5a23b775
at java.net.ServerSocket.accept(Compiled Code)@5a23b57c
at sun.rmi.transport.tcp.TCPTransport.run(Compiled Code)@5a23a9f8
at java.lang.Thread.run(Compiled Code)@59e3328e
at java.lang.Thread.startThreadFromVM(Compiled Code)@59e33134
--- End of stack trace
### End of stacktrace.
=====================
====== THREAD 00000680 == RMI Reaper
State: WAITING, NONDAEMON, GCABLE
Prio: 0 (5)
Timestamp: 2221 before current stamp
Stack: 0x00000000
Code: 0x00000000
LastJava: 0x7FE4FEA0
ThreadID: 0x000008FB
### Stacktrace:
--- End of stack trace
### End of stacktrace.
=====================
====== THREAD 00000700 == GC Daemon
State: WAITING, DAEMON, GCABLE
Prio: 0 (5)
Timestamp: 2220 before current stamp
Stack: 0x00000000
Code: 0x00000000
LastJava: 0x7FE3FEC4
ThreadID: 0x00000927
### Stacktrace:
--- End of stack trace
### End of stacktrace.
=====================
====== THREAD 00000780 == Thread-11
State: WAITING, NONDAEMON, GCABLE
Prio: 0 (5)
Timestamp: 2213 before current stamp
Stack: 0x00000000
Code: 0x00000000
LastJava: 0x7FE2FEC8
ThreadID: 0x00000CF1
### Stacktrace:
--- End of stack trace
### End of stacktrace.
=====================
====== THREAD 00000800 == Gtpl
State: ACTIVE, NONDAEMON, GCABLE
Prio: 0 (5)
Timestamp: 2204 before current stamp
Stack: 0x00000000
Code: 0x00000000
LastJava: 0x7FE1FDC8
ThreadID: 0x00000B01
### Stacktrace:
--- End of stack trace
### End of stacktrace.
=====================
====== THREAD 00000880 == Pbok
State: ACTIVE, NONDAEMON, GCABLE
Prio: 0 (5)
Timestamp: 2203 before current stamp
Stack: 0x00000000
Code: 0x00000000
LastJava: 0x7FE0FDC8
ThreadID: 0x00000A27
### Stacktrace:
--- End of stack trace
### End of stacktrace.
=====================
====== THREAD 00000900 == Beval
State: ACTIVE, NONDAEMON, GCABLE
Prio: 0 (5)
Timestamp: 2202 before current stamp
Stack: 0x00000000
Code: 0x00000000
LastJava: 0x7FDFFDC8
ThreadID: 0x00000C27
### Stacktrace:
at java.net.SocketInputStream.read0(Optimized Code)@5f776df9
at java.net.SocketInputStream.read(Optimized Code)@5f776e42
at java.io.DataInputStream.readInt(Optimized Code)@5f58a2df
at com.ibm.mq.MQInternalCommunications.receive(Optimized Code)@5f762c43
at com.ibm.mq.MQSESSIONClient.MQGET(Optimized Code)@5f74a056
at com.ibm.mq.MQQueue.get(Optimized Code)@5f76e931
at se.sj.otm.ramverk.hostConnection.communication.MQPoll.execute(Optimiz
ed Code)@5f8fc96f
at se.sj.otm.basobjekt.Poll.run(Compiled Code)@5a35db6f
at java.lang.Thread.startThreadFromVM(Compiled Code)@59e33134
--- End of stack trace
### End of stacktrace.
=====================
====== THREAD 00000980 == Kal
State: ACTIVE, NONDAEMON, GCABLE
Prio: 0 (5)
Timestamp: 2201 before current stamp
Stack: 0x00000000
Code: 0x00000000
LastJava: 0x7FDEFDC8
ThreadID: 0x0000064A
### Stacktrace:
--- End of stack trace
### End of stacktrace.
=====================
====== THREAD 00000a00 == OrbixWeb Connection Monitor thread
State: WAITING, DAEMON, GCABLE
Prio: 0 (5)
Timestamp: 2218 before current stamp
Stack: 0x00000000
Code: 0x00000000
LastJava: 0x7FDDFEC8
ThreadID: 0x00000968
### Stacktrace:
--- End of stack trace
### End of stacktrace.
=====================
====== THREAD 00000a80 == Connection[IIOP, Socket[addr=nttmd51.sj.se/10.54.132.9
5,port=1574,localport=1977], is_daemon]
State: ACTIVE, DAEMON, GCABLE
Prio: 0 (5)
Timestamp: 2217 before current stamp
Stack: 0x00000000
Code: 0x00000000
LastJava: 0x7FDCFEA4
ThreadID: 0x000007AA
### Stacktrace:
--- End of stack trace
### End of stacktrace.
=====================
====== THREAD 00000b80 == Thread-9
State: WAITING, NONDAEMON, GCABLE
Prio: 0 (5)
Timestamp: 2215 before current stamp
Stack: 0x00000000
Code: 0x00000000
LastJava: 0x7FDAFEC8
ThreadID: 0x00000F58
### Stacktrace:
--- End of stack trace
### End of stacktrace.
=====================
====== THREAD 00000c00 == Thread-10
State: WAITING, NONDAEMON, GCABLE
Prio: 0 (5)
Timestamp: 2214 before current stamp
Stack: 0x00000000
Code: 0x00000000
LastJava: 0x7FD9FEC8
ThreadID: 0x00000302
### Stacktrace:
--- End of stack trace
### End of stacktrace.
=====================
====== THREAD 00000c80 == Thread-12
State: WAITING, NONDAEMON, GCABLE
Prio: 0 (5)
Timestamp: 2212 before current stamp
Stack: 0x00000000
Code: 0x00000000
LastJava: 0x7FD8FEC8
ThreadID: 0x00000D52
### Stacktrace:
--- End of stack trace
### End of stacktrace.
=====================
====== THREAD 00000d00 == Thread-13
State: WAITING, NONDAEMON, GCABLE
Prio: 0 (5)
Timestamp: 2211 before current stamp
Stack: 0x00000000
Code: 0x00000000
LastJava: 0x7FD7FEC8
ThreadID: 0x00000ABC
### Stacktrace:
--- End of stack trace
### End of stacktrace.
=====================
====== THREAD 00000d80 == Thread-14
State: WAITING, NONDAEMON, GCABLE
Prio: 0 (5)
Timestamp: 2210 before current stamp
Stack: 0x00000000
Code: 0x00000000
LastJava: 0x7FD6FEC8
ThreadID: 0x000008F5
### Stacktrace:
--- End of stack trace
### End of stacktrace.
=====================
====== THREAD 00000e00 == Thread-15
State: WAITING, NONDAEMON, GCABLE
Prio: 0 (5)
Timestamp: 2209 before current stamp
Stack: 0x00000000
Code: 0x00000000
LastJava: 0x7FD5FEC8
ThreadID: 0x000001C2
### Stacktrace:
--- End of stack trace
### End of stacktrace.
=====================
====== THREAD 00000e80 == Thread-16
State: WAITING, NONDAEMON, GCABLE
Prio: 0 (5)
Timestamp: 2208 before current stamp
Stack: 0x00000000
Code: 0x00000000
LastJava: 0x7FD4FEC8
ThreadID: 0x0000078E
### Stacktrace:
--- End of stack trace
### End of stacktrace.
=====================
====== THREAD 00000f00 == Schemalõggare
State: ACTIVE, NONDAEMON, GCABLE
Prio: 0 (5)
Timestamp: 2207 before current stamp
Stack: 0x00000000
Code: 0x00000000
LastJava: 0x7FD3FA0C
ThreadID: 0x00000AC0
### Stacktrace:
at se.sj.otm.vagnstyrningsplanering.optimeringsmodell.AggregeradTomvagns
fordelningsmodell.minskaReservationerUtanBehovspaverkan(Compiled Code)@5f5e6678
at se.sj.otm.vagnstyrningsplanering.optimeringsmodell.AggregeradTomvagns
fordelningsmodell.anpassaReservationerTillKapacitetsminskning(CompiledCode)@5f5
e6945
at se.sj.otm.vagnstyrningsplanering.tomvagnstyrning.impl.Godsvagnstyrnin
gsplanImpl.forandradTillgangligKapacitetITaglagen(Compiled Code)@5d33750a
at java.lang.reflect.Method.invoke(Native Method)@5a0c225e
at se.sj.otm.verksamhetsobjekt.trafikoperator.impl.ArgumentFormedlareImp
l.invokeMethod(Compiled Code)@5a5f545e
at se.sj.otm.vagnstyrningsplanering.tomvagnstyrning.impl.Godsvagnstyrnin
gsplanImpl.anropaVagnstyrningsplanerare(Optimized Code)@5f8fdba5
at se.sj.otm.verksamhetsobjekt.fordon.impl.GodsvagnparkImpl.anropaVagnst
yrningsplanerare(Compiled Code)@5a5f511f
at se.sj.otm.verksamhetsobjekt.fordon.impl.GodsvagnparkImpl.forandradTil
lgangligKapacitetITaglagen(Compiled Code)@5d337101
at se.sj.otm.verksamhetsobjekt.fordon.impl.GodsvagnparkImpl.genomforRese
rvationslistor(Optimized Code)@5f8fee98
at se.sj.otm.verksamhetsobjekt.fordon.impl.GodsvagnparkImpl.genomforOnsk
adeReservationer(Optimized Code)@5f7a4c4a
at se.sj.otm.verksamhetsobjekt.fordon.impl.GodsvagnparkImpl.hanteraSvarF
ranPlaneraren(Compiled Code)@5d330a01
at se.sj.otm.verksamhetsobjekt.fordon.impl.GodsvagnparkImpl.forberedFixe
raTomtransporter(Optimized Code)@5f799aab
at se.sj.otm.verksamhetsobjekt.fordon.impl.GodsvagnparkImpl.fixeraTomtra
nsporter(Compiled Code)@5f5c81d1
at se.sj.otm.verksamhetsobjekt.tidtabell.impl.TidtabellImpl.utforFortida
Fixering(Compiled Code)@5f74b166
at java.lang.reflect.Method.invoke(Native Method)@5a0c225e
at se.sj.otm.ramverk.scheduler.OTAssignment.perform(OptimizedCode)@5f76
b227
at se.sj.otm.ramverk.scheduler.OTScheduler.performNextAssignment(Optimiz
ed Code)@5f900796
at se.sj.otm.ramverk.scheduler.OTScheduler.execute(OptimizedCode)@5f904
b9d
at se.sj.otm.basobjekt.Poll.run(Compiled Code)@5a35db6f
at java.lang.Thread.startThreadFromVM(Compiled Code)@59e33134
--- End of stack trace
### End of stacktrace.
=====================
====== THREAD 00000f80 == TidsstyrdUppdragsk÷
State: WAITING, NONDAEMON, GCABLE
Prio: 0 (5)
Timestamp: 2206 before current stamp
Stack: 0x00000000
Code: 0x00000000
LastJava: 0x7FD2FEC0
ThreadID: 0x00000B34
### Stacktrace:
--- End of stack trace
### End of stacktrace.
=====================
====== THREAD 00001000 == TidsstyrdUppdragsk÷
State: WAITING, NONDAEMON, GCABLE
Prio: 0 (5)
Timestamp: 2205 before current stamp
Stack: 0x00000000
Code: 0x00000000
LastJava: 0x7FD1FEC0
ThreadID: 0x00000AC2
### Stacktrace:
--- End of stack trace
### End of stacktrace.
=====================
====== THREAD 00001080 == AWT-EventQueue-0
State: WAITING, NONDAEMON, GCABLE
Prio: 0 (5)
Timestamp: 2200 before current stamp
Stack: 0x00000000
Code: 0x00000000
LastJava: 0x7FD0FEA0
ThreadID: 0x000001B1
### Stacktrace:
--- End of stack trace
### End of stacktrace.
=====================
====== THREAD 00001100 == SunToolkit.PostEventQueue-0
State: WAITING, NONDAEMON, GCABLE
Prio: 0 (5)
Timestamp: 2199 before current stamp
Stack: 0x00000000
Code: 0x00000000
LastJava: 0x7FCFFED4
ThreadID: 0x00000E2E
### Stacktrace:
at sun.awt.PostEventQueue.run(Compiled Code)@5a3bde4e
at java.lang.Thread.startThreadFromVM(Compiled Code)@59e33134
--- End of stack trace
### End of stacktrace.
=====================
====== THREAD 00001180 == Thread-20
State: CREATED, DAEMON, GCABLE
Prio: 0 (6)
Timestamp: 2232 before current stamp
Stack: 0x00000000
Code: 0x00000000
LastJava: 0x7FCEFF58
ThreadID: 0x000000A2
### Stacktrace:
No stack trace for unstarted threads.
### End of stacktrace.
=====================
====== THREAD 00001200 == AWT-Windows
State: ACTIVE, DAEMON, GCABLE
Prio: 0 (6)
Timestamp: 2197 before current stamp
Stack: 0x00000000
Code: 0x00000000
LastJava: 0x7FCDFEBC
ThreadID: 0x00000D0A
### Stacktrace:
at COM.jrockit.awt.WToolkit.run(Compiled Code)@5a3bdfe9
at java.lang.Thread.run(Compiled Code)@59e3328e
at java.lang.Thread.startThreadFromVM(Compiled Code)@59e33134
--- End of stack trace
### End of stacktrace.
=====================
====== THREAD 00001280 == RMI LeaseChecker
State: WAITING, DAEMON, GCABLE
Prio: 0 (5)
Timestamp: 346 before current stamp
Stack: 0x00000000
Code: 0x00000000
LastJava: 0x7FCCFEBC
ThreadID: 0x000007C0
### Stacktrace:
--- End of stack trace
### End of stacktrace.
=====================