Managed server startup issue!!!
hi all,
i am facing managedserver startup issue
i am start the managed server it will up take the 6 min
how to reduce the time
1)i am trying differnt ways 1)threaddump 2)GCparamets
but no usee
can u see the log and give me suugestions
below log one perticuler area it will load the application 4 min
please see the time stamps 8:31:01 to 8:35:09
please give me suggistions!!
======================================
####<Apr 11, 2010 8:31:00 PM PDT> <Info> <Deployer> <agwlcrptrn1> <agwlcrptrn1> <[ACTIVE] ExecuteThread: '0' for queue: 'weblogic.kernel.Default (self-tuning)'> <<WLS Kernel>> <> <> <1271043060997> <BEA-149059> <Module eci.jar of application Agile is transitioning from STATE_PREPARED to STATE_ADMIN on server agwlcrptrn1.>
####<Apr 11, 2010 8:31:01 PM PDT> <Info> <EJB> <agwlcrptrn1> <agwlcrptrn1> <[ACTIVE] ExecuteThread: '0' for queue: 'weblogic.kernel.Default (self-tuning)'> <<WLS Kernel>> <> <> <1271043061016> <BEA-010009> <EJB Deployed EJB with JNDI name com.eigner.eci.EciSession.>
####<Apr 11, 2010 8:31:01 PM PDT> <Debug> <Deployment> <agwlcrptrn1> <agwlcrptrn1> <[ACTIVE] ExecuteThread: '0' for queue: 'weblogic.kernel.Default (self-tuning)'> <<WLS Kernel>> <> <> <1271043061016> <BEA-000000> <Listener: end ModuleCtx[appId=Agile, modId=eci.jar, type=ejb, Target=Cluster/AgileCluster] STATE_PREPARED>STATE_ADMIN>
####<Apr 11, 2010 8:31:01 PM PDT> <Info> <Deployer> <agwlcrptrn1> <agwlcrptrn1> <[ACTIVE] ExecuteThread: '0' for queue: 'weblogic.kernel.Default (self-tuning)'> <<WLS Kernel>> <> <> <1271043061016> <BEA-149060> <Module eci.jar of application Agile successfully transitioned from STATE_PREPARED to STATE_ADMIN on server agwlcrptrn1.>
####<Apr 11, 2010 8:35:09 PM PDT> <Debug> <Deployment> <agwlcrptrn1> <agwlcrptrn1> <[ACTIVE] ExecuteThread: '0' for queue: 'weblogic.kernel.Default (self-tuning)'> <<WLS Kernel>> <> <> <1271043309172> <BEA-000000> <Relaying updated state for app, Agile to STATE_ADMIN>
####<Apr 11, 2010 8:35:09 PM PDT> <Debug> <Deployment> <agwlcrptrn1> <agwlcrptrn1> <[ACTIVE] ExecuteThread: '0' for queue: 'weblogic.kernel.Default (self-tuning)'> <<WLS Kernel>> <> <> <1271043309173> <BEA-000000> < +++ Returning app's state : STATE_ACTIVE>
####<Apr 11, 2010 8:35:09 PM PDT> <Debug> <Deployment> <agwlcrptrn1> <agwlcrptrn1> <[ACTIVE] ExecuteThread: '0' for queue: 'weblogic.kernel.Default (self-tuning)'> <<WLS Kernel>> <> <
hi sandeep,
i take the thread dump 10 times at the start the server can u look into this one...
===============================
CLASSPATH=/local/mnt/agile/bea/patch_wls1030/profiles/default/sys_manifest_classpath/weblogic_patch.jar:/local/mnt/agile/bea/patch_cie660/profiles/default/sys_manifest_classpath/weblogic_patch.jar:/local/mnt/agile/bea/jrockit_160_05/lib/tools.jar:/local/mnt/agile/bea/wlserver_10.3/server/lib/weblogic_sp.jar:/local/mnt/agile/bea/wlserver_10.3/server/lib/weblogic.jar:/local/mnt/agile/bea/modules/features/weblogic.server.modules_10.3.0.0.jar:/local/mnt/agile/bea/wlserver_10.3/server/lib/webservices.jar:/local/mnt/agile/bea/modules/org.apache.ant_1.6.5/lib/ant-all.jar:/local/mnt/agile/bea/modules/net.sf.antcontrib_1.0.0.0_1-0b2/lib/ant-contrib.jar::/local/mnt/agile/agile93/agileDomain/lib/jms.jar:/local/mnt/agile/agile93/agileDomain/lib/jndi.jar:/local/mnt/agile/agile93/agileDomain/lib/tibjms.jar
PATH=/local/mnt/agile/bea/wlserver_10.3/server/bin:/local/mnt/agile/bea/modules/org.apache.ant_1.6.5/bin:/local/mnt/agile/bea/jrockit_160_05/jre/bin:/local/mnt/agile/bea/jrockit_160_05/bin:/usr/kerberos/bin:/usr/local/bin:/bin:/usr/bin:/usr/X11R6/bin
Your environment has been set.
QCHTTPHeaderIdentityAsserter.initialize
AgileAuthenticationProviderImpl.initialize
2010-04-10 20:03:14
Full thread dump Java HotSpot(TM) Server VM (10.0-b19 mixed mode):
"Thread-13" daemon prio=10 tid=0x62a8a800 nid=0x1b6 waiting on condition [0x5f7b8000..0x5f7b9130]
java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0xf2d78078> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:158)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1925)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:358)
at weblogic.utils.concurrent.JDK15ConcurrentBlockingQueue.take(JDK15ConcurrentBlockingQueue.java:89)
at weblogic.store.internal.PersistentStoreImpl.getOutstandingWork(PersistentStoreImpl.java:567)
at weblogic.store.internal.PersistentStoreImpl.run(PersistentStoreImpl.java:615)
at weblogic.store.internal.PersistentStoreImpl$2.run(PersistentStoreImpl.java:383)
"LDAPCache-TTLTimer" daemon prio=10 tid=0x09277000 nid=0x1b5 in Object.wait() [0x5f90b000..0x5f90bfb0]
java.lang.Thread.State: TIMED_WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0xf2d7c068> (a netscape.ldap.TTLTimer)
at netscape.ldap.TTLTimer.run(LDAPCache.java:828)
- locked <0xf2d7c068> (a netscape.ldap.TTLTimer)
at java.lang.Thread.run(Thread.java:619)
"LDAPConnThread-1 ldaps://qpip.qualcomm.com:389" daemon prio=10 tid=0x5f6fc000 nid=0x1b4 runnable [0x5f95c000..0x5f95d030]
java.lang.Thread.State: RUNNABLE
at java.net.SocketInputStream.socketRead0(Native Method)
at java.net.SocketInputStream.read(SocketInputStream.java:129)
at java.io.BufferedInputStream.fill(BufferedInputStream.java:218)
at java.io.BufferedInputStream.read(BufferedInputStream.java:237)
- locked <0xf2d820a8> (a java.io.BufferedInputStream)
at netscape.ldap.ber.stream.BERElement.getElement(BERElement.java:101)
at netscape.ldap.LDAPConnThread.run(LDAPConnThread.java:538)
at java.lang.Thread.run(Thread.java:619)
"Thread-12" daemon prio=10 tid=0x61c2ac00 nid=0x1b3 waiting on condition [0x5f9ad000..0x5f9adeb0]
java.lang.Thread.State: TIMED_WAITING (sleeping)
at java.lang.Thread.sleep(Native Method)
at oracle.jdbc.pool.OracleConnectionCacheTimeOutThread.run(OracleConnectionCacheTimeOutThread.java:80)
"LDAPConnThread-0 ldap://10.47.24.141:9001" daemon prio=10 tid=0x61cb5400 nid=0x1b1 runnable [0x5fb55000..0x5fb55db0]
java.lang.Thread.State: RUNNABLE
at java.net.SocketInputStream.socketRead0(Native Method)
at java.net.SocketInputStream.read(SocketInputStream.java:129)
at java.io.BufferedInputStream.fill(BufferedInputStream.java:218)
at java.io.BufferedInputStream.read(BufferedInputStream.java:237)
- locked <0xf2d920a8> (a java.io.BufferedInputStream)
at netscape.ldap.ber.stream.BERElement.getElement(BERElement.java:101)
at netscape.ldap.LDAPConnThread.run(LDAPConnThread.java:538)
at java.lang.Thread.run(Thread.java:619)
"DoSManager" daemon prio=10 tid=0x0932a000 nid=0x1b0 waiting on condition [0x5f9fe000..0x5f9fee30]
java.lang.Thread.State: TIMED_WAITING (sleeping)
at java.lang.Thread.sleep(Native Method)
at com.octetstring.vde.DoSManager.run(DoSManager.java:433)
"VDE Transaction Processor Thread" daemon prio=10 tid=0x61c07000 nid=0x1ae in Object.wait() [0x5fba6000..0x5fba7130]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0xf2d70090> (a com.octetstring.vde.backend.standard.TransactionProcessor)
at java.lang.Object.wait(Object.java:485)
at com.octetstring.vde.backend.standard.TransactionProcessor.waitChange(TransactionProcessor.java:367)
- locked <0xf2d70090> (a com.octetstring.vde.backend.standard.TransactionProcessor)
at com.octetstring.vde.backend.standard.TransactionProcessor.run(TransactionProcessor.java:212)
"ExecuteThread: '16' for queue: 'weblogic.socket.Muxer'" daemon prio=10 tid=0x62a67400 nid=0x1ad waiting for monitor entry [0x5fbf7000..0x5fbf7fb0]
java.lang.Thread.State: BLOCKED (on object monitor)
at weblogic.socket.PosixSocketMuxer.processSockets(PosixSocketMuxer.java:95)
- waiting to lock <0xf2d8c098> (a weblogic.socket.PosixSocketMuxer$1)
at weblogic.socket.SocketReaderRequest.run(SocketReaderRequest.java:29)
at weblogic.socket.SocketReaderRequest.execute(SocketReaderRequest.java:42)
at weblogic.kernel.ExecuteThread.execute(ExecuteThread.java:145)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:117)
"ExecuteThread: '15' for queue: 'weblogic.socket.Muxer'" daemon prio=10 tid=0x62a66000 nid=0x1ac waiting for monitor entry [0x5fc48000..0x5fc49030]
java.lang.Thread.State: BLOCKED (on object monitor)
at weblogic.socket.PosixSocketMuxer.processSockets(PosixSocketMuxer.java:95)
- waiting to lock <0xf2d8c098> (a weblogic.socket.PosixSocketMuxer$1)
at weblogic.socket.SocketReaderRequest.run(SocketReaderRequest.java:29)
at weblogic.socket.SocketReaderRequest.execute(SocketReaderRequest.java:42)
at weblogic.kernel.ExecuteThread.execute(ExecuteThread.java:145)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:117)
"ExecuteThread: '14' for queue: 'weblogic.socket.Muxer'" daemon prio=10 tid=0x62a65000 nid=0x1ab waiting for monitor entry [0x5fc99000..0x5fc99eb0]
java.lang.Thread.State: BLOCKED (on object monitor)
at weblogic.socket.PosixSocketMuxer.processSockets(PosixSocketMuxer.java:95)
- waiting to lock <0xf2d8c098> (a weblogic.socket.PosixSocketMuxer$1)
at weblogic.socket.SocketReaderRequest.run(SocketReaderRequest.java:29)
at weblogic.socket.SocketReaderRequest.execute(SocketReaderRequest.java:42)
at weblogic.kernel.ExecuteThread.execute(ExecuteThread.java:145)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:117)
"ExecuteThread: '13' for queue: 'weblogic.socket.Muxer'" daemon prio=10 tid=0x62a63c00 nid=0x1aa waiting for monitor entry [0x5fcea000..0x5fceaf30]
java.lang.Thread.State: BLOCKED (on object monitor)
at weblogic.socket.PosixSocketMuxer.processSockets(PosixSocketMuxer.java:95)
- waiting to lock <0xf2d8c098> (a weblogic.socket.PosixSocketMuxer$1)
at weblogic.socket.SocketReaderRequest.run(SocketReaderRequest.java:29)
at weblogic.socket.SocketReaderRequest.execute(SocketReaderRequest.java:42)
at weblogic.kernel.ExecuteThread.execute(ExecuteThread.java:145)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:117)
"ExecuteThread: '12' for queue: 'weblogic.socket.Muxer'" daemon prio=10 tid=0x62a62c00 nid=0x1a9 runnable [0x5fd3b000..0x5fd3bdb0]
java.lang.Thread.State: RUNNABLE
at weblogic.socket.PosixSocketMuxer.poll(Native Method)
at weblogic.socket.PosixSocketMuxer.processSockets(PosixSocketMuxer.java:102)
- locked <0xf2d8c098> (a weblogic.socket.PosixSocketMuxer$1)
at weblogic.socket.SocketReaderRequest.run(SocketReaderRequest.java:29)
at weblogic.socket.SocketReaderRequest.execute(SocketReaderRequest.java:42)
at weblogic.kernel.ExecuteThread.execute(ExecuteThread.java:145)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:117)
"ExecuteThread: '11' for queue: 'weblogic.socket.Muxer'" daemon prio=10 tid=0x62a61c00 nid=0x1a8 waiting for monitor entry [0x5fd8c000..0x5fd8ce30]
java.lang.Thread.State: BLOCKED (on object monitor)
at weblogic.socket.PosixSocketMuxer.processSockets(PosixSocketMuxer.java:95)
- waiting to lock <0xf2d8c098> (a weblogic.socket.PosixSocketMuxer$1)
at weblogic.socket.SocketReaderRequest.run(SocketReaderRequest.java:29)
at weblogic.socket.SocketReaderRequest.execute(SocketReaderRequest.java:42)
at weblogic.kernel.ExecuteThread.execute(ExecuteThread.java:145)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:117)
"ExecuteThread: '10' for queue: 'weblogic.socket.Muxer'" daemon prio=10 tid=0x62a60800 nid=0x1a7 waiting for monitor entry [0x5fddd000..0x5fdde0b0]
java.lang.Thread.State: BLOCKED (on object monitor)
at weblogic.socket.PosixSocketMuxer.processSockets(PosixSocketMuxer.java:95)
- waiting to lock <0xf2d8c098> (a weblogic.socket.PosixSocketMuxer$1)
at weblogic.socket.SocketReaderRequest.run(SocketReaderRequest.java:29)
at weblogic.socket.SocketReaderRequest.execute(SocketReaderRequest.java:42)
at weblogic.kernel.ExecuteThread.execute(ExecuteThread.java:145)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:117)
"ExecuteThread: '9' for queue: 'weblogic.socket.Muxer'" daemon prio=10 tid=0x62a6f400 nid=0x1a6 waiting for monitor entry [0x5fe2e000..0x5fe2f130]
java.lang.Thread.State: BLOCKED (on object monitor)
at weblogic.socket.PosixSocketMuxer.processSockets(PosixSocketMuxer.java:95)
- waiting to lock <0xf2d8c098> (a weblogic.socket.PosixSocketMuxer$1)
at weblogic.socket.SocketReaderRequest.run(SocketReaderRequest.java:29)
at weblogic.socket.SocketReaderRequest.execute(SocketReaderRequest.java:42)
at weblogic.kernel.ExecuteThread.execute(ExecuteThread.java:145)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:117)
"ExecuteThread: '8' for queue: 'weblogic.socket.Muxer'" daemon prio=10 tid=0x0928d400 nid=0x1a5 waiting for monitor entry [0x5fe7f000..0x5fe7ffb0]
java.lang.Thread.State: BLOCKED (on object monitor)
at weblogic.socket.PosixSocketMuxer.processSockets(PosixSocketMuxer.java:95)
- waiting to lock <0xf2d8c098> (a weblogic.socket.PosixSocketMuxer$1)
at weblogic.socket.SocketReaderRequest.run(SocketReaderRequest.java:29)
at weblogic.socket.SocketReaderRequest.execute(SocketReaderRequest.java:42)
at weblogic.kernel.ExecuteThread.execute(ExecuteThread.java:145)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:117)
"ExecuteThread: '7' for queue: 'weblogic.socket.Muxer'" daemon prio=10 tid=0x0928c000 nid=0x1a4 waiting for monitor entry [0x5fed0000..0x5fed1030]
java.lang.Thread.State: BLOCKED (on object monitor)
at weblogic.socket.PosixSocketMuxer.processSockets(PosixSocketMuxer.java:95)
- waiting to lock <0xf2d8c098> (a weblogic.socket.PosixSocketMuxer$1)
at weblogic.socket.SocketReaderRequest.run(SocketReaderRequest.java:29)
at weblogic.socket.SocketReaderRequest.execute(SocketReaderRequest.java:42)
at weblogic.kernel.ExecuteThread.execute(ExecuteThread.java:145)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:117)
"ExecuteThread: '6' for queue: 'weblogic.socket.Muxer'" daemon prio=10 tid=0x0928b000 nid=0x1a3 waiting for monitor entry [0x5ff21000..0x5ff21eb0]
java.lang.Thread.State: BLOCKED (on object monitor)
at weblogic.socket.PosixSocketMuxer.processSockets(PosixSocketMuxer.java:95)
- waiting to lock <0xf2d8c098> (a weblogic.socket.PosixSocketMuxer$1)
at weblogic.socket.SocketReaderRequest.run(SocketReaderRequest.java:29)
at weblogic.socket.SocketReaderRequest.execute(SocketReaderRequest.java:42)
at weblogic.kernel.ExecuteThread.execute(ExecuteThread.java:145)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:117)
"ExecuteThread: '5' for queue: 'weblogic.socket.Muxer'" daemon prio=10 tid=0x0930c400 nid=0x1a2 waiting for monitor entry [0x5ff72000..0x5ff72f30]
java.lang.Thread.State: BLOCKED (on object monitor)
at weblogic.socket.PosixSocketMuxer.processSockets(PosixSocketMuxer.java:95)
- waiting to lock <0xf2d8c098> (a weblogic.socket.PosixSocketMuxer$1)
at weblogic.socket.SocketReaderRequest.run(SocketReaderRequest.java:29)
at weblogic.socket.SocketReaderRequest.execute(SocketReaderRequest.java:42)
at weblogic.kernel.ExecuteThread.execute(ExecuteThread.java:145)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:117)
"ExecuteThread: '4' for queue: 'weblogic.socket.Muxer'" daemon prio=10 tid=0x0928dc00 nid=0x1a1 waiting for monitor entry [0x5ffc3000..0x5ffc3db0]
java.lang.Thread.State: BLOCKED (on object monitor)
at weblogic.socket.PosixSocketMuxer.processSockets(PosixSocketMuxer.java:95)
- waiting to lock <0xf2d8c098> (a weblogic.socket.PosixSocketMuxer$1)
at weblogic.socket.SocketReaderRequest.run(SocketReaderRequest.java:29)
at weblogic.socket.SocketReaderRequest.execute(SocketReaderRequest.java:42)
at weblogic.kernel.ExecuteThread.execute(ExecuteThread.java:145)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:117)
"ExecuteThread: '3' for queue: 'weblogic.socket.Muxer'" daemon prio=10 tid=0x09288c00 nid=0x1a0 waiting for monitor entry [0x60014000..0x60014e30]
java.lang.Thread.State: BLOCKED (on object monitor)
at weblogic.socket.PosixSocketMuxer.processSockets(PosixSocketMuxer.java:95)
- waiting to lock <0xf2d8c098> (a weblogic.socket.PosixSocketMuxer$1)
at weblogic.socket.SocketReaderRequest.run(SocketReaderRequest.java:29)
at weblogic.socket.SocketReaderRequest.execute(SocketReaderRequest.java:42)
at weblogic.kernel.ExecuteThread.execute(ExecuteThread.java:145)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:117)
"ExecuteThread: '2' for queue: 'weblogic.socket.Muxer'" daemon prio=10 tid=0x092d4800 nid=0x19f waiting for monitor entry [0x60065000..0x600660b0]
java.lang.Thread.State: BLOCKED (on object monitor)
at weblogic.socket.PosixSocketMuxer.processSockets(PosixSocketMuxer.java:95)
- waiting to lock <0xf2d8c098> (a weblogic.socket.PosixSocketMuxer$1)
at weblogic.socket.SocketReaderRequest.run(SocketReaderRequest.java:29)
at weblogic.socket.SocketReaderRequest.execute(SocketReaderRequest.java:42)
at weblogic.kernel.ExecuteThread.execute(ExecuteThread.java:145)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:117)
"ExecuteThread: '1' for queue: 'weblogic.socket.Muxer'" daemon prio=10 tid=0x092d4400 nid=0x19e waiting for monitor entry [0x600b6000..0x600b7130]
java.lang.Thread.State: BLOCKED (on object monitor)
at weblogic.socket.PosixSocketMuxer.processSockets(PosixSocketMuxer.java:95)
- waiting to lock <0xf2d8c098> (a weblogic.socket.PosixSocketMuxer$1)
at weblogic.socket.SocketReaderRequest.run(SocketReaderRequest.java:29)
at weblogic.socket.SocketReaderRequest.execute(SocketReaderRequest.java:42)
at weblogic.kernel.ExecuteThread.execute(ExecuteThread.java:145)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:117)
"ExecuteThread: '0' for queue: 'weblogic.socket.Muxer'" daemon prio=10 tid=0x0932d800 nid=0x19d waiting for monitor entry [0x60107000..0x60107fb0]
java.lang.Thread.State: BLOCKED (on object monitor)
at weblogic.socket.PosixSocketMuxer.processSockets(PosixSocketMuxer.java:95)
- waiting to lock <0xf2d8c098> (a weblogic.socket.PosixSocketMuxer$1)
at weblogic.socket.SocketReaderRequest.run(SocketReaderRequest.java:29)
at weblogic.socket.SocketReaderRequest.execute(SocketReaderRequest.java:42)
at weblogic.kernel.ExecuteThread.execute(ExecuteThread.java:145)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:117)
"[ACTIVE] ExecuteThread: '1' for queue: 'weblogic.kernel.Default (self-tuning)'" daemon prio=10 tid=0x0932c400 nid=0x19c in Object.wait() [0x60158000..0x60159030]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0xf2daa030> (a weblogic.work.ExecuteThread)
at java.lang.Object.wait(Object.java:485)
at weblogic.work.ExecuteThread.waitForRequest(ExecuteThread.java:157)
- locked <0xf2daa030> (a weblogic.work.ExecuteThread)
at weblogic.work.ExecuteThread.run(ExecuteThread.java:178)
"Thread-7" daemon prio=10 tid=0x0932e400 nid=0x19b waiting on condition [0x601a9000..0x601a9eb0]
java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0xf2daa150> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:158)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1925)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:358)
at weblogic.utils.concurrent.JDK15ConcurrentBlockingQueue.take(JDK15ConcurrentBlockingQueue.java:89)
at weblogic.store.internal.PersistentStoreImpl.getOutstandingWork(PersistentStoreImpl.java:567)
at weblogic.store.internal.PersistentStoreImpl.run(PersistentStoreImpl.java:615)
at weblogic.store.internal.PersistentStoreImpl$2.run(PersistentStoreImpl.java:383)
"weblogic.timers.TimerThread" daemon prio=10 tid=0x60467800 nid=0x19a in Object.wait() [0x603fe000..0x603fef30]
java.lang.Thread.State: TIMED_WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0xf2daa2c0> (a weblogic.timers.internal.TimerThread)
at weblogic.timers.internal.TimerThread$Thread.run(TimerThread.java:267)
- locked <0xf2daa2c0> (a weblogic.timers.internal.TimerThread)
"weblogic.time.TimeEventGenerator" daemon prio=10 tid=0x60431800 nid=0x199 in Object.wait() [0x60555000..0x60555db0]
java.lang.Thread.State: TIMED_WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0xf2daa380> (a weblogic.time.common.internal.TimeTable)
at weblogic.time.common.internal.TimeTable.snooze(TimeTable.java:286)
- locked <0xf2daa380> (a weblogic.time.common.internal.TimeTable)
at weblogic.time.common.internal.TimeEventGenerator.run(TimeEventGenerator.java:117)
at java.lang.Thread.run(Thread.java:619)
"[ACTIVE] ExecuteThread: '0' for queue: 'weblogic.kernel.Default (self-tuning)'" daemon prio=10 tid=0x6042e000 nid=0x198 runnable [0x605a5000..0x605a6e30]
java.lang.Thread.State: RUNNABLE
at java.util.HashMap.<init>(HashMap.java:209)
at java.util.jar.Manifest.<init>(Manifest.java:37)
at java.util.jar.JarFile.getManifestFromReference(JarFile.java:160)
at java.util.jar.JarFile.getManifest(JarFile.java:146)
at weblogic.utils.classloaders.GenericClassLoader$JarSource.getManifest(GenericClassLoader.java:528)
at weblogic.utils.classloaders.GenericClassLoader.defineClass(GenericClassLoader.java:310)
at weblogic.utils.classloaders.GenericClassLoader.findLocalClass(GenericClassLoader.java:288)
- locked <0xe5c43a98> (a weblogic.utils.classloaders.GenericClassLoader)
at weblogic.utils.classloaders.GenericClassLoader.findClass(GenericClassLoader.java:256)
at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
- locked <0xe5c43a98> (a weblogic.utils.classloaders.GenericClassLoader)
at java.lang.ClassLoader.loadClass(ClassLoader.java:251)
at weblogic.utils.classloaders.GenericClassLoader.loadClass(GenericClassLoader.java:176)
at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:319)
- locked <0xe5c43a98> (a weblogic.utils.classloaders.GenericClassLoader)
at java.lang.ClassLoader.defineClass1(Native Method)
at java.lang.ClassLoader.defineClass(ClassLoader.java:620)
at java.security.SecureClassLoader.defineClass(SecureClassLoader.java:124)
at weblogic.utils.classloaders.GenericClassLoader.defineClass(GenericClassLoader.java:335)
at weblogic.utils.classloaders.GenericClassLoader.findLocalClass(GenericClassLoader.java:288)
- locked <0xe5c43a98> (a weblogic.utils.classloaders.GenericClassLoader)
at weblogic.utils.classloaders.GenericClassLoader.findClass(GenericClassLoader.java:256)
at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
- locked <0xe5c43a98> (a weblogic.utils.classloaders.GenericClassLoader)
at java.lang.ClassLoader.loadClass(ClassLoader.java:251)
at weblogic.utils.classloaders.GenericClassLoader.loadClass(GenericClassLoader.java:176)
at weblogic.ejb.container.deployer.EJBModule.setupEJBToImplClassDependencies(EJBModule.java:1790)
at weblogic.ejb.container.deployer.EJBModule.prepare(EJBModule.java:397)
at weblogic.application.internal.flow.ModuleListenerInvoker.prepare(ModuleListenerInvoker.java:93)
at weblogic.application.internal.flow.DeploymentCallbackFlow$1.next(DeploymentCallbackFlow.java:387)
at weblogic.application.utils.StateMachineDriver.nextState(StateMachineDriver.java:37)
at weblogic.application.internal.flow.DeploymentCallbackFlow.prepare(DeploymentCallbackFlow.java:58)
at weblogic.application.internal.flow.DeploymentCallbackFlow.prepare(DeploymentCallbackFlow.java:42)
at weblogic.application.internal.BaseDeployment$1.next(BaseDeployment.java:615)
at weblogic.application.utils.StateMachineDriver.nextState(StateMachineDriver.java:37)
at weblogic.application.internal.BaseDeployment.prepare(BaseDeployment.java:191)
at weblogic.application.internal.EarDeployment.prepare(EarDeployment.java:16)
at weblogic.application.internal.DeploymentStateChecker.prepare(DeploymentStateChecker.java:155)
at weblogic.deploy.internal.targetserver.AppContainerInvoker.prepare(AppContainerInvoker.java:60)
at weblogic.deploy.internal.targetserver.AppDeployment.prepare(AppDeployment.java:141)
at weblogic.management.deploy.internal.DeploymentAdapter$1.doPrepare(DeploymentAdapter.java:39)
at weblogic.management.deploy.internal.DeploymentAdapter.prepare(DeploymentAdapter.java:187)
at weblogic.management.deploy.internal.AppTransition$1.transitionApp(AppTransition.java:21)
at weblogic.management.deploy.internal.ConfiguredDeployments.transitionApps(ConfiguredDeployments.java:233)
at weblogic.management.deploy.internal.ConfiguredDeployments.prepare(ConfiguredDeployments.java:165)
at weblogic.management.deploy.internal.ConfiguredDeployments.deploy(ConfiguredDeployments.java:122)
at weblogic.management.deploy.internal.DeploymentServerService.resume(DeploymentServerService.java:173)
at weblogic.management.deploy.internal.DeploymentServerService.start(DeploymentServerService.java:89)
at weblogic.t3.srvr.SubsystemRequest.run(SubsystemRequest.java:64)
at weblogic.work.ExecuteThread.execute(ExecuteThread.java:201)
at weblogic.work.ExecuteThread.run(ExecuteThread.java:173)
"Timer-1" daemon prio=10 tid=0x609e3800 nid=0x197 in Object.wait() [0x605f7000..0x605f80b0]
java.lang.Thread.State: TIMED_WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0xf2d7a2c0> (a java.util.TaskQueue)
at java.util.TimerThread.mainLoop(Timer.java:509)
- locked <0xf2d7a2c0> (a java.util.TaskQueue)
at java.util.TimerThread.run(Timer.java:462)
"Timer-0" daemon prio=10 tid=0x609e0000 nid=0x196 in Object.wait() [0x62350000..0x62351130]
java.lang.Thread.State: TIMED_WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0xf2d7a3b0> (a java.util.TaskQueue)
at java.util.TimerThread.mainLoop(Timer.java:509)
- locked <0xf2d7a3b0> (a java.util.TaskQueue)
at java.util.TimerThread.run(Timer.java:462)
"RMI TCP Accept-9896" daemon prio=10 tid=0x61ebf800 nid=0x194 runnable [0x623ba000..0x623bb030]
java.lang.Thread.State: RUNNABLE
at java.net.PlainSocketImpl.socketAccept(Native Method)
at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:384)
- locked <0xf2d76210> (a java.net.SocksSocketImpl)
at java.net.ServerSocket.implAccept(ServerSocket.java:453)
at java.net.ServerSocket.accept(ServerSocket.java:421)
at sun.rmi.transport.tcp.TCPTransport$AcceptLoop.executeAcceptLoop(TCPTransport.java:369)
at sun.rmi.transport.tcp.TCPTransport$AcceptLoop.run(TCPTransport.java:341)
at java.lang.Thread.run(Thread.java:619)
"RMI TCP Accept-0" daemon prio=10 tid=0x61eb6c00 nid=0x193 runnable [0x6240b000..0x6240beb0]
java.lang.Thread.State: RUNNABLE
at java.net.PlainSocketImpl.socketAccept(Native Method)
at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:384)
- locked <0xf2da0170> (a java.net.SocksSocketImpl)
at java.net.ServerSocket.implAccept(ServerSocket.java:453)
at java.net.ServerSocket.accept(ServerSocket.java:421)
at sun.rmi.transport.tcp.TCPTransport$AcceptLoop.executeAcceptLoop(TCPTransport.java:369)
at sun.rmi.transport.tcp.TCPTransport$AcceptLoop.run(TCPTransport.java:341)
at java.lang.Thread.run(Thread.java:619)
"Low Memory Detector" daemon prio=10 tid=0x63b01400 nid=0x192 runnable [0x00000000..0x00000000]
java.lang.Thread.State: RUNNABLE
"CompilerThread1" daemon prio=10 tid=0x63901c00 nid=0x191 runnable [0x00000000..0x634f3278]
java.lang.Thread.State: RUNNABLE
"CompilerThread0" daemon prio=10 tid=0x63900800 nid=0x190 runnable [0x00000000..0x635742f8]
java.lang.Thread.State: RUNNABLE
"Signal Dispatcher" daemon prio=10 tid=0x0919e000 nid=0x18f waiting on condition [0x00000000..0x00000000]
java.lang.Thread.State: RUNNABLE
"Finalizer" daemon prio=10 tid=0x09183000 nid=0x18e in Object.wait() [0x63aad000..0x63aae130]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0xf2d8e2d0> (a java.lang.ref.ReferenceQueue$Lock)
at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:116)
- locked <0xf2d8e2d0> (a java.lang.ref.ReferenceQueue$Lock)
at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:132)
at java.lang.ref.Finalizer$FinalizerThread.run(Finalizer.java:159)
"Reference Handler" daemon prio=10 tid=0x09181c00 nid=0x18d in Object.wait() [0x63afe000..0x63afefb0]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0xf2daa4c8> (a java.lang.ref.Reference$Lock)
at java.lang.Object.wait(Object.java:485)
at java.lang.ref.Reference$ReferenceHandler.run(Reference.java:116)
- locked <0xf2daa4c8> (a java.lang.ref.Reference$Lock)
"main" prio=10 tid=0x0900f000 nid=0x17b in Object.wait() [0xf7f1d000..0xf7f1e208]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0xf2d723c8> (a weblogic.t3.srvr.SubsystemRequest)
at weblogic.t3.srvr.SubsystemRequest.rendezvouz(SubsystemRequest.java:100)
- locked <0xf2d723c8> (a weblogic.t3.srvr.SubsystemRequest)
at weblogic.t3.srvr.SubsystemRequest.action(SubsystemRequest.java:81)
at weblogic.t3.srvr.SubsystemRequest.start(SubsystemRequest.java:51)
at weblogic.t3.srvr.ServerServicesManager.startService(ServerServicesManager.java:457)
at weblogic.t3.srvr.ServerServicesManager.startInAdminState(ServerServicesManager.java:237)
- locked <0x6536b220> (a java.lang.Class for weblogic.t3.srvr.ServerServicesManager)
at weblogic.t3.srvr.T3Srvr.initializeAdmin(T3Srvr.java:738)
at weblogic.t3.srvr.T3Srvr.startup(T3Srvr.java:499)
at weblogic.t3.srvr.T3Srvr.run(T3Srvr.java:440)
at weblogic.Server.main(Server.java:67)
"VM Thread" prio=10 tid=0x0917e800 nid=0x18c runnable
"GC task thread#0 (ParallelGC)" prio=10 tid=0x09015c00 nid=0x17c runnable
"GC task thread#1 (ParallelGC)" prio=10 tid=0x09016c00 nid=0x17d runnable
"GC task thread#2 (ParallelGC)" prio=10 tid=0x09018000 nid=0x17e runnable
"GC task thread#3 (ParallelGC)" prio=10 tid=0x09019000 nid=0x17f runnable
"GC task thread#4 (ParallelGC)" prio=10 tid=0x0901a000 nid=0x180 runnable
"GC task thread#5 (ParallelGC)" prio=10 tid=0x0901b000 nid=0x181 runnable
"GC task thread#6 (ParallelGC)" prio=10 tid=0x0901c400 nid=0x182 runnable
"GC task thread#7 (ParallelGC)" prio=10 tid=0x0901d400 nid=0x183 runnable
"GC task thread#8 (ParallelGC)" prio=10 tid=0x0901e400 nid=0x184 runnable
"GC task thread#9 (ParallelGC)" prio=10 tid=0x0901f400 nid=0x185 runnable
"GC task thread#10 (ParallelGC)" prio=10 tid=0x09020800 nid=0x186 runnable
"GC task thread#11 (ParallelGC)" prio=10 tid=0x09021800 nid=0x187 runnable
"GC task thread#12 (ParallelGC)" prio=10 tid=0x09022800 nid=0x188 runnable
"GC task thread#13 (ParallelGC)" prio=10 tid=0x09023800 nid=0x189 runnable
"GC task thread#14 (ParallelGC)" prio=10 tid=0x09024c00 nid=0x18a runnable
"GC task thread#15 (ParallelGC)" prio=10 tid=0x09025c00 nid=0x18b runnable
"VM Periodic Task Thread" prio=10 tid=0x61ec2000 nid=0x195 waiting on condition
JNI global references: 957
Heap
PSYoungGen total 229376K, used 39147K [0xe4d70000, 0xf4d70000, 0xf4d70000)
eden space 196608K, 8% used [0xe4d70000,0xe5cf3870,0xf0d70000)
from space 32768K, 70% used [0xf2d70000,0xf4427708,0xf4d70000)
to space 32768K, 0% used [0xf0d70000,0xf0d70000,0xf2d70000)
PSOldGen total 1835008K, used 0K [0x74d70000, 0xe4d70000, 0xe4d70000)
object space 1835008K, 0% used [0x74d70000,0x74d70000,0xe4d70000)
PSPermGen total 62208K, used 62093K [0x64d70000, 0x68a30000, 0x74d70000)
object space 62208K, 99% used [0x64d70000,0x68a134a8,0x68a30000)
Similar Messages
-
WLS Admin and managed server startup issue
Hi ,
In one of WLS Domain both the Admin Server and Managed Server startup is just hanging at the below mentioned point :
<Security> <BEA-090082> <Security initializing using security realm myrealm.>
After this there are no error messages or logs being generated and the server start up is not proceeding .
Only message shown a while after this is :
Warning : domain runtime mbean server has not been found after trying for 600 seconds
Please provide some inputs on how to troubleshoot this issue .
Checked the AdminServer.log and there are no errors reported there as well .
Some more data from AdminServer.log :
<[ACTIVE] ExecuteThread: '0' for queue: 'weblogic.kernel.Default (self-tuning)'> <<WLS Kernel>> <> <> <1336448845368> <BEA-090516> <The Authenticator provider has preexisting LDAP data.>
<[ACTIVE] ExecuteThread: '0' for queue: 'weblogic.kernel.Default (self-tuning)'> <<WLS Kernel>> <> <> <1336448845632> <BEA-090516> <The Authorizer provider has preexisting LDAP data.>
<[ACTIVE] ExecuteThread: '0' for queue: 'weblogic.kernel.Default (self-tuning)'> <<WLS Kernel>> <> <> <1336448846193> <BEA-090516> <The CredentialMapper provider has preexisting LDAP data.>
<[ACTIVE] ExecuteThread: '0' for queue: 'weblogic.kernel.Default (self-tuning)'> <<WLS Kernel>> <> <> <1336448846208> <BEA-090516> <The RoleMapper provider has preexisting LDAP data.>
<[ACTIVE] ExecuteThread: '0' for queue: 'weblogic.kernel.Default (self-tuning)'> <<WLS Kernel>> <> <> <1336448846433> <BEA-090093> <No pre-WLS 8.1 Keystore providers are configured for server AdminServer for security realm myrealm.>
<[ACTIVE] ExecuteThread: '0' for queue: 'weblogic.kernel.Default (self-tuning)'> <<WLS Kernel>> <> <> <1336448846433> <BEA-090082> <Security initializing using security realm myrealm.>
Thanks
Srinath
Edited by: Srinath Menon on May 8, 2012 9:36 AMHi Ashish ,
Thanks for the inputs.
Tried the same steps as mentioned but the issue still remains like that .
Posting the thread dump collected for AdminServer:
===== FULL THREAD DUMP ===============
Tue May 8 10:04:58 2012
Oracle JRockit(R) R28.1.3-11-141760-1.6.0_24-20110301-1430-linux-ia32
"Main Thread" id=1 idx=0x4 tid=9341 prio=5 alive, waiting, native_blocked
-- Waiting for notification on: weblogic/t3/srvr/SubsystemRequest@0x9f81d3c0[fat lock]
at <unknown>(???.c)@0xb7fe9410
at eventTimedWaitNoTransitionImpl+79(event.c:90)@0xb7d6bae0
at syncWaitForSignalNoTransition+81(synchronization.c:28)@0xb7ee7c62
at syncWaitForSignal+157(synchronization.c:85)@0xb7ee7dbe
at syncWaitForJavaSignal+53(synchronization.c:93)@0xb7ee7ea6
at RJNI_jrockit_vm_Threads_waitForNotifySignal+53(rnithreads.c:72)@0xb7eb78a6
at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
at java/lang/Object.wait(J)V(Native Method)
at weblogic/t3/srvr/SubsystemRequest.rendezvouz(SubsystemRequest.java:100)
^-- Lock released while waiting: weblogic/t3/srvr/SubsystemRequest@0x9f81d3c0[fat lock]
at weblogic/t3/srvr/SubsystemRequest.action(SubsystemRequest.java:81)
at weblogic/t3/srvr/SubsystemRequest.start(SubsystemRequest.java:51)
at weblogic/t3/srvr/ServerServicesManager.startService(ServerServicesManager.java:459)
at weblogic/t3/srvr/ServerServicesManager.startInStandbyState(ServerServicesManager.java:166)
^-- Holding lock: java/lang/Class@0x9fa95598[biased lock]
at weblogic/t3/srvr/T3Srvr.initializeStandby(T3Srvr.java:879)
at weblogic/t3/srvr/T3Srvr.startup(T3Srvr.java:566)
at weblogic/t3/srvr/T3Srvr.run(T3Srvr.java:467)
at weblogic/Server.main(Server.java:71)
at jrockit/vm/RNI.c2java(IIIII)V(Native Method)
-- end of trace
"(Signal Handler)" id=2 idx=0x8 tid=9342 prio=5 alive, native_blocked, daemon
at <unknown>(???.c)@0xb7fe9410
at sigiSignalHandlerThread+135(signalhandler.c:131)@0xb7ec2fd8
at thread_stub+146(lifecycle.c:808)@0xb7e2c333
at start_thread+225(:0)@0x515832
at __clone+93(:0)@0x46ae0e
"(OC Main Thread)" id=3 idx=0xc tid=9343 prio=5 alive, native_waiting, daemon
at <unknown>(???.c)@0xb7fe9410
at eventTimedWaitNoTransitionImpl+79(event.c:90)@0xb7d6bae0
at syncWaitForSignalNoTransition+81(synchronization.c:28)@0xb7ee7c62
at innerNativeDoWait+894(nativelock.c:614)@0xb7e78caf
at nativeWait+71(nativelock.c:721)@0xb7e79008
at ocMainThread+663(gcthreads.c:581)@0xb7d8a098
at thread_stub+146(lifecycle.c:808)@0xb7e2c333
at start_thread+225(:0)@0x515832
at __clone+93(:0)@0x46ae0e
"(GC Worker Thread 1)" id=? idx=0x10 tid=9344 prio=5 alive, daemon
at <unknown>(???.c)@0xb7fe9410
at eventTimedWaitNoTransitionImpl+79(event.c:90)@0xb7d6bae0
at eventTimedWaitNoTransition+62(event.c:72)@0xb7d6bb3f
at eventWaitNoTransition+32(event.c:62)@0xb7d6bc31
at mmGCWorkerThread+134(gcthreads.c:797)@0xb7d89d67
at thread_stub+146(lifecycle.c:808)@0xb7e2c333
at start_thread+225(:0)@0x515832
at __clone+93(:0)@0x46ae0e
"(GC Worker Thread 2)" id=? idx=0x14 tid=9345 prio=5 alive, daemon
at <unknown>(???.c)@0xb7fe9410
at eventTimedWaitNoTransitionImpl+79(event.c:90)@0xb7d6bae0
at eventTimedWaitNoTransition+62(event.c:72)@0xb7d6bb3f
at eventWaitNoTransition+32(event.c:62)@0xb7d6bc31
at mmGCWorkerThread+134(gcthreads.c:797)@0xb7d89d67
at thread_stub+146(lifecycle.c:808)@0xb7e2c333
at start_thread+225(:0)@0x515832
at __clone+93(:0)@0x46ae0e
"(Code Generation Thread 1)" id=4 idx=0x18 tid=9348 prio=5 alive, native_waiting, daemon
at <unknown>(???.c)@0xb7fe9410
at eventTimedWaitNoTransitionImpl+79(event.c:90)@0xb7d6bae0
at syncWaitForSignalNoTransition+81(synchronization.c:28)@0xb7ee7c62
at innerNativeDoWait+894(nativelock.c:614)@0xb7e78caf
at nativeWait+71(nativelock.c:721)@0xb7e79008
at cg_thread+380(compilerqueue.c:203)@0xb7d4be5d
at thread_stub+146(lifecycle.c:808)@0xb7e2c333
at start_thread+225(:0)@0x515832
at __clone+93(:0)@0x46ae0e
"(Code Optimization Thread 1)" id=5 idx=0x1c tid=9349 prio=5 alive, native_waiting, daemon
at <unknown>(???.c)@0xb7fe9410
at eventTimedWaitNoTransitionImpl+79(event.c:90)@0xb7d6bae0
at syncWaitForSignalNoTransition+81(synchronization.c:28)@0xb7ee7c62
at innerNativeDoWait+894(nativelock.c:614)@0xb7e78caf
at nativeWait+71(nativelock.c:721)@0xb7e79008
at cg_thread+380(compilerqueue.c:203)@0xb7d4be5d
at thread_stub+146(lifecycle.c:808)@0xb7e2c333
at start_thread+225(:0)@0x515832
at __clone+93(:0)@0x46ae0e
"(VM Periodic Task)" id=6 idx=0x20 tid=9350 prio=10 alive, native_blocked, daemon
at <unknown>(???.c)@0xb7fe9410
at block_for_safepoint+106(safepoint.c:34)@0xb7ebad5b
at eventTimedWait+239(event.c:83)@0xb7d6bd30
at periodic_task_thread+627(periodictask.c:367)@0xb7e90dd4
at thread_stub+146(lifecycle.c:808)@0xb7e2c333
at start_thread+225(:0)@0x515832
at __clone+93(:0)@0x46ae0e
"Finalizer" id=7 idx=0x24 tid=9351 prio=8 alive, native_waiting, daemon
at <unknown>(???.c)@0xb7fe9410
at eventTimedWaitNoTransitionImpl+79(event.c:90)@0xb7d6bae0
at syncWaitForSignalNoTransition+81(synchronization.c:28)@0xb7ee7c62
at innerNativeDoWait+894(nativelock.c:614)@0xb7e78caf
at nativeWait+71(nativelock.c:721)@0xb7e79008
at RJNI_jrockit_memory_Finalizer_waitForFinalizees+211(finalhandles.c:1007)@0xb7d751f4
at jrockit/memory/Finalizer.waitForFinalizees(J[Ljava/lang/Object;)I(Native Method)
at jrockit/memory/Finalizer.access$700(Finalizer.java:12)
at jrockit/memory/Finalizer$4.run(Finalizer.java:189)
at java/lang/Thread.run(Thread.java:662)
at jrockit/vm/RNI.c2java(IIIII)V(Native Method)
-- end of trace
"Reference Handler" id=8 idx=0x28 tid=9352 prio=10 alive, native_waiting, daemon
at <unknown>(???.c)@0xb7fe9410
at eventTimedWaitNoTransitionImpl+79(event.c:90)@0xb7d6bae0
at syncWaitForSignalNoTransition+81(synchronization.c:28)@0xb7ee7c62
at innerNativeDoWait+894(nativelock.c:614)@0xb7e78caf
at nativeUnlockAndWait+71(nativelock.c:686)@0xb7e790a8
at RJNI_java_lang_ref_Reference_waitForActivatedQueue+38(semiref.c:342)@0xb7ebd9b7
at java/lang/ref/Reference.waitForActivatedQueue(J)Ljava/lang/ref/Reference;(Native Method)
at java/lang/ref/Reference.access$100(Reference.java:11)
at java/lang/ref/Reference$ReferenceHandler.run(Reference.java:82)
at jrockit/vm/RNI.c2java(IIIII)V(Native Method)
-- end of trace
"(Sensor Event Thread)" id=9 idx=0x2c tid=9353 prio=5 alive, native_blocked, daemon
at <unknown>(???.c)@0xb7fe9410
at eventTimedWaitNoTransitionImpl+79(event.c:90)@0xb7d6bae0
at eventTimedWaitNoTransition+62(event.c:72)@0xb7d6bb3f
at eventTimedWait+138(event.c:56)@0xb7d6bccb
at eventWait+32(event.c:50)@0xb7d6bd81
at sensor_event_loop+37(sensor.c:68)@0xb7ebfda6
at thread_stub+146(lifecycle.c:808)@0xb7e2c333
at start_thread+225(:0)@0x515832
at __clone+93(:0)@0x46ae0e
"VM JFR Buffer Thread" id=10 idx=0x30 tid=9354 prio=5 alive, in native, daemon
at <unknown>(???.c)@0xb7fe9410
at bufferthread+2135(vmjfr.c:1008)@0xb71744b8
at run_agent_thread+128(jvmtithreads.c:524)@0xb7e1f361
at thread_stub+146(lifecycle.c:808)@0xb7e2c333
at start_thread+225(:0)@0x515832
at __clone+93(:0)@0x46ae0e
"Timer-0" id=13 idx=0x34 tid=9358 prio=5 alive, waiting, native_blocked, daemon
-- Waiting for notification on: java/util/TaskQueue@0x9f9fc350[fat lock]
at <unknown>(???.c)@0xb7fe9410
at eventTimedWaitNoTransitionImpl+79(event.c:90)@0xb7d6bae0
at syncWaitForSignalNoTransition+81(synchronization.c:28)@0xb7ee7c62
at syncWaitForSignal+157(synchronization.c:85)@0xb7ee7dbe
at syncWaitForJavaSignal+53(synchronization.c:93)@0xb7ee7ea6
at RJNI_jrockit_vm_Threads_waitForNotifySignal+53(rnithreads.c:72)@0xb7eb78a6
at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
at java/lang/Object.wait(J)V(Native Method)
at java/lang/Object.wait(Object.java:485)
at java/util/TimerThread.mainLoop(Timer.java:483)
^-- Lock released while waiting: java/util/TaskQueue@0x9f9fc350[fat lock]
at java/util/TimerThread.run(Timer.java:462)
at jrockit/vm/RNI.c2java(IIIII)V(Native Method)
-- end of trace
"Timer-1" id=14 idx=0x38 tid=9363 prio=5 alive, waiting, native_blocked, daemon
-- Waiting for notification on: java/util/TaskQueue@0xa20ee240[fat lock]
at <unknown>(???.c)@0xb7fe9410
at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
at java/lang/Object.wait(J)V(Native Method)
at java/util/TimerThread.mainLoop(Timer.java:509)
^-- Lock released while waiting: java/util/TaskQueue@0xa20ee240[fat lock]
at java/util/TimerThread.run(Timer.java:462)
at jrockit/vm/RNI.c2java(IIIII)V(Native Method)
-- end of trace
"[ACTIVE] ExecuteThread: '0' for queue: 'weblogic.kernel.Default (self-tuning)'" id=15 idx=0x3c tid=9364 prio=5 alive, waiting, native_blocked, daemon
-- Waiting for notification on: netscape/ldap/LDAPResponseListener@0x9724f0c8[fat lock]
at <unknown>(???.c)@0xb7fe9410
at eventTimedWaitNoTransitionImpl+79(event.c:90)@0xb7d6bae0
at syncWaitForSignalNoTransition+81(synchronization.c:28)@0xb7ee7c62
at syncWaitForSignal+157(synchronization.c:85)@0xb7ee7dbe
at syncWaitForJavaSignal+53(synchronization.c:93)@0xb7ee7ea6
at RJNI_jrockit_vm_Threads_waitForNotifySignal+53(rnithreads.c:72)@0xb7eb78a6
at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
at java/lang/Object.wait(J)V(Native Method)
at java/lang/Object.wait(Object.java:485)
at netscape/ldap/LDAPMessageQueue.waitForMessage(LDAPMessageQueue.java:200)
^-- Lock released while waiting: netscape/ldap/LDAPResponseListener@0x9724f0c8[recursive]
at netscape/ldap/LDAPMessageQueue.waitFirstMessage(LDAPMessageQueue.java:101)
^-- Lock released while waiting: netscape/ldap/LDAPResponseListener@0x9724f0c8[fat lock]
at netscape/ldap/LDAPConnection.sendRequest(LDAPConnection.java:1796)
^-- Holding lock: netscape/ldap/LDAPConnection@0x9721f310[biased lock]
at netscape/ldap/LDAPConnection.simpleBind(LDAPConnection.java:1763)
at netscape/ldap/LDAPConnection.authenticate(LDAPConnection.java:1264)
at netscape/ldap/LDAPConnection.authenticate(LDAPConnection.java:1273)
at netscape/ldap/LDAPConnection.bind(LDAPConnection.java:1562)
at weblogic/security/providers/authentication/LDAPAtnDelegate$LDAPFactory.newInstance(LDAPAtnDelegate.java:4134)
at weblogic/security/utils/Pool.newInstance(Pool.java:37)
at weblogic/security/utils/Pool.getInstance(Pool.java:33)
at weblogic/security/providers/authentication/LDAPAtnDelegate.getConnection(LDAPAtnDelegate.java:3478)
at weblogic/security/providers/authentication/LDAPAtnDelegate.getConnection(LDAPAtnDelegate.java:3470)
at weblogic/security/providers/authentication/LDAPAtnDelegate.authenticate(LDAPAtnDelegate.java:3522)
at weblogic/security/providers/authentication/LDAPAtnLoginModuleImpl.login(LDAPAtnLoginModuleImpl.java:227)
at com/bea/common/security/internal/service/LoginModuleWrapper$1.run(LoginModuleWrapper.java:110)
at jrockit/vm/AccessController.doPrivileged(AccessController.java:254)
at jrockit/vm/AccessController.doPrivileged(AccessController.java:268)
at com/bea/common/security/internal/service/LoginModuleWrapper.login(LoginModuleWrapper.java:106)
at jrockit/vm/RNI.c2java(IIIII)V(Native Method)
at jrockit/vm/Reflect.invokeMethod(Ljava/lang/Object;Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;(Native Method)
at sun/reflect/NativeMethodAccessorImpl.invoke0(Ljava/lang/reflect/Method;Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;(Native Method)
at sun/reflect/NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun/reflect/DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java/lang/reflect/Method.invoke(Method.java:597)
at javax/security/auth/login/LoginContext.invoke(LoginContext.java:769)
at javax/security/auth/login/LoginContext.access$000(LoginContext.java:186)
at javax/security/auth/login/LoginContext$4.run(LoginContext.java:683)
at jrockit/vm/AccessController.doPrivileged(AccessController.java:254)
at jrockit/vm/AccessController.doPrivileged(AccessController.java:268)
at javax/security/auth/login/LoginContext.invokePriv(LoginContext.java:680)
at javax/security/auth/login/LoginContext.login(LoginContext.java:579)
at com/bea/common/security/internal/service/JAASLoginServiceImpl.login(JAASLoginServiceImpl.java:113)
at jrockit/vm/RNI.c2java(IIIII)V(Native Method)
at jrockit/vm/Reflect.invokeMethod(Ljava/lang/Object;Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;(Native Method)
at sun/reflect/NativeMethodAccessorImpl.invoke0(Ljava/lang/reflect/Method;Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;(Native Method)
at sun/reflect/NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun/reflect/DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java/lang/reflect/Method.invoke(Method.java:597)
at com/bea/common/security/internal/utils/Delegator$ProxyInvocationHandler.invoke(Delegator.java:57)
at $Proxy28.login(Ljava/lang/String;Ljavax/security/auth/callback/CallbackHandler;Lweblogic/security/service/ContextHandler;)Lcom/bea/common/security/service/Identity;(Unknown Source)
at weblogic/security/service/internal/WLSJAASLoginServiceImpl$ServiceImpl.login(WLSJAASLoginServiceImpl.java:89)
at com/bea/common/security/internal/service/JAASAuthenticationServiceImpl.authenticate(JAASAuthenticationServiceImpl.java:82)
at jrockit/vm/RNI.c2java(IIIII)V(Native Method)
at jrockit/vm/Reflect.invokeMethod(Ljava/lang/Object;Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;(Native Method)
at sun/reflect/NativeMethodAccessorImpl.invoke0(Ljava/lang/reflect/Method;Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;(Native Method)
at sun/reflect/NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun/reflect/DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java/lang/reflect/Method.invoke(Method.java:597)
at com/bea/common/security/internal/utils/Delegator$ProxyInvocationHandler.invoke(Delegator.java:57)
at $Proxy46.authenticate(Ljavax/security/auth/callback/CallbackHandler;Lweblogic/security/service/ContextHandler;)Lcom/bea/common/security/service/Identity;(Unknown Source)
at weblogic/security/service/WLSJAASAuthenticationServiceWrapper.authenticate(WLSJAASAuthenticationServiceWrapper.java:40)
at weblogic/security/service/PrincipalAuthenticator.authenticate(PrincipalAuthenticator.java:348)
at weblogic/security/service/CommonSecurityServiceManagerDelegateImpl.doBootAuthorization(CommonSecurityServiceManagerDelegateImpl.java:929)
at weblogic/security/service/CommonSecurityServiceManagerDelegateImpl.initialize(CommonSecurityServiceManagerDelegateImpl.java:1050)
at weblogic/security/service/SecurityServiceManager.initialize(SecurityServiceManager.java:873)
at weblogic/security/SecurityService.start(SecurityService.java:141)
at weblogic/t3/srvr/SubsystemRequest.run(SubsystemRequest.java:64)
at weblogic/work/ExecuteThread.execute(ExecuteThread.java:207)
at weblogic/work/ExecuteThread.run(ExecuteThread.java:176)
at jrockit/vm/RNI.c2java(IIIII)V(Native Method)
-- end of trace
"JFR request timer" id=16 idx=0x40 tid=9365 prio=5 alive, waiting, native_blocked, daemon
-- Waiting for notification on: java/util/TaskQueue@0xa2049280[fat lock]
at <unknown>(???.c)@0xb7fe9410
at eventTimedWaitNoTransitionImpl+79(event.c:90)@0xb7d6bae0
at syncWaitForSignalNoTransition+81(synchronization.c:28)@0xb7ee7c62
at syncWaitForSignal+157(synchronization.c:85)@0xb7ee7dbe
at syncWaitForJavaSignal+53(synchronization.c:93)@0xb7ee7ea6
at RJNI_jrockit_vm_Threads_waitForNotifySignal+53(rnithreads.c:72)@0xb7eb78a6
at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
at java/lang/Object.wait(J)V(Native Method)
at java/lang/Object.wait(Object.java:485)
at java/util/TimerThread.mainLoop(Timer.java:483)
^-- Lock released while waiting: java/util/TaskQueue@0xa2049280[fat lock]
at java/util/TimerThread.run(Timer.java:462)
at jrockit/vm/RNI.c2java(IIIII)V(Native Method)
-- end of trace
"weblogic.time.TimeEventGenerator" id=18 idx=0x44 tid=9366 prio=9 alive, waiting, native_blocked, daemon
-- Waiting for notification on: weblogic/time/common/internal/TimeTable@0xa2089c70[fat lock]
at <unknown>(???.c)@0xb7fe9410
at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
at java/lang/Object.wait(J)V(Native Method)
at weblogic/time/common/internal/TimeTable.snooze(TimeTable.java:286)
^-- Lock released while waiting: weblogic/time/common/internal/TimeTable@0xa2089c70[fat lock]
at weblogic/time/common/internal/TimeEventGenerator.run(TimeEventGenerator.java:117)
at java/lang/Thread.run(Thread.java:662)
at jrockit/vm/RNI.c2java(IIIII)V(Native Method)
-- end of trace
"JMAPI event thread" id=19 idx=0x48 tid=9367 prio=5 alive, in native, daemon
at <unknown>(???.c)@0xb7fe9410
at eventTimedWaitNoTransitionImpl+79(event.c:90)@0xb7d6bae0
at syncWaitForSignalNoTransition+81(synchronization.c:28)@0xb7ee7c62
at innerNativeDoWait+526(nativelock.c:614)@0xb7e78b3f
at nlMonitorWaitInner+79(nativelock.c:1112)@0xb7e78df0
at nlMonitorWaitNoTransition+38(nativelock.c:1132)@0xb7e78e47
at nativeRawMonitorWait+78(rawmonitor.c:161)@0xb7ea8caf
at jvmti_RawMonitorWait+111(jvmtirawmonitors.c:95)@0xb7e1b420
at threadProc+291(jmapi.c:305)@0x90452bd4
at run_agent_thread+128(jvmtithreads.c:524)@0xb7e1f361
at thread_stub+146(lifecycle.c:808)@0xb7e2c333
at start_thread+225(:0)@0x515832
at __clone+93(:0)@0x46ae0e
"weblogic.timers.TimerThread" id=20 idx=0x4c tid=9368 prio=9 alive, waiting, native_blocked, daemon
-- Waiting for notification on: weblogic/timers/internal/TimerThread@0xa203dbf0[fat lock]
at <unknown>(???.c)@0xb7fe9410
at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
at java/lang/Object.wait(J)V(Native Method)
at weblogic/timers/internal/TimerThread$Thread.run(TimerThread.java:262)
^-- Lock released while waiting: weblogic/timers/internal/TimerThread@0xa203dbf0[fat lock]
at jrockit/vm/RNI.c2java(IIIII)V(Native Method)
-- end of trace -
SOA Cluster: Managed Server startup issue
Hi,
I did the SOA clustering as follows:
10.111.122.133 – Admin Server and soa_server1
10.111.122.136 – soa_server2
Configured "soadomain" that contains Admin Server, soa_server1 and soa_server2.
used pack and unpack to replicate domain structure in the box where soa_server2 resides.
when I start managed server soa_server2, I'm getting the following issue:
<Nov 3, 2011 4:42:54 PM IST> <Error> <Deployer> <BEA-149205> <Failed to initialize the application 'oracle.soa.rules_dict_dc.webapp [LibSpecVersion=11.1.1,LibImplVersion=11.1.1]' due to error weblogic.management.DeploymentException: .
weblogic.management.DeploymentException:
at weblogic.servlet.internal.WarDeploymentFactory.findOrCreateComponentMBeans(WarDeploymentFactory.java:69)
at weblogic.application.internal.MBeanFactoryImpl.findOrCreateComponentMBeans(MBeanFactoryImpl.java:48)
at weblogic.application.internal.MBeanFactoryImpl.createComponentMBeans(MBeanFactoryImpl.java:110)
at weblogic.application.internal.MBeanFactoryImpl.initializeMBeans(MBeanFactoryImpl.java:76)
at weblogic.management.deploy.internal.MBeanConverter.createApplicationMBean(MBeanConverter.java:91)
Truncated. see log file for complete stacktrace
Caused By: java.io.FileNotFoundException: File not found
at java.util.zip.ZipFile.open(Native Method)
at java.util.zip.ZipFile.<init>(ZipFile.java:117)
at java.util.zip.ZipFile.<init>(ZipFile.java:133)
at weblogic.servlet.utils.WarUtils.existsInWar(WarUtils.java:84)
at weblogic.servlet.utils.WarUtils.isWebServices(WarUtils.java:76)
Truncated. see log file for complete stacktrace
>
<Nov 3, 2011 4:42:54 PM IST> <Error> <Deployer> <BEA-149605> <Failed to create App/Comp mbeans for AppDeploymentMBean oracle.soa.rules_editor_dc.webapp#[email protected]. Error - weblogic.management.DeploymentException: .
weblogic.management.DeploymentException:
at weblogic.servlet.internal.WarDeploymentFactory.findOrCreateComponentMBeans(WarDeploymentFactory.java:69)
at weblogic.application.internal.MBeanFactoryImpl.findOrCreateComponentMBeans(MBeanFactoryImpl.java:48)
at weblogic.application.internal.MBeanFactoryImpl.createComponentMBeans(MBeanFactoryImpl.java:110)
at weblogic.application.internal.MBeanFactoryImpl.initializeMBeans(MBeanFactoryImpl.java:76)
at weblogic.management.deploy.internal.MBeanConverter.createApplicationMBean(MBeanConverter.java:91)
Truncated. see log file for complete stacktrace
Caused By: java.io.FileNotFoundException: File not found
at java.util.zip.ZipFile.open(Native Method)
at java.util.zip.ZipFile.<init>(ZipFile.java:117)
at java.util.zip.ZipFile.<init>(ZipFile.java:133)
at weblogic.servlet.utils.WarUtils.existsInWar(WarUtils.java:84)
at weblogic.servlet.utils.WarUtils.isWebServices(WarUtils.java:76)
Truncated. see log file for complete stacktrace
>
<Nov 3, 2011 4:42:54 PM IST> <Error> <Deployer> <BEA-149205> <Failed to initialize the application 'oracle.soa.rules_editor_dc.webapp [LibSpecVersion=11.1.1,LibImplVersion=11.1.1]' due to error weblogic.management.DeploymentException: .
weblogic.management.DeploymentException:
at weblogic.servlet.internal.WarDeploymentFactory.findOrCreateComponentMBeans(WarDeploymentFactory.java:69)
at weblogic.application.internal.MBeanFactoryImpl.findOrCreateComponentMBeans(MBeanFactoryImpl.java:48)
at weblogic.application.internal.MBeanFactoryImpl.createComponentMBeans(MBeanFactoryImpl.java:110)
at weblogic.application.internal.MBeanFactoryImpl.initializeMBeans(MBeanFactoryImpl.java:76)
at weblogic.management.deploy.internal.MBeanConverter.createApplicationMBean(MBeanConverter.java:91)
Truncated. see log file for complete stacktrace
Caused By: java.io.FileNotFoundException: File not found
at java.util.zip.ZipFile.open(Native Method)
at java.util.zip.ZipFile.<init>(ZipFile.java:117)
at java.util.zip.ZipFile.<init>(ZipFile.java:133)
at weblogic.servlet.utils.WarUtils.existsInWar(WarUtils.java:84)
at weblogic.servlet.utils.WarUtils.isWebServices(WarUtils.java:76)
Truncated. see log file for complete stacktrace
>
<Nov 3, 2011 4:42:54 PM IST> <Error> <Deployer> <BEA-149205> <Failed to initialize the application 'oracle.soa.ext [LibSpecVersion=11.1.1,LibImplVersion=11.1.1]' due to error weblogic.management.DeploymentException: [Deployer:149003]Unable to access application source information in '/softwares/app/Middleware/Oracle_SOA1/soa/modules/oracle.soa.ext_11.1.1/oracle.soa.ext.jar' for application 'oracle.soa.ext [LibSpecVersion=11.1.1,LibImplVersion=11.1.1]'. The specific error is: [Deployer:149158]No application files exist at '/softwares/app/Middleware/Oracle_SOA1/soa/modules/oracle.soa.ext_11.1.1/oracle.soa.ext.jar'...
weblogic.management.DeploymentException: [Deployer:149003]Unable to access application source information in '/softwares/app/Middleware/Oracle_SOA1/soa/modules/oracle.soa.ext_11.1.1/oracle.soa.ext.jar' for application 'oracle.soa.ext [LibSpecVersion=11.1.1,LibImplVersion=11.1.1]'. The specific error is: [Deployer:149158]No application files exist at '/softwares/app/Middleware/Oracle_SOA1/soa/modules/oracle.soa.ext_11.1.1/oracle.soa.ext.jar'..
at weblogic.deploy.internal.targetserver.BasicDeployment.verifyLocalApp(BasicDeployment.java:124)
at weblogic.deploy.internal.targetserver.BasicDeployment.createDeployment(BasicDeployment.java:146)
at weblogic.deploy.internal.targetserver.AppDeployment.prepare(AppDeployment.java:114)
at weblogic.management.deploy.internal.DeploymentAdapter$1.doPrepare(DeploymentAdapter.java:40)
at weblogic.management.deploy.internal.DeploymentAdapter.prepare(DeploymentAdapter.java:191)
Truncated. see log file for complete stacktrace
>
<Nov 3, 2011 4:42:54 PM IST> <Error> <Deployer> <BEA-149205> <Failed to initialize the application 'oracle.soa.b2b [LibSpecVersion=11.1.1,LibImplVersion=11.1.1]' due to error weblogic.management.DeploymentException: [Deployer:149003]Unable to access application source information in '/softwares/app/Middleware/Oracle_SOA1/soa/modules/oracle.soa.b2b_11.1.1/oracle.soa.b2b.jar' for application 'oracle.soa.b2b [LibSpecVersion=11.1.1,LibImplVersion=11.1.1]'. The specific error is: [Deployer:149158]No application files exist at '/softwares/app/Middleware/Oracle_SOA1/soa/modules/oracle.soa.b2b_11.1.1/oracle.soa.b2b.jar'...
weblogic.management.DeploymentException: [Deployer:149003]Unable to access application source information in '/softwares/app/Middleware/Oracle_SOA1/soa/modules/oracle.soa.b2b_11.1.1/oracle.soa.b2b.jar' for application 'oracle.soa.b2b [LibSpecVersion=11.1.1,LibImplVersion=11.1.1]'. The specific error is: [Deployer:149158]No application files exist at '/softwares/app/Middleware/Oracle_SOA1/soa/modules/oracle.soa.b2b_11.1.1/oracle.soa.b2b.jar'..
at weblogic.deploy.internal.targetserver.BasicDeployment.verifyLocalApp(BasicDeployment.java:124)
at weblogic.deploy.internal.targetserver.BasicDeployment.createDeployment(BasicDeployment.java:146)
at weblogic.deploy.internal.targetserver.AppDeployment.prepare(AppDeployment.java:114)
at weblogic.management.deploy.internal.DeploymentAdapter$1.doPrepare(DeploymentAdapter.java:40)
at weblogic.management.deploy.internal.DeploymentAdapter.prepare(DeploymentAdapter.java:191)
Truncated. see log file for complete stacktrace
>
<Nov 3, 2011 4:42:54 PM IST> <Error> <Deployer> <BEA-149605> <Failed to create App/Comp mbeans for AppDeploymentMBean oracle.soa.worklist.webapp#[email protected]. Error - weblogic.management.DeploymentException: .
weblogic.management.DeploymentException:
at weblogic.servlet.internal.WarDeploymentFactory.findOrCreateComponentMBeans(WarDeploymentFactory.java:69)
at weblogic.application.internal.MBeanFactoryImpl.findOrCreateComponentMBeans(MBeanFactoryImpl.java:48)
at weblogic.application.internal.MBeanFactoryImpl.createComponentMBeans(MBeanFactoryImpl.java:110)
at weblogic.application.internal.MBeanFactoryImpl.initializeMBeans(MBeanFactoryImpl.java:76)
at weblogic.management.deploy.internal.MBeanConverter.createApplicationMBean(MBeanConverter.java:91)
Truncated. see log file for complete stacktrace
Caused By: java.io.IOException: File not found with : /softwares/app/Middleware/Oracle_SOA1/communications/applications/sdpmessagingdriver-smpp.ear
at java.util.zip.ZipFile.open(Native Method)
at java.util.zip.ZipFile.<init>(ZipFile.java:117)
at java.util.jar.JarFile.<init>(JarFile.java:133)
at java.util.jar.JarFile.<init>(JarFile.java:97)
at weblogic.utils.jars.JarFileDelegate.<init>(JarFileDelegate.java:32)
Truncated. see log file for complete stacktrace
>
<Nov 3, 2011 4:43:06 PM IST> <Error> <Deployer> <BEA-149205> <Failed to initialize the application 'usermessagingdriver-smpp' due to error weblogic.management.DeploymentException: File not found with : /softwares/app/Middleware/Oracle_SOA1/communications/applications/sdpmessagingdriver-smpp.ear.
weblogic.management.DeploymentException: File not found with : /softwares/app/Middleware/Oracle_SOA1/communications/applications/sdpmessagingdriver-smpp.ear
at weblogic.application.internal.EarDeploymentFactory.findOrCreateComponentMBeans(EarDeploymentFactory.java:193)
at weblogic.application.internal.MBeanFactoryImpl.findOrCreateComponentMBeans(MBeanFactoryImpl.java:48)
at weblogic.application.internal.MBeanFactoryImpl.createComponentMBeans(MBeanFactoryImpl.java:110)
at weblogic.application.internal.MBeanFactoryImpl.initializeMBeans(MBeanFactoryImpl.java:76)
at weblogic.management.deploy.internal.MBeanConverter.createApplicationMBean(MBeanConverter.java:91)
Truncated. see log file for complete stacktrace
Caused By: java.io.IOException: File not found with : /softwares/app/Middleware/Oracle_SOA1/communications/applications/sdpmessagingdriver-smpp.ear
at java.util.zip.ZipFile.open(Native Method)
at java.util.zip.ZipFile.<init>(ZipFile.java:117)
at java.util.jar.JarFile.<init>(JarFile.java:133)
at java.util.jar.JarFile.<init>(JarFile.java:97)
at weblogic.utils.jars.JarFileDelegate.<init>(JarFileDelegate.java:32)
Truncated. see log file for complete stacktrace
>
<Nov 3, 2011 4:43:06 PM IST> <Error> <Deployer> <BEA-149605> <Failed to create App/Comp mbeans for AppDeploymentMBean usermessagingdriver-voicexml. Error - weblogic.management.DeploymentException: File not found with : /softwares/app/Middleware/Oracle_SOA1/communications/applications/sdpmessagingdriver-voicexml.ear.
weblogic.management.DeploymentException: File not found with : /softwares/app/Middleware/Oracle_SOA1/communications/applications/sdpmessagingdriver-voicexml.ear
at weblogic.application.internal.EarDeploymentFactory.findOrCreateComponentMBeans(EarDeploymentFactory.java:193)
at weblogic.application.internal.MBeanFactoryImpl.findOrCreateComponentMBeans(MBeanFactoryImpl.java:48)
at weblogic.application.internal.MBeanFactoryImpl.createComponentMBeans(MBeanFactoryImpl.java:110)
at weblogic.application.internal.MBeanFactoryImpl.initializeMBeans(MBeanFactoryImpl.java:76)
at weblogic.management.deploy.internal.MBeanConverter.createApplicationMBean(MBeanConverter.java:91)
Truncated. see log file for complete stacktrace
Caused By: java.io.IOException: File not found with : /softwares/app/Middleware/Oracle_SOA1/communications/applications/sdpmessagingdriver-voicexml.ear
at java.util.zip.ZipFile.open(Native Method)
at java.util.zip.ZipFile.<init>(ZipFile.java:117)
at java.util.jar.JarFile.<init>(JarFile.java:133)
at java.util.jar.JarFile.<init>(JarFile.java:97)
at weblogic.utils.jars.JarFileDelegate.<init>(JarFileDelegate.java:32)
Truncated. see log file for complete stacktrace
>
<Nov 3, 2011 4:43:06 PM IST> <Error> <Deployer> <BEA-149205> <Failed to initialize the application 'usermessagingdriver-voicexml' due to error weblogic.management.DeploymentException: File not found with : /softwares/app/Middleware/Oracle_SOA1/communications/applications/sdpmessagingdriver-voicexml.ear.
weblogic.management.DeploymentException: File not found with : /softwares/app/Middleware/Oracle_SOA1/communications/applications/sdpmessagingdriver-voicexml.ear
at weblogic.application.internal.EarDeploymentFactory.findOrCreateComponentMBeans(EarDeploymentFactory.java:193)
at weblogic.application.internal.MBeanFactoryImpl.findOrCreateComponentMBeans(MBeanFactoryImpl.java:48)
at weblogic.application.internal.MBeanFactoryImpl.createComponentMBeans(MBeanFactoryImpl.java:110)
at weblogic.application.internal.MBeanFactoryImpl.initializeMBeans(MBeanFactoryImpl.java:76)
at weblogic.management.deploy.internal.MBeanConverter.createApplicationMBean(MBeanConverter.java:91)
Truncated. see log file for complete stacktrace
Caused By: java.io.IOException: File not found with : /softwares/app/Middleware/Oracle_SOA1/communications/applications/sdpmessagingdriver-voicexml.ear
at java.util.zip.ZipFile.open(Native Method)
at java.util.zip.ZipFile.<init>(ZipFile.java:117)
at java.util.jar.JarFile.<init>(JarFile.java:133)
at java.util.jar.JarFile.<init>(JarFile.java:97)
at weblogic.utils.jars.JarFileDelegate.<init>(JarFileDelegate.java:32)
Truncated. see log file for complete stacktrace
>
<Nov 3, 2011 4:43:06 PM IST> <Error> <Deployer> <BEA-149605> <Failed to create App/Comp mbeans for AppDeploymentMBean worklistapp. Error - weblogic.management.DeploymentException: File not found with : /softwares/app/Middleware/Oracle_SOA1/soa/applications/worklist-wls.ear.
weblogic.management.DeploymentException: File not found with : /softwares/app/Middleware/Oracle_SOA1/soa/applications/worklist-wls.ear
at weblogic.application.internal.EarDeploymentFactory.findOrCreateComponentMBeans(EarDeploymentFactory.java:193)
at weblogic.application.internal.MBeanFactoryImpl.findOrCreateComponentMBeans(MBeanFactoryImpl.java:48)
at weblogic.application.internal.MBeanFactoryImpl.createComponentMBeans(MBeanFactoryImpl.java:110)
at weblogic.application.internal.MBeanFactoryImpl.initializeMBeans(MBeanFactoryImpl.java:76)
at weblogic.management.deploy.internal.MBeanConverter.createApplicationMBean(MBeanConverter.java:91)
Truncated. see log file for complete stacktrace
Caused By: java.io.IOException: File not found with : /softwares/app/Middleware/Oracle_SOA1/soa/applications/worklist-wls.ear
at java.util.zip.ZipFile.open(Native Method)
at java.util.zip.ZipFile.<init>(ZipFile.java:117)
at java.util.jar.JarFile.<init>(JarFile.java:133)
at java.util.jar.JarFile.<init>(JarFile.java:97)
at weblogic.utils.jars.JarFileDelegate.<init>(JarFileDelegate.java:32)
Truncated. see log file for complete stacktrace
>
<Nov 3, 2011 4:43:06 PM IST> <Error> <Deployer> <BEA-149205> <Failed to initialize the application 'worklistapp' due to error weblogic.management.DeploymentException: File not found with : /softwares/app/Middleware/Oracle_SOA1/soa/applications/worklist-wls.ear.
weblogic.management.DeploymentException: File not found with : /softwares/app/Middleware/Oracle_SOA1/soa/applications/worklist-wls.ear
at weblogic.application.internal.EarDeploymentFactory.findOrCreateComponentMBeans(EarDeploymentFactory.java:193)
at weblogic.application.internal.MBeanFactoryImpl.findOrCreateComponentMBeans(MBeanFactoryImpl.java:48)
at weblogic.application.internal.MBeanFactoryImpl.createComponentMBeans(MBeanFactoryImpl.java:110)
at weblogic.application.internal.MBeanFactoryImpl.initializeMBeans(MBeanFactoryImpl.java:76)
at weblogic.management.deploy.internal.MBeanConverter.createApplicationMBean(MBeanConverter.java:91)
Truncated. see log file for complete stacktrace
Caused By: java.io.IOException: File not found with : /softwares/app/Middleware/Oracle_SOA1/soa/applications/worklist-wls.ear
at java.util.zip.ZipFile.open(Native Method)
at java.util.zip.ZipFile.<init>(ZipFile.java:117)
at java.util.jar.JarFile.<init>(JarFile.java:133)
at java.util.jar.JarFile.<init>(JarFile.java:97)
at weblogic.utils.jars.JarFileDelegate.<init>(JarFileDelegate.java:32)
Truncated. see log file for complete stacktrace
>
<Nov 3, 2011 4:43:06 PM IST> <Error> <Deployer> <BEA-149605> <Failed to create App/Comp mbeans for AppDeploymentMBean b2bui. Error - weblogic.management.DeploymentException: File not found with : /softwares/app/Middleware/Oracle_SOA1/soa/applications/soa-infra-b2bui-wls.ear.
weblogic.management.DeploymentException: File not found with : /softwares/app/Middleware/Oracle_SOA1/soa/applications/soa-infra-b2bui-wls.ear
at weblogic.application.internal.EarDeploymentFactory.findOrCreateComponentMBeans(EarDeploymentFactory.java:193)
at weblogic.application.internal.MBeanFactoryImpl.findOrCreateComponentMBeans(MBeanFactoryImpl.java:48)
at weblogic.application.internal.MBeanFactoryImpl.createComponentMBeans(MBeanFactoryImpl.java:110)
at weblogic.application.internal.MBeanFactoryImpl.initializeMBeans(MBeanFactoryImpl.java:76)
at weblogic.management.deploy.internal.MBeanConverter.createApplicationMBean(MBeanConverter.java:91)
Truncated. see log file for complete stacktrace
Caused By: java.io.IOException: File not found with : /softwares/app/Middleware/Oracle_SOA1/soa/applications/soa-infra-b2bui-wls.ear
at java.util.zip.ZipFile.open(Native Method)
at java.util.zip.ZipFile.<init>(ZipFile.java:117)
at java.util.jar.JarFile.<init>(JarFile.java:133)
at java.util.jar.JarFile.<init>(JarFile.java:97)
at weblogic.utils.jars.JarFileDelegate.<init>(JarFileDelegate.java:32)
Truncated. see log file for complete stacktrace
>
<Nov 3, 2011 4:43:06 PM IST> <Error> <Deployer> <BEA-149205> <Failed to initialize the application 'b2bui' due to error weblogic.management.DeploymentException: File not found with : /softwares/app/Middleware/Oracle_SOA1/soa/applications/soa-infra-b2bui-wls.ear.
weblogic.management.DeploymentException: File not found with : /softwares/app/Middleware/Oracle_SOA1/soa/applications/soa-infra-b2bui-wls.ear
at weblogic.application.internal.EarDeploymentFactory.findOrCreateComponentMBeans(EarDeploymentFactory.java:193)
at weblogic.application.internal.MBeanFactoryImpl.findOrCreateComponentMBeans(MBeanFactoryImpl.java:48)
at weblogic.application.internal.MBeanFactoryImpl.createComponentMBeans(MBeanFactoryImpl.java:110)
at weblogic.application.internal.MBeanFactoryImpl.initializeMBeans(MBeanFactoryImpl.java:76)
at weblogic.management.deploy.internal.MBeanConverter.createApplicationMBean(MBeanConverter.java:91)
Truncated. see log file for complete stacktrace
<Nov 3, 2011 4:43:06 PM IST> <Error> <Deployer> <BEA-149205> <Failed to initialize the application 'OracleAppsAdapter' due to error weblogic.management.DeploymentException: [Deployer:149003]Unable to access application source information in '/softwares/app/Middleware/Oracle_SOA1/soa/connectors/AppsAdapter.rar' for application 'OracleAppsAdapter'. The specific error is: [Deployer:149158]No application files exist at '/softwares/app/Middleware/Oracle_SOA1/soa/connectors/AppsAdapter.rar'...
weblogic.management.DeploymentException: [Deployer:149003]Unable to access application source information in '/softwares/app/Middleware/Oracle_SOA1/soa/connectors/AppsAdapter.rar' for application 'OracleAppsAdapter'. The specific error is: [Deployer:149158]No application files exist at '/softwares/app/Middleware/Oracle_SOA1/soa/connectors/AppsAdapter.rar'..
at weblogic.deploy.internal.targetserver.BasicDeployment.verifyLocalApp(BasicDeployment.java:124)
at weblogic.deploy.internal.targetserver.BasicDeployment.createDeployment(BasicDeployment.java:146)
at weblogic.deploy.internal.targetserver.AppDeployment.prepare(AppDeployment.java:114)
at weblogic.management.deploy.internal.DeploymentAdapter$1.doPrepare(DeploymentAdapter.java:40)
at weblogic.management.deploy.internal.DeploymentAdapter.prepare(DeploymentAdapter.java:191)
Truncated. see log file for complete stacktrace
>
<Nov 3, 2011 4:43:06 PM IST> <Error> <Deployer> <BEA-149205> <Failed to initialize the application 'OracleBamAdapter' due to error weblogic.management.DeploymentException: [Deployer:149003]Unable to access application source information in '/softwares/app/Middleware/Oracle_SOA1/soa/connectors/OracleBamAdapter.rar' for application 'OracleBamAdapter'. The specific error is: [Deployer:149158]No application files exist at '/softwares/app/Middleware/Oracle_SOA1/soa/connectors/OracleBamAdapter.rar'...
weblogic.management.DeploymentException: [Deployer:149003]Unable to access application source information in '/softwares/app/Middleware/Oracle_SOA1/soa/connectors/OracleBamAdapter.rar' for application 'OracleBamAdapter'. The specific error is: [Deployer:149158]No application files exist at '/softwares/app/Middleware/Oracle_SOA1/soa/connectors/OracleBamAdapter.rar'..
at weblogic.deploy.internal.targetserver.BasicDeployment.verifyLocalApp(BasicDeployment.java:124)
at weblogic.deploy.internal.targetserver.BasicDeployment.createDeployment(BasicDeployment.java:146)
at weblogic.deploy.internal.targetserver.AppDeployment.prepare(AppDeployment.java:114)
at weblogic.management.deploy.internal.DeploymentAdapter$1.doPrepare(DeploymentAdapter.java:40)
at weblogic.management.deploy.internal.DeploymentAdapter.prepare(DeploymentAdapter.java:191)
Truncated. see log file for complete stacktrace
>
<Nov 3, 2011 4:43:06 PM IST> <Error> <Deployer> <BEA-149605> <Failed to create App/Comp mbeans for AppDeploymentMBean soa-infra. Error - weblogic.management.DeploymentException: File not found with : /softwares/app/Middleware/Oracle_SOA1/soa/applications/soa-infra-wls.ear.
weblogic.management.DeploymentException: File not found with : /softwares/app/Middleware/Oracle_SOA1/soa/applications/soa-infra-wls.ear
at weblogic.application.internal.EarDeploymentFactory.findOrCreateComponentMBeans(EarDeploymentFactory.java:193)
at weblogic.application.internal.MBeanFactoryImpl.findOrCreateComponentMBeans(MBeanFactoryImpl.java:48)
at weblogic.application.internal.MBeanFactoryImpl.createComponentMBeans(MBeanFactoryImpl.java:110)
at weblogic.application.internal.MBeanFactoryImpl.initializeMBeans(MBeanFactoryImpl.java:76)
at weblogic.management.deploy.internal.MBeanConverter.createApplicationMBean(MBeanConverter.java:91)
Truncated. see log file for complete stacktrace
Caused By: java.io.IOException: File not found with : /softwares/app/Middleware/Oracle_SOA1/soa/applications/soa-infra-wls.ear
at java.util.zip.ZipFile.open(Native Method)
at java.util.zip.ZipFile.<init>(ZipFile.java:117)
at java.util.jar.JarFile.<init>(JarFile.java:133)
at java.util.jar.JarFile.<init>(JarFile.java:97)
at weblogic.utils.jars.JarFileDelegate.<init>(JarFileDelegate.java:32)
Truncated. see log file for complete stacktrace
>
<Nov 3, 2011 4:43:06 PM IST> <Error> <Deployer> <BEA-149205> <Failed to initialize the application 'soa-infra' due to error weblogic.management.DeploymentException: File not found with : /softwares/app/Middleware/Oracle_SOA1/soa/applications/soa-infra-wls.ear.
weblogic.management.DeploymentException: File not found with : /softwares/app/Middleware/Oracle_SOA1/soa/applications/soa-infra-wls.ear
at weblogic.application.internal.EarDeploymentFactory.findOrCreateComponentMBeans(EarDeploymentFactory.java:193)
at weblogic.application.internal.MBeanFactoryImpl.findOrCreateComponentMBeans(MBeanFactoryImpl.java:48)
at weblogic.application.internal.MBeanFactoryImpl.createComponentMBeans(MBeanFactoryImpl.java:110)
at weblogic.application.internal.MBeanFactoryImpl.initializeMBeans(MBeanFactoryImpl.java:76)
at weblogic.management.deploy.internal.MBeanConverter.createApplicationMBean(MBeanConverter.java:91)
Truncated. see log file for complete stacktrace
Caused By: java.io.IOException: File not found with : /softwares/app/Middleware/Oracle_SOA1/soa/applications/soa-infra-wls.ear
at java.util.zip.ZipFile.open(Native Method)
at java.util.zip.ZipFile.<init>(ZipFile.java:117)
at java.util.jar.JarFile.<init>(JarFile.java:133)
at java.util.jar.JarFile.<init>(JarFile.java:97)
at weblogic.utils.jars.JarFileDelegate.<init>(JarFileDelegate.java:32)
Truncated. see log file for complete stacktrace
>
<Nov 3, 2011 4:43:06 PM IST> <Emergency> <Deployer> <BEA-149259> <Server 'soa_server2' in cluster 'soa_cluster' is being brought up in administration state due to failed deployments.>
<Nov 3, 2011 4:43:12 PM IST> <Notice> <Log Management> <BEA-170027> <The Server has established connection with the Domain level Diagnostic Service successfully.>
<Nov 3, 2011 4:43:21 PM IST> <Notice> <Cluster> <BEA-000197> <Listening for announcements from cluster using unicast cluster messaging>
<Nov 3, 2011 4:43:21 PM IST> <Notice> <Cluster> <BEA-000133> <Waiting to synchronize with other running members of soa_cluster.>
<Nov 3, 2011 4:43:51 PM IST> <Notice> <Security> <BEA-090171> <Loading the identity certificate and private key stored under the alias DemoIdentity from the jks keystore file /softwares/app/Middleware/wlserver_10.3/server/lib/DemoIdentity.jks.>
<Nov 3, 2011 4:43:52 PM IST> <Notice> <Security> <BEA-090169> <Loading trusted certificates from the jks keystore file /softwares/app/Middleware/wlserver_10.3/server/lib/DemoTrust.jks.>
<Nov 3, 2011 4:43:52 PM IST> <Notice> <Security> <BEA-090169> <Loading trusted certificates from the jks keystore file /softwares/app/Middleware/jrockit_160_17_R28.0.0-679/jre/lib/security/cacerts.>
<Nov 3, 2011 4:43:52 PM IST> <Notice> <Security> <BEA-090898> <Ignoring the trusted CA certificate "CN=T-TeleSec GlobalRoot Class 3,OU=T-Systems Trust Center,O=T-Systems Enterprise Services GmbH,C=DE". The loading of the trusted certificate list raised a certificate parsing exception PKIX: Unsupported OID in the AlgorithmIdentifier object: 1.2.840.113549.1.1.11.>
<Nov 3, 2011 4:43:52 PM IST> <Notice> <Security> <BEA-090898> <Ignoring the trusted CA certificate "CN=T-TeleSec GlobalRoot Class 2,OU=T-Systems Trust Center,O=T-Systems Enterprise Services GmbH,C=DE". The loading of the trusted certificate list raised a certificate parsing exception PKIX: Unsupported OID in the AlgorithmIdentifier object: 1.2.840.113549.1.1.11.>
<Nov 3, 2011 4:43:52 PM IST> <Notice> <Security> <BEA-090898> <Ignoring the trusted CA certificate "CN=GlobalSign,O=GlobalSign,OU=GlobalSign Root CA - R3". The loading of the trusted certificate list raised a certificate parsing exception PKIX: Unsupported OID in the AlgorithmIdentifier object: 1.2.840.113549.1.1.11.>
<Nov 3, 2011 4:43:52 PM IST> <Notice> <Security> <BEA-090898> <Ignoring the trusted CA certificate "OU=Security Communication RootCA2,O=SECOM Trust Systems CO.\,LTD.,C=JP". The loading of the trusted certificate list raised a certificate parsing exception PKIX: Unsupported OID in the AlgorithmIdentifier object: 1.2.840.113549.1.1.11.>
<Nov 3, 2011 4:43:52 PM IST> <Notice> <Security> <BEA-090898> <Ignoring the trusted CA certificate "CN=KEYNECTIS ROOT CA,OU=ROOT,O=KEYNECTIS,C=FR". The loading of the trusted certificate list raised a certificate parsing exception PKIX: Unsupported OID in the AlgorithmIdentifier object: 1.2.840.113549.1.1.11.>
<Nov 3, 2011 4:43:52 PM IST> <Notice> <Server> <BEA-002613> <Channel "Default" is now listening on 10.136.155.136:8001 for protocols iiop, t3, CLUSTER-BROADCAST, ldap, snmp, http.>
<Nov 3, 2011 4:43:52 PM IST> <Notice> <Server> <BEA-002613> <Channel "DefaultSecure" is now listening on 10.136.155.136:8002 for protocols iiops, t3s, CLUSTER-BROADCAST-SECURE, ldaps, https.>
<Nov 3, 2011 4:43:52 PM IST> <Notice> <WebLogicServer> <BEA-000332> <Started WebLogic Managed Server "soa_server2" for domain "soadomain" running in Development Mode>
<Nov 3, 2011 4:43:54 PM IST> <Notice> <WebLogicServer> <BEA-000365> <Server state changed to ADMIN>
<Nov 3, 2011 4:43:54 PM IST> <Notice> <WebLogicServer> <BEA-000360> <Server started in ADMIN mode>
I have checked the domain config file /softwares/app/Middleware/user_projects/domains/soadomain/config/config.xml of Box 2 where soa_server2 resides and found that <source-path> tags are having the paths pointing to Oracle_SOA1 (soa home of soa_server1) as shown in the sample below instead of soa home Oracle_SOA2 of soa_server2.
<source-path>/softwares/app/Middleware/Oracle_SOA1/soa/connectors/FileAdapter.rar</source-path>
Can I change Oracle_SOA1 to Oracle_SOA2 in all the paths to overcome the below issue or you see any fundamental issue here ... please advise.
Thanks,
CCHello Dear Poster....
Were you able to resolve your issue. I also followed the EDG and I'm in the same situation. I did everything per the instructions. The first cluster for WSM does not have any issues. But both the nodes or managed servers on the two nodes show similar behavior.
The messages are:
Failed to initialize the application 'usermessagingdriver-email' due to error weblogic.management.DeploymentException: [J2EE:160149]Error while processing library references. Unresolved application library references, defined in weblogic-application.xml: [Extension-Name: oracle.sdp.messaging, exact-match: false]..
weblogic.management.DeploymentException: [J2EE:160149]Error while processing library references. Unresolved application library references, defined in weblogic-application.xml: [Extension-Name: oracle.sdp.messaging, exact-match: false].
at weblogic.application.internal.flow.CheckLibraryReferenceFlow.prepare(CheckLibraryReferenceFlow.java:26)
at weblogic.application.internal.BaseDeployment$1.next(BaseDeployment.java:613)
at weblogic.application.utils.StateMachineDriver.nextState(StateMachineDriver.java:52)
at weblogic.application.internal.BaseDeployment.prepare(BaseDeployment.java:184)
at weblogic.application.internal.EarDeployment.prepare(EarDeployment.java:58)
Truncated. see log file for complete stacktrace
>
<Nov 9, 2011 2:08:07 PM PST> <Error> <Deployer> <BEA-149205> <Failed to initialize the application 'DefaultToDoTaskFlow' due to error weblogic.management.DeploymentException: [J2EE:160149]Error while processing library references. Unresolved application library references, defined in weblogic-application.xml: [Extension-Name: adf.oracle.domain, Implementation-Version: 11.1.1.1.0, exact-match: false], [Extension-Name: oracle.soa.workflow.wc, exact-match: false], [Extension-Name: oracle.jsp.next, exact-match: false]..
weblogic.management.DeploymentException: [J2EE:160149]Error while processing library references. Unresolved application library references, defined in weblogic-application.xml: [Extension-Name: adf.oracle.domain, Implementation-Version: 11.1.1.1.0, exact-match: false], [Extension-Name: oracle.soa.workflow.wc, exact-match: false], [Extension-Name: oracle.jsp.next, exact-match: false].
at weblogic.application.internal.flow.CheckLibraryReferenceFlow.prepare(CheckLibraryReferenceFlow.java:26)
at weblogic.application.internal.BaseDeployment$1.next(BaseDeployment.java:613)
at weblogic.application.utils.StateMachineDriver.nextState(StateMachineDriver.java:52)
at weblogic.application.internal.BaseDeployment.prepare(BaseDeployment.java:184)
at weblogic.application.internal.EarDeployment.prepare(EarDeployment.java:58)
Truncated. see log file for complete stacktrace
>
<Nov 9, 2011 2:08:12 PM PST> <Emergency> <Deployer> <BEA-149259> <Server 'dev_soa2' in cluster 'dev_soa_cluster' is being brought up in administration state due to failed deployments.> -
Server Startup issue with Weblogic 10!!!
Hi All,
We are on weblogic 10 and have deployed few portlets along with Vignette Portl 7.4. Whenever, we are doing a restart of managed server, we are getting below error in managed01.out:
Failed to load servlet Class: FileOutputServletIgnoring: unable to load class:java.lang.ClassNotFoundException: FileOutputServlet at: weblogic.xml.schema.binding.util.ClassUtil.loadClass(ClassUtil.java:76)Failed to load servlet Class: FileOutputServletIgnoring: unable to load class:java.lang.ClassNotFoundException: FileOutputServlet at: weblogic.xml.schema.binding.util.ClassUtil.loadClass(ClassUtil.java:76)log4j:ERROR Could not parse address [].
javax.mail.internet.AddressException: Illegal address in string ``''
at javax.mail.internet.InternetAddress.<init>(InternetAddress.java:66)
at org.apache.log4j.net.SMTPAppender.getAddress(Unknown Source)
at org.apache.log4j.net.SMTPAppender.activateOptions(Unknown Source)
at org.apache.log4j.config.PropertySetter.activate(PropertySetter.java:256)
at org.apache.log4j.config.PropertySetter.setProperties(PropertySetter.java:132)
at org.apache.log4j.config.PropertySetter.setProperties(PropertySetter.java:96)
at org.apache.log4j.PropertyConfigurator.parseAppender(PropertyConfigurator.java:654)
at org.apache.log4j.PropertyConfigurator.parseCategory(PropertyConfigurator.java:612)
After this, all applications are starting up without any issue. Please let me know if someone have already faced this issue before or any pointers on this?
Thanks & Regards,
SanjeevHi,
I have deployed 10 or more portlets on same managed server and every portlet have a logging initiator servlet which uses log4j. During managed server startup, above exception only comes ones and after that, all portlets are starting fine. There is no issue at all with other portlet.
I was getting same error if I am not having log4j.jar in manged server JVM startup classpath for every portlet. But, once I added log4j.jar to classpath, it is coming only once and after that, all portlets are starting fine.
Any pointer to look at? I tried to add log4j.properties to startup classpath as well, but with no luck :(
Thanks,
Sanjeev -
Managed Server Startup - Part Duex
Hello:
Is it possible to auto-start managed servers on WLS 10.3.5 under Solaris 10?
I read the thread "managed server startup" and did not want to hijack the thread. In my case, I have an init script that starts up Node Manager and one that starts up the Admin Server.
So, once those two processes are up, is there a way for the defined managed servers to auto-start without any manual intervention on a user's part? Yes, I do have CrashRecoveryEnabled=true but as I understand it, that is for when a managed server goes down. In my case, the Solaris server is booting up.
Thank you,
PerryUnless you have 50 managed servers then I can't understand why you would want that. Just start them all up at the same time from the admin console under 'control' tab of server page. What if you have a server or two that you don't want on for some reason? This would power it up regardless. I would think you would want to control that from node manager lifecycle. There may be a way to do that through scripting but it's probably not a best practice. We'll see if someone else chimes in on the subject. I am curious as well...
-
WebLogic 10.3.2 managed server startup failed : ''31' could not be found'
Dears: I ran my managed server using script but failed , the weblogic version is 10.3.2 (11g R1) , on Solaris 10 sparc 64bit.:
ports=( 7001 7003 7005 7007 )
instances=( instance1 instance2 instance3 )
adminip=192.168.11.174
"startManagedWebLogic.sh ${instances[1]} http://$adminip:${ports[0]}"&
Does anyone get jammed into this situation?
The Managed Server instance2 is going to running
JAVA Memory arguments: -Xms768m -Xmx2048m -XX:NewSize=512m -XX:MaxNewSize=512m -XX:SurvivorRatio=6 -XX:+DisableExplicitGC -XX:MaxPermSize=2048m
WLS Start Mode=Production
CLASSPATH=/wls11g/patch_wls1032/profiles/default/sys_manifest_classpath/weblogic_patch.jar:/wls11g/jdk1.6.0_18/lib/tools.jar:/wls11g/utils/config/10.3/config-launch.jar:/wls11g/wlserver_10.3/server/lib/weblogic_sp.jar:/wls11g/wlserver_10.3/server/lib/weblogic.jar:/wls11g/modules/features/weblogic.server.modules_10.3.2.0.jar:/wls11g/wlserver_10.3/server/lib/webservices.jar:/wls11g/modules/org.apache.ant_1.7.0/lib/ant-all.jar:/wls11g/modules/net.sf.antcontrib_1.0.0.0_1-0b2/lib/ant-contrib.jar:/wls11g/wlserver_10.3/common/eval/pointbase/lib/pbclient57.jar:/wls11g/wlserver_10.3/server/lib/xqrl.jar
PATH=/wls11g/wlserver_10.3/server/bin:/wls11g/modules/org.apache.ant_1.7.0/bin:/wls11g/jdk1.6.0_18/jre/bin:/wls11g/jdk1.6.0_18/bin:/wls11g/user_projects/domains/base_domain:/wls11g/user_projects/domains/base_domain/bin:/wls11g/wlserver_10.3/server/bin:/wls11g/user_projects/domains/base_domain:/wls11g/user_projects/domains/base_domain/bin:/wls11g/wlserver_10.3/server/bin:/usr/bin
* To start WebLogic Server, use a username and *
* password assigned to an admin-level user. For *
* server administration, use the WebLogic Server *
* console at http://hostname:port/console *
starting weblogic with Java version:
-bash-3.00$ java version "1.6.0_18-ea"
Java(TM) SE Runtime Environment (build 1.6.0_18-ea-b05)
Java HotSpot(TM) 64-Bit Server VM (build 16.0-b12, mixed mode)
Starting WLS with line:
/wls11g/jdk1.6.0_18/bin/java -server -d64 -Xms768m -Xmx2048m -XX:NewSize=512m -XX:MaxNewSize=512m -XX:SurvivorRatio=6 -XX:+DisableExplicitGC -XX:MaxPermSize=2048m -Dweblogic.Name=instance2 -Djava.security.policy=/wls11g/wlserver_10.3/server/lib/weblogic.policy -da -Dplatform.home=/wls11g/wlserver_10.3 -Dwls.home=/wls11g/wlserver_10.3/server -Dweblogic.home=/wls11g/wlserver_10.3/server -Dweblogic.management.discover=false -Dweblogic.management.server=http://140.126.24.25:6001 -Dwlw.iterativeDev=false -Dwlw.testConsole=false -Dwlw.logErrorsToConsole=false -Dweblogic.ext.dirs=/wls11g/patch_wls1032/profiles/default/sysext_manifest_classpath weblogic.Server
<Jan 20, 2010 6:02:46 PM CST> <Info> <WebLogicServer> <BEA-000377> <Starting WebLogic Server with Java HotSpot(TM) 64-Bit Server VM Version 16.0-b12 from Sun Microsystems Inc.>
<Jan 20, 2010 6:02:49 PM CST> <Info> <Management> <BEA-141107> <Version: WebLogic Server 10.3.2.0 Tue Oct 20 12:16:15 PDT 2009 1267925 >
<Jan 20, 2010 6:03:00 PM CST> <Emergency> <Management> <BEA-141151> <The admin server could not be reached at http://140.126.24.25:6001.>
<Jan 20, 2010 6:03:00 PM CST> <Info> <Configuration Management> <BEA-150018> <This server is being started in managed server independence mode in the absence of the admin server.>
<Jan 20, 2010 6:03:00 PM CST> <Notice> <WebLogicServer> <BEA-000365> <Server state changed to STARTING>
<Jan 20, 2010 6:03:00 PM CST> <Info> <WorkManager> <BEA-002900> <Initializing self-tuning thread pool>
<Jan 20, 2010 6:03:01 PM CST> <Notice> <LoggingService> <BEA-320400> <The log file /wls11g/user_projects/domains/base_domain/servers/instance2/logs/instance2.log will be rotated. Reopen the log file if tailing has stopped. This can happen on some platforms like Windows.>
<Jan 20, 2010 6:03:01 PM CST> <Notice> <LoggingService> <BEA-320401> <The log file has been rotated to /wls11g/user_projects/domains/base_domain/servers/instance2/logs/instance2.log00026. Log messages will continue to be logged in /wls11g/user_projects/domains/base_domain/servers/instance2/logs/instance2.log.>
<Jan 20, 2010 6:03:01 PM CST> <Notice> <Log Management> <BEA-170019> <The server log file /wls11g/user_projects/domains/base_domain/servers/instance2/logs/instance2.log is opened. All server side log events will be written to this file.>
<Jan 20, 2010 6:03:16 PM CST> <Notice> <Security> <BEA-090082> <Security initializing using security realm myrealm.>
<Jan 20, 2010 6:03:19 PM CST> <Error> <Configuration Management> <BEA-150000> <An error occurred while establishing a connection back to the adminstration server t3://140.126.24.25:6001 during startup. Since bootstrap succeeded check that t3://140.126.24.25:6001 uniquely identifies the administration server.
javax.naming.ServiceUnavailableException [Root exception is java.rmi.NoSuchObjectException: The object identified by: '31' could not be found. Either it was has not been exported or it has been collected by the distributed garbage collector.]
at weblogic.jndi.internal.ExceptionTranslator.toNamingException(ExceptionTranslator.java:70)
at weblogic.jndi.internal.ExceptionTranslator.toNamingException(ExceptionTranslator.java:32)
at weblogic.jndi.WLInitialContextFactoryDelegate.toNamingException(WLInitialContextFactoryDelegate.java:783)
at weblogic.jndi.WLInitialContextFactoryDelegate.getInitialReference(WLInitialContextFactoryDelegate.java:430)
at weblogic.jndi.Environment.getInitialReference(Environment.java:245)
Truncated. see log file for complete stacktrace
Caused By: java.rmi.NoSuchObjectException: The object identified by: '31' could not be found. Either it was has not been exported or it has been collected by the distributed garbage collector.
at weblogic.rmi.internal.OIDManager.getServerReference(OIDManager.java:251)
at weblogic.rmi.extensions.server.ServerHelper.getLocalInitialReference(ServerHelper.java:429)
at weblogic.rmi.extensions.StubFactory.getStub(StubFactory.java:131)
at weblogic.rmi.extensions.StubFactory.getStub(StubFactory.java:124)
at weblogic.jndi.WLInitialContextFactoryDelegate.getInitialReference(WLInitialContextFactoryDelegate.java:426)
Truncated. see log file for complete stacktrace
>
<Jan 20, 2010 6:03:19 PM CST> <Critical> <WebLogicServer> <BEA-000362> <Server failed. Reason:
There are 1 nested errors:
javax.naming.ServiceUnavailableException [Root exception is java.rmi.NoSuchObjectException: The object identified by: '31' could not be found. Either it was has not been exported or it has been collected by the distributed garbage collector.]
at weblogic.jndi.internal.ExceptionTranslator.toNamingException(ExceptionTranslator.java:70)
at weblogic.jndi.internal.ExceptionTranslator.toNamingException(ExceptionTranslator.java:32)
at weblogic.jndi.WLInitialContextFactoryDelegate.toNamingException(WLInitialContextFactoryDelegate.java:783)
at weblogic.jndi.WLInitialContextFactoryDelegate.getInitialReference(WLInitialContextFactoryDelegate.java:430)
at weblogic.jndi.Environment.getInitialReference(Environment.java:245)
at weblogic.server.channels.RemoteChannelServiceImpl.registerInternal(RemoteChannelServiceImpl.java:173)
at weblogic.server.channels.RemoteChannelServiceImpl.registerForever(RemoteChannelServiceImpl.java:146)
at weblogic.protocol.ConnectMonitorFactory.registerForever(ConnectMonitorFactory.java:88)
at weblogic.management.provider.MSIService.registerForReconnectToAdminServer(MSIService.java:174)
at weblogic.management.mbeanservers.compatibility.internal.CompatibilityMBeanServerService.start(CompatibilityMBeanServerService.java:154)
at weblogic.t3.srvr.SubsystemRequest.run(SubsystemRequest.java:64)
at weblogic.work.ExecuteThread.execute(ExecuteThread.java:201)
at weblogic.work.ExecuteThread.run(ExecuteThread.java:173)
Caused by: java.rmi.NoSuchObjectException: The object identified by: '31' could not be found. Either it was has not been exported or it has been collected by the distributed garbage collector.
at weblogic.rmi.internal.OIDManager.getServerReference(OIDManager.java:251)
at weblogic.rmi.extensions.server.ServerHelper.getLocalInitialReference(ServerHelper.java:429)
at weblogic.rmi.extensions.StubFactory.getStub(StubFactory.java:131)
at weblogic.rmi.extensions.StubFactory.getStub(StubFactory.java:124)
at weblogic.jndi.WLInitialContextFactoryDelegate.getInitialReference(WLInitialContextFactoryDelegate.java:426)
... 9 more
>
<Jan 20, 2010 6:03:19 PM CST> <Notice> <WebLogicServer> <BEA-000365> <Server state changed to FAILED>
<Jan 20, 2010 6:03:19 PM CST> <Error> <WebLogicServer> <BEA-000383> <A critical service failed. The server will shut itself down>
<Jan 20, 2010 6:03:19 PM CST> <Notice> <WebLogicServer> <BEA-000365> <Server state changed to FORCE_SHUTTING_DOWN>
-bash-3.00$
Edited by: user7322888 on 2010/2/4 下午 11:41Hi,
Reproducing this issue is very easy.....
1). Just Create a Admin and Managed Server
2). Start AdminServer then from Admin Console Disable the normal listen-port for admin Server (suppose it was 7001 disable it)....AND enable only the SSL port for Admin Server (example 7002).
Managed Server (Listen Port=7003 and SSL ListenPort=7004)
3). Now Try Start Managed Server.
you wil get the Exact same exception
<Jan 20, 2010 6:03:19 PM CST> <Error> <Configuration Management> <BEA-150000> <An error occurred while establishing a connection back to the adminstration server t3://140.126.24.25:6001 during startup. Since bootstrap succeeded check that t3://140.126.24.25:6001 uniquely identifies the administration server.
javax.naming.ServiceUnavailableException [Root exception is java.rmi.NoSuchObjectException: The object identified by: '31' could not be found. Either it was has not been exported or it has been collected by the distributed garbage collector.]
And
<Emergency> <Management> <BEA-141151> <The admin server could not be reached at http://140.126.24.25:6001.>
Now it will be easy for us to find out where is the issue actually.
Thanks
Jay SenSharma
http://jaysensharma.wordpress.com (WebLogic Wonders Are Here)
Edited by: Jay SenSharma on Feb 24, 2010 4:15 PM -
SOA managed server startup problem
Hi All,
I am facing an issue while starting the SOA Managed Server (soa_server1) using NodeManager.
Backgound:
I have setup a soa domain, started up NM and admin server using NM in solaris environemnt. All runs fine but when I start MS using NM for the first time it throws error. If I start the MS from the admin console it starts fine. The execution steps I have performed-
1. Started NodeManager - using script
2. Shutdown the NodeManager , changed the nodemanager.properties file to update parameter [startScriptEnabled=true] and start it again.
3. Started AS using NM [nmConnect(..) and nmStart('AdminServer')]
4. Enrolled the NM with the current machine [connect(..), nmEnroll(domain_dir, nodemanager_home)]
5. Copied the boot.properties to security/ dir of soa_server1
6. Started MS using NM - Throws error
Does it really mean I have to start the MS through admin console everytime I start MS first time in the machine? (I am working on automation on SOA env where everynight env wipes off and installs the SOA stack from scratch)
The soa-server1.out looks like:
<15-Mar-2012 10:26:41 o'clock GMT> <Info> <Security> <BEA-090906> <Changing the default Random Number Generator in RSA CryptoJ from ECDRBG to FIPS186PRNG. To disable this change, specify -Dweblogic.security.allowCryptoJDefaultPRNG=true>
<15-Mar-2012 10:26:41 o'clock GMT> <Info> <WebLogicServer> <BEA-000377> <Starting WebLogic Server with Java HotSpot(TM) 64-Bit Server VM Version 20.1-b02 from Sun Microsystems Inc.>
<15-Mar-2012 10:26:42 o'clock GMT> <Info> <Management> <BEA-141107> <Version: WebLogic Server 10.3.4.0 Fri Dec 17 20:47:33 PST 2010 1384255 >
<15-Mar-2012 10:26:45 o'clock GMT> <Critical> <WebLogicServer> <BEA-000362> <Server failed. Reason:
There are 1 nested errors:
weblogic.management.ManagementException: Booting as admin server, but servername, soa_server1, does not match the admin server name, AdminServer
at weblogic.management.provider.internal.RuntimeAccessService.start(RuntimeAccessService.java:67)
at weblogic.t3.srvr.ServerServicesManager.startService(ServerServicesManager.java:461)
at weblogic.t3.srvr.ServerServicesManager.startInStandbyState(ServerServicesManager.java:166)
at weblogic.t3.srvr.T3Srvr.initializeStandby(T3Srvr.java:879)
at weblogic.t3.srvr.T3Srvr.startup(T3Srvr.java:566)
at weblogic.t3.srvr.T3Srvr.run(T3Srvr.java:467)
at weblogic.Server.main(Server.java:71)
>
<15-Mar-2012 10:26:45 o'clock GMT> <Notice> <WebLogicServer> <BEA-000365> <Server state changed to FAILED>
<15-Mar-2012 10:26:45 o'clock GMT> <Error> <WebLogicServer> <BEA-000383> <A critical service failed. The server will shut itself down>
<15-Mar-2012 10:26:45 o'clock GMT> <Notice> <WebLogicServer> <BEA-000365> <Server state changed to FORCE_SHUTTING_DOWN>
<15-Mar-2012 10:26:45> <FINEST> <NodeManager> <Waiting for the process to die: 20518>
<15-Mar-2012 10:26:45> <INFO> <NodeManager> <Server failed during startup so will not be restarted>
<15-Mar-2012 10:26:45> <FINEST> <NodeManager> <runMonitor returned, setting finished=true and notifying waiters>
Please help with your expertise.
Apologies if I have missed any info or posted in wrong forum, if you need more feel free to shout.
Thanks in advance.
Cheers,
BhaskarHi,
I have implemented the above mentioned suggestions. But seems to have no luck. I had
1. Copied startup.properties to ${DOMAIN_HOME}/servers/soa_server1/data/nodemanager
2. Copied the boot.properties to ${DOMAIN_HOME}/servers/soa_server1/security
These did not added any value, so I though of passing the parameters at nmStart() as WLST object;
arg="Arguments=\" -Dweblogic.management.server=localhost:8001\"" (My AS and MS runs on same machine)
prps=makePropertiesObject(arg)
nmStart('soa_server1',props=prps)
This started throwing Boot Identity file not valid.
I changed my way.
1. Connected to Admin Server using WLST
connect (username, password)
2. Start MS
start('soa_server1')
Its working fine now and under NM control. Not sure what more NM demands when starting without AS.
Regards,
Bhaskar -
Hi,
I have installed a WLS10.3.5 on Linux machine. We created new domain and able to start the admin server. But when created managed server; and tried to start, it throws error like:
<Sep 16, 2011 2:26:02 PM> <INFO> <NodeManager> <Server output log file is '/opt/weblogic/user_projects/domains/cohe_domain/servers/Cohe-Server1/logs/Cohe-Server1.out'>
Exception in thread "main" java.lang.NoSuchMethodError: weblogic.i18n.logging.CatalogMessage.getDiagnosticVolume()Ljava/lang/String;
at weblogic.logging.MessageLogger.log(MessageLogger.java:85)
at weblogic.logging.MessageLogger.log(MessageLogger.java:111)
at weblogic.logging.WLMessageLogger.log(WLMessageLogger.java:52)
at weblogic.security.SecurityLogger.logDisallowingCryptoJDefaultJCEVerification(SecurityLogger.java:13444)
at weblogic.security.utils.SecurityUtils.turnOffCryptoJDefaultJCEVerification(SecurityUtils.java:78)
at weblogic.Server.main(Server.java:67)
<Sep 16, 2011 2:26:04 PM> <FINEST> <NodeManager> <Waiting for the process to die: 7021>
<Sep 16, 2011 2:26:04 PM> <INFO> <NodeManager> <Server failed during startup so will not be restarted>
<Sep 16, 2011 2:26:04 PM> <FINEST> <NodeManager> <runMonitor returned, setting finished=true and notifying waiters>
Can someone please suggest, what could be the issue?
RegardsMake sure you run /opt/weblogic/user_projects/domains/cohe_domain/bin/setDomainEnv.sh ... then run /opt/weblogic/user_projects/domains/cohe_domain/bin/startWebLogic.sh
-
Managed Server Startup Sloooow
I have a 10.3.2 WLP environment with some regular managed servers and 1 portal server. All regular managed servers start within a reasonable amount of time (2-3 minutes on average). However, my portal managed server has been taking 1-2 hours to start. No errors in the logs but it eventually starts. In my other environments this same configured portal server starts in 2-3 minutes as expected. In the problem environment there are plenty of resources and memory and system monitoring are showing low usage so it appears to be a WL issue and not a system problem. Any ideas on what may be causing this or ways to narrow it down effectively?
ThanksNo, we are a Windows shop and use nodemanager and services and use the console to start our managed servers. But I went ahead and used the script to start the server and was able to do a thread dump. Info below...anyone have a decoder ring and can tell me what the problem is?
Full thread dump Java HotSpot(TM) 64-Bit Server VM (14.0-b16 mixed mode):
"Thread-14" daemon prio=6 tid=0x0000000036230800 nid=0x93c waiting on condition [0x000000003c21f000]
java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x00000000125167c8> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:158)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1925)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:358)
at weblogic.utils.concurrent.JDK15ConcurrentBlockingQueue.take(JDK15ConcurrentBlockingQueue.java:89)
at weblogic.store.internal.PersistentStoreImpl.getOutstandingWork(PersistentStoreImpl.java:567)
at weblogic.store.internal.PersistentStoreImpl.run(PersistentStoreImpl.java:615)
at weblogic.store.internal.PersistentStoreImpl$2.run(PersistentStoreImpl.java:383)
"[STANDBY] ExecuteThread: '3' for queue: 'weblogic.kernel.Default (self-tuning)'" daemon prio=6 tid=0x000000003622f800 nid=0xc18 in Object.wait() [0x000000003bf1f000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x00000000124d3d18> (a weblogic.work.ExecuteThread)
at java.lang.Object.wait(Object.java:485)
at weblogic.work.ExecuteThread.waitForRequest(ExecuteThread.java:157)
- locked <0x00000000124d3d18> (a weblogic.work.ExecuteThread)
at weblogic.work.ExecuteThread.run(ExecuteThread.java:178)
"[STANDBY] ExecuteThread: '2' for queue: 'weblogic.kernel.Default (self-tuning)'" daemon prio=6 tid=0x000000003622b800 nid=0xa3c in Object.wait() [0x000000003a94f000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x00000000123fc4e8> (a weblogic.work.ExecuteThread)
at java.lang.Object.wait(Object.java:485)
at weblogic.work.ExecuteThread.waitForRequest(ExecuteThread.java:157)
- locked <0x00000000123fc4e8> (a weblogic.work.ExecuteThread)
at weblogic.work.ExecuteThread.run(ExecuteThread.java:178)
"Timer-3" daemon prio=6 tid=0x000000003622f000 nid=0x13cc in Object.wait() [0x000000003be1f000]
java.lang.Thread.State: TIMED_WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x0000000011debbd0> (a java.util.TaskQueue)
at java.util.TimerThread.mainLoop(Timer.java:509)
- locked <0x0000000011debbd0> (a java.util.TaskQueue)
at java.util.TimerThread.run(Timer.java:462)
"Timer-2" daemon prio=6 tid=0x000000003622e000 nid=0x1374 in Object.wait() [0x000000003bd1f000]
java.lang.Thread.State: TIMED_WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x0000000011de9f28> (a java.util.TaskQueue)
at java.util.TimerThread.mainLoop(Timer.java:509)
- locked <0x0000000011de9f28> (a java.util.TaskQueue)
at java.util.TimerThread.run(Timer.java:462)
"LDAPConnThread-1 ldaps://10.10.110.116:636" daemon prio=6 tid=0x000000003622d800 nid=0x1058 runnable [0x000000003bc1f000]
java.lang.Thread.State: RUNNABLE
at java.net.SocketInputStream.socketRead0(Native Method)
at java.net.SocketInputStream.read(SocketInputStream.java:129)
at weblogic.utils.io.ChunkedInputStream.read(ChunkedInputStream.java:159)
at java.io.InputStream.read(InputStream.java:85)
at com.certicom.tls.record.ReadHandler.readFragment(Unknown Source)
at com.certicom.tls.record.ReadHandler.readRecord(Unknown Source)
at com.certicom.tls.record.ReadHandler.read(Unknown Source)
- locked <0x0000000011b342e0> (a com.certicom.tls.record.ReadHandler)
at com.certicom.io.InputSSLIOStreamWrapper.read(Unknown Source)
at java.io.BufferedInputStream.fill(BufferedInputStream.java:218)
at java.io.BufferedInputStream.read(BufferedInputStream.java:237)
- locked <0x0000000011b4ca28> (a java.io.BufferedInputStream)
at netscape.ldap.ber.stream.BERElement.getElement(BERElement.java:101)
at netscape.ldap.LDAPConnThread.run(LDAPConnThread.java:538)
at java.lang.Thread.run(Thread.java:619)
"LDAPConnThread-0 ldaps://SITADSERVER1.fcdev.com:636" daemon prio=6 tid=0x000000003622d000 nid=0x658 runnable [0x000000003bb1f000]
java.lang.Thread.State: RUNNABLE
at java.net.SocketInputStream.socketRead0(Native Method)
at java.net.SocketInputStream.read(SocketInputStream.java:129)
at weblogic.utils.io.ChunkedInputStream.read(ChunkedInputStream.java:159)
at java.io.InputStream.read(InputStream.java:85)
at com.certicom.tls.record.ReadHandler.readFragment(Unknown Source)
at com.certicom.tls.record.ReadHandler.readRecord(Unknown Source)
at com.certicom.tls.record.ReadHandler.read(Unknown Source)
- locked <0x0000000011b02f20> (a com.certicom.tls.record.ReadHandler)
at com.certicom.io.InputSSLIOStreamWrapper.read(Unknown Source)
at java.io.BufferedInputStream.fill(BufferedInputStream.java:218)
at java.io.BufferedInputStream.read(BufferedInputStream.java:237)
- locked <0x0000000011b14d20> (a java.io.BufferedInputStream)
at netscape.ldap.ber.stream.BERElement.getElement(BERElement.java:101)
at netscape.ldap.LDAPConnThread.run(LDAPConnThread.java:538)
at java.lang.Thread.run(Thread.java:619)
"DoSManager" daemon prio=6 tid=0x000000003622c000 nid=0xd7c waiting on condition [0x000000003aa4f000]
java.lang.Thread.State: TIMED_WAITING (sleeping)
at java.lang.Thread.sleep(Native Method)
at com.octetstring.vde.DoSManager.run(DoSManager.java:433)
"VDE Transaction Processor Thread" daemon prio=2 tid=0x00000000389b9800 nid=0x1334 in Object.wait() [0x000000003a84f000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x0000000011691978> (a com.octetstring.vde.backend.standard.TransactionProcessor)
at java.lang.Object.wait(Object.java:485)
at com.octetstring.vde.backend.standard.TransactionProcessor.waitChange(TransactionProcessor.java:367)
- locked <0x0000000011691978> (a com.octetstring.vde.backend.standard.TransactionProcessor)
at com.octetstring.vde.backend.standard.TransactionProcessor.run(TransactionProcessor.java:212)
"ExecuteThread: '1' for queue: 'weblogic.socket.Muxer'" daemon prio=6 tid=0x000000003794f000 nid=0x12d8 runnable [0x000000003a74f000]
java.lang.Thread.State: RUNNABLE
at weblogic.socket.NTSocketMuxer.getIoCompletionResult(Native Method)
at weblogic.socket.NTSocketMuxer.processSockets(NTSocketMuxer.java:81)
at weblogic.socket.SocketReaderRequest.run(SocketReaderRequest.java:29)
at weblogic.socket.SocketReaderRequest.execute(SocketReaderRequest.java:42)
at weblogic.kernel.ExecuteThread.execute(ExecuteThread.java:145)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:117)
"ExecuteThread: '0' for queue: 'weblogic.socket.Muxer'" daemon prio=6 tid=0x00000000374e6800 nid=0x1270 runnable [0x000000003a64f000]
java.lang.Thread.State: RUNNABLE
at weblogic.socket.NTSocketMuxer.getIoCompletionResult(Native Method)
at weblogic.socket.NTSocketMuxer.processSockets(NTSocketMuxer.java:81)
at weblogic.socket.SocketReaderRequest.run(SocketReaderRequest.java:29)
at weblogic.socket.SocketReaderRequest.execute(SocketReaderRequest.java:42)
at weblogic.kernel.ExecuteThread.execute(ExecuteThread.java:145)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:117)
"Thread-7" daemon prio=6 tid=0x0000000036b0d800 nid=0x1328 waiting on condition [0x000000003a54f000]
java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x000000001149e6f0> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:158)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1925)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:358)
at weblogic.utils.concurrent.JDK15ConcurrentBlockingQueue.take(JDK15ConcurrentBlockingQueue.java:89)
at weblogic.store.internal.PersistentStoreImpl.getOutstandingWork(PersistentStoreImpl.java:567)
at weblogic.store.internal.PersistentStoreImpl.run(PersistentStoreImpl.java:615)
at weblogic.store.internal.PersistentStoreImpl$2.run(PersistentStoreImpl.java:383)
"[ACTIVE] ExecuteThread: '1' for queue: 'weblogic.kernel.Default (self-tuning)'" daemon prio=6 tid=0x00000000374e5800 nid=0x1234 in Object.wait() [0x0000000039c9f000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x00000000113b5098> (a weblogic.work.ExecuteThread)
at java.lang.Object.wait(Object.java:485)
at weblogic.work.ExecuteThread.waitForRequest(ExecuteThread.java:157)
- locked <0x00000000113b5098> (a weblogic.work.ExecuteThread)
at weblogic.work.ExecuteThread.run(ExecuteThread.java:178)
"weblogic.timers.TimerThread" daemon prio=10 tid=0x0000000038a7a000 nid=0x748 in Object.wait() [0x0000000039b9f000]
java.lang.Thread.State: TIMED_WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x00000000113b2b78> (a weblogic.timers.internal.TimerThread)
at weblogic.timers.internal.TimerThread$Thread.run(TimerThread.java:267)
- locked <0x00000000113b2b78> (a weblogic.timers.internal.TimerThread)
"weblogic.time.TimeEventGenerator" daemon prio=10 tid=0x000000003799c000 nid=0x51c in Object.wait() [0x0000000039a9f000]
java.lang.Thread.State: TIMED_WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x00000000113af9a0> (a weblogic.time.common.internal.TimeTable)
at weblogic.time.common.internal.TimeTable.snooze(TimeTable.java:286)
- locked <0x00000000113af9a0> (a weblogic.time.common.internal.TimeTable)
at weblogic.time.common.internal.TimeEventGenerator.run(TimeEventGenerator.java:117)
at java.lang.Thread.run(Thread.java:619)
"[ACTIVE] ExecuteThread: '0' for queue: 'weblogic.kernel.Default (self-tuning)'" daemon prio=6 tid=0x0000000038a79800 nid=0x58c waiting on condition [0x000000003999c000]
java.lang.Thread.State: TIMED_WAITING (sleeping)
at java.lang.Thread.sleep(Native Method)
at weblogic.rjvm.t3.MuxableSocketT3.newSocketWithRetry(MuxableSocketT3.java:213)
at weblogic.rjvm.t3.MuxableSocketT3.connect(MuxableSocketT3.java:375)
at weblogic.rjvm.t3.ConnectionFactoryT3.createConnection(ConnectionFactoryT3.java:33)
at weblogic.rjvm.ConnectionManager.createConnection(ConnectionManager.java:1773)
at weblogic.rjvm.ConnectionManager.findOrCreateConnection(ConnectionManager.java:1416)
- locked <0x0000000007953090> (a weblogic.rjvm.ConnectionManagerServer)
- locked <0x0000000007953090> (a weblogic.rjvm.ConnectionManagerServer)
at weblogic.rjvm.ConnectionManager.bootstrap(ConnectionManager.java:437)
at weblogic.rjvm.ConnectionManager.bootstrap(ConnectionManager.java:315)
at weblogic.rjvm.RJVMManager.findOrCreateRemoteInternal(RJVMManager.java:251)
- locked <0x00000000114b32d0> (a java.lang.Object)
at weblogic.rjvm.RJVMManager.findOrCreate(RJVMManager.java:194)
at weblogic.rjvm.RJVMFinder.findOrCreateRemoteServer(RJVMFinder.java:238)
at weblogic.rjvm.RJVMFinder.findOrCreateRemoteCluster(RJVMFinder.java:316)
at weblogic.rjvm.RJVMFinder.findOrCreateInternal(RJVMFinder.java:205)
at weblogic.rjvm.RJVMFinder.findOrCreate(RJVMFinder.java:170)
- locked <0x000000000794b3e0> (a weblogic.rjvm.RJVMFinder)
at weblogic.rjvm.ServerURL.findOrCreateRJVM(ServerURL.java:153)
at weblogic.jndi.WLInitialContextFactoryDelegate.getInitialContext(WLInitialContextFactoryDelegate.java:352)
at weblogic.jndi.Environment.getContext(Environment.java:315)
at weblogic.jndi.Environment.getContext(Environment.java:285)
at weblogic.jndi.WLInitialContextFactory.getInitialContext(WLInitialContextFactory.java:117)
at javax.naming.spi.NamingManager.getInitialContext(NamingManager.java:667)
at javax.naming.InitialContext.getDefaultInitCtx(InitialContext.java:288)
at javax.naming.InitialContext.init(InitialContext.java:223)
at javax.naming.InitialContext.<init>(InitialContext.java:197)
at com.bea.common.security.jms.JMSRemoteCommitProvider.newContext(JMSRemoteCommitProvider.java:126)
at com.bea.common.security.jms.JMSRemoteCommitProvider.connect(JMSRemoteCommitProvider.java:171)
at com.bea.common.security.jms.RobustJMSRemoteCommitProvider.connect(RobustJMSRemoteCommitProvider.java:167)
- locked <0x000000001190dd18> (a java.lang.Integer)
at weblogic.security.jms.WebLogicJMSRemoteCommitProvider.broadcast(WebLogicJMSRemoteCommitProvider.java:46)
at org.apache.openjpa.event.RemoteCommitEventManager.afterCommit(RemoteCommitEventManager.java:156)
at org.apache.openjpa.event.TransactionEventManager.fireEvent(TransactionEventManager.java:107)
at org.apache.openjpa.lib.util.concurrent.AbstractConcurrentEventManager.fireEvent(AbstractConcurrentEventManager.java:115)
at org.apache.openjpa.kernel.BrokerImpl.fireTransactionEvent(BrokerImpl.java:764)
at org.apache.openjpa.kernel.BrokerImpl.endTransaction(BrokerImpl.java:2207)
at org.apache.openjpa.kernel.BrokerImpl.afterCompletion(BrokerImpl.java:1853)
at org.apache.openjpa.kernel.LocalManagedRuntime.commit(LocalManagedRuntime.java:94)
- locked <0x00000000079202c0> (a org.apache.openjpa.kernel.LocalManagedRuntime)
at org.apache.openjpa.kernel.BrokerImpl.commit(BrokerImpl.java:1357)
at kodo.kernel.KodoBroker.commit(KodoBroker.java:103)
at org.apache.openjpa.kernel.DelegatingBroker.commit(DelegatingBroker.java:877)
at kodo.jdo.PersistenceManagerImpl.commit(PersistenceManagerImpl.java:409)
at com.bea.security.providers.xacml.store.BasePolicyStore.setPolicy(BasePolicyStore.java:659)
at com.bea.security.providers.xacml.store.BasePolicyStore.setPolicy(BasePolicyStore.java:612)
at com.bea.security.providers.xacml.entitlement.PolicyManager.setPolicy(PolicyManager.java:222)
at com.bea.security.providers.xacml.entitlement.PolicyManager.setPolicy(PolicyManager.java:165)
at weblogic.security.providers.xacml.DeployableAuthorizationProviderV2Helper.deployPolicy(DeployableAuthorizationProviderV2Helper.java:108)
at weblogic.security.providers.xacml.DeployableAuthorizationProviderV2Helper.deployPolicy(DeployableAuthorizationProviderV2Helper.java:166)
at weblogic.security.providers.xacml.authorization.XACMLAuthorizationProviderImpl.deployPolicy(XACMLAuthorizationProviderImpl.java:281)
at com.bea.common.security.internal.legacy.service.PolicyDeployerProviderImpl$V2Adapter$DeploymentHandlerImpl.deployPolicy(PolicyDeployerProviderImpl.java:84)
at com.bea.common.security.internal.service.PolicyDeploymentServiceImpl$DeploymentHandlerImpl.deployPolicy(PolicyDeploymentServiceImpl.java:166)
at weblogic.security.service.WLSPolicyDeploymentServiceWrapper$DeploymentHandlerImpl.deployPolicy(WLSPolicyDeploymentServiceWrapper.java:85)
at weblogic.security.service.AuthorizationManager$HandlerAdaptor.deployPolicy(AuthorizationManager.java:707)
at weblogic.security.service.AuthorizationManager.deployPolicy(AuthorizationManager.java:511)
at weblogic.ejb.container.internal.SecurityHelperWLS.deployPolicy(SecurityHelperWLS.java:478)
at weblogic.ejb.container.internal.SecurityHelperWLS.deployPolicy(SecurityHelperWLS.java:430)
at weblogic.ejb.container.internal.SecurityHelperWLS.deployPolicies(SecurityHelperWLS.java:290)
at weblogic.ejb.container.internal.SecurityHelper.deployPolicies(SecurityHelper.java:290)
at weblogic.ejb.container.internal.SecurityHelper.deployAllPolicies(SecurityHelper.java:273)
at weblogic.ejb.container.internal.SecurityHelper.deployAllPolicies(SecurityHelper.java:231)
at weblogic.ejb.container.internal.RuntimeHelper.deployAllPolicies(RuntimeHelper.java:249)
at weblogic.ejb.container.deployer.EJBDeployer.deployAllPolicies(EJBDeployer.java:857)
at weblogic.ejb.container.deployer.EJBDeployer.setupBeanInfos(EJBDeployer.java:1021)
at weblogic.ejb.container.deployer.EJBDeployer.prepare(EJBDeployer.java:1275)
at weblogic.ejb.container.deployer.EJBModule.prepare(EJBModule.java:427)
at weblogic.application.internal.flow.ModuleListenerInvoker.prepare(ModuleListenerInvoker.java:199)
at weblogic.application.internal.flow.DeploymentCallbackFlow$1.next(DeploymentCallbackFlow.java:391)
at weblogic.application.utils.StateMachineDriver.nextState(StateMachineDriver.java:83)
at weblogic.application.internal.flow.DeploymentCallbackFlow.prepare(DeploymentCallbackFlow.java:59)
at weblogic.application.internal.flow.DeploymentCallbackFlow.prepare(DeploymentCallbackFlow.java:43)
at weblogic.application.internal.BaseDeployment$1.next(BaseDeployment.java:1221)
at weblogic.application.utils.StateMachineDriver.nextState(StateMachineDriver.java:83)
at weblogic.application.internal.BaseDeployment.prepare(BaseDeployment.java:367)
at weblogic.application.internal.EarDeployment.prepare(EarDeployment.java:54)
at weblogic.application.internal.DeploymentStateChecker.prepare(DeploymentStateChecker.java:154)
at weblogic.deploy.internal.targetserver.AppContainerInvoker.prepare(AppContainerInvoker.java:60)
at weblogic.deploy.internal.targetserver.AppDeployment.prepare(AppDeployment.java:141)
at weblogic.management.deploy.internal.DeploymentAdapter$1.doPrepare(DeploymentAdapter.java:39)
at weblogic.management.deploy.internal.DeploymentAdapter.prepare(DeploymentAdapter.java:187)
at weblogic.management.deploy.internal.AppTransition$1.transitionApp(AppTransition.java:21)
at weblogic.management.deploy.internal.ConfiguredDeployments.transitionApps(ConfiguredDeployments.java:233)
at weblogic.management.deploy.internal.ConfiguredDeployments.prepare(ConfiguredDeployments.java:165)
at weblogic.management.deploy.internal.ConfiguredDeployments.deploy(ConfiguredDeployments.java:122)
at weblogic.management.deploy.internal.DeploymentServerService.resume(DeploymentServerService.java:173)
at weblogic.management.deploy.internal.DeploymentServerService.start(DeploymentServerService.java:89)
at weblogic.t3.srvr.SubsystemRequest.run(SubsystemRequest.java:64)
at weblogic.work.ExecuteThread.execute(ExecuteThread.java:201)
at weblogic.work.ExecuteThread.run(ExecuteThread.java:173)
"Timer-1" daemon prio=6 tid=0x000000003799d000 nid=0x12ac in Object.wait() [0x000000003989f000]
java.lang.Thread.State: TIMED_WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x0000000011393be0> (a java.util.TaskQueue)
at java.util.TimerThread.mainLoop(Timer.java:509)
- locked <0x0000000011393be0> (a java.util.TaskQueue)
at java.util.TimerThread.run(Timer.java:462)
"Timer-0" daemon prio=6 tid=0x000000003798c000 nid=0x121c in Object.wait() [0x000000003872f000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x000000001092b3a8> (a java.util.TaskQueue)
at java.lang.Object.wait(Object.java:485)
at java.util.TimerThread.mainLoop(Timer.java:483)
- locked <0x000000001092b3a8> (a java.util.TaskQueue)
at java.util.TimerThread.run(Timer.java:462)
"Low Memory Detector" daemon prio=6 tid=0x00000000014ed000 nid=0xe98 runnable [0x0000000000000000]
java.lang.Thread.State: RUNNABLE
"CompilerThread1" daemon prio=10 tid=0x00000000014ec000 nid=0x13f0 waiting on condition [0x0000000000000000]
java.lang.Thread.State: RUNNABLE
"CompilerThread0" daemon prio=10 tid=0x00000000014e5000 nid=0xbe4 waiting on condition [0x0000000000000000]
java.lang.Thread.State: RUNNABLE
"Attach Listener" daemon prio=10 tid=0x00000000014e4800 nid=0x404 runnable [0x0000000000000000]
java.lang.Thread.State: RUNNABLE
"Signal Dispatcher" daemon prio=10 tid=0x00000000014e1800 nid=0x540 waiting on condition [0x0000000000000000]
java.lang.Thread.State: RUNNABLE
"Finalizer" daemon prio=8 tid=0x00000000014cf800 nid=0xbd8 in Object.wait() [0x000000003619f000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x000000001092b7b8> (a java.lang.ref.ReferenceQueue$Lock)
at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:118)
- locked <0x000000001092b7b8> (a java.lang.ref.ReferenceQueue$Lock)
at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:134)
at java.lang.ref.Finalizer$FinalizerThread.run(Finalizer.java:159)
"Reference Handler" daemon prio=10 tid=0x00000000014c4800 nid=0x1208 in Object.wait() [0x000000003609f000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x000000001092b898> (a java.lang.ref.Reference$Lock)
at java.lang.Object.wait(Object.java:485)
at java.lang.ref.Reference$ReferenceHandler.run(Reference.java:116)
- locked <0x000000001092b898> (a java.lang.ref.Reference$Lock)
"main" prio=6 tid=0x000000000016f800 nid=0x13e8 in Object.wait() [0x0000000002b8f000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0x0000000010947eb8> (a weblogic.t3.srvr.SubsystemRequest)
at weblogic.t3.srvr.SubsystemRequest.rendezvouz(SubsystemRequest.java:100)
- locked <0x0000000010947eb8> (a weblogic.t3.srvr.SubsystemRequest)
at weblogic.t3.srvr.SubsystemRequest.action(SubsystemRequest.java:81)
at weblogic.t3.srvr.SubsystemRequest.start(SubsystemRequest.java:51)
at weblogic.t3.srvr.ServerServicesManager.startService(ServerServicesManager.java:459)
at weblogic.t3.srvr.ServerServicesManager.startInAdminState(ServerServicesManager.java:239)
- locked <0x00000000261cedb0> (a java.lang.Class for weblogic.t3.srvr.ServerServicesManager)
at weblogic.t3.srvr.T3Srvr.initializeAdmin(T3Srvr.java:776)
at weblogic.t3.srvr.T3Srvr.startup(T3Srvr.java:505)
at weblogic.t3.srvr.T3Srvr.run(T3Srvr.java:446)
at weblogic.Server.main(Server.java:67)
"VM Thread" prio=10 tid=0x00000000014bd800 nid=0x128c runnable
"VM Periodic Task Thread" prio=10 tid=0x00000000014f1800 nid=0x13a0 waiting on condition
JNI global references: 1278
Heap
def new generation total 78720K, used 37995K [0x0000000005bd0000, 0x000000000b130000, 0x0000000010670000)
eden space 70016K, 43% used [0x0000000005bd0000, 0x00000000079e0eb0, 0x000000000a030000)
from space 8704K, 82% used [0x000000000a030000, 0x000000000a739eb0, 0x000000000a8b0000)
to space 8704K, 0% used [0x000000000a8b0000, 0x000000000a8b0000, 0x000000000b130000)
tenured generation total 174784K, used 62627K [0x0000000010670000, 0x000000001b120000, 0x0000000025bd0000)
the space 174784K, 35% used [0x0000000010670000, 0x0000000014398cf0, 0x0000000014398e00, 0x000000001b120000)
compacting perm gen total 114368K, used 114334K [0x0000000025bd0000, 0x000000002cb80000, 0x0000000035bd0000)
the space 114368K, 99% used [0x0000000025bd0000, 0x000000002cb779f0, 0x000000002cb77a00, 0x000000002cb80000)
No shared spaces configured. -
Disaster Recovery - Managed Server Startup
We are testing some disaster recovery and want to be able to start our managed servers on our B node in MSI mode while the A node with admin server is down. It tests fine and works with nodemanager running. However, we want to assume that there has been a jvm problem on one or more managed servers and they have ceased to run on the B node. When I run the startManagedWebLogic.cmd and plug in my managed server name and admin link (which is obviously unreachable), I get the message below. I copied down the managed servers info (there is no 'config' folder as mentioned in the Oracle instructions so I copied down the 6 server folder into \common\bin\config\acr2 folder). Any tips on getting this to work?
<Apr 9, 2010 11:11:09 AM CDT> <Info> <Management> <BEA-141107> <Version: WebLogi
c Server Temporary Patch for 9216172 Tue Jan 12 02:07:27 PST 2010
WebLogic Server 10.3.2.0 Tue Oct 20 12:16:15 PDT 2009 1267925 >
<Apr 9, 2010 11:11:09 AM CDT> <Critical> <WebLogicServer> <BEA-000362> <Server f
ailed. Reason:
There are 1 nested errors:
weblogic.management.ManagementException: [Management:141247]The configuration di
rectory C:\Oracle\Middleware\wlserver_10.3\common\bin\config does not exist and
the admin server is not available.
at weblogic.management.provider.internal.RuntimeAccessImpl.parseNewStyle
Config(RuntimeAccessImpl.java:200)
at weblogic.management.provider.internal.RuntimeAccessImpl.<init>(Runtim
eAccessImpl.java:115)
at weblogic.management.provider.internal.RuntimeAccessService.start(Runt
imeAccessService.java:41)
at weblogic.t3.srvr.ServerServicesManager.startService(ServerServicesMan
ager.java:461)
at weblogic.t3.srvr.ServerServicesManager.startInStandbyState(ServerServ
icesManager.java:166)
at weblogic.t3.srvr.T3Srvr.initializeStandby(T3Srvr.java:749)
at weblogic.t3.srvr.T3Srvr.startup(T3Srvr.java:488)
at weblogic.t3.srvr.T3Srvr.run(T3Srvr.java:446)
at weblogic.Server.main(Server.java:67)
>
<Apr 9, 2010 11:11:09 AM CDT> <Notice> <WebLogicServer> <BEA-000365> <Server sta
te changed to FAILED>
<Apr 9, 2010 11:11:09 AM CDT> <Error> <WebLogicServer> <BEA-000383> <A critical
service failed. The server will shut itself down>
<Apr 9, 2010 11:11:09 AM CDT> <Notice> <WebLogicServer> <BEA-000365> <Server sta
te changed to FORCE_SHUTTING_DOWN>So no one has ever had to restart a managed server on a clustered environment when the admin was down? Seems like this would be a common disaster recovery item that would be needed. If anyone has this working please provide details. These details found in Oracle documentation are a bit incomplete...
Starting a Managed Server in MSI Mode
To start up a Managed Server in MSI mode:
1.Ensure that the Managed Server’s root directory contains the config subdirectory.
If the config directory does not exist, copy it from the Administration Server’s root directory or from a backup to the Managed Server’s root directory.
Note: Alternatively, you can use the -Dweblogic.RootDirectory=path startup option to specify a root directory that already contains these files.
2.Start the Managed Server at the command line or using a script.
The Managed Server will run in MSI mode until it is contacted by its Administration Server. For information about restarting the Administration Server in this scenario, see Restarting a Failed Administration Server.
I have used the root.directory switch to point to these locations as well but still get message.....<Apr 13, 2010 11:28:05 AM CDT> <Critical> <WebLogicServer> <BEA-000386> <Server
subsystem failed. Reason: weblogic.descriptor.ResourceUnavailableException: Miss
ing SerializedSystemIni.dat
weblogic.descriptor.ResourceUnavailableException: Missing SerializedSystemIni.da
t
at weblogic.descriptor.DescriptorManager$SecurityServiceImpl$SecurityPro
xy.<init>(DescriptorManager.java:153)
at weblogic.descriptor.DescriptorManager$SecurityServiceImpl$SecurityPro
xy.instance(DescriptorManager.java:137)
at weblogic.descriptor.DescriptorManager$SecurityServiceImpl.decrypt(Des
criptorManager.java:114)
at weblogic.descriptor.internal.AbstractDescriptorBean._decrypt(Abstract
DescriptorBean.java:991)
at weblogic.management.configuration.SecurityConfigurationMBeanImpl.getC
redential(SecurityConfigurationMBeanImpl.java:709)
Truncated. see log file for complete stacktrace
>
<Apr 13, 2010 11:28:05 AM CDT> <Notice> <WebLogicServer> <BEA-000365> <Server st
ate changed to FAILED> -
Changing Managed Server Startup
hi experts,
I am trying to change the JAVA HOME for my managed server via the Server --> Configuration --> Server Start tab on the weblogic console of the managed server. I am starting this Managed Server via NodeManager and I don't want the managed server to start with the Java Version specified on the Node Manager.
As per the note on this page it is stated as follows
+"Node Manager is a WebLogic Server utility that you can use to start, suspend, shut down, and restart servers in normal or unexpected conditions. *Use this page to configure the startup settings that Node Manager will use to start this server on a remote machine*"+
I have changed the JAVA_HOME, Java Vendor, Bea Home, and Root directory to the new JRocket version, but still when I restart the server via Nodemanager, the Managed Server is started with the Java Home set on the Nodemanager.
Can anybody let me know what is the correct way to start the Manager Server with a JVM that is different from the JVM set on the Nodemanager?
Cheers,hi,
If your using Linux,then try setting JAVA_HOME parameter in .profile and try excuting the .profile
If windows then trying setting environment parameters
then go to weblogic
open a command prompt....run "setWLSEnv.sh/cmd"
Can your please attach startup.properties file on your next post
Location
$ORACLE_HOME/user_projects/domains/base_domain/servers/<managed_server>/data/nodemanager
as well as
nodemanager.properties
This link will provide you more light
http://middlewaremagic.com/weblogic/?p=780
Regards
Fabian -
OIM11g managed server startup takes too long
I am running a OIM11g managed server using weblogic on windows xp; in development mode
My managed server takes too long to startup; averaging atleast an hour at the minimum.
I am attaching the logs from the server between the time frame when it took the longest time.
Can someone please help me to improve the startup.
Edited by: 838243 on Feb 20, 2011 10:22 AM<9:32:14 PM> <Info> <EJB><oim1> <[ACTIVE] ExecuteThread: '0' for queue: 'weblogic.kernel.Default (self-tuning)'> <WLS Kernel> <BEA-010008> <EJB Deploying file: iam-ejb.jar>
<9:45:06 PM> <Info> <JDBC><oim1> <[ACTIVE] ExecuteThread: '23' for queue: 'weblogic.kernel.Default (self-tuning)'> <WLS Kernel> <BEA-001128> <Connection for pool "mds-oim" closed.>
<9:45:07 PM> <Info> <Common><oim1> <MDSPollingThread-[oim, jdbc/mds/MDS_REPOS]> <anonymous> <BEA-000628> <Created "1" resources for pool "mds-oim", out of which "1" are available and "0" are unavailable.>
<10:00:06 PM> <Info> <JDBC><oim1> <[ACTIVE] ExecuteThread: '14' for queue: 'weblogic.kernel.Default (self-tuning)'> <WLS Kernel> <BEA-001128> <Connection for pool "mds-oim" closed.>
<10:00:07 PM> <Info> <Common><oim1> <MDSPollingThread-[oim, jdbc/mds/MDS_REPOS]> <anonymous> <BEA-000628> <Created "1" resources for pool "mds-oim", out of which "1" are available and "0" are unavailable.>
<10:15:11 PM> <Info> <JDBC><oim1> <[ACTIVE] ExecuteThread: '14' for queue: 'weblogic.kernel.Default (self-tuning)'> <WLS Kernel> <BEA-001128> <Connection for pool "mds-oim" closed.>
<10:15:41 PM> <Info> <Common><oim1> <MDSPollingThread-[oim, jdbc/mds/MDS_REPOS]> <anonymous> <BEA-000628> <Created "1" resources for pool "mds-oim", out of which "1" are available and "0" are unavailable.>
<10:30:11 PM> <Info> <JDBC><oim1> <[ACTIVE] ExecuteThread: '19' for queue: 'weblogic.kernel.Default (self-tuning)'> <WLS Kernel> <BEA-001128> <Connection for pool "mds-oim" closed.>
<10:30:15 PM> <Info> <Common><oim1> <MDSPollingThread-[oim, jdbc/mds/MDS_REPOS]> <anonymous> <BEA-000628> <Created "1" resources for pool "mds-oim", out of which "1" are available and "0" are unavailable.>
<10:32:44 PM> <Info> <Deployer><oim1> <[ACTIVE] ExecuteThread: '0' for queue: 'weblogic.kernel.Default (self-tuning)'> <WLS Kernel> <BEA-149060> <Module iam-ejb.jar of application oim [Version=11.1.1.3.0] successfully transitioned from STATE_NEW to STATE_PREPARED on server oim_server1.>
<10:32:44 PM> <Info> <Deployer><oim1> <[ACTIVE] ExecuteThread: '0' for queue: 'weblogic.kernel.Default (self-tuning)'> <WLS Kernel> <BEA-149059> <Module dataobjects-ejb.jar of application oim [Version=11.1.1.3.0] is transitioning from STATE_NEW to STATE_PREPARED on server oim_server1.>
<10:33:08 PM> <Info> <J2EE><oim1> <[ACTIVE] ExecuteThread: '0' for queue: 'weblogic.kernel.Default (self-tuning)'> <WLS Kernel> <BEA-160166> <References were found in deployment plan for module 'dataobjects-ejb.jar' with uri, 'META-INF/weblogic-ejb-jar.xml'. The plan was merged.>
<10:33:14 PM> <Info> <EJB><oim1> <[ACTIVE] ExecuteThread: '0' for queue: 'weblogic.kernel.Default (self-tuning)'> <WLS Kernel> <BEA-010008> <EJB Deploying file: dataobjects-ejb.jar>
<10:38:10 PM> <Info> <Deployer><oim1> <[ACTIVE] ExecuteThread: '0' for queue: 'weblogic.kernel.Default (self-tuning)'> <WLS Kernel> <BEA-149060> <Module dataobjects-ejb.jar of application oim [Version=11.1.1.3.0] successfully transitioned from STATE_NEW to STATE_PREPARED on server oim_server1.>
<10:38:10 PM> <Info> <Deployer><oim1> <[ACTIVE] ExecuteThread: '0' for queue: 'weblogic.kernel.Default (self-tuning)'> <WLS Kernel> <BEA-149059> <Module iam-async-mdb.jar of application oim [Version=11.1.1.3.0] is transitioning from STATE_NEW to STATE_PREPARED on server oim_server1.>
<10:38:10 PM> <Info> <J2EE><oim1> <[ACTIVE] ExecuteThread: '0' for queue: 'weblogic.kernel.Default (self-tuning)'> <WLS Kernel> <BEA-160166> <References were found in deployment plan for module 'iam-async-mdb.jar' with uri, 'META-INF/ejb-jar.xml'. The plan was merged.>
<10:38:11 PM> <Info> <J2EE><oim1> <[ACTIVE] ExecuteThread: '0' for queue: 'weblogic.kernel.Default (self-tuning)'> <WLS Kernel> <BEA-160166> <References were found in deployment plan for module 'iam-async-mdb.jar' with uri, 'META-INF/weblogic-ejb-jar.xml'. The plan was merged.>
<10:38:11 PM> <Info> <EJB><oim1> <[ACTIVE] ExecuteThread: '0' for queue: 'weblogic.kernel.Default (self-tuning)'> <WLS Kernel> <BEA-010008> <EJB Deploying file: iam-async-mdb.jar>
<10:38:13 PM> <Info> <Deployer><oim1> <[ACTIVE] ExecuteThread: '0' for queue: 'weblogic.kernel.Default (self-tuning)'> <WLS Kernel> <BEA-149060> <Module iam-async-mdb.jar of application oim [Version=11.1.1.3.0] successfully transitioned from STATE_NEW to STATE_PREPARED on server oim_server1.>
<10:38:13 PM> <Info> <Deployer><oim1> <[ACTIVE] ExecuteThread: '0' for queue: 'weblogic.kernel.Default (self-tuning)'> <WLS Kernel> <BEA-149059> <Module xlWebApp of application oim [Version=11.1.1.3.0] is transitioning from STATE_NEW to STATE_PREPARED on server oim_server1.>
<10:38:13 PM> <Info> <J2EE><oim1> <[ACTIVE] ExecuteThread: '0' for queue: 'weblogic.kernel.Default (self-tuning)'> <WLS Kernel> <BEA-160166> <References were found in deployment plan for module 'xlWebApp.war' with uri, 'WEB-INF/web.xml'. The plan was merged.>
Edited by: 838243 on Feb 20, 2011 10:22 AM -
Managed server startup script not reading login info from boot.properties
To encrypt the username and password in weblogic admin server, I used a boot.properties file and setting some properties like StoreBootIdentity=true. This works as expected.
Now, I have a weblogic managed server within the same folder i.e.
under /bea/user_projects/domains/mydomain
To get the similar behaviour on this managed server, I created a boot1.properties file and set the following in the startup script
java -Djava.compiler=NONE -ms200m -mx200m $HOTSPOT_OPTIONS -classpath $CLASSPATH -Dweblogic.Domain=mydomain -Dweblogic.Name=$SERVER_NAME -Dweblogic.management.server=$ADMIN_URL -Djava.security.policy==$WL_HOME/server/lib/weblogic.policy -DRCP_PROPS=/data/css/adixit/samsung/scc612/server/cfg/RCP.props -Dlog4j.configuration=log4j.xml -Dweblogic.system.BootIdentityFile=/bea/user_projects/domains/mydomain/boot1.properties -Dweblogic.RootDirectory=/bea/user_projects/domains/mydomain weblogic.Server
When I run the script I get the following :-
<Jan 24, 2005 3:41:44 PM GMT+05:30> <Info> <Security> <BEA-090065> <Getting boot identity from user.>
Enter username to boot WebLogic server:
Why is it not able to pick the username and password from the boot1.properties file ? Any clues ? What settings can I change to make it work ?
Thanks in advance.Being that you posted this problem a few months ago, I am assuming you found the cause of your problem. I too experienced this same symptom (boot.properties not being read) when trying to start a managed server on a different server than the admin JVM. I found the resolution in the following documentation:
http://e-docs.bea.com/wls/docs81/ConsoleHelp/startstop.html#BootIdentityFiles
Basically, you have to copy the SerializedSystemIni.dat from the server that the admin JVM is on to the secondary server where the managed JVM is going to run. I was able to do as the link says (add the boot.properties file with plain text passwords and have it encrypted). Hope this helps you or someone else down the road. -
We have a 10.3.2 clustered environment and need to verify that all our managed servers will start in the event the admin server goes down. So when I run the startmanagedWebLogic.cmd from the domain\bin folder it DOES start the managed server okay. However, it starts it with the -256 -512 memory defaults. I was under the impression it would use the startup.properties of that managed server out of the domain\server\xxxserver\data folder. Anyone familiar with this?
ThanksHi the_assface,
By default the MSI mode is enabled for Managed Servers ..it means you can start Managed Servers without the AdminServer Running.
If you will go through the "startManagedWebLogic.sh" file then you will find that internally it calls "startWebLogic.sh".
So whatever Memory settings you want to apply for your Managed Servers you can provide it inside "setDomainEnv.sh" or else it will take the default Heap settings....256...
If you want to have different Heap settings for your different ManagedServers then you need to create separate Custom start scripts for different ManagedServers...with different Mem args.
*"startup.properties" file contents takes effect when u try to start ManagedServers using the NodeManager.* It wont take any effect if you will start your ManagedServers using the startup scripts.
Thanks
Jay SenSharma
http://weblogic-wonders.com/weblogic (WebLogic Wonders Are here) -
Coherence 3.6 server startup issue weblogic 11gR1sp5
Hi All,
I had managed to startup my weblogic server monitored by node manager. It is a single server domain. I have a coherence cluster setup and a single coherence server listing to the unicast address/port of the coherence cluster. I had the setup running. I had shut down my machine and next day when I tried starting it up, I started getting this error in coherence server out log --
2012-02-08 10:28:06.734/3.672 Oracle Coherence GE 3.6.0.4 <Error> (thread=Main Thread, member=n/a): Error while starting cluster: java.lang.NullPointerException
at com.tangosol.coherence.component.net.TcpRing.ensureSelector(TcpRing.CDB:7)
at com.tangosol.coherence.component.net.TcpRing.setServerSocketChannel(TcpRing.CDB:20)
at com.tangosol.coherence.component.net.Cluster.onStart(Cluster.CDB:510)
at com.tangosol.coherence.component.net.Cluster.start(Cluster.CDB:11)
at com.tangosol.coherence.component.util.SafeCluster.startCluster(SafeCluster.CDB:3)
at com.tangosol.coherence.component.util.SafeCluster.restartCluster(SafeCluster.CDB:7)
at com.tangosol.coherence.component.util.SafeCluster.ensureRunningCluster(SafeCluster.CDB:26)
Another error is coming up in the weblogic server output log which says:
<Feb 8, 2012 10:37:55 AM EST> <Warning> <OSB Kernel> <BEA-398306> <The Result Cache /osb/service/ResultCache was not found: com.bea.alsb.coherence.CacheNotFoundException: Cache /osb/service/ResultCache not found:
com.tangosol.net.RequestPolicyException: No storage-enabled nodes exist for service ORA-OSB-deployments
com.tangosol.net.RequestPolicyException: No storage-enabled nodes exist for service ORA-OSB-deployments
at com.tangosol.coherence.component.util.daemon.queueProcessor.service.grid.partitionedService.PartitionedCache$BinaryMap.onMissingStorage(PartitionedCache.CDB:23)
at com.tangosol.coherence.component.util.daemon.queueProcessor.service.grid.partitionedService.PartitionedCache$BinaryMap.sendStorageRequest(PartitionedCache.CDB:15)
at com.tangosol.coherence.component.util.daemon.queueProcessor.service.grid.partitionedService.PartitionedCache$BinaryMap.addIndex(PartitionedCache.CDB:11)
at com.tangosol.coherence.component.util.daemon.queueProcessor.service.grid.partitionedService.PartitionedCache$ViewMap.addIndex(PartitionedCache.CDB:1)
I have added the additional cmd line args for OSB to use coherence client :
-Dtangosol.coherence.distributed.localstorage=false -DOSB.coherence.cluster=ip-dev-coh-cluster -DOSB.coherence.localhost=windows -DOSB.coherence.localport=1111
And here is my override xml:
<!DOCTYPE coherence SYSTEM "coherence.dtd">
<coherence>
<cluster-config>
<unicast-listener>
<well-known-addresses>
<socket-address id="1">
<address>windows</address>
<port>1111</port>
</socket-address>
</well-known-addresses>
<address system-property="OSB.coherence.wka1">windows</address>
<port system-property="OSB.coherence.wka1.port">1111</port>
</unicast-listener>
</cluster-config>
</coherence>
I am not sure what has gone wrong in terms of my shutting down of the machine? All I did was
1. shut down the coherence server (from console)
2. shut down the admin server (from console)
3. paused my vm!
Any help would be appreciated!
Regards,
Souvik MukherjeeHi,
I have the same concern.I have a single server topology. The coherence cluster is targeted to admin server. I am not able to start the coherence server before starting the admin server. Is there any way by which I can start the coherence server without connecting to the admin server?
What I usually do is:
1. Run wlst
2. connect to node manager
3. nmStart('AdminServer')
4. start coherence server from the console
This setup works fine when the coherence server is up and running. When ever I shut down my coherence server, the setup doesnt work. Can you please help me doing this? I did not find any documentation as well which shows how to start coherence server from commandline or node manager. Everywhere it shows how to start coherence server from console!
Regards,
Souvik Mukherjee
Maybe you are looking for
-
Multi-Threaded FTP was a huge attraction for me, and one of the features that sold me on upgrading to Dreamweaver CS6. However, I haven't seen any sign of it in the product or any documentation to help me use it. My files keep transferring in the t
-
I have tried deleting things off my iMac to create more space. I still get the message that my recently order TV series cannot be downloaded because I have very little space left on my start up disk. I need guidance as to how to create more space.
-
Internet suddenly stopped working on WRT54G for no apparent reason. Any ideas??
I have a WRT54G v2 that has been working fine until a couple days ago the internet stopped responding. Internet works fine with direct connection from modem so that isn't the problem. Internet light on front of router is solid green when internet i
-
I am trying to download the new version of Adobe Flash- keep getting no mountable file error
Please help- how do I get rid of this? Thanks
-
Booting from a NTFS external HD?
Hey. I just got an external HD and I want to format it in NTFS format so that I can read it on Windows computers. But, would I be able to boot from it on my MacBook if it's in this format? It's only 60GB, so I don't have enough space to make multiple