Weblogic 6.1 cluster startup issue
We've recently experienced a horrendous morning with Weblogic 6.1 SP3. We were
restarting all of our servers (4 Servlet containers (clustered), 2 EJB containers
(clustered)), and found that after doing so, the web servers started dying off
one by one with a hotspot error message. The stack sometimes seemed to indicate
a failure in an weblogic 'internalLookup' method.
After a while, I noticed that one of the EJB servers was consuming 0 CPU. I suspected
that this EJB server had not properly started up, and bounced it. After I made
sure that i had started up properly, I then proceeded to restart all of the Web
servers, one by one. Since then everything has been fine.
When restarting the clustered servers, we noticed that it took an inordinate amount
of time compared to starting each one up individually... Is there a known problem
related to starting up multiple clustered servers simultaneously?
Thanks in Advance, Chad Stansbury
Forget about it. Turns out that the instability was due to someone inadvertently
modifying our startup scripts and limiting all our VMs to -mx64m. Not good.
Anyway, sorry for any time you may have wasted.
Chad
Rajesh Mirchandani <[email protected]> wrote:
Take multiple thread dumps of the servers in the cluster and post it
here. What happens if
you start one server after the other ?
Chad Stansbury wrote:
We've recently experienced a horrendous morning with Weblogic 6.1 SP3.We were
restarting all of our servers (4 Servlet containers (clustered), 2EJB containers
(clustered)), and found that after doing so, the web servers starteddying off
one by one with a hotspot error message. The stack sometimes seemedto indicate
a failure in an weblogic 'internalLookup' method.
After a while, I noticed that one of the EJB servers was consuming0 CPU. I suspected
that this EJB server had not properly started up, and bounced it. After I made
sure that i had started up properly, I then proceeded to restart allof the Web
servers, one by one. Since then everything has been fine.
When restarting the clustered servers, we noticed that it took an inordinateamount
of time compared to starting each one up individually... Is there aknown problem
related to starting up multiple clustered servers simultaneously?
Thanks in Advance, Chad Stansbury--
Rajesh Mirchandani
Developer Relations Engineer
BEA Support
Similar Messages
-
Strange Cluster Startup Timing Issues (Solaris 2.7)
When we start up our admin server for our WLS 6.0sp1 cluster (running on Solaris
2.7), then try to start all the managed servers approximately simultaneously,
the managed servers come up apparently normally (no errors in the logs) but no
EJBs ever deploy.
If we follow the same steps, but wait until each server is all the way up before
starting the next, everything is fine.
Has anyone else run into this?
-daniel
Hmm, I wonder if they "cannot" or "will not" supply you the patch...
Oh well, hopefully this won't get me in trouble! Here's the patch, stick it in your weblogic /lib
directory or in CLASSPATH, and add the following to your startup command:
-Dweblogic.rmi.queuesize=n
And if you are having problems, don't tell BEA who gave this to you! :-)
Gene
"Aaron Oas" <[email protected]> wrote in message
news:[email protected]...
> Thanks for the information.
>
> We wrote to BEA support; here's the response (i.e. no patch is forthcoming):
>
> ----------------------------- begin BEA
> response -----------------------------
> FR: tommy
>
> CASE_ID_NUM: 248170
>
> MESSAGE:
>
> Daniel,
>
> My name is Tommy, and I'm a Developer Relations Engineer with
> BEA Technical Support. I wanted to drop you a quick note to tell you
> that I've picked up your support case.
>
> At this time engineering does not have a patch for this CR. This issue is
> slated to be fixed in WLS 6.1 release which is scheduled for end of July.
> At this time engineering is pushing to have 6.1 released on schedule, and
> since
> there is a valid work around for this issue, they will not provide a patch.
>
> The work around is to simply boot your servers in increments of about 30
> seconds.
>
> Thanks in Advance,
>
> Tommy Butcher
>
> ----------------------------- end BEA response -----------------------------
>
> I guess it could be worse.
>
> - Aaron
>
>
> "Gene Chuang" <[email protected]> wrote in message
> news:[email protected]...
> > Currently, weblogic_admin_rmi_queue native thread count is fixed at 3 (or
> was it 4?). I did get a
> > patch which allows me to set the count as a flag at startup, although it
> would seem the longterm
> > solution is for WL to self-manage the thread count dynamically. For
> anyone who needs this interim
> > solution, write to support and mention the CR.
> >
> > Gene
> >
> > "Aaron Oas" <[email protected]> wrote in message
> > news:[email protected]...
> > > Gene (and clusterers in general) -
> > >
> > > It seems odd that so few people have reported problems with concurrently
> > > starting servers in a cluster if it is a limitation of
> > > weblogic_admin_rmi_queue native thread count. Is it a limitation
> imposed by
> > > the Solaris kernel on weblogic (i.e. Solaris max threads per process or
> per
> > > user can't be set high enough in /etc/system)?
> > >
> > > I would think that for a mission-critical environment, starting managed
> > > servers in a weblogic cluster would ideally be automated and
> simultaneous;
> > > rather than serial, and certainly rather than manual (log into each
> solaris
> > > box in turn and run the startup script by hand).
> > >
> > > Does anyone out there running weblogic clusters automate the startup of
> > > their weblogic cluster as a whole (e.g. a startup script on the admin
> server
> > > box that cranks up all the remote managed servers as well)?
> > >
> > > I have ideas about how to do this without using rexec and .rhosts files,
> but
> > > it's not trivial (create a listener on each box wait for startup
> command,
> > > check for managed server process, run startup script...), and I'm
> wondering
> > > if:
> > > 1) there is a well-known approach to starting up all the managed servers
> on
> > > remote boxes, and
> > > 2) there is a solution to the apparent requirement that clustered
> managed
> > > servers can't start at the same time, even on separate boxes
> > >
> > > Hope there are some thoughts on this out there,
> > >
> > >
> > > - Aaron
> > > "Gene Chuang" <[email protected]> wrote in message
> > > news:[email protected]...
> > > > I've filed a issue, CR042545, where I cannot concurrently start more
> than
> > > 2 managed servers in
> > > > Solaris 2.7 due to weblogic_admin_rmi_queue native thread count
> > > limitations... hopefully it has
> > > > been fixed in 6.1?
> > > >
> > > > Gene
> > > >
> > > > "Fred Bloggs" <[email protected]> wrote in message
> > > news:[email protected]...
> > > > >
> > > > > When we start up our admin server for our WLS 6.0sp1 cluster
> (running on
> > > Solaris
> > > > > 2.7), then try to start all the managed servers approximately
> > > simultaneously,
> > > > > the managed servers come up apparently normally (no errors in the
> logs)
> > > but no
> > > > > EJBs ever deploy.
> > > > >
> > > > > If we follow the same steps, but wait until each server is all the
> way
> > > up before
> > > > > starting the next, everything is fine.
> > > > >
> > > > > Has anyone else run into this?
> > > > >
> > > > > -daniel
> > > >
> > > >
> > >
> > >
> >
> >
>
>
[cr042545.jar]
-
Weblogic Server 10.0 MP1 on RHEL5 StartUp Issues
I am a newbie to Weblogic on RHEL. Havin issues with Weblogic to start up. I tried installing with root or a non root user but still the same result.
Its get stuck at Initializing state and never move on from there.
<BEA-000365> <Server state changed to STARTING>
<BEA-002900> <Initializing self-tuning thread pool>
Please let me know how to resolve this. I dunno if its a permission issue or not cos with root too its the same case .
I tried to create a new domain with configure.sh, gave the user name and password too while startup but still it doesnt move from this line.
Kindly let me know how to trace where n why its stuck .. or pls help me with the correct procedure to installHi,
Specially in Linux Environments sometimes we face issue of Locked Threads while starting some new processes...It happens many times because of less Entropy...Please refer to : http://weblogic-wonders.com/weblogic/2010/07/29/issues-relating-to-urandomrandom-on-weblogic-server-in-linux-environment/ for more details ....
Above may be one of the reason.
Thanks
jay SenSharma
http://weblogic-wonders.com/ /(Wonders Are Here) -
Managed server startup issue!!!
hi all,
i am facing managedserver startup issue
i am start the managed server it will up take the 6 min
how to reduce the time
1)i am trying differnt ways 1)threaddump 2)GCparamets
but no usee
can u see the log and give me suugestions
below log one perticuler area it will load the application 4 min
please see the time stamps 8:31:01 to 8:35:09
please give me suggistions!!
======================================
####<Apr 11, 2010 8:31:00 PM PDT> <Info> <Deployer> <agwlcrptrn1> <agwlcrptrn1> <[ACTIVE] ExecuteThread: '0' for queue: 'weblogic.kernel.Default (self-tuning)'> <<WLS Kernel>> <> <> <1271043060997> <BEA-149059> <Module eci.jar of application Agile is transitioning from STATE_PREPARED to STATE_ADMIN on server agwlcrptrn1.>
####<Apr 11, 2010 8:31:01 PM PDT> <Info> <EJB> <agwlcrptrn1> <agwlcrptrn1> <[ACTIVE] ExecuteThread: '0' for queue: 'weblogic.kernel.Default (self-tuning)'> <<WLS Kernel>> <> <> <1271043061016> <BEA-010009> <EJB Deployed EJB with JNDI name com.eigner.eci.EciSession.>
####<Apr 11, 2010 8:31:01 PM PDT> <Debug> <Deployment> <agwlcrptrn1> <agwlcrptrn1> <[ACTIVE] ExecuteThread: '0' for queue: 'weblogic.kernel.Default (self-tuning)'> <<WLS Kernel>> <> <> <1271043061016> <BEA-000000> <Listener: end ModuleCtx[appId=Agile, modId=eci.jar, type=ejb, Target=Cluster/AgileCluster] STATE_PREPARED>STATE_ADMIN>
####<Apr 11, 2010 8:31:01 PM PDT> <Info> <Deployer> <agwlcrptrn1> <agwlcrptrn1> <[ACTIVE] ExecuteThread: '0' for queue: 'weblogic.kernel.Default (self-tuning)'> <<WLS Kernel>> <> <> <1271043061016> <BEA-149060> <Module eci.jar of application Agile successfully transitioned from STATE_PREPARED to STATE_ADMIN on server agwlcrptrn1.>
####<Apr 11, 2010 8:35:09 PM PDT> <Debug> <Deployment> <agwlcrptrn1> <agwlcrptrn1> <[ACTIVE] ExecuteThread: '0' for queue: 'weblogic.kernel.Default (self-tuning)'> <<WLS Kernel>> <> <> <1271043309172> <BEA-000000> <Relaying updated state for app, Agile to STATE_ADMIN>
####<Apr 11, 2010 8:35:09 PM PDT> <Debug> <Deployment> <agwlcrptrn1> <agwlcrptrn1> <[ACTIVE] ExecuteThread: '0' for queue: 'weblogic.kernel.Default (self-tuning)'> <<WLS Kernel>> <> <> <1271043309173> <BEA-000000> < +++ Returning app's state : STATE_ACTIVE>
####<Apr 11, 2010 8:35:09 PM PDT> <Debug> <Deployment> <agwlcrptrn1> <agwlcrptrn1> <[ACTIVE] ExecuteThread: '0' for queue: 'weblogic.kernel.Default (self-tuning)'> <<WLS Kernel>> <> <hi sandeep,
i take the thread dump 10 times at the start the server can u look into this one...
===============================
CLASSPATH=/local/mnt/agile/bea/patch_wls1030/profiles/default/sys_manifest_classpath/weblogic_patch.jar:/local/mnt/agile/bea/patch_cie660/profiles/default/sys_manifest_classpath/weblogic_patch.jar:/local/mnt/agile/bea/jrockit_160_05/lib/tools.jar:/local/mnt/agile/bea/wlserver_10.3/server/lib/weblogic_sp.jar:/local/mnt/agile/bea/wlserver_10.3/server/lib/weblogic.jar:/local/mnt/agile/bea/modules/features/weblogic.server.modules_10.3.0.0.jar:/local/mnt/agile/bea/wlserver_10.3/server/lib/webservices.jar:/local/mnt/agile/bea/modules/org.apache.ant_1.6.5/lib/ant-all.jar:/local/mnt/agile/bea/modules/net.sf.antcontrib_1.0.0.0_1-0b2/lib/ant-contrib.jar::/local/mnt/agile/agile93/agileDomain/lib/jms.jar:/local/mnt/agile/agile93/agileDomain/lib/jndi.jar:/local/mnt/agile/agile93/agileDomain/lib/tibjms.jar
PATH=/local/mnt/agile/bea/wlserver_10.3/server/bin:/local/mnt/agile/bea/modules/org.apache.ant_1.6.5/bin:/local/mnt/agile/bea/jrockit_160_05/jre/bin:/local/mnt/agile/bea/jrockit_160_05/bin:/usr/kerberos/bin:/usr/local/bin:/bin:/usr/bin:/usr/X11R6/bin
Your environment has been set.
QCHTTPHeaderIdentityAsserter.initialize
AgileAuthenticationProviderImpl.initialize
2010-04-10 20:03:14
Full thread dump Java HotSpot(TM) Server VM (10.0-b19 mixed mode):
"Thread-13" daemon prio=10 tid=0x62a8a800 nid=0x1b6 waiting on condition [0x5f7b8000..0x5f7b9130]
java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0xf2d78078> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:158)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1925)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:358)
at weblogic.utils.concurrent.JDK15ConcurrentBlockingQueue.take(JDK15ConcurrentBlockingQueue.java:89)
at weblogic.store.internal.PersistentStoreImpl.getOutstandingWork(PersistentStoreImpl.java:567)
at weblogic.store.internal.PersistentStoreImpl.run(PersistentStoreImpl.java:615)
at weblogic.store.internal.PersistentStoreImpl$2.run(PersistentStoreImpl.java:383)
"LDAPCache-TTLTimer" daemon prio=10 tid=0x09277000 nid=0x1b5 in Object.wait() [0x5f90b000..0x5f90bfb0]
java.lang.Thread.State: TIMED_WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0xf2d7c068> (a netscape.ldap.TTLTimer)
at netscape.ldap.TTLTimer.run(LDAPCache.java:828)
- locked <0xf2d7c068> (a netscape.ldap.TTLTimer)
at java.lang.Thread.run(Thread.java:619)
"LDAPConnThread-1 ldaps://qpip.qualcomm.com:389" daemon prio=10 tid=0x5f6fc000 nid=0x1b4 runnable [0x5f95c000..0x5f95d030]
java.lang.Thread.State: RUNNABLE
at java.net.SocketInputStream.socketRead0(Native Method)
at java.net.SocketInputStream.read(SocketInputStream.java:129)
at java.io.BufferedInputStream.fill(BufferedInputStream.java:218)
at java.io.BufferedInputStream.read(BufferedInputStream.java:237)
- locked <0xf2d820a8> (a java.io.BufferedInputStream)
at netscape.ldap.ber.stream.BERElement.getElement(BERElement.java:101)
at netscape.ldap.LDAPConnThread.run(LDAPConnThread.java:538)
at java.lang.Thread.run(Thread.java:619)
"Thread-12" daemon prio=10 tid=0x61c2ac00 nid=0x1b3 waiting on condition [0x5f9ad000..0x5f9adeb0]
java.lang.Thread.State: TIMED_WAITING (sleeping)
at java.lang.Thread.sleep(Native Method)
at oracle.jdbc.pool.OracleConnectionCacheTimeOutThread.run(OracleConnectionCacheTimeOutThread.java:80)
"LDAPConnThread-0 ldap://10.47.24.141:9001" daemon prio=10 tid=0x61cb5400 nid=0x1b1 runnable [0x5fb55000..0x5fb55db0]
java.lang.Thread.State: RUNNABLE
at java.net.SocketInputStream.socketRead0(Native Method)
at java.net.SocketInputStream.read(SocketInputStream.java:129)
at java.io.BufferedInputStream.fill(BufferedInputStream.java:218)
at java.io.BufferedInputStream.read(BufferedInputStream.java:237)
- locked <0xf2d920a8> (a java.io.BufferedInputStream)
at netscape.ldap.ber.stream.BERElement.getElement(BERElement.java:101)
at netscape.ldap.LDAPConnThread.run(LDAPConnThread.java:538)
at java.lang.Thread.run(Thread.java:619)
"DoSManager" daemon prio=10 tid=0x0932a000 nid=0x1b0 waiting on condition [0x5f9fe000..0x5f9fee30]
java.lang.Thread.State: TIMED_WAITING (sleeping)
at java.lang.Thread.sleep(Native Method)
at com.octetstring.vde.DoSManager.run(DoSManager.java:433)
"VDE Transaction Processor Thread" daemon prio=10 tid=0x61c07000 nid=0x1ae in Object.wait() [0x5fba6000..0x5fba7130]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0xf2d70090> (a com.octetstring.vde.backend.standard.TransactionProcessor)
at java.lang.Object.wait(Object.java:485)
at com.octetstring.vde.backend.standard.TransactionProcessor.waitChange(TransactionProcessor.java:367)
- locked <0xf2d70090> (a com.octetstring.vde.backend.standard.TransactionProcessor)
at com.octetstring.vde.backend.standard.TransactionProcessor.run(TransactionProcessor.java:212)
"ExecuteThread: '16' for queue: 'weblogic.socket.Muxer'" daemon prio=10 tid=0x62a67400 nid=0x1ad waiting for monitor entry [0x5fbf7000..0x5fbf7fb0]
java.lang.Thread.State: BLOCKED (on object monitor)
at weblogic.socket.PosixSocketMuxer.processSockets(PosixSocketMuxer.java:95)
- waiting to lock <0xf2d8c098> (a weblogic.socket.PosixSocketMuxer$1)
at weblogic.socket.SocketReaderRequest.run(SocketReaderRequest.java:29)
at weblogic.socket.SocketReaderRequest.execute(SocketReaderRequest.java:42)
at weblogic.kernel.ExecuteThread.execute(ExecuteThread.java:145)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:117)
"ExecuteThread: '15' for queue: 'weblogic.socket.Muxer'" daemon prio=10 tid=0x62a66000 nid=0x1ac waiting for monitor entry [0x5fc48000..0x5fc49030]
java.lang.Thread.State: BLOCKED (on object monitor)
at weblogic.socket.PosixSocketMuxer.processSockets(PosixSocketMuxer.java:95)
- waiting to lock <0xf2d8c098> (a weblogic.socket.PosixSocketMuxer$1)
at weblogic.socket.SocketReaderRequest.run(SocketReaderRequest.java:29)
at weblogic.socket.SocketReaderRequest.execute(SocketReaderRequest.java:42)
at weblogic.kernel.ExecuteThread.execute(ExecuteThread.java:145)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:117)
"ExecuteThread: '14' for queue: 'weblogic.socket.Muxer'" daemon prio=10 tid=0x62a65000 nid=0x1ab waiting for monitor entry [0x5fc99000..0x5fc99eb0]
java.lang.Thread.State: BLOCKED (on object monitor)
at weblogic.socket.PosixSocketMuxer.processSockets(PosixSocketMuxer.java:95)
- waiting to lock <0xf2d8c098> (a weblogic.socket.PosixSocketMuxer$1)
at weblogic.socket.SocketReaderRequest.run(SocketReaderRequest.java:29)
at weblogic.socket.SocketReaderRequest.execute(SocketReaderRequest.java:42)
at weblogic.kernel.ExecuteThread.execute(ExecuteThread.java:145)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:117)
"ExecuteThread: '13' for queue: 'weblogic.socket.Muxer'" daemon prio=10 tid=0x62a63c00 nid=0x1aa waiting for monitor entry [0x5fcea000..0x5fceaf30]
java.lang.Thread.State: BLOCKED (on object monitor)
at weblogic.socket.PosixSocketMuxer.processSockets(PosixSocketMuxer.java:95)
- waiting to lock <0xf2d8c098> (a weblogic.socket.PosixSocketMuxer$1)
at weblogic.socket.SocketReaderRequest.run(SocketReaderRequest.java:29)
at weblogic.socket.SocketReaderRequest.execute(SocketReaderRequest.java:42)
at weblogic.kernel.ExecuteThread.execute(ExecuteThread.java:145)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:117)
"ExecuteThread: '12' for queue: 'weblogic.socket.Muxer'" daemon prio=10 tid=0x62a62c00 nid=0x1a9 runnable [0x5fd3b000..0x5fd3bdb0]
java.lang.Thread.State: RUNNABLE
at weblogic.socket.PosixSocketMuxer.poll(Native Method)
at weblogic.socket.PosixSocketMuxer.processSockets(PosixSocketMuxer.java:102)
- locked <0xf2d8c098> (a weblogic.socket.PosixSocketMuxer$1)
at weblogic.socket.SocketReaderRequest.run(SocketReaderRequest.java:29)
at weblogic.socket.SocketReaderRequest.execute(SocketReaderRequest.java:42)
at weblogic.kernel.ExecuteThread.execute(ExecuteThread.java:145)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:117)
"ExecuteThread: '11' for queue: 'weblogic.socket.Muxer'" daemon prio=10 tid=0x62a61c00 nid=0x1a8 waiting for monitor entry [0x5fd8c000..0x5fd8ce30]
java.lang.Thread.State: BLOCKED (on object monitor)
at weblogic.socket.PosixSocketMuxer.processSockets(PosixSocketMuxer.java:95)
- waiting to lock <0xf2d8c098> (a weblogic.socket.PosixSocketMuxer$1)
at weblogic.socket.SocketReaderRequest.run(SocketReaderRequest.java:29)
at weblogic.socket.SocketReaderRequest.execute(SocketReaderRequest.java:42)
at weblogic.kernel.ExecuteThread.execute(ExecuteThread.java:145)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:117)
"ExecuteThread: '10' for queue: 'weblogic.socket.Muxer'" daemon prio=10 tid=0x62a60800 nid=0x1a7 waiting for monitor entry [0x5fddd000..0x5fdde0b0]
java.lang.Thread.State: BLOCKED (on object monitor)
at weblogic.socket.PosixSocketMuxer.processSockets(PosixSocketMuxer.java:95)
- waiting to lock <0xf2d8c098> (a weblogic.socket.PosixSocketMuxer$1)
at weblogic.socket.SocketReaderRequest.run(SocketReaderRequest.java:29)
at weblogic.socket.SocketReaderRequest.execute(SocketReaderRequest.java:42)
at weblogic.kernel.ExecuteThread.execute(ExecuteThread.java:145)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:117)
"ExecuteThread: '9' for queue: 'weblogic.socket.Muxer'" daemon prio=10 tid=0x62a6f400 nid=0x1a6 waiting for monitor entry [0x5fe2e000..0x5fe2f130]
java.lang.Thread.State: BLOCKED (on object monitor)
at weblogic.socket.PosixSocketMuxer.processSockets(PosixSocketMuxer.java:95)
- waiting to lock <0xf2d8c098> (a weblogic.socket.PosixSocketMuxer$1)
at weblogic.socket.SocketReaderRequest.run(SocketReaderRequest.java:29)
at weblogic.socket.SocketReaderRequest.execute(SocketReaderRequest.java:42)
at weblogic.kernel.ExecuteThread.execute(ExecuteThread.java:145)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:117)
"ExecuteThread: '8' for queue: 'weblogic.socket.Muxer'" daemon prio=10 tid=0x0928d400 nid=0x1a5 waiting for monitor entry [0x5fe7f000..0x5fe7ffb0]
java.lang.Thread.State: BLOCKED (on object monitor)
at weblogic.socket.PosixSocketMuxer.processSockets(PosixSocketMuxer.java:95)
- waiting to lock <0xf2d8c098> (a weblogic.socket.PosixSocketMuxer$1)
at weblogic.socket.SocketReaderRequest.run(SocketReaderRequest.java:29)
at weblogic.socket.SocketReaderRequest.execute(SocketReaderRequest.java:42)
at weblogic.kernel.ExecuteThread.execute(ExecuteThread.java:145)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:117)
"ExecuteThread: '7' for queue: 'weblogic.socket.Muxer'" daemon prio=10 tid=0x0928c000 nid=0x1a4 waiting for monitor entry [0x5fed0000..0x5fed1030]
java.lang.Thread.State: BLOCKED (on object monitor)
at weblogic.socket.PosixSocketMuxer.processSockets(PosixSocketMuxer.java:95)
- waiting to lock <0xf2d8c098> (a weblogic.socket.PosixSocketMuxer$1)
at weblogic.socket.SocketReaderRequest.run(SocketReaderRequest.java:29)
at weblogic.socket.SocketReaderRequest.execute(SocketReaderRequest.java:42)
at weblogic.kernel.ExecuteThread.execute(ExecuteThread.java:145)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:117)
"ExecuteThread: '6' for queue: 'weblogic.socket.Muxer'" daemon prio=10 tid=0x0928b000 nid=0x1a3 waiting for monitor entry [0x5ff21000..0x5ff21eb0]
java.lang.Thread.State: BLOCKED (on object monitor)
at weblogic.socket.PosixSocketMuxer.processSockets(PosixSocketMuxer.java:95)
- waiting to lock <0xf2d8c098> (a weblogic.socket.PosixSocketMuxer$1)
at weblogic.socket.SocketReaderRequest.run(SocketReaderRequest.java:29)
at weblogic.socket.SocketReaderRequest.execute(SocketReaderRequest.java:42)
at weblogic.kernel.ExecuteThread.execute(ExecuteThread.java:145)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:117)
"ExecuteThread: '5' for queue: 'weblogic.socket.Muxer'" daemon prio=10 tid=0x0930c400 nid=0x1a2 waiting for monitor entry [0x5ff72000..0x5ff72f30]
java.lang.Thread.State: BLOCKED (on object monitor)
at weblogic.socket.PosixSocketMuxer.processSockets(PosixSocketMuxer.java:95)
- waiting to lock <0xf2d8c098> (a weblogic.socket.PosixSocketMuxer$1)
at weblogic.socket.SocketReaderRequest.run(SocketReaderRequest.java:29)
at weblogic.socket.SocketReaderRequest.execute(SocketReaderRequest.java:42)
at weblogic.kernel.ExecuteThread.execute(ExecuteThread.java:145)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:117)
"ExecuteThread: '4' for queue: 'weblogic.socket.Muxer'" daemon prio=10 tid=0x0928dc00 nid=0x1a1 waiting for monitor entry [0x5ffc3000..0x5ffc3db0]
java.lang.Thread.State: BLOCKED (on object monitor)
at weblogic.socket.PosixSocketMuxer.processSockets(PosixSocketMuxer.java:95)
- waiting to lock <0xf2d8c098> (a weblogic.socket.PosixSocketMuxer$1)
at weblogic.socket.SocketReaderRequest.run(SocketReaderRequest.java:29)
at weblogic.socket.SocketReaderRequest.execute(SocketReaderRequest.java:42)
at weblogic.kernel.ExecuteThread.execute(ExecuteThread.java:145)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:117)
"ExecuteThread: '3' for queue: 'weblogic.socket.Muxer'" daemon prio=10 tid=0x09288c00 nid=0x1a0 waiting for monitor entry [0x60014000..0x60014e30]
java.lang.Thread.State: BLOCKED (on object monitor)
at weblogic.socket.PosixSocketMuxer.processSockets(PosixSocketMuxer.java:95)
- waiting to lock <0xf2d8c098> (a weblogic.socket.PosixSocketMuxer$1)
at weblogic.socket.SocketReaderRequest.run(SocketReaderRequest.java:29)
at weblogic.socket.SocketReaderRequest.execute(SocketReaderRequest.java:42)
at weblogic.kernel.ExecuteThread.execute(ExecuteThread.java:145)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:117)
"ExecuteThread: '2' for queue: 'weblogic.socket.Muxer'" daemon prio=10 tid=0x092d4800 nid=0x19f waiting for monitor entry [0x60065000..0x600660b0]
java.lang.Thread.State: BLOCKED (on object monitor)
at weblogic.socket.PosixSocketMuxer.processSockets(PosixSocketMuxer.java:95)
- waiting to lock <0xf2d8c098> (a weblogic.socket.PosixSocketMuxer$1)
at weblogic.socket.SocketReaderRequest.run(SocketReaderRequest.java:29)
at weblogic.socket.SocketReaderRequest.execute(SocketReaderRequest.java:42)
at weblogic.kernel.ExecuteThread.execute(ExecuteThread.java:145)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:117)
"ExecuteThread: '1' for queue: 'weblogic.socket.Muxer'" daemon prio=10 tid=0x092d4400 nid=0x19e waiting for monitor entry [0x600b6000..0x600b7130]
java.lang.Thread.State: BLOCKED (on object monitor)
at weblogic.socket.PosixSocketMuxer.processSockets(PosixSocketMuxer.java:95)
- waiting to lock <0xf2d8c098> (a weblogic.socket.PosixSocketMuxer$1)
at weblogic.socket.SocketReaderRequest.run(SocketReaderRequest.java:29)
at weblogic.socket.SocketReaderRequest.execute(SocketReaderRequest.java:42)
at weblogic.kernel.ExecuteThread.execute(ExecuteThread.java:145)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:117)
"ExecuteThread: '0' for queue: 'weblogic.socket.Muxer'" daemon prio=10 tid=0x0932d800 nid=0x19d waiting for monitor entry [0x60107000..0x60107fb0]
java.lang.Thread.State: BLOCKED (on object monitor)
at weblogic.socket.PosixSocketMuxer.processSockets(PosixSocketMuxer.java:95)
- waiting to lock <0xf2d8c098> (a weblogic.socket.PosixSocketMuxer$1)
at weblogic.socket.SocketReaderRequest.run(SocketReaderRequest.java:29)
at weblogic.socket.SocketReaderRequest.execute(SocketReaderRequest.java:42)
at weblogic.kernel.ExecuteThread.execute(ExecuteThread.java:145)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:117)
"[ACTIVE] ExecuteThread: '1' for queue: 'weblogic.kernel.Default (self-tuning)'" daemon prio=10 tid=0x0932c400 nid=0x19c in Object.wait() [0x60158000..0x60159030]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0xf2daa030> (a weblogic.work.ExecuteThread)
at java.lang.Object.wait(Object.java:485)
at weblogic.work.ExecuteThread.waitForRequest(ExecuteThread.java:157)
- locked <0xf2daa030> (a weblogic.work.ExecuteThread)
at weblogic.work.ExecuteThread.run(ExecuteThread.java:178)
"Thread-7" daemon prio=10 tid=0x0932e400 nid=0x19b waiting on condition [0x601a9000..0x601a9eb0]
java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0xf2daa150> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:158)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1925)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:358)
at weblogic.utils.concurrent.JDK15ConcurrentBlockingQueue.take(JDK15ConcurrentBlockingQueue.java:89)
at weblogic.store.internal.PersistentStoreImpl.getOutstandingWork(PersistentStoreImpl.java:567)
at weblogic.store.internal.PersistentStoreImpl.run(PersistentStoreImpl.java:615)
at weblogic.store.internal.PersistentStoreImpl$2.run(PersistentStoreImpl.java:383)
"weblogic.timers.TimerThread" daemon prio=10 tid=0x60467800 nid=0x19a in Object.wait() [0x603fe000..0x603fef30]
java.lang.Thread.State: TIMED_WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0xf2daa2c0> (a weblogic.timers.internal.TimerThread)
at weblogic.timers.internal.TimerThread$Thread.run(TimerThread.java:267)
- locked <0xf2daa2c0> (a weblogic.timers.internal.TimerThread)
"weblogic.time.TimeEventGenerator" daemon prio=10 tid=0x60431800 nid=0x199 in Object.wait() [0x60555000..0x60555db0]
java.lang.Thread.State: TIMED_WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0xf2daa380> (a weblogic.time.common.internal.TimeTable)
at weblogic.time.common.internal.TimeTable.snooze(TimeTable.java:286)
- locked <0xf2daa380> (a weblogic.time.common.internal.TimeTable)
at weblogic.time.common.internal.TimeEventGenerator.run(TimeEventGenerator.java:117)
at java.lang.Thread.run(Thread.java:619)
"[ACTIVE] ExecuteThread: '0' for queue: 'weblogic.kernel.Default (self-tuning)'" daemon prio=10 tid=0x6042e000 nid=0x198 runnable [0x605a5000..0x605a6e30]
java.lang.Thread.State: RUNNABLE
at java.util.HashMap.<init>(HashMap.java:209)
at java.util.jar.Manifest.<init>(Manifest.java:37)
at java.util.jar.JarFile.getManifestFromReference(JarFile.java:160)
at java.util.jar.JarFile.getManifest(JarFile.java:146)
at weblogic.utils.classloaders.GenericClassLoader$JarSource.getManifest(GenericClassLoader.java:528)
at weblogic.utils.classloaders.GenericClassLoader.defineClass(GenericClassLoader.java:310)
at weblogic.utils.classloaders.GenericClassLoader.findLocalClass(GenericClassLoader.java:288)
- locked <0xe5c43a98> (a weblogic.utils.classloaders.GenericClassLoader)
at weblogic.utils.classloaders.GenericClassLoader.findClass(GenericClassLoader.java:256)
at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
- locked <0xe5c43a98> (a weblogic.utils.classloaders.GenericClassLoader)
at java.lang.ClassLoader.loadClass(ClassLoader.java:251)
at weblogic.utils.classloaders.GenericClassLoader.loadClass(GenericClassLoader.java:176)
at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:319)
- locked <0xe5c43a98> (a weblogic.utils.classloaders.GenericClassLoader)
at java.lang.ClassLoader.defineClass1(Native Method)
at java.lang.ClassLoader.defineClass(ClassLoader.java:620)
at java.security.SecureClassLoader.defineClass(SecureClassLoader.java:124)
at weblogic.utils.classloaders.GenericClassLoader.defineClass(GenericClassLoader.java:335)
at weblogic.utils.classloaders.GenericClassLoader.findLocalClass(GenericClassLoader.java:288)
- locked <0xe5c43a98> (a weblogic.utils.classloaders.GenericClassLoader)
at weblogic.utils.classloaders.GenericClassLoader.findClass(GenericClassLoader.java:256)
at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
- locked <0xe5c43a98> (a weblogic.utils.classloaders.GenericClassLoader)
at java.lang.ClassLoader.loadClass(ClassLoader.java:251)
at weblogic.utils.classloaders.GenericClassLoader.loadClass(GenericClassLoader.java:176)
at weblogic.ejb.container.deployer.EJBModule.setupEJBToImplClassDependencies(EJBModule.java:1790)
at weblogic.ejb.container.deployer.EJBModule.prepare(EJBModule.java:397)
at weblogic.application.internal.flow.ModuleListenerInvoker.prepare(ModuleListenerInvoker.java:93)
at weblogic.application.internal.flow.DeploymentCallbackFlow$1.next(DeploymentCallbackFlow.java:387)
at weblogic.application.utils.StateMachineDriver.nextState(StateMachineDriver.java:37)
at weblogic.application.internal.flow.DeploymentCallbackFlow.prepare(DeploymentCallbackFlow.java:58)
at weblogic.application.internal.flow.DeploymentCallbackFlow.prepare(DeploymentCallbackFlow.java:42)
at weblogic.application.internal.BaseDeployment$1.next(BaseDeployment.java:615)
at weblogic.application.utils.StateMachineDriver.nextState(StateMachineDriver.java:37)
at weblogic.application.internal.BaseDeployment.prepare(BaseDeployment.java:191)
at weblogic.application.internal.EarDeployment.prepare(EarDeployment.java:16)
at weblogic.application.internal.DeploymentStateChecker.prepare(DeploymentStateChecker.java:155)
at weblogic.deploy.internal.targetserver.AppContainerInvoker.prepare(AppContainerInvoker.java:60)
at weblogic.deploy.internal.targetserver.AppDeployment.prepare(AppDeployment.java:141)
at weblogic.management.deploy.internal.DeploymentAdapter$1.doPrepare(DeploymentAdapter.java:39)
at weblogic.management.deploy.internal.DeploymentAdapter.prepare(DeploymentAdapter.java:187)
at weblogic.management.deploy.internal.AppTransition$1.transitionApp(AppTransition.java:21)
at weblogic.management.deploy.internal.ConfiguredDeployments.transitionApps(ConfiguredDeployments.java:233)
at weblogic.management.deploy.internal.ConfiguredDeployments.prepare(ConfiguredDeployments.java:165)
at weblogic.management.deploy.internal.ConfiguredDeployments.deploy(ConfiguredDeployments.java:122)
at weblogic.management.deploy.internal.DeploymentServerService.resume(DeploymentServerService.java:173)
at weblogic.management.deploy.internal.DeploymentServerService.start(DeploymentServerService.java:89)
at weblogic.t3.srvr.SubsystemRequest.run(SubsystemRequest.java:64)
at weblogic.work.ExecuteThread.execute(ExecuteThread.java:201)
at weblogic.work.ExecuteThread.run(ExecuteThread.java:173)
"Timer-1" daemon prio=10 tid=0x609e3800 nid=0x197 in Object.wait() [0x605f7000..0x605f80b0]
java.lang.Thread.State: TIMED_WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0xf2d7a2c0> (a java.util.TaskQueue)
at java.util.TimerThread.mainLoop(Timer.java:509)
- locked <0xf2d7a2c0> (a java.util.TaskQueue)
at java.util.TimerThread.run(Timer.java:462)
"Timer-0" daemon prio=10 tid=0x609e0000 nid=0x196 in Object.wait() [0x62350000..0x62351130]
java.lang.Thread.State: TIMED_WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0xf2d7a3b0> (a java.util.TaskQueue)
at java.util.TimerThread.mainLoop(Timer.java:509)
- locked <0xf2d7a3b0> (a java.util.TaskQueue)
at java.util.TimerThread.run(Timer.java:462)
"RMI TCP Accept-9896" daemon prio=10 tid=0x61ebf800 nid=0x194 runnable [0x623ba000..0x623bb030]
java.lang.Thread.State: RUNNABLE
at java.net.PlainSocketImpl.socketAccept(Native Method)
at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:384)
- locked <0xf2d76210> (a java.net.SocksSocketImpl)
at java.net.ServerSocket.implAccept(ServerSocket.java:453)
at java.net.ServerSocket.accept(ServerSocket.java:421)
at sun.rmi.transport.tcp.TCPTransport$AcceptLoop.executeAcceptLoop(TCPTransport.java:369)
at sun.rmi.transport.tcp.TCPTransport$AcceptLoop.run(TCPTransport.java:341)
at java.lang.Thread.run(Thread.java:619)
"RMI TCP Accept-0" daemon prio=10 tid=0x61eb6c00 nid=0x193 runnable [0x6240b000..0x6240beb0]
java.lang.Thread.State: RUNNABLE
at java.net.PlainSocketImpl.socketAccept(Native Method)
at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:384)
- locked <0xf2da0170> (a java.net.SocksSocketImpl)
at java.net.ServerSocket.implAccept(ServerSocket.java:453)
at java.net.ServerSocket.accept(ServerSocket.java:421)
at sun.rmi.transport.tcp.TCPTransport$AcceptLoop.executeAcceptLoop(TCPTransport.java:369)
at sun.rmi.transport.tcp.TCPTransport$AcceptLoop.run(TCPTransport.java:341)
at java.lang.Thread.run(Thread.java:619)
"Low Memory Detector" daemon prio=10 tid=0x63b01400 nid=0x192 runnable [0x00000000..0x00000000]
java.lang.Thread.State: RUNNABLE
"CompilerThread1" daemon prio=10 tid=0x63901c00 nid=0x191 runnable [0x00000000..0x634f3278]
java.lang.Thread.State: RUNNABLE
"CompilerThread0" daemon prio=10 tid=0x63900800 nid=0x190 runnable [0x00000000..0x635742f8]
java.lang.Thread.State: RUNNABLE
"Signal Dispatcher" daemon prio=10 tid=0x0919e000 nid=0x18f waiting on condition [0x00000000..0x00000000]
java.lang.Thread.State: RUNNABLE
"Finalizer" daemon prio=10 tid=0x09183000 nid=0x18e in Object.wait() [0x63aad000..0x63aae130]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0xf2d8e2d0> (a java.lang.ref.ReferenceQueue$Lock)
at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:116)
- locked <0xf2d8e2d0> (a java.lang.ref.ReferenceQueue$Lock)
at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:132)
at java.lang.ref.Finalizer$FinalizerThread.run(Finalizer.java:159)
"Reference Handler" daemon prio=10 tid=0x09181c00 nid=0x18d in Object.wait() [0x63afe000..0x63afefb0]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0xf2daa4c8> (a java.lang.ref.Reference$Lock)
at java.lang.Object.wait(Object.java:485)
at java.lang.ref.Reference$ReferenceHandler.run(Reference.java:116)
- locked <0xf2daa4c8> (a java.lang.ref.Reference$Lock)
"main" prio=10 tid=0x0900f000 nid=0x17b in Object.wait() [0xf7f1d000..0xf7f1e208]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)
- waiting on <0xf2d723c8> (a weblogic.t3.srvr.SubsystemRequest)
at weblogic.t3.srvr.SubsystemRequest.rendezvouz(SubsystemRequest.java:100)
- locked <0xf2d723c8> (a weblogic.t3.srvr.SubsystemRequest)
at weblogic.t3.srvr.SubsystemRequest.action(SubsystemRequest.java:81)
at weblogic.t3.srvr.SubsystemRequest.start(SubsystemRequest.java:51)
at weblogic.t3.srvr.ServerServicesManager.startService(ServerServicesManager.java:457)
at weblogic.t3.srvr.ServerServicesManager.startInAdminState(ServerServicesManager.java:237)
- locked <0x6536b220> (a java.lang.Class for weblogic.t3.srvr.ServerServicesManager)
at weblogic.t3.srvr.T3Srvr.initializeAdmin(T3Srvr.java:738)
at weblogic.t3.srvr.T3Srvr.startup(T3Srvr.java:499)
at weblogic.t3.srvr.T3Srvr.run(T3Srvr.java:440)
at weblogic.Server.main(Server.java:67)
"VM Thread" prio=10 tid=0x0917e800 nid=0x18c runnable
"GC task thread#0 (ParallelGC)" prio=10 tid=0x09015c00 nid=0x17c runnable
"GC task thread#1 (ParallelGC)" prio=10 tid=0x09016c00 nid=0x17d runnable
"GC task thread#2 (ParallelGC)" prio=10 tid=0x09018000 nid=0x17e runnable
"GC task thread#3 (ParallelGC)" prio=10 tid=0x09019000 nid=0x17f runnable
"GC task thread#4 (ParallelGC)" prio=10 tid=0x0901a000 nid=0x180 runnable
"GC task thread#5 (ParallelGC)" prio=10 tid=0x0901b000 nid=0x181 runnable
"GC task thread#6 (ParallelGC)" prio=10 tid=0x0901c400 nid=0x182 runnable
"GC task thread#7 (ParallelGC)" prio=10 tid=0x0901d400 nid=0x183 runnable
"GC task thread#8 (ParallelGC)" prio=10 tid=0x0901e400 nid=0x184 runnable
"GC task thread#9 (ParallelGC)" prio=10 tid=0x0901f400 nid=0x185 runnable
"GC task thread#10 (ParallelGC)" prio=10 tid=0x09020800 nid=0x186 runnable
"GC task thread#11 (ParallelGC)" prio=10 tid=0x09021800 nid=0x187 runnable
"GC task thread#12 (ParallelGC)" prio=10 tid=0x09022800 nid=0x188 runnable
"GC task thread#13 (ParallelGC)" prio=10 tid=0x09023800 nid=0x189 runnable
"GC task thread#14 (ParallelGC)" prio=10 tid=0x09024c00 nid=0x18a runnable
"GC task thread#15 (ParallelGC)" prio=10 tid=0x09025c00 nid=0x18b runnable
"VM Periodic Task Thread" prio=10 tid=0x61ec2000 nid=0x195 waiting on condition
JNI global references: 957
Heap
PSYoungGen total 229376K, used 39147K [0xe4d70000, 0xf4d70000, 0xf4d70000)
eden space 196608K, 8% used [0xe4d70000,0xe5cf3870,0xf0d70000)
from space 32768K, 70% used [0xf2d70000,0xf4427708,0xf4d70000)
to space 32768K, 0% used [0xf0d70000,0xf0d70000,0xf2d70000)
PSOldGen total 1835008K, used 0K [0x74d70000, 0xe4d70000, 0xe4d70000)
object space 1835008K, 0% used [0x74d70000,0x74d70000,0xe4d70000)
PSPermGen total 62208K, used 62093K [0x64d70000, 0x68a30000, 0x74d70000)
object space 62208K, 99% used [0x64d70000,0x68a134a8,0x68a30000) -
WLS Admin and managed server startup issue
Hi ,
In one of WLS Domain both the Admin Server and Managed Server startup is just hanging at the below mentioned point :
<Security> <BEA-090082> <Security initializing using security realm myrealm.>
After this there are no error messages or logs being generated and the server start up is not proceeding .
Only message shown a while after this is :
Warning : domain runtime mbean server has not been found after trying for 600 seconds
Please provide some inputs on how to troubleshoot this issue .
Checked the AdminServer.log and there are no errors reported there as well .
Some more data from AdminServer.log :
<[ACTIVE] ExecuteThread: '0' for queue: 'weblogic.kernel.Default (self-tuning)'> <<WLS Kernel>> <> <> <1336448845368> <BEA-090516> <The Authenticator provider has preexisting LDAP data.>
<[ACTIVE] ExecuteThread: '0' for queue: 'weblogic.kernel.Default (self-tuning)'> <<WLS Kernel>> <> <> <1336448845632> <BEA-090516> <The Authorizer provider has preexisting LDAP data.>
<[ACTIVE] ExecuteThread: '0' for queue: 'weblogic.kernel.Default (self-tuning)'> <<WLS Kernel>> <> <> <1336448846193> <BEA-090516> <The CredentialMapper provider has preexisting LDAP data.>
<[ACTIVE] ExecuteThread: '0' for queue: 'weblogic.kernel.Default (self-tuning)'> <<WLS Kernel>> <> <> <1336448846208> <BEA-090516> <The RoleMapper provider has preexisting LDAP data.>
<[ACTIVE] ExecuteThread: '0' for queue: 'weblogic.kernel.Default (self-tuning)'> <<WLS Kernel>> <> <> <1336448846433> <BEA-090093> <No pre-WLS 8.1 Keystore providers are configured for server AdminServer for security realm myrealm.>
<[ACTIVE] ExecuteThread: '0' for queue: 'weblogic.kernel.Default (self-tuning)'> <<WLS Kernel>> <> <> <1336448846433> <BEA-090082> <Security initializing using security realm myrealm.>
Thanks
Srinath
Edited by: Srinath Menon on May 8, 2012 9:36 AMHi Ashish ,
Thanks for the inputs.
Tried the same steps as mentioned but the issue still remains like that .
Posting the thread dump collected for AdminServer:
===== FULL THREAD DUMP ===============
Tue May 8 10:04:58 2012
Oracle JRockit(R) R28.1.3-11-141760-1.6.0_24-20110301-1430-linux-ia32
"Main Thread" id=1 idx=0x4 tid=9341 prio=5 alive, waiting, native_blocked
-- Waiting for notification on: weblogic/t3/srvr/SubsystemRequest@0x9f81d3c0[fat lock]
at <unknown>(???.c)@0xb7fe9410
at eventTimedWaitNoTransitionImpl+79(event.c:90)@0xb7d6bae0
at syncWaitForSignalNoTransition+81(synchronization.c:28)@0xb7ee7c62
at syncWaitForSignal+157(synchronization.c:85)@0xb7ee7dbe
at syncWaitForJavaSignal+53(synchronization.c:93)@0xb7ee7ea6
at RJNI_jrockit_vm_Threads_waitForNotifySignal+53(rnithreads.c:72)@0xb7eb78a6
at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
at java/lang/Object.wait(J)V(Native Method)
at weblogic/t3/srvr/SubsystemRequest.rendezvouz(SubsystemRequest.java:100)
^-- Lock released while waiting: weblogic/t3/srvr/SubsystemRequest@0x9f81d3c0[fat lock]
at weblogic/t3/srvr/SubsystemRequest.action(SubsystemRequest.java:81)
at weblogic/t3/srvr/SubsystemRequest.start(SubsystemRequest.java:51)
at weblogic/t3/srvr/ServerServicesManager.startService(ServerServicesManager.java:459)
at weblogic/t3/srvr/ServerServicesManager.startInStandbyState(ServerServicesManager.java:166)
^-- Holding lock: java/lang/Class@0x9fa95598[biased lock]
at weblogic/t3/srvr/T3Srvr.initializeStandby(T3Srvr.java:879)
at weblogic/t3/srvr/T3Srvr.startup(T3Srvr.java:566)
at weblogic/t3/srvr/T3Srvr.run(T3Srvr.java:467)
at weblogic/Server.main(Server.java:71)
at jrockit/vm/RNI.c2java(IIIII)V(Native Method)
-- end of trace
"(Signal Handler)" id=2 idx=0x8 tid=9342 prio=5 alive, native_blocked, daemon
at <unknown>(???.c)@0xb7fe9410
at sigiSignalHandlerThread+135(signalhandler.c:131)@0xb7ec2fd8
at thread_stub+146(lifecycle.c:808)@0xb7e2c333
at start_thread+225(:0)@0x515832
at __clone+93(:0)@0x46ae0e
"(OC Main Thread)" id=3 idx=0xc tid=9343 prio=5 alive, native_waiting, daemon
at <unknown>(???.c)@0xb7fe9410
at eventTimedWaitNoTransitionImpl+79(event.c:90)@0xb7d6bae0
at syncWaitForSignalNoTransition+81(synchronization.c:28)@0xb7ee7c62
at innerNativeDoWait+894(nativelock.c:614)@0xb7e78caf
at nativeWait+71(nativelock.c:721)@0xb7e79008
at ocMainThread+663(gcthreads.c:581)@0xb7d8a098
at thread_stub+146(lifecycle.c:808)@0xb7e2c333
at start_thread+225(:0)@0x515832
at __clone+93(:0)@0x46ae0e
"(GC Worker Thread 1)" id=? idx=0x10 tid=9344 prio=5 alive, daemon
at <unknown>(???.c)@0xb7fe9410
at eventTimedWaitNoTransitionImpl+79(event.c:90)@0xb7d6bae0
at eventTimedWaitNoTransition+62(event.c:72)@0xb7d6bb3f
at eventWaitNoTransition+32(event.c:62)@0xb7d6bc31
at mmGCWorkerThread+134(gcthreads.c:797)@0xb7d89d67
at thread_stub+146(lifecycle.c:808)@0xb7e2c333
at start_thread+225(:0)@0x515832
at __clone+93(:0)@0x46ae0e
"(GC Worker Thread 2)" id=? idx=0x14 tid=9345 prio=5 alive, daemon
at <unknown>(???.c)@0xb7fe9410
at eventTimedWaitNoTransitionImpl+79(event.c:90)@0xb7d6bae0
at eventTimedWaitNoTransition+62(event.c:72)@0xb7d6bb3f
at eventWaitNoTransition+32(event.c:62)@0xb7d6bc31
at mmGCWorkerThread+134(gcthreads.c:797)@0xb7d89d67
at thread_stub+146(lifecycle.c:808)@0xb7e2c333
at start_thread+225(:0)@0x515832
at __clone+93(:0)@0x46ae0e
"(Code Generation Thread 1)" id=4 idx=0x18 tid=9348 prio=5 alive, native_waiting, daemon
at <unknown>(???.c)@0xb7fe9410
at eventTimedWaitNoTransitionImpl+79(event.c:90)@0xb7d6bae0
at syncWaitForSignalNoTransition+81(synchronization.c:28)@0xb7ee7c62
at innerNativeDoWait+894(nativelock.c:614)@0xb7e78caf
at nativeWait+71(nativelock.c:721)@0xb7e79008
at cg_thread+380(compilerqueue.c:203)@0xb7d4be5d
at thread_stub+146(lifecycle.c:808)@0xb7e2c333
at start_thread+225(:0)@0x515832
at __clone+93(:0)@0x46ae0e
"(Code Optimization Thread 1)" id=5 idx=0x1c tid=9349 prio=5 alive, native_waiting, daemon
at <unknown>(???.c)@0xb7fe9410
at eventTimedWaitNoTransitionImpl+79(event.c:90)@0xb7d6bae0
at syncWaitForSignalNoTransition+81(synchronization.c:28)@0xb7ee7c62
at innerNativeDoWait+894(nativelock.c:614)@0xb7e78caf
at nativeWait+71(nativelock.c:721)@0xb7e79008
at cg_thread+380(compilerqueue.c:203)@0xb7d4be5d
at thread_stub+146(lifecycle.c:808)@0xb7e2c333
at start_thread+225(:0)@0x515832
at __clone+93(:0)@0x46ae0e
"(VM Periodic Task)" id=6 idx=0x20 tid=9350 prio=10 alive, native_blocked, daemon
at <unknown>(???.c)@0xb7fe9410
at block_for_safepoint+106(safepoint.c:34)@0xb7ebad5b
at eventTimedWait+239(event.c:83)@0xb7d6bd30
at periodic_task_thread+627(periodictask.c:367)@0xb7e90dd4
at thread_stub+146(lifecycle.c:808)@0xb7e2c333
at start_thread+225(:0)@0x515832
at __clone+93(:0)@0x46ae0e
"Finalizer" id=7 idx=0x24 tid=9351 prio=8 alive, native_waiting, daemon
at <unknown>(???.c)@0xb7fe9410
at eventTimedWaitNoTransitionImpl+79(event.c:90)@0xb7d6bae0
at syncWaitForSignalNoTransition+81(synchronization.c:28)@0xb7ee7c62
at innerNativeDoWait+894(nativelock.c:614)@0xb7e78caf
at nativeWait+71(nativelock.c:721)@0xb7e79008
at RJNI_jrockit_memory_Finalizer_waitForFinalizees+211(finalhandles.c:1007)@0xb7d751f4
at jrockit/memory/Finalizer.waitForFinalizees(J[Ljava/lang/Object;)I(Native Method)
at jrockit/memory/Finalizer.access$700(Finalizer.java:12)
at jrockit/memory/Finalizer$4.run(Finalizer.java:189)
at java/lang/Thread.run(Thread.java:662)
at jrockit/vm/RNI.c2java(IIIII)V(Native Method)
-- end of trace
"Reference Handler" id=8 idx=0x28 tid=9352 prio=10 alive, native_waiting, daemon
at <unknown>(???.c)@0xb7fe9410
at eventTimedWaitNoTransitionImpl+79(event.c:90)@0xb7d6bae0
at syncWaitForSignalNoTransition+81(synchronization.c:28)@0xb7ee7c62
at innerNativeDoWait+894(nativelock.c:614)@0xb7e78caf
at nativeUnlockAndWait+71(nativelock.c:686)@0xb7e790a8
at RJNI_java_lang_ref_Reference_waitForActivatedQueue+38(semiref.c:342)@0xb7ebd9b7
at java/lang/ref/Reference.waitForActivatedQueue(J)Ljava/lang/ref/Reference;(Native Method)
at java/lang/ref/Reference.access$100(Reference.java:11)
at java/lang/ref/Reference$ReferenceHandler.run(Reference.java:82)
at jrockit/vm/RNI.c2java(IIIII)V(Native Method)
-- end of trace
"(Sensor Event Thread)" id=9 idx=0x2c tid=9353 prio=5 alive, native_blocked, daemon
at <unknown>(???.c)@0xb7fe9410
at eventTimedWaitNoTransitionImpl+79(event.c:90)@0xb7d6bae0
at eventTimedWaitNoTransition+62(event.c:72)@0xb7d6bb3f
at eventTimedWait+138(event.c:56)@0xb7d6bccb
at eventWait+32(event.c:50)@0xb7d6bd81
at sensor_event_loop+37(sensor.c:68)@0xb7ebfda6
at thread_stub+146(lifecycle.c:808)@0xb7e2c333
at start_thread+225(:0)@0x515832
at __clone+93(:0)@0x46ae0e
"VM JFR Buffer Thread" id=10 idx=0x30 tid=9354 prio=5 alive, in native, daemon
at <unknown>(???.c)@0xb7fe9410
at bufferthread+2135(vmjfr.c:1008)@0xb71744b8
at run_agent_thread+128(jvmtithreads.c:524)@0xb7e1f361
at thread_stub+146(lifecycle.c:808)@0xb7e2c333
at start_thread+225(:0)@0x515832
at __clone+93(:0)@0x46ae0e
"Timer-0" id=13 idx=0x34 tid=9358 prio=5 alive, waiting, native_blocked, daemon
-- Waiting for notification on: java/util/TaskQueue@0x9f9fc350[fat lock]
at <unknown>(???.c)@0xb7fe9410
at eventTimedWaitNoTransitionImpl+79(event.c:90)@0xb7d6bae0
at syncWaitForSignalNoTransition+81(synchronization.c:28)@0xb7ee7c62
at syncWaitForSignal+157(synchronization.c:85)@0xb7ee7dbe
at syncWaitForJavaSignal+53(synchronization.c:93)@0xb7ee7ea6
at RJNI_jrockit_vm_Threads_waitForNotifySignal+53(rnithreads.c:72)@0xb7eb78a6
at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
at java/lang/Object.wait(J)V(Native Method)
at java/lang/Object.wait(Object.java:485)
at java/util/TimerThread.mainLoop(Timer.java:483)
^-- Lock released while waiting: java/util/TaskQueue@0x9f9fc350[fat lock]
at java/util/TimerThread.run(Timer.java:462)
at jrockit/vm/RNI.c2java(IIIII)V(Native Method)
-- end of trace
"Timer-1" id=14 idx=0x38 tid=9363 prio=5 alive, waiting, native_blocked, daemon
-- Waiting for notification on: java/util/TaskQueue@0xa20ee240[fat lock]
at <unknown>(???.c)@0xb7fe9410
at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
at java/lang/Object.wait(J)V(Native Method)
at java/util/TimerThread.mainLoop(Timer.java:509)
^-- Lock released while waiting: java/util/TaskQueue@0xa20ee240[fat lock]
at java/util/TimerThread.run(Timer.java:462)
at jrockit/vm/RNI.c2java(IIIII)V(Native Method)
-- end of trace
"[ACTIVE] ExecuteThread: '0' for queue: 'weblogic.kernel.Default (self-tuning)'" id=15 idx=0x3c tid=9364 prio=5 alive, waiting, native_blocked, daemon
-- Waiting for notification on: netscape/ldap/LDAPResponseListener@0x9724f0c8[fat lock]
at <unknown>(???.c)@0xb7fe9410
at eventTimedWaitNoTransitionImpl+79(event.c:90)@0xb7d6bae0
at syncWaitForSignalNoTransition+81(synchronization.c:28)@0xb7ee7c62
at syncWaitForSignal+157(synchronization.c:85)@0xb7ee7dbe
at syncWaitForJavaSignal+53(synchronization.c:93)@0xb7ee7ea6
at RJNI_jrockit_vm_Threads_waitForNotifySignal+53(rnithreads.c:72)@0xb7eb78a6
at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
at java/lang/Object.wait(J)V(Native Method)
at java/lang/Object.wait(Object.java:485)
at netscape/ldap/LDAPMessageQueue.waitForMessage(LDAPMessageQueue.java:200)
^-- Lock released while waiting: netscape/ldap/LDAPResponseListener@0x9724f0c8[recursive]
at netscape/ldap/LDAPMessageQueue.waitFirstMessage(LDAPMessageQueue.java:101)
^-- Lock released while waiting: netscape/ldap/LDAPResponseListener@0x9724f0c8[fat lock]
at netscape/ldap/LDAPConnection.sendRequest(LDAPConnection.java:1796)
^-- Holding lock: netscape/ldap/LDAPConnection@0x9721f310[biased lock]
at netscape/ldap/LDAPConnection.simpleBind(LDAPConnection.java:1763)
at netscape/ldap/LDAPConnection.authenticate(LDAPConnection.java:1264)
at netscape/ldap/LDAPConnection.authenticate(LDAPConnection.java:1273)
at netscape/ldap/LDAPConnection.bind(LDAPConnection.java:1562)
at weblogic/security/providers/authentication/LDAPAtnDelegate$LDAPFactory.newInstance(LDAPAtnDelegate.java:4134)
at weblogic/security/utils/Pool.newInstance(Pool.java:37)
at weblogic/security/utils/Pool.getInstance(Pool.java:33)
at weblogic/security/providers/authentication/LDAPAtnDelegate.getConnection(LDAPAtnDelegate.java:3478)
at weblogic/security/providers/authentication/LDAPAtnDelegate.getConnection(LDAPAtnDelegate.java:3470)
at weblogic/security/providers/authentication/LDAPAtnDelegate.authenticate(LDAPAtnDelegate.java:3522)
at weblogic/security/providers/authentication/LDAPAtnLoginModuleImpl.login(LDAPAtnLoginModuleImpl.java:227)
at com/bea/common/security/internal/service/LoginModuleWrapper$1.run(LoginModuleWrapper.java:110)
at jrockit/vm/AccessController.doPrivileged(AccessController.java:254)
at jrockit/vm/AccessController.doPrivileged(AccessController.java:268)
at com/bea/common/security/internal/service/LoginModuleWrapper.login(LoginModuleWrapper.java:106)
at jrockit/vm/RNI.c2java(IIIII)V(Native Method)
at jrockit/vm/Reflect.invokeMethod(Ljava/lang/Object;Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;(Native Method)
at sun/reflect/NativeMethodAccessorImpl.invoke0(Ljava/lang/reflect/Method;Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;(Native Method)
at sun/reflect/NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun/reflect/DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java/lang/reflect/Method.invoke(Method.java:597)
at javax/security/auth/login/LoginContext.invoke(LoginContext.java:769)
at javax/security/auth/login/LoginContext.access$000(LoginContext.java:186)
at javax/security/auth/login/LoginContext$4.run(LoginContext.java:683)
at jrockit/vm/AccessController.doPrivileged(AccessController.java:254)
at jrockit/vm/AccessController.doPrivileged(AccessController.java:268)
at javax/security/auth/login/LoginContext.invokePriv(LoginContext.java:680)
at javax/security/auth/login/LoginContext.login(LoginContext.java:579)
at com/bea/common/security/internal/service/JAASLoginServiceImpl.login(JAASLoginServiceImpl.java:113)
at jrockit/vm/RNI.c2java(IIIII)V(Native Method)
at jrockit/vm/Reflect.invokeMethod(Ljava/lang/Object;Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;(Native Method)
at sun/reflect/NativeMethodAccessorImpl.invoke0(Ljava/lang/reflect/Method;Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;(Native Method)
at sun/reflect/NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun/reflect/DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java/lang/reflect/Method.invoke(Method.java:597)
at com/bea/common/security/internal/utils/Delegator$ProxyInvocationHandler.invoke(Delegator.java:57)
at $Proxy28.login(Ljava/lang/String;Ljavax/security/auth/callback/CallbackHandler;Lweblogic/security/service/ContextHandler;)Lcom/bea/common/security/service/Identity;(Unknown Source)
at weblogic/security/service/internal/WLSJAASLoginServiceImpl$ServiceImpl.login(WLSJAASLoginServiceImpl.java:89)
at com/bea/common/security/internal/service/JAASAuthenticationServiceImpl.authenticate(JAASAuthenticationServiceImpl.java:82)
at jrockit/vm/RNI.c2java(IIIII)V(Native Method)
at jrockit/vm/Reflect.invokeMethod(Ljava/lang/Object;Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;(Native Method)
at sun/reflect/NativeMethodAccessorImpl.invoke0(Ljava/lang/reflect/Method;Ljava/lang/Object;[Ljava/lang/Object;)Ljava/lang/Object;(Native Method)
at sun/reflect/NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun/reflect/DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java/lang/reflect/Method.invoke(Method.java:597)
at com/bea/common/security/internal/utils/Delegator$ProxyInvocationHandler.invoke(Delegator.java:57)
at $Proxy46.authenticate(Ljavax/security/auth/callback/CallbackHandler;Lweblogic/security/service/ContextHandler;)Lcom/bea/common/security/service/Identity;(Unknown Source)
at weblogic/security/service/WLSJAASAuthenticationServiceWrapper.authenticate(WLSJAASAuthenticationServiceWrapper.java:40)
at weblogic/security/service/PrincipalAuthenticator.authenticate(PrincipalAuthenticator.java:348)
at weblogic/security/service/CommonSecurityServiceManagerDelegateImpl.doBootAuthorization(CommonSecurityServiceManagerDelegateImpl.java:929)
at weblogic/security/service/CommonSecurityServiceManagerDelegateImpl.initialize(CommonSecurityServiceManagerDelegateImpl.java:1050)
at weblogic/security/service/SecurityServiceManager.initialize(SecurityServiceManager.java:873)
at weblogic/security/SecurityService.start(SecurityService.java:141)
at weblogic/t3/srvr/SubsystemRequest.run(SubsystemRequest.java:64)
at weblogic/work/ExecuteThread.execute(ExecuteThread.java:207)
at weblogic/work/ExecuteThread.run(ExecuteThread.java:176)
at jrockit/vm/RNI.c2java(IIIII)V(Native Method)
-- end of trace
"JFR request timer" id=16 idx=0x40 tid=9365 prio=5 alive, waiting, native_blocked, daemon
-- Waiting for notification on: java/util/TaskQueue@0xa2049280[fat lock]
at <unknown>(???.c)@0xb7fe9410
at eventTimedWaitNoTransitionImpl+79(event.c:90)@0xb7d6bae0
at syncWaitForSignalNoTransition+81(synchronization.c:28)@0xb7ee7c62
at syncWaitForSignal+157(synchronization.c:85)@0xb7ee7dbe
at syncWaitForJavaSignal+53(synchronization.c:93)@0xb7ee7ea6
at RJNI_jrockit_vm_Threads_waitForNotifySignal+53(rnithreads.c:72)@0xb7eb78a6
at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
at java/lang/Object.wait(J)V(Native Method)
at java/lang/Object.wait(Object.java:485)
at java/util/TimerThread.mainLoop(Timer.java:483)
^-- Lock released while waiting: java/util/TaskQueue@0xa2049280[fat lock]
at java/util/TimerThread.run(Timer.java:462)
at jrockit/vm/RNI.c2java(IIIII)V(Native Method)
-- end of trace
"weblogic.time.TimeEventGenerator" id=18 idx=0x44 tid=9366 prio=9 alive, waiting, native_blocked, daemon
-- Waiting for notification on: weblogic/time/common/internal/TimeTable@0xa2089c70[fat lock]
at <unknown>(???.c)@0xb7fe9410
at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
at java/lang/Object.wait(J)V(Native Method)
at weblogic/time/common/internal/TimeTable.snooze(TimeTable.java:286)
^-- Lock released while waiting: weblogic/time/common/internal/TimeTable@0xa2089c70[fat lock]
at weblogic/time/common/internal/TimeEventGenerator.run(TimeEventGenerator.java:117)
at java/lang/Thread.run(Thread.java:662)
at jrockit/vm/RNI.c2java(IIIII)V(Native Method)
-- end of trace
"JMAPI event thread" id=19 idx=0x48 tid=9367 prio=5 alive, in native, daemon
at <unknown>(???.c)@0xb7fe9410
at eventTimedWaitNoTransitionImpl+79(event.c:90)@0xb7d6bae0
at syncWaitForSignalNoTransition+81(synchronization.c:28)@0xb7ee7c62
at innerNativeDoWait+526(nativelock.c:614)@0xb7e78b3f
at nlMonitorWaitInner+79(nativelock.c:1112)@0xb7e78df0
at nlMonitorWaitNoTransition+38(nativelock.c:1132)@0xb7e78e47
at nativeRawMonitorWait+78(rawmonitor.c:161)@0xb7ea8caf
at jvmti_RawMonitorWait+111(jvmtirawmonitors.c:95)@0xb7e1b420
at threadProc+291(jmapi.c:305)@0x90452bd4
at run_agent_thread+128(jvmtithreads.c:524)@0xb7e1f361
at thread_stub+146(lifecycle.c:808)@0xb7e2c333
at start_thread+225(:0)@0x515832
at __clone+93(:0)@0x46ae0e
"weblogic.timers.TimerThread" id=20 idx=0x4c tid=9368 prio=9 alive, waiting, native_blocked, daemon
-- Waiting for notification on: weblogic/timers/internal/TimerThread@0xa203dbf0[fat lock]
at <unknown>(???.c)@0xb7fe9410
at jrockit/vm/Threads.waitForNotifySignal(JLjava/lang/Object;)Z(Native Method)
at java/lang/Object.wait(J)V(Native Method)
at weblogic/timers/internal/TimerThread$Thread.run(TimerThread.java:262)
^-- Lock released while waiting: weblogic/timers/internal/TimerThread@0xa203dbf0[fat lock]
at jrockit/vm/RNI.c2java(IIIII)V(Native Method)
-- end of trace -
Diskgroup not mounted during cluster startup
Hi,
I have a 2 node RAC(11GR2) on VMWare 7.1.4. OS is Solaris 10
I have registered 2 instances in the cluster.
srvctl add database -d dbrac -o /u01/app/oracle/product/11.2.0/dbhome_1 -a "extdg,nordg"
srvctl add instance -d dbrac -i dbrac2 -n vmsol2
srvctl add instance -d dbrac -i dbrac1 -n vmsol1
After after registering the 2 instances, initially the instance were automatically up when ever I execute a ./crsctl start cluster.
But now the database instances on both nodes are not comming up; only ASM is up.
While checking ASM disk group, I found EXTDG and NORDG is not mounted. So I mounted the disk group and started the database.
Then I manually mounted, the disk groups and started the database.
SQL> alter diskgroup nordg mount;
Diskgroup altered
SQL> alter diskgroup extdg mount;
Later I tried removing the the database configuration from the cluster using SRVCTL and added the database to cluster again.
srvctl remove instance -d dbrac -i dbrac1
srvctl remove instance -d dbrac -i dbrac2
srvctl remove database -d dbrac
srvctl add database -d dbrac -o /u01/app/oracle/product/11.2.0/dbhome_1 -a "extdg,nordg"
srvctl add instance -d dbrac -i dbrac2 -n vmsol2
srvctl add instance -d dbrac -i dbrac1 -n vmsol1
Still database is not starting during cluster startup.
Why did the disk group is not getting mounted while cluster is starting? Can someone help me?
Regards,
Mat
Edited by: user11278087 on Mar 9, 2012 7:37 PM
Edited by: user11278087 on Mar 9, 2012 7:41 PM
Edited by: user11278087 on Mar 9, 2012 7:42 PMHi,
Thank you for your replay.
Disk group was mounting previously without doing any modification in spfile after executing the following commands.
srvctl add database -d dbrac -o /u01/app/oracle/product/11.2.0/dbhome_1 -a "extdg,nordg"
srvctl add instance -d dbrac -i dbrac2 -n vmsol2
srvctl add instance -d dbrac -i dbrac1 -n vmsol1
But suddenly this issue happened.
I do not have metalink access. Could you please help me?
Regards,
Mat. -
My new MacBook Pro 17" has been having startup issues recently. After I shut down, leave, and come back, the startup issue occurs.
After pressing the power button, fans will go on, proccessing noises occur, HOWEVER, it just boots to a white/grey screen W/OUT the apple logo or round loading bar. The keyboard does not initialize either.
The only thing that I have found to 'fix' it, is just to leave it powered off for an extended period of time. It will then boot up.
I have tried many non-software related 'cures', and my compuer is completely up to date on all OsX software.
Any ideas guys??you can try to boot to safe mode ( restart holding Shift )
- you can attempt to boot to install disc and disk utility
- you can boot to AHT ( apple hardware test ) to see what component is failing ( insert disc, restart holding D )
- chances are, this is a hardware issue though. you will probably need repairs. -
Startup issue - Process 'Starting Framework'
Hi
I seem to have a startup issue with NM2004s. I get a Half Green/ Half Yellow icon in the MMC. The 01 instance is always yellow and never progresses onto green. I have a process status of 'starting framework'.
Anyone else had this issue?
Cheers
IanHi Ian,
I just installed the J2E on a laptop that already has a NSP instance.I am facing the same issue on the J2E.Do you remember if you could resolve this and how?
Any hints would help.
Thank you -
Startup issue - Managed Server Soa_server1
Hi,
Can anyone share your expertise on the following as I am getting this error When I try to start soa_server1 by startManagedWebllogic.cmd on win 32bit.
Thanks in advance,
Prasad.
starting weblogic with Java version:
java version "1.6.0_29"
Java(TM) SE Runtime Environment (build 1.6.0_29-b11)
Java HotSpot(TM) Client VM (build 20.4-b02, mixed mode)
Starting WLS with line:
d:\Oracle\MIDDLE~1\JDK160~1\bin\java -client -Xms512m -Xmx768m -XX:PermSize=128m -XX:MaxPermSize=768m -Dweblogic.Name=soa_server1 -Djava.security.policy=D:\Oracle\MIDDLE~1\WLSERV~1.1\server\lib\weblogic.policy -Djava.security.debug=jpspolicy weblogic.Server
<12 Aug, 2013 8:45:07 AM IST> <Info> <Security> <BEA-090905> <Disabling CryptoJ JCE Provider self-integrity check for better startup performance. To enable this check, specify -Dweblogic.security.allowCryptoJDefaultJCEVerification=true>
<12 Aug, 2013 8:45:07 AM IST> <Info> <Security> <BEA-090906> <Changing the default Random Number Generator in RSA CryptoJ from ECDRBG to FIPS186PRNG. To disable this change, specify -Dweblogic.security.allowCryptoJDefaultPRNG=true>
<12 Aug, 2013 8:45:08 AM IST> <Info> <WebLogicServer> <BEA-000377> <Starting WebLogic Server with Java HotSpot(TM) Client VM Version 20.4-b02 from Sun Microsystems Inc..>
<12 Aug, 2013 8:45:09 AM IST> <Info> <Management> <BEA-141107> <Version: WebLogic Server Temporary Patch for 13340309 Thu Feb 16 18:30:21 IST 2012
WebLogic Server Temporary Patch for 13019800 Mon Jan 16 16:53:54 IST 2012
WebLogic Server Temporary Patch for BUG13391585 Thu Feb 02 10:18:36 IST 2012
WebLogic Server Temporary Patch for 13516712 Mon Jan 30 15:09:33 IST 2012
WebLogic Server Temporary Patch for BUG13641115 Tue Jan 31 11:19:13 IST 2012
WebLogic Server Temporary Patch for BUG13603813 Wed Feb 15 19:34:13 IST 2012
WebLogic Server Temporary Patch for 13424251 Mon Jan 30 14:32:34 IST 2012
WebLogic Server Temporary Patch for 13361720 Mon Jan 30 15:24:05 IST 2012
WebLogic Server Temporary Patch for BUG13421471 Wed Feb 01 11:24:18 IST 2012
WebLogic Server Temporary Patch for BUG13657792 Thu Feb 23 12:57:33 IST 2012
WebLogic Server 12.1.1.0 Wed Dec 7 08:40:57 PST 2011 1445491 >
<12 Aug, 2013 8:45:11 AM IST> <Critical> <WebLogicServer> <BEA-000362> <Server failed. Reason:
There are 1 nested errors:
weblogic.management.ManagementException: Booting as admin server, but servername, soa_server1, does not match the admin server name, AdminServer
at weblogic.management.provider.internal.RuntimeAccessService.start(RuntimeAccessService.java:67)
at weblogic.t3.srvr.ServerServicesManager.startService(ServerServicesManager.java:461)
at weblogic.t3.srvr.ServerServicesManager.startInStandbyState(ServerServicesManager.java:166)
at weblogic.t3.srvr.T3Srvr.initializeStandby(T3Srvr.java:883)
at weblogic.t3.srvr.T3Srvr.startup(T3Srvr.java:570)
at weblogic.t3.srvr.T3Srvr.run(T3Srvr.java:469)
at weblogic.Server.main(Server.java:74)
>
<12 Aug, 2013 8:45:11 AM IST> <Notice> <WebLogicServer> <BEA-000365> <Server state changed to FAILED.>
<12 Aug, 2013 8:45:11 AM IST> <Error> <WebLogicServer> <BEA-000383> <A critical service failed. The server will shut itself down.>
<12 Aug, 2013 8:45:11 AM IST> <Notice> <WebLogicServer> <BEA-000365> <Server state changed to FORCE_SHUTTING_DOWN.>
<12 Aug, 2013 8:45:12 AM> <FINEST> <NodeManager> <Waiting for the process to die: 5876>
<12 Aug, 2013 8:45:12 AM> <INFO> <NodeManager> <Server failed during startup so will not be restarted>
<12 Aug, 2013 8:45:12 AM> <FINEST> <NodeManager> <runMonitor returned, setting finished=true and notifying waiters>Sorry this is the correct info..
starting weblogic with Java version:
Starting WLS with line:
d:\Oracle\MIDDLE~1\JDK160~1\bin\java -client -Xms512m -Xmx768m -XX:PermSize=128m -XX:MaxPermSize=768m -Dweblogic.Name=soa_server1 -Djava.security.policy=D:\Oracle\MIDDLE~1\WLSERV~1.1\server\lib\weblogic.policy -Djava.security.debug=jpspolicy weblogic.Server
<12 Aug, 2013 8:33:15 AM IST> <Info> <Security> <BEA-090905> <Disabling CryptoJ JCE Provider self-integrity check for better startup performance. To enable this check, specify -Dweblogic.security.allowCryptoJDefaultJCEVerification=true>
<12 Aug, 2013 8:33:15 AM IST> <Info> <Security> <BEA-090906> <Changing the default Random Number Generator in RSA CryptoJ from ECDRBG to FIPS186PRNG. To disable this change, specify -Dweblogic.security.allowCryptoJDefaultPRNG=true>
<12 Aug, 2013 8:33:16 AM IST> <Info> <WebLogicServer> <BEA-000377> <Starting WebLogic Server with Java HotSpot(TM) Client VM Version 20.4-b02 from Sun Microsystems Inc..>
<12 Aug, 2013 8:33:16 AM IST> <Info> <Management> <BEA-141107> <Version: WebLogic Server Temporary Patch for 13340309 Thu Feb 16 18:30:21 IST 2012
WebLogic Server Temporary Patch for 13019800 Mon Jan 16 16:53:54 IST 2012
WebLogic Server Temporary Patch for BUG13391585 Thu Feb 02 10:18:36 IST 2012
WebLogic Server Temporary Patch for 13516712 Mon Jan 30 15:09:33 IST 2012
WebLogic Server Temporary Patch for BUG13641115 Tue Jan 31 11:19:13 IST 2012
WebLogic Server Temporary Patch for BUG13603813 Wed Feb 15 19:34:13 IST 2012
WebLogic Server Temporary Patch for 13424251 Mon Jan 30 14:32:34 IST 2012
WebLogic Server Temporary Patch for 13361720 Mon Jan 30 15:24:05 IST 2012
WebLogic Server Temporary Patch for BUG13421471 Wed Feb 01 11:24:18 IST 2012
WebLogic Server Temporary Patch for BUG13657792 Thu Feb 23 12:57:33 IST 2012
WebLogic Server 12.1.1.0 Wed Dec 7 08:40:57 PST 2011 1445491 >
<12 Aug, 2013 8:33:18 AM IST> <Critical> <WebLogicServer> <BEA-000362> <Server failed. Reason:
There are 1 nested errors:
weblogic.management.ManagementException: Booting as admin server, but servername, soa_server1, does not match the admin server name, AdminServer
at weblogic.management.provider.internal.RuntimeAccessService.start(RuntimeAccessService.java:67)
at weblogic.t3.srvr.ServerServicesManager.startService(ServerServicesManager.java:461)
at weblogic.t3.srvr.ServerServicesManager.startInStandbyState(ServerServicesManager.java:166)
at weblogic.t3.srvr.T3Srvr.initializeStandby(T3Srvr.java:883)
at weblogic.t3.srvr.T3Srvr.startup(T3Srvr.java:570)
at weblogic.t3.srvr.T3Srvr.run(T3Srvr.java:469)
at weblogic.Server.main(Server.java:74)
>
<12 Aug, 2013 8:33:18 AM IST> <Notice> <WebLogicServer> <BEA-000365> <Server state changed to FAILED.>
<12 Aug, 2013 8:33:18 AM IST> <Error> <WebLogicServer> <BEA-000383> <A critical service failed. The server will shut itself down.>
<12 Aug, 2013 8:33:18 AM IST> <Notice> <WebLogicServer> <BEA-000365> <Server state changed to FORCE_SHUTTING_DOWN.> -
Startup issue when having more than one database on machine
Startup issue when having more than one database on machine:
I’ve installed two databases.
When I shutdown one of the database and try to start it up using
Startup pfile=’…location..’;
I get ora-12514: TNS: listener does not currently know of service rquirest in connect descriptor
when I try it again after 3 seconds, I get a new error, ora-01041: internal error. Hostdef extension doesn’t exist
Shutdown and Startup gave no problems when I had one database. Why am I getting problems when I have two databases?
I’m using: show parameter pfile|spfile; to make sure I have the right parameter locations, so the error shouldn’t be from location.
I’ve never installed two databases on one machine, so maybe I’m making a first-timer’s error.
Anyone know how to get this working, i.e. starting and stopping DB without issues?
Using oracle 11gR2 on Windows 7 64bit, all is working normal.
Thanks,
Ayman
Edited by: aymanzone on Jun 15, 2011 9:27 AMaymanzone wrote:
my oracle_sid is set to the name of one of my databases
echo %oracle_sid%
shows me the name of my first database.
Still not working though.
When I start the services of both databases using Services, I can connect and run queries from both of the database.
Edited by: aymanzone on Jun 15, 2011 11:47 AMFirstly ... the Oracle Service for the instance should be started for the DB you are trying to connect or start.
Next ... from the command prompt:
set oracle_sid=<Instance_Name>
sqlplus sys as sysdba
startup pfile='location of the respective db pfile'
Now, if you want to start or connect to another DB which is on the same server (again assuming the Service is STARTED) ...
From the same command prompt session or other ....
set oracle_sid=<Other_Instance_Name>
sqlplus sys as sysdba
startup pfile='location of the respective db pfile'
Edited by: Srikanth on Jun 16, 2011 12:27 AM -
Jaas.jar conflict in Weblogic 6.1 cluster
We are using a Custom realm for Weblogic which communicates with Tivoli Policy
director for user authentication and authorization.
For communicating with PolicyDirector, We need to have IBM's jaas.jar as a JDK
extension(in jre/lib/ext directory)along with some more jar files.We never had
problems when running Weblogic in stand alone mode.But when we are trying to run
Weblogic as a cluster, Managed Server is not able to communicate with Admin Server
giving following exception:
Starting WebLogic Server ....
Connecting to http://166.57.31.66:8101...
<Feb 7, 2002 1:52:26 PM EST> <Info> <Logging> <FileLogger Opened.>
<Feb 7, 2002 1:52:27 PM EST> <Info> <Posix Performance Pack> <System has file
descriptor limits of - soft: '1024', hard: '1024'>
<Feb 7, 2002 1:52:27 PM EST> <Info> <Posix Performance Pack> <Using effective
file descriptor limit of: '1024' open sockets/files.>
<Feb 7, 2002 1:52:27 PM EST> <Info> <Posix Performance Pack> <Allocating: '3'
POSIX reader threads>
<Feb 7, 2002 1:52:28 PM EST> <Emergency> <Configuration Management> <Errors detected
attempting to connect to admin server at 166.57.31.66:8101 during initialization
of managed server ( 166.57.31.69:8001 ). The reported error was: < null > This
condition generally results when the managed and admin servers are using the same
listen address and port.>
<Feb 7, 2002 1:52:28 PM EST> <Emergency> <Server> <Unable to initialize the server:
'Fatal initialization exception
Throwable: weblogic.management.configuration.ConfigurationException - with nested
exception:
[javax.naming.AuthenticationException [Root exception is java.lang.SecurityException:
attempting to add an object which is not an instance of java.security.Principal
to a Subject's Principal Set]]
javax.naming.AuthenticationException. Root exception is java.lang.SecurityException:
attempting to add an object which is not an instance of java.security.Principal
to a Subject's Principal Set
at javax.security.auth.Subject$SecureSet.add(d:/jn130-userlvl/src/classes/sov/javax/security/auth/Subject.java:1098)
at weblogic.common.internal.BootServicesStub.writeUserInfoToSubject(BootServicesStub.java:72)
at weblogic.common.internal.BootServicesStub.authenticate(BootServicesStub.java:80)
at weblogic.security.acl.internal.Security.authenticate(Security.java:108)
at weblogic.jndi.WLInitialContextFactoryDelegate.pushUser(WLInitialContextFactoryDelegate.java:509)
at weblogic.jndi.WLInitialContextFactoryDelegate.newContext(WLInitialContextFactoryDelegate.java:364)
at weblogic.jndi.WLInitialContextFactoryDelegate.getInitialContext(WLInitialContextFactoryDelegate.java:336)
at weblogic.jndi.Environment.getContext(Environment.java:156)
at weblogic.jndi.Environment.getInitialContext(Environment.java:139)
at weblogic.management.Admin.initializeRemoteAdminHome(Admin.java:950)
at weblogic.management.Admin.start(Admin.java:351)
at weblogic.t3.srvr.T3Srvr.initialize(T3Srvr.java:372)
at weblogic.t3.srvr.T3Srvr.run(T3Srvr.java:202)
at weblogic.Server.main(Server.java:35)
--------------- nested within: ------------------
weblogic.management.configuration.ConfigurationException - with nested exception:
[javax.naming.AuthenticationException [Root exception is java.lang.SecurityException:
attempting to add an object which is not an instance of java.security.Principal
to a Subject's Principal Set]]
at weblogic.management.Admin.initializeRemoteAdminHome(Admin.java:959)
at weblogic.management.Admin.start(Admin.java:351)
at weblogic.t3.srvr.T3Srvr.initialize(T3Srvr.java:372)
at weblogic.t3.srvr.T3Srvr.run(T3Srvr.java:202)
at weblogic.Server.main(Server.java:35)
When we removed IBM's jaas.jar from jdk/jre/lib/ext to check the clustering.It
works fine.But We need to have jaas.jar for our custom realm.
Thanks.
Jagan.Hi jerry
i already got that problem solved by removing jaas.jar file
from class path.
i don'nt how it is working with out in classpath...?
Jerry <[email protected]> wrote:
Hi Nivas,
I think that the problem you are seeing has something to do with the
placement of jaas.jar in your classpath
On WebLogic server, put jaas.jar in the classpath after weblogic.jar.
I would bet that you have it placed before weblogic.jar right now.
I don't think the exception that you're seeing right now has anything
to do with your weblogic.policy file right now, so I think it is
safe to not worry about it right now.
Hope this helps,
Joe Jerry -
Routing and Remote access can cause cluster network issues?
After enabling routing and remote access on the servers, we found lots of cluster issues on our server like<o:p></o:p>
Cluster Service stopped
Communication was lost and reestablished between cluster nodes
Unable to access witness resource
Cluster resource failed
can RRAS enabling causes cluster network issues?
RahulHi TwoR,
Please offer more information about your current cluster and RRAS configuration, such as are you installed the RRAS role on any cluster node? Are your cluster in Hyper-V environment?
Or if you want to create the RRAS cluster you can refer the following KB:
Deploy Remote Access in a Cluster
http://technet.microsoft.com/en-us/library/jj134175.aspx
How to configure Network Load Balancing (NLB) based cluster of VPN Servers
http://blogs.technet.com/b/rrasblog/archive/2009/07/02/configuring-network-load-balancing-nlb-cluster-of-vpn-servers.aspx
I’m glad to be of help to you!
We
are trying to better understand customer views on social support experience, so your participation in this
interview project would be greatly appreciated if you have time.
Thanks for helping make community forums a great place. -
I have a problem with system startup. My MacBook is pretty much brand new and the system is not cluttered or anything. And still the startup-process freezes even before the apple logo appears, so I just get the grey screen and that's it. I have read about other startup issues, but in those cases the computer at least booted until the apple logo was shown, so my case is slightly different.
After unplugging my external USB hard drive startup works. It also works when I plug it into the other USB-slot. Other devices plugged into the problematic slot (keyboard, USB-stick) work and do not cause problems during startup.
Any experiences with this problem? Would you say the USB-slot is broken in any way? Is it something that can be fixed?
Ordinarily, I would just use the other slot and be done with it. Since the computer is brand new, however, I'd prefer to be on the safe side.
Thanks in advance,
TimoHi
+"Would you say the USB-slot is broken in any way?"+
Possibly? Running an Apple Hardware Test might say?
+"Is it something that can be fixed?"+
Yes. It should be covered under the standard 1 year warranty regardless. Provided the fault is not down to wilful or accidental damage it will be covered under the warranty.
You could connect the external USB hard drive in the affected slot an restart the mac in verbose mode (command+v) at restart. This should display error messages - if any - at the point where the start-up stalls. Possibly giving a clue as to what it's having a problem with? You may see an I/OKit error problem or something similar?
Tony -
Hi,everyone:
I am running into this error when I call a webService :My weblogic version is 10.3.5 and have applied the patch N5G9.
javax.xml.ws.soap.SOAPFaultException: ClusterRoutingTubeUtils weblogic.wsee.jaxws.cluster.ClusterRoutingTubeUtils@6ad8e382 not ready, no WseeClusterRoutingRuntimeMBean/WseeRuntimeMBean
at com.sun.xml.ws.fault.SOAP11Fault.getProtocolException(SOAP11Fault.java:197)
at com.sun.xml.ws.fault.SOAPFaultBuilder.createException(SOAPFaultBuilder.java:122)
at com.sun.xml.ws.client.sei.SyncMethodHandler.invoke(SyncMethodHandler.java:125)
at com.sun.xml.ws.client.sei.SyncMethodHandler.invoke(SyncMethodHandler.java:95)
at com.sun.xml.ws.client.sei.SEIStub.invoke(SEIStub.java:136)
at $Proxy117.getLoginUserInfoByCzryDm(Unknown Source)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at weblogic.wsee.jaxws.spi.ClientInstanceInvocationHandler.invoke(ClientInstanceInvocationHandler.java:84)
at $Proxy118.getLoginUserInfoByCzryDm(Unknown Source)
at com.hkgt.sso.access.ZRWebServiceProxyImpl.getLoginUserInfoByCzryDm(ZRWebServiceProxyImpl.java:106)
at com.hkgt.sso.access.WebServiceAuthenticationHandler.doAuthentication(WebServiceAuthenticationHandler.java:71)
at com.hkgt.sso.access.AMManagerImpl.doAuthentication(AMManagerImpl.java:165)
at com.hkgt.sso.authserver.SSOLoginServlet.doPost(SSOLoginServlet.java:175)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:727)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:820)
at weblogic.servlet.internal.StubSecurityHelper$ServletServiceAction.run(StubSecurityHelper.java:227)
at weblogic.servlet.internal.StubSecurityHelper.invokeServlet(StubSecurityHelper.java:125)
at weblogic.servlet.internal.ServletStubImpl.execute(ServletStubImpl.java:300)
at weblogic.servlet.internal.TailFilter.doFilter(TailFilter.java:26)
at weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:56)
at weblogic.servlet.internal.RequestEventsFilter.doFilter(RequestEventsFilter.java:27)
at weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:56)
at weblogic.servlet.internal.WebAppServletContext$ServletInvocationAction.wrapRun(WebAppServletContext.java:3723)
at weblogic.servlet.internal.WebAppServletContext$ServletInvocationAction.run(WebAppServletContext.java:3689)
at weblogic.security.acl.internal.AuthenticatedSubject.doAs(AuthenticatedSubject.java:321)
at weblogic.security.service.SecurityManager.runAs(SecurityManager.java:120)
at weblogic.servlet.internal.WebAppServletContext.securedExecute(WebAppServletContext.java:2285)
at weblogic.servlet.internal.WebAppServletContext.execute(WebAppServletContext.java:2184)
at weblogic.servlet.internal.ServletRequestImpl.run(ServletRequestImpl.java:1459)
at weblogic.work.ExecuteThread.execute(ExecuteThread.java:209)
at weblogic.work.ExecuteThread.run(ExecuteThread.java:178)
However it works fine under another machine(say machine A) when I call the same webservice. I tried to copy the whole domain to the problematic machine, this error still appears.
Does anyone have any suggestions. Thank you !Hi,everyone:
I am running into this error when I call a webService :My weblogic version is 10.3.5 and have applied the patch N5G9.
javax.xml.ws.soap.SOAPFaultException: ClusterRoutingTubeUtils weblogic.wsee.jaxws.cluster.ClusterRoutingTubeUtils@6ad8e382 not ready, no WseeClusterRoutingRuntimeMBean/WseeRuntimeMBean
at com.sun.xml.ws.fault.SOAP11Fault.getProtocolException(SOAP11Fault.java:197)
at com.sun.xml.ws.fault.SOAPFaultBuilder.createException(SOAPFaultBuilder.java:122)
at com.sun.xml.ws.client.sei.SyncMethodHandler.invoke(SyncMethodHandler.java:125)
at com.sun.xml.ws.client.sei.SyncMethodHandler.invoke(SyncMethodHandler.java:95)
at com.sun.xml.ws.client.sei.SEIStub.invoke(SEIStub.java:136)
at $Proxy117.getLoginUserInfoByCzryDm(Unknown Source)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at weblogic.wsee.jaxws.spi.ClientInstanceInvocationHandler.invoke(ClientInstanceInvocationHandler.java:84)
at $Proxy118.getLoginUserInfoByCzryDm(Unknown Source)
at com.hkgt.sso.access.ZRWebServiceProxyImpl.getLoginUserInfoByCzryDm(ZRWebServiceProxyImpl.java:106)
at com.hkgt.sso.access.WebServiceAuthenticationHandler.doAuthentication(WebServiceAuthenticationHandler.java:71)
at com.hkgt.sso.access.AMManagerImpl.doAuthentication(AMManagerImpl.java:165)
at com.hkgt.sso.authserver.SSOLoginServlet.doPost(SSOLoginServlet.java:175)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:727)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:820)
at weblogic.servlet.internal.StubSecurityHelper$ServletServiceAction.run(StubSecurityHelper.java:227)
at weblogic.servlet.internal.StubSecurityHelper.invokeServlet(StubSecurityHelper.java:125)
at weblogic.servlet.internal.ServletStubImpl.execute(ServletStubImpl.java:300)
at weblogic.servlet.internal.TailFilter.doFilter(TailFilter.java:26)
at weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:56)
at weblogic.servlet.internal.RequestEventsFilter.doFilter(RequestEventsFilter.java:27)
at weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:56)
at weblogic.servlet.internal.WebAppServletContext$ServletInvocationAction.wrapRun(WebAppServletContext.java:3723)
at weblogic.servlet.internal.WebAppServletContext$ServletInvocationAction.run(WebAppServletContext.java:3689)
at weblogic.security.acl.internal.AuthenticatedSubject.doAs(AuthenticatedSubject.java:321)
at weblogic.security.service.SecurityManager.runAs(SecurityManager.java:120)
at weblogic.servlet.internal.WebAppServletContext.securedExecute(WebAppServletContext.java:2285)
at weblogic.servlet.internal.WebAppServletContext.execute(WebAppServletContext.java:2184)
at weblogic.servlet.internal.ServletRequestImpl.run(ServletRequestImpl.java:1459)
at weblogic.work.ExecuteThread.execute(ExecuteThread.java:209)
at weblogic.work.ExecuteThread.run(ExecuteThread.java:178)
However it works fine under another machine(say machine A) when I call the same webservice. I tried to copy the whole domain to the problematic machine, this error still appears.
Does anyone have any suggestions. Thank you ! -
Have any ideas re: G5 startup issues? Long post...
My dual processor G5 (purchased Jan. 2005) is in the shop, and, of course, out of warranty. It's been down for over two weeks. Here is the story of its demise:
Installed 10.4.9 upgrade. Began having "launch systems" and crashdump/usb crash errors thereafter. Not a lot of info online regarding these problems, so I decided to do an archive and re-install of my system software.
Started having intermittent problems restarting the G5. Either it would chime, but not kick on the monitor, chime and kick on the monitor but hang at the grey apple startup screen, or not chime at all, with which only the fans would come on. Apple Extended Hardware Test came back OK. Still had problems after removing my USB devices.
Problems continued after the reinstall of the system software, eventually to the point where I could not even boot from a CD. When the G5 did operate, after a short period of use it would freeze, and I would have to force a restart and pray it would boot up completely. It would reliably freeze after waking it from sleep, but also froze in iPhoto and Finder as well.
I have tried resetting the PMU and the PRAM with no improvement. Took it to an Apple Authorized Service Center, luckily only a couple miles from where I work. They tried booting with the Apple RAM only, then the third party RAM only, no improvement. Hard drive was completely reformatted and system reinstalled, no improvement. I am waiting to hear what else they've tried.
My G5's serial # falls outside of those involved with the power supply issues. Yet, could this be a possibility? Any other ideas as to what the problem could be, or has anyone had similar issues?
I freelance as a graphic designer and this has me in a panic. Now using the hubby's Intel iMac to run CS2 and it's a drag.
Thanks in advance.Hi and thanks for the input. I just spoke to the Apple service guy and he still insists there is not a hardware issue. Apparently there is an Apple technical doc, available only to authorized techs, that refers to this particular issue, and the fix is a download and install (firmware, perhaps?) He has to contact Apple and confirm my G5 is within the serial # range for this particular fix.
That's my best interpretation of our discussion. He was rather cryptic. But he says it's not the power supply.
I did an archive and install because, like an idiot, I did not have anything backed up at that point. After that failed, I used up my stash of DVDs and copied gigs to our iMac until the G5 gave out. I had run the hardware test several times and each time came back clean.
Permissions were repaired before and after updates; had it freeze a couple times mid-update. Tried booting in safe mode and single-user mode and still had the same startup issues.
To add insult to injury, I purchased a LaCie Porsche external drive as an eventual backup drive whenever the G5 returns. Hooked it up to our iMac to backup the items I saved off the G5. It failed after the second use. Returned for replacement.
Thanks.
G5 Dual 2.5 MHz Mac OS X (10.4.8)
Maybe you are looking for
-
Parking documents through program ZLOADGL
How to trigger the DERIVATION button while parking the documents through the standard program ZLOADGL ?
-
I wanna know,which module is best to get trained in.Is it SD or MM?I've learnt SAP - ABAP.Is it good to shift to Functional at this point of time?Basically i'm from Electronics background. It would be great if you could help me out in this issue?
-
Airport express identification and 1st and 2nd generation connectivity
Hi I have three questions regarding airport express 1. How do i know what model airport express i have? i'm not sure if i bought before or after 2008 if it operates with 802.11b/g or 802.11a/b/g/Draft N 2. Second question is if I have the 802.11a/b/g
-
Unable to just "select" the whole clip.
Every time I click on a clip in the Event Library the default range selection appears on the clip. As a result I am unable to just "select" the whole clip. The "Select" tool has been selected from the Dashboard. How do I get back to being able to
-
I cannot download java. Why? I have windows 98 OS. In tools I have enable java checked so that is not the problem. It works when I use internet explorer so why can't I use it or download it with firefox? Also I don't have java listed in the add\remov