10.4.8 server "hangs" EVERY morning around 6am

Hi team,
We have a basic file server running 10.4.8 server, with AFP and SMB services running only, its our main fileserver for sharing files only. Pretty basic.
The last week, it has been going into a non responsive state, when I remote desktop to it and run "top", all processes are running at pretty much zero%, except "coreservices", this is running at 100.1%!!!! Can anyone tell me what this is and why it may have just started doing this? Nothing has changed on the server and the only way to get it back up and running until the following morning is by force restarting machine (which obviously isn't good!!)
We thought it might be a screensaver thing, but the screensaver is set to "never" anyway.
We have "superduper" installed which clones the system every night to an external drive, but this has shows on the screen as having run successfully, and besides we have had this software installed for months and its run without a hitch.
We are hesitate to run the server update as we can't afford the down time in case it gets worse.
Please help!!
Whats wrong here?

Retrospect 6.1 is running fine on my 10.4.8 server test machine.
-Ralph

Similar Messages

Mac server hangs every few days. where to look for cause?

I have a Mac server that hangs every few days and requires a hard reboot.
It is run headless so we have no screen feed back of what is happening when it hangs.
It is possible that just the network communications fail. But it is in software because a reboot restores the situation everytime.
I could use some advice on where to look for possible causes: which logs, or dumps that are produced by the system.
Thanks

These instructions must be carried out as an administrator.
Launch the Console application.
Step 1
For this step, the title of the Console window should be All Messages. If it isn't, select
          SYSTEM LOG QUERIES ▹ All Messages
from the log list on the left. If you don't see that list, select
          View ▹ Show Log List
from the menu bar at the top of the screen.
In the top right corner of the Console window, there's a search box labeled Filter. Initially the words "String Matching" are shown in that box. Enter "BOOT_TIME" (without the quotes.)
Each message in the log begins with the date and time when it was entered. Note the timestamps of the BOOT_TIME log messages, which refer to the times when the system was started. Now clear the search box and scroll back in the log to the last boot time when you had the problem. Select the messages logged before the boot, during the time something abnormal was happening. Copy them to the Clipboard by pressing the key combination command-C. Paste into a reply to this message by pressing command-V.
For example, if the system was unresponsive or was failing to shut down for three minutes before you forced a restart, post the messages timestamped within three minutes before the boot time, not after. Please include the BOOT_TIME message at the end of the log extract—not at the beginning.
If there are long runs of repeated messages, please post only one example of each. Don’t post many repetitions of the same message.
☞ When posting a log extract, be selective. A few dozen lines are almost always more than enough.
☞ Some private information, such as your name, may appear in the log. Anonymize before posting.
Please don't indiscriminately dump thousands of lines from the log into this discussion.
Please don't post screenshots of log messages—post the text.
Step 2
In the Console window, select
          DIAGNOSTIC AND USAGE INFORMATION ▹ System Diagnostic Reports
(not Diagnostic and Usage Messages) from the log list on the left. If you don't see that list, select
          View ▹ Show Log List
from the menu bar.
There is a disclosure triangle to the left of the list item. If the triangle is pointing to the right, click it so that it points down. You'll see a list of reports. A crash report has a name that begins with the name of the crashed process and ends in ".crash". A panic report has a name that begins with "Kernel" and ends in ".panic". A shutdown stall report has a name that ends in ".shutdownstall". Select the most recent of each, if any. The contents of the report will appear on the right. Use copy and paste to post the entire contents—the text, not a screenshot. It's possible that none of these reports exists.
I know the report is long, maybe several hundred lines. Please post all of it anyway.
☞ If you don't see any reports listed, but you know there was a crash or panic, you may have chosen Diagnostic and Usage Messages from the log list. Choose DIAGNOSTIC AND USAGE INFORMATION instead.
In the interest of privacy, I suggest that, before posting, you edit out the “Anonymous UUID,” a long string of letters, numbers, and dashes in the header of the report, if it’s present (it may not be.)
☞ Please don’t post other kinds of diagnostic report—they're very long and rarely helpful.

CF Server hangs every few days

Every couple of days, ranging from 1 day to 2 weeks, we get
an application that hangs when trying to access a page that uses a
database query. I have to manually restart the CF application
server service to correct the problem. I am unsure what is causing
this.
My Server.log shows multiple entries of the same error
message, but reported in 30 second intervals (which I believe is
due to the option in CF administrator "Timeout Requests after (
seconds ) [30]" )
Here is one line of the Server.log, and this line repeats
over and over in close to 30 second intervals:
"Warning","jrpp-206","02/23/07","13:51:36",,"Thread:
jrpp-206, processing template:
C:\Inetpub\wwwroot\CFMX7\tagout\login.cfm, completed in 30 seconds,
exceeding the 30 second warning limit"
this error message continued through "completed in 1009
seconds" before I restarted the CF service.
When I restart the server, is all back to normal. Sometimes
it can go only a few days before hanging, sometimes up to 2 weeks.
But rarely longer than 2 weeks without a hang.
I have read the "ColdFusion MX Hanging Condition
Investigation" thread, but I didn't get much help from it. I
couldn't tell if my problem was either of the cases described. So
I've come here hoping that someone has the answer! :)

If you are running on MS Access, be sure to disable "Maintain
Connections".
You will also likely benefit by using the Jadozoom JDBC
Driver instead of the native ODBC drivers.
See
http://www.adobe.com/go/2d2a7a19
and
http://www.adobe.com/go/tn_17034
If you are using an enterprise database with JDBC support,
you may benefit by updating to the 3.5 JDBC drivers:
See
http://www.adobe.com/go/42dcb10a
You also may benefit from the "Database Design" section of
this article:
http://www.adobe.com/go/tn_17054

IPod waking me up every morning around 3am

In the middle of the night, every night, my ipod lights up and plays 5 or 6 loud alternating tones. The sound comes out of some internal speaker, because I hear it even when the ipod isn't plugged in to any speakers or headphones.
I've tried doing Settings->Reset All, which didn't change anything. Has anyone seen this problem before?

I have the EXACT same thing. It just started recently, or at least I just started noticing. But I googled the topic and mostly people just say it's the alarm. However, I checked the alarm and although there was a little bell next to the Alarm. The alarm was actually set for 12am but the time zone was set for the west coast which would make it 3 am on the east coast. However, I didn't even know how to get into the alarm clock so obviously have no idea how it got set. But, I will say the alarm was set and the time does make sense. The ipod turned out and even plugged into a set of headphones there is some kind of external speaker that allows the ipod to chime out loud.
Bottom line--check the alarm because it's probably been inadvertently set.

Wls6.1withsp2 Server hangs

 Hi,
 I am facing a problem with weblogic6.0 with sp2.I am doing a loadtest on wls6.0.After
 around 40,000th clients acceses the servlet,server hangs forever.
 Whether this may be due to below things----as written in the release doc of
 wls6.0
 " WebLogic Server may hang when used with the HotSpot server VM on Windows NT
 or Windows 2000. Use the HotSpot client VM on Windows NT or Windows 2000
 instead.
 I noticed that memory usage reaches the peak around 40000th client.I ran same
 application under wls5.1 but no problem.
 Please help me.
 Regards,
 Jango


Chris,
It seems to be quite abnormal to have a full GC every 2 mins. Did you
try taking a thread dump any time. If you take a thred dump, you can
analyze to see the threads are spending most of the time. It might
give you a good idea on where to start with and focus. Also try using
the alternate thread Library found under /usr/lib/lwp. This might help
some times. I assume you are using Server JVM. If not use Server JVM
by adding -server to the command line arguments.
Can you post the ThreadCount and Percentage of threads used as socket
readers (found under DomainName->Servers->ManagedServerName->Tuning).
You can tweak these parameters to make the server span more threads
which will help if you have lot of request coming in and if you see
lot of queing.
-Kiran
Chris Drake <[email protected]> wrote in message news:<[email protected]>...
Hello,
I have a WLS6.1 environment with (2) JVM's in a cluster on the sameSol2.8 server. While applying a load on the server one of the two
JVM's will stop resonding and will stack up outstanding requests.
After about 2 minutes, the JVM will "wake up" and begin to process the
outstanding requests until it catches up. After an indeterminate
period of time, the patter will repeat. There are no errors in the
logs but the JVM's will do a full GC every 2 minutes.
The listener threads will max out and pile up outstanding requests. The 8.1.7 JDBC connections will go from a typical 4 concurrent to the max limit of 40 concurrent. I cant tell what happens first. The front end, (listener threads)or the back end (jdbc connections).
Here is the startup parameters
JAVA_OPTIONS="-ms600m -mx600m -XX:NewSize=128m -XX:MaxNewSize=128m -XX:SurvivorRatio=8 -noclassgc -verbose:gc"
HEre is what I have tried so far...
SP3, SP4, Java 1.3.1_03, (1) JVM, (3) JVM's

BBM & Email stop working every morning....

Every morning my BBM, Whatsapp, Email and Facebook notifications stop working....
BBM has a red clock when sending and doesn't receive and the others don't receive or send anything...
The only fix has been pulling the battery or doing a soft reset with ctrl+alt+delete.
I have tried reinstalling the apps, reinstalling the OS (don't know how to format and reinstall tho)
Can anyone give me some solutions? Does it sound like a hardware problem?
My phone is a brand new out the box Blackberry Curve 8520, its got an etisalat sim card as I live in Dubai if that matters.

Cat and Maximo,
> Let me try to get that straight. Your BM does static NAT for your
> mailserver (and other boxes), and suddenly UDP and ICMP from these
> natted servers through the BM still works, but TCP doesn't?
Yes. That's what it looks like.
> Can you still do TCP *to* the BM from the natted devices when that
> happens? As you say your proxy continues to work, it sounds as if TCP in
> general on the server continues to work, but does it also work from the
> mailserver?
Everyone browsing via BM proxy continues with no interuption.
The mail server can telnet to any other server on the internal LAN but
nothing past BM. DNS continues working for the mail server too.
> If really nothing changed, this might be a (succesful) DOS attack of
> some sort. I wonder if a LAN trace could reveal anything of interest.
Do you mean port scan the BM server?
I know that "nothing has changed" is a loaded statement. The only thing
(that I know of) that has changed relatively recently is the addition of
the Squid server. It has been running behind the BM server for about 3
weeks. Recently I added a filter exception allowing the Squid server to
access higher ports (dyn/tcp).
But, as I noted before, I think removing ipflt should eliminate any
doubts there. Is there some way Squid could be corrupting something there?
The problem was compounded this morning (saturday). I came in today so I
would have the network essentially to myself. But, to my surprise,
everything was ok.
Cat, You're right. This server is no spring chicken. It is an IBM
Netfinity 3000. Its probably 3 or 4 years old (maybe more). I will think
about this as a hardware problem but I just wish the thing would die
altogether and get it over with. :o)
Thanks,
Brian

CS4 InDesign Server hangs

I've ran into a problem where the my CS4 InDesign Server hangs.
I'm adding pages dynamically using the JAVA API. Basically I go through all the content, check to see if I've reached the ParagraphStyle that indicates the "end" of the document. If not, I add a page, flow the content into a text frame on that page & check if I've reached the end. If not I add another page. And so on until I finally reach the end. But it ends up hanging while attempting to do this. What's odd, it works the first 5-10 times, but it takes longer and longer each time it adds a page until around the 10th page or so, it completely stops. I'm using the "duplicate(OptLocationOptionsEnum arg0, OptVariableType arg1)" method on the com.adobe.ids.layout.Page object.
Any ideas? I can provide sample code if it would help.
-Josh

Hi Chandi,
      If Microsoft fix is not working or it is too old to apply then go for manual process i.e.;
      In the Microsoft KB article follow this :-
     Services that use the local system account to log on to a Windows Server 2003-based computer start if the Allow service to interact with desktop
     option is turned on. To turn this option on, follow these steps:
In the Services tool, click the service that you want to start, and then click Properties.
Right-click the Log On tab, and then click to select the Allow service to interact with desktop check box.
Click OK to exit the Properties dialog box.
   This will solve your problem.
   Thanks,
   Akansh Upadhyaya,
   System Engineer,
   (Windows + Unix.)

Server hangs or freezes during heavy load

During peak times of the day, especially during heavy load on the Calendar Server,
the application seems to hang. The client side application will not respond on
the user's desktop, and uni* commands on the server itself respond considerably
slow.

There are two parameters in the server configuration file that are strongly
believed to be a trigger of server hangs or freezes in large deployments and/or
busy servers. Here is a description of the problem:

Large deployments tend to be 3000+ users per node. This could be a single or
multi-node environment.

A lock manager fix was implemented in 4.0 to correct a problem that was
found in 3.51 where the server would hang. At that time, the parameters called
read/writelocktimeouts
were introduced as a failover mechanism in case the
database was not available, which would then trigger the client process to
disconnect rather than hang the whole server.

These timeouts effectively will terminate a process whose read or write exceeds
the specified periods. The default of 20 seconds is quite a large amount of time;
however, it is not totally unlikely that such a value could be met on a
very busy system. If this is the case, and there is some relation between a
process being terminated by one of these timeouts and subsequent system
instability, then the "solution" would not be to extend the values of the
timeouts but rather to exclude them. This way, it will ensure that no process is
terminated this way and therefore the process would be allowed to continue until
it had completed its job.

The timeouts were not removed from the product, but under normal circumstances
they probably won't be needed anymore anyhow. It seems that on a busy calendar
server, setting the db timeout alarms may actually trigger the server to freeze.
Below are some examples of errors that appear in the log files which show
that the database is no longer accepting client requests:

db_VISTA ERROR -920 -> cst_d_open: d_open
db_SchedBaseOpen: unable to open database
probable cause: unilckd is down or "/users/unison/tmp/unisonlckm"
was removed
uniengd: database lock timeout
ITEM: "NA,NA" <0,0>
CLIENT: "unises", "A.02.80"
INET-NAME:
INET-ADDR:
CALL: "SessionsInfoGet"

To make the fix:
<OL>
<LI>Using your favorite editor, edit the /users/unison/misc/unison.ini file.
In the following section you will see these two parameters:

[ENG]
writelocktimeout = 20
readlocktimeout = 20

<LI>Place a "#" sign (or the appropriate comment symbol for your OS) in front of
these two lines and save the file.

<LI>The server will now have to be restarted in order for the changes to take
effect.
</OL>

This looks similar to what I'm seeing.
DPM 2010, there's one backup set (for me a file server disk) that every time I try to run the initial replica on it the server hangs and needs to be rebooted by iLO. It doesn't just die suddenly, first the data stream on the backup stops then the OS becomes
less responsive but there is no resource issue. trying to open event view will cause a few things to lock up then over a few mins the server is complete froze. like the disk drives have been locked.
Suspecting McAfee, I added in all the exclusions, that didn't help so I added the process exclusions which are done by setting dpmra and csc to low risk and that didn't help either. I could reproduce it just by kicking off a backup for this one file servers
drive so it's easy to test with.
Tonight, I had some permissions in EPO to let me stop the scanning completely and disable the on-access scan and for the first time it worked!
There is definitely an issue between DPM and McAfee beyond what is on MS's web page for AV checks.
I don't have a workaround yet other than stopping the AV completely... Something to follow up on next week. For the moment I made some progress though.

EIS Server hangs

Dear All,
We have Hyperion 9.3V EIS running on windows. A schedule job runs every hour which
1. Builds and loads data into an ASO cube
2. Only builds a BSO cube.
The problem here is that the EIS server hangs during the BSO outline build (after loading the Metadata Catalog information). It is needed to restart the server each time it hangs and runs sucessfully for some time and then starts hang. Searched the EIS server log and essbase and application log but no information was found. But in the event viewer it shows there has been a problem with the GLOBLC.32 dll.
Need your help identifying what exactly the issue is and how can i overcome it?
Thanks,
Praveen

EIS is notorious for crashing. I found if I stop and start the service between steps, I don't run into a problem. I just add a netstop and netstart into my batch script (I also put in a sleep 30 to allow it time to stop and start)

Every morning receive Event Source MSExchange Common ID 4999

Every morning at 2/2/2012 2:06:02 AM
for weeks now we receive Event Source MSExchange Common ID
SBS 2011
Standard – Exchange 2010 => build 14.01.0355.002 (Update Rollup 6 for Exchange Server 2010 SP1)
Event Details:
Watson report about to be sent for process id: 12000, with parameters: E12, c-buddy-RTL-AMD64, 14.01.0355.001, BPA, M.E.Data.Directory, M.E.D.D.DSAccessTopologyProvider..ctor, S.IO.FileLoadException, 72f, 14.01.0355.001. ErrorReportingEnabled:
False
This is an Intel machine so we are not sure why there is “AMD64” in the details - This Event does not seem to cause any problem that we can detect.
Anyone tried
- Exchange Server 2010 SP2 December 4, 2011 Build 14.2.247.6 on a SBS2011 Standard yet? -
Since one of the KB articles – I found says -
Maybe -
http://support.microsoft.com/kb/2447629 (Rollup 3 but we have 6)

Hi,
It seems that the issue is related to the special characters in the database name cause an
IndexOutOfRangeException exception. This exception crashes the
MSExchangeServicesAppPool application pool.
For more detailed information, you could refer to the article below:
Title: Event ID 4999 is logged on an Exchange Server 2010 Client Access server (CAS)
URL:
http://support.microsoft.com/kb/2665115
From the KB article resolution, you need to obtain Interim Update (IU) by contacting Microsoft Customer Service and Support.
Regards,
James
James Xiong
TechNet Community Support

App Server stalls every 2-3 deployments of ADF BC - Anyone seen/fixed this?

Hello,
I am running Jdev 10.1.3.2 and the App Server is 10.1.3.
We have a separate OC4J container that we have created on the App Server for the ADF BC applications. This is because we were having library conflicts with other non ADF BC applications and Oracle advised us to create a seperate container.
I can usually deploy to the server 2-3 times in this OC4J container and then the application server hangs up during deployment and must be restarted. The applications outside of our container still run. I can deploy the non ADF BC projects to the original HOME container over and over with no problems.
Does anyone know of any possible reason for this? The ADF Runtime Libraries are installed in our specific container. Is there some other installation that we might be missing that could be causing this?
Every time it hangs up, I have to contact and wait for someone to restart the App server. It has been frustrating.
Thanks,
Cindy

Hello,
I am running Jdev 10.1.3.2 and the App Server is 10.1.3.
We have a separate OC4J container that we have created on the App Server for the ADF BC applications. This is because we were having library conflicts with other non ADF BC applications and Oracle advised us to create a seperate container.
I can usually deploy to the server 2-3 times in this OC4J container and then the application server hangs up during deployment and must be restarted. The applications outside of our container still run. I can deploy the non ADF BC projects to the original HOME container over and over with no problems.
Does anyone know of any possible reason for this? The ADF Runtime Libraries are installed in our specific container. Is there some other installation that we might be missing that could be causing this?
Every time it hangs up, I have to contact and wait for someone to restart the App server. It has been frustrating.
Thanks,
Cindy

Server Hangs while compiling some EJB in Weblogic 6.1 SP5 on AIX 4.3.3

Hi,
Iam not able to deploy a J2EE application in WebLogic 6.1 SP5 on an AIX 4.3.3
box.
CMP is being used and my EJBs are not being compiled( though there are no errors
thrown).
Iam using IBM DB2 ver 8.0 DB as client and server.
While compiling, the server Hangs, displaying the message "<Info> <Management>
<Configuration changes for domain saved to the repository.>"
Is there any configuration Issues with weblogic 6.1 SP5 and AIX 4.3.3?
Because the same EAR works in SP3.
Please help ASAP.
Thanks in advance.
Nagesh

The only thing to do again with "hangs" is to take thread dumps. As for why
things are going wrong...... I am at a loss other than some AIX weirdness.
Cheers
mbg
"Deshpande" <[email protected]> wrote in message
news:[email protected]...
>
Hi Mark,
I tried it out ....I ran EJBC on all my EJB's and then tried to deploy myapplication.
Application got deployed and the server was up, but JSP's dosent getcompiled(
i.e when I want to run my application, my server hangs again).
I tried one more option.. I pointed my JAVAHOME in startweblogic.sh to anSP3
JDK .. and it worked!! Now with this JDK Iam able to deploy my entireapplication
( with out precompiled) also run through the application without anyproblems.
I then over wrote the existing JDK ( of SP5 ) with that of SP3 and thentried.
Which also works fentastically!!!
I can feel something fishy here ....
Any help in this regard is most welcome.
Thanks and Regards...
Nagesh
"Mark Griffith" <[email protected]> wrote:
Deshpande:
"Deshpande" <[email protected]> wrote in message
news:[email protected]...
Hi Mark,
Thanks again.
For
Q1> How much time was between the two dumps?
A1> There was a minute gap B/w the two dumps. ( since it took so longto
write
the Core)
Q2> How long have you waited with no progress seeming to be made?
A1> Over a whole night. ( appx 14 hours).
Now I believe you would have figured out what the problem is.Not sure if this is a statement saying you think I have figured it out,
or a
statement saying you think I should have figured it out but I haven't.
Anyway... Did you try running ejbc on the "app" first?
Meanwhile also it would be great, if you would tell me the proceduresto
get support
form the BEA and AIX to solve the Issue.
http://www.bea.com/framework.jsp?CNT=index.htm&FP=/content/services/custome
r_support/contacts/
>>
I would suggest sending as much detail as possible, including zips of
the
thread dumps and pointers to this newsgroup conversation [email protected]
>>
I do however suggest you first try running ejbc.
Cheers
mbg
Thanks in advance.
R
Deshpande.
"Mark Griffith" <[email protected]> wrote:
Nagesh:
Wow, AXI outputs some interesting thread dumps. ;)
So the interesting thread (and the problem) is:
"main" (TID:0x300C41D8, sys_thread_t:0x30010A60, state:CW, native
ID:0x1)
prio=5
at java.lang.Object.wait(Native Method)
at java.lang.Object.wait(Object.java:429)
at java.lang.UNIXProcess.waitFor(UNIXProcess.java:130)
at weblogic.utils.Executable.exec(Executable.java(Compiled Code))
at weblogic.utils.Executable.exec(Executable.java(Inlined CompiledCode))
at
weblogic.utils.compiler.CompilerInvoker.compileMaybeExit(CompilerInvoker.j
a
v
a(Compiled Code))
at
weblogic.utils.compiler.CompilerInvoker.compile(CompilerInvoker.java(Inlin
e
d
Compiled Code))
at
weblogic.ejb20.ejbc.EJBCompiler.compileEJB(EJBCompiler.java(Compiled
Code))
at weblogic.ejb20.deployer.Deployer.runEJBC(Deployer.java(InlinedCompiled
Code))
at weblogic.ejb20.deployer.Deployer.compileEJB(Deployer.java(Compiled
Code))
at weblogic.ejb20.deployer.Deployer.deploy(Deployer.java(CompiledCode))
at weblogic.j2ee.EJBComponent.deploy(EJBComponent.java:33)
at weblogic.j2ee.Application.addComponent(Application.java:176)
at weblogic.j2ee.J2EEService.addDeployment(J2EEService.java:117)
at
weblogic.management.mbeans.custom.DeploymentTarget.addDeployment(Deploymen
t
T
arget.java(Compiled Code))
at
weblogic.management.mbeans.custom.DeploymentTarget.addDeployments(Deployme
n
t
Target.java:286)
at
weblogic.management.mbeans.custom.DeploymentTarget.updateServerDeployments
D
eploymentTarget.java:239)
at
weblogic.management.mbeans.custom.DeploymentTarget.updateDeployments(Deplo
y
m
entTarget.java:199)
at java.lang.reflect.Method.invoke(Native Method)
at
weblogic.management.internal.DynamicMBeanImpl.invokeLocally(DynamicMBeanIm
p
l
..java(Compiled Code))
at
weblogic.management.internal.DynamicMBeanImpl.invoke(DynamicMBeanImpl.java
C
ompiled Code))
at
weblogic.management.internal.ConfigurationMBeanImpl.invoke(ConfigurationMB
e
a
nImpl.java:374)
atcom.sun.management.jmx.MBeanServerImpl.invoke(MBeanServerImpl.java:1557)
atcom.sun.management.jmx.MBeanServerImpl.invoke(MBeanServerImpl.java:1525)
atweblogic.management.internal.MBeanProxy.invoke(MBeanProxy.java(Compiled
Code))
atweblogic.management.internal.MBeanProxy.invoke(MBeanProxy.java(Compiled
Code))
at $Proxy34.updateDeployments(Unknown Source)
at
weblogic.management.configuration.ServerMBean_CachingStub.updateDeployment
s
ServerMBean_CachingStub.java:3015)
at
weblogic.management.mbeans.custom.ApplicationManager.startConfigManager(Ap
p
l
icationManager.java:376)
at
weblogic.management.mbeans.custom.ApplicationManager.start(ApplicationMana
g
e
r.java:164)
at java.lang.reflect.Method.invoke(Native Method)
at
weblogic.management.internal.DynamicMBeanImpl.invokeLocally(DynamicMBeanIm
p
l
..java(Compiled Code))
at
weblogic.management.internal.DynamicMBeanImpl.invoke(DynamicMBeanImpl.java
C
ompiled Code))
at
weblogic.management.internal.ConfigurationMBeanImpl.invoke(ConfigurationMB
e
a
nImpl.java:374)
atcom.sun.management.jmx.MBeanServerImpl.invoke(MBeanServerImpl.java:1557)
atcom.sun.management.jmx.MBeanServerImpl.invoke(MBeanServerImpl.java:1525)
atweblogic.management.internal.MBeanProxy.invoke(MBeanProxy.java(Compiled
Code))
atweblogic.management.internal.MBeanProxy.invoke(MBeanProxy.java(Compiled
Code))
at $Proxy48.start(Unknown Source)
at
weblogic.management.configuration.ApplicationManagerMBean_CachingStub.star
t
ApplicationManagerMBean_CachingStub.java:480)
at weblogic.management.Admin.startApplicationManager(Admin.java:1309)
at weblogic.management.Admin.finish(Admin.java:650)
at weblogic.t3.srvr.T3Srvr.start(T3Srvr.java:547)
at weblogic.t3.srvr.T3Srvr.run(T3Srvr.java:214)
at weblogic.Server.main(Server.java:35)
So the Server never gets out of the Main thread to run, because theEJBC
compilation is "stuck", ejbc is running because either the EJB being
deployed was previously deployed on a different version of WLS orejbc
had
never been run on those beans. Either there is a problem on the AIX
VM
where execing processes are not returning, OR the ejb that ejbc isrunning
on is huge and is taking a REALLY long time. How much time was
between
the
two dumps? How long have you waited with no progress seeming to bemade?
Depending on the answers to these questions it maybe that there isa
VM bug
and you will need to contact BEA support to see the procedure forworking
with AIX to resolve the issue.
You maybe able to work around the problem by running EJBC on the ejb
in
question prior to starting the server.
http://edocs.bea.com/wls/docs61/ejb/EJB_utilities.html#1075296
Cheers
mbg
"deshpande" <[email protected]> wrote in message
news:[email protected]...
Hi, Mark,
Thanks for the early reply.
I have attached two consecutive dumps Zipped.
Pls look into the same and helpme out.
Thanks in advance.
Regards,
Nagesh
"Mark Griffith" <[email protected]> wrote:
When it hangs, you need to get thread dumps.
"kill -3 PID" is how this works on Solaris. Additionally if the
terminal/shell has focus that started the process you can do "CTRL
Break"
as
well. The thread dumps will go to std-out/err, so you'll have
to
redierect
std-out and err of the shell. (Make sure you don't nohup the
process
(if
AIX even supports that) since this prevents sigquits). When thehang
occurs
take a thread dump, wait 10 seconds and take another one, thenplease
zip
and attach the file in a post.
Cheers
mbg
"Deshpande" <[email protected]> wrote in message
news:[email protected]...
Hi,
Iam not able to deploy a J2EE application in WebLogic 6.1 SP5
on
an
AIX
4.3.3
box.
CMP is being used and my EJBs are not being compiled( though
there
are no
errors
thrown).
Iam using IBM DB2 ver 8.0 DB as client and server.
While compiling, the server Hangs, displaying the message "<Info><Management>
<Configuration changes for domain saved to the repository.>"
Is there any configuration Issues with weblogic 6.1 SP5 and AIX
4.3.3?
Because the same EAR works in SP3.
Please help ASAP.
Thanks in advance.
Nagesh

WebLogic 8.1 hanging every 1 to 14 days

Hi folks,
I am new to WebLogic. We had WebLogic 8.1 sp3 running fine on a RedHat AS 3 machine. We ported application to a new RedHat AS 3 machine. The web server started to hang every few days. We patched to WebLogic 8.1 sp5. No help. We switched JVM from Jrockit to Sun JVM. No help. We changed garbage collection methods. No help.
Here is a section from my std out with a thread dump. If anyone could give me some pointers, I would be forever in your debt.
Thanks in advance.
[ParNew 139393K->35017K(511232K), 0.0159350 secs]
[ParNew 139977K->33634K(511232K), 0.0323530 secs]
<Jun 1, 2006 9:19:07 AM EDT> <Error> <WebLogicServer> <BEA-000337> <ExecuteThread: '49' for queue: 'weblogic.kernel.Default' has been busy for "746" seconds working on the request "Http Request: /psp/fs8prd/EMPLOYEE/ERP/h/", which is more than the configured time (StuckThreadMaxTime) of "600" seconds.>
java.lang.NullPointerException
 at psft.pt8.portal.PIADirectConnection.getHeaderField(PIADirectConnection.java:156)
 at psft.pt8.portal.ContentGetter.setRefreshCookie(ContentGetter.java:1015)
 at psft.pt8.portal.ContentGetter.getPIADirectContent(ContentGetter.java:366)
 at psft.pt8.portal.ContentGetter.getPIADirectContent(ContentGetter.java:281)
 at psft.pt8.portal.ContentGetter.getPIADirectContent(ContentGetter.java:277)
 at psft.pt8.portal.ContentGetter.getContent(ContentGetter.java:519)
 at psft.pt8.portal.ContentGetter.getContent(ContentGetter.java:470)
 at psft.pt8.portal.ContentGetter.getContent(ContentGetter.java:467)
 at psft.pt8.portal.template.IClientComponent.doGetContent(IClientComponent.java:381)
 at psft.pt8.portal.template.IClientComponent.getContent(IClientComponent.java:273)
 at psft.pt8.portal.PageAssembler.getPIAContent(PageAssembler.java:739)
 at psft.pt8.portal.PageAssembler.replaceComponent(PageAssembler.java:525)
 at psft.pt8.portal.PageAssembler.replaceComponentTags(PageAssembler.java:219)
 at psft.pt8.portal.PageAssembler.assemble(PageAssembler.java:109)
 at psft.pt8.psp.onStartTab(psp.java:1873)
 at psft.pt8.psp.service(psp.java:603)
 at javax.servlet.http.HttpServlet.service(HttpServlet.java:853)
 at weblogic.servlet.internal.ServletStubImpl$ServletInvocationAction.run(ServletStubImpl.java:1072)
 at weblogic.servlet.internal.ServletStubImpl.invokeServlet(ServletStubImpl.java:465)
 at weblogic.servlet.internal.TailFilter.doFilter(TailFilter.java:28)
 at weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:27)
 at psft.pt8.psfilter.doFilter(psfilter.java:76)
 at weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:27)
 at weblogic.servlet.internal.WebAppServletContext$ServletInvocationAction.run(WebAppServletContext.java:6987)
 at weblogic.security.acl.internal.AuthenticatedSubject.doAs(AuthenticatedSubject.java:321)
 at weblogic.security.service.SecurityManager.runAs(SecurityManager.java:121)
 at weblogic.servlet.internal.WebAppServletContext.invokeServlet(WebAppServletContext.java:3892)
 at weblogic.servlet.internal.ServletRequestImpl.execute(ServletRequestImpl.java:2766)
 at weblogic.kernel.ExecuteThread.execute(ExecuteThread.java:224)
 at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:183)
<Jun 1, 2006 9:26:42 AM EDT> <Info> <WebLogicServer> <BEA-000339> <ExecuteThread: '49' for queue: 'weblogic.kernel.Default' has become "unstuck".>
<Jun 1, 2006 10:39:07 AM EDT> <Error> <WebLogicServer> <BEA-000337> <ExecuteThread: '49' for queue: 'weblogic.kernel.Default' has been busy for "642" seconds working on the request "Http Request: /psp/fs8prd/EMPLOYEE/ERP/h/", which is more than the configured time (StuckThreadMaxTime) of "600" seconds.>
Full thread dump Java HotSpot(TM) Server VM (1.4.2_08-b03 mixed mode):
"NwWriter" daemon prio=1 tid=0x85875000 nid=0x146a in Object.wait() [848e5000..848e5cc8]
 at java.lang.Object.wait(Native Method)
 - waiting on <0x9222f970> (a bea.jolt.OutQ)
 at java.lang.Object.wait(Object.java:429)
 at bea.jolt.OutQ.getFromQ(OutQ.java:89)
 - locked <0x9222f970> (a bea.jolt.OutQ)
 at bea.jolt.NwWriter.run(NwHdlr.java:3932)
"NwReader" daemon prio=1 tid=0x87820398 nid=0x1469 runnable [860fe000..860fecc8]
 at java.net.SocketInputStream.socketRead0(Native Method)
 at java.net.SocketInputStream.read(SocketInputStream.java:129)
 at java.io.DataInputStream.readFully(DataInputStream.java:266)
 at bea.jolt.NwReader.run(NwHdlr.java:3577)
"ExecuteThread: '2' for queue: 'weblogic.socket.Muxer'" daemon prio=1 tid=0x08c22938 nid=0x1d7a waiting for monitor entry [8691d000..8691dcc8]
 at weblogic.socket.PosixSocketMuxer.processSockets(PosixSocketMuxer.java:91)
 - waiting to lock <0x97780f50> (a java.lang.String)
 at weblogic.socket.SocketReaderRequest.execute(SocketReaderRequest.java:32)
 at weblogic.kernel.ExecuteThread.execute(ExecuteThread.java:224)
 at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:183)
"ExecuteThread: '1' for queue: 'weblogic.socket.Muxer'" daemon prio=1 tid=0x08c23040 nid=0x1d79 waiting for monitor entry [871f1000..871f1cc8]
 at weblogic.socket.PosixSocketMuxer.processSockets(PosixSocketMuxer.java:91)
 - waiting to lock <0x97780f50> (a java.lang.String)
 at weblogic.socket.SocketReaderRequest.execute(SocketReaderRequest.java:32)
 at weblogic.kernel.ExecuteThread.execute(ExecuteThread.java:224)
 at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:183)
"ExecuteThread: '0' for queue: 'weblogic.socket.Muxer'" daemon prio=1 tid=0x08a30268 nid=0x1d78 in Object.wait() [87272000..87272cc8]
 at java.lang.Object.wait(Native Method)
 at java.lang.Object.wait(Object.java:429)
 at weblogic.socket.PosixSocketMuxer.processSockets(PosixSocketMuxer.java:95)
 - locked <0x97786320> (a [Lweblogic.socket.PosixSocketInfo$FdStruct;)
 - locked <0x97780f50> (a java.lang.String)
 at weblogic.socket.SocketReaderRequest.execute(SocketReaderRequest.java:32)
 at weblogic.kernel.ExecuteThread.execute(ExecuteThread.java:224)
 at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:183)
"SSLListenThread.Default" prio=1 tid=0x08c8d180 nid=0x1d77 runnable [875ff000..875ffcc8]
 at java.net.PlainSocketImpl.socketAccept(Native Method)
 at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:353)
 - locked <0x97780ad0> (a java.net.PlainSocketImpl)
 at java.net.ServerSocket.implAccept(ServerSocket.java:448)
 at javax.net.ssl.impl.SSLServerSocketImpl.accept(Unknown Source)
 at weblogic.t3.srvr.ListenThread.accept(ListenThread.java:735)
 at weblogic.t3.srvr.ListenThread.run(ListenThread.java:301)
"ListenThread.Default" prio=1 tid=0x08d10088 nid=0x1d76 runnable [87cff000..87cffcc8]
 at java.net.PlainSocketImpl.socketAccept(Native Method)
 at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:353)
 - locked <0x9778e508> (a java.net.PlainSocketImpl)
 at java.net.ServerSocket.implAccept(ServerSocket.java:448)
 at java.net.ServerSocket.accept(ServerSocket.java:419)
 at weblogic.socket.WeblogicServerSocket.accept(WeblogicServerSocket.java:26)
 at weblogic.t3.srvr.ListenThread.accept(ListenThread.java:735)
 at weblogic.t3.srvr.ListenThread.run(ListenThread.java:301)
"weblogic.health.CoreHealthMonitor" daemon prio=1 tid=0x08175dc8 nid=0x1d74 waiting on condition [87ebe000..87ebecc8]
 at java.lang.Thread.sleep(Native Method)
 at weblogic.t3.srvr.CoreHealthMonitorThread.run(CoreHealthMonitorThread.java:163)
"Thread-5" prio=1 tid=0x08174910 nid=0x1d73 in Object.wait() [87f3f000..87f3fcc8]
 at java.lang.Object.wait(Native Method)
 at java.util.TimerThread.mainLoop(Timer.java:429)
 - locked <0x96b01d60> (a java.util.TaskQueue)
 at java.util.TimerThread.run(Timer.java:382)
"VDE Transaction Processor Thread" prio=1 tid=0x08179738 nid=0x1d6e in Object.wait() [87fc0000..87fc0cc8]
 at java.lang.Object.wait(Native Method)
 - waiting on <0x96b02c50> (a com.octetstring.vde.backend.standard.TransactionProcessor)
 at java.lang.Object.wait(Object.java:429)
 at com.octetstring.vde.backend.standard.TransactionProcessor.waitChange(TransactionProcessor.java:365)
 - locked <0x96b02c50> (a com.octetstring.vde.backend.standard.TransactionProcessor)
 at com.octetstring.vde.backend.standard.TransactionProcessor.run(TransactionProcessor.java:212)
"ExecuteThread: '2' for queue: 'weblogic.admin.RMI'" daemon prio=1 tid=0x08169808 nid=0x1d6d in Object.wait() [88048000..88048cc8]
 at java.lang.Object.wait(Native Method)
 at java.lang.Object.wait(Object.java:429)
 at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:154)
 - locked <0x96b01da8> (a weblogic.kernel.ExecuteThread)
 at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:174)
"ExecuteThread: '1' for queue: 'weblogic.admin.RMI'" daemon prio=1 tid=0x08169660 nid=0x1d6c in Object.wait() [880c9000..880c9cc8]
 at java.lang.Object.wait(Native Method)
 - waiting on <0x96b01e28> (a weblogic.kernel.ExecuteThread)
 at java.lang.Object.wait(Object.java:429)
 at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:154)
 - locked <0x96b01e28> (a weblogic.kernel.ExecuteThread)
 at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:174)
"ExecuteThread: '0' for queue: 'weblogic.admin.RMI'" daemon prio=1 tid=0x08169308 nid=0x1d6b in Object.wait() [8814a000..8814acc8]
 at java.lang.Object.wait(Native Method)
 at java.lang.Object.wait(Object.java:429)
 at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:154)
 - locked <0x96b01ea8> (a weblogic.kernel.ExecuteThread)
 at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:174)
"ExecuteThread: '1' for queue: 'weblogic.admin.HTTP'" daemon prio=1 tid=0x08171058 nid=0x1d6a in Object.wait() [881cb000..881cbcc8]
 at java.lang.Object.wait(Native Method)
 at java.lang.Object.wait(Object.java:429)
 at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:154)
 - locked <0x96b01f28> (a weblogic.kernel.ExecuteThread)
 at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:174)
"ExecuteThread: '0' for queue: 'weblogic.admin.HTTP'" daemon prio=1 tid=0x0816ef60 nid=0x1d69 in Object.wait() [8824c000..8824ccc8]
 at java.lang.Object.wait(Native Method)
 at java.lang.Object.wait(Object.java:429)
 at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:154)
 - locked <0x96b01fa8> (a weblogic.kernel.ExecuteThread)
 at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:174)
"weblogic.security.SpinnerRandomSource" daemon prio=1 tid=0x0807ee50 nid=0x1d68 in Object.wait() [882cd000..882cdcc8]
 at java.lang.Object.wait(Native Method)
 - waiting on <0x96b02070> (a java.lang.Object)
 at java.lang.Object.wait(Object.java:429)
 at weblogic.security.SpinnerRandomBitsSource.run(SpinnerRandomBitsSource.java:60)
 - locked <0x96b02070> (a java.lang.Object)
 at java.lang.Thread.run(Thread.java:534)
"weblogic.time.TimeEventGenerator" daemon prio=1 tid=0x08698128 nid=0x1d67 runnable [8834e000..8834ecc8]
 at java.lang.Object.wait(Native Method)
 at weblogic.time.common.internal.TimeTable.snooze(TimeTable.java:285)
 - locked <0x96b020e0> (a weblogic.time.common.internal.TimeTable)
 at weblogic.time.common.internal.TimeEventGenerator.run(TimeEventGenerator.java:118)
 at java.lang.Thread.run(Thread.java:534)
"ExecuteThread: '4' for queue: 'weblogic.kernel.System'" daemon prio=1 tid=0x086ab750 nid=0x1d66 in Object.wait() [883cf000..883cfcc8]
 at java.lang.Object.wait(Native Method)
 at java.lang.Object.wait(Object.java:429)
 at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:154)
 - locked <0x96b02150> (a weblogic.kernel.ExecuteThread)
 at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:174)
"ExecuteThread: '3' for queue: 'weblogic.kernel.System'" daemon prio=1 tid=0x086aa5a0 nid=0x1d65 in Object.wait() [88450000..88450cc8]
 at java.lang.Object.wait(Native Method)
 at java.lang.Object.wait(Object.java:429)
 at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:154)
 - locked <0x96b021d0> (a weblogic.kernel.ExecuteThread)
 at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:174)
"ExecuteThread: '2' for queue: 'weblogic.kernel.System'" daemon prio=1 tid=0x086a93d8 nid=0x1d64 in Object.wait() [884d1000..884d1cc8]
 at java.lang.Object.wait(Native Method)
 at java.lang.Object.wait(Object.java:429)
 at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:154)
 - locked <0x96b02250> (a weblogic.kernel.ExecuteThread)
 at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:174)
"ExecuteThread: '1' for queue: 'weblogic.kernel.System'" daemon prio=1 tid=0x086a8210 nid=0x1d63 in Object.wait() [88552000..88552cc8]
 at java.lang.Object.wait(Native Method)
 at java.lang.Object.wait(Object.java:429)
 at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:154)
 - locked <0x96b022d0> (a weblogic.kernel.ExecuteThread)
 at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:174)
"ExecuteThread: '0' for queue: 'weblogic.kernel.System'" daemon prio=1 tid=0x086a7060 nid=0x1d62 in Object.wait() [885d3000..885d3cc8]
 at java.lang.Object.wait(Native Method)
 at java.lang.Object.wait(Object.java:429)
 at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:154)
 - locked <0x96b02350> (a weblogic.kernel.ExecuteThread)
 at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:174)
"ExecuteThread: '49' for queue: 'weblogic.kernel.Default'" daemon prio=1 tid=0x086a5e98 nid=0x1d61 in Object.wait() [88653000..88654cc8]
 at java.lang.Object.wait(Native Method)
 - waiting on <0x921e8c38> (a bea.jolt.IOBuf)
 at bea.jolt.IOBuf.waitOnBuf(IOBuf.java:119)
 - locked <0x921e8c38> (a bea.jolt.IOBuf)
 at bea.jolt.NwHdlr.recv(NwHdlr.java:1413)
 at bea.jolt.CMgr.recv(CMgr.java:126)
 at bea.jolt.JoltSession.recv(JoltSession.java:550)
 at bea.jolt.JoltSession.endSession(JoltSession.java:358)
 at psft.pt8.net.NetSession.endSession(NetSession.java:646)
 at psft.pt8.jb.JBEntry.disconnect(JBEntry.java:830)
 at psft.pt8.jb.JBEntry.disconnect(JBEntry.java:819)
 at psft.pt8.auth.PSAuthenticator.CleanUp(PSAuthenticator.java:1608)
 at psft.pt8.auth.PSAuthenticator.handleExceptionBin(PSAuthenticator.java:1735)
 at psft.pt8.psc.onActionDirect(psc.java:1345)
 - locked <0xb05923b0> (a java.lang.String)
 at psft.pt8.portal.PIADirectConnection.connect(PIADirectConnection.java:111)
 at psft.pt8.portal.ContentGetter.getPIADirectContent(ContentGetter.java:362)
 at psft.pt8.portal.ContentGetter.getPIADirectContent(ContentGetter.java:281)
 at psft.pt8.portal.ContentGetter.getPIADirectContent(ContentGetter.java:277)
 at psft.pt8.portal.ContentGetter.getContent(ContentGetter.java:519)
 at psft.pt8.portal.ContentGetter.getContent(ContentGetter.java:470)
 at psft.pt8.portal.ContentGetter.getContent(ContentGetter.java:467)
 at psft.pt8.portal.template.IClientComponent.doGetContent(IClientComponent.java:381)
 at psft.pt8.portal.template.IClientComponent.getContent(IClientComponent.java:273)
 at psft.pt8.portal.PageAssembler.getPIAContent(PageAssembler.java:739)
 at psft.pt8.portal.PageAssembler.replaceComponent(PageAssembler.java:525)
 at psft.pt8.portal.PageAssembler.replaceComponentTags(PageAssembler.java:219)
 at psft.pt8.portal.PageAssembler.assemble(PageAssembler.java:109)
 at psft.pt8.psp.onStartTab(psp.java:1873)
 at psft.pt8.psp.service(psp.java:603)
 at javax.servlet.http.HttpServlet.service(HttpServlet.java:853)
 at weblogic.servlet.internal.ServletStubImpl$ServletInvocationAction.run(ServletStubImpl.java:1072)
 at weblogic.servlet.internal.ServletStubImpl.invokeServlet(ServletStubImpl.java:465)
 at weblogic.servlet.internal.TailFilter.doFilter(TailFilter.java:28)
 at weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:27)
 at psft.pt8.psfilter.doFilter(psfilter.java:76)
 at weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:27)
 at weblogic.servlet.internal.WebAppServletContext$ServletInvocationAction.run(WebAppServletContext.java:6987)
 at weblogic.security.acl.internal.AuthenticatedSubject.doAs(AuthenticatedSubject.java:321)
 at weblogic.security.service.SecurityManager.runAs(SecurityManager.java:121)
 at weblogic.servlet.internal.WebAppServletContext.invokeServlet(WebAppServletContext.java:3892)
 at weblogic.servlet.internal.ServletRequestImpl.execute(ServletRequestImpl.java:2766)
 at weblogic.kernel.ExecuteThread.execute(ExecuteThread.java:224)
 at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:183)
"ExecuteThread: '48' for queue: 'weblogic.kernel.Default'" daemon prio=1 tid=0x086a4ce8 nid=0x1d60 in Object.wait() [886d5000..886d5cc8]
 at java.lang.Object.wait(Native Method)
 at java.lang.Object.wait(Object.java:429)
 at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:154)
 - locked <0x96b02450> (a weblogic.kernel.ExecuteThread)
 at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:174)
"ExecuteThread: '47' for queue: 'weblogic.kernel.Default'" daemon prio=1 tid=0x087cdb98 nid=0x1d5f waiting for monitor entry [88756000..88756cc8]
 at psft.pt8.psp.onStartTab(psp.java:1760)
 - waiting to lock <0xb05923b0> (a java.lang.String)
 at psft.pt8.psp.service(psp.java:603)
 at javax.servlet.http.HttpServlet.service(HttpServlet.java:853)
 at weblogic.servlet.internal.ServletStubImpl$ServletInvocationAction.run(ServletStubImpl.java:1072)
 at weblogic.servlet.internal.ServletStubImpl.invokeServlet(ServletStubImpl.java:465)
 at weblogic.servlet.internal.TailFilter.doFilter(TailFilter.java:28)
 at weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:27)
 at psft.pt8.psfilter.doFilter(psfilter.java:76)
 at weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:27)
 at weblogic.servlet.internal.WebAppServletContext$ServletInvocationAction.run(WebAppServletContext.java:6987)
 at weblogic.security.acl.internal.AuthenticatedSubject.doAs(AuthenticatedSubject.java:321)
 at weblogic.security.service.SecurityManager.runAs(SecurityManager.java:121)
 at weblogic.servlet.internal.WebAppServletContext.invokeServlet(WebAppServletContext.java:3892)
 at weblogic.servlet.internal.ServletRequestImpl.execute(ServletRequestImpl.java:2766)
 at weblogic.kernel.ExecuteThread.execute(ExecuteThread.java:224)
 at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:183)
"ExecuteThread: '46' for queue: 'weblogic.kernel.Default'" daemon prio=1 tid=0x087cc9d0 nid=0x1d5e in Object.wait() [887d7000..887d7cc8]
 at java.lang.Object.wait(Native Method)
 at java.lang.Object.wait(Object.java:429)
 at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:154)
 - locked <0x96b02550> (a weblogic.kernel.ExecuteThread)
 at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:174)
"ExecuteThread: '45' for queue: 'weblogic.kernel.Default'" daemon prio=1 tid=0x087cb820 nid=0x1d5d in Object.wait() [88858000..88858cc8]
 at java.lang.Object.wait(Native Method)
 at java.lang.Object.wait(Object.java:429)
 at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:154)
 - locked <0x96b025d0> (a weblogic.kernel.ExecuteThread)
 at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:174)
"ExecuteThread: '44' for queue: 'weblogic.kernel.Default'" daemon prio=1 tid=0x087ca658 nid=0x1d5c in Object.wait() [888d9000..888d9cc8]
 at java.lang.Object.wait(Native Method)
 - waiting on <0x96b02650> (a weblogic.kernel.ExecuteThread)
 at java.lang.Object.wait(Object.java:429)
 at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:154)
 - locked <0x96b02650> (a weblogic.kernel.ExecuteThread)
 at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:174)
"ExecuteThread: '43' for queue: 'weblogic.kernel.Default'" daemon prio=1 tid=0x087c9490 nid=0x1d5b in Object.wait() [8895a000..8895acc8]
 at java.lang.Object.wait(Native Method)
 - waiting on <0x96b026d0> (a weblogic.kernel.ExecuteThread)
 at java.lang.Object.wait(Object.java:429)
 at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:154)
 - locked <0x96b026d0> (a weblogic.kernel.ExecuteThread)
 at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:174)
"ExecuteThread: '42' for queue: 'weblogic.kernel.Default'" daemon prio=1 tid=0x087c82e0 nid=0x1d5a in Object.wait() [889db000..889dbcc8]
 at java.lang.Object.wait(Native Method)
 - waiting on <0x96b02750> (a weblogic.kernel.ExecuteThread)
 at java.lang.Object.wait(Object.java:429)
 at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:154)
 - locked <0x96b02750> (a weblogic.kernel.ExecuteThread)
 at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:174)
"ExecuteThread: '41' for queue: 'weblogic.kernel.Default'" daemon prio=1 tid=0x087c7118 nid=0x1d59 in Object.wait() [88a5c000..88a5ccc8]
 at java.lang.Object.wait(Native Method)
 - waiting on <0x96b027d0> (a weblogic.kernel.ExecuteThread)
 at java.lang.Object.wait(Object.java:429)
 at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:154)
 - locked <0x96b027d0> (a weblogic.kernel.ExecuteThread)
 at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:174)
"ExecuteThread: '40' for queue: 'weblogic.kernel.Default'" daemon prio=1 tid=0x087c5f50 nid=0x1d58 in Object.wait() [88add000..88addcc8]
 at java.lang.Object.wait(Native Method)
 - waiting on <0x96b02850> (a weblogic.kernel.ExecuteThread)
 at java.lang.Object.wait(Object.java:429)
 at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:154)
 - locked <0x96b02850> (a weblogic.kernel.ExecuteThread)
 at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:174)
"ExecuteThread: '39' for queue: 'weblogic.kernel.Default'" daemon prio=1 tid=0x087c4da0 nid=0x1d57 in Object.wait() [88b5e000..88b5ecc8]
 at java.lang.Object.wait(Native Method)
 - waiting on <0x96b028d0> (a weblogic.kernel.ExecuteThread)
 at java.lang.Object.wait(Object.java:429)
 at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:154)
 - locked <0x96b028d0> (a weblogic.kernel.ExecuteThread)
 at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:174)
"ExecuteThread: '38' for queue: 'weblogic.kernel.Default'" daemon prio=1 tid=0x087c3bd8 nid=0x1d56 in Object.wait() [88bdf000..88bdfcc8]
 at java.lang.Object.wait(Native Method)
 - waiting on <0x96b02950> (a weblogic.kernel.ExecuteThread)
 at java.lang.Object.wait(Object.java:429)
 at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:154)
 - locked <0x96b02950> (a weblogic.kernel.ExecuteThread)
 at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:174)
"ExecuteThread: '37' for queue: 'weblogic.kernel.Default'" daemon prio=1 tid=0x087c2a10 nid=0x1d55 in Object.wait() [88c60000..88c60cc8]
 at java.lang.Object.wait(Native Method)
 - waiting on <0x96b029d0> (a weblogic.kernel.ExecuteThread)
 at java.lang.Object.wait(Object.java:429)
 at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:154)
 - locked <0x96b029d0> (a weblogic.kernel.ExecuteThread)
 at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:174)
"ExecuteThread: '36' for queue: 'weblogic.kernel.Default'" daemon prio=1 tid=0x087c1860 nid=0x1d54 in Object.wait() [88ce1000..88ce1cc8]
 at java.lang.Object.wait(Native Method)
 - waiting on <0x96b02a50> (a weblogic.kernel.ExecuteThread)
 at java.lang.Object.wait(Object.java:429)
 at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:154)
 - locked <0x96b02a50> (a weblogic.kernel.ExecuteThread)
 at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:174)
"ExecuteThread: '35' for queue: 'weblogic.kernel.Default'" daemon prio=1 tid=0x087c0698 nid=0x1d53 in Object.wait() [88d62000..88d62cc8]
 at java.lang.Object.wait(Native Method)
 - waiting on <0x96b02ad0> (a weblogic.kernel.ExecuteThread)
 at java.lang.Object.wait(Object.java:429)
 at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:154)
 - locked <0x96b02ad0> (a weblogic.kernel.ExecuteThread)
 at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:174)
"ExecuteThread: '34' for queue: 'weblogic.kernel.Default'" daemon prio=1 tid=0x087bf4d0 nid=0x1d52 in Object.wait() [88de3000..88de3cc8]
 at java.lang.Object.wait(Native Method)
 - waiting on <0x96b02b50> (a weblogic.kernel.ExecuteThread)
 at java.lang.Object.wait(Object.java:429)
 at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:154)
 - locked <0x96b02b50> (a weblogic.kernel.ExecuteThread)
 at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:174)
"ExecuteThread: '33' for queue: 'weblogic.kernel.Default'" daemon prio=1 tid=0x087be320 nid=0x1d51 in Object.wait() [88e64000..88e64cc8]
 at java.lang.Object.wait(Native Method)
 - waiting on <0x96b02bd0> (a weblogic.kernel.ExecuteThread)
 at java.lang.Object.wait(Object.java:429)
 at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:154)
 - locked <0x96b02bd0> (a weblogic.kernel.ExecuteThread)
 at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:174)
"ExecuteThread: '32' for queue: 'weblogic.kernel.Default'" daemon prio=1 tid=0x087bd158 nid=0x1d50 in Object.wait() [88ee5000..88ee5cc8]
 at java.lang.Object.wait(Native Method)
 - waiting on <0x96b03b10> (a weblogic.kernel.ExecuteThread)
 at java.lang.Object.wait(Object.java:429)
 at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:154)
 - locked <0x96b03b10> (a weblogic.kernel.ExecuteThread)
 at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:174)
"ExecuteThread: '31' for queue: 'weblogic.kernel.Default'" daemon prio=1 tid=0x087bbf90 nid=0x1d4f in Object.wait() [88f66000..88f66cc8]
 at java.lang.Object.wait(Native Method)
 - waiting on <0x96b03b90> (a weblogic.kernel.ExecuteThread)
 at java.lang.Object.wait(Object.java:429)
 at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:154)
 - locked <0x96b03b90> (a weblogic.kernel.ExecuteThread)
 at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:174)
"ExecuteThread: '30' for queue: 'weblogic.kernel.Default'" daemon prio=1 tid=0x087bade0 nid=0x1d4e in Object.wait() [88fe7000..88fe7cc8]
 at java.lang.Object.wait(Native Method)
 - waiting on <0x96b03c10> (a weblogic.kernel.ExecuteThread)
 at java.lang.Object.wait(Object.java:429)
 at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:154)
 - locked <0x96b03c10> (a weblogic.kernel.ExecuteThread)
 at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:174)
"ExecuteThread: '29' for queue: 'weblogic.kernel.Default'" daemon prio=1 tid=0x087b9c18 nid=0x1d4d in Object.wait() [89068000..89068cc8]
 at java.lang.Object.wait(Native Method)
 - waiting on <0x96b03c90> (a weblogic.kernel.ExecuteThread)
 at java.lang.Object.wait(Object.java:429)
 at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:154)
 - locked <0x96b03c90> (a weblogic.kernel.ExecuteThread)
 at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:174)
"ExecuteThread: '28' for queue: 'weblogic.kernel.Default'" daemon prio=1 tid=0x087b8a68 nid=0x1d4c in Object.wait() [890e9000..890e9cc8]
 at java.lang.Object.wait(Native Method)
 - waiting on <0x96b03d10> (a weblogic.kernel.ExecuteThread)
 at java.lang.Object.wait(Object.java:429)
 at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:154)
 - locked <0x96b03d10> (a weblogic.kernel.ExecuteThread)
 at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:174)
"ExecuteThread: '27' for queue: 'weblogic.kernel.Default'" daemon prio=1 tid=0x087b78f0 nid=0x1d4b in Object.wait() [8916a000..8916acc8]
 at java.lang.Object.wait(Native Method)
 - waiting on <0x96b03d90> (a weblogic.kernel.ExecuteThread)
 at java.lang.Object.wait(Object.java:429)
 at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:154)
 - locked <0x96b03d90> (a weblogic.kernel.ExecuteThread)
 at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:174)
"ExecuteThread: '26' for queue: 'weblogic.kernel.Default'" daemon prio=1 tid=0x08772fe0 nid=0x1d4a in Object.wait() [891eb000..891ebcc8]
 at java.lang.Object.wait(Native Method)
 - waiting on <0x96b03e10> (a weblogic.kernel.ExecuteThread)
 at java.lang.Object.wait(Object.java:429)
 at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:154)
 - locked <0x96b03e10> (a weblogic.kernel.ExecuteThread)
 at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:174)
"ExecuteThread: '25' for queue: 'weblogic.kernel.Default'" daemon prio=1 tid=0x08771e18 nid=0x1d49 in Object.wait() [8926c000..8926ccc8]
 at java.lang.Object.wait(Native Method)
 - waiting on <0x96b03e90> (a weblogic.kernel.ExecuteThread)
 at java.lang.Object.wait(Object.java:429)
 at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:154)
 - locked <0x96b03e90> (a weblogic.kernel.ExecuteThread)
 at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:174)
"ExecuteThread: '24' for queue: 'weblogic.kernel.Default'" daemon prio=1 tid=0x08770c50 nid=0x1d48 in Object.wait() [892ed000..892edcc8]
 at java.lang.Object.wait(Native Method)
 - waiting on <0x96b03f10> (a weblogic.kernel.ExecuteThread)
 at java.lang.Object.wait(Object.java:429)
 at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:154)
 - locked <0x96b03f10> (a weblogic.kernel.ExecuteThread)
 at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:174)
"ExecuteThread: '23' for queue: 'weblogic.kernel.Default'" daemon prio=1 tid=0x0876faa0 nid=0x1d47 in Object.wait() [8936e000..8936ecc8]
 at java.lang.Object.wait(Native Method)
 - waiting on <0x96b03f90> (a weblogic.kernel.ExecuteThread)
 at java.lang.Object.wait(Object.java:429)
 at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:154)
 - locked <0x96b03f90> (a weblogic.kernel.ExecuteThread)
 at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:174)
"ExecuteThread: '22' for queue: 'weblogic.kernel.Default'" daemon prio=1 tid=0x0876e8d8 nid=0x1d46 in Object.wait() [893ef000..893efcc8]
 at java.lang.Object.wait(Native Method)
 - waiting on <0x96b04010> (a weblogic.kernel.ExecuteThread)
 at java.lang.Object.wait(Object.java:429)
 at weblogic.kernel.ExecuteThread.waitForRequest(ExecuteThread.java:154)
 - locked <0x96b04010> (a weblogic.kernel.ExecuteThread)
 at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:174)
"ExecuteThread: '21' for queue: 'weblogic.kernel.Default'" daemon prio=1 tid=0x0876d710 nid=0x1d45 in Object.wait() [89470000..89470cc8]
 at java.lang.Object.wait(Native Method)
 - waiting on <0x96b04090> (a web

Hi,
I am not sure about the root cause for the problem you are facing. But i could understand few things from the error messages.
There are two kinds of queues in weblogic server
- Socket queue
- Execute queue
Socket queue is used for intercommunication between servers. Execute queue is used for client requests.
I believe in your cases all of the execute queue threads are in use by other request and hence the new request for any resoure is not serviced. So you can try creating a new custom queue giving more threads to it and use this instead of weblogic.kernel.default.
Let me know if this helps and write back for any doubts.
Thanks,
Sushma

Error repeating every morning

Hi!
We are running a WebLogic Commerce Server 3.5, with MS-SQL Server 7.0 (both
clustered), along with a IIS_WebLogic Bridge (IIS Acts as the WebServer). We
notice that every morning the following error appears on the WebLogic
Console. We have checked for the maintenance plan for the SQL Server -
weekly backups are scheduled. Apart from that there does not appear to be
any reason for roll-back.
Can anyone help?
<Aug 25, 2001 9:08:36 AM GMT+02:00> <Error> <JTA> <Transaction =
transaction=(Id Hash=-20308453,Name = [EJB
SchemaManagerBeanImpl.getDefaultValues()],Xid=22:fbac251331a6fc9c,Status=Rol
led back. [Reason =
weblogic.transaction.internal.AppSetRollbackOnlyException],numRepliesOwedMe=
0,numRepliesOwedOthers=0,seconds since begin=31,seconds
left=30,activeThread=Thread[ExecuteThread: '8' for queue: 'default',5,Thread
Group for Queue:
'default'],ServerResourceInfo[weblogic.jdbc.jts.Connection]=(state=rolledbac
k,assigned=wlcs-server5),SCInfo[wlcs-server5]=(state=rolledback),properties=
({weblogic.transaction.name=[EJB SchemaManagerBeanImpl.getDefaultValues()],
ISOLATION LEVEL=2, weblogic.jdbc=t3://xyz-app-01.xyz.com:7501})) completed
heuristically:Possible heuristic hazard situation with resource
'weblogic.jdbc.jts.Connection Error = javax.transaction.xa.XAException: I/O
exception while talking to the server, java.net.SocketException: Connection
reset by peer: JVM_recv in socket input stream read>
<Aug 25, 2001 9:08:36 AM GMT+02:00> <Error> <EJB> <Exception during rollback
of transaction transaction=(IdHash=-20308453,Name = [EJB
SchemaManagerBeanImpl.getDefaultValues()],Xid=22:fbac251331a6fc9c,Status=Rol
led back. [Reason =
weblogic.transaction.internal.AppSetRollbackOnlyException],numRepliesOwedMe=
0,numRepliesOwedOthers=0,seconds since begin=31,seconds
left=30,ServerResourceInfo[weblogic.jdbc.jts.Connection]=(state=rolledback,a
ssigned=wlcs-server5),SCInfo[wlcs-server5]=(state=rolledback),properties=({w
eblogic.transaction.name=[EJB SchemaManagerBeanImpl.getDefaultValues()],
ISOLATION LEVEL=2, weblogic.jdbc=t3://xyz-app-01.xyz.com:7501})):
javax.transaction.SystemException: Heuristic hazard: Possible
heuristic hazard situation with resource 'weblogic.jdbc.jts.Connection Error
= javax.transaction.xa.XAException: I/O exception while talking to the
server, java.net.SocketException: Connection reset by peer: JVM_recv in
socket input stream read
at
weblogic.transaction.internal.ServerTransactionImpl.rollback(ServerTransacti
onImpl.java:271)
at
weblogic.ejb20.internal.BaseEJBObject.postInvoke(BaseEJBObject.java:189)
at
com.beasys.commerce.foundation.property.SchemaManagerBeanEOImpl.getDefaultVa
lues(SchemaManagerBeanEOImpl.java:74)
at
com.beasys.commerce.foundation.flow.FlowManager.getPropertySet(FlowManager.j
ava:293)
at
com.beasys.commerce.foundation.flow.FlowManager.getApplication(FlowManager.j
ava:238)
at
com.beasys.commerce.foundation.flow.FlowManager.service(FlowManager.java:506
at javax.servlet.http.HttpServlet.service(HttpServlet.java:853)
at
weblogic.servlet.internal.ServletStubImpl.invokeServlet(ServletStubImpl.java
:213)
at
weblogic.servlet.internal.WebAppServletContext.invokeServlet(WebAppServletCo
ntext.java:1265)
at
weblogic.servlet.internal.ServletRequestImpl.execute(ServletRequestImpl.java
:1631)
at weblogic.kernel.ExecuteThread.execute(ExecuteThread.java:137)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:120)
regards,
Prajesh K. Verma
Eclaton eBDU India Pvt. Ltd.
Huis van Eclaton
25, Lavelle Road
Bangalore 560 001
Tel: +91 80 2996569
Email: [email protected]
http://www.eclaton.com

Jim,
Thanks, but it does not appear as if we have any network issues. We also
checked the database log, but nothing abnormal could be detected.
regards,
Prajesh
Jim Clark <[email protected]> wrote in message
news:[email protected]...
'weblogic.jdbc.jts.Connection Error
= javax.transaction.xa.XAException: I/O exception while talking to the
server
Have you experienced network problems? It seems as if you're losing the
connection between the server and the db.
"Prajesh K. Verma" <[email protected]> wrote in message
news:[email protected]...
Hi!
We are running a WebLogic Commerce Server 3.5, with MS-SQL Server 7.0(both
clustered), along with a IIS_WebLogic Bridge (IIS Acts as the
WebServer).
We
notice that every morning the following error appears on the WebLogic
Console. We have checked for the maintenance plan for the SQL Server -
weekly backups are scheduled. Apart from that there does not appear to
be
any reason for roll-back.
Can anyone help?
<Aug 25, 2001 9:08:36 AM GMT+02:00> <Error> <JTA> <Transaction =
transaction=(Id Hash=-20308453,Name = [EJB
SchemaManagerBeanImpl.getDefaultValues()],Xid=22:fbac251331a6fc9c,Status=Rol
led back. [Reason =
weblogic.transaction.internal.AppSetRollbackOnlyException,numRepliesOwedMe=
0,numRepliesOwedOthers=0,seconds since begin=31,seconds
left=30,activeThread=Thread[ExecuteThread: '8' for queue:
'default',5,Thread> > Group for Queue:> >>'default',ServerResourceInfo[weblogic.jdbc.jts.Connection]=(state=rolledbac
k,assigned=wlcs-server5),SCInfo[wlcs-server5]=(state=rolledback),properties=
({weblogic.transaction.name=[EJBSchemaManagerBeanImpl.getDefaultValues()],
ISOLATION LEVEL=2, weblogic.jdbc=t3://xyz-app-01.xyz.com:7501}))
completed
heuristically:Possible heuristic hazard situation with resource
'weblogic.jdbc.jts.Connection Error = javax.transaction.xa.XAException:I/O
exception while talking to the server, java.net.SocketException:Connection
reset by peer: JVM_recv in socket input stream read>
<Aug 25, 2001 9:08:36 AM GMT+02:00> <Error> <EJB> <Exception duringrollback
of transaction transaction=(IdHash=-20308453,Name = [EJB
SchemaManagerBeanImpl.getDefaultValues()],Xid=22:fbac251331a6fc9c,Status=Rol
led back. [Reason =
weblogic.transaction.internal.AppSetRollbackOnlyException,numRepliesOwedMe=
0,numRepliesOwedOthers=0,seconds since begin=31,seconds
left=30,ServerResourceInfo[weblogic.jdbc.jts.Connection]=(state=rolledback,a
>>
>
ssigned=wlcs-server5),SCInfo[wlcs-server5]=(state=rolledback),properties=({w
eblogic.transaction.name=[EJB SchemaManagerBeanImpl.getDefaultValues()],
ISOLATION LEVEL=2, weblogic.jdbc=t3://xyz-app-01.xyz.com:7501})):
javax.transaction.SystemException: Heuristic hazard: Possible
heuristic hazard situation with resource 'weblogic.jdbc.jts.ConnectionError
= javax.transaction.xa.XAException: I/O exception while talking to the
server, java.net.SocketException: Connection reset by peer: JVM_recv in
socket input stream read
at
weblogic.transaction.internal.ServerTransactionImpl.rollback(ServerTransacti
onImpl.java:271)
at
weblogic.ejb20.internal.BaseEJBObject.postInvoke(BaseEJBObject.java:189)
at
com.beasys.commerce.foundation.property.SchemaManagerBeanEOImpl.getDefaultVa
lues(SchemaManagerBeanEOImpl.java:74)
at
com.beasys.commerce.foundation.flow.FlowManager.getPropertySet(FlowManager.j
ava:293)
at
com.beasys.commerce.foundation.flow.FlowManager.getApplication(FlowManager.j
ava:238)
at
com.beasys.commerce.foundation.flow.FlowManager.service(FlowManager.java:506
at javax.servlet.http.HttpServlet.service(HttpServlet.java:853)
at
weblogic.servlet.internal.ServletStubImpl.invokeServlet(ServletStubImpl.java
:213)
at
weblogic.servlet.internal.WebAppServletContext.invokeServlet(WebAppServletCo
ntext.java:1265)
at
weblogic.servlet.internal.ServletRequestImpl.execute(ServletRequestImpl.java
:1631)
at weblogic.kernel.ExecuteThread.execute(ExecuteThread.java:137)
at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:120)
regards,
Prajesh K. Verma
Eclaton eBDU India Pvt. Ltd.
Huis van Eclaton
25, Lavelle Road
Bangalore 560 001
Tel: +91 80 2996569
Email: [email protected]
http://www.eclaton.com

Essbase Server Hangs Intermittently - Urgent pls Help

Essbase Version - 9.3.3
Shared Services - 9.3.3
Enviroment - Windows Server 2003
We are in the process of migrating the users from Domain A to Domain B
There are around 15000 users across the board, out of which I assume there are around 250 users accessing the Hyperion Application.
Since the Domain Migration was started, We encountered Essbase Server freezes Intermittently.
Essbase Server goes down for about 10-15 Minutes and automatically comes back. No Error Msg in the Essbase Log.
Active Directory Migration was put on Hold because business had to complete their Month end Activities.
While we were working to find the RCA and identified that few users who were migrated from Domain A to Domain B appeared to be on Both the Domain and we figured out that it might be one of the reason for Essbase Server Hangs.
We had a Plan to Run the Update native Directory Utility to clear the Stale Data
Post Performing the Action our system was stable and didn't had system Hangs.
we also changed the shared services Cache refresh Interval to 24 Hrs in CSS.xml File ( Just to Make sure the Refresh happens Overnight)
Since the Active Directory Team had resumed their Migration Activies, we started Experiencing the System Hangs Issues again. server goes down for 5-10 min and comes back up
Please Input your Valuable Thoughts, Would Really Appreciate your Help.
Thanks in Advance.

Hi,
Thanks for your prompt response.
As mentioned, AD team have the filters on place, There is no issues with the User Access and there was no change in password after migrating the Domain.
I have checked the Display Session through Maxl and there is No heavy sessions.
As Stated earlier, we are unable to identify the cause regarding the System Freeze. All users access the application all of sudden essbase server hangs and it doesn't allow user to retrieve the data, nor allow him to access any application within Essbase and Planning.
After 5-10 Min, server automatically comes back.
Can you tell me if there is a way to track the system Hangs through Essbase Log without getting the any inputs from the users.
Assuming if the users sessions are heavy what makes the server hang and automatically resumes without intervention.
Shared Services Security Log display the following Error, Can you tell me if you had come across any such errors before.
com.hyperion.css.spi.impl.msad.MSADCacheUpdater.updateUserCache(Ljavax.naming.directory.DirContext;Lcom.hyperion.css.common.CSSNodeImpl;Ljava.lang.String;Ljava.lang.String;Lcom.hyperion.css.datastructures.ProviderCacheMap;Ljava.util.Map;)V(Unknown Source) - Ignoring User. Error getting User for User Cache:[LDAP: error code 32 - 0000208D: NameErr: DSID-031522C9, problem 2001 (NO_OBJECT), data 0, best match of:
'OU=USMigrate,OU=Add_Audit,OU=Users,OU=Accounts,OU=RAC-IOC,DC=us,DC=ricoh,DC=ds'
Error Code: -1
com.hyperion.css.common.configuration.CSSConfigurationException: Unable to load certificate from keystore or unable to locate keystore: SAP.keystore Error Code: 9
NestedException:
com.hyperion.css.common.configuration.CSSConfigurationException: No certificates present for SAP Authentication to take place Error Code: 9
at com.hyperion.css.SAPSecurity.loadKeyStoreWithSAPCertificate(Ljava.util.ResourceBundle;Ljava.security.KeyStore;Ljava.lang.ClassLoader;)Ljava.security.KeyStore;(Unknown Source)
Please advise.
Thanks in Advance.

10.4.8 server "hangs" EVERY morning around 6am

Similar Messages

Maybe you are looking for