Manage server are getting down frequently

Hi All,
i am using weblogic 10.3 version i have one problem , weblogic server is have two managed servers ,problem here is my one of manage server is always getting down, when i check in Unix memory utilization the usage is 90% displaying. is the problem is related to memory utilization are some thing else
Exception its displaying
java.lang.OutOfMemoryError: GC overhead limit exceeded
Please help me on these
Thanks in Advance
Sreenivasulu

I am not getting exactly same messsage. Here is my message, just outcome look sames, managedsever got disconnected from AdminServer.
####<Feb 3, 2011 10:31:16 AM CST> <Info> <Health> <bldxbiap01> <AdminServer> <weblogic.GCMonitor> <<anonymous>> <> <> <1296750676097> <BEA-3100
02> <43% of the total memory in the server is free>
####<Feb 3, 2011 12:33:16 PM CST> <Info> <Health> <bldxbiap01> <AdminServer> <weblogic.GCMonitor> <<anonymous>> <> <> <1296757996590> <BEA-3100
02> <32% of the total memory in the server is free>
####<Feb 3, 2011 1:13:42 PM CST> <Info> <Server> <bldxbiap01> <AdminServer> <[STANDBY] ExecuteThread: '1' for queue: 'weblogic.kernel.Default (
self-tuning)'> <<WLS Kernel>> <> <> <1296760422800> <BEA-002634> <The server "BIServer01" disconnected from this server.>
####<Feb 3, 2011 1:13:42 PM CST> <Info> <JMX> <bldxbiap01> <AdminServer> <[ACTIVE] ExecuteThread: '2' for queue: 'weblogic.kernel.Default (self
-tuning)'> <<WLS Kernel>> <> <> <1296760422801> <BEA-149507> <JMX Connectivity has been discontinued with the managed server BIServer01.>
####<Feb 3, 2011 2:56:17 PM CST> <Info> <Health> <bldxbiap01> <AdminServer> <weblogic.GCMonitor> <<anonymous>> <> <> <1296766577142> <BEA-31000
2> <21% of the total memory in the server is free>

Similar Messages

  • The Managed servers are going down  frequently due to leasing renewal.

    We have 3 SOA Managed Servers in our Production Environment running each of them on 3 different Machines.
    The servers are going down frequently due to leasing renewal issue.
    Please see the errors below. SOA_MS3 was the Cluster Leader.
    From SOA_MS1 logs we see -
    <Jun 15, 2011 12:11:24 AM MDT> <Warning> <Cluster> <WL-000147> <Server "SOA_MS1" failed to renew lease in the leasing basis hosted by SOA_MS3.>
    <Jun 15, 2011 12:11:24 AM MDT> <Error> <Cluster> <WL-000150> <Server failed to get a connection to the leasing basis hosted by SOA_MS3 in the past 30 seconds for lease renewal. Server will shut itself down.>
    <Jun 15, 2011 12:11:24 AM MDT> <Critical> <Health> <WL-310006> <Critical Subsystem ServerMigration has failed. Setting server state to FAILED.
    Reason: ServerSOA_MS1 failed to renew lease in the leasing basis hosted by SOA_MS3>
    <Jun 15, 2011 12:11:24 AM MDT> <Critical> <WebLogicServer> <WL-000385> <Server health failed. Reason: health of critical service 'ServerMigration' failed>
    <Jun 15, 2011 12:11:24 AM MDT> <Notice> <WebLogicServer> <WL-000365> <Server state changed to FAILED>
    <Jun 15, 2011 12:11:24 AM MDT> <Error> <com.bea.weblogic.kernel> <BEA-000000> <cannot load libary 'stackdump': java.lang.UnsatisfiedLinkError: no stackdump in java.library.path
    >
    <Jun 15, 2011 12:11:24 AM MDT> <Error> <WebLogicServer> <WL-000383> <A critical service failed. The server will shut itself down>
    <Jun 15, 2011 12:11:24 AM MDT> <Notice> <WebLogicServer> <WL-000365> <Server state changed to FORCE_SHUTTING_DOWN>
    <Jun 15, 2011 12:11:24 AM MDT> <Notice> <Cluster> <WL-000163> <Stopping "async" replication service>
    From SOA_MS2 logs we see -
    15, 2011 12:11:16 AM MDT> <Warning> <Cluster> <WL-000147> <Server "SOA_MS2" failed to renew lease in the leasing basis hosted by SOA_MS3.>
    <Jun 15, 2011 12:11:16 AM MDT> <Error> <Cluster> <WL-000150> <Server failed to get a connection to the leasing basis hosted by SOA_MS3 in the past 30 seconds for lease renewal. Server will shut itself down.>
    <Jun 15, 2011 12:11:16 AM MDT> <Critical> <Health> <WL-310006> <Critical Subsystem ServerMigration has failed. Setting server state to FAILED.
    Reason: ServerSOA_MS2 failed to renew lease in the leasing basis hosted by SOA_MS3>
    <Jun 15, 2011 12:11:16 AM MDT> <Critical> <WebLogicServer> <WL-000385> <Server health failed. Reason: health of critical service 'ServerMigration' failed>
    <Jun 15, 2011 12:11:16 AM MDT> <Notice> <WebLogicServer> <WL-000365> <Server state changed to FAILED>
    <Jun 15, 2011 12:11:16 AM MDT> <Error> <com.bea.weblogic.kernel> <BEA-000000> <cannot load libary 'stackdump': java.lang.UnsatisfiedLinkError: no stackdump in java.library.path
    >
    <Jun 15, 2011 12:11:16 AM MDT> <Error> <WebLogicServer> <WL-000383> <A critical service failed. The server will shut itself down>
    <Jun 15, 2011 12:11:16 AM MDT> <Notice> <WebLogicServer> <WL-000365> <Server state changed to FORCE_SHUTTING_DOWN>
    Also, In SOA_MS3 logs we see the followi error -
    ####<Jun 15, 2011 11:43:18 PM MDT> <Error> <Cluster> <soaprdi3> <SOA_MS3> <[ACTIVE] ExecuteThread: '15' for queue: 'weblogic.kernel.Default (self-tuning)'> <<WLS Kernel>> <> <> <1308202998662> <WL-000168> <Failed to restart/migrate server "SOA_MS3" because of Failed to start the migratable server on one of the candidate machines
    Failed to start the migratable server on one of the candidate machines
    at weblogic.cluster.singleton.MigratableServerState.serverUnresponsive(MigratableServerState.java:95)
    at weblogic.cluster.singleton.MigratableServersMonitorImpl.timerExpired(MigratableServersMonitorImpl.java:164)
    at weblogic.timers.internal.TimerImpl.run(TimerImpl.java:273)
    at weblogic.work.SelfTuningWorkManagerImpl$WorkAdapterImpl.run(SelfTuningWorkManagerImpl.java:528)
    at weblogic.work.ExecuteThread.execute(ExecuteThread.java:201)
    at weblogic.work.ExecuteThread.run(ExecuteThread.java:173)
    Thanks,

    Its been many days support working on this, they do not have any clue. we escalated, not much of clue they have yet.
    So, wanted put it across industry experts on SOA.
    Any idea on what causes this Leasing renewal issue and the potential resolution?
    Thanks

  • BPM Server is getting down frequently in dev environment.

    Hi,
    Please help me to resolve the problem that BPM Server getting down frequently in development environment. Daily 2-3 times it gets down. Generally it happens when we do any application deployment.
    Thanks in advance.

    What are your Memory settings? Do You Know the BPM Performance Tuning Guide?http://www.oracle.com/technetwork/middleware/bpm/learnmore/bpm11gperftuning-1912340.pdf
    Danilo

  • Managed server is getting crashed with Unexpected Signal : 11 occurred

    Hi All,
    I have installed weblogic 8.1 in production environment which has 4 manged servers configured on it.
    One of my managed server is getting down on daily basis with JVM crash leaving the below error:
    Unexpected Signal : 11 occurred at PC=0xFEDCBCAC
    Function=[Unknown. Nearest: JVM_FillInStackTrace+0x4CE4]
    Library=/Prod/bea/jdk142_05/jre/lib/sparc/server/libjvm.so
    Current Java thread:
    Dynamic libraries:
    0x10000      /Prod/bea/jdk142_05/bin/java
    0xff380000      /usr/lib/libthread.so.1
    0xff370000      /usr/lib/libdl.so.1
    0xff280000      /usr/lib/libc.so.1
    0xff3b0000      /usr/platform/SUNW,Sun-Fire-V890/lib/libc_psr.so.1
    0xfec00000      /Prod/bea/jdk142_05/jre/lib/sparc/server/libjvm.so
    0xff230000      /usr/lib/libCrun.so.1
    0xff210000      /usr/lib/libsocket.so.1
    0xfeb00000      /usr/lib/libnsl.so.1
    0xfeab0000      /usr/lib/libm.so.1
    0xff1f0000      /usr/lib/libsched.so.1
    0xfebd0000      /usr/lib/libmp.so.2
    0xfea80000      /Prod/bea/jdk142_05/jre/lib/sparc/native_threads/libhpi.so
    0xfea50000      /Prod/bea/jdk142_05/jre/lib/sparc/libverify.so
    0xfea10000      /Prod/bea/jdk142_05/jre/lib/sparc/libjava.so
    0xfe9e0000      /Prod/bea/jdk142_05/jre/lib/sparc/libzip.so
    0xfe860000      /usr/lib/locale/en_GB.ISO8859-1/en_GB.ISO8859-1.so.2
    0xf98d0000      /Prod/bea/jdk142_05/jre/lib/sparc/libnet.so
    0xf9a90000      /Prod/bea/weblogic81/server/lib/solaris/libweblogicunix1.so
    0xf9890000      /Prod/bea/weblogic81/server/lib/solaris/libstackdump.so
    0x59560000      /Prod/bea/jdk142_05/jre/lib/sparc/libnio.so
    0x59540000      /usr/lib/librt.so.1
    0x59520000      /usr/lib/libaio.so.1
    0x58fe0000      /usr/lib/libmd5.so.1
    0x58fc0000      /usr/lib/libsendfile.so.1
    0x58fa0000      /Prod/bea/jdk142_05/jre/lib/sparc/libioser12.so
    0x49300000      /Prod/bea/jdk142_05/jre/lib/sparc/libawt.so
    0x4ca00000      /Prod/bea/jdk142_05/jre/lib/sparc/libmlib_image.so
    0x51e60000      /Prod/bea/jdk142_05/jre/lib/sparc/headless/libmawt.so
    0x49200000      /Prod/bea/jdk142_05/jre/lib/sparc/libfontmanager.so
    Heap at VM Abort:
    Heap
    def new generation total 678464K, used 239751K [0x59800000, 0x842a0000, 0x842a0000)
    eden space 657920K, 35% used [0x59800000, 0x67e59228, 0x81a80000)
    from space 20544K, 18% used [0x82e90000, 0x83258bc0, 0x842a0000)
    to space 20544K, 0% used [0x81a80000, 0x81a80000, 0x82e90000)
    tenured generation total 1398144K, used 91656K [0x842a0000, 0xd9800000, 0xd9800000)
    the space 1398144K, 6% used [0x842a0000, 0x89c22090, 0x89c22200, 0xd9800000)
    compacting perm gen total 74496K, used 74281K [0xd9800000, 0xde0c0000, 0xf9800000)
    the space 74496K, 99% used [0xd9800000, 0xde08a7c8, 0xde08a800, 0xde0c0000)
    Local Time = Tue Sep 22 12:17:26 2009
    Elapsed Time = 94624
    # HotSpot Virtual Machine Error : 11
    # Error ID : 4F530E43505002EF 01
    # Please report this error at
    # http://java.sun.com/cgi-bin/bugreport.cgi
    # Java VM: Java HotSpot(TM) Server VM (1.4.2_05-b04 mixed mode)
    Kindly help me out to solve above problem ......
    Thanks,
    Karthik.

    The kinds of issues are usually bugs in the JVM, I would check your 8.1 Service Pack / Operating System combination on this page:
    http://download.oracle.com/docs/cd/E13196_01/platform/suppconfigs/configs81/81_over/overview.html#1146895
    Make sure you're using the latest supported version of the JVM available for your platform.
    So if you're using 8.1 SP6 on Solaris SPARC, then you could be using Sun Java 2 SDK 1.4.2_11.
    You should also open a support request.

  • MS SQL server is going down frequently(10 days of gap) with exception message: "A severe error occurred on the current command. The results, if any, should be discarded".

    MS SQL server is going down frequently(10 days of gap) with exception message: "A severe error occurred
    on the current command. The results, if any, should be discarded". We are facing this issue for past two month.But funny thing is server will be up automatically with out any service restart manually.  Also if we try to restart the SQL
    server service manually then SQL server will be in a dead lock situation and it will not come up even if we wait for long time. Then we should do a windows server machine restart to
    make the SQL sever up. As a suggestion from Microsoft to fix this kind of similar issue,
    we have installed service pack 3 for SQL Server. But even after we are facing same issue.
    Server Details:
    Server OS: Windows Server 2008 R2
    Two type of database servers are installed on server:
    1. MS SQL Server 2008 R2
    2. My SQL
    Also Reporting server is configured for the purpose of generating SSRS report from a dot net website.
     NOTE:Immediately after the data retrieval/save, we are closing the connection explicitly by the
    application.
    we have checked the windows event log and below are the details:
    Log Name:      Application
    Source:        ASP.NET 4.0.30319.0
    Application information:
        Application domain: /LM/W3SVC/5/ROOT-1-130718142067856406
        Trust level: Full
        Application Virtual Path: /
        Application Path: E:\WebSpaceFolder\ACSQuiK\Production\
        Machine name: DBSERVER 
     Process information:
        Process ID: 148
        Process name: w3wp.exe
        Account name: NT AUTHORITY\NETWORK SERVICE 
     Exception information:
        Exception type: SqlException
        Exception message: A severe error occurred on the current command.  The results, if any, should be discarded.
       at System.Data.SqlClient.SqlInternalConnection.OnError(SqlException exception, Boolean breakConnection, Action`1 wrapCloseInAction)
       at System.Data.SqlClient.TdsParser.ThrowExceptionAndWarning(TdsParserStateObject stateObj, Boolean callerHasConnectionLock, Boolean asyncClose)
       at System.Data.SqlClient.TdsParser.TryRun(RunBehavior runBehavior, SqlCommand cmdHandler, SqlDataReader dataStream, BulkCopySimpleResultSet bulkCopyHandler, TdsParserStateObject stateObj, Boolean& dataReady)
    Log Name:      Application
    Source:        Report Server Windows Service (MSSQLSERVER)
    Description:
    Report Server Windows Service (MSSQLSERVER) cannot connect to the report server database.
    Event Xml:
    <Event xmlns="http://schemas.microsoft.com/win/2004/08/events/event">
      <System>
        <Provider Name="Report Server Windows Service (MSSQLSERVER)" />
        <EventID Qualifiers="0">107</EventID>
    Could anybody can suggest any kind of fix for this issue? Thanks in advance.

    Hi YesYemPee,
    I have tried but still not clear about your issue, I would like you provide more details information about your issue based on below points to better analysis about the issue:
    What action did you do and caused the error "A severe error occurred on the current command. The results, if any, should be discarded", did you run report on the web application or something else then the error happen?
    If you rendering the report and got the error, please try to provide us more error information in the log files which path like:
    C:\Program Files\Microsoft SQL Server\MSRS10_50.MSSQLSERVER\Reporting Services\LogFiles
    If it is not the case in step1, Please try to provide SQL Server Error log(SQL Server Logs) and more details information.
    If you still have any problem, please feel free to ask.
    Regards,
    Vicky Liu
    Vicky Liu
    TechNet Community Support

  • SOA managed derver is going down frequently

    Hi,
    We are facing one specific issue in SOA 11g environment .
    SOA managed server is hosted on WebLogic Server Version: 10.3.4.0.
    Server is keep on going down even after restart, after each restart it iwll come up for 15-20 minutes max and then again soa managed serve will go down.
    Also in nohup logs we observed below warning :
    oracle.adf.share.ADFContext> <BEA-000000>
    +<Automatically initializing a DefaultContext for getCurrent.+
    Caller should ensure that a DefaultContext is proper for this use.
    Memory leaks and/or unexpected behaviour may occur if the automatic initialization is
    performed improperly.
    This message may be avoided by performing initADFContext before using getCurrent().
    To see the stack trace for thread that is initializing this, set the logging level of
    oracle.adf.share.ADFContext to FINEST>
    Also some error messages like :
    +<BEA-000000> <ServletContainerAdapter manager not initialized correctly.>+
    +<BEA-000000> <Could not find saved view state for token lb617ahaj>+
    Could some once please let us know what could be reason for this .
    Please suggest if there is any solution for the same.
    Regards,
    Nupur

    Hi,
    We are facing one specific issue in SOA 11g environment .
    SOA managed server is hosted on WebLogic Server Version: 10.3.4.0.
    Server is keep on going down even after restart, after each restart it iwll come up for 15-20 minutes max and then again soa managed serve will go down.
    Also in nohup logs we observed below warning :
    oracle.adf.share.ADFContext> <BEA-000000>
    +<Automatically initializing a DefaultContext for getCurrent.+
    Caller should ensure that a DefaultContext is proper for this use.
    Memory leaks and/or unexpected behaviour may occur if the automatic initialization is
    performed improperly.
    This message may be avoided by performing initADFContext before using getCurrent().
    To see the stack trace for thread that is initializing this, set the logging level of
    oracle.adf.share.ADFContext to FINEST>
    Also some error messages like :
    +<BEA-000000> <ServletContainerAdapter manager not initialized correctly.>+
    +<BEA-000000> <Could not find saved view state for token lb617ahaj>+
    Could some once please let us know what could be reason for this .
    Please suggest if there is any solution for the same.
    Regards,
    Nupur

  • Notification mailer getting down frequently

    Hi All,
    Notification mailer getting down frequently.
    We have checked the log file and got the below errors:
    1) Maximum number of errors (null) have been reached for this Service Component -> oracle.apps.fnd.cp.gsc.ProcessorException: Unable to connect to mail store)
    2) Maximum number of errors (10) have been reached for this Service Component -> oracle.apps.fnd.cp.gsc.ProcessorException: Unable to connect to mail store
    Please help us to resolve the issue.
    Thanks
    Subhasis
    Edited by: user11977214 on Jul 13, 2010 12:48 AM
    This Automatic Service Component has been restarted the maximum of 10 times after stopping with error. Thus, it has been system deactivated -> oracle.apps.fnd.cp.gsc.ProcessorException: Problem getting HTML content. -> oracle.apps.fnd.wf.mailer.FormatterException: Problem getting the HTML content -> oracle.apps.fnd.wf.mailer.NotificationFormatter$FormatterSAXException: Problem obtaining the HTML content -> oracle.apps.fnd.wf.common.HTTPClientException: Unable to invoke method HTTPClient.HTTPConnection.Get caused by: java.net.UnknownHostException: ccuine03.eveready.co.in at oracle.apps.fnd.wf.mailer.NotificationFormatter.handleResEndTag(NotificationFormatter.java:3151) at oracle.apps.fnd.wf.mailer.NotificationFormatter.endElement(NotificationFormatter.java:562) at oracle.xml.parser.v2.XMLContentHandler.endElement(XMLContentHandler.java:196) at oracle.xml.parser.v2.NonValidatingParser.parseElement(NonValidatingParser.java:1212) at oracle.xml.parser.v2.NonValidatingParser.parseRootElement(NonValidatingParser.java:301) at oracle.xml.parser.v2.NonValidatingParser.parseDocument(NonValidatingParser.java:268) at oracle.xml.parser.v2.XMLParser.parse(XMLParser.java:253) at oracle.apps.fnd.wf.mailer.NotificationFormatter.getFormattedMessages(NotificationFormatter.java:338) at oracle.apps.fnd.wf.mailer.SMTPMessageHandler.prepareMessages(SMTPMessageHandler.java:96) at oracle.apps.fnd.wf.mailer.SMTPOutboundProcessor.read(SMTPOutboundProcessor.java:707) at oracle.apps.fnd.cp.gsc.SvcComponentProcessor.process(SvcComponentProcessor.java:596) at oracle.apps.fnd.cp.gsc.Processor.run(Processor.java:283) at java.lang.Thread.run(Thread.java:534) Caused by: oracle.apps.fnd.wf.mailer.NotificationFormatter$FormatterSAXException: Problem obtaining the HTML content -> oracle.apps.fnd.wf.common.HTTPClientException: Unable to invoke method HTTPClient.HTTPConnection.Get caused by: java.net.UnknownHostException: ccuine03.eveready.co.in
    Is the error

    Please go through the Note: 469822.1 - Oracle Workflow Release 12 Diagnostics and run the tests.
    It may help is troubleshooting the issue.
    Regards
    http://www.oracleracexpert.com
    ORA-07445 Error and reasons for it.
    http://www.oracleracexpert.com/2009/08/ora-07445-error.html
    See the ORA-27102 Error and Soltuion on Solaris
    http://www.oracleracexpert.com/2009/08/ora-27102-out-of-memory-on-solaris.html

  • MDM ABAP API  ISSUE ( server  is getting down )

    Hi Folks,
    I am trying to retrieve matching results using MDM ABAP API.
    I am spiting source and target records into lot of blocks dynamically
    in program. I am getting output 2 to 3 times if i can run program
    sequential after that server is getting down (before running program
    i am completely going out and rerunning).After server bring's up
    running couple of times and server getting down.
    Please help me how can i solve this issue.
    Thanks,
    Anil.

    Hi Anil,
    You can have a look at the below links can cross check the steps you have performed in establishing the connection correctly:
    https://www.sdn.sap.com/irj/sdn/go/portal/prtroot/docs/media/uuid/00c49ffb-e5e5-2910-73ba-c85af1da5b0a
    ABAP APIs: Error "The connection is not trusted"
    Comaptible ABAP APIs for MDM 5.5 SP6 Patch 1
    https://www.sdn.sap.com/irj/sdn/wiki?path=/display/profile/tip%2b%2bMDM%2bABAP-API%2b%2bThings%2bto%2bRemember%2b(for%2bStarters)
    https://www.sdn.sap.com/irj/sdn/go/portal/prtroot/docs/library/uuid/e060251e-b58d-2910-02a2-c9a1d60d9116
    Hope It Helped
    Thanks & Regards
    Simona Pinto

  • UME IM getting down frequently.

    Hi,
    In our development portal UME IM is frequently getting down and we don't understand why it happens. We redeploy the component again into the portal and whenever the portal restarting , again it goes down.
    it shows the following error
    " A required service for the identity management user interface is not available. Contact your system administrator "
    By the if in case if we want restart he UME IM in Portal, What is the Application Console name of UME IM ?
    please help
    Regards,
    Jyothi

    Hi,
    My system details are below
    Java(TM) 2 Runtime Environment, Standard Edition :  1.4.2_13-b06
    OS                                            :  SunOS (5.10)
    Server                                                                  :  64 Bit
    I find there is not error in trace file. Where can we find "JHVM_LoadJavaVM" and other details?
    Regards,
    Jyothi

  • After LDAP Configuration Starting biserver1(Managed Server) is getting Fail

    I have Configured the LDAP(OID) by following the Oracle Fusion Middleware Security Guide for Oracle Business Intelligence Enterprise Edition
    11g Release 1 (11.1.1) (Section 3) Completed sucessfully with out any errors.. Users also imported sucessfully. after that when I am starting the biserver1(Managed Server) I am getting error like
    "Server subsystem failed. Reason: weblogic.security.SecurityInitializationException: Authentication for user denied"
    was taken from biserver log file. please find the below attachment for the same.
    Please help me for the same
    biserver.log
    ####<Mar 22, 2012 2:40:41 PM CDT> <Info> <Server> <usstuobitest03.diversey.com> <bi_server1> <[ACTIVE] ExecuteThread: '0' for queue: 'weblogic.kernel.Default (self-tuning)'> <<WLS Kernel>> <> <> <1332445241307> <BEA-002609> <Channel Service initialized.>
    ####<Mar 22, 2012 2:40:41 PM CDT> <Info> <Socket> <usstuobitest03.diversey.com> <bi_server1> <[STANDBY] ExecuteThread: '1' for queue: 'weblogic.kernel.Default (self-tuning)'> <<WLS Kernel>> <> <> <1332445241317> <BEA-000415> <System has file descriptor limits of - soft: 4,096, hard: 4,096>
    ####<Mar 22, 2012 2:40:41 PM CDT> <Info> <Socket> <usstuobitest03.diversey.com> <bi_server1> <[STANDBY] ExecuteThread: '1' for queue: 'weblogic.kernel.Default (self-tuning)'> <<WLS Kernel>> <> <> <1332445241317> <BEA-000416> <Using effective file descriptor limit of: 4,096 open sockets/files.>
    ####<Mar 22, 2012 2:40:41 PM CDT> <Info> <Socket> <usstuobitest03.diversey.com> <bi_server1> <[STANDBY] ExecuteThread: '1' for queue: 'weblogic.kernel.Default (self-tuning)'> <<WLS Kernel>> <> <> <1332445241317> <BEA-000406> <PosixSocketMuxer was built on Apr 24 2007 16:05:00>
    ####<Mar 22, 2012 2:40:41 PM CDT> <Info> <Socket> <usstuobitest03.diversey.com> <bi_server1> <[STANDBY] ExecuteThread: '1' for queue: 'weblogic.kernel.Default (self-tuning)'> <<WLS Kernel>> <> <> <1332445241339> <BEA-000436> <Allocating 3 reader threads.>
    ####<Mar 22, 2012 2:40:41 PM CDT> <Info> <Socket> <usstuobitest03.diversey.com> <bi_server1> <[STANDBY] ExecuteThread: '1' for queue: 'weblogic.kernel.Default (self-tuning)'> <<WLS Kernel>> <> <> <1332445241339> <BEA-000446> <Native IO Enabled.>
    ####<Mar 22, 2012 2:40:41 PM CDT> <Info> <IIOP> <usstuobitest03.diversey.com> <bi_server1> <[ACTIVE] ExecuteThread: '0' for queue: 'weblogic.kernel.Default (self-tuning)'> <<WLS Kernel>> <> <> <1332445241572> <BEA-002014> <IIOP subsystem enabled.>
    ####<Mar 22, 2012 2:40:46 PM CDT> <Info> <Security> <usstuobitest03.diversey.com> <bi_server1> <[STANDBY] ExecuteThread: '1' for queue: 'weblogic.kernel.Default (self-tuning)'> <<WLS Kernel>> <> <> <1332445246302> <BEA-090894> <Successfully loaded the OPSS Policy Provider using oracle.security.jps.internal.policystore.JavaPolicyProvider.>
    ####<Mar 22, 2012 2:40:46 PM CDT> <Info> <Security> <usstuobitest03.diversey.com> <bi_server1> <[STANDBY] ExecuteThread: '1' for queue: 'weblogic.kernel.Default (self-tuning)'> <<WLS Kernel>> <> <> <1332445246667> <BEA-000000> <Starting OpenJPA 1.1.1-SNAPSHOT>
    ####<Mar 22, 2012 2:40:46 PM CDT> <Info> <Security> <usstuobitest03.diversey.com> <bi_server1> <[STANDBY] ExecuteThread: '1' for queue: 'weblogic.kernel.Default (self-tuning)'> <<WLS Kernel>> <> <> <1332445246944> <BEA-000000> <StoreServiceImpl.initJDO - StoreService is initialized with Id = ldap_lDqprIBb69IOInpk4TtgfToFVP8=>
    ####<Mar 22, 2012 2:40:47 PM CDT> <Info> <Security> <usstuobitest03.diversey.com> <bi_server1> <[STANDBY] ExecuteThread: '1' for queue: 'weblogic.kernel.Default (self-tuning)'> <<WLS Kernel>> <> <> <1332445247141> <BEA-090516> <The Authorizer provider has preexisting LDAP data.>
    ####<Mar 22, 2012 2:40:47 PM CDT> <Info> <Security> <usstuobitest03.diversey.com> <bi_server1> <[STANDBY] ExecuteThread: '1' for queue: 'weblogic.kernel.Default (self-tuning)'> <<WLS Kernel>> <> <> <1332445247707> <BEA-090516> <The CredentialMapper provider has preexisting LDAP data.>
    ####<Mar 22, 2012 2:40:47 PM CDT> <Info> <Security> <usstuobitest03.diversey.com> <bi_server1> <[STANDBY] ExecuteThread: '1' for queue: 'weblogic.kernel.Default (self-tuning)'> <<WLS Kernel>> <> <> <1332445247719> <BEA-090516> <The RoleMapper provider has preexisting LDAP data.>
    ####<Mar 22, 2012 2:40:47 PM CDT> <Info> <Security> <usstuobitest03.diversey.com> <bi_server1> <[STANDBY] ExecuteThread: '1' for queue: 'weblogic.kernel.Default (self-tuning)'> <<WLS Kernel>> <> <> <1332445247891> <BEA-090093> <No pre-WLS 8.1 Keystore providers are configured for server bi_server1 for security realm myrealm.>
    ####<Mar 22, 2012 2:40:47 PM CDT> <Notice> <Security> <usstuobitest03.diversey.com> <bi_server1> <[STANDBY] ExecuteThread: '1' for queue: 'weblogic.kernel.Default (self-tuning)'> <<WLS Kernel>> <> <> <1332445247892> <BEA-090082> <Security initializing using security realm myrealm.>
    ####<Mar 22, 2012 2:40:47 PM CDT> <Critical> <Security> <usstuobitest03.diversey.com> <bi_server1> <[STANDBY] ExecuteThread: '1' for queue: 'weblogic.kernel.Default (self-tuning)'> <<WLS Kernel>> <> <> <1332445247908> <BEA-090403> <Authentication for user denied>
    ####<Mar 22, 2012 2:40:47 PM CDT> <Critical> <WebLogicServer> <usstuobitest03.diversey.com> <bi_server1> <main> <<WLS Kernel>> <> <> <1332445247909> <BEA-000386> <Server subsystem failed. Reason: weblogic.security.SecurityInitializationException: Authentication for user denied
    weblogic.security.SecurityInitializationException: Authentication for user denied
         at weblogic.security.service.CommonSecurityServiceManagerDelegateImpl.doBootAuthorization(CommonSecurityServiceManagerDelegateImpl.java:966)
         at weblogic.security.service.CommonSecurityServiceManagerDelegateImpl.initialize(CommonSecurityServiceManagerDelegateImpl.java:1054)
         at weblogic.security.service.SecurityServiceManager.initialize(SecurityServiceManager.java:873)
         at weblogic.security.SecurityService.start(SecurityService.java:141)
         at weblogic.t3.srvr.SubsystemRequest.run(SubsystemRequest.java:64)
         at weblogic.work.SelfTuningWorkManagerImpl$WorkAdapterImpl.run(SelfTuningWorkManagerImpl.java:545)
         at weblogic.work.ExecuteThread.execute(ExecuteThread.java:256)
         at weblogic.work.ExecuteThread.run(ExecuteThread.java:221)
    Caused By: javax.security.auth.login.FailedLoginException: [Security:090304]Authentication Failed: User javax.security.auth.login.LoginException: [Security:090301]Password Not Supplied
         at weblogic.security.providers.authentication.LDAPAtnLoginModuleImpl.login(LDAPAtnLoginModuleImpl.java:261)
         at com.bea.common.security.internal.service.LoginModuleWrapper$1.run(LoginModuleWrapper.java:110)
         at java.security.AccessController.doPrivileged(Native Method)
         at com.bea.common.security.internal.service.LoginModuleWrapper.login(LoginModuleWrapper.java:106)
         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
         at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
         at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
         at java.lang.reflect.Method.invoke(Method.java:597)
         at javax.security.auth.login.LoginContext.invoke(LoginContext.java:769)
         at javax.security.auth.login.LoginContext.access$000(LoginContext.java:186)
         at javax.security.auth.login.LoginContext$4.run(LoginContext.java:683)
         at java.security.AccessController.doPrivileged(Native Method)
         at javax.security.auth.login.LoginContext.invokePriv(LoginContext.java:680)
         at javax.security.auth.login.LoginContext.login(LoginContext.java:579)
         at com.bea.common.security.internal.service.JAASLoginServiceImpl.login(JAASLoginServiceImpl.java:113)
         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
         at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
         at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
         at java.lang.reflect.Method.invoke(Method.java:597)
         at com.bea.common.security.internal.utils.Delegator$ProxyInvocationHandler.invoke(Delegator.java:57)
         at $Proxy36.login(Unknown Source)
         at weblogic.security.service.internal.WLSJAASLoginServiceImpl$ServiceImpl.login(WLSJAASLoginServiceImpl.java:89)
         at com.bea.common.security.internal.service.JAASAuthenticationServiceImpl.authenticate(JAASAuthenticationServiceImpl.java:82)
         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
         at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
         at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
         at java.lang.reflect.Method.invoke(Method.java:597)
         at com.bea.common.security.internal.utils.Delegator$ProxyInvocationHandler.invoke(Delegator.java:57)
         at $Proxy54.authenticate(Unknown Source)
         at weblogic.security.service.WLSJAASAuthenticationServiceWrapper.authenticate(WLSJAASAuthenticationServiceWrapper.java:40)
         at weblogic.security.service.PrincipalAuthenticator.authenticate(PrincipalAuthenticator.java:338)
         at weblogic.security.service.CommonSecurityServiceManagerDelegateImpl.doBootAuthorization(CommonSecurityServiceManagerDelegateImpl.java:930)
         at weblogic.security.service.CommonSecurityServiceManagerDelegateImpl.initialize(CommonSecurityServiceManagerDelegateImpl.java:1054)
         at weblogic.security.service.SecurityServiceManager.initialize(SecurityServiceManager.java:873)
         at weblogic.security.SecurityService.start(SecurityService.java:141)
         at weblogic.t3.srvr.SubsystemRequest.run(SubsystemRequest.java:64)
         at weblogic.work.SelfTuningWorkManagerImpl$WorkAdapterImpl.run(SelfTuningWorkManagerImpl.java:545)
         at weblogic.work.ExecuteThread.execute(ExecuteThread.java:256)
         at weblogic.work.ExecuteThread.run(ExecuteThread.java:221)
    >
    ####<Mar 22, 2012 2:40:47 PM CDT> <Notice> <WebLogicServer> <usstuobitest03.diversey.com> <bi_server1> <main> <<WLS Kernel>> <> <> <1332445247917> <BEA-000365> <Server state changed to FAILED>
    ####<Mar 22, 2012 2:40:47 PM CDT> <Error> <WebLogicServer> <usstuobitest03.diversey.com> <bi_server1> <main> <<WLS Kernel>> <> <> <1332445247917> <BEA-000383> <A critical service failed. The server will shut itself down>
    ####<Mar 22, 2012 2:40:47 PM CDT> <Notice> <WebLogicServer> <usstuobitest03.diversey.com> <bi_server1> <main> <<WLS Kernel>> <> <> <1332445247918> <BEA-000365> <Server state changed to FORCE_SHUTTING_DOWN>
    ####<Mar 22, 2012 2:40:47 PM CDT> <Info> <WebLogicServer> <usstuobitest03.diversey.com> <bi_server1> <main> <<WLS Kernel>> <> <> <1332445247923> <BEA-000236> <Stopping execute threads.>

    WebLogic has 2 accounts that were created on install..BISystemUser and weblogic or whatever you may have called that. Are the passwords of BISystemUser the same in EM and WebLogic? Also, I believe you had to create a BISystemUser in OID. That password should match to the BISystemUser in EM and WL.

  • File system getting full and Server node getting down.

    Hi Team,
    Currently we are using IBM Power 6 AIX operating system.
    And in our environment, for development system, file system is getting full and development system is getting slow while accessing.
    Can you please let me know , what exactly the problem & which command is used to see the file system size and how to resolve the issue by deleting the core files or some ting. Please help me .
    Thanks
    Manoj K

    Hi      Orkun Gedik,
    When i executed the command df -lg and find . -name core noting is displayed, but if i execute the command df is showed me the below information. below is an original file which i have modified the sid.
    Filesystem    512-blocks      Free %Used    Iused %Iused Mounted on
    /dev/fslv10     52428800  16279744   69%   389631    15% /usr/sap/SID
    Server 0 node is giving the problem. its getting down all the times.
    And if i check it in the /usr/sap/SID/<Instance>/work for the server node "std_server0.out file , the below information is written in the file.
    framework started for 73278 ms.
    SAP J2EE Engine Version 7.00   PatchLevel 81863.450 is running! PatchLevel 81863.450 March 10, 2010 11:48 GMT
    94.539: [GC 94.539: [ParNew: 239760K->74856K(261888K), 0.2705150 secs] 239760K->74856K(2009856K), 0.2708720 secs] [Times: user=0.00 sys=0.36, real=0.27 secs]
    105.163: [GC 105.164: [ParNew: 249448K->80797K(261888K), 0.2317650 secs] 249448K->80797K(2009856K), 0.2320960 secs] [Times: user=0.00 sys=0.44, real=0.23 secs]
    113.248: [GC 113.248: [ParNew: 255389K->87296K(261888K), 0.3284190 secs] 255389K->91531K(2009856K), 0.3287400 secs] [Times: user=0.00 sys=0.58, real=0.33 secs]
    Please advise.
    thanks in advance
    Manoj K

  • Java stack of XI server is going down frequently.

    Hi Experts,
    The java stack of our XI Server is going down very frequently. This is happening mostly once in 3 to 4 days.Please let me know what could be the problem and how can I reolve it
    Thanks & Regards,
    Shanahas.K

    Hi Sunny,
    Where can I check default trace files when your Java is down ?
    I have checked in /usr/sap/<SID>/DVEBMGS00/j2ee/cluster/server0 folder. But the files which I have found are either very old(about a month) or the files are latest which are created after the system is restarted.(Java started working after we restarted the server)
    Also, how to find out whether installed license in our As Java.
    Please help
    Thanks & regards,
    Shanahas

  • Listeners are going down frequently..

    Hi,
    I have two node cluster databases.in that cluster 5 databases are running. We have configuared 2 listeners for each database and registered in OCR.But frequently some listeners are going down or UNKNOWN state from first node only. everything is running fine from second node. How to troubleshoot this?
    Thanks in advance

    user2017273 wrote:
    I have two node cluster databases.in that cluster 5 databases are running. We have configuared 2 listeners for each database and registered in OCR.As I understand, you are running 5 RAC databases on the same cluster (meaning 5 RAC instances per node), with each instance having 2 listeners, resulting in 10 listeners per node?
    What on earth for? Why? What problem/issue are you trying to address that way?
    But frequently some listeners are going down or UNKNOWN state from first node only. everything is running fine from second node. How to troubleshoot this? RAC is only as robust as
    a) the architecture it is implemented on (server h/w, Interconnect, etc)
    b) how well it adheres to Oracle concepts and fundamentals
    5 RAC instances on the same 2 nodes, using 10 listeners per node? That is anything but adhering to Oracle fundamentals. More like total madness IMO.
    Cannot recall ever having a listener (stand-alone or on any of our RACs) simply going down and not working as designed. So I doubt strongly that your are dealing with an Oracle issue here. Seems to be a case of an unnecessary self inflicted wound.

  • 10gRAC VIP get down frequently on VM....

    Hi All,
    I have setup oracle10gR2 RAC (10.2.0.4.0) EE on VM. During the installation there is no issues , infact going very smoothly.
    When I handover this envrionment to my QA/QA department there is always complaint about VIP. VIP frequently gets down on both the nodes. I have no option except reboot both the RAC VMs. CAn you please suggest me what could be the reason to get VIP frequently down on VM ? Is this known issue on VM?
    Please suggest me.
    Thanks...

    Hi,
    You need to have minimum 3 voting disk to determine the survival in case on node eviction. So add 2 more voting disk.
    Always ODD number of Voting disks.
    http://docs.oracle.com/cd/B19306_01/rac.102/b28759/adminoc.htm#TDPRC055
    And ownership should be oracle:dba with 640 permission.
    Anand

  • SOA Server getting down frequently

    Hi All,
    Following are the versions:
    WebLogic Version : 10.3.3.0
    SOA : 11.1.1.3.0
    We are facing frequent server breakdown issues.
    But we could not find the root cause for it.
    Does anyone faced this scenario ?
    What could be the possible reasons regarding this server down issue ??
    In the error logs too we could not find any valuable information .
    Please add your suggestions.
    Regards
    Sridhar

    Is this when u run certain process or its happening commonly when no process is running.
    when its failing doea it give any datasource errors.
    Which server shuts down admin or soa server, if its shuts down is it throwing overloaded first and then shut down.

Maybe you are looking for