WLS 10.3.5 on RHEL 5.4, SocketException: Too many open files

Hi
I'm running Weblogic server 10.3.5 on Red Hat Enterprise Linux Server release 5.4 (Tikanga), with Java jdk1.6.0_27.
My order handling application, when receiving client orders, needs to make outbound SOAP calls to fulfill the order. During a performance test, we got following errors:
####<Feb 10, 2012 2:28:41 PM ICT> <Critical> <Server> <KKMOMAPP2> <KKMOMPE2> <DynamicListenThread[Default]> <<WLS Kernel>> <> <> <1328858921806> <BEA-002616> <Failed to listen on channel "Default" on 172.24.106.81:4095, failure count: 1, failing for 0 seconds, java.net.SocketException: Too many open files>
I monitored the java process of this application, when the "Too many open files" error happened, it had 1388 open file descriptors, among which 655 were sockets.
I also monitored the total open file descriptors of the weblogic user account, the count was around 6300 during this error.
These numbers are far smaller than the file limits configured on OS:
- Under weblogic account, ulimit -n shows 65536
- /proc/sys/fs/file-max shows 772591
- Following lines are already in /etc/security/limits.conf
weblogic soft nofile 65536
weblogic hard nofile 65536
weblogic soft nproc 16384
weblogic hard nproc 16384
I did another test using a simple java program to open large number of sockets under weblogic account. It has no problem to open 15,000 sockets. It seems the file descriptor limit is indeed quite high, but for some reasons, the Weblogic process fails even when it has merely 1388 open files. Are there other Linux or Weblogic parameters I should tune? Or anything else I missed?
Thank you very much
Ning

Hi All,
Any help on this issue ?
Thank you,
Ram

Similar Messages

  • WLS 92MP1: Application Poller issue Too many open files

    Hi,
    We have a wls92mp1 domain on linux AS4(64bit) with Sun jdk 1.5.0_14. It contains only Admin server where we have deployed the application. Over a period of time the server start showing up below message in the logs. We have not deployed the application from autodeploy directory. And the file "/home/userid/wls92/etg/servers/userid_a/cache/.app_poller_lastrun " is available in the location, still it throws FileNotFoundException.
    <Error> <Application Poller> <BEA-149411> <I/O exception encountered java.io.FileNotFoundException: /home/userid/wls92/etg/servers/userid_a/cache/.a
    pp_poller_lastrun (Too many open files).
    java.io.FileNotFoundException: /home/userid/wls92/etg/servers/userid_a/cache/.app_poller_lastrun (Too many open files)
    at java.io.FileOutputStream.open(Native Method)
    at java.io.FileOutputStream.<init>(FileOutputStream.java:179)
    at java.io.FileOutputStream.<init>(FileOutputStream.java:131)
    at java.io.FileWriter.<init>(FileWriter.java:73)
    at weblogic.management.deploy.GenericAppPoller.setLastRunFileMap(GenericAppPoller.java:423)
    Any help regarding this would be highly appreciated.
    Thanks.

    Hi,
    By above seeing in error, this error code (BEA-149411) describe the following
    149411: I/O exception encountered {0}.
    L10n Package: weblogic.management.deploy.internal
    I18n Package: weblogic.management.deploy.internal
    Subsystem: Application Poller
    Severity: Error
    Stack Trace: true
    Message Detail: An I/O exception denotes a failure to perform a read/write operation on the application files.
    Cause: An I/O exception can occur during file read/write while deploying an application.
    Action: Take corrective action based on the exception message details.
    i think it helps u.
    -abhi

  • WLS 7.0.4 - JMS Connection Factory - Server Affinity - issues in log file

    <b>WLS 7.0.4 - JMS Connection Factory - Server Affinity - issues in log file</b>
              We are using WLS 7.0.4 - One of JMS connection factory setting in admin console we selected "Server Affinity" options.
              We see this messages appear in Weblogic log file,
              ####<Apr 24, 2006 1:56:53 AM EDT> <Error> <Cluster> <liberatenode4.dc2.adelphia.com> <node4_svr> <ExecuteThrea
              d: '4' for queue: '__weblogic_admin_rmi_queue'> <kernel identity> <> <000123> <Conflict start: You tried to bi
              nd an object under the name sbetrmi2 in the JNDI tree. The object you have bound from liberatenode2.dc2.adelp
              hia.com is non clusterable and you have tried to bind more than once from two or more servers. Such objects ca
              n only deployed from one server.>
              and then,
              ####<Apr 24, 2006 1:58:12 AM EDT> <Error> <Cluster> <liberatenode5.dc2.adelphia.com> <node5_svr> <ExecuteThrea
              d: '7' for queue: '__weblogic_admin_rmi_queue'> <kernel identity> <> <000125> <Conflict Resolved: sbetrmi2 for
              the object from liberatenode5.dc2.adelphia.com under the bind name sbetrmi2 in the JNDI tree.>
              Should we use 'load balancing option' instead of 'server affinity' ?
              Any thuoghts?
              Thanks in adv.
              Vijay

    Test Reply
              <Vijay Kumar> wrote in message news:[email protected]..
              > <b>WLS 7.0.4 - JMS Connection Factory - Server Affinity - issues in log
              > file</b>
              >
              > We are using WLS 7.0.4 - One of JMS connection factory setting in admin
              > console we selected "Server Affinity" options.
              >
              > We see this messages appear in Weblogic log file,
              > ####<Apr 24, 2006 1:56:53 AM EDT> <Error> <Cluster>
              > <liberatenode4.dc2.adelphia.com> <node4_svr> <ExecuteThrea
              > d: '4' for queue: '__weblogic_admin_rmi_queue'> <kernel identity> <>
              > <000123> <Conflict start: You tried to bi
              > nd an object under the name sbetrmi2 in the JNDI tree. The object you have
              > bound from liberatenode2.dc2.adelp
              > hia.com is non clusterable and you have tried to bind more than once from
              > two or more servers. Such objects ca
              > n only deployed from one server.>
              >
              > and then,
              > ####<Apr 24, 2006 1:58:12 AM EDT> <Error> <Cluster>
              > <liberatenode5.dc2.adelphia.com> <node5_svr> <ExecuteThrea
              > d: '7' for queue: '__weblogic_admin_rmi_queue'> <kernel identity> <>
              > <000125> <Conflict Resolved: sbetrmi2 for
              > the object from liberatenode5.dc2.adelphia.com under the bind name
              > sbetrmi2 in the JNDI tree.>
              >
              >
              > Should we use 'load balancing option' instead of 'server affinity' ?
              >
              > Any thuoghts?
              >
              > Thanks in adv.
              > Vijay

  • WLS 10.3.x for RHEL 5.4

    Hi
    I'm trying to download WLS 10.3.x for a RHEL 5.4, and I don't see any link from the download page for this kind of architecture (64bits for RH).
    Can someone tell from where I can get it (if there is a version)?
    Thanks in advance,
    Andres

    Hi
    I'm trying to download WLS 10.3.x for a RHEL 5.4, and I don't see any link from the download page for this kind of architecture (64bits for RH).
    Can someone tell from where I can get it (if there is a version)?
    Thanks in advance,
    Andres

  • Upgrading of WLS 6.1 from SP3 to SP5

    Can anyone help me.
    I am going to upgrade WLS 6.1 from SP3 to SP5.
    How can i do this ?
    From where do i download the ServicePack (SP5) ?
    Is there someting i have to be aware off, about the license ?

    Hi Paul
    This is a JVM bug, Upgrade to 1.3.1_08 jvm from sun
    Contact weblogic support for temporary workaround
    Paul Wilson wrote:
    We've a client running 6.1 sp2 on Solaris, who is experiencing
    Weblogic hanging for roughly 10 minutes at a time. On resumption they
    get:
    ####<06-May-03 16:28:50 BST> <Critical> <WebLogicServer> <edox>
    <Mendel> <ListenThread> <system> <> <000204> <Failed to listen on port
    80, failure count: 1, failing for 1,052,234,928 seconds,
    java.net.SocketException: Software caused connection abort>
    ####<06-May-03 16:28:51 BST> <Notice> <WebLogicServer> <edox> <Mendel>
    <ListenThread> <system> <> <000205> <After having failed to listen,
    the server is now listening on port 80>
    The last time it occurred, I got them to take a thread dump and all
    but one execution thread and the listener threads were idle. One
    execution thread was busy reloading (or loading) a class from the war.
    I've asked them to ensure that the reload period is -1, but that
    shouldn't cause a 10 minute hang; plus nothing had changed. Red
    herring?
    As an experiment I wrote a servlet that just blocks its execution
    thread: after about a thousand calls to this on our dev box, we get
    <May 14, 2003 5:45:42 PM BST> <Critical> <WebLogicServer> <Failed to
    listen on port 6001, failure count: 3, failing for 1,052,930,739
    seconds, java.net.SocketException: Too many open files>
    AFAIK this means that we've run out of file descriptors. Our client
    doesn't get this, so I don't think that is happening to them.
    A number of people on weblogic.* groups reported similar problems
    about a year ago, but without any really definitive resolutions.
    Anyone solved this, even by upgrading?

  • AD connector on OIM 11g

    Hi experts
    I am trying to install AD connector on OIM 11g. However, when i run the installation, the first two steps i.e,
    Configuration of Connector Libraries and
    Import of Connector XML files
    complete successfully, however, the third step "Compilation of Adapter Definitions" takes really long time and eventually fails.
    the server logs are as under :-
    ####<Jan 13, 2011 11:38:44 PM EST> <Warning> <JDBC> <oim.soa.af> <oim_server1> <MDSPollingThread-[oim, jdbc/mds/MDS_REPOS]> <<anonymous>> <> <11d1def534ea1be0:edd9efd:12d79bd90fb:-7ffd-0000000000000013> <1294979924173> <BEA-001129> <Received exception while creating connection for pool "mds-oim": The Network Adapter could not establish the connection>
    ####<Jan 13, 2011 11:38:44 PM EST> <Info> <JDBC> <oim.soa.af> <oim_server1> <MDSPollingThread-[oim, jdbc/mds/MDS_REPOS]> <<anonymous>> <> <11d1def534ea1be0:edd9efd:12d79bd90fb:-7ffd-0000000000000013> <1294979924176> <BEA-001156> <Stack trace associated with message 001129 follows:
    java.sql.SQLException: The Network Adapter could not establish the connection
         at oracle.jdbc.driver.SQLStateMapping.newSQLException(SQLStateMapping.java:74)
         at oracle.jdbc.driver.DatabaseError.newSQLException(DatabaseError.java:135)
         at oracle.jdbc.driver.DatabaseError.throwSqlException(DatabaseError.java:203)
         at oracle.jdbc.driver.DatabaseError.throwSqlException(DatabaseError.java:489)
         at oracle.jdbc.driver.T4CConnection.logon(T4CConnection.java:439)
         at oracle.jdbc.driver.PhysicalConnection.<init>(PhysicalConnection.java:640)
         at oracle.jdbc.driver.T4CConnection.<init>(T4CConnection.java:205)
         at oracle.jdbc.driver.T4CDriverExtension.getConnection(T4CDriverExtension.java:35)
         at oracle.jdbc.driver.OracleDriver.connect(OracleDriver.java:554)
         at weblogic.jdbc.common.internal.ConnectionEnvFactory.makeConnection(ConnectionEnvFactory.java:327)
         at weblogic.jdbc.common.internal.ConnectionEnvFactory.createResource(ConnectionEnvFactory.java:227)
         at weblogic.common.resourcepool.ResourcePoolImpl.makeResources(ResourcePoolImpl.java:1193)
         at weblogic.common.resourcepool.ResourcePoolImpl.makeResources(ResourcePoolImpl.java:1117)
         at weblogic.common.resourcepool.ResourcePoolImpl.reserveResourceInternal(ResourcePoolImpl.java:427)
         at weblogic.common.resourcepool.ResourcePoolImpl.reserveResource(ResourcePoolImpl.java:332)
         at weblogic.common.resourcepool.ResourcePoolImpl.reserveResource(ResourcePoolImpl.java:322)
         at weblogic.jdbc.common.internal.ConnectionPool.reserve(ConnectionPool.java:438)
         at weblogic.jdbc.common.internal.ConnectionPool.reserve(ConnectionPool.java:317)
         at weblogic.jdbc.common.internal.ConnectionPoolManager.reserve(ConnectionPoolManager.java:93)
         at weblogic.jdbc.common.internal.RmiDataSource.getPoolConnection(RmiDataSource.java:342)
         at weblogic.jdbc.common.internal.RmiDataSource.getConnection(RmiDataSource.java:360)
         at oracle.mds.internal.persistence.db.JNDIConnectionManagerImpl.fetchConnection(JNDIConnectionManagerImpl.java:91)
         at oracle.mds.internal.persistence.db.ConnectionManager.getConnection(ConnectionManager.java:347)
         at oracle.mds.internal.persistence.db.BaseReposAccess.<init>(BaseReposAccess.java:347)
         at oracle.mds.internal.persistence.db.shredded.ShreddedReposAccess.<init>(ShreddedReposAccess.java:274)
         at oracle.mds.internal.persistence.db.shredded.ShreddedDBMSConnection.createReposAccess(ShreddedDBMSConnection.java:444)
         at oracle.mds.internal.persistence.db.BaseDBMSConnection.getOrCreateReposAccess(BaseDBMSConnection.java:2072)
         at oracle.mds.internal.persistence.db.BaseDBMSConnection.queryStoreForLatestCommitNumber(BaseDBMSConnection.java:2503)
         at oracle.mds.internal.persistence.db.DBDocumentChangeProvider.queryStoreForLatestCommitNumber(DBDocumentChangeProvider.java:330)
         at oracle.mds.internal.persistence.db.DBDocumentChangeProvider.getChanges(DBDocumentChangeProvider.java:81)
         at oracle.mds.persistence.stores.db.DBMetadataStoreCommunicator.signalChanges(DBMetadataStoreCommunicator.java:134)
         at oracle.mds.internal.persistence.db.ChangePollingThread.run(ChangePollingThread.java:81)
    Caused By: oracle.net.ns.NetException: The Network Adapter could not establish the connection
         at oracle.net.nt.ConnStrategy.execute(ConnStrategy.java:334)
         at oracle.net.resolver.AddrResolution.resolveAndExecute(AddrResolution.java:425)
         at oracle.net.ns.NSProtocol.establishConnection(NSProtocol.java:646)
         at oracle.net.ns.NSProtocol.connect(NSProtocol.java:212)
         at oracle.jdbc.driver.T4CConnection.connect(T4CConnection.java:1076)
         at oracle.jdbc.driver.T4CConnection.logon(T4CConnection.java:303)
         at oracle.jdbc.driver.PhysicalConnection.<init>(PhysicalConnection.java:640)
         at oracle.jdbc.driver.T4CConnection.<init>(T4CConnection.java:205)
         at oracle.jdbc.driver.T4CDriverExtension.getConnection(T4CDriverExtension.java:35)
         at oracle.jdbc.driver.OracleDriver.connect(OracleDriver.java:554)
         at weblogic.jdbc.common.internal.ConnectionEnvFactory.makeConnection(ConnectionEnvFactory.java:327)
         at weblogic.jdbc.common.internal.ConnectionEnvFactory.createResource(ConnectionEnvFactory.java:227)
         at weblogic.common.resourcepool.ResourcePoolImpl.makeResources(ResourcePoolImpl.java:1193)
         at weblogic.common.resourcepool.ResourcePoolImpl.makeResources(ResourcePoolImpl.java:1117)
         at weblogic.common.resourcepool.ResourcePoolImpl.reserveResourceInternal(ResourcePoolImpl.java:427)
         at weblogic.common.resourcepool.ResourcePoolImpl.reserveResource(ResourcePoolImpl.java:332)
         at weblogic.common.resourcepool.ResourcePoolImpl.reserveResource(ResourcePoolImpl.java:322)
         at weblogic.jdbc.common.internal.ConnectionPool.reserve(ConnectionPool.java:438)
         at weblogic.jdbc.common.internal.ConnectionPool.reserve(ConnectionPool.java:317)
         at weblogic.jdbc.common.internal.ConnectionPoolManager.reserve(ConnectionPoolManager.java:93)
         at weblogic.jdbc.common.internal.RmiDataSource.getPoolConnection(RmiDataSource.java:342)
         at weblogic.jdbc.common.internal.RmiDataSource.getConnection(RmiDataSource.java:360)
         at oracle.mds.internal.persistence.db.JNDIConnectionManagerImpl.fetchConnection(JNDIConnectionManagerImpl.java:91)
         at oracle.mds.internal.persistence.db.ConnectionManager.getConnection(ConnectionManager.java:347)
         at oracle.mds.internal.persistence.db.BaseReposAccess.<init>(BaseReposAccess.java:347)
         at oracle.mds.internal.persistence.db.shredded.ShreddedReposAccess.<init>(ShreddedReposAccess.java:274)
         at oracle.mds.internal.persistence.db.shredded.ShreddedDBMSConnection.createReposAccess(ShreddedDBMSConnection.java:444)
         at oracle.mds.internal.persistence.db.BaseDBMSConnection.getOrCreateReposAccess(BaseDBMSConnection.java:2072)
         at oracle.mds.internal.persistence.db.BaseDBMSConnection.queryStoreForLatestCommitNumber(BaseDBMSConnection.java:2503)
         at oracle.mds.internal.persistence.db.DBDocumentChangeProvider.queryStoreForLatestCommitNumber(DBDocumentChangeProvider.java:330)
         at oracle.mds.internal.persistence.db.DBDocumentChangeProvider.getChanges(DBDocumentChangeProvider.java:81)
         at oracle.mds.persistence.stores.db.DBMetadataStoreCommunicator.signalChanges(DBMetadataStoreCommunicator.java:134)
         at oracle.mds.internal.persistence.db.ChangePollingThread.run(ChangePollingThread.java:81)
    Caused By: java.net.SocketException: Too many open files
         at java.net.Socket.createImpl(Socket.java:397)
         at java.net.Socket.connect(Socket.java:527)
         at oracle.net.nt.MetricsEnabledSocket.connect(TcpNTAdapter.java:465)
         at oracle.net.nt.TcpNTAdapter.connect(TcpNTAdapter.java:134)
         at oracle.net.nt.ConnOption.connect(ConnOption.java:130)
         at oracle.net.nt.ConnStrategy.execute(ConnStrategy.java:310)
         at oracle.net.resolver.AddrResolution.resolveAndExecute(AddrResolution.java:425)
         at oracle.net.ns.NSProtocol.establishConnection(NSProtocol.java:646)
         at oracle.net.ns.NSProtocol.connect(NSProtocol.java:212)
         at oracle.jdbc.driver.T4CConnection.connect(T4CConnection.java:1076)
         at oracle.jdbc.driver.T4CConnection.logon(T4CConnection.java:303)
         at oracle.jdbc.driver.PhysicalConnection.<init>(PhysicalConnection.java:640)
         at oracle.jdbc.driver.T4CConnection.<init>(T4CConnection.java:205)
         at oracle.jdbc.driver.T4CDriverExtension.getConnection(T4CDriverExtension.java:35)
         at oracle.jdbc.driver.OracleDriver.connect(OracleDriver.java:554)
         at weblogic.jdbc.common.internal.ConnectionEnvFactory.makeConnection(ConnectionEnvFactory.java:327)
         at weblogic.jdbc.common.internal.ConnectionEnvFactory.createResource(ConnectionEnvFactory.java:227)
         at weblogic.common.resourcepool.ResourcePoolImpl.makeResources(ResourcePoolImpl.java:1193)
         at weblogic.common.resourcepool.ResourcePoolImpl.makeResources(ResourcePoolImpl.java:1117)
         at weblogic.common.resourcepool.ResourcePoolImpl.reserveResourceInternal(ResourcePoolImpl.java:427)
         at weblogic.common.resourcepool.ResourcePoolImpl.reserveResource(ResourcePoolImpl.java:332)
         at weblogic.common.resourcepool.ResourcePoolImpl.reserveResource(ResourcePoolImpl.java:322)
         at weblogic.jdbc.common.internal.ConnectionPool.reserve(ConnectionPool.java:438)
         at weblogic.jdbc.common.internal.ConnectionPool.reserve(ConnectionPool.java:317)
         at weblogic.jdbc.common.internal.ConnectionPoolManager.reserve(ConnectionPoolManager.java:93)
         at weblogic.jdbc.common.internal.RmiDataSource.getPoolConnection(RmiDataSource.java:342)
         at weblogic.jdbc.common.internal.RmiDataSource.getConnection(RmiDataSource.java:360)
         at oracle.mds.internal.persistence.db.JNDIConnectionManagerImpl.fetchConnection(JNDIConnectionManagerImpl.java:91)
         at oracle.mds.internal.persistence.db.ConnectionManager.getConnection(ConnectionManager.java:347)
         at oracle.mds.internal.persistence.db.BaseReposAccess.<init>(BaseReposAccess.java:347)
         at oracle.mds.internal.persistence.db.shredded.ShreddedReposAccess.<init>(ShreddedReposAccess.java:274)
         at oracle.mds.internal.persistence.db.shredded.ShreddedDBMSConnection.createReposAccess(ShreddedDBMSConnection.java:444)
         at oracle.mds.internal.persistence.db.BaseDBMSConnection.getOrCreateReposAccess(BaseDBMSConnection.java:2072)
         at oracle.mds.internal.persistence.db.BaseDBMSConnection.queryStoreForLatestCommitNumber(BaseDBMSConnection.java:2503)
         at oracle.mds.internal.persistence.db.DBDocumentChangeProvider.queryStoreForLatestCommitNumber(DBDocumentChangeProvider.java:330)
         at oracle.mds.internal.persistence.db.DBDocumentChangeProvider.getChanges(DBDocumentChangeProvider.java:81)
         at oracle.mds.persistence.stores.db.DBMetadataStoreCommunicator.signalChanges(DBMetadataStoreCommunicator.java:134)
         at oracle.mds.internal.persistence.db.ChangePollingThread.run(ChangePollingThread.java:81)
    >
    ####<Jan 13, 2011 11:38:51 PM EST> <Critical> <Server> <oim.soa.af> <oim_server1> <DynamicListenThread[Default]> <<WLS Kernel>> <> <11d1def534ea1be0:edd9efd:12d79bd90fb:-7ffd-00000000000006e1> <1294979931516> <BEA-002616> <Failed to listen on channel "Default" on 10.33.100.217:14000, failure count: 1, failing for 0 seconds, java.net.SocketException: Too many open files>
    I have checked the data source for connection through weblogic console and the connection test of mds-oim is successful.
    can anyone please help me out here?
    OIM is 11.1.1.3 and Connector is 9.1.1.5.0
    Best Regards

    Sir
    i tried out wireshark and well the ip and port filter show that the machine is infact talking to the right DB. but the problem still remains the same. i am once again pasting the complete trace of exception, if you could help me out here. i have installed OIM on a virtual machine. could that be the issue? although it gave me no issue while installing and while creating users / organizations in it.
    the error trace is as under :-
    java.sql.SQLException: The Network Adapter could not establish the connection
         at oracle.jdbc.driver.SQLStateMapping.newSQLException(SQLStateMapping.java:74)
         at oracle.jdbc.driver.DatabaseError.newSQLException(DatabaseError.java:135)
         at oracle.jdbc.driver.DatabaseError.throwSqlException(DatabaseError.java:203)
         at oracle.jdbc.driver.DatabaseError.throwSqlException(DatabaseError.java:489)
         at oracle.jdbc.driver.T4CConnection.logon(T4CConnection.java:439)
         at oracle.jdbc.driver.PhysicalConnection.<init>(PhysicalConnection.java:640)
         at oracle.jdbc.driver.T4CConnection.<init>(T4CConnection.java:205)
         at oracle.jdbc.driver.T4CDriverExtension.getConnection(T4CDriverExtension.java:35)
         at oracle.jdbc.driver.OracleDriver.connect(OracleDriver.java:554)
         at weblogic.jdbc.common.internal.ConnectionEnvFactory.makeConnection(ConnectionEnvFactory.java:327)
         at weblogic.jdbc.common.internal.ConnectionEnvFactory.createResource(ConnectionEnvFactory.java:227)
         at weblogic.common.resourcepool.ResourcePoolImpl.makeResources(ResourcePoolImpl.java:1193)
         at weblogic.common.resourcepool.ResourcePoolImpl.makeResources(ResourcePoolImpl.java:1117)
         at weblogic.common.resourcepool.ResourcePoolImpl.reserveResourceInternal(ResourcePoolImpl.java:427)
         at weblogic.common.resourcepool.ResourcePoolImpl.reserveResource(ResourcePoolImpl.java:332)
         at weblogic.common.resourcepool.ResourcePoolImpl.reserveResource(ResourcePoolImpl.java:322)
         at weblogic.jdbc.common.internal.ConnectionPool.reserve(ConnectionPool.java:438)
         at weblogic.jdbc.common.internal.ConnectionPool.reserve(ConnectionPool.java:317)
         at weblogic.jdbc.common.internal.ConnectionPoolManager.reserve(ConnectionPoolManager.java:93)
         at weblogic.jdbc.common.internal.RmiDataSource.getPoolConnection(RmiDataSource.java:342)
         at weblogic.jdbc.common.internal.RmiDataSource.getConnection(RmiDataSource.java:360)
         at oracle.mds.internal.persistence.db.JNDIConnectionManagerImpl.fetchConnection(JNDIConnectionManagerImpl.java:91)
         at oracle.mds.internal.persistence.db.ConnectionManager.getConnection(ConnectionManager.java:347)
         at oracle.mds.internal.persistence.db.BaseReposAccess.<init>(BaseReposAccess.java:347)
         at oracle.mds.internal.persistence.db.shredded.ShreddedReposAccess.<init>(ShreddedReposAccess.java:274)
         at oracle.mds.internal.persistence.db.shredded.ShreddedDBMSConnection.createReposAccess(ShreddedDBMSConnection.java:444)
         at oracle.mds.internal.persistence.db.BaseDBMSConnection.getOrCreateReposAccess(BaseDBMSConnection.java:2072)
         at oracle.mds.internal.persistence.db.BaseDBMSConnection.queryStoreForLatestCommitNumber(BaseDBMSConnection.java:2503)
         at oracle.mds.internal.persistence.db.DBDocumentChangeProvider.queryStoreForLatestCommitNumber(DBDocumentChangeProvider.java:330)
         at oracle.mds.internal.persistence.db.DBDocumentChangeProvider.getChanges(DBDocumentChangeProvider.java:81)
         at oracle.mds.persistence.stores.db.DBMetadataStoreCommunicator.signalChanges(DBMetadataStoreCommunicator.java:134)
         at oracle.mds.internal.persistence.db.ChangePollingThread.run(ChangePollingThread.java:81)
    Caused By: java.net.SocketException: Too many open files
         at java.net.Socket.createImpl(Socket.java:397)
         at java.net.Socket.connect(Socket.java:527)
         at oracle.net.nt.MetricsEnabledSocket.connect(TcpNTAdapter.java:465)
         at oracle.net.nt.TcpNTAdapter.connect(TcpNTAdapter.java:134)
         at oracle.net.nt.ConnOption.connect(ConnOption.java:130)
         at oracle.net.nt.ConnStrategy.execute(ConnStrategy.java:310)
         at oracle.net.resolver.AddrResolution.resolveAndExecute(AddrResolution.java:425)
         at oracle.net.ns.NSProtocol.establishConnection(NSProtocol.java:646)
         at oracle.net.ns.NSProtocol.connect(NSProtocol.java:212)
         at oracle.jdbc.driver.T4CConnection.connect(T4CConnection.java:1076)
         at oracle.jdbc.driver.T4CConnection.logon(T4CConnection.java:303)
         at oracle.jdbc.driver.PhysicalConnection.<init>(PhysicalConnection.java:640)
         at oracle.jdbc.driver.T4CConnection.<init>(T4CConnection.java:205)
         at oracle.jdbc.driver.T4CDriverExtension.getConnection(T4CDriverExtension.java:35)
         at oracle.jdbc.driver.OracleDriver.connect(OracleDriver.java:554)
         at weblogic.jdbc.common.internal.ConnectionEnvFactory.makeConnection(ConnectionEnvFactory.java:327)
         at weblogic.jdbc.common.internal.ConnectionEnvFactory.createResource(ConnectionEnvFactory.java:227)
         at weblogic.common.resourcepool.ResourcePoolImpl.makeResources(ResourcePoolImpl.java:1193)
         at weblogic.common.resourcepool.ResourcePoolImpl.makeResources(ResourcePoolImpl.java:1117)
         at weblogic.common.resourcepool.ResourcePoolImpl.reserveResourceInternal(ResourcePoolImpl.java:427)
         at weblogic.common.resourcepool.ResourcePoolImpl.reserveResource(ResourcePoolImpl.java:332)
         at weblogic.common.resourcepool.ResourcePoolImpl.reserveResource(ResourcePoolImpl.java:322)
         at weblogic.jdbc.common.internal.ConnectionPool.reserve(ConnectionPool.java:438)
         at weblogic.jdbc.common.internal.ConnectionPool.reserve(ConnectionPool.java:317)
         at weblogic.jdbc.common.internal.ConnectionPoolManager.reserve(ConnectionPoolManager.java:93)
         at weblogic.jdbc.common.internal.RmiDataSource.getPoolConnection(RmiDataSource.java:342)
         at weblogic.jdbc.common.internal.RmiDataSource.getConnection(RmiDataSource.java:360)
         at oracle.mds.internal.persistence.db.JNDIConnectionManagerImpl.fetchConnection(JNDIConnectionManagerImpl.java:91)
         at oracle.mds.internal.persistence.db.ConnectionManager.getConnection(ConnectionManager.java:347)
         at oracle.mds.internal.persistence.db.BaseReposAccess.<init>(BaseReposAccess.java:347)
         at oracle.mds.internal.persistence.db.shredded.ShreddedReposAccess.<init>(ShreddedReposAccess.java:274)
         at oracle.mds.internal.persistence.db.shredded.ShreddedDBMSConnection.createReposAccess(ShreddedDBMSConnection.java:444)
         at oracle.mds.internal.persistence.db.BaseDBMSConnection.getOrCreateReposAccess(BaseDBMSConnection.java:2072)
         at oracle.mds.internal.persistence.db.BaseDBMSConnection.queryStoreForLatestCommitNumber(BaseDBMSConnection.java:2503)
         at oracle.mds.internal.persistence.db.DBDocumentChangeProvider.queryStoreForLatestCommitNumber(DBDocumentChangeProvider.java:330)
         at oracle.mds.internal.persistence.db.DBDocumentChangeProvider.getChanges(DBDocumentChangeProvider.java:81)
         at oracle.mds.persistence.stores.db.DBMetadataStoreCommunicator.signalChanges(DBMetadataStoreCommunicator.java:134)
         at oracle.mds.internal.persistence.db.ChangePollingThread.run(ChangePollingThread.java:81)
    >
    #<Jan 18, 2011 12:38:13 AM EST> <Critical> <Server> <oim.soa.af> <oim_server1> <DynamicListenThread[Default]> <<WLS Kernel>> <> <11d1def534ea1be0:25a9f4c3:12d932a8a21:-7ffd-00000000000000e9> <1295329093681> <BEA-002616> <Failed to listen on channel "Default" on 10.33.100.217:14000, failure count: 5, failing for 72 seconds, java.net.SocketException: Too many open files>
    #<Jan 18, 2011 12:38:18 AM EST> <Notice> <Server> <oim.soa.af> <oim_server1> <DynamicListenThread[Default]> <<WLS Kernel>> <> <11d1def534ea1be0:25a9f4c3:12d932a8a21:-7ffd-00000000000000e9> <1295329098685> <BEA-002615> <After having failed to listen, the server is now listening on channel "Default" on 10.33.100.217:14000.>
    #<Jan 18, 2011 12:38:20 AM EST> <Info> <Health> <oim.soa.af> <oim_server1> <weblogic.GCMonitor> <<anonymous>> <> <11d1def534ea1be0:25a9f4c3:12d932a8a21:-7ffd-0000000000000051> <1295329100292> <BEA-310002> <38% of the total memory in the server is free>
    #<Jan 18, 2011 12:40:33 AM EST> <Info> <Common> <oim.soa.af> <oim_server1> <OIMQuartzScheduler_Worker-8> <xelsysadm> <> <11d1def534ea1be0:25a9f4c3:12d932a8a21:-7ffd-00000000000000f7> <1295329233235> <BEA-000628> <Created "1" resources for pool "oimJMSStoreDS", out of which "1" are available and "0" are unavailable.>
    #<Jan 18, 2011 12:40:33 AM EST> <Info> <Common> <oim.soa.af> <oim_server1> <OIMQuartzScheduler_Worker-3> <xelsysadm> <BEA1-74D38D67E38B2F5F9DC8> <11d1def534ea1be0:25a9f4c3:12d932a8a21:-7ffd-00000000000000e1> <1295329233291> <BEA-000628> <Created "1" resources for pool "oimJMSStoreDS", out of which "1" are available and "0" are unavailable.>
    #<Jan 18, 2011 12:40:33 AM EST> <Info> <Common> <oim.soa.af> <oim_server1> <OIMQuartzScheduler_Worker-3> <xelsysadm> <> <11d1def534ea1be0:25a9f4c3:12d932a8a21:-7ffd-00000000000000e1> <1295329233547> <BEA-000628> <Created "1" resources for pool "oimOperationsDB", out of which "1" are available and "0" are unavailable.>
    #<Jan 18, 2011 12:47:57 AM EST> <Error> <HTTP> <oim.soa.af> <oim_server1> <[ACTIVE] ExecuteThread: '1' for queue: 'weblogic.kernel.Default (self-tuning)'> <<WLS Kernel>> <> <11d1def534ea1be0:25a9f4c3:12d932a8a21:-7ffd-00000000000005ca> <1295329677638> <BEA-101020> <[ServletContext@1688516550[app:oim module:oim path:/oim spec-version:2.5 version:11.1.1.3.0]] Servlet failed with Exception
    java.lang.IllegalStateException: Cannot forward a response that is already committed
         at weblogic.servlet.internal.RequestDispatcherImpl.forward(RequestDispatcherImpl.java:122)
         at com.sun.faces.context.ExternalContextImpl.dispatch(ExternalContextImpl.java:410)
         at org.apache.myfaces.trinidad.context.ExternalContextDecorator.dispatch(ExternalContextDecorator.java:44)
         at org.apache.myfaces.trinidad.context.ExternalContextDecorator.dispatch(ExternalContextDecorator.java:44)
         at org.apache.myfaces.trinidad.context.ExternalContextDecorator.dispatch(ExternalContextDecorator.java:44)
         at org.apache.myfaces.trinidad.context.ExternalContextDecorator.dispatch(ExternalContextDecorator.java:44)
         at org.apache.myfaces.trinidadinternal.context.FacesContextFactoryImpl$OverrideDispatch.dispatch(FacesContextFactoryImpl.java:267)
         at com.sun.faces.application.ViewHandlerImpl.executePageToBuildView(ViewHandlerImpl.java:473)
         at com.sun.faces.application.ViewHandlerImpl.renderView(ViewHandlerImpl.java:141)
         at javax.faces.application.ViewHandlerWrapper.renderView(ViewHandlerWrapper.java:189)
         at org.apache.myfaces.trinidadinternal.application.ViewHandlerImpl.renderView(ViewHandlerImpl.java:193)
         at oracle.iam.consoles.faces.utils.CustomViewHandler.renderView(CustomViewHandler.java:82)
         at oracle.adfinternal.view.faces.lifecycle.LifecycleImpl._renderResponse(LifecycleImpl.java:710)
         at oracle.adfinternal.view.faces.lifecycle.LifecycleImpl._executePhase(LifecycleImpl.java:273)
         at oracle.adfinternal.view.faces.lifecycle.LifecycleImpl.render(LifecycleImpl.java:205)
         at javax.faces.webapp.FacesServlet.service(FacesServlet.java:266)
         at weblogic.servlet.internal.StubSecurityHelper$ServletServiceAction.run(StubSecurityHelper.java:227)
         at weblogic.servlet.internal.StubSecurityHelper.invokeServlet(StubSecurityHelper.java:125)
         at weblogic.servlet.internal.ServletStubImpl.execute(ServletStubImpl.java:300)
         at weblogic.servlet.internal.TailFilter.doFilter(TailFilter.java:26)
         at weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:56)
         at oracle.help.web.rich.OHWFilter.doFilter(Unknown Source)
         at weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:56)
         at oracle.adf.model.servlet.ADFBindingFilter.doFilter(ADFBindingFilter.java:191)
         at weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:56)
         at oracle.adfinternal.view.faces.webapp.rich.RegistrationFilter.doFilter(RegistrationFilter.java:97)
         at org.apache.myfaces.trinidadinternal.webapp.TrinidadFilterImpl$FilterListChain.doFilter(TrinidadFilterImpl.java:420)
         at oracle.adfinternal.view.faces.activedata.AdsFilter.doFilter(AdsFilter.java:60)
         at org.apache.myfaces.trinidadinternal.webapp.TrinidadFilterImpl$FilterListChain.doFilter(TrinidadFilterImpl.java:420)
         at org.apache.myfaces.trinidadinternal.webapp.TrinidadFilterImpl._doFilterImpl(TrinidadFilterImpl.java:247)
         at org.apache.myfaces.trinidadinternal.webapp.TrinidadFilterImpl.doFilter(TrinidadFilterImpl.java:157)
         at org.apache.myfaces.trinidad.webapp.TrinidadFilter.doFilter(TrinidadFilter.java:92)
         at weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:56)
         at oracle.security.am.agent.wls.filters.OAMServletAuthenticationFilter.doFilter(OAMServletAuthenticationFilter.java:260)
         at oracle.security.am.agent.wls.filters.OAMValidationSystemFilter.doFilter(OAMValidationSystemFilter.java:133)
         at oracle.security.wls.oamagent.OAMAgentWrapperFilter.doFilter(OAMAgentWrapperFilter.java:121)
         at weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:56)
         at oracle.iam.platform.auth.web.PwdMgmtNavigationFilter.doFilter(PwdMgmtNavigationFilter.java:115)
         at weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:56)
         at oracle.iam.platform.auth.web.OIMAuthContextFilter.doFilter(OIMAuthContextFilter.java:100)
         at weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:56)
         at oracle.adf.library.webapp.LibraryFilter.doFilter(LibraryFilter.java:159)
         at weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:56)
         at oracle.dms.wls.DMSServletFilter.doFilter(DMSServletFilter.java:330)
         at weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:56)
         at weblogic.servlet.internal.RequestEventsFilter.doFilter(RequestEventsFilter.java:27)
         at weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:56)
    #<Jan 18, 2011 12:47:57 AM EST> <Notice> <Diagnostics> <oim.soa.af> <oim_server1> <[ACTIVE] ExecuteThread: '0' for queue: 'weblogic.kernel.Default (self-tuning)'> <<WLS Kernel>> <> <11d1def534ea1be0:25a9f4c3:12d932a8a21:-7ffd-00000000000005cd> <1295329677644> <BEA-320068> <Watch 'UncheckedException' with severity 'Notice' on server 'oim_server1' has triggered at Jan 18, 2011 12:47:57 AM EST. Notification details:
    WatchRuleType: Log
    WatchRule: (SEVERITY = 'Error') AND ((MSGID = 'BEA-101020') OR (MSGID = 'BEA-101017') OR (MSGID = 'BEA-000802'))
    WatchData: DATE = Jan 18, 2011 12:47:57 AM EST SERVER = oim_server1 MESSAGE = [ServletContext@1688516550[app:oim module:oim path:/oim spec-version:2.5 version:11.1.1.3.0]] Servlet failed with Exception
    java.lang.IllegalStateException: Cannot forward a response that is already committed
         at weblogic.servlet.internal.RequestDispatcherImpl.forward(RequestDispatcherImpl.java:122)
         at com.sun.faces.context.ExternalContextImpl.dispatch(ExternalContextImpl.java:410)
         at org.apache.myfaces.trinidad.context.ExternalContextDecorator.dispatch(ExternalContextDecorator.java:44)
         at org.apache.myfaces.trinidad.context.ExternalContextDecorator.dispatch(ExternalContextDecorator.java:44)
         at org.apache.myfaces.trinidad.context.ExternalContextDecorator.dispatch(ExternalContextDecorator.java:44)
         at org.apache.myfaces.trinidad.context.ExternalContextDecorator.dispatch(ExternalContextDecorator.java:44)
         at org.apache.myfaces.trinidadinternal.context.FacesContextFactoryImpl$OverrideDispatch.dispatch(FacesContextFactoryImpl.java:267)
         at com.sun.faces.application.ViewHandlerImpl.executePageToBuildView(ViewHandlerImpl.java:473)
         at com.sun.faces.application.ViewHandlerImpl.renderView(ViewHandlerImpl.java:141)
         at javax.faces.application.ViewHandlerWrapper.renderView(ViewHandlerWrapper.java:189)
         at org.apache.myfaces.trinidadinternal.application.ViewHandlerImpl.renderView(ViewHandlerImpl.java:193)
         at oracle.iam.consoles.faces.utils.CustomViewHandler.renderView(CustomViewHandler.java:82)
         at oracle.adfinternal.view.faces.lifecycle.LifecycleImpl._renderResponse(LifecycleImpl.java:710)
         at oracle.adfinternal.view.faces.lifecycle.LifecycleImpl._executePhase(LifecycleImpl.java:273)
         at oracle.adfinternal.view.faces.lifecycle.LifecycleImpl.render(LifecycleImpl.java:205)
         at javax.faces.webapp.FacesServlet.service(FacesServlet.java:266)
         at weblogic.servlet.internal.StubSecurityHelper$ServletServiceAction.run(StubSecurityHelper.java:227)
         at weblogic.servlet.internal.StubSecurityHelper.invokeServlet(StubSecurityHelper.java:125)
         at weblogic.servlet.internal.ServletStubImpl.execute(ServletStubImpl.java:300)
         at weblogic.servlet.internal.TailFilter.doFilter(TailFilter.java:26)
         at weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:56)
         at oracle.help.web.rich.OHWFilter.doFilter(Unknown Source)
         at weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:56)
         at oracle.adf.model.servlet.ADFBindingFilter.doFilter(ADFBindingFilter.java:191)
         at weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:56)
         at oracle.adfinternal.view.faces.webapp.rich.RegistrationFilter.doFilter(RegistrationFilter.java:97)
         at org.apache.myfaces.trinidadinternal.webapp.TrinidadFilterImpl$FilterListChain.doFilter(TrinidadFilterImpl.java:420)
         at oracle.adfinternal.view.faces.activedata.AdsFilter.doFilter(AdsFilter.java:60)
         at org.apache.myfaces.trinidadinternal.webapp.TrinidadFilterImpl$FilterListChain.doFilter(TrinidadFilterImpl.java:420)
         at org.apache.myfaces.trinidadinternal.webapp.TrinidadFilterImpl._doFilterImpl(TrinidadFilterImpl.java:247)
         at org.apache.myfaces.trinidadinternal.webapp.TrinidadFilterImpl.doFilter(TrinidadFilterImpl.java:157)
         at org.apache.myfaces.trinidad.webapp.TrinidadFilter.doFilter(TrinidadFilter.java:92)
         at weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:56)
         at oracle.security.am.agent.wls.filters.OAMServletAuthenticationFilter.doFilter(OAMServletAuthenticationFilter.java:260)
         at oracle.security.am.agent.wls.filters.OAMValidationSystemFilter.doFilter(OAMValidationSystemFilter.java:133)
         at oracle.security.wls.oamagent.OAMAgentWrapperFilter.doFilter(OAMAgentWrapperFilter.java:121)
         at weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:56)
         at oracle.iam.platform.auth.web.PwdMgmtNavigationFilter.doFilter(PwdMgmtNavigationFilter.java:115)
         at weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:56)
         at oracle.iam.platform.auth.web.OIMAuthContextFilter.doFilter(OIMAuthContextFilter.java:100)
         at weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:56)
         at oracle.adf.library.webapp.LibraryFilter.doFilter(LibraryFilter.java:159)
         at weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:56)
         at oracle.dms.wls.DMSServletFilter.doFilter(DMSServletFilter.java:330)
         at weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:56)
         at weblogic.servlet.internal.RequestEventsFilter.doFilter(RequestEventsFilter.java:27)
         at weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:56)
         at weblogic.servlet.internal.WebAppServletContext$ServletInvocationAction.doIt(WebAppServletContext.java:3684)
         at weblogic.servlet.internal.WebAppServletContext$ServletInvocationAction.run(WebAppServletContext.java:3650)
    SUBSYSTEM = HTTP USERID = <WLS Kernel> SEVERITY = Error THREAD = [ACTIVE] ExecuteThread: '1' for queue: 'weblogic.kernel.Default (self-tuning)' MSGID = BEA-101020 MACHINE = oim.soa.af TXID = CONTEXTID = 11d1def534ea1be0:25a9f4c3:12d932a8a21:-7ffd-00000000000005ca TIMESTAMP = 1295329677638
    WatchAlarmType: AutomaticReset
    WatchAlarmResetPeriod: 30000
    >
    #<Jan 18, 2011 12:48:06 AM EST> <Alert> <Diagnostics> <oim.soa.af> <oim_server1> <oracle.dfw.dump.DumpManager - Dump Executor (created: Tue Jan 18 00:48:00 EST 2011)> <<WLS Kernel>> <> <11d1def534ea1be0:25a9f4c3:12d932a8a21:-7ffd-00000000000005d5> <1295329686538> <BEA-320016> <Creating diagnostic image in /home/oracle/Oracle/Middleware/user_projects/domains/base_domain/servers/oim_server1/adr/diag/ofm/base_domain/oim_server1/incident/incdir_5 with a lockout minute period of 1.>
    #<Jan 18, 2011 12:50:21 AM EST> <Info> <Health> <oim.soa.af> <oim_server1> <weblogic.GCMonitor> <<anonymous>> <> <11d1def534ea1be0:25a9f4c3:12d932a8a21:-7ffd-0000000000000051> <1295329821309> <BEA-310002> <50% of the total memory in the server is free>
    #<Jan 18, 2011 12:50:37 AM EST> <Info> <JDBC> <oim.soa.af> <oim_server1> <[ACTIVE] ExecuteThread: '7' for queue: 'weblogic.kernel.Default (self-tuning)'> <<WLS Kernel>> <> <11d1def534ea1be0:25a9f4c3:12d932a8a21:-7ffd-0000000000000666> <1295329837005> <BEA-001128> <Connection for pool "mds-oim" closed.>
    #<Jan 18, 2011 12:50:37 AM EST> <Info> <JDBC> <oim.soa.af> <oim_server1> <[ACTIVE] ExecuteThread: '5' for queue: 'weblogic.kernel.Default (self-tuning)'> <<WLS Kernel>> <> <11d1def534ea1be0:25a9f4c3:12d932a8a21:-7ffd-0000000000000667> <1295329837111> <BEA-001128> <Connection for pool "mds-owsm" closed.>
    #<Jan 18, 2011 12:50:37 AM EST> <Info> <JDBC> <oim.soa.af> <oim_server1> <[ACTIVE] ExecuteThread: '7' for queue: 'weblogic.kernel.Default (self-tuning)'> <<WLS Kernel>> <> <11d1def534ea1be0:25a9f4c3:12d932a8a21:-7ffd-0000000000000668> <1295329837138> <BEA-001128> <Connection for pool "oimJMSStoreDS" closed.>
    #<Jan 18, 2011 12:50:37 AM EST> <Info> <JDBC> <oim.soa.af> <oim_server1> <[ACTIVE] ExecuteThread: '7' for queue: 'weblogic.kernel.Default (self-tuning)'> <<WLS Kernel>> <> <11d1def534ea1be0:25a9f4c3:12d932a8a21:-7ffd-0000000000000668> <1295329837139> <BEA-001128> <Connection for pool "oimJMSStoreDS" closed.>
    #<Jan 18, 2011 12:50:37 AM EST> <Info> <JDBC> <oim.soa.af> <oim_server1> <[ACTIVE] ExecuteThread: '7' for queue: 'weblogic.kernel.Default (self-tuning)'> <<WLS Kernel>> <> <11d1def534ea1be0:25a9f4c3:12d932a8a21:-7ffd-0000000000000668> <1295329837140> <BEA-001128> <Connection for pool "oimJMSStoreDS" closed.>
    #<Jan 18, 2011 12:50:43 AM EST> <Info> <Common> <oim.soa.af> <oim_server1> <QuartzScheduler_OIMQuartzScheduler-oim.soa.af1295254191399_ClusterManager> <xelsysadm> <> <11d1def534ea1be0:25a9f4c3:12d932a8a21:-7ffd-0000000000000008> <1295329843613> <BEA-000628> <Created "1" resources for pool "oimJMSStoreDS", out of which "1" are available and "0" are unavailable.>
    #<Jan 18, 2011 12:50:45 AM EST> <Info> <Common> <oim.soa.af> <oim_server1> <MDSPollingThread-[oim, jdbc/mds/MDS_REPOS]> <<anonymous>> <> <11d1def534ea1be0:25a9f4c3:12d932a8a21:-7ffd-0000000000000015> <1295329845418> <BEA-000628> <Created "1" resources for pool "mds-oim", out of which "1" are available and "0" are unavailable.>
    #<Jan 18, 2011 12:50:51 AM EST> <Info> <Common> <oim.soa.af> <oim_server1> <MDSPollingThread-[owsm, jdbc/mds/owsm]> <OracleSystemUser> <> <11d1def534ea1be0:25a9f4c3:12d932a8a21:-7ffd-000000000000000f> <1295329851840> <BEA-000628> <Created "1" resources for pool "mds-owsm", out of which "1" are available and "0" are unavailable.>
    #<Jan 18, 2011 12:53:05 AM EST> <Info> <Common> <oim.soa.af> <oim_server1> <[ACTIVE] ExecuteThread: '7' for queue: 'weblogic.kernel.Default (self-tuning)'> <xelsysadm> <> <11d1def534ea1be0:25a9f4c3:12d932a8a21:-7ffd-00000000000006cc> <1295329985072> <BEA-000628> <Created "1" resources for pool "oimOperationsDB", out of which "1" are available and "0" are unavailable.>
    #<Jan 18, 2011 12:55:58 AM EST> <Info> <Common> <oim.soa.af> <oim_server1> <QuartzScheduler_OIMQuartzScheduler-oim.soa.af1295254191399_ClusterManager> <xelsysadm> <> <11d1def534ea1be0:25a9f4c3:12d932a8a21:-7ffd-0000000000000008> <1295330158899> <BEA-000628> <Created "1" resources for pool "oimJMSStoreDS", out of which "1" are available and "0" are unavailable.>
    #<Jan 18, 2011 12:56:41 AM EST> <Info> <Common> <oim.soa.af> <oim_server1> <[ACTIVE] ExecuteThread: '5' for queue: 'weblogic.kernel.Default (self-tuning)'> <xelsysadm> <> <11d1def534ea1be0:25a9f4c3:12d932a8a21:-7ffd-0000000000000730> <1295330201205> <BEA-000628> <Created "1" resources for pool "oimOperationsDB", out of which "1" are available and "0" are unavailable.>
    #<Jan 18, 2011 12:56:46 AM EST> <Error> <HTTP> <oim.soa.af> <oim_server1> <[ACTIVE] ExecuteThread: '7' for queue: 'weblogic.kernel.Default (self-tuning)'> <<WLS Kernel>> <> <11d1def534ea1be0:25a9f4c3:12d932a8a21:-7ffd-000000000000073a> <1295330206768> <BEA-101017> <[ServletContext@1029576171[app:oim module:xlWebApp path:/xlWebApp spec-version:2.5 version:11.1.1.3.0], request: weblogic.servlet.internal.ServletRequestImpl@187b918a[
    GET /xlWebApp/pages/CIWInstallPages.jsp HTTP/1.1
    Accept: image/gif, image/x-xbitmap, image/jpeg, image/pjpeg, application/vnd.ms-excel, application/vnd.ms-powerpoint, application/msword, */*
    Referer: http://10.33.100.217:14000/xlWebApp/connectorInstallation.do
    Accept-Language: en-us
    UA-CPU: x86
    Accept-Encoding: gzip, deflate
    User-Agent: Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 6.0; WOW64; SLCC1; .NET CLR 2.0.50727)
    Connection: Keep-Alive
    Cookie: oimjsessionid=9QxkN1qQvxfZPGJ1PbtQTqgGWnTldRdQ5cNSY6NmmGT3LQmNwXJT!-1753691039
    ]] Root cause of ServletException.
    javax.servlet.jsp.JspException: Can't insert page '/layouts/tjspClassicLayout.jsp' : Connection reset
         at org.apache.struts.tiles.taglib.InsertTag$InsertHandler.doEndTag(InsertTag.java:902)
         at org.apache.struts.tiles.taglib.InsertTag.doEndTag(InsertTag.java:465)
         at jsp_servlet._pages.__ciwinstallpages._jsp__tag1(__ciwinstallpages.java:151)
         at jsp_servlet._pages.__ciwinstallpages._jspService(__ciwinstallpages.java:82)
         at weblogic.servlet.jsp.JspBase.service(JspBase.java:34)
         at weblogic.servlet.internal.StubSecurityHelper$ServletServiceAction.run(StubSecurityHelper.java:227)
         at weblogic.servlet.internal.StubSecurityHelper.invokeServlet(StubSecurityHelper.java:125)
         at weblogic.servlet.internal.ServletStubImpl.execute(ServletStubImpl.java:300)
         at weblogic.servlet.internal.TailFilter.doFilter(TailFilter.java:26)
         at weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:56)
         at oracle.security.am.agent.wls.filters.OAMServletAuthenticationFilter.doFilter(OAMServletAuthenticationFilter.java:260)
         at oracle.security.am.agent.wls.filters.OAMValidationSystemFilter.doFilter(OAMValidationSystemFilter.java:133)
         at oracle.security.wls.oamagent.OAMAgentWrapperFilter.doFilter(OAMAgentWrapperFilter.java:121)
         at weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:56)
         at com.thortech.xl.webclient.security.CSRFFilter.doFilter(CSRFFilter.java:61)
         at weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:56)
         at oracle.iam.platform.auth.web.PwdMgmtNavigationFilter.doFilter(PwdMgmtNavigationFilter.java:115)
         at weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:56)
         at oracle.iam.platform.auth.web.OIMAuthContextFilter.doFilter(OIMAuthContextFilter.java:100)
         at weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:56)
         at oracle.dms.wls.DMSServletFilter.doFilter(DMSServletFilter.java:330)
         at weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:56)
         at weblogic.servlet.internal.RequestEventsFilter.doFilter(RequestEventsFilter.java:27)
         at weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:56)
         at weblogic.servlet.internal.WebAppServletContext$ServletInvocationAction.doIt(WebAppServletContext.java:3684)
         at weblogic.servlet.internal.WebAppServletContext$ServletInvocationAction.run(WebAppServletContext.java:3650)
         at weblogic.security.acl.internal.AuthenticatedSubject.doAs(AuthenticatedSubject.java:321)
    >
    #<Jan 18, 2011 12:56:46 AM EST> <Notice> <Diagnostics> <oim.soa.af> <oim_server1> <[STANDBY] ExecuteThread: '2' for queue: 'weblogic.kernel.Default (self-tuning)'> <<WLS Kernel>> <> <11d1def534ea1be0:25a9f4c3:12d932a8a21:-7ffd-000000000000073d> <1295330206805> <BEA-320068> <Watch 'UncheckedException' with severity 'Notice' on server 'oim_server1' has triggered at Jan 18, 2011 12:56:46 AM EST. Notification details:
    WatchRuleType: Log
    WatchRule: (SEVERITY = 'Error') AND ((MSGID = 'BEA-101020') OR (MSGID = 'BEA-101017') OR (MSGID = 'BEA-000802'))
    WatchData: DATE = Jan 18, 2011 12:56:46 AM EST SERVER = oim_server1 MESSAGE = [ServletContext@1029576171[app:oim module:xlWebApp path:/xlWebApp spec-version:2.5 version:11.1.1.3.0], request: weblogic.servlet.internal.ServletRequestImpl@187b918a[
    GET /xlWebApp/pages/CIWInstallPages.jsp HTTP/1.1
    Accept: image/gif, image/x-xbitmap, image/jpeg, image/pjpeg, application/vnd.ms-excel, application/vnd.ms-powerpoint, application/msword, */*
    Referer: http://10.33.100.217:14000/xlWebApp/connectorInstallation.do
    Accept-Language: en-us
    UA-CPU: x86
    Accept-Encoding: gzip, deflate
    User-Agent: Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 6.0; WOW64; SLCC1; .NET CLR 2.0.50727)
    Connection: Keep-Alive
    Cookie: oimjsessionid=9QxkN1qQvxfZPGJ1PbtQTqgGWnTldRdQ5cNSY6NmmGT3LQmNwXJT!-1753691039

  • OBIEE11G Weblogic Error

    Hi All
    When i star my weblogic server it through below error.
    <Oct 17, 2012 11:35:14 PM UTC> <Critical> <Server> <BEA-002616> <Failed to listen on channel "Default" on 10.112.161.53:7001, failure count: 2, failing for 1 seconds, java.net.SocketException: Too many open files>
    <Oct 17, 2012 11:35:16 PM UTC> <Critical> <Server> <BEA-002616> <Failed to listen on channel "Default" on 10.112.161.53:7001, failure count: 3, failing for 3 seconds, java.net.SocketException: Too many open files>
    <Oct 17, 2012 11:35:19 PM UTC> <Notice> <Server> <BEA-002615> <After having failed to listen, the server is now listening on channel "Default" on 10.112.161.53:7001.>
    <Oct 17, 2012 11:35:27 PM UTC> <Critical> <Server> <BEA-002616> <Failed to listen on channel "Default" on 10.112.161.53:7001, failure count: 1, failing for 0 seconds, java.net.SocketException: Too many open files>
    java.util.zip.ZipException: error in opening zip file
    at java.util.zip.ZipFile.open(Native Method)
    at java.util.zip.ZipFile.<init>(ZipFile.java:127)
    at java.util.zip.ZipFile.<init>(ZipFile.java:143)
    at weblogic.jsp.internal.Jar.<init>(Jar.java:24)
    at weblogic.jsp.internal.Application.createJavelinFile(Application.java:185)
    at weblogic.jsp.internal.CPL.initializeBinaryPaths(CPL.java:234)
    at weblogic.servlet.jsp.JavelinxJSPStub.prepareCPLClasspath(JavelinxJSPStub.java:273)
    at weblogic.servlet.jsp.JavelinxJSPStub.compilePage(JavelinxJSPStub.java:126)
    at weblogic.servlet.jsp.JspStub.prepareServlet(JspStub.java:256)
    at weblogic.servlet.jsp.JspStub.prepareServlet(JspStub.java:216)
    at weblogic.servlet.internal.ServletStubImpl.execute(ServletStubImpl.java:243)
    at weblogic.servlet.internal.ServletStubImpl.onAddToMapException(ServletStubImpl.java:416)
    at weblogic.servlet.internal.ServletStubImpl.execute(ServletStubImpl.java:326)
    at weblogic.servlet.internal.TailFilter.doFilter(TailFilter.java:26)
    at weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:56)
    at oracle.security.jps.ee.http.JpsAbsFilter$1.run(JpsAbsFilter.java:119)
    at java.security.AccessController.doPrivileged(Native Method)
    at oracle.security.jps.util.JpsSubject.doAsPrivileged(JpsSubject.java:315)
    at oracle.security.jps.ee.util.JpsPlatformUtil.runJaasMode(JpsPlatformUtil.java:442)
    at oracle.security.jps.ee.http.JpsAbsFilter.runJaasMode(JpsAbsFilter.java:103)
    at oracle.security.jps.ee.http.JpsAbsFilter.doFilter(JpsAbsFilter.java:171)
    at oracle.security.jps.ee.http.JpsFilter.doFilter(JpsFilter.java:71)
    at weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:56)
    at oracle.dms.servlet.DMSServletFilter.doFilter(DMSServletFilter.java:139)
    at weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:56)
    at weblogic.servlet.internal.WebAppServletContext$ServletInvocationAction.wrapRun(WebAppServletContext.java:3715)
    at weblogic.servlet.internal.WebAppServletContext$ServletInvocationAction.run(WebAppServletContext.java:3681)
    at weblogic.security.acl.internal.AuthenticatedSubject.doAs(AuthenticatedSubject.java:321)
    at weblogic.security.service.SecurityManager.runAs(SecurityManager.java:120)
    at weblogic.servlet.internal.WebAppServletContext.securedExecute(WebAppServletContext.java:2277)
    at weblogic.servlet.internal.WebAppServletContext.execute(WebAppServletContext.java:2183)
    at weblogic.servlet.internal.ServletRequestImpl.run(ServletRequestImpl.java:1454)
    at weblogic.work.ExecuteThread.execute(ExecuteThread.java:209)
    at weblogic.work.ExecuteThread.run(ExecuteThread.java:178)
    <Oct 17, 2012 11:35:30 PM UTC> <Error> <HTTP> <BEA-101017> <[ServletContext@2045821149[app:analytics module:analytics path:/analytics spec-version:2.5 version:11.1.1]] Root cause of ServletException.
    weblogic.servlet.jsp.CompilationException: Failed to compile JSP /default.jsp
    Exception occurred while processing '/app/obiee/OBIEE11G/user_projects/domains/bifoundation_domain/servers/AdminServer/tmp/_WL_user/analytics_11.1.1/silp1v/war/default.jsp'java.lang.NullPointerException
    at weblogic.jsp.internal.jsp.JspParser.jspParse(JspParser.java:1092)
    at weblogic.jsp.internal.jsp.JspParser._parse(JspParser.java:604)
    at weblogic.jsp.internal.jsp.JspParser.parse(JspParser.java:597)
    at weblogic.jsp.internal.jsp.JspAnalyzer.parseFile(JspAnalyzer.java:104)
    at weblogic.jsp.internal.jsp.JspAnalyzer.parse(JspAnalyzer.java:92)
    at weblogic.jsp.internal.ProxySourceFile.parse(ProxySourceFile.java:106)
    at weblogic.jsp.internal.SourceFile.getAst(SourceFile.java:559)
    at weblogic.jsp.internal.SourceFile.getAst(SourceFile.java:533)
    at weblogic.jsp.internal.SourceFile.check(SourceFile.java:335)
    at weblogic.jsp.internal.ProxySourceFile.codeGen(ProxySourceFile.java:224)
    at weblogic.jsp.internal.SourceFile.codeGen(SourceFile.java:327)
    at weblogic.jsp.internal.client.ClientUtilsImpl$CodeGenJob.run(ClientUtilsImpl.java:599)
    at weblogic.jsp.internal.client.Job.performJob(Job.java:83)
    at weblogic.jsp.internal.client.ThreadPool$WorkerThread.run(ThreadPool.java:217)
    at weblogic.servlet.jsp.JavelinxJSPStub.reportCompilationErrorIfNeccessary(JavelinxJSPStub.java:226)
    at weblogic.servlet.jsp.JavelinxJSPStub.compilePage(JavelinxJSPStub.java:162)
    at weblogic.servlet.jsp.JspStub.prepareServlet(JspStub.java:256)
    at weblogic.servlet.jsp.JspStub.prepareServlet(JspStub.java:216)
    at weblogic.servlet.internal.ServletStubImpl.execute(ServletStubImpl.java:243)
    Truncated. see log file for complete stacktrace
    >
    <Oct 17, 2012 11:35:30 PM UTC> <Notice> <Diagnostics> <BEA-320068> <Watch 'UncheckedException' with severity 'Notice' on server 'AdminServer' has triggered at Oct 17, 2012 11:35:30 PM UTC. Notification details:
    WatchRuleType: Log
    WatchRule: (SEVERITY = 'Error') AND ((MSGID = 'WL-101020') OR (MSGID = 'WL-101017') OR (MSGID = 'WL-000802') OR (MSGID = 'BEA-101020') OR (MSGID = 'BEA-101017') OR (MSGID = 'BEA-000802'))
    WatchData: DATE = Oct 17, 2012 11:35:30 PM UTC SERVER = AdminServer MESSAGE = [ServletContext@2045821149[app:analytics module:analytics path:/analytics spec-version:2.5 version:11.1.1]] Root cause of ServletException.
    weblogic.servlet.jsp.CompilationException: Failed to compile JSP /default.jsp
    Exception occurred while processing '/app/obiee/OBIEE11G/user_projects/domains/bifoundation_domain/servers/AdminServer/tmp/_WL_user/analytics_11.1.1/silp1v/war/default.jsp'java.lang.NullPointerException
    at weblogic.jsp.internal.jsp.JspParser.jspParse(JspParser.java:1092)
    at weblogic.jsp.internal.jsp.JspParser._parse(JspParser.java:604)
    at weblogic.jsp.internal.jsp.JspParser.parse(JspParser.java:597)
    at weblogic.jsp.internal.jsp.JspAnalyzer.parseFile(JspAnalyzer.java:104)
    at weblogic.jsp.internal.jsp.JspAnalyzer.parse(JspAnalyzer.java:92)
    at weblogic.jsp.internal.ProxySourceFile.parse(ProxySourceFile.java:106)
    at weblogic.jsp.internal.SourceFile.getAst(SourceFile.java:559)
    at weblogic.jsp.internal.SourceFile.getAst(SourceFile.java:533)
    at weblogic.jsp.internal.SourceFile.check(SourceFile.java:335)
    at weblogic.jsp.internal.ProxySourceFile.codeGen(ProxySourceFile.java:224)
    at weblogic.jsp.internal.SourceFile.codeGen(SourceFile.java:327)
    at weblogic.jsp.internal.client.ClientUtilsImpl$CodeGenJob.run(ClientUtilsImpl.java:599)
    at weblogic.jsp.internal.client.Job.performJob(Job.java:83)
    at weblogic.jsp.internal.client.ThreadPool$WorkerThread.run(ThreadPool.java:217)
    at weblogic.servlet.jsp.JavelinxJSPStub.reportCompilationErrorIfNeccessary(JavelinxJSPStub.java:226)
    at weblogic.servlet.jsp.JavelinxJSPStub.compilePage(JavelinxJSPStub.java:162)
    at weblogic.servlet.jsp.JspStub.prepareServlet(JspStub.java:256)
    at weblogic.servlet.jsp.JspStub.prepareServlet(JspStub.java:216)
    at weblogic.servlet.internal.ServletStubImpl.execute(ServletStubImpl.java:243)
    at weblogic.servlet.internal.ServletStubImpl.onAddToMapException(ServletStubImpl.java:416)
    at weblogic.servlet.internal.ServletStubImpl.execute(ServletStubImpl.java:326)
    at weblogic.servlet.internal.TailFilter.doFilter(TailFilter.java:26)
    at weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:56)
    at oracle.security.jps.ee.http.JpsAbsFilter$1.run(JpsAbsFilter.java:119)
    at java.security.AccessController.doPrivileged(Native Method)
    at oracle.security.jps.util.JpsSubject.doAsPrivileged(JpsSubject.java:315)
    at oracle.security.jps.ee.util.JpsPlatformUtil.runJaasMode(JpsPlatformUtil.java:442)
    at oracle.security.jps.ee.http.JpsAbsFilter.runJaasMode(JpsAbsFilter.java:103)
    at oracle.security.jps.ee.http.JpsAbsFilter.doFilter(JpsAbsFilter.java:171)
    at oracle.security.jps.ee.http.JpsFilter.doFilter(JpsFilter.java:71)
    at weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:56)
    at oracle.dms.servlet.DMSServletFilter.doFilter(DMSServletFilter.java:139)
    at weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:56)
    at weblogic.servlet.internal.WebAppServletContext$ServletInvocationAction.wrapRun(WebAppServletContext.java:3715)
    at weblogic.servlet.internal.WebAppServletContext$ServletInvocationAction.run(WebAppServletContext.java:3681)
    at weblogic.security.acl.internal.AuthenticatedSubject.doAs(AuthenticatedSubject.java:321)
    at weblogic.security.service.SecurityManager.runAs(SecurityManager.java:120)
    at weblogic.servlet.internal.WebAppServletContext.securedExecute(WebAppServletContext.java:2277)
    at weblogic.servlet.internal.WebAppServletContext.execute(WebAppServletContext.java:2183)
    at weblogic.servlet.internal.ServletRequestImpl.run(ServletRequestImpl.java:1454)
    at weblogic.work.ExecuteThread.execute(ExecuteThread.java:209)
    at weblogic.work.ExecuteThread.run(ExecuteThread.java:178)
    SUBSYSTEM = HTTP USERID = <WLS Kernel> SEVERITY = Error THREAD = [ACTIVE] ExecuteThread: '0' for queue: 'weblogic.kernel.Default (self-tuning)' MSGID = BEA-101017 MACHINE = CERSAPP01 TXID = CONTEXTID = df93d959eaf5306a:-34b7973a:13a710d1053:-8000-0000000000000033 TIMESTAMP = 1350516930084
    WatchAlarmType: AutomaticReset
    WatchAlarmResetPeriod: 30000
    >
    <Oct 17, 2012 11:35:30 PM UTC> <Warning> <oracle.dfw.framework> <DFW-40121> <failure creating incident from WLDF notification
    oracle.dfw.incident.IncidentCreationException: DFW-40116: failure creating incident
    Cause: DFW-40112: There was an error executing adrci commands; the following errors have been found "Cannot run program "/app/obiee/OBIEE11G/wlserver_10.3/server/adr/adrci": java.io.IOException: error=24, Too many open files"
    Action: Ensure that command line tool "adrci" can be executed from the command line.
    at oracle.dfw.impl.incident.DiagnosticsDataExtractorImpl.createADRIncident(DiagnosticsDataExtractorImpl.java:952)
    at oracle.dfw.impl.incident.DiagnosticsDataExtractorImpl.createIncident(DiagnosticsDataExtractorImpl.java:303)
    at oracle.dfw.spi.weblogic.JMXWatchNotificationListener.handleNotification(JMXWatchNotificationListener.java:439)
    at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor$ListenerWrapper.handleNotification(DefaultMBeanServerInterceptor.java:1732)
    at javax.management.NotificationBroadcasterSupport.handleNotification(NotificationBroadcasterSupport.java:257)
    at javax.management.NotificationBroadcasterSupport$SendNotifJob.run(NotificationBroadcasterSupport.java:322)
    at javax.management.NotificationBroadcasterSupport$1.execute(NotificationBroadcasterSupport.java:307)
    at javax.management.NotificationBroadcasterSupport.sendNotification(NotificationBroadcasterSupport.java:229)
    at weblogic.management.jmx.modelmbean.WLSModelMBean.sendNotification(WLSModelMBean.java:828)
    at weblogic.diagnostics.watch.JMXNotificationProducer.postJMXNotification(JMXNotificationProducer.java:79)
    at weblogic.diagnostics.watch.JMXNotificationProducer.sendNotification(JMXNotificationProducer.java:104)
    at com.bea.diagnostics.notifications.JMXNotificationService.send(JMXNotificationService.java:122)
    at weblogic.diagnostics.watch.JMXNotificationListener.processWatchNotification(JMXNotificationListener.java:103)
    at weblogic.diagnostics.watch.Watch.performNotifications(Watch.java:621)
    at weblogic.diagnostics.watch.Watch.evaluateLogRuleWatch(Watch.java:546)
    at weblogic.diagnostics.watch.WatchManager.evaluateLogEventRulesAsync(WatchManager.java:792)
    at weblogic.diagnostics.watch.WatchManager.run(WatchManager.java:552)
    at weblogic.work.SelfTuningWorkManagerImpl$WorkAdapterImpl.run(SelfTuningWorkManagerImpl.java:528)
    at weblogic.work.ExecuteThread.execute(ExecuteThread.java:209)
    at weblogic.work.ExecuteThread.run(ExecuteThread.java:178)
    Caused By: oracle.dfw.common.DiagnosticsException: DFW-40112: failed to execute the adrci commands ""
    Cause: There was an error executing adrci commands; the following errors have been found "Cannot run program "/app/obiee/OBIEE11G/wlserver_10.3/server/adr/adrci": java.io.IOException: error=24, Too many open files"
    Action: Ensure that command line tool "adrci" can be executed from the command line.
    at oracle.dfw.impl.incident.ADRHelper.invoke(ADRHelper.java:1182)
    at oracle.dfw.impl.incident.ADRHelper.createIncident(ADRHelper.java:869)
    at oracle.dfw.impl.incident.DiagnosticsDataExtractorImpl.createADRIncident(DiagnosticsDataExtractorImpl.java:932)
    at oracle.dfw.impl.incident.DiagnosticsDataExtractorImpl.createIncident(DiagnosticsDataExtractorImpl.java:303)
    at oracle.dfw.spi.weblogic.JMXWatchNotificationListener.handleNotification(JMXWatchNotificationListener.java:439)
    at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor$ListenerWrapper.handleNotification(DefaultMBeanServerInterceptor.java:1732)
    at javax.management.NotificationBroadcasterSupport.handleNotification(NotificationBroadcasterSupport.java:257)
    at javax.management.NotificationBroadcasterSupport$SendNotifJob.run(NotificationBroadcasterSupport.java:322)
    at javax.management.NotificationBroadcasterSupport$1.execute(NotificationBroadcasterSupport.java:307)
    at javax.management.NotificationBroadcasterSupport.sendNotification(NotificationBroadcasterSupport.java:229)
    at weblogic.management.jmx.modelmbean.WLSModelMBean.sendNotification(WLSModelMBean.java:828)
    at weblogic.diagnostics.watch.JMXNotificationProducer.postJMXNotification(JMXNotificationProducer.java:79)
    at weblogic.diagnostics.watch.JMXNotificationProducer.sendNotification(JMXNotificationProducer.java:104)
    at com.bea.diagnostics.notifications.JMXNotificationService.send(JMXNotificationService.java:122)
    at weblogic.diagnostics.watch.JMXNotificationListener.processWatchNotification(JMXNotificationListener.java:103)
    at weblogic.diagnostics.watch.Watch.performNotifications(Watch.java:621)
    at weblogic.diagnostics.watch.Watch.evaluateLogRuleWatch(Watch.java:546)
    at weblogic.diagnostics.watch.WatchManager.evaluateLogEventRulesAsync(WatchManager.java:792)
    at weblogic.diagnostics.watch.WatchManager.run(WatchManager.java:552)
    at weblogic.work.SelfTuningWorkManagerImpl$WorkAdapterImpl.run(SelfTuningWorkManagerImpl.java:528)
    at weblogic.work.ExecuteThread.execute(ExecuteThread.java:209)
    at weblogic.work.ExecuteThread.run(ExecuteThread.java:178)
    >
    How to fix.
    Could you please provide me solution.
    Edited by: Raj on Oct 18, 2012 9:58 PM

    Hi All
    When i star my weblogic server it through below error.
    <Oct 17, 2012 11:35:14 PM UTC> <Critical> <Server> <BEA-002616> <Failed to listen on channel "Default" on 10.112.161.53:7001, failure count: 2, failing for 1 seconds, java.net.SocketException: Too many open files>
    <Oct 17, 2012 11:35:16 PM UTC> <Critical> <Server> <BEA-002616> <Failed to listen on channel "Default" on 10.112.161.53:7001, failure count: 3, failing for 3 seconds, java.net.SocketException: Too many open files>
    <Oct 17, 2012 11:35:19 PM UTC> <Notice> <Server> <BEA-002615> <After having failed to listen, the server is now listening on channel "Default" on 10.112.161.53:7001.>
    <Oct 17, 2012 11:35:27 PM UTC> <Critical> <Server> <BEA-002616> <Failed to listen on channel "Default" on 10.112.161.53:7001, failure count: 1, failing for 0 seconds, java.net.SocketException: Too many open files>
    java.util.zip.ZipException: error in opening zip file
    at java.util.zip.ZipFile.open(Native Method)
    at java.util.zip.ZipFile.<init>(ZipFile.java:127)
    at java.util.zip.ZipFile.<init>(ZipFile.java:143)
    at weblogic.jsp.internal.Jar.<init>(Jar.java:24)
    at weblogic.jsp.internal.Application.createJavelinFile(Application.java:185)
    at weblogic.jsp.internal.CPL.initializeBinaryPaths(CPL.java:234)
    at weblogic.servlet.jsp.JavelinxJSPStub.prepareCPLClasspath(JavelinxJSPStub.java:273)
    at weblogic.servlet.jsp.JavelinxJSPStub.compilePage(JavelinxJSPStub.java:126)
    at weblogic.servlet.jsp.JspStub.prepareServlet(JspStub.java:256)
    at weblogic.servlet.jsp.JspStub.prepareServlet(JspStub.java:216)
    at weblogic.servlet.internal.ServletStubImpl.execute(ServletStubImpl.java:243)
    at weblogic.servlet.internal.ServletStubImpl.onAddToMapException(ServletStubImpl.java:416)
    at weblogic.servlet.internal.ServletStubImpl.execute(ServletStubImpl.java:326)
    at weblogic.servlet.internal.TailFilter.doFilter(TailFilter.java:26)
    at weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:56)
    at oracle.security.jps.ee.http.JpsAbsFilter$1.run(JpsAbsFilter.java:119)
    at java.security.AccessController.doPrivileged(Native Method)
    at oracle.security.jps.util.JpsSubject.doAsPrivileged(JpsSubject.java:315)
    at oracle.security.jps.ee.util.JpsPlatformUtil.runJaasMode(JpsPlatformUtil.java:442)
    at oracle.security.jps.ee.http.JpsAbsFilter.runJaasMode(JpsAbsFilter.java:103)
    at oracle.security.jps.ee.http.JpsAbsFilter.doFilter(JpsAbsFilter.java:171)
    at oracle.security.jps.ee.http.JpsFilter.doFilter(JpsFilter.java:71)
    at weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:56)
    at oracle.dms.servlet.DMSServletFilter.doFilter(DMSServletFilter.java:139)
    at weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:56)
    at weblogic.servlet.internal.WebAppServletContext$ServletInvocationAction.wrapRun(WebAppServletContext.java:3715)
    at weblogic.servlet.internal.WebAppServletContext$ServletInvocationAction.run(WebAppServletContext.java:3681)
    at weblogic.security.acl.internal.AuthenticatedSubject.doAs(AuthenticatedSubject.java:321)
    at weblogic.security.service.SecurityManager.runAs(SecurityManager.java:120)
    at weblogic.servlet.internal.WebAppServletContext.securedExecute(WebAppServletContext.java:2277)
    at weblogic.servlet.internal.WebAppServletContext.execute(WebAppServletContext.java:2183)
    at weblogic.servlet.internal.ServletRequestImpl.run(ServletRequestImpl.java:1454)
    at weblogic.work.ExecuteThread.execute(ExecuteThread.java:209)
    at weblogic.work.ExecuteThread.run(ExecuteThread.java:178)
    <Oct 17, 2012 11:35:30 PM UTC> <Error> <HTTP> <BEA-101017> <[ServletContext@2045821149[app:analytics module:analytics path:/analytics spec-version:2.5 version:11.1.1]] Root cause of ServletException.
    weblogic.servlet.jsp.CompilationException: Failed to compile JSP /default.jsp
    Exception occurred while processing '/app/obiee/OBIEE11G/user_projects/domains/bifoundation_domain/servers/AdminServer/tmp/_WL_user/analytics_11.1.1/silp1v/war/default.jsp'java.lang.NullPointerException
    at weblogic.jsp.internal.jsp.JspParser.jspParse(JspParser.java:1092)
    at weblogic.jsp.internal.jsp.JspParser._parse(JspParser.java:604)
    at weblogic.jsp.internal.jsp.JspParser.parse(JspParser.java:597)
    at weblogic.jsp.internal.jsp.JspAnalyzer.parseFile(JspAnalyzer.java:104)
    at weblogic.jsp.internal.jsp.JspAnalyzer.parse(JspAnalyzer.java:92)
    at weblogic.jsp.internal.ProxySourceFile.parse(ProxySourceFile.java:106)
    at weblogic.jsp.internal.SourceFile.getAst(SourceFile.java:559)
    at weblogic.jsp.internal.SourceFile.getAst(SourceFile.java:533)
    at weblogic.jsp.internal.SourceFile.check(SourceFile.java:335)
    at weblogic.jsp.internal.ProxySourceFile.codeGen(ProxySourceFile.java:224)
    at weblogic.jsp.internal.SourceFile.codeGen(SourceFile.java:327)
    at weblogic.jsp.internal.client.ClientUtilsImpl$CodeGenJob.run(ClientUtilsImpl.java:599)
    at weblogic.jsp.internal.client.Job.performJob(Job.java:83)
    at weblogic.jsp.internal.client.ThreadPool$WorkerThread.run(ThreadPool.java:217)
    at weblogic.servlet.jsp.JavelinxJSPStub.reportCompilationErrorIfNeccessary(JavelinxJSPStub.java:226)
    at weblogic.servlet.jsp.JavelinxJSPStub.compilePage(JavelinxJSPStub.java:162)
    at weblogic.servlet.jsp.JspStub.prepareServlet(JspStub.java:256)
    at weblogic.servlet.jsp.JspStub.prepareServlet(JspStub.java:216)
    at weblogic.servlet.internal.ServletStubImpl.execute(ServletStubImpl.java:243)
    Truncated. see log file for complete stacktrace
    >
    <Oct 17, 2012 11:35:30 PM UTC> <Notice> <Diagnostics> <BEA-320068> <Watch 'UncheckedException' with severity 'Notice' on server 'AdminServer' has triggered at Oct 17, 2012 11:35:30 PM UTC. Notification details:
    WatchRuleType: Log
    WatchRule: (SEVERITY = 'Error') AND ((MSGID = 'WL-101020') OR (MSGID = 'WL-101017') OR (MSGID = 'WL-000802') OR (MSGID = 'BEA-101020') OR (MSGID = 'BEA-101017') OR (MSGID = 'BEA-000802'))
    WatchData: DATE = Oct 17, 2012 11:35:30 PM UTC SERVER = AdminServer MESSAGE = [ServletContext@2045821149[app:analytics module:analytics path:/analytics spec-version:2.5 version:11.1.1]] Root cause of ServletException.
    weblogic.servlet.jsp.CompilationException: Failed to compile JSP /default.jsp
    Exception occurred while processing '/app/obiee/OBIEE11G/user_projects/domains/bifoundation_domain/servers/AdminServer/tmp/_WL_user/analytics_11.1.1/silp1v/war/default.jsp'java.lang.NullPointerException
    at weblogic.jsp.internal.jsp.JspParser.jspParse(JspParser.java:1092)
    at weblogic.jsp.internal.jsp.JspParser._parse(JspParser.java:604)
    at weblogic.jsp.internal.jsp.JspParser.parse(JspParser.java:597)
    at weblogic.jsp.internal.jsp.JspAnalyzer.parseFile(JspAnalyzer.java:104)
    at weblogic.jsp.internal.jsp.JspAnalyzer.parse(JspAnalyzer.java:92)
    at weblogic.jsp.internal.ProxySourceFile.parse(ProxySourceFile.java:106)
    at weblogic.jsp.internal.SourceFile.getAst(SourceFile.java:559)
    at weblogic.jsp.internal.SourceFile.getAst(SourceFile.java:533)
    at weblogic.jsp.internal.SourceFile.check(SourceFile.java:335)
    at weblogic.jsp.internal.ProxySourceFile.codeGen(ProxySourceFile.java:224)
    at weblogic.jsp.internal.SourceFile.codeGen(SourceFile.java:327)
    at weblogic.jsp.internal.client.ClientUtilsImpl$CodeGenJob.run(ClientUtilsImpl.java:599)
    at weblogic.jsp.internal.client.Job.performJob(Job.java:83)
    at weblogic.jsp.internal.client.ThreadPool$WorkerThread.run(ThreadPool.java:217)
    at weblogic.servlet.jsp.JavelinxJSPStub.reportCompilationErrorIfNeccessary(JavelinxJSPStub.java:226)
    at weblogic.servlet.jsp.JavelinxJSPStub.compilePage(JavelinxJSPStub.java:162)
    at weblogic.servlet.jsp.JspStub.prepareServlet(JspStub.java:256)
    at weblogic.servlet.jsp.JspStub.prepareServlet(JspStub.java:216)
    at weblogic.servlet.internal.ServletStubImpl.execute(ServletStubImpl.java:243)
    at weblogic.servlet.internal.ServletStubImpl.onAddToMapException(ServletStubImpl.java:416)
    at weblogic.servlet.internal.ServletStubImpl.execute(ServletStubImpl.java:326)
    at weblogic.servlet.internal.TailFilter.doFilter(TailFilter.java:26)
    at weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:56)
    at oracle.security.jps.ee.http.JpsAbsFilter$1.run(JpsAbsFilter.java:119)
    at java.security.AccessController.doPrivileged(Native Method)
    at oracle.security.jps.util.JpsSubject.doAsPrivileged(JpsSubject.java:315)
    at oracle.security.jps.ee.util.JpsPlatformUtil.runJaasMode(JpsPlatformUtil.java:442)
    at oracle.security.jps.ee.http.JpsAbsFilter.runJaasMode(JpsAbsFilter.java:103)
    at oracle.security.jps.ee.http.JpsAbsFilter.doFilter(JpsAbsFilter.java:171)
    at oracle.security.jps.ee.http.JpsFilter.doFilter(JpsFilter.java:71)
    at weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:56)
    at oracle.dms.servlet.DMSServletFilter.doFilter(DMSServletFilter.java:139)
    at weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:56)
    at weblogic.servlet.internal.WebAppServletContext$ServletInvocationAction.wrapRun(WebAppServletContext.java:3715)
    at weblogic.servlet.internal.WebAppServletContext$ServletInvocationAction.run(WebAppServletContext.java:3681)
    at weblogic.security.acl.internal.AuthenticatedSubject.doAs(AuthenticatedSubject.java:321)
    at weblogic.security.service.SecurityManager.runAs(SecurityManager.java:120)
    at weblogic.servlet.internal.WebAppServletContext.securedExecute(WebAppServletContext.java:2277)
    at weblogic.servlet.internal.WebAppServletContext.execute(WebAppServletContext.java:2183)
    at weblogic.servlet.internal.ServletRequestImpl.run(ServletRequestImpl.java:1454)
    at weblogic.work.ExecuteThread.execute(ExecuteThread.java:209)
    at weblogic.work.ExecuteThread.run(ExecuteThread.java:178)
    SUBSYSTEM = HTTP USERID = <WLS Kernel> SEVERITY = Error THREAD = [ACTIVE] ExecuteThread: '0' for queue: 'weblogic.kernel.Default (self-tuning)' MSGID = BEA-101017 MACHINE = CERSAPP01 TXID = CONTEXTID = df93d959eaf5306a:-34b7973a:13a710d1053:-8000-0000000000000033 TIMESTAMP = 1350516930084
    WatchAlarmType: AutomaticReset
    WatchAlarmResetPeriod: 30000
    >
    <Oct 17, 2012 11:35:30 PM UTC> <Warning> <oracle.dfw.framework> <DFW-40121> <failure creating incident from WLDF notification
    oracle.dfw.incident.IncidentCreationException: DFW-40116: failure creating incident
    Cause: DFW-40112: There was an error executing adrci commands; the following errors have been found "Cannot run program "/app/obiee/OBIEE11G/wlserver_10.3/server/adr/adrci": java.io.IOException: error=24, Too many open files"
    Action: Ensure that command line tool "adrci" can be executed from the command line.
    at oracle.dfw.impl.incident.DiagnosticsDataExtractorImpl.createADRIncident(DiagnosticsDataExtractorImpl.java:952)
    at oracle.dfw.impl.incident.DiagnosticsDataExtractorImpl.createIncident(DiagnosticsDataExtractorImpl.java:303)
    at oracle.dfw.spi.weblogic.JMXWatchNotificationListener.handleNotification(JMXWatchNotificationListener.java:439)
    at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor$ListenerWrapper.handleNotification(DefaultMBeanServerInterceptor.java:1732)
    at javax.management.NotificationBroadcasterSupport.handleNotification(NotificationBroadcasterSupport.java:257)
    at javax.management.NotificationBroadcasterSupport$SendNotifJob.run(NotificationBroadcasterSupport.java:322)
    at javax.management.NotificationBroadcasterSupport$1.execute(NotificationBroadcasterSupport.java:307)
    at javax.management.NotificationBroadcasterSupport.sendNotification(NotificationBroadcasterSupport.java:229)
    at weblogic.management.jmx.modelmbean.WLSModelMBean.sendNotification(WLSModelMBean.java:828)
    at weblogic.diagnostics.watch.JMXNotificationProducer.postJMXNotification(JMXNotificationProducer.java:79)
    at weblogic.diagnostics.watch.JMXNotificationProducer.sendNotification(JMXNotificationProducer.java:104)
    at com.bea.diagnostics.notifications.JMXNotificationService.send(JMXNotificationService.java:122)
    at weblogic.diagnostics.watch.JMXNotificationListener.processWatchNotification(JMXNotificationListener.java:103)
    at weblogic.diagnostics.watch.Watch.performNotifications(Watch.java:621)
    at weblogic.diagnostics.watch.Watch.evaluateLogRuleWatch(Watch.java:546)
    at weblogic.diagnostics.watch.WatchManager.evaluateLogEventRulesAsync(WatchManager.java:792)
    at weblogic.diagnostics.watch.WatchManager.run(WatchManager.java:552)
    at weblogic.work.SelfTuningWorkManagerImpl$WorkAdapterImpl.run(SelfTuningWorkManagerImpl.java:528)
    at weblogic.work.ExecuteThread.execute(ExecuteThread.java:209)
    at weblogic.work.ExecuteThread.run(ExecuteThread.java:178)
    Caused By: oracle.dfw.common.DiagnosticsException: DFW-40112: failed to execute the adrci commands ""
    Cause: There was an error executing adrci commands; the following errors have been found "Cannot run program "/app/obiee/OBIEE11G/wlserver_10.3/server/adr/adrci": java.io.IOException: error=24, Too many open files"
    Action: Ensure that command line tool "adrci" can be executed from the command line.
    at oracle.dfw.impl.incident.ADRHelper.invoke(ADRHelper.java:1182)
    at oracle.dfw.impl.incident.ADRHelper.createIncident(ADRHelper.java:869)
    at oracle.dfw.impl.incident.DiagnosticsDataExtractorImpl.createADRIncident(DiagnosticsDataExtractorImpl.java:932)
    at oracle.dfw.impl.incident.DiagnosticsDataExtractorImpl.createIncident(DiagnosticsDataExtractorImpl.java:303)
    at oracle.dfw.spi.weblogic.JMXWatchNotificationListener.handleNotification(JMXWatchNotificationListener.java:439)
    at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor$ListenerWrapper.handleNotification(DefaultMBeanServerInterceptor.java:1732)
    at javax.management.NotificationBroadcasterSupport.handleNotification(NotificationBroadcasterSupport.java:257)
    at javax.management.NotificationBroadcasterSupport$SendNotifJob.run(NotificationBroadcasterSupport.java:322)
    at javax.management.NotificationBroadcasterSupport$1.execute(NotificationBroadcasterSupport.java:307)
    at javax.management.NotificationBroadcasterSupport.sendNotification(NotificationBroadcasterSupport.java:229)
    at weblogic.management.jmx.modelmbean.WLSModelMBean.sendNotification(WLSModelMBean.java:828)
    at weblogic.diagnostics.watch.JMXNotificationProducer.postJMXNotification(JMXNotificationProducer.java:79)
    at weblogic.diagnostics.watch.JMXNotificationProducer.sendNotification(JMXNotificationProducer.java:104)
    at com.bea.diagnostics.notifications.JMXNotificationService.send(JMXNotificationService.java:122)
    at weblogic.diagnostics.watch.JMXNotificationListener.processWatchNotification(JMXNotificationListener.java:103)
    at weblogic.diagnostics.watch.Watch.performNotifications(Watch.java:621)
    at weblogic.diagnostics.watch.Watch.evaluateLogRuleWatch(Watch.java:546)
    at weblogic.diagnostics.watch.WatchManager.evaluateLogEventRulesAsync(WatchManager.java:792)
    at weblogic.diagnostics.watch.WatchManager.run(WatchManager.java:552)
    at weblogic.work.SelfTuningWorkManagerImpl$WorkAdapterImpl.run(SelfTuningWorkManagerImpl.java:528)
    at weblogic.work.ExecuteThread.execute(ExecuteThread.java:209)
    at weblogic.work.ExecuteThread.run(ExecuteThread.java:178)
    >
    How to fix.
    Could you please provide me solution.
    Edited by: Raj on Oct 18, 2012 9:58 PM

  • Idle File Descriptors

    Hello:
    We recently upgraded from WLS 7.01 to WLS 8.1. One thing we have encountered
    is an effective crash of the WebLogic server given that WebLogic appears to not
    be releasing idle TCP connections. We specifically are seeing idle file descriptors
    (using lsof -p) which remain idle for days (far exceeding any timeout settings
    on the Solaris machine). In addition, when all descriptors are used (current
    limit is 1024), we receive a socket exception (java.net.SocketException: Too many
    open files).
    We have contacted BEA support and received a response of 'network configuration
    is the issue'. We are highly skeptical of the response given that we have changed
    nothing in our network configuration between 7.0 and 8.1. In addition, we recently
    interrogated some production environments running 7.0 and found a small number
    of idle file descriptors. Overall it appears that the idle file descriptor problem
    is amplified in 8.1. Has any else encountered this behavior?
    Finally we are not in a position to restart production instances on a periodic
    basis. We have service level agreements to achieve and kicking our customers
    out of the product on a routine basis is not even close to being acceptable.
    Any thoughts or ideas from the group would be sincerely appreciated.
    Brian

    Hi,
    Have you managed to sort this yet, we are getting the same error in HPUX running
    BEA 6.1 - would be good if you could email me a resolution if you found one.
    thanks

  • Weblogic Server Switch over automatically due to too many open files error.

    Hi,
    I am facing problem in production environment. I am using Weblogic 8.1 SP4 application.
    Weblogic Server automatically switch over every 3 weeks due to few reasons.
    1. out of memorry error.
    2. Too many open files error.
    Please see my below portalserver. log files. Kindly provide some good solution to solve this problem.
    The following log is portalserver.log file
    ###<May 6, 2009 8:28:15 PM ICT> <Notice> <WebLogicServer> <ebizdr> <portalServer> <ListenThread.Default> <<WLS Kernel>> <> <BEA-000205> <After having failed to listen, the server is now listening on port 9001.>
    ####<May 6, 2009 8:28:15 PM ICT> <Critical> <WebLogicServer> <ebizdr> <portalServer> <ListenThread.Default> <<WLS Kernel>> <> <BEA-000204> <Failed to listen on port 9001, failure count: 1, failing for 0 seconds, java.net.SocketException: Too many open files>
    ####<May 6, 2009 8:28:15 PM ICT> <Error> <HTTP> <ebizdr> <portalServer> <ExecuteThread: '5' for queue: 'default'> <<WLS Kernel>> <> <BEA-101019> <[ServletContext(id=18480784,name=NBIAProject,context-path=)] Servlet failed with IOException
    java.io.FileNotFoundException: /var/opt/weblogic/user_projects/domains/eBizPortalDomain/portalServer/.wlnotdelete/NBIAPortalApp/NBIAProject/images/go.gif (Too many open files)
         at java.io.FileInputStream.open(Native Method)
         at java.io.FileInputStream.<init>(FileInputStream.java:106)
         at weblogic.utils.classloaders.FileSource.getInputStream(FileSource.java:23)
         at weblogic.servlet.FileServlet.sendFile(FileServlet.java:563)
         at weblogic.servlet.FileServlet.service(FileServlet.java:206)
         at javax.servlet.http.HttpServlet.service(HttpServlet.java:853)
         at weblogic.servlet.internal.ServletStubImpl$ServletInvocationAction.run(ServletStubImpl.java:1006)
         at weblogic.servlet.internal.ServletStubImpl.invokeServlet(ServletStubImpl.java:419)
         at weblogic.servlet.internal.TailFilter.doFilter(TailFilter.java:28)
         at weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:27)
         at com.bea.p13n.servlets.PortalServletFilter.doFilter(PortalServletFilter.java:293)
         at weblogic.servlet.internal.FilterChainImpl.doFilter(FilterChainImpl.java:27)
         at weblogic.servlet.internal.WebAppServletContext$ServletInvocationAction.run(WebAppServletContext.java:6724)
         at weblogic.security.acl.internal.AuthenticatedSubject.doAs(AuthenticatedSubject.java:321)
         at weblogic.security.service.SecurityManager.runAs(SecurityManager.java:121)
         at weblogic.servlet.internal.WebAppServletContext.invokeServlet(WebAppServletContext.java:3764)
         at weblogic.servlet.internal.ServletRequestImpl.execute(ServletRequestImpl.java:2644)
         at weblogic.kernel.ExecuteThread.execute(ExecuteThread.java:219)
         at weblogic.kernel.ExecuteThread.run(ExecuteThread.java:178)
    >
    ####<May 6, 2009 8:28:16 PM ICT> <Notice> <WebLogicServer> <ebizdr> <portalServer> <ListenThread.Default> <<WLS Kernel>> <> <BEA-000205> <After having failed to listen, the server is now listening on port 9001.>
    ####<May 6, 2009 8:28:16 PM ICT> <Critical> <WebLogicServer> <ebizdr> <portalServer> <ListenThread.Default> <<WLS Kernel>> <> <BEA-000204> <Failed to listen on port 9001, failure count: 1, failing for 0 seconds, java.net.SocketException: Too many open files>
    ####<May 6, 2009 8:28:16 PM ICT> <Error> <HTTP> <ebizdr> <portalServer> <ExecuteThread: '5' for queue: 'default'> <<WLS Kernel>> <> <BEA-101019> <[ServletContext(id=18480784,name=NBIAProject,context-path=)] Servlet failed with IOException
    java.io.FileNotFoundException: /var/opt/weblogic/user_projects/domains/eBizPortalDomain/portalServer/.wlnotdelete/NBIAPortalApp/NBIAProject/images/search_right.gif (Too many open files)
    Thanks & Regards,
    Suriyaprakash.V

    Sorry for the late resp. Here's what dev suggests be investigated:
    I would want to know:
    Can they do a "$ORACLE_HOME/bin/dmstool -dump" and
    save/compress/send the results?
    Are there any errors printed in the Apache error_log while this leak occurs?
    The customer could/should re-check their TCP settings, especially the TCP time wait interval and generally follow the TCP settings recommended in Chapter 5 of the iAS Performance Guide for 9.0.2.
    Is there anything else interesting/unusual about the site?
    Let us know how it goes.

  • I am trying to Integrate EBS-12.1.3 with Endeca on  RHEL5-64 bit

    Hi, am new to Endeca i m doing a Ebs connection with Oracle endeca but i m not been able to do it.
    I done setup of (./envSetup.sh)Database, Domains but when i start (./startAllEndeca.sh) Endeca Components Endeca Studio Managed Server (5) giving error..
    Starting Studio Managed Server ...
    Server is taking much time to start? you can force close by hitting Ctrl + C or check log file at /home/oracle/Ext/Oracle/Middleware/user_projects/domains/endeca_domain/bin/studio.log
    Endeca Admin Server didn't start properly!, please check log file at /home/oracle/Ext/Oracle/Middleware/user_projects/domains/endeca_domain/bin/studio.log
    I dont Knw Oracle EBS and New in Oracle Endeca so pls can anyone guide me to solve....
    ************************************************************error.log**********************************************************
    <Nov 26, 2014 10:49:52 AM IST> <Warning> <Deployer> <BEA-149617> <Non-critical internal application uddi was not deployed. Error: [Deployer:149158]No application files exist at '/home/oracle/Ext/Oracle/Middleware/wlserver_10.3/server/lib/uddi.war'.>
    <Nov 26, 2014 10:49:52 AM IST> <Warning> <Deployer> <BEA-149617> <Non-critical internal application uddiexplorer was not deployed. Error: [Deployer:149158]No application files exist at '/home/oracle/Ext/Oracle/Middleware/wlserver_10.3/server/lib/uddiexplorer.war'.>
    studio.log
    JAVA Memory arguments: -Xms256m -Xmx512m  -XX:MaxPermSize=512m
    WLS Start Mode=Production
    CLASSPATH=/home/oracle/Ext/Oracle/Middleware/oracle_common/modules/oracle.jdbc_11.1.1/ojdbc6dms.jar:/home/oracle/Ext/Oracle/Middleware/patch_wls1036/profiles/default/sys_manifest_classpath/weblogic_patch.jar:/home/oracle/Ext/Oracle/software/java/jdk1.6.0_43/lib/tools.jar:/home/oracle/Ext/Oracle/Middleware/wlserver_10.3/server/lib/weblogic_sp.jar:/home/oracle/Ext/Oracle/Middleware/wlserver_10.3/server/lib/weblogic.jar:/home/oracle/Ext/Oracle/Middleware/modules/features/weblogic.server.modules_10.3.6.0.jar:/home/oracle/Ext/Oracle/Middleware/wlserver_10.3/server/lib/webservices.jar:/home/oracle/Ext/Oracle/Middleware/modules/org.apache.ant_1.7.1/lib/ant-all.jar:/home/oracle/Ext/Oracle/Middleware/modules/net.sf.antcontrib_1.1.0.0_1-0b2/lib/ant-contrib.jar:/home/oracle/Ext/Oracle/Middleware/oracle_common/modules/oracle.jrf_11.1.1/jrf.jar:/home/oracle/Ext/Oracle/Middleware/wlserver_10.3/common/derby/lib/derbyclient.jar:/home/oracle/Ext/Oracle/Middleware/wlserver_10.3/server/lib/xqrl.jar
    PATH=/home/oracle/Ext/Oracle/Middleware/wlserver_10.3/server/bin:/home/oracle/Ext/Oracle/Middleware/modules/org.apache.ant_1.7.1/bin:/home/oracle/Ext/Oracle/software/java/jdk1.6.0_43/jre/bin:/home/oracle/Ext/Oracle/software/java/jdk1.6.0_43/bin:/usr/lib64/qt-3.3/bin:/usr/kerberos/bin:/usr/local/bin:/usr/bin:/bin:/usr/X11R6/bin:/u01/Oracle/software/java/jdk1.6.0_43/bin/java/bin
    *  To start WebLogic Server, use a username and   *
    *  password assigned to an admin-level user.  For *
    *  server administration, use the WebLogic Server *
    *  console at http://hostname:port/console        *
    starting weblogic with Java version:
    java version "1.6.0_43"
    Java(TM) SE Runtime Environment (build 1.6.0_43-b01)
    Java HotSpot(TM) 64-Bit Server VM (build 20.14-b01, mixed mode)
    Starting WLS with line:
    /home/oracle/Ext/Oracle/software/java/jdk1.6.0_43/bin/java -server   -Xms256m -Xmx512m  -XX:MaxPermSize=512m -Dweblogic.Name=StudioManagedServer -Djava.security.policy=/home/oracle/Ext/Oracle/Middleware/wlserver_10.3/server/lib/weblogic.policy  -Dweblogic.ProductionModeEnabled=true -Djavax.xml.transform.TransformerFactory=com.sun.org.apache.xalan.internal.xsltc.trax.TransformerFactoryImpl -Djavax.xml.parsers.DocumentBuilderFactory=com.sun.org.apache.xerces.internal.jaxp.DocumentBuilderFactoryImpl -Djavax.xml.parsers.SAXParserFactory=com.sun.org.apache.xerces.internal.jaxp.SAXParserFactoryImpl  -da -Dplatform.home=/home/oracle/Ext/Oracle/Middleware/wlserver_10.3 -Dwls.home=/home/oracle/Ext/Oracle/Middleware/wlserver_10.3/server -Dweblogic.home=/home/oracle/Ext/Oracle/Middleware/wlserver_10.3/server  -Dcommon.components.home=/home/oracle/Ext/Oracle/Middleware/oracle_common -Djrf.version=11.1.1 -Dorg.apache.commons.logging.Log=org.apache.commons.logging.impl.Jdk14Logger -Ddomain.home=/home/oracle/Ext/Oracle/Middleware/user_projects/domains/endeca_domain -Djrockit.optfile=/home/oracle/Ext/Oracle/Middleware/oracle_common/modules/oracle.jrf_11.1.1/jrocket_optfile.txt -Doracle.server.config.dir=/home/oracle/Ext/Oracle/Middleware/user_projects/domains/endeca_domain/config/fmwconfig/servers/StudioManagedServer -Doracle.domain.config.dir=/home/oracle/Ext/Oracle/Middleware/user_projects/domains/endeca_domain/config/fmwconfig  -Digf.arisidbeans.carmlloc=/home/oracle/Ext/Oracle/Middleware/user_projects/domains/endeca_domain/config/fmwconfig/carml  -Digf.arisidstack.home=/home/oracle/Ext/Oracle/Middleware/user_projects/domains/endeca_domain/config/fmwconfig/arisidprovider -Doracle.security.jps.config=/home/oracle/Ext/Oracle/Middleware/user_projects/domains/endeca_domain/config/fmwconfig/jps-config.xml -Doracle.deployed.app.dir=/home/oracle/Ext/Oracle/Middleware/user_projects/domains/endeca_domain/servers/StudioManagedServer/tmp/_WL_user -Doracle.deployed.app.ext=/- -Dweblogic.alternateTypesDirectory=/home/oracle/Ext/Oracle/Middleware/oracle_common/modules/oracle.ossoiap_11.1.1,/home/oracle/Ext/Oracle/Middleware/oracle_common/modules/oracle.oamprovider_11.1.1 -Djava.protocol.handler.pkgs=oracle.mds.net.protocol  -Dweblogic.jdbc.remoteEnabled=false -Dweblogic.threadpool.MinPoolSize=25 -Dweblogic.management.discover=false -Dweblogic.management.server=t3://localhost:7002  -Dwlw.iterativeDev=false -Dwlw.testConsole=false -Dwlw.logErrorsToConsole=false -Dweblogic.ext.dirs=/home/oracle/Ext/Oracle/Middleware/patch_wls1036/profiles/default/sysext_manifest_classpath  weblogic.Server
    <Nov 26, 2014 10:47:39 AM IST> <Info> <Security> <BEA-090905> <Disabling CryptoJ JCE Provider self-integrity check for better startup performance. To enable this check, specify -Dweblogic.security.allowCryptoJDefaultJCEVerification=true>
    <Nov 26, 2014 10:47:39 AM IST> <Info> <Security> <BEA-090906> <Changing the default Random Number Generator in RSA CryptoJ from ECDRBG to FIPS186PRNG. To disable this change, specify -Dweblogic.security.allowCryptoJDefaultPRNG=true>
    <Nov 26, 2014 10:47:40 AM IST> <Info> <WebLogicServer> <BEA-000377> <Starting WebLogic Server with Java HotSpot(TM) 64-Bit Server VM Version 20.14-b01 from Sun Microsystems Inc.>
    <Nov 26, 2014 10:47:41 AM IST> <Info> <Management> <BEA-141107> <Version: WebLogic Server 10.3.6.0  Tue Nov 15 08:52:36 PST 2011 1441050 >
    <Nov 26, 2014 10:47:44 AM IST> <Notice> <WebLogicServer> <BEA-000365> <Server state changed to STARTING>
    <Nov 26, 2014 10:47:44 AM IST> <Info> <WorkManager> <BEA-002900> <Initializing self-tuning thread pool>
    <Nov 26, 2014 10:47:44 AM IST> <Notice> <Log Management> <BEA-170019> <The server log file /home/oracle/Ext/Oracle/Middleware/user_projects/domains/endeca_domain/servers/StudioManagedServer/logs/StudioManagedServer.log is opened. All server side log events will be written to this file.>
    <Nov 26, 2014 10:49:27 AM IST> <Notice> <Security> <BEA-090082> <Security initializing using security realm myrealm.>
    <Nov 26, 2014 10:49:27 AM IST> <Notice> <Security> <BEA-090083> <Storing boot identity in the file: /home/oracle/Ext/Oracle/Middleware/user_projects/domains/endeca_domain/servers/StudioManagedServer/security/boot.properties>
    <Nov 26, 2014 10:49:52 AM IST> <Warning> <Deployer> <BEA-149617> <Non-critical internal application uddi was not deployed. Error: [Deployer:149158]No application files exist at '/home/oracle/Ext/Oracle/Middleware/wlserver_10.3/server/lib/uddi.war'.>
    <Nov 26, 2014 10:49:52 AM IST> <Warning> <Deployer> <BEA-149617> <Non-critical internal application uddiexplorer was not deployed. Error: [Deployer:149158]No application files exist at '/home/oracle/Ext/Oracle/Middleware/wlserver_10.3/server/lib/uddiexplorer.war'.>
    <Nov 26, 2014 10:49:54 AM IST> <Notice> <WebLogicServer> <BEA-000365> <Server state changed to STANDBY>
    <Nov 26, 2014 10:49:54 AM IST> <Notice> <WebLogicServer> <BEA-000365> <Server state changed to STARTING>
    <Nov 26, 2014 10:51:00 AM IST> <Warning> <Munger> <BEA-2156203> <A version attribute was not found in element application in the deployment descriptor in /home/oracle/Ext/Oracle/Middleware/user_projects/domains/endeca_domain/servers/StudioManagedServer/stage/studio-portal/studio-portal/META-INF/application.xml. A version attribute is required, but this version of the Weblogic Server will assume that the JEE5 is used. Future versions of the Weblogic Server will reject descriptors that do not specify the JEE version.>
    <Nov 26, 2014 10:51:02 AM IST> <Warning> <Munger> <BEA-2156203> <A version attribute was not found in element application in the deployment descriptor in /home/oracle/Ext/Oracle/Middleware/user_projects/domains/endeca_domain/servers/StudioManagedServer/stage/studio-portal/studio-portal/META-INF/application.xml. A version attribute is required, but this version of the Weblogic Server will assume that the JEE5 is used. Future versions of the Weblogic Server will reject descriptors that do not specify the JEE version.>
    Loading zip:/home/oracle/Ext/Oracle/Middleware/user_projects/domains/endeca_domain/servers/StudioManagedServer/stage/studio-portal/studio-portal/endeca-portal/WEB-INF/lib/portal-impl.jar!/system.properties
    Loading file:/home/oracle/Ext/Oracle/Middleware/user_projects/domains/endeca_domain/servers/StudioManagedServer/stage/studio-portal/studio-portal/endeca-portal/WEB-INF/classes/system-ext.properties
    Loading zip:/home/oracle/Ext/Oracle/Middleware/user_projects/domains/endeca_domain/servers/StudioManagedServer/stage/studio-portal/studio-portal/endeca-portal/WEB-INF/lib/portal-impl.jar!/portal.properties
    Loading file:/home/oracle/Ext/Oracle/Middleware/user_projects/domains/endeca_domain/servers/StudioManagedServer/stage/studio-portal/studio-portal/endeca-portal/WEB-INF/classes/portal-ext.properties
    Loading file:/home/oracle/Ext/Oracle/Middleware/user_projects/domains/portal-ext.properties
    2014-11-26 10:54:54,395 WARN  [DataSourceFactoryBean] A JNDI data source is not configured. For security reasons it is strongly recommended to configure Studio's database connection via JNDI rather than setting database connection parameters directly in Studio's configuration file.
    Nov 26, 2014 10:54:59 AM net.sf.ehcache.hibernate.EhCacheProvider buildCache
    WARNING: Could not find a specific ehcache configuration for cache named [com.liferay.portlet.documentlibrary.model.impl.DLFileEntryImpl]; using defaults.
    Nov 26, 2014 10:54:59 AM net.sf.ehcache.hibernate.EhCacheProvider buildCache
    WARNING: Could not find a specific ehcache configuration for cache named [com.liferay.portlet.messageboards.model.impl.MBStatsUserImpl]; using defaults.
    Nov 26, 2014 10:54:59 AM net.sf.ehcache.hibernate.EhCacheProvider buildCache
    WARNING: Could not find a specific ehcache configuration for cache named [com.liferay.portal.model.impl.UserIdMapperImpl]; using defaults.
    Nov 26, 2014 10:54:59 AM net.sf.ehcache.hibernate.EhCacheProvider buildCache
    WARNING: Could not find a specific ehcache configuration for cache named [com.liferay.portal.model.impl.LayoutSetImpl]; using defaults.
    Nov 26, 2014 10:54:59 AM net.sf.ehcache.hibernate.EhCacheProvider buildCache
    WARNING: Could not find a specific ehcache configuration for cache named [com.liferay.portlet.softwarecatalog.model.impl.SCProductScreenshotImpl]; using defaults.
    Nov 26, 2014 10:54:59 AM net.sf.ehcache.hibernate.EhCacheProvider buildCache
    WARNING: Could not find a specific ehcache configuration for cache named [com.endeca.portal.liferay.ext.metadata.model.impl.MetadataPropertyRecordImpl]; using defaults.
    Nov 26, 2014 10:54:59 AM net.sf.ehcache.hibernate.EhCacheProvider buildCache
    WARNING: Could not find a specific ehcache configuration for cache named [com.liferay.portal.model.impl.PortletItemImpl]; using defaults.
    Nov 26, 2014 10:54:59 AM net.sf.ehcache.hibernate.EhCacheProvider buildCache
    WARNING: Could not find a specific ehcache configuration for cache named [com.liferay.portal.model.impl.UserGroupRoleImpl]; using defaults.
    Nov 26, 2014 10:54:59 AM net.sf.ehcache.hibernate.EhCacheProvider buildCache
    WARNING: Could not find a specific ehcache configuration for cache named [com.liferay.portlet.tags.model.impl.TagsAssetImpl]; using defaults.
    Nov 26, 2014 10:54:59 AM net.sf.ehcache.hibernate.EhCacheProvider buildCache
    WARNING: Could not find a specific ehcache configuration for cache named [com.liferay.portlet.journal.model.impl.JournalStructureImpl]; using defaults.
    Nov 26, 2014 10:54:59 AM net.sf.ehcache.hibernate.EhCacheProvider buildCache
    WARNING: Could not find a specific ehcache configuration for cache named [com.liferay.portlet.tasks.model.impl.TasksReviewImpl]; using defaults.
    Nov 26, 2014 10:54:59 AM net.sf.ehcache.hibernate.EhCacheProvider buildCache
    WARNING: Could not find a specific ehcache configuration for cache named [com.liferay.portal.model.impl.PortletPreferencesImpl]; using defaults.
    Nov 26, 2014 10:54:59 AM net.sf.ehcache.hibernate.EhCacheProvider buildCache
    WARNING: Could not find a specific ehcache configuration for cache named [com.endeca.portal.liferay.ext.bookmarks.model.impl.PortletStateRecordImpl]; using defaults.
    Nov 26, 2014 10:54:59 AM net.sf.ehcache.hibernate.EhCacheProvider buildCache
    WARNING: Could not find a specific ehcache configuration for cache named [com.liferay.portlet.announcements.model.impl.AnnouncementsEntryImpl]; using defaults.
    Nov 26, 2014 10:54:59 AM net.sf.ehcache.hibernate.EhCacheProvider buildCache
    WARNING: Could not find a specific ehcache configuration for cache named [com.liferay.portal.model.impl.SubscriptionImpl]; using defaults.
    Nov 26, 2014 10:54:59 AM net.sf.ehcache.hibernate.EhCacheProvider buildCache
    WARNING: Could not find a specific ehcache configuration for cache named [com.endeca.portal.liferay.ext.metadata.model.impl.MetadataRecordImpl]; using defaults.
    Nov 26, 2014 10:54:59 AM net.sf.ehcache.hibernate.EhCacheProvider buildCache
    WARNING: Could not find a specific ehcache configuration for cache named [com.liferay.portlet.blogs.model.impl.BlogsEntryImpl]; using defaults.
    Nov 26, 2014 10:54:59 AM net.sf.ehcache.hibernate.EhCacheProvider buildCache
    WARNING: Could not find a specific ehcache configuration for cache named [com.liferay.portal.model.impl.AddressImpl]; using defaults.
    Nov 26, 2014 10:54:59 AM net.sf.ehcache.hibernate.EhCacheProvider buildCache
    WARNING: Could not find a specific ehcache configuration for cache named [com.liferay.portlet.messageboards.model.impl.MBThreadImpl]; using defaults.
    Nov 26, 2014 10:54:59 AM net.sf.ehcache.hibernate.EhCacheProvider buildCache
    WARNING: Could not find a specific ehcache configuration for cache named [com.liferay.portlet.journal.model.impl.JournalArticleImpl]; using defaults.
    Nov 26, 2014 10:54:59 AM net.sf.ehcache.hibernate.EhCacheProvider buildCache
    WARNING: Could not find a specific ehcache configuration for cache named [com.liferay.portal.model.impl.ServiceComponentImpl]; using defaults.
    Nov 26, 2014 10:55:00 AM net.sf.ehcache.hibernate.EhCacheProvider buildCache
    WARNING: Could not find a specific ehcache configuration for cache named [com.liferay.portlet.journal.model.impl.JournalArticleResourceImpl]; using defaults.
    Nov 26, 2014 10:55:00 AM net.sf.ehcache.hibernate.EhCacheProvider buildCache
    WARNING: Could not find a specific ehcache configuration for cache named [com.liferay.portlet.expando.model.impl.ExpandoValueImpl]; using defaults.
    Nov 26, 2014 10:55:00 AM net.sf.ehcache.hibernate.EhCacheProvider buildCache
    WARNING: Could not find a specific ehcache configuration for cache named [com.liferay.portlet.blogs.model.impl.BlogsStatsUserImpl]; using defaults.
    Nov 26, 2014 10:55:00 AM net.sf.ehcache.hibernate.EhCacheProvider buildCache
    WARNING: Could not find a specific ehcache configuration for cache named [com.liferay.portlet.softwarecatalog.model.impl.SCLicenseImpl]; using defaults.
    Nov 26, 2014 10:55:00 AM net.sf.ehcache.hibernate.EhCacheProvider buildCache
    WARNING: Could not find a specific ehcache configuration for cache named [com.liferay.portlet.journal.model.impl.JournalArticleImageImpl]; using defaults.
    Nov 26, 2014 10:55:00 AM net.sf.ehcache.hibernate.EhCacheProvider buildCache
    WARNING: Could not find a specific ehcache configuration for cache named [com.liferay.portlet.ratings.model.impl.RatingsEntryImpl]; using defaults.
    Nov 26, 2014 10:55:00 AM net.sf.ehcache.hibernate.EhCacheProvider buildCache
    WARNING: Could not find a specific ehcache configuration for cache named [com.endeca.portal.liferay.ext.bookmarks.model.impl.BookmarkRecordImpl]; using defaults.
    Nov 26, 2014 10:55:00 AM net.sf.ehcache.hibernate.EhCacheProvider buildCache
    WARNING: Could not find a specific ehcache configuration for cache named [com.liferay.portlet.imagegallery.model.impl.IGImageImpl]; using defaults.
    Nov 26, 2014 10:55:00 AM net.sf.ehcache.hibernate.EhCacheProvider buildCache
    WARNING: Could not find a specific ehcache configuration for cache named [com.liferay.portlet.imagegallery.model.impl.IGFolderImpl]; using defaults.
    Nov 26, 2014 10:55:00 AM net.sf.ehcache.hibernate.EhCacheProvider buildCache
    WARNING: Could not find a specific ehcache configuration for cache named [com.liferay.portlet.journal.model.impl.JournalFeedImpl]; using defaults.
    Nov 26, 2014 10:55:00 AM net.sf.ehcache.hibernate.EhCacheProvider buildCache
    WARNING: Could not find a specific ehcache configuration for cache named [com.liferay.portal.model.impl.PasswordPolicyImpl]; using defaults.
    Nov 26, 2014 10:55:00 AM net.sf.ehcache.hibernate.EhCacheProvider buildCache
    WARNING: Could not find a specific ehcache configuration for cache named [com.liferay.portal.model.impl.ResourceImpl]; using defaults.
    Nov 26, 2014 10:55:00 AM net.sf.ehcache.hibernate.EhCacheProvider buildCache
    WARNING: Could not find a specific ehcache configuration for cache named [com.liferay.portal.model.impl.PasswordPolicyRelImpl]; using defaults.
    Nov 26, 2014 10:55:00 AM net.sf.ehcache.hibernate.EhCacheProvider buildCache
    WARNING: Could not find a specific ehcache configuration for cache named [com.liferay.portal.model.impl.RoleImpl]; using defaults.
    Nov 26, 2014 10:55:00 AM net.sf.ehcache.hibernate.EhCacheProvider buildCache
    WARNING: Could not find a specific ehcache configuration for cache named [com.liferay.portal.model.impl.LayoutImpl]; using defaults.
    Nov 26, 2014 10:55:00 AM net.sf.ehcache.hibernate.EhCacheProvider buildCache
    WARNING: Could not find a specific ehcache configuration for cache named [com.liferay.portal.model.impl.MembershipRequestImpl]; using defaults.
    Nov 26, 2014 10:55:00 AM net.sf.ehcache.hibernate.EhCacheProvider buildCache
    WARNING: Could not find a specific ehcache configuration for cache named [com.liferay.portal.model.impl.CompanyImpl]; using defaults.
    Nov 26, 2014 10:55:00 AM net.sf.ehcache.hibernate.EhCacheProvider buildCache
    WARNING: Could not find a specific ehcache configuration for cache named [com.liferay.portlet.tags.model.impl.TagsSourceImpl]; using defaults.
    Nov 26, 2014 10:55:00 AM net.sf.ehcache.hibernate.EhCacheProvider buildCache
    WARNING: Could not find a specific ehcache configuration for cache named [com.liferay.portlet.messageboards.model.impl.MBMessageImpl]; using defaults.
    Nov 26, 2014 10:55:00 AM net.sf.ehcache.hibernate.EhCacheProvider buildCache
    WARNING: Could not find a specific ehcache configuration for cache named [com.liferay.portal.model.impl.ListTypeImpl]; using defaults.
    Nov 26, 2014 10:55:00 AM net.sf.ehcache.hibernate.EhCacheProvider buildCache
    WARNING: Could not find a specific ehcache configuration for cache named [com.liferay.portal.model.impl.EmailAddressImpl]; using defaults.
    Nov 26, 2014 10:55:00 AM net.sf.ehcache.hibernate.EhCacheProvider buildCache
    WARNING: Could not find a specific ehcache configuration for cache named [com.liferay.portal.model.impl.ImageImpl]; using defaults.
    Nov 26, 2014 10:55:00 AM net.sf.ehcache.hibernate.EhCacheProvider buildCache
    WARNING: Could not find a specific ehcache configuration for cache named [com.liferay.portal.model.impl.PasswordTrackerImpl]; using defaults.
    Nov 26, 2014 10:55:00 AM net.sf.ehcache.hibernate.EhCacheProvider buildCache
    WARNING: Could not find a specific ehcache configuration for cache named [com.liferay.portal.model.impl.AccountImpl]; using defaults.
    Nov 26, 2014 10:55:00 AM net.sf.ehcache.hibernate.EhCacheProvider buildCache
    WARNING: Could not find a specific ehcache configuration for cache named [com.liferay.portal.model.impl.WebsiteImpl]; using defaults.
    Nov 26, 2014 10:55:00 AM net.sf.ehcache.hibernate.EhCacheProvider buildCache
    WARNING: Could not find a specific ehcache configuration for cache named [com.liferay.portal.model.impl.ResourcePermissionImpl]; using defaults.
    Nov 26, 2014 10:55:00 AM net.sf.ehcache.hibernate.EhCacheProvider buildCache
    WARNING: Could not find a specific ehcache configuration for cache named [com.liferay.portlet.tags.model.impl.TagsPropertyImpl]; using defaults.
    Nov 26, 2014 10:55:00 AM net.sf.ehcache.hibernate.EhCacheProvider buildCache
    WARNING: Could not find a specific ehcache configuration for cache named [com.liferay.portlet.messageboards.model.impl.MBDiscussionImpl]; using defaults.
    Nov 26, 2014 10:55:00 AM net.sf.ehcache.hibernate.EhCacheProvider buildCache
    WARNING: Could not find a specific ehcache configuration for cache named [com.liferay.portlet.documentlibrary.model.impl.DLFileRankImpl]; using defaults.
    Nov 26, 2014 10:55:00 AM net.sf.ehcache.hibernate.EhCacheProvider buildCache
    WARNING: Could not find a specific ehcache configuration for cache named [com.liferay.portlet.calendar.model.impl.CalEventImpl]; using defaults.
    Nov 26, 2014 10:55:00 AM net.sf.ehcache.hibernate.EhCacheProvider buildCache
    WARNING: Could not find a specific ehcache configuration for cache named [com.liferay.portal.model.impl.PortletImpl]; using defaults.
    Nov 26, 2014 10:55:00 AM net.sf.ehcache.hibernate.EhCacheProvider buildCache
    WARNING: Could not find a specific ehcache configuration for cache named [com.liferay.portal.model.impl.ClassNameImpl]; using defaults.
    Nov 26, 2014 10:55:00 AM net.sf.ehcache.hibernate.EhCacheProvider buildCache
    WARNING: Could not find a specific ehcache configuration for cache named [com.liferay.portlet.tasks.model.impl.TasksProposalImpl]; using defaults.
    Nov 26, 2014 10:55:00 AM net.sf.ehcache.hibernate.EhCacheProvider buildCache
    WARNING: Could not find a specific ehcache configuration for cache named [com.liferay.portlet.expando.model.impl.ExpandoRowImpl]; using defaults.
    Nov 26, 2014 10:55:00 AM net.sf.ehcache.hibernate.EhCacheProvider buildCache
    WARNING: Could not find a specific ehcache configuration for cache named [com.liferay.portlet.ratings.model.impl.RatingsStatsImpl]; using defaults.
    Nov 26, 2014 10:55:00 AM net.sf.ehcache.hibernate.EhCacheProvider buildCache
    WARNING: Could not find a specific ehcache configuration for cache named [com.liferay.portlet.journal.model.impl.JournalTemplateImpl]; using defaults.
    Nov 26, 2014 10:55:00 AM net.sf.ehcache.hibernate.EhCacheProvider buildCache
    WARNING: Could not find a specific ehcache configuration for cache named [com.liferay.portal.model.impl.GroupImpl]; using defaults.
    Nov 26, 2014 10:55:00 AM net.sf.ehcache.hibernate.EhCacheProvider buildCache
    WARNING: Could not find a specific ehcache configuration for cache named [com.endeca.portal.liferay.ext.bookmarks.model.impl.DataSourceStateRecordImpl]; using defaults.
    Nov 26, 2014 10:55:00 AM net.sf.ehcache.hibernate.EhCacheProvider buildCache
    WARNING: Could not find a specific ehcache configuration for cache named [com.liferay.portlet.softwarecatalog.model.impl.SCProductEntryImpl]; using defaults.
    Nov 26, 2014 10:55:00 AM net.sf.ehcache.hibernate.EhCacheProvider buildCache
    WARNING: Could not find a specific ehcache configuration for cache named [com.liferay.portlet.tags.model.impl.TagsEntryImpl]; using defaults.
    Nov 26, 2014 10:55:00 AM net.sf.ehcache.hibernate.EhCacheProvider buildCache
    WARNING: Could not find a specific ehcache configuration for cache named [com.liferay.portlet.expando.model.impl.ExpandoColumnImpl]; using defaults.
    Nov 26, 2014 10:55:00 AM net.sf.ehcache.hibernate.EhCacheProvider buildCache
    WARNING: Could not find a specific ehcache configuration for cache named [com.liferay.portal.model.impl.UserGroupImpl]; using defaults.
    Nov 26, 2014 10:55:00 AM net.sf.ehcache.hibernate.EhCacheProvider buildCache
    WARNING: Could not find a specific ehcache configuration for cache named [com.liferay.portlet.messageboards.model.impl.MBMailingListImpl]; using defaults.
    Nov 26, 2014 10:55:00 AM net.sf.ehcache.hibernate.EhCacheProvider buildCache
    WARNING: Could not find a specific ehcache configuration for cache named [com.liferay.portal.model.impl.BrowserTrackerImpl]; using defaults.
    Nov 26, 2014 10:55:00 AM net.sf.ehcache.hibernate.EhCacheProvider buildCache
    WARNING: Could not find a specific ehcache configuration for cache named [com.liferay.portal.model.impl.PluginSettingImpl]; using defaults.
    Nov 26, 2014 10:55:00 AM net.sf.ehcache.hibernate.EhCacheProvider buildCache
    WARNING: Could not find a specific ehcache configuration for cache named [com.liferay.portlet.announcements.model.impl.AnnouncementsDeliveryImpl]; using defaults.
    Nov 26, 2014 10:55:00 AM net.sf.ehcache.hibernate.EhCacheProvider buildCache
    WARNING: Could not find a specific ehcache configuration for cache named [com.liferay.portal.model.impl.PermissionImpl]; using defaults.
    Nov 26, 2014 10:55:00 AM net.sf.ehcache.hibernate.EhCacheProvider buildCache
    WARNING: Could not find a specific ehcache configuration for cache named [com.liferay.portlet.softwarecatalog.model.impl.SCFrameworkVersionImpl]; using defaults.
    Nov 26, 2014 10:55:00 AM net.sf.ehcache.hibernate.EhCacheProvider buildCache
    WARNING: Could not find a specific ehcache configuration for cache named [com.liferay.portlet.expando.model.impl.ExpandoTableImpl]; using defaults.
    Nov 26, 2014 10:55:00 AM net.sf.ehcache.hibernate.EhCacheProvider buildCache
    WARNING: Could not find a specific ehcache configuration for cache named [com.liferay.portal.model.impl.ShardImpl]; using defaults.
    Nov 26, 2014 10:55:00 AM net.sf.ehcache.hibernate.EhCacheProvider buildCache
    WARNING: Could not find a specific ehcache configuration for cache named [com.liferay.portlet.tags.model.impl.TagsVocabularyImpl]; using defaults.
    Nov 26, 2014 10:55:00 AM net.sf.ehcache.hibernate.EhCacheProvider buildCache
    WARNING: Could not find a specific ehcache configuration for cache named [com.liferay.portlet.announcements.model.impl.AnnouncementsFlagImpl]; using defaults.
    Nov 26, 2014 10:55:00 AM net.sf.ehcache.hibernate.EhCacheProvider buildCache
    WARNING: Could not find a specific ehcache configuration for cache named [com.liferay.portal.model.impl.PhoneImpl]; using defaults.
    Nov 26, 2014 10:55:00 AM net.sf.ehcache.hibernate.EhCacheProvider buildCache
    WARNING: Could not find a specific ehcache configuration for cache named [com.liferay.portlet.messageboards.model.impl.MBMessageFlagImpl]; using defaults.
    Nov 26, 2014 10:55:00 AM net.sf.ehcache.hibernate.EhCacheProvider buildCache
    WARNING: Could not find a specific ehcache configuration for cache named [com.liferay.portlet.journal.model.impl.JournalContentSearchImpl]; using defaults.
    Nov 26, 2014 10:55:00 AM net.sf.ehcache.hibernate.EhCacheProvider buildCache
    WARNING: Could not find a specific ehcache configuration for cache named [com.liferay.portlet.documentlibrary.model.impl.DLFileShortcutImpl]; using defaults.
    Nov 26, 2014 10:55:00 AM net.sf.ehcache.hibernate.EhCacheProvider buildCache
    WARNING: Could not find a specific ehcache configuration for cache named [com.liferay.portlet.documentlibrary.model.impl.DLFileVersionImpl]; using defaults.
    Nov 26, 2014 10:55:00 AM net.sf.ehcache.hibernate.EhCacheProvider buildCache
    WARNING: Could not find a specific ehcache configuration for cache named [com.liferay.portal.model.impl.CountryImpl]; using defaults.
    Nov 26, 2014 10:55:00 AM net.sf.ehcache.hibernate.EhCacheProvider buildCache
    WARNING: Could not find a specific ehcache configuration for cache named [com.liferay.portlet.softwarecatalog.model.impl.SCProductVersionImpl]; using defaults.
    Nov 26, 2014 10:55:00 AM net.sf.ehcache.hibernate.EhCacheProvider buildCache
    WARNING: Could not find a specific ehcache configuration for cache named [com.liferay.portal.model.impl.ResourceCodeImpl]; using defaults.
    Nov 26, 2014 10:55:00 AM net.sf.ehcache.hibernate.EhCacheProvider buildCache
    WARNING: Could not find a specific ehcache configuration for cache named [com.liferay.portal.model.impl.ContactImpl]; using defaults.
    Nov 26, 2014 10:55:00 AM net.sf.ehcache.hibernate.EhCacheProvider buildCache
    WARNING: Could not find a specific ehcache configuration for cache named [com.liferay.portal.model.impl.UserTrackerImpl]; using defaults.
    Nov 26, 2014 10:55:00 AM net.sf.ehcache.hibernate.EhCacheProvider buildCache
    WARNING: Could not find a specific ehcache configuration for cache named [com.liferay.portlet.messageboards.model.impl.MBCategoryImpl]; using defaults.
    Nov 26, 2014 10:55:00 AM net.sf.ehcache.hibernate.EhCacheProvider buildCache
    WARNING: Could not find a specific ehcache configuration for cache named [com.liferay.portal.model.impl.ResourceActionImpl]; using defaults.
    Nov 26, 2014 10:55:00 AM net.sf.ehcache.hibernate.EhCacheProvider buildCache
    WARNING: Could not find a specific ehcache configuration for cache named [com.liferay.portlet.messageboards.model.impl.MBBanImpl]; using defaults.
    Nov 26, 2014 10:55:00 AM net.sf.ehcache.hibernate.EhCacheProvider buildCache
    WARNING: Could not find a specific ehcache configuration for cache named [com.liferay.portal.model.impl.RegionImpl]; using defaults.
    Nov 26, 2014 10:55:00 AM net.sf.ehcache.hibernate.EhCacheProvider buildCache
    WARNING: Could not find a specific ehcache configuration for cache named [com.liferay.portal.model.impl.UserTrackerPathImpl]; using defaults.
    Nov 26, 2014 10:55:00 AM net.sf.ehcache.hibernate.EhCacheProvider buildCache
    WARNING: Could not find a specific ehcache configuration for cache named [com.liferay.portlet.documentlibrary.model.impl.DLFolderImpl]; using defaults.
    Nov 26, 2014 10:55:01 AM net.sf.ehcache.hibernate.EhCacheProvider buildCache
    WARNING: Could not find a specific ehcache configuration for cache named [org.hibernate.cache.StandardQueryCache]; using defaults.
    Loading zip:/home/oracle/Ext/Oracle/Middleware/user_projects/domains/endeca_domain/servers/StudioManagedServer/stage/studio-portal/studio-portal/endeca-portal/WEB-INF/lib/portal-impl.jar!/captcha.properties
    2014-11-26 10:55:03,071 INFO  [PortalImpl] Portal lib directory /home/oracle/Ext/Oracle/Middleware/user_projects/domains/endeca_domain/servers/StudioManagedServer/stage/studio-portal/studio-portal/endeca-portal/WEB-INF/lib/
    Nov 26, 2014 10:55:11 AM org.quartz.core.QuartzScheduler <init>
    INFO: Quartz Scheduler v.1.6.0 created.
    Nov 26, 2014 10:55:11 AM org.quartz.impl.jdbcjobstore.JobStoreSupport initialize
    INFO: Using thread monitor-based data access locking (synchronization).
    2014-11-26 10:55:11,307 INFO  [DBUtil] Using dialect org.hibernate.dialect.Oracle10gDialect
    Nov 26, 2014 10:55:11 AM org.quartz.impl.jdbcjobstore.JobStoreSupport cleanVolatileTriggerAndJobs
    INFO: Removed 0 Volatile Trigger(s).
    Nov 26, 2014 10:55:11 AM org.quartz.impl.jdbcjobstore.JobStoreSupport cleanVolatileTriggerAndJobs
    INFO: Removed 0 Volatile Job(s).
    Nov 26, 2014 10:55:11 AM org.quartz.impl.jdbcjobstore.JobStoreTX initialize
    INFO: JobStoreTX initialized.
    Nov 26, 2014 10:55:11 AM org.quartz.impl.StdSchedulerFactory instantiate
    INFO: Quartz scheduler 'QuartzSchedulerEngineInstance' initialized from an externally provided properties instance.
    Nov 26, 2014 10:55:11 AM org.quartz.impl.StdSchedulerFactory instantiate
    INFO: Quartz scheduler version: 1.6.0
    Nov 26, 2014 10:55:11 AM org.quartz.core.QuartzScheduler <init>
    INFO: Quartz Scheduler v.1.6.0 created.
    Nov 26, 2014 10:55:11 AM org.quartz.simpl.RAMJobStore initialize
    INFO: RAMJobStore initialized.
    Nov 26, 2014 10:55:11 AM org.quartz.impl.StdSchedulerFactory instantiate
    INFO: Quartz scheduler 'org.springframework.scheduling.quartz.SchedulerFactoryBean#1ce2e307' initialized from an externally provided properties instance.
    Nov 26, 2014 10:55:11 AM org.quartz.impl.StdSchedulerFactory instantiate
    INFO: Quartz scheduler version: 1.6.0
    Nov 26, 2014 10:55:11 AM org.quartz.core.QuartzScheduler setJobFactory
    INFO: JobFactory set to: [email protected]9
    Nov 26, 2014 10:55:11 AM org.quartz.core.QuartzScheduler start
    INFO: Scheduler org.springframework.scheduling.quartz.SchedulerFactoryBean#1ce2e307_$_NON_CLUSTERED started.
    2014-11-26 10:55:11,833 INFO  [ServerDetector] Detected server weblogic
    Nov 26, 2014 10:55:16 AM com.sun.portal.container.service.ServiceManagerContextListenerImpl contextInitialized
    INFO: PSC_CSPCS001 : Started initializing ServiceManager
    Nov 26, 2014 10:55:16 AM com.sun.portal.container.service.ServiceManager addService
    INFO: PSC_CSPCS004 : Service added, Name: com.sun.portal.container.service.CoordinationService, Implementation: com.sun.portal.container.service.coordination.impl.CoordinationServiceImpl
    Nov 26, 2014 10:55:16 AM com.sun.portal.container.service.ServiceManager addService
    INFO: PSC_CSPCS004 : Service added, Name: com.sun.portal.container.service.CachingService, Implementation: com.sun.portal.container.service.caching.impl.CachingServiceImpl
    Nov 26, 2014 10:55:16 AM com.sun.portal.container.service.ServiceManager addService
    INFO: PSC_CSPCS004 : Service added, Name: com.sun.portal.container.service.ClientCachingService, Implementation: com.sun.portal.container.service.caching.impl.ClientCachingServiceImpl
    Nov 26, 2014 10:55:16 AM com.sun.portal.container.service.ServiceManager addService
    INFO: PSC_CSPCS004 : Service added, Name: com.sun.portal.container.service.DeploymentService_Local, Implementation: com.sun.portal.container.service.deployment.impl.DeploymentServiceLocalImpl
    Nov 26, 2014 10:55:16 AM com.sun.portal.container.service.ServiceManager addService
    INFO: PSC_CSPCS004 : Service added, Name: com.sun.portal.container.service.ContainerEventService, Implementation: com.sun.portal.container.service.coordination.impl.ContainerEventServiceImpl
    Nov 26, 2014 10:55:16 AM com.sun.portal.container.service.ServiceManager addService
    INFO: PSC_CSPCS004 : Service added, Name: com.sun.portal.container.service.PolicyService, Implementation: com.liferay.portal.portletcontainer.PolicyServiceImpl
    Nov 26, 2014 10:55:16 AM com.sun.portal.container.service.ServiceManagerContextListenerImpl contextInitialized
    INFO: PSC_CSPCS002 : Finished initializing ServiceManager
    Nov 26, 2014 10:55:16 AM com.sun.portal.portletcontainer.impl.PortletContainerContextListenerImpl contextInitialized
    INFO: PSPL_PCCSPCPCI0003 : Starting PortletContainer 2.1
    Nov 26, 2014 10:55:17 AM org.apache.struts.tiles.TilesPlugin initDefinitionsFactory
    INFO: Tiles definition factory loaded for module ''.
    Starting Oracle Endeca Information Discovery Studio 3.0 (Cupcake / Build 30017631 / Mon, 7 Jul 2014 06:40:33 -0400)
    Nov 26, 2014 10:55:19 AM org.quartz.impl.jdbcjobstore.JobStoreSupport recoverJobs
    INFO: Freed 0 triggers from 'acquired' / 'blocked' state.
    Nov 26, 2014 10:55:19 AM org.quartz.impl.jdbcjobstore.JobStoreSupport recoverJobs
    INFO: Recovering 0 jobs that were in-progress at the time of the last shut-down.
    Nov 26, 2014 10:55:19 AM org.quartz.impl.jdbcjobstore.JobStoreSupport recoverJobs
    INFO: Recovery complete.
    Nov 26, 2014 10:55:19 AM org.quartz.impl.jdbcjobstore.JobStoreSupport recoverJobs
    INFO: Removed 0 'complete' triggers.
    Nov 26, 2014 10:55:19 AM org.quartz.impl.jdbcjobstore.JobStoreSupport recoverJobs
    INFO: Removed 0 stale fired job entries.
    Nov 26, 2014 10:55:19 AM org.quartz.core.QuartzScheduler start
    INFO: Scheduler QuartzSchedulerEngineInstance_$_NON_CLUSTERED started.
    2014-11-26 10:55:22,438 WARN  [SpriteProcessorImpl] Unable to process /home/oracle/Ext/Oracle/Middleware/user_projects/domains/endeca_domain/servers/StudioManagedServer/stage/studio-portal/studio-portal/endeca-portal/html/icons/ext/boxy-ne.png
    2014-11-26 10:55:22,438 WARN  [SpriteProcessorImpl] Unable to process /home/oracle/Ext/Oracle/Middleware/user_projects/domains/endeca_domain/servers/StudioManagedServer/stage/studio-portal/studio-portal/endeca-portal/html/icons/ext/boxy-nw.png
    2014-11-26 10:55:22,438 WARN  [SpriteProcessorImpl] Unable to process /home/oracle/Ext/Oracle/Middleware/user_projects/domains/endeca_domain/servers/StudioManagedServer/stage/studio-portal/studio-portal/endeca-portal/html/icons/ext/boxy-se.png
    2014-11-26 10:55:22,438 WARN  [SpriteProcessorImpl] Unable to process /home/oracle/Ext/Oracle/Middleware/user_projects/domains/endeca_domain/servers/StudioManagedServer/stage/studio-portal/studio-portal/endeca-portal/html/icons/ext/boxy-sw.png
    2014-11-26 10:55:22,439 WARN  [SpriteProcessorImpl] Unable to process /home/oracle/Ext/Oracle/Middleware/user_projects/domains/endeca_domain/servers/StudioManagedServer/stage/studio-portal/studio-portal/endeca-portal/html/icons/loan_calculator.png
    2014-11-26 10:55:22,439 WARN  [SpriteProcessorImpl] Unable to process /home/oracle/Ext/Oracle/Middleware/user_projects/domains/endeca_domain/servers/StudioManagedServer/stage/studio-portal/studio-portal/endeca-portal/html/icons/message_boards.png
    2014-11-26 10:55:22,439 WARN  [SpriteProcessorImpl] Unable to process /home/oracle/Ext/Oracle/Middleware/user_projects/domains/endeca_domain/servers/StudioManagedServer/stage/studio-portal/studio-portal/endeca-portal/html/icons/image_gallery.png
    2014-11-26 10:55:22,440 WARN  [SpriteProcessorImpl] Unable to process /home/oracle/Ext/Oracle/Middleware/user_projects/domains/endeca_domain/servers/StudioManagedServer/stage/studio-portal/studio-portal/endeca-portal/html/icons/polls_display.png
    2014-11-26 10:55:22,440 WARN  [SpriteProcessorImpl] Unable to process /home/oracle/Ext/Oracle/Middleware/user_projects/domains/endeca_domain/servers/StudioManagedServer/stage/studio-portal/studio-portal/endeca-portal/html/icons/search.png
    2014-11-26 10:55:22,440 WARN  [SpriteProcessorImpl] Unable to process /home/oracle/Ext/Oracle/Middleware/user_projects/domains/endeca_domain/servers/StudioManagedServer/stage/studio-portal/studio-portal/endeca-portal/html/icons/login.png
    2014-11-26 10:55:22,440 WARN  [SpriteProcessorImpl] Unable to process /home/oracle/Ext/Oracle/Middleware/user_projects/domains/endeca_domain/servers/StudioManagedServer/stage/studio-portal/studio-portal/endeca-portal/html/icons/page_ratings.png
    2014-11-26 10:55:22,440 WARN  [SpriteProcessorImpl] Unable to process /home/oracle/Ext/Oracle/Middleware/user_projects/domains/endeca_domain/servers/StudioManagedServer/stage/studio-portal/studio-portal/endeca-portal/html/icons/rss.png
    2014-11-26 10:55:22,441 WARN  [SpriteProcessorImpl] Unable to process /home/oracle/Ext/Oracle/Middleware/user_projects/domains/endeca_domain/servers/StudioManagedServer/stage/studio-portal/studio-portal/endeca-portal/html/icons/blogs_aggregator.png
    2014-11-26 10:55:22,441 WARN  [SpriteProcessorImpl] Unable to process /home/oracle/Ext/Oracle/Middleware/user_projects/domains/endeca_domain/servers/StudioManagedServer/stage/studio-portal/studio-portal/endeca-portal/html/icons/recent_documents.png
    2014-11-26 10:55:22,441 WARN  [SpriteProcessorImpl] Unable to process /home/oracle/Ext/Oracle/Middleware/user_projects/domains/endeca_domain/servers/StudioManagedServer/stage/studio-portal/studio-portal/endeca-portal/html/icons/recent_bloggers.png
    2014-11-26 10:55:22,441 WARN  [SpriteProcessorImpl] Unable to process /home/oracle/Ext/Oracle/Middleware/user_projects/domains/endeca_domain/servers/StudioManagedServer/stage/studio-portal/studio-portal/endeca-portal/html/icons/bible_gateway.png
    2014-11-26 10:55:22,441 WARN  [SpriteProcessorImpl] Unable to process /home/oracle/Ext/Oracle/Middleware/user_projects/domains/endeca_domain/servers/StudioManagedServer/stage/studio-portal/studio-portal/endeca-portal/html/icons/default.png
    2014-11-26 10:55:22,441 WARN  [SpriteProcessorImpl] Unable to process /home/oracle/Ext/Oracle/Middleware/user_projects/domains/endeca_domain/servers/StudioManagedServer/stage/studio-portal/studio-portal/endeca-portal/html/icons/calendar.png
    2014-11-26 10:55:22,442 WARN  [SpriteProcessorImpl] Unable to process /home/oracle/Ext/Oracle/Middleware/user_projects/domains/endeca_domain/servers/StudioManagedServer/stage/studio-portal/studio-portal/endeca-portal/html/icons/currency_converter.png
    2014-11-26 10:55:22,442 WARN  [SpriteProcessorImpl] Unable to process /home/oracle/Ext/Oracle/Middleware/user_projects/domains/endeca_domain/servers/StudioManagedServer/stage/studio-portal/studio-portal/endeca-portal/html/icons/blogs.png
    2014-11-26 10:55:22,442 WARN  [SpriteProcessorImpl] Unable to process /home/oracle/Ext/Oracle/Middleware/user_projects/domains/endeca_domain/servers/StudioManagedServer/stage/studio-portal/studio-portal/endeca-portal/html/icons/refresh-icon.png
    2014-11-26 10:55:22,442 WARN  [SpriteProcessorImpl] Unable to process /home/oracle/Ext/Oracle/Middleware/user_projects/domains/endeca_domain/servers/StudioManagedServer/stage/studio-portal/studio-portal/endeca-portal/html/icons/random_bible_verse.png
    2014-11-26 10:55:22,442 WARN  [SpriteProcessorImpl] Unable to process /home/oracle/Ext/Oracle/Middleware/user_projects/domains/endeca_domain/servers/StudioManagedServer/stage/studio-portal/studio-portal/endeca-portal/html/icons/quick_note.png
    2014-11-26 10:55:22,443 WARN  [SpriteProcessorImpl] Unable to process /home/oracle/Ext/Oracle/Middleware/user_projects/domains/endeca_domain/servers/StudioManagedServer/stage/studio-portal/studio-portal/endeca-portal/html/icons/announcements.png
    2014-11-26 10:55:22,443 WARN  [SpriteProcessorImpl] Unable to process /home/oracle/Ext/Oracle/Middleware/user_projects/domains/endeca_domain/servers/StudioManagedServer/stage/studio-portal/studio-portal/endeca-portal/html/icons/polls.png
    2014-11-26 10:55:22,443 WARN  [SpriteProcessorImpl] Unable to process /home/oracle/Ext/Oracle/Middleware/user_projects/domains/endeca_domain/servers/StudioManagedServer/stage/studio-portal/studio-portal/endeca-portal/html/icons/communities.png
    2014-11-26 10:55:23,062 WARN  [SpriteProcessorImpl] Unable to process /home/oracle/Ext/Oracle/Middleware/user_projects/domains/endeca_domain/servers/StudioManagedServer/stage/studio-portal/studio-portal/endeca-portal/html/themes/classic/images/common/Oracle_logo.png
    2014-11-26 10:55:23,065 WARN  [SpriteProcessorImpl] Unable to process /home/oracle/Ext/Oracle/Middleware/user_projects/domains/endeca_domain/servers/StudioManagedServer/stage/studio-portal/studio-portal/endeca-portal/html/themes/classic/images/dock/welcome_arrows.png
    2014-11-26 10:55:23,065 WARN  [SpriteProcessorImpl] Unable to process /home/oracle/Ext/Oracle/Middleware/user_projects/domains/endeca_domain/servers/StudioManagedServer/stage/studio-portal/studio-portal/endeca-portal/html/themes/classic/images/dock/center_bg.png
    2014-11-26 10:55:23,069 WARN  [SpriteProcessorImpl] Unable to process /home/oracle/Ext/Oracle/Middleware/user_projects/domains/endeca_domain/servers/StudioManagedServer/stage/studio-portal/studio-portal/endeca-portal/html/themes/classic/images/portlet/restore.png
    2014-11-26 10:55:23,070 WARN  [SpriteProcessorImpl] Unable to process /home/oracle/Ext/Oracle/Middleware/user_projects/domains/endeca_domain/servers/StudioManagedServer/stage/studio-portal/studio-portal/endeca-portal/html/themes/classic/images/portlet/minimize.png
    2014-11-26 10:55:23,070 WARN  [SpriteProcessorImpl] Unable to process /home/oracle/Ext/Oracle/Middleware/user_projects/domains/endeca_domain/servers/StudioManagedServer/stage/studio-portal/studio-portal/endeca-portal/html/themes/classic/images/portlet/options.png
    2014-11-26 10:55:23,071 WARN  [SpriteProcessorImpl] Unable to process /home/oracle/Ext/Oracle/Middleware/user_projects/domains/endeca_domain/servers/StudioManagedServer/stage/studio-portal/studio-portal/endeca-portal/html/themes/classic/images/portlet/maximize.png
    2014-11-26 10:55:23,071 WARN  [SpriteProcessorImpl] Unable to process /home/oracle/Ext/Oracle/Middleware/user_projects/domains/endeca_domain/servers/StudioManagedServer/stage/studio-portal/studio-portal/endeca-portal/html/themes/classic/images/portlet/options_selected.png
    2014-11-26 10:55:23,072 WARN  [SpriteProcessorImpl] Unable to process /home/oracle/Ext/Oracle/Middleware/user_projects/domains/endeca_domain/servers/StudioManagedServer/stage/studio-portal/studio-portal/endeca-portal/html/themes/classic/images/portlet/close.png
    2014-11-26 10:55:23,073 WARN  [SpriteProcessorImpl] Unable to process /home/oracle/Ext/Oracle/Middleware/user_projects/domains/endeca_domain/servers/StudioManagedServer/stage/studio-portal/studio-portal/endeca-portal/html/themes/classic/images/close_modal.png
    2014-11-26 10:55:23,074 WARN  [SpriteProcessorImpl] Unable to process /home/oracle/Ext/Oracle/Middleware/user_projects/domains/endeca_domain/servers/StudioManagedServer/stage/studio-portal/studio-portal/endeca-portal/html/themes/classic/images/generic-blue-heading.png
    2014-11-26 10:55:23,074 WARN  [SpriteProcessorImpl] Unable to process /home/oracle/Ext/Oracle/Middleware/user_projects/domains/endeca_domain/servers/StudioManagedServer/stage/studio-portal/studio-portal/endeca-portal/html/themes/classic/images/page-background-gradient.png
    2014-11-26 10:55:23,075 WARN  [SpriteProcessorImpl] Unable to process /home/oracle/Ext/Oracle/Middleware/user_projects/domains/endeca_domain/servers/StudioManagedServer/stage/studio-portal/studio-portal/endeca-portal/html/themes/classic/images/generic-orange-heading.png
    2014-11-26 10:55:23,080 WARN  [SpriteProcessorImpl] Unable to process /home/oracle/Ext/Oracle/Middleware/user_projects/domains/endeca_domain/servers/StudioManagedServer/stage/studio-portal/studio-portal/endeca-portal/html/themes/control_panel/images/common/Oracle_logo.png
    2014-11-26 10:55:23,083 WARN  [SpriteProcessorImpl] Unable to process /home/oracle/Ext/Oracle/Middleware/user_projects/domains/endeca_domain/servers/StudioManagedServer/stage/studio-portal/studio-portal/endeca-portal/html/themes/control_panel/images/portlet/restore.png
    2014-11-26 10:55:23,084 WARN  [SpriteProcessorImpl] Unable to process /home/oracle/Ext/Oracle/Middleware/user_projects/domains/endeca_domain/servers/StudioManagedServer/stage/studio-portal/studio-portal/endeca-portal/html/themes/control_panel/images/portlet/options_selected.png
    2014-11-26 10:55:23,084 WARN  [SpriteProcessorImpl] Unable to process /home/oracle/Ext/Oracle/Middleware/user_projects/domains/endeca_domain/servers/StudioManagedServer/stage/studio-portal/studio-portal/endeca-portal/html/themes/control_panel/images/portlet/options.png
    2014-11-26 10:55:23,085 WARN  [SpriteProcessorImpl] Unable to process /home/oracle/Ext/Oracle/Middleware/user_projects/domains/endeca_domain/servers/StudioManagedServer/stage/studio-portal/studio-portal/endeca-portal/html/themes/control_panel/images/portlet/minimize.png
    2014-11-26 10:55:23,085 WARN  [SpriteProcessorImpl] Unable to process /home/oracle/Ext/Oracle/Middleware/user_projects/domains/endeca_domain/servers/StudioManagedServer/stage/studio-portal/studio-portal/endeca-portal/html/themes/control_panel/images/portlet/close.png
    2014-11-26 10:55:23,086 WARN  [SpriteProcessorImpl] Unable to process /home/oracle/Ext/Oracle/Middleware/user_projects/domains/endeca_domain/servers/StudioManagedServer/stage/studio-portal/studio-portal/endeca-portal/html/themes/control_panel/images/portlet/maximize.png
    2014-11-26 10:55:23,088 WARN  [SpriteProcessorImpl] Unable to process /home/oracle/Ext/Oracle/Middleware/user_projects/domains/endeca_domain/servers/StudioManagedServer/stage/studio-portal/studio-portal/endeca-portal/html/themes/control_panel/images/dock/welcome_arrows.png
    2014-11-26 10:55:23,088 WARN  [SpriteProcessorImpl] Unable to process /home/oracle/Ext/Oracle/Middleware/user_projects/domains/endeca_domain/servers/StudioManagedServer/stage/studio-portal/studio-portal/endeca-portal/html/themes/control_panel/images/dock/center_bg.png
    2014-11-26 10:55:23,094 WARN  [SpriteProcessorImpl] Unable to process /home/oracle/Ext/Oracle/Middleware/user_projects/domains/endeca_domain/servers/StudioManagedServer/stage/studio-portal/studio-portal/endeca-portal/html/themes/control_panel/images/close_modal.png
    2014-11-26 10:55:23,095 WARN  [SpriteProcessorImpl] Unable to process /home/oracle/Ext/Oracle/Middleware/user_projects/domains/endeca_domain/servers/StudioManagedServer/stage/studio-portal/studio-portal/endeca-portal/html/themes/control_panel/images/page-background-gradient.png
    2014-11-26 10:55:23,095 WARN  [SpriteProcessorImpl] Unable to process /home/oracle/Ext/Oracle/Middleware/user_projects/domains/endeca_domain/servers/StudioManagedServer/stage/studio-portal/studio-portal/endeca-portal/html/themes/control_panel/images/generic-blue-heading.png
    2014-11-26 10:55:23,096 WARN  [SpriteProcessorImpl] Unable to process /home/oracle/Ext/Oracle/Middleware/user_projects/domains/endeca_domain/servers/StudioManagedServer/stage/studio-portal/studio-portal/endeca-portal/html/themes/control_panel/images/generic-orange-heading.png
    2014-11-26 10:55:23,102 WARN  [SpriteProcessorImpl] Unable to process /home/oracle/Ext/Oracle/Middleware/user_projects/domains/endeca_domain/servers/StudioManagedServer/stage/studio-portal/studio-portal/endeca-portal/html/themes/landing_page/images/portlet/close.png
    2014-11-26 10:55:23,103 WARN  [SpriteProcessorImpl] Unable to process /home/oracle/Ext/Oracle/Middleware/user_projects/domains/endeca_domain/servers/StudioManagedServer/stage/studio-portal/studio-portal/endeca-portal/html/themes/landing_page/images/portlet/options_selected.png
    2014-11-26 10:55:23,104 WARN  [SpriteProcessorImpl] Unable to process /home/oracle/Ext/Oracle/Middleware/user_projects/domains/endeca_domain/servers/StudioManagedServer/stage/studio-portal/studio-portal/endeca-portal/html/themes/landing_page/images/portlet/options.png
    2014-11-26 10:55:23,104 WARN  [SpriteProcessorImpl] Unable to process /home/oracle/Ext/Oracle/Middleware/user_projects/domains/endeca_domain/servers/StudioManagedServer/stage/studio-portal/studio-portal/endeca-portal/html/themes/landing_page/images/portlet/minimize.png
    2014-11-26 10:55:23,104 WARN  [SpriteProcessorImpl] Unable to process /home/oracle/Ext/Oracle/Middleware/user_projects/domains/endeca_domain/servers/StudioManagedServer/stage/studio-portal/studio-portal/endeca-portal/html/themes/landing_page/images/portlet/maximize.png
    2014-11-26 10:55:23,105 WARN  [SpriteProcessorImpl] Unable to process /home/oracle/Ext/Oracle/Middleware/user_projects/domains/endeca_domain/servers/StudioManagedServer/stage/studio-portal/studio-portal/endeca-portal/html/themes/landing_page/images/portlet/restore.png
    2014-11-26 10:55:23,112 WARN  [SpriteProcessorImpl] Unable to process /home/oracle/Ext/Oracle/Middleware/user_projects/domains/endeca_domain/servers/StudioManagedServer/stage/studio-portal/studio-portal/endeca-portal/html/themes/landing_page/images/common/Oracle_logo.png
    2014-11-26 10:55:23,114 WARN  [SpriteProcessorImpl] Unable to process /home/oracle/Ext/Oracle/Middleware/user_projects/domains/endeca_domain/servers/StudioManagedServer/stage/studio-portal/studio-portal/endeca-portal/html/themes/landing_page/images/dock/welcome_arrows.png
    2014-11-26 10:55:23,114 WARN  [SpriteProcessorImpl] Unable to process /home/oracle/Ext/Oracle/Middleware/user_projects/domains/endeca_domain/servers/StudioManagedServer/stage/studio-portal/studio-portal/endeca-portal/html/themes/landing_page/images/dock/center_bg.png
    2014-11-26 10:55:23,115 WARN  [SpriteProcessorImpl] Unable to process /home/oracle/Ext/Oracle/Middleware/user_projects/domains/endeca_domain/servers/StudioManagedServer/stage/studio-portal/studio-portal/endeca-portal/html/themes/landing_page/images/generic-blue-heading.png
    2014-11-26 10:55:23,116 WARN  [SpriteProcessorImpl] Unable to process /home/oracle/Ext/Oracle/Middleware/user_projects/domains/endeca_domain/servers/StudioManagedServer/stage/studio-portal/studio-portal/endeca-portal/html/themes/landing_page/images/generic-orange-heading.png
    2014-11-26 10:55:23,116 WARN  [SpriteProcessorImpl] Unable to process /home/oracle/Ext/Oracle/Middleware/user_projects/domains/endeca_domain/servers/StudioManagedServer/stage/studio-portal/studio-portal/endeca-portal/html/themes/landing_page/images/close_modal.png
    2014-11-26 10:55:23,116 WARN  [SpriteProcessorImpl] Unable to process /home/oracle/Ext/Oracle/Middleware/user_projects/domains/endeca_domain/servers/StudioManagedServer/stage/studio-portal/studio-portal/endeca-portal/html/themes/landing_page/images/page-background-gradient.png
    2014-11-26 10:55:23,428 INFO  [HotDeployUtil] Initializing hot deploy manager 642389332
    2014-11-26 10:55:23,533 ERROR [PortletAutoDeployer]
    java.io.FileNotFoundException: /tmp/liferay/com/liferay/portal/deploy/dependencies/liferay-portlet.tld (Too many open files)
        at java.io.FileOutputStream.open(Native Method)
        at java.io.FileOutputStream.<init>(FileOutputStream.java:194)
        at java.io.FileOutputStream.<init>(FileOutputStream.java:145)
        at com.liferay.portal.deploy.DeployUtil._getResourcePath(DeployUtil.java:160)
        at com.liferay.portal.deploy.DeployUtil.getResourcePath(DeployUtil.java:93)
        at com.liferay.portal.deploy.auto.PortletAutoDeployer.<init>(PortletAutoDeployer.java:56)
        at com.liferay.portal.deploy.auto.PortletAutoDeployListener.<init>(PortletAutoDeployListener.java:43)
        at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
        at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:39)
        at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:27)
        at java.lang.reflect.Constructor.newInstance(Constructor.java:513)
        at java.lang.Class.newInstance0(Class.java:357)
        at java.lang.Class.newInstance(Class.java:310)
        at com.liferay.portal.events.GlobalStartupAction.getAutoDeployListeners(GlobalStartupAction.java:70)
        at com.liferay.portal.events.GlobalStartupAction.run(GlobalStartupAction.java:145)
        at com.liferay.portal.events.EventsProcessorImpl.processEvent(EventsProcessorImpl.java:117)
        at com.liferay.portal.events.EventsProcessorImpl.process(EventsProcessorImpl.java:69)
        at com.liferay.portal.events.EventsProcessorUtil.process(EventsProcessorUtil.java:43)
        at com.liferay.portal.servlet.MainServlet.init(MainServlet.java:415)
        at javax.servlet.GenericServlet.init(GenericServlet.java:241)
        at weblogic.servlet.internal.StubSecurityHelper$ServletInitAction.run(StubSecurityHelper.java:283)
        at weblogic.security.acl.internal.AuthenticatedSubject.doAs(AuthenticatedSubject.java:321)
        at weblogic.security.service.SecurityManager.runAs(SecurityManager.java:120)
        at weblogic.servlet.internal.StubSecurityHelper.createServlet(StubSecurityHelper.java:64)
        at weblogic.servlet.internal.StubLifecycleHelper.createOneInstance(StubLifecycleHelper.java:58)
        at weblogic.servlet.internal.StubLifecycleHelper.<init>(StubLifecycleHelper.java:48)
        at weblogic.servlet.internal.ServletStubImpl.prepareServlet(ServletStubImpl.java:539)
        at weblogic.servlet.internal.WebAppServletContext.preloadServlet(WebAppServletContext.java:1981)
        at weblogic.servlet.internal.WebAppServletContext.loadServletsOnStartup(WebAppServletContext.java:1955)
        at weblogic.servlet.internal.WebAppServletContext.preloadResources(WebAppServletContext.java:1874)
        at weblogic.servlet.internal.WebAppServletContext.start(WebAppServletContext.java:3154)
        at weblogic.servlet.internal.WebAppModule.startContexts(WebAppModule.java:1518)
        at weblogic.servlet.internal.WebAppModule.start(WebAppModule.java:484)
        at weblogic.application.internal.flow.ModuleStateDriver$3.next(ModuleStateDriver.java:425)
        at weblogic.application.utils.StateMachineDriver.nextState(StateMachineDriver.java:52)
        at weblogic.application.internal.flow.ModuleStateDriver.start(ModuleStateDriver.java:119)
        at weblogic.application.internal.flow.ScopedModuleDriver.start(ScopedModuleDriver.java:200)
        at weblogic.application.internal.flow.ModuleListenerInvoker.start(ModuleListenerInvoker.java:247)
        at weblogic.application.internal.flow.ModuleStateDriver$3.next(ModuleStateDriver.java:425)
        at weblogic.application.utils.StateMachineDriver.nextState(StateMachineDriver.java:52)
        at weblogic.application.internal.flow.ModuleStateDriver.start(ModuleStateDriver.java:119)
        at weblogic.application.internal.flow.StartModulesFlow.activate(StartModulesFlow.java:27)
        at weblogic.application.internal.BaseDeployment$2.next(BaseDeployment.java:671)
        at weblogic.application.utils.StateMachineDriver.nextState(StateMachineDriver.java:52)
        at weblogic.application.internal.BaseDeployment.activate(BaseDeployment.java:212)
        at weblogic.application.internal.EarDeployment.activate(EarDeployment.java:59)
        at weblogic.application.internal.DeploymentStateChecker.activate(DeploymentStateChecker.java:161)
        at weblogic.deploy.internal.targetserver.AppContainerInvoker.activate(AppContainerInvoker.java:79)
        at weblogic.deploy.internal.targetserver.BasicDeployment.activate(BasicDeployment.java:184)
        at weblogic.deploy.internal.targetserver.BasicDeployment.activateFromServerLifecycle(BasicDeployment.java:361)
        at weblogic.management.deploy.internal.DeploymentAdapter$1.doActivate(DeploymentAdapter.java:51)
        at weblogic.management.deploy.internal.DeploymentAdapter.activate(DeploymentAdapter.java:200)
        at weblogic.management.deploy.internal.AppTransition$2.transitionApp(AppTransition.java:30)
        at weblogic.management.deploy.internal.ConfiguredDeployments.transitionApps(ConfiguredDeployments.java:240)
        at weblogic.management.deploy.internal.ConfiguredDeployments.activate(ConfiguredDeployments.java:169)
        at weblogic.management.deploy.internal.ConfiguredDeployments.deploy(ConfiguredDeployments.java:123)
        at weblogic.management.deploy.internal.DeploymentServerService.resume(DeploymentServerService.java:180)
        at weblogic.management.deploy.internal.DeploymentServerService.start(DeploymentServerService.java:96)
        at weblogic.t3.srvr.SubsystemRequest.run(SubsystemRequest.java:64)
        at weblogic.work.ExecuteThread.execute(ExecuteThread.java:256)
        at weblogic.work.ExecuteThread.run(ExecuteThread.java:221)
    2014-11-26 10:55:23,545 ERROR [ThemeAutoDeployer]
    java.io.FileNotFoundException: /tmp/liferay/com/liferay/portal/deploy/dependencies/liferay-theme.tld (Too many open files)
        at java.io.FileOutputStream.open(Native Method)
        at java.io.FileOutputStream.<init>(FileOutputStream.java:194)
        at java.io.FileOutputStream.<init>(FileOutputStream.java:145)
        at com.liferay.portal.deploy.DeployUtil._getResourcePath(DeployUtil.java:160)
        at com.liferay.portal.deploy.DeployUtil.getResourcePath(DeployUtil.java:93)
        at com.liferay.portal.deploy.auto.ThemeAutoDeployer.<init>(ThemeAutoDeployer.java:55)
        at com.liferay.portal.deploy.auto.ThemeAutoDeployListener.<init>(ThemeAutoDeployListener.java:41)
        at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
        at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:39)
        at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:27)
        at java.lang.reflect.Constructor.newInstance(Constructor.java:513)
        at java.lang.Class.newInstance0(Class.java:357)
        at java.lang.Class.newInstance(Class.java:310)
        at com.liferay.portal.events.GlobalStartupAction.getAutoDeployListeners(GlobalStartupAction.java:70)
        at com.liferay.portal.events.GlobalStartupAction.run(GlobalStartupAction.java:145)
        at com.liferay.portal.events.EventsProcessorImpl.processEvent(EventsProcessorImpl.java:117)
        at com.liferay.portal.events.EventsProcessorImpl.process(EventsProcessorImpl.java:69)
        at com.liferay.portal.events.EventsProcessorUtil.process(EventsProcessorUtil.java:43)
        at com.liferay.portal.servlet.MainServlet.init(MainServlet.java:415)
        at javax.servlet.GenericServlet.init(GenericServlet.java:241)
        at weblogic.servlet.internal.StubSecurityHelper$ServletInitAction.run(StubSecurityHelper.java:283)
        at weblogic.security.acl.internal.AuthenticatedSubject.doAs(AuthenticatedSubject.java:321)
        at weblogic.security.service.SecurityManager.runAs(SecurityManager.java:120)
        at weblogic.servlet.internal.StubSecurityHelper.createServlet(StubSecurityHelper.java:64)
      

    I see this error in your output:
    2014-11-26 10:55:23,583 ERROR [ThemeAutoDeployer]
    java.io.FileNotFoundException: /tmp/liferay/com/liferay/portal/deploy/dependencies/liferay-theme.tld (Too many open files)
    I'm not across what the EBS recommended setting for this is, or if there is one.  But try running:
    ulimit -n
    ... and if the number is low, edit /etc/security/limits.conf , add some entries for increased "soft nofile" and "hard nofile" and run sysctl -p.  See Linux & Java tips: Too many open files .

  • BPM for Weblogic configuration is failed

    1, I install BPM for Weblogic.
    2, I create a domain for weblogic using config tool and start it.
    3, I create a new directory.
    However, the configuration is failed.
    The BPM for weblogic is installed in XP and the window of selecting JDK is not pop out.
    The log is as follows:
    For more help, use help(edit) Starting an edit session ... Started edit session, please be sure to save and activate your
    changes once you are done. creating mbean of type JMSServer ... creating mbean of type JMSSystemResource ... creating mbean of type SubDeployment ... creating mbean of type Queue ... creating mbean of type Topic ... creating mbean of type ConnectionFactory ... creating mbean of type ConnectionFactory ... creating mbean of type JDBCSystemResource ... creating mbean of type Property ... creating mbean of type Property ... creating mbean of type Property ... creating mbean of type Property ... creating mbean of type JDBCSystemResource ... creating mbean of type Property ... creating mbean of type Property ... creating mbean of type Property ... creating mbean of type Property ... setting attributes for mbean type JMSServer setting attributes for mbean type JMSSystemResource setting attributes for mbean type SubDeployment setting attributes for mbean type Queue setting attributes for mbean type Topic setting attributes for mbean type JMSConnectionFactory setting attributes for mbean type JMSConnectionFactory setting attributes for mbean type JDBCSystemResource setting attributes for mbean type JDBCProperty setting attributes for mbean type JDBCProperty setting attributes for mbean type JDBCProperty setting attributes for mbean type JDBCProperty setting attributes for mbean type JDBCConnectionPoolParams setting attributes for mbean type JDBCDriverParams setting attributes for mbean type JDBCDataSource setting attributes for mbean type JDBCDataSource setting attributes for mbean type JDBCXAParams setting attributes for mbean type JDBCDataSourceParams setting attributes for mbean type JDBCConnectionPoolParams setting attributes for mbean type JDBCDriverParams setting attributes for mbean type JDBCDataSourceParams setting attributes for mbean type JDBCSystemResource setting attributes for mbean type JDBCProperty setting attributes for mbean type JDBCProperty setting attributes for mbean type JDBCProperty setting attributes for mbean type JDBCProperty Saving all your changes ... Saved all your changes successfully. Your edit session is not stopped, you can continue your edits. Activating all your changes, this may take a while ...
    The edit lock associated with this edit session is released
    once the activation is completed. Activation completed Creating a user ... Created user successfully Deploying application from E:\OraBPMwlHome20090715WebLogic\j2ee\weblogic\deployer\wlj2eedeployer.ear to targets examplesServer (upload=true) ... <Jul 15, 2009 12:11:44 PM CST> <Info> <J2EE Deployment SPI> <BEA-260121> <Initiating deploy operation for application, wlj2eedeployer archive: E:\OraBPMwlHome20090715WebLogic\j2ee\weblogic\deployer\wlj2eedeployer.ear, to examplesServer .> .Completed the deployment of Application with status completed Current Status of your Deployment: Deployment command type: deploy Deployment State : completed Deployment Message : no message Deploying application from E:\OraBPMwlHome20090715WebLogic\ears\engine\01-eng-bpmengine3.ear to targets examplesServer (upload=true) ... <Jul 15, 2009 12:11:54 PM CST> <Info> <J2EE Deployment SPI> <BEA-260121> <Initiating deploy operation for application, 01-eng-bpmengine3 archive: E:\OraBPMwlHome20090715WebLogic\ears\engine\01-eng-bpmengine3.ear, to examplesServer .> Failed to deploy the application with status failed Current Status of your Deployment: Deployment command type: deploy Deployment State : failed Deployment Message : java.lang.OutOfMemoryError: Java heap space No stack trace available. This Exception occurred at Wed Jul 15 12:12:17 CST 2009. weblogic.management.scripting.ScriptException: Error occured while performing deploy : Deployment Failed. at weblogic.management.scripting.ExceptionHandler.handleException(ExceptionHandler.java:48) at weblogic.management.scripting.WLSTUtils.throwWLSTException(WLSTUtils.java:185) at weblogic.management.scripting.JSR88DeployHandler.deploy(JSR88DeployHandler.java:536) at weblogic.management.scripting.WLScriptContext.deploy(WLScriptContext.java:429) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at org.python.core.PyReflectedFunction.__call__(PyReflectedFunction.java:160) at org.python.core.PyMethod.__call__(PyMethod.java:96) at org.python.core.PyObject.__call__(PyObject.java:248) at org.python.core.PyObject.invoke(PyObject.java:2016) at org.python.pycode._pyx17.deploy$8(<iostream>:223) at org.python.pycode._pyx17.call_function(<iostream>) at org.python.core.PyTableCode.call(PyTableCode.java:208) at org.python.core.PyTableCode.call(PyTableCode.java:404) at org.python.core.PyFunction.__call__(PyFunction.java:184) at org.python.pycode._pyx16.deploy_Applications$61(C:\Documents and Settings\Administrator\.configWizard\tmp\config.py:623) at org.python.pycode._pyx16.call_function(C:\Documents and Settings\Administrator\.configWizard\tmp\config.py) at org.python.core.PyTableCode.call(PyTableCode.java:208) at org.python.core.PyTableCode.call(PyTableCode.java:256) at org.python.core.PyFunction.__call__(PyFunction.java:169) at org.python.pycode._pyx16.f$0(C:\Documents and Settings\Administrator\.configWizard\tmp\config.py:738) at org.python.pycode._pyx16.call_function(C:\Documents and Settings\Administrator\.configWizard\tmp\config.py) at org.python.core.PyTableCode.call(PyTableCode.java:208) at org.python.core.PyCode.call(PyCode.java:14) at org.python.core.Py.runCode(Py.java:1135) at org.python.util.PythonInterpreter.execfile(PythonInterpreter.java:167) at weblogic.management.scripting.WLST.main(WLST.java:129) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at weblogic.WLST.main(WLST.java:29)
    Exiting WebLogic Scripting Tool.
    <Jul 15, 2009 12:12:17 PM CST> <Warning> <JNDI> <BEA-050001> <WLContext.close() was called in a different thread than the one in which it was created.> QuestionConfirm Action
    Do you want to cancel this wizard?

    Hi,
    Thanks for your reply. I change the file and reconfigure the BPM for weblogic. However, it is still failed in 70-72%.
    -------------------log message-------------------------------
    TO_MSG PATH=/root/bea/wlserver_10.3/server/bin:/root/bea/modules/org.apache.ant_1.6.5/bin:/root/bea/jrockit_160_05/jre/bin:/root/bea/jrockit_160_05/bin:/usr/kerberos/sbin:/usr/kerberos/bin:/usr/local/sbin:/usr/local/bin:/sbin:/bin:/usr/sbin:/usr/bin:/usr/X11R6/bin:/root/bin
    TO_MSG
    TO_MSG Your environment has been set.
    TO_MSG
    TO_MSG CLASSPATH=/root/bea/patch_wlw1030/profiles/default/sys_manifest_classpath/weblogic_patch.jar:/root/bea/patch_wls1030/profiles/default/sys_manifest_classpath/weblogic_patch.jar:/root/bea/patch_cie660/profiles/default/sys_manifest_classpath/weblogic_patch.jar:/root/bea/jrockit_160_05/lib/tools.jar:/root/bea/wlserver_10.3/server/lib/weblogic_sp.jar:/root/bea/wlserver_10.3/server/lib/weblogic.jar:/root/bea/modules/features/weblogic.server.modules_10.3.0.0.jar:/root/bea/wlserver_10.3/server/lib/webservices.jar:/root/bea/modules/org.apache.ant_1.6.5/lib/ant-all.jar:/root/bea/modules/net.sf.antcontrib_1.0.0.0_1-0b2/lib/ant-contrib.jar:/root/OraBPMwlHome/lib/fuego.boot.jar:/root/OraBPMwlHome/bin/./:/root/OraBPMwlHome/bin/./lax.jar::/root/bea/wlserver_10.3/common/eval/pointbase/lib/pbembedded57.jar:/root/bea/wlserver_10.3/common/eval/pointbase/lib/pbtools57.jar:/root/bea/wlserver_10.3/common/eval/pointbase/lib/pbclient57.jar
    TO_MSG
    TO_MSG Initializing WebLogic Scripting Tool (WLST) ...
    TO_MSG
    TO_MSG Welcome to WebLogic Server Administration Scripting Shell
    TO_MSG
    TO_MSG Type help() for help on available commands
    TO_MSG
    TO_MSG Starting server BPMServer
    TO_MSG Please see the server log files for startup messages available at /root/weblogic3/bpm
    TO_MSG Starting weblogic server ...
    TO_MSG WLST-WLS-1249792014056: [WARN ] -XX:MaxPermSize=256m is not a valid VM option. Ignoring
    TO_MSG .WLST-WLS-1249792014056: <2009-8-9 ¦ᄌヒ¥ヘネ12₩ラᄊ26¥ネニ58￧ᄃメ CST> <Info> <WebLogicServer> <BEA-000377> <Starting WebLogic Server with BEA JRockit(R) Version R27.6.0-50_o-100423-1.6.0_05-20080626-2104-linux-ia32 from BEA Systems, Inc.>
    TO_MSG WLST-WLS-1249792014056: <2009-8-9 ¦ᄌヒ¥ヘネ12₩ラᄊ27¥ネニ00￧ᄃメ CST> <Info> <Management> <BEA-140013> </root/weblogic3/bpm/config/config.xml not found>
    TO_MSG WLST-WLS-1249792014056: <2009-8-9 ¦ᄌヒ¥ヘネ12₩ラᄊ27¥ネニ00￧ᄃメ CST> <Info> <Management> <BEA-141254> <Generating new domain directory in /root/weblogic3/bpm>
    TO_MSG .....WLST-WLS-1249792014056: <2009-8-9 ¦ᄌヒ¥ヘネ12₩ラᄊ27¥ネニ12￧ᄃメ CST> <Info> <Management> <BEA-141255> <Domain generation completed in 12,326 milliseconds.>
    TO_MSG WLST-WLS-1249792014056: <2009-8-9 ¦ᄌヒ¥ヘネ12₩ラᄊ27¥ネニ13￧ᄃメ CST> <Info> <Management> <BEA-141107> <Version: WebLogic Server 10.3 Fri Jul 25 16:30:05 EDT 2008 1137967 >
    TO_MSG .WLST-WLS-1249792014056: <2009-8-9 ¦ᄌヒ¥ヘネ12₩ラᄊ27¥ネニ15￧ᄃメ CST> <Notice> <WebLogicServer> <BEA-000365> <Server state changed to STARTING>
    TO_MSG WLST-WLS-1249792014056: <2009-8-9 ¦ᄌヒ¥ヘネ12₩ラᄊ27¥ネニ15￧ᄃメ CST> <Info> <WorkManager> <BEA-002900> <Initializing self-tuning thread pool>
    TO_MSG WLST-WLS-1249792014056: <2009-8-9 ¦ᄌヒ¥ヘネ12₩ラᄊ27¥ネニ16￧ᄃメ CST> <Notice> <Log Management> <BEA-170019> <The server log file /root/weblogic3/bpm/servers/BPMServer/logs/BPMServer.log is opened. All server side log events will be written to this file.>
    TO_MSG ...WLST-WLS-1249792014056: <2009-8-9 ¦ᄌヒ¥ヘネ12₩ラᄊ27¥ネニ24￧ᄃメ CST> <Notice> <Security> <BEA-090082> <Security initializing using security realm myrealm.>
    TO_MSG ....WLST-WLS-1249792014056: <2009-8-9 ¦ᄌヒ¥ヘネ12₩ラᄊ27¥ネニ34￧ᄃメ CST> <Notice> <WebLogicServer> <BEA-000365> <Server state changed to STANDBY>
    TO_MSG WLST-WLS-1249792014056: <2009-8-9 ¦ᄌヒ¥ヘネ12₩ラᄊ27¥ネニ34￧ᄃメ CST> <Notice> <WebLogicServer> <BEA-000365> <Server state changed to STARTING>
    TO_MSG WLST-WLS-1249792014056: <2009-8-9 ¦ᄌヒ¥ヘネ12₩ラᄊ27¥ネニ34￧ᄃメ CST> <Notice> <Log Management> <BEA-170027> <The Server has established connection with the Domain level Diagnostic Service successfully.>
    TO_MSG .WLST-WLS-1249792014056: <2009-8-9 ¦ᄌヒ¥ヘネ12₩ラᄊ27¥ネニ35￧ᄃメ CST> <Notice> <WebLogicServer> <BEA-000365> <Server state changed to ADMIN>
    TO_MSG WLST-WLS-1249792014056: <2009-8-9 ¦ᄌヒ¥ヘネ12₩ラᄊ27¥ネニ35￧ᄃメ CST> <Notice> <WebLogicServer> <BEA-000365> <Server state changed to RESUMING>
    TO_MSG WLST-WLS-1249792014056: <2009-8-9 ¦ᄌヒ¥ヘネ12₩ラᄊ27¥ネニ35￧ᄃメ CST> <Notice> <Server> <BEA-002613> <Channel "Default" is now listening on 127.0.0.1:7001 for protocols iiop, t3, ldap, snmp, http.>
    TO_MSG WLST-WLS-1249792014056: <2009-8-9 ¦ᄌヒ¥ヘネ12₩ラᄊ27¥ネニ35￧ᄃメ CST> <Notice> <WebLogicServer> <BEA-000331> <Started WebLogic Admin Server "BPMServer" for domain "bpm" running in Development Mode>
    TO_MSG WLST-WLS-1249792014056: <2009-8-9 ¦ᄌヒ¥ヘネ12₩ラᄊ27¥ネニ36￧ᄃメ CST> <Notice> <WebLogicServer> <BEA-000365> <Server state changed to RUNNING>
    TO_MSG WLST-WLS-1249792014056: <2009-8-9 ¦ᄌヒ¥ヘネ12₩ラᄊ27¥ネニ36￧ᄃメ CST> <Notice> <WebLogicServer> <BEA-000360> <Server started in RUNNING mode>
    TO_MSG Server started successfully.
    TO_MSG Started Server. Trying to connect to the server ...
    TO_MSG Connecting to t3://localhost.localdomain:7001 with userid weblogic ...
    TO_MSG Successfully connected to Admin Server 'BPMServer' that belongs to domain 'bpm'.
    TO_MSG
    TO_MSG Warning: An insecure protocol was used to connect to the
    TO_MSG server. To ensure on-the-wire security, the SSL port or
    TO_MSG Admin port should be used instead.
    TO_MSG
    TO_MSG Location changed to edit tree. This is a writable tree with
    TO_MSG DomainMBean as the root. To make changes you will need to start
    TO_MSG an edit session via startEdit().
    TO_MSG
    TO_MSG For more help, use help(edit)
    TO_MSG
    TO_MSG Starting an edit session ...
    TO_MSG Started edit session, please be sure to save and activate your
    TO_MSG changes once you are done.
    TO_MSG creating mbean of type JMSServer ...
    TO_MSG creating mbean of type JMSSystemResource ...
    TO_MSG creating mbean of type SubDeployment ...
    TO_MSG creating mbean of type Queue ...
    TO_MSG creating mbean of type Topic ...
    TO_MSG creating mbean of type ConnectionFactory ...
    TO_MSG creating mbean of type ConnectionFactory ...
    TO_MSG creating mbean of type Server ...
    TO_MSG creating mbean of type JDBCSystemResource ...
    TO_MSG creating mbean of type Property ...
    TO_MSG creating mbean of type Property ...
    TO_MSG creating mbean of type Property ...
    TO_MSG creating mbean of type Property ...
    TO_MSG creating mbean of type JDBCSystemResource ...
    TO_MSG creating mbean of type Property ...
    TO_MSG creating mbean of type Property ...
    TO_MSG creating mbean of type Property ...
    TO_MSG creating mbean of type Property ...
    TO_MSG creating mbean of type Realm ...
    TO_MSG creating mbean of type RoleMapper ...
    TO_MSG creating mbean of type CredentialMapper ...
    TO_MSG creating mbean of type CertPathProvider ...
    TO_MSG creating mbean of type Authorizer ...
    TO_MSG creating mbean of type Adjudicator ...
    TO_MSG creating mbean of type AuthenticationProvider ...
    TO_MSG creating mbean of type AuthenticationProvider ...
    TO_MSG setting attributes for mbean type JMSServer
    TO_MSG setting attributes for mbean type JMSSystemResource
    TO_MSG setting attributes for mbean type SubDeployment
    TO_MSG setting attributes for mbean type Queue
    TO_MSG setting attributes for mbean type Topic
    TO_MSG setting attributes for mbean type JMSConnectionFactory
    TO_MSG setting attributes for mbean type JMSConnectionFactory
    TO_MSG setting attributes for mbean type Server
    TO_MSG setting attributes for mbean type JDBCSystemResource
    TO_MSG setting attributes for mbean type JDBCProperty
    TO_MSG setting attributes for mbean type JDBCProperty
    TO_MSG setting attributes for mbean type JDBCProperty
    TO_MSG setting attributes for mbean type JDBCProperty
    TO_MSG setting attributes for mbean type JDBCConnectionPoolParams
    TO_MSG setting attributes for mbean type JDBCDriverParams
    TO_MSG setting attributes for mbean type JDBCDataSource
    TO_MSG setting attributes for mbean type DefaultIdentityAsserter
    TO_MSG setting attributes for mbean type SecurityConfiguration
    TO_MSG setting attributes for mbean type SecurityParams
    TO_MSG setting attributes for mbean type EmbeddedLDAP
    TO_MSG setting attributes for mbean type SecurityParams
    TO_MSG setting attributes for mbean type Domain
    TO_MSG setting attributes for mbean type JDBCDataSource
    TO_MSG setting attributes for mbean type JDBCXAParams
    TO_MSG setting attributes for mbean type JDBCDataSourceParams
    TO_MSG setting attributes for mbean type JDBCConnectionPoolParams
    TO_MSG setting attributes for mbean type JDBCDriverParams
    TO_MSG setting attributes for mbean type JDBCDataSourceParams
    TO_MSG setting attributes for mbean type JDBCSystemResource
    TO_MSG setting attributes for mbean type JDBCProperty
    TO_MSG setting attributes for mbean type JDBCProperty
    TO_MSG setting attributes for mbean type JDBCProperty
    TO_MSG setting attributes for mbean type JDBCProperty
    TO_MSG Saving all your changes ...
    TO_MSG Saved all your changes successfully.
    TO_MSG Your edit session is not stopped, you can continue your edits.
    TO_MSG Activating all your changes, this may take a while ...
    TO_MSG The edit lock associated with this edit session is released
    TO_MSG once the activation is completed.
    TO_MSG WLST-WLS-1249792014056: <2009-8-9 ¦ᄌヒ¥ヘネ12₩ラᄊ27¥ネニ53￧ᄃメ CST> <Warning> <Management> <BEA-141239> <The non-dynamic attribute InternalAppsDeployOnDemandEnabled on weblogic.management.configuration.DomainMBeanImpl@fffe8220([bpm]) has been changed. This may require redeploying or rebooting configured entities>
    TO_MSG WLST-WLS-1249792014056: <2009-8-9 ¦ᄌヒ¥ヘネ12₩ラᄊ27¥ネニ53￧ᄃメ CST> <Warning> <Management> <BEA-141238> <A non-dynamic change has been made which affects the server BPMServer. This server must be rebooted in order to consume this change.>
    TO_MSG WLST-WLS-1249792014056: <2009-8-9 ¦ᄌヒ¥ヘネ12₩ラᄊ27¥ネニ53￧ᄃメ CST> <Warning> <Management> <BEA-141239> <The non-dynamic attribute RotateLogOnStartup on weblogic.management.configuration.LogMBeanImpl@1759a12([bpm]/Log[bpm]) has been changed. This may require redeploying or rebooting configured entities>
    TO_MSG WLST-WLS-1249792014056: <2009-8-9 ¦ᄌヒ¥ヘネ12₩ラᄊ27¥ネニ53￧ᄃメ CST> <Warning> <Management> <BEA-141238> <A non-dynamic change has been made which affects the server BPMServer. This server must be rebooted in order to consume this change.>
    TO_MSG WLST-WLS-1249792014056: <2009-8-9 ¦ᄌヒ¥ヘネ12₩ラᄊ27¥ネニ53￧ᄃメ CST> <Warning> <Management> <BEA-141239> <The non-dynamic attribute ListenAddress on weblogic.management.configuration.ServerMBeanImpl@2ddd7637([bpm]/Servers[BPMServer]) has been changed. This may require redeploying or rebooting configured entities>
    TO_MSG WLST-WLS-1249792014056: <2009-8-9 ¦ᄌヒ¥ヘネ12₩ラᄊ27¥ネニ53￧ᄃメ CST> <Warning> <Management> <BEA-141238> <A non-dynamic change has been made which affects the server BPMServer. This server must be rebooted in order to consume this change.>
    TO_MSG WLST-WLS-1249792014056: <2009-8-9 ¦ᄌヒ¥ヘネ12₩ラᄊ27¥ネニ53￧ᄃメ CST> <Warning> <Management> <BEA-141239> <The non-dynamic attribute RotateLogOnStartup on weblogic.management.configuration.LogMBeanImpl@2df105fa([bpm]/Servers[BPMServer]/Log[BPMServer]) has been changed. This may require redeploying or rebooting configured entities>
    TO_MSG WLST-WLS-1249792014056: <2009-8-9 ¦ᄌヒ¥ヘネ12₩ラᄊ27¥ネニ53￧ᄃメ CST> <Warning> <Management> <BEA-141238> <A non-dynamic change has been made which affects the server BPMServer. This server must be rebooted in order to consume this change.>
    TO_MSG WLST-WLS-1249792014056: <2009-8-9 ¦ᄌヒ¥ヘネ12₩ラᄊ27¥ネニ53￧ᄃメ CST> <Warning> <Management> <BEA-141239> <The non-dynamic attribute RotateLogOnStartup on weblogic.management.configuration.WebServerLogMBeanImpl@2df106e5([bpm]/Servers[BPMServer]/WebServer[BPMServer]/WebServerLog[BPMServer]) has been changed. This may require redeploying or rebooting configured entities>
    TO_MSG WLST-WLS-1249792014056: <2009-8-9 ¦ᄌヒ¥ヘネ12₩ラᄊ27¥ネニ53￧ᄃメ CST> <Warning> <Management> <BEA-141238> <A non-dynamic change has been made which affects the server BPMServer. This server must be rebooted in order to consume this change.>
    TO_MSG
    TO_MSG The following non-dynamic attribute(s) have been changed on MBeans
    TO_MSG that require server re-start:
    TO_MSG MBean Changed : com.bea:Name=BPMServer,Type=Log,Server=BPMServer
    TO_MSG Attributes changed : RotateLogOnStartup
    TO_MSG
    TO_MSG MBean Changed : com.bea:Name=BPMServer,Type=Server
    TO_MSG Attributes changed : ListenAddress
    TO_MSG
    TO_MSG MBean Changed : com.bea:Name=bpm,Type=Log
    TO_MSG Attributes changed : RotateLogOnStartup
    TO_MSG
    TO_MSG MBean Changed : com.bea:Name=bpm,Type=Domain
    TO_MSG Attributes changed : InternalAppsDeployOnDemandEnabled, ProductionModeEnabled
    TO_MSG
    TO_MSG MBean Changed : com.bea:Name=BPMServer,Type=WebServerLog,Server=BPMServer,WebServer=BPMServer
    TO_MSG Attributes changed : RotateLogOnStartup
    TO_MSG
    TO_MSG Activation completed
    TO_MSG Creating a user ...
    TO_MSG
    TO_MSG Created user successfully
    TO_MSG Deploying application from /root/OraBPMwlHome/j2ee/weblogic/deployer/wlj2eedeployer.ear to targets BPMServer (upload=true) ...
    TO_MSG <2009-8-9 ¦ᄌヒ¥ヘネ12₩ラᄊ28¥ネニ01￧ᄃメ CST> <Info> <J2EE Deployment SPI> <BEA-260121> <Initiating deploy operation for application, wlj2eedeployer [archive: /root/OraBPMwlHome/j2ee/weblogic/deployer/wlj2eedeployer.ear], to BPMServer .>
    TO_MSG .Completed the deployment of Application with status completed
    TO_MSG Current Status of your Deployment:
    TO_MSG Deployment command type: deploy
    TO_MSG Deployment State : completed
    TO_MSG Deployment Message : no message
    TO_MSG Deploying application from /root/OraBPMwlHome/ears/engine/01-eng-bpmengine.ear to targets BPMServer (upload=true) ...
    TO_MSG <2009-8-9 ¦ᄌヒ¥ヘネ12₩ラᄊ28¥ネニ08￧ᄃメ CST> <Info> <J2EE Deployment SPI> <BEA-260121> <Initiating deploy operation for application, 01-eng-bpmengine [archive: /root/OraBPMwlHome/ears/engine/01-eng-bpmengine.ear], to BPMServer .>
    TO_MSG .................Completed the deployment of Application with status completed
    TO_MSG Current Status of your Deployment:
    TO_MSG Deployment command type: deploy
    TO_MSG Deployment State : completed
    TO_MSG Deployment Message : no message
    TO_MSG Deploying application from /root/OraBPMwlHome/ears/webapps/webapps_expanded/08-workspace-XAFDIDS.ear to targets BPMServer (upload=true) ...
    TO_MSG <2009-8-9 ¦ᄌヒ¥ヘネ12₩ラᄊ29¥ネニ48￧ᄃメ CST> <Info> <J2EE Deployment SPI> <BEA-260121> <Initiating deploy operation for application, 08-workspace-XAFDIDS.ear [archive: /root/OraBPMwlHome/ears/webapps/webapps_expanded/08-workspace-XAFDIDS.ear], to BPMServer .>
    TO_MSG .Completed the deployment of Application with status completed
    TO_MSG Current Status of your Deployment:
    TO_MSG Deployment command type: deploy
    TO_MSG Deployment State : completed
    TO_MSG Deployment Message : no message
    TO_MSG Deploying application from /root/OraBPMwlHome/ears/webapps/webapps_expanded/09-feeds-XAFDIDS.ear to targets BPMServer (upload=true) ...
    TO_MSG <2009-8-9 ¦ᄌヒ¥ヘネ12₩ラᄊ30¥ネニ45￧ᄃメ CST> <Info> <J2EE Deployment SPI> <BEA-260121> <Initiating deploy operation for application, 09-feeds-XAFDIDS.ear [archive: /root/OraBPMwlHome/ears/webapps/webapps_expanded/09-feeds-XAFDIDS.ear], to BPMServer .>
    TO_MSG .Completed the deployment of Application with status completed
    TO_MSG Current Status of your Deployment:
    TO_MSG Deployment command type: deploy
    TO_MSG Deployment State : completed
    TO_MSG Deployment Message : no message
    TO_MSG Deploying application from /root/OraBPMwlHome/ears/webapps/webapps_expanded/06-workspaceadmin-XAFDIDS.ear to targets BPMServer (upload=true) ...
    TO_MSG <2009-8-9 ¦ᄌヒ¥ヘネ12₩ラᄊ31¥ネニ00￧ᄃメ CST> <Info> <J2EE Deployment SPI> <BEA-260121> <Initiating deploy operation for application, 06-workspaceadmin-XAFDIDS.ear [archive: /root/OraBPMwlHome/ears/webapps/webapps_expanded/06-workspaceadmin-XAFDIDS.ear], to BPMServer .>
    TO_MSG .Completed the deployment of Application with status completed
    TO_MSG Current Status of your Deployment:
    TO_MSG Deployment command type: deploy
    TO_MSG Deployment State : completed
    TO_MSG Deployment Message : no message
    TO_MSG Deploying application from /root/OraBPMwlHome/ears/webapps/07-papiws-wls103-XAFDIDS.ear to targets BPMServer (upload=true) ...
    TO_MSG <2009-8-9 ¦ᄌヒ¥ヘネ12₩ラᄊ31¥ネニ31￧ᄃメ CST> <Info> <J2EE Deployment SPI> <BEA-260121> <Initiating deploy operation for application, 07-papiws-wls103-XAFDIDS.ear [archive: /root/OraBPMwlHome/ears/webapps/07-papiws-wls103-XAFDIDS.ear], to BPMServer .>
    TO_MSG ..WLST-WLS-1249792014056: <2009-8-9 ¦ᄌヒ¥ヘネ12₩ラᄊ31¥ネニ48￧ᄃメ CST> <Error> <HTTP> <BEA-101220> <Error occurred while setting document root for "weblogic.servlet.internal.WebAppServletContext@30302d0 - appName: '07-papiws-wls103-XAFDIDS.ear', name: 'papiws', context-path: '/papiws', spec-version: '2.5'" to "/root/weblogic3/bpm/servers/BPMServer/tmp/_WL_user/07-papiws-wls103-XAFDIDS.ear/f0r1c0/papiws.war".>
    TO_MSG WLST-WLS-1249792014056: <2009-8-9 ¦ᄌヒ¥ヘネ12₩ラᄊ31¥ネニ48￧ᄃメ CST> <Error> <Deployer> <BEA-149265> <Failure occurred in the execution of deployment request with ID '1249792304208' for task '5'. Error is: 'weblogic.application.ModuleException: Failed to load webapp: 'papiws''
    TO_MSG WLST-WLS-1249792014056: weblogic.application.ModuleException: Failed to load webapp: 'papiws'
    TO_MSG WLST-WLS-1249792014056:      at weblogic.servlet.internal.WebAppModule.prepare(WebAppModule.java:387)
    TO_MSG WLST-WLS-1249792014056:      at weblogic.application.internal.flow.ScopedModuleDriver.prepare(ScopedModuleDriver.java:176)
    TO_MSG WLST-WLS-1249792014056:      at weblogic.application.internal.flow.ModuleListenerInvoker.prepare(ModuleListenerInvoker.java:93)
    TO_MSG WLST-WLS-1249792014056:      at weblogic.application.internal.flow.DeploymentCallbackFlow$1.next(DeploymentCallbackFlow.java:387)
    TO_MSG WLST-WLS-1249792014056:      at weblogic.application.utils.StateMachineDriver.nextState(StateMachineDriver.java:37)
    TO_MSG WLST-WLS-1249792014056:      Truncated. see log file for complete stacktrace
    TO_MSG WLST-WLS-1249792014056: java.io.IOException: Error opening file
    TO_MSG WLST-WLS-1249792014056:      at java.util.zip.ZipFile.open(Native Method)
    TO_MSG WLST-WLS-1249792014056:      at java.util.zip.ZipFile.<init>(ZipFile.java:117)
    TO_MSG WLST-WLS-1249792014056:      at java.util.zip.ZipFile.<init>(ZipFile.java:133)
    TO_MSG WLST-WLS-1249792014056:      at weblogic.utils.classloaders.ZipClassFinder.<init>(ZipClassFinder.java:23)
    TO_MSG WLST-WLS-1249792014056:      at weblogic.application.io.ArchivedWar$WebInfClassesFinder.<init>(ArchivedWar.java:290)
    TO_MSG WLST-WLS-1249792014056:      Truncated. see log file for complete stacktrace
    TO_MSG WLST-WLS-1249792014056: >
    TO_MSG WLST-WLS-1249792014056: java.io.FileNotFoundException: /root/weblogic3/bpm/config/config.xml (Too many open files)
    TO_MSG WLST-WLS-1249792014056:      at java.io.FileOutputStream.open(Native Method)
    TO_MSG WLST-WLS-1249792014056:      at java.io.FileOutputStream.<init>(FileOutputStream.java:179)
    TO_MSG WLST-WLS-1249792014056:      at java.io.FileOutputStream.<init>(FileOutputStream.java:131)
    TO_MSG WLST-WLS-1249792014056:      at weblogic.utils.FileUtils.writeToFile(FileUtils.java:115)
    TO_MSG WLST-WLS-1249792014056:      at weblogic.utils.Fil

  • "Too many open files" Exception on "tapestry-framework-4.1.1.jar"

    When a browser attempts accessing to my webwork, the server opens a certain number of file descriptors to "tapestry-framework-4.1.1.jar" file and don't release them for a while.
    Below is the output from "lsof | grep tapestry":
    java 26735 root mem REG 253,0 62415 2425040 /usr/local/apache-tomcat-5.5.20/my_webwork/WEB-INF/lib/tapestry-portlet-4.1.1.jar
    java 26735 root mem REG 253,0 2280602 2425039 /usr/local/apache-tomcat-5.5.20/my_webwork/WEB-INF/lib/tapestry-framework-4.1.1.jar
    java 26735 root mem REG 253,0 320546 2425036 /usr/local/apache-tomcat-5.5.20/my_webwork/WEB-INF/lib/tapestry-contrib-4.1.1.jar
    java 26735 root mem REG 253,0 49564 2424979 /usr/local/apache-tomcat-5.5.20/my_webwork/WEB-INF/lib/tapestry-annotations-4.1.1.jar
    java 26735 root 28r REG 253,0 2280602 2425039 /usr/local/apache-tomcat-5.5.20/my_webwork/WEB-INF/lib/tapestry-framework-4.1.1.jar
    java 26735 root 29r REG 253,0 2280602 2425039 /usr/local/apache-tomcat-5.5.20/my_webwork/WEB-INF/lib/tapestry-framework-4.1.1.jar
    java 26735 root 30r REG 253,0 2280602 2425039 /usr/local/apache-tomcat-5.5.20/my_webwork/WEB-INF/lib/tapestry-framework-4.1.1.jar
    These unknown references are sometimes released automatically, but sometimes not.
    And I get "Too many open files" exception after using my application for a few hours.
    The number of the unknown references increases as I access to my webwork or just hit on "F5" key on my browser to reload it.
    I tried different types of browsers to see if I could see any differences in consequence, and in fact it differed by the browser I used.
    When viewed by Internet Explorer it increased by 3 for every access.
    On the other hand it increased by 7 for each attempt when accessed by FireFox.
    I have already tried optimizing the max number of file discriptors, and it solved the "Too many open files" exception.
    But stil I'm wondering who actually is opening "tapestry-framework-4.1.1.jar" this many.
    Could anyone figure out what is going on?
    Thanks in advance.
    The following is my environmental version info:
    - Red Hat Enterprise Linux ES release 4 (Nahant Update 4)
    - Java: 1.5.0_11
    - Tomcat: 5.5.20
    - Tapestry: 4.1.1

    Hi,
    Cause might The server got an exception while trying to accept client connections. It will try to backoff to aid recovery.
    The OS limit for the number of open file descriptor (FD limit) needs to be increased. Tune OS parameters that might help the server to accept more client connections (e.g. TCP accept back log).
    http://e-docs.bea.com/wls/docs90/messages/Server.html#BEA-002616
    Regards,
    Prasanna Yalam

  • WL10 Compiler executable.exec error "too many open files" deploying ear

    When I try to deploy an ear containing a web module and some ejb modules, I obtain this error:
    <Info> <J2EE Deployment SPI> <BEA-260121> <Initiating deploy operation for application, MB-ADM_EAR [archive: /wl/wlments/MB-ADM_EAR/MB-ADM_EAR.ear], to Cluster1 .>
    Task 1 initiated: [Deployer:149026]deploy application MB-ADM_EAR on Cluster1.
    Task 1 failed: [Deployer:149026]deploy application MB-ADM_EAR on Cluster1.
    Target state: deploy failed on Cluster Cluster1
    java.io.IOException: Compiler failed executable.exec:
    /wl/servers/MS1/cache/EJBCompilerCache/-1dj0waj53cbu8/it/apps/ejbs/core/ExSvc_167qnt_Impl.java:17: error while writing it.apps.ejbs.core.ExSvc_167qnt_Impl: /wl/servers/MS1/cache/EJBCompilerCache/-1dj0waj53cbu8/it/apps/ejbs/core/ExSvc_167qnt_Impl.class (Too many open files)If i split the ear in two parts, web in one ear and ejbs in another ear, deploy is succesfull.
    Do you have any idea of what is happening?
    Below the environment specifications:
    JVM Version: jrockit_150_11
    JVM Heap: 512
    Web Logic: 10.0.1.0
    Server: Hewlett Packard DL585 G2
    OS: Linux / 2.6.5-7.287.3.PTF.345489.1-smp
    Thank you, bye,
    Marco

    Hello Marco.
    When you try to deploy an EAR weblogic server at the time of deployment unjar's it and compiles the files and so on. Every Operating system has a limit on how many number of files can be opened by a process. If your EAR is big then the number of files which WLS will unjar will also be large hence you hit the limit. By splitting your ear into 2, you are splitting wls task into smaller parts, which means the number of files it unjars at a time is less.
    The following note tells what needs to be done to avert this issue.
    http://download.oracle.com/docs/cd/E12839_01/doc.1111/e14772/weblogic_server_issues.htm#CHDGFFHD

  • Connection limits: how to overcome?

    Dearest DS guru!
    I'm afraid this question is quite often here. And I've seen some instances, but I failed to find any usefull information.
    I have SunDS 5.2 running on RHEL 3.
    One day I've experienced the problem of open FD limit (the message in the error log file:
    ERROR<12293> - Connection - conn=-1 op=-1 msgId=-1 - fd limit exceeded Too many open file descriptors - not listening on new connection)
    So as it is advised in the tuning manual I've changed the OS limits (at this time I have ulimit -n 65535 in both /etc/profile and in the script which starts up the DS) and I've also changed the nsslapd-maxdescriptors in the directory itself (set it to 65535).
    But unfortunately it looks like DS has not applied the changes. Although I was permited to change the nsslapd-maxdescriptors (so he knows about new OS limit, as when the OS limit was 1024 I wasn't able to set maxdescriptors more than 1024) I still have the limitation of allowed connections set to 960 (it is 1024 = 960 + 64, where 64 is nsslapd-reservedescriptors).
    The value of nsslapd-maxconnections is set to 0. My attempts to increase it fail with the message:
    additional info: max connection out of range. Valid range is [1..1024].
    So, the question is: why does DS consider the connection number limit to be 1024 when the maxdescriptors set to 65535.
    Thanks a lot!

    Hi!
    Thanks a lot for the link - the page contains quite good information regarding Linux tuning. And it is good to have all those things in one place.
    But I've already seen those tunings and have applied them - they helped just partialy.
    Although basicaly they are quite proper, but in my case I have not done one thing only - I didn't restart the slapd after having changed the nsslapd-maxdescriptors.
    I was told that if I changed the nsslapd-maxdescriptors via ldapmodify it is not neccessary to restart slapdm but that is not the case. Even after setting the nsslapd-maxdescriptors=65535 a could not set the nsslapd-maxconnections higher than 1024 and the value of dtablesize (under dn: cn=monitor) was 1024.
    At last I got an opportunity to restart the slapd and now I can change the nsslapd-maxconnections in 1-65535 range and the value of dtablesize is now 65535.
    That is all...
    it works :)
    Thanks a lot!

  • DirectoryService[67]: socket(PF_ROUTE) failed: Too many open files

    Hello!
    On MacOSX 10.4.10 which is an OD master, my log are filed with this:
    DirectoryService[67]: socket(PF_ROUTE) failed: Too many open files
    It happens at exactly every hours 44 minutes 18 seconds 161 times. At the same time, it makes a lot dns request for "kerberos-master.udp.XXXXXXXXX.COM IN SRV +"
    The server works fine, but there's probably a cronjob that go crazy and i would like to know why it's happening.
    Thanks a lot!
    Fred

    Hi,
    Cause might The server got an exception while trying to accept client connections. It will try to backoff to aid recovery.
    The OS limit for the number of open file descriptor (FD limit) needs to be increased. Tune OS parameters that might help the server to accept more client connections (e.g. TCP accept back log).
    http://e-docs.bea.com/wls/docs90/messages/Server.html#BEA-002616
    Regards,
    Prasanna Yalam

Maybe you are looking for