Inbound Connection Timeout ORA-3136

Hi,
Certain users are getting locked automatically and when I checked the Alert log file I found
WARNING: inbound connection timed out (ORA-3136)
I referred to the Metalink doc : 465043.1.
I increase the SQLNET.INBOUND_CONNECT_TIMEOUT to 120, and still the users are getting locked, there is no network delay, there is no database performance degradation.
However, I found ORA 600 error in the alert log file along with the following errors
ORA-00600: ?ف? ??? ???غمش ?غك???? [pfri.c: pfri8: plio mismatch ], [], [], [], [
ORA-04061: غف م?ف ?غ??ظظ فµ ??غ? package body "HR_BASE.PN$LEAVE_BALANCE" ?غفك?ك?
ORA-04065: غف م?ف ?غ?µطم?ش ?ف ???مغ ?ك ??ظ?? package body "HR_BASE.PN$LEAVE_BALA
NCE"
Sat Jan 3 14:35:01 2009
Errors in file /u01/app/oracle/admin/central/udump/central_ora_5902.trc:
ORA-00600: ?ف? ??? ???غمش ?غك???? [pfri.c: pfri8: plio mismatch ], [], [], [], [
Sat Jan 3 14:35:24 2009
Errors in file /u01/app/oracle/admin/central/udump/central_ora_5902.trc:
ORA-00600: ?ف? ??? ???غمش ?غك???? [pfri.c: pfri8: plio mismatch ], [], [], [], [
Sat Jan 3 14:40:01 2009
Thread 1 advanced to log sequence 1987 (LGWR switch)
Current log# 3 seq# 1987 mem# 0: /oradb/oradata/central/redo03a.log
ORA-12012: ??? طم ?غ?µطم? ?غ?غم غغك?مط? 37
ORA-01403: غف م?ف ?غ??ك? ?غل ?م? ?م?µ??
ORA-06512: ?µ? "HR_BASE.BSH$PAYROLL", line 143
ORA-06512: ?µ? line 1
Sun Jan 25 12:26:47 2009
Errors in file /u01/app/oracle/admin/central/bdump/central_j000_6523.trc:
ORA-12012: ??? طم ?غ?µطم? ?غ?غم غغك?مط? 37
ORA-01403: غف م?ف ?غ??ك? ?غل ?م? ?م?µ??
ORA-06512: ?µ? "HR_BASE.BSH$PAYROLL", line 143
ORA-06512: ?µ? line 1
Sun Jan 25 12:30:48 2009
Errors in file /u01/app/oracle/admin/central/bdump/central_j000_6523.trc:
ORA-12012: ??? طم ?غ?µطم? ?غ?غم غغك?مط? 37
ORA-01403: غف م?ف ?غ??ك? ?غل ?م? ?م?µ??
ORA-06512: ?µ? "HR_BASE.BSH$PAYROLL", line 143
ORA-06512: ?µ? line 1
Sun Jan 25 12:31:38 2009
Thread 1 advanced to log sequence 3184 (LGWR switch)
PLEASE Help!!!

Thanks for your reply,
Could you please tell me how to recompile a set of objects, can I recompile the objects using utlrp.sql script?
and there are some other errors as well
*ORA-00604: error occurred at recursive SQL level 1
ORA-01801: date format is too long for internal buffer
RMAN-08132: WARNING: cannot update recovery area reclaimable file *
for all those errors I need to contact Oracle support?

Similar Messages

Remote Connection Timeouts - ORA-03113 Errors

I have two Sun Solaris servers running Oracle 10.1.0.4. One is our production server, the other is our test server. Both servers are using the same parameters in the SQLNET.ORA file located on each server. All Oracle Net files are located under /var/opt/oracle. The TNS_ADMIN environmental variable is set to /var/opt/oracle on both servers.
When I connect to the production server via TOAD, OEM, or SQL*Plus from my desktop, I can remain connected as long as I like. If after two hours, I want to run another SQL, I type it in and it runs.
When I connect to the test server via TOAD, OAM, or SQL*Plus from my desktop, I can remain connected for only 30 mins of inactivity. After which, if I issue a new SQL statement, I receive an ORA-03113 end-of-file communication channel error.
I believe I've checked everything on both servers and they appear identical. Both of these server sit behind a firewall. So my feeling is that only the firewall could be causing the idle timeout connections to be dropped on the test server.
Anyone have any ideas on this??
P.S. - I realize that killing idle connections is actually a good thing, but I'm trying to verify the reason for the difference and not whether this is or is not a good networking practice.

user583592 wrote:
I have two Sun Solaris servers running Oracle 10.1.0.4. One is our production server, the other is our test server. Both servers are using the same parameters in the SQLNET.ORA file located on each server. All Oracle Net files are located under /var/opt/oracle. The TNS_ADMIN environmental variable is set to /var/opt/oracle on both servers.
When I connect to the production server via TOAD, OEM, or SQL*Plus from my desktop, I can remain connected as long as I like. If after two hours, I want to run another SQL, I type it in and it runs.
When I connect to the test server via TOAD, OAM, or SQL*Plus from my desktop, I can remain connected for only 30 mins of inactivity. After which, if I issue a new SQL statement, I receive an ORA-03113 end-of-file communication channel error.
I believe I've checked everything on both servers and they appear identical. Both of these server sit behind a firewall. So my feeling is that only the firewall could be causing the idle timeout connections to be dropped on the test server.
Anyone have any ideas on this??
P.S. - I realize that killing idle connections is actually a good thing, but I'm trying to verify the reason for the difference and not whether this is or is not a good networking practice.The firewall could very well be the culprit. I had that problem at a previous employer. Why not check with your network guys and find out?

Inbound connection & MTTR problem

Dear Friends ,
I have to find the following errors in my production server . My oracle and server status is :
SQL> select * from v$version;
BANNER
Oracle Database 10g Enterprise Edition Release 10.2.0.1.0 - 64bi
PL/SQL Release 10.2.0.1.0 - Production
CORE 10.2.0.1.0 Production
TNS for IBM/AIX RISC System/6000: Version 10.2.0.1.0 - Productio
NLSRTL Version 10.2.0.1.0 - Production
The Errors are :
1)
FAST_START_MTTR_TARGET 12 is out of the valid MTTR range, use 310 instead.
Sat Jul 12 10:01:39 2008
FAST_START_MTTR_TARGET 12 is out of the valid MTTR range, use 307 instead.
Sat Jul 12 10:02:09 2008
I got this error frequently . here my "fast_start" parameters are as following :
SQL> show parameter fast_
NAME TYPE VALUE
fast_start_io_target integer 0
fast_start_mttr_target integer 12
fast_start_parallel_rollback string LOW
2) Another error is :
" WARNING: inbound connection timed out (ORA-3136)
Sat Jul 12 09:27:00 2008
WARNING: inbound connection timed out (ORA-3136)
Sat Jul 12 09:28:15 2008"
I also get this error frequently .
Can anybody plz help me ragarding this errors ? Waiting for ur kind reply .. ..

Hi
1) IIRC there is a bug related to this. Have a look to Metalink... you should be able to find it.
2) IMHO the error description says it all..
oracle@helicon:~/ [DBM10201] oerr ora 3136
03136, 00000, "inbound connection timed out"
// *Cause: Inbound connection was timed out by the server because
//          user authentication was not completed within the given time
//          specified by SQLNET.INBOUND_CONNECT_TIMEOUT or its default value
// *Action: 1) Check SQL*NET and RDBMS log for trace of suspicious connections.
//          2) Configure SQL*NET with a proper inbound connect timeout value
//             if necessary.HTH
Chris Antognini
Author of Troubleshooting Oracle Performance, Apress 2008 (http://top.antognini.ch)

WARNING: inbound connection timed out (ORA-3136)

While applying the patch i got the below error and database went down :
There are now 7638 jobs remaining (current phase=A8):
    8 running, 1537 ready to run and 6093 waiting.
Completed: file bencwbutils.pkb on worker 1 for product ben username BEN.
AutoPatch error:
adptaskGetTaskStatusID: Error while selecting from table AD_TASK_STATUS
AutoPatch error:
ORA-03113: end-of-file on communication channel
AutoPatch error:
adtmjob: Error calling adptaskGetTaskStatusID()
Telling workers to quit...
AutoPatch error:
The following ORACLE error:
ORA-03114: not connected to ORACLE
occurred while executing the SQL statement:
SET control_code = 'Q'
WHERE worker_id > 0
AND control_code <> 'A'
Telling workers to quit...
AutoPatch error:
The following ORACLE error:
ORA-03114: not connected to ORACLE
occurred while executing the SQL statement:
SET control_code = 'Q'
WHERE worker_id > 0
AND control_code <> 'A'
AutoPatch error:
Error running SQL and EXEC commands in parallel
You should check the file
/u01/applR12/apps/apps_st/appl/admin/PROD/log/7577660_3.log
for errors.
And when i checked the alert log file i got the below error :
WARNING: inbound connection timed out (ORA-3136)
Thu Nov 14 15:04:02 2013
WARNING: inbound connection timed out (ORA-3136)
Thu Nov 14 15:04:02 2013
WARNING: inbound connection timed out (ORA-3136)
Thu Nov 14 15:27:49 2013
Incremental checkpoint up to RBA [0x9.1475c3.0], current log tail at RBA [0x9.147e52.0]
Thu Nov 14 16:17:14 2013
Incremental checkpoint up to RBA [0x9.14bfd9.0], current log tail at RBA [0x9.1604e1.0]
Thu Nov 14 16:19:20 2013
ksvcreate: Process(q002) creation failed
Thu Nov 14 16:29:04 2013
ksvcreate: Process(q004) creation failed
Thu Nov 14 16:54:09 2013
Incremental checkpoint up to RBA [0x9.161455.0], current log tail at RBA [0x9.161455.0]
Thu Nov 14 17:38:52 2013
Incremental checkpoint up to RBA [0x9.169d06.0], current log tail at RBA [0x9.16d52c.0]
Thu Nov 14 18:28:38 2013
Incremental checkpoint up to RBA [0x9.172cae.0], current log tail at RBA [0x9.18b77f.0]
Thu Nov 14 19:45:51 2013
MMNL absent for 2813 secs; Foregrounds taking over
Thu Nov 14 19:45:55 2013
MMNL absent for 2819 secs; Foregrounds taking over
Thu Nov 14 19:45:55 2013
MMNL absent for 2819 secs; Foregrounds taking over
Thu Nov 14 20:46:23 2013
MMNL absent for 1364 secs; Foregrounds taking over
Thu Nov 14 20:47:36 2013
Process m000 died, see its trace file
Thu Nov 14 20:50:31 2013
ksvcreate: Process(m000) creation failed
Thu Nov 14 21:51:30 2013
Process startup failed, error stack:
Thu Nov 14 21:56:33 2013
MMNL absent for 5295 secs; Foregrounds taking over
Thu Nov 14 21:58:16 2013
MMNL absent for 5295 secs; Foregrounds taking over
Thu Nov 14 22:00:58 2013
MMNL absent for 4353 secs; Foregrounds taking over
Thu Nov 14 22:03:37 2013
MMNL absent for 4353 secs; Foregrounds taking over
Thu Nov 14 22:07:25 2013
PMON failed to acquire latch, see PMON dump
Thu Nov 14 22:07:37 2013
Errors in file /u01/oraR12/db/tech_st/10.2.0/admin/PROD_linux101/bdump/prod_psp0_6324.trc:
ORA-27300: OS system dependent operation:fork failed with status: 11
ORA-27301: OS failure message: Resource temporarily unavailable
ORA-27302: failure occurred at: skgpspawn5
Thu Nov 14 22:07:42 2013
ksvcreate: Process(q002) creation failed
Thu Nov 14 22:07:25 2013
MMNL absent for 4815 secs; Foregrounds taking over
Thu Nov 14 22:07:50 2013
MMNL absent for 4871 secs; Foregrounds taking over
MMNL absent for 4871 secs; Foregrounds taking over
MMNL absent for 4871 secs; Foregrounds taking over
Thu Nov 14 22:07:58 2013
MMNL absent for 4871 secs; Foregrounds taking over
Thu Nov 14 22:07:58 2013
MMNL absent for 4815 secs; Foregrounds taking over
Thu Nov 14 22:08:01 2013
Errors in file /u01/oraR12/db/tech_st/10.2.0/admin/PROD_linux101/bdump/prod_pmon_6322.trc:
ORA-00476: RECO process terminated with error
Thu Nov 14 22:08:16 2013
And in the /u01/oraR12/db/tech_st/10.2.0/admin/PROD_linux101/bdump/prod_pmon_6322.trc
[oracle@linux101 ~]$ tail -100f /u01/oraR12/db/tech_st/10.2.0/admin/PROD_linux101/bdump/prod_psp0_6324.trc
Dump file /u01/oraR12/db/tech_st/10.2.0/admin/PROD_linux101/bdump/prod_psp0_6324.trc
Oracle Database 10g Enterprise Edition Release 10.2.0.2.0 - Production
With the Partitioning, OLAP and Data Mining options
ORACLE_HOME = /u01/oraR12/db/tech_st/10.2.0
System name:    Linux
Node name: linux101.sri.com
Release:        2.6.18-164.el5
Version:        #1 SMP Tue Aug 18 15:51:54 EDT 2009
Machine:        i686
Instance name: PROD
Redo thread mounted by this instance: 1
Oracle process number: 3
Unix process pid: 6324, image: [email protected] (PSP0)
*** 2013-11-14 22:04:46.895
*** 2013-11-14 22:03:58.930
*** 2013-11-14 22:03:03.974
*** 2013-11-14 22:02:21.143
*** SERVICE NAME:(SYS$BACKGROUND) 2013-11-14 21:54:35.247
*** SESSION ID:(399.1) 2013-11-14 21:54:06.303
*** 2013-11-14 21:53:42.334
Process startup failed, error stack:
*** 2013-11-14 22:07:20.551
ORA-27300: OS system dependent operation:fork failed with status: 11
ORA-27301: OS failure message: Resource temporarily unavailable
ORA-27302: failure occurred at: skgpspawn5
And in sqlnet.ora
#$Header: NetServiceHandler.java 120.16 2006/12/12 06:15:41 nsugguna ship $
NAMES.DIRECTORY_PATH=(TNSNAMES, ONAMES, HOSTNAME)
SQLNET.EXPIRE_TIME= 10
IFILE=/u01/oraR12/db/tech_st/10.2.0/network/admin/PROD_linux101/sqlnet_ifile.ora
~
~
How to troubleshoot this. plz help me.
ThankQ.

Hi,
Please provide your environment details and mention what patch you are applying so that we may better assist you.
Thanks &
Best Regards,

Handling the ORA-12170: TNS:Connect timeout in a procedure

Post moved to:
Handling the ORA-12170: TNS:Connect timeout in a procedure
Edited by: John_75 on Jun 28, 2010 9:33 AM

http://download.oracle.com/docs/cd/B19306_01/network.102/b14212/troublestng.htm#i440403
will give you
http://download.oracle.com/docs/cd/B19306_01/network.102/b14212/troublestng.htm#CEGEDBIE

ORA-12170:TNS:Connect timeout occurred

Hi, I am no longer able to log into SQL Plus. I get the error message above. I think the problem comes from my comtputer being renamed. Can someone help me?
Thanks.

ORA-12170:TNS:Connect timeout occurred
Cause: The server shut down because connection establishment or communication with a client failed to complete within the allotted time interval. This may be a result of network or system delays; or this may indicate that a malicious client is trying to cause a Denial of Service attack on the server.
Action: If the error occurred because of a slow network or system, reconfigure one or all of the parameters SQLNET.INBOUND_CONNECT_TIMEOUT, SQLNET.SEND_TIMEOUT, SQLNET.RECV_TIMEOUT in sqlnet.ora to larger values. If a malicious client is suspected, use the address in sqlnet.log to identify the source and restrict access. Note that logged addresses may not be reliable as they can be forged (e.g. in TCP/IP).
1. Check whether database is up and running.
2. tnsping <databasename> and see whether you are able to ping the database in command prompt.
3. Check tnsnames are configured properly.
4. check DNS entry in your host file.
Regards,
Syed

Ora - 12170 - Connection Timeout

Hi,
Problem - I am using TOAD on my machine to connect to my database, but giving the error "Ora-12170, Connection Timeout".
Explanation - I have installed Oracle InstantClient 10.2 on local machine and using that home as default home to connect to target instance.
Here the thing is , I can able to PING to the UNIX box but can't able to make Database connection.
Have made PATH, LNS_LANG system variables...
Have created TNSNAME.Ora in instantClient with proper entries.
Any help is like wind of heaven... stucked here for long time...
Thanks & regards,
Madhav
Edited by: user13155845 on May 31, 2010 2:48 AM

do it in command promt.
tnsping EONVIS_11
if you are getting error while doing tnsping then port 1521 is not open or may be firewell issue.
if sqlnet.ora file in not there create it like this in ORACLE_HOME/network/admin location
for windows
# sqlnet.ora Network Configuration File: D:\oracle\product\10.1.0\db_1\network\admin\sqlnet.ora
# Generated by Oracle configuration tools.
SQLNET.AUTHENTICATION_SERVICES= (NTS)
NAMES.DIRECTORY_PATH= (TNSNAMES,EZCONNECT,NAMES)
for unix
# sqlnet.ora Network Configuration File: D:\oracle\product\10.1.0\db_1\network\admin\sqlnet.ora
# Generated by Oracle configuration tools.
NAMES.DIRECTORY_PATH= (TNSNAMES,EZCONNECT,NAMES)
Edited by: PrafullaNath on May 31, 2010 3:36 PM

Logging in Oeacle SQL*Plus (ORA-12170: TNS: Connect timeout occured) ...

I installed recently Oracle 10g. When I try to log in, with the account and password setup[ earlier, I get the message "ORA-12170: TNS: Connect timeout occured". Do I need to specify a Host String" at Log On? Should I un-install and re-install the software again? Thank you.

/* Error:     ORA-12170 (ORA-12170)
Text:     TNS:Connect timeout occurred
Cause:     The server shut down because connection establishment with a
     client failed to complete within the allotted time interval. This
     may be a result of network/system delays; or this may indicate
     that a malicious client is trying to cause a Denial of Service
     attack on the server.
Action:     If the error occurred because of a slow network/system,
     reconfigure the SQLNET.INBOUND_CONNECT_TIMEOUT parameter in
     sqlnet.ora to a larger value. If a malicious client is suspected,
     use the address in sqlnet.log to identify the source and restrict
     access. Note that logged addresses may not be reliable as they can
     be forged (e.g. in TCP/IP).
Could also be a firewall issue.
Werner

ORA-12170:TNS connect timeout occured.

HI, i am getting this error when trying to connect, sqlplus, form builder in devsuite.10.1.0
can anyone help, plz........................
ORA-12170:TNS connect timeout occured.
with regards,
AJAZ.

In $ORAHOME/network/admin on the machine where you have Forms Builder installed, there is a file called tnsnames.ora
This file maps the 'tns name' which you are probably using in your connect string, to a specific TCP/IP port (and 'service identifier') on the database host.
A TNS connect timeout could occur because:
a) a firewall is preventing communcation between your machine and the database host/port in your tns definition
b) the TNS 'listener' on the database host at that port is hung
For my money, I'd be investigating (a) first.
It's worth investing time in learning about TNS. It will save you a lot of hassle.
regards,
David.
(Please mark this post as 'helpful' if it put you on the right track ... thanks!).

ORA-3136 error in alert log file(EBS R12)

I have found ora-3136 alert log error in ebs r12 instance Can any one help on this error. Alert log continuously write this error. Below is the error i found.
Fatal NI connect error 12170.
VERSION INFORMATION:
        TNS for Linux: Version 11.1.0.7.0 - Production
        Oracle Bequeath NT Protocol Adapter for Linux: Version 11.1.0.7.0 - Production
        TCP/IP NT Protocol Adapter for Linux: Version 11.1.0.7.0 - Production
Time: 07-NOV-2013 18:33:49
Tracing not turned on.
Tns error struct:
    ns main err code: 12535
TNS-12535: TNS:operation timed out
    ns secondary err code: 12606
    nt main err code: 0
    nt secondary err code: 0
    nt OS err code: 0
Client address: (ADDRESS=(PROTOCOL=tcp)(HOST=172.17.100.108)(PORT=60495))
WARNING: inbound connection timed out (ORA-3136)

Does this affect the functionality of the application?
Do you get any errors when opening forms or self-service pages?
Please see:
ORA-01403 and FRM-40735 error occur while opening any forms (Doc ID 1358117.1)
Troubleshooting ORA-3135/ORA-3136 Connection Timeouts Errors - Database Diagnostics (Doc ID 730066.1)
ORA-3136/TNS-12535 or Hang Reported for Connections Across Firewall (Doc ID 974783.1)
Thanks,
Hussein

ORA-1555 ORA-3136 errors:: elapsed time vs Query Duration

Dear all,
- My Database version is 11.2.0.2, Solaris.
- We have been having a problem in the production database where the front end nodes start going up and down for couple of hours sometimes. ; When node flapping is going on we get connection timed out alerts.
WARNING: inbound connection timed out (ORA-3136) opiodr aborting
process unknown ospid (4342) as a result of ORA-609 opiodr aborting
process unknown ospid (4532) as a result of ORA-609 opiodr aborting
process unknown ospid (4534) as a result of ORA-609 opiodr aborting....
Since this week node flapping is happening every day. Since past 2 days after or during node flapping we are getting ORA-1555 error.
Extract from alert log error:
ORA-01555 caused by SQL statement below (SQL ID: g8804k5pkmtyt, Query Duration=19443 sec, SCN: 0x0001.07bd90ed):
SELECT d.devId, d.vendor, d.model, d.productClass, d.oui, d.parentDeviceId, d.created, d.lastModified AS devLastMod, d.customerId, d.userKey1, d.userKey2, d.userKey4, d
.userKey5, d.firmwareFamily, d.softwareVer, d.serialNum, d.ip, d.mac, d.userKey3, d.userKey6, d.provisioningId, d.status, d.classification, d.population, d.name, d.ipRe
solver, d.ipExpirationTime, d.geoLocationId,contact.firstContactTime, ifaces.id, ifaces.type AS ifaceType, ifaces.lastModified AS ifaceLastMod, ifaces.timeoutname, ifac
es.username1, ifaces.password1, ifaces.username2, ifaces.password2, ifaces.connReqUrl, ifaces.connReqScheme, ifaces.srvNonce, ifaces.deviceNonce, ifaces.phoneNumber,ifa
ces.bootstrapSecMethod, ifaces.srvAuthentication, ifaces.deviceAuthentication, ifaces.userPIN, ifaces.networkID, ifaces.omaSessionID, ifaces.portNum, ifaces.mgtIp, ifac
es.cmtsIp, ifaces.mgtReadCommunity, ifaces.mgtWriteCommunity, ifaces.cmtsReadCommunity, ifaces.cmtsWriteCommunity, devto.name AS devtoName, devto.rebootTimeout, devto.sessionInitiationI run Statspack report from the whole day duration, and looking into the elapsed time in seconds no more than 3739.61 sec (too lower than run duration in the alert log file of 19443 sec); So I would like to know if there is any co-relations between the ORA-3136 errors and the ORA-1555 errors?
   CPU                  CPU per             Elapsd                     Old
Time (s)   Executions Exec (s) %Total   Time (s)    Buffer Gets Hash Value
tTime <= :3 ) AND (endTime IS NULL OR endTime >= :4 )
   2773.77    7,787,914       0.00    3.4    3739.61     112,671,645 1909376826
Module: JDBC Thin Client
SELECT d.devId, d.vendor, d.model, d.productClass, d.oui, d.pare
ntDeviceId, d.created, d.lastModified AS devLastMod, d.customerI
d, d.userKey1, d.userKey2, d.userKey4, d.userKey5, d.firmwareFam
ily, d.softwareVer, d.serialNum, d.ip, d.mac, d.userKey3, d.user
SQL> show parameter UNDO_MANAGEMENT
NAME                                 TYPE        VALUE
undo_management                      string      AUTO
SQL> show parameter UNDO_RETENTION
NAME                                 TYPE        VALUE
undo_retention                       integer     10800BR,
Diego

Thank you. Please let me know if it is enough or you need more information;
SQL ordered by Gets DB/Inst: DB01/db01 Snaps: 14835-14846
-> End Buffer Gets Threshold:    100000 Total Buffer Gets:     677,689,568
-> Captured SQL accounts for   73.6% of Total Buffer Gets
-> SQL reported below exceeded 1.0% of Total Buffer Gets
                                                     CPU      Elapsd     Old
Buffer Gets    Executions Gets per Exec %Total Time (s) Time (s) Hash Value
     21,286,248    2,632,793            8.1    3.4   666.73    666.76 3610154549
Module: JDBC Thin Client
SELECT d.devId, d.vendor, d.model, d.productClass, d.oui, d.pare
ntDeviceId, d.created, d.lastModified AS devLastMod, d.customerI
d, d.userKey1, d.userKey2, d.userKey4, d.userKey5, d.firmwareFam
ily, d.softwareVer, d.serialNum, d.ip, d.mac, d.userKey3, d.user
     17,029,561    1,176,849           14.5    2.7   417.32    416.73 1909376826
Module: JDBC Thin Client
SELECT d.devId, d.vendor, d.model, d.productClass, d.oui, d.pare
ntDeviceId, d.created, d.lastModified AS devLastMod, d.customerI
d, d.userKey1, d.userKey2, d.userKey4, d.userKey5, d.firmwareFam
ily, d.softwareVer, d.serialNum, d.ip, d.mac, d.userKey3, d.user
     17,006,795           37      459,643.1    2.7   367.61    368.95 4045552861
Module: JDBC Thin Client
SELECT d.devId, d.vendor, d.model, d.productClass, d.oui, d.pare
ntDeviceId, d.created, d.lastModified AS devLastMod, d.customerI
d, d.userKey1, d.userKey2, d.userKey4, d.userKey5, d.firmwareFam
ily, d.softwareVer, d.serialNum, d.ip, d.mac, d.userKey3, d.userAnother Statspack report for the whole day shows;
SQL ordered by CPU DB/Inst: DB01/db01 Snaps: 14822-14847
-> Total DB CPU (s):          82,134
-> Captured SQL accounts for   40.9% of Total DB CPU
-> SQL reported below exceeded 1.0% of Total DB CPU
    CPU                  CPU per             Elapsd                     Old
Time (s)   Executions Exec (s) %Total   Time (s)    Buffer Gets Hash Value
tTime <= :3 ) AND (endTime IS NULL OR endTime >= :4 )
   2773.77    7,787,914       0.00    3.4    3739.61     112,671,645 1909376826
Module: JDBC Thin Client
SELECT d.devId, d.vendor, d.model, d.productClass, d.oui, d.pare
ntDeviceId, d.created, d.lastModified AS devLastMod, d.customerI
d, d.userKey1, d.userKey2, d.userKey4, d.userKey5, d.firmwareFam
ily, d.softwareVer, d.serialNum, d.ip, d.mac, d.userKey3, d.user
SQL ordered by Gets DB/Inst: DB01/db01 Snaps: 14822-14847
-> End Buffer Gets Threshold:    100000 Total Buffer Gets:   1,416,456,340
-> Captured SQL accounts for   55.8% of Total Buffer Gets
-> SQL reported below exceeded 1.0% of Total Buffer Gets
                                                     CPU      Elapsd     Old
Buffer Gets    Executions Gets per Exec %Total Time (s) Time (s) Hash Value
     86,354,963    7,834,326           11.0    6.3 2557.34   2604.08 906944860
Module: JDBC Thin Client
SELECT d.devId, d.vendor, d.model, d.productClass, d.oui, d.pare
ntDeviceId, d.created, d.lastModified AS devLastMod, d.customerI
d, d.userKey1, d.userKey2, d.userKey4, d.userKey5, d.firmwareFam
ily, d.softwareVer, d.serialNum, d.ip, d.mac, d.userKey3, d.user
.....BR,
Diego
Edited by: 899660 on 27-ene-2012 7:43
Edited by: 899660 on 27-ene-2012 7:45

Ora-3136 then ksvcreate: Process(m000) creation failed and db hangs

Recently upgraded a large database from 10.2.0.4.0 to 10.2.0.5.0.
The database recevies many thousand short-lived connections per minute.
Since the upgrade we're repeatedly running into this problem
Symptoms are that the incoming sessions will start to time out with ora-3136, then the alert log will show
ksvcreate: Process(m000) creation failed
then finally existying connections will freeze and no more connections can be established. I can't even get in to shut the db down normally - i have to kill pmon to get to the point where i can restart it.
Typical alert log pattern:
Thu Feb 02 02:26:51 PST 2012
WARNING: inbound connection timed out (ORA-3136)
Thu Feb 02 02:31:21 PST 2012
ksvcreate: Process(m000) creation failed
Thu Feb 02 02:33:29 PST 2012
ksvcreate: Process(m000) creation failed
Thu Feb 02 02:35:36 PST 2012
kkjcre1p: unable to spawn jobq slave process
Thu Feb 02 02:35:36 PST 2012
Errors in file /scratch/jdevadf/oracle/product/10.2.0/admin/srg102/bdump/srg102_cjq0_5920.trc:
If i look in that file, i get this:
/scratch/jdevadf/oracle/product/10.2.0/admin/srg102/bdump/srg102_cjq0_5920.trc
Oracle Database 10g Enterprise Edition Release 10.2.0.5.0 - 64bit Production
With the Partitioning, OLAP, Data Mining and Real Application Testing options
ORACLE_HOME = /scratch/jdevadf/oracle/product/10.2.0
System name: Linux
Node name: dadvil0075
Release: 2.6.32-100.26.2.el5
Version: #1 SMP Tue Jan 18 20:11:49 EST 2011
Machine: x86_64
Instance name: srg102
Redo thread mounted by this instance: 1
Oracle process number: 10
Unix process pid: 5920, image: oracle@dadvil0075 (CJQ0)
*** 2012-02-01 21:34:08.175
*** SERVICE NAME:(SYS$BACKGROUND) 2012-02-01 21:34:08.149
*** SESSION ID:(3992.1) 2012-02-01 21:34:08.149
ssd_unwind_bp: unhandled instruction at 0x2fb3962 instr=f
*** 2012-02-02 02:34:29.355
Waited for process J001 to initialize for 60 seconds
*** 2012-02-02 02:34:29.362
Process diagnostic dump for J001, OS id=25477
loadavg : 5.22 3.75 3.36
Memory (Avail / Total) = 755.21M / 11706.12M
Swap (Avail / Total) = 1904.80M / 2047.34M
F S UID PID PPID C PRI NI ADDR SZ WCHAN STIME TTY TIME CMD
0 S jdevadf 25477 1 0 80 0 - 680831 semtim 02:33 ? 00:00:00 ora_j001_srg102
Stack:
[Thread debugging using libthread_db enabled]
0x00000038556d5497 in semop () from /lib64/libc.so.6
#0 0x00000038556d5497 in semop () from /lib64/libc.so.6
#1 0x0000000003d91322 in sskgpwwait ()
#2 0x0000000003d73d7a in skgpwwait ()
#3 0x00000000007acf87 in kslges ()
#4 0x00000000007ac8f0 in kslgetl ()
#5 0x0000000000777a37 in kstipg ()
#6 0x0000000000813aaa in ksucrp ()
#7 0x0000000002498644 in kkjrdp ()
#8 0x00000000030b98c7 in opirip ()
#9 0x00000000013a4a2b in opidrv ()
#10 0x0000000001f9e66e in sou2o ()
#11 0x000000000072d2c5 in opimai_real ()
#12 0x000000000072d17c in main ()
A debugging session is active.
Inferior 1 [process 25477] will be detached.
Quit anyway? (y or n) [answered Y; input not from terminal]
Process diagnostic dump actual duration=1.190000 sec
(max dump time=30.000000 sec)
*** 2012-02-02 02:34:30.544
*** 2012-02-02 02:34:40.555
Waited for process J001 to initialize for 70 seconds
*** 2012-02-02 02:34:40.555
Process diagnostic dump for J001, OS id=25477
loadavg : 4.80 3.71 3.35
Memory (Avail / Total) = 728.61M / 11706.12M
Swap (Avail / Total) = 1904.81M / 2047.34M
F S UID PID PPID C PRI NI ADDR SZ WCHAN STIME TTY TIME CMD
0 S jdevadf 25477 1 0 80 0 - 680831 semtim 02:33 ? 00:00:00 ora_j001_srg102
Stack:
[Thread debugging using libthread_db enabled]
0x00000038556d5497 in semop () from /lib64/libc.so.6
#0 0x00000038556d5497 in semop () from /lib64/libc.so.6
#1 0x0000000003d91322 in sskgpwwait ()
#2 0x0000000003d73d7a in skgpwwait ()
#3 0x00000000007acf87 in kslges ()
#4 0x00000000007ac8f0 in kslgetl ()
#5 0x0000000000777a37 in kstipg ()
#6 0x0000000000813aaa in ksucrp ()
#7 0x0000000002498644 in kkjrdp ()
#8 0x00000000030b98c7 in opirip ()
#9 0x00000000013a4a2b in opidrv ()
#10 0x0000000001f9e66e in sou2o ()
#11 0x000000000072d2c5 in opimai_real ()
#12 0x000000000072d17c in main ()
A debugging session is active.
Inferior 1 [process 25477] will be detached.
Quit anyway? (y or n) [answered Y; input not from terminal]
[repeated for several processes]
I can upload the files or they are available on the internal network.
Initially i thought it was bug 8426816, but that's supposed to be included in the 10.2.0.5.0 patchset.

Hi;
Symptoms are that the incoming sessions will start to time out with ora-3136, then the alert log will show
ksvcreate: Process(m000) creation failedDid you check note Troubleshooting Guide (TSG) - ksvcreate: Process(xxxx) creation failed [ID 1379200.1] ?
Regard
Helios

Inbound connection timed out and TNS:operation timed out in Oracle 11g

Hello All,
We are getting the below messages in alert log since yesterday... And we could not see any other messages other than this...Users also complaining slow response from DB,
Could any one please help me to resolve this ...? I believe in 11g inbound connection time out is deprecated ..isn't it ...?
VERSION INFORMATION:
TNS for Linux: Version 11.2.0.2.0 - Production
Oracle Bequeath NT Protocol Adapter for Linux: Version 11.2.0.2.0 - Production
TCP/IP NT Protocol Adapter for Linux: Version 11.2.0.2.0 - Production
Time: 18-NOV-2011 01:54:50
Tracing not turned on.
Tns error struct:
ns main err code: 12535
TNS-12535: TNS:operation timed out
ns secondary err code: 12560
nt main err code: 505
TNS-00505: Operation timed out
nt secondary err code: 110
nt OS err code: 0
Client address: (ADDRESS=(PROTOCOL=tcp)(HOST=10.21.0.159)(PORT=4789))
Fri Nov 18 09:43:04 2011
Fatal NI connect error 12170.
VERSION INFORMATION:
TNS for Linux: Version 11.2.0.2.0 - Production
Oracle Bequeath NT Protocol Adapter for Linux: Version 11.2.0.2.0 - Production
TCP/IP NT Protocol Adapter for Linux: Version 11.2.0.2.0 - Production
Time: 18-NOV-2011 09:43:04
Tracing not turned on.
Tns error struct:
ns main err code: 12535
TNS-12535: TNS:operation timed out
ns secondary err code: 12606
nt main err code: 0
nt secondary err code: 0
nt OS err code: 0
Client address: (ADDRESS=(PROTOCOL=tcp)(HOST=10.25.1.65)(PORT=50839))
WARNING: inbound connection timed out (ORA-3136)

889828 wrote:
Hello All,
We are getting the below messages in alert log since yesterday... And we could not see any other messages other than this...Users also complaining slow response from DB,
Could any one please help me to resolve this ...? I believe in 11g inbound connection time out is deprecated ..isn't it ...?
VERSION INFORMATION:
TNS for Linux: Version 11.2.0.2.0 - Production
Oracle Bequeath NT Protocol Adapter for Linux: Version 11.2.0.2.0 - Production
TCP/IP NT Protocol Adapter for Linux: Version 11.2.0.2.0 - Production
Time: 18-NOV-2011 01:54:50
Tracing not turned on.
Tns error struct:
ns main err code: 12535
TNS-12535: TNS:operation timed out
ns secondary err code: 12560
nt main err code: 505
TNS-00505: Operation timed out
nt secondary err code: 110
nt OS err code: 0
Client address: (ADDRESS=(PROTOCOL=tcp)(HOST=10.21.0.159)(PORT=4789))
Fri Nov 18 09:43:04 2011
Fatal NI connect error 12170.
VERSION INFORMATION:
TNS for Linux: Version 11.2.0.2.0 - Production
Oracle Bequeath NT Protocol Adapter for Linux: Version 11.2.0.2.0 - Production
TCP/IP NT Protocol Adapter for Linux: Version 11.2.0.2.0 - Production
Time: 18-NOV-2011 09:43:04
Tracing not turned on.
Tns error struct:
ns main err code: 12535
TNS-12535: TNS:operation timed out
ns secondary err code: 12606
nt main err code: 0
nt secondary err code: 0
nt OS err code: 0
Client address: (ADDRESS=(PROTOCOL=tcp)(HOST=10.25.1.65)(PORT=50839))
WARNING: inbound connection timed out (ORA-3136)The most common cause for this error is a firewall between clint & DB Server;
which allows packets on port #1521, but does not allow DB Server to use new high random port.

Connection timeout error while refreshing a deski report

Hi All,
When I tried to refresh a report I'm getting the following error.
" Exception: DBD, ORA-12170: TNS:Connect timeout occurred State: N/A"
Can any one tell me how to over come it.
BO S/W DETAILS: boxi R3.1
DATABASE: Oracle 10g
Thanks in Advance,
Suresh Aluri.

Hi,
The issue seems to be at the database level.
Please chk this link: http://www.dba-oracle.com/t_ora_12170_tns_connect_timeout.htm
Suggest you to check with the DBA team.
Regards

Oracle 9.0.1 on Solaris/SPARC infinite connection timeouts

Hello, All!
I have the following system configuration:
Solaris 5.9 Maintenance Update 4;
Sun Ultra 10, 1 UltraSPARC IIi 440Mhz CPU, 1024M RAM;
Oracle 9.0.1 (9i Release 1).
The database was created with JServer option turned on (we're using the integrated CORBA functionality); archive log mode is OFF, database cache advice is ON.
In a nutshell,
==============
the problem is in really infinite connection timeouts of Oracle after a long time of inactivity (say, on Monday after two weekend days).
Long description.
=================
Client-side symptoms.
First, I tried to establish a connection to a published CORBA object, and received no response (I am already waiting for 1 hour 40 minutes).
Then, I tried to connect to the database with SQLPlus, remotely:
$ sqlplus /nolog
SQL> CONNECT SYS/change_on_install@ORCL AS SYSDBA;
All the same, I receive no reply. However, the listener is alive, I can establish a network connection to both ports 1521 and 2481. Client-side logs (specified via sqlnet.ora) say the following:
=========== skipped ===========
[09-АВГ-2004 10:27:24:770] nioqsn: entry
[09-АВГ-2004 10:27:24:770] nioqsn: exit
[09-АВГ-2004 10:27:24:770] nioqrc: entry
[09-АВГ-2004 10:27:24:771] nsdo: cid=0, opcode=84, bl=0, what=1, uflgs=0x20, c
[09-АВГ-2004 10:27:24:771] nsdo: rank=64, nsctxrnk=0
[09-АВГ-2004 10:27:24:771] nsdo: nsctx: state=8, flg=0x400d, mvd=0
[09-АВГ-2004 10:27:24:771] nsdo: gtn=127, gtc=127, ptn=10, ptc=2011
[09-АВГ-2004 10:27:24:771] nsdofls: DATA flags: 0x0
[09-АВГ-2004 10:27:24:771] nsdofls: sending NSPTDA packet
[09-АВГ-2004 10:27:24:771] nspsend: plen=770, type=6
[09-АВГ-2004 10:27:24:771] nttwr: entry
[09-АВГ-2004 10:27:24:771] nttwr: socket 12 had bytes written=770
[09-АВГ-2004 10:27:24:771] nttwr: exit
[09-АВГ-2004 10:27:24:771] nspsend: 770 bytes to transport
[09-АВГ-2004 10:27:24:772] nsdo: nsctxrnk=0
[09-АВГ-2004 10:27:24:772] nsdo: cid=0, opcode=85, bl=0, what=0, uflgs=0x0, cf
[09-АВГ-2004 10:27:24:772] nsdo: rank=64, nsctxrnk=0
[09-АВГ-2004 10:27:24:772] nsdo: nsctx: state=8, flg=0x400d, mvd=0
[09-АВГ-2004 10:27:24:772] nsdo: gtn=127, gtc=127, ptn=10, ptc=2011
[09-АВГ-2004 10:27:24:772] nsdo: switching to application buffer
[09-АВГ-2004 10:27:24:772] nsrdr: recving a packet
[09-АВГ-2004 10:27:24:772] nsprecv: reading from transport...
[09-АВГ-2004 10:27:24:772] nttrd: entry
If I try to connect to the database locally, I receive the same result:
$ sqlplus /nolog
SQL> CONNECT / AS SYSDBA;
-- no reply.
Server-side symptoms.
Oracle logs in ${ORACLE_BASE}/admin/ORCL have no entries referring the last two days. Oracle server debug log (specified via sqlnet.ora) says the following:
========== skipped ===================
nttrd: socket 20 had bytes read=181
nttrd: exit
nsprecv: 181 bytes from transport
nsprecv: tlen=181, plen=181, type=6
nsrdr: got NSPTDA packet
nsrdr: NSPTDA flags: 0x0
nsdo: what=1, bl=2009
nsdo: nsctxrnk=0
nioqrc: exit
nioqsn: entry
nioqrc: entry
nsdo: cid=0, opcode=84, bl=0, what=1, uflgs=0x20, cflgs=0x3
nsdo: rank=64, nsctxrnk=0
nsdo: nsctx: state=8, flg=0x420c, mvd=0
nsdo: gtn=156, gtc=156, ptn=10, ptc=2019
nsdofls: DATA flags: 0x0
nsdofls: sending NSPTDA packet
nspsend: plen=93, type=6
nttwr: entry
nttwr: socket 20 had bytes written=93
nttwr: exit
nspsend: 93 bytes to transport
nsdo: nsctxrnk=0
nsdo: cid=0, opcode=85, bl=0, what=0, uflgs=0x0, cflgs=0x3
nsdo: rank=64, nsctxrnk=0
nsdo: nsctx: state=8, flg=0x420c, mvd=0
nsdo: gtn=156, gtc=156, ptn=10, ptc=2019
nsdo: switching to application buffer
nsrdr: recving a packet
nsprecv: reading from transport...
nttrd: entry
nttrd: socket 20 had bytes read=770
nttrd: exit
nsprecv: 770 bytes from transport
nsprecv: tlen=770, plen=770, type=6
nsrdr: got NSPTDA packet
nsrdr: NSPTDA flags: 0x0
nsdo: what=1, bl=2009
nsdo: nsctxrnk=0
nioqrc: exit
Oracle local client debug log (oracle enterprise manager runs on the same machine) says:
...nsevwait: nsevwait: nsevwait: nsevwait: nsevwait:
nsevwait: nsevwait: nsevwait: nsevwait: nsevwait:
nsevwait: nsevwait: nsevwait: nsevwait: nsevwait: ...
ps -e -o "user,pid,pcpu,pmem,rss,vsz,args" says there're several (3) processes running as oracle, with "args" oracle_ORCL, which eat up nearly all available memory (they have "pmem" values of 25, 25 and 17 per cent, respectively). One of these processes has "pcpu" value varying from 97% to 100%, moreover, this is a user, NOT system time (according to sdtperfmeter, disk/page/swap activity is extremely low; system load holds at value of 4). Here is a sample vmstat output:
cpu
cs us sy id
287 99 1 0
285 100 0 0
280 100 0 0
272 100 0 0
298 98 2 0
275 99 1 0
267 100 0 0
307 97 3 0
282 100 0 0
270 100 0 0
307 98 2 0
287 100 0 0
Here cs is the number of cpu context switches per second;
us is cpu user time;
sy is cpu system time.
The question is: what oracle may be doing and how can I fix the problem?
Thanks in advance.

Now, 3 hours later, the first two (of three) connections got established, but subsequent database queries are in the same nearly dead state.
CPU usage remains about 100%, system load 4.
I know that oracle restart (and/or system restart) will cure the problem -- but only until next weekend.
Can this be oracle misconfiguration?

Inbound Connection Timeout ORA-3136

Similar Messages

Maybe you are looking for