ORA-16198: Timeout incurred on internal channel during remote archival

Hello All,
I have a unique issue with Streams
I am trying to replicate my source database to another database using SYNC method.
I have standby logs in place at my target database with same size as online log files on source, but when LGWR tries to write to the Standby logs , it fails with the following error with LNSb
LNSb: connect status = 0
*** 2014-01-06 10:14:39.111
ksedmp: internal or fatal error
ORA-00600: internal error code, arguments: [kcrrnsfwa.15], [4294967104], [512],
I also see the below errors at LNs trace file
kcrrfail: dest:2 err:16198 force:0 blast:1
*** 2014-01-06 10:21:56.523
ERROR: Receive timedout!
Error 16198 attaching RFS server to standby instance at host 'strm10r'
*** 2014-01-06 10:14:49.121 59313 kcrr.c
Making upidhs request to LNSb (ocis 0xffffffff7a424a00). Begin time is <01/06/20
NetServer pid:22413
*** 2014-01-06 10:14:49.122 64896 kcrr.c
LGWR: Error 16164 disconnecting from destination LOG_ARCHIVE_DEST_2 standby host
Error 16198 attaching to destination LOG_ARCHIVE_DEST_2 standby host 'strm10r'
*** 2014-01-06 10:14:49.122 64896 kcrr.c
LGWR: Error 16198 creating archivelog file 'strm10r'
ORA-16198: Timeout incurred on internal channel during remote archival
*** 2014-01-06 10:14:49.129 63005 kcrr.c
kcrrfail: dest:2 err:16198 force:0 blast:1
*** 2014-01-06 10:21:56.523
Warning: log write time 770ms, size 8561KB
*** 2014-01-06 10:21:57.645
Warning: log write time 1110ms, size 11229KB
*** 2014-01-06 10:21:58.815
Warning: log write time 900ms, size 3331KB
*** 2014-01-06 10:29:27.707
Warning: log write time 1260ms, size 455KB
*** 2014-01-06 12:07:56.726
Warning: log write time 3240ms, size 76KB
*** 2014-01-06 12:15:25.634
*** 2014-01-06 10:14:39.091 58444 kcrr.c
upiahm connect done status is 0
Receiving message from LNSb
*** 2014-01-06 10:14:49.121
LGWR found LNSb has shutdown or timedout
*** 2014-01-06 10:14:49.121 64896 kcrr.c
ORA-16198: LGWR received timedout error from KSR
ERROR: Receive timedout!
Error 16198 attaching RFS server to standby instance at host 'strm10r'
*** 2014-01-06 10:14:49.121 59313 kcrr.c
Making upidhs request to LNSb (ocis 0xffffffff7a424a00). Begin time is <01/06/20
14 10:14:35> and NET_TIMEOUT <180> seconds
Waiting for LNSb to initialize itself
*** 2014-01-06 10:14:38.790 57777 kcrr.c
Netserver LNSb [pid 22413] for mode SYNC has been initialized
Performing a channel reset to ignore previous responses
Successfully started LNSb [pid 22413] for dest strm10r mode SYNC ocis=0xffffffff
7a424a00
*** 2014-01-06 10:14:38.790 58280 kcrr.c
Making upiahm request to LNSb [pid 22413]: Begin Time is <01/06/2014 10:14:35>.
NET_TIMEOUT = <180> seconds
Waiting for LNSb to respond to upiahm
*** 2014-01-06 10:14:39.091 58444 kcrr.c
upiahm connect done status is 0
Receiving message from LNSb
*** 2014-01-06 10:14:49.121
LGWR found LNSb has shutdown or timedout
*** 2014-01-06 10:14:49.121 64896 kcrr.c
ORA-16198: LGWR received timedout error from KSR
ERROR: Receive timedout!
Error 16198 attaching RFS server to standby instance at host 'strm10r'
IF any one has any suggestions regarding this error , please let me know. I checked and created password files at both source and destinations, also there are enough standby logfiles at the destination ,
Other thing is , I have streams working in other servers, its only with this particular server , I am not able to replicate, Let me know if you guys need any other information.
Thanks,
Krishna

Hi Krishna,
The slowness may caused by:
1. Operating System. Please keep track of OS usage (like iostat).
2. Network. Please keep track network flow (like tcpdump).
Note: Please don't use SYNC log transport mode across a wide area network (WAN) with latencies above 10ms.
Also check below:
Bug 9259587 - Multiple LGWR reconnect attempts in Data Guard MAXIMUM_AVAILABILITY (Doc ID 9259587.8)
Bug is fixed in 11.2.0.2

Similar Messages

ORA-03113 end-of-file on channel communication

Hello at everyone:
I have a laptop pentium 133 MMX, 40 MB Ram, 2.1 GB.
I have been installed slackware 3.5, kernel 2.0.36, on it and
oracle 8 too.
I run svrmgrl, connect internal, everithing go well, but when
write the command "startup nomount" <ENTER>, oracle begin to work
and 2 seconds after, more or less, appear the message of the
subject.
I found the possibly means of this:
ORA-03113: end-of-file on communication channel
Cause: An unexpected end-of-file was processed on the
communication channel. The problem could not be handled by the
Net8, two task, software. This message could occur if the shadow
two-task process associated with a Net8 connect has terminated
abnormally, or if there is a physical failure of the interprocess
communication vehicle, that is, the network or server machine
went down.
Action: If this message occurs during a connection attempt, check
the setup files for the appropriate Net8 driver and confirm Net8
software is correctly installed on the server. If the message
occurs after a connection is well established, and the error is
not due to a physical failure, check if a trace file was
generated on the server at failure time. Existence of a trace
file may suggest an Oracle internal error that requires the
assistance of customer support.
------------------------------------------<^
This possibility, above |, i guess that not apply, because, i
work in any network, everything is local.
------------------------------------------<ORA-3113: end of file communication channel
Cause: An unexpected end-of-file was processed on the
communication channel. The TCP/IP retransmission count on Win
NT/95 has a default value of 5. This means that the send side
retransmits the packet five times or until it gets an
acknowledgment. The timeout for each retransmission is two times
the timeout for the previous retransmission (exponential
backoff). With the default value of 5, the send side retransmits
5 times (approximately. 15 seconds) and if it does not get an
acknowledgment. it assumes that the other side is down and closes
the connection. If the link goes down for a minute or two the
Net8 client receives this error.
Action: Modify the retransmission count.
Please see your Microsoft specific operating system manual for
more information on tuning the microsoft TCP/IP software.
----------------------------------------------<I got it from Oracle 8 documentation for W95/NT. I guess that it
is a good posibility. But how can to modify the retransmission
count under Linux?
This is the alert_UNIX.log
Sun Feb 21 21:54:35 1999
Shutting down instance (abort)
Sun Feb 21 21:55:34 1999
Starting ORACLE instance (normal)
LICENSE_MAX_SESSION = 0
LICENSE_SESSIONS_WARNING = 0
LICENSE_MAX_USERS = 0
Starting up ORACLE RDBMS Version: 8.0.5.0.0.
System parameters with non-default values:
processes = 50
shared_pool_size = 3500000
control_files = ora_control1, ora_control2
db_block_buffers = 100
log_buffer = 8192
log_checkpoint_interval = 10000
db_files = 80
db_file_multiblock_read_count= 8
sequence_cache_entries = 10
sequence_cache_hash_buckets= 10
global_names = TRUE
db_name = UNIX
parallel_max_servers = 5
max_dump_file_size = 10240
Sun Feb 21 21:55:37 1999
Errors in file
/usr/local/apps/oracle/product/8.0.5/rdbms/log/ora_unix_1534.trc:
ORA-07445: exception encountered: core dump [11] [43] [] [] [] []
Shutting down instance (abort)
License high water mark = 0
Instance terminated by USER, pid = 1538
And that is the ora_unix_1534.trc:
Dump file
/usr/local/apps/oracle/product/8.0.5/rdbms/log/ora_unix_1534.trc
Oracle8 Release 8.0.5.0.0 - Production
PL/SQL Release 8.0.5.0.0 - Production
ORACLE_HOME = /usr/local/apps/oracle/product/8.0.5
System name: Linux
Node name: wired
Release: 2.0.35
Version: #1 Sat Feb 20 08:41:09 COT 1999
Machine: i586
Instance name: UNIX
Redo thread mounted by this instance: 0 <none>
Oracle process number: 0
Unix process pid: 1534, image: oracleUNIX
Exception signal: 11, code = 2b
ORA-07445: exception encountered: core dump [11] [43] [] [] [] []
----- Call Stack Trace -----
calling call entry argument
values in hex
location type point (? means
dubious value)
ssexhd()+221 CALL ksedst()+0 40033DFC ? 400
----- Argument/Register Address Dump -----
Argument/Register addr=40033dfc. Dump of memory from 40033DBC to
40033EFC
40033DA0
00000000
40033DC0 00000000 0000007E 000003A3 00000000 00000036 00000461
00000661 000006EF
40033DE0 00000000 00000000 00000208 000000F2 000002FF 000000F0
000002B6 00000000
40033E00 00000000 00000000 00000000 00000001 00091250 00000000
FFF10011 0000000A
40033E20 00090560 00000000 FFF10011 00000020 00015D50 00000031
000B0012 00000034
40033E40 0008320C 00000031 000C0012 0000003A 000912D8 00000004
00170011 00000040
40033E60 000912D8 00000004 00170011 00000047 00090544 00000000
FFF10011 0000005E
40033E80 00090550 00000000 FFF10011 00000074 00015D84 00000049
000B0012 00000080
40033EA0 00083240 0000000B 000D0011 0000008F 0008324B 00000006
000D0011 0000009E
40033EC0 00015DD0 0000002A 000B0012 000000B3 000659B0 00000046
000B0022 000000BB
40033EE0 00015DFC 0000001C 000B0012 000000C7 0005A2C0 0000003F
000B0012
----- End of Call Stack Trace -----
===================================================
PROCESS STATE
Process global information:
process: 0, call: 0, xact: 0, curses: 0, usrses: 0
No process is allocated.
END OF PROCESS STATE
******************** Cursor Dump ************************
No curdef array
ssexhd: crashing the process...
Shadow_Core_Dump = full
Well, i have been installed oracle 8 succesfully in my Desktop
PC, with oracle working well, i can3t understand what happened in
my laptop.
My Desktop, 48 Mb, 4.5 GB, Pentium 166 MMX, Slackware 3.3, kernel
2.0.36.
Thanks in advanced, for your attention and help.
null

ORA-00600/ORA-07445/ORA-03113 = Oracle bug => search on Metalink and/or call Oracle support

ORA-02049: timeout: distributed transaction waiting for lock

Hi,
My name is Guneet and I'm working on an application running on BEA Weblogic Server 9.2 running on a Red Hat Linux box using Oracle 10g as the database. My problem is that recently our code started getting the following exception while updating a database table.
java.sql.SQLException: [BEA][Oracle JDBC Driver][Oracle]ORA-02049: timeout: distributed transaction waiting for lock
Application Details
* Using Stateless Session EJB
* Only one Business method in this EJB with transaction attribute set to "required"
* This method executes two select queries & one update query
* We are using JDBC to access the database.
* We have configured a Data Source & are using it to get a database connection.
* Weblogic's Oracle Driver is being used.
More details
* The application has been running well since a month.
* Two days ago,the update query failed with the above error.
* At that time, a single client was accessing the system.
* Once this problem occurs, it starts appearing frequently.
* Eventually a request to get a connection from the Data Source times out & the exception copied at the end is thrown
* At this stage the application gets stuck and all requests trying to get a connection end up with this exception.
* Fortunately, Restarting the Weblogic Server gets us out of this problem and transactions resume normally.
Now my questions are
# Why is this error happening & what does it mean?
# It looks like the second exception (unable to get a connection from ds) is an after effect of the first problem (ORA-02049) once it appears for a couple of times. Can somebody validate this?
# Though I don't understand JTA well but I don't think this application needs distributed transactions so, I'm thinking of modifying the driver type to non-XA oracle driver. Any advise/pointers/comments on this front is welcome !!!!!!!!
Thanks
Guneet Sahai
Exception Trace
Dec 27, 2006 4:47:50 PM | com.gisil.themis.db | SEVERE | Unable to load merchant DEL = 911168900164. Reason - java.sql.SQLException: Unexpected exception while enlisting XAConnection java.sql.SQLException: XA error: XAResource.XAER_RMERR start() failed on resource 'themis-ds': XAER_RMERR : A resource manager error has occured in the transaction branch
javax.transaction.xa.XAException: Unexpected error during start for XAResource 'themis-ds': Transaction timed out after 29 seconds
BEA1-252DE51AC930078CA638
at weblogic.jdbc.wrapper.XA.createException(XA.java:103)
at weblogic.jdbc.jta.DataSource.start(DataSource.java:753)
at weblogic.transaction.internal.XAServerResourceInfo.start(XAServerResourceInfo.java:1182)
at weblogic.transaction.internal.XAServerResourceInfo.xaStart(XAServerResourceInfo.java:1115)
at weblogic.transaction.internal.XAServerResourceInfo.enlist(XAServerResourceInfo.java:274)
at weblogic.transaction.internal.ServerTransactionImpl.enlistResource(ServerTransactionImpl.java:497)
at weblogic.transaction.internal.ServerTransactionImpl.enlistResource(ServerTransactionImpl.java:429)
at weblogic.jdbc.jta.DataSource.enlist(DataSource.java:1408)
at weblogic.jdbc.jta.DataSource.refreshXAConnAndEnlist(DataSource.java:1332)
at weblogic.jdbc.jta.DataSource.getConnection(DataSource.java:440)
at weblogic.jdbc.jta.DataSource.connect(DataSource.java:396)
at weblogic.jdbc.common.internal.RmiDataSource.getConnection(RmiDataSource.java:359)
at com.gisil.themis.db.impl1.DbManagerImpl.isPinValid(DbManagerImpl.java:872)
at com.gisil.themis.ejb.ThemisBean.isPinValid(ThemisBean.java:185)
at com.gisil.themis.ejb.Themis_aqqc4k_EOImpl.isPinValid(Themis_aqqc4k_EOImpl.java:207)
at com.gisil.themis.ejb.Themis_aqqc4k_EOImpl_WLSkel.invoke(Unknown Source)
at weblogic.rmi.internal.BasicServerRef.invoke(BasicServerRef.java:517)
at weblogic.rmi.cluster.ClusterableServerRef.invoke(ClusterableServerRef.java:224)
at weblogic.rmi.internal.BasicServerRef$1.run(BasicServerRef.java:407)
at weblogic.security.acl.internal.AuthenticatedSubject.doAs(AuthenticatedSubject.java:363)
at weblogic.security.service.SecurityManager.runAs(SecurityManager.java:147)
at weblogic.rmi.internal.BasicServerRef.handleRequest(BasicServerRef.java:403)
at weblogic.rmi.internal.BasicServerRef.access$300(BasicServerRef.java:56)
at weblogic.rmi.internal.BasicServerRef$BasicExecuteRequest.run(BasicServerRef.java:934)
at weblogic.work.ExecuteThread.execute(ExecuteThread.java:209)
at weblogic.work.ExecuteThread.run(ExecuteThread.java:181)
at weblogic.jdbc.jta.DataSource.enlist(DataSource.java:1413)
at weblogic.jdbc.jta.DataSource.refreshXAConnAndEnlist(DataSource.java:1332)
at weblogic.jdbc.jta.DataSource.getConnection(DataSource.java:440)
at weblogic.jdbc.jta.DataSource.connect(DataSource.java:396)
at weblogic.jdbc.common.internal.RmiDataSource.getConnection(RmiDataSource.java:359)
at com.gisil.themis.db.impl1.DbManagerImpl.isPinValid(DbManagerImpl.java:872)
at com.gisil.themis.ejb.ThemisBean.isPinValid(ThemisBean.java:185)
at com.gisil.themis.ejb.Themis_aqqc4k_EOImpl.isPinValid(Themis_aqqc4k_EOImpl.java:207)
at com.gisil.themis.ejb.Themis_aqqc4k_EOImpl_WLSkel.invoke(Unknown Source)
at weblogic.rmi.internal.BasicServerRef.invoke(BasicServerRef.java:517)
at weblogic.rmi.cluster.ClusterableServerRef.invoke(ClusterableServerRef.java:224)
at weblogic.rmi.internal.BasicServerRef$1.run(BasicServerRef.java:407)
at weblogic.security.acl.internal.AuthenticatedSubject.doAs(AuthenticatedSubject.java:363)
at weblogic.security.service.SecurityManager.runAs(SecurityManager.java:147)
at weblogic.rmi.internal.BasicServerRef.handleRequest(BasicServerRef.java:403)
at weblogic.rmi.internal.BasicServerRef.access$300(BasicServerRef.java:56)
at weblogic.rmi.internal.BasicServerRef$BasicExecuteRequest.run(BasicServerRef.java:934)
at weblogic.work.ExecuteThread.execute(ExecuteThread.java:209)
at weblogic.work.ExecuteThread.run(ExecuteThread.java:181)

guneet sahai wrote:
Hi,
My name is Guneet and I'm working on an application running on BEA Weblogic Server 9.2 running on a Red Hat Linux box using Oracle 10g as the database. My problem is that recently our code started getting the following exception while updating a database table.
java.sql.SQLException: [BEA][Oracle JDBC Driver][Oracle]ORA-02049: timeout: distributed transaction waiting for lock
Application Details
* Using Stateless Session EJB
* Only one Business method in this EJB with transaction attribute set to "required"
* This method executes two select queries & one update query
* We are using JDBC to access the database.
* We have configured a Data Source & are using it to get a database connection.
* Weblogic's Oracle Driver is being used.
More details
* The application has been running well since a month.
* Two days ago,the update query failed with the above error.
* At that time, a single client was accessing the system.
* Once this problem occurs, it starts appearing frequently.
* Eventually a request to get a connection from the Data Source times out & the exception copied at the end is thrown
* At this stage the application gets stuck and all requests trying to get a connection end up with this exception.
* Fortunately, Restarting the Weblogic Server gets us out of this problem and transactions resume normally.
Now my questions are
# Why is this error happening & what does it mean?
# It looks like the second exception (unable to get a connection from ds) is an after effect of the first problem (ORA-02049) once it appears for a couple of times. Can somebody validate this?
# Though I don't understand JTA well but I don't think this application needs distributed transactions so, I'm thinking of modifying the driver type to non-XA oracle driver. Any advise/pointers/comments on this front is welcome !!!!!!!!
Thanks
Guneet SahaiHi Guneet. If you want to debug the JTA issue, I suggest opening an official
support case. They will lead you through producing the JTA debug information.
However, I believe you are correct that the transaction you describe is
completely doable with a simple local transaction, so if you were to alter
your pool to use the non-XA driver, it would probably be faster, simpler,
and just work.
Let me know...
Joe
>
Exception Trace
Dec 27, 2006 4:47:50 PM | com.gisil.themis.db | SEVERE | Unable to load merchant DEL = 911168900164. Reason - java.sql.SQLException: Unexpected exception while enlisting XAConnection java.sql.SQLException: XA error: XAResource.XAER_RMERR start() failed on resource 'themis-ds': XAER_RMERR : A resource manager error has occured in the transaction branch
javax.transaction.xa.XAException: Unexpected error during start for XAResource 'themis-ds': Transaction timed out after 29 seconds
BEA1-252DE51AC930078CA638
at weblogic.jdbc.wrapper.XA.createException(XA.java:103)
at weblogic.jdbc.jta.DataSource.start(DataSource.java:753)
at weblogic.transaction.internal.XAServerResourceInfo.start(XAServerResourceInfo.java:1182)
at weblogic.transaction.internal.XAServerResourceInfo.xaStart(XAServerResourceInfo.java:1115)
at weblogic.transaction.internal.XAServerResourceInfo.enlist(XAServerResourceInfo.java:274)
at weblogic.transaction.internal.ServerTransactionImpl.enlistResource(ServerTransactionImpl.java:497)
at weblogic.transaction.internal.ServerTransactionImpl.enlistResource(ServerTransactionImpl.java:429)
at weblogic.jdbc.jta.DataSource.enlist(DataSource.java:1408)
at weblogic.jdbc.jta.DataSource.refreshXAConnAndEnlist(DataSource.java:1332)
at weblogic.jdbc.jta.DataSource.getConnection(DataSource.java:440)
at weblogic.jdbc.jta.DataSource.connect(DataSource.java:396)
at weblogic.jdbc.common.internal.RmiDataSource.getConnection(RmiDataSource.java:359)
at com.gisil.themis.db.impl1.DbManagerImpl.isPinValid(DbManagerImpl.java:872)
at com.gisil.themis.ejb.ThemisBean.isPinValid(ThemisBean.java:185)
at com.gisil.themis.ejb.Themis_aqqc4k_EOImpl.isPinValid(Themis_aqqc4k_EOImpl.java:207)
at com.gisil.themis.ejb.Themis_aqqc4k_EOImpl_WLSkel.invoke(Unknown Source)
at weblogic.rmi.internal.BasicServerRef.invoke(BasicServerRef.java:517)
at weblogic.rmi.cluster.ClusterableServerRef.invoke(ClusterableServerRef.java:224)
at weblogic.rmi.internal.BasicServerRef$1.run(BasicServerRef.java:407)
at weblogic.security.acl.internal.AuthenticatedSubject.doAs(AuthenticatedSubject.java:363)
at weblogic.security.service.SecurityManager.runAs(SecurityManager.java:147)
at weblogic.rmi.internal.BasicServerRef.handleRequest(BasicServerRef.java:403)
at weblogic.rmi.internal.BasicServerRef.access$300(BasicServerRef.java:56)
at weblogic.rmi.internal.BasicServerRef$BasicExecuteRequest.run(BasicServerRef.java:934)
at weblogic.work.ExecuteThread.execute(ExecuteThread.java:209)
at weblogic.work.ExecuteThread.run(ExecuteThread.java:181)
at weblogic.jdbc.jta.DataSource.enlist(DataSource.java:1413)
at weblogic.jdbc.jta.DataSource.refreshXAConnAndEnlist(DataSource.java:1332)
at weblogic.jdbc.jta.DataSource.getConnection(DataSource.java:440)
at weblogic.jdbc.jta.DataSource.connect(DataSource.java:396)
at weblogic.jdbc.common.internal.RmiDataSource.getConnection(RmiDataSource.java:359)
at com.gisil.themis.db.impl1.DbManagerImpl.isPinValid(DbManagerImpl.java:872)
at com.gisil.themis.ejb.ThemisBean.isPinValid(ThemisBean.java:185)
at com.gisil.themis.ejb.Themis_aqqc4k_EOImpl.isPinValid(Themis_aqqc4k_EOImpl.java:207)
at com.gisil.themis.ejb.Themis_aqqc4k_EOImpl_WLSkel.invoke(Unknown Source)
at weblogic.rmi.internal.BasicServerRef.invoke(BasicServerRef.java:517)
at weblogic.rmi.cluster.ClusterableServerRef.invoke(ClusterableServerRef.java:224)
at weblogic.rmi.internal.BasicServerRef$1.run(BasicServerRef.java:407)
at weblogic.security.acl.internal.AuthenticatedSubject.doAs(AuthenticatedSubject.java:363)
at weblogic.security.service.SecurityManager.runAs(SecurityManager.java:147)
at weblogic.rmi.internal.BasicServerRef.handleRequest(BasicServerRef.java:403)
at weblogic.rmi.internal.BasicServerRef.access$300(BasicServerRef.java:56)
at weblogic.rmi.internal.BasicServerRef$BasicExecuteRequest.run(BasicServerRef.java:934)
at weblogic.work.ExecuteThread.execute(ExecuteThread.java:209)
at weblogic.work.ExecuteThread.run(ExecuteThread.java:181)

Patch 9239090 - ORA-04021: timeout occurred while waiting to lock object

Hello Guys,
I need help urgently to comlete an upgrade of ebs 12.1.1 to 12.1.3.
We are upgrading ebs 11i to 12i going live this weekend. We have encountered "ORA-04021: timeout occurred while waiting to lock object" on patch 9239090 with two Workers:
In adctrl:
1 Run AutoPatch R120 AFUTLGRS.pls FAILED
2 Run AutoPatch R120 AFUTLOGS.pls FAILED
sqlplus -s APPS/***** @/u02/applfinp/apps/apps_st/appl/admin/OFPROD/out/p001invok.sql
Connected.
create or replace package wf_bes_cleanup AUTHID CURRENT_USER as
ERROR at line 1:
ORA-04021: timeout occurred while waiting to lock object
I have done everything everything imaginable but cannot get pass these 2 failed workers.
1) I have checked are there are no locks blocking on any objects:
select s1.username || '@' || s1.machine
|| ' ( SID=' || s1.sid || ' ) is blocking '
|| s2.username || '@' || s2.machine || ' ( SID=' || s2.sid || ' ) ' AS blocking_status
from v$lock l1, v$session s1, v$lock l2, v$session s2
where s1.sid=l1.sid and s2.sid=l2.sid
and l1.BLOCK=1 and l2.request > 0
and l1.id1 = l2.id1
and l2.id2 = l2.id2 ;
2) I also checked and there is space in the database.
3) From adctrl, I have tried restarting the jobs one by one but the worker 1 hangs at and eventually fails on several (12) attempts.
4) The solution on Doc ID 1291064.1 is not the problem:
SQL> select SUPPLEMENTAL_LOG_DATA_MIN, SUPPLEMENTAL_LOG_DATA_PK, SUPPLEMENTAL_LOG_DATA_UI, FORCE_LOGGING
from v$database;
SUPPLEME SUP SUP FOR
NO NO NO NO
5) Manual execution still gave ORA-04021:
sqlplus -s APPS/apps @/u02/applfinp/apps/apps_st/appl/admin/OFPROD/out/p001invok.sql
sqlplus -s APPS/apps @/u02/applfinp/apps/apps_st/appl/admin/OFPROD/out/p002invok.sql
6) The alert log has no related errors
7) I Finally, after over 6 hours of waiting, I could only get the patch to continue after by using adctrl option 8 to skip these two workers.
After proceeding, I have yet hit two more errors and now stuck:
I have hit another error with the same patch:
create or replace package body FND_LOG as
/* $Header: AFUTLOGB.pls 120 ...
AD Worker error:
ORA-04021: timeout occurred while waiting to lock object
Unable to process file in PACKAGE mode.
Not converting file for Invoker's Rights because it appears to be a package body creation script (based on the filename).
File is: /u02/applfinp/apps/apps_st/appl/fnd/12.0.0/patch/115/sql/AFUTLOGB.pls
AD Worker warning:
Product Data File
/u02/applfinp/apps/apps_st/appl/admin/xniprod.txt
does not exist for product "xni".
This product is registered in the database but the above file does not exist in APPL_TOP. The product will be ignored without error
AD Worker error:
The following ORACLE error:
ORA-04063: package body "APPS.FND_LOG" has errors
ORA-06508: PL/SQL: could not find program unit being called: "APPS.FND_LOG"
ORA-06512: at "APPS.FND_FUNCTION", line 834
ORA-06512: at "APPS.FND_MENU_ENTRIES_C_DELTRG", line 4
ORA-04088: error during execution of trigger 'APPS.FND_MENU_ENTRIES_C_DELTRG'
Can I stop and restart this patch 9239090?

Hello,
I later executed the failed jobs or scripts manually (successfully) for the patch to continue
sqlplus -s APPS/apps @/u02/applfinp/apps/apps_st/appl/admin/OFPROD/out/p001invok.sql
sqlplus -s APPS/apps @/u02/applfinp/apps/apps_st/appl/admin/OFPROD/out/p002invok.sql
The patch ended with the following :
The following Oracle Reports objects did not generate successfully:
ap reports/US APXARATE.rdf
ar reports/US ARXCTA.rdf
fa reports/US FASRSVED.rdf
ont reports/US OEXOEORD.rdf
pa reports/US PAXACMPT.rdf
pa reports/US PAXALRUN.rdf
pa reports/US PAXACRPT.rdf
pa reports/US PAXCPGAL.rdf
pa reports/US PAXPCRFD.rdf
The patch execution ended but the patch number is not record in apps.ad_bugs table:
select TO_CHAR(CREATION_DATE,'dd-Mon-yyyy, hh24:mm:ss'), BUG_NUMBER from apps.ad_bugs where bug_number in ('9239090');
no rows selected
JFI
Patches located in ad_applied_patches to which there is no a corresponding record in ad_bugs:
SQL> SELECT a.patch_name, TO_CHAR(max(a.last_update_date),'dd-Mon-yyyy, hh24:mm:ss')
2 FROM applsys.ad_applied_patches a
3 WHERE NOT EXISTS (SELECT '1'
4 FROM ad_bugs b
5 WHERE b.bug_number = a.patch_name)
6 group by a.patch_name;
PATCH_NAME TO_CHAR(MAX(A.LAST_UP
9239090 26-Oct-2013, 00:10:27
AutoConfig 25-Oct-2013, 17:10:51
merger9179588 25-Oct-2013, 11:10:30
merger_post_5903765 27-Apr-2013, 23:04:45
mergeu6678700 25-Oct-2013, 16:10:09
What could have happened that this was not recorded in ad_bugs?
How to I get this recorded in the ad_bugs table?
Thanks
Mathias

ORA-03111: break received on communication channel

We have recently migrated the weblogic from 8.1 to 10.3.2 which using for backend of java application. I am getting the error message "ORA-03111: break received on communication channel" often but it was working well before the weblogic upgrade. As per recommendations, I increased the JTA timeout in web logic server even though the error is still persisting.
Please let me know if any suggestions to sort out this issue.

http://royontechnology.blogspot.com/2009/06/mysterious-ora-03111-error.html
see here
ORA-03111: break received on communication channel
google helps
looks like you have to review your JDBC configuration

Error while transporting objects:Internal error during pvc call: Parameter

Dear all,
We are facing the following error while transporting the individual configuration objects from our PI development system.
Export failed: Internal error during pvc call: Parameter versionSpecifier or version has the invalid value null .
However, it works fine when the complete configuration scenario is transported.
We tried to transport the objects with different user id's, even then the issue still exists.
Any inputs to resolve this will be highly helpful.
Thank you,
Younus

Hi Mohammed,
Answer is inside this oss [Note 1554387 - Error during export from Integration Directory|https://service.sap.com/sap/support/notes/1554387]. In this oss note, solution is to apply a patch (just a patch, not a SP). as it's a litle sap bug...
Note: your issue is also explained with picture in this one "1550549 - PI transport: Internal error during pvc call" (sorry for this one I cannot insert a link)
regards
Mickael
Edited by: Mickael Huchet on Jan 26, 2012 2:50 PM

Ora-04021 timeout occurred while waiting to lock object

Hai All
When adding a column into a table then an error comes error
Error Message:
ORA-04021: timeout occurred while waiting to lock object .....
How it happens ...what is the solution....please help
Shiju..

Hi
Identify the session that is using this object, kill it and then perform the ALTER table... or wait until the session that is accessing this table release it.
Rgds
Adnan

Internal error during pvc call: No space left on device (errno:28)

Hi
When we am exproting the objects ( using File System) we are getting the following error
Internal error during pvc call: No space left on device (errno:28) For more information, see the server log.
Please help us how to resolve this problem
Thanks & Regards
Sowmya

Hi
Check with the export directory file system. Looks like space issue for the .tpz you are trying to export.
Thanks
Gaurav

VLD-1141: Internal error during mapping generation.

I am getting the "VLD-1141: Internal error during mapping generation" error when deploying a mapping. This mapping was previously working fine. As part of a re-factoring effort, for all the underlying tables and views, we replace 2 existing columns with a new column. All the objects were successfully re-imported and synchronized in the mapping. The mapping is using Mapping Input Parameter, Lookups, Expression Transformations, Splitter, Set Operator, Source & Target Tables. All these transformation were part of the earlier working version of the mapping.
On doing validation within the mapping, I get a success message followed by 4 warning for the Lookup Condition on key Lookup does not contain a complete unique key. Before the re-factoring effort, I was getting the same 4 warning messages, however the mapping was executing correctly.
When I do Generate within the mapping, I get the following message:
Code cannot be generated.
Click the message tab for details.
In the Design Center, when I do a validation on the mapping I get the following error:
VLD-1141: Internal error during mapping generation.
java.lang.NullPointerException
at oracle.wh.service.impl.mapping.component.Sequence.getSequenceExpressions(Sequence.java:138)
at oracle.wh.service.impl.mapping.component.Sequence.doSequenceValidation(Sequence.java:239)
at oracle.wh.service.impl.mapping.component.entity.EntitySqlDelegate.prepareOutputContext2(EntitySqlDelegate.java:123)
at oracle.wh.service.impl.mapping.component.entity.EntitySqlDelegate.prepareOutputContext2(EntitySqlDelegate.java:97)
at oracle.wh.service.impl.mapping.component.entity.EntitySqlDelegate.prepareOutputContext(EntitySqlDelegate.java:78)
at oracle.wh.service.impl.mapping.generation.WBMappingGenerator.generate(WBMappingGenerator.java:240)
at oracle.wh.service.impl.mapping.generation.PlSqlGenerationMediator.assembleSetBasedInternal(PlSqlGenerationMediator.java:2108)
at oracle.wh.service.impl.mapping.generation.PlSqlGenerationMediator.assembleSetBased(PlSqlGenerationMediator.java:2090)
at oracle.wh.service.impl.mapping.generation.PlSqlGenerationMediator.assemble(PlSqlGenerationMediator.java:541)
at oracle.wh.service.impl.mapping.generation.WBMappingGenerator.generate(WBMappingGenerator.java:798)
at oracle.wh.service.impl.mapping.generation.WBMappingGenerator.generate(WBMappingGenerator.java:335)
at oracle.wh.service.impl.mapping.generation.WBDeployableMappingGenerator.generate(WBDeployableMappingGenerator.java:102)
at oracle.wh.service.impl.generation.common.WBGenerationService.generateCode(WBGenerationService.java:433)
at oracle.wh.service.impl.generation.common.WBGenerationService.generateCode(WBGenerationService.java:311)
at oracle.wh.service.impl.generation.service.WhValidationGenerationTransaction.run(WhValidationGenerationTransaction.java:251)
Any help in this regards would be appreciated.
Naval

Hi,
I think your mapping is corrupted by converting two columns to one. The owb has always a problem if you change the structure of a table which is bound to a table operator. The way to avoid this is to drop the table operator after changing the table in the table editor and recreate it with the changed table definition.
Make a test: select the new attribut in the table operator and look left on the configuration window. To which table and attribute it's bound?
Regards,
Detlef

How to get the field name of an internal table during runtime?

How to get the field name of an internal table during runtime?

Hi Sudhir,
Declare and Use Get Cursor Field in Your Prm to get the field Name of the Intenal Table
Example Code:
 DATA: v_field(60). " Insert this code.
 GET CURSOR FIELD v_field. " Insert this code.
 CHECK v_field = 'ITAB-KUNNR'. " Insert this code. (or)
Write: v_field.
Regards,
Ramganesan K.

Internal error during pricing in CRM service order

Hello Guys,
   Here is an issue when i add line item in service order, it pops up with an error message " Internal error during pricing "at header & line item. Its observed that output tax condition type MWST is not called from TTE. Pricing procedure has picked up perfectly & even TTE setting is maintained which in turn calls Tax Calculation procedure 11000. But then we are unable to trace where system is falling to call MWST condition type. Request you to guide me on the issue.
Regards
Devika.S

Hi Devika,
please refer to following SAP notes:
559836          FAQ: tips & tricks for CRM pricing
559876          FAQ: Tricks and hints for the error analysis in pricing
559866          FAQ: tips & tricks for the IPC installation
best regards,
Johannes

EXP-00056: ORACLE error 4021 encountered ORA-04021: timeout occurred while

hi all oracle gurus ,
i have this problem which i am facing its like this.i have a batch file that runs export every night one week back it was all okay .few days back when i looked the log files it gives me this error ---EXP-00056: ORACLE error 4021 encountered
ORA-04021: timeout occurred while waiting to lock object
what should i do this is a production database runing in windows platform and there is no backup pls help me .....
export log file -------
Connected to: Oracle Database 10g Enterprise Edition Release 10.1.0.2.0 - Production
With the Partitioning, OLAP and Data Mining options
Export done in AL32UTF8 character set and AL16UTF16 NCHAR character set
About to export specified users ...
. exporting pre-schema procedural objects and actions
. exporting foreign function library names for user PILOT
. exporting foreign function library names for user FINANCE
. exporting foreign function library names for user MBCNEWS
. exporting PUBLIC type synonyms
. exporting private type synonyms
. exporting PUBLIC type synonyms
. exporting private type synonyms
. exporting PUBLIC type synonyms
. exporting private type synonyms
. exporting object type definitions for user PILOT
. exporting object type definitions for user FINANCE
. exporting object type definitions for user MBCNEWS
About to export PILOT's objects ...
. exporting database links
. exporting sequence numbers
. exporting cluster definitions
EXP-00056: ORACLE error 4021 encountered
ORA-04021: timeout occurred while waiting to lock object
ORA-06512: at "SYS.DBMS_METADATA", line 1511
ORA-06512: at "SYS.DBMS_METADATA", line 1548
ORA-06512: at "SYS.DBMS_METADATA", line 1864
ORA-06512: at "SYS.DBMS_METADATA", line 3707
ORA-06512: at "SYS.DBMS_METADATA", line 3689
ORA-06512: at line 1
EXP-00000: Export terminated unsuccessfully
robyav

this is a production database runing in windows platform and there is no backup
what should iWell first of all you should stop using EXP for backups, it's quite unsuitable, and start using RMAN instead. Find out more.
If you have a Metalink account you shoudl read Note:298968.1. But teh headline is there is a bug in 10gR1 which is fixed in 10gR2. This may not help you much. The workaround is to try running the export again later, which may not be any more helpful.
Cheers, APC

Prob in IR :Internal error during bean lookup for bean RepObjectAccessBean

Hi,
I am facing the problem in IR .
Internal error during bean lookup for bean RepObjectAccessBean
is the Error window I am getting frequently, After getting this error, It is no allowing to open any of the IR Objects.
Thanks in advance,
Dhanabal T

Hi Dhanabal,
i got the same error. But it is clear.
Please chek once ur configuration part. The error is in configuration part only.
once check all the steps in ur configuration part.
REgards,
chandra.

MSG-00000: ORA-20001: -: XLA-95103: An internal error occurred

hi All,
OS OUL5x64
ebs r12 12.1.1
we applied patch # 9325101 and have about 32 invalid packages and manually compile and now only 12 invalid packages left.
one of the post installation was to run
XLAABACR module: Validate Application Accounting Definitions
when running this program we receive error below.
can someone please help.
Thanks,
MSG-00000: ORA-20001: -: XLA-95103: An internal error occurred. Please inform your system administrator or support representative that:
An internal error has occurred in the program xla_compile_pad_pkg.CompileProductRule. ORA-06508: PL/SQL: could not find program unit being
ORA-06512: at "APPS.XLA_AMB_AAD_PKG", line 2192
REP-1419: 'beforereport': PL/SQL program aborted.
REP-0069: Internal error
REP-57054: In-process job terminated:Terminated with error:
REP-1419: MSG-00000: ORA-20001: -: XLA-95103: An internal error occurred. Please inform your system administrator or support representative that:
An internal error has occurred in the program xla_compile_pad_pkg.CompileProductRule. ORA-06508: PL/SQL: could not find program unit being
ORA-06512: at "APPS.XLA_AMB_AAD_PKG", line 2192
REP-1419: 'beforereport': PL/SQL program aborted.

Hi,
we applied patch # 9325101 and have about 32 invalid packages and manually compile and now only 12 invalid packages left.Please compile the invalid objects manually and post the error here.
one of the post installation was to run
XLAABACR module: Validate Application Accounting Definitions
when running this program we receive error below.
can someone please help.
Thanks,
MSG-00000: ORA-20001: -: XLA-95103: An internal error occurred. Please inform your system administrator or support representative that:See if these documents help.
Note: 472564.1 - R12 XLAABACR Error XLA-95103 When Attempting to Validate Application Accounting Definitions
Note: 601318.1 - R12 Validate Application Accounting Definitions FAQs
Note: 1073855.1 - Application Accounting Definition fails due to XLA_CMP_CREATE_PKG
Thanks,
Hussein

ORA-04021:timeout...

Hi guys,
I have a problem: when I try to replace or delete a package I recive
an error message ORA-04021: timeout occurred while waiting to lock object XXX
Of course it's becouse this package is used by another session.
In v$access table I've found out whitch session it is, but I don't
know how to kill or stop this session to allowed replacing of package.
I killed the session and its status is marked as killed but the
package is still used.
Pls help me it's very important. Any solution how to compile this
package is welcomed. Restart of database doesn't help, I tried :-(
Thanx a lot.

Most likely, the problem is that someone else in some other session is calling your procedure, which prevents you from locking it in order to run DDL against it. If this is a busy system, you'll likely have to wait for a downtime window in order to run your DDL. If this is not a busy system, you may be able to just retry the operation.
Justin

ORA-16198: Timeout incurred on internal channel during remote archival

Similar Messages

Maybe you are looking for