Apply processes aborted with ORA-12805 error

After regular load on a replication system for a couple days, apply processes aborted with
ORA-12805: parallel query server died unexpectedly, and restarting of the apply processes
works but the error come back a couple days later.
I adjusted multiple apply parameters such as PARALLELISM, COMMIT_SERIALIZATION and DYNAMICSTMTS, but none of them can resolve the issue.
there are CLOB columns in replicated tables.

Read the following thread.
ORA-12805: parallel query server died unexpectedly
kapil

Similar Messages

Capture process aborted with ORA-00604

Hi all,
I am new to oracle streams and trying to set up streams on single DB instance
from one schema to other.
the capture process always aborts with the following error messsages as soon as i make change in the associated table.I was following the demo in the link
http://blogs.ittoolbox.com/oracle/guide/archives/oracle-streams-configuration-change-data-capture-13501.
I executed exec DBMS_CAPTURE_ADM.BUILD();
procedure also for setting up the log miner data dictionary but it also does not help.
ORA-00604: error occurred at recursive SQL level 1
ORA-00979: not a GROUP BY expression
ORA-06512: at "SYS.LOGMNR_KRVRDLUID3", line 1799
ORA-06512: at line 1
Any one can help me on this,since i am stuck here.
thanks in advance.

I would use 10.2.0.3 version with Streams. Just install patch and verify if problem is still exists.
Serge

Apply process is aborting with:ORA-12801: error signaled in parallel query

hi,
We created a queue of a specific type, capture and apply process on the queue. Then we started the queue capture and the apply process. The problem is that the apply process is getting enabled and with in moments going into aborted state. wea re getting the follwoing error:
ORA-12801: error signaled in parallel query server P000
ORA-00600: internal error code, arguments: [kwqiceval:anyconv], [], [], [], [], [], [], []
Any idea what could have gone wrong?
scripts:
exec dbms_aqadm.create_queue_table(queue_table=>'qt_anc',queue_payload_type=>'type_anc',multiple_consumers=> true, compatible => '9.0');
exec dbms_aqadm.create_queue (queue_name => 'q_anc',queue_table=>'qt_anc');
EXEC DBMS_AQADM.START_QUEUE (queue_name => 'q_anc');
DECLARE
emp_rule_name_dml VARCHAR2(300);
emp_rule_name_ddl VARCHAR2(300);
BEGIN
DBMS_STREAMS_ADM.ADD_TABLE_RULES(
table_name => 'ops.t_anc',
streams_type => 'capture',
streams_name => 'capture_anc',
queue_name => 'strmadmin.q_anc',
include_dml => true,
include_ddl => false,
source_database => null,
dml_rule_name => emp_rule_name_dml,
ddl_rule_name => emp_rule_name_ddl);
DBMS_APPLY_ADM.SET_ENQUEUE_DESTINATION(
rule_name => emp_rule_name_dml,
destination_queue_name => 'strmadmin.q_anc');
END;
DECLARE
emp_rule_name_dml VARCHAR2(300);
emp_rule_name_ddl VARCHAR2(300);
BEGIN
DBMS_STREAMS_ADM.ADD_TABLE_RULES(
table_name => 'ops.t_anc',
streams_type => 'apply',
streams_name => 'apply_anc',
queue_name => 'strmadmin.q_anc',
include_dml => true,
include_ddl => false,
source_database => null,
dml_rule_name => emp_rule_name_dml,
ddl_rule_name => emp_rule_name_ddl);
DBMS_APPLY_ADM.SET_ENQUEUE_DESTINATION(
rule_name => emp_rule_name_dml,
destination_queue_name => 'strmadmin.q_anc');
END;
BEGIN
DBMS_APPLY_ADM.START_APPLY(
apply_name => 'apply_anc');
END;
BEGIN
DBMS_CAPTURE_ADM.START_CAPTURE(
capture_name => 'capture_anc');
END;
/

Hello
The above configuration is never supported. The implicit capture expects the queue payload to be SYS.ANYDATA and same with implicit apply also.
However you can use Streams Messaging capability to achieve this. You need to wrap the messages with SYS.ANYDATA for this to work. The implicit capture uses a persistent logminer session to generate LCRs and it then wraps it with SYS.ANYDATA and enqueues into the capture queue, it then propagated to apply queue. You can generate LCRs and wrap it with SYS.ANYDATA and then enqueue into the capture queue then apply can recognise the messages.
Here is an example on creating LCRs (tested in 10g):
CREATE TABLE lcr_test (col1 NUMBER);
DECLARE
     l_lcr SYS.LCR$_ROW_RECORD;
BEGIN
     l_lcr :=
SYS.LCR$_ROW_RECORD.CONSTRUCT
     source_database_name=>SYS_CONTEXT('USERENV','DB_NAME'),
     command_type=>'INSERT',
     object_owner=>USER,
     object_name=>'LCR_TEST'
     l_lcr.ADD_COLUMN('new','col1',SYS.AnyData.ConvertNumber(99));
     l_lcr.EXECUTE(TRUE);
     COMMIT;
END;
SELECT * FROM lcr_test;
Converting to SYS.ANYDATA:
DECLARE
     l_lcr SYS.LCR$_ROW_RECORD;
     l_anydata SYS.ANYDATA;
BEGIN
     l_lcr :=
SYS.LCR$_ROW_RECORD.CONSTRUCT
     source_database_name=>SYS_CONTEXT('USERENV','DB_NAME'),
     command_type=>'INSERT',
     object_owner=>USER,
     object_name=>'LCR_TEST'
     l_lcr.ADD_COLUMN('new','col1',SYS.AnyData.ConvertNumber(99));
     l_anydata:=SYS.ANYDATA.ConvertObject(l_lcr);
     ENQ_PROC(l_anydata);
     COMMIT;
END;
Thanks,
Rijesh

Capture process aborts with logminer error

Hi,
We have set up streams on Oracle10g instance on a machine with 4 CPUs. The capture and propagate processes have been configured on this instance ( this instance has the initialization parameter "parallel_max_servers" set to 5)
The capture process frequently aborted with the following error in the alert log.
Thu Nov 10 13:23:07 2005
Errors in file /oracle/apps/oracle/product/101/admin/seqprod/bdump/seqprod_p001_24657.trc:
ORA-01341: LogMiner out-of-memory
Thu Nov 10 13:23:08 2005
TLCR process death detected. Shutting down TLCR
Thu Nov 10 13:23:10 2005
Streams CAPTURE C001 with pid=36, OS id=24213 stopped
The executed the query : select * from V$RESOURCE_LIMIT where resource_name in ('processes', 'sessions', 'enqueue_resources', 'parallel_max_servers');
The values of max_utilization and initial_allocation columns for the resource "parallel_max_servers" gives the values 5 and 5 respectively.
So, we increased the value of the parameter from 5 to 8 and restarted the instance ( some of the initialization parameters are : )
processes = 1500
sga_max_size = 7650410496
__shared_pool_size = 855638016
__large_pool_size = 16777216
__java_pool_size = 16777216
streams_pool_size = 218103808
job_queue_processes = 12
parallel_max_servers = 8
pga_aggregate_target = 1695547392
The capture process aborted again in 1.5 hrs time with the same error.
The executed the query : select * from V$RESOURCE_LIMIT where resource_name in ('processes', 'sessions', 'enqueue_resources', 'parallel_max_servers');
The values of max_utilization and initial_allocation columns for the resource "parallel_max_servers" gives the values 8 and 8 respectively.
My queries are :
1. Could parallel_max_servers be the cause of the capture abort?
2. Can the parameter "parallel_max_servers" be further increased without affecting the CPU load ?
3. Could there be other parameters affecting the capture process. ?
Thanx.

Did you try configuring streams pool size parameter of your database? I 've set this value to 200MB, the shared-pool-size is 1Gigabyte and the problem has not been encountered since then. If streams-shared-pool size is not set then the capture uses 10 percent of your shared pool size for the buffer queues eventually leading to low memory for logminer session. If streams-pool is set the capture uses the memory from SGA directyl without affecting the shared-pool size.
~Raj

Build process aborting due to following error

I should also probably add that machines usually build fine, it's only been with this new batch of PCs that the build has been failing.

So I'm trying to build a machine over the network, (the operating system I'm installing is Windows 7 Professional) however I'm getting this error message when building a machine from our new batch of PCs;
'Build process aborting due to following error:
Disk partitioning/formatting exception: VDS API
IVdsCreatePartitionEz::CreatePartitionEx returned 0x80042571 size = 45788 MB,
offset = 1 MB, format = 39'
Any suggestions greatly appreciated.
This topic first appeared in the Spiceworks Community

Creating database problem with ORA-01519: error while processing file '' ne

Dear all,
I am having rough time with creating database manually. can anyone help me with the following errors.
ALERT LOGFILE:-
Sun May 31 12:00:39 2009
Errors in file d:\oracle\product\10.1.0\admin\oracle5\udump\oracle5_ora_3444.trc:
ORA-01501: CREATE DATABASE failed
ORA-01519: error while processing file '%ORACLE_HOME%\RDBMS\ADMIN\SQL.BSQ' near line 5744
ORA-00604: error occurred at recursive SQL level 1
ORA-01119: error in creating database file 'D:\oracle\product\10.1.0\oradata\ORACLE5 \datafile\undotbs1.dbf'
ORA-27040: file create error, unable to create file
OSD-04002: unable to open file
O/S-Error: (OS 3) The system cannot find the path specified.
Error 1519 happened during db open, shutting down database
USER: terminating instance due to error 1519
Sun May 31 12:00:39 2009
Errors in file d:\oracle\product\10.1.0\admin\oracle5\bdump\oracle5_reco_3416.trc:
ORA-01519: error while processing file '' near line
CREATE DATABASE SCRIPT:-
create database ORACLE5
user sys identified by bala
user system identified by bala
logfile
group 1 ('D:\oracle\product\10.1.0\oradata\ORACLE5\logfile\redo01.log') SIZE 50M,
group 2 ('D:\oracle\product\10.1.0\oradata\ORACLE5\logfile\redo02.log') SIZE 50M,
group 3 ('D:\oracle\product\10.1.0\oradata\ORACLE5\logfile\redo03.log') SIZE 50M
maxlogfiles 5
maxlogmembers 5
maxloghistory 1
maxdatafiles 50
maxinstances 1
datafile 'D:\oracle\product\10.1.0\oradata\ORACLE5\datafile\system01.dbf' size 200m autoextend on maxsize unlimited extent management local
undo tablespace UNDOTBS1 datafile 'D:\oracle\product\10.1.0\oradata\ORACLE5 \datafile\undotbs1.dbf' size 10m autoextend on maxsize unlimited
sysaux datafile 'D:\oracle\product\10.1.0\oradata\ORACLE5\datafile\sysaux01.dbf' size 100m autoextend on maxsize unlimited
default temporary tablespace temp tempfile 'D:\oracle\product\10.1.0\oradata\ORACLE5 \datafile\temp01.dbf' size 10m autoextend on maxsize unlimited
character set US7ASCII
NATIONAL CHARACTER SET AL16UTF16
INIT.ORA FILE:-
# Copyright (c) 1991, 2001, 2002 by Oracle Corporation
# Archive
log_archive_format=ARC%S_%R.%T
# Cache and I/O
db_block_size=8192
db_cache_size=25165824
db_file_multiblock_read_count=16
# Cursors and Library Cache
open_cursors=300
# Database Identification
db_domain=""
db_name=oracle5
# Diagnostics and Statistics
background_dump_dest=D:\oracle\product\10.1.0\admin\oracle5\bdump
core_dump_dest=D:\oracle\product\10.1.0\admin\oracle5\cdump
user_dump_dest=D:\oracle\product\10.1.0\admin\oracle5\udump
# File Configuration
#db_create_file_dest=D:\oracle\product\10.1.0\oradata
db_recovery_file_dest=D:\oracle\product\10.1.0\flash_recovery_area
db_recovery_file_dest_size=2147483648
# Job Queues
job_queue_processes=10
# Miscellaneous
compatible=10.1.0.2.0
# Pools
java_pool_size=50331648
large_pool_size=8388608
shared_pool_size=83886080
# Processes and Sessions
processes=150
# Security and Auditing
remote_login_passwordfile=EXCLUSIVE
# Shared Server
dispatchers="(PROTOCOL=TCP) (SERVICE=oracle5XDB)"
# Sort, Hash Joins, Bitmap Indexes
pga_aggregate_target=25165824
sort_area_size=65536
# System Managed Undo and Rollback Segments
undo_management=AUTO
undo_tablespace=UNDOTBS1
control_files=("D:\ORACLE\PRODUCT\10.1.0\ORADATA\ORACLE5\CONTROLFILE\control01.CTL", "D:\ORACLE\PRODUCT\10.1.0\FLASH_RECOVERY_AREA\ORACLE5\CONTROLFILE\control02.CTL")

Hi,
undo tablespace UNDOTBS1 datafile 'D:\oracle\product\10.1.0\oradata\ORACLE5 \datafile\undotbs1.dbf' size 10m autoextend on maxsize unlimited
After ORACLE5 there is a space character. Typo? Create proper directory or delete this character.
Bartek

SAP BW with ORA-04031 Errors

Hello All,
Context:
We have a financial closing system working in the BW 3.5 and Oracle 9.2.0.7.0.
We are working with more than 100 millions records in 3 days.
In general, the system uses the standard data marts and BPS processes (copy, distribution, etc).
Error:
We had a lot of ORA-04031 errors for all execution (ABAP Programs, Data Loads, BPS Executions), it stopped the environment.
We did the "stop/start" the server to solved the problem.
The basis team increase the parameter "shared_pool_size" = 3000M - We saw the SAP Note (690241) and which is more than enough.
We have fear about it, we think it is posible to occurs again.
This is a big impact for the business.
Have you got this error in the past?
Could you please help us.
Thanks a lot.
Daniel Souza
SAP BW, SEM and Portal Consultant.
São Paulo - Brazil
+55 11 99092151

Hi Chandran,
We saw this note.
The basis team have been changed the KGHDSIDXCOUNT parameter ( 4 to 1).
I am not founding more causes for this problem in the note.
Is it posible to have problems if the DB_CACHE_SIZE parameter is very large? example 18000M?
The basis team reduces the value for 1700M, in the last shutdown.
How can I flush the memory automatically?
The basis team reported this error for us. "It is not posible to flush the memory, it is necessary to shutdown the server".
Is it posible for the oracle 9i manage the memory area (shared pool) automatically? Is it recommended? Have you got this experience?
We have seen two notes about it:
997889 --> "Increase the memory SGA the ocurrence of error ORA-04031 but it does not prevent it."
617416 --> "The following areas of the SGA can be changed dynamically with Oracle 9.2 if the SGA is configured dynamically: Buffer Cache, Shared Pool, Large Pool."
Thanks a lot.
Best regards,
Daniel Souza
São Paulo - Brazil

Database and os was hang with ORA-240 ERROR

Environment： AIX 6.1 ，TWO node rac，oracle 10.2.0.4
Symptom ：
用户反映无法打开MES程序，连接到2号节点查看，发现sqlplus /as sysdba
回车后卡死，cancel不掉？重新开一个连接，到root账户下 crsctl check crs 命令也卡死，lsnrctl status 命令卡死，OS命令正常。
1号节点正常。
Alterlog有如下报错
Sat Nov 3 16:37:32 2012
Thread 2 advanced to log sequence 55778 (LGWR switch)
Current log# 8 seq# 55778 mem# 0: +SFC3DB_DATA/sfc3db/onlinelog/group_8.304.722515055
Current log# 8 seq# 55778 mem# 1: +SFC3DB_ARCH/sfc3db/onlinelog/group_8.264.722515055
Sat Nov 3 16:40:19 2012
Errors in file /apps/oracle/admin/sfc3db/bdump/sfc3db2_arc0_1843352.trc:
ORA-00240: control file enqueue held for more than 120 seconds
Sat Nov 3 16:42:29 2012
Errors in file /apps/oracle/admin/sfc3db/bdump/sfc3db2_arc1_565424.trc:
ORA-00240: control file enqueue held for more than 120 seconds
Sat Nov 3 16:47:00 2012
kkjcre1p: unable to spawn jobq slave process
Sat Nov 3 16:47:00 2012
Sat Nov 3 17:04:22 2012
ksvsubmit: Process(O001) creation failed
系统应该是无法分配新的进程了，所以这些命令都卡死，但是当时OS free的内存还有10多G，也远没有达到最大进程数。
select * from v$resource_limit; 看到最大的processes为1406 processes参数为2000
job_queue_processes 是默认值 10，当前可用的job不超过30，这个参数已经够用了
我最后的解决办法是直接reboot OS，重启后OK，各位大神有遇到过这种情况的吗？需要什么LOG 我发上来。
如下是trc文件
sfc3rac2:/apps/oracle/admin/sfc3db/bdump$ cat /apps/oracle/admin/sfc3db/bdump/sfc3db2_cjq0_5861420.trc
Dump file /apps/oracle/admin/sfc3db/bdump/sfc3db2_cjq0_5861420.trc
Oracle Database 10g Enterprise Edition Release 10.2.0.4.0 - 64bit Production
With the Partitioning, Real Application Clusters, OLAP, Data Mining
and Real Application Testing options
ORACLE_HOME = /apps/oracle/product/10.2.0
System name: AIX
Node name: sfc3rac2
Release: 1
Version: 6
Machine: 00C8B9724C00
Instance name: sfc3db2
Redo thread mounted by this instance: 2
Oracle process number: 15
Unix process pid: 5861420, image: oracle@sfc3rac2 (CJQ0)
*** 2012-11-03 06:00:41.427
*** SERVICE NAMESYS$BACKGROUND) 2012-11-03 06:00:41.419
*** SESSION ID2192.1) 2012-11-03 06:00:41.419
GATHER_STATS_JOB: Stopped by Scheduler.
Consider increasing the maintenance window duration if this happens frequently.
The following objects/segments were not analyzed due to timeout:
*** 2012-11-03 16:31:39.479
Waited for process J000 to initialize for 60 seconds
*** 2012-11-03 16:31:39.479
Dumping diagnostic information for J000:
OS pid = 917522
loadavg : 3.77 3.49 3.60
swap info: free_mem = 9427.14M rsv = 64.00M
alloc = 241.15M avail = 16384.00M swap_free = 16142.85M
F S UID PID PPID C PRI NI ADDR SZ WCHAN STIME TTY TIME CMD
1040005 A oracle 917522 1 0 60 20 1ad230590 89196 16:30:38 - 0:00 [oracle]
skgpgpstack: read() for cmd /bin/sh -c '/usr/bin/procstack 917522 2>&1' timed out after 60 seconds
*** 2012-11-03 16:33:40.701
*** 2012-11-03 16:33:50.907
Waited for process J000 to initialize for 70 seconds
*** 2012-11-03 16:33:50.907
Dumping diagnostic information for J000:
OS pid = 917522
loadavg : 2.86 3.25 3.49
swap info: free_mem = 9348.35M rsv = 64.00M
alloc = 241.11M avail = 16384.00M swap_free = 16142.89M
F S UID PID PPID C PRI NI ADDR SZ WCHAN STIME TTY TIME CMD
1040005 A oracle 917522 1 0 60 20 1ad230590 89196 16:30:38 - 0:00 [oracle]
skgpgpstack: read() for cmd /bin/sh -c '/usr/bin/procstack 917522 2>&1' timed out after 60 seconds
*** 2012-11-03 16:35:52.258
*** 2012-11-03 16:36:02.459
Waited for process J000 to initialize for 80 seconds
*** 2012-11-03 16:36:02.459
Dumping diagnostic information for J000:
OS pid = 917522
loadavg : 2.74 3.00 3.36
swap info: free_mem = 9385.39M rsv = 64.00M
alloc = 241.10M avail = 16384.00M swap_free = 16142.90M
F S UID PID PPID C PRI NI ADDR SZ WCHAN STIME TTY TIME CMD
1040005 A oracle 917522 1 0 60 20 1ad230590 89196 16:30:38 - 0:00 [oracle]
skgpgpstack: read() for cmd /bin/sh -c '/usr/bin/procstack 917522 2>&1' timed out after 60 seconds
*** 2012-11-03 16:38:03.960
*** 2012-11-03 16:38:14.165
Waited for process J000 to initialize for 90 seconds
*** 2012-11-03 16:38:14.165
Dumping diagnostic information for J000:
OS pid = 917522
loadavg : 2.56 2.96 3.30
swap info: free_mem = 9440.27M rsv = 64.00M
alloc = 241.00M avail = 16384.00M swap_free = 16143.00M
F S UID PID PPID C PRI NI ADDR SZ WCHAN STIME TTY TIME CMD
1040005 A oracle 917522 1 0 60 20 1ad230590 89196 16:30:38 - 0:00 [oracle]
skgpgpstack: read() for cmd /bin/sh -c '/usr/bin/procstack 917522 2>&1' timed out after 60 seconds
*** 2012-11-03 16:40:16.175
*** 2012-11-03 16:40:26.384
Waited for process J000 to initialize for 100 seconds
*** 2012-11-03 16:40:26.384
Dumping diagnostic information for J000:
OS pid = 917522
loadavg : 2.82 2.90 3.23
swap info: free_mem = 9488.88M rsv = 64.00M
alloc = 240.96M avail = 16384.00M swap_free = 16143.04M
F S UID PID PPID C PRI NI ADDR SZ WCHAN STIME TTY TIME CMD
1040005 A oracle 917522 1 0 60 20 1ad230590 89196 16:30:38 - 0:00 [oracle]
skgpgpstack: read() for cmd /bin/sh -c '/usr/bin/procstack 917522 2>&1' timed out after 60 seconds
*** 2012-11-03 16:42:29.100
*** 2012-11-03 16:42:39.305
Waited for process J000 to initialize for 110 seconds
*** 2012-11-03 16:42:39.305
Dumping diagnostic information for J000:
OS pid = 917522
loadavg : 4.05 3.26 3.32
swap info: free_mem = 9640.50M rsv = 64.00M
alloc = 240.90M avail = 16384.00M swap_free = 16143.10M
F S UID PID PPID C PRI NI ADDR SZ WCHAN STIME TTY TIME CMD
1040005 A oracle 917522 1 0 60 20 1ad230590 89196 16:30:38 - 0:00 [oracle]
skgpgpstack: read() for cmd /bin/sh -c '/usr/bin/procstack 917522 2>&1' timed out after 60 seconds
*** 2012-11-03 16:44:43.732
*** 2012-11-03 16:44:53.936
Waited for process J000 to initialize for 120 seconds
*** 2012-11-03 16:44:53.936
Dumping diagnostic information for J000:
OS pid = 917522
loadavg : 3.03 3.16 3.28
swap info: free_mem = 9667.09M rsv = 64.00M
alloc = 240.84M avail = 16384.00M swap_free = 16143.16M
F S UID PID PPID C PRI NI ADDR SZ WCHAN STIME TTY TIME CMD
1040005 A oracle 917522 1 0 60 20 1ad230590 89196 16:30:38 - 0:00 [oracle]
skgpgpstack: read() for cmd /bin/sh -c '/usr/bin/procstack 917522 2>&1' timed out after 60 seconds
*** 2012-11-03 16:47:00.265
Killing process (ospid 917522): (reason=x4 error=0)
... and the process is still alive after kill!
*** 2012-11-03 17:05:23.892
Waited for process J000 to initialize for 60 seconds
*** 2012-11-03 17:05:23.892
Dumping diagnostic information for J000:
OS pid = 3915970
loadavg : 2.43 2.42 2.75
swap info: free_mem = 10365.04M rsv = 64.00M
alloc = 239.53M avail = 16384.00M swap_free = 16144.47M
F S UID PID PPID C PRI NI ADDR SZ WCHAN STIME TTY TIME CMD
1040005 A oracle 3915970 1 0 60 20 105d26590 89196 17:04:22 - 0:00 [oracle]
skgpgpstack: read() for cmd /bin/sh -c '/usr/bin/procstack 3915970 2>&1' timed out after 60 seconds
*** 2012-11-03 17:07:35.954
*** 2012-11-03 17:07:46.156
Waited for process J000 to initialize for 70 seconds
*** 2012-11-03 17:07:46.156
Dumping diagnostic information for J000:
OS pid = 3915970
loadavg : 2.24 2.33 2.67
swap info: free_mem = 10400.53M rsv = 64.00M
alloc = 239.37M avail = 16384.00M swap_free = 16144.63M
F S UID PID PPID C PRI NI ADDR SZ WCHAN STIME TTY TIME CMD
1040005 A oracle 3915970 1 0 60 20 105d26590 89196 17:04:22 - 0:00 [oracle]
skgpgpstack: read() for cmd /bin/sh -c '/usr/bin/procstack 3915970 2>&1' timed out after 60 seconds
*** 2012-11-03 17:09:58.294
*** 2012-11-03 17:10:08.495
Waited for process J000 to initialize for 80 seconds
*** 2012-11-03 17:10:08.495
Dumping diagnostic information for J000:
OS pid = 3915970
loadavg : 2.36 2.38 2.64
swap info: free_mem = 10389.09M rsv = 64.00M
alloc = 239.23M avail = 16384.00M swap_free = 16144.77M
F S UID PID PPID C PRI NI ADDR SZ WCHAN STIME TTY TIME CMD
1040005 A oracle 3915970 1 0 60 20 105d26590 89196 17:04:22 - 0:00 [oracle]
skgpgpstack: read() for cmd /bin/sh -c '/usr/bin/procstack 3915970 2>&1' timed out after 60 seconds
*** 2012-11-03 17:12:20.685
*** 2012-11-03 17:12:30.886
Waited for process J000 to initialize for 90 seconds
*** 2012-11-03 17:12:30.886
Dumping diagnostic information for J000:
还有个trc文件太大暂时不放了。

Environment： AIX 6.1 ，TWO node rac，oracle 10.2.0.4
Symptom ：
用户反映无法打开MES程序，连接到2号节点查看，发现sqlplus /as sysdba
回车后卡死，cancel不掉？重新开一个连接，到root账户下 crsctl check crs 命令也卡死，lsnrctl status 命令卡死，OS命令正常。
1号节点正常。
Alterlog有如下报错
Sat Nov 3 16:37:32 2012
Thread 2 advanced to log sequence 55778 (LGWR switch)
Current log# 8 seq# 55778 mem# 0: +SFC3DB_DATA/sfc3db/onlinelog/group_8.304.722515055
Current log# 8 seq# 55778 mem# 1: +SFC3DB_ARCH/sfc3db/onlinelog/group_8.264.722515055
Sat Nov 3 16:40:19 2012
Errors in file /apps/oracle/admin/sfc3db/bdump/sfc3db2_arc0_1843352.trc:
ORA-00240: control file enqueue held for more than 120 seconds
Sat Nov 3 16:42:29 2012
Errors in file /apps/oracle/admin/sfc3db/bdump/sfc3db2_arc1_565424.trc:
ORA-00240: control file enqueue held for more than 120 seconds
Sat Nov 3 16:47:00 2012
kkjcre1p: unable to spawn jobq slave process
Sat Nov 3 16:47:00 2012
Sat Nov 3 17:04:22 2012
ksvsubmit: Process(O001) creation failed
系统应该是无法分配新的进程了，所以这些命令都卡死，但是当时OS free的内存还有10多G，也远没有达到最大进程数。
select * from v$resource_limit; 看到最大的processes为1406 processes参数为2000
job_queue_processes 是默认值 10，当前可用的job不超过30，这个参数已经够用了
我最后的解决办法是直接reboot OS，重启后OK，各位大神有遇到过这种情况的吗？需要什么LOG 我发上来。
如下是trc文件
sfc3rac2:/apps/oracle/admin/sfc3db/bdump$ cat /apps/oracle/admin/sfc3db/bdump/sfc3db2_cjq0_5861420.trc
Dump file /apps/oracle/admin/sfc3db/bdump/sfc3db2_cjq0_5861420.trc
Oracle Database 10g Enterprise Edition Release 10.2.0.4.0 - 64bit Production
With the Partitioning, Real Application Clusters, OLAP, Data Mining
and Real Application Testing options
ORACLE_HOME = /apps/oracle/product/10.2.0
System name: AIX
Node name: sfc3rac2
Release: 1
Version: 6
Machine: 00C8B9724C00
Instance name: sfc3db2
Redo thread mounted by this instance: 2
Oracle process number: 15
Unix process pid: 5861420, image: oracle@sfc3rac2 (CJQ0)
*** 2012-11-03 06:00:41.427
*** SERVICE NAMESYS$BACKGROUND) 2012-11-03 06:00:41.419
*** SESSION ID2192.1) 2012-11-03 06:00:41.419
GATHER_STATS_JOB: Stopped by Scheduler.
Consider increasing the maintenance window duration if this happens frequently.
The following objects/segments were not analyzed due to timeout:
*** 2012-11-03 16:31:39.479
Waited for process J000 to initialize for 60 seconds
*** 2012-11-03 16:31:39.479
Dumping diagnostic information for J000:
OS pid = 917522
loadavg : 3.77 3.49 3.60
swap info: free_mem = 9427.14M rsv = 64.00M
alloc = 241.15M avail = 16384.00M swap_free = 16142.85M
F S UID PID PPID C PRI NI ADDR SZ WCHAN STIME TTY TIME CMD
1040005 A oracle 917522 1 0 60 20 1ad230590 89196 16:30:38 - 0:00 [oracle]
skgpgpstack: read() for cmd /bin/sh -c '/usr/bin/procstack 917522 2>&1' timed out after 60 seconds
*** 2012-11-03 16:33:40.701
*** 2012-11-03 16:33:50.907
Waited for process J000 to initialize for 70 seconds
*** 2012-11-03 16:33:50.907
Dumping diagnostic information for J000:
OS pid = 917522
loadavg : 2.86 3.25 3.49
swap info: free_mem = 9348.35M rsv = 64.00M
alloc = 241.11M avail = 16384.00M swap_free = 16142.89M
F S UID PID PPID C PRI NI ADDR SZ WCHAN STIME TTY TIME CMD
1040005 A oracle 917522 1 0 60 20 1ad230590 89196 16:30:38 - 0:00 [oracle]
skgpgpstack: read() for cmd /bin/sh -c '/usr/bin/procstack 917522 2>&1' timed out after 60 seconds
*** 2012-11-03 16:35:52.258
*** 2012-11-03 16:36:02.459
Waited for process J000 to initialize for 80 seconds
*** 2012-11-03 16:36:02.459
Dumping diagnostic information for J000:
OS pid = 917522
loadavg : 2.74 3.00 3.36
swap info: free_mem = 9385.39M rsv = 64.00M
alloc = 241.10M avail = 16384.00M swap_free = 16142.90M
F S UID PID PPID C PRI NI ADDR SZ WCHAN STIME TTY TIME CMD
1040005 A oracle 917522 1 0 60 20 1ad230590 89196 16:30:38 - 0:00 [oracle]
skgpgpstack: read() for cmd /bin/sh -c '/usr/bin/procstack 917522 2>&1' timed out after 60 seconds
*** 2012-11-03 16:38:03.960
*** 2012-11-03 16:38:14.165
Waited for process J000 to initialize for 90 seconds
*** 2012-11-03 16:38:14.165
Dumping diagnostic information for J000:
OS pid = 917522
loadavg : 2.56 2.96 3.30
swap info: free_mem = 9440.27M rsv = 64.00M
alloc = 241.00M avail = 16384.00M swap_free = 16143.00M
F S UID PID PPID C PRI NI ADDR SZ WCHAN STIME TTY TIME CMD
1040005 A oracle 917522 1 0 60 20 1ad230590 89196 16:30:38 - 0:00 [oracle]
skgpgpstack: read() for cmd /bin/sh -c '/usr/bin/procstack 917522 2>&1' timed out after 60 seconds
*** 2012-11-03 16:40:16.175
*** 2012-11-03 16:40:26.384
Waited for process J000 to initialize for 100 seconds
*** 2012-11-03 16:40:26.384
Dumping diagnostic information for J000:
OS pid = 917522
loadavg : 2.82 2.90 3.23
swap info: free_mem = 9488.88M rsv = 64.00M
alloc = 240.96M avail = 16384.00M swap_free = 16143.04M
F S UID PID PPID C PRI NI ADDR SZ WCHAN STIME TTY TIME CMD
1040005 A oracle 917522 1 0 60 20 1ad230590 89196 16:30:38 - 0:00 [oracle]
skgpgpstack: read() for cmd /bin/sh -c '/usr/bin/procstack 917522 2>&1' timed out after 60 seconds
*** 2012-11-03 16:42:29.100
*** 2012-11-03 16:42:39.305
Waited for process J000 to initialize for 110 seconds
*** 2012-11-03 16:42:39.305
Dumping diagnostic information for J000:
OS pid = 917522
loadavg : 4.05 3.26 3.32
swap info: free_mem = 9640.50M rsv = 64.00M
alloc = 240.90M avail = 16384.00M swap_free = 16143.10M
F S UID PID PPID C PRI NI ADDR SZ WCHAN STIME TTY TIME CMD
1040005 A oracle 917522 1 0 60 20 1ad230590 89196 16:30:38 - 0:00 [oracle]
skgpgpstack: read() for cmd /bin/sh -c '/usr/bin/procstack 917522 2>&1' timed out after 60 seconds
*** 2012-11-03 16:44:43.732
*** 2012-11-03 16:44:53.936
Waited for process J000 to initialize for 120 seconds
*** 2012-11-03 16:44:53.936
Dumping diagnostic information for J000:
OS pid = 917522
loadavg : 3.03 3.16 3.28
swap info: free_mem = 9667.09M rsv = 64.00M
alloc = 240.84M avail = 16384.00M swap_free = 16143.16M
F S UID PID PPID C PRI NI ADDR SZ WCHAN STIME TTY TIME CMD
1040005 A oracle 917522 1 0 60 20 1ad230590 89196 16:30:38 - 0:00 [oracle]
skgpgpstack: read() for cmd /bin/sh -c '/usr/bin/procstack 917522 2>&1' timed out after 60 seconds
*** 2012-11-03 16:47:00.265
Killing process (ospid 917522): (reason=x4 error=0)
... and the process is still alive after kill!
*** 2012-11-03 17:05:23.892
Waited for process J000 to initialize for 60 seconds
*** 2012-11-03 17:05:23.892
Dumping diagnostic information for J000:
OS pid = 3915970
loadavg : 2.43 2.42 2.75
swap info: free_mem = 10365.04M rsv = 64.00M
alloc = 239.53M avail = 16384.00M swap_free = 16144.47M
F S UID PID PPID C PRI NI ADDR SZ WCHAN STIME TTY TIME CMD
1040005 A oracle 3915970 1 0 60 20 105d26590 89196 17:04:22 - 0:00 [oracle]
skgpgpstack: read() for cmd /bin/sh -c '/usr/bin/procstack 3915970 2>&1' timed out after 60 seconds
*** 2012-11-03 17:07:35.954
*** 2012-11-03 17:07:46.156
Waited for process J000 to initialize for 70 seconds
*** 2012-11-03 17:07:46.156
Dumping diagnostic information for J000:
OS pid = 3915970
loadavg : 2.24 2.33 2.67
swap info: free_mem = 10400.53M rsv = 64.00M
alloc = 239.37M avail = 16384.00M swap_free = 16144.63M
F S UID PID PPID C PRI NI ADDR SZ WCHAN STIME TTY TIME CMD
1040005 A oracle 3915970 1 0 60 20 105d26590 89196 17:04:22 - 0:00 [oracle]
skgpgpstack: read() for cmd /bin/sh -c '/usr/bin/procstack 3915970 2>&1' timed out after 60 seconds
*** 2012-11-03 17:09:58.294
*** 2012-11-03 17:10:08.495
Waited for process J000 to initialize for 80 seconds
*** 2012-11-03 17:10:08.495
Dumping diagnostic information for J000:
OS pid = 3915970
loadavg : 2.36 2.38 2.64
swap info: free_mem = 10389.09M rsv = 64.00M
alloc = 239.23M avail = 16384.00M swap_free = 16144.77M
F S UID PID PPID C PRI NI ADDR SZ WCHAN STIME TTY TIME CMD
1040005 A oracle 3915970 1 0 60 20 105d26590 89196 17:04:22 - 0:00 [oracle]
skgpgpstack: read() for cmd /bin/sh -c '/usr/bin/procstack 3915970 2>&1' timed out after 60 seconds
*** 2012-11-03 17:12:20.685
*** 2012-11-03 17:12:30.886
Waited for process J000 to initialize for 90 seconds
*** 2012-11-03 17:12:30.886
Dumping diagnostic information for J000:
还有个trc文件太大暂时不放了。

ORA-12805 error message

I was building a clustering model and occurred the following error after a hour and 37 minutes of execution:
"ORA-12805 parallel query server died unexpectedly"
My input table has 520 numeric attributes and 73.000 records.
Does anybody have some idea of the problem?
Mauricio Onoda

The PQ process died during the activity. This could be caused by various reasons. You may first check if any Oracle trace files were generated and verify the alert logfile contents. For large datasets, there might be a resource issue which should be indicated in the trace or alert logfile.
Xiafang

Help with ORA 14400 error while inserting data

Hi all,
i am facing an ora 14400 error in the following scenario , please help.
i have created a table using the syntax:
CREATE TABLE temp_table
GRPKEY NUMBER(20, 0) NOT NULL,
UKEY NUMBER(10, 0),
ANUM VARCHAR2(250 BYTE),
APC VARCHAR2(2 BYTE),
SID VARCHAR2(65 BYTE),
RDATETIME VARCHAR2(19 BYTE),
CKEY NUMBER(20, 0),
AVER VARCHAR2(25 BYTE),
CVER VARCHAR2(250 BYTE),
TNAME VARCHAR2(50 BYTE),
SCODE VARCHAR2(30 BYTE),
PTYPE VARCHAR2(50 BYTE),
FILENUMB NUMBER(10, 0),
LINENUMB NUMBER(10, 0),
ENTRY_CREATEDDATE DATE
, CONSTRAINT temp_table_PK PRIMARY KEY (GRPKEY))
PARTITION BY RANGE(ENTRY_CREATEDDATE)
(PARTITION P0 VALUES LESS THAN(TO_DATE(' 2009-01-01 00:00:00', 'SYYYY-MM-DD HH24:MI:SS', 'NLS_CALENDAR=GREGORIAN'))
when i try to insert data using :
insert into temp_table values
(1,null,null,null,null,null,null,null,null,null,null,null,null,null,'01-NOV-2010');
i get the following error output:
Error report:
SQL Error: ORA-14400: inserted partition key does not map to any partition
14400. 00000 - "inserted partition key does not map to any partition"
*Cause: An attempt was made to insert a record into, a Range or Composite
Range object, with a concatenated partition key that is beyond
the concatenated partition bound list of the last partition -OR-
An attempt was made to insert a record into a List object with
a partition key that did not match the literal values specified
for any of the partitions.
*Action: Do not insert the key. Or, add a partition capable of accepting
the key, Or add values matching the key to a partition specification

Hi Chaitanya,
Change your table script to
CREATE TABLE temp_table
GRPKEY NUMBER(20, 0) NOT NULL,
UKEY NUMBER(10, 0),
ANUM VARCHAR2(250 BYTE),
APC VARCHAR2(2 BYTE),
SID VARCHAR2(65 BYTE),
RDATETIME VARCHAR2(19 BYTE),
CKEY NUMBER(20, 0),
AVER VARCHAR2(25 BYTE),
CVER VARCHAR2(250 BYTE),
TNAME VARCHAR2(50 BYTE),
SCODE VARCHAR2(30 BYTE),
PTYPE VARCHAR2(50 BYTE),
FILENUMB NUMBER(10, 0),
LINENUMB NUMBER(10, 0),
ENTRY_CREATEDDATE DATE
, CONSTRAINT temp_table_PK PRIMARY KEY (GRPKEY))
PARTITION BY RANGE(ENTRY_CREATEDDATE)
(PARTITION P0 VALUES LESS THAN(TO_DATE(' 2009-01-01 00:00:00', 'SYYYY-MM-DD HH24:MI:SS', 'NLS_CALENDAR=GREGORIAN')),
PARTITION P1 VALUES LESS THAN(MAXVALUE)
insert into temp_table values
(1,null,null,null,null,null,null,null,null,null,null,null,null,null,'01-NOV-2010');
1 row insertedor refer question regarding "Date Partitioning a table"
*009*
Edited by: 009 on Nov 3, 2010 11:29 PM

Problem with ora-28000 error

Hi all,
I got a problem with ORA-28000 in my form. In my app, it allows user to try maximum 3 time to logon, if the user fails, his/her user will be locked. The problem is, when Oracle locked that user, in on-error trigger I cannot catch that error and show the error message.
Anybody, please give me a hand.
Thank alot

I put code (in the on-error trigger) here. please have look, thanks again.
IN_ERR_CODE NUMBER := ERROR_CODE;
BEGIN
     IF(IN_ERR_CODE = 28001) THEN
     ELSIF (IN_ERR_CODE = 28002) THEN
     ELSIF (IN_ERR_CODE = 28011) THEN
     ELSIF (IN_ERR_CODE = 28000) THEN
          MESSAGE(ERROR_TEXT);
          --LEAVE_FORM;
          --clear_form(no_validate);
          --RAISE FORM_TRIGGER_FAILURE;
          --EXIT_FORM(NO_VALIDATE);
     END IF;
END;

Creating physical standby using rman fails with ORA-19558: error de-allocat

Dear All,
We are creating physical stadnby database from 2 node RAC ( 2 node RAC to standalone physical standby).
While in the rman duplicate process we are getting below error, we were not able to sorted out..
No third party storage has been used ....
DB version : 11gR2 and the OS is RHEL5
Appreciate if any one hepl us to resolve this issue ...
Thanks in advance ...
RMAN-03009: failure of backup command on prmy1 channel at 10/05/2011 17:59:26
ORA-19558: error de-allocating device
ORA-19557: device error, device type: DISK, device name:
ORA-17627: ORA-01041: internal error. hostdef extension doesn't exist
ORA-17627: ORA-01041: internal error. hostdef extension doesn't exist
ORA-03113: end-of-file on communication channel
Edited by: 889828 on 2011/10/06 2:17 AM

The problem is well decribed in your alert log.....you are using Oracle Managed File names which means you will not be able to duplicate the database as RMAN won't be able to automatically generate new names for the files using the DB_FILE_NAME_CONVERT and LOG_FILE_NAME_CONVERT initialization parameters.
Youll have to use the SET NEWNAME command to specify the names of the database files. Done this a few times , and I don't recommend using OMF specifically beacuse of this hassle.
WARNING: OMF is enabled on this database. Creating a physical standby controlfile, when OMF is enabled on the primary database, requires manual RMAN intervention to resolve OMF
datafile pathnames.
NOTE: Please refer to the RMAN documentation for procedures describing how to manually resolve OMF datafile pathnames.
Problem handling is described in
Oracle® Database Backup and Recovery Reference
10g Release 2 (10.2)
Part Number B14194-03

DBMS_LDAP call fails with ORA-06512 Error Mapping function

Hi,
I am facing a problem with workflow integration with LDAP.
I receive
ORA-6512 Error Mapping Function on one particular line within the WF_LDAP.get_cfg_val procedure.
WHILE my_entry IS NOT NULL
LOOP
my_vals := DBMS_LDAP.get_values (p_session,
my_entry,
p_name);
The documentation says:
ORA-06521 PL/SQL: Error mapping function
Cause: An error was detected by PL/SQL trying to map the mentioned
function dynamically.
Action: Check the stacked error (if any) for more details.
This is the trace of the error:
ORA-06521 PL/SQL Error mapping Function
ORA-06512 at SYS.DBMS_LDAP_API_FFI line 0
ORA-06512 at SYS.DBMS_LDAP line 1332
ORA-06512 at SYS.DBMS_LDAP line 1302
ORA-06512 at SYS.DBMS_LDAP line 582
This is the header of the catldap.sql file
Rem
Rem $Header: catldap.sql 07-jan-2000.19:15:20 akolli Exp $
Rem
Rem catldap.sql
Rem
Rem $Header: dbmsldap.sql 14-dec-2001.23:25:22 rbollu Exp $
Rem
Rem dbmsldap.sql
Rem
This is the output while running it (No errors):
Library created.
Package created.
Package created.
Package created.
Package body created.
Package body created.
Package body created.
Synonym created.
Grant succeeded.
Synonym created.
Grant succeeded.
Database is :
compatible 9.2.0.0.0
Am I missing something?
I have searched all the forums and although there are many references to "Error Mapping Function", noone has reported it in the context of WF - LDAP Integration. So I am not sure how to proceed.
Please help.
thanks in advance,
Libin

Hi Libin,
Can you please explain to me the parameters that you put in the Global Preferences, the LDAP_port,LDAP_user,and the others, because I don�t know where I need to search in the server this parameters and I don�t understand su much of OID.
if you can give to me and little description of that parameters,this would thank for much.
anticipated thanks
Arlet

Reg : Datapump export failing with ORA-31633 error

Hi,
I am trying to export one of the production databases (10.2.0.4.0) using datapump - backup is failing with the following error.
[UBASE2]:/backup/exports/scripts>more /backup/exports/cron/cron_UBASE_log
Export Start
Sat Oct 10 10:32:00 GMT 2009
Export: Release 10.2.0.4.0 - 64bit Production on Saturday, 10 October, 2009 10:32:00
Copyright (c) 2003, 2007, Oracle. All rights reserved.
Connected to: Oracle Database 10g Enterprise Edition Release 10.2.0.4.0 - 64bit Production
With the Partitioning, Real Application Clusters, OLAP, Data Mining
and Real Application Testing options
ORA-31626: job does not exist
ORA-31633: unable to create master table "SYSTEM.FULL_UBASE"
ORA-06512: at "SYS.DBMS_SYS_ERROR", line 95
ORA-06512: at "SYS.KUPV$FT", line 871
ORA-00955: name is already used by an existing object
Export End
Sat Oct 10 10:32:01 GMT 2009
I tried to attach to the existing job to kill that, but i am getting the below error -
[UBASE2]:/backup/exports/scripts>expdp attach=FULL_UBASE
Export: Release 10.2.0.4.0 - 64bit Production on Saturday, 10 October, 2009 14:31:46
Copyright (c) 2003, 2007, Oracle. All rights reserved.
Username: / as sysdba
Connected to: Oracle Database 10g Enterprise Edition Release 10.2.0.4.0 - 64bit Production
With the Partitioning, Real Application Clusters, OLAP, Data Mining
and Real Application Testing options
ORA-31626: job does not exist
ORA-06512: at "SYS.DBMS_SYS_ERROR", line 79
ORA-06512: at "SYS.KUPV$FT", line 438
ORA-31638: cannot attach to job FULL_UBASE for user SYS
ORA-31632: master table "SYS.FULL_UBASE" not found, invalid, or inaccessible
ORA-00942: table or view does not exist
As this is critical production database please help me how to resolve this.
Thanks in Advance.
Raju A
Oracle DBA.

Hi,
Have you verified if your DBMS_AQ environment has been corrupted? If so, then you'll have to drop and recreate a number of queue related objects all over again. Furthermore, ORA-00942 appears to be the main problem as it is a case sensitivity error. You should change the table names to UPPERCASE and then try again.
Hope this helps.
Regards,
Naveed.

Ora -07445 with ora-03135 error

Hi,
Sorry for asking questiob about this generic error, i shouldd contact oracle support for this. But for some tecnical reason metalink SR request page is offline. May be i get some help from you guys.
For last three days i have been getting ora-07445 error at same time, by going through the trace file it shows a sql statment fired from sql developer which caused the error.
detailed error as follows....
ORA-07445: exception encountered: core dump [kprball()+684] [SIGSEGV]
[Address not mapped to object] [0x000000238] [] []
ORA-03135: connection lost contact
Any help would be appreciated.
Thanks and Regards
Jafar

Hi,
version - oracle 10g on solaria 9.
Metalink is working fine but for rasing TAR page is offline.
A similar issue in Oracle 10g Release 2 is seems to be fixed in 10.2.0.4 How this was fixed, by appying patch.
Thanks
Jafar

Apply processes aborted with ORA-12805 error

Similar Messages

Maybe you are looking for