Error 472 in job queue process + ORA-472: PMON process terminated with err
Hi,
I've an Oracle Database 11g Release 11.1.0.6.0 - 64bit Production With the Real Application Clusters option.
Yesterday instance on node1 crashed.
This is the extract of alert log:
Errors in file /u01/app/oracle/diag/rdbms/evodb/EVODB1/trace/EVODB1_pmon_9297.trc (incident=195198):
ORA-00600: internal error code, arguments: [17183], [0x14E251C38], [], [], [], [], [], []
Incident details in: /u01/app/oracle/diag/rdbms/evodb/EVODB1/incident/incdir_195198/EVODB1_pmon_9297_i195198.trc
Sat Jan 22 16:24:47 2011
Trace dumping is performing id=[cdmp_20110122162447]
Sat Jan 22 16:24:50 2011
Sweep Incident[195198]: completed
Sat Jan 22 16:25:00 2011
Errors in file /u01/app/oracle/diag/rdbms/evodb/EVODB1/trace/EVODB1_pmon_9297.trc (incident=195199):
ORA-00600: internal error code, arguments: [17183], [0x14E251C38], [], [], [], [], [], []
Incident details in: /u01/app/oracle/diag/rdbms/evodb/EVODB1/incident/incdir_195199/EVODB1_pmon_9297_i195199.trc
Sat Jan 22 16:25:10 2011
Trace dumping is performing id=[cdmp_20110122162510]
Sat Jan 22 16:25:12 2011
Errors in file /u01/app/oracle/diag/rdbms/evodb/EVODB1/trace/EVODB1_pmon_9297.trc (incident=195200):
ORA-00600: internal error code, arguments: [17183], [0x14E251C38], [], [], [], [], [], []
Incident details in: /u01/app/oracle/diag/rdbms/evodb/EVODB1/incident/incdir_195200/EVODB1_pmon_9297_i195200.trc
Sat Jan 22 16:25:23 2011
DBRM (ospid: 9310): terminating the instance due to error 472
Sat Jan 22 16:25:23 2011
System state dump is made for local instance
System State dumped to trace file /u01/app/oracle/diag/rdbms/evodb/EVODB1/trace/EVODB1_diag_16320.trc
Sat Jan 22 16:25:23 2011
ORA-1092 : opiodr aborting process unknown ospid (3724_47445977853072)
Sat Jan 22 16:25:23 2011
SUCCESS: diskgroup ARCHIVELOG was dismounted
Sat Jan 22 16:14:22 2011
DDE: Problem Key 'ORA 600 [17183]' was completely flood controlled (0x6)
Further messages for this problem key will be suppressed for up to 10 minutes
Sat Jan 22 16:15:56 2011
Thread 1 advanced to log sequence 171322
Current log# 18 seq# 171322 mem# 0: +ONLINELOG/evodb/onlinelog/group_18.264.729348055
Sat Jan 22 16:15:56 2011
SUCCESS: diskgroup ARCHIVELOG was mounted
Sat Jan 22 16:16:15 2011
SUCCESS: diskgroup ARCHIVELOG was dismounted
Sat Jan 22 16:20:52 2011
Thread 1 advanced to log sequence 171323
Current log# 12 seq# 171323 mem# 0: +ONLINELOG/evodb/onlinelog/group_12.267.729333861
Sat Jan 22 16:20:53 2011
SUCCESS: diskgroup ARCHIVELOG was mounted
Sat Jan 22 16:21:14 2011
SUCCESS: diskgroup ARCHIVELOG was dismounted
Sat Jan 22 16:24:23 2011
DDE: Problem Key 'ORA 600 [17183]' was completely flood controlled (0x2)
Further messages for this problem key will be suppressed for up to 10 minutes
Sat Jan 22 16:24:38 2011
Errors in file /u01/app/oracle/diag/rdbms/evodb/EVODB1/trace/EVODB1_pmon_9297.trc (incident=195198):
ORA-00600: internal error code, arguments: [17183], [0x14E251C38], [], [], [], [], [], []
Incident details in: /u01/app/oracle/diag/rdbms/evodb/EVODB1/incident/incdir_195198/EVODB1_pmon_9297_i195198.trc
Sat Jan 22 16:24:47 2011
Trace dumping is performing id=[cdmp_20110122162447]
Sat Jan 22 16:24:50 2011
Sweep Incident[195198]: completed
Sat Jan 22 16:25:00 2011
Errors in file /u01/app/oracle/diag/rdbms/evodb/EVODB1/trace/EVODB1_pmon_9297.trc (incident=195199):
ORA-00600: internal error code, arguments: [17183], [0x14E251C38], [], [], [], [], [], []
Incident details in: /u01/app/oracle/diag/rdbms/evodb/EVODB1/incident/incdir_195199/EVODB1_pmon_9297_i195199.trc
Sat Jan 22 16:25:10 2011
Trace dumping is performing id=[cdmp_20110122162510]
Sat Jan 22 16:25:12 2011
Errors in file /u01/app/oracle/diag/rdbms/evodb/EVODB1/trace/EVODB1_pmon_9297.trc (incident=195200):
ORA-00600: internal error code, arguments: [17183], [0x14E251C38], [], [], [], [], [], []
Incident details in: /u01/app/oracle/diag/rdbms/evodb/EVODB1/incident/incdir_195200/EVODB1_pmon_9297_i195200.trc
Sat Jan 22 16:25:23 2011
DBRM (ospid: 9310): terminating the instance due to error 472
Sat Jan 22 16:25:23 2011
System state dump is made for local instance
System State dumped to trace file /u01/app/oracle/diag/rdbms/evodb/EVODB1/trace/EVODB1_diag_16320.trc
Sat Jan 22 16:25:23 2011
ORA-1092 : opiodr aborting process unknown ospid (3724_47445977853072)
Sat Jan 22 16:25:23 2011
ORA-1092 : opiodr aborting process unknown ospid (3650_47673206152336)
Sat Jan 22 16:25:23 2011
ORA-1092 : opiodr aborting process unknown ospid (19709_47962498952336)
Sat Jan 22 16:25:23 2011
ORA-1092 : opiodr aborting process unknown ospid (3715_47239602621584)
Sat Jan 22 16:25:23 2011
ORA-1092 : opiodr aborting process unknown ospid (3718_47120460606608)
Sat Jan 22 16:25:23 2011
ORA-1092 : opiodr aborting process unknown ospid (3646_47899813694608)
Sat Jan 22 16:25:23 2011
ORA-1092 : opiodr aborting process unknown ospid (3671_47700480982160)
Sat Jan 22 16:25:23 2011
ORA-1092 : opiodr aborting process unknown ospid (3637_47223057443984)
Sat Jan 22 16:25:23 2011
ORA-1092 : opiodr aborting process unknown ospid (3695_47109627223184)
Sat Jan 22 16:25:23 2011
ORA-1092 : opiodr aborting process unknown ospid (3679_47262512999568)
Sat Jan 22 16:25:23 2011
ORA-1092 : opiodr aborting process unknown ospid (3733_46976527121552)
Sat Jan 22 16:25:23 2011
ORA-1092 : opiodr aborting process unknown ospid (3667_47474016554128)
Sat Jan 22 16:25:23 2011
ORA-1092 : opiodr aborting process unknown ospid (3669_47585103858832)
Sat Jan 22 16:25:23 2011
ORA-1092 : opiodr aborting process unknown ospid (3658_47992462539920)
Sat Jan 22 16:25:23 2011
ORA-1092 : opiodr aborting process unknown ospid (3654_47736794324112)
Sat Jan 22 16:25:23 2011
ORA-1092 : opiodr aborting process unknown ospid (3686_47295241862288)
Sat Jan 22 16:25:23 2011
ORA-1092 : opiodr aborting process unknown ospid (3706_47055349939344)
Sat Jan 22 16:25:23 2011
ORA-1092 : opiodr aborting process unknown ospid (3630_47331091332240)
Sat Jan 22 16:25:23 2011
ORA-1092 : opiodr aborting process unknown ospid (3713_47194150415504)
Sat Jan 22 16:25:23 2011
ORA-1092 : opiodr aborting process unknown ospid (3726_47289949199504)
Sat Jan 22 16:25:23 2011
ORA-1092 : opiodr aborting process unknown ospid (3677_47842172337296)
Sat Jan 22 16:25:23 2011
ORA-1092 : opiodr aborting process unknown ospid (19131_47557370236048)
Sat Jan 22 16:25:23 2011
ORA-1092 : opiodr aborting process unknown ospid (27091_47096969530512)
Sat Jan 22 16:25:23 2011
ORA-1092 : opiodr aborting process unknown ospid (3688_47422639070352)
Sat Jan 22 16:25:23 2011
ORA-1092 : opiodr aborting process unknown ospid (3652_47944422886544)
Sat Jan 22 16:25:23 2011
ORA-1092 : opiodr aborting process unknown ospid (3648_47426149817488)
Sat Jan 22 16:25:24 2011
Errors in file /u01/app/oracle/diag/rdbms/evodb/EVODB1/trace/EVODB1_j005_9360.trc:
ORA-00472: PMON process terminated with error
ORA-1092 : opidrv aborting process J005 ospid (9360_47420959304848)
Sat Jan 22 16:25:24 2011
ORA-1092 : opiodr aborting process unknown ospid (18393_47566684101776)
Sat Jan 22 16:25:24 2011
Errors in file /u01/app/oracle/diag/rdbms/evodb/EVODB1/trace/EVODB1_j003_7054.trc:
ORA-00472: PMON process terminated with error
ORA-1092 : opidrv aborting process J003 ospid (7054_47244451724432)
Sat Jan 22 16:25:24 2011
ORA-1092 : opiodr aborting process unknown ospid (19719_47840732109968)
Sat Jan 22 16:25:24 2011
ORA-1092 : opiodr aborting process unknown ospid (22184_47575322619024)
Sat Jan 22 16:25:24 2011
ORA-1092 : opiodr aborting process unknown ospid (19721_47679094451344)
Sat Jan 22 16:25:24 2011
ORA-1092 : opiodr aborting process unknown ospid (30170_47106572815504)
Sat Jan 22 16:25:24 2011
ORA-472 : opidrv aborting process S000 ospid (9367_46990649617552)
Sat Jan 22 16:25:24 2011
Errors in file /u01/app/oracle/diag/rdbms/evodb/EVODB1/trace/EVODB1_j002_7052.trc:
ORA-00472: PMON process terminated with error
ORA-1092 : opidrv aborting process J002 ospid (7052_47411695402128)
Sat Jan 22 16:25:24 2011
ORA-1092 : opiodr aborting process unknown ospid (18493_47469336738960)
Sat Jan 22 16:25:24 2011
Errors in file /u01/app/oracle/diag/rdbms/evodb/EVODB1/trace/EVODB1_j006_10011.trc:
ORA-00472: PMON process terminated with error
ORA-1092 : opidrv aborting process J006 ospid (10011_47836408102032)
Sat Jan 22 16:25:24 2011
ORA-1092 : opiodr aborting process unknown ospid (19714_47958179912848)
Sat Jan 22 16:25:24 2011
Errors in file /u01/app/oracle/diag/rdbms/evodb/EVODB1/trace/EVODB1_j007_10289.trc:
ORA-00472: PMON process terminated with error
ORA-1092 : opidrv aborting process J007 ospid (10289_47356480347280)
Sat Jan 22 16:25:24 2011
ORA-1092 : opiodr aborting process unknown ospid (9076_47765392362640)
Sat Jan 22 16:25:24 2011
ORA-1092 : opitsk aborting process
Sat Jan 22 16:25:25 2011
ORA-1092 : opiodr aborting process unknown ospid (22167_47949919177872)
Sat Jan 22 16:25:25 2011
ORA-1092 : opiodr aborting process unknown ospid (24320_47408077532304)
Sat Jan 22 16:25:25 2011
ORA-1092 : opiodr aborting process unknown ospid (22130_47998542101648)
Sat Jan 22 16:25:25 2011
ORA-472 : opidrv aborting process N000 ospid (14774_47466200525968)
Sat Jan 22 16:25:25 2011
Errors in file /u01/app/oracle/diag/rdbms/evodb/EVODB1/trace/EVODB1_q000_14701.trc:
ORA-00472: PMON process terminated with error
ORA-1092 : opidrv aborting process Q000 ospid (14701_47693688122512)
Sat Jan 22 16:25:25 2011
ORA-1092 : opiodr aborting process unknown ospid (18386_47900707175568)
Sat Jan 22 16:25:25 2011
ORA-1092 : opiodr aborting process unknown ospid (27553_46921398619280)
Sat Jan 22 16:25:26 2011
Errors in file /u01/app/oracle/diag/rdbms/evodb/EVODB1/trace/EVODB1_j001_7050.trc:
ORA-00472: PMON process terminated with error
ORA-1092 : opidrv aborting process J001 ospid (7050_47290016251024)
Sat Jan 22 16:25:26 2011
Errors in file /u01/app/oracle/diag/rdbms/evodb/EVODB1/trace/EVODB1_o001_5297.trc:
ORA-00472: PMON process terminated with error
ORA-1092 : opidrv aborting process O001 ospid (5297_47702958673040)
Sat Jan 22 16:25:26 2011
Errors in file /u01/app/oracle/diag/rdbms/evodb/EVODB1/trace/EVODB1_o000_5277.trc:
ORA-00472: PMON process terminated with error
ORA-1092 : opidrv aborting process O000 ospid (5277_47599668255888)
Sat Jan 22 16:25:26 2011
ORA-1092 : opiodr aborting process unknown ospid (19745_47560156560528)
Sat Jan 22 16:25:26 2011
ORA-1092 : opiodr aborting process unknown ospid (27044_47388543339664)
Sat Jan 22 16:25:26 2011
Errors in file /u01/app/oracle/diag/rdbms/evodb/EVODB1/trace/EVODB1_j004_7061.trc:
ORA-00472: PMON process terminated with error
ORA-1092 : opidrv aborting process J004 ospid (7061_47341656689808)
Sat Jan 22 16:25:27 2011
ORA-1092 : opiodr aborting process unknown ospid (14431_47662297960112)
Sat Jan 22 16:25:27 2011
ORA-1092 : opiodr aborting process unknown ospid (14433_47826608635568)
Sat Jan 22 16:25:31 2011
ORA-1092 : opitsk aborting process
Sat Jan 22 16:25:32 2011
License high water mark = 269
Instance terminated by DBRM, pid = 9310
USER (ospid: 10539): terminating the instance
Instance terminated by USER, pid = 10539
Sat Jan 22 16:25:49 2011
Starting ORACLE instance (normal)
This is the trace /u01/app/oracle/diag/rdbms/evodb/EVODB1/incident/incdir_195200/EVODB1_pmon_9297_i195200.trc
(the one regarding the error DBRM (ospid: 9310): terminating the instance due to error 472)
Oracle Database 11g Release 11.1.0.6.0 - 64bit Production
With the Real Application Clusters option
ORACLE_HOME = /u01/app/oracle/product/11.1.0/db1
System name: Linux
Node name: dcsrv-evodb01
Release: 2.6.18-164.10.1.el5
Version: #1 SMP Wed Dec 30 18:35:28 EST 2009
Machine: x86_64
Instance name: EVODB1
Redo thread mounted by this instance: 1
Oracle process number: 2
Unix process pid: 9297, image: oracle@dcsrv-evodb01 (PMON)
*** 2011-01-22 16:25:12.984
*** SESSION ID:(884.1) 2011-01-22 16:25:12.984
*** CLIENT ID:() 2011-01-22 16:25:12.984
*** SERVICE NAME:(SYS$BACKGROUND) 2011-01-22 16:25:12.984
*** MODULE NAME:() 2011-01-22 16:25:12.984
*** ACTION NAME:() 2011-01-22 16:25:12.984
Dump continued from file: /u01/app/oracle/diag/rdbms/evodb/EVODB1/trace/EVODB1_pmon_9297.trc
ORA-00600: internal error code, arguments: [17183], [0x14E251C38], [], [], [], [], [], []
+========= Dump for incident 195200 (ORA 600 [17183]) ========+
----- Beginning of Customized Incident Dump(s) -----
And this is the trace /u01/app/oracle/diag/rdbms/evodb/EVODB1/trace/EVODB1_j005_9360.trc
(the one regarding the error ORA-00472: PMON process terminated with error)
Trace file /u01/app/oracle/diag/rdbms/evodb/EVODB1/trace/EVODB1_j005_9360.trc
Oracle Database 11g Release 11.1.0.6.0 - 64bit Production
With the Real Application Clusters option
ORACLE_HOME = /u01/app/oracle/product/11.1.0/db1
System name: Linux
Node name: dcsrv-evodb01
Release: 2.6.18-164.10.1.el5
Version: #1 SMP Wed Dec 30 18:35:28 EST 2009
Machine: x86_64
Instance name: EVODB1
Redo thread mounted by this instance: 1
Oracle process number: 95
Unix process pid: 9360, image: oracle@dcsrv-evodb01 (J005)
*** 2011-01-22 16:25:24.057
*** SESSION ID:(649.45863) 2011-01-22 16:25:24.057
*** CLIENT ID:() 2011-01-22 16:25:24.057
*** SERVICE NAME:(SYS$USERS) 2011-01-22 16:25:24.057
*** MODULE NAME:() 2011-01-22 16:25:24.057
*** ACTION NAME:() 2011-01-22 16:25:24.057
error 472 in job queue process
ORA-00472: PMON process terminated with error
My questions are:
- how can I discover the nature of the ORA-00600: internal error code, arguments: [17183], [0x14E251C38], [], [], [], [], [], []?
- what does error 472 in job queue proces mean?
- is it normal the the error 472 in job queue proces crash the instance?
Thanks in advanca for any kind of help!
Samuel
>
how can I discover the nature of the ORA-00600: internal error code, arguments: [17183], [0x14E251C38], [], [], [], [], [], []?
>
ORA-00600 should be reported to oracle. Only they know the meaning.
Regards,
- wiZ
Similar Messages
-
ORA-00472: PMON process terminated with error
Hi,
I got this error in alert log.But the clients didn't complain they had a downtime.But in alert log I see the following.Why the db got restarted and why the clients could not notice it.Can somebody please reply why this has happened.
Mon Jul 18 12:28:02 2011
ARC1: terminating instance due to error 472
Mon Jul 18 12:28:03 2011
Errors in file /backups/p01/app/oracle/admin/plsprod/bdump/plsprod_lns1_3772752.trc:
ORA-00472: PMON process terminated with error
Instance terminated by ARC1, pid = 2306362
Mon Jul 18 12:28:52 2011
Starting ORACLE instance (normal)
LICENSE_MAX_SESSION = 0
LICENSE_SESSIONS_WARNING = 0
Picked latch-free SCN scheme 3
Autotune of undo retention is turned on.
IMODE=BR
ILAT =242
LICENSE_MAX_USERS = 0
SYS auditing is disabled
ksdpec: called for event 13740 prior to event group initialization
Starting up ORACLE RDBMS Version: 10.2.0.3.0.
System parameters with non-default values:
processes = 2000
shared_pool_size = 536870912
large_pool_size = 54525952
java_pool_size = 75497472
streams_pool_size = 54525952
control_files = /data/plsprod/p02/control01.ctl, /data/plsprod/p03/control02.ctl, /data/plsprod/p04/control03.ctl
db_block_size = 8192
db_cache_size = 104857600
compatible = 10.2.0.3
log_archive_dest_1 = location=/data/plsprod/archredo MANDATORY REOPEN
log_archive_dest_2 = SERVICE=talon_plsprod.travimp.com LGWR ASYNC NOAFFIRM REOPEN=60 NODELAY
log_archive_dest_state_1 = enable
log_archive_dest_state_2 = enable
standby_archive_dest = /data/plsprod/archredo
log_archive_format = redo_plsprod_%r_%t_%s.arc
log_buffer = 6120448
fast_start_mttr_target = 30
undo_management = AUTO
undo_tablespace = plsprod_undo
undo_retention = 1500
remote_login_passwordfile= EXCLUSIVE
db_domain = travimp.com
instance_name = plsprod
service_names = plsprod.travimp.com
local_listener = (ADDRESS=(PROTOCOL=TCP)(HOST=catalina)(PORT=1521))
background_dump_dest = /backups/p01/app/oracle/admin/plsprod/bdump
user_dump_dest = /backups/p01/app/oracle/admin/plsprod/udump
core_dump_dest = /backups/p01/app/oracle/admin/plsprod/cdump
session_max_open_files = 60
sort_area_size = 1048576
sort_area_retained_size = 1048576
db_name = plsprod
open_cursors = 100
os_authent_prefix =
pga_aggregate_target = 26214400
aq_tm_processes = 0
PMON started with pid=2, OS id=5623926
PSP0 started with pid=3, OS id=5566632
MMAN started with pid=4, OS id=5328992
DBW0 started with pid=5, OS id=4362640
DBW1 started with pid=6, OS id=4808940
LGWR started with pid=7, OS id=4358468
CKPT started with pid=8, OS id=4784160
SMON started with pid=9, OS id=4354538
RECO started with pid=10, OS id=4313420
MMON started with pid=11, OS id=4771908
MMNL started with pid=12, OS id=4743272
Mon Jul 18 12:28:53 2011
ALTER DATABASE MOUNT
Mon Jul 18 12:28:57 2011
Setting recovery target incarnation to 1
Mon Jul 18 12:28:57 2011
Successful mount of redo thread 1, with mount id 2894903685
Mon Jul 18 12:28:57 2011
Database mounted in Exclusive Mode
Completed: ALTER DATABASE MOUNT
Mon Jul 18 12:28:58 2011
ALTER DATABASE OPEN
Mon Jul 18 12:28:58 2011
Beginning crash recovery of 1 threads
parallel recovery started with 15 processes
Mon Jul 18 12:28:58 2011
Started redo scan
Mon Jul 18 12:28:58 2011
Completed redo scan
1696 redo blocks read, 56 data blocks need recovery
Mon Jul 18 12:28:58 2011
Started redo application at
Thread 1: logseq 17759, block 26354
Mon Jul 18 12:28:58 2011
Recovery of Online Redo Log: Thread 1 Group 1 Seq 17759 Reading mem 0
Mem# 0: /data/plsprod/p01/redo_t1_g1_f1.log
Mem# 1: /data/plsprod/p02/redo_t1_g1_f2.log
Mon Jul 18 12:28:58 2011
Completed redo application
Mon Jul 18 12:28:58 2011
Completed crash recovery at
Thread 1: logseq 17759, block 28050, scn 35195499598
56 data blocks read, 56 data blocks written, 1696 redo blocks read
Mon Jul 18 12:28:58 2011
LGWR: STARTING ARCH PROCESSES
ARC0 started with pid=29, OS id=4338022
Mon Jul 18 12:28:58 2011
ARC0: Archival started
ARC1: Archival started
LGWR: STARTING ARCH PROCESSES COMPLETE
ARC1 started with pid=30, OS id=1081522
LNS1 started with pid=31, OS id=5537854
Mon Jul 18 12:29:01 2011
Thread 1 advanced to log sequence 17760
Thread 1 opened at log sequence 17760
Current log# 2 seq# 17760 mem# 0: /data/plsprod/p01/redo_t1_g2_f1.log
Current log# 2 seq# 17760 mem# 1: /data/plsprod/p02/redo_t1_g2_f2.log
Successful open of redo thread 1
Mon Jul 18 12:29:01 2011
ARC0: STARTING ARCH PROCESSES
Mon Jul 18 12:29:01 2011
ARC1: Becoming the 'no FAL' ARCH
ARC1: Becoming the 'no SRL' ARCH
Mon Jul 18 12:29:01 2011
SMON: enabling cache recovery
Mon Jul 18 12:29:02 2011
ARC2: Archival started
ARC0: STARTING ARCH PROCESSES COMPLETE
ARC0: Becoming the heartbeat ARCH
ARC2 started with pid=32, OS id=5644370
Mon Jul 18 12:29:02 2011
ARC0: Standby redo logfile selected for thread 1 sequence 17759 for destination LOG_ARCHIVE_DEST_2
Mon Jul 18 12:29:02 2011
LGWR: Setting 'active' archival for destination LOG_ARCHIVE_DEST_2
Mon Jul 18 12:29:03 2011
Successfully onlined Undo Tablespace 16.
Mon Jul 18 12:29:03 2011
SMON: enabling tx recovery
Mon Jul 18 12:29:03 2011
Database Characterset is US7ASCII
replication_dependency_tracking turned off (no async multimaster replication found)
WARNING: AQ_TM_PROCESSES is set to 0. System operation might be adversely affected.
Completed: ALTER DATABASE OPEN
Mon Jul 18 12:29:58 2011
Shutting down archive processes
Mon Jul 18 12:30:03 2011
ARCH shutting down
ARC2: Archival stoppedHi CKPT,
Please find the output of the trace file as below.I deleted the repetitive output "Attempting to send buffer 0x111441d30 start block 91942 block count 84
total size to send 43008 blocksize 512" as it exceeds maximum length of 30000 characters in this post.
CATALINA_mardiprd>cat /backups/p01/app/oracle/admin/plsprod/bdump/plsprod_lns1_3772752.trc
/backups/p01/app/oracle/admin/plsprod/bdump/plsprod_lns1_3772752.trc
Oracle Database 10g Enterprise Edition Release 10.2.0.3.0 - 64bit Production
With the Partitioning, OLAP and Data Mining options
ORACLE_HOME = /p01/app/oracle10g/product/10.2.0.3
System name: AIX
Node name: catalina
Release: 3
Version: 5
Machine: 00044C5FD600
Instance name: plsprod
Redo thread mounted by this instance: 1
Oracle process number: 16
Unix process pid: 3772752, image: oracle@catalina (LNS1)
*** SERVICE NAME:() 2011-07-18 09:42:11.573
*** SESSION ID:(2189.1) 2011-07-18 09:42:11.573
*** 2011-07-18 09:42:11.573 57516 kcrr.c
LNS1: initializing for LGWR communication
LNS1: connecting to KSR channel
Success
LNS1: subscribing to KSR channel
Success
*** 2011-07-18 09:42:11.574 57569 kcrr.c
LNS1: initialized successfully ASYNC=1
Destination is specified with ASYNC=61440
*** 2011-07-18 09:42:12.577 71560 kcrr.c
Sending online log thread 1 seq 17731 [logfile 3] to standby
Opening logfile [logno 3]
Redo shipping client performing standby login
*** 2011-07-18 09:42:12.693 65194 kcrr.c
Logged on to standby successfully
Client logon and security negotiation successful!
Destination LOG_ARCHIVE_DEST_2 is in MAXIMUM PERFORMANCE mode
Archiving to destination talon_plsprod.travimp.com ASYNC blocks=20480
Allocate ASYNC blocks: Previous blocks=0 New blocks=20480
Log file opened [logno 3]
Attempting to send buffer 0x111441d30 start block 2 block count 1
total size to send 512 blocksize 512
Attempting to send buffer 0x111441d30 start block 3 block count 35
total size to send 17920 blocksize 512
*** 2011-07-18 09:42:27.009
Attempting to send buffer 0x111441d30 start block 38 block count 2914
total size to send 1491968 blocksize 512
*** 2011-07-18 09:42:50.007
Attempting to send buffer 0x111441d30 start block 2952 block count 2
total size to send 1024 blocksize 512
*** 2011-07-18 09:43:01.441
Attempting to send buffer 0x111441d30 start block 2954 block count 19286
total size to send 9874432 blocksize 512
Attempting to send buffer 0x111441d30 start block 22240 block count 19657
total size to send 10064384 blocksize 512
Attempting to send buffer 0x111441d30 start block 41897 block count 1687
total size to send 863744 blocksize 512
*** 2011-07-18 09:43:13.007
Attempting to send buffer 0x111441d30 start block 43584 block count 1
total size to send 512 blocksize 512
Attempting to send buffer 0x111441d30 start block 43585 block count 13
total size to send 6656 blocksize 512
Attempting to send buffer 0x111441d30 start block 43598 block count 19008
total size to send 9732096 blocksize 512
*** 2011-07-18 09:43:24.265
Attempting to send buffer 0x111441d30 start block 62606 block count 19349
total size to send 9906688 blocksize 512
*** 2011-07-18 09:43:25.524 72367 kcrr.c
Detected proper completion of online log
*** 2011-07-18 09:43:25.524 72204 kcrr.c
Detected physical end of file
Attempting to send buffer 0x111441d30 start block 81955 block count 10066
total size to send 5153792 blocksize 512
Online entry still exists for log 3 thr 1 seq 17731. Using it
Closing thread 1 sequence 17731 logno 3 nab 92021 los 35193489640 nxs 35193490559
*** 2011-07-18 09:43:26.686 71560 kcrr.c
Sending online log thread 1 seq 17732 [logfile 1] to standby
Opening logfile [logno 1]
Destination LOG_ARCHIVE_DEST_2 is in MAXIMUM PERFORMANCE mode
Archiving to destination talon_plsprod.travimp.com ASYNC blocks=20480
Log file opened [logno 1]
Attempting to send buffer 0x111441d30 start block 2 block count 20407
total size to send 10448384 blocksize 512
Attempting to send buffer 0x111441d30 start block 20409 block count 20349
total size to send 10418688 blocksize 512
Attempting to send buffer 0x111441d30 start block 40758 block count 19751
total size to send 10112512 blocksize 512
Attempting to send buffer 0x111441d30 start block 60509 block count 20260
total size to send 10373120 blocksize 512
*** 2011-07-18 09:43:33.262 72367 kcrr.c
Detected proper completion of online log
*** 2011-07-18 09:43:33.262 72204 kcrr.c
Detected physical end of file
Attempting to send buffer 0x111441d30 start block 80769 block count 11251
total size to send 5760512 blocksize 512
Online entry still exists for log 1 thr 1 seq 17732. Using it
Closing thread 1 sequence 17732 logno 1 nab 92020 los 35193490559 nxs 35193490735
*** 2011-07-18 09:43:33.541 71560 kcrr.c
Sending online log thread 1 seq 17733 [logfile 2] to standby
Opening logfile [logno 2]
Destination LOG_ARCHIVE_DEST_2 is in MAXIMUM PERFORMANCE mode
*** 2011-07-18 09:43:34.387
Archiving to destination talon_plsprod.travimp.com ASYNC blocks=20480
Log file opened [logno 2]
Attempting to send buffer 0x111441d30 start block 2 block count 19192
total size to send 9826304 blocksize 512
Attempting to send buffer 0x111441d30 start block 19194 block count 18876
total size to send 9664512 blocksize 512
Attempting to send buffer 0x111441d30 start block 38070 block count 19565
total size to send 10017280 blocksize 512
Attempting to send buffer 0x111441d30 start block 57635 block count 19765
total size to send 10119680 blocksize 512
*** 2011-07-18 09:43:41.660 72367 kcrr.c
Detected proper completion of online log
*** 2011-07-18 09:43:41.660 72204 kcrr.c
Detected physical end of file
Attempting to send buffer 0x111441d30 start block 77400 block count 14627
total size to send 7489024 blocksize 512
Online entry still exists for log 2 thr 1 seq 17733. Using it
Closing thread 1 sequence 17733 logno 2 nab 92027 los 35193490735 nxs 35193490800
*** 2011-07-18 09:43:41.928 71560 kcrr.c
Sending online log thread 1 seq 17734 [logfile 3] to standby
Opening logfile [logno 3]
Destination LOG_ARCHIVE_DEST_2 is in MAXIMUM PERFORMANCE mode
Archiving to destination talon_plsprod.travimp.com ASYNC blocks=20480
Log file opened [logno 3]
Attempting to send buffer 0x111441d30 start block 59038 block count 18758
total size to send 9604096 blocksize 512
*** 2011-07-18 09:44:42.141
*** 2011-07-18 09:44:42.141 72367 kcrr.c
Detected proper completion of online log
*** 2011-07-18 09:44:42.142 72204 kcrr.c
Detected physical end of file
total size to send 586240 blocksize 512
Online entry still exists for log 1 thr 1 seq 17744. Using it
Closing thread 1 sequence 17744 logno 1 nab 92029 los 35193494218 nxs 35193494529
*** 2011-07-18 09:45:58.974 71560 kcrr.c
Sending online log thread 1 seq 17745 [logfile 2] to standby
Opening logfile [logno 2]
Destination LOG_ARCHIVE_DEST_2 is in MAXIMUM PERFORMANCE mode
Archiving to destination talon_plsprod.travimp.com ASYNC blocks=20480
Log file opened [logno 2]
Attempting to send buffer 0x111441d30 start block 2 block count 9013
total size to send 4614656 blocksize 512
Attempting to send buffer 0x111441d30 start block 9015 block count 20176
total size to send 10330112 blocksize 512
Attempting to send buffer 0x111441d30 start block 29191 block count 19808
total size to send 10141696 blocksize 512
Attempting to send buffer 0x111441d30 start block 48999 block count 18939
total size to send 9696768 blocksize 512
*** 2011-07-18 09:46:10.146
Attempting to send buffer 0x111441d30 start block 67938 block count 19124
total size to send 9791488 blocksize 512
Attempting to send buffer 0x111441d30 start block 87062 block count 3690
total size to send 1889280 blocksize 512
*** 2011-07-18 09:46:12.644 72367 kcrr.c
Detected proper completion of online log
*** 2011-07-18 09:46:12.644 72204 kcrr.c
Detected physical end of file
Attempting to send buffer 0x111441d30 start block 90752 block count 1267
total size to send 648704 blocksize 512
Online entry still exists for log 2 thr 1 seq 17745. Using it
Closing thread 1 sequence 17745 logno 2 nab 92019 los 35193494529 nxs 35193494940
*** 2011-07-18 09:46:13.690 71560 kcrr.c
Sending online log thread 1 seq 17746 [logfile 3] to standby
Opening logfile [logno 3]
Destination LOG_ARCHIVE_DEST_2 is in MAXIMUM PERFORMANCE mode
Archiving to destination talon_plsprod.travimp.com ASYNC blocks=20480
Log file opened [logno 3]
Attempting to send buffer 0x111441d30 start block 2 block count 19533
total size to send 10000896 blocksize 512
Attempting to send buffer 0x111441d30 start block 19535 block count 11151
total size to send 5709312 blocksize 512
Attempting to send buffer 0x111441d30 start block 30686 block count 20154
total size to send 10318848 blocksize 512
*** 2011-07-18 09:46:20.822
Attempting to send buffer 0x111441d30 start block 50840 block count 19083
total size to send 9770496 blocksize 512
Attempting to send buffer 0x111441d30 start block 69923 block count 19167
total size to send 9813504 blocksize 512
*** 2011-07-18 09:46:22.573 72367 kcrr.c
Detected proper completion of online log
*** 2011-07-18 09:46:22.573 72204 kcrr.c
Detected physical end of file
Attempting to send buffer 0x111441d30 start block 89090 block count 2933
total size to send 1501696 blocksize 512
Online entry still exists for log 3 thr 1 seq 17746. Using it
Closing thread 1 sequence 17746 logno 3 nab 92023 los 35193494940 nxs 35193495191
*** 2011-07-18 09:46:23.637 71560 kcrr.c
Sending online log thread 1 seq 17747 [logfile 1] to standby
Opening logfile [logno 1]
Destination LOG_ARCHIVE_DEST_2 is in MAXIMUM PERFORMANCE mode
Archiving to destination talon_plsprod.travimp.com ASYNC blocks=20480
Log file opened [logno 1]
Attempting to send buffer 0x111441d30 start block 2 block count 8093
total size to send 4143616 blocksize 512
Attempting to send buffer 0x111441d30 start block 8095 block count 20288
total size to send 10387456 blocksize 512
Attempting to send buffer 0x111441d30 start block 28383 block count 18967
total size to send 9711104 blocksize 512
*** 2011-07-18 09:46:31.007
Attempting to send buffer 0x111441d30 start block 47350 block count 5237
total size to send 2681344 blocksize 512
Attempting to send buffer 0x111441d30 start block 52587 block count 20188
total size to send 10336256 blocksize 512
Attempting to send buffer 0x111441d30 start block 72775 block count 19167
total size to send 9813504 blocksize 512
*** 2011-07-18 09:46:37.430 72367 kcrr.c
Detected proper completion of online log
*** 2011-07-18 09:46:37.430 72204 kcrr.c
Detected physical end of file
Attempting to send buffer 0x111441d30 start block 91942 block count 84
total size to send 43008 blocksize 512
Online entry still exists for log 1 thr 1 seq 17747. Using it
Closing thread 1 sequence 17747 logno 1 nab 92026 los 35193495191 nxs 35193495503
*** 2011-07-18 09:46:37.501 71560 kcrr.c
Sending online log thread 1 seq 17748 [logfile 2] to standby
Opening logfile [logno 2]
Destination LOG_ARCHIVE_DEST_2 is in MAXIMUM PERFORMANCE mode
Archiving to destination talon_plsprod.travimp.com ASYNC blocks=20480
Log file opened [logno 2]
Attempting to send buffer 0x111441d30 start block 2 block count 2052
total size to send 1050624 blocksize 512
*** 2011-07-18 09:46:43.059
total size to send 8164352 blocksize 512
*** 2011-07-18 09:48:18.781
*** 2011-07-18 09:48:18.781 72367 kcrr.c
Detected proper completion of online log
**** 2011-07-18 09:48:18.781 72204 kcrr.c*
Detected physical end of file
Attempting to send buffer 0x111441d30 start block 90604 block count 1416
total size to send 724992 blocksize 512
Online entry still exists for log 2 thr 1 seq 17754. Using it
Closing thread 1 sequence 17754 logno 2 nab 92020 los 35193496751 nxs 35193496934
**** 2011-07-18 09:48:19.891 71560 kcrr.c*
*Sending online log thread 1 seq 17755 [logfile 3] to standby*
*Opening logfile [logno 3]*
Destination LOG_ARCHIVE_DEST_2 is in MAXIMUM PERFORMANCE mode
Archiving to destination talon_plsprod.travimp.com ASYNC blocks=20480
*Log file opened [logno 3]*
Attempting to send buffer 0x111441d30 start block 2 block count 19248
total size to send 9854976 blocksize 512
Attempting to send buffer 0x111441d30 start block 19250 block count 20166
total size to send 10324992 blocksize 512
Attempting to send buffer 0x111441d30 start block 39416 block count 4955
total size to send 2536960 blocksize 512
Attempting to send buffer 0x111441d30 start block 44371 block count 19903
total size to send 10190336 blocksize 512
*** 2011-07-18 09:48:30.215
Attempting to send buffer 0x111441d30 start block 64274 block count 19991
total size to send 10235392 blocksize 512
*** 2011-07-18 09:48:32.370 72367 kcrr.c
Detected proper completion of online log
*** 2011-07-18 09:48:32.370 72204 kcrr.c
Detected physical end of file
Attempting to send buffer 0x111441d30 start block 84265 block count 7754
total size to send 3970048 blocksize 512
Online entry still exists for log 3 thr 1 seq 17755. Using it
Closing thread 1 sequence 17755 logno 3 nab 92019 los 35193496934 nxs 35193498387
*** 2011-07-18 09:48:32.472 71560 kcrr.c
Sending online log thread 1 seq 17756 [logfile 1] to standby
Opening logfile [logno 1]
Destination LOG_ARCHIVE_DEST_2 is in MAXIMUM PERFORMANCE mode
Archiving to destination talon_plsprod.travimp.com ASYNC blocks=20480
Log file opened [logno 1]
Attempting to send buffer 0x111441d30 start block 2 block count 19214
total size to send 9837568 blocksize 512
*** 2011-07-18 09:48:40.267
Attempting to send buffer 0x111441d30 start block 19216 block count 19981
total size to send 10230272 blocksize 512
Attempting to send buffer 0x111441d30 start block 39197 block count 19586
total size to send 10028032 blocksize 512
Attempting to send buffer 0x111441d30 start block 58783 block count 6569
total size to send 3363328 blocksize 512
Attempting to send buffer 0x111441d30 start block 65352 block count 19894
total size to send 10185728 blocksize 512
*** 2011-07-18 09:48:47.133 72367 kcrr.c
Detected proper completion of online log
*** 2011-07-18 09:48:47.133 72204 kcrr.c
Detected physical end of file
Attempting to send buffer 0x111441d30 start block 85246 block count 6772
total size to send 3467264 blocksize 512
Online entry still exists for log 1 thr 1 seq 17756. Using it
Closing thread 1 sequence 17756 logno 1 nab 92018 los 35193498387 nxs 35193500455
*** 2011-07-18 09:48:47.344 71560 kcrr.c
Sending online log thread 1 seq 17757 [logfile 2] to standby
Opening logfile [logno 2]
Destination LOG_ARCHIVE_DEST_2 is in MAXIMUM PERFORMANCE mode
Archiving to destination talon_plsprod.travimp.com ASYNC blocks=20480
Log file opened [logno 2]
*** 2011-07-18 09:48:50.302
Attempting to send buffer 0x111441d30 start block 2 block count 18546
total size to send 9495552 blocksize 512
Attempting to send buffer 0x111441d30 start block 18548 block count 19821
total size to send 10148352 blocksize 512
Attempting to send buffer 0x111441d30 start block 38369 block count 20457
total size to send 10473984 blocksize 512
*** 2011-07-18 09:49:02.194
Attempting to send buffer 0x111441d30 start block 58826 block count 20477
total size to send 10484224 blocksize 512
Attempting to send buffer 0x111441d30 start block 79303 block count 12397
total size to send 6347264 blocksize 512
*** 2011-07-18 09:49:08.443 72367 kcrr.c
Detected proper completion of online log
*** 2011-07-18 09:49:08.443 72204 kcrr.c
Detected physical end of file
Attempting to send buffer 0x111441d30 start block 91700 block count 333
total size to send 170496 blocksize 512
Online entry still exists for log 2 thr 1 seq 17757. Using it
Closing thread 1 sequence 17757 logno 2 nab 92033 los 35193500455 nxs 35193504614
*** 2011-07-18 09:49:08.549 71560 kcrr.c
Sending online log thread 1 seq 17758 [logfile 3] to standby
Opening logfile [logno 3]
Destination LOG_ARCHIVE_DEST_2 is in MAXIMUM PERFORMANCE mode
Archiving to destination talon_plsprod.travimp.com ASYNC blocks=20480
Log file opened [logno 3]
Attempting to send buffer 0x111441d30 start block 2 block count 19640
total size to send 10055680 blocksize 512
*** 2011-07-18 09:49:15.005
Attempting to send buffer 0x111441d30 start block 19642 block count 12646
total size to send 6474752 blocksize 512
Attempting to send buffer 0x111441d30 start block 92000 block count 23
total size to send 11776 blocksize 512
*** 2011-07-18 11:30:19.515 72367 kcrr.c
Detected proper completion of online log
*** 2011-07-18 11:30:19.515 72204 kcrr.c
Detected physical end of file
Attempting to send buffer 0x111441d30 start block 92023 block count 11
total size to send 5632 blocksize 512
Online entry still exists for log 3 thr 1 seq 17758. Using it
Closing thread 1 sequence 17758 logno 3 nab 92034 los 35193504614 nxs 35194291751
*** 2011-07-18 11:30:21.546 71560 kcrr.c
Sending online log thread 1 seq 17759 [logfile 1] to standby
Opening logfile [logno 1]
Destination LOG_ARCHIVE_DEST_2 is in MAXIMUM PERFORMANCE mode
Archiving to destination talon_plsprod.travimp.com ASYNC blocks=20480
Log file opened [logno 1]
Attempting to send buffer 0x111441d30 start block 2 block count 24
total size to send 12288 blocksize 512
*** 2011-07-18 11:30:27.006
Attempting to send buffer 0x111441d30 start block 26 block count 1
total size to send 512 blocksize 512
Attempting to send buffer 0x111441d30 start block 27 block count 34
total size to send 17408 blocksize 512
Attempting to send buffer 0x111441d30 start block 61 block count 31
total size to send 15872 blocksize 512
*** 2011-07-18 11:30:39.003
Attempting to send buffer 0x111441d30 start block 92 block count 32
total size to send 16384 blocksize 512
Attempting to send buffer 0x111441d30 start block 124 block count 2
total size to send 1024 blocksize 512
Attempting to send buffer 0x111441d30 start block 126 block count 1
total size to send 512 blocksize 512
*** 2011-07-18 11:30:51.000
Attempting to send buffer 0x111441d30 start block 127 block count 1
total size to send 512 blocksize 512
Attempting to send buffer 0x111441d30 start block 128 block count 30
total size to send 15360 blocksize 512
Attempting to send buffer 0x111441d30 start block 158 block count 88
total size to send 45056 blocksize 512
Attempting to send buffer 0x111441d30 start block 246 block count 3
total size to send 1536 blocksize 512
*** 2011-07-18 11:31:03.002
Attempting to send buffer 0x111441d30 start block 249 block count 32
total size to send 16384 blocksize 512
Attempting to send buffer 0x111441d30 start block 27416 block count 4
total size to send 2048 blocksize 512
Attempting to send buffer 0x111441d30 start block 27420 block count 14
total size to send 7168 blocksize 512
Attempting to send buffer 0x111441d30 start block 27434 block count 54
total size to send 27648 blocksize 512
Attempting to send buffer 0x111441d30 start block 27488 block count 10
total size to send 5120 blocksize 512
*** 2011-07-18 12:27:01.000
Attempting to send buffer 0x111441d30 start block 27498 block count 78
total size to send 39936 blocksize 512
Attempting to send buffer 0x111441d30 start block 27576 block count 2
total size to send 1024 blocksize 512
Attempting to send buffer 0x111441d30 start block 27578 block count 56
total size to send 28672 blocksize 512
Attempting to send buffer 0x111441d30 start block 27634 block count 60
total size to send 30720 blocksize 512
*** 2011-07-18 12:27:14.006
Attempting to send buffer 0x111441d30 start block 27694 block count 7
total size to send 3584 blocksize 512
Attempting to send buffer 0x111441d30 start block 27701 block count 1
total size to send 512 blocksize 512
Attempting to send buffer 0x111441d30 start block 27702 block count 106
total size to send 54272 blocksize 512
*** 2011-07-18 12:27:28.001
Attempting to send buffer 0x111441d30 start block 27808 block count 2
total size to send 1024 blocksize 512
Attempting to send buffer 0x111441d30 start block 27810 block count 37
total size to send 18944 blocksize 512
Attempting to send buffer 0x111441d30 start block 27847 block count 2
total size to send 1024 blocksize 512
*** 2011-07-18 12:27:42.002
Attempting to send buffer 0x111441d30 start block 27849 block count 78
total size to send 39936 blocksize 512
Attempting to send buffer 0x111441d30 start block 27927 block count 43
total size to send 22016 blocksize 512
*** 2011-07-18 12:27:52.001
Attempting to send buffer 0x111441d30 start block 27970 block count 1
total size to send 512 blocksize 512
Attempting to send buffer 0x111441d30 start block 27971 block count 2
total size to send 1024 blocksize 512
Attempting to send buffer 0x111441d30 start block 27973 block count 38
total size to send 19456 blocksize 512
*** 2011-07-18 12:28:03.007
ORA-00472: PMON process terminated with error
Closing Redo Read Context
Redo Push Server: Freeing ASYNC PGA buffer
LNS1: Doing a channel reset for next time around...
Please help me out. -
Ora-00472 PMON process terminated with error on production system
Hi,
I am getting the above error when I shutdown the database after a power outage. Alert log file shows " ora-00130 Invalid listener address when I bring up the database...." Nothing has changed between prior to the power outage and after that.
RDBMS 9i.
Help please!!
A/AThis is what the listener status shows
Alias FINPROD
Version TNSLSNR for HPUX: Version 9.2.0.6.0 - Production
Start Date 26-JUL-2010 13:45:15
Uptime 0 days 2 hr. 9 min. 22 sec
Trace Level off
Security OFF
SNMP OFF
Listener Parameter File /d01/finprod/product/9i/network/admin/listener.ora
Listener Log File /d01/finprod/product/9i/network/admin/finprod.log
Listening Endpoints Summary...
(DESCRIPTION=(ADDRESS=(PROTOCOL=ipc)(KEY=EXTPROCFINPROD)))
(DESCRIPTION=(ADDRESS=(PROTOCOL=tcp)(HOST=hp3.nfpc.com)(PORT=1521)))
Services Summary...
Service "FINPROD" has 1 instance(s).
Instance "FINPROD", status UNKNOWN, has 1 handler(s) for this service...
Service "FINPROD.nfpc.com" has 1 instance(s).
Instance "FINPROD", status READY, has 1 handler(s) for this service...
Service "PLSExtProc" has 1 instance(s).
Instance "PLSExtProc", status UNKNOWN, has 1 handler(s) for this service...
The command completed successfully -
Hi All,
My System Configuration is
CPU: Intel Xeon Dual Core 2.5GHz.
RAM: 8 GB
Databse : Oracle 10.2.0.2
Interim Oracle Patch: 18
SAP: Solution Manager
OS: Windows 2003 Standard Edition x86_64
I have install the system successfully. I stop the SAP system & database for backup but is not starting while I chek the log files I found that the database is crashed. I check the log files & found the below error
Dump file f:\oracle\smn\saptrace\background\smn_pmon_3160.trc
Tue Jul 28 17:23:42 2009
ORACLE V10.2.0.2.0 - 64bit Production vsnsta=0
vsnsql=14 vsnxtr=3
Oracle Database 10g Enterprise Edition Release 10.2.0.2.0 - 64bit Production
Process Id: 0x00000cd4 Thread Id : 0x00000c58 Time : Tue Jul 28 17:23:42
Excp. Code: 0xc0000005 Excp. Type: ACCESS_VIO Flags: 0x00000000
Registers -
ip=0000000077EF1CD6 sp=000000000BB7B628 rp=0000000000000000
r1=000000003AF40000 r2=00000000049D0E50 r3=00000000000001D0
r4=0000000000000010 r5=000000000BB7B628 r6=0000000000000000 r7=00000000049D0E50
r8=00000000049D0000 r9=0000000000000048 r10=0000000000000000 r11=0000000000000000
r12=0000000000000246 r13=0000000000000000 r14=0000000000000006 r15=0000000000000048
End of Registers -
Oracle Database 10g Enterprise Edition Release 10.2.0.2.0 - 64bit Production
With the Partitioning, OLAP, Data Mining and Real Application Testing options
Abrupt exit from ksedmp in Exception Handler
2009-07-28 17:23:42.140
ksedmp: internal or fatal error
ORA-07445: exception encountered: core dump [ACCESS_VIOLATION] [unable_to_trans_pc] [PC:0x77EF1CD6] [ADDR:0x1D0] [UNABLE_TO_READ] []
----- Call Stack Trace -
calling call entry argument values in hex
location type point (? means dubious value)
0000000077EF1CD6 0000000000000000 000000000 000000000 000000000
000000000
0000000077EF3CB7 CALL??? 0000000077EF1CD6 000000000 077EF3B0C 000000001
000000100
000007FF771B813D CALL??? 0000000077EF3CB7 000000010 000000000 000000048
000000010
0000000000000010 CALL??? 000007FF771B813D 000000000 000000048 000000010
000000000
Binary Stack Dump -
========== FRAME [1] (0000000077EF1CD6 -> 0000000000000000) ==========
Inaccessible memory range: 0000000000000000 -> 0000000000000400
========== FRAME [2] (0000000077EF3CB7 -> 0000000077EF1CD6) ==========
Dump of memory from 0x000000000BB7B620 to 0x000000000BB7B870
00BB7B620 00460019 00000001 77EF3CB7 00000000 [..F......<.w....]
00BB7B630 00000000 00000000 77EF3B0C 00000000 [.........;.w....]
00BB7B640 00000001 00000000 00000100 00000000 [................]
00BB7B650 00000000 00000000 00000000 00000000 [................]
In alert_sid.log file is
ALTER DATABASE MOUNT
Tue Jul 28 17:23:42 2009
Errors in file f:\oracle\smn\saptrace\background\smn_pmon_3160.trc:
ORA-07445: exception encountered: core dump [ACCESS_VIOLATION] [unable_to_trans_pc] [PC:0x77EF1CD6] [ADDR:0x1D0] [UNABLE_TO_READ] []
Tue Jul 28 17:23:44 2009
PSP0: terminating instance due to error 472
Tue Jul 28 17:23:44 2009
Errors in file f:\oracle\smn\saptrace\background\smn_mman_3164.trc:
ORA-00472: PMON process terminated with error
I am not able to understand the error is due to memory or I have missed something to apply.
Please help me to solve this.
Thanks,
SachinHi Markus,
Thanks for your quick reply.
As per the Standard SAP Installation Guide Windows Server 2003 Standard / Enterprise / Datacenter Edition is suppoted.
See the document Page 48 Hardware and Software requirements.
[https://websmp206.sap-ag.de/~sapidb/011000358700000512392008E/solman_40_sr4_win_ora.pdf]
Thanks,
Shambo -
FBU Internal Job Queue Full for Synchronous Processing of Print Requests
Hello All,
We are getting a lot of errors in system log (SM21) with the
Error : FBU Internal Job Queue Full for Synchronous Processing of Print Requests
User :SAPSYS
MNO:FBU
=============================================================
Documentation for system log message FB U :
If a spool server is to process output requests in the order they were
created using multiple work processes, the processing of requests for a
particular device can only run on one work process. To do this an
internal queue (limited size) is used.
If too many requests are created for this device too quickly, the work
process may get overloaded. This is recognized when, as in this case,
the internal queue is exhausted.
This can only be solved by reducing the print load or increasing
processor performance or, if there is a connection problem to the host
spooler, by improving the transfer of data to the host spooler.
Increasing the number of spool work processes will not help, as
requests for one device can only be processed by one work process. If
processing in order of creation is not required, sequential request
processing can be deactivated (second page of device configuration in
Transaction SPAD). This allows several work processes to process
requests from the same device thus alleviating the bottleneck.
Enlarging the internal queue will only help if the overload is
temporary. If the overload is constant, a larger queue will eventually
also be overloaded.
===========================================================
Can you please tell me how to proceed.
Best Regards,
PratyushaSolution is here:
412065 - Incorrect output sequence of output requests
Reason and Prerequisites
The following messages appear in the developer trace (dev_trc) of the SPO processes or in the syslog:
S *** ERROR => overflow of internal job queue [rspowunx.c 788]
Syslog Message FBU:
Internal job queue for synchronous request processing of output requests full
The "request processing sequence compliance" on a spool server with several SPO processes only works provided the server-internal job queue (see Note 118057) does not overflow. The size of this request queue is prepared using the rspo/global_shm/job_list profile parameter. The default value is 50 requests. However, if more output requests arrive for the spool server than can be processed (and the internal request queue is full as a result), more SPO processes are used to process the requests (in parallel), and the output sequence of the requests is no longer guaranteed.
Solution
Increase the rspo/global_shm/job_list profile parameter to a much larger value. Unfortunately, the value actually required cannot be found by "trial and error" because this queue contains all the incoming output requests on a spool server, not just the "sequence compliant" requests. A practical lower limit for this value represents the maximum sequence-compliant output requests for the above generated output device. If, for example, 1000 documents that should be output in sequence are issued from an application program to an output device, the queue must be able to hold 1000 entries so that it does not overflow if the SPO process processes the requests at a maximum low-speed. -
Errors in Job Queue for Timesheet
I am having errors in my Job Queue when i fill the timesheet (fill+send+approve) and also when i delete the timesheet from Manage Timesheet or from Delete Enterprise object.
Following is the error description;
1. For Timesheet Fill and submision:
Job Type: Reporting (Timesheet Save)
Job State: Failed But Not Blocking Correlation
Error Description:
Reporting message processor failed:
ReportingTimesheetSaveMessageFailed (24014) - Violation of UNIQUE KEY constraint 'UK_MSP_Timesheet'. Cannot insert duplicate key in object 'dbo.MSP_Timesheet'. The statement has been terminated.. Details: id='24014' name='ReportingTimesheetSaveMessageFailed'
uid='1ba73948-5c8a-4f8f-b8e8-0b1eb822f54d' QueueMessageBody='TimesheetUid='944c71f6-bce1-43f3-aa15-067f9b9bf0ee'' Error='Violation of UNIQUE KEY constraint 'UK_MSP_Timesheet'. Cannot insert duplicate key in object 'dbo.MSP_Timesheet'. The statement has been
terminated.'.
2. For Deletion:
Job Type: Reporting (Timesheet Delete)
Job State: Failed But Not Blocking Correlation
Error Description:
Reporting message processor failed:
ReportingTimesheetDeleteMessageFailed (24011) - Invalid call to MSP_EpmDeleteTimesheetAdminAssignments. Timesheet UID (944C71F6-BCE1-43F3-AA15-067F9B9BF0EE) was not found in MSP_Timesheet.. Details: id='24011' name='ReportingTimesheetDeleteMessageFailed'
uid='8c923f72-eeb4-43cf-a7eb-9ef79bfae86a' QueueMessageBody='TimesheetUid='944c71f6-bce1-43f3-aa15-067f9b9bf0ee'' Error='Invalid call to MSP_EpmDeleteTimesheetAdminAssignments. Timesheet UID (944C71F6-BCE1-43F3-AA15-067F9B9BF0EE) was not found in MSP_Timesheet.'.
Can anyone tell me why is it happening and how to resolve this issue?
Maaz IbrahimHi, I suppose you are running a patch level before CU August 2010? Following issue was resolved by this CU: "Timesheet actuals are not populated in the Reporting database if an initial save or submit operation fails." I have seen the same before August
2010 and it was caused by some circumstances while deleting a timesheet. It was deleted from Published DB, but data remained in Reporting DB. You can check if you have the same situation with following statement: SELECT ResourceName, PERIODNAME, FROM MSP_TIMESHEET
AS MT TIMESHEETUID INNER JOIN AS MTP MSP_TIMESHEETPERIOD ON = MT.PERIODUID MTP.PERIODUID INNER JOIN MSP_TIMESHEETRESOURCE AS MTR ON = MT.OWNERRESOURCENAMEUID MTR.RESOURCENAMEUID TIMESHEETUID WHERE NOT IN (SELECT TS_UID FROM <ProjectServer> _PUBLISHED.DBO.MSP_TIMESHEETS)
I called support and they helped me to resolve. Regards Barbara -
ORA-00471: DBWR process terminated instance with error...
we are upgrading to Portal 10.1.4 from 10.1.2.0.2
Right in the middle of the upgrade scripts running get ORA-00471: DBWR process terminated with error...
Any suggestion?
TIAthe only trace file referred in alert below:
/u01/oracle/infr10.1.2/admin/iaspl14/bdump/iaspl14_pmon_30175.trc
Oracle Database 10g Enterprise Edition Release 10.1.0.4.2 - Production
With the Partitioning, OLAP and Data Mining options
ORACLE_HOME = /u01/oracle/infr10.1.2
System name: Linux
Node name: sandbox3.e-hms.net
Release: 2.6.9-67.ELsmp
Version: #1 SMP Wed Nov 7 13:58:04 EST 2007
Machine: i686
Instance name: iaspl14
Redo thread mounted by this instance: 1
Oracle process number: 2
Unix process pid: 30175, image: [email protected] (PMON)
*** 2007-12-20 11:52:04.239
*** SERVICE NAME:(SYS$BACKGROUND) 2007-12-20 11:52:04.201
*** SESSION ID:(400.1) 2007-12-20 11:52:04.201
error 471 detected in background process
ORA-00471: DBWR process terminated with error -
Instance crashing with ORA-00469: CKPT process terminated with error
Hi,
Instance crashing with ORA-00469: CKPT process terminated with error on 10.2.0.4. Any possibe causes?
Thanks,
MadhavI did check alert log and trace files. I just find this in alert log:
ORA-00469: CKPT process terminated with error
Trace file:
*** 2009-07-29 02:22:06.840
*** SERVICE NAME:(SYS$BACKGROUND) 2009-07-29 02:22:06.839
*** SESSION ID:(275.1) 2009-07-29 02:22:06.839
error 469 detected in background process
ORA-00469: CKPT process terminated with error -
ORA-00476: RECO process terminated with error
My dev instance shutdown automatically due to error 476. I looked up on the error details and found this:
Sun Jan 7 10:17:39 2007
Errors in file /usr/lib/oracle/xe/app/oracle/admin/XE/bdump/xe_pmon_26220.trc:
ORA-00476: RECO process terminated with error
Sun Jan 7 10:17:39 2007
PMON: terminating instance due to error 476
Instance terminated by PMON, pid = 26220
Details for this error from xe_pmon_26220.trc file:
/usr/lib/oracle/xe/app/oracle/admin/XE/bdump/xe_pmon_26220.trc
Oracle Database 10g Express Edition Release 10.2.0.1.0 - Production
ORACLE_HOME = /usr/lib/oracle/xe/app/oracle/product/10.2.0/server
System name: Linux
Node name: boromir
Release: 2.6.9-34.0.1.ELsmp
Version: #1 SMP Wed May 17 17:05:24 EDT 2006
Machine: i686
Instance name: XE
Redo thread mounted by this instance: 1
Oracle process number: 2
Unix process pid: 26220, (PMON)
*** 2007-01-07 10:17:34.543
*** SERVICE NAME:(SYS$BACKGROUND) 2007-01-07 10:17:18.261
*** SESSION ID:(225.1) 2007-01-07 10:17:18.261
Background process RECO found dead
Oracle pid = 9
OS pid (from detached process) = 26234
OS pid (from process state) = 26234
error 476 detected in background process
ORA-00476: RECO process terminated with error
After restarting database I found information about succesfull data recovery
Mon Jan 8 10:37:59 2007
Starting ORACLE instance (normal)
Started redo scan
Completed redo scan
2126 redo blocks read, 42 data blocks need recovery
Started redo application at
Thread 1: logseq 152, block 56161
Recovery of Online Redo Log: Thread 1 Group 1 Seq 152 Reading mem 0
Mem# 0 errs 0: /usr/lib/oracle/xe/app/oracle/flash_recovery_area/XE/onlinelog/o1_mf_1_2f61ppsy_.log
Completed redo application
Completed crash recovery at
Thread 1: logseq 152, block 58287, scn 6441576
42 data blocks read, 42 data blocks written, 2126 redo blocks read
Thread 1 checkpoint: logseq 152, block 2, scn 6369309
cache-low rba: logseq 152, block 56161
on-disk rba: logseq 152, block 58287, scn 6421576
start recovery at logseq 152, block 56161, scn 0
----- Redo read statistics for thread 1 -----
Read rate (ASYNC): 1063Kb in 0.20s => 5.19 Mb/sec
Total physical reads: 4096Kb
Longest record: 2Kb, moves: 0/1139 (0%)
Change moves: 0/24 (0%), moved: 0Mb
Longest LWN: 6Kb, moves: 0/1047 (0%), moved: 0Mb
Last redo scn: 0x0000.0061fc47 (6421575)
*** 2007-01-08 10:38:05.342
KCRA: start recovery claims for 42 data blocks
*** 2007-01-08 10:38:05.446
KCRA: blocks processed = 42/42, claimed = 42, eliminated = 0
*** 2007-01-08 10:38:05.448
Recovery of Online Redo Log: Thread 1 Group 1 Seq 152 Reading mem 0
What are the possible reasons of error ??
Konradit seems that it might be related to killing the RECO
process on the OS level. The crash happen on Sunday (Sun Jan 7 10:17:39 2007) and no one have phisical access to OS
Are you using database links? Might be related to
that, too. No I dont use database links. One database with two schemas.
Does it happen frequently?It happen only one time.
Regards,
Konrad. -
ORA-00470: LGWR process terminated with error
Hi,
Often we are getting the following error on our 10g instance.
ORA-00470: LGWR process terminated with error
Mon Sep 6 22:47:53 2010
PMON: terminating instance due to error 470
Instance terminated by PMON, pid = 16986
And checked in /var/log/messages showing the following
kernel: Out of Memory: Killed process 16995 (oracle)
How can I solve this?
Thanks,
KAvithaHi,
I am using 10g database on Red Hat Enterprise Linux AS release 4 (Nahant Update 4).
The alert log showing the following information.
Mon Sep 6 23:09:45 2010
Completed: ALTER DATABASE OPEN
Mon Sep 6 23:17:30 2010
Errors in file /d04/u02/oracle/admin/cidb/bdump/cidb_pmon_19969.trc:
ORA-00470: LGWR process terminated with error
Mon Sep 6 23:17:30 2010
PMON: terminating instance due to error 470
Termination issued to instance processes. Waiting for the processes to exit
Mon Sep 6 23:17:44 2010
Instance termination failed to kill one or more processes
Instance terminated by PMON, pid = 19969
And also check cidb_pmon_19969.trc file
/d04/u02/oracle/admin/cidb/bdump/cidb_pmon_19969.trc
Oracle Database 10g Enterprise Edition Release 10.2.0.2.0 - Production
With the Partitioning, OLAP and Data Mining options
ORACLE_HOME = /d04/u02/oracle/cidb
System name: Linux
Node name: sflxdb07.donerus.com
Release: 2.6.9-34.ELsmp
Version: #1 SMP Fri Feb 24 16:54:53 EST 2006
Machine: i686
Instance name: cidb
Redo thread mounted by this instance: 1
Oracle process number: 2
Unix process pid: 19969, image: [email protected] (PMON)
*** 2010-09-06 23:17:30.676
*** SERVICE NAME:(SYS$BACKGROUND) 2010-09-06 23:17:30.530
*** SESSION ID:(170.1) 2010-09-06 23:17:30.530
Background process LGWR found dead
Oracle pid = 6
OS pid (from detached process) = 19977
OS pid (from process state) = 19977
dtp = 0x2000bab8, proc = 0x8b2b13fc
Dump of memory from 0x2000BAB8 to 0x2000BAE4
2000BAB0 00000074 8B2B13FC [t.....+.]
2000BAC0 00000000 00000000 5257474C 00000200 [........LGWR....]
2000BAD0 00004E09 113B6215 00000001 2AD428DC [.N...b;......(.*]
2000BAE0 00040001 [....]
Dump of memory from 0x8B2B13FC to 0x8B2B19B4
8B2B13F0 00000102 [....]
8B2B1400 00000000 00000000 00000000 00000000 [................]
8B2B1410 89555C60 8B82DB2C 8B3C2078 8B82CBEC [`\U.,...x <.....]
8B2B1420 00000000 8B82CC50 8B82CC50 8B82DB20 [....P...P... ...]
8B2B1430 00000601 8B3AE848 8B3C2078 00000006 [....H.:.x <.....]
8B2B1440 00000000 00000000 00000000 8B4D2F48 [............H/M.]
8B2B1450 8B4D2FE4 00000000 00000000 00000000 [./M.............]
8B2B1460 00000000 00000000 00000000 00000000 [................]
Repeat 2 times
8B2B1490 00000000 00000000 00030000 00000000 [................]
8B2B14A0 00030000 00000000 00000000 00000000 [................]
Repeat 1 times
8B2B17B0 00000000 00000000 00000014 4E4B4E55 [............UNKN]
8B2B17C0 004E574F 00000000 00000000 00000000 [OWN.............]
8B2B17D0 00000000 00000000 00000000 00000008 [................]
8B2B17E0 37393931 00000037 00000000 00000000 [19977...........]
8B2B17F0 00000000 00000000 00000005 6361726F [............orac]
8B2B19B0 00000006 [....]
error 470 detected in background process
ORA-00470: LGWR process terminated with error
*** 2010-09-06 23:17:44.081
Instance termination failed to kill one or more processes
ksuitm_check: OS PID=20017 is still alive
*** 2010-09-06 23:17:44.083
Dumping diagnostic information for [email protected] (J002):
OS pid = 20017
loadavg : 63.67 22.12 10.45
memory info: free memory = 0.00M
swap info: free = 0.00M alloc = 0.00M total = 0.00M
F S UID PID PPID C PRI NI ADDR SZ WCHAN STIME TTY TIME CMD
ERROR: process 20017 is not alive
*** 2010-09-06 23:17:44.814
Thanks,
Kavitha -
SAP oracle database crash with errore:ORA-00490: PSP process terminated
Hi ALL,
Our oracle database crash with errore code in trace : ORA:00490; i started database again and it working fine; but could not fine reason of down and what is this erroe all about
can some help me
Errors in file /oracle/SRD/saptrace/background/srd_pmon_28096.trc:
ORA-00490: PSP process terminated with error
Tue Nov 25 09:00:57 2008
PMON: terminating instance due to error 490
Instance terminated by PMON, pid = 28096
Thanks,
DineshHi stefen,
please find the trace file as below
/oracle/SRD/saptrace/background/srd_pmon_28096.trc
Oracle Database 10g Enterprise Edition Release 10.2.0.2.0 - 64bit Production
With the Partitioning and Data Mining options
ORACLE_HOME = /oracle/SRD/102_64
System name: SunOS
Node name: nzlsfn23
Release: 5.10
Version: Generic_137111-01
Machine: sun4u
Instance name: SRD
Redo thread mounted by this instance: 1
Oracle process number: 2
Unix process pid: 28096, image: oracle@nzlsfn23 (PMON)
2008-11-25 09:00:57.497
SERVICE NAME:(SYS$BACKGROUND) 2008-11-25 09:00:56.210
SESSION ID:(24.1) 2008-11-25 09:00:56.194
Background process PSP0 found dead
Oracle pid = 6
OS pid (from detached process) = 28098
OS pid (from process state) = 28098
dtp = 38000afd8, proc = 497000860
Dump of memory from 0x000000038000AFD8 to 0x000000038000B020
38000AFD0 00000005 00000000 [........]
38000AFE0 00000004 97000860 00000000 00000000 [.......`........]
38000AFF0 00000000 50535030 00020000 00000000 [....PSP0........]
38000B000 00006DC2 00000000 00000000 48E50DA4 [..m.........H...]
38000B010 00000001 000E3273 00040081 00000000 [......2s........]
Dump of memory from 0x0000000497000860 to 0x0000000497001048
497000860 02010000 00000000 00000000 00000000 [................]
497000870 00000000 00000000 00000000 00000000 [................]
497000880 00000004 97042570 00000004 97047810 [......%p......x.]
497000890 00000004 97028E68 00000004 97045BE8 [.......h......[.]
4970008A0 00000000 00000000 00000004 97045C70 [..............\p]
4970008B0 00000004 97045C70 00000004 97047800 [......\p......x.]
4970008C0 01060000 00000000 00000004 97025ED8 [..............^.]
4970008D0 00000004 97028E68 00000006 00000000 [.......h........]
4970008E0 00000000 00000000 00000000 00000000 [................]
4970008F0 00000000 00000000 00000004 97042490 [..............$.]
497000900 00000004 970425A0 00000000 00000000 [......%.........]
497000910 00000000 00000000 00000000 00000000 [................]
Repeat 3 times
497000950 00000003 00000000 00000000 00000000 [................]
Repeat 1 times
497000970 00000000 00000000 00000000 00000000 [................]
497000980 00000004 00000000 00000000 00000000 [................]
497000990 00000003 00000000 00000000 00000000 [................]
Repeat 1 times
4970009B0 00000004 00000000 00000000 00000000 [................]
4970009C0 00000005 00000000 00000000 00000000 [................]
4970009D0 00000003 00000000 00000000 00000000 [................]
4970009E0 00000000 00000000 00000000 00000000 [................]
Repeat 8 times
497000A70 00000000 00000000 00000004 97000A78 [...............x]
497000A80 00000004 97000A78 00000000 00000000 [.......x........]
497000A90 00000000 00000000 00000004 97000A98 [................]
497000AA0 00000004 97000A98 00000000 00000000 [................]
497000AB0 00000000 00000000 00000000 00000000 [................]
Repeat 2 times
497000AE0 00000000 00000000 00000018 00000030 [...............0]
497000AF0 00000001 00000B3D 00000004 970037D0 [.......=......7.]
497000B00 00000004 580096B0 00000001 00000000 [....X...........]
497000B10 00000000 00000000 00000000 00000000 [................]
Repeat 2 times
497000B40 00006DC2 00000000 00000000 00000000 [..m.............]
497000B50 00000000 00000000 00000000 00000000 [................]
Repeat 2 times
497000B80 00000004 97000860 00000000 00000000 [.......`........]
497000B90 00000000 00000000 00000000 00000000 [................]
Repeat 7 times
497000C10 00000004 97000C10 00000004 97000C10 [................]
497000C20 00000000 00000000 00010000 00000000 [................]
497000C30 00000000 00000117 0000000A 00000000 [................]
497000C40 00006DC2 00000000 00000000 48E50DA4 [..m.........H...]
497000C50 00000001 00000000 00000000 00000000 [................]
497000C60 00000000 00000000 00000000 00000000 [................]
Repeat 2 times
497000C90 00000000 00000000 00000003 FFFFFFFF [................]
497000CA0 00000000 00000000 00000000 00000000 [................]
Repeat 13 times
497000D80 73726461 646D0000 00000000 00000000 [srdadm..........]
497000D90 00000000 00000000 00000000 00000000 [................]
497000DA0 00000000 00000006 6E7A6C73 666E3233 [........nzlsfn23]
497000DB0 00000000 00000000 00000000 00000000 [................]
Repeat 2 times
497000DE0 00000000 00000000 00000000 00000008 [................]
497000DF0 554E4B4E 4F574E00 00000000 00000000 [UNKNOWN.........]
497000E00 00000000 00000000 00000000 00000000 [................]
497000E10 00000000 00000008 32383039 38000000 [........28098...]
497000E20 00000000 00000000 00000000 00000000 [................]
497000E30 00000000 00000005 6F726163 6C65406E [........oracle@n]
497000E40 7A6C7366 6E323320 28505350 30290000 [zlsfn23 (PSP0)..]
497000E50 00000000 00000000 00000000 00000000 [................]
497000E60 00000000 00000000 00000000 00000016 [................]
497000E70 00000000 00000002 00000000 00000000 [................]
497000E80 00000000 00000000 00000000 00000000 [................]
Repeat 8 times
497000F10 00000000 00000000 00000000 00020000 [................]
497000F20 00000000 00000000 00000000 00000000 [................]
497000F30 00000000 00000000 00000003 9E1F6748 [..............gH]
497000F40 00000004 97001728 00000004 97000758 [.......(.......X]
497000F50 00000000 00000000 00000003 9E26B5B0 [.............&..]
497000F60 00000000 00000000 00000000 00000000 [................]
Repeat 1 times
497000F80 00000004 97000F80 00000004 97000F80 [................]
497000F90 00000000 00040000 00000000 00000000 [................]
497000FA0 00000000 00031A55 00000000 0004D7DD [.......U........]
497000FB0 00000000 00071A55 00000000 00000000 [.......U........]
497000FC0 00000000 00000000 00000000 00000000 [................]
497000FD0 00000000 00000828 00000000 000000E0 [.......(........]
497000FE0 00000000 00000828 00000000 00000000 [.......(........]
497000FF0 00000000 00000000 00000000 00000000 [................]
Repeat 4 times
497001040 00000002 00000000 [........]
error 490 detected in background process
ORA-00490: PSP process terminated with error -
SMON process terminated with error
Hi,
Oracle Version:10.2.0.3
Operating system:Linux
I alert log file i found that smon process was terminated with error.Below is the contents of the alert log file.
Fri Dec 31 05:12:32 2010
sculkget: failed to lock /home/oracle/oracle/oracle/product/10.2.0/db_1/dbs/lkinstqfundeca exclusive
sculkget: lock held by PID: 9127
Oracle Instance Shutdown operation failed. Another process may be attempting to startup or shutdown this Instance.
Failed to acquire instance startup/shutdown serialization primitive
Fri Dec 31 05:56:23 2010
sculkget: failed to lock /home/oracle/oracle/oracle/product/10.2.0/db_1/dbs/lkinstqfundeca exclusive
sculkget: lock held by PID: 9127
Oracle Instance Shutdown operation failed. Another process may be attempting to startup or shutdown this Instance.
Failed to acquire instance startup/shutdown serialization primitive
Fri Dec 31 06:40:53 2010
WARNING: inbound connection timed out (ORA-3136)
Fri Dec 31 06:40:53 2010
WARNING: inbound connection timed out (ORA-3136)
Fri Dec 31 06:40:53 2010
WARNING: inbound connection timed out (ORA-3136)
Fri Dec 31 06:40:53 2010
WARNING: inbound connection timed out (ORA-3136)
Fri Dec 31 06:40:53 2010
WARNING: inbound connection timed out (ORA-3136)
Fri Dec 31 06:40:53 2010
WARNING: inbound connection timed out (ORA-3136)
Fri Dec 31 06:40:53 2010
WARNING: inbound connection timed out (ORA-3136)
Fri Dec 31 06:40:53 2010
MMNL absent for 7904 secs; Foregrounds taking over
Fri Dec 31 06:40:53 2010
Starting background process EMN0
Fri Dec 31 06:40:53 2010
The value (30) of MAXTRANS parameter ignored.
Fri Dec 31 06:40:53 2010
Thread 1 cannot allocate new log, sequence 62004
Checkpoint not complete
Current log# 1 seq# 62003 mem# 0: /u02/oradata/qfundeca/redo01a.log
Current log# 1 seq# 62003 mem# 1: /u03/oradata/qfundeca/redo01b.log
EMN0 started with pid=29, OS id=7176
Fri Dec 31 06:40:53 2010
Shutting down instance: further logons disabled
Fri Dec 31 06:40:53 2010
ksvcreate: Process(m001) creation failed
Fri Dec 31 06:40:53 2010
kkjcre1p: unable to spawn jobq slave process, error 1089
Fri Dec 31 06:40:53 2010
kkjcre1p: unable to spawn jobq slave process, error 1089
Fri Dec 31 06:40:54 2010
Stopping background process QMNC
Fri Dec 31 06:40:54 2010
Stopping background process CJQ0
Fri Dec 31 06:40:54 2010
Thread 1 cannot allocate new log, sequence 62004
Private strand flush not complete
Current log# 1 seq# 62003 mem# 0: /u02/oradata/qfundeca/redo01a.log
Current log# 1 seq# 62003 mem# 1: /u03/oradata/qfundeca/redo01b.log
Fri Dec 31 06:40:56 2010
Stopping background process MMNL
Fri Dec 31 06:40:56 2010
Thread 1 advanced to log sequence 62004
Current log# 2 seq# 62004 mem# 0: /u02/oradata/qfundeca/redo02a.log
Current log# 2 seq# 62004 mem# 1: /u03/oradata/qfundeca/redo02b.log
Fri Dec 31 06:40:57 2010
Starting background process QMNC
Fri Dec 31 06:40:57 2010
Errors in file /home/oracle/oracle/admin/qfundeca/udump/qfundeca_ora_3065.trc:
ORA-00443: background process "QMNC" did not start
Fri Dec 31 06:41:04 2010
Stopping background process MMON
Fri Dec 31 06:41:05 2010
Errors in file /home/oracle/oracle/admin/qfundeca/udump/qfundeca_ora_9127.trc:
ORA-00604: error occurred at recursive SQL level 1
ORA-12663: Services required by client not available on the server
ORA-36961: Oracle OLAP is not available.
ORA-06512: at "SYS.OLAPIHISTORYRETENTION", line 1
ORA-06512: at line 15
Fri Dec 31 06:41:05 2010
Shutting down instance (immediate)
License high water mark = 93
Fri Dec 31 06:41:05 2010
Stopping Job queue slave processes
Fri Dec 31 06:41:05 2010
Job queue slave processes stopped
Fri Dec 31 06:41:57 2010
All dispatchers and shared servers shutdown
Fri Dec 31 06:41:59 2010
ALTER DATABASE CLOSE NORMAL
Fri Dec 31 06:41:59 2010
SMON: disabling tx recovery
SMON: disabling cache recovery
Fri Dec 31 06:42:00 2010
Shutting down archive processes
Archiving is disabled
Fri Dec 31 06:42:05 2010
ARCH shutting down
ARC1: Archival stopped
Fri Dec 31 06:42:11 2010
ARCH shutting down
ARC0: Archival stopped
Fri Dec 31 06:42:12 2010
Thread 1 closed at log sequence 62004
Successful close of redo thread 1
Fri Dec 31 06:42:12 2010
Completed: ALTER DATABASE CLOSE NORMAL
Fri Dec 31 06:42:12 2010
ALTER DATABASE DISMOUNT
Completed: ALTER DATABASE DISMOUNT
ARCH: Archival disabled due to shutdown: 1089
Shutting down archive processes
Archiving is disabled
Archive process shutdown avoided: 0 active
ARCH: Archival disabled due to shutdown: 1089
Shutting down archive processes
Archiving is disabled
Archive process shutdown avoided: 0 active
Fri Dec 31 06:49:52 2010
Starting ORACLE instance (normal)
LICENSE_MAX_SESSION = 0
LICENSE_SESSIONS_WARNING = 0
Picked latch-free SCN scheme 2
Autotune of undo retention is turned on.
IMODE=BR
ILAT =27
LICENSE_MAX_USERS = 0
SYS auditing is disabled
ksdpec: called for event 13740 prior to event group initialization
Starting up ORACLE RDBMS Version: 10.2.0.3.0.
System parameters with non-default values:
processes = 150
sessions = 250
__shared_pool_size = 385875968
__large_pool_size = 16777216
__java_pool_size = 16777216
__streams_pool_size = 33554432
streams_pool_size = 33554432
sga_target = 1610612736
control_files = /u02/oradata/qfundeca/control01.ctl, /u02/oradata/qfundeca/control02.ctl, /u03/oradata/qfundeca/control03.ctl
db_block_size = 8192
__db_cache_size = 1140850688
compatible = 10.2.0.3.0
log_archive_dest_1 = LOCATION=/u02/oradata/arch/qfundeca
log_archive_format = %t_%s_%r.dbf
archive_lag_target = 2700
db_file_multiblock_read_count= 16
db_recovery_file_dest = /u02/oradata/flash_recovery_area
db_recovery_file_dest_size= 21474836480
standby_file_management = AUTO
undo_management = AUTO
undo_tablespace = UNDOTBS1
remote_login_passwordfile= EXCLUSIVE
db_domain =
dispatchers = (PROTOCOL=TCP) (SERVICE=qfundecaXDB)
job_queue_processes = 17
cursor_sharing = EXACT
background_dump_dest = /home/oracle/oracle/admin/qfundeca/bdump
user_dump_dest = /home/oracle/oracle/admin/qfundeca/udump
core_dump_dest = /home/oracle/oracle/admin/qfundeca/cdump
audit_file_dest = /home/oracle/oracle/admin/qfundeca/adump
db_name = qfundeca
open_cursors = 300
pga_aggregate_target = 839909376
PMON started with pid=2, OS id=9591
PSP0 started with pid=3, OS id=9593
MMAN started with pid=4, OS id=9595
DBW0 started with pid=5, OS id=9597
LGWR started with pid=6, OS id=9599
CKPT started with pid=7, OS id=9601
SMON started with pid=8, OS id=9603
RECO started with pid=9, OS id=9605
CJQ0 started with pid=10, OS id=9607
MMON started with pid=11, OS id=9609
Fri Dec 31 06:49:54 2010
starting up 1 dispatcher(s) for network address '(ADDRESS=(PARTIAL=YES)(PROTOCOL=TCP))'...
MMNL started with pid=12, OS id=9611
Fri Dec 31 06:49:54 2010
starting up 1 shared server(s) ...
Oracle Data Guard is not available in this edition of Oracle.
Fri Dec 31 06:49:54 2010
ALTER DATABASE MOUNT
Fri Dec 31 06:49:58 2010
Setting recovery target incarnation to 1
Fri Dec 31 06:49:58 2010
Successful mount of redo thread 1, with mount id 256948178
Fri Dec 31 06:49:58 2010
Database mounted in Exclusive Mode
Completed: ALTER DATABASE MOUNT
Fri Dec 31 06:49:58 2010
ALTER DATABASE OPEN
Fri Dec 31 06:49:58 2010
LGWR: STARTING ARCH PROCESSES
ARC0 started with pid=16, OS id=9619
Fri Dec 31 06:49:58 2010
ARC0: Archival started
ARC1: Archival started
LGWR: STARTING ARCH PROCESSES COMPLETE
ARC1 started with pid=17, OS id=9621
Fri Dec 31 06:49:58 2010
Thread 1 opened at log sequence 62004
Current log# 2 seq# 62004 mem# 0: /u02/oradata/qfundeca/redo02a.log
Current log# 2 seq# 62004 mem# 1: /u03/oradata/qfundeca/redo02b.log
Successful open of redo thread 1
Fri Dec 31 06:49:58 2010
ARC0: Becoming the 'no FAL' ARCH
ARC0: Becoming the 'no SRL' ARCH
Fri Dec 31 06:49:58 2010
ARC1: Becoming the heartbeat ARCH
Fri Dec 31 06:49:58 2010
SMON: enabling cache recovery
Fri Dec 31 06:49:58 2010
Successfully onlined Undo Tablespace 1.
Fri Dec 31 06:49:58 2010
SMON: enabling tx recovery
Fri Dec 31 06:49:58 2010
Database Characterset is WE8ISO8859P1
replication_dependency_tracking turned off (no async multimaster replication found)
Starting background process QMNC
QMNC started with pid=18, OS id=9623
Fri Dec 31 06:49:59 2010
Errors in file /home/oracle/oracle/admin/qfundeca/udump/qfundeca_ora_9617.trc:
ORA-00604: error occurred at recursive SQL level 1
ORA-12663: Services required by client not available on the server
ORA-36961: Oracle OLAP is not available.
ORA-06512: at "SYS.OLAPIHISTORYRETENTION", line 1
ORA-06512: at line 15
Fri Dec 31 06:50:00 2010
Completed: ALTER DATABASE OPEN
Fri Dec 31 06:50:00 2010
db_recovery_file_dest_size of 20480 MB is 0.00% used. This is a
user-specified limit on the amount of space that will be used by this
database for recovery-related files, and does not reflect the amount of
space available in the underlying filesystem or ASM diskgroup.
Fri Dec 31 06:55:59 2010
The value (30) of MAXTRANS parameter ignored.
kupprdp: master process DM00 started with pid=36, OS id=12004
to execute - SYS.KUPM$MCP.MAIN('QFUNDECA_PROD_BKP', 'QFUNDECAPROD', 'KUPC$C_1_20101231065559', 'KUPC$S_1_20101231065559', 0);
kupprdp: worker process DW01 started with worker id=1, pid=37, OS id=12009
to execute - SYS.KUPW$WORKER.MAIN('QFUNDECA_PROD_BKP', 'QFUNDECAPROD');
Fri Dec 31 07:04:59 2010
Thread 1 cannot allocate new log, sequence 62005
Private strand flush not complete
Current log# 2 seq# 62004 mem# 0: /u02/oradata/qfundeca/redo02a.log
Current log# 2 seq# 62004 mem# 1: /u03/oradata/qfundeca/redo02b.log
Thread 1 advanced to log sequence 62005
Current log# 3 seq# 62005 mem# 0: /u02/oradata/qfundeca/redo03a.log
Current log# 3 seq# 62005 mem# 1: /u03/oradata/qfundeca/redo03b.log
Fri Dec 31 07:30:01 2010
Thread 1 cannot allocate new log, sequence 62006
Private strand flush not complete
Current log# 3 seq# 62005 mem# 0: /u02/oradata/qfundeca/redo03a.log
Current log# 3 seq# 62005 mem# 1: /u03/oradata/qfundeca/redo03b.log
Thread 1 advanced to log sequence 62006
Current log# 1 seq# 62006 mem# 0: /u02/oradata/qfundeca/redo01a.log
Current log# 1 seq# 62006 mem# 1: /u03/oradata/qfundeca/redo01b.log
Fri Dec 31 07:54:42 2010
System State dumped to trace file /home/oracle/oracle/admin/qfundeca/udump/qfundeca_ora_24979.trc
Fri Dec 31 07:55:06 2010
System State dumped to trace file /home/oracle/oracle/admin/qfundeca/udump/qfundeca_ora_25057.trc
Fri Dec 31 07:55:37 2010
System State dumped to trace file /home/oracle/oracle/admin/qfundeca/udump/qfundeca_ora_25209.trc
Fri Dec 31 07:59:33 2010
System State dumped to trace file /home/oracle/oracle/admin/qfundeca/udump/qfundeca_ora_26237.trc
Fri Dec 31 08:00:25 2010
System State dumped to trace file /home/oracle/oracle/admin/qfundeca/udump/qfundeca_ora_26523.trc
Fri Dec 31 08:00:40 2010
System State dumped to trace file /home/oracle/oracle/admin/qfundeca/udump/qfundeca_ora_26909.trc
Fri Dec 31 08:06:34 2010
Errors in file /home/oracle/oracle/admin/qfundeca/bdump/qfundeca_pmon_9591.trc:
*ORA-00474: SMON process terminated with error*
*Fri Dec 31 08:06:34 2010*
*PMON: terminating instance due to error 474*
Instance terminated by PMON, pid = 9591
Fri Dec 31 08:08:31 2010
Starting ORACLE instance (normal)
LICENSE_MAX_SESSION = 0
LICENSE_SESSIONS_WARNING = 0
Picked latch-free SCN scheme 2
Autotune of undo retention is turned on.
IMODE=BR
ILAT =27
LICENSE_MAX_USERS = 0
SYS auditing is disabled
ksdpec: called for event 13740 prior to event group initialization
Starting up ORACLE RDBMS Version: 10.2.0.3.0.
System parameters with non-default values:
processes = 150
sessions = 250
__shared_pool_size = 234881024
__large_pool_size = 16777216
__java_pool_size = 16777216
__streams_pool_size = 33554432
streams_pool_size = 33554432
sga_target = 1610612736
control_files = /u02/oradata/qfundeca/control01.ctl, /u02/oradata/qfundeca/control02.ctl, /u03/oradata/qfundeca/control03.ctl
db_block_size = 8192
__db_cache_size = 1291845632
compatible = 10.2.0.3.0
log_archive_dest_1 = LOCATION=/u02/oradata/arch/qfundeca
log_archive_format = %t_%s_%r.dbf
archive_lag_target = 2700
db_file_multiblock_read_count= 16
db_recovery_file_dest = /u02/oradata/flash_recovery_area
db_recovery_file_dest_size= 21474836480
standby_file_management = AUTO
undo_management = AUTO
undo_tablespace = UNDOTBS1
remote_login_passwordfile= EXCLUSIVE
db_domain =
dispatchers = (PROTOCOL=TCP) (SERVICE=qfundecaXDB)
job_queue_processes = 17
cursor_sharing = EXACT
background_dump_dest = /home/oracle/oracle/admin/qfundeca/bdump
user_dump_dest = /home/oracle/oracle/admin/qfundeca/udump
core_dump_dest = /home/oracle/oracle/admin/qfundeca/cdump
audit_file_dest = /home/oracle/oracle/admin/qfundeca/adump
db_name = qfundeca
open_cursors = 300
pga_aggregate_target = 839909376
PMON started with pid=2, OS id=648
PSP0 started with pid=3, OS id=650
MMAN started with pid=4, OS id=652
DBW0 started with pid=5, OS id=654
LGWR started with pid=6, OS id=656
CKPT started with pid=7, OS id=658
SMON started with pid=8, OS id=660
RECO started with pid=9, OS id=662
CJQ0 started with pid=10, OS id=664
MMON started with pid=11, OS id=666
Fri Dec 31 08:08:32 2010
starting up 1 dispatcher(s) for network address '(ADDRESS=(PARTIAL=YES)(PROTOCOL=TCP))'...
MMNL started with pid=12, OS id=668
Fri Dec 31 08:08:32 2010
starting up 1 shared server(s) ...
Oracle Data Guard is not available in this edition of Oracle.
Fri Dec 31 08:08:32 2010
ALTER DATABASE MOUNT
Fri Dec 31 08:08:36 2010
Setting recovery target incarnation to 1
Fri Dec 31 08:08:36 2010
Successful mount of redo thread 1, with mount id 257031232
Fri Dec 31 08:08:36 2010
Database mounted in Exclusive Mode
Completed: ALTER DATABASE MOUNT
Fri Dec 31 08:08:36 2010
ALTER DATABASE OPEN
Fri Dec 31 08:08:37 2010
Beginning crash recovery of 1 threads
Fri Dec 31 08:08:37 2010
Started redo scan
Fri Dec 31 08:08:37 2010
Completed redo scan
31201 redo blocks read, 754 data blocks need recovery
Fri Dec 31 08:08:38 2010
Started redo application at
Thread 1: logseq 62004, block 66343
Fri Dec 31 08:08:38 2010
Recovery of Online Redo Log: Thread 1 Group 2 Seq 62004 Reading mem 0
Mem# 0: /u02/oradata/qfundeca/redo02a.log
Mem# 1: /u03/oradata/qfundeca/redo02b.log
Fri Dec 31 08:08:38 2010
Recovery of Online Redo Log: Thread 1 Group 3 Seq 62005 Reading mem 0
Mem# 0: /u02/oradata/qfundeca/redo03a.log
Mem# 1: /u03/oradata/qfundeca/redo03b.logHow to know what is the reason for this one.On that day the database hangs two time as i mentioned in my previous post.
Thanks & Regards,
Poorna Prasad.Hi Chinar,
Here is the contents for the file /home/oracle/oracle/admin/qfundeca/bdump/qfundeca_pmon_9591.trc
/home/oracle/oracle/admin/qfundeca/bdump/qfundeca_pmon_9591.trc
Oracle Database 10g Release 10.2.0.3.0 - Production
ORACLE_HOME = /home/oracle/oracle/oracle/product/10.2.0/db_1
System name: Linux
Node name: virqts2ora001.localdomain
Release: 2.6.9-5.ELsmp
Version: #1 SMP Wed Jan 5 19:30:39 EST 2005
Machine: i686
Instance name: qfundeca
Redo thread mounted by this instance: 1
Oracle process number: 2
Unix process pid: 9591, image: [email protected] (PMON)
*** 2010-12-31 08:06:34.723
*** SERVICE NAME:(SYS$BACKGROUND) 2010-12-31 08:06:34.723
*** SESSION ID:(250.1) 2010-12-31 08:06:34.723
Background process SMON found dead
Oracle pid = 8
OS pid (from detached process) = 9603
OS pid (from process state) = 9603
dtp = 0x2000ed88, proc = 0x7f3528a0
Dump of memory from 0x2000ED88 to 0x2000EDB4
2000ED80 0000007C 7F3528A0 [|....(5.]
2000ED90 00000000 00000000 4E4F4D53 00000200 [........SMON....]
2000EDA0 00002583 FFFFFFFF 00000001 5634F590 [.%............4V]
2000EDB0 00040081 [....]
Dump of memory from 0x7F3528A0 to 0x7F352E58
7F3528A0 00000102 00000000 00000000 00000000 [................]
7F3528B0 00000000 7F5FDF30 7F95787C 7F4C61E0 [....0._.|x...aL.]
7F3528C0 7F956AE4 00000000 7F956B48 7F956B48 [.j......Hk..Hk..]
7F3528D0 7F957870 00001601 7F4AA968 7F4C61E0 [px......h.J..aL.]
7F3528E0 00000008 7F4C7430 7F4C75B4 00000000 [....0tL..uL.....]
7F3528F0 7F5FCE18 7F5FDF48 00000000 00000000 [.._.H._.........]
7F352900 00000000 00000000 00000000 00000000 [................]
Repeat 2 times
7F352930 00000000 00000000 00000000 000C0000 [................]
7F352940 00000000 00080000 00000000 00050000 [................]
7F352950 00000000 00040000 00000000 00040000 [................]
7F352960 00000000 00080000 00000000 000C0000 [................]
7F352970 00000000 000C0000 00000000 00050000 [................]
7F352980 00000000 00110000 00000000 000F0000 [................]
7F352990 00000000 00000000 00000000 00000000 [................]
Repeat 3 times
7F3529D0 00000002 7F3529D4 7F3529D4 00000000 [.....)5..)5.....]
7F3529E0 00000001 00000000 7F3529E8 7F3529E8 [.........)5..)5.]
7F3529F0 00000000 00000000 00000000 00000000 [................]
Repeat 1 times
7F352A10 00000021 00000018 00000095 00000015 [!...............]
7F352A20 7F366E98 7F351D30 00010000 00000000 [.n6.0.5.........]
7F352A30 00000000 00000000 00000000 00000000 [................]
Repeat 1 times
7F352A50 00000000 00000000 00002583 00000000 [.........%......]
7F352A60 00000000 00000000 00000000 00000000 [................]
Repeat 2 times
7F352A90 00000000 00000000 7F3528A0 00000000 [.........(5.....]
7F352AA0 00000000 00000000 00000000 00000000 [................]
Repeat 6 times
7F352B10 00000000 7F352B14 7F352B14 00000000 [.....+5..+5.....]
7F352B20 00000000 00000001 00000000 00000000 [................]
7F352B30 3461800E 0000000C 00002583 FFFFFFFF [..a4.....%......]
7F352B40 B74796C0 00000000 00000000 00000000 [..G.............]
7F352B50 00000000 00000000 00000000 00000000 [................]
7F352B60 00000000 00000000 00000008 FFFFFFFF [................]
7F352B70 00000000 00000000 00000000 00000000 [................]
Repeat 7 times
7F352BF0 00000000 00000000 6361726F 0000656C [........oracle..]
7F352C00 00000000 00000000 00000000 00000000 [................]
7F352C10 00000000 00000000 00000006 71726976 [............virq]
7F352C20 6F327374 30306172 6F6C2E31 646C6163 [ts2ora001.locald]
7F352C30 69616D6F 0000006E 00000000 00000000 [omain...........]
7F352C40 00000000 00000000 00000000 00000000 [................]
7F352C50 00000000 00000000 00000000 00000019 [................]
7F352C60 4E4B4E55 004E574F 00000000 00000000 [UNKNOWN.........]
7F352C70 00000000 00000000 00000000 00000000 [................]
7F352C80 00000008 33303639 00000000 00000000 [....9603........]
7F352C90 00000000 00000000 00000000 00000004 [................]
7F352CA0 6361726F 7640656C 74717269 726F3273 [oracle@virqts2or]
7F352CB0 31303061 636F6C2E 6F646C61 6E69616D [a001.localdomain]
7F352CC0 4D532820 00294E4F 00000000 00000000 [ (SMON).........]
7F352CD0 00000027 00000002 00000001 7864736B ['...........ksdx]
7F352CE0 6B747366 312B2928 6B2D3C39 63786473 [fstk()+19<-ksdxc]
7F352CF0 2B292862 31323331 73732D3C 65737570 [b()+1321<-sspuse]
7F352D00 2B292872 3C323031 3930302D 41374131 [r()+102<-0091A7A]
7F352D10 00000032 00000000 00000000 00000000 [2...............]
7F352D20 00000000 00000000 00000000 00000000 [................]
Repeat 4 times
7F352D70 00000000 00000000 00000000 00060200 [................]
7F352D80 0000691D FFFFFFFF 00000000 00000000 [.i..............]
7F352D90 7F38693C 7F35334C 7F3527DC 00000000 [<i8.L35..'5.....]
7F352DA0 7F5D3CEC 00000000 00000000 00000000 [.<].............]
7F352DB0 00000000 00000000 00000000 00000000 [................]
7F352DC0 7F352DC0 7F352DC0 001B0000 00130000 [.-5..-5.........]
7F352DD0 00029615 0007CBB1 001E9615 0000EB2C [............,...]
7F352DE0 00000000 00005F28 00000000 0002C440 [....(_......@...]
7F352DF0 00000000 00000814 00000000 00000088 [................]
7F352E00 00000000 00000814 00000000 00000000 [................]
7F352E10 00000000 00000000 00000000 00000000 [................]
Repeat 3 times
7F352E50 00000000 00000003 [........]
error 474 detected in background process
ORA-00474: SMON process terminated with error -
Terminating instance due to error - CKPT process terminated with error
Hi Folks !
i have a problem with my oracle 10g it works under an debain 3.1. In my alert.log i have see an error-message, the database terminating.
Thu Feb 15 13:01:21 2007
Errors in file /u01/app/oracle/admin/tlp/bdump/tlp_pmon_9689.trc:
ORA-00469: CKPT process terminated with error
Thu Feb 15 13:01:21 2007
PMON: terminating instance due to error 469
Instance terminated by PMON, pid = 9689
A look into the trace file:
/u01/app/oracle/admin/tlp/bdump/tlp_pmon_9689.trc
Oracle Database 10g Release 10.2.0.1.0 - Production
ORACLE_HOME = /u01/app/oracle/product/10.2.0/db_1
System name: Linux
Node name: hyperion
Release: 2.6.18.1-vs2.1.1-rc48-vserver
Version: #1 SMP PREEMPT Wed Nov 15 16:53:41 CET 2006
Machine: i686
Instance name: tlp
Redo thread mounted by this instance: 1
Oracle process number: 2
Unix process pid: 9689, image: oracle@hyperion (PMON)
*** 2007-02-15 13:01:21.813
*** SERVICE NAME:(SYS$BACKGROUND) 2007-02-15 13:01:21.813
*** SESSION ID:(170.1) 2007-02-15 13:01:21.813
Background process CKPT found dead
Oracle pid = 7
OS pid (from detached process) = 9700
OS pid (from process state) = 9700
dtp = 0x2000c9ac, proc = 0x672b14c4
Dump of memory from 0x2000C9AC to 0x2000C9D8
2000C9A0 00000076 [v...]
2000C9B0 672B14C4 00000000 00000000 54504B43 [..+g........CKPT]
2000C9C0 00000200 000025E4 0A8BA210 00000001 [.....%..........]
2000C9D0 70F2A67F 00040081 [...p....]
Dump of memory from 0x672B14C4 to 0x672B1A78
672B14C0 00000102 00000000 00000000 [............]
672B14D0 00000000 00000000 65621FF8 67825F00 [..........be._.g]
672B14E0 673C0034 678250A4 00000000 67825108 [4.<g.P.g.....Q.g]
672B14F0 67825108 67825EF4 01000601 673AB4A0 [.Q.g.^.g......:g]
672B1500 673C0034 00000007 00000000 00000000 [4.<g............]
672B1510 00000000 674CB40C 674CC04C 00000000 [......LgL.Lg....]
672B1520 00000000 00000000 00000000 00000000 [................]
Repeat 3 times
672B1A70 00000003 00000005 [........]
error 469 detected in background process
ORA-00469: CKPT process terminated with error
What can i do ? Have you any ideas to fix the problem ?
Problem 2:
After the error message i start my server and see in my alert.log:
Starting background process QMNC
QMNC started with pid=17, OS id=17164
Thu Feb 15 14:33:45 2007
Errors in file /u01/app/oracle/admin/tlp/udump/tlp_ora_17122.trc:
ORA-00604: error occurred at recursive SQL level 1
ORA-12663: Services required by client not available on the server
ORA-36961: Oracle OLAP is not available.
ORA-06512: at "SYS.OLAPIHISTORYRETENTION", line 1
ORA-06512: at line 15
Thu Feb 15 14:33:45 2007
db_recovery_file_dest_size of 5120 MB is 0.00% used. This is a
user-specified limit on the amount of space that will be used by this
database for recovery-related files, and does not reflect the amount of
space available in the underlying filesystem or ASM diskgroup.
Thu Feb 15 14:33:46 2007
Completed: ALTER DATABASE OPEN
hyperion:/u01/app/oracle/logs# less /u01/app/oracle/admin/tlp/udump/tlp_ora_17122.trc
Node name: hyperion
Release: 2.6.18.1-vs2.1.1-rc48-vserver
Version: #1 SMP PREEMPT Wed Nov 15 16:53:41 CET 2006
Machine: i686
Instance name: tlp
Redo thread mounted by this instance: 1
Oracle process number: 15
Unix process pid: 17122, image: oracle@hyperion (TNS V1-V3)
*** SERVICE NAME:() 2007-02-15 14:33:39.169
*** SESSION ID:(159.7) 2007-02-15 14:33:39.169
Thread 1 checkpoint: logseq 204, block 3873, scn 6263056
cache-low rba: logseq 204, block 63015
on-disk rba: logseq 204, block 66596, scn 6301195
start recovery at logseq 204, block 63015, scn 0
----- Redo read statistics for thread 1 -----
Read rate (ASYNC): 1790Kb in 0.18s => 9.71 Mb/sec
Total physical reads: 4096Kb
Longest record: 20Kb, moves: 0/2889 (0%)
Change moves: 0/32 (0%), moved: 0Mb
Longest LWN: 299Kb, moves: 0/503 (0%), moved: 0Mb
Last redo scn: 0x0000.0060260a (6301194)
----- Recovery Hash Table Statistics ---------
Hash table buckets = 32768
Longest hash chain = 2
Average hash chain = 477/472 = 1.0
Max compares per lookup = 1
Avg compares per lookup = 8228/8877 = 0.9
*** 2007-02-15 14:33:39.382
KCRA: start recovery claims for 477 data blocks
*** 2007-02-15 14:33:39.398
KCRA: blocks processed = 477/477, claimed = 477, eliminated = 0
*** 2007-02-15 14:33:39.403
Recovery of Online Redo Log: Thread 1 Group 2 Seq 204 Reading mem 0
----- Recovery Hash Table Statistics ---------
Hash table buckets = 32768
Longest hash chain = 2
Average hash chain = 477/472 = 1.0
Max compares per lookup = 2
Avg compares per lookup = 7619/8700 = 0.9
Error in executing triggers on database startup
*** 2007-02-15 14:33:45.811
ksedmp: internal or fatal error
ORA-00604: error occurred at recursive SQL level 1
ORA-12663: Services required by client not available on the server
ORA-36961: Oracle OLAP is not available.
ORA-06512: at "SYS.OLAPIHISTORYRETENTION", line 1
ORA-06512: at line 15
Any ideas ?
Thanks
BlueYour basic problem seems to be you have a trigger, which wants to use OLAP functionality, but OLAP is not installed or not available for whatever reason
Error in executing triggers on database startup <================
*** 2007-02-15 14:33:45.811
ksedmp: internal or fatal error
ORA-00604: error occurred at recursive SQL level 1
ORA-12663: Services required by client not available on the server
ORA-36961: Oracle OLAP is not available.
ORA-06512: at "SYS.OLAPIHISTORYRETENTION", line 1
ORA-06512: at line 15
So check your database startup triggers.
Werner -
Error when scheduling job (JOB_SUBMIT) when execute PC in WAD
Dear BIers,
I execute a Process Chain in commond button of WAD, however, I got the error message:
Job BI_PROCESS_DTP_LOAD could not be scheduled. Termination with returncode 8
Returncode '8' means ' Error when scheduling job (JOB_SUBMIT).
Any suggestions are appreciated.
B.R
GeraldDear Raju,
Have you checked SM21? Maybe you have a problem with your TemSe object. If this is the case a basis guy should know how to handle it.
Greetings,
Stefan -
SID assignment terminated with errors
Folks
When I was trying to load data into ODS thru info package I got the following errors in the monitor, but I see all the records without any errors in PSA.
System error occured (RFC Call)
Task 0001 for parallel SID assignment terminated with errors
Activation of data records from ODS object ZTSODS terminated
Error getting SID for ODS object ZTSODS
Please suggest,
Thanks,
KumarThanks Sudheer and Prathibha,
I did the same in my previous load, Unchecked the BEx reporting flag, activated the ODS and did the full load but it failed with Process Overdue and with Short dump (Message_Type_x) runtime error.
When I right click on the ODS and selected Manage, I can see a green status for the load but when I see the contents I can only see the header got loaded (only the top row).
If I do this again, I may end up with the same error as I'm not doing anything difference from my previous load?. Pls advise.
Thanks,
Kumar
Message was edited by:
kumar K
Maybe you are looking for
-
Goods Receipt in STO with delivery ( SD Route ) problem
Hi, there is issue related to Goods Receipt in STO with delivery ( SD Route) here 1. PO with delivery is created ( SD rote ) 2. with reference to above STO outboud delivery & PGI is done but after this Goods Receipt is done but outbound delivery docu
-
I have just recently realized that my time machine has not backed up in a couple of weeks. I am using a LaCie external hard drive that I purchased with the iMac and has been plugged into the firewire port since day one. When I try to establish a con
-
There as an error in the iTunes Store. Please try again later.
I keep trying to sync my iPhone 5 to the new iOS 7 on iTunes, but I keep getting an error that says "We could not complete your iTunes Store request. The network connection was lost. There was an error in the iTunes Store. Please try again later."
-
Applications Info Is Not Showing Up in the System Profiler
My applications info is not showing up in the new system profiler. I get the message "no information found". Any help would be appreciated.
-
Cs6 dreamweaver - javascript error with Clean up Word HTML . . .
Very recently upgraded to CS6 from CS5.5. Every now and then, I have to run the Clean up Word HTML Commands function for a client. Never had a problem before. This time, I got this message: While executing onClick in Clean Up Word HTML.htm, the follo