Trace file in RAC environment

When creating a trace file, is it possible to specify a node where the trace file will be created? If so, please give example?
thank u

Like Chandra mentioned i dont think we can have a trace file get generated on a specific node. however you can do the following.. you can identify your trace files using..
ALTER SESSION SET TRACEFILE_IDENTIFIER ='MV'
Then you can use the 'trcsess' utility to bring down the trace files from multiple instances (if any) into one file and then run a TKPROF.
Refer to metalink Note # 280543.1 on how to use trcsess

Similar Messages

Tnsname.ora and listener.ora files in RAC environment.

Want to clear my concept regarding
tnsname.ora and listener.ora files in RAC environment. Is there any good notes on Metalink for that?

Check this metalink note, it covers specific RAC issues:
Configuration of Load Balancing and Transparent Application Failover
Note:226880.1
Werner

Questions on sqlnet.ora, listener.ora files in RAC environment.

Experts,
I've some confusion with below files in RAC environment.
sqlnet.ora
listener.ora
These files are available in two locations: <GRID_HOME> & <DB_HOME>.
My questions:
1. Why do we have two versions of files ?
2. When I query lsnrctl status from BOTH the homes, it says it is using listener.ora from <GRID_HOME> as shown below.
Listener Parameter File D:\app\11.2.0\grid\network\admin\listener.ora
3. What is the use of files which are in <DB_Home>
4. If you make some changes to listener using "Netmgr" tool, we expect it will update listener.ora in <GRID_HOME>. Interestingly, it is changing the contents of listener.ora in <DB_HOME> .
Can anyone please clarify it ?
Thanks in advance.

859875 wrote:
1. Why do we have two versions of files ? In the past, the CRS s/w did not include ASM (ASM did not provide support for cluster voting and registration disks). Thus the networking components such as SQL*Net and the Listener were not part of the CRS installation.
With Grid Infrastructure, ASM supports cluster voting and registration disks and is recommended to be used for that (as oppose to the old style of raw disks or using an external cluster-based cooked file system like <i>ocfs</i>). And with ASM comes the SQL*Net networking layer and s/w (such as the Listener). As ASM ships with Grid Infrastructure, it now also includes the same networking layer as what the RDBMS installation will. Thus both <GRID_HOME> and <DB_HOME> will contain the same networking components.
However, only a single Listener is for example needed. And that can only run from a single base location. So for operational use, only one version will be actively in use.

How to create DIR/File on a raw device in RAC environment.

Hi all,
I use a shell script to create DIR and File on a raw device also it creates schema and tablespaces.
I am facing problem in creating DIR and Files on raw device.
One more thing, can multiple tablespaces be created on a raw device.
Thanks & regards,
Sanjeev

Thanks for the response. Please help me further.
About the Script - It asks for the path for creating DIR and uses shell command to create DIR. Later same path and DIR name is used to create Oracle DIR. Now in place of absolute path raw device name is passed. The same script is also used for creating tablespaces and schema.
There is second script that is .sql script that creates external table in the newly created schema. All this has been working fine on single instance Oracle server. we have tested many times but fails in RAC environment when we use raw device.
Question is - If I use filesystem will the external table's flat files and Directories be accessible to all the instances.
I have one application written in java that would be clustered and running on these oracle servers. This application would be accessing those external tables and their flat files. Will there be a problem accessing these flat files accross the instances.
Regards,
Sanjeev.

Instnce name in non-RAC environment

Hi!
In non-RAC environment V$INSTANCE.INSTANCE_NAME does not actually displays the name of the instance,that was set in INSTANCE_NAME parameter.
It always displays DB_NAME instead.
Is it any way to get instance_name that has service user connected to in this environment?
LSNRCTL for 32-bit Windows: Version 10.2.0.4.0 - Production on 28-JAN-2010 09:16:25
Copyright (c) 1991, 2007, Oracle. All rights reserved.
Connecting to (DESCRIPTION=(ADDRESS=(PROTOCOL=TCP)(HOST=vegas)(PORT=1524)))
STATUS of the LISTENER
Alias LISTENER
Version TNSLSNR for 32-bit Windows: Version 10.2.0.4.0 - Production
Start Date 28-JAN-2010 09:15:36
Uptime 0 days 0 hr. 0 min. 48 sec
Trace Level off
Security ON: Local OS Authentication
SNMP OFF
Listener Parameter File D:\oracle\db\product\10.2.0\network\admin\listener.ora
Listener Log File D:\oracle\db\product\10.2.0\network\log\listener.log
Listening Endpoints Summary...
(DESCRIPTION=(ADDRESS=(PROTOCOL=tcp)(HOST=vegas)(PORT=1524)))
Services Summary...
Service "EMCOR" has 1 instance(s).
Instance "INST0", status READY, has 1 handler(s) for this service...
Service "EMCOR_XPT" has 1 instance(s).
Instance "INST0", status READY, has 1 handler(s) for this service...
Service "PLSExtProc" has 1 instance(s).
Instance "PLSExtProc", status UNKNOWN, has 1 handler(s) for this service...
Service "RESXDB" has 1 instance(s).
Instance "INST0", status READY, has 1 handler(s) for this service...
Service "SRV1" has 1 instance(s).
Instance "INST0", status READY, has 1 handler(s) for this service...
Service "SRV2" has 1 instance(s).
Instance "INST0", status READY, has 1 handler(s) for this service...
The command completed successfully
And SQLPLUS said
C:\Documents and Settings\oradba>sqlplus
SQL*Plus: Release 10.2.0.4.0 - Production on Thu Jan 28 09:44:59 2010
Copyright (c) 1982, 2007, Oracle. All Rights Reserved.
Enter user-name: emcos@emcor_srv2
Enter password:
Connected to:
Oracle Database 10g Enterprise Edition Release 10.2.0.4.0 - Production
With the Partitioning, OLAP, Data Mining and Real Application Testing options
09:45:04 EMCOS@emcor_srv2 >select name from v$database;
NAME
EMCOR
Elapsed: 00:00:00.00
09:45:07 EMCOS@emcor_srv2 >select instance_name from v$instance;
INSTANCE_NAME
emcor
Elapsed: 00:00:00.01
09:45:21 EMCOS@emcor_srv2 >select service_name from v$session where sid=(select unique sid from v$mystat);
SERVICE_NAME
SRV2

Hemant K Chitale wrote:
The documentation on INSTANCE_NAME in the 10gR2 Reference says :
"In a single-instance database system, the instance name is usually the same as the database name."
(this after
"In a Real Application Clusters environment, multiple instances can be associated with a single database service. Clients can override Oracle's connection load balancing by specifying a particular instance by which to connect to the database. INSTANCE_NAME specifies the unique name of this instance.")
This would imply that setting INSTANCE_NAME in non-RAC is ignored. The usage of the word "usually" is weak.
Hemant K ChitaleBut what do says lsnrctl - it says that it is not weak
11:33:28 SYS@EMCOR_SRV1 >show parameter instance_name
NAME TYPE VALUE
instance_name string INST0
11:33:36 SYS@EMCOR_SRV1 >host lsnrctl status
LSNRCTL for 32-bit Windows: Version 10.2.0.4.0 - Production on 28-JAN-2010 11:33:50
Copyright (c) 1991, 2007, Oracle. All rights reserved.
Connecting to (DESCRIPTION=(ADDRESS=(PROTOCOL=TCP)(HOST=vegas)(PORT=1524)))
STATUS of the LISTENER
Alias LISTENER
Version TNSLSNR for 32-bit Windows: Version 10.2.0.4.0 - Production
Start Date 28-JAN-2010 09:15:36
Uptime 0 days 2 hr. 18 min. 14 sec
Trace Level off
Security ON: Local OS Authentication
SNMP OFF
Listener Parameter File D:\oracle\db\product\10.2.0\network\admin\listener.ora
Listener Log File D:\oracle\db\product\10.2.0\network\log\listener.log
Listening Endpoints Summary...
(DESCRIPTION=(ADDRESS=(PROTOCOL=tcp)(HOST=vegas)(PORT=1524)))
Services Summary...
Service "EMCOR" has 1 instance(s).
Instance "INST0", status READY, has 1 handler(s) for this service...
Service "EMCOR_XPT" has 1 instance(s).
Instance "INST0", status READY, has 1 handler(s) for this service...
Service "PLSExtProc" has 1 instance(s).
Instance "PLSExtProc", status UNKNOWN, has 1 handler(s) for this service...
Service "RESXDB" has 1 instance(s).
Instance "INST0", status READY, has 1 handler(s) for this service...
Service "SRV1" has 1 instance(s).
Instance "INST0", status READY, has 1 handler(s) for this service...
Service "SRV2" has 1 instance(s).
Instance "INST0", status READY, has 1 handler(s) for this service...
The command completed successfully
11:33:50 SYS@EMCOR_SRV1 >select sys_context('USERENV','INSTANCE_NAME') from dual;
SYS_CONTEXT('USERENV','INSTANCE_NAME')
emcor
Elapsed: 00:00:00.00
11:34:42 SYS@EMCOR_SRV1 >select service_name from v$session where sid=sys_context('USERENV','SID');
SERVICE_NAME
SRV1
Best regards, Sergey

Different Deadlock trace files

Hello,
In our application we use to have deadlock issues and i need to analyze that
trace file.Some time i use to have trace files which is having current session and
waiting session information and with modules and queries they are executing in top section
of trace file only , no need to read below data in trace file . But some times the
trace files are different..all update or select for update queries are spread
across the file and very difficult to understand which was locking what. Is that in rac or 11g environment
deadlock trace file is having different structure,?
One more question regarding deadlock ...many time we found that the current
query is updating on table A and waiting query updating on table B .. Is it possible
to have deadlock scenario when queries are working on different tables ? or
many be it is happening only if tables are in relation like parent and child ?

hi,
Are you referring to .trm extention trace files which youare unable to read?
Here is good explanation of reading deadlock trace files
ORA-00060 Deadlock trace files.. how to read?
Thanks,
Ajay More
http://www.moreajays.com

Cssd does not start in non-RAC environment Thus we can not bring up ASM

Non-RAC environment
ASM version = 11.1.0.7
HP-UX Itanium 11.23
After power outage, CSSD does not start on non-RAC environment
Running as root "/sbin/init.d/init.cssd start" does not start cssd
Oracle support tried "$ASM_HOME/bin/localconfig delete" and "$ASM_HOME/bin/localconfig add"
but it did not start CSS
Oracle support tried "$ASM_HOME/bin/localconfig reset $ASM_HOME"
It started the CSSD and the "crsctl check css" came back with CSS is healthy
But around 1 minute later it rebooted the server and when it came up again CSS does not start.
They checked /etc/inittab and it looked fine.
Before the reboot we saw this message in the /var/adm/syslog/OLDsyslog.log:
Cluster Ready Services completed waiting on dependencies
Again it is a NON-RAC environment. We only need CSSD for ASM. We do not have CRS installed on this server.
Our test system has been down for a week and we did not get the resolution from Oracle support yet !
Any pointers are greately appriciated.
Thanks,
Dzung

Here is the message in $ASM_HOME/log/<hostname>/alert<hostname>.log :
2010-07-16 09:42:02.956
[client(11930)]CRS-1006:The OCR location /db/app/oracle/product/11.1/cdata/localhost/local.ocr is inacce
ssible. Details in /db/app/oracle/product/11.1/log/rmodbd01/client/clscfg10.log.
2010-07-16 09:42:02.971
[client(11930)]CRS-1006:The OCR location /db/app/oracle/product/11.1/cdata/localhost/local.ocr is inacce
ssible. Details in /db/app/oracle/product/11.1/log/rmodbd01/client/clscfg10.log.
2010-07-16 09:42:03.054
[client(11930)]CRS-1013:The OCR at /db/app/oracle/product/11.1/cdata/localhost/local.ocr was successfull
y formatted using version 2. Ignore earlier CRS-1006 messages if any.
2010-07-16 09:42:46.379
[cssd(12297)]CRS-1601:CSSD Reconfiguration complete. Active nodes are rmodbd01 .
Here is the message in $ASM_HOME/log/<hostname>/cssd/cssdOUT.log:
setsid: failed with -1/1
s0clssscGetEnvOracleUser: calling getpwnam_r for user oracle
s0clssscGetEnvOracleUser: info for user oracle complete
07/16/10 09:42:36: CSSD starting
Here is the message in $ASM_HOME/log/<hostname>/cssd/ocssd.log:
[    CSSD]2010-07-16 09:42:46.378 [18] >TRACE: clssgmCompareSwapEventValue: changed CmInfo State val 7, from 6, changes 6
[    CSSD]2010-07-16 09:42:46.378 [18] >TRACE: clssgmSetVersions: properties common to all peers: 1,2,3,4,5,6,7
[    CSSD]2010-07-16 09:42:46.378 [18] >TRACE: clssgmEstablishMasterNode: MASTER for 174732166 is node(0) birth(174732166)
[    CSSD]2010-07-16 09:42:46.378 [18] >TRACE: clssgmChangeMasterNode: requeued 0 RPCs
[    CSSD]2010-07-16 09:42:46.378 [18] >TRACE: clssgmCompareSwapEventValue: changed CmInfo State val 8, from 7, changes 7
[    CSSD]2010-07-16 09:42:46.378 [18] >TRACE: clssgmMasterCMSync: Synchronizing group/lock status
[    CSSD]2010-07-16 09:42:46.378 [18] >TRACE: clssgmMasterSendDBDone: group/lock status synchronization complete
[    CSSD]2010-07-16 09:42:46.378 [18] >TRACE: clssgmCompareSwapEventValue: changed CmInfo State val 9, from 8, changes 8
[    CSSD]2010-07-16 09:42:46.378 [18] >TRACE: clssgmCompareSwapEventValue: changed CmInfo State val 10, from 9, changes 9
[    CSSD]CLSS-3000: reconfiguration successful, incarnation 174732166 with 1 nodes
[    CSSD]CLSS-3001: local node number 0, master node number 0
[    CSSD]2010-07-16 09:42:46.378 [18] >TRACE: clssscSAGEInitFenceCompl: Completing kgzf fence initialization
[    CSSD]2010-07-16 09:42:46.394 [12] >TRACE: clssgmUpdateEventValue: Client listener incarn val 174732166, changes 1
[    CSSD]2010-07-16 09:42:46.395 [12] >TRACE: clssgmAllocProc: (60000000003c7120) allocated
[    CSSD]2010-07-16 09:42:46.395 [12] >TRACE: clssgmAllocProc: (60000000003c73a0) allocated
[    CSSD]2010-07-16 09:42:46.396 [14] >TRACE: Connect request from user oracle
[    CSSD]2010-07-16 09:42:46.396 [14] >TRACE: Connect request from user root
[    CSSD]2010-07-16 09:42:46.397 [12] >TRACE: clssgmClientConnectMsg: properties of cmProc 60000000003c7120 - 1,2,3
[    CSSD]2010-07-16 09:42:46.397 [12] >TRACE: clssgmClientConnectMsg: Connect from con(60000000003b2810) proc(60000000003c7120) pid(12350) version 11:1:1:4
[    CSSD]2010-07-16 09:42:46.397 [12] >TRACE: clssgmClientConnectMsg: properties of cmProc 60000000003c73a0 - 1,2,3
[    CSSD]2010-07-16 09:42:46.397 [12] >TRACE: clssgmClientConnectMsg: Connect from con(60000000003b2990) proc(60000000003c73a0) pid(12131) version 11:1:1:4
[    CSSD]2010-07-16 09:42:46.402 [12] >TRACE: clssgmRegisterClient: proc(1/60000000003c7120), client(1/600000000096e7c0)
[    CSSD]2010-07-16 09:42:46.402 [12] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (600000000096e7c0)
[    CSSD]2010-07-16 09:42:46.402 [12] >TRACE: clssgmJoinGrock: local grock CSS_INTERNAL_NODE_GROUP new client 600000000096e7c0 with con 60000000003b2b10, requested num 0
[    CSSD]2010-07-16 09:42:46.402 [12] >TRACE: clssgmAddNodeGrpMember: member (60000000009e0030) added
[    CSSD]2010-07-16 09:42:46.403 [12] >TRACE: clssgmGroupState: requested group state of group localhost_NG, member count 0
[    CSSD]2010-07-16 09:42:46.403 [12] >TRACE: clssgmGroupState: requested group state of group localhost_NG, member count 0
[    CSSD]2010-07-16 09:42:46.404 [12] >TRACE: clssgmDeadProc: proc 60000000003c73a0
[    CSSD]2010-07-16 09:42:46.404 [12] >TRACE: clssgmDestroyProc: cleaning up proc(60000000003c73a0) con(60000000003b2990) skgpid ospid 12131 with 0 clients, refcount 0
[    CSSD]2010-07-16 09:42:46.425 [12] >TRACE: clssgmGroupState: requested group state of unknown group MASTER#DISKMON#GROUP
[    CSSD]2010-07-16 09:42:46.425 [12] >TRACE: clssgmGroupState: requested group state of group MASTER#DISKMON#GROUP, member count 0
[    CSSD]2010-07-16 09:42:46.425 [18] >TRACE: KGZF: context successfully initialized, API version 1.4, using pipe default
[    CSSD]2010-07-16 09:42:46.425 [18] >TRACE: clssscSAGEInitFenceCompl: kgzf fence initialization successfully completed
[    CSSD]2010-07-16 09:42:46.425 [18] >TRACE: clssgmReconfigThread: CSS/GM open for global group registrations
[    CSSD]2010-07-16 09:42:46.425 [18] >TRACE: clssgmReconfigThread: completed for reconfig(174732166), with status(1)
[    CSSD]2010-07-16 09:42:46.425 [18] >TRACE: clssgmUpdateEventValue: Reconfig Event val 2, changes 2
[    CSSD]2010-07-16 09:42:46.425 [1] >TRACE: clssgmWaitOnEventValue: after Reconfig Event val 2, eval 2 waited 47
[    CSSD]2010-07-16 09:42:46.425 [12] >TRACE: clssgmRegisterClient: proc(1/60000000003c7120), client(2/600000000096e870)
[    CSSD]2010-07-16 09:42:46.425 [1] >TRACE: clssgmUpdateEventValue: Reconfig Event val 0, changes 3
[    CSSD]2010-07-16 09:42:46.425 [1] >TRACE: clssgmStartNMMon: previous reconfig complete, incarnation(174732166)
[    CSSD]2010-07-16 09:42:46.425 [12] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 2 (600000000096e870)
[    CSSD]2010-07-16 09:42:46.425 [12] >TRACE: clssgmJoinGrock: global grock MASTER#DISKMON#GROUP#MX new client 600000000096e870 with con 60000000003b2990, requested num -1
[    CSSD]2010-07-16 09:42:46.425 [12] >TRACE: clssgmAddGrockMember: adding member to grock MASTER#DISKMON#GROUP#MX
[    CSSD]2010-07-16 09:42:46.425 [12] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(0) grock (6000000000989e50/MASTER#DISKMON#GROUP#MX)
[    CSSD]2010-07-16 09:42:46.425 [12] >TRACE: clssgmQueueGrockEvent: lockName(MASTER#DISKMON#GROUP#MX) type(3) count (1/1) xwaiters(1) event(1) to memberNo(0)
[    CSSD]2010-07-16 09:42:46.425 [12] >TRACE: clssgmCommonAddMember: global lock grock MASTER#DISKMON#GROUP#MX member(0/Local) node(0) flags 0x2 0x2
[    CSSD]2010-07-16 09:42:46.425 [12] >TRACE: clssgmRegisterClient: proc(1/60000000003c7120), client(3/600000000096e920)
[    CSSD]2010-07-16 09:42:46.425 [12] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 3 (600000000096e920)
[    CSSD]2010-07-16 09:42:46.425 [12] >TRACE: clssgmJoinGrock: global grock MASTER#DISKMON#GROUP new client 600000000096e920 with con 60000000003b2bd0, requested num 0
[    CSSD]2010-07-16 09:42:46.425 [12] >TRACE: clssgmAddGrockMember: adding member to grock MASTER#DISKMON#GROUP
[    CSSD]2010-07-16 09:42:46.425 [12] >TRACE: clssgmAddMember: new master 0 for group(MASTER#DISKMON#GROUP)
[    CSSD]2010-07-16 09:42:46.426 [12] >TRACE: clssgmAddMember: Adding fencing for member 0, group MASTER#DISKMON#GROUP, death 1, SAGE 0
[    CSSD]2010-07-16 09:42:46.426 [12] >TRACE: clssgmAddMember: member (0/60000000009e0230) added. pbsz(72) prsz(0) flags 0x0 to grock (600000000098a170/MASTER#DISKMON#GROUP)
[    CSSD]2010-07-16 09:42:46.426 [12] >TRACE: clssgmQueueGrockEvent: groupName(MASTER#DISKMON#GROUP) count(1) master(0) event(1), incarn 1, mbrc 1, to member 0, events 0x78, state 0x0
[    CSSD]2010-07-16 09:42:46.426 [12] >TRACE: clssgmCommonAddMember: global group grock MASTER#DISKMON#GROUP member(0/Local) node(0) flags 0x0 0x1e00
[    CSSD]2010-07-16 09:42:46.426 [12] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 2 (600000000096e870)
[    CSSD]2010-07-16 09:42:46.426 [12] >TRACE: clssgmExitGrock: client 2 (600000000096e870), grock MASTER#DISKMON#GROUP#MX, member 0
[    CSSD]2010-07-16 09:42:46.426 [12] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (60000000009e0130) in global grock MASTER#DISKMON#GROUP#MX
[    CSSD]2010-07-16 09:42:46.426 [12] >TRACE: clssgmRemoveMember: grock MASTER#DISKMON#GROUP#MX, member number 0 (60000000009e0130) node number 0 state 0x14 member refcnt 0 grock type 3
[    CSSD]2010-07-16 09:42:48.405 [8] >TRACE: clssnmSendingThread: sending status msg to all nodes
[    CSSD]2010-07-16 09:42:48.405 [8] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes
[    CSSD]2010-07-16 09:42:52.444 [8] >TRACE: clssnmSendingThread: sending status msg to all nodes
[    CSSD]2010-07-16 09:42:52.444 [8] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes
[    CSSD]2010-07-16 09:42:56.484 [8] >TRACE: clssnmSendingThread: sending status msg to all nodes
[    CSSD]2010-07-16 09:42:56.484 [8] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes
[    CSSD]2010-07-16 09:43:00.516 [8] >TRACE: clssnmSendingThread: sending status msg to all nodes
[    CSSD]2010-07-16 09:43:00.516 [8] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes
[    CSSD]2010-07-16 09:43:04.563 [8] >TRACE: clssnmSendingThread: sending status msg to all nodes
[    CSSD]2010-07-16 09:43:04.563 [8] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes
[    CSSD]2010-07-16 09:43:08.603 [8] >TRACE: clssnmSendingThread: sending status msg to all nodes
[    CSSD]2010-07-16 09:43:08.603 [8] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes
[    CSSD]2010-07-16 09:43:12.643 [8] >TRACE: clssnmSendingThread: sending status msg to all nodes
[    CSSD]2010-07-16 09:43:12.643 [8] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes
[    CSSD]2010-07-16 09:43:16.676 [8] >TRACE: clssnmSendingThread: sending status msg to all nodes
[    CSSD]2010-07-16 09:43:16.676 [8] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes
[    CSSD]2010-07-16 09:43:20.723 [8] >TRACE: clssnmSendingThread: sending status msg to all nodes
[    CSSD]2010-07-16 09:43:20.723 [8] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes
[    CSSD]2010-07-16 09:43:24.762 [8] >TRACE: clssnmSendingThread: sending status msg to all nodes
[    CSSD]2010-07-16 09:43:24.762 [8] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes
[    CSSD]2010-07-16 09:43:28.802 [8] >TRACE: clssnmSendingThread: sending status msg to all nodes
[    CSSD]2010-07-16 09:43:28.802 [8] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes
[    CSSD]2010-07-16 09:43:32.842 [8] >TRACE: clssnmSendingThread: sending status msg to all nodes
[    CSSD]2010-07-16 09:43:32.842 [8] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes
[    CSSD]2010-07-16 09:43:36.882 [8] >TRACE: clssnmSendingThread: sending status msg to all nodes
[    CSSD]2010-07-16 09:43:36.882 [8] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes
[    CSSD]2010-07-16 09:43:40.922 [8] >TRACE: clssnmSendingThread: sending status msg to all nodes
[    CSSD]2010-07-16 09:43:40.922 [8] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes
[    CSSD]2010-07-16 09:43:44.964 [8] >TRACE: clssnmSendingThread: sending status msg to all nodes
[    CSSD]2010-07-16 09:43:44.964 [8] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes
[    CSSD]2010-07-16 09:43:49.002 [8] >TRACE: clssnmSendingThread: sending status msg to all nodes
[    CSSD]2010-07-16 09:43:49.002 [8] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes
[    CSSD]2010-07-16 09:43:53.043 [8] >TRACE: clssnmSendingThread: sending status msg to all nodes
[    CSSD]2010-07-16 09:43:53.043 [8] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes
[    CSSD]2010-07-16 09:43:57.085 [8] >TRACE: clssnmSendingThread: sending status msg to all nodes
[    CSSD]2010-07-16 09:43:57.085 [8] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes
[    CSSD]2010-07-16 09:43:58.354 [12] >TRACE: clssgmAllocProc: (60000000003c7ee0) allocated
[    CSSD]2010-07-16 09:43:58.355 [14] >TRACE: Connect request from user oracle
[    CSSD]2010-07-16 09:43:58.356 [12] >TRACE: clssgmClientConnectMsg: properties of cmProc 60000000003c7ee0 - 1,2,3
[    CSSD]2010-07-16 09:43:58.356 [12] >TRACE: clssgmClientConnectMsg: Connect from con(60000000003b2990) proc(60000000003c7ee0) pid(13157) version 11:1:1:4
[    CSSD]2010-07-16 09:43:58.360 [12] >TRACE: clssgmRegisterClient: proc(2/60000000003c7ee0), client(1/600000000096e870)
[    CSSD]2010-07-16 09:43:58.360 [12] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 1 (600000000096e870)
[    CSSD]2010-07-16 09:43:58.360 [12] >TRACE: clssgmJoinGrock: global grock CLSSSCHECK_GROUP new client 600000000096e870 with con 60000000003b2c90, requested num -1
[    CSSD]2010-07-16 09:43:58.360 [12] >TRACE: clssgmAddGrockMember: adding member to grock CLSSSCHECK_GROUP
[    CSSD]2010-07-16 09:43:58.360 [12] >TRACE: clssgmAddMember: new master 0 for group(CLSSSCHECK_GROUP)
[    CSSD]2010-07-16 09:43:58.360 [12] >TRACE: clssgmAddMember: Adding fencing for member 0, group CLSSSCHECK_GROUP, death 1, SAGE 0
[    CSSD]2010-07-16 09:43:58.360 [12] >TRACE: clssgmAddMember: member (0/60000000009e0130) added. pbsz(8) prsz(8) flags 0x0 to grock (6000000000989e50/CLSSSCHECK_GROUP)
[    CSSD]2010-07-16 09:43:58.360 [12] >TRACE: clssgmQueueGrockEvent: groupName(CLSSSCHECK_GROUP) count(1) master(0) event(1), incarn 1, mbrc 1, to member 0, events 0x0, state 0x0
[    CSSD]2010-07-16 09:43:58.360 [12] >TRACE: clssgmCommonAddMember: global group grock CLSSSCHECK_GROUP member(0/Local) node(0) flags 0x0 0x0
[    CSSD]2010-07-16 09:43:58.361 [12] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 1 (600000000096e870)
[    CSSD]2010-07-16 09:43:58.361 [12] >TRACE: clssgmExitGrock: client 1 (600000000096e870), grock CLSSSCHECK_GROUP, member 0
[    CSSD]2010-07-16 09:43:58.361 [12] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (60000000009e0130) in global grock CLSSSCHECK_GROUP
[    CSSD]2010-07-16 09:43:58.361 [12] >TRACE: clssgmRemoveMember: grock CLSSSCHECK_GROUP, member number 0 (60000000009e0130) node number 0 state 0x14 member refcnt 0 grock type 2
[    CSSD]2010-07-16 09:43:58.361 [12] >TRACE: clssgmRegisterClient: proc(2/60000000003c7ee0), client(2/600000000096e870)
[    CSSD]2010-07-16 09:43:58.361 [12] >TRACE: clssgmExecuteClientRequest: GRKJOIN recvd from client 2 (600000000096e870)
[    CSSD]2010-07-16 09:43:58.361 [12] >TRACE: clssgmJoinGrock: global grock CLSSSCHECK_LOCK new client 600000000096e870 with con 60000000003b2c90, requested num -1
[    CSSD]2010-07-16 09:43:58.361 [12] >TRACE: clssgmAddGrockMember: adding member to grock CLSSSCHECK_LOCK
[    CSSD]2010-07-16 09:43:58.361 [12] >TRACE: clssgmAddMember: granted member(0) flags(0x2) node(0) grock (6000000000989e50/CLSSSCHECK_LOCK)
[    CSSD]2010-07-16 09:43:58.361 [12] >TRACE: clssgmQueueGrockEvent: lockName(CLSSSCHECK_LOCK) type(3) count (1/1) xwaiters(1) event(1) to memberNo(0)
[    CSSD]2010-07-16 09:43:58.361 [12] >TRACE: clssgmCommonAddMember: global lock grock CLSSSCHECK_LOCK member(0/Local) node(0) flags 0x2 0x2
[    CSSD]2010-07-16 09:43:58.361 [12] >TRACE: clssgmExecuteClientRequest: GRKEXIT recvd from client 2 (600000000096e870)
[    CSSD]2010-07-16 09:43:58.361 [12] >TRACE: clssgmExitGrock: client 2 (600000000096e870), grock CLSSSCHECK_LOCK, member 0
[    CSSD]2010-07-16 09:43:58.361 [12] >TRACE: clssgmUnregisterPrimary: Unregistering member 0 (60000000009e0130) in global grock CLSSSCHECK_LOCK
[    CSSD]2010-07-16 09:43:58.361 [12] >TRACE: clssgmRemoveMember: grock CLSSSCHECK_LOCK, member number 0 (60000000009e0130) node number 0 state 0x14 member refcnt 0 grock type 3
[    CSSD]2010-07-16 09:43:58.362 [12] >TRACE: clssgmDeadProc: proc 60000000003c7ee0
[    CSSD]2010-07-16 09:43:58.362 [12] >TRACE: clssgmDestroyProc: cleaning up proc(60000000003c7ee0) con(60000000003b2990) skgpid ospid 13157 with 0 clients, refcount 0
[    CSSD]2010-07-16 09:44:01.125 [8] >TRACE: clssnmSendingThread: sending status msg to all nodes
[    CSSD]2010-07-16 09:44:01.125 [8] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes
[    CSSD]2010-07-16 09:44:05.164 [8] >TRACE: clssnmSendingThread: sending status msg to all nodes
[    CSSD]2010-07-16 09:44:05.164 [8] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes
[    CSSD]2010-07-16 09:44:09.196 [8] >TRACE: clssnmSendingThread: sending status msg to all nodes
[    CSSD]2010-07-16 09:44:09.196 [8] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes
[    CSSD]2010-07-16 09:44:13.236 [8] >TRACE: clssnmSendingThread: sending status msg to all nodes
[    CSSD]2010-07-16 09:44:13.236 [8] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes
[    CSSD]2010-07-16 09:44:17.284 [8] >TRACE: clssnmSendingThread: sending status msg to all nodes
[    CSSD]2010-07-16 09:44:17.284 [8] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes
[    CSSD]2010-07-16 09:44:21.322 [8] >TRACE: clssnmSendingThread: sending status msg to all nodes
[    CSSD]2010-07-16 09:44:21.322 [8] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes
[    CSSD]2010-07-16 09:44:25.316 [8] >TRACE: clssnmSendingThread: sending status msg to all nodes
[    CSSD]2010-07-16 09:44:25.316 [8] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes
[    CSSD]2010-07-16 09:44:30.333 [8] >TRACE: clssnmSendingThread: sending status msg to all nodes
[    CSSD]2010-07-16 09:44:30.333 [8] >TRACE: clssnmSendingThread: sent 5 status msgs to all nodes
[    CSSD]2010-07-16 09:44:34.324 [8] >TRACE: clssnmSendingThread: sending status msg to all nodes
[    CSSD]2010-07-16 09:44:34.324 [8] >TRACE: clssnmSendingThread: sent 4 status msgs to all nodes
Here is the message in $ASM_HOME/log/<hostname>/diskmon/client.log:
[ DISKMON] 07/16/2010 18:33:32.050 dskm_send_command: process 23246 sending command 8 to master diskmon listening on default pipe
[ DISKMON] 07/16/2010 18:33:32.080 dskm_send_command3: skgznp_connect failed with error 56815
[ DISKMON] 07/16/2010 18:33:32.080 dskm_send_command3: error 56815 at location skgznpcon6 - connect() - Connection refused
Here is the message in $ASM_HOME/log/<hostname>/diskmon/diskmonOUT.log:
setsid: failed with -1/1
dskm_getenv_oracle_user: calling getpwnam_r for user oracle
dskm_getenv_oracle_user: info for user oracle complete
07/16/10 18:33:31: Master Diskmon starting
Here is the message in $ASM_HOME/log/<hostname>/diskmon/diskmon.log:
[ DISKMON] 07/16/2010 09:42:35.573 dskm main: starting up
[ DISKMON] 07/16/2010 09:42:35.588 [12350:3] dskm_rac_thrd_main: running
[ DISKMON] 07/16/2010 09:42:35.588 [12350:1] dskm_rac_thrd_creat2: got the post from the css event handling thread
[ DISKMON] 07/16/2010 09:42:35.589 [12350:1] dskm main: startup complete
[ DISKMON] 07/16/2010 09:42:35.589 [12350:1] listening on -> default pipe
[ DISKMON] 07/16/2010 09:42:35.792 clsc_connect: (6000000000700420) no listener at (ADDRESS=(PROTOCOL=ipc)(KEY=OCSSD_LL_rmodbd01_))
[ DISKMON] 07/16/2010 09:42:36.385 clsc_connect: (6000000000700420) no listener at (ADDRESS=(PROTOCOL=ipc)(KEY=OCSSD_LL_rmodbd01_))
[ DISKMON] 07/16/2010 09:42:36.906 clsc_connect: (6000000000700420) no listener at (ADDRESS=(PROTOCOL=ipc)(KEY=OCSSD_LL_rmodbd01_))
[ DISKMON] 07/16/2010 09:42:37.426 clsc_connect: (6000000000700420) no listener at (ADDRESS=(PROTOCOL=ipc)(KEY=OCSSD_LL_rmodbd01_))
[ DISKMON] 07/16/2010 09:42:37.945 clsc_connect: (6000000000700420) no listener at (ADDRESS=(PROTOCOL=ipc)(KEY=OCSSD_LL_rmodbd01_))
[ DISKMON] 07/16/2010 09:42:38.465 clsc_connect: (6000000000700420) no listener at (ADDRESS=(PROTOCOL=ipc)(KEY=OCSSD_LL_rmodbd01_))
[ DISKMON] 07/16/2010 09:42:46.376 [12350:1] dskm_slave_thrd_creat: thread created
[ DISKMON] 07/16/2010 09:42:46.376 [12350:11] dskm_slave_thrd_main1: slave 0 running
[ DISKMON] 07/16/2010 09:42:46.376 [12350:11] dskm_process_msg5: received msg type KGZM_IDENTIFY (0x0001)
[ DISKMON] 07/16/2010 09:42:46.389 [12350:11] dskm_proc_identify8: client kgzf/12297, version 0x01020000, slave 0, reid cid=3e0391f05e06cfafbf7419d7cf085a44,icin=174732166,nmn=0,lnid=174732166,gid=0,gin=0,gmn=0,umemid=0,opid=0,opsn=0,lvl=node
[ DISKMON] 07/16/2010 09:42:46.389 [12350:11] dskm_send_version1:
[ DISKMON] 07/16/2010 09:42:46.389 [12350:11] dskm_send_version4: done
[ DISKMON] 07/16/2010 09:42:46.389 [12350:11] dskm_process_msg7: processed msg 0 type KGZM_IDENTIFY (0x0001), retcode 0
[ DISKMON] 07/16/2010 09:42:46.389 [12350:11] dskm_process_msg5: received msg type KGZM_KGZF_HANDSHAKE (0x0010)
[ DISKMON] 07/16/2010 09:42:46.389 [12350:11] dskm_proc_kgzf_handshake3: client kgzf/12297, kgzf version 0x00010004, slave 0
[ DISKMON] 07/16/2010 09:42:46.401 [12350:3] dskm_clss_ini2: successful clsssinit(), clssvers 2.1
[ DISKMON] 07/16/2010 09:42:46.402 [12350:3] dskm_clss_ini12: node rmodbd01 (0) registered in cluster
[ DISKMON] 07/16/2010 09:42:46.403 [12350:3] dskm_reid_ini12: diskmon reid cid=3e0391f05e06cfafbf7419d7cf085a44,icin=174732166,nmn=0,lnid=174732166,gid=-1,gin=-1,gmn=-1,umemid=-1,opid=12350,opsn=1279291355,lvl=process
[ DISKMON] 07/16/2010 09:42:46.424 [12350:3] dskm_sage_config: CELL storage configuration file cellinit.ora not found
[ DISKMON] 07/16/2010 09:42:46.425 [12350:3] dskm_nfy_kgzf1: notified thread kgzf enabled
[ DISKMON] 07/16/2010 09:42:46.425 [12350:11] dskm_proc_kgzf_handshake5: got the post from the hb thread
[ DISKMON] 07/16/2010 09:42:46.425 [12350:11] dskm_proc_kgzf_handshake9: done, kgzf enabled
[ DISKMON] 07/16/2010 09:42:46.425 [12350:11] dskm_process_msg7: processed msg 0 type KGZM_KGZF_HANDSHAKE (0x0010), retcode 0
[ DISKMON] 07/16/2010 09:42:46.426 [12350:3] dskm_rac_ini22: CELL storage not configured in the cluster; registered in group MASTER#DISKMON#GROUP as memno 0 (GSDGRPSZ 512)

Create database on RAC environment - DBCA hangs on clone database creation

Hi, friends!
I have two vm´s (vmware 2) with OEL 5 installed.
I´ve installed OGI and database software sucessfully. So, my crs stack is working fine in both two nodes.
However, when i use DBCA to create a database in this RAC environment, it hangs when it gets on "clone database creation", about 52% of the progress bar.
My DBCA logs don´t point any error out. It just hangs on..
I wait about 4 hours and it doesn´t move on.
I searched and found many cases like that, including here in OTN. But it seems nobody could find a resolution to this issue.
Is there any bug about OEL 5 and database 11gR2??
More details:
I apllied the patch "p8670579_112010_LINUX" on both OGI installation (before root.sh) and databae software install (also before root.sh).
Everything worked fine.
Sorry for the grammar errors.

you can trace dbca, and you can found witch step is occurs problem.
can you paste here last 15-20 sentence of dbca trace file?
Mahir

ORA-01157: cannot identify/lock data file 13 - see DBWR trace file

Hi all,
I've a Oracle Database 11g Release 11.1.0.6.0 - 64bit Production With the Real Application Clusters option.
I'm using ASM.
Yesterday I added new disks and then I changed the +/etc/udev/rules.d/98-oracle.rules+ file.
Now it looks like this (the bolded are the new ones):
# Oracle Configuration Registry
KERNEL=="emcpowerd1", OWNER="root", GROUP="oinstall", MODE="640", NAME="ocr"
# Voting Disks
KERNEL=="emcpowerr1", OWNER="oracle", GROUP="oinstall", MODE="640", NAME="voting"
# Spfile ASM+
KERNEL=="emcpowers1", OWNER="oracle", GROUP="dba", MODE="660", NAME="spfileASM"
# ASM Devices
KERNEL=="emcpowerj1", OWNER="oracle", GROUP="dba", MODE="660", NAME="asm0" #onlineredo asm disk
KERNEL=="emcpowern1", OWNER="oracle", GROUP="dba", MODE="660", NAME="asm1" #data asm disk
KERNEL=="emcpowerh1", OWNER="oracle", GROUP="dba", MODE="660", NAME="asm2" #data asm disk
KERNEL=="emcpowerq1", OWNER="oracle", GROUP="dba", MODE="660", NAME="asm3" #data asm disk
KERNEL=="emcpowere1", OWNER="oracle", GROUP="dba", MODE="660", NAME="asm4" #data asm disk
KERNEL=="emcpowerg1", OWNER="oracle", GROUP="dba", MODE="660", NAME="asm5" #data asm disk
KERNEL=="emcpowerl1", OWNER="oracle", GROUP="dba", MODE="660", NAME="asm6" #data asm disk
KERNEL=="emcpowero1", OWNER="oracle", GROUP="dba", MODE="660", NAME="asm7" #data asm disk
KERNEL=="emcpowerf1", OWNER="oracle", GROUP="dba", MODE="660", NAME="asm8" #data asm disk
KERNEL=="emcpowerm1", OWNER="oracle", GROUP="dba", MODE="660", NAME="asm9" #data asm disk
KERNEL=="emcpoweri1", OWNER="oracle", GROUP="dba", MODE="660", NAME="asm10" #data asm disk
KERNEL=="emcpowerp1", OWNER="oracle", GROUP="dba", MODE="660", NAME="asm11" #data asm disk
KERNEL=="emcpowerk1", OWNER="oracle", GROUP="dba", MODE="660", NAME="asm12" #data asm disk
KERNEL=="emcpowert", OWNER="oracle", GROUP="dba", MODE="660", NAME="asm210" #data asm disk SATA
KERNEL=="emcpowerc", OWNER="oracle", GROUP="dba", MODE="660", NAME="asm211" #data asm disk SATA
KERNEL=="emcpowerb", OWNER="oracle", GROUP="dba", MODE="660", NAME="asm212" #data asm disk SATA
KERNEL=="emcpowera", OWNER="oracle", GROUP="dba", MODE="660", NAME="asm213" #data asm disk SATA
It's the same on both RAC nodes.
The operating system, a RedHat 5.4, see the new devices (both nodes):
ls -ltr /dev/asm*
brw-rw---- 1 oracle dba 120, 16 May 18 10:03 /dev/asm212
brw-rw---- 1 oracle dba 120, 304 May 18 10:03 /dev/asm210
brw-rw---- 1 oracle dba 120, 32 May 18 10:03 /dev/asm211
brw-rw---- 1 oracle dba 120, 0 May 18 10:03 /dev/asm213
brw-rw---- 1 oracle dba 120, 209 May 18 10:05 /dev/asm1
brw-rw---- 1 oracle dba 120, 81 May 18 13:40 /dev/asm8
brw-rw---- 1 oracle dba 120, 97 May 18 13:40 /dev/asm5
brw-rw---- 1 oracle dba 120, 193 May 18 13:40 /dev/asm9
brw-rw---- 1 oracle dba 120, 161 May 18 13:40 /dev/asm12
brw-rw---- 1 oracle dba 120, 241 May 18 13:40 /dev/asm11
brw-rw---- 1 oracle dba 120, 177 May 18 13:40 /dev/asm6
brw-rw---- 1 oracle dba 120, 225 May 18 13:40 /dev/asm7
brw-rw---- 1 oracle dba 120, 65 May 18 13:40 /dev/asm4
brw-rw---- 1 oracle dba 120, 129 May 18 13:40 /dev/asm10
brw-rw---- 1 oracle dba 120, 257 May 18 13:40 /dev/asm3
brw-rw---- 1 oracle dba 120, 113 May 18 13:40 /dev/asm2
brw-rw---- 1 oracle dba 120, 145 May 18 13:40 /dev/asm0
Both ASM instance see new devices:
From ASM1
SQL*Plus: Release 11.1.0.6.0 - Production on Tue May 18 13:43:10 2010
Copyright (c) 1982, 2007, Oracle. All rights reserved.
Connected to:
Oracle Database 11g Release 11.1.0.6.0 - 64bit Production
With the Real Application Clusters option
SQL> select instance_name from v$instance;
INSTANCE_NAME
+ASM1
SQL> select path from v$asm_disk;
PATH
/dev/asm212
/dev/asm211
/dev/asm213
/dev/asm210
/dev/asm1
/dev/asm4
/dev/asm5
/dev/asm0
/dev/asm12
/dev/asm9
/dev/asm2
/dev/asm10
/dev/asm7
/dev/asm11
/dev/asm3
/dev/asm8
/dev/asm6
17 rows selected.
SQL>
From ASM2
SQL*Plus: Release 11.1.0.6.0 - Production on Tue May 18 13:42:39 2010
Copyright (c) 1982, 2007, Oracle. All rights reserved.
Connected to:
Oracle Database 11g Release 11.1.0.6.0 - 64bit Production
With the Real Application Clusters option
SQL> select instance_name from v$instance;
INSTANCE_NAME
+ASM2
SQL> select path from v$asm_disk;
PATH
/dev/asm213
/dev/asm211
/dev/asm210
/dev/asm212
/dev/asm8
/dev/asm7
/dev/asm6
/dev/asm11
/dev/asm4
/dev/asm12
/dev/asm5
/dev/asm9
/dev/asm1
/dev/asm3
/dev/asm10
/dev/asm2
/dev/asm0
17 rows selected.
SQL>
Then I created a disk group:
CREATE DISKGROUP STORE EXTERNAL REDUNDANCY DISK '/dev/asm210';
Then I created a new tablespace:
CREATE TABLESPACE store DATAFILE '+STORE';
I did all this operations from NODE1.
What is happening now is that everytime I try to read something from new diskgroup FROM NODE2 I get the ORA-01157:
ORA-01157: cannot identify/lock data file 13 - see DBWR trace file
ORA-01110: data file 13: '+STORE/evodb/datafile/store.256.719232707
No problem to read from NODE1.
The simple query on dba_data_file work from NODE1 and fails from NODE2 with the ORA-01157.
I found this on the alert log:
<msg time='2010-05-18T10:06:41.084+00:00' org_id='oracle' comp_id='rdbms'
client_id='' type='UNKNOWN' level='16'
module='' pid='11014'>
<txt>Errors in file /u01/app/oracle/diag/rdbms/evodb/EVODB2/trace/EVODB2_smon_11014.trc:
ORA-01157: cannot identify/lock data file 13 - see DBWR trace file
ORA-01110: data file 13: '+STORE/evodb/datafile/store.256.719232707'
</txt>
</msg>
And this from the trace:
Trace file /u01/app/oracle/diag/rdbms/evodb/EVODB2/trace/EVODB2_smon_11014.trc
Oracle Database 11g Release 11.1.0.6.0 - 64bit Production
With the Real Application Clusters option
ORACLE_HOME = /u01/app/oracle/product/11.1.0/db1
System name: Linux
Node name: node02
Release: 2.6.18-128.7.1.el5
Version: #1 SMP Wed Aug 19 04:00:49 EDT 2009
Machine: x86_64
Instance name: EVODB2
Redo thread mounted by this instance: 2
Oracle process number: 19
Unix process pid: 11014, image: oracle@node02 (SMON)
*** 2010-05-18 10:06:41.084
*** SESSION ID:(151.1) 2010-05-18 10:06:41.084
*** CLIENT ID:() 2010-05-18 10:06:41.084
*** SERVICE NAME:(SYS$BACKGROUND) 2010-05-18 10:06:41.084
*** MODULE NAME:() 2010-05-18 10:06:41.084
*** ACTION NAME:() 2010-05-18 10:06:41.084
DDE rules only execution for: ORA 1110
----- START Event Driven Actions Dump ----
---- END Event Driven Actions Dump ----
----- START DDE Actions Dump -----
----- DDE Action: 'DB_STRUCTURE_INTEGRITY_CHECK' (Async) -----
Successfully dispatched
----- (Action duration in csec: 0) -----
----- END DDE Actions Dump -----
*** 2010-05-18 10:06:41.084
SMON: following errors trapped and ignored:
ORA-01157: cannot identify/lock data file 13 - see DBWR trace file
ORA-01110: data file 13: '+STORE/evodb/datafile/store.256.719232707'
Any suggestion about how to solve the problem?
Thanks in advance!
Samuel

I didn't understand what do you mean with thread...
But I think you found the problem
Initialization files of both ASM instance are: SPFILE='/dev/spfileASM'
that SPFILE is (common for both):
+ASM2.__oracle_base='/u01/app/oracle'#ORACLE_BASE set from environment
+ASM2.asm_diskgroups='ONLINELOG','ARCHIVELOG','DATA'
+ASM1.asm_diskgroups='ONLINELOG','ARCHIVELOG','DATA','STORE'#Manual Mount
*.asm_diskstring='/dev/asm*'
*.cluster_database=true
*.diagnostic_dest='/u01/app/oracle'
+ASM1.instance_number=1
+ASM2.instance_number=2
*.instance_type='asm'
*.large_pool_size=12M
+ASM1.local_listener='LISTENER_ASM'
+AC
Then I executed another query:
From ASM1
SQL> select instance_name from v$instance;
INSTANCE_NAME
+ASM1
SQL> select name, state from v$asm_diskgroup;
NAME STATE
ARCHIVELOG MOUNTED
DATA MOUNTED
ONLINELOG MOUNTED
STORE MOUNTED
SQL>
From ASM2
SQL> select instance_name from v$instance;
INSTANCE_NAME
+ASM2
SQL> select name, state from v$asm_diskgroup;
NAME STATE
ARCHIVELOG MOUNTED
DATA MOUNTED
ONLINELOG MOUNTED
STORE DISMOUNTED
SQL>
Than the question is:
how can I mount the disk group STORE also on ASM2?
I think the problems is into the spfile lines:
+ASM2.asm_diskgroups='ONLINELOG','ARCHIVELOG','DATA'
+ASM1.asm_diskgroups='ONLINELOG','ARCHIVELOG','DATA','STORE'
How can I change the +ASM2.asm_diskgroups value?
Thanks

Recreating control file in RAC with noresetlogs

Hi all,
I need to recreate the controlfile in a 2-node RAC environment (9i)
for altering the MAXLOGHISTORY value. I will be using noresetlogs as I
have all the online logs available with me.
I referred to metalink note (Note:118931.1) for the same, and to
clarify the same, it refers to set cluster_database to false and then
to true after creating the new controlfile.
Here I have Log Groups 1,2,5,6,7 belongs to instance1 and the rest belongs to
instance2
Below is the trace of controlfile...
create controlfile reuse database "prod" noresetlogs force logging
archivelog
maxlogfiles 64
maxlogmembers 3
maxdatafiles 800
maxinstances 32
maxloghistory 15000
logfile
group 1 '/dev/rprod_redo11' size 100m,
group 2 '/dev/rprod_redo12' size 100m,
group 3 '/dev/rprod_redo21' size 100m,
group 4 '/dev/rprod_redo22' size 100m,
group 5 '/dev/rprod_redo13' size 100m,
group 6 '/dev/rprod_redo14' size 100m,
group 7 '/dev/rprod_redo15' size 100m,
group 8 '/dev/rprod_redo23' size 100m,
group 9 '/dev/rprod_redo24' size 100m,
group 10 '/dev/rprod_redo25' size 100m
-- standby logfile
datafile
Please clarify on the same, do the traced controlfile need to have some thread info for redo logs & do I need to make the cluster_database parameter to fale/true.
Thanks!
Prat

1. Create the trace file (with Create control file statements..)
2. Edit the trace file, to remove the log groups which doesn't belong to Instance 1 (in you case you would be removing groups 3,4,8,9,10).
3. Shutdown all the instances.
4. edit the init.ora file to make CLUSTER_DATABASE=FALSE:
5. startup nomount instance 1.
6. Run the edited trace file to create the control file.
7. shutdown instance 1.
8. edit the init.ora file to make CLUSTER_DATABASE=TRUE;
9. Startup instance 1;
10. Add the log groups for the instance 2 (groups 3,4,8,9,10)
11. Add tempfiles as indicated in the trace file.
12. Enable thread 2;
13. Startup instance 2.
As always, take backups.
HTH
Thanks
Chandra

Ubormal trace file generation in 11.1.0.7

oracle version
Oracle Database 11g Enterprise Edition Release 11.1.0.7.0 - 64bit Production
PL/SQL Release 11.1.0.7.0 - Production
CORE 11.1.0.7.0 Production
TNS for 64-bit Windows: Version 11.1.0.7.0 - Production
NLSRTL Version 11.1.0.7.0 - Production
OS
Windows 2008 EE R1 SP2
Problem
My trace files generated every 30 second and its drive me crazy i have to delete to maintain space of the server
i check the alert logfile and it does not show anything suspecious here are a couple of lines from the alert.log file
Sat Jan 22 00:16:52 2011
Thread 1 advanced to log sequence 117 (LGWR switch)
Current log# 1 seq# 117 mem# 0: E:\DATA\ORACLE\PMDB\REDO01A.LOG
Current log# 1 seq# 117 mem# 1: E:\DATA\ORACLE\PMDB\REDO01B.LOG
Sat Jan 22 02:00:00 2011
Clearing Resource Manager plan via parameter
Sat Jan 22 06:00:00 2011
Setting Resource Manager plan SCHEDULER[0x2C49]:DEFAULT_MAINTENANCE_PLAN via scheduler window
Setting Resource Manager plan DEFAULT_MAINTENANCE_PLAN via parameter
Sat Jan 22 06:00:03 2011
Begin automatic SQL Tuning Advisor run for special tuning task "SYS_AUTO_SQL_TUNING_TASK"
End automatic SQL Tuning Advisor run for special tuning task "SYS_AUTO_SQL_TUNING_TASK"
Sat Jan 22 06:00:36 2011
Thread 1 advanced to log sequence 118 (LGWR switch)
Current log# 2 seq# 118 mem# 0: E:\DATA\ORACLE\name\REDO02A.LOG
Current log# 2 seq# 118 mem# 1: E:\DATA\ORACLE\nameREDO02B.LOG
Sat Jan 22 11:09:15 2011
Thread 1 advanced to log sequence 119 (LGWR switch)
Current log# 1 seq# 119 mem# 0: E:\DATA\ORACLE\name\REDO01A.LOG
Current log# 1 seq# 119 mem# 1: E:\DATA\ORACLE/name\REDO01B.LOG
Sat Jan 22 11:37:19 2011
Thread 1 advanced to log sequence 120 (LGWR switch)
Current log# 2 seq# 120 mem# 0: E:\DATA\ORACLE\nam\REDO02A.LOG
Current log# 2 seq# 120 mem# 1: E:\DATA\ORACLE\name\REDO02B.LOG
And i have cheched the trace files and here are a couple of lines
*** 2011-01-19 15:23:54.265
*** SESSION ID:(43.21827) 2011-01-19 15:23:54.265
*** CLIENT ID:() 2011-01-19 15:23:54.265
*** SERVICE NAME:(name) 2011-01-19 15:23:54.265
*** MODULE NAME:(OMS) 2011-01-19 15:23:54.265
*** ACTION NAME:() 2011-01-19 15:23:54.265
XS Users and Roles -- OCI Info
kzxupnamread error -- 942: ORA-00942: table or view does not exist
XS Users and Roles -- OCI Info
kzxupnamread error -- 942: ORA-00942: table or view does not exist
Trace file e:\app\oracle\diag\rdbms\pmdb\pmdb\trace\pmdb_ora_7688.trc
Oracle Database 11g Enterprise Edition Release 11.1.0.7.0 - 64bit Production
With the Partitioning, OLAP, Data Mining and Real Application Testing options
Windows NT Version V6.0 Service Pack 2
CPU : 16 - type 8664, 8 Physical Cores
Process Affinity : 0x0000000000000000
Memory (Avail/Total): Ph:8575M/16372M, Ph+PgF:24932M/32827M
Instance name: name
Redo thread mounted by this instance: 1
Oracle process number: 18
Windows thread id: 7688, image: ORACLE.EXE (SHAD)
Would you please help me in identifying a solution to this problem

Thanks everybody ,
I have communciated to Oracle Support below is their reply :-
<< Based on the Developer comment in the bug, "This belongs to EXTENDED SECURITY and don't have conditions to run, it is addressed in patch 7019661 and solved in 11.2", >>
i have to test the patch in the test environment and than i will do it in Live
Thank you again

Unable to write trace files in Background dump destination in oracle 10g

Hi All,
OS version : RHEL 5.7
DB version : 10.2.0.4
cluster : 2 node RAC database
Today I faced a strange behaviour for one of our production database. Its a 2-node rac database. On the first node there is no auto generation of trace files in the BAckground dump destination. I am able to see trace files of second in its background dump dest. But the strange behaviour occurs on the first node. I see only Alert log file in the background dump dest . Inspite of getting an error which shows trace file generated but no file occurs in the bdump. The following is the error but physically there no trace file generated:
Errors in file /oracle/db/admin/<sid>/bdump/<sid>j0011558.trc:
ORA-12012: error on auto execute of job 94377
ORA-12008: error in materialized view refresh pathCan anyone have any idea for this strange behaviour. There are no maintenance script for removal of trace files.
Regards,
Imran Khan

ORA-00980:synonym translation is no longer valid
Cause:The synonym used is based on a table, view, or synonym that no longer exists.
Action:Replace the synonym with the name of the object it references or re-create the synonym so that it refers to a valid table, view, or synonym.
Check the following :
From User Number 1 : Osama1
create table osama_table as select empname from scott.emp;
create public synonym osama_tbl for osama_table ;
grant select on osama_tbl to user_b;
From User Number 2 : Osama2
select 1 from osama_tbl;
SMITH
ALLEN
JONES
MARTIN
From User Number 1 : Osama1
drop table osama_table;
From User Number 2 : Osama2
select 1 from osama_tbl;
ORA-00980: synonym translation is no longer valid

Unable to find trace file for a particular sid

Hi all,
I have a oracle 9.2.0.6 on solaris platform.I have to use tkrpof for PT for a particular sid.But when i checked out the trace file for that particular sid, i am not able to find out the same.....
SQL> select c.value || '\' || lower(d.value) || '_ora_' || to_char(a.spid, 'fm0
0000') || '.trc' "TRACE FILE"
2 from v$process a, v$session b, v$parameter c, v$parameter d where a.addr =
b.paddr
3 and b.audsid = userenv('sessionid') and c.name = 'user_dump_dest'
4 and d.name = 'db_name';
TRACE FILE
/arch/dump/udump\icai_ora_02464.trc-rw-r----- 1 oracle dba 2526 Nov 9 04:27 icai12_ora_1314.trc
-rw-r----- 1 oracle dba 2528 Nov 9 04:41 icai12_ora_1541.trc
-rw-r----- 1 oracle dba 689 Nov 9 14:26 icai11_ora_14071.trc
-rw-r----- 1 oracle dba 6414 Nov 9 23:56 icai12_ora_456.trc
-rw-r----- 1 oracle dba 1427 Nov 10 12:02 icai11_ora_1867.trc
-rw-r----- 1 oracle dba 613 Nov 10 12:02 icai12_ora_292.trc
-rw-r----- 1 oracle dba 678 Nov 10 12:07 icai11_ora_2356.trc
-rw-r----- 1 oracle dba 613 Nov 10 12:12 icai12_ora_490.trc
-rw-r----- 1 oracle dba 626 Nov 10 12:12 icai11_ora_2275.trc
-rw-r----- 1 oracle dba 613 Nov 10 12:12 icai12_ora_505.trc
-rw-r----- 1 oracle dba 626 Nov 10 12:15 icai11_ora_2430.trc
-rw-r----- 1 oracle dba 613 Nov 10 12:15 icai12_ora_286.trc
-rw-r----- 1 oracle dba 625 Nov 10 12:42 icai11_ora_2378.trc
-rw-r----- 1 oracle dba 625 Nov 10 12:45 icai11_ora_2549.trc
-rw-r----- 1 oracle dba 625 Nov 10 12:46 icai11_ora_2514.trc
-rw-r----- 1 oracle dba 626 Nov 10 12:48 icai11_ora_2626.trc
-rw-r----- 1 oracle dba 731 Nov 10 12:49 icai11_ora_2322.trc
-rw-r----- 1 oracle dba 1312 Nov 10 12:49 icai11_ora_2096.trc
-rw-r----- 1 oracle dba 625 Nov 10 12:50 icai11_ora_2315.trc
-rw-r----- 1 oracle dba 625 Nov 10 12:50 icai11_ora_1390.trc
-rw-r----- 1 oracle dba 729 Nov 10 12:51 icai11_ora_1990.trc
-rw-r----- 1 oracle dba 626 Nov 10 12:52 icai11_ora_2485.trc
-rw-r----- 1 oracle dba 626 Nov 10 12:52 icai11_ora_2063.trc
-rw-r----- 1 oracle dba 644 Nov 10 12:53 icai11_ora_2605.trc
-rw-r----- 1 oracle dba 626 Nov 10 12:54 icai11_ora_2299.trc
-rw-r----- 1 oracle dba 625 Nov 10 13:07 icai11_ora_2333.trc
-rw-r----- 1 oracle dba 626 Nov 10 13:07 icai11_ora_2380.trc
-rw-r----- 1 oracle dba 729 Nov 10 13:07 icai11_ora_2174.trc
-rw-r----- 1 oracle dba 625 Nov 10 13:08 icai11_ora_2851.trc
-rw-r----- 1 oracle dba 613 Nov 10 13:08 icai12_ora_627.trc
-rw-r----- 1 oracle dba 626 Nov 10 13:11 icai11_ora_2894.trc
-rw-r----- 1 oracle dba 1365 Nov 10 13:12 icai11_ora_2443.trc
-rw-r----- 1 oracle dba 1640016 Nov 10 13:42 icai12_ora_427.trc
-rw-r----- 1 oracle dba 676 Nov 10 13:48 icai11_ora_2183.trc
-rw-r----- 1 oracle dba 626 Nov 10 13:48 icai11_ora_2230.trc
-rw-r----- 1 oracle dba 645 Nov 10 13:55 icai11_ora_3220.trc
-rw-r----- 1 oracle dba 675 Nov 10 13:57 icai12_ora_276.trc
-rw-r----- 1 oracle dba 625 Nov 10 14:07 icai11_ora_3198.trc
-rw-r----- 1 oracle dba 1376 Nov 10 14:08 icai11_ora_2935.trc
-rw-r----- 1 oracle dba 625 Nov 10 14:09 icai11_ora_3273.trc
-rw-r----- 1 oracle dba 677 Nov 10 14:10 icai11_ora_2465.trc
-rw-r----- 1 oracle dba 634 Nov 10 14:17 icai12_ora_1137.trc
-rw-r----- 1 oracle dba 687 Nov 10 14:21 icai11_ora_1971.trc
-rw-r----- 1 oracle dba 688 Nov 10 14:23 icai11_ora_2973.trc
-rw-r----- 1 oracle dba 626 Nov 10 14:25 icai11_ora_2144.trc
-rw-r----- 1 oracle dba 770 Nov 10 14:32 icai12_ora_399.trc
-rw-r----- 1 oracle dba 718 Nov 10 14:37 icai12_ora_917.trc
-rw-r----- 1 oracle dba 644 Nov 10 14:48 icai11_ora_3510.trc
-rw-r----- 1 oracle dba 645 Nov 10 15:31 icai11_ora_2957.trc
-rw-r----- 1 oracle dba 730 Nov 10 15:33 icai11_ora_1973.trc
-rw-r----- 1 oracle dba 688 Nov 10 15:56 icai11_ora_3830.trc
-rw-r----- 1 oracle dba 2527 Nov 10 16:11 icai12_ora_364.trc
-rw-r----- 1 oracle dba 687 Nov 10 16:34 icai11_ora_4150.trc
-rw-r----- 1 oracle dba 1332 Nov 10 16:35 icai11_ora_3760.trc
-rw-r----- 1 oracle dba 715 Nov 10 16:38 icai11_ora_3723.trc
-rw-r----- 1 oracle dba 687 Nov 10 16:46 icai11_ora_4295.trc
-rw-r----- 1 oracle dba 714 Nov 10 16:56 icai11_ora_2598.trc
-rw-r----- 1 oracle dba 615 Nov 10 17:06 icai12_ora_2232.trc
-rw-r----- 1 oracle dba 615 Nov 10 17:09 icai12_ora_2290.trc
-rw-r----- 1 oracle dba 2527 Nov 10 17:13 icai12_ora_1875.trc
-rw-r----- 1 oracle dba 688 Nov 10 17:18 icai11_ora_4473.trc
-rw-r----- 1 oracle dba 978 Nov 10 17:25 icai12_ora_2265.trc
-rw-r----- 1 oracle dba 645 Nov 10 17:29 icai11_ora_4582.trc
-rw-r----- 1 oracle dba 730 Nov 10 17:36 icai11_ora_4084.trc
-rw-r----- 1 oracle dba 616 Nov 10 17:46 icai12_ora_2281.trc
-rw-r----- 1 oracle dba 615 Nov 10 17:46 icai12_ora_1811.trc
-rw-r----- 1 oracle dba 730 Nov 10 17:50 icai11_ora_4225.trc
-rw-r----- 1 oracle dba 2528 Nov 10 18:08 icai12_ora_2352.trc
-rw-r----- 1 oracle dba 626 Nov 10 18:10 icai11_ora_2501.trc
-rw-r----- 1 oracle dba 738 Nov 10 18:10 icai11_ora_2790.trc
-rw-r----- 1 oracle dba 688 Nov 10 18:28 icai11_ora_3768.trc
-rw-r----- 1 oracle dba 626 Nov 10 18:33 icai11_ora_4029.trc
-rw-r----- 1 oracle dba 626 Nov 10 18:33 icai11_ora_3965.trc
root@ai2 #

You seem to have RAC with multiple instances.
Anyhow, lower(d.value) --> icai, doesn't occur in any filename. This is because the instance name is in the trace filename, not the database name.
You are aware you can set the tracefile_identifier?
This will be simply appended to the original filename.
Sybrand Bakker
Senior Oracle DBA

Logrotate and open trace files

On our racs we see a lot of open (lsof) trace files in our dump directories. We've been using logrotate with cumpersome pre/post rotate code to rotate the files, with the code supposedly filtering out open files, but we still run into issue and are going to revisit this code soon.
I'm wondering if anybody has found a clean way to rotate and delete trace files without accidently deleting open files?
-Jeff

Hollis, let's set expectations first.
Digital Editions runs on your computer, not your ereader. What it does is
interface between the publisher or distributor and you, by taking files
from them, reformatting them into readable documents in some cases (in
others, checking and maintaining digital rights), and transferring those
files (now in .epub format) to your computer. It keeps a library of these
epubs and manages it for you. You have to have Digital Editions or some
other similar program on your computer if you intent to obtain ebooks from
various sources. If you're satisfied with Barnes and Noble and the ebooks
they have, then you can link up with them via the Nook's wireless features
or through your computer and download ebooks directly to it that way.
You do not load Digital Editions or any similar program onto your Nook.
Next, at least a couple of people have told you how to the download. Arpit
Kapoor works for Adobe. His reply tells you how to download Digital
Editions and get it installed onto your computer. So my question to is do
you understand what he's saying?
If you have a problem with the download, then tell us in a bit more detail
what your computer is and what it's running (Windows or Mac). There are
some issues that others have had which relate to Win7, but your post isn't
clear enough to tell us whether you're encountering those issues.
===================

Genclntst fail in oracle10g RAC environment

After installation of oracle 10gR2 RAC on two-node solaris10 environment ,we need to run $ORACLE_HOME/bin/genclntst to generate the Client Static Library(libclntst10.a) but it failed .We copy another successfully generated libclntst10.a file from a non-RAC oracle10g environment running on solaris10.
and it seems to work correctly. is it really OK ?,is there any difference between the libclntst10.a file in a RAC environment and in a non-RAC environment ?
thanks a lot.
----------------------------the error message--------------------------------------------------------
     (file /opt/lib/cobol/lib/libcobrts.so value=LOCL);
ld: warning: global symbol `' has non-global binding:
     (file /opt/lib/cobol/lib/libcobrts.so value=LOCL);
ld: warning: global symbol `' has non-global binding:
     (file /opt/lib/cobol/lib/libcobrts.so value=LOCL);
ld: warning: global symbol `' has non-global binding:
     (file /opt/lib/cobol/lib/libcobrts.so value=LOCL);
ld: warning: global symbol `' has non-global binding:
     (file /opt/lib/cobol/lib/libcobrts.so value=LOCL);
ld: warning: global symbol `' has non-global binding:
     (file /opt/lib/cobol/lib/libcobcrtn.so value=LOCL);
ld: warning: global symbol `' has non-global binding:
     (file /opt/lib/cobol/lib/libcobmisc.so value=LOCL);
ld: warning: global symbol `' has non-global binding:
     (file /opt/lib/cobol/lib/libcobscreen.so.2 value=LOCL);
Undefined               first referenced
symbol                in file
lms_fblang /oracle/oracle/product/10.2.0.1/lib32/libclntst10.a(lmsai.o)
lms_pmlang /oracle/oracle/product/10.2.0.1/lib32/libclntst10.a(lmsai.o)
ld: fatal: Symbol referencing errors. No output written to olcp
*** Error code 1
make: Fatal error: Command failed for target `olcp'

Hi,
In 11g you can use the instance_id job attribute to do this.
In 10g you can do this using services.
- create a service for each instance
- create a job class pointing to each service
- grant execute on the job classes to all job owners that need to use them
- when creating a job point to the job class for the service for the instance it should run on
Oracle recommends using services instead of instances since services are more flexible and can provide high-availability and fail-over in case one instance goes down.
Hope this helps,
Ravi.

Trace file in RAC environment

Similar Messages

Maybe you are looking for