Oracle RAC Node Crashing

Hi,
We recently upgraded to Oracle RAC database to support Siebel Call Center APplication (8.1.1.11.12 [IP2013]).Oracle Database 11g Enterprise Edition Release 11.2.0.3.0 - 64bit Production
Frequently we are facing problem of crashing with the Nodes in RAC (Kernal Panic). Due to this users using siebel application are unstable and facing multiple issues Once we restore Siebel Gateway and restart of AOM server fixing the issue.
Below are the SQL's and Crashing Signature we are seeing du to this crash.
DBCLog DBCLogError 1 00081f1254bb0ad4:1423830 2015-01-18 11:49:20 OCIStmtExecute: SELECT
T2.CONFLICT_ID,
T2.LAST_UPD,
T2.CREATED,
T2.LAST_UPD_BY,
T2.CREATED_BY,
T2.MODIFICATION_NUM,
T2.ROW_ID,
T2.EFF_START_TS,
T2.EFF_END_TS,
T2.NAME,
T2.BUSOBJ_NAME,
T2.VERSION,
T2.DEPLOY_STATUS_CD,
T2.MODE_CD
FROM
SIEBEL.S_LST_OF_VAL T1,
SIEBEL.S_WFA_DPLOY_DEF T2
WHERE
T2.DEPLOY_STATUS_CD = T1.NAME AND T1.TYPE = 'WFA_DPLY_STAT_CD' AND T1.LANG_ID = :1 AND
(T2.TYPE_CD IN ( :2 )) AND
(T2.NAME = :3 AND T2.DEPLOY_STATUS_CD IN ( :4 ) AND (T2.EFF_END_TS > TO_DATE(:5,'MM/DD/YYYY HH24:MI:SS') OR T2.EFF_END_TS IS NULL))
ORDER BY
T2.NAME, T1.VAL
ObjMgrLog Error 1 00081f1254bb0ad4:1423830 2015-01-18 11:49:20 (oracon.cpp (3896)) SBL-DBC-00105: An error has occurred executing a Sql statement.
Please continue or ask your systems administrator to check your application configuration if the problem persists.
and Crash Signature Looks like below
Exception 0xc0000005 at 0x006500f6
Thread: 0x00002700, Process 0x00000254
Thread: 9984, Process 596
- CONTEXT -
EIP: 0x00000000, EFL: 0x00010246, FS: 0x0000003b, GS: 0x00000000
CS: 0x0000001b, DS: 0x00000023, SS: 0x00000023, ES: 0x00000023
EAX: 0x1a511968, EBX: 0x294ca048, ECX: 0x4cc50008, EDX: 0x3a2ad200
ESI: 0x4cc50008, EDI: 0x00000000, EBP: 0x00000000, ESP: 0x3a2afff4
- CALL STACK -
sslcscr +0xf6
sscfcmn +0x19050 = CSSObjectBase::CopyErrorMsg() +0xf0
sscfcmn +0x1950d = CSSObjectBase::DoSetErrorMsg() +0x13d
sscfcmn +0x19bb5 = CSSObjectBase::SetErrorMsg() +0xa5
SSFACMBC +0x34a6 = CSSFABCVRec::IsBusinessProcessActive() +0x3b6
SSFACMBC +0x5133 = CSSFABCVRec::VBCCreate() +0x1e3
sscfom +0x71d1e = CSSBCVRec::SqlCreate() +0xde
sscfom +0x4aea = CSSModel::ConstructBusComp() +0xaa
sscfom +0x653f5 = CSSBusObj::GetBusComp() +0x265
sscfom +0x65a18 = CSSBusObj::GetBusComp() +0x18
sscfom +0x13ad8 = CSSModel::BeginSetupView() +0x418
sscfom +0x13dee = CSSModel::BeginSetupView() +0x5e
sscaswbc +0x8b070 = CSSSWEUdfLoader::BeginSetupView() +0x30
sscaswbc +0xe3d88 = CSSSWEFrameMgrInternal::BuildView() +0x1618
sscaswbc +0xe5646 = CSSSWEFrameMgrInternal::BuildView() +0x36
sscaswbc +0xb8343 = CSSSWEActionMgr::ActionBuildViewAsync() +0x293
sscaswbc +0xb873b = CSSSWEActionMgr::DoPostedAction() +0xab
sscaswbc +0xb9287 = CSSSWEActionMgr::CheckPostedActions() +0x3d7
sscaswbc +0xe6d41 = CSSSWEFrameMgrInternal::InvokeAppletMethod() +0x11b1
sscaswbc +0xbbcdc = CSSSWECmdProcessor::InvokeMethod() +0x74c
sscaswbc +0xc1495 = CSSSWECmdProcessor::_ProcessCommand() +0x725
sscaswbc +0xc27f8 = CSSSWECmdProcessor::ProcessCommand() +0xab8
sscaswbc +0xc2d04 = CSSSWECmdProcessor::ProcessCommand() +0xc4
sscaswbc +0x265559 = CSSServiceSWEIface::Request() +0x309
sscaswbc +0x267391 = CSSServiceSWEIface::DoInvokeMethod() +0xed1
sscfom +0x1976c = CSSService::InvokeMethod() +0x24c
sstcsiom +0x6d6a = CSSSIOMSession::ModInvokeSrvcMethod() +0x10a
sstcsiom +0x7613 = CSSSIOMSession::RPCMiscModel() +0x513
sstcsiom +0xe9dd = CSSSIOMSession::HandleRPC() +0x3ad
sssasos +0x6616 = CompCleanup() +0x3be6
sssasos +0x5a95 = CompCleanup() +0x3065
sssasos +0x1a35 = CSSSISObject::operator=() +0x9f5
sssasos +0x2135 = CompHandleMsg() +0x485
siebmtshmw +0x494e
siebmtshmw +0x20051 = GetSmiTaskAPI() +0x6d21
siebmtshmw +0x239d1 = SmiInProcMsgHandler() +0x2051
siebmtshmw +0x15f15 = SmiBeginTrace() +0x3195
siebmtshmw +0x174cf = GetSmiWorkQObj() +0x148f
siebmtshmw +0xc7f7 = SmiCleanupDetTask() +0x3be7
sslcosd +0x2152 = OSDThreadPrivIsInit() +0x1d2
sslcosd +0x21dc = OSDThreadPrivIsInit() +0x25c
MSVCR71 +0x9565 = endthreadex() +0xa0
kernel32 +0x2484f = GetModuleHandleA() +0xdf
- STACK DUMP -
- MODULE LIST -
00400000-00445000: C:\siebel\siebsrvr\BIN\siebmtshmw.exe, 811.11.822.4
7c800000-7c8c3000: C:\WINDOWS\system32\ntdll.dll, 5.2.3790.4937
77e40000-77f44000: C:\WINDOWS\system32\kernel32.dll, 5.2.3790.5295
10000000-10025000: C:\siebel\siebsrvr\BIN\ssscsci.dll, 811.11.822.4
00320000-003cc000: C:\siebel\siebsrvr\BIN\ssscscf.dll, 811.11.822.4
003d0000-003d7000: C:\siebel\siebsrvr\BIN\sslcosa.dll, 811.11.822.4
7c340000-7c396000: C:\siebel\siebsrvr\BIN\MSVCR71.dll, 7.10.3052.4
00450000-0054d000: C:\siebel\siebsrvr\BIN\sslcshar.dll, 811.11.822.4
77380000-77411000: C:\WINDOWS\system32\USER32.dll, 5.2.3790.4033
77c00000-77c49000: C:\WINDOWS\system32\GDI32.dll, 5.2.3790.5398
7d1e0000-7d27c000: C:\WINDOWS\system32\ADVAPI32.dll, 5.2.3790.4455
77c50000-77cf1000: C:\WINDOWS\system32\RPCRT4.dll, 5.2.3790.5254
76f50000-76f63000: C:\WINDOWS\system32\Secur32.dll, 5.2.3790.4455
77b90000-77b98000: C:\WINDOWS\system32\VERSION.dll, 5.2.3790.3959
77ba0000-77bfa000: C:\WINDOWS\system32\msvcrt.dll, 7.0.3790.3959
71bb0000-71bb9000: C:\WINDOWS\system32\WSOCK32.dll, 5.2.3790.0
71c00000-71c17000: C:\WINDOWS\system32\WS2_32.dll, 5.2.3790.3959
71bf0000-71bf8000: C:\WINDOWS\system32\WS2HELP.dll, 5.2.3790.3959
003e0000-003e6000: C:\siebel\siebsrvr\BIN\libarm.dll, 811.10.822.3
00550000-005d5000: C:\siebel\siebsrvr\BIN\sslcsym.dll, 811.11.822.4
7c3a0000-7c41b000: C:\siebel\siebsrvr\BIN\MSVCP71.dll, 7.10.3077.0
005e0000-005f1000: C:\siebel\siebsrvr\BIN\sslccore.dll, 811.11.822.4
00600000-00618000: C:\siebel\siebsrvr\BIN\sslcosd.dll, 811.11.822.4
00620000-00645000: C:\siebel\siebsrvr\BIN\sslcrsa.dll, 811.11.822.4
00650000-0067f000: C:\siebel\siebsrvr\BIN\sslcscr.dll, 811.11.822.4
00680000-007cf000: C:\siebel\siebsrvr\BIN\sslcsrd.dll, 811.11.822.4
007d0000-0082b000: C:\siebel\siebsrvr\BIN\sslcscc.dll, 811.11.822.4
003f0000-003ff000: C:\siebel\siebsrvr\BIN\sslcevt.dll, 811.11.822.4
00830000-00840000: C:\siebel\siebsrvr\BIN\sslcsobj.dll, 811.11.822.4
00840000-00850000: C:\siebel\siebsrvr\BIN\sslcsnns.dll, 811.11.822.4
00850000-00931000: C:\siebel\siebsrvr\BIN\sslcnapi.dll, 811.11.822.4
00940000-00954000: C:\siebel\siebsrvr\BIN\sslcns.dll, 811.11.822.4
00960000-00968000: C:\siebel\siebsrvr\BIN\sslcsnsc.dll, 811.11.822.4
00970000-0097b000: C:\siebel\siebsrvr\BIN\ssscsmi.dll, 811.11.822.4
00980000-00991000: C:\siebel\siebsrvr\BIN\sslcsrvr.dll, 811.11.822.4
009a0000-009bb000: C:\siebel\siebsrvr\BIN\sslcos.dll, 811.11.822.4
009c0000-00a5f000: C:\siebel\siebsrvr\BIN\sscfcmn.dll, 811.11.822.4
7c8d0000-7d0cf000: C:\WINDOWS\system32\SHELL32.dll, 6.0.3790.5018
7d180000-7d1d2000: C:\WINDOWS\system32\SHLWAPI.dll, 6.0.3790.5318
77670000-777aa000: C:\WINDOWS\system32\ole32.dll, 5.2.3790.5209
7d0e0000-7d16c000: C:\WINDOWS\system32\OLEAUT32.dll, 5.2.3790.5464
761b0000-76245000: C:\WINDOWS\system32\CRYPT32.dll, 5.131.3790.5235
76190000-761a2000: C:\WINDOWS\system32\MSASN1.dll, 5.2.3790.4584
77210000-772bb000: C:\WINDOWS\system32\WININET.dll, 6.0.3790.5467
00a60000-00a70000: C:\siebel\siebsrvr\BIN\sslczlib.dll, 811.11.822.4
00a70000-00b72000: C:\siebel\siebsrvr\BIN\MFC71U.DLL, 7.10.3077.0
00b80000-00b88000: C:\siebel\siebsrvr\BIN\sslcsnsr.dll, 811.11.822.4
00b90000-00b99000: C:\siebel\siebsrvr\BIN\sslcsrtr.dll, 811.11.822.4
00ba0000-00baf000: C:\siebel\siebsrvr\BIN\sslcsrms.dll, 811.11.822.4
00bb0000-00bb6000: C:\siebel\siebsrvr\BIN\sslcsssm.dll, 811.11.822.4
00bc0000-00bd1000: C:\siebel\siebsrvr\BIN\sslcsrcn.dll, 811.11.822.4
00be0000-00be7000: C:\siebel\siebsrvr\BIN\sslcsysstat.dll, 811.11.822.4
00fe0000-0100d000: C:\siebel\siebsrvr\BIN\sslcrsa256.dll, 8.1.1.5
77420000-77523000: C:\WINDOWS\WinSxS\x86_Microsoft.Windows.Common-Controls_6595b64144ccf1df_6.0.3790.5190_x-ww_319264BE\comctl32.dll, 6.0.3790.5190
5d360000-5d36e000: C:\siebel\siebsrvr\BIN\MFC71ENU.DLL, 7.10.3077.0
76b70000-76b7b000: C:\WINDOWS\system32\psapi.dll, 5.2.3790.3959
012b0000-012c0000: C:\siebel\siebsrvr\BIN\sslcasrv.dll, 811.11.822.4
012c0000-01328000: C:\siebel\siebsrvr\BIN\sslcsrs.dll, 811.11.822.4
01330000-0133a000: C:\siebel\siebsrvr\BIN\sslcntfy.dll, 811.11.822.4
01740000-01746000: C:\siebel\siebsrvr\BIN\enu\srcf.dll, 811.9.822.2
01750000-01756000: C:\siebel\siebsrvr\BIN\enu\srcfapps.dll, 811.9.822.2
01760000-01766000: C:\siebel\siebsrvr\BIN\sbcf.dll, 811.9.822.2
01770000-01776000: C:\siebel\siebsrvr\BIN\sbcfapps.dll, 811.9.822.2
01780000-01791000: C:\siebel\siebsrvr\BIN\sssasos.dll, 811.11.822.4
017a0000-017a8000: C:\siebel\siebsrvr\BIN\sslcom.dll, 811.11.822.4
017b0000-017be000: C:\siebel\siebsrvr\BIN\sslcsnom.dll, 811.11.822.4
017c0000-017f8000: C:\siebel\siebsrvr\BIN\sstcsiom.dll, 811.11.822.4
020f0000-021f0000: C:\siebel\siebsrvr\BIN\sscfom.dll, 811.11.822.4
021f0000-022ef000: C:\siebel\siebsrvr\BIN\sslcsc.dll, 811.11.822.4
022f0000-0236f000: C:\siebel\siebsrvr\BIN\sslcdb.dll, 811.11.822.4
4bf70000-4bfae000: C:\WINDOWS\system32\ODBC32.dll, 3.526.4795.0
77530000-775c7000: C:\WINDOWS\WinSxS\x86_Microsoft.Windows.Common-Controls_6595b64144ccf1df_5.82.3790.5190_x-ww_D21E1F39\COMCTL32.dll, 5.82.3790.5190
762b0000-762f9000: C:\WINDOWS\system32\comdlg32.dll, 6.0.3790.3959
01800000-0180b000: C:\siebel\siebsrvr\BIN\sscadsecr.dll, 811.11.822.4
02370000-0237d000: C:\siebel\siebsrvr\BIN\sslclm.dll, 811.11.822.4
02380000-0239c000: C:\siebel\siebsrvr\BIN\sslcupg.dll, 811.11.822.4
023a0000-023ba000: C:\siebel\siebsrvr\BIN\sslcsecm.dll, 811.11.822.4
023c0000-023ef000: C:\siebel\siebsrvr\BIN\sscfel.dll, 811.11.822.4
023f0000-026b0000: C:\siebel\siebsrvr\BIN\sscfdm.dll, 811.11.822.4
026b0000-026bd000: C:\siebel\siebsrvr\BIN\sslcfsm.dll, 811.11.822.4
026c0000-026c8000: C:\siebel\siebsrvr\BIN\sslcsecc.dll, 811.11.822.4
026d0000-026e1000: C:\siebel\siebsrvr\BIN\sslccachev2.dll, 811.11.822.4
026f0000-026f9000: C:\siebel\siebsrvr\BIN\sslcmsgagent.dll, 811.11.822.4
02bd0000-02be7000: C:\WINDOWS\system32\odbcint.dll, 3.526.3959.0
02bf0000-02c23000: C:\siebel\siebsrvr\BIN\sslcrsa56.dll, 811.11.822.4
71b20000-71b61000: C:\WINDOWS\System32\mswsock.dll, 5.2.3790.4318
76ed0000-76efa000: C:\WINDOWS\system32\DNSAPI.dll, 5.2.3790.4840
76f70000-76f77000: C:\WINDOWS\System32\winrnr.dll, 5.2.3790.3959
76f10000-76f3e000: C:\WINDOWS\system32\WLDAP32.dll, 5.2.3790.3959
76f80000-76f85000: C:\WINDOWS\system32\rasadhlp.dll, 5.2.3790.3959
5f270000-5f2ca000: C:\WINDOWS\system32\hnetcfg.dll, 5.2.3790.3959
71ae0000-71ae8000: C:\WINDOWS\System32\wshtcpip.dll, 5.2.3790.3959
0ae80000-0af6a000: C:\siebel\siebsrvr\BIN\eBaySecAda.dll
76920000-769e2000: C:\WINDOWS\system32\userenv.dll, 5.2.3790.3959
71c40000-71c97000: C:\WINDOWS\system32\netapi32.dll, 5.2.3790.5030
76bb0000-76bdc000: C:\WINDOWS\system32\wintrust.dll, 5.131.3790.5060
76c10000-76c3a000: C:\WINDOWS\system32\imagehlp.dll, 5.2.3790.5240
76750000-76779000: C:\WINDOWS\system32\schannel.dll, 5.2.3790.5462
76e90000-76ecf000: C:\WINDOWS\system32\RASAPI32.DLL, 5.2.3790.3959
76e40000-76e52000: C:\WINDOWS\system32\rasman.dll, 5.2.3790.3959
76e60000-76e8f000: C:\WINDOWS\system32\TAPI32.dll, 5.2.3790.3959
76e30000-76e3c000: C:\WINDOWS\system32\rtutils.dll, 5.2.3790.3959
76aa0000-76acd000: C:\WINDOWS\system32\WINMM.dll, 5.2.3790.4916
722f0000-722f5000: C:\WINDOWS\system32\sensapi.dll, 5.2.3790.3959
772c0000-77371000: C:\WINDOWS\system32\urlmon.dll, 6.0.3790.5467
68000000-68035000: C:\WINDOWS\system32\rsaenh.dll, 5.2.3790.3959
68100000-68127000: C:\WINDOWS\system32\dssenh.dll, 5.2.3790.3959
0b300000-0b31a000: C:\siebel\siebsrvr\BIN\sscdo90.dll, 811.11.822.4
0b320000-0b3a2000: C:\oracle\product\11.1.0\client_1\bin\OCI.dll, 11.1.0.1
61c20000-61f81000: C:\oracle\product\11.1.0\client_1\bin\OraClient11.Dll, 11.1.0.7
60870000-6095b000: C:\oracle\product\11.1.0\client_1\bin\oracore11.dll, 11.1.0.7
60a80000-60b4e000: C:\oracle\product\11.1.0\client_1\bin\oranls11.dll, 11.1.0.7
63690000-636a8000: C:\oracle\product\11.1.0\client_1\bin\oraunls11.dll, 11.1.0.7
60eb0000-60eb7000: C:\oracle\product\11.1.0\client_1\bin\orauts.dll, 11.1.0.7
636b0000-636b6000: C:\oracle\product\11.1.0\client_1\bin\oravsn11.dll, 11.1.0.7
60fa0000-61158000: C:\oracle\product\11.1.0\client_1\bin\oracommon11.dll, 11.1.0.7
63430000-6345d000: C:\oracle\product\11.1.0\client_1\bin\orasnls11.dll, 11.1.0.7
0b3b0000-0be77000: C:\oracle\product\11.1.0\client_1\bin\orageneric11.dll, 11.1.0.7
0be80000-0c0dc000: C:\oracle\product\11.1.0\client_1\bin\oraxml11.dll, 11.1.0.7
60020000-60030000: C:\WINDOWS\system32\MSVCIRT.dll, 7.0.3790.0
0c0e0000-0c4b2000: C:\oracle\product\11.1.0\client_1\bin\oran11.dll, 11.1.0.6
62740000-627a3000: C:\oracle\product\11.1.0\client_1\bin\oranl11.dll, 11.1.0.6
62980000-629b1000: C:\oracle\product\11.1.0\client_1\bin\orantcp11.dll, 11.1.0.6
0c4c0000-0c507000: C:\oracle\product\11.1.0\client_1\bin\oranldap11.dll, 11.1.0.6
627f0000-62905000: C:\oracle\product\11.1.0\client_1\bin\orannzsbb11.dll, 11.1.0.6
62530000-6266d000: C:\oracle\product\11.1.0\client_1\bin\oraldapclnt11.dll, 11.1.0.7
62670000-6268b000: C:\oracle\product\11.1.0\client_1\bin\orancrypt11.dll, 11.1.0.6
0c510000-0c643000: C:\oracle\product\11.1.0\client_1\bin\orazt11.dll, 11.1.0.6
76cf0000-76d0a000: C:\WINDOWS\system32\iphlpapi.dll, 5.2.3790.3959
62920000-6296d000: C:\oracle\product\11.1.0\client_1\bin\oranro11.dll, 11.1.0.6
626b0000-626b9000: C:\oracle\product\11.1.0\client_1\bin\oranhost11.dll, 11.1.0.6
0c650000-0c656000: C:\oracle\product\11.1.0\client_1\bin\orancds11.dll, 11.1.0.6
629c0000-629cd000: C:\oracle\product\11.1.0\client_1\bin\orantns11.dll, 11.1.0.6
0c660000-0c6e0000: C:\oracle\product\11.1.0\client_1\bin\oraztkg11.dll, 11.1.0.6
0c6e0000-0caba000: C:\oracle\product\11.1.0\client_1\bin\orapls11.dll, 11.1.0.7
63420000-63429000: C:\oracle\product\11.1.0\client_1\bin\oraslax11.dll, 11.1.0.6
63080000-63296000: C:\oracle\product\11.1.0\client_1\bin\oraplp11.dll, 11.1.0.7
0cac0000-0cb6d000: C:\oracle\product\11.1.0\client_1\bin\orahasgen11.dll, 11.1.0.6
62ab0000-62b2f000: C:\oracle\product\11.1.0\client_1\bin\oraocr11.dll, 11.1.0.6
0cb70000-0cbce000: C:\oracle\product\11.1.0\client_1\bin\oraocrb11.dll, 11.1.0.6
6d580000-6d628000: C:\WINDOWS\system32\dbghelp.dll, 5.2.3790.3959
63520000-635c2000: C:\oracle\product\11.1.0\client_1\bin\orasql11.dll, 11.1.0.7
63060000-63074000: C:\oracle\product\11.1.0\client_1\bin\OraPlc11.Dll, 11.1.0.7
0cde0000-0cde6000: C:\siebel\siebsrvr\BIN\sslcdbgengw.dll, 811.11.822.4
0ce30000-0ce4c000: C:\siebel\siebsrvr\BIN\sscfomlg.dll, 811.11.822.4
0ce60000-0cffb000: C:\siebel\siebsrvr\BIN\sscfcli.dll, 811.11.822.4
0d070000-0d11d000: C:\siebel\siebsrvr\BIN\sscacmbc.dll, 811.11.822.4
209c0000-20a7e000: C:\siebel\siebsrvr\BIN\SSCABCBC.DLL, 811.11.822.4
20cc0000-20d19000: C:\siebel\siebsrvr\BIN\SSCACCBC.DLL, 811.11.822.4
212d0000-212ec000: C:\siebel\siebsrvr\BIN\sscapsppricersvc.dll, 811.11.822.4
20060000-2059a000: C:\siebel\siebsrvr\BIN\sscaswbc.dll, 811.11.822.4
21690000-21704000: C:\siebel\siebsrvr\BIN\SSCMSVC.DLL, 811.11.822.4
215a0000-2166c000: C:\siebel\siebsrvr\BIN\SSCMCLNT.DLL, 811.11.822.4
21740000-2179e000: C:\siebel\siebsrvr\BIN\sscmcfgsvc.dll, 811.11.822.4
0d010000-0d025000: C:\siebel\siebsrvr\BIN\SSCASRMS.DLL, 811.11.822.4
0d030000-0d070000: C:\siebel\siebsrvr\BIN\sscaadbc.dll, 811.11.822.4
21590000-2159d000: C:\siebel\siebsrvr\BIN\SSCFHIMS.DLL, 811.11.822.4
22490000-224aa000: C:\siebel\siebsrvr\BIN\SSCASSMC.DLL, 811.11.822.4
222d0000-22371000: C:\siebel\siebsrvr\BIN\sscacabc.dll, 811.11.822.4
224b0000-224ec000: C:\siebel\siebsrvr\BIN\SSCASVBC.DLL, 811.11.822.4
22be0000-22c24000: C:\siebel\siebsrvr\BIN\swcahcfr.dll, 811.11.822.4
22aa0000-22b54000: C:\siebel\siebsrvr\BIN\SWCACAFR.DLL, 811.11.822.4
22c30000-22ca0000: C:\siebel\siebsrvr\BIN\SSCAXMLPWFR.DLL, 811.11.822.4
22ed0000-22f8c000: C:\siebel\siebsrvr\BIN\SSDTBC.DLL, 811.11.822.4
22a80000-22a9f000: C:\siebel\siebsrvr\BIN\SSCACTBC.DLL, 811.11.822.4
23040000-230c1000: C:\siebel\siebsrvr\BIN\SWCASIFR.DLL, 811.11.822.4
211b0000-211cd000: C:\siebel\siebsrvr\BIN\swcacmfr.dll, 811.11.822.4
21f60000-21f6d000: C:\siebel\siebsrvr\BIN\SSLCKM.DLL, 811.11.822.4
22060000-220ca000: C:\siebel\siebsrvr\BIN\SSCANSHSV.DLL, 811.11.822.4
21b20000-21b9d000: C:\siebel\siebsrvr\BIN\SWCANSHFR.DLL, 811.11.822.4
21af0000-21b1a000: C:\siebel\siebsrvr\BIN\SSCANSHBC.DLL, 811.11.822.4
21f80000-21fc9000: C:\siebel\siebsrvr\BIN\sWcasvfr.dll, 811.11.822.4
22170000-22202000: C:\siebel\siebsrvr\BIN\SSFAFCBC.DLL, 811.11.822.4
23580000-235c4000: C:\siebel\siebsrvr\BIN\SSCAPRMSV.DLL, 811.11.822.4
22020000-2203e000: C:\siebel\siebsrvr\BIN\SSCAEITE.DLL, 811.11.822.4
1ff20000-2005a000: C:\siebel\siebsrvr\BIN\sscafwsv.dll, 811.11.822.4
22d40000-22ea8000: C:\siebel\siebsrvr\BIN\sscaeiwm.dll, 811.11.822.4
22d10000-22d3e000: C:\siebel\siebsrvr\BIN\SSCAEIWO.DLL, 811.11.822.4
23780000-2378b000: C:\siebel\siebsrvr\BIN\SSCAEILM.DLL, 811.11.822.4
23790000-237e3000: C:\siebel\siebsrvr\BIN\SSCAEISA.DLL, 811.11.822.4
22560000-22652000: C:\siebel\siebsrvr\BIN\SSCASPBC.DLL, 811.11.822.4
23880000-23897000: C:\siebel\siebsrvr\BIN\sscafssvactcache.dll, 811.11.822.4
239a0000-23a89000: C:\siebel\siebsrvr\BIN\SSCOMMSV.DLL, 811.11.822.4
036c0000-0372a000: C:\siebel\siebsrvr\BIN\SSCHATBS.DLL, 811.11.822.4
22770000-227c1000: C:\siebel\siebsrvr\BIN\sscasabc.dll, 811.11.822.4
23b30000-23b4c000: C:\siebel\siebsrvr\BIN\SSFACMBC.DLL, 811.11.822.4
23b50000-23b64000: C:\siebel\siebsrvr\BIN\SSFACMSV.DLL, 811.11.822.4
23ea0000-23eef000: C:\siebel\siebsrvr\BIN\sscacmuinsv.dll, 811.11.822.4
23490000-234f6000: C:\siebel\siebsrvr\BIN\SWCAFSFR.DLL, 811.11.822.4
21a80000-21aa5000: C:\siebel\siebsrvr\BIN\SSCASHSV.DLL, 811.11.822.4
21eb0000-21edd000: C:\siebel\siebsrvr\BIN\SSCASHBC.DLL, 811.11.822.4
21ee0000-21f2f000: C:\siebel\siebsrvr\BIN\SWCASHFR.DLL, 811.11.822.4
211d0000-211ee000: C:\siebel\siebsrvr\BIN\sscaxmbc.dll, 811.11.822.4
23ef0000-23f41000: C:\siebel\siebsrvr\BIN\SWCACGFR.DLL, 811.11.822.4
22140000-22170000: C:\siebel\siebsrvr\BIN\SSCATASV.DLL, 811.11.822.4
21220000-212c8000: C:\siebel\siebsrvr\BIN\swcabcfr.dll, 811.11.822.4
23bd0000-23bf4000: C:\siebel\siebsrvr\BIN\sscasasv.dll, 811.11.822.4
23b90000-23ba6000: C:\siebel\siebsrvr\BIN\SSCAEIXQ.DLL, 811.11.822.4
24860000-24929000: C:\siebel\siebsrvr\BIN\swcaspsv.dll, 811.11.822.4
04080000-0408b000: C:\siebel\siebsrvr\BIN\SSCFUREC.DLL, 811.11.822.4
Heap status          : ok
Total physical memory: 50320576 KB
Free physical memory : 35138076 KB
Paging file size     : 51918740 KB
Available paging size: 36997428 KB
Virtual memory info:
Total              : 2097024 KB
Available          : 836420 KB
Available extendent: 0 KB
Assert failure count : 1595991
Command line         : siebmtshmw.exe C:\siebel\siebsrvr\admin\siebprodent.pxsblaom026.shm 33 0 1 5 0 ENU 0 0
Current directory    : C:\siebel\siebsrvr\BIN
Executable           : C:\siebel\siebsrvr\BIN\siebmtshmw.exe
Current time         : 01/19/2015 10:52:32:099
CCF Version          : 8.1.1.10 SIA [23017] LANG_INDEPENDENT
CCF Compiled On      : Jan 21 2013 18:06:00
Would approciate if anyone could provide some inputs on the same..
Thanks
Ruban

Similar Messages

Huge number of idle connections from loopback ip on oracle RAC node

Hi,
We have a 2node 11gR2(11.2.0.3) oracle RAC node. We are seeing huge number of idle connection(more than 5000 in each node) on both the nodes and increasing day by day. All the idle connections are from VIP and loopback address(127.0.0.1.47971 )
netstat -an |grep -i idle|more
127.0.0.1.47971 Idle
any insight will be helpful.
The server is suffering memory issues occasionally (once in a month).
ORA-27300: OS system dependent operation:fork failed with status: 11
ORA-27301: OS failure message: Resource temporarily unavailable
Thanks

user12959884 wrote:
Hi,
We have a 2node 11gR2(11.2.0.3) oracle RAC node. We are seeing huge number of idle connection(more than 5000 in each node) on both the nodes and increasing day by day. All the idle connections are from VIP and loopback address(127.0.0.1.47971 )
netstat -an |grep -i idle|more
127.0.0.1.47971 Idle
any insight will be helpful.
The server is suffering memory issues occasionally (once in a month).
ORA-27300: OS system dependent operation:fork failed with status: 11
ORA-27301: OS failure message: Resource temporarily unavailable
Thankswe can not control what occurs on your DB Server.
How do I ask a question on the forums?
SQL and PL/SQL FAQ
post results from following SQL
SELECT * FROM V$VERSION;

If use MSSQ , when oracle rac node reboot, client get TPEOS error

Hi, all
in my tuxedo applicaton, if we use Single Server, Single Queue mode , when reboot any Oracle RAC node, our application is ok, client can get correct result. but if we use MSSQ（Multi Server, Single Queue) , if Oracle RAC node is ok , our application also is ok. but if we reboot any Oracle RAC node, client program can continue run, get correct result, but always get TPEOS error , for this situation， server can get client request, but client can not get server reply, only get TPEOS error.
our enviroment is :
oracle RAC ,10g 10.2.0.4 , two instances ,rac1 rac2, and two DTP services s1 and s2, set s1 and s2 services TAF is basic
tuxedo 10R3 , two nodes ,work in MP model ，use XA access oracle rac database，services have Transaction and not Transaction
OS is linux AS4 U5, 64bits
service program use OCI
can any one encounter this problem ?

Hi, first thanks you
in ULOG file , only have failover information, not any other error message, in client side also has no other error.
not use MSSQ, ubb file about MSSQ config
SERVERS
DEFAULT:
CLOPT="-A "
sinUpdate_server SRVGRP=GROUP11 SRVID=80 MIN=10 MAX=30 MAXGEN=10 GRACE=10 RESTART=Y
sinUpdate_server SRVGRP=GROUP12 SRVID=160 MIN=10 MAX=30 MAXGEN=10 GRACE=10 RESTART=Y
sinCount_server SRVGRP=GROUP11 SRVID=240 MIN=10 MAX=30 MAXGEN=10 GRACE=10 RESTART=Y
sinCount_server SRVGRP=GROUP12 SRVID=320 MIN=10 MAX=30 MAXGEN=10 GRACE=10 RESTART=Y
sinSelect_server SRVGRP=GROUP11 SRVID=360 MIN=10 MAX=30 MAXGEN=10 GRACE=10 RESTART=Y
sinSelect_server SRVGRP=GROUP12 SRVID=400 MIN=10 MAX=30 MAXGEN=10 GRACE=10 RESTART=Y
sinInsert_server SRVGRP=GROUP11 SRVID=520 MIN=10 MAX=30 MAXGEN=10 GRACE=10 RESTART=Y
sinInsert_server SRVGRP=GROUP12 SRVID=560 MIN=10 MAX=30 MAXGEN=10 GRACE=10 RESTART=Y
sinDelete_server SRVGRP=GROUP11 SRVID=600 MIN=10 MAX=30 MAXGEN=10 GRACE=10 RESTART=Y
sinDelete_server SRVGRP=GROUP12 SRVID=640 MIN=10 MAX=30 MAXGEN=10 GRACE=10 RESTART=Y
sinDdl_server SRVGRP=GROUP11 SRVID=700 MIN=5 MAX=30 MAXGEN=10 GRACE=10 RESTART=Y
sinDdl_server SRVGRP=GROUP12 SRVID=740 MIN=5 MAX=30 MAXGEN=10 GRACE=10 RESTART=Y
lockselect_server SRVGRP=GROUP11 SRVID=800 MIN=10 MAX=30 MAXGEN=10 GRACE=10 RESTART=Y
lockselect_server SRVGRP=GROUP12 SRVID=840 MIN=10 MAX=30 MAXGEN=10 GRACE=10 RESTART=Y
#mulup_server SRVGRP=GROUP11 SRVID=1 MIN=2 MAX=30 MAXGEN=10 GRACE=10 RESTART=Y
#mulup_server SRVGRP=GROUP12 SRVID=60 MIN=2 MAX=30 MAXGEN=10 GRACE=10 RESTART=Y
sinUpdate_server SRVGRP=GROUP13 SRVID=83 MIN=10 MAX=30 MAXGEN=10 GRACE=10 RESTART=Y
sinUpdate_server SRVGRP=GROUP14 SRVID=164 MIN=10 MAX=30 MAXGEN=10 GRACE=10 RESTART=Y
sinCount_server SRVGRP=GROUP13 SRVID=243 MIN=10 MAX=30 MAXGEN=10 GRACE=10 RESTART=Y
sinCount_server SRVGRP=GROUP14 SRVID=324 MIN=10 MAX=30 MAXGEN=10 GRACE=10 RESTART=Y
sinSelect_server SRVGRP=GROUP13 SRVID=363 MIN=10 MAX=30 MAXGEN=10 GRACE=10 RESTART=Y
sinSelect_server SRVGRP=GROUP14 SRVID=404 MIN=10 MAX=30 MAXGEN=10 GRACE=10 RESTART=Y
sinInsert_server SRVGRP=GROUP13 SRVID=523 MIN=10 MAX=30 MAXGEN=10 GRACE=10 RESTART=Y
sinInsert_server SRVGRP=GROUP14 SRVID=564 MIN=10 MAX=30 MAXGEN=10 GRACE=10 RESTART=Y
sinDelete_server SRVGRP=GROUP13 SRVID=603 MIN=10 MAX=30 MAXGEN=10 GRACE=10 RESTART=Y
sinDelete_server SRVGRP=GROUP14 SRVID=644 MIN=10 MAX=30 MAXGEN=10 GRACE=10 RESTART=Y
sinDdl_server SRVGRP=GROUP13 SRVID=703 MIN=5 MAX=30 MAXGEN=10 GRACE=10 RESTART=Y
sinDdl_server SRVGRP=GROUP14 SRVID=744 MIN=5 MAX=30 MAXGEN=10 GRACE=10 RESTART=Y
lockselect_server SRVGRP=GROUP13 SRVID=803 MIN=10 MAX=30 MAXGEN=10 GRACE=10 RESTART=Y
lockselect_server SRVGRP=GROUP14 SRVID=844 MIN=10 MAX=30 MAXGEN=10 GRACE=10 RESTART=Y
#mulup_server SRVGRP=GROUP13 SRVID=13 MIN=2 MAX=30 MAXGEN=10 GRACE=10 RESTART=Y
#mulup_server SRVGRP=GROUP14 SRVID=64 MIN=2 MAX=30 MAXGEN=10 GRACE=10 RESTART=Y
WSL SRVGRP=GROUP11 SRVID=1000
CLOPT="-A -- -n//120.3.8.237:7200 -I 60 -T 60 -w WSH -m 50 -M 100 -x 6 -N 3600"
WSL SRVGRP=GROUP12 SRVID=1001
CLOPT="-A -- -n//120.3.8.238:7200 -I 60 -T 60 -w WSH -m 50 -M 100 -x 6 -N 3600"
WSL SRVGRP=GROUP13 SRVID=1003
CLOPT="-A -- -n//120.3.8.237:7203 -I 60 -T 60 -w WSH -m 50 -M 100 -x 6 -N 3600"
WSL SRVGRP=GROUP14 SRVID=1004
CLOPT="-A -- -n//120.3.8.238:7204 -I 60 -T 60 -w WSH -m 50 -M 100 -x 6 -N 3600"
if we use MSSQ ,ubb file about MSSQ config is
*SERVERS
DEFAULT:
CLOPT="-A -p 1,60:1,30"
sinUpdate_server SRVGRP=GROUP11 SRVID=80 MIN=10 MAX=30 MAXGEN=10 GRACE=10 RESTART=Y RQADDR=sinUpdate11 REPLYQ=Y
sinUpdate_server SRVGRP=GROUP12 SRVID=160 MIN=10 MAX=30 MAXGEN=10 GRACE=10 RESTART=Y RQADDR=sinUpdate12 REPLYQ=Y
sinCount_server SRVGRP=GROUP11 SRVID=240 MIN=10 MAX=30 MAXGEN=10 GRACE=10 RESTART=Y RQADDR=sinCount11 REPLYQ=Y
sinCount_server SRVGRP=GROUP12 SRVID=320 MIN=10 MAX=30 MAXGEN=10 GRACE=10 RESTART=Y RQADDR=sinCount12 REPLYQ=Y
sinSelect_server SRVGRP=GROUP11 SRVID=360 MIN=10 MAX=30 MAXGEN=10 GRACE=10 RESTART=Y RQADDR=sinSelec11 REPLYQ=Y
sinSelect_server SRVGRP=GROUP12 SRVID=400 MIN=10 MAX=30 MAXGEN=10 GRACE=10 RESTART=Y RQADDR=sinSelect12 REPLYQ=Y
sinInsert_server SRVGRP=GROUP11 SRVID=520 MIN=10 MAX=30 MAXGEN=10 GRACE=10 RESTART=Y RQADDR=sinInsert11 REPLYQ=Y
sinInsert_server SRVGRP=GROUP12 SRVID=560 MIN=10 MAX=30 MAXGEN=10 GRACE=10 RESTART=Y RQADDR=sinInsert12 REPLYQ=Y
sinDelete_server SRVGRP=GROUP11 SRVID=600 MIN=10 MAX=30 MAXGEN=10 GRACE=10 RESTART=Y RQADDR=sinDelete11 REPLYQ=Y
sinDelete_server SRVGRP=GROUP12 SRVID=640 MIN=10 MAX=30 MAXGEN=10 GRACE=10 RESTART=Y RQADDR=sinDelete12 REPLYQ=Y
sinDdl_server SRVGRP=GROUP11 SRVID=700 MIN=5 MAX=30 MAXGEN=10 GRACE=10 RESTART=Y RQADDR=sinDdl11 REPLYQ=Y
sinDdl_server SRVGRP=GROUP12 SRVID=740 MIN=5 MAX=30 MAXGEN=10 GRACE=10 RESTART=Y RQADDR=sinDdl12 REPLYQ=Y
lockselect_server SRVGRP=GROUP11 SRVID=800 MIN=10 MAX=30 MAXGEN=10 GRACE=10 RESTART=Y RQADDR=lockselect11 REPLYQ=Y
lockselect_server SRVGRP=GROUP12 SRVID=840 MIN=10 MAX=30 MAXGEN=10 GRACE=10 RESTART=Y RQADDR=lockselect12 REPLYQ=Y
#mulup_server SRVGRP=GROUP11 SRVID=1 MIN=2 MAX=30 MAXGEN=10 GRACE=10 RESTART=Y RQADDR=mulup11 REPLYQ=Y
#mulup_server SRVGRP=GROUP12 SRVID=60 MIN=2 MAX=30 MAXGEN=10 GRACE=10 RESTART=Y RQADDR=mulup12 REPLYQ=Y
sinUpdate_server SRVGRP=GROUP13 SRVID=83 MIN=10 MAX=30 MAXGEN=10 GRACE=10 RESTART=Y RQADDR=sinUpdate13 REPLYQ=Y
sinUpdate_server SRVGRP=GROUP14 SRVID=164 MIN=10 MAX=30 MAXGEN=10 GRACE=10 RESTART=Y RQADDR=sinUpdate14 REPLYQ=Y
sinCount_server SRVGRP=GROUP13 SRVID=243 MIN=10 MAX=30 MAXGEN=10 GRACE=10 RESTART=Y RQADDR=sinCount13 REPLYQ=Y
sinCount_server SRVGRP=GROUP14 SRVID=324 MIN=10 MAX=30 MAXGEN=10 GRACE=10 RESTART=Y RQADDR=sinCount14 REPLYQ=Y
sinSelect_server SRVGRP=GROUP13 SRVID=363 MIN=10 MAX=30 MAXGEN=10 GRACE=10 RESTART=Y RQADDR=sinSelec13 REPLYQ=Y
sinSelect_server SRVGRP=GROUP14 SRVID=404 MIN=10 MAX=30 MAXGEN=10 GRACE=10 RESTART=Y RQADDR=sinSelect14 REPLYQ=Y
sinInsert_server SRVGRP=GROUP13 SRVID=523 MIN=10 MAX=30 MAXGEN=10 GRACE=10 RESTART=Y RQADDR=sinInsert13 REPLYQ=Y
sinInsert_server SRVGRP=GROUP14 SRVID=564 MIN=10 MAX=30 MAXGEN=10 GRACE=10 RESTART=Y RQADDR=sinInsert14 REPLYQ=Y
sinDelete_server SRVGRP=GROUP13 SRVID=603 MIN=10 MAX=30 MAXGEN=10 GRACE=10 RESTART=Y RQADDR=sinDelete13 REPLYQ=Y
sinDelete_server SRVGRP=GROUP14 SRVID=644 MIN=10 MAX=30 MAXGEN=10 GRACE=10 RESTART=Y RQADDR=sinDelete14 REPLYQ=Y
sinDdl_server SRVGRP=GROUP13 SRVID=703 MIN=5 MAX=30 MAXGEN=10 GRACE=10 RESTART=Y RQADDR=sinDdl13 REPLYQ=Y
sinDdl_server SRVGRP=GROUP14 SRVID=744 MIN=5 MAX=30 MAXGEN=10 GRACE=10 RESTART=Y RQADDR=sinDdl14 REPLYQ=Y
lockselect_server SRVGRP=GROUP13 SRVID=803 MIN=10 MAX=30 MAXGEN=10 GRACE=10 RESTART=Y RQADDR=lockselect13 REPLYQ=Y
lockselect_server SRVGRP=GROUP14 SRVID=844 MIN=10 MAX=30 MAXGEN=10 GRACE=10 RESTART=Y RQADDR=lockselect14 REPLYQ=Y
#mulup_server SRVGRP=GROUP13 SRVID=13 MIN=2 MAX=30 MAXGEN=10 GRACE=10 RESTART=Y RQADDR=mulup13 REPLYQ=Y
#mulup_server SRVGRP=GROUP14 SRVID=64 MIN=2 MAX=30 MAXGEN=10 GRACE=10 RESTART=Y RQADDR=mulup14 REPLYQ=Y
WSL SRVGRP=GROUP11 SRVID=1000
CLOPT="-A -- -n//120.3.8.237:7200 -I 60 -T 60 -w WSH -m 50 -M 100 -x 6 -N 3600"
WSL SRVGRP=GROUP12 SRVID=1001
CLOPT="-A -- -n//120.3.8.238:7200 -I 60 -T 60 -w WSH -m 50 -M 100 -x 6 -N 3600"
WSL SRVGRP=GROUP13 SRVID=1003
CLOPT="-A -- -n//120.3.8.237:7203 -I 60 -T 60 -w WSH -m 50 -M 100 -x 6 -N 3600"
WSL SRVGRP=GROUP14 SRVID=1004
CLOPT="-A -- -n//120.3.8.238:7204 -I 60 -T 60 -w WSH -m 50 -M 100 -x 6 -N 3600"
about above ubb file ,has any error ? or not correct use MSSQ
look forward to you answer,thanks.

Domain migration of Oracle RAC nodes on windows 2008

Hello masters,
We are planning to migrate servers from old domain to a new domain due to company name change. That is, our DB servers named like db-node-x.old-domain.com will be migrated to db-node-x.new-domain.com. The servers are all on Windows 2008 R2 and Oracle RAC 11g2. As dba, i have no idea about what will happen to DBs. Please let me know any possible solutions?
Thanks in advance.

user2033016 wrote:
Hi Everyone,
I installed Oracle RAC 11g on Windows 2008 64 bit, The installation was successfull crs_state -t executed successfully.
Bt the machine got crashed ,when executed a select query with 100 sessions( For performance evaluation using TG). A blue screen is appeared on two nodes. So i am not able to evaluate the performance.
Can you please tell any suggesstions to solve this issue? Is our hardware is not sufficient? Or any software settings has to be done?. I tried most of hte technique ,bt the problem still exists.
The following machine configuration is used for Oracle RAC setup
Intel Core 2 Duo 2.66 GHz,
Ram :4GB.
OS : windows 2008 Server 64 Bit
Oracle RAC , Clusterware 11g R2 64 Bit.i guess you have installed/configured RAC using VMware. i guess, the problem is with your RAM size. how much disk space and RAM size you have allocated for each machine?
which documentation you have followed?

Oracle RAC Nodes getting reboot in case of preferred controller failed

When we are disconnecting both Fiber cable from preferred Controller A or plugging out Controller A card from Disk Array(IBM DS 4300), After 90 seconds both the servers are rebooting.
In this time complete RAC network is going out of service for approx 5 minutes.After reboot both servers are coming with both instances without any manual intervention
Its a critical issue for us because we are loosing High Availability, Let us know how we can resolve this critical issue.
Detail of Network:
1. Software- Oracle 10g Release2
2. OS- Redhat Linux 3 (Kernel Version-2.4.21-27.ELsmp)
3. Shared Storage- IBM DS 4300.
4. Multipathing Driver - RDAC (rdac-LINUX-09.00 A5.13)
4. Nodes- IBM 346
5. Databse on ASM
6. ASM,OCR & Voting Disk Preferred controller is A.
7. Hangcheck timer value is 210 seconds.
8. Both Server available with 2 HBA port . I HBA port is connected with Controller A and Seconfd HBA port is connected with Controller B of SAN Disk Array.
As per my understanding,
Voting disk resides in Disk Array and Controller A is preferred owner of Voting Disk LUN.. When i am disconnecting both fiber cable from preferred controller A , then Both Nodes Clusterware software trying to contact with Voting Disk, When they are unable to contact with Voting disk in specfic time period, they are going for reboot.
I tested Controller failure testing with Oracle RAC software as well without Oracle. Without Oracle its working fine and reason behind, in that time Disk Array is waiting for approx 300 seconds for changing preferred controlller from A to B.
But With Oracle, Clusterware Software reboot both nodes before Controller can shift from A to B.
So if i conclude,the tech who has good understanding of Oracle Clusterware on Linux OS & IBM RDAC multipath driver can help me.
when we install Oracle RAC on Linux, it is required to configure hangcheck timer.
Oracle recomends 180 second.
It means if one of node is hanging, then second node will wait for 180 seconds, if within 180 seconds ,it is not able to resolve this situation then it will reboot hung node.
I think Hangcheck timer configuration reuired only with Linux OS.
Configuration File
cat >> /etc/rc.d/rc.local << EOF
modprobe hangcheck-timer hangcheck_tick=15 hangcheck_margin=60

Sorry
Hangcheck timer is
Configuration File
cat >> /etc/rc.d/rc.local << EOF
modprobe hangcheck-timer hangcheck_tick=30 hangcheck_margin=180

Oracle Rac Node 1 , Node 2

*Hi All ,
I need to ask about RAC :
I have Oracle RAC ( Node1,Node2) When i check The performance For both nodes , the all load Goes to node 1 without anything happened on node 2 , as i know the the load must be equal on the both Nodes ( node1 , node2 ).
How Can i do this ? to make the load for both nodes equal.
Thank you very much.*

Thank you Guys
My Load balance Configuration like the following :
Node 1 "tnsname":
MARKADB_SRV =
(DESCRIPTION =
(ADDRESS = (PROTOCOL = TCP)(HOST = 172.29.11.23)(PORT = 1521))
(ADDRESS = (PROTOCOL = TCP)(HOST = 172.29.11.22)(PORT = 1521))
(LOAD_BALANCE = yes)
(CONNECT_DATA =
(SERVER = DEDICATED)
(SERVICE_NAME = markadb_srv)
(FAILOVER_MODE =
(TYPE = SELECT)
(METHOD = BASIC)
(RETRIES = 180)
(DELAY = 5)
Node 1 "Listener"
LISTENER_MARKADB1 =
(DESCRIPTION_LIST =
(DESCRIPTION =
(ADDRESS = (PROTOCOL = TCP)(HOST = 172.29.11.22)(PORT = 1521))
(DESCRIPTION =
(ADDRESS = (PROTOCOL = TCP)(HOST = 172.29.11.20)(PORT = 1521))
Node 2 "Tnsname" :
MARKADB_SRV =
(DESCRIPTION =
(ADDRESS = (PROTOCOL = TCP)(HOST = 172.29.11.22)(PORT = 1521))
(ADDRESS = (PROTOCOL = TCP)(HOST = 172.29.11.23)(PORT = 1521))
(LOAD_BALANCE = yes)
(CONNECT_DATA =
(SERVER = DEDICATED)
(SERVICE_NAME = markadb_srv)
(FAILOVER_MODE =
(TYPE = SELECT)
(METHOD = BASIC)
(RETRIES = 180)
(DELAY = 5)
Node 2 "Listener"
LISTENER_MARKADB2 =
(DESCRIPTION_LIST =
(DESCRIPTION =
(ADDRESS = (PROTOCOL = TCP)(HOST = 172.29.11.23)(PORT = 1521))
(DESCRIPTION =
(ADDRESS = (PROTOCOL = TCP)(HOST = 172.29.11.21)(PORT = 1521))
But all traffic goes to node 1 , and when node 1 goes down its not converting to node 2 as we all know but to another site /Failover ( I got Oracle Stream )
Any Solution Guys ?

Delete oracle RAC node - still appear on addNode script

Hello ,
I delete one from oracle RAC have 3 node .
I try to re-install it again but it give me below error :
The following error was encountered for new node . the node names rac3 are unique ...
it still appear on add node ! why ?
[oracle@rac1 dev]$ /u01/crs/oracle/product/10.2.0/crs/bin/crs_stat -t
Name           Type           Target    State     Host
ora....C1.inst application    ONLINE    OFFLINE
ora....C2.inst application    ONLINE    OFFLINE
ora.RAC.db     application    ONLINE    OFFLINE
ora....SM1.asm application    ONLINE    ONLINE    rac1
ora....C1.lsnr application    ONLINE    OFFLINE
ora.rac1.gsd   application    ONLINE    OFFLINE
ora.rac1.ons   application    ONLINE    ONLINE    rac1
ora.rac1.vip   application    ONLINE    ONLINE    rac1
ora....SM2.asm application    ONLINE    OFFLINE
ora....C2.lsnr application    ONLINE    OFFLINE
ora.rac2.gsd   application    ONLINE    OFFLINE
ora.rac2.ons   application    ONLINE    OFFLINE
ora.rac2.vip   application    ONLINE    ONLINE    rac1
Can you help please how to solve this issue ?
Thanks

Hello ,
Finally done
/u01/crs/oracle/product/10.2.0/crs/install/rootdeletenode.sh rac3,3
/u01/crs/oracle/product/10.2.0/crs/bin/olsnodes -n now it done appear
but still same error appear .......
so after
/u01/crs/oracle/product/10.2.0/crs/oui/bin/runInstaller -updateNodelist ORACLE_HOME=/u01/crs/oracle/product/10.2.0/crs/ "CLUSTER_NODES={rac1,rac2}" CRS=true
445 locate racgons
446 /u01/crs/oracle/product/10.2.0/crs/bin/racgons remove_config rac3
Regards,
Mohanad Awad

ORA-12514 on R12 EBS Apps server when 1 DB RAC node crashed/down

Just now Production 11.2.0.2 RAC DB on windows 2008 server Node1 crashed. While on Node 2 all services are up and running including database. But from EBS R12.1.2 application server when connecting as username/password from sql*plus is throwing ORA-12514 error.
While It is connecting if I give username/password@TNSNAME but not without @TNSNAME. Due to this none of the application services are starting.
Please help/advise. Thank you.
Following is the tnsnames.ora,
# This file is automatically generated by AutoConfig. It will be read and
# overwritten. If you were instructed to edit this file, or if you are not
# able to use the settings created by AutoConfig, refer to Metalink Note
# 387859.1 for assistance.
#$Header: NetServiceHandler.java 120.19.12010000.6 2010/03/09 08:11:36 jmajumde ship $
ORCL=
        (DESCRIPTION=
                (ADDRESS=(PROTOCOL=tcp)(HOST=orcldbscan)(PORT=1521))
            (CONNECT_DATA=
                (SERVICE_NAME=ORCL)
                (INSTANCE_NAME=ORCL1)
ORCL1=
        (DESCRIPTION=
                (ADDRESS=(PROTOCOL=tcp)(HOST=orcldbscan)(PORT=1521))
            (CONNECT_DATA=
                (SERVICE_NAME=ORCL)
                (INSTANCE_NAME=ORCL1)
ORCL1_FO=
        (DESCRIPTION=
                (ADDRESS=(PROTOCOL=tcp)(HOST=orcldbscan)(PORT=1521))
            (CONNECT_DATA=
                (SERVICE_NAME=ORCL)
                (INSTANCE_NAME=ORCL1)
ORCL_FO=
        (DESCRIPTION=
                (ADDRESS=(PROTOCOL=tcp)(HOST=orcldbscan)(PORT=1521))
            (CONNECT_DATA=
                (SERVICE_NAME=ORCL)
                (INSTANCE_NAME=ORCL1)
ORCL1=
        (DESCRIPTION=
                (ADDRESS=(PROTOCOL=tcp)(HOST=orcldbscan)(PORT=1521))
            (CONNECT_DATA=
                (SERVICE_NAME=ORCL)
                (INSTANCE_NAME=ORCL1)
ORCL1_FO=
        (DESCRIPTION=
                (ADDRESS=(PROTOCOL=tcp)(HOST=orcldbscan)(PORT=1521))
            (CONNECT_DATA=
                (SERVICE_NAME=ORCL)
                (INSTANCE_NAME=ORCL1)
ORCL2=
        (DESCRIPTION=
                (ADDRESS=(PROTOCOL=tcp)(HOST=orcldb2-vip.sa.company.net)(PORT=1521))
            (CONNECT_DATA=
                (SERVICE_NAME=ORCL)
                (INSTANCE_NAME=ORCL2)
ORCL2_FO=
        (DESCRIPTION=
                (ADDRESS=(PROTOCOL=tcp)(HOST=orcldb2-vip.sa.company.net)(PORT=1521))
            (CONNECT_DATA=
                (SERVICE_NAME=ORCL)
                (INSTANCE_NAME=ORCL2)
ORCL_BALANCE=
        (DESCRIPTION=
            (ADDRESS_LIST=
                (LOAD_BALANCE=YES)
                (FAILOVER=YES)
                (ADDRESS=(PROTOCOL=tcp)(HOST=orcldb1-vip.sa.company.net)(PORT=1521))
                (ADDRESS=(PROTOCOL=tcp)(HOST=orcldb2-vip.sa.company.net)(PORT=1521))
            (CONNECT_DATA=
                (SERVICE_NAME=ORCL)
FNDFS_orclAPPL=
        (DESCRIPTION=
                (ADDRESS=(PROTOCOL=tcp)(HOST=orclAPPL.sa.company.net)(PORT=1626))
            (CONNECT_DATA=
                (SID=FNDFS)
FNDFS_orclAPPL.sa.company.net=
        (DESCRIPTION=
                (ADDRESS=(PROTOCOL=tcp)(HOST=orclAPPL.sa.company.net)(PORT=1626))
            (CONNECT_DATA=
                (SID=FNDFS)
FNDFS_ORCL_orclAPPL=
        (DESCRIPTION=
                (ADDRESS=(PROTOCOL=tcp)(HOST=orclAPPL.sa.company.net)(PORT=1626))
            (CONNECT_DATA=
                (SID=FNDFS)
FNDFS_ORCL_orclAPPL.sa.company.net=
        (DESCRIPTION=
                (ADDRESS=(PROTOCOL=tcp)(HOST=orclAPPL.sa.company.net)(PORT=1626))
            (CONNECT_DATA=
                (SID=FNDFS)
FNDSM_orclAPPL_ORCL=
        (DESCRIPTION=
                (ADDRESS=(PROTOCOL=tcp)(HOST=orclAPPL.sa.company.net)(PORT=1626))
            (CONNECT_DATA=
                (SID=FNDSM)
FNDSM_orclAPPL.sa.company.net_ORCL=
        (DESCRIPTION=
                (ADDRESS=(PROTOCOL=tcp)(HOST=orclAPPL.sa.company.net)(PORT=1626))
            (CONNECT_DATA=
                (SID=FNDSM)
FNDFS_APPLTOP_orclappl=
        (DESCRIPTION=
            (ADDRESS_LIST=
                (ADDRESS=(PROTOCOL=tcp)(HOST=orclAPPL.sa.company.net)(PORT=1626))
            (CONNECT_DATA=
                (SID=FNDFS)
IFILE=E:\ORACLE\ORCL\INST\APPS\ORCL_orclappl\ora\10.1.2\network\admin\ORCL_orclappl_ifile.ora

A database/OS crash shouldn't have such impact on your configuration. Please review the following docs and verify your setup.
Using Oracle 11g Release 2 Real Application Clusters with Oracle E-Business Suite Release 12 (Doc ID 823587.1)
Configuring and Managing E-Business Application Tier for RAC (Doc ID 1311528.1)
Thanks,
Hussein

Rac node crash

Hi,
I am using 2 node rac enviroment.I am doing some tests for availability.When i poweroff one node of cluster the other node of cluster reboot itself. The voting disk is online. I think this is caused from network heartbeat of private network. So i wonder when one node of cluster goes down , does the other node have to reboot itself or not ?
Thanks.

Hi,
This is 10gr1 rac.I could not find alertlog.But taken log from ocssd logs from both nodes.I have rebooted node2 and node1 reboot itself.
Node2
CLSS-3001: local node number 2, master node number 1
2012-05-22 08:45:57.247 [773] >TRACE:   clssgmClientConnectMsg: Connect from con(111cdebb0), proc(111ce38b0) pid()
2012-05-22 08:45:57.247 [773] >TRACE:   clssgmClientConnectMsg: Connect from con(111ce1650), proc(111ce3b70) pid()
2012-05-22 08:47:20.865 [773] >TRACE:   clsc_receive: (111ce0e10) Connection failed, transport error (507, 0, 0)
2012-05-22 08:47:20.865 [773] >TRACE:   clscreceive: (111ce1650) Physical connection (111ce0e10) not active, rc 11
2012-05-22 08:47:20.865 [773] >TRACE:   clscreceive: (111ce3fb0) Physical connection (111ce0e10) not active, rc 11
2012-05-22 08:47:20.865 [773] >TRACE:   clssgmDeleteClientListener: cleanup for proc(111ce3b70) con(111ce1650) pid()
2012-05-22 08:47:20.879 [1287] >TRACE:   clscsendx: (111ce3fb0) Connection not active
2012-05-22 08:47:20.934 [773] >TRACE:   clsc_receive: (111cde370) Connection failed, transport error (507, 0, 0)
2012-05-22 08:47:20.934 [773] >TRACE:   clscreceive: (111cdebb0) Physical connection (111cde370) not active, rc 11
2012-05-22 08:47:20.934 [773] >TRACE:   clssgmDeleteClientListener: cleanup for proc(111ce38b0) con(111cdebb0) pid()
2012-05-22 08:47:51.100 [773] >TRACE:   clssgmClientConnectMsg: Connect from con(111cdebb0), proc(111ce0e10) pid()
Node1
CLSS-3001: local node number 1, master node number 1
2012-05-22 08:47:51.112 [516] >TRACE:   clsc_receive: (111ce6c50) Connection failed, transport error (507, 0, 0)
2012-05-22 08:47:51.112 [516] >WARNING: clssnmeventhndlr: Receive failure with node 2, rc=11
2012-05-22 08:47:51.112 [1287] >TRACE:   clsc_receive: (111bd8ab0) Connection failed, transport error (507, 0, 0)
2012-05-22 08:47:51.157 [1544] >WARNING: clssnmPollingThread: Eviction started for node 2, flags 0x0001, state 3, wt4c 0
2012-05-22 08:47:56.157 [1544] >TRACE:   clssnmDoSyncUpdate: Initiating sync 3
2012-05-22 08:47:56.157 [516] >TRACE:   clssnmHandleSync: Acknowledging sync: src[1] seq[9] sync[3]
2012-05-22 08:47:56.203 [1] >USER:    NMEVENT_SUSPEND [00][00][00][02]
2012-05-22 08:48:00.165 [1544] >TRACE:   clssnmEvict: Evicting node 2, birth 2, death 0, killme 1
2012-05-22 08:48:00.165 [1544] >TRACE:   clssnmWaitOnEvictions: Waiting for node 2 to die, missed HB 0 of 22503
2012-05-22 08:48:01.165 [1544] >TRACE:   clssnmWaitOnEvictions: Waiting for node 2 to die, missed HB 1 of 22503
2012-05-22 08:48:02.166 [1544] >TRACE:   clssnmWaitOnEvictions: Waiting for node 2 to die, missed HB 2 of 22503While node2 rebooting node1 has begun to reboot . Below log is OS log from node1
LABEL:          CORE_DUMP
IDENTIFIER:     C69F5C9B
Date/Time:       Tue May 22 08:48:05 2012
Sequence Number: 26098
Machine Id:      00C2F7704C00
Node Id:         kopstest1
Class:           S
Type:            PERM
Resource Name:   SYSPROC
Description
SOFTWARE PROGRAM ABNORMALLY TERMINATED
Probable Causes
SOFTWARE PROGRAM
User Causes
USER GENERATED SIGNAL
        Recommended Actions
        CORRECT THEN RETRY
Failure Causes
SOFTWARE PROGRAM
        Recommended Actions
        RERUN THE APPLICATION PROGRAM
        IF PROBLEM PERSISTS THEN DO THE FOLLOWING
        CONTACT APPROPRIATE SERVICE REPRESENTATIVE
Detail Data
SIGNAL NUMBER
           6
USER'S PROCESS ID:
                909402
FILE SYSTEM SERIAL NUMBER
          12
INODE NUMBER
      109027
CORE FILE NAME
/oracle/product/10.1.0/crs/css/init/core
PROGRAM NAME
ocssd.bin
STACK EXECUTION DISABLED
           0
COME FROM ADDRESS REGISTER
PROCESSOR ID
hw_fru_id: N/A
hw_cpu_id: N/A
ADDITIONAL INFORMATION
pthread_k 88
Symptom Data
REPORTABLE
1
INTERNAL ERROR
0
SYMPTOM CODE
PCSS/SPI2 FLDS/ocssd.bin SIG/6 FLDS/pthread_k VALU/88Thanks.
Edited by: ecer on May 21, 2012 11:11 PM

Oracle RAC node recovery

Hi,All,
Oracle 10.2.0.4 soalris 10 sun cluster. 2 nodes
Node 1's OS system and Oracle software was delete by mis-action.
how can I recovery Node 1 after re-install OS.
Thanks
Simon Lai

Nodes are not databases.
Instances are not databases.
Databases are recovered not memory processes and caches.

Oracle RAC 11g query

Hi All,
I am new to Oracle RAC 11g, facing a issue, Request all to help.
1) What is the instance id means which we get from gv$session in Oracle RAC setup?
2) What is differnce between Session failure and node failure?
3) If session fail, then client should connect to node1(to which session previously connected) or node2?
Thanks

1) What is the instance id means which we get from gv$session in Oracle RAC setup?Instance ID is unique for each instance in clustered database.
2) What is differnce between Session failure and node failure?Session Failure - when the connection to an instance is lost, SESSION failover results only in the establishment of a new connection to another Oracle RAC node
Node Failure/Eviction - we can say hardware fails, the Cluster Manager reports the change in the cluster's membership to Global Resource Directory (GRD)
Resource directory which consists of both Global enqueue service & cache service
3) If session fail, then client should connect to node1(to which session previously connected) or node2?You have to configure in SERVICE.

How to establish user equvalance between 2 rac nodes on non default ports??

Hi Friends,
Please shed some light on how to establish user equvalance between 2 rac nodes on non default ports such as ssh on 22...
i want to establish user equvalance on other ports..
Thanks
RB

R12DBA wrote:
Hi Friends,
Please shed some light on how to establish user equvalance between 2 rac nodes on non default ports such as ssh on 22...
i want to establish user equvalance on other ports..
Thanks
RBHi RB ,
22 is default port for ssh. For configuring
http://yasarmoran.wordpress.com/2010/06/12/configuring-ssh-on-oracle-rac-nodes/
For non default port , first of all you need to configure ssh on new port . For that refer :
http://www.itworld.com/nls_unixssh0500506

Oracle RAC 11g on Windows 2008 64 bit - blue screen error on both nodes

Hi Everyone,
I installed Oracle RAC 11g on Windows 2008 64 bit, The installation was successfull and crs_state -t shows all services in two nodes are online.
When executed a select query with 100 sessions( For performance evaluation using Transaction generator ) ,the machine got crashed and blue screen is appeared on two nodes. I restrated the machines and and starts the same evaluation ,bt the same bug is repeating.
Can anyone suggest a solution to solve this issue? Is our hardware is not sufficient ? Shall we need to perform any
specific settings in Oracle RAC setup for performance evaluations?
Is our settings for load balancing is not enough? ( We added "Load Balancing= On" on tnsnames.ora on client for load
balancing)
The following machine configuration is used for Oracle RAC setup
Intel Core 2 Duo 2.66 GHz,
Ram :4GB.
OS : windows 2008 Server 64 Bit
Oracle RAC 11g , Clusterware 11g R2 , ASM with 5 raw disk ( 1- votting disk ,1- ocr files and 3 disk files)
Edited by: user2033016 on Jun 29, 2011 10:02 PM

user2033016 wrote:
Hi Everyone,
I installed Oracle RAC 11g on Windows 2008 64 bit, The installation was successfull crs_state -t executed successfully.
Bt the machine got crashed ,when executed a select query with 100 sessions( For performance evaluation using TG). A blue screen is appeared on two nodes. So i am not able to evaluate the performance.
Can you please tell any suggesstions to solve this issue? Is our hardware is not sufficient? Or any software settings has to be done?. I tried most of hte technique ,bt the problem still exists.
The following machine configuration is used for Oracle RAC setup
Intel Core 2 Duo 2.66 GHz,
Ram :4GB.
OS : windows 2008 Server 64 Bit
Oracle RAC , Clusterware 11g R2 64 Bit.i guess you have installed/configured RAC using VMware. i guess, the problem is with your RAM size. how much disk space and RAM size you have allocated for each machine?
which documentation you have followed?

Oracle RAC 10.2G reboots node every 45 minutes

Hello:
- We have installed Oracle RAC 10.2G for Solaris X86 ( 64 bit ).
- On one node, there are no issues. But the other node ( I think )
is being rebooted by CRS every 45 minutes or so.
- Is this issue caused by some misconfiguration I did during the install ?
- Or is there a patch available to fix this ?
- Has anyone else encountered this problem ?
Thanks
jlem

Hello:
- I re-installed Oracle RAC. The nodes were only rebooted once so far.
So, the second install may be ok. If not, I have provided answers to the first email reply.
- Any help given is most welcome. In meantime, I will continue searching the oracle forums
for solutions.
- My environment is:
- both nodes are running under vmware ESX server version 3.0.1
- the shared storage for OCR and Voting Disk is a raw shared device under vmware
- both nodes are using Solaris X86 5.10 update 5
- Oracle version is: 10.2.0.3 ( patched from version 10.2.0.1 )
- My public network configuration is:
node 1:
e1000g0: flags=1000843<UP,BROADCAST,RUNNING,MULTICAST,IPv4> mtu 1500 index 2
inet 10.20.1.74 netmask ffff0000 broadcast 10.20.255.255
ether 0:c:29:3a:45:a9
e1000g0:1: flags=1000843<UP,BROADCAST,RUNNING,MULTICAST,IPv4> mtu 1500 index 2
inet 10.20.1.77 netmask ffff0000 broadcast 10.20.255.255
node 2:
e1000g0: flags=1000843<UP,BROADCAST,RUNNING,MULTICAST,IPv4> mtu 1500 index 2
inet 10.20.1.75 netmask ffff0000 broadcast 10.20.255.255
ether 0:c:29:2b:db:90
e1000g0:1: flags=1000843<UP,BROADCAST,RUNNING,MULTICAST,IPv4> mtu 1500 index 2
inet 10.20.1.78 netmask ffff0000 broadcast 10.20.255.255
- My private network configuration is:
node 1:
e1000g1: flags=1000843<UP,BROADCAST,RUNNING,MULTICAST,IPv4> mtu 1500 index 3
inet 192.168.0.1 netmask ffffff00 broadcast 192.168.0.255
ether 0:c:29:3a:45:b3
node 2:
e1000g1: flags=1000843<UP,BROADCAST,RUNNING,MULTICAST,IPv4> mtu 1500 index 3
inet 192.168.0.2 netmask ffffff00 broadcast 192.168.0.255
ether 0:c:29:2b:db:9a
- My storage solution is:
- 3 virtual shared SCSI hard disks ( each 500 MB in size )
- My log files are:
- /var/adm/messages
- doesn't report much only the following:
Nov 12 10:57:05 saucer nfs4cbd[328]: [ID 867284 daemon.notice] nfsv4 cannot determine local hostname binding for transport
tcp6 - delegations will not be available on this transport
Nov 12 10:57:21 saucer savecore: [ID 570001 auth.error] reboot after panic: forced crash dump initiated at user requestNov 12 10:57:21 saucer savecore: [ID 748169 auth.error] saving system crash dump in /var/crash/saucer/*.2Nov 12 10:57:41 saucer root: [ID 702911 user.error] Oracle Cluster Ready Services disabled by administrator.Nov 12 10:57:54 saucer rootnex: [ID 349649 kern.info] xsvc0 at rootNov 12 10:57:54 saucer genunix: [ID 936769 kern.info] xsvc0 is /xsvc
- ocssd.log file for node1 indicates that node2 was evicted for impeding a reconfig. Details are:
[    CSSD]2008-11-12 10:55:43.700 [15] >TRACE: clssnmPollingThread: node saucer (2) is impending reconfig
[    CSSD]2008-11-12 10:55:43.700 [15] >WARNING: clssnmPollingThread: node saucer (2) at 90% heartbeat fatal, eviction in 0
.973 seconds
[    CSSD]2008-11-12 10:55:44.679 [15] >TRACE: clssnmPollingThread: node saucer (2) is impending reconfig
[    CSSD]2008-11-12 10:55:44.679 [15] >TRACE: clssnmPollingThread: Eviction started for node saucer (2), flags 0x000d, s
tate 3, wt4c 0
[    CSSD]2008-11-12 10:55:44.690 [17] >TRACE: clssnmDoSyncUpdate: Initiating sync 3
[    CSSD]2008-11-12 10:55:44.690 [17] >TRACE: clssnmDoSyncUpdate: diskTimeout set to (27000)ms
[    CSSD]2008-11-12 10:55:44.691 [17] >TRACE: clssnmSetupAckWait: Ack message type (11)
[    CSSD]2008-11-12 10:55:44.691 [17] >TRACE: clssnmSetupAckWait: node(1) is ALIVE
[    CSSD]2008-11-12 10:55:44.691 [17] >TRACE: clssnmSetupAckWait: node(2) is ALIVE
[    CSSD]2008-11-12 10:55:44.691 [17] >TRACE: clssnmSendSync: syncSeqNo(3)
- node2 ocssd.log does not indicate the problem. See below for details:
[    CSSD]2008-11-12 10:52:34.731 [11] >TRACE: clssgmClientConnectMsg: Connect from con(da8410) proc(dab900) pid() proto(
10:2:1:1)
[    CSSD]2008-11-12 10:53:37.305 [11] >TRACE: clssgmClientConnectMsg: Connect from con(da8410) proc(dab900) pid() proto(
10:2:1:1)
[    CSSD]2008-11-12 10:54:40.515 [11] >TRACE: clssgmClientConnectMsg: Connect from con(da8410) proc(dab900) pid() proto(
10:2:1:1)
[    CSSD]2008-11-12 11:18:09.997 >USER: Oracle Database 10g CSS Release 10.2.0.3.0 Production Copyright 1996, 2004 Orac
le. All rights reserved.
[    CSSD]2008-11-12 11:18:09.997 >USER: CSS daemon log for node saucer, number 2, in cluster crs
[ clsdmt]Listening to (ADDRESS=(PROTOCOL=ipc)(KEY=saucerDBG_CSSD))
[    CSSD]2008-11-12 11:18:10.016 [1] >TRACE: clssscmain: local-only set to false
[    CSSD]2008-11-12 11:18:10.031 [1] >TRACE: clssnmReadNodeInfo: added node 1 (flying) to cluster
[    CSSD]2008-11-12 11:18:10.042 [1] >TRACE: clssnmReadNodeInfo: added node 2 (saucer) to cluster
[    CSSD]2008-11-12 11:18:10.057 [5] >TRACE: clssnm_skgxnmon: skgxn init failed
[    CSSD]2008-11-12 11:18:10.057 [1] >TRACE: clssnm_skgxnonline: Using vacuous skgxn monitor
- ORACLE VERIFY: cluvfy was run on node2 resulting with the following:
bash-3.00$ ./cluvfy comp ocr -n all -verbose
Verifying OCR integrity
Checking OCR integrity...
Checking the absence of a non-clustered configuration...
All nodes free of non-clustered, local-only configurations.
Uniqueness check for OCR device passed.
Checking the version of OCR...
OCR of correct Version "2" exists.
Checking data integrity of OCR...
Data integrity check for OCR passed.
OCR integrity check passed.
Verification of OCR integrity was successful.
bash-3.00$
Thanks
jlem

RAC -process failover at node crash

Hi,
how to prevent running process(transaction) from termination in RAC while a node crashes ..
Ex: if there is a process running on node 1 and if it suddenly crashes in RAC how does we make node2 or node3 to pick it up and process or start the transaction again??
Thanks,

Hello,
Look at your tnsnames.ora entry and see if it configured to benefit from FAILOVER, you can aslo explore other available options options
http://stanford.edu/dept/itss/docs/oracle/10g/network.101/b10776/tnsnames.htm
myservice=
(DESCRIPTION=
   (SOURCE_ROUTE=yes)
   (ADDRESS=(PROTOCOL=tcp)(HOST=host1)(PORT=1630))    # <-- hop 1
   (ADDRESS_LIST=
     (FAILOVER=on)
     (LOAD_BALANCE=off)                                # <--- hop 2
     (ADDRESS=(PROTOCOL=tcp)(HOST=host2a)(PORT=1532))
     (ADDRESS=(PROTOCOL=tcp)(HOST=host2b)(PORT=1521)))
   (ADDRESS=(PROTOCOL=tcp)(HOST=host3)(PORT=1521))    # <-- hop 3
   (CONNECT_DATA=(SERVICE_NAME=myservice)))Another Example
MYSERVICE =
(DESCRIPTION =
(ADDRESS_LIST=
     (FAILOVER = on)
     (LOAD_BALANCE = on)
     (ADDRESS= (PROTOCOL = TCP)(HOST = server1)(PORT = 1521))
     (ADDRESS= (PROTOCOL = TCP)(HOST = server2)(PORT = 1521))
     (ADDRESS= (PROTOCOL = TCP)(HOST = server3)(PORT = 1521))
(CONNECT_DATA=
     (SERVICE_NAME =MYSERVICE)
     (FAILOVER_MODE =
         (BACKUP=server2)
         (TYPE=select)
         (METHOD=preconnect)
         (RETRIES=20)
         (DELAY=3)
) Regards
OrionNet
Edited by: OrionNet on Dec 18, 2008 3:12 PM

Oracle RAC Node Crashing

Similar Messages

Maybe you are looking for