Oracle RAC node recovery

Hi,All,
Oracle 10.2.0.4 soalris 10 sun cluster. 2 nodes
Node 1's OS system and Oracle software was delete by mis-action.
how can I recovery Node 1 after re-install OS.
Thanks
Simon Lai

Nodes are not databases.
Instances are not databases.
Databases are recovered not memory processes and caches.

Similar Messages

  • Huge number of idle connections from loopback ip on oracle RAC node

    Hi,
    We have a 2node 11gR2(11.2.0.3) oracle RAC node. We are seeing huge number of idle connection(more than 5000 in each node) on both the nodes and increasing day by day. All the idle connections are from VIP and loopback address(127.0.0.1.47971 )
    netstat -an |grep -i idle|more
    127.0.0.1.47971 Idle
    any insight will be helpful.
    The server is suffering memory issues occasionally (once in a month).
    ORA-27300: OS system dependent operation:fork failed with status: 11
    ORA-27301: OS failure message: Resource temporarily unavailable
    Thanks

    user12959884 wrote:
    Hi,
    We have a 2node 11gR2(11.2.0.3) oracle RAC node. We are seeing huge number of idle connection(more than 5000 in each node) on both the nodes and increasing day by day. All the idle connections are from VIP and loopback address(127.0.0.1.47971 )
    netstat -an |grep -i idle|more
    127.0.0.1.47971 Idle
    any insight will be helpful.
    The server is suffering memory issues occasionally (once in a month).
    ORA-27300: OS system dependent operation:fork failed with status: 11
    ORA-27301: OS failure message: Resource temporarily unavailable
    Thankswe can not control what occurs on your DB Server.
    How do I ask a question on the forums?
    SQL and PL/SQL FAQ
    post results from following SQL
    SELECT * FROM V$VERSION;

  • If use MSSQ , when oracle rac node reboot, client get TPEOS error

    Hi, all
    in my tuxedo applicaton, if we use Single Server, Single Queue mode , when reboot any Oracle RAC node, our application is ok, client can get correct result. but if we use MSSQ(Multi Server, Single Queue) , if Oracle RAC node is ok , our application also is ok. but if we reboot any Oracle RAC node, client program can continue run, get correct result, but always get TPEOS error , for this situation, server can get client request, but client can not get server reply, only get TPEOS error.
    our enviroment is :
    oracle RAC ,10g 10.2.0.4 , two instances ,rac1 rac2, and two DTP services s1 and s2, set s1 and s2 services TAF is basic
    tuxedo 10R3 , two nodes ,work in MP model ,use XA access oracle rac database,services have Transaction and not Transaction
    OS is linux AS4 U5, 64bits
    service program use OCI
    can any one encounter this problem ?

    Hi, first thanks you
    in ULOG file , only have failover information, not any other error message, in client side also has no other error.
    not use MSSQ, ubb file about MSSQ config
    SERVERS
    DEFAULT:
    CLOPT="-A "
    sinUpdate_server SRVGRP=GROUP11 SRVID=80 MIN=10 MAX=30 MAXGEN=10 GRACE=10 RESTART=Y
    sinUpdate_server SRVGRP=GROUP12 SRVID=160 MIN=10 MAX=30 MAXGEN=10 GRACE=10 RESTART=Y
    sinCount_server SRVGRP=GROUP11 SRVID=240 MIN=10 MAX=30 MAXGEN=10 GRACE=10 RESTART=Y
    sinCount_server SRVGRP=GROUP12 SRVID=320 MIN=10 MAX=30 MAXGEN=10 GRACE=10 RESTART=Y
    sinSelect_server SRVGRP=GROUP11 SRVID=360 MIN=10 MAX=30 MAXGEN=10 GRACE=10 RESTART=Y
    sinSelect_server SRVGRP=GROUP12 SRVID=400 MIN=10 MAX=30 MAXGEN=10 GRACE=10 RESTART=Y
    sinInsert_server SRVGRP=GROUP11 SRVID=520 MIN=10 MAX=30 MAXGEN=10 GRACE=10 RESTART=Y
    sinInsert_server SRVGRP=GROUP12 SRVID=560 MIN=10 MAX=30 MAXGEN=10 GRACE=10 RESTART=Y
    sinDelete_server SRVGRP=GROUP11 SRVID=600 MIN=10 MAX=30 MAXGEN=10 GRACE=10 RESTART=Y
    sinDelete_server SRVGRP=GROUP12 SRVID=640 MIN=10 MAX=30 MAXGEN=10 GRACE=10 RESTART=Y
    sinDdl_server SRVGRP=GROUP11 SRVID=700 MIN=5 MAX=30 MAXGEN=10 GRACE=10 RESTART=Y
    sinDdl_server SRVGRP=GROUP12 SRVID=740 MIN=5 MAX=30 MAXGEN=10 GRACE=10 RESTART=Y
    lockselect_server SRVGRP=GROUP11 SRVID=800 MIN=10 MAX=30 MAXGEN=10 GRACE=10 RESTART=Y
    lockselect_server SRVGRP=GROUP12 SRVID=840 MIN=10 MAX=30 MAXGEN=10 GRACE=10 RESTART=Y
    #mulup_server SRVGRP=GROUP11 SRVID=1 MIN=2 MAX=30 MAXGEN=10 GRACE=10 RESTART=Y
    #mulup_server SRVGRP=GROUP12 SRVID=60 MIN=2 MAX=30 MAXGEN=10 GRACE=10 RESTART=Y
    sinUpdate_server SRVGRP=GROUP13 SRVID=83 MIN=10 MAX=30 MAXGEN=10 GRACE=10 RESTART=Y
    sinUpdate_server SRVGRP=GROUP14 SRVID=164 MIN=10 MAX=30 MAXGEN=10 GRACE=10 RESTART=Y
    sinCount_server SRVGRP=GROUP13 SRVID=243 MIN=10 MAX=30 MAXGEN=10 GRACE=10 RESTART=Y
    sinCount_server SRVGRP=GROUP14 SRVID=324 MIN=10 MAX=30 MAXGEN=10 GRACE=10 RESTART=Y
    sinSelect_server SRVGRP=GROUP13 SRVID=363 MIN=10 MAX=30 MAXGEN=10 GRACE=10 RESTART=Y
    sinSelect_server SRVGRP=GROUP14 SRVID=404 MIN=10 MAX=30 MAXGEN=10 GRACE=10 RESTART=Y
    sinInsert_server SRVGRP=GROUP13 SRVID=523 MIN=10 MAX=30 MAXGEN=10 GRACE=10 RESTART=Y
    sinInsert_server SRVGRP=GROUP14 SRVID=564 MIN=10 MAX=30 MAXGEN=10 GRACE=10 RESTART=Y
    sinDelete_server SRVGRP=GROUP13 SRVID=603 MIN=10 MAX=30 MAXGEN=10 GRACE=10 RESTART=Y
    sinDelete_server SRVGRP=GROUP14 SRVID=644 MIN=10 MAX=30 MAXGEN=10 GRACE=10 RESTART=Y
    sinDdl_server SRVGRP=GROUP13 SRVID=703 MIN=5 MAX=30 MAXGEN=10 GRACE=10 RESTART=Y
    sinDdl_server SRVGRP=GROUP14 SRVID=744 MIN=5 MAX=30 MAXGEN=10 GRACE=10 RESTART=Y
    lockselect_server SRVGRP=GROUP13 SRVID=803 MIN=10 MAX=30 MAXGEN=10 GRACE=10 RESTART=Y
    lockselect_server SRVGRP=GROUP14 SRVID=844 MIN=10 MAX=30 MAXGEN=10 GRACE=10 RESTART=Y
    #mulup_server SRVGRP=GROUP13 SRVID=13 MIN=2 MAX=30 MAXGEN=10 GRACE=10 RESTART=Y
    #mulup_server SRVGRP=GROUP14 SRVID=64 MIN=2 MAX=30 MAXGEN=10 GRACE=10 RESTART=Y
    WSL SRVGRP=GROUP11 SRVID=1000
    CLOPT="-A -- -n//120.3.8.237:7200 -I 60 -T 60 -w WSH -m 50 -M 100 -x 6 -N 3600"
    WSL SRVGRP=GROUP12 SRVID=1001
    CLOPT="-A -- -n//120.3.8.238:7200 -I 60 -T 60 -w WSH -m 50 -M 100 -x 6 -N 3600"
    WSL SRVGRP=GROUP13 SRVID=1003
    CLOPT="-A -- -n//120.3.8.237:7203 -I 60 -T 60 -w WSH -m 50 -M 100 -x 6 -N 3600"
    WSL SRVGRP=GROUP14 SRVID=1004
    CLOPT="-A -- -n//120.3.8.238:7204 -I 60 -T 60 -w WSH -m 50 -M 100 -x 6 -N 3600"
    if we use MSSQ ,ubb file about MSSQ config is
    *SERVERS
    DEFAULT:
    CLOPT="-A -p 1,60:1,30"
    sinUpdate_server SRVGRP=GROUP11 SRVID=80 MIN=10 MAX=30 MAXGEN=10 GRACE=10 RESTART=Y RQADDR=sinUpdate11 REPLYQ=Y
    sinUpdate_server SRVGRP=GROUP12 SRVID=160 MIN=10 MAX=30 MAXGEN=10 GRACE=10 RESTART=Y RQADDR=sinUpdate12 REPLYQ=Y
    sinCount_server SRVGRP=GROUP11 SRVID=240 MIN=10 MAX=30 MAXGEN=10 GRACE=10 RESTART=Y RQADDR=sinCount11 REPLYQ=Y
    sinCount_server SRVGRP=GROUP12 SRVID=320 MIN=10 MAX=30 MAXGEN=10 GRACE=10 RESTART=Y RQADDR=sinCount12 REPLYQ=Y
    sinSelect_server SRVGRP=GROUP11 SRVID=360 MIN=10 MAX=30 MAXGEN=10 GRACE=10 RESTART=Y RQADDR=sinSelec11 REPLYQ=Y
    sinSelect_server SRVGRP=GROUP12 SRVID=400 MIN=10 MAX=30 MAXGEN=10 GRACE=10 RESTART=Y RQADDR=sinSelect12 REPLYQ=Y
    sinInsert_server SRVGRP=GROUP11 SRVID=520 MIN=10 MAX=30 MAXGEN=10 GRACE=10 RESTART=Y RQADDR=sinInsert11 REPLYQ=Y
    sinInsert_server SRVGRP=GROUP12 SRVID=560 MIN=10 MAX=30 MAXGEN=10 GRACE=10 RESTART=Y RQADDR=sinInsert12 REPLYQ=Y
    sinDelete_server SRVGRP=GROUP11 SRVID=600 MIN=10 MAX=30 MAXGEN=10 GRACE=10 RESTART=Y RQADDR=sinDelete11 REPLYQ=Y
    sinDelete_server SRVGRP=GROUP12 SRVID=640 MIN=10 MAX=30 MAXGEN=10 GRACE=10 RESTART=Y RQADDR=sinDelete12 REPLYQ=Y
    sinDdl_server SRVGRP=GROUP11 SRVID=700 MIN=5 MAX=30 MAXGEN=10 GRACE=10 RESTART=Y RQADDR=sinDdl11 REPLYQ=Y
    sinDdl_server SRVGRP=GROUP12 SRVID=740 MIN=5 MAX=30 MAXGEN=10 GRACE=10 RESTART=Y RQADDR=sinDdl12 REPLYQ=Y
    lockselect_server SRVGRP=GROUP11 SRVID=800 MIN=10 MAX=30 MAXGEN=10 GRACE=10 RESTART=Y RQADDR=lockselect11 REPLYQ=Y
    lockselect_server SRVGRP=GROUP12 SRVID=840 MIN=10 MAX=30 MAXGEN=10 GRACE=10 RESTART=Y RQADDR=lockselect12 REPLYQ=Y
    #mulup_server SRVGRP=GROUP11 SRVID=1 MIN=2 MAX=30 MAXGEN=10 GRACE=10 RESTART=Y RQADDR=mulup11 REPLYQ=Y
    #mulup_server SRVGRP=GROUP12 SRVID=60 MIN=2 MAX=30 MAXGEN=10 GRACE=10 RESTART=Y RQADDR=mulup12 REPLYQ=Y
    sinUpdate_server SRVGRP=GROUP13 SRVID=83 MIN=10 MAX=30 MAXGEN=10 GRACE=10 RESTART=Y RQADDR=sinUpdate13 REPLYQ=Y
    sinUpdate_server SRVGRP=GROUP14 SRVID=164 MIN=10 MAX=30 MAXGEN=10 GRACE=10 RESTART=Y RQADDR=sinUpdate14 REPLYQ=Y
    sinCount_server SRVGRP=GROUP13 SRVID=243 MIN=10 MAX=30 MAXGEN=10 GRACE=10 RESTART=Y RQADDR=sinCount13 REPLYQ=Y
    sinCount_server SRVGRP=GROUP14 SRVID=324 MIN=10 MAX=30 MAXGEN=10 GRACE=10 RESTART=Y RQADDR=sinCount14 REPLYQ=Y
    sinSelect_server SRVGRP=GROUP13 SRVID=363 MIN=10 MAX=30 MAXGEN=10 GRACE=10 RESTART=Y RQADDR=sinSelec13 REPLYQ=Y
    sinSelect_server SRVGRP=GROUP14 SRVID=404 MIN=10 MAX=30 MAXGEN=10 GRACE=10 RESTART=Y RQADDR=sinSelect14 REPLYQ=Y
    sinInsert_server SRVGRP=GROUP13 SRVID=523 MIN=10 MAX=30 MAXGEN=10 GRACE=10 RESTART=Y RQADDR=sinInsert13 REPLYQ=Y
    sinInsert_server SRVGRP=GROUP14 SRVID=564 MIN=10 MAX=30 MAXGEN=10 GRACE=10 RESTART=Y RQADDR=sinInsert14 REPLYQ=Y
    sinDelete_server SRVGRP=GROUP13 SRVID=603 MIN=10 MAX=30 MAXGEN=10 GRACE=10 RESTART=Y RQADDR=sinDelete13 REPLYQ=Y
    sinDelete_server SRVGRP=GROUP14 SRVID=644 MIN=10 MAX=30 MAXGEN=10 GRACE=10 RESTART=Y RQADDR=sinDelete14 REPLYQ=Y
    sinDdl_server SRVGRP=GROUP13 SRVID=703 MIN=5 MAX=30 MAXGEN=10 GRACE=10 RESTART=Y RQADDR=sinDdl13 REPLYQ=Y
    sinDdl_server SRVGRP=GROUP14 SRVID=744 MIN=5 MAX=30 MAXGEN=10 GRACE=10 RESTART=Y RQADDR=sinDdl14 REPLYQ=Y
    lockselect_server SRVGRP=GROUP13 SRVID=803 MIN=10 MAX=30 MAXGEN=10 GRACE=10 RESTART=Y RQADDR=lockselect13 REPLYQ=Y
    lockselect_server SRVGRP=GROUP14 SRVID=844 MIN=10 MAX=30 MAXGEN=10 GRACE=10 RESTART=Y RQADDR=lockselect14 REPLYQ=Y
    #mulup_server SRVGRP=GROUP13 SRVID=13 MIN=2 MAX=30 MAXGEN=10 GRACE=10 RESTART=Y RQADDR=mulup13 REPLYQ=Y
    #mulup_server SRVGRP=GROUP14 SRVID=64 MIN=2 MAX=30 MAXGEN=10 GRACE=10 RESTART=Y RQADDR=mulup14 REPLYQ=Y
    WSL SRVGRP=GROUP11 SRVID=1000
    CLOPT="-A -- -n//120.3.8.237:7200 -I 60 -T 60 -w WSH -m 50 -M 100 -x 6 -N 3600"
    WSL SRVGRP=GROUP12 SRVID=1001
    CLOPT="-A -- -n//120.3.8.238:7200 -I 60 -T 60 -w WSH -m 50 -M 100 -x 6 -N 3600"
    WSL SRVGRP=GROUP13 SRVID=1003
    CLOPT="-A -- -n//120.3.8.237:7203 -I 60 -T 60 -w WSH -m 50 -M 100 -x 6 -N 3600"
    WSL SRVGRP=GROUP14 SRVID=1004
    CLOPT="-A -- -n//120.3.8.238:7204 -I 60 -T 60 -w WSH -m 50 -M 100 -x 6 -N 3600"
    about above ubb file ,has any error ? or not correct use MSSQ
    look forward to you answer,thanks.

  • Oracle RAC Nodes getting reboot in case of preferred controller failed

    When we are disconnecting both Fiber cable from preferred Controller A or plugging out Controller A card from Disk Array(IBM DS 4300), After 90 seconds both the servers are rebooting.
    In this time complete RAC network is going out of service for approx 5 minutes.After reboot both servers are coming with both instances without any manual intervention
    It’s a critical issue for us because we are loosing High Availability, Let us know how we can resolve this critical issue.
    Detail of Network:
    1. Software- Oracle 10g Release2
    2. OS- Redhat Linux 3 (Kernel Version-2.4.21-27.ELsmp)
    3. Shared Storage- IBM DS 4300.
    4. Multipathing Driver - RDAC (rdac-LINUX-09.00 A5.13)
    4. Nodes- IBM 346
    5. Databse on ASM
    6. ASM,OCR & Voting Disk Preferred controller is A.
    7. Hangcheck timer value is 210 seconds.
    8. Both Server available with 2 HBA port . I HBA port is connected with Controller A and Seconfd HBA port is connected with Controller B of SAN Disk Array.
    As per my understanding,
    Voting disk resides in Disk Array and Controller A is preferred owner of Voting Disk LUN.. When i am disconnecting both fiber cable from preferred controller A , then Both Nodes Clusterware software trying to contact with Voting Disk, When they are unable to contact with Voting disk in specfic time period, they are going for reboot.
    I tested Controller failure testing with Oracle RAC software as well without Oracle. Without Oracle its working fine and reason behind, in that time Disk Array is waiting for approx 300 seconds for changing preferred controlller from A to B.
    But With Oracle, Clusterware Software reboot both nodes before Controller can shift from A to B.
    So if i conclude,the tech who has good understanding of Oracle Clusterware on Linux OS & IBM RDAC multipath driver can help me.
    when we install Oracle RAC on Linux, it is required to configure hangcheck timer.
    Oracle recomends 180 second.
    It means if one of node is hanging, then second node will wait for 180 seconds, if within 180 seconds ,it is not able to resolve this situation then it will reboot hung node.
    I think Hangcheck timer configuration reuired only with Linux OS.
    Configuration File
    cat >> /etc/rc.d/rc.local << EOF
    modprobe hangcheck-timer hangcheck_tick=15 hangcheck_margin=60

    Sorry
    Hangcheck timer is
    Configuration File
    cat >> /etc/rc.d/rc.local << EOF
    modprobe hangcheck-timer hangcheck_tick=30 hangcheck_margin=180

  • Domain migration of Oracle RAC nodes on windows 2008

    Hello masters,
    We are planning to migrate servers from old domain to a new domain due to company name change. That is, our DB servers named like db-node-x.old-domain.com will be migrated to db-node-x.new-domain.com. The servers are all on Windows 2008 R2 and Oracle RAC 11g2. As dba, i have no idea about what will happen to DBs. Please let me know any possible solutions?
    Thanks in advance.

    user2033016 wrote:
    Hi Everyone,
    I installed Oracle RAC 11g on Windows 2008 64 bit, The installation was successfull crs_state -t executed successfully.
    Bt the machine got crashed ,when executed a select query with 100 sessions( For performance evaluation using TG). A blue screen is appeared on two nodes. So i am not able to evaluate the performance.
    Can you please tell any suggesstions to solve this issue? Is our hardware is not sufficient? Or any software settings has to be done?. I tried most of hte technique ,bt the problem still exists.
    The following machine configuration is used for Oracle RAC setup
    Intel Core 2 Duo 2.66 GHz,
    Ram :4GB.
    OS : windows 2008 Server 64 Bit
    Oracle RAC , Clusterware 11g R2 64 Bit.i guess you have installed/configured RAC using VMware. i guess, the problem is with your RAM size. how much disk space and RAM size you have allocated for each machine?
    which documentation you have followed?

  • Oracle RAC Node Crashing

    Hi,
    We recently upgraded to Oracle RAC database to support Siebel Call Center APplication (8.1.1.11.12 [IP2013]).Oracle Database 11g Enterprise Edition Release 11.2.0.3.0 - 64bit Production
    Frequently we are facing problem of crashing with the Nodes in RAC (Kernal Panic). Due to this users using siebel application are unstable and facing multiple issues Once we restore Siebel Gateway and restart of AOM server fixing the issue.
    Below are the SQL's and Crashing Signature we are seeing du to this crash.
    DBCLog DBCLogError 1 00081f1254bb0ad4:1423830 2015-01-18 11:49:20 OCIStmtExecute: SELECT
    T2.CONFLICT_ID,
    T2.LAST_UPD,
    T2.CREATED,
    T2.LAST_UPD_BY,
    T2.CREATED_BY,
    T2.MODIFICATION_NUM,
    T2.ROW_ID,
    T2.EFF_START_TS,
    T2.EFF_END_TS,
    T2.NAME,
    T2.BUSOBJ_NAME,
    T2.VERSION,
    T2.DEPLOY_STATUS_CD,
    T2.MODE_CD
    FROM
    SIEBEL.S_LST_OF_VAL T1,
    SIEBEL.S_WFA_DPLOY_DEF T2
    WHERE
    T2.DEPLOY_STATUS_CD = T1.NAME AND T1.TYPE = 'WFA_DPLY_STAT_CD' AND T1.LANG_ID = :1 AND
    (T2.TYPE_CD IN ( :2 )) AND
    (T2.NAME = :3 AND T2.DEPLOY_STATUS_CD IN ( :4 ) AND (T2.EFF_END_TS > TO_DATE(:5,'MM/DD/YYYY HH24:MI:SS') OR T2.EFF_END_TS IS NULL))
    ORDER BY
    T2.NAME, T1.VAL
    ObjMgrLog Error 1 00081f1254bb0ad4:1423830 2015-01-18 11:49:20 (oracon.cpp (3896)) SBL-DBC-00105: An error has occurred executing a Sql statement.
    Please continue or ask your systems administrator to check your application configuration if the problem persists.
    and Crash Signature Looks like below
    Exception 0xc0000005 at 0x006500f6
    Thread: 0x00002700, Process 0x00000254
    Thread: 9984, Process 596
    - CONTEXT -
    EIP: 0x00000000, EFL: 0x00010246, FS:  0x0000003b, GS:  0x00000000
    CS:  0x0000001b, DS:  0x00000023, SS:  0x00000023, ES:  0x00000023
    EAX: 0x1a511968, EBX: 0x294ca048, ECX: 0x4cc50008, EDX: 0x3a2ad200
    ESI: 0x4cc50008, EDI: 0x00000000, EBP: 0x00000000, ESP: 0x3a2afff4
    - CALL STACK -
    sslcscr +0xf6
    sscfcmn +0x19050 = CSSObjectBase::CopyErrorMsg() +0xf0
    sscfcmn +0x1950d = CSSObjectBase::DoSetErrorMsg() +0x13d
    sscfcmn +0x19bb5 = CSSObjectBase::SetErrorMsg() +0xa5
    SSFACMBC +0x34a6 = CSSFABCVRec::IsBusinessProcessActive() +0x3b6
    SSFACMBC +0x5133 = CSSFABCVRec::VBCCreate() +0x1e3
    sscfom +0x71d1e = CSSBCVRec::SqlCreate() +0xde
    sscfom +0x4aea = CSSModel::ConstructBusComp() +0xaa
    sscfom +0x653f5 = CSSBusObj::GetBusComp() +0x265
    sscfom +0x65a18 = CSSBusObj::GetBusComp() +0x18
    sscfom +0x13ad8 = CSSModel::BeginSetupView() +0x418
    sscfom +0x13dee = CSSModel::BeginSetupView() +0x5e
    sscaswbc +0x8b070 = CSSSWEUdfLoader::BeginSetupView() +0x30
    sscaswbc +0xe3d88 = CSSSWEFrameMgrInternal::BuildView() +0x1618
    sscaswbc +0xe5646 = CSSSWEFrameMgrInternal::BuildView() +0x36
    sscaswbc +0xb8343 = CSSSWEActionMgr::ActionBuildViewAsync() +0x293
    sscaswbc +0xb873b = CSSSWEActionMgr::DoPostedAction() +0xab
    sscaswbc +0xb9287 = CSSSWEActionMgr::CheckPostedActions() +0x3d7
    sscaswbc +0xe6d41 = CSSSWEFrameMgrInternal::InvokeAppletMethod() +0x11b1
    sscaswbc +0xbbcdc = CSSSWECmdProcessor::InvokeMethod() +0x74c
    sscaswbc +0xc1495 = CSSSWECmdProcessor::_ProcessCommand() +0x725
    sscaswbc +0xc27f8 = CSSSWECmdProcessor::ProcessCommand() +0xab8
    sscaswbc +0xc2d04 = CSSSWECmdProcessor::ProcessCommand() +0xc4
    sscaswbc +0x265559 = CSSServiceSWEIface::Request() +0x309
    sscaswbc +0x267391 = CSSServiceSWEIface::DoInvokeMethod() +0xed1
    sscfom +0x1976c = CSSService::InvokeMethod() +0x24c
    sstcsiom +0x6d6a = CSSSIOMSession::ModInvokeSrvcMethod() +0x10a
    sstcsiom +0x7613 = CSSSIOMSession::RPCMiscModel() +0x513
    sstcsiom +0xe9dd = CSSSIOMSession::HandleRPC() +0x3ad
    sssasos +0x6616 = CompCleanup() +0x3be6
    sssasos +0x5a95 = CompCleanup() +0x3065
    sssasos +0x1a35 = CSSSISObject::operator=() +0x9f5
    sssasos +0x2135 = CompHandleMsg() +0x485
    siebmtshmw +0x494e
    siebmtshmw +0x20051 = GetSmiTaskAPI() +0x6d21
    siebmtshmw +0x239d1 = SmiInProcMsgHandler() +0x2051
    siebmtshmw +0x15f15 = SmiBeginTrace() +0x3195
    siebmtshmw +0x174cf = GetSmiWorkQObj() +0x148f
    siebmtshmw +0xc7f7 = SmiCleanupDetTask() +0x3be7
    sslcosd +0x2152 = OSDThreadPrivIsInit() +0x1d2
    sslcosd +0x21dc = OSDThreadPrivIsInit() +0x25c
    MSVCR71 +0x9565 = endthreadex() +0xa0
    kernel32 +0x2484f = GetModuleHandleA() +0xdf
    - STACK DUMP -
    - MODULE LIST -
    00400000-00445000: C:\siebel\siebsrvr\BIN\siebmtshmw.exe, 811.11.822.4
    7c800000-7c8c3000: C:\WINDOWS\system32\ntdll.dll, 5.2.3790.4937
    77e40000-77f44000: C:\WINDOWS\system32\kernel32.dll, 5.2.3790.5295
    10000000-10025000: C:\siebel\siebsrvr\BIN\ssscsci.dll, 811.11.822.4
    00320000-003cc000: C:\siebel\siebsrvr\BIN\ssscscf.dll, 811.11.822.4
    003d0000-003d7000: C:\siebel\siebsrvr\BIN\sslcosa.dll, 811.11.822.4
    7c340000-7c396000: C:\siebel\siebsrvr\BIN\MSVCR71.dll, 7.10.3052.4
    00450000-0054d000: C:\siebel\siebsrvr\BIN\sslcshar.dll, 811.11.822.4
    77380000-77411000: C:\WINDOWS\system32\USER32.dll, 5.2.3790.4033
    77c00000-77c49000: C:\WINDOWS\system32\GDI32.dll, 5.2.3790.5398
    7d1e0000-7d27c000: C:\WINDOWS\system32\ADVAPI32.dll, 5.2.3790.4455
    77c50000-77cf1000: C:\WINDOWS\system32\RPCRT4.dll, 5.2.3790.5254
    76f50000-76f63000: C:\WINDOWS\system32\Secur32.dll, 5.2.3790.4455
    77b90000-77b98000: C:\WINDOWS\system32\VERSION.dll, 5.2.3790.3959
    77ba0000-77bfa000: C:\WINDOWS\system32\msvcrt.dll, 7.0.3790.3959
    71bb0000-71bb9000: C:\WINDOWS\system32\WSOCK32.dll, 5.2.3790.0
    71c00000-71c17000: C:\WINDOWS\system32\WS2_32.dll, 5.2.3790.3959
    71bf0000-71bf8000: C:\WINDOWS\system32\WS2HELP.dll, 5.2.3790.3959
    003e0000-003e6000: C:\siebel\siebsrvr\BIN\libarm.dll, 811.10.822.3
    00550000-005d5000: C:\siebel\siebsrvr\BIN\sslcsym.dll, 811.11.822.4
    7c3a0000-7c41b000: C:\siebel\siebsrvr\BIN\MSVCP71.dll, 7.10.3077.0
    005e0000-005f1000: C:\siebel\siebsrvr\BIN\sslccore.dll, 811.11.822.4
    00600000-00618000: C:\siebel\siebsrvr\BIN\sslcosd.dll, 811.11.822.4
    00620000-00645000: C:\siebel\siebsrvr\BIN\sslcrsa.dll, 811.11.822.4
    00650000-0067f000: C:\siebel\siebsrvr\BIN\sslcscr.dll, 811.11.822.4
    00680000-007cf000: C:\siebel\siebsrvr\BIN\sslcsrd.dll, 811.11.822.4
    007d0000-0082b000: C:\siebel\siebsrvr\BIN\sslcscc.dll, 811.11.822.4
    003f0000-003ff000: C:\siebel\siebsrvr\BIN\sslcevt.dll, 811.11.822.4
    00830000-00840000: C:\siebel\siebsrvr\BIN\sslcsobj.dll, 811.11.822.4
    00840000-00850000: C:\siebel\siebsrvr\BIN\sslcsnns.dll, 811.11.822.4
    00850000-00931000: C:\siebel\siebsrvr\BIN\sslcnapi.dll, 811.11.822.4
    00940000-00954000: C:\siebel\siebsrvr\BIN\sslcns.dll, 811.11.822.4
    00960000-00968000: C:\siebel\siebsrvr\BIN\sslcsnsc.dll, 811.11.822.4
    00970000-0097b000: C:\siebel\siebsrvr\BIN\ssscsmi.dll, 811.11.822.4
    00980000-00991000: C:\siebel\siebsrvr\BIN\sslcsrvr.dll, 811.11.822.4
    009a0000-009bb000: C:\siebel\siebsrvr\BIN\sslcos.dll, 811.11.822.4
    009c0000-00a5f000: C:\siebel\siebsrvr\BIN\sscfcmn.dll, 811.11.822.4
    7c8d0000-7d0cf000: C:\WINDOWS\system32\SHELL32.dll, 6.0.3790.5018
    7d180000-7d1d2000: C:\WINDOWS\system32\SHLWAPI.dll, 6.0.3790.5318
    77670000-777aa000: C:\WINDOWS\system32\ole32.dll, 5.2.3790.5209
    7d0e0000-7d16c000: C:\WINDOWS\system32\OLEAUT32.dll, 5.2.3790.5464
    761b0000-76245000: C:\WINDOWS\system32\CRYPT32.dll, 5.131.3790.5235
    76190000-761a2000: C:\WINDOWS\system32\MSASN1.dll, 5.2.3790.4584
    77210000-772bb000: C:\WINDOWS\system32\WININET.dll, 6.0.3790.5467
    00a60000-00a70000: C:\siebel\siebsrvr\BIN\sslczlib.dll, 811.11.822.4
    00a70000-00b72000: C:\siebel\siebsrvr\BIN\MFC71U.DLL, 7.10.3077.0
    00b80000-00b88000: C:\siebel\siebsrvr\BIN\sslcsnsr.dll, 811.11.822.4
    00b90000-00b99000: C:\siebel\siebsrvr\BIN\sslcsrtr.dll, 811.11.822.4
    00ba0000-00baf000: C:\siebel\siebsrvr\BIN\sslcsrms.dll, 811.11.822.4
    00bb0000-00bb6000: C:\siebel\siebsrvr\BIN\sslcsssm.dll, 811.11.822.4
    00bc0000-00bd1000: C:\siebel\siebsrvr\BIN\sslcsrcn.dll, 811.11.822.4
    00be0000-00be7000: C:\siebel\siebsrvr\BIN\sslcsysstat.dll, 811.11.822.4
    00fe0000-0100d000: C:\siebel\siebsrvr\BIN\sslcrsa256.dll, 8.1.1.5
    77420000-77523000: C:\WINDOWS\WinSxS\x86_Microsoft.Windows.Common-Controls_6595b64144ccf1df_6.0.3790.5190_x-ww_319264BE\comctl32.dll, 6.0.3790.5190
    5d360000-5d36e000: C:\siebel\siebsrvr\BIN\MFC71ENU.DLL, 7.10.3077.0
    76b70000-76b7b000: C:\WINDOWS\system32\psapi.dll, 5.2.3790.3959
    012b0000-012c0000: C:\siebel\siebsrvr\BIN\sslcasrv.dll, 811.11.822.4
    012c0000-01328000: C:\siebel\siebsrvr\BIN\sslcsrs.dll, 811.11.822.4
    01330000-0133a000: C:\siebel\siebsrvr\BIN\sslcntfy.dll, 811.11.822.4
    01740000-01746000: C:\siebel\siebsrvr\BIN\enu\srcf.dll, 811.9.822.2
    01750000-01756000: C:\siebel\siebsrvr\BIN\enu\srcfapps.dll, 811.9.822.2
    01760000-01766000: C:\siebel\siebsrvr\BIN\sbcf.dll, 811.9.822.2
    01770000-01776000: C:\siebel\siebsrvr\BIN\sbcfapps.dll, 811.9.822.2
    01780000-01791000: C:\siebel\siebsrvr\BIN\sssasos.dll, 811.11.822.4
    017a0000-017a8000: C:\siebel\siebsrvr\BIN\sslcom.dll, 811.11.822.4
    017b0000-017be000: C:\siebel\siebsrvr\BIN\sslcsnom.dll, 811.11.822.4
    017c0000-017f8000: C:\siebel\siebsrvr\BIN\sstcsiom.dll, 811.11.822.4
    020f0000-021f0000: C:\siebel\siebsrvr\BIN\sscfom.dll, 811.11.822.4
    021f0000-022ef000: C:\siebel\siebsrvr\BIN\sslcsc.dll, 811.11.822.4
    022f0000-0236f000: C:\siebel\siebsrvr\BIN\sslcdb.dll, 811.11.822.4
    4bf70000-4bfae000: C:\WINDOWS\system32\ODBC32.dll, 3.526.4795.0
    77530000-775c7000: C:\WINDOWS\WinSxS\x86_Microsoft.Windows.Common-Controls_6595b64144ccf1df_5.82.3790.5190_x-ww_D21E1F39\COMCTL32.dll, 5.82.3790.5190
    762b0000-762f9000: C:\WINDOWS\system32\comdlg32.dll, 6.0.3790.3959
    01800000-0180b000: C:\siebel\siebsrvr\BIN\sscadsecr.dll, 811.11.822.4
    02370000-0237d000: C:\siebel\siebsrvr\BIN\sslclm.dll, 811.11.822.4
    02380000-0239c000: C:\siebel\siebsrvr\BIN\sslcupg.dll, 811.11.822.4
    023a0000-023ba000: C:\siebel\siebsrvr\BIN\sslcsecm.dll, 811.11.822.4
    023c0000-023ef000: C:\siebel\siebsrvr\BIN\sscfel.dll, 811.11.822.4
    023f0000-026b0000: C:\siebel\siebsrvr\BIN\sscfdm.dll, 811.11.822.4
    026b0000-026bd000: C:\siebel\siebsrvr\BIN\sslcfsm.dll, 811.11.822.4
    026c0000-026c8000: C:\siebel\siebsrvr\BIN\sslcsecc.dll, 811.11.822.4
    026d0000-026e1000: C:\siebel\siebsrvr\BIN\sslccachev2.dll, 811.11.822.4
    026f0000-026f9000: C:\siebel\siebsrvr\BIN\sslcmsgagent.dll, 811.11.822.4
    02bd0000-02be7000: C:\WINDOWS\system32\odbcint.dll, 3.526.3959.0
    02bf0000-02c23000: C:\siebel\siebsrvr\BIN\sslcrsa56.dll, 811.11.822.4
    71b20000-71b61000: C:\WINDOWS\System32\mswsock.dll, 5.2.3790.4318
    76ed0000-76efa000: C:\WINDOWS\system32\DNSAPI.dll, 5.2.3790.4840
    76f70000-76f77000: C:\WINDOWS\System32\winrnr.dll, 5.2.3790.3959
    76f10000-76f3e000: C:\WINDOWS\system32\WLDAP32.dll, 5.2.3790.3959
    76f80000-76f85000: C:\WINDOWS\system32\rasadhlp.dll, 5.2.3790.3959
    5f270000-5f2ca000: C:\WINDOWS\system32\hnetcfg.dll, 5.2.3790.3959
    71ae0000-71ae8000: C:\WINDOWS\System32\wshtcpip.dll, 5.2.3790.3959
    0ae80000-0af6a000: C:\siebel\siebsrvr\BIN\eBaySecAda.dll
    76920000-769e2000: C:\WINDOWS\system32\userenv.dll, 5.2.3790.3959
    71c40000-71c97000: C:\WINDOWS\system32\netapi32.dll, 5.2.3790.5030
    76bb0000-76bdc000: C:\WINDOWS\system32\wintrust.dll, 5.131.3790.5060
    76c10000-76c3a000: C:\WINDOWS\system32\imagehlp.dll, 5.2.3790.5240
    76750000-76779000: C:\WINDOWS\system32\schannel.dll, 5.2.3790.5462
    76e90000-76ecf000: C:\WINDOWS\system32\RASAPI32.DLL, 5.2.3790.3959
    76e40000-76e52000: C:\WINDOWS\system32\rasman.dll, 5.2.3790.3959
    76e60000-76e8f000: C:\WINDOWS\system32\TAPI32.dll, 5.2.3790.3959
    76e30000-76e3c000: C:\WINDOWS\system32\rtutils.dll, 5.2.3790.3959
    76aa0000-76acd000: C:\WINDOWS\system32\WINMM.dll, 5.2.3790.4916
    722f0000-722f5000: C:\WINDOWS\system32\sensapi.dll, 5.2.3790.3959
    772c0000-77371000: C:\WINDOWS\system32\urlmon.dll, 6.0.3790.5467
    68000000-68035000: C:\WINDOWS\system32\rsaenh.dll, 5.2.3790.3959
    68100000-68127000: C:\WINDOWS\system32\dssenh.dll, 5.2.3790.3959
    0b300000-0b31a000: C:\siebel\siebsrvr\BIN\sscdo90.dll, 811.11.822.4
    0b320000-0b3a2000: C:\oracle\product\11.1.0\client_1\bin\OCI.dll, 11.1.0.1
    61c20000-61f81000: C:\oracle\product\11.1.0\client_1\bin\OraClient11.Dll, 11.1.0.7
    60870000-6095b000: C:\oracle\product\11.1.0\client_1\bin\oracore11.dll, 11.1.0.7
    60a80000-60b4e000: C:\oracle\product\11.1.0\client_1\bin\oranls11.dll, 11.1.0.7
    63690000-636a8000: C:\oracle\product\11.1.0\client_1\bin\oraunls11.dll, 11.1.0.7
    60eb0000-60eb7000: C:\oracle\product\11.1.0\client_1\bin\orauts.dll, 11.1.0.7
    636b0000-636b6000: C:\oracle\product\11.1.0\client_1\bin\oravsn11.dll, 11.1.0.7
    60fa0000-61158000: C:\oracle\product\11.1.0\client_1\bin\oracommon11.dll, 11.1.0.7
    63430000-6345d000: C:\oracle\product\11.1.0\client_1\bin\orasnls11.dll, 11.1.0.7
    0b3b0000-0be77000: C:\oracle\product\11.1.0\client_1\bin\orageneric11.dll, 11.1.0.7
    0be80000-0c0dc000: C:\oracle\product\11.1.0\client_1\bin\oraxml11.dll, 11.1.0.7
    60020000-60030000: C:\WINDOWS\system32\MSVCIRT.dll, 7.0.3790.0
    0c0e0000-0c4b2000: C:\oracle\product\11.1.0\client_1\bin\oran11.dll, 11.1.0.6
    62740000-627a3000: C:\oracle\product\11.1.0\client_1\bin\oranl11.dll, 11.1.0.6
    62980000-629b1000: C:\oracle\product\11.1.0\client_1\bin\orantcp11.dll, 11.1.0.6
    0c4c0000-0c507000: C:\oracle\product\11.1.0\client_1\bin\oranldap11.dll, 11.1.0.6
    627f0000-62905000: C:\oracle\product\11.1.0\client_1\bin\orannzsbb11.dll, 11.1.0.6
    62530000-6266d000: C:\oracle\product\11.1.0\client_1\bin\oraldapclnt11.dll, 11.1.0.7
    62670000-6268b000: C:\oracle\product\11.1.0\client_1\bin\orancrypt11.dll, 11.1.0.6
    0c510000-0c643000: C:\oracle\product\11.1.0\client_1\bin\orazt11.dll, 11.1.0.6
    76cf0000-76d0a000: C:\WINDOWS\system32\iphlpapi.dll, 5.2.3790.3959
    62920000-6296d000: C:\oracle\product\11.1.0\client_1\bin\oranro11.dll, 11.1.0.6
    626b0000-626b9000: C:\oracle\product\11.1.0\client_1\bin\oranhost11.dll, 11.1.0.6
    0c650000-0c656000: C:\oracle\product\11.1.0\client_1\bin\orancds11.dll, 11.1.0.6
    629c0000-629cd000: C:\oracle\product\11.1.0\client_1\bin\orantns11.dll, 11.1.0.6
    0c660000-0c6e0000: C:\oracle\product\11.1.0\client_1\bin\oraztkg11.dll, 11.1.0.6
    0c6e0000-0caba000: C:\oracle\product\11.1.0\client_1\bin\orapls11.dll, 11.1.0.7
    63420000-63429000: C:\oracle\product\11.1.0\client_1\bin\oraslax11.dll, 11.1.0.6
    63080000-63296000: C:\oracle\product\11.1.0\client_1\bin\oraplp11.dll, 11.1.0.7
    0cac0000-0cb6d000: C:\oracle\product\11.1.0\client_1\bin\orahasgen11.dll, 11.1.0.6
    62ab0000-62b2f000: C:\oracle\product\11.1.0\client_1\bin\oraocr11.dll, 11.1.0.6
    0cb70000-0cbce000: C:\oracle\product\11.1.0\client_1\bin\oraocrb11.dll, 11.1.0.6
    6d580000-6d628000: C:\WINDOWS\system32\dbghelp.dll, 5.2.3790.3959
    63520000-635c2000: C:\oracle\product\11.1.0\client_1\bin\orasql11.dll, 11.1.0.7
    63060000-63074000: C:\oracle\product\11.1.0\client_1\bin\OraPlc11.Dll, 11.1.0.7
    0cde0000-0cde6000: C:\siebel\siebsrvr\BIN\sslcdbgengw.dll, 811.11.822.4
    0ce30000-0ce4c000: C:\siebel\siebsrvr\BIN\sscfomlg.dll, 811.11.822.4
    0ce60000-0cffb000: C:\siebel\siebsrvr\BIN\sscfcli.dll, 811.11.822.4
    0d070000-0d11d000: C:\siebel\siebsrvr\BIN\sscacmbc.dll, 811.11.822.4
    209c0000-20a7e000: C:\siebel\siebsrvr\BIN\SSCABCBC.DLL, 811.11.822.4
    20cc0000-20d19000: C:\siebel\siebsrvr\BIN\SSCACCBC.DLL, 811.11.822.4
    212d0000-212ec000: C:\siebel\siebsrvr\BIN\sscapsppricersvc.dll, 811.11.822.4
    20060000-2059a000: C:\siebel\siebsrvr\BIN\sscaswbc.dll, 811.11.822.4
    21690000-21704000: C:\siebel\siebsrvr\BIN\SSCMSVC.DLL, 811.11.822.4
    215a0000-2166c000: C:\siebel\siebsrvr\BIN\SSCMCLNT.DLL, 811.11.822.4
    21740000-2179e000: C:\siebel\siebsrvr\BIN\sscmcfgsvc.dll, 811.11.822.4
    0d010000-0d025000: C:\siebel\siebsrvr\BIN\SSCASRMS.DLL, 811.11.822.4
    0d030000-0d070000: C:\siebel\siebsrvr\BIN\sscaadbc.dll, 811.11.822.4
    21590000-2159d000: C:\siebel\siebsrvr\BIN\SSCFHIMS.DLL, 811.11.822.4
    22490000-224aa000: C:\siebel\siebsrvr\BIN\SSCASSMC.DLL, 811.11.822.4
    222d0000-22371000: C:\siebel\siebsrvr\BIN\sscacabc.dll, 811.11.822.4
    224b0000-224ec000: C:\siebel\siebsrvr\BIN\SSCASVBC.DLL, 811.11.822.4
    22be0000-22c24000: C:\siebel\siebsrvr\BIN\swcahcfr.dll, 811.11.822.4
    22aa0000-22b54000: C:\siebel\siebsrvr\BIN\SWCACAFR.DLL, 811.11.822.4
    22c30000-22ca0000: C:\siebel\siebsrvr\BIN\SSCAXMLPWFR.DLL, 811.11.822.4
    22ed0000-22f8c000: C:\siebel\siebsrvr\BIN\SSDTBC.DLL, 811.11.822.4
    22a80000-22a9f000: C:\siebel\siebsrvr\BIN\SSCACTBC.DLL, 811.11.822.4
    23040000-230c1000: C:\siebel\siebsrvr\BIN\SWCASIFR.DLL, 811.11.822.4
    211b0000-211cd000: C:\siebel\siebsrvr\BIN\swcacmfr.dll, 811.11.822.4
    21f60000-21f6d000: C:\siebel\siebsrvr\BIN\SSLCKM.DLL, 811.11.822.4
    22060000-220ca000: C:\siebel\siebsrvr\BIN\SSCANSHSV.DLL, 811.11.822.4
    21b20000-21b9d000: C:\siebel\siebsrvr\BIN\SWCANSHFR.DLL, 811.11.822.4
    21af0000-21b1a000: C:\siebel\siebsrvr\BIN\SSCANSHBC.DLL, 811.11.822.4
    21f80000-21fc9000: C:\siebel\siebsrvr\BIN\sWcasvfr.dll, 811.11.822.4
    22170000-22202000: C:\siebel\siebsrvr\BIN\SSFAFCBC.DLL, 811.11.822.4
    23580000-235c4000: C:\siebel\siebsrvr\BIN\SSCAPRMSV.DLL, 811.11.822.4
    22020000-2203e000: C:\siebel\siebsrvr\BIN\SSCAEITE.DLL, 811.11.822.4
    1ff20000-2005a000: C:\siebel\siebsrvr\BIN\sscafwsv.dll, 811.11.822.4
    22d40000-22ea8000: C:\siebel\siebsrvr\BIN\sscaeiwm.dll, 811.11.822.4
    22d10000-22d3e000: C:\siebel\siebsrvr\BIN\SSCAEIWO.DLL, 811.11.822.4
    23780000-2378b000: C:\siebel\siebsrvr\BIN\SSCAEILM.DLL, 811.11.822.4
    23790000-237e3000: C:\siebel\siebsrvr\BIN\SSCAEISA.DLL, 811.11.822.4
    22560000-22652000: C:\siebel\siebsrvr\BIN\SSCASPBC.DLL, 811.11.822.4
    23880000-23897000: C:\siebel\siebsrvr\BIN\sscafssvactcache.dll, 811.11.822.4
    239a0000-23a89000: C:\siebel\siebsrvr\BIN\SSCOMMSV.DLL, 811.11.822.4
    036c0000-0372a000: C:\siebel\siebsrvr\BIN\SSCHATBS.DLL, 811.11.822.4
    22770000-227c1000: C:\siebel\siebsrvr\BIN\sscasabc.dll, 811.11.822.4
    23b30000-23b4c000: C:\siebel\siebsrvr\BIN\SSFACMBC.DLL, 811.11.822.4
    23b50000-23b64000: C:\siebel\siebsrvr\BIN\SSFACMSV.DLL, 811.11.822.4
    23ea0000-23eef000: C:\siebel\siebsrvr\BIN\sscacmuinsv.dll, 811.11.822.4
    23490000-234f6000: C:\siebel\siebsrvr\BIN\SWCAFSFR.DLL, 811.11.822.4
    21a80000-21aa5000: C:\siebel\siebsrvr\BIN\SSCASHSV.DLL, 811.11.822.4
    21eb0000-21edd000: C:\siebel\siebsrvr\BIN\SSCASHBC.DLL, 811.11.822.4
    21ee0000-21f2f000: C:\siebel\siebsrvr\BIN\SWCASHFR.DLL, 811.11.822.4
    211d0000-211ee000: C:\siebel\siebsrvr\BIN\sscaxmbc.dll, 811.11.822.4
    23ef0000-23f41000: C:\siebel\siebsrvr\BIN\SWCACGFR.DLL, 811.11.822.4
    22140000-22170000: C:\siebel\siebsrvr\BIN\SSCATASV.DLL, 811.11.822.4
    21220000-212c8000: C:\siebel\siebsrvr\BIN\swcabcfr.dll, 811.11.822.4
    23bd0000-23bf4000: C:\siebel\siebsrvr\BIN\sscasasv.dll, 811.11.822.4
    23b90000-23ba6000: C:\siebel\siebsrvr\BIN\SSCAEIXQ.DLL, 811.11.822.4
    24860000-24929000: C:\siebel\siebsrvr\BIN\swcaspsv.dll, 811.11.822.4
    04080000-0408b000: C:\siebel\siebsrvr\BIN\SSCFUREC.DLL, 811.11.822.4
    Heap status          : ok
    Total physical memory: 50320576 KB
    Free physical memory : 35138076 KB
    Paging file size     : 51918740 KB
    Available paging size: 36997428 KB
    Virtual memory info:
    Total              : 2097024 KB
    Available          : 836420 KB
    Available extendent: 0 KB
    Assert failure count : 1595991
    Command line         : siebmtshmw.exe C:\siebel\siebsrvr\admin\siebprodent.pxsblaom026.shm 33 0 1 5 0 ENU 0 0
    Current directory    : C:\siebel\siebsrvr\BIN
    Executable           : C:\siebel\siebsrvr\BIN\siebmtshmw.exe
    Current time         : 01/19/2015 10:52:32:099
    CCF Version          : 8.1.1.10 SIA [23017] LANG_INDEPENDENT
    CCF Compiled On      : Jan 21 2013 18:06:00
    Would approciate if anyone could provide some inputs on the same..
    Thanks
    Ruban

    Hi,
    We recently upgraded to Oracle RAC database to support Siebel Call Center APplication (8.1.1.11.12 [IP2013]).Oracle Database 11g Enterprise Edition Release 11.2.0.3.0 - 64bit Production
    Frequently we are facing problem of crashing with the Nodes in RAC (Kernal Panic). Due to this users using siebel application are unstable and facing multiple issues Once we restore Siebel Gateway and restart of AOM server fixing the issue.
    Below are the SQL's and Crashing Signature we are seeing du to this crash.
    DBCLog DBCLogError 1 00081f1254bb0ad4:1423830 2015-01-18 11:49:20 OCIStmtExecute: SELECT
    T2.CONFLICT_ID,
    T2.LAST_UPD,
    T2.CREATED,
    T2.LAST_UPD_BY,
    T2.CREATED_BY,
    T2.MODIFICATION_NUM,
    T2.ROW_ID,
    T2.EFF_START_TS,
    T2.EFF_END_TS,
    T2.NAME,
    T2.BUSOBJ_NAME,
    T2.VERSION,
    T2.DEPLOY_STATUS_CD,
    T2.MODE_CD
    FROM
    SIEBEL.S_LST_OF_VAL T1,
    SIEBEL.S_WFA_DPLOY_DEF T2
    WHERE
    T2.DEPLOY_STATUS_CD = T1.NAME AND T1.TYPE = 'WFA_DPLY_STAT_CD' AND T1.LANG_ID = :1 AND
    (T2.TYPE_CD IN ( :2 )) AND
    (T2.NAME = :3 AND T2.DEPLOY_STATUS_CD IN ( :4 ) AND (T2.EFF_END_TS > TO_DATE(:5,'MM/DD/YYYY HH24:MI:SS') OR T2.EFF_END_TS IS NULL))
    ORDER BY
    T2.NAME, T1.VAL
    ObjMgrLog Error 1 00081f1254bb0ad4:1423830 2015-01-18 11:49:20 (oracon.cpp (3896)) SBL-DBC-00105: An error has occurred executing a Sql statement.
    Please continue or ask your systems administrator to check your application configuration if the problem persists.
    and Crash Signature Looks like below
    Exception 0xc0000005 at 0x006500f6
    Thread: 0x00002700, Process 0x00000254
    Thread: 9984, Process 596
    - CONTEXT -
    EIP: 0x00000000, EFL: 0x00010246, FS:  0x0000003b, GS:  0x00000000
    CS:  0x0000001b, DS:  0x00000023, SS:  0x00000023, ES:  0x00000023
    EAX: 0x1a511968, EBX: 0x294ca048, ECX: 0x4cc50008, EDX: 0x3a2ad200
    ESI: 0x4cc50008, EDI: 0x00000000, EBP: 0x00000000, ESP: 0x3a2afff4
    - CALL STACK -
    sslcscr +0xf6
    sscfcmn +0x19050 = CSSObjectBase::CopyErrorMsg() +0xf0
    sscfcmn +0x1950d = CSSObjectBase::DoSetErrorMsg() +0x13d
    sscfcmn +0x19bb5 = CSSObjectBase::SetErrorMsg() +0xa5
    SSFACMBC +0x34a6 = CSSFABCVRec::IsBusinessProcessActive() +0x3b6
    SSFACMBC +0x5133 = CSSFABCVRec::VBCCreate() +0x1e3
    sscfom +0x71d1e = CSSBCVRec::SqlCreate() +0xde
    sscfom +0x4aea = CSSModel::ConstructBusComp() +0xaa
    sscfom +0x653f5 = CSSBusObj::GetBusComp() +0x265
    sscfom +0x65a18 = CSSBusObj::GetBusComp() +0x18
    sscfom +0x13ad8 = CSSModel::BeginSetupView() +0x418
    sscfom +0x13dee = CSSModel::BeginSetupView() +0x5e
    sscaswbc +0x8b070 = CSSSWEUdfLoader::BeginSetupView() +0x30
    sscaswbc +0xe3d88 = CSSSWEFrameMgrInternal::BuildView() +0x1618
    sscaswbc +0xe5646 = CSSSWEFrameMgrInternal::BuildView() +0x36
    sscaswbc +0xb8343 = CSSSWEActionMgr::ActionBuildViewAsync() +0x293
    sscaswbc +0xb873b = CSSSWEActionMgr::DoPostedAction() +0xab
    sscaswbc +0xb9287 = CSSSWEActionMgr::CheckPostedActions() +0x3d7
    sscaswbc +0xe6d41 = CSSSWEFrameMgrInternal::InvokeAppletMethod() +0x11b1
    sscaswbc +0xbbcdc = CSSSWECmdProcessor::InvokeMethod() +0x74c
    sscaswbc +0xc1495 = CSSSWECmdProcessor::_ProcessCommand() +0x725
    sscaswbc +0xc27f8 = CSSSWECmdProcessor::ProcessCommand() +0xab8
    sscaswbc +0xc2d04 = CSSSWECmdProcessor::ProcessCommand() +0xc4
    sscaswbc +0x265559 = CSSServiceSWEIface::Request() +0x309
    sscaswbc +0x267391 = CSSServiceSWEIface::DoInvokeMethod() +0xed1
    sscfom +0x1976c = CSSService::InvokeMethod() +0x24c
    sstcsiom +0x6d6a = CSSSIOMSession::ModInvokeSrvcMethod() +0x10a
    sstcsiom +0x7613 = CSSSIOMSession::RPCMiscModel() +0x513
    sstcsiom +0xe9dd = CSSSIOMSession::HandleRPC() +0x3ad
    sssasos +0x6616 = CompCleanup() +0x3be6
    sssasos +0x5a95 = CompCleanup() +0x3065
    sssasos +0x1a35 = CSSSISObject::operator=() +0x9f5
    sssasos +0x2135 = CompHandleMsg() +0x485
    siebmtshmw +0x494e
    siebmtshmw +0x20051 = GetSmiTaskAPI() +0x6d21
    siebmtshmw +0x239d1 = SmiInProcMsgHandler() +0x2051
    siebmtshmw +0x15f15 = SmiBeginTrace() +0x3195
    siebmtshmw +0x174cf = GetSmiWorkQObj() +0x148f
    siebmtshmw +0xc7f7 = SmiCleanupDetTask() +0x3be7
    sslcosd +0x2152 = OSDThreadPrivIsInit() +0x1d2
    sslcosd +0x21dc = OSDThreadPrivIsInit() +0x25c
    MSVCR71 +0x9565 = endthreadex() +0xa0
    kernel32 +0x2484f = GetModuleHandleA() +0xdf
    - STACK DUMP -
    - MODULE LIST -
    00400000-00445000: C:\siebel\siebsrvr\BIN\siebmtshmw.exe, 811.11.822.4
    7c800000-7c8c3000: C:\WINDOWS\system32\ntdll.dll, 5.2.3790.4937
    77e40000-77f44000: C:\WINDOWS\system32\kernel32.dll, 5.2.3790.5295
    10000000-10025000: C:\siebel\siebsrvr\BIN\ssscsci.dll, 811.11.822.4
    00320000-003cc000: C:\siebel\siebsrvr\BIN\ssscscf.dll, 811.11.822.4
    003d0000-003d7000: C:\siebel\siebsrvr\BIN\sslcosa.dll, 811.11.822.4
    7c340000-7c396000: C:\siebel\siebsrvr\BIN\MSVCR71.dll, 7.10.3052.4
    00450000-0054d000: C:\siebel\siebsrvr\BIN\sslcshar.dll, 811.11.822.4
    77380000-77411000: C:\WINDOWS\system32\USER32.dll, 5.2.3790.4033
    77c00000-77c49000: C:\WINDOWS\system32\GDI32.dll, 5.2.3790.5398
    7d1e0000-7d27c000: C:\WINDOWS\system32\ADVAPI32.dll, 5.2.3790.4455
    77c50000-77cf1000: C:\WINDOWS\system32\RPCRT4.dll, 5.2.3790.5254
    76f50000-76f63000: C:\WINDOWS\system32\Secur32.dll, 5.2.3790.4455
    77b90000-77b98000: C:\WINDOWS\system32\VERSION.dll, 5.2.3790.3959
    77ba0000-77bfa000: C:\WINDOWS\system32\msvcrt.dll, 7.0.3790.3959
    71bb0000-71bb9000: C:\WINDOWS\system32\WSOCK32.dll, 5.2.3790.0
    71c00000-71c17000: C:\WINDOWS\system32\WS2_32.dll, 5.2.3790.3959
    71bf0000-71bf8000: C:\WINDOWS\system32\WS2HELP.dll, 5.2.3790.3959
    003e0000-003e6000: C:\siebel\siebsrvr\BIN\libarm.dll, 811.10.822.3
    00550000-005d5000: C:\siebel\siebsrvr\BIN\sslcsym.dll, 811.11.822.4
    7c3a0000-7c41b000: C:\siebel\siebsrvr\BIN\MSVCP71.dll, 7.10.3077.0
    005e0000-005f1000: C:\siebel\siebsrvr\BIN\sslccore.dll, 811.11.822.4
    00600000-00618000: C:\siebel\siebsrvr\BIN\sslcosd.dll, 811.11.822.4
    00620000-00645000: C:\siebel\siebsrvr\BIN\sslcrsa.dll, 811.11.822.4
    00650000-0067f000: C:\siebel\siebsrvr\BIN\sslcscr.dll, 811.11.822.4
    00680000-007cf000: C:\siebel\siebsrvr\BIN\sslcsrd.dll, 811.11.822.4
    007d0000-0082b000: C:\siebel\siebsrvr\BIN\sslcscc.dll, 811.11.822.4
    003f0000-003ff000: C:\siebel\siebsrvr\BIN\sslcevt.dll, 811.11.822.4
    00830000-00840000: C:\siebel\siebsrvr\BIN\sslcsobj.dll, 811.11.822.4
    00840000-00850000: C:\siebel\siebsrvr\BIN\sslcsnns.dll, 811.11.822.4
    00850000-00931000: C:\siebel\siebsrvr\BIN\sslcnapi.dll, 811.11.822.4
    00940000-00954000: C:\siebel\siebsrvr\BIN\sslcns.dll, 811.11.822.4
    00960000-00968000: C:\siebel\siebsrvr\BIN\sslcsnsc.dll, 811.11.822.4
    00970000-0097b000: C:\siebel\siebsrvr\BIN\ssscsmi.dll, 811.11.822.4
    00980000-00991000: C:\siebel\siebsrvr\BIN\sslcsrvr.dll, 811.11.822.4
    009a0000-009bb000: C:\siebel\siebsrvr\BIN\sslcos.dll, 811.11.822.4
    009c0000-00a5f000: C:\siebel\siebsrvr\BIN\sscfcmn.dll, 811.11.822.4
    7c8d0000-7d0cf000: C:\WINDOWS\system32\SHELL32.dll, 6.0.3790.5018
    7d180000-7d1d2000: C:\WINDOWS\system32\SHLWAPI.dll, 6.0.3790.5318
    77670000-777aa000: C:\WINDOWS\system32\ole32.dll, 5.2.3790.5209
    7d0e0000-7d16c000: C:\WINDOWS\system32\OLEAUT32.dll, 5.2.3790.5464
    761b0000-76245000: C:\WINDOWS\system32\CRYPT32.dll, 5.131.3790.5235
    76190000-761a2000: C:\WINDOWS\system32\MSASN1.dll, 5.2.3790.4584
    77210000-772bb000: C:\WINDOWS\system32\WININET.dll, 6.0.3790.5467
    00a60000-00a70000: C:\siebel\siebsrvr\BIN\sslczlib.dll, 811.11.822.4
    00a70000-00b72000: C:\siebel\siebsrvr\BIN\MFC71U.DLL, 7.10.3077.0
    00b80000-00b88000: C:\siebel\siebsrvr\BIN\sslcsnsr.dll, 811.11.822.4
    00b90000-00b99000: C:\siebel\siebsrvr\BIN\sslcsrtr.dll, 811.11.822.4
    00ba0000-00baf000: C:\siebel\siebsrvr\BIN\sslcsrms.dll, 811.11.822.4
    00bb0000-00bb6000: C:\siebel\siebsrvr\BIN\sslcsssm.dll, 811.11.822.4
    00bc0000-00bd1000: C:\siebel\siebsrvr\BIN\sslcsrcn.dll, 811.11.822.4
    00be0000-00be7000: C:\siebel\siebsrvr\BIN\sslcsysstat.dll, 811.11.822.4
    00fe0000-0100d000: C:\siebel\siebsrvr\BIN\sslcrsa256.dll, 8.1.1.5
    77420000-77523000: C:\WINDOWS\WinSxS\x86_Microsoft.Windows.Common-Controls_6595b64144ccf1df_6.0.3790.5190_x-ww_319264BE\comctl32.dll, 6.0.3790.5190
    5d360000-5d36e000: C:\siebel\siebsrvr\BIN\MFC71ENU.DLL, 7.10.3077.0
    76b70000-76b7b000: C:\WINDOWS\system32\psapi.dll, 5.2.3790.3959
    012b0000-012c0000: C:\siebel\siebsrvr\BIN\sslcasrv.dll, 811.11.822.4
    012c0000-01328000: C:\siebel\siebsrvr\BIN\sslcsrs.dll, 811.11.822.4
    01330000-0133a000: C:\siebel\siebsrvr\BIN\sslcntfy.dll, 811.11.822.4
    01740000-01746000: C:\siebel\siebsrvr\BIN\enu\srcf.dll, 811.9.822.2
    01750000-01756000: C:\siebel\siebsrvr\BIN\enu\srcfapps.dll, 811.9.822.2
    01760000-01766000: C:\siebel\siebsrvr\BIN\sbcf.dll, 811.9.822.2
    01770000-01776000: C:\siebel\siebsrvr\BIN\sbcfapps.dll, 811.9.822.2
    01780000-01791000: C:\siebel\siebsrvr\BIN\sssasos.dll, 811.11.822.4
    017a0000-017a8000: C:\siebel\siebsrvr\BIN\sslcom.dll, 811.11.822.4
    017b0000-017be000: C:\siebel\siebsrvr\BIN\sslcsnom.dll, 811.11.822.4
    017c0000-017f8000: C:\siebel\siebsrvr\BIN\sstcsiom.dll, 811.11.822.4
    020f0000-021f0000: C:\siebel\siebsrvr\BIN\sscfom.dll, 811.11.822.4
    021f0000-022ef000: C:\siebel\siebsrvr\BIN\sslcsc.dll, 811.11.822.4
    022f0000-0236f000: C:\siebel\siebsrvr\BIN\sslcdb.dll, 811.11.822.4
    4bf70000-4bfae000: C:\WINDOWS\system32\ODBC32.dll, 3.526.4795.0
    77530000-775c7000: C:\WINDOWS\WinSxS\x86_Microsoft.Windows.Common-Controls_6595b64144ccf1df_5.82.3790.5190_x-ww_D21E1F39\COMCTL32.dll, 5.82.3790.5190
    762b0000-762f9000: C:\WINDOWS\system32\comdlg32.dll, 6.0.3790.3959
    01800000-0180b000: C:\siebel\siebsrvr\BIN\sscadsecr.dll, 811.11.822.4
    02370000-0237d000: C:\siebel\siebsrvr\BIN\sslclm.dll, 811.11.822.4
    02380000-0239c000: C:\siebel\siebsrvr\BIN\sslcupg.dll, 811.11.822.4
    023a0000-023ba000: C:\siebel\siebsrvr\BIN\sslcsecm.dll, 811.11.822.4
    023c0000-023ef000: C:\siebel\siebsrvr\BIN\sscfel.dll, 811.11.822.4
    023f0000-026b0000: C:\siebel\siebsrvr\BIN\sscfdm.dll, 811.11.822.4
    026b0000-026bd000: C:\siebel\siebsrvr\BIN\sslcfsm.dll, 811.11.822.4
    026c0000-026c8000: C:\siebel\siebsrvr\BIN\sslcsecc.dll, 811.11.822.4
    026d0000-026e1000: C:\siebel\siebsrvr\BIN\sslccachev2.dll, 811.11.822.4
    026f0000-026f9000: C:\siebel\siebsrvr\BIN\sslcmsgagent.dll, 811.11.822.4
    02bd0000-02be7000: C:\WINDOWS\system32\odbcint.dll, 3.526.3959.0
    02bf0000-02c23000: C:\siebel\siebsrvr\BIN\sslcrsa56.dll, 811.11.822.4
    71b20000-71b61000: C:\WINDOWS\System32\mswsock.dll, 5.2.3790.4318
    76ed0000-76efa000: C:\WINDOWS\system32\DNSAPI.dll, 5.2.3790.4840
    76f70000-76f77000: C:\WINDOWS\System32\winrnr.dll, 5.2.3790.3959
    76f10000-76f3e000: C:\WINDOWS\system32\WLDAP32.dll, 5.2.3790.3959
    76f80000-76f85000: C:\WINDOWS\system32\rasadhlp.dll, 5.2.3790.3959
    5f270000-5f2ca000: C:\WINDOWS\system32\hnetcfg.dll, 5.2.3790.3959
    71ae0000-71ae8000: C:\WINDOWS\System32\wshtcpip.dll, 5.2.3790.3959
    0ae80000-0af6a000: C:\siebel\siebsrvr\BIN\eBaySecAda.dll
    76920000-769e2000: C:\WINDOWS\system32\userenv.dll, 5.2.3790.3959
    71c40000-71c97000: C:\WINDOWS\system32\netapi32.dll, 5.2.3790.5030
    76bb0000-76bdc000: C:\WINDOWS\system32\wintrust.dll, 5.131.3790.5060
    76c10000-76c3a000: C:\WINDOWS\system32\imagehlp.dll, 5.2.3790.5240
    76750000-76779000: C:\WINDOWS\system32\schannel.dll, 5.2.3790.5462
    76e90000-76ecf000: C:\WINDOWS\system32\RASAPI32.DLL, 5.2.3790.3959
    76e40000-76e52000: C:\WINDOWS\system32\rasman.dll, 5.2.3790.3959
    76e60000-76e8f000: C:\WINDOWS\system32\TAPI32.dll, 5.2.3790.3959
    76e30000-76e3c000: C:\WINDOWS\system32\rtutils.dll, 5.2.3790.3959
    76aa0000-76acd000: C:\WINDOWS\system32\WINMM.dll, 5.2.3790.4916
    722f0000-722f5000: C:\WINDOWS\system32\sensapi.dll, 5.2.3790.3959
    772c0000-77371000: C:\WINDOWS\system32\urlmon.dll, 6.0.3790.5467
    68000000-68035000: C:\WINDOWS\system32\rsaenh.dll, 5.2.3790.3959
    68100000-68127000: C:\WINDOWS\system32\dssenh.dll, 5.2.3790.3959
    0b300000-0b31a000: C:\siebel\siebsrvr\BIN\sscdo90.dll, 811.11.822.4
    0b320000-0b3a2000: C:\oracle\product\11.1.0\client_1\bin\OCI.dll, 11.1.0.1
    61c20000-61f81000: C:\oracle\product\11.1.0\client_1\bin\OraClient11.Dll, 11.1.0.7
    60870000-6095b000: C:\oracle\product\11.1.0\client_1\bin\oracore11.dll, 11.1.0.7
    60a80000-60b4e000: C:\oracle\product\11.1.0\client_1\bin\oranls11.dll, 11.1.0.7
    63690000-636a8000: C:\oracle\product\11.1.0\client_1\bin\oraunls11.dll, 11.1.0.7
    60eb0000-60eb7000: C:\oracle\product\11.1.0\client_1\bin\orauts.dll, 11.1.0.7
    636b0000-636b6000: C:\oracle\product\11.1.0\client_1\bin\oravsn11.dll, 11.1.0.7
    60fa0000-61158000: C:\oracle\product\11.1.0\client_1\bin\oracommon11.dll, 11.1.0.7
    63430000-6345d000: C:\oracle\product\11.1.0\client_1\bin\orasnls11.dll, 11.1.0.7
    0b3b0000-0be77000: C:\oracle\product\11.1.0\client_1\bin\orageneric11.dll, 11.1.0.7
    0be80000-0c0dc000: C:\oracle\product\11.1.0\client_1\bin\oraxml11.dll, 11.1.0.7
    60020000-60030000: C:\WINDOWS\system32\MSVCIRT.dll, 7.0.3790.0
    0c0e0000-0c4b2000: C:\oracle\product\11.1.0\client_1\bin\oran11.dll, 11.1.0.6
    62740000-627a3000: C:\oracle\product\11.1.0\client_1\bin\oranl11.dll, 11.1.0.6
    62980000-629b1000: C:\oracle\product\11.1.0\client_1\bin\orantcp11.dll, 11.1.0.6
    0c4c0000-0c507000: C:\oracle\product\11.1.0\client_1\bin\oranldap11.dll, 11.1.0.6
    627f0000-62905000: C:\oracle\product\11.1.0\client_1\bin\orannzsbb11.dll, 11.1.0.6
    62530000-6266d000: C:\oracle\product\11.1.0\client_1\bin\oraldapclnt11.dll, 11.1.0.7
    62670000-6268b000: C:\oracle\product\11.1.0\client_1\bin\orancrypt11.dll, 11.1.0.6
    0c510000-0c643000: C:\oracle\product\11.1.0\client_1\bin\orazt11.dll, 11.1.0.6
    76cf0000-76d0a000: C:\WINDOWS\system32\iphlpapi.dll, 5.2.3790.3959
    62920000-6296d000: C:\oracle\product\11.1.0\client_1\bin\oranro11.dll, 11.1.0.6
    626b0000-626b9000: C:\oracle\product\11.1.0\client_1\bin\oranhost11.dll, 11.1.0.6
    0c650000-0c656000: C:\oracle\product\11.1.0\client_1\bin\orancds11.dll, 11.1.0.6
    629c0000-629cd000: C:\oracle\product\11.1.0\client_1\bin\orantns11.dll, 11.1.0.6
    0c660000-0c6e0000: C:\oracle\product\11.1.0\client_1\bin\oraztkg11.dll, 11.1.0.6
    0c6e0000-0caba000: C:\oracle\product\11.1.0\client_1\bin\orapls11.dll, 11.1.0.7
    63420000-63429000: C:\oracle\product\11.1.0\client_1\bin\oraslax11.dll, 11.1.0.6
    63080000-63296000: C:\oracle\product\11.1.0\client_1\bin\oraplp11.dll, 11.1.0.7
    0cac0000-0cb6d000: C:\oracle\product\11.1.0\client_1\bin\orahasgen11.dll, 11.1.0.6
    62ab0000-62b2f000: C:\oracle\product\11.1.0\client_1\bin\oraocr11.dll, 11.1.0.6
    0cb70000-0cbce000: C:\oracle\product\11.1.0\client_1\bin\oraocrb11.dll, 11.1.0.6
    6d580000-6d628000: C:\WINDOWS\system32\dbghelp.dll, 5.2.3790.3959
    63520000-635c2000: C:\oracle\product\11.1.0\client_1\bin\orasql11.dll, 11.1.0.7
    63060000-63074000: C:\oracle\product\11.1.0\client_1\bin\OraPlc11.Dll, 11.1.0.7
    0cde0000-0cde6000: C:\siebel\siebsrvr\BIN\sslcdbgengw.dll, 811.11.822.4
    0ce30000-0ce4c000: C:\siebel\siebsrvr\BIN\sscfomlg.dll, 811.11.822.4
    0ce60000-0cffb000: C:\siebel\siebsrvr\BIN\sscfcli.dll, 811.11.822.4
    0d070000-0d11d000: C:\siebel\siebsrvr\BIN\sscacmbc.dll, 811.11.822.4
    209c0000-20a7e000: C:\siebel\siebsrvr\BIN\SSCABCBC.DLL, 811.11.822.4
    20cc0000-20d19000: C:\siebel\siebsrvr\BIN\SSCACCBC.DLL, 811.11.822.4
    212d0000-212ec000: C:\siebel\siebsrvr\BIN\sscapsppricersvc.dll, 811.11.822.4
    20060000-2059a000: C:\siebel\siebsrvr\BIN\sscaswbc.dll, 811.11.822.4
    21690000-21704000: C:\siebel\siebsrvr\BIN\SSCMSVC.DLL, 811.11.822.4
    215a0000-2166c000: C:\siebel\siebsrvr\BIN\SSCMCLNT.DLL, 811.11.822.4
    21740000-2179e000: C:\siebel\siebsrvr\BIN\sscmcfgsvc.dll, 811.11.822.4
    0d010000-0d025000: C:\siebel\siebsrvr\BIN\SSCASRMS.DLL, 811.11.822.4
    0d030000-0d070000: C:\siebel\siebsrvr\BIN\sscaadbc.dll, 811.11.822.4
    21590000-2159d000: C:\siebel\siebsrvr\BIN\SSCFHIMS.DLL, 811.11.822.4
    22490000-224aa000: C:\siebel\siebsrvr\BIN\SSCASSMC.DLL, 811.11.822.4
    222d0000-22371000: C:\siebel\siebsrvr\BIN\sscacabc.dll, 811.11.822.4
    224b0000-224ec000: C:\siebel\siebsrvr\BIN\SSCASVBC.DLL, 811.11.822.4
    22be0000-22c24000: C:\siebel\siebsrvr\BIN\swcahcfr.dll, 811.11.822.4
    22aa0000-22b54000: C:\siebel\siebsrvr\BIN\SWCACAFR.DLL, 811.11.822.4
    22c30000-22ca0000: C:\siebel\siebsrvr\BIN\SSCAXMLPWFR.DLL, 811.11.822.4
    22ed0000-22f8c000: C:\siebel\siebsrvr\BIN\SSDTBC.DLL, 811.11.822.4
    22a80000-22a9f000: C:\siebel\siebsrvr\BIN\SSCACTBC.DLL, 811.11.822.4
    23040000-230c1000: C:\siebel\siebsrvr\BIN\SWCASIFR.DLL, 811.11.822.4
    211b0000-211cd000: C:\siebel\siebsrvr\BIN\swcacmfr.dll, 811.11.822.4
    21f60000-21f6d000: C:\siebel\siebsrvr\BIN\SSLCKM.DLL, 811.11.822.4
    22060000-220ca000: C:\siebel\siebsrvr\BIN\SSCANSHSV.DLL, 811.11.822.4
    21b20000-21b9d000: C:\siebel\siebsrvr\BIN\SWCANSHFR.DLL, 811.11.822.4
    21af0000-21b1a000: C:\siebel\siebsrvr\BIN\SSCANSHBC.DLL, 811.11.822.4
    21f80000-21fc9000: C:\siebel\siebsrvr\BIN\sWcasvfr.dll, 811.11.822.4
    22170000-22202000: C:\siebel\siebsrvr\BIN\SSFAFCBC.DLL, 811.11.822.4
    23580000-235c4000: C:\siebel\siebsrvr\BIN\SSCAPRMSV.DLL, 811.11.822.4
    22020000-2203e000: C:\siebel\siebsrvr\BIN\SSCAEITE.DLL, 811.11.822.4
    1ff20000-2005a000: C:\siebel\siebsrvr\BIN\sscafwsv.dll, 811.11.822.4
    22d40000-22ea8000: C:\siebel\siebsrvr\BIN\sscaeiwm.dll, 811.11.822.4
    22d10000-22d3e000: C:\siebel\siebsrvr\BIN\SSCAEIWO.DLL, 811.11.822.4
    23780000-2378b000: C:\siebel\siebsrvr\BIN\SSCAEILM.DLL, 811.11.822.4
    23790000-237e3000: C:\siebel\siebsrvr\BIN\SSCAEISA.DLL, 811.11.822.4
    22560000-22652000: C:\siebel\siebsrvr\BIN\SSCASPBC.DLL, 811.11.822.4
    23880000-23897000: C:\siebel\siebsrvr\BIN\sscafssvactcache.dll, 811.11.822.4
    239a0000-23a89000: C:\siebel\siebsrvr\BIN\SSCOMMSV.DLL, 811.11.822.4
    036c0000-0372a000: C:\siebel\siebsrvr\BIN\SSCHATBS.DLL, 811.11.822.4
    22770000-227c1000: C:\siebel\siebsrvr\BIN\sscasabc.dll, 811.11.822.4
    23b30000-23b4c000: C:\siebel\siebsrvr\BIN\SSFACMBC.DLL, 811.11.822.4
    23b50000-23b64000: C:\siebel\siebsrvr\BIN\SSFACMSV.DLL, 811.11.822.4
    23ea0000-23eef000: C:\siebel\siebsrvr\BIN\sscacmuinsv.dll, 811.11.822.4
    23490000-234f6000: C:\siebel\siebsrvr\BIN\SWCAFSFR.DLL, 811.11.822.4
    21a80000-21aa5000: C:\siebel\siebsrvr\BIN\SSCASHSV.DLL, 811.11.822.4
    21eb0000-21edd000: C:\siebel\siebsrvr\BIN\SSCASHBC.DLL, 811.11.822.4
    21ee0000-21f2f000: C:\siebel\siebsrvr\BIN\SWCASHFR.DLL, 811.11.822.4
    211d0000-211ee000: C:\siebel\siebsrvr\BIN\sscaxmbc.dll, 811.11.822.4
    23ef0000-23f41000: C:\siebel\siebsrvr\BIN\SWCACGFR.DLL, 811.11.822.4
    22140000-22170000: C:\siebel\siebsrvr\BIN\SSCATASV.DLL, 811.11.822.4
    21220000-212c8000: C:\siebel\siebsrvr\BIN\swcabcfr.dll, 811.11.822.4
    23bd0000-23bf4000: C:\siebel\siebsrvr\BIN\sscasasv.dll, 811.11.822.4
    23b90000-23ba6000: C:\siebel\siebsrvr\BIN\SSCAEIXQ.DLL, 811.11.822.4
    24860000-24929000: C:\siebel\siebsrvr\BIN\swcaspsv.dll, 811.11.822.4
    04080000-0408b000: C:\siebel\siebsrvr\BIN\SSCFUREC.DLL, 811.11.822.4
    Heap status          : ok
    Total physical memory: 50320576 KB
    Free physical memory : 35138076 KB
    Paging file size     : 51918740 KB
    Available paging size: 36997428 KB
    Virtual memory info:
    Total              : 2097024 KB
    Available          : 836420 KB
    Available extendent: 0 KB
    Assert failure count : 1595991
    Command line         : siebmtshmw.exe C:\siebel\siebsrvr\admin\siebprodent.pxsblaom026.shm 33 0 1 5 0 ENU 0 0
    Current directory    : C:\siebel\siebsrvr\BIN
    Executable           : C:\siebel\siebsrvr\BIN\siebmtshmw.exe
    Current time         : 01/19/2015 10:52:32:099
    CCF Version          : 8.1.1.10 SIA [23017] LANG_INDEPENDENT
    CCF Compiled On      : Jan 21 2013 18:06:00
    Would approciate if anyone could provide some inputs on the same..
    Thanks
    Ruban

  • Oracle Rac Node 1 , Node 2

    *Hi All ,
    I need to ask about RAC :
    I have Oracle RAC ( Node1,Node2) When i check The performance For both nodes , the all load Goes to node 1 without anything happened on node 2 , as i know the the load must be equal on the both Nodes ( node1 , node2 ).
    How Can i do this ? to make the load for both nodes equal.
    Thank you very much.*

    Thank you Guys
    My Load balance Configuration like the following :
    Node 1 "tnsname":
    MARKADB_SRV =
    (DESCRIPTION =
    (ADDRESS = (PROTOCOL = TCP)(HOST = 172.29.11.23)(PORT = 1521))
    (ADDRESS = (PROTOCOL = TCP)(HOST = 172.29.11.22)(PORT = 1521))
    (LOAD_BALANCE = yes)
    (CONNECT_DATA =
    (SERVER = DEDICATED)
    (SERVICE_NAME = markadb_srv)
    (FAILOVER_MODE =
    (TYPE = SELECT)
    (METHOD = BASIC)
    (RETRIES = 180)
    (DELAY = 5)
    Node 1 "Listener"
    LISTENER_MARKADB1 =
    (DESCRIPTION_LIST =
    (DESCRIPTION =
    (ADDRESS = (PROTOCOL = TCP)(HOST = 172.29.11.22)(PORT = 1521))
    (DESCRIPTION =
    (ADDRESS = (PROTOCOL = TCP)(HOST = 172.29.11.20)(PORT = 1521))
    Node 2 "Tnsname" :
    MARKADB_SRV =
    (DESCRIPTION =
    (ADDRESS = (PROTOCOL = TCP)(HOST = 172.29.11.22)(PORT = 1521))
    (ADDRESS = (PROTOCOL = TCP)(HOST = 172.29.11.23)(PORT = 1521))
    (LOAD_BALANCE = yes)
    (CONNECT_DATA =
    (SERVER = DEDICATED)
    (SERVICE_NAME = markadb_srv)
    (FAILOVER_MODE =
    (TYPE = SELECT)
    (METHOD = BASIC)
    (RETRIES = 180)
    (DELAY = 5)
    Node 2 "Listener"
    LISTENER_MARKADB2 =
    (DESCRIPTION_LIST =
    (DESCRIPTION =
    (ADDRESS = (PROTOCOL = TCP)(HOST = 172.29.11.23)(PORT = 1521))
    (DESCRIPTION =
    (ADDRESS = (PROTOCOL = TCP)(HOST = 172.29.11.21)(PORT = 1521))
    But all traffic goes to node 1 , and when node 1 goes down its not converting to node 2 as we all know but to another site /Failover ( I got Oracle Stream )
    Any Solution Guys ?

  • Delete oracle RAC node - still appear on addNode script

    Hello ,
    I delete one from oracle RAC have 3 node .
    I try to re-install it again but it give me below error :
    The following error was encountered for new node . the node names rac3 are unique ...
    it still appear on add node ! why ?
    [oracle@rac1 dev]$ /u01/crs/oracle/product/10.2.0/crs/bin/crs_stat -t
    Name           Type           Target    State     Host       
    ora....C1.inst application    ONLINE    OFFLINE              
    ora....C2.inst application    ONLINE    OFFLINE              
    ora.RAC.db     application    ONLINE    OFFLINE              
    ora....SM1.asm application    ONLINE    ONLINE    rac1       
    ora....C1.lsnr application    ONLINE    OFFLINE              
    ora.rac1.gsd   application    ONLINE    OFFLINE              
    ora.rac1.ons   application    ONLINE    ONLINE    rac1       
    ora.rac1.vip   application    ONLINE    ONLINE    rac1       
    ora....SM2.asm application    ONLINE    OFFLINE              
    ora....C2.lsnr application    ONLINE    OFFLINE              
    ora.rac2.gsd   application    ONLINE    OFFLINE              
    ora.rac2.ons   application    ONLINE    OFFLINE              
    ora.rac2.vip   application    ONLINE    ONLINE    rac1
    Can you help please how to solve this issue  ?
    Thanks

    Hello ,
    Finally done
    /u01/crs/oracle/product/10.2.0/crs/install/rootdeletenode.sh rac3,3
    /u01/crs/oracle/product/10.2.0/crs/bin/olsnodes -n now it done appear
    but still same error appear .......
    so after
    /u01/crs/oracle/product/10.2.0/crs/oui/bin/runInstaller -updateNodelist ORACLE_HOME=/u01/crs/oracle/product/10.2.0/crs/ "CLUSTER_NODES={rac1,rac2}" CRS=true
      445  locate racgons
      446  /u01/crs/oracle/product/10.2.0/crs/bin/racgons remove_config rac3
    Regards,
    Mohanad Awad

  • Oracle RAC 11g query

    Hi All,
    I am new to Oracle RAC 11g, facing a issue, Request all to help.
    1) What is the instance id means which we get from gv$session in Oracle RAC setup?
    2) What is differnce between Session failure and node failure?
    3) If session fail, then client should connect to node1(to which session previously connected) or node2?
    Thanks

    1) What is the instance id means which we get from gv$session in Oracle RAC setup?Instance ID is unique for each instance in clustered database.
    2) What is differnce between Session failure and node failure?Session Failure - when the connection to an instance is lost, SESSION failover results only in the establishment of a new connection to another Oracle RAC node
    Node Failure/Eviction - we can say hardware fails, the Cluster Manager reports the change in the cluster's membership to Global Resource Directory (GRD)
    Resource directory which consists of both Global enqueue service & cache service
    3) If session fail, then client should connect to node1(to which session previously connected) or node2?You have to configure in SERVICE.

  • How to establish user equvalance between 2 rac nodes on non default ports??

    Hi Friends,
    Please shed some light on how to establish user equvalance between 2 rac nodes on non default ports such as ssh on 22...
    i want to establish user equvalance on other ports..
    Thanks
    RB

    R12DBA wrote:
    Hi Friends,
    Please shed some light on how to establish user equvalance between 2 rac nodes on non default ports such as ssh on 22...
    i want to establish user equvalance on other ports..
    Thanks
    RBHi RB ,
    22 is default port for ssh. For configuring
    http://yasarmoran.wordpress.com/2010/06/12/configuring-ssh-on-oracle-rac-nodes/
    For non default port , first of all you need to configure ssh on new port . For that refer :
    http://www.itworld.com/nls_unixssh0500506

  • Oracle Rac - Targetting clients to particular nodes?

    We have a deployment case that wanted to find out best practices.
    Currently there is a two node RAC setup.
    We have an application that on one side -- is a high write, minor read component -- and another side which is mostly read and minor write. Each component uses multiple connections and have logical separations of what tables they are writing to.
    The current proposed solution is to target the high write components to one node instance -- while distributing the other component, which does A LOT of reading and some writing, across both RAC instances.
    The question is what is the best paradigm for this: Any documentation of when to target components to single instances versus letting RAC do it's own distribution/etc. There are different user accounts for the components that do the high volume writing versus the selecting/etc..
    Thanks.

    Hi,
    The question is what is the best paradigm for this: Any documentation of when to target components to single instances versus letting RAC do it's own distribution/etc. There are different user accounts for the components that do the high volume writing versus the selecting/etc..I'm assuming you're using version 10g or later. On Oracle RAC 9i you don't have this feature.
    You can direct connections to nodes that have characteristics in common workload using Oracle Services.
    To manage workloads or a group of applications, you can define services that you assign to a particular application or to a subset of an application's operations. You can also group work by type under services.
    Oracle recommends that all users who share a service have the same service level requirements. You can define specific characteristics for services and each service can be a separate unit of work. There are many options that you can take advantage of when using services. Although you do not have to implement these options, using them helps optimize application performance.
    When you define a service, you define which instances normally support that service. These are known as the PREFERRED instances. You can also define other instances to support a service if the service's preferred instance fails. These are known as AVAILABLE instances.
    Services are integrated with Resource Manager, which enables you to restrict the resources that are used by the users who connect with a service in an instance. The Resource Manager enables you to map a consumer group to a service so that users who connect with the service are members of the specified consumer group.
    Using a Service (11.1 or later) when you execute a SQL statement in parallel, the parallel processes only run on the instances that offer the service with which you originally connected to the database. This is the default behavior. This does not affect other parallel operations such as parallel recovery or the processing of GV$ queries. To override this behavior, set a value for the PARALLEL_INSTANCE_GROUP initialization parameter.
    You'll have much more concept to learn how it works than to know how to configure.
    Understanding how it works is essential to configure the services properly.
    http://download.oracle.com/docs/cd/B28359_01/rac.111/b28254/hafeats.htm#CHDGEBED
    http://www.ardentperf.com/pub/schneider-services.pdf
    Any questions just ask.
    Regards,
    Levi Pereira

  • In oracle rac, If user query a select query and in processing data is fetched but in the duration of fetching the particular node is evicted then how failover to another node internally?

    In oracle rac, If user query a select query and in processing data is fetched but in the duration of fetching the particular node is evicted then how failover to another node internally?

    The query is re-issued as a flashback query and the client process can continue to fetch from the cursor. This is described in the Net Services Administrators Guide, the section on Transparent Application Failover.

  • ASM instances on 2 node Oracle RAC 10g r2  on Red Hat 4 u1

    Hi all
    I'm experiencing a problem in configuring diskgroups under +ASM instances on a two node Oracle RAC.
    I followed the official guide and also official documents from metalink site, but i'm stuck with the visibility of asm disks.
    I created fake disks on nfs with Netapp certified storage binding them to block device with the usual trick "losetup /dev/loopX /nfs/disk1 " ,
    run "oracleasm createdisk DISKX /dev/loopX" on one node and
    "oracleasm scandisks" on the other one.
    With "oracleasm listdisks" i can see the disks at OS level in both nodes , but , when i try to create and mount diskgroup in the ASM instances , on the instance on which i create the diskgroup all is well, but the other one doesn't see the disks at all, and diskgroup mount fails with :
    ERROR: no PST quorum in group 1: required 2, found 0
    Tue Sep 20 16:22:32 2005
    NOTE: cache dismounting group 1/0x6F88595E (DG1)
    NOTE: dbwr not being msg'd to dismount
    ERROR: diskgroup DG1 was not mounted
    any help would be appreciated
    thanks a lot.
    Antonello

    I'm having this same problem. Did you ever find a solution?

  • Oracle RAC 11g on Windows 2008 64 bit - blue screen error on both nodes

    Hi Everyone,
    I installed Oracle RAC 11g on Windows 2008 64 bit, The installation was successfull and crs_state -t shows all services in two nodes are online.
    When executed a select query with 100 sessions( For performance evaluation using Transaction generator ) ,the machine got crashed and blue screen is appeared on two nodes. I restrated the machines and and starts the same evaluation ,bt the same bug is repeating.
    Can anyone suggest a solution to solve this issue? Is our hardware is not sufficient ? Shall we need to perform any
    specific settings in Oracle RAC setup for performance evaluations?
    Is our settings for load balancing is not enough? ( We added "Load Balancing= On" on tnsnames.ora on client for load
    balancing)
    The following machine configuration is used for Oracle RAC setup
    Intel Core 2 Duo 2.66 GHz,
    Ram :4GB.
    OS : windows 2008 Server 64 Bit
    Oracle RAC 11g , Clusterware 11g R2 , ASM with 5 raw disk ( 1- votting disk ,1- ocr files and 3 disk files)
    Edited by: user2033016 on Jun 29, 2011 10:02 PM

    user2033016 wrote:
    Hi Everyone,
    I installed Oracle RAC 11g on Windows 2008 64 bit, The installation was successfull crs_state -t executed successfully.
    Bt the machine got crashed ,when executed a select query with 100 sessions( For performance evaluation using TG). A blue screen is appeared on two nodes. So i am not able to evaluate the performance.
    Can you please tell any suggesstions to solve this issue? Is our hardware is not sufficient? Or any software settings has to be done?. I tried most of hte technique ,bt the problem still exists.
    The following machine configuration is used for Oracle RAC setup
    Intel Core 2 Duo 2.66 GHz,
    Ram :4GB.
    OS : windows 2008 Server 64 Bit
    Oracle RAC , Clusterware 11g R2 64 Bit.i guess you have installed/configured RAC using VMware. i guess, the problem is with your RAM size. how much disk space and RAM size you have allocated for each machine?
    which documentation you have followed?

  • Running Oracle database 10g and 11g on same 5 RAC nodes

    Hello Gurus,
    Could any body throw light if I can install and sucessfully run Oracle database 10g and 11g on the same Oracle RAC installation setup.My setup is below
    Number of nodes-5
    OS- windows 2003 or RHEL5
    storage- DELL EMC SAN
    Clusterware- oracle version11g
    File system-Automatic storage management(ASM)
    After I successfully setup clusterware,ASM on the nodes,I would want to install 11g database on all 5 nodes .
    Then Install 10g database on only 3 of the nodes using the same clusterware.
    What are your views on the same.
    Also FYI... as per metalink node 220970.1(RAC: Frequently Asked Questions) one can do such a setup.
    what iam looking for is practical experience if anyone has implemented this in production system,if yes any issues faced and how tough it is to support.
    Thanks,
    Imtiyaz

    You could run an 11g database and 10g database on the same cluster as long as you use Clusterware 11g.
    The administration aspect will drastically change according to the platform you run on. As of now, it appears you don't know whether it will be Linux or Windows.
    It would be practical to support the same database release.

Maybe you are looking for