Facing problem in deleting RAC node.

Dear All,
Please guide me, I am in a critical situation due to my own mistake,
during node deletion process, I forgot to to mention CRS=true during
$ ./runInstaller -updateNodeList ORACLE_HOME=$ORA_CRS_HOME CLUSTER_NODES="" -local CRS=true
and uninstall the cluster software, now when mentioned the below command, it failed.
$ ./runInstaller -updateNodeList ORACLE_HOME=$ORA_CRS_HOME "CLUSTER_NODES={linux1,linux2}" CRS=true
Please tell me how can I adjust my mistake.
Many Thanks!

On what node are you running the command:
/runInstaller -updateNodeList ORACLE_HOME=$ORA_CRS_HOME "CLUSTER_NODES={linux1,linux2}" CRS=true ?
This should be run on one of the remaining nodes. Are Linux1 and linux2 remaining nodes ?
Michael

Similar Messages

  • Issues while Add / Delete RAC Node in Oracle 10g R2

    Hi,
    I have an requirement to add a New Node in the existing 2 Node RAC at Production, where 1 Node is Active & other one is passive due to licence issue & cannot keep both the nodes as active. Due to performance issues (Memory , CPU Cores ..etc) we are adding another new node.
    Right now we are planning to add a 3rd database node making the new node as active and current active one as passive which is a swap & later on after final observation delete and decommission the current passive node.
    This activity is checked at the Dev database with the same infrastructure (OS + Memory ..etc) but want to check what is the best approach (or) challenges we face during the RAC Node Addition / Deletion
    RAC DB Version : 10.2.o.4
    OS Version : RHEL 5.8
    (1) Is the approach is right one , First Adding the node & later on delete
    (2) If the approach is the correct , what would be the behavious of the 3rd node in means of active (or) passive
    (3) We have taken RMAN backup , OS backup , CRS , ORACLE_HOME , ASM_Home backup , OCR & VD.
    (4) Could you please give detail steps for adding / deleting node in 10g R2.
    (5) Are they any known bugs to us with the DB release (or) OS while performing this activity.
    Since this is a production machine we want to more proactive . Please correct or add any thing i am missing out ...
    With Thanks,
    Rakesh

    Hello Rakesh,
    Please follow the following steps.
    Node Addition Steps
    1. Install and configure OS and hardware for new node.
    2. Add Oracle Clusterware to the new node.
    3. Configure ONS for the new node.
    4. Add ASM home to the new node.
    5. Add Databse home to the new node.
    6. Add a listener to the new node.
    7. Add ASM instance to the New Node.
    8. Add a database instance to the new node.
    Details of steps
    1. run cluvfy to verify whether New node is ready for addition or not.
         $ cluvfy stage -pre crsinst -n node2
    2. from node1, execute
              $/u01/app/crs11g/oui/bin/addNode.sh
    3. Specify node2 vip address and follow instructions.
    4. In the last of installtion it may through an wornig and will ask to click on YES. click on YES
    5. from node1,
              /u01/app/crs11g/bin/racgons add_config node2:6200
    6. from Node1,set ORACLE_HOME=ASM_HOME and then execute addNode.sh from $ASM_HOME/oui/bin and Follow instrusctions.
    7. From node1, set ORACLE_HOME=DB_HOME and then
         /u01/app/oracle/product/11.1.0/db_1/oui/bin/addNode.sh
         and Follow instructions.
    8. from node2 start NETCA and configure listener for new node. While configuring Listener select the name of new node.
    9. from node1 start dbca from ASM Home to configure ASM instance for new node.
    10. Again from node1 start dbca from DB Home to add DB instance
    Node deletion Steps
    1. Delete the Database instance on the node to be deleted.
    2. Clean up the ASM instance.
    3. Remove the listener from the node to be deleted.
    4. Remove the node from the database.
    5. Remove the node from ASM.
    6. Remove ONS configuration from the node to be deleted.
    7. Remove the node from the clusterware
    Details of Steps
    1. Remove database Instance of node2
         Dbca -> instance Management -> delete instance -> password for sys -> select node -> finish.
    2. Stop asm for node2 from any nodes.
         $srvctl stop asm –n node2
    3. Remove asm for node2
         $ srvctl remove asm -n node2
    4. Remove Listener from Node2 using NETCA.
    5. From Node2:
              ./runInstaller -updateNodeList ORACLE_HOME=$ORACLE_HOME "CLUSTER_NODES=node2" -local
    6. From Node2, start runinstaller from Oracle_DB_Home/oui/bin, and remove "DB_HOME"
         $ ./runinstaller
         On the WELCOME Screen -> Deinstall product -> Select dbhome name (OraDb10g_Home1) -> Remove
    7. From Node1:
              ./runInstaller -updateNodeList ORACLE_HOME=$ORACLE_HOME "CLUSTER_NODES=node1"
    8. From Node2, set Oracle_Home to asm_1 and then fire:
              ./runInstaller -updateNodeList ORACLE_HOME=$ORACLE_HOME "CLUSTER_NODES=node2" -local
    9. From Node2, start OUI and deinstall ASM Home.
    10. From Node1, Set ORACLE_HOME= /u01/app/oracle/product/11.1.0/asm_1
    11. From Node1: from /u01/app/oracle/product/11.1.0/asm_1/oui/bin, start OUI
              ./runInstaller -updateNodeList ORACLE_HOME=$ORACLE_HOME "CLUSTER_NODES=node1"
    12. From Node2: as a root user (#) execute rootdelete.sh from /u01/app/crs11g/install
         # /u01/app/crs11g/install/rootdelete.sh
    13.From Node-1 first find out the node numbers
         # /u01/app/crs11g/bin/olsnodes -n
         output : node1 1
              node2 2
    14. From Node-1 as a root user (#):
         # /u01/app/crs11g/install/rootdeletenode.sh node2[Node_Name] 2[node_no]
         output:
              CRS nodeapps are deleted successfully
              clscfg: EXISTING configuration version 4 detected.
              clscfg: version 4 is 11 Release 1.
              Node deletion operation successful.
              'node2' deleted successfully
    15. From Node2 set ORACLE_HOME=CRS_HOME and then execute
         $$ORACLE_HOME/oui/bin/runInstaller -updateNodeList ORACLE_HOME=$ORACLE_HOME "CLUSTER_NODES=node2" CRS=TRUE -local
    16. ./runInstaller and remove CRS_HOME
    17. From Node-1:
         $ /u01/app/crs11g/oui/bin/runInstaller -updateNodeList ORACLE_HOME=$ORACLE_HOME "CLUSTER_NODES=node1" CRS=TRUE
    18. check node is deleted from ./crs_stat -t

  • Facing problem While deleting rows and adding rows

    Hi,
    In my form i have pass values to table rows by selecting values from Dropdown list.
    i have taken 3 hidden obj and passing the dropdown values to hidden objects and then from hidden objects to table rows.
    h1,h2,h2 are hidden obj
    EMPNO,EMPNAME, DESIGNATION are drop downlist
    i have add button with the following code
    if(form1.P1.ItemSet.EMPNO.rawValue != null){
    form1.P1.ItemSet.instanceManager.addInstance();
    form1.P1.execInitialize();
    var dynamicArray = form1.P1.resolveNode("ItemSet[" + arrayIncri + "]");
    dynamicArray .EMPNO.rawValue = form1.P1.hidden.h1.rawValue;
    dynamicArray .EMPNAME.rawValue = form1.P1.hidden.h2.rawValue;
    dynamicArray .DESIGNATION.rawValue = form1.P1.hidden.h3.rawValue;
    arrayIncri++;
    form1.P1.SF1.EmpID.rawValue = null;
    form1.P1.SF1.EmpName.rawValue = null;
    form1.P1.SF1.Designation.rawValue = null;
    My delete button code is
    _ItemSet.removeInstance(this.parent.index);
    form1.P1.execInitialize();
    My problem is adding is happening while click and deleting is happening to the perticular row but once i delete paricular row then again if i want to add new row then it is taking null values . and agian if i click add then the values are passing to the next row
    means i am getting null row if i do add funtionality after delete funtionality....
    Please help me out in this..
    Subba reddy

    Hi,
    I got the answer for this query, but when i do download and upload of the files from R/3 to GRC. Still it is not showing me the new transactions which were developed in R/3.
    it means when i try to add the transaction in a function, under search mode with respective of the r/3 system, it is not showing me the search results.
    What i did was, i run the reports /VIRSA/ZCC_DOWNLOAD_DESC & /VIRSA/ZCC_DOWNLOAD_SAPOBJ and uploaded them as below in GRC.
    Text Objects - /VIRSA/ZCC_DOWNLOAD_DESC
    permissions   -  /VIRSA/ZCC_DOWNLOAD_SAPOBJ
    For each of the download i get 2 files for each and i tried to upload both of them but no luck.
    Please suggest me, as am missing anything in this process
    SV

  • Facing problem while deleting a child record in hibernate.

    I am trying to update a child records i have following scenario
    master record (having one to many assciation with child table cascade=all in .hbm.xml configuration file) ===> customerInfo
    detail record set (having many to one assciation with master table cascade=all in .hbm.xml configuration file) ===> customerAccountsSet
    i do following steps to update a record
    1) get the customerInfo objetc from session successfully
    2) get the customerAccountsSet = customerInfo.getCustomerAccounts();
    3) traying to add a new customerAccount say customerAccount1 to be saved for the first time without primery key in it
    4) traying to update a customerAccount say customerAccount2 to be updated with primery key in it
    5) traying to add a delete customerAccount say customerAccount3 with primery key in it
    only step 5 is not executed properly as i can still see the deleted record in db , although save and update steps have been successfully completed in db.
    can anybody tell me whats going wrong here.code for steps 2,3,4,5 is as follows in the same order
    2)Set customerAccountSet = (Set) customerInfo.getCustomerAccounts();
    3)customerAccountSet.add(customerAccount);
    4)customerAccountSet.add(customerAccount);
    5)customerAccountSet.remove(customerAccount);

    Hi Nitesh,
    1) Java stack should be up while trying to connect to R/3 backend.
    2) You can check the JCOs by doing the following:
                           Type the following url   http://<server name>:<port number>
                           Click on Webdynpro Console
                           Enter the user name and password.(You need the system admin right on the EP to do the same)
                           You can find the JCOs.
    3) Better you contact the basis guy who had created the JCOs earlier and get the JCOs tested.
    Hope it helps.
    Regards.
    Rajat
    Edited by: Rajat Jain on Oct 12, 2009 1:47 PM

  • Remove RAC node on Windows

    I have done all the steps to remove one RAC node but got stuck at the step of running rootdelete.sh file from $CRS_HOME/install directory as I don't have this file in windows environment.
    What is the equivalent file for rootdelete.sh on windows platform. I want to run this to remove the node info from the clusterware entry.
    Is there a good document that explains about removing the node on windows platform.

    Hello,
    You need to run the following steps to remove a node from a RAC cluster on Windows platform:
    Perform the following steps on a node other than the node you want to delete:
    1. Run the Database Configuration Assistant (DBCA) utility to delete the instance.
    2. Then run the Net Configuration Assistant (NetCA) to delete the listener.
    3. If the node that you are deleting has ASM instance, then delete the ASM instance using the srvctl stop asm and srvctl remove asm commands.
    4. Run the command srvctl stop nodeapps -n nodename of the node to be deleted to stop the node applications.
    5. Run the command srvctl remove nodeapps -n nodename of the node to be deleted to remove the node applications.
    6. Stop isqlplus if it is running.
    7. Run the command setup.exe -updateNodeList ORACLE_HOME=Oracle_home ORACLE_HOME_NAME=Oracle_home_name CLUSTER_NODES=remaining
    nodes where remaining nodes is a list of the nodes that are to remain part of the cluster.
    Perform the following steps on the deleted RAC node:
    1. Run the command setup.exe -updateNodeList -local -noClusterEnabled ORACLE_HOME=Oracle_home ORACLE_HOME_NAME=Oracle_home_name CLUSTER_NODES="".
    Note that you do not need a value for "" after the CLUSTER_NODES= entry in this command. If you delete more than one node, then you must run this command on every deleted node to remove the Oracle home if you have a non-shared Oracle home (non-cluster file system) installation.
    2. On the same node, delete the Windows Registry entries and ASM services using Oradim.
    3. From the deleted RAC node, run the command Oracle_home\oui\bin\setup.exe to start the Oracle Universal Installer (OUI). Select Deinstall Products and select the Oracle home that you want to de-install.
    4. Then to delete the CRS node, from a remaining node run the command crssetup del -nn node_name of the deleted node, node number
    5. Then run the command setup.exe -updateNodeList ORACLE_HOME=CRS home ORACLE_HOME_NAME=CRS home name CLUSTER_NODES=remaining nodes where remaining nodes is a list of the nodes that are to remain in the cluster.
    6. Then on the deleted CRS node, run the command setup.exe -updateNodeList -local -noClusterEnabled ORACLE_HOME=CRS home ORACLE_HOME_NAME=CRS home name CLUSTER_NODES=""
    7. Remove the Oracle home manually from the new node if the home is not shared and then manually remove the HKLM/software/Oracle registry keys and the Oracle services. 7
    8. After adding or deleting nodes from your Oracle Database 10g with RAC environment, and after you are sure that your system is functioning properly, make a backup of the contents of the voting disk using the dd.exe utility. The dd.exe utility is part of the MKS toolkit.
    ASM Instance Cleanup Procedures after Node Deletion on Windows-Based Platforms
    The delete node procedure requires the following additional steps on Windows-based systems to remove the ASM instances:
    1. If this is the Oracle home from which the node-specific listener named LISTENER_nodename runs, then use NetCA to remove this listener and its CRS resources. If necessary, re-create this listener in another home.
    2. If this is the Oracle home from which the ASM instance runs, then remove the ASM configuration by running the following command for all nodes on which this Oracle home exists:
    srvctl stop asm -n node
    Then run the following command for the nodes that you are removing:
    srvctl remove asm -n node
    3. If you are using a cluster file system for your ASM Oracle home, then run the following commands on the local node:
    4. rd -s -q %ORACLE_BASE%\admin\+ASM
    delete %ORACLE_HOME%\database\*ASM*
    5. If you are not using a cluster file system for your ASM Oracle home, then run the delete command mentioned in the previous step on each node on which the Oracle home exists.
    6. Run the following command on each node that has an ASM instance:
    oradim -delete -asmsid +ASMnode_number
    Source:
    Oracle® Real Application Clusters Administrator's Guide
    10g Release 1 (10.1)
    Part Number B10765-02
    Chapter 5: Adding and Deleting Nodes and Instances
    Hope this helps,
    Ben Prusinski, Oracle 10g OCP
    http://oracle-magician.blogspot.com

  • Looping and Deleting XML Nodes

    A bit perplexed about what is likely a simple problem.
    Say I have the following XML (myXML):
    <stories>
    <story id="1"/>
    <story id="2"/>
    <story id="3"/>
    <otherNode id="15"/>
    <otherNode id="15"/>
    </stories>
    I want to delete nodes with id's of one and two.
    So I currently have:
    for (var nodeIndex in myXML.story) {
    var nodeValue = myXML.story[nodeIndex];
    if (nodeValue != undefined) {
    if (nodeValue.@id == "1" || nodeValue.@id == "2") {
    delete myXML.story[nodeIndex];
    The problem: After deleting the node with id="1" the very next iteration is the node with id="3" - the node with id="2" is never read.
    While it totally makes sense to me, my only dummified solution was to switch to a numeric loop and use nodeIndex-- when I delete a node. But that seems rather unelegant.

    Hi,
    elegant:
    delete myXML.story.(@id = '1')[0];
    delete myXML.story.(@id = '2')[0];
    But you should know that you have only one element with this id.

  • RAC Node hang and unexpected reboot

    Hello friends      
    We are facing the intermittent issue of node hang and unexpected shutdown of node. This is 2 node rac 10.2.03 running on windows 2003. Here's crsd.log
    2009-07-16 17:24:03.058: [ OCRMSG][5252]prom_rpc: CLSC recv failure..ret code 7
    2009-07-16 17:24:03.058: [ OCRMSG][5252]prom_rpc: possible OCR retry scenario
    2009-07-16 17:24:03.058: [ COMMCRS][5616]clscsendx: (0000000002AF5C60) Physical connection (0000000003892080) not active
    2009-07-16 17:24:03.058: [ OCRMSG][5616]prom_rpc: CLSC send failure..ret code 11
    2009-07-16 17:24:03.058: [ OCRMSG][5616]prom_rpc: possible OCR retry scenario
    2009-07-16 17:24:03.105: [ COMMCRS][5252]clscsendx: (0000000002AF5C60) Connection not active
    2009-07-16 17:24:03.105: [ OCRMSG][5252]prom_rpc: CLSC send failure..ret code 6
    2009-07-16 17:24:03.105: [ OCRMSG][5252]prom_rpc: possible OCR retry scenario
    2009-07-16 17:24:03.105: [ COMMCRS][5616]clscsendx: (0000000002AF5C60) Connection not active
    2009-07-16 17:24:03.105: [ OCRMSG][5616]prom_rpc: CLSC send failure..ret code 6
    2009-07-16 17:24:03.105: [ OCRMSG][5616]prom_rpc: possible OCR retry scenario
    2009-07-16 17:24:03.152: [ COMMCRS][5252]clscsendx: (0000000002AF5C60) Connection not active
    2009-07-16 17:24:03.152: [ OCRMSG][5252]prom_rpc: CLSC send failure..ret code 6
    2009-07-16 17:24:03.152: [ OCRMSG][5252]prom_rpc: possible OCR retry scenario
    2009-07-16 17:24:03.168: [ COMMCRS][5616]clscsendx: (0000000002AF5C60) Connection not active
    2009-07-16 17:24:03.168: [ OCRMSG][5616]prom_rpc: CLSC send failure..ret code 6
    2009-07-16 17:24:03.168: [ OCRMSG][5616]prom_rpc: possible OCR retry scenario
    2009-07-16 17:24:03.215: [ COMMCRS][5252]clscsendx: (0000000002AF5C60) Connection not active
    2009-07-16 17:24:03.215: [ OCRMSG][5252]prom_rpc: CLSC send failure..ret code 6
    2009-07-16 17:24:03.215: [ OCRMSG][5252]prom_rpc: possible OCR retry scenario
    2009-07-16 17:24:03.215: [ COMMCRS][5616]clscsendx: (0000000002AF5C60) Connection not active
    2009-07-16 17:24:03.215: [ OCRMSG][5616]prom_rpc: CLSC send failure..ret code 6
    2009-07-16 17:24:03.215: [ OCRMSG][5616]prom_rpc: possible OCR retry scenario
    2009-07-16 17:24:03.261: [ COMMCRS][5616]clscsendx: (0000000002AF5C60) Connection not active
    2009-07-16 17:24:03.261: [ OCRMSG][5616]prom_rpc: CLSC send failure..ret code 6
    2009-07-16 17:24:03.261: [ OCRMSG][5616]prom_rpc: possible OCR retry scenario
    Please throw me the light, what may be issue.

    I suggest you install [ IPD/OS|http://www.oracle.com/technology/products/database/clustering/ipd_download_homepage.html] on you cluster. This will give you all the relevant OS statistics so when a node reboot happens, you can figure out what the state of the nodes was at that time and then fix the problem. The hang is often caused by something other than Oracle RAC.

  • Rac node failure crs cleanup failing

    I have a three node rac database, 10.2.0.4 running on Windows server 2008. I lost a hard drive on one of the servers and it corrupted the mirror disk as well so I am having to rebuild. I am going through these procedures, RAC on Windows: How to Cleanup When A Node Has Been Disconnected or The OS Rebuilt (Doc ID 742737.1) and am running into a problem once I tried to delete the listener and then on to crs to delete the nodeapps for node3.
    For the listener, I go into netca and the option to delete a listener is grayed out. When I run crs_stat I can still see the ora.node3.lsnr there. Does this mean that I just need to update tnsnames.ora or is there another place the information would be held? I hate to manually delete because I am afraid I won't get it cleaned out from everywhere. Any idea why that option would not be there?
    My second issue is when I run this:
    srvctl stop nodeapps -n node3 The nodeapps stop doesn't return any output and then when I try to remove nodeapps it gives me PRKO-2112: Some or all node applications are not removed successfully on node.
    I have searched metalink for that error with no success as the document I found also says that you must stop nodeapps. I have already deleted the node from the db and asm and updated the appropriate inventory. I just need to finish the listener and crs and update the inventory for crs. Also, I noticed that the vip for the failed node was reassigned to node2 and I show that it has been released when i run cluvfy to check. Would crs give me errors on this if that was not the case?
    I appreciate any help or guidance!

    Wanted to post a follow up in case any others are interested in the results...
    I had tried to add the listener back to one of the remaining nodes .ora file and then delete but that didn't work. Also, remove nodeapps continued to throw an error that it could not stop the listener or vip for the failed node.
    After a few days of reading I make a decision to just unregister the abandoned services from crs. I made sure to backup the OCRCONFIG before I ran crs_unregister and was able to successfully remove the listener and vip services from the failed node.
    This eliminated my issue with netca, the node did not show up there anymore. I then went on to remove nodeapps and it failed saying it could not find the resource vip. I then ran olsnodes -n and used crssetup to remove the node entirely. Everything showed removed and I went and updated the crs inventory to finish.
    All looks good and now I am working to rebuild and add the node back in.

  • RAC node restarting!

    hi
    one of our RAC environment keep restarting.
    i've disable the init.cssd, init.crs, init.evmd in the /etc/inittab in order to check the logs.
    this is the situation:
    crsd.log:
    2009-02-04 00:09:00.118: [ COMMCRS][9]clsc_connect: (8000000100318640) no listener at (ADDRESS=(PROTOCOL=ipc)(KEY=OCSSD_LL_node1_loud))
    2009-02-04 00:09:00.132: [ CSSCLNT][1]clsssInitNative: connect failed, rc 9
    2009-02-04 00:09:00.134: [  CRSRTI][1]32CSS is not ready. Received status 3 from CSS. Waiting for good status ..
    2009-02-04 00:09:08.016: [    CRSD][1]32Daemon Version: 10.2.0.2.0 Active Version: 10.2.0.2.0
    2009-02-04 00:09:08.016: [    CRSD][1]32Active Version and Software Version are same
    2009-02-04 00:09:08.017: [ CRSMAIN][1]32Initializing OCR
    2009-02-04 00:09:08.037: [  OCRRAW][1]proprioo: for disk 0 (/dev/rdsk/ora_ocr_raw), id match (1), my id set (752560621,1028247821) total id sets (1), 1st set
    (752560621,1028247821), 2nd set (0,0) my votes (2), total votes (2)
    2009-02-04 00:09:08.140: [ CSSCLNT][24]clssgsGroupJoin: CSS has not reached fatal mode.Registration is not yet safe. Retrying
    ocssd.log:
    [    CSSD]2009-02-03 21:52:08.651 [9] >USER: clssnmHandleUpdate: NODE 1 (node1l) IS ACTIVE MEMBER OF CLUSTER
    [    CSSD]2009-02-03 21:52:08.651 [9] >TRACE: clssnmHandleUpdate: diskTimeout set to (200000)ms
    [    CSSD]2009-02-03 21:52:08.651 [16] >TRACE: clssnmWaitForAcks: done, msg type(15)
    [    CSSD]2009-02-03 21:52:08.651 [16] >TRACE: clssnmDoSyncUpdate: Sync Complete!
    [    CSSD]2009-02-03 21:52:08.722 [1] >USER: NMEVENT_SUSPEND [00][00][00][00]
    [    CSSD]2009-02-03 21:52:08.724 [17] >TRACE: clssgmReconfigThread: started for reconfig (1)
    [    CSSD]2009-02-03 21:52:08.749 [17] >USER: NMEVENT_RECONFIG [00][00][00][02]
    [    CSSD]2009-02-03 21:52:08.749 [17] >TRACE: clssgmEstablishConnections: 1 nodes in cluster incarn 1
    [    CSSD]2009-02-03 21:52:08.751 [13] >TRACE: clssgmPeerListener: connects done (1/1)
    [    CSSD]2009-02-03 21:52:08.752 [17] >TRACE: clssgmEstablishMasterNode: MASTER for 1 is node(1) birth(1)
    [    CSSD]2009-02-03 21:52:08.752 [17] >TRACE: clssgmChangeMasterNode: requeued 0 RPCs
    [    CSSD]2009-02-03 21:52:08.752 [17] >TRACE: clssgmMasterCMSync: Synchronizing group/lock status
    [    CSSD]2009-02-03 21:52:08.752 [17] >TRACE: clssgmMasterSendDBDone: group/lock status synchronization complete
    [    CSSD]CLSS-3000: reconfiguration successful, incarnation 1 with 1 nodes
    [    CSSD]CLSS-3001: local node number 1, master node number 1
    [    CSSD]2009-02-03 21:52:08.753 [17] >TRACE: clssgmReconfigThread: completed for reconfig(1), with status(1)
    [    CSSD]2009-02-03 21:52:08.863 [10] >TRACE: clssgmClientConnectMsg: Connect from con(80000001008fd2a0) proc(8000000100ae26a8) pid() proto(10:2:1:1)
    [    CSSD]2009-02-03 21:52:08.864 [10] >TRACE: clssgmClientConnectMsg: Connect from con(8000000100ae0128) proc(8000000100ae2a10) pid() proto(10:2:1:1) from con(8000000100aa32c0) proc(8000000100aa5b90) pid() proto(10:2:1:1)
    alertlog:
    [cssd(2535)]CRS-1601:CSSD Reconfiguration complete. Active nodes are node1 .
    2009-02-03 23:55:20.821
    [cssd(2575)]CRS-1605:CSSD voting file is online: /dev/rdsk/ora_voting_raw. Detai ls in /work/crs/product/10.2/crs/log/lourmel/cssd/ocssd.log.
    2009-02-03 23:55:28.376
    evmd.log:
    Oracle Database 10g CRS Release 10.2.0.2.0 Production Copyright 1996, 2004, Oracle. All rights reserved
    2009-02-04 00:08:58.331: [    EVMD][1]32EVMD waiting for CSS to be ready err = 3
    2009-02-04 00:08:59.939: [ COMMCRS][9]clsc_connect: (800000010007d658) no listener at (ADDRESS=(PROTOCOL=ipc)(KEY=OCSSD_LL_node1_loud))
    2009-02-04 00:08:59.946: [ CSSCLNT][1]clsssInitNative: connect failed, rc 9
    2009-02-04 00:08:59.948: [    EVMD][1]32EVMD waiting for CSS to be ready err = 3
    2009-02-04 00:09:07.596: [ CSSCLNT][1]clssgsGroupJoin: CSS has not reached fatal mode.Registration is not yet safe. Retrying
    syslog:
    Feb 4 00:08:41 lourmel syslog: Oracle Cluster Ready Services starting up automatically.
    Feb 4 00:08:45 lourmel sfd[2153]: starting the daemon.
    Feb 4 00:08:45 lourmel su: + tty?? root-orac
    Feb 4 00:08:45 lourmel krsd[2152]: Delay time is 300 seconds
    Feb 4 00:08:43 lourmel syslog: Oracle Cluster Ready Services starting up automatically.
    Feb 4 00:08:52 lourmel above message repeats 2 times
    Feb 4 00:08:52 lourmel syslog: Cluster Ready Services completed waiting on dependencies.
    Feb 4 00:08:53 lourmel syslog: Running CRSD with TZ =
    when i checked(befor the restart) the command crs_stat i got the message:
    ORA-0184: Cannot communicate wirh CRS
    crsctl check crs gives us:
    Failure 1 contacting CSS daemon
    Cannot communicate with CRS
    Cannot communicate with EVM
    as i said befor, the machine always restarting
    anyone have an idea?? please

    Dear All,
    I recently upgrade the Few RAC setups with Oracle 10g Patchset 3 (10.2.0.4) on Linux Servers
    In one of the RAC setup, found servers are rebooting daily. The same setup was working fine and problem started only after applying the Patchset. Checked all the logs and Found nothing relevant.
    Then i checked the things which added with this Patchset.
    The Most interesting found , Oracle Added a New Daemon- oprocd.
    # ps -efl | grep oprocd
    4 S root 6440 6063 0 -40 - - 2114 - Mar03 ? 00:00:00 /opt/oracle/product/10.2.0/crs/bin/oprocd.bin run -t 1000 -m 500 -hsi 5:10:50:75:90 -f
    These are Interesting Points about above line
    1.This Process is running by root user
    2. With Highest Priority -40
    3. Probing every Seconds (t 1000)
    4. waiting CPU response for 500 Milliseconds ( -m 500 means margin time is 500 Milli Seconds)
    5. Process status is Fatal (-f)
    Now I am concluding these points- This daemon will probe cpu every second and wait for response within 500 Mill seconds. If in the 500 Milli second not getting any response from the cpu, will assume the CPU is hang and try to Reboot the Machine. The OPERATING SYSTEM will not get enough time to write the system logs and server reboots.
    So the solution is increase the Margin time for 500 Milli second to 10 seconds.
    These are following steps to increase the Margin time.
    Please Remember- The Modification process need Downtime and You need to stop cluster service in all member nodes.
    1. Stop The CRS Process
    #crsctl stop crs
    #<CRS_HOME>/bin/oprocd stop
    2. Ensure that Clusterware stack is down and not running
    #ps -ef |egrep "crsd.bin|ocssd.bin|evmd.bin|oprocd"
    This should return no processes.
    3. From one node of the cluster, change the value of the "diagwait" parameter to 13 by issuing the command as root:
    #crsctl set css diagwait 13 -force
    4. Check if diagwait is successfully set.
    #crsctl get css diagwait
    5. Restart the Oracle Clusterware on all the nodes by executing:
    #crsctl start crs
    (Note- If facing any problem to restarting the CRS services, ASM and Database, You can reboot the Nodes.The Cluster and Database will come automatically due to init startup scripts.)
    6. The oprocd daemon process will show with -m 10000
    # ps -efl| grep oprocd
    # 4 S root 6440 6063 0 -40 - - 2114 - Feb02 ? 00:00:00 /opt/oracle/product/10.2.0/crs/bin/oprocd.bin run -t 1000 -m 10000 -hsi 5:10:50:75:90 -f
    Rollback Procedure-
    If You need to unset oprocd value due any reason
    #crsctl unset css diagwait
    I am confident, The abnormal RAC Node restart problem will solve with this workaround.
    Regards,
    Sumit
    Bangalore,India

  • Oracle RAC Node Crashing

    Hi,
    We recently upgraded to Oracle RAC database to support Siebel Call Center APplication (8.1.1.11.12 [IP2013]).Oracle Database 11g Enterprise Edition Release 11.2.0.3.0 - 64bit Production
    Frequently we are facing problem of crashing with the Nodes in RAC (Kernal Panic). Due to this users using siebel application are unstable and facing multiple issues Once we restore Siebel Gateway and restart of AOM server fixing the issue.
    Below are the SQL's and Crashing Signature we are seeing du to this crash.
    DBCLog DBCLogError 1 00081f1254bb0ad4:1423830 2015-01-18 11:49:20 OCIStmtExecute: SELECT
    T2.CONFLICT_ID,
    T2.LAST_UPD,
    T2.CREATED,
    T2.LAST_UPD_BY,
    T2.CREATED_BY,
    T2.MODIFICATION_NUM,
    T2.ROW_ID,
    T2.EFF_START_TS,
    T2.EFF_END_TS,
    T2.NAME,
    T2.BUSOBJ_NAME,
    T2.VERSION,
    T2.DEPLOY_STATUS_CD,
    T2.MODE_CD
    FROM
    SIEBEL.S_LST_OF_VAL T1,
    SIEBEL.S_WFA_DPLOY_DEF T2
    WHERE
    T2.DEPLOY_STATUS_CD = T1.NAME AND T1.TYPE = 'WFA_DPLY_STAT_CD' AND T1.LANG_ID = :1 AND
    (T2.TYPE_CD IN ( :2 )) AND
    (T2.NAME = :3 AND T2.DEPLOY_STATUS_CD IN ( :4 ) AND (T2.EFF_END_TS > TO_DATE(:5,'MM/DD/YYYY HH24:MI:SS') OR T2.EFF_END_TS IS NULL))
    ORDER BY
    T2.NAME, T1.VAL
    ObjMgrLog Error 1 00081f1254bb0ad4:1423830 2015-01-18 11:49:20 (oracon.cpp (3896)) SBL-DBC-00105: An error has occurred executing a Sql statement.
    Please continue or ask your systems administrator to check your application configuration if the problem persists.
    and Crash Signature Looks like below
    Exception 0xc0000005 at 0x006500f6
    Thread: 0x00002700, Process 0x00000254
    Thread: 9984, Process 596
    - CONTEXT -
    EIP: 0x00000000, EFL: 0x00010246, FS:  0x0000003b, GS:  0x00000000
    CS:  0x0000001b, DS:  0x00000023, SS:  0x00000023, ES:  0x00000023
    EAX: 0x1a511968, EBX: 0x294ca048, ECX: 0x4cc50008, EDX: 0x3a2ad200
    ESI: 0x4cc50008, EDI: 0x00000000, EBP: 0x00000000, ESP: 0x3a2afff4
    - CALL STACK -
    sslcscr +0xf6
    sscfcmn +0x19050 = CSSObjectBase::CopyErrorMsg() +0xf0
    sscfcmn +0x1950d = CSSObjectBase::DoSetErrorMsg() +0x13d
    sscfcmn +0x19bb5 = CSSObjectBase::SetErrorMsg() +0xa5
    SSFACMBC +0x34a6 = CSSFABCVRec::IsBusinessProcessActive() +0x3b6
    SSFACMBC +0x5133 = CSSFABCVRec::VBCCreate() +0x1e3
    sscfom +0x71d1e = CSSBCVRec::SqlCreate() +0xde
    sscfom +0x4aea = CSSModel::ConstructBusComp() +0xaa
    sscfom +0x653f5 = CSSBusObj::GetBusComp() +0x265
    sscfom +0x65a18 = CSSBusObj::GetBusComp() +0x18
    sscfom +0x13ad8 = CSSModel::BeginSetupView() +0x418
    sscfom +0x13dee = CSSModel::BeginSetupView() +0x5e
    sscaswbc +0x8b070 = CSSSWEUdfLoader::BeginSetupView() +0x30
    sscaswbc +0xe3d88 = CSSSWEFrameMgrInternal::BuildView() +0x1618
    sscaswbc +0xe5646 = CSSSWEFrameMgrInternal::BuildView() +0x36
    sscaswbc +0xb8343 = CSSSWEActionMgr::ActionBuildViewAsync() +0x293
    sscaswbc +0xb873b = CSSSWEActionMgr::DoPostedAction() +0xab
    sscaswbc +0xb9287 = CSSSWEActionMgr::CheckPostedActions() +0x3d7
    sscaswbc +0xe6d41 = CSSSWEFrameMgrInternal::InvokeAppletMethod() +0x11b1
    sscaswbc +0xbbcdc = CSSSWECmdProcessor::InvokeMethod() +0x74c
    sscaswbc +0xc1495 = CSSSWECmdProcessor::_ProcessCommand() +0x725
    sscaswbc +0xc27f8 = CSSSWECmdProcessor::ProcessCommand() +0xab8
    sscaswbc +0xc2d04 = CSSSWECmdProcessor::ProcessCommand() +0xc4
    sscaswbc +0x265559 = CSSServiceSWEIface::Request() +0x309
    sscaswbc +0x267391 = CSSServiceSWEIface::DoInvokeMethod() +0xed1
    sscfom +0x1976c = CSSService::InvokeMethod() +0x24c
    sstcsiom +0x6d6a = CSSSIOMSession::ModInvokeSrvcMethod() +0x10a
    sstcsiom +0x7613 = CSSSIOMSession::RPCMiscModel() +0x513
    sstcsiom +0xe9dd = CSSSIOMSession::HandleRPC() +0x3ad
    sssasos +0x6616 = CompCleanup() +0x3be6
    sssasos +0x5a95 = CompCleanup() +0x3065
    sssasos +0x1a35 = CSSSISObject::operator=() +0x9f5
    sssasos +0x2135 = CompHandleMsg() +0x485
    siebmtshmw +0x494e
    siebmtshmw +0x20051 = GetSmiTaskAPI() +0x6d21
    siebmtshmw +0x239d1 = SmiInProcMsgHandler() +0x2051
    siebmtshmw +0x15f15 = SmiBeginTrace() +0x3195
    siebmtshmw +0x174cf = GetSmiWorkQObj() +0x148f
    siebmtshmw +0xc7f7 = SmiCleanupDetTask() +0x3be7
    sslcosd +0x2152 = OSDThreadPrivIsInit() +0x1d2
    sslcosd +0x21dc = OSDThreadPrivIsInit() +0x25c
    MSVCR71 +0x9565 = endthreadex() +0xa0
    kernel32 +0x2484f = GetModuleHandleA() +0xdf
    - STACK DUMP -
    - MODULE LIST -
    00400000-00445000: C:\siebel\siebsrvr\BIN\siebmtshmw.exe, 811.11.822.4
    7c800000-7c8c3000: C:\WINDOWS\system32\ntdll.dll, 5.2.3790.4937
    77e40000-77f44000: C:\WINDOWS\system32\kernel32.dll, 5.2.3790.5295
    10000000-10025000: C:\siebel\siebsrvr\BIN\ssscsci.dll, 811.11.822.4
    00320000-003cc000: C:\siebel\siebsrvr\BIN\ssscscf.dll, 811.11.822.4
    003d0000-003d7000: C:\siebel\siebsrvr\BIN\sslcosa.dll, 811.11.822.4
    7c340000-7c396000: C:\siebel\siebsrvr\BIN\MSVCR71.dll, 7.10.3052.4
    00450000-0054d000: C:\siebel\siebsrvr\BIN\sslcshar.dll, 811.11.822.4
    77380000-77411000: C:\WINDOWS\system32\USER32.dll, 5.2.3790.4033
    77c00000-77c49000: C:\WINDOWS\system32\GDI32.dll, 5.2.3790.5398
    7d1e0000-7d27c000: C:\WINDOWS\system32\ADVAPI32.dll, 5.2.3790.4455
    77c50000-77cf1000: C:\WINDOWS\system32\RPCRT4.dll, 5.2.3790.5254
    76f50000-76f63000: C:\WINDOWS\system32\Secur32.dll, 5.2.3790.4455
    77b90000-77b98000: C:\WINDOWS\system32\VERSION.dll, 5.2.3790.3959
    77ba0000-77bfa000: C:\WINDOWS\system32\msvcrt.dll, 7.0.3790.3959
    71bb0000-71bb9000: C:\WINDOWS\system32\WSOCK32.dll, 5.2.3790.0
    71c00000-71c17000: C:\WINDOWS\system32\WS2_32.dll, 5.2.3790.3959
    71bf0000-71bf8000: C:\WINDOWS\system32\WS2HELP.dll, 5.2.3790.3959
    003e0000-003e6000: C:\siebel\siebsrvr\BIN\libarm.dll, 811.10.822.3
    00550000-005d5000: C:\siebel\siebsrvr\BIN\sslcsym.dll, 811.11.822.4
    7c3a0000-7c41b000: C:\siebel\siebsrvr\BIN\MSVCP71.dll, 7.10.3077.0
    005e0000-005f1000: C:\siebel\siebsrvr\BIN\sslccore.dll, 811.11.822.4
    00600000-00618000: C:\siebel\siebsrvr\BIN\sslcosd.dll, 811.11.822.4
    00620000-00645000: C:\siebel\siebsrvr\BIN\sslcrsa.dll, 811.11.822.4
    00650000-0067f000: C:\siebel\siebsrvr\BIN\sslcscr.dll, 811.11.822.4
    00680000-007cf000: C:\siebel\siebsrvr\BIN\sslcsrd.dll, 811.11.822.4
    007d0000-0082b000: C:\siebel\siebsrvr\BIN\sslcscc.dll, 811.11.822.4
    003f0000-003ff000: C:\siebel\siebsrvr\BIN\sslcevt.dll, 811.11.822.4
    00830000-00840000: C:\siebel\siebsrvr\BIN\sslcsobj.dll, 811.11.822.4
    00840000-00850000: C:\siebel\siebsrvr\BIN\sslcsnns.dll, 811.11.822.4
    00850000-00931000: C:\siebel\siebsrvr\BIN\sslcnapi.dll, 811.11.822.4
    00940000-00954000: C:\siebel\siebsrvr\BIN\sslcns.dll, 811.11.822.4
    00960000-00968000: C:\siebel\siebsrvr\BIN\sslcsnsc.dll, 811.11.822.4
    00970000-0097b000: C:\siebel\siebsrvr\BIN\ssscsmi.dll, 811.11.822.4
    00980000-00991000: C:\siebel\siebsrvr\BIN\sslcsrvr.dll, 811.11.822.4
    009a0000-009bb000: C:\siebel\siebsrvr\BIN\sslcos.dll, 811.11.822.4
    009c0000-00a5f000: C:\siebel\siebsrvr\BIN\sscfcmn.dll, 811.11.822.4
    7c8d0000-7d0cf000: C:\WINDOWS\system32\SHELL32.dll, 6.0.3790.5018
    7d180000-7d1d2000: C:\WINDOWS\system32\SHLWAPI.dll, 6.0.3790.5318
    77670000-777aa000: C:\WINDOWS\system32\ole32.dll, 5.2.3790.5209
    7d0e0000-7d16c000: C:\WINDOWS\system32\OLEAUT32.dll, 5.2.3790.5464
    761b0000-76245000: C:\WINDOWS\system32\CRYPT32.dll, 5.131.3790.5235
    76190000-761a2000: C:\WINDOWS\system32\MSASN1.dll, 5.2.3790.4584
    77210000-772bb000: C:\WINDOWS\system32\WININET.dll, 6.0.3790.5467
    00a60000-00a70000: C:\siebel\siebsrvr\BIN\sslczlib.dll, 811.11.822.4
    00a70000-00b72000: C:\siebel\siebsrvr\BIN\MFC71U.DLL, 7.10.3077.0
    00b80000-00b88000: C:\siebel\siebsrvr\BIN\sslcsnsr.dll, 811.11.822.4
    00b90000-00b99000: C:\siebel\siebsrvr\BIN\sslcsrtr.dll, 811.11.822.4
    00ba0000-00baf000: C:\siebel\siebsrvr\BIN\sslcsrms.dll, 811.11.822.4
    00bb0000-00bb6000: C:\siebel\siebsrvr\BIN\sslcsssm.dll, 811.11.822.4
    00bc0000-00bd1000: C:\siebel\siebsrvr\BIN\sslcsrcn.dll, 811.11.822.4
    00be0000-00be7000: C:\siebel\siebsrvr\BIN\sslcsysstat.dll, 811.11.822.4
    00fe0000-0100d000: C:\siebel\siebsrvr\BIN\sslcrsa256.dll, 8.1.1.5
    77420000-77523000: C:\WINDOWS\WinSxS\x86_Microsoft.Windows.Common-Controls_6595b64144ccf1df_6.0.3790.5190_x-ww_319264BE\comctl32.dll, 6.0.3790.5190
    5d360000-5d36e000: C:\siebel\siebsrvr\BIN\MFC71ENU.DLL, 7.10.3077.0
    76b70000-76b7b000: C:\WINDOWS\system32\psapi.dll, 5.2.3790.3959
    012b0000-012c0000: C:\siebel\siebsrvr\BIN\sslcasrv.dll, 811.11.822.4
    012c0000-01328000: C:\siebel\siebsrvr\BIN\sslcsrs.dll, 811.11.822.4
    01330000-0133a000: C:\siebel\siebsrvr\BIN\sslcntfy.dll, 811.11.822.4
    01740000-01746000: C:\siebel\siebsrvr\BIN\enu\srcf.dll, 811.9.822.2
    01750000-01756000: C:\siebel\siebsrvr\BIN\enu\srcfapps.dll, 811.9.822.2
    01760000-01766000: C:\siebel\siebsrvr\BIN\sbcf.dll, 811.9.822.2
    01770000-01776000: C:\siebel\siebsrvr\BIN\sbcfapps.dll, 811.9.822.2
    01780000-01791000: C:\siebel\siebsrvr\BIN\sssasos.dll, 811.11.822.4
    017a0000-017a8000: C:\siebel\siebsrvr\BIN\sslcom.dll, 811.11.822.4
    017b0000-017be000: C:\siebel\siebsrvr\BIN\sslcsnom.dll, 811.11.822.4
    017c0000-017f8000: C:\siebel\siebsrvr\BIN\sstcsiom.dll, 811.11.822.4
    020f0000-021f0000: C:\siebel\siebsrvr\BIN\sscfom.dll, 811.11.822.4
    021f0000-022ef000: C:\siebel\siebsrvr\BIN\sslcsc.dll, 811.11.822.4
    022f0000-0236f000: C:\siebel\siebsrvr\BIN\sslcdb.dll, 811.11.822.4
    4bf70000-4bfae000: C:\WINDOWS\system32\ODBC32.dll, 3.526.4795.0
    77530000-775c7000: C:\WINDOWS\WinSxS\x86_Microsoft.Windows.Common-Controls_6595b64144ccf1df_5.82.3790.5190_x-ww_D21E1F39\COMCTL32.dll, 5.82.3790.5190
    762b0000-762f9000: C:\WINDOWS\system32\comdlg32.dll, 6.0.3790.3959
    01800000-0180b000: C:\siebel\siebsrvr\BIN\sscadsecr.dll, 811.11.822.4
    02370000-0237d000: C:\siebel\siebsrvr\BIN\sslclm.dll, 811.11.822.4
    02380000-0239c000: C:\siebel\siebsrvr\BIN\sslcupg.dll, 811.11.822.4
    023a0000-023ba000: C:\siebel\siebsrvr\BIN\sslcsecm.dll, 811.11.822.4
    023c0000-023ef000: C:\siebel\siebsrvr\BIN\sscfel.dll, 811.11.822.4
    023f0000-026b0000: C:\siebel\siebsrvr\BIN\sscfdm.dll, 811.11.822.4
    026b0000-026bd000: C:\siebel\siebsrvr\BIN\sslcfsm.dll, 811.11.822.4
    026c0000-026c8000: C:\siebel\siebsrvr\BIN\sslcsecc.dll, 811.11.822.4
    026d0000-026e1000: C:\siebel\siebsrvr\BIN\sslccachev2.dll, 811.11.822.4
    026f0000-026f9000: C:\siebel\siebsrvr\BIN\sslcmsgagent.dll, 811.11.822.4
    02bd0000-02be7000: C:\WINDOWS\system32\odbcint.dll, 3.526.3959.0
    02bf0000-02c23000: C:\siebel\siebsrvr\BIN\sslcrsa56.dll, 811.11.822.4
    71b20000-71b61000: C:\WINDOWS\System32\mswsock.dll, 5.2.3790.4318
    76ed0000-76efa000: C:\WINDOWS\system32\DNSAPI.dll, 5.2.3790.4840
    76f70000-76f77000: C:\WINDOWS\System32\winrnr.dll, 5.2.3790.3959
    76f10000-76f3e000: C:\WINDOWS\system32\WLDAP32.dll, 5.2.3790.3959
    76f80000-76f85000: C:\WINDOWS\system32\rasadhlp.dll, 5.2.3790.3959
    5f270000-5f2ca000: C:\WINDOWS\system32\hnetcfg.dll, 5.2.3790.3959
    71ae0000-71ae8000: C:\WINDOWS\System32\wshtcpip.dll, 5.2.3790.3959
    0ae80000-0af6a000: C:\siebel\siebsrvr\BIN\eBaySecAda.dll
    76920000-769e2000: C:\WINDOWS\system32\userenv.dll, 5.2.3790.3959
    71c40000-71c97000: C:\WINDOWS\system32\netapi32.dll, 5.2.3790.5030
    76bb0000-76bdc000: C:\WINDOWS\system32\wintrust.dll, 5.131.3790.5060
    76c10000-76c3a000: C:\WINDOWS\system32\imagehlp.dll, 5.2.3790.5240
    76750000-76779000: C:\WINDOWS\system32\schannel.dll, 5.2.3790.5462
    76e90000-76ecf000: C:\WINDOWS\system32\RASAPI32.DLL, 5.2.3790.3959
    76e40000-76e52000: C:\WINDOWS\system32\rasman.dll, 5.2.3790.3959
    76e60000-76e8f000: C:\WINDOWS\system32\TAPI32.dll, 5.2.3790.3959
    76e30000-76e3c000: C:\WINDOWS\system32\rtutils.dll, 5.2.3790.3959
    76aa0000-76acd000: C:\WINDOWS\system32\WINMM.dll, 5.2.3790.4916
    722f0000-722f5000: C:\WINDOWS\system32\sensapi.dll, 5.2.3790.3959
    772c0000-77371000: C:\WINDOWS\system32\urlmon.dll, 6.0.3790.5467
    68000000-68035000: C:\WINDOWS\system32\rsaenh.dll, 5.2.3790.3959
    68100000-68127000: C:\WINDOWS\system32\dssenh.dll, 5.2.3790.3959
    0b300000-0b31a000: C:\siebel\siebsrvr\BIN\sscdo90.dll, 811.11.822.4
    0b320000-0b3a2000: C:\oracle\product\11.1.0\client_1\bin\OCI.dll, 11.1.0.1
    61c20000-61f81000: C:\oracle\product\11.1.0\client_1\bin\OraClient11.Dll, 11.1.0.7
    60870000-6095b000: C:\oracle\product\11.1.0\client_1\bin\oracore11.dll, 11.1.0.7
    60a80000-60b4e000: C:\oracle\product\11.1.0\client_1\bin\oranls11.dll, 11.1.0.7
    63690000-636a8000: C:\oracle\product\11.1.0\client_1\bin\oraunls11.dll, 11.1.0.7
    60eb0000-60eb7000: C:\oracle\product\11.1.0\client_1\bin\orauts.dll, 11.1.0.7
    636b0000-636b6000: C:\oracle\product\11.1.0\client_1\bin\oravsn11.dll, 11.1.0.7
    60fa0000-61158000: C:\oracle\product\11.1.0\client_1\bin\oracommon11.dll, 11.1.0.7
    63430000-6345d000: C:\oracle\product\11.1.0\client_1\bin\orasnls11.dll, 11.1.0.7
    0b3b0000-0be77000: C:\oracle\product\11.1.0\client_1\bin\orageneric11.dll, 11.1.0.7
    0be80000-0c0dc000: C:\oracle\product\11.1.0\client_1\bin\oraxml11.dll, 11.1.0.7
    60020000-60030000: C:\WINDOWS\system32\MSVCIRT.dll, 7.0.3790.0
    0c0e0000-0c4b2000: C:\oracle\product\11.1.0\client_1\bin\oran11.dll, 11.1.0.6
    62740000-627a3000: C:\oracle\product\11.1.0\client_1\bin\oranl11.dll, 11.1.0.6
    62980000-629b1000: C:\oracle\product\11.1.0\client_1\bin\orantcp11.dll, 11.1.0.6
    0c4c0000-0c507000: C:\oracle\product\11.1.0\client_1\bin\oranldap11.dll, 11.1.0.6
    627f0000-62905000: C:\oracle\product\11.1.0\client_1\bin\orannzsbb11.dll, 11.1.0.6
    62530000-6266d000: C:\oracle\product\11.1.0\client_1\bin\oraldapclnt11.dll, 11.1.0.7
    62670000-6268b000: C:\oracle\product\11.1.0\client_1\bin\orancrypt11.dll, 11.1.0.6
    0c510000-0c643000: C:\oracle\product\11.1.0\client_1\bin\orazt11.dll, 11.1.0.6
    76cf0000-76d0a000: C:\WINDOWS\system32\iphlpapi.dll, 5.2.3790.3959
    62920000-6296d000: C:\oracle\product\11.1.0\client_1\bin\oranro11.dll, 11.1.0.6
    626b0000-626b9000: C:\oracle\product\11.1.0\client_1\bin\oranhost11.dll, 11.1.0.6
    0c650000-0c656000: C:\oracle\product\11.1.0\client_1\bin\orancds11.dll, 11.1.0.6
    629c0000-629cd000: C:\oracle\product\11.1.0\client_1\bin\orantns11.dll, 11.1.0.6
    0c660000-0c6e0000: C:\oracle\product\11.1.0\client_1\bin\oraztkg11.dll, 11.1.0.6
    0c6e0000-0caba000: C:\oracle\product\11.1.0\client_1\bin\orapls11.dll, 11.1.0.7
    63420000-63429000: C:\oracle\product\11.1.0\client_1\bin\oraslax11.dll, 11.1.0.6
    63080000-63296000: C:\oracle\product\11.1.0\client_1\bin\oraplp11.dll, 11.1.0.7
    0cac0000-0cb6d000: C:\oracle\product\11.1.0\client_1\bin\orahasgen11.dll, 11.1.0.6
    62ab0000-62b2f000: C:\oracle\product\11.1.0\client_1\bin\oraocr11.dll, 11.1.0.6
    0cb70000-0cbce000: C:\oracle\product\11.1.0\client_1\bin\oraocrb11.dll, 11.1.0.6
    6d580000-6d628000: C:\WINDOWS\system32\dbghelp.dll, 5.2.3790.3959
    63520000-635c2000: C:\oracle\product\11.1.0\client_1\bin\orasql11.dll, 11.1.0.7
    63060000-63074000: C:\oracle\product\11.1.0\client_1\bin\OraPlc11.Dll, 11.1.0.7
    0cde0000-0cde6000: C:\siebel\siebsrvr\BIN\sslcdbgengw.dll, 811.11.822.4
    0ce30000-0ce4c000: C:\siebel\siebsrvr\BIN\sscfomlg.dll, 811.11.822.4
    0ce60000-0cffb000: C:\siebel\siebsrvr\BIN\sscfcli.dll, 811.11.822.4
    0d070000-0d11d000: C:\siebel\siebsrvr\BIN\sscacmbc.dll, 811.11.822.4
    209c0000-20a7e000: C:\siebel\siebsrvr\BIN\SSCABCBC.DLL, 811.11.822.4
    20cc0000-20d19000: C:\siebel\siebsrvr\BIN\SSCACCBC.DLL, 811.11.822.4
    212d0000-212ec000: C:\siebel\siebsrvr\BIN\sscapsppricersvc.dll, 811.11.822.4
    20060000-2059a000: C:\siebel\siebsrvr\BIN\sscaswbc.dll, 811.11.822.4
    21690000-21704000: C:\siebel\siebsrvr\BIN\SSCMSVC.DLL, 811.11.822.4
    215a0000-2166c000: C:\siebel\siebsrvr\BIN\SSCMCLNT.DLL, 811.11.822.4
    21740000-2179e000: C:\siebel\siebsrvr\BIN\sscmcfgsvc.dll, 811.11.822.4
    0d010000-0d025000: C:\siebel\siebsrvr\BIN\SSCASRMS.DLL, 811.11.822.4
    0d030000-0d070000: C:\siebel\siebsrvr\BIN\sscaadbc.dll, 811.11.822.4
    21590000-2159d000: C:\siebel\siebsrvr\BIN\SSCFHIMS.DLL, 811.11.822.4
    22490000-224aa000: C:\siebel\siebsrvr\BIN\SSCASSMC.DLL, 811.11.822.4
    222d0000-22371000: C:\siebel\siebsrvr\BIN\sscacabc.dll, 811.11.822.4
    224b0000-224ec000: C:\siebel\siebsrvr\BIN\SSCASVBC.DLL, 811.11.822.4
    22be0000-22c24000: C:\siebel\siebsrvr\BIN\swcahcfr.dll, 811.11.822.4
    22aa0000-22b54000: C:\siebel\siebsrvr\BIN\SWCACAFR.DLL, 811.11.822.4
    22c30000-22ca0000: C:\siebel\siebsrvr\BIN\SSCAXMLPWFR.DLL, 811.11.822.4
    22ed0000-22f8c000: C:\siebel\siebsrvr\BIN\SSDTBC.DLL, 811.11.822.4
    22a80000-22a9f000: C:\siebel\siebsrvr\BIN\SSCACTBC.DLL, 811.11.822.4
    23040000-230c1000: C:\siebel\siebsrvr\BIN\SWCASIFR.DLL, 811.11.822.4
    211b0000-211cd000: C:\siebel\siebsrvr\BIN\swcacmfr.dll, 811.11.822.4
    21f60000-21f6d000: C:\siebel\siebsrvr\BIN\SSLCKM.DLL, 811.11.822.4
    22060000-220ca000: C:\siebel\siebsrvr\BIN\SSCANSHSV.DLL, 811.11.822.4
    21b20000-21b9d000: C:\siebel\siebsrvr\BIN\SWCANSHFR.DLL, 811.11.822.4
    21af0000-21b1a000: C:\siebel\siebsrvr\BIN\SSCANSHBC.DLL, 811.11.822.4
    21f80000-21fc9000: C:\siebel\siebsrvr\BIN\sWcasvfr.dll, 811.11.822.4
    22170000-22202000: C:\siebel\siebsrvr\BIN\SSFAFCBC.DLL, 811.11.822.4
    23580000-235c4000: C:\siebel\siebsrvr\BIN\SSCAPRMSV.DLL, 811.11.822.4
    22020000-2203e000: C:\siebel\siebsrvr\BIN\SSCAEITE.DLL, 811.11.822.4
    1ff20000-2005a000: C:\siebel\siebsrvr\BIN\sscafwsv.dll, 811.11.822.4
    22d40000-22ea8000: C:\siebel\siebsrvr\BIN\sscaeiwm.dll, 811.11.822.4
    22d10000-22d3e000: C:\siebel\siebsrvr\BIN\SSCAEIWO.DLL, 811.11.822.4
    23780000-2378b000: C:\siebel\siebsrvr\BIN\SSCAEILM.DLL, 811.11.822.4
    23790000-237e3000: C:\siebel\siebsrvr\BIN\SSCAEISA.DLL, 811.11.822.4
    22560000-22652000: C:\siebel\siebsrvr\BIN\SSCASPBC.DLL, 811.11.822.4
    23880000-23897000: C:\siebel\siebsrvr\BIN\sscafssvactcache.dll, 811.11.822.4
    239a0000-23a89000: C:\siebel\siebsrvr\BIN\SSCOMMSV.DLL, 811.11.822.4
    036c0000-0372a000: C:\siebel\siebsrvr\BIN\SSCHATBS.DLL, 811.11.822.4
    22770000-227c1000: C:\siebel\siebsrvr\BIN\sscasabc.dll, 811.11.822.4
    23b30000-23b4c000: C:\siebel\siebsrvr\BIN\SSFACMBC.DLL, 811.11.822.4
    23b50000-23b64000: C:\siebel\siebsrvr\BIN\SSFACMSV.DLL, 811.11.822.4
    23ea0000-23eef000: C:\siebel\siebsrvr\BIN\sscacmuinsv.dll, 811.11.822.4
    23490000-234f6000: C:\siebel\siebsrvr\BIN\SWCAFSFR.DLL, 811.11.822.4
    21a80000-21aa5000: C:\siebel\siebsrvr\BIN\SSCASHSV.DLL, 811.11.822.4
    21eb0000-21edd000: C:\siebel\siebsrvr\BIN\SSCASHBC.DLL, 811.11.822.4
    21ee0000-21f2f000: C:\siebel\siebsrvr\BIN\SWCASHFR.DLL, 811.11.822.4
    211d0000-211ee000: C:\siebel\siebsrvr\BIN\sscaxmbc.dll, 811.11.822.4
    23ef0000-23f41000: C:\siebel\siebsrvr\BIN\SWCACGFR.DLL, 811.11.822.4
    22140000-22170000: C:\siebel\siebsrvr\BIN\SSCATASV.DLL, 811.11.822.4
    21220000-212c8000: C:\siebel\siebsrvr\BIN\swcabcfr.dll, 811.11.822.4
    23bd0000-23bf4000: C:\siebel\siebsrvr\BIN\sscasasv.dll, 811.11.822.4
    23b90000-23ba6000: C:\siebel\siebsrvr\BIN\SSCAEIXQ.DLL, 811.11.822.4
    24860000-24929000: C:\siebel\siebsrvr\BIN\swcaspsv.dll, 811.11.822.4
    04080000-0408b000: C:\siebel\siebsrvr\BIN\SSCFUREC.DLL, 811.11.822.4
    Heap status          : ok
    Total physical memory: 50320576 KB
    Free physical memory : 35138076 KB
    Paging file size     : 51918740 KB
    Available paging size: 36997428 KB
    Virtual memory info:
    Total              : 2097024 KB
    Available          : 836420 KB
    Available extendent: 0 KB
    Assert failure count : 1595991
    Command line         : siebmtshmw.exe C:\siebel\siebsrvr\admin\siebprodent.pxsblaom026.shm 33 0 1 5 0 ENU 0 0
    Current directory    : C:\siebel\siebsrvr\BIN
    Executable           : C:\siebel\siebsrvr\BIN\siebmtshmw.exe
    Current time         : 01/19/2015 10:52:32:099
    CCF Version          : 8.1.1.10 SIA [23017] LANG_INDEPENDENT
    CCF Compiled On      : Jan 21 2013 18:06:00
    Would approciate if anyone could provide some inputs on the same..
    Thanks
    Ruban

    Hi,
    We recently upgraded to Oracle RAC database to support Siebel Call Center APplication (8.1.1.11.12 [IP2013]).Oracle Database 11g Enterprise Edition Release 11.2.0.3.0 - 64bit Production
    Frequently we are facing problem of crashing with the Nodes in RAC (Kernal Panic). Due to this users using siebel application are unstable and facing multiple issues Once we restore Siebel Gateway and restart of AOM server fixing the issue.
    Below are the SQL's and Crashing Signature we are seeing du to this crash.
    DBCLog DBCLogError 1 00081f1254bb0ad4:1423830 2015-01-18 11:49:20 OCIStmtExecute: SELECT
    T2.CONFLICT_ID,
    T2.LAST_UPD,
    T2.CREATED,
    T2.LAST_UPD_BY,
    T2.CREATED_BY,
    T2.MODIFICATION_NUM,
    T2.ROW_ID,
    T2.EFF_START_TS,
    T2.EFF_END_TS,
    T2.NAME,
    T2.BUSOBJ_NAME,
    T2.VERSION,
    T2.DEPLOY_STATUS_CD,
    T2.MODE_CD
    FROM
    SIEBEL.S_LST_OF_VAL T1,
    SIEBEL.S_WFA_DPLOY_DEF T2
    WHERE
    T2.DEPLOY_STATUS_CD = T1.NAME AND T1.TYPE = 'WFA_DPLY_STAT_CD' AND T1.LANG_ID = :1 AND
    (T2.TYPE_CD IN ( :2 )) AND
    (T2.NAME = :3 AND T2.DEPLOY_STATUS_CD IN ( :4 ) AND (T2.EFF_END_TS > TO_DATE(:5,'MM/DD/YYYY HH24:MI:SS') OR T2.EFF_END_TS IS NULL))
    ORDER BY
    T2.NAME, T1.VAL
    ObjMgrLog Error 1 00081f1254bb0ad4:1423830 2015-01-18 11:49:20 (oracon.cpp (3896)) SBL-DBC-00105: An error has occurred executing a Sql statement.
    Please continue or ask your systems administrator to check your application configuration if the problem persists.
    and Crash Signature Looks like below
    Exception 0xc0000005 at 0x006500f6
    Thread: 0x00002700, Process 0x00000254
    Thread: 9984, Process 596
    - CONTEXT -
    EIP: 0x00000000, EFL: 0x00010246, FS:  0x0000003b, GS:  0x00000000
    CS:  0x0000001b, DS:  0x00000023, SS:  0x00000023, ES:  0x00000023
    EAX: 0x1a511968, EBX: 0x294ca048, ECX: 0x4cc50008, EDX: 0x3a2ad200
    ESI: 0x4cc50008, EDI: 0x00000000, EBP: 0x00000000, ESP: 0x3a2afff4
    - CALL STACK -
    sslcscr +0xf6
    sscfcmn +0x19050 = CSSObjectBase::CopyErrorMsg() +0xf0
    sscfcmn +0x1950d = CSSObjectBase::DoSetErrorMsg() +0x13d
    sscfcmn +0x19bb5 = CSSObjectBase::SetErrorMsg() +0xa5
    SSFACMBC +0x34a6 = CSSFABCVRec::IsBusinessProcessActive() +0x3b6
    SSFACMBC +0x5133 = CSSFABCVRec::VBCCreate() +0x1e3
    sscfom +0x71d1e = CSSBCVRec::SqlCreate() +0xde
    sscfom +0x4aea = CSSModel::ConstructBusComp() +0xaa
    sscfom +0x653f5 = CSSBusObj::GetBusComp() +0x265
    sscfom +0x65a18 = CSSBusObj::GetBusComp() +0x18
    sscfom +0x13ad8 = CSSModel::BeginSetupView() +0x418
    sscfom +0x13dee = CSSModel::BeginSetupView() +0x5e
    sscaswbc +0x8b070 = CSSSWEUdfLoader::BeginSetupView() +0x30
    sscaswbc +0xe3d88 = CSSSWEFrameMgrInternal::BuildView() +0x1618
    sscaswbc +0xe5646 = CSSSWEFrameMgrInternal::BuildView() +0x36
    sscaswbc +0xb8343 = CSSSWEActionMgr::ActionBuildViewAsync() +0x293
    sscaswbc +0xb873b = CSSSWEActionMgr::DoPostedAction() +0xab
    sscaswbc +0xb9287 = CSSSWEActionMgr::CheckPostedActions() +0x3d7
    sscaswbc +0xe6d41 = CSSSWEFrameMgrInternal::InvokeAppletMethod() +0x11b1
    sscaswbc +0xbbcdc = CSSSWECmdProcessor::InvokeMethod() +0x74c
    sscaswbc +0xc1495 = CSSSWECmdProcessor::_ProcessCommand() +0x725
    sscaswbc +0xc27f8 = CSSSWECmdProcessor::ProcessCommand() +0xab8
    sscaswbc +0xc2d04 = CSSSWECmdProcessor::ProcessCommand() +0xc4
    sscaswbc +0x265559 = CSSServiceSWEIface::Request() +0x309
    sscaswbc +0x267391 = CSSServiceSWEIface::DoInvokeMethod() +0xed1
    sscfom +0x1976c = CSSService::InvokeMethod() +0x24c
    sstcsiom +0x6d6a = CSSSIOMSession::ModInvokeSrvcMethod() +0x10a
    sstcsiom +0x7613 = CSSSIOMSession::RPCMiscModel() +0x513
    sstcsiom +0xe9dd = CSSSIOMSession::HandleRPC() +0x3ad
    sssasos +0x6616 = CompCleanup() +0x3be6
    sssasos +0x5a95 = CompCleanup() +0x3065
    sssasos +0x1a35 = CSSSISObject::operator=() +0x9f5
    sssasos +0x2135 = CompHandleMsg() +0x485
    siebmtshmw +0x494e
    siebmtshmw +0x20051 = GetSmiTaskAPI() +0x6d21
    siebmtshmw +0x239d1 = SmiInProcMsgHandler() +0x2051
    siebmtshmw +0x15f15 = SmiBeginTrace() +0x3195
    siebmtshmw +0x174cf = GetSmiWorkQObj() +0x148f
    siebmtshmw +0xc7f7 = SmiCleanupDetTask() +0x3be7
    sslcosd +0x2152 = OSDThreadPrivIsInit() +0x1d2
    sslcosd +0x21dc = OSDThreadPrivIsInit() +0x25c
    MSVCR71 +0x9565 = endthreadex() +0xa0
    kernel32 +0x2484f = GetModuleHandleA() +0xdf
    - STACK DUMP -
    - MODULE LIST -
    00400000-00445000: C:\siebel\siebsrvr\BIN\siebmtshmw.exe, 811.11.822.4
    7c800000-7c8c3000: C:\WINDOWS\system32\ntdll.dll, 5.2.3790.4937
    77e40000-77f44000: C:\WINDOWS\system32\kernel32.dll, 5.2.3790.5295
    10000000-10025000: C:\siebel\siebsrvr\BIN\ssscsci.dll, 811.11.822.4
    00320000-003cc000: C:\siebel\siebsrvr\BIN\ssscscf.dll, 811.11.822.4
    003d0000-003d7000: C:\siebel\siebsrvr\BIN\sslcosa.dll, 811.11.822.4
    7c340000-7c396000: C:\siebel\siebsrvr\BIN\MSVCR71.dll, 7.10.3052.4
    00450000-0054d000: C:\siebel\siebsrvr\BIN\sslcshar.dll, 811.11.822.4
    77380000-77411000: C:\WINDOWS\system32\USER32.dll, 5.2.3790.4033
    77c00000-77c49000: C:\WINDOWS\system32\GDI32.dll, 5.2.3790.5398
    7d1e0000-7d27c000: C:\WINDOWS\system32\ADVAPI32.dll, 5.2.3790.4455
    77c50000-77cf1000: C:\WINDOWS\system32\RPCRT4.dll, 5.2.3790.5254
    76f50000-76f63000: C:\WINDOWS\system32\Secur32.dll, 5.2.3790.4455
    77b90000-77b98000: C:\WINDOWS\system32\VERSION.dll, 5.2.3790.3959
    77ba0000-77bfa000: C:\WINDOWS\system32\msvcrt.dll, 7.0.3790.3959
    71bb0000-71bb9000: C:\WINDOWS\system32\WSOCK32.dll, 5.2.3790.0
    71c00000-71c17000: C:\WINDOWS\system32\WS2_32.dll, 5.2.3790.3959
    71bf0000-71bf8000: C:\WINDOWS\system32\WS2HELP.dll, 5.2.3790.3959
    003e0000-003e6000: C:\siebel\siebsrvr\BIN\libarm.dll, 811.10.822.3
    00550000-005d5000: C:\siebel\siebsrvr\BIN\sslcsym.dll, 811.11.822.4
    7c3a0000-7c41b000: C:\siebel\siebsrvr\BIN\MSVCP71.dll, 7.10.3077.0
    005e0000-005f1000: C:\siebel\siebsrvr\BIN\sslccore.dll, 811.11.822.4
    00600000-00618000: C:\siebel\siebsrvr\BIN\sslcosd.dll, 811.11.822.4
    00620000-00645000: C:\siebel\siebsrvr\BIN\sslcrsa.dll, 811.11.822.4
    00650000-0067f000: C:\siebel\siebsrvr\BIN\sslcscr.dll, 811.11.822.4
    00680000-007cf000: C:\siebel\siebsrvr\BIN\sslcsrd.dll, 811.11.822.4
    007d0000-0082b000: C:\siebel\siebsrvr\BIN\sslcscc.dll, 811.11.822.4
    003f0000-003ff000: C:\siebel\siebsrvr\BIN\sslcevt.dll, 811.11.822.4
    00830000-00840000: C:\siebel\siebsrvr\BIN\sslcsobj.dll, 811.11.822.4
    00840000-00850000: C:\siebel\siebsrvr\BIN\sslcsnns.dll, 811.11.822.4
    00850000-00931000: C:\siebel\siebsrvr\BIN\sslcnapi.dll, 811.11.822.4
    00940000-00954000: C:\siebel\siebsrvr\BIN\sslcns.dll, 811.11.822.4
    00960000-00968000: C:\siebel\siebsrvr\BIN\sslcsnsc.dll, 811.11.822.4
    00970000-0097b000: C:\siebel\siebsrvr\BIN\ssscsmi.dll, 811.11.822.4
    00980000-00991000: C:\siebel\siebsrvr\BIN\sslcsrvr.dll, 811.11.822.4
    009a0000-009bb000: C:\siebel\siebsrvr\BIN\sslcos.dll, 811.11.822.4
    009c0000-00a5f000: C:\siebel\siebsrvr\BIN\sscfcmn.dll, 811.11.822.4
    7c8d0000-7d0cf000: C:\WINDOWS\system32\SHELL32.dll, 6.0.3790.5018
    7d180000-7d1d2000: C:\WINDOWS\system32\SHLWAPI.dll, 6.0.3790.5318
    77670000-777aa000: C:\WINDOWS\system32\ole32.dll, 5.2.3790.5209
    7d0e0000-7d16c000: C:\WINDOWS\system32\OLEAUT32.dll, 5.2.3790.5464
    761b0000-76245000: C:\WINDOWS\system32\CRYPT32.dll, 5.131.3790.5235
    76190000-761a2000: C:\WINDOWS\system32\MSASN1.dll, 5.2.3790.4584
    77210000-772bb000: C:\WINDOWS\system32\WININET.dll, 6.0.3790.5467
    00a60000-00a70000: C:\siebel\siebsrvr\BIN\sslczlib.dll, 811.11.822.4
    00a70000-00b72000: C:\siebel\siebsrvr\BIN\MFC71U.DLL, 7.10.3077.0
    00b80000-00b88000: C:\siebel\siebsrvr\BIN\sslcsnsr.dll, 811.11.822.4
    00b90000-00b99000: C:\siebel\siebsrvr\BIN\sslcsrtr.dll, 811.11.822.4
    00ba0000-00baf000: C:\siebel\siebsrvr\BIN\sslcsrms.dll, 811.11.822.4
    00bb0000-00bb6000: C:\siebel\siebsrvr\BIN\sslcsssm.dll, 811.11.822.4
    00bc0000-00bd1000: C:\siebel\siebsrvr\BIN\sslcsrcn.dll, 811.11.822.4
    00be0000-00be7000: C:\siebel\siebsrvr\BIN\sslcsysstat.dll, 811.11.822.4
    00fe0000-0100d000: C:\siebel\siebsrvr\BIN\sslcrsa256.dll, 8.1.1.5
    77420000-77523000: C:\WINDOWS\WinSxS\x86_Microsoft.Windows.Common-Controls_6595b64144ccf1df_6.0.3790.5190_x-ww_319264BE\comctl32.dll, 6.0.3790.5190
    5d360000-5d36e000: C:\siebel\siebsrvr\BIN\MFC71ENU.DLL, 7.10.3077.0
    76b70000-76b7b000: C:\WINDOWS\system32\psapi.dll, 5.2.3790.3959
    012b0000-012c0000: C:\siebel\siebsrvr\BIN\sslcasrv.dll, 811.11.822.4
    012c0000-01328000: C:\siebel\siebsrvr\BIN\sslcsrs.dll, 811.11.822.4
    01330000-0133a000: C:\siebel\siebsrvr\BIN\sslcntfy.dll, 811.11.822.4
    01740000-01746000: C:\siebel\siebsrvr\BIN\enu\srcf.dll, 811.9.822.2
    01750000-01756000: C:\siebel\siebsrvr\BIN\enu\srcfapps.dll, 811.9.822.2
    01760000-01766000: C:\siebel\siebsrvr\BIN\sbcf.dll, 811.9.822.2
    01770000-01776000: C:\siebel\siebsrvr\BIN\sbcfapps.dll, 811.9.822.2
    01780000-01791000: C:\siebel\siebsrvr\BIN\sssasos.dll, 811.11.822.4
    017a0000-017a8000: C:\siebel\siebsrvr\BIN\sslcom.dll, 811.11.822.4
    017b0000-017be000: C:\siebel\siebsrvr\BIN\sslcsnom.dll, 811.11.822.4
    017c0000-017f8000: C:\siebel\siebsrvr\BIN\sstcsiom.dll, 811.11.822.4
    020f0000-021f0000: C:\siebel\siebsrvr\BIN\sscfom.dll, 811.11.822.4
    021f0000-022ef000: C:\siebel\siebsrvr\BIN\sslcsc.dll, 811.11.822.4
    022f0000-0236f000: C:\siebel\siebsrvr\BIN\sslcdb.dll, 811.11.822.4
    4bf70000-4bfae000: C:\WINDOWS\system32\ODBC32.dll, 3.526.4795.0
    77530000-775c7000: C:\WINDOWS\WinSxS\x86_Microsoft.Windows.Common-Controls_6595b64144ccf1df_5.82.3790.5190_x-ww_D21E1F39\COMCTL32.dll, 5.82.3790.5190
    762b0000-762f9000: C:\WINDOWS\system32\comdlg32.dll, 6.0.3790.3959
    01800000-0180b000: C:\siebel\siebsrvr\BIN\sscadsecr.dll, 811.11.822.4
    02370000-0237d000: C:\siebel\siebsrvr\BIN\sslclm.dll, 811.11.822.4
    02380000-0239c000: C:\siebel\siebsrvr\BIN\sslcupg.dll, 811.11.822.4
    023a0000-023ba000: C:\siebel\siebsrvr\BIN\sslcsecm.dll, 811.11.822.4
    023c0000-023ef000: C:\siebel\siebsrvr\BIN\sscfel.dll, 811.11.822.4
    023f0000-026b0000: C:\siebel\siebsrvr\BIN\sscfdm.dll, 811.11.822.4
    026b0000-026bd000: C:\siebel\siebsrvr\BIN\sslcfsm.dll, 811.11.822.4
    026c0000-026c8000: C:\siebel\siebsrvr\BIN\sslcsecc.dll, 811.11.822.4
    026d0000-026e1000: C:\siebel\siebsrvr\BIN\sslccachev2.dll, 811.11.822.4
    026f0000-026f9000: C:\siebel\siebsrvr\BIN\sslcmsgagent.dll, 811.11.822.4
    02bd0000-02be7000: C:\WINDOWS\system32\odbcint.dll, 3.526.3959.0
    02bf0000-02c23000: C:\siebel\siebsrvr\BIN\sslcrsa56.dll, 811.11.822.4
    71b20000-71b61000: C:\WINDOWS\System32\mswsock.dll, 5.2.3790.4318
    76ed0000-76efa000: C:\WINDOWS\system32\DNSAPI.dll, 5.2.3790.4840
    76f70000-76f77000: C:\WINDOWS\System32\winrnr.dll, 5.2.3790.3959
    76f10000-76f3e000: C:\WINDOWS\system32\WLDAP32.dll, 5.2.3790.3959
    76f80000-76f85000: C:\WINDOWS\system32\rasadhlp.dll, 5.2.3790.3959
    5f270000-5f2ca000: C:\WINDOWS\system32\hnetcfg.dll, 5.2.3790.3959
    71ae0000-71ae8000: C:\WINDOWS\System32\wshtcpip.dll, 5.2.3790.3959
    0ae80000-0af6a000: C:\siebel\siebsrvr\BIN\eBaySecAda.dll
    76920000-769e2000: C:\WINDOWS\system32\userenv.dll, 5.2.3790.3959
    71c40000-71c97000: C:\WINDOWS\system32\netapi32.dll, 5.2.3790.5030
    76bb0000-76bdc000: C:\WINDOWS\system32\wintrust.dll, 5.131.3790.5060
    76c10000-76c3a000: C:\WINDOWS\system32\imagehlp.dll, 5.2.3790.5240
    76750000-76779000: C:\WINDOWS\system32\schannel.dll, 5.2.3790.5462
    76e90000-76ecf000: C:\WINDOWS\system32\RASAPI32.DLL, 5.2.3790.3959
    76e40000-76e52000: C:\WINDOWS\system32\rasman.dll, 5.2.3790.3959
    76e60000-76e8f000: C:\WINDOWS\system32\TAPI32.dll, 5.2.3790.3959
    76e30000-76e3c000: C:\WINDOWS\system32\rtutils.dll, 5.2.3790.3959
    76aa0000-76acd000: C:\WINDOWS\system32\WINMM.dll, 5.2.3790.4916
    722f0000-722f5000: C:\WINDOWS\system32\sensapi.dll, 5.2.3790.3959
    772c0000-77371000: C:\WINDOWS\system32\urlmon.dll, 6.0.3790.5467
    68000000-68035000: C:\WINDOWS\system32\rsaenh.dll, 5.2.3790.3959
    68100000-68127000: C:\WINDOWS\system32\dssenh.dll, 5.2.3790.3959
    0b300000-0b31a000: C:\siebel\siebsrvr\BIN\sscdo90.dll, 811.11.822.4
    0b320000-0b3a2000: C:\oracle\product\11.1.0\client_1\bin\OCI.dll, 11.1.0.1
    61c20000-61f81000: C:\oracle\product\11.1.0\client_1\bin\OraClient11.Dll, 11.1.0.7
    60870000-6095b000: C:\oracle\product\11.1.0\client_1\bin\oracore11.dll, 11.1.0.7
    60a80000-60b4e000: C:\oracle\product\11.1.0\client_1\bin\oranls11.dll, 11.1.0.7
    63690000-636a8000: C:\oracle\product\11.1.0\client_1\bin\oraunls11.dll, 11.1.0.7
    60eb0000-60eb7000: C:\oracle\product\11.1.0\client_1\bin\orauts.dll, 11.1.0.7
    636b0000-636b6000: C:\oracle\product\11.1.0\client_1\bin\oravsn11.dll, 11.1.0.7
    60fa0000-61158000: C:\oracle\product\11.1.0\client_1\bin\oracommon11.dll, 11.1.0.7
    63430000-6345d000: C:\oracle\product\11.1.0\client_1\bin\orasnls11.dll, 11.1.0.7
    0b3b0000-0be77000: C:\oracle\product\11.1.0\client_1\bin\orageneric11.dll, 11.1.0.7
    0be80000-0c0dc000: C:\oracle\product\11.1.0\client_1\bin\oraxml11.dll, 11.1.0.7
    60020000-60030000: C:\WINDOWS\system32\MSVCIRT.dll, 7.0.3790.0
    0c0e0000-0c4b2000: C:\oracle\product\11.1.0\client_1\bin\oran11.dll, 11.1.0.6
    62740000-627a3000: C:\oracle\product\11.1.0\client_1\bin\oranl11.dll, 11.1.0.6
    62980000-629b1000: C:\oracle\product\11.1.0\client_1\bin\orantcp11.dll, 11.1.0.6
    0c4c0000-0c507000: C:\oracle\product\11.1.0\client_1\bin\oranldap11.dll, 11.1.0.6
    627f0000-62905000: C:\oracle\product\11.1.0\client_1\bin\orannzsbb11.dll, 11.1.0.6
    62530000-6266d000: C:\oracle\product\11.1.0\client_1\bin\oraldapclnt11.dll, 11.1.0.7
    62670000-6268b000: C:\oracle\product\11.1.0\client_1\bin\orancrypt11.dll, 11.1.0.6
    0c510000-0c643000: C:\oracle\product\11.1.0\client_1\bin\orazt11.dll, 11.1.0.6
    76cf0000-76d0a000: C:\WINDOWS\system32\iphlpapi.dll, 5.2.3790.3959
    62920000-6296d000: C:\oracle\product\11.1.0\client_1\bin\oranro11.dll, 11.1.0.6
    626b0000-626b9000: C:\oracle\product\11.1.0\client_1\bin\oranhost11.dll, 11.1.0.6
    0c650000-0c656000: C:\oracle\product\11.1.0\client_1\bin\orancds11.dll, 11.1.0.6
    629c0000-629cd000: C:\oracle\product\11.1.0\client_1\bin\orantns11.dll, 11.1.0.6
    0c660000-0c6e0000: C:\oracle\product\11.1.0\client_1\bin\oraztkg11.dll, 11.1.0.6
    0c6e0000-0caba000: C:\oracle\product\11.1.0\client_1\bin\orapls11.dll, 11.1.0.7
    63420000-63429000: C:\oracle\product\11.1.0\client_1\bin\oraslax11.dll, 11.1.0.6
    63080000-63296000: C:\oracle\product\11.1.0\client_1\bin\oraplp11.dll, 11.1.0.7
    0cac0000-0cb6d000: C:\oracle\product\11.1.0\client_1\bin\orahasgen11.dll, 11.1.0.6
    62ab0000-62b2f000: C:\oracle\product\11.1.0\client_1\bin\oraocr11.dll, 11.1.0.6
    0cb70000-0cbce000: C:\oracle\product\11.1.0\client_1\bin\oraocrb11.dll, 11.1.0.6
    6d580000-6d628000: C:\WINDOWS\system32\dbghelp.dll, 5.2.3790.3959
    63520000-635c2000: C:\oracle\product\11.1.0\client_1\bin\orasql11.dll, 11.1.0.7
    63060000-63074000: C:\oracle\product\11.1.0\client_1\bin\OraPlc11.Dll, 11.1.0.7
    0cde0000-0cde6000: C:\siebel\siebsrvr\BIN\sslcdbgengw.dll, 811.11.822.4
    0ce30000-0ce4c000: C:\siebel\siebsrvr\BIN\sscfomlg.dll, 811.11.822.4
    0ce60000-0cffb000: C:\siebel\siebsrvr\BIN\sscfcli.dll, 811.11.822.4
    0d070000-0d11d000: C:\siebel\siebsrvr\BIN\sscacmbc.dll, 811.11.822.4
    209c0000-20a7e000: C:\siebel\siebsrvr\BIN\SSCABCBC.DLL, 811.11.822.4
    20cc0000-20d19000: C:\siebel\siebsrvr\BIN\SSCACCBC.DLL, 811.11.822.4
    212d0000-212ec000: C:\siebel\siebsrvr\BIN\sscapsppricersvc.dll, 811.11.822.4
    20060000-2059a000: C:\siebel\siebsrvr\BIN\sscaswbc.dll, 811.11.822.4
    21690000-21704000: C:\siebel\siebsrvr\BIN\SSCMSVC.DLL, 811.11.822.4
    215a0000-2166c000: C:\siebel\siebsrvr\BIN\SSCMCLNT.DLL, 811.11.822.4
    21740000-2179e000: C:\siebel\siebsrvr\BIN\sscmcfgsvc.dll, 811.11.822.4
    0d010000-0d025000: C:\siebel\siebsrvr\BIN\SSCASRMS.DLL, 811.11.822.4
    0d030000-0d070000: C:\siebel\siebsrvr\BIN\sscaadbc.dll, 811.11.822.4
    21590000-2159d000: C:\siebel\siebsrvr\BIN\SSCFHIMS.DLL, 811.11.822.4
    22490000-224aa000: C:\siebel\siebsrvr\BIN\SSCASSMC.DLL, 811.11.822.4
    222d0000-22371000: C:\siebel\siebsrvr\BIN\sscacabc.dll, 811.11.822.4
    224b0000-224ec000: C:\siebel\siebsrvr\BIN\SSCASVBC.DLL, 811.11.822.4
    22be0000-22c24000: C:\siebel\siebsrvr\BIN\swcahcfr.dll, 811.11.822.4
    22aa0000-22b54000: C:\siebel\siebsrvr\BIN\SWCACAFR.DLL, 811.11.822.4
    22c30000-22ca0000: C:\siebel\siebsrvr\BIN\SSCAXMLPWFR.DLL, 811.11.822.4
    22ed0000-22f8c000: C:\siebel\siebsrvr\BIN\SSDTBC.DLL, 811.11.822.4
    22a80000-22a9f000: C:\siebel\siebsrvr\BIN\SSCACTBC.DLL, 811.11.822.4
    23040000-230c1000: C:\siebel\siebsrvr\BIN\SWCASIFR.DLL, 811.11.822.4
    211b0000-211cd000: C:\siebel\siebsrvr\BIN\swcacmfr.dll, 811.11.822.4
    21f60000-21f6d000: C:\siebel\siebsrvr\BIN\SSLCKM.DLL, 811.11.822.4
    22060000-220ca000: C:\siebel\siebsrvr\BIN\SSCANSHSV.DLL, 811.11.822.4
    21b20000-21b9d000: C:\siebel\siebsrvr\BIN\SWCANSHFR.DLL, 811.11.822.4
    21af0000-21b1a000: C:\siebel\siebsrvr\BIN\SSCANSHBC.DLL, 811.11.822.4
    21f80000-21fc9000: C:\siebel\siebsrvr\BIN\sWcasvfr.dll, 811.11.822.4
    22170000-22202000: C:\siebel\siebsrvr\BIN\SSFAFCBC.DLL, 811.11.822.4
    23580000-235c4000: C:\siebel\siebsrvr\BIN\SSCAPRMSV.DLL, 811.11.822.4
    22020000-2203e000: C:\siebel\siebsrvr\BIN\SSCAEITE.DLL, 811.11.822.4
    1ff20000-2005a000: C:\siebel\siebsrvr\BIN\sscafwsv.dll, 811.11.822.4
    22d40000-22ea8000: C:\siebel\siebsrvr\BIN\sscaeiwm.dll, 811.11.822.4
    22d10000-22d3e000: C:\siebel\siebsrvr\BIN\SSCAEIWO.DLL, 811.11.822.4
    23780000-2378b000: C:\siebel\siebsrvr\BIN\SSCAEILM.DLL, 811.11.822.4
    23790000-237e3000: C:\siebel\siebsrvr\BIN\SSCAEISA.DLL, 811.11.822.4
    22560000-22652000: C:\siebel\siebsrvr\BIN\SSCASPBC.DLL, 811.11.822.4
    23880000-23897000: C:\siebel\siebsrvr\BIN\sscafssvactcache.dll, 811.11.822.4
    239a0000-23a89000: C:\siebel\siebsrvr\BIN\SSCOMMSV.DLL, 811.11.822.4
    036c0000-0372a000: C:\siebel\siebsrvr\BIN\SSCHATBS.DLL, 811.11.822.4
    22770000-227c1000: C:\siebel\siebsrvr\BIN\sscasabc.dll, 811.11.822.4
    23b30000-23b4c000: C:\siebel\siebsrvr\BIN\SSFACMBC.DLL, 811.11.822.4
    23b50000-23b64000: C:\siebel\siebsrvr\BIN\SSFACMSV.DLL, 811.11.822.4
    23ea0000-23eef000: C:\siebel\siebsrvr\BIN\sscacmuinsv.dll, 811.11.822.4
    23490000-234f6000: C:\siebel\siebsrvr\BIN\SWCAFSFR.DLL, 811.11.822.4
    21a80000-21aa5000: C:\siebel\siebsrvr\BIN\SSCASHSV.DLL, 811.11.822.4
    21eb0000-21edd000: C:\siebel\siebsrvr\BIN\SSCASHBC.DLL, 811.11.822.4
    21ee0000-21f2f000: C:\siebel\siebsrvr\BIN\SWCASHFR.DLL, 811.11.822.4
    211d0000-211ee000: C:\siebel\siebsrvr\BIN\sscaxmbc.dll, 811.11.822.4
    23ef0000-23f41000: C:\siebel\siebsrvr\BIN\SWCACGFR.DLL, 811.11.822.4
    22140000-22170000: C:\siebel\siebsrvr\BIN\SSCATASV.DLL, 811.11.822.4
    21220000-212c8000: C:\siebel\siebsrvr\BIN\swcabcfr.dll, 811.11.822.4
    23bd0000-23bf4000: C:\siebel\siebsrvr\BIN\sscasasv.dll, 811.11.822.4
    23b90000-23ba6000: C:\siebel\siebsrvr\BIN\SSCAEIXQ.DLL, 811.11.822.4
    24860000-24929000: C:\siebel\siebsrvr\BIN\swcaspsv.dll, 811.11.822.4
    04080000-0408b000: C:\siebel\siebsrvr\BIN\SSCFUREC.DLL, 811.11.822.4
    Heap status          : ok
    Total physical memory: 50320576 KB
    Free physical memory : 35138076 KB
    Paging file size     : 51918740 KB
    Available paging size: 36997428 KB
    Virtual memory info:
    Total              : 2097024 KB
    Available          : 836420 KB
    Available extendent: 0 KB
    Assert failure count : 1595991
    Command line         : siebmtshmw.exe C:\siebel\siebsrvr\admin\siebprodent.pxsblaom026.shm 33 0 1 5 0 ENU 0 0
    Current directory    : C:\siebel\siebsrvr\BIN
    Executable           : C:\siebel\siebsrvr\BIN\siebmtshmw.exe
    Current time         : 01/19/2015 10:52:32:099
    CCF Version          : 8.1.1.10 SIA [23017] LANG_INDEPENDENT
    CCF Compiled On      : Jan 21 2013 18:06:00
    Would approciate if anyone could provide some inputs on the same..
    Thanks
    Ruban

  • Interesting scenario- user facing error while deleting a sales order

    Hello All,
    I have one interesting scenario and want feedback from your side as soon as possible
    Scenario-
    One of my clients is facing a problem while deleting a sales order.
    the sales order he is trying to delete is the old order created in 2007.
    when i see the document flow the user has created the export order, then delivered it, invoiced and sent it to accounting, accounting document is also cleared. then he cancelled the invoice, reverse PGI and deleted the delivery. the status of the sales order system is showing is being processed. but please note in this case after reversing PGI and deleting a delivery the delivery document disappears from the document flow.
    document flow looks like this
    Order - 200004715                     Being processed
    invoice- 700005310                    completed
    accounting 700005311                 cleared
    Cancel Invoice 700005315            completed
    Accounting 700005316                 cleared
    Now, in 2008 user is trying to delete the sales order but he is unable to do the same. system is giving him message "unable to delete sales order because of subsequent document 70005310 (which is invoice number)"
    Can somebody please throw some light on this problem.
    Thanks in advance.

    Hi,
    As fas as I know, this is standard system behaviour. The reason - you have done PGI (which has created a material document as well as accounting doc) and invoiced & reversed (which again has created accounting documents & rversal documents). All these documents are referencing the sales order.
    If you delete sales order, sales order number gets deleted from VBAK /VBAP tables.
    Hence, in relational data base scenario (meanin SAP in this context), deletion of sales order after creation of subsequent documents is not feasible.
    Hope it clarifies the issue.
    Regards
    Murali

  • How to Delete the node from cluster when the machine crashed?

    In an three nodes Rac of 11g r2,How to delete the node from cluster when the machine crashed?
    There is now way to repair the machine and have to add a new one.
    What is step to follow up?

    hi
    IF YOU WANT TO DELETE RAC1 NODE
    check $./olsnodes
    1) delete the instance using dbca from any active nodes
    crs_stat -t
    srvctl stop asm -n rac1
    2) delete listener
    3) delete oracle_home from oracle user
    $ORACLE_HOME/bin/runInstaller -updatenodelist ORACLE_HOME=<db_home> "CLUSTER_NODES={RAC1}
    4)delete asm home
    $ORACLE_HOME/bin/runInstaller -updatenodelist ORACLE_HOME=<asm_home> "CLUSTER_NODES={RAC1}
    5) update cluster node
    $ORACLE_HOME/bin/runInstaller -updatenodelist ORACLE_HOME=<db_home> "CLUSTER_NODES={active nodes like rac2,rac3}
    6) update ASm home
    $ORACLE_HOME/bin/runInstaller -updatenodelist ORACLE_HOME=<asm_home> "CLUSTER_NODES={active nodes like rac2,rac3}
    cd $ORA_CRS_HOME
    cd crs/opmn/conf
    check for
    $cat ons.config
    remoteport=6200
    cd crs_home/bin
    $./racgons remove_config rac1:6200
    $ go to crs home
    and $ORA_CRS_HOME/crs/install/rootdelete.sh
    $ORA_CRS_HOME/crs/install/rootdeletenode.sh
    check for ./olsnodes

  • What is best use of 1400 gb SGA (2 rac nodes 768gb each)

    currently using 11.2.0.3.0 on unix sun sever with 2 RAC nodes each 8 UltraSPARC-T1 cpus (came out in 2005) four threads each so oracle sees 32 CPUS very slow(1.2 gb).  Database is 4TB in size on regular SAN (10k speed).
    8gb SGA.
    New boss wants to update system to the max to get best performance possible  Money is a concern of course but budget is pretty high,  Our use case is 12-16 users at same time, running reports some small others very large (return single row or 10000s or rows).  reports take 5 sec to 5 minutes, Our job is get the fastest system possible,  We have total of 8 licenses available so we can have 16 cores.  We are also getting a 6tb all flash SSD array for database.  we can get any CPU we want but we cant use parallel query server due to all kinds of issues we have experienced (too many slaves, RAC interconnect saturation etc, whack-a-mole).  sparc has too many threads and without PS oracle runs query in single thread. 
    we have speced out the following system for each RAC node
    HP ProLiant DL380p Gen8 8 SFF server
    2 Intel Xeon E5-2637v2 3.5GHz/4-core cpus
    768 gb ram
    2 HP 300GB 6G SAS 15K drives for database software
    this will give us total of 4 Xeon E5-2637v2 cpus 16 cores total (,5 factor for 8 licenses) and 1536 ram (leaving ~1400 for sga).  this will guarantee an available core for each user.  we intend to create very very large keep pool around 300 gb for each node that will hold all our dimension tables.  this we hope will reduce reads from the SSD to just data from fact tables.,
    Are we doing a massive overkill here?  the budget for this was way less than what our boss expected.  will that big an sga be wasted will say a 256gb be fine.  or will oracle take advantage of it and be able to keep most blocks in there.
    will an sga that big cause oracle problems due to overhead of handling that much ram?

    Current System:
    ===========
    a. Version : 11.2.0.3
    b. Unix Sun
    c. CPU - 8 cpus with 4 threads => 32 logical cpus or cores
    d. database 4TB
    e. SAN - 10k speed disk drives
    f. 8gb SGA
    g. 1.2 gb ??
    h. Users --> 12-16 concurrent and run reports varying size
    i. reports elasped time 5 sec to 5 mins
    j. cpu license -->8
    Target System
    ===========
    a. Version: 11.2.0.3
    b. HP ProLiant DL380p Gen8 8 SFF server
    c. RAM --> 768 GB
    d. 2 HP 300GB 6G SAS 15K drives for database software
    e. large keep pool -->90 gb to  hold all dimension tables. 
    f.  SSD to just data from fact tables
    g. SGA -->256gb
    Reassessment of the performance issues of current system appears to be required.Good performance tuning expert is required to look into tuning issues of current application by analyzing awr performance metrics . If 8GB SGA is not enough,then reason behind so is that queries running in the system are not having good access path to select lesser data to avoid flushing out of recent buffers from different tables involved in the query. Until those issues are identified , wherever you go, performance issue wont be going away as table size increase in future , problem will reappear.Even if the queries are running with more FULL Scan , then re-platforming to Exadata might be right decision as Exadata has smart scan , cell offloading feature which works faster and might be right direction for best performance and best investment for future.Compression (compress for OLTP) could be one of the other feature to exploit to improve further efficiency while reading the lesser block in lesser read time.
    Investment in infrastructure will solve a few issue in short term but long term issue will again arise.
    Investment in identifying the performance issues of current system would be best investment in current scenario.

  • Facing problem in copy of standard SAP  program

    hi,,,,,,,,,,,,
           when i execute this program in production server it displays an error ....i  m    trying to find out this error but this type(error) i cudnt find plz help me .....
           i m sending the documents which i rcvd from the system after the  execution of this program.
    this program executes perfctlly in developmnt server but it creates problem in production server,,,i searched out the type kkblo_t_sortinfo in the whole program but i cud nt find it ,,,,,,,,,
    documents.....
    Runtime Errors SYNTAX_ERROR
    Date and Time 18.11.2006 12:01:19
    ShrtText
    Syntax error in program "ZVISA_RM07MLBD ".
    What happened?
    Error in ABAP application program.
    The current ABAP program "????????????????????????????????????????" had to be
    terminated because one of the
    statements could not be executed.
    This is probably due to an error in the ABAP program.
    In program "ZVISA_RM07MLBD ", the following syntax error occurred
    in the Include "RM07MLBD_FORM_01 " in line 1805:
    The type KKBLO_T_SORTINFO" is unknown."
    also i m sending the include program ver i m facing problem...*&----
    *&  Include           RM07MLBD_FORM_01                                 *
    correction Aug. 2005 MM                                   "n856424
    - the fields "entry time", "entry date", and "User" are   "n856424
      are not filled filled for price change documents        "n856424
    MB5B improved regarding accessibilty                      "n773673
    Improvements :                       March 2003 MM        "n599218
    - print the page numbers                                  "n599218
    - send warning M7 393 when user deletes the initial       "n599218
      display variant                                         "n599218
    - show the current activity and the progress              "n599218
    contains FORM routines without preprocessor commands and  "n547170
    no text elements                                          "n547170
    *&      Form  INITIALISIERUNG
          Vorbelegung der Anzeigevariante                                *
    form initialisierung.
      repid = sy-repid.
      variant_save = 'A'.
      clear variante.
      variante-report = repid.
    Default-Variante holen:
      def_variante = variante.
      call function 'REUSE_ALV_VARIANT_DEFAULT_GET'
           exporting
                i_save     = variant_save
           changing
                cs_variant = def_variante
           exceptions
                not_found  = 2.
      if sy-subrc = 0.
      save the initial, e.g. default variant                  "n599218
        move  def_variante-variant  to  alv_default_variant.    "n599218
        p_vari = def_variante-variant.
      endif.
    print-no_print_listinfos = 'X'.
    endform.                               " INITIALISIERUNG
    *&      Form  AKTUELLE_BESTAENDE
         Ermittlung der aktuellen eigenen Bestände,
         d.h. der bewerteten Bestände und des Retourensperrbestandes,
         auf Lagerortebene und auf Material- bzw. Chargenebene;
         folgende Sonderbestände können gesondert ausgewiesen werden:
          Lohnbearbeitung         ( Sonderbestandskennzeichen  O )
          Kundenkonsignation      (             "              V, W, M )
          Lieferantenkonsignation (             "              K )
          Projektbestand          (             "              Q )
          Kundenauftragsbestand   (             "              E )
    form aktuelle_bestaende.
    delete the range tables for the creation of table g_t_organ
      if  g_t_organ[] is initial.                               "n433765
        refresh : g_0000_ra_werks, g_0000_ra_bwkey, g_0000_ra_bukrs.
        clear   : g_0000_ra_werks, g_0000_ra_bwkey, g_0000_ra_bukrs.
      endif.
      if      bwbst = 'X'.
      select the valuated stocks
        perform                  aktuelle_bst_bwbst.
      elseif lgbst = 'X'.
      all own stock from storage locations or batches
        if xchar = ' '.
          perform                aktuelle_bst_lgbst_mard.
        elseif  xchar = 'X'.
          perform                aktuelle_bst_lgbst_xchar.
        endif.
      elseif   sbbst = 'X'.
       special stocks
        case    sobkz.
          when  'O'.
            perform              aktuelle_bst_sbbst_o.
          when  'V' or  'W'.
            perform              aktuelle_bst_sbbst_v_w.
          when  'K' or  'M'.
            perform              aktuelle_bst_sbbst_k_m.
          when  'Q'.
            perform              aktuelle_bst_sbbst_q.
          when  'E'.
            perform              aktuelle_bst_sbbst_e.
          when  others.
          Angegebener Sonderbestand nicht vorhanden.
            message s290.
            perform              anforderungsbild.
        endcase.
      endif.
    create table g_t_organ with the plants and valuation areas from
    the database selection if table g_t_organ is empty
      perform  f0000_create_table_g_t_organ
                                 using  c_no_error.
    endform.                     "aktuelle_bestaende.
    *&   AKTUELLE_BST_LGBST_MARD
    form aktuelle_bst_lgbst_mard.
    eigener Bestand auf Lagerortebene -
    ... auf Materialebene -
      select * from mard into corresponding fields of table imard
                                             where werks in g_ra_werks
                                             and   lgort in g_ra_lgort
                                             and   matnr in matnr.
      if sy-subrc ne 0.          "no records found ?
        message s289.
      Kein Material in Selektion vorhanden.
        perform                  anforderungsbild.
      endif.
    does the user has the the authority for the found entries ?
      loop at imard.
        perform    f9000_auth_plant_check
                                 using  imard-werks.
        if  g_flag_authority is initial.
          delete             imard.
        else.
          perform  f9200_collect_plant     using  imard-werks.
          perform  f9400_material_key      using  imard-matnr.
        endif.
      endloop.
      describe table imard       lines g_f_cnt_lines.
      if  g_f_cnt_lines is initial.       "no records left  ?
        message s289.
      Kein Material in Selektion vorhanden.
        perform                  anforderungsbild.
      endif.
      if not charg-low is initial or not charg-high is initial.
        clear charg.
        message w285.
      Charge wird zurückgesetzt.
      endif.
    endform.                     "aktuelle_bst_lgbst_mard
       AKTUELLE_BST_LGBST_XCHAR
    form aktuelle_bst_lgbst_xchar.
    read the stock table mchb for batches
      select * from mchb into corresponding fields of table imchb
                                 where   werks  in  g_ra_werks
                                   and   lgort  in  g_ra_lgort
                                   and   matnr  in  matnr
                                   and   charg  in  charg.
      describe table imchb       lines  g_f_cnt_lines.
      if g_f_cnt_lines is initial.         "no records found ?
        message s821 with matnr werks lgort.
      Keine Chargen zu Material & in Werk & Lagerort & vorhanden.
        perform anforderungsbild.
      endif.
    process working table with the batches
      loop at imchb.
      does the user has the the authority for the found entries ?
        perform    f9000_auth_plant_check
                                 using  imchb-werks.
        if  g_flag_authority is initial.
          delete             imchb.
        else.
          perform  f9200_collect_plant     using  imchb-werks.
          perform  f9400_material_key      using  imchb-matnr.
        endif.
      endloop.
    endform.                     "aktuelle_bst_lgbst_xchar
       AKTUELLE_BST_SBBST_O
    form aktuelle_bst_sbbst_o.
    process Special Stocks with Vendor
    Bemerkung: Im Gegensatz zu den anderen Sonderbeständen existieren
               der Lohnbearbeitungs- und Kundenkonsignationsbestand
               nur auf Werksebene.
      select * from mslb into corresponding fields of table xmslb
                                 where  werks  in  g_ra_werks
                                   and  matnr  in  matnr
                                   and  charg  in  charg
                                   and  sobkz  =   'O'.
      if sy-subrc <> 0.                     "no records found ?
         message s289.
       Kein Material in Selektion vorhanden.
         perform anforderungsbild.
      endif.
    process the found records special stock vendor
      loop at xmslb.
      check the authority
        perform  f9000_auth_plant_check
                                 using      xmslb-werks.
        if  g_flag_authority is initial.
          delete                 xmslb.
        else.
        fill range table g_0000_ra_werks if it is still empty
          perform  f9200_collect_plant     using  xmslb-werks.
          perform  f9400_material_key      using  xmslb-matnr.
        endif.
      endloop.
    error, if no records are left
      describe table xmslb       lines g_f_cnt_lines.
      if  g_f_cnt_lines is initial.
        message s289.
      Kein Material in Selektion vorhanden.
        perform anforderungsbild.
      endif.
          sort xmslb.
          loop at xmslb.
            move-corresponding xmslb to imslb.
            collect imslb.
          endloop.
          free xmslb. refresh xmslb.
          if xchar = ' '.
            loop at imslb.
              move-corresponding imslb to imslbx.
              collect imslbx.
            endloop.
            sort imslbx.
          elseif xchar = 'X'.
            loop at imslb.
              check imslb-charg is initial.
              delete imslb.
            endloop.
          endif.
    endform.                     "aktuelle_bst_sbbst_o.
       AKTUELLE_BST_SBBST_V_W
    form aktuelle_bst_sbbst_v_w.
    Sonderbestand Kundenkonsignation -
      elseif sobkz = 'V' or sobkz = 'W'.
          select * from msku into corresponding fields of table xmsku
                                             where werks in g_ra_werks
                                             and   matnr in matnr
                                             and   charg in charg
                                             and   sobkz eq sobkz.
      if sy-subrc <> 0.          "no records found
        message s289.
      Kein Material in Selektion vorhanden.
        perform anforderungsbild.
      endif.
    process Special Stocks with Customer
      loop at xmsku.
        perform  f9000_auth_plant_check    using     xmsku-werks.
        if  g_flag_authority is initial.
          delete                 xmsku.
        else.
          perform  f9200_collect_plant     using  xmsku-werks.
          perform  f9400_material_key      using  xmsku-matnr.
        endif.
      endloop.
      describe table xmsku       lines  g_f_cnt_lines.
      if g_f_cnt_lines is initial.         "no records found
        message s289.
      Kein Material in Selektion vorhanden.
        perform anforderungsbild.
      endif.
          sort xmsku.
          loop at xmsku.
            move-corresponding xmsku to imsku.
            collect imsku.
          endloop.
          free xmsku. refresh xmsku.
          if xchar = ' '.
            loop at imsku.
              move-corresponding imsku to imskux.
              collect imskux.
            endloop.
            sort imskux.
          elseif xchar = 'X'.
            loop at imsku.
              check imsku-charg is initial.
              delete imsku.
            endloop.
          endif.
          if sy-subrc ne 0.
            message s042.                             "#EC *    "n443935
          Charge ist nicht vorhanden.
            perform anforderungsbild.
          endif.
    endform.                     "aktuelle_bst_sbbst_v_w
       AKTUELLE_BST_SBBST_K_M
    form aktuelle_bst_sbbst_k_m.
    Sonderbestand Lieferantenkonsignation -
      elseif sobkz = 'K' or sobkz = 'M'.
          select * from mkol into corresponding fields of table xmkol
                                            where werks in g_ra_werks
                                            and   lgort in g_ra_lgort
                                            and   matnr in matnr
                                            and   charg in charg
                                            and   sobkz eq sobkz.
      if sy-subrc <> 0.          "no records found
        message s289.
      Kein Material in Selektion vorhanden.
        perform anforderungsbild.
      endif.
    process Special Stocks from Vendor
      loop at xmkol.
        perform  f9000_auth_plant_check    using  xmkol-werks.
        if  g_flag_authority is initial.
          delete             xmkol.
        else.
          perform  f9200_collect_plant     using  xmkol-werks.
          perform  f9400_material_key      using  xmkol-matnr.
        endif.
      endloop.
      describe table xmkol       lines  g_f_cnt_lines.
      if g_f_cnt_lines is initial.         "no records found
        message s289.
      Kein Material in Selektion vorhanden.
        perform anforderungsbild.
      endif.
          sort xmkol.
          loop at xmkol.
            move-corresponding xmkol to imkol.
            collect imkol.
          endloop.
          free xmkol. refresh xmkol.
          if xchar = ' '.
            loop at imkol.
              move-corresponding imkol to imkolx.
              collect imkolx.
            endloop.
            sort imkolx.
          elseif xchar = 'X'.
            loop at imkol.
              check imkol-charg is initial.
              delete imkol.
            endloop.
          endif.
          if sy-subrc ne 0.
            message s042.                             "#EC *    "n443935
          Charge ist nicht vorhanden.
            perform anforderungsbild.
          endif.
    endform.                     "aktuelle_bst_sbbst_k_m.
       AKTUELLE_BST_SBBST_Q
    form aktuelle_bst_sbbst_q.
    Projektbestand -
      elseif sobkz = 'Q'.
          select * from mspr into corresponding fields of table xmspr
                                             where werks in g_ra_werks
                                             and   lgort in g_ra_lgort
                                             and   matnr in matnr
                                             and   charg in charg
                                             and   sobkz eq sobkz.
      if sy-subrc <> 0.          "no record found
        message s289.
      Kein Material in Selektion vorhanden.
        perform anforderungsbild.
      endif.
    process project stock
      loop at xmspr.
        perform  f9000_auth_plant_check    using  xmspr-werks.
        if  g_flag_authority is initial.
          delete                 xmspr.
        else.
          perform  f9200_collect_plant     using  xmspr-werks.
          perform  f9400_material_key      using  xmspr-matnr.
        endif.
      endloop.
      describe table xmspr       lines  g_f_cnt_lines.
      if  g_f_cnt_lines is initial.        "no record left
        message s289.
      Kein Material in Selektion vorhanden.
        perform anforderungsbild.
      endif.
          sort xmspr.
          loop at xmspr.
            move-corresponding xmspr to imspr.
            collect imspr.
          endloop.
          free xmspr. refresh xmspr.
          if xchar = ' '.
            loop at imspr.
              move-corresponding imspr to imsprx.
              collect imsprx.
            endloop.
            sort imsprx.
          elseif xchar = 'X'.
            loop at imspr.
              check imspr-charg is initial.
              delete imspr.
            endloop.
          endif.
    endform.:                     "aktuelle_bst_sbbst_q
       AKTUELLE_BST_SBBST_E
    form aktuelle_bst_sbbst_e.
    Kundenauftragsbestand -
          select * from mska into corresponding fields of table xmska
                                             where werks in g_ra_werks
                                             and   lgort in g_ra_lgort
                                             and   matnr in matnr
                                             and   charg in charg
                                             and   sobkz eq sobkz.
      if sy-subrc <> 0.            "no records found
        message s289.
      Kein Material in Selektion vorhanden.
        perform anforderungsbild.
      endif.
    process Sales Order Stock
      loop at xmska.
        perform  f9000_auth_plant_check    using  xmska-werks.
        if  g_flag_authority is initial.
          delete                   xmska.
        else.
          perform  f9200_collect_plant     using  xmska-werks.
          perform  f9400_material_key      using  xmska-matnr.
        endif.
      endloop.
      describe table xmska       lines  g_f_cnt_lines.
      if  g_f_cnt_lines is initial.        "no records left ?
        message s289.
      Kein Material in Selektion vorhanden.
        perform anforderungsbild.
      endif.
          sort xmska.
          loop at xmska.
            move-corresponding xmska to imska.
            collect imska.
          endloop.
          free xmska. refresh xmska.
          if xchar = ' '.
            loop at imska.
              move-corresponding imska to imskax.
              collect imskax.
            endloop.
            sort imskax.
          elseif xchar = 'X'.
            loop at imska.
              check imska-charg is initial.
              delete imska.
            endloop.
          endif.
    endform.                     "aktuelle_bst_sbbst_e
    *&      Form  TABELLEN_LESEN
          Lesen der Materialkurztexte (Tabelle MAKT),                    *
          der Mengeneinheiten (Tabelle MARA) und                         *
          Mengen- und Wertfortschreibung zum Material (Tabelle T134M)    *
          (Letzteres ist zum Aussortieren der unbewerteten bzw.          *
          kontierten Warenbewegungen notwendig)                          *
    form tabellen_lesen.
      if  not g_t_mat_key[] is initial.                         "n451923
      select the material masters
        select matnr meins mtart from mara
                       into corresponding fields of table imara
                       for all entries in g_t_mat_key
                                 where  matnr  =  g_t_mat_key-matnr.
      select the short text for all materials
      take only the necessary fields                          "n451923
        select matnr maktx       from makt                      "n451923
             into corresponding fields of table g_t_makt        "n451923
                       for all entries in g_t_mat_key
                       where  matnr = g_t_mat_key-matnr
                         and  spras = sy-langu.
        sort  imara              by  matnr.                     "n451923
        sort  g_t_makt           by  matnr.                     "n451923
        free                     g_t_mat_key.
      endif.
      data: begin of k1 occurs 0,
        mtart like t134m-mtart,
      end of k1.
      refresh k1.
      loop at imara.
        k1-mtart = imara-mtart.
        collect k1.
      endloop.
      if  not k1[] is initial.                                  "n451923
        select * from t134m
               into corresponding fields of table it134m
               for all entries in k1         where mtart = k1-mtart
                                             and   bwkey in g_ra_bwkey.
      endif.                                                    "n451923
      loop at it134m.
      read table organ with key bwkey = it134m-bwkey.
        perform  f9300_read_organ
                       using     c_bwkey     it134m-bwkey.
        if sy-subrc ne 0.
          delete it134m.
        endif.
      endloop.
    To find postings with valuation string, but without relevance for
    the valuated stock, Big-G recommended this logic:
    Take lines from MSEG where for the combination BUSTW/XAUTO=XBGBB
    there is an entry in T156W with key BSX.
      select bustw xbgbb from t156w
                         into corresponding fields of table it156w
                         where vorsl = 'BSX'.
      sort it156w by bustw xbgbb.
      delete adjacent duplicates from it156w.
      delete it156w where bustw = space.
    endform.                               " TABELLEN_LESEN
    *&      Form  UNBEWERTET_WEG
          Löschen der unbewerteten Materialien aus der internen          *
          Tabelle IMBEW
    form unbewertet_weg.
      sort  it134m               by bwkey mtart.                "n451923
                                                                "n450764
    delete the materials in plants without valuation          "n450764
      loop at g_t_mbew           into  g_s_mbew.                "n450764
        read table imara                                        "n450764
                       with key matnr = g_s_mbew-matnr          "n450764
                       binary search.                           "n450764
                                                                "n450764
        read table it134m with key bwkey = g_s_mbew-bwkey       "n450764
                                   mtart = imara-mtart binary search.
        if sy-subrc ne 0.
        message ...
          delete                 g_t_mbew.                      "n450764
        else.
          if it134m-wertu = ' '.
            delete               g_t_mbew.                      "n450764
          else.                                                 "n450764
          enrich the entries with the quantity unit           "n450764
            move    imara-meins  to    g_s_mbew-meins.          "n450764
            modify  g_t_mbew     from  g_s_mbew                 "n450764
                                 transporting  meins.           "n450764
          endif.
        endif.
      endloop.
    endform.                               " UNBEWERTET_WEG
    *&      Form  FI_BELEGE_LESEN                                          *
          Lesen der Buchhaltungsbelege                                   *
    Beim Erfassen der Werte ist es notwendig, die Buchhaltungsbelege    *
    zum Material zu lesen, um abweichende Werte zwischen Wareneingang   *
    und Rechnungseingang sowie Nachbelastungen zu berücksichtigen.      *
    form fi_belege_lesen.
    Not related to note 184465, but a significant performance issue
    if ORGAN is large due to many plants/storage locations.
      data: begin of t_bwkey occurs 0,                               "184465
              bwkey like bsim-bwkey,                                 "184465
            end of t_bwkey.                                          "184465
      loop at g_t_organ          where  keytype  =  c_bwkey.
        move g_t_organ-bwkey     to  t_bwkey-bwkey.
        collect t_bwkey.                                             "184465
      endloop.                                                       "184465
      read table t_bwkey index 1.                                    "184465
      check sy-subrc = 0.                                            "184465
      select * from bsim                                        "n443935
             into corresponding fields of table g_t_bsim_lean   "n443935
               for all entries in t_bwkey   where  bwkey = t_bwkey-bwkey
                                            and    matnr in matnr
                                            and    bwtar in bwtar
                                            and    budat >= datum-low.
      loop at g_t_bsim_lean      into  g_s_bsim_lean.           "n443935
        perform  f9300_read_organ
                       using     c_bwkey  g_s_bsim_lean-bwkey.  "n443935
        if  sy-subrc is initial.
        record found : the user has the authority, go on
          move  g_s_organ-bukrs  to  g_s_bsim_lean-bukrs.       "n443935
          modify  g_t_bsim_lean  from  g_s_bsim_lean            "n443935
                                 transporting  bukrs.           "n451923
        create working table with the keys for the FI documents
          move-corresponding  g_s_bsim_lean                     "n443935
                                 to  g_t_bkpf_key.              "n443935
          append                 g_t_bkpf_key.
        else.
          delete                 g_t_bsim_lean.                 "n443935
        endif.
      endloop.
    endform.                               " FI_BELEGE_LESEN
    *&      Form  BELEGE_SORTIEREN
       Die Materialbelege werden anhand des Buchungsdatums sortiert.
       Die Materialbelege mit Buchungsdatum zwischen 'datum-high'
       und dem aktuellen Datum werden in der internen Tabelle IMSWEG
       gesammelt, während die Materialbelege mit Buchungsdatum
       zwischen 'datum-low' und 'datum-high' in der internen Tabelle
       IMSEG verbleiben.
    form belege_sortieren.
      aktdat = sy-datlo + 30.
      if not ( datum-high is initial or datum-high > aktdat ).
        loop at g_t_mseg_lean    into  g_s_mseg_lean
                                 where budat > datum-high.
          move-corresponding g_s_mseg_lean to imsweg.
          append imsweg.
          delete                 g_t_mseg_lean.
        endloop.
      endif.
      describe table imsweg lines index_2.
    endform.                               " BELEGE_SORTIEREN
    *&      Form  KONTIERT_AUSSORTIEREN
          Aussortierung der kontierten Belegpositionen,                  *
          da diese Mengen nicht bestandsrelevant sind                    *
    form kontiert_aussortieren.
    process table g_t_mseg_lean
    loop at imseg where kzvbr <> space and                         "144845
        ( kzbew = 'B' or kzbew = 'F' ).                            "144845
        read table imara with key matnr = imseg-matnr.
        read table it134m with key mtart = imara-mtart.
        if not it134m-mengu is initial and not it134m-wertu is initial.
    Die Felder 'mengu' und 'wertu' (Mengen- bzw. Wertfortschreibung)
    sind ab Release 3.0 D auch in die Tabelle MSEG aufgenommen.
    Die Einträge in der Tabelle T134M stellen nach wie vor die generelle
    Einstellung dar; auf Positionsebene sind jedoch Abänderungen möglich,
    die anhand der Einträge in der Tabelle MSEG nachverfolgt werden
    können.
          delete imseg.
        endif.
    endloop.
      data : l_f_bwkey           like  t001k-bwkey.             "n497992
      sort  it134m               by  bwkey  mtart.              "n497992
      loop at g_t_mseg_lean      into  g_s_mseg_lean
                                 where  kzvbr <> space
                                   and ( kzbew = 'B' or kzbew = 'F' ).
      get the valuation area                                  "n497992
        if  curm = '3'.                                         "n497992
        valuation level is company code                       "n497992
          if  g_s_mseg_lean-bukrs is initial.                   "n497992
          get the valuation area for this plant               "n497992
            perform  f9300_read_organ                           "n497992
                       using     c_werks   g_s_mseg_lean-werks. "n497992
                                                                "n497992
            move  g_s_organ-bwkey     to  l_f_bwkey.            "n497992
          else.                                                 "n497992
            move  g_s_mseg_lean-bukrs to  l_f_bwkey.            "n497992
          endif.                                                "n497992
        else.                                                   "n497992
        valuation level is plant                              "n497992
          move  g_s_mseg_lean-werks   to  l_f_bwkey.            "n497992
        endif.                                                  "n497992
        read table imara with key matnr = g_s_mseg_lean-matnr
                                 binary search.
        if  sy-subrc is initial.
          read table it134m      with key  bwkey = l_f_bwkey    "n497992
                                           mtart = imara-mtart  "n497992
                                 binary search.
          if  sy-subrc is initial.
            if not it134m-mengu is initial and
               not it134m-wertu is initial.
              delete              g_t_mseg_lean.
            endif.
          endif.
        else.
          delete                  g_t_mseg_lean.
        endif.
      endloop.
    endform.                               " KONTIERT_AUSSORTIEREN
    *&      Form  BELEGE_ERGAENZEN (engl. enrich documents)
    Material documents and FI documents from BSIM are merged together.
    Complications:
    - A material document can have more than one FI document.
    - There are FI documents without material documnts
    - There are material documents without FI documents
    - The document type is customizeable
    - There is no link from the materia document position to
      the FI document entry in BSIM (except URZEILE, but this
      can be filled incorrectly)
    form belege_ergaenzen.                         "Version from note 204872
    - show the current activity and the progress              "n599218
      call function 'SAPGUI_PROGRESS_INDICATOR'                 "n599218
        exporting                                               "n599218
          text = text-061.       "Reading FI documents          "n599218
    Eliminate material documents with valuation string, but without
    relevance to the valuated stock. IT156W contains all valuation
    strings with posting key BSX. XBGBB says: "I am an accrural posting".
    For more details please ask Big-G.
      loop at g_t_mseg_lean      into  g_s_mseg_lean.
      special processing for tied empties active ?            "n497992
        if  not g_cust_tied_empties is initial.                 "n497992
        look for MM documents with xauto = L and change       "n497992
        indicators                                            "n497992
          case  g_s_mseg_lean-xauto.                            "n497992
            when  'X'.                                          "n497992
            when  space.                                        "n497992
            when  others.                                       "n547170
            range table g_ra_xauto contains the special       "n547170
            indicators for the transfer movements of the      "n547170
            tied empties                                      "n547170
              if  g_s_mseg_lean-xauto in g_ra_xauto.            "n547170
                move  g_s_mseg_lean-xauto                         "n497992
                                 to  g_s_mseg_lean-retail.        "n497992
                clear              g_s_mseg_lean-xauto.           "n497992
                modify  g_t_mseg_lean    from  g_s_mseg_lean      "n497992
                                 transporting xauto retail.       "n497992
              endif.                                            "n547170
          endcase.                                              "n497992
        endif.                                                  "n497992
        read table it156w        with key
                                 bustw = g_s_mseg_lean-bustw
                                 xbgbb = g_s_mseg_lean-xauto
                                 transporting no fields
                                 binary search.
        if sy-subrc <> 0.
          delete                 g_t_mseg_lean.
        else.                                                   "n443935
        enrich the current entry with the company code        "n443935
          perform f9300_read_organ                              "n443935
                       using     c_werks  g_s_mseg_lean-werks.  "n443935
                                                                "n443935
          check : sy-subrc is initial.                          "n443935
          move  g_s_organ-bukrs  to  g_s_mseg_lean-bukrs.       "n443935
          modify  g_t_mseg_lean  from  g_s_mseg_lean            "n443935
                                 transporting  bukrs.           "n451923
        endif.
      endloop.
    For all available FI documents from BSIM, read the header data
    from BKPF to get the link to the originating material document.
      if  not g_t_bkpf_key[] is initial.
      look for the header of the matching FI documents
        sort  g_t_bkpf_key       by  bukrs belnr gjahr.
        delete adjacent duplicates from g_t_bkpf_key.
      save result from database selection into global hashed  "n856424
      table g_t_bkpf                                          "n856424
        select  *                 from bkpf                     "n856424
          into corresponding fields of table g_t_bkpf           "n856424
               for all entries in g_t_bkpf_key
                       where  bukrs = g_t_bkpf_key-bukrs
                         and  belnr = g_t_bkpf_key-belnr
                         and  gjahr = g_t_bkpf_key-gjahr.
        if  sy-subrc is initial.
        create working table l_t_keytab_m
          free                   g_t_bkpf_key.
          loop at g_t_bsim_lean  into  g_s_bsim_lean.           "n443935
          enrich the working table g_t_bsim_lean with the     "n443935
          MM doc info                                         "n443935
                                                                "n443935
          look for the matching FI document header            "n443935
            read table g_t_bkpf  assigning           "n856424
                       with key  bukrs = g_s_bsim_lean-bukrs    "n443935
                                 belnr = g_s_bsim_lean-belnr    "n443935
                                 gjahr = g_s_bsim_lean-gjahr.   "n443935
                                                                "n443935
            if  sy-subrc is initial.                            "n443935
            enrich table G_T_BSIM_LEAN with the MM doc        "n443935
            consider only FI docs created by MM docs here     "n856424
              check :

    Hi Ravi,
    possibly a service pack has been installed just in the time when you created the copy. I found
        data: lt_sort type kkblo_t_sortinfo.                    "n890109
    in the include mentioned on our system. Please check if the includes are identical in development and production server (remote-compare from editor).
    But we also have a copy of this in our system. In the copy I found type name like alv_type_sortinfo but no kkblo_t_sortinfo.
    Note KKBLO was the predecessor of ALV.
    Must have to dio something with version changed by service pack.
    Regards,
    Clemens

  • Rac node restart

    Hello everyone,
    I have met an error,that is our RAC node auto restart with below messages.
    #/u01/app/oracle/diag/rdbms/odsdb/odsdb1/trace/alert_odsdb1.log
    Fri Jun 07 12:23:42 2013
    Thread 1 cannot allocate new log, sequence 58363
    Checkpoint not complete
    Current log# 2 seq# 58362 mem# 0: +DATA/odsdb/onlinelog/group_2.265.812288839
    Current log# 2 seq# 58362 mem# 1: +DATA/odsdb/onlinelog/group_2.266.812288839
    Fri Jun 07 12:23:42 2013
    NOTE: ASMB terminating
    Errors in file /u01/app/oracle/diag/rdbms/odsdb/odsdb1/trace/odsdb1_asmb_32641.trc:
    ORA-15064: ? ASM ??????
    ORA-03113: ?????????
    ?? ID:
    ?? ID: 2047 ???: 5
    Errors in file /u01/app/oracle/diag/rdbms/odsdb/odsdb1/trace/odsdb1_asmb_32641.trc:
    ORA-15064: ? ASM ??????
    ORA-03113: ?????????
    ?? ID:
    ?? ID: 2047 ???: 5
    ASMB (ospid: 32641): terminating the instance due to error 15064
    Fri Jun 07 12:23:44 2013
    ORA-1092 : opitsk aborting process
    Fri Jun 07 12:23:46 2013
    ORA-1092 : opitsk aborting process
    Instance terminated by ASMB, pid = 32641
    Fri Jun 07 12:25:02 2013
    Starting ORACLE instance (normal)
    Fri Jun 07 12:25:23 2013
    LICENSE_MAX_SESSION = 0
    LICENSE_SESSIONS_WARNING = 0
    Private Interface 'eth1:1' configured from GPnP for use as a private interconnect.
    [name='eth1:1', type=1, ip=169.254.37.103, mac=00-26-55-eb-61-89, net=169.254.0.0/16, mask=255.255.0.0, use=haip:cluster_interconnect/62]
    Public Interface 'eth0' configured from GPnP for use as a public interface.
    [name='eth0', type=1, ip=135.33.2.8, mac=00-26-55-eb-61-88, net=135.33.2.0/27, mask=255.255.255.224, use=public/1]
    Public Interface 'eth0:1' configured from GPnP for use as a public interface.
    [name='eth0:1', type=1, ip=135.33.2.13, mac=00-26-55-eb-61-88, net=135.33.2.0/27, mask=255.255.255.224, use=public/1]
    Picked latch-free SCN scheme 3
    Using LOG_ARCHIVE_DEST_1 parameter default value as /u01/app/oracle/product/11.2.0/dbhome_2/dbs/arch
    Autotune of undo retention is turned on.
    LICENSE_MAX_USERS = 0
    SYS auditing is disabled
    Starting up:
    Oracle Database 11g Enterprise Edition Release 11.2.0.3.0 - 64bit Production
    With the Partitioning, Real Application Clusters, OLAP, Data Mining
    and Real Application Testing options.
    ORACLE_HOME = /u01/app/oracle/product/11.2.0/dbhome_2
    System name:     Linux
    Node name:     odsdb1
    Release:     2.6.18-308.el5
    Version:     #1 SMP Fri Jan 27 17:17:51 EST 2012
    Machine:     x86_64
    Using parameter settings in server-side pfile /u01/app/oracle/product/11.2.0/dbhome_2/dbs/initodsdb1.ora
    System parameters with non-default values:
    processes = 4500
    sessions = 6784
    event = ""
    spfile = "+DATA/odsdb/spfileodsdb.ora"
    nls_language = "SIMPLIFIED CHINESE"
    nls_territory = "CHINA"
    memory_target = 170G
    control_files = "+DATA/odsdb/controlfile/current.262.812288837"
    control_files = "+DATA/odsdb/controlfile/current.261.812288837"
    db_block_size = 8192
    compatible = "11.2.0.0.0"
    db_files = 4096
    cluster_database = TRUE
    db_create_file_dest = "+DATA"
    db_recovery_file_dest = ""
    db_recovery_file_dest_size= 38820M
    thread = 1
    undo_tablespace = "UNDOTBS1"
    instance_number = 1
    remote_login_passwordfile= "EXCLUSIVE"
    db_domain = ""
    dispatchers = "(PROTOCOL=TCP) (SERVICE=odsdbXDB)"
    remote_listener = "odsdb-cluster-scan:1521"
    job_queue_processes = 1000
    audit_file_dest = "/u01/app/oracle/admin/odsdb/adump"
    audit_trail = "DB"
    db_name = "odsdb"
    open_cursors = 300
    diagnostic_dest = "/u01/app/oracle"
    Cluster communication is configured to use the following interface(s) for this instance
    169.254.37.103
    cluster interconnect IPC version:Oracle UDP/IP (generic)
    IPC Vendor 1 proto 2
    Fri Jun 07 12:25:33 2013
    PMON started with pid=2, OS id=22959
    Fri Jun 07 12:25:33 2013
    PSP0 started with pid=3, OS id=22962
    Fri Jun 07 12:25:34 2013
    VKTM started with pid=4, OS id=22971 at elevated priority
    VKTM running at (1)millisec precision with DBRM quantum (100)ms
    Fri Jun 07 12:25:34 2013
    GEN0 started with pid=5, OS id=22977
    Fri Jun 07 12:25:34 2013
    DIAG started with pid=6, OS id=22979
    Fri Jun 07 12:25:35 2013
    DBRM started with pid=7, OS id=22981
    Fri Jun 07 12:25:35 2013
    PING started with pid=8, OS id=22983
    Fri Jun 07 12:25:35 2013
    ACMS started with pid=9, OS id=22985
    Fri Jun 07 12:25:35 2013
    DIA0 started with pid=10, OS id=22987
    Fri Jun 07 12:25:35 2013
    LMON started with pid=11, OS id=22989
    Fri Jun 07 12:25:35 2013
    LMD0 started with pid=12, OS id=22991
    * Load Monitor used for high load check
    * New Low - High Load Threshold Range = [61440 - 81920]
    Fri Jun 07 12:25:35 2013
    LMS0 started with pid=13, OS id=22994 at elevated priority
    Fri Jun 07 12:25:35 2013
    LMS1 started with pid=14, OS id=22998 at elevated priority
    Fri Jun 07 12:25:35 2013
    LMS2 started with pid=15, OS id=23002 at elevated priority
    Fri Jun 07 12:25:35 2013
    LMS3 started with pid=16, OS id=23006 at elevated priority
    Fri Jun 07 12:25:35 2013
    RMS0 started with pid=17, OS id=23010
    Fri Jun 07 12:25:35 2013
    LMHB started with pid=18, OS id=23013
    Fri Jun 07 12:25:35 2013
    MMAN started with pid=19, OS id=23015
    Fri Jun 07 12:25:35 2013
    DBW0 started with pid=20, OS id=23017
    Fri Jun 07 12:25:35 2013
    DBW1 started with pid=21, OS id=23019
    Fri Jun 07 12:25:35 2013
    DBW2 started with pid=22, OS id=23022
    Fri Jun 07 12:25:35 2013
    DBW3 started with pid=23, OS id=23024
    Fri Jun 07 12:25:35 2013
    DBW4 started with pid=24, OS id=23026
    Fri Jun 07 12:25:35 2013
    DBW5 started with pid=25, OS id=23028
    Fri Jun 07 12:25:35 2013
    DBW6 started with pid=26, OS id=23031
    Fri Jun 07 12:25:35 2013
    DBW7 started with pid=27, OS id=23033
    Fri Jun 07 12:25:35 2013
    LGWR started with pid=28, OS id=23035
    Fri Jun 07 12:25:35 2013
    CKPT started with pid=29, OS id=23037
    Fri Jun 07 12:25:35 2013
    SMON started with pid=30, OS id=23039
    Fri Jun 07 12:25:35 2013
    RECO started with pid=31, OS id=23041
    Fri Jun 07 12:25:35 2013
    RBAL started with pid=32, OS id=23043
    Fri Jun 07 12:25:35 2013
    ASMB started with pid=33, OS id=23045
    Fri Jun 07 12:25:35 2013
    MMON started with pid=34, OS id=23048
    Fri Jun 07 12:25:35 2013
    MMNL started with pid=35, OS id=23052
    Fri Jun 07 12:25:35 2013
    starting up 1 dispatcher(s) for network address '(ADDRESS=(PARTIAL=YES)(PROTOCOL=TCP))'...
    NOTE: initiating MARK startup
    starting up 1 shared server(s) ...
    Starting background process MARK
    Fri Jun 07 12:25:35 2013
    MARK started with pid=37, OS id=23056
    NOTE: MARK has subscribed
    lmon registered with NM - instance number 1 (internal mem no 0)
    Reconfiguration started (old inc 0, new inc 119)
    List of instances:
    1 2 (myinst: 1)
    Global Resource Directory frozen
    * allocate domain 0, invalid = TRUE
    Communication channels reestablished
    * domain 0 valid according to instance 2
    * domain 0 valid = 1 according to instance 2
    Master broadcasted resource hash value bitmaps
    Non-local Process blocks cleaned out
    LMS 3: 0 GCS shadows cancelled, 0 closed, 0 Xw survived
    LMS 1: 0 GCS shadows cancelled, 0 closed, 0 Xw survived
    LMS 2: 0 GCS shadows cancelled, 0 closed, 0 Xw survived
    LMS 0: 0 GCS shadows cancelled, 0 closed, 0 Xw survived
    Set master node info
    Submitted all remote-enqueue requests
    Dwn-cvts replayed, VALBLKs dubious
    All grantable enqueues granted
    Submitted all GCS remote-cache requests
    Fix write in gcs resources
    Reconfiguration started (old inc 119, new inc 121)
    List of instances:
    1 2 (myinst: 1)
    Nested reconfiguration detected.
    Global Resource Directory frozen
    Communication channels reestablished
    Master broadcasted resource hash value bitmaps
    Non-local Process blocks cleaned out
    LMS 0: 0 GCS shadows cancelled, 0 closed, 0 Xw survived
    LMS 3: 0 GCS shadows cancelled, 0 closed, 0 Xw survived
    LMS 2: 0 GCS shadows cancelled, 0 closed, 0 Xw survived
    LMS 1: 0 GCS shadows cancelled, 0 closed, 0 Xw survived
    Set master node info
    Submitted all remote-enqueue requests
    Dwn-cvts replayed, VALBLKs dubious
    All grantable enqueues granted
    Fri Jun 07 12:25:45 2013
    Submitted all GCS remote-cache requests
    Fri Jun 07 12:26:08 2013
    Fix write in gcs resources
    Reconfiguration complete
    Fri Jun 07 12:26:10 2013
    LCK0 started with pid=40, OS id=23632
    Fri Jun 07 12:26:10 2013
    Starting background process RSMN
    Fri Jun 07 12:26:10 2013
    RSMN started with pid=41, OS id=23646
    ORACLE_BASE not set in environment. It is recommended
    that ORACLE_BASE be set in the environment
    Reusing ORACLE_BASE from an earlier startup = /u01/app/oracle
    Fri Jun 07 12:26:11 2013
    ALTER SYSTEM SET local_listener=' (DESCRIPTION=(ADDRESS_LIST=(ADDRESS=(PROTOCOL=TCP)(HOST=135.33.2.13)(PORT=1521))))' SCOPE=MEMORY SID='odsdb1';
    ALTER DATABASE MOUNT /* db agent *//* {1:9971:2} */
    Fri Jun 07 12:26:11 2013
    NOTE: Loaded library: System
    Fri Jun 07 12:26:11 2013
    SUCCESS: diskgroup DATA was mounted
    Fri Jun 07 12:26:11 2013
    NOTE: dependency between database odsdb and diskgroup resource ora.DATA.dg is established
    Fri Jun 07 12:26:16 2013
    Successful mount of redo thread 1, with mount id 3452000551
    Database mounted in Shared Mode (CLUSTER_DATABASE=TRUE)
    Lost write protection disabled
    Completed: ALTER DATABASE MOUNT /* db agent *//* {1:9971:2} */
    ALTER DATABASE OPEN /* db agent *//* {1:9971:2} */
    Picked broadcast on commit scheme to generate SCNs
    Thread 1 advanced to log sequence 58364 (thread open)
    Thread 1 opened at log sequence 58364
    Current log# 2 seq# 58364 mem# 0: +DATA/odsdb/onlinelog/group_2.265.812288839
    Current log# 2 seq# 58364 mem# 1: +DATA/odsdb/onlinelog/group_2.266.812288839
    Successful open of redo thread 1
    MTTR advisory is disabled because FAST_START_MTTR_TARGET is not set
    Fri Jun 07 12:26:21 2013
    SMON: enabling cache recovery
    Fri Jun 07 12:26:23 2013
    minact-scn: Inst 1 is a slave inc#:121 mmon proc-id:23048 status:0x2
    minact-scn status: grec-scn:0x0000.00000000 gmin-scn:0x0000.00000000 gcalc-scn:0x0000.00000000
    Fri Jun 07 12:26:34 2013
    [23651] Successfully onlined Undo Tablespace 2.
    Undo initialization finished serial:0 start:2061372614 end:2061384964 diff:12350 (123 seconds)
    Verifying file header compatibility for 11g tablespace encryption..
    Verifying 11g file header compatibility for tablespace encryption completed
    Fri Jun 07 12:26:34 2013
    SMON: enabling tx recovery
    Database Characterset is ZHS16GBK
    No Resource Manager plan active
    Starting background process GTX0
    Fri Jun 07 12:26:35 2013
    GTX0 started with pid=45, OS id=23931
    Starting background process RCBG
    Fri Jun 07 12:26:35 2013
    RCBG started with pid=46, OS id=23933
    replication_dependency_tracking turned off (no async multimaster replication found)
    Starting background process QMNC
    Fri Jun 07 12:26:35 2013
    QMNC started with pid=48, OS id=23940
    Completed: ALTER DATABASE OPEN /* db agent *//* {1:9971:2} */
    Fri Jun 07 12:26:38 2013
    Starting background process CJQ0
    Fri Jun 07 12:26:38 2013
    CJQ0 started with pid=55, OS id=23977
    Fri Jun 07 12:27:56 2013
    Thread 1 advanced to log sequence 58365 (LGWR switch)
    Current log# 1 seq# 58365 mem# 0: +DATA/odsdb/onlinelog/group_1.263.812288839
    Current log# 1 seq# 58365 mem# 1: +DATA/odsdb/onlinelog/group_1.264.812288839
    Fri Jun 07 12:28:18 2013
    Starting background process SMCO
    Fri Jun 07 12:28:18 2013
    SMCO started with pid=70, OS id=25166
    Fri Jun 07 12:29:01 2013
    Thread 1 cannot allocate new log, sequence 58366
    Trace file /u01/app/oracle/diag/rdbms/odsdb/odsdb1/trace/odsdb1_asmb_32641.trc
    Oracle Database 11g Enterprise Edition Release 11.2.0.3.0 - 64bit Production
    With the Partitioning, Real Application Clusters, OLAP, Data Mining
    and Real Application Testing options
    ORACLE_HOME = /u01/app/oracle/product/11.2.0/dbhome_2
    System name: Linux
    Node name: odsdb1
    Release: 2.6.18-308.el5
    Version: #1 SMP Fri Jan 27 17:17:51 EST 2012
    Machine: x86_64
    Instance name: odsdb1
    Redo thread mounted by this instance: 0 <none>
    Oracle process number: 33
    Unix process pid: 32641, image: oracle@odsdb1 (ASMB)
    *** 2013-05-14 15:37:08.705
    *** SESSION ID:(3499.1) 2013-05-14 15:37:08.705
    *** CLIENT ID:() 2013-05-14 15:37:08.705
    *** SERVICE NAME:() 2013-05-14 15:37:08.705
    *** MODULE NAME:() 2013-05-14 15:37:08.705
    *** ACTION NAME:() 2013-05-14 15:37:08.705
    NOTE: initiating MARK startup
    *** 2013-05-14 15:37:16.835
    instance health monitoring reports instance shutting down
    *** 2013-06-07 12:23:42.700
    NOTE: ASMB terminating
    ORA-15064: ? ASM ??????
    ORA-03113: ?????????
    ?? ID:
    ?? ID: 2047 ???: 5
    error 15064 detected in background process
    ORA-15064: ? ASM ??????
    ORA-03113: ?????????
    ?? ID:
    ?? ID: 2047 ???: 5
    kjzduptcctx: Notifying DIAG for crash event
    ----- Abridged Call Stack Trace -----
    ksedsts()+461<-kjzdssdmp()+267<-kjzduptcctx()+232<-kjzdicrshnfy()+53<-ksuitm()+1332<-ksbrdp()+3344<-opirip()+623<-opidrv()+603<-sou2o()+103<-opimai_real()+266<-ssthrdmain()+252<-main()+201<-__libc_start_main()+244<-_start()+36
    ----- End of Abridged Call Stack Trace -----
    *** 2013-06-07 12:23:42.783
    ASMB (ospid: 32641): terminating the instance due to error 15064
    /u01/app/grid/diag/asm/+asm/+ASM1/trace/alert_+ASM1.log
    NOTE: ASMB process exiting, either shutdown is in progress
    NOTE: or foreground connected to ASMB was killed.
    Fri Jun 07 12:23:42 2013
    NOTE: client exited [14808]
    Fri Jun 07 12:23:44 2013
    Received an instance abort message from instance 2
    Please check instance 2 alert and LMON trace files for detail.
    Fri Jun 07 12:23:44 2013
    Received an instance abort message from instance 2
    Please check instance 2 alert and LMON trace files for detail.
    LMD0 (ospid: 31201): terminating the instance due to error 481
    Instance terminated by LMD0, pid = 31201
    Fri Jun 07 12:24:30 2013
    * instance_number obtained from CSS = 1, checking for the existence of node 0...
    * node 0 does not exist. instance_number = 1
    Starting ORACLE instance (normal)
    LICENSE_MAX_SESSION = 0
    LICENSE_SESSIONS_WARNING = 0
    Private Interface 'eth1:1' configured from GPnP for use as a private interconnect.
    [name='eth1:1', type=1, ip=169.254.37.103, mac=00-26-55-eb-61-89, net=169.254.0.0/16, mask=255.255.0.0, use=haip:cluster_interconnect/62]
    Public Interface 'eth0' configured from GPnP for use as a public interface.
    [name='eth0', type=1, ip=135.33.2.8, mac=00-26-55-eb-61-88, net=135.33.2.0/27, mask=255.255.255.224, use=public/1]
    Picked latch-free SCN scheme 3
    Using LOG_ARCHIVE_DEST_1 parameter default value as /u01/app/11.2.0.2/grid/dbs/arch
    Autotune of undo retention is turned on.
    LICENSE_MAX_USERS = 0
    [grid@odsdb1 cssd]$ file core.30481
    core.30481: ELF 64-bit LSB core file AMD x86-64, version 1 (SYSV), SVR4-style, from 'ocssd.bin'
    [grid@odsdb1 cssd]$ gdb
    gdb gdbserver gdbtui
    [grid@odsdb1 cssd]$ gdb ocssd.bin core.30481
    GNU gdb (GDB) Red Hat Enterprise Linux (7.0.1-42.el5)
    Copyright (C) 2009 Free Software Foundation, Inc.
    License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html>
    This is free software: you are free to change and redistribute it.
    There is NO WARRANTY, to the extent permitted by law. Type "show copying"
    and "show warranty" for details.
    This GDB was configured as "x86_64-redhat-linux-gnu".
    For bug reporting instructions, please see:
    <http://www.gnu.org/software/gdb/bugs/>...
    Reading symbols from /u01/app/11.2.0.2/grid/bin/ocssd.bin...(no debugging symbols found)...done.
    [New Thread 30486]
    [New Thread 30530]
    [New Thread 30526]
    [New Thread 30525]
    [New Thread 30523]
    [New Thread 30522]
    [New Thread 30521]
    [New Thread 30520]
    [New Thread 30519]
    [New Thread 30504]
    [New Thread 30503]
    [New Thread 30495]
    [New Thread 30485]
    [New Thread 30484]
    [New Thread 30483]
    [New Thread 30481]
    Reading symbols from /u01/app/11.2.0.2/grid/lib/libhasgen11.so...(no debugging symbols found)...done.
    Loaded symbols for /u01/app/11.2.0.2/grid/lib/libhasgen11.so
    Reading symbols from /u01/app/11.2.0.2/grid/lib/libocr11.so...(no debugging symbols found)...done.
    Loaded symbols for /u01/app/11.2.0.2/grid/lib/libocr11.so
    Reading symbols from /u01/app/11.2.0.2/grid/lib/libocrb11.so...(no debugging symbols found)...done.
    Loaded symbols for /u01/app/11.2.0.2/grid/lib/libocrb11.so
    Reading symbols from /u01/app/11.2.0.2/grid/lib/libocrutl11.so...(no debugging symbols found)...done.
    Loaded symbols for /u01/app/11.2.0.2/grid/lib/libocrutl11.so
    Reading symbols from /u01/app/11.2.0.2/grid/lib/libclntsh.so.11.1...(no debugging symbols found)...done.
    Loaded symbols for /u01/app/11.2.0.2/grid/lib/libclntsh.so.11.1
    Reading symbols from /u01/app/11.2.0.2/grid/lib/libskgxn2.so...(no debugging symbols found)...done.
    Loaded symbols for /u01/app/11.2.0.2/grid/lib/libskgxn2.so
    Reading symbols from /lib64/libdl.so.2...(no debugging symbols found)...done.
    Loaded symbols for /lib64/libdl.so.2
    Reading symbols from /lib64/libm.so.6...(no debugging symbols found)...done.
    Loaded symbols for /lib64/libm.so.6
    Reading symbols from /lib64/libpthread.so.0...(no debugging symbols found)...done.
    [Thread debugging using libthread_db enabled]
    Loaded symbols for /lib64/libpthread.so.0
    Reading symbols from /lib64/libnsl.so.1...(no debugging symbols found)...done.
    Loaded symbols for /lib64/libnsl.so.1
    Reading symbols from /u01/app/11.2.0.2/grid/lib/libasmclntsh11.so...(no debugging symbols found)...done.
    Loaded symbols for /u01/app/11.2.0.2/grid/lib/libasmclntsh11.so
    Reading symbols from /u01/app/11.2.0.2/grid/lib/libcell11.so...(no debugging symbols found)...done.
    Loaded symbols for /u01/app/11.2.0.2/grid/lib/libcell11.so
    Reading symbols from /u01/app/11.2.0.2/grid/lib/libskgxp11.so...(no debugging symbols found)...done.
    Loaded symbols for /u01/app/11.2.0.2/grid/lib/libskgxp11.so
    Reading symbols from /u01/app/11.2.0.2/grid/lib/libnnz11.so...(no debugging symbols found)...done.
    Loaded symbols for /u01/app/11.2.0.2/grid/lib/libnnz11.so
    Reading symbols from /lib64/libc.so.6...(no debugging symbols found)...done.
    Loaded symbols for /lib64/libc.so.6
    Reading symbols from /usr/lib64/libaio.so.1...(no debugging symbols found)...done.
    Loaded symbols for /usr/lib64/libaio.so.1
    Reading symbols from /lib64/ld-linux-x86-64.so.2...(no debugging symbols found)...done.
    Loaded symbols for /lib64/ld-linux-x86-64.so.2
    Reading symbols from /u01/app/11.2.0.2/grid/lib/libnque11.so...(no debugging symbols found)...done.
    Loaded symbols for /u01/app/11.2.0.2/grid/lib/libnque11.so
    Reading symbols from /opt/oracle/extapi/64/asm/orcl/1/libasm.so...(no debugging symbols found)...done.
    Loaded symbols for /opt/oracle/extapi/64/asm/orcl/1/libasm.so
    warning: no loadable sections found in added symbol-file system-supplied DSO at 0x7fff505fd000
    Core was generated by `/u01/app/11.2.0.2/grid/bin/ocssd.bin '.
    Program terminated with signal 6, Aborted.
    #0 0x000000369ea30265 in raise () from /lib64/libc.so.6
    (gdb) where
    #0 0x000000369ea30265 in raise () from /lib64/libc.so.6
    #1 0x000000369ea31d10 in abort () from /lib64/libc.so.6
    #2 0x00002afc67f9aeda in scls_abort (flags=0) at scls.c:7088
    #3 0x000000000040babd in clssscExit (thrd=0x10d325a0, status=clssscreasonSHUTNORM) at clsssc.c:2155
    #4 0x0000000000446221 in clssgmClientShutdown (thrd=0x10d325a0, cmInfo=0x10b40090) at clssgmc.c:6415
    #5 0x0000000000436707 in clssgmProcClientReqs (thrd=0x10d325a0, clctx=0x10b40630) at clssgmc.c:704
    #6 0x0000000000436405 in clssgmclientlsnr (thrd=0x10d325a0) at clssgmc.c:644
    #7 0x000000000040ac2f in clssscthrdmain (thrd=0x10d325a0) at clsssc.c:1716
    #8 0x000000369fa0677d in start_thread () from /lib64/libpthread.so.0
    #9 0x000000369ead49ad in clone () from /lib64/libc.so.6
    (gdb)
    2013-06-07 12:19:37.377: [    CSSD][1085888832]clssscSelect: cookie accept request 0x10b40630
    2013-06-07 12:19:37.377: [    CSSD][1085888832]clssgmAllocProc: (0x2aaab0133ea0) allocated
    2013-06-07 12:19:37.379: [    CSSD][1085888832]clssgmClientConnectMsg: properties of cmProc 0x2aaab0133ea0 - 1,2,3,4,5
    2013-06-07 12:19:37.379: [    CSSD][1085888832]clssgmClientConnectMsg: Connect from con(0x6ae44fa) proc(0x2aaab0133ea0) pid(14139/14139) version 11:2:1:4, properties: 1,2,3,4,5
    2013-06-07 12:19:37.379: [    CSSD][1085888832]clssgmClientConnectMsg: msg flags 0x0000
    2013-06-07 12:19:37.384: [    CSSD][1085888832]clssscSelect: cookie accept request 0x2aaab0133ea0
    2013-06-07 12:19:37.384: [    CSSD][1085888832]clssscevtypSHRCON: getting client with cmproc 0x2aaab0133ea0
    2013-06-07 12:19:37.384: [    CSSD][1085888832]clssgmRegisterClient: proc(69/0x2aaab0133ea0), client(1/0x2aaab010c5c0)
    2013-06-07 12:19:37.385: [    CSSD][1085888832]clssgmRegisterShared: grp DBODSDB, mbr 0, type 1
    2013-06-07 12:19:37.385: [    CSSD][1085888832]clssgmQueueShare: (0x2aaab0085790) target global grock DBODSDB member 0 type 1 queued from client (0x2aaab010c5c0), global grock DBODSDB, refcount 23
    2013-06-07 12:19:37.385: [    CSSD][1085888832]clssgmRegisterShared: global grock DBODSDB member 0 share type 1, refcount 23
    2013-06-07 12:19:37.391: [    CSSD][1085888832]clssscSelect: cookie accept request 0x2aaab0133ea0
    2013-06-07 12:19:37.391: [    CSSD][1085888832]clssscevtypSHRCON: getting client with cmproc 0x2aaab0133ea0
    2013-06-07 12:19:37.391: [    CSSD][1085888832]clssgmRegisterClient: proc(69/0x2aaab0133ea0), client(2/0x2aaab0061f10)
    what is the problem
    Edited by: 徐振富 on 2013-6-7 下午6:38
    Edited by: 徐振富 on 2013-6-7 下午6:45

    is your ASM instance up?
    If not, trying bring up ASM instance up just by itself and see if it throws any error?
    Post status of crsctl status cluster -all

Maybe you are looking for

  • Using "Place" Command in Photoshop CS4 with Snow Leopard Crashes (HELP)

    I've downloaded the most recent update for snow leopard 10.6.2, run the cleanup utility for cs4, uninstalled, reinstalled, and I keep crashing along with this error... Process: translate [1972] Path: /Applications/Adobe Photoshop CS4/Adobe Photoshop

  • Problem with Zen Microph

    Hi all... I have just bought a Zen Microphoto and have installed everything on the CD, but when I connect it to my computer, it can't find a driver for it - even though the CD still is in the dri've... I have also been trying to charge the battery, b

  • Browsers not loading pages

    Yesterday, I have upgraded my MacBook Pro (Late 2011 13-inch Model) to Mac OS X Mountain Lion. I have updated whatever updates available as soon as I upgraded. But today, earlier this morning my Internet was working fine for a moment until at a certa

  • What settings to export IMovie to PS3

    Hi, I have been trying to export my videos as MP4 for playback on my PS3, and I have had no success. Does anyone here know what settings in IMovie will allow playback of videos on the PS3? Thanks

  • Terminate Portal User Login with JSessionID or MYSAPSSO2 Cookie

    Dear All, I know using Visual Administrator , we can terminate the session. Is it possible for the administrator to terminate a logged in portal user with his/her  JsessionID or MYSAPSSO2 cookie value or User Id programmatically.? Is it possible for