Error on CRS-1

Hi All ,
We have a Fp140 card reloaded due to the following error.
plim_xge[242]: %PLATFORM-CIH-5-ASIC_ERROR : pla[0]: A
parity error has occurred causing  performance loss transient. 0x10440003
plim_xge[242]:
%PLATFORM-CIH-5-ASIC_ERROR_HARD_RESET_START : pla[0]: HARD_RESET needed 0x10440003
Cisco error message decoder provides following explanation.
%PLATFORM-CIH-5-ASIC_ERROR [chars]: [chars] error has occurred[chars]%s [hex]
[chars] [chars]
Explanation    An ASIC error has occurred and been handled.
Can someone help me undertsand if issue was with FP140 card or the Associated PLIM.
Thanks
Deepak

Deepak,
This error was reported by your PLIM ASIC (PLA0). We have 2 of them on every PLIM. This is a log level 5 - notification.
That said, its better you proceed with a TAC case as you might want this to be looked just to be safe.
If you like to track this down I would run the following commnad:
show asic-errors plim asic 0 all location 0/x/CPU0 - X stands for the slot #.
The same info can found in "dir harddisk:/ASIC-ERROR. We keep these records in case the LC had been reset by the system in case we had expereinced an event where we could not recover.
This is all valid for a single/random occurance, if you keep get this message in your syslog and the output of the above command shows a pattern or a trend please go ahead and open SR.
When you do, please capture the following:
show log
show ver br
show inst ac su
ad show platfrom
admin show diag
show asic-errors plim asic 0 all location 0/x/CPU0
show asic-errors plim asic trace all location 0/x/CPU0
show controllers plim asic summary location 0/0/CPU0  <= That maps your PLA to interfaces and/or SIP/SPA HW if exists. Since this is Taiko (CRS-3 AKA 140 Fabric/Line Cards) and I see XGE, I would guess your PLIM is one of these:
14X10GBE
1X100GBE
20X10GBE
show inter br loc 0/x/cpu0
Yigal

Similar Messages

  • Search indexing error in CRS 10.0.2

    Hi All,
    I have setup the CRS with Search and i have done full deployment and started doing search full indexing. i am getting the following error.
    Please suggest if you have any.
    Error Message In Search Indexing status monitor
    atg.searchadmin.core.IndexLoaderException: Exception while processing customization item atg.search.adapter.customization.CustomizationItemProxy@6476d0: Customization atg.search.adapter.customization.CustomizationItemProxy@6476d0 failed.
         at atg.searchadmin.core.IndexLoader.executeCustomizationList(IndexLoader.java:1008)
         at atg.searchadmin.core.IndexLoader.executeCustomizationType(IndexLoader.java:926)
         at atg.searchadmin.core.IndexLoader.executeCustomizationType(IndexLoader.java:876)
         at atg.searchadmin.core.IndexLoader.executeCustomizations(IndexLoader.java:847)
         at atg.searchadmin.core.IndexLoader.completeIndex(IndexLoader.java:1489)
         at atg.searchadmin.core.IndexLoader.executeSession(IndexLoader.java:1991)
         at atg.searchadmin.core.IndexLoader$IndexingThread.run(IndexLoader.java:2423)
    Caused by :atg.searchadmin.core.IndexLoaderException: Customization atg.search.adapter.customization.CustomizationItemProxy@6476d0 failed.
         at atg.searchadmin.core.IndexLoader.executeCustomizationList(IndexLoader.java:1004)
         at atg.searchadmin.core.IndexLoader.executeCustomizationType(IndexLoader.java:926)
         at atg.searchadmin.core.IndexLoader.executeCustomizationType(IndexLoader.java:876)
         at atg.searchadmin.core.IndexLoader.executeCustomizations(IndexLoader.java:847)
         at atg.searchadmin.core.IndexLoader.completeIndex(IndexLoader.java:1489)
         at atg.searchadmin.core.IndexLoader.executeSession(IndexLoader.java:1991)
         at atg.searchadmin.core.IndexLoader$IndexingThread.run(IndexLoader.java:2423)
    Error message In BCC Server console:
    17:33:17,977 ERROR [IndexLoader] Error occurred in step post_index_customization_step for sync task 400004 of type complete. Error:
    atg.searchadmin.core.IndexLoaderException: Exception while processing customization item atg.search.adapter.customization.CustomizationItemProxy@6476d0: Customization atg.search.ad
    apter.customization.CustomizationItemProxy@6476d0 failed.
    atg.searchadmin.core.IndexLoaderException: Exception while processing customization item atg.search.adapter.customization.CustomizationItemProxy@6476d0: Customization atg.search.ad
    apter.customization.CustomizationItemProxy@6476d0 failed.
    at atg.searchadmin.core.IndexLoader.executeCustomizationList(IndexLoader.java:1008)
    at atg.searchadmin.core.IndexLoader.executeCustomizationType(IndexLoader.java:926)
    at atg.searchadmin.core.IndexLoader.executeCustomizationType(IndexLoader.java:876)
    at atg.searchadmin.core.IndexLoader.executeCustomizations(IndexLoader.java:847)
    at atg.searchadmin.core.IndexLoader.completeIndex(IndexLoader.java:1489)
    at atg.searchadmin.core.IndexLoader.executeSession(IndexLoader.java:1991)
    at atg.searchadmin.core.IndexLoader$IndexingThread.run(IndexLoader.java:2423)
    Caused by: atg.searchadmin.core.IndexLoaderException: Customization atg.search.adapter.customization.CustomizationItemProxy@6476d0 failed.
    at atg.searchadmin.core.IndexLoader.executeCustomizationList(IndexLoader.java:1004)
    ... 6 more

    You have two options, if your cartridge is like MediaBanner, and at least has media and link objects, you just need to use OOTB MediaBanner handler in the properties file.
    Otherwise, you first have to define the class you will use for MediaBanner handler, and in that class you will need to convert linkBuilder to linkaction like this:
    - your class needs to extend from NavigationCartridgeHandler
    - in the process method, you will need to get linkBuilder object
    - and then get linkAction object like this:
    linkBuilder.createAction(this.navigationStateBuilder, this.contentSource, getActionPathProvider())
    Does it make sense?
    Regards,
    Naresh

  • LinkBuilder to Action convert error in CRS 10.1.2 MediaBanner.jsp

    Hi, we are now trying to build MediaBanner.jsp on CRS 10.1.2, based on the similar one in discover. We have put following on MediaBanner.jsp, and get following error:
    ++<c:url value="${util:getUrlForAction(contentItem.link)}" var="hrefUrl"></c:url>++
    ++</c:if>++
    +####<Mar 12, 2013 3:56:41 PM JST> <Error> <HTTP> <cx.com> <ATGProduction> <[ACTIVE] ExecuteThread: '0' for queue: 'weblogic.kernel.Default (self-tuning)'> <<WLS Kernel>> <> <> <1363071401230> <BEA-101020> <[ServletContext@1590038242[app:ATGProduction.ear module:crs path:/crs spec-version:2.5]] Servlet failed with Exception+
    java.lang.IllegalArgumentException: Cannot convert com.endeca.infront.cartridge.model.LinkBuilder@763b50a0 of type class com.endeca.infront.cartridge.model.LinkBuilder to class com.endeca.infront.cartridge.model.Action
    How this error van be resolved ?
    Thanks,
    Yuki

    You have two options, if your cartridge is like MediaBanner, and at least has media and link objects, you just need to use OOTB MediaBanner handler in the properties file.
    Otherwise, you first have to define the class you will use for MediaBanner handler, and in that class you will need to convert linkBuilder to linkaction like this:
    - your class needs to extend from NavigationCartridgeHandler
    - in the process method, you will need to get linkBuilder object
    - and then get linkAction object like this:
    linkBuilder.createAction(this.navigationStateBuilder, this.contentSource, getActionPathProvider())
    Does it make sense?
    Regards,
    Naresh

  • Error OUI CRS

    Hi all,
    Installing CRS I got the error:
    PRKC-1073 : Failed to transfer directory "/crs" to any of the given nodes "dwbd02 ". Error on node dwbd02:null
    Open the log:
    Log: installActions2010-05-31_04-50-09PM.log ------
    INFO: Updating files in Oracle home '/crs' to remote nodes 'dwbd02'.
    INFO: List of files to be excluded from:install/excludeList.txt
    INFO: Exclude file list /tmp/OraInstall2010-05-31_04-50-09PM/installExcludeFile.lst does not exist or is empty. The file is ignored.
    WARNING: Error while copying directory /crs with exclude file list 'null' to nodes 'dwbd02'. [PRKC-1073 : Failed to transfer directory "/crs" to any of the given nodes "dwbd02 ".
    Error on node dwbd02:null]
    Refer to '/u01/app/oracle/oraInventory/logs/installActions2010-05-31_04-50-09PM.log' for details. You may fix the errors on the required remote nodes. Refer to the install guide for error recovery. Click 'Yes' if you want to proceed. Click 'No' to exit the install. Do you want to continue?
    INFO: User Selected: Yes/OK
    what to do to continue?
    Oracle RAC 10g (two nodes)
    SO:AIX
    regards

    hi
    Configure SSH on each node in the cluster. Log in as the "oracle" user and perform the following tasks on each node.
    su - oracle
    mkdir ~/.ssh
    chmod 700 ~/.ssh
    /usr/bin/ssh-keygen -t rsa # Accept the default settings.
    The RSA public key is written to the ~/.ssh/id_rsa.pub file and the private key to the ~/.ssh/id_rsa file.
    Log in as the "oracle" user on RAC1, generate an "authorized_keys" file on RAC1 and copy it to RAC2 using the following commands.
    su - oracle
    cd ~/.ssh
    cat id_rsa.pub >> authorized_keys
    scp authorized_keys rac2:/home/oracle/.ssh/
    Next, log in as the "oracle" user on RAC2 and perform the following commands.
    su - oracle
    cd ~/.ssh
    cat id_rsa.pub >> authorized_keys
    scp authorized_keys rac1:/home/oracle/.ssh/
    The "authorized_keys" file on both servers now contains the public keys generated on all RAC nodes.
    To enable SSH user equivalency on the cluster member nodes issue the following commands on each node.
    ssh rac1
    ssh rac2
    You should now be able to SSH and SCP between servers without entering passwords.
    then use cluvfy utilty.
    cluvfy comp sys -n node1,node2 -p crs -verbose
    To verify the minimal system requirements on the nodes before installing Oracle Clusterware or RAC, use the sys component verification command. To check the system requirements for installing RAC, use the -p database argument, and to check the system requirements for installing Oracle Clusterware, use the -p crs argument.
    you can download
    http://www.oracle.com/technology/products/database/clustering/cvu/faq/cvufaq_11g.html#How_do_I_install_CVU
    pls send us result of cluvfy
    hope this helps
    zekeriya

  • Reschedule Excel or PDF instance fails with CAST error in CRS 2008

    Rescheduling an Excel or PDF Instance in Crystal Reports Server 2008 gives error message when trying to set parameters.  "An error has occurred:Unable to cast object of type 'CrystalDecisions.Enterprise.Desktop.Pdf' to type 'BusinessObjects.Enterprise.Desktop.Publication'. "
    Previously this used to give a $Proxy5 message. 
    I have installed SP2 and now it does this. 
    It works in the Java InfoView - but not in the .Net Infoview. 
    Any suggestions (other than using Java Infoview that is) ...

    Hi,
    this morning reading note (metalink and other) about CSS Timeout misscount ,and the impact on dbca ... i have changed the value from 60 to 360 ... byt the problem is not resolved!!
    i wait for news ......
    i beginning to think next to some particular bug, data also the ORA-600... with argumet not identified (today) from Oracle.
    bye,
    Luca Acri

  • CRS-0215 error in the step:Create the TNS Listener Process

    Error listening on: (ADDRESS=(PROTOCOL=TCP)(Host= 192.168.x.xxx)(Port=1521))
    TNS-12545: Connect failed because target host or object does not exist
    TNS-12560: TNS:protocol adapter error
    TNS-00515: Connect failed because target host or object does not exist
    Linux Error: 9: Cannot assign requested address
    I am getting the above error when starting the listener_linux2 on linux2 node. I ran the netca configuration tool on linux1 to configure the listener. It ends in error with CRS-0215.
    According to metalink note 339600.1 i should
    request the interface corresponding to the VIP Address be moved to/enabled on cluster server, where the TNS Listener is being started. Once the interface is enabled on cluster server, then start the TNS Listener.
    but how do i do that ?
    I am going to reboot the linux1 and linux2 boxes to see if that helps/solves the issue.
    Running Oracle Enterprise Linux 4 update 5 with oracle 10g R2
    Thanks
    Edited by: ow001294 on Aug 24, 2008 12:33 PM

    you wrote :
    "Please check your listener.ora and tnsnames.ora to make sure they entries are correct.
    You can also try that from a client machine tnsping(<server name> and IP address) is ok."
    I responded :
    This is on a brand new installation of Oracle RAC at home on 2 desktop pc's using Jeff Hunter's article on OTN website for testing/playing with Oracle 10 RAC at home. I used netca (network configuration assistant) to configure the listener. So, the listener.ora file should be correct. I only have listener.ora and sqlnet.ora files. No tnsnames.ora file yet.
    I don't have another client pc to connect to the server. This is a home based installation NOT connected to internet.
    The metalink note suggested a solution but i am not that familiar with linux/unix to know how to enable the interfaces. I just rebooted the boxes to see if that would solve the situation. am going to try again.....
    thanks

  • 11gR2RAC "CRS is not installed on any of the nodes" error message

    Hi
    I found error message while try to install Oracle Software "CRS is not installed on any of the nodes".
    This is my server information.
    Server : HP solaris x86-64
    Scan : setup complete
    Grid install : Silent installation complete but found some warning while run orainstRoot.sh on node1 only
    +"Changing permissions of /rtr/app/oraInventory.+
    +Adding read,write permissions for group.+
    +Removing read,write,execute permissions for world.+
    +chmod: WARNING: chmod: could not getcwd+
    +OUI-35086:WARNING: chmod of /rtr/app/oraInventory+
    +Adding read,write permissions for group.+
    +,Removing read,write,execute permissions for world.+
    + failed!+
    +Changing groupname of /rtr/app/oraInventory to oinstall.+
    +chgrp:+
    +OUI-10057:WARNING: chgrp of /rtr/app/oraInventory to oinstall failed!+
    +The execution of the script is complete."+
    after that, the root.sh is run successfully for both nodes.
    Then while install database software I found CRS is not installed on any of the nodes
    I tried to check oraInst.loc and found 3 oraInst.loc, all of them can access by oracle user
    +#ls -l /rtr/app/oraInventory/oraInst.loc+
    -rw-rw----   1 grid     oinstall      60 Mar  4 16:45 /rtr/app/oraInventory/oraInst.loc
    +# ls -l /rtr/app/11.2.0/grid/oraInst.loc+
    -rw-r-----   1 grid     oinstall      60 Mar  4 16:26 /rtr/app/11.2.0/grid/oraInst.loc
    +# ls -l /var/opt/oracle/oraInst.loc+
    -rw-r--r--   1 root     root          60 Mar  4 16:49 /var/opt/oracle/oraInst.loc
    cat /var/opt/oracle/oraInst.loc
    inventory_loc=/rtr/app/oraInventory
    inst_group=oinstall
    oracle@bkkd-sirac03 # cat /rtr/app/oraInventory/oraInst.loc
    inventory_loc=/rtr/app/oraInventory
    inst_group=oinstall
    oracle@bkkd-sirac03 # cat /rtr/app/11.2.0/grid/oraInst.loc
    inventory_loc=/rtr/app/oraInventory
    inst_group=oinstall
    All oracle services are online
    HA Resource                                   Target     State
    ora.LISTENER_SCAN1.lsnr                       ONLINE     ONLINE on bkkd-sirac04
    ora.LISTENER_SCAN2.lsnr                       ONLINE     ONLINE on bkkd-sirac03
    ora.LISTENER_SCAN3.lsnr                       ONLINE     ONLINE on bkkd-sirac03
    ora.asm                                       OFFLINE    OFFLINE
    ora.bkkd-sirac03.ASM1.asm                     OFFLINE    OFFLINE
    ora.bkkd-sirac03.gsd                          OFFLINE    OFFLINE
    ora.bkkd-sirac03.ons                          ONLINE     ONLINE on bkkd-sirac03
    ora.bkkd-sirac03.vip                          ONLINE     ONLINE on bkkd-sirac03
    ora.bkkd-sirac04.ASM2.asm                     OFFLINE    OFFLINE
    ora.bkkd-sirac04.gsd                          OFFLINE    OFFLINE
    ora.bkkd-sirac04.ons                          ONLINE     ONLINE on bkkd-sirac04
    ora.bkkd-sirac04.vip                          ONLINE     ONLINE on bkkd-sirac04
    ora.eons                                      ONLINE     ONLINE on bkkd-sirac03
    ora.gsd                                       OFFLINE    OFFLINE
    ora.net1.network                              ONLINE     ONLINE on bkkd-sirac03
    ora.oc4j                                      OFFLINE    OFFLINE
    ora.ons                                       ONLINE     ONLINE on bkkd-sirac03
    ora.scan1.vip                                 ONLINE     ONLINE on bkkd-sirac04
    ora.scan2.vip                                 ONLINE     ONLINE on bkkd-sirac03
    ora.scan3.vip                                 ONLINE     ONLINE on bkkd-sirac03
    crsctl check crs
    CRS-4638: Oracle High Availability Services is online
    CRS-4537: Cluster Ready Services is online
    CRS-4529: Cluster Synchronization Services is online
    CRS-4533: Event Manager is online
    Kindly help me please.
    Edited by: user9258303 on Mar 4, 2010 4:43 AM

    Hi Pavel,
    I already run the runcluvfy shell script but found the same error
    Checking CRS integrity...
    ERROR:
    CRS is not installed on any of the nodes
    Verification cannot proceed
    CRS integrity check failed
    Checking node application existence...
    ERROR:
    CRS is not installed on any of the nodes
    Verification cannot proceed
    Checking time zone consistency...
    ERROR:
    CRS home "{0}" is not a valid directory
    Anything i can check? I think the error might be from incorrect location of central inventory or grid home or permission but i cannot find the root cause.
    Regards,
    Ann.

  • Issue with CRS Historical report scheduler

    Hello guys,
    I have a customer with ipccx 5.02 .
    THe customer could execute manual reports but  the  scheduler reports doesnt work.
    I follow the IPCCX troubleshooting guide :
    1.Stop and start scheduler service.
    2. Connectivity is fine.
    I dont receivce any error from CRS client , i need little help im new in IPCC world?
    Any suggestions please?
    Thanks,
    Carlos

    Hi Anubhati,
    PC is logged during the time that scheduled is programming and also is not in sleep mode.
    I have download the CiscoSch log from CRS Historical report and i found i issue with license :
    INFORMATIONAL Jan 19 2011|17:00:45 Authenticate [email protected]@default user on Application Server 10.181.55.247
    104 ERROR  Jan 19 2011|17:00:45 Getting of total available license info failed
    105 ERROR  Jan 19 2011|17:00:45 Historical Reporting Licenses Available(=0); Report cannot be generated.
    I have the following license :
    UCCX enhanced
    IVR ports 150
    Enhanced seat 22
    CCX Maximum agents 300.
    I generated a report for see how many agents is logged in = 15 .
    Regards,
    Carlos

  • 11G R2 root.sh failed on first node with OLE fetch parameter error

    I have successfully installed 11G R2.1 on Centos 5.4 64 bit.
    Now it's coming to install 11G R2.2 on Redhat 5.4 64bit with HDS storrage.
    [grid@dmdb1 grid]$ uname -a
    Linux dmdb1 2.6.18-164.el5 #1 SMP Tue Aug 18 15:51:48 EDT 2009 x86_64 x86_64 x86_64 GNU/Linux
    I passed all pre-ins requirements except shared storage. However, I manually verify it with no problems.
    [grid@dmdb1 grid]$ ./runcluvfy.sh stage -pre crsinst -fixup -n dmdb1,dmdb2,dmdb3,dmdb4 -verbose|grep -i fail
    [grid@dmdb1 grid]$ ./runcluvfy.sh stage -post hwos -n dmdb1,dmdb2,dmdb3,dmdb4 -verbose|grep -i fail
    [grid@dmdb1 grid]$ ./runcluvfy.sh comp sys -n dmdb1,dmdb2,dmdb3,dmdb4 -p crs -osdba dba -orainv oinstall
    Verifying system requirement
    Total memory check passed
    Available memory check passed
    Swap space check passed
    Free disk space check passed for "dmdb4:/tmp"
    Free disk space check passed for "dmdb3:/tmp"
    Free disk space check passed for "dmdb2:/tmp"
    Free disk space check passed for "dmdb1:/tmp"
    User existence check passed for "grid"
    Group existence check passed for "oinstall"
    Group existence check passed for "dba"
    Membership check for user "grid" in group "oinstall" [as Primary] passed
    Membership check for user "grid" in group "dba" passed
    Run level check passed
    Hard limits check passed for "maximum open file descriptors"
    Soft limits check passed for "maximum open file descriptors"
    Hard limits check passed for "maximum user processes"
    Soft limits check passed for "maximum user processes"
    System architecture check passed
    Kernel version check passed
    Kernel parameter check passed for "semmsl"
    Kernel parameter check passed for "semmns"
    Kernel parameter check passed for "semopm"
    Kernel parameter check passed for "semmni"
    Kernel parameter check passed for "shmmax"
    Kernel parameter check passed for "shmmni"
    Kernel parameter check passed for "shmall"
    Kernel parameter check passed for "file-max"
    Kernel parameter check passed for "ip_local_port_range"
    Kernel parameter check passed for "rmem_default"
    Kernel parameter check passed for "rmem_max"
    Kernel parameter check passed for "wmem_default"
    Kernel parameter check passed for "wmem_max"
    Kernel parameter check passed for "aio-max-nr"
    Package existence check passed for "make-3.81"
    Package existence check passed for "binutils-2.17.50.0.6"
    Package existence check passed for "gcc-4.1"
    Package existence check passed for "libaio-0.3.106 (i386)"
    Package existence check passed for "libaio-0.3.106 (x86_64)"
    Package existence check passed for "glibc-2.5-24 (i686)"
    Package existence check passed for "glibc-2.5-24 (x86_64)"
    Package existence check passed for "compat-libstdc++-33-3.2.3 (i386)"
    Package existence check passed for "compat-libstdc++-33-3.2.3 (x86_64)"
    Package existence check passed for "elfutils-libelf-0.125 (x86_64)"
    Package existence check passed for "elfutils-libelf-devel-0.125"
    Package existence check passed for "glibc-common-2.5"
    Package existence check passed for "glibc-devel-2.5 (i386)"
    Package existence check passed for "glibc-devel-2.5 (x86_64)"
    Package existence check passed for "glibc-headers-2.5"
    Package existence check passed for "gcc-c++-4.1.2"
    Package existence check passed for "libaio-devel-0.3.106 (i386)"
    Package existence check passed for "libaio-devel-0.3.106 (x86_64)"
    Package existence check passed for "libgcc-4.1.2 (i386)"
    Package existence check passed for "libgcc-4.1.2 (x86_64)"
    Package existence check passed for "libstdc++-4.1.2 (i386)"
    Package existence check passed for "libstdc++-4.1.2 (x86_64)"
    Package existence check passed for "libstdc++-devel-4.1.2 (x86_64)"
    Package existence check passed for "sysstat-7.0.2"
    Package existence check passed for "unixODBC-2.2.11 (i386)"
    Package existence check passed for "unixODBC-2.2.11 (x86_64)"
    Package existence check passed for "unixODBC-devel-2.2.11 (i386)"
    Package existence check passed for "unixODBC-devel-2.2.11 (x86_64)"
    Package existence check passed for "ksh-20060214"
    Check for multiple users with UID value 0 passed
    Verification of system requirement was successful.
    [grid@dmdb1 grid]$ ./runcluvfy.sh comp sys -n dmdb1,dmdb2,dmdb3,dmdb4 -p database -osdba dba -orainv oinstall|grep -i fail
    [grid@dmdb1 grid]$ ./runcluvfy.sh comp ssa -n dmdb1,dmdb2,dmdb3,dmdb4
    Verifying shared storage accessibility
    Checking shared storage accessibility...
    Storage operation failed
    Shared storage check failed on nodes "dmdb4,dmdb3,dmdb2,dmdb1"
    Verification of shared storage accessibility was unsuccessful on all the specified nodes.
    I followed below article to verify shared storage issues:
    http://www.webofwood.com/rac/oracle-response-to-shared-storage-check-failed-on-nodes/
    it's ok.
    So I skipped SSA issue and go on install with (./runInstaller -ignoreInternalDriverError).
    However, when I ran root.sh with below error:
    CRS-2673: Attempting to stop 'ora.mdnsd' on 'dmdb1'
    CRS-2677: Stop of 'ora.mdnsd' on 'dmdb1' succeeded
    CRS-2673: Attempting to stop 'ora.gipcd' on 'dmdb1'
    CRS-2677: Stop of 'ora.gipcd' on 'dmdb1' succeeded
    CRS-4000: Command Start failed, or completed with errors.
    CRS-2672: Attempting to start 'ora.gipcd' on 'dmdb1'
    CRS-2672: Attempting to start 'ora.mdnsd' on 'dmdb1'
    CRS-2676: Start of 'ora.gipcd' on 'dmdb1' succeeded
    CRS-2676: Start of 'ora.mdnsd' on 'dmdb1' succeeded
    CRS-2672: Attempting to start 'ora.gpnpd' on 'dmdb1'
    CRS-2676: Start of 'ora.gpnpd' on 'dmdb1' succeeded
    CRS-2672: Attempting to start 'ora.cssdmonitor' on 'dmdb1'
    CRS-2676: Start of 'ora.cssdmonitor' on 'dmdb1' succeeded
    CRS-2672: Attempting to start 'ora.cssd' on 'dmdb1'
    CRS-2672: Attempting to start 'ora.diskmon' on 'dmdb1'
    CRS-2676: Start of 'ora.diskmon' on 'dmdb1' succeeded
    CRS-2674: Start of 'ora.cssd' on 'dmdb1' failed
    CRS-2679: Attempting to clean 'ora.cssd' on 'dmdb1'
    CRS-2681: Clean of 'ora.cssd' on 'dmdb1' succeeded
    CRS-2673: Attempting to stop 'ora.diskmon' on 'dmdb1'
    CRS-2677: Stop of 'ora.diskmon' on 'dmdb1' succeeded
    CRS-2673: Attempting to stop 'ora.gpnpd' on 'dmdb1'
    CRS-2677: Stop of 'ora.gpnpd' on 'dmdb1' succeeded
    CRS-2673: Attempting to stop 'ora.mdnsd' on 'dmdb1'
    CRS-2677: Stop of 'ora.mdnsd' on 'dmdb1' succeeded
    CRS-2673: Attempting to stop 'ora.gipcd' on 'dmdb1'
    CRS-2677: Stop of 'ora.gipcd' on 'dmdb1' succeeded
    CRS-4000: Command Start failed, or completed with errors.
    Command return code of 1 (256) from command: /opt/app/11.2.0/grid/bin/crsctl start resource ora.ctssd -init
    Start of resource "ora.ctssd -init" failed
    Clusterware exclusive mode start of resource ora.ctssd failed
    CRS-2500: Cannot stop resource 'ora.crsd' as it is not running
    CRS-4000: Command Stop failed, or completed with errors.
    Command return code of 1 (256) from command: /opt/app/11.2.0/grid/bin/crsctl stop resource ora.crsd -init
    Stop of resource "ora.crsd -init" failed
    Failed to stop CRSD
    CRS-2500: Cannot stop resource 'ora.asm' as it is not running
    CRS-4000: Command Stop failed, or completed with errors.
    Command return code of 1 (256) from command: /opt/app/11.2.0/grid/bin/crsctl stop resource ora.asm -init
    Stop of resource "ora.asm -init" failed
    Failed to stop ASM
    CRS-2673: Attempting to stop 'ora.cssdmonitor' on 'dmdb1'
    CRS-2677: Stop of 'ora.cssdmonitor' on 'dmdb1' succeeded
    Initial cluster configuration failed. See /opt/app/11.2.0/grid/cfgtoollogs/crsconfig/rootcrs_dmdb1.log for details
    I manually ran '/opt/app/11.2.0/grid/bin/crsctl start resource ora.ctssd -init' and got below erros from /opt/app/11.2.0/grid/log/dmdb1/cssd/ocssd.log
    Oracle Database 11g Clusterware Release 11.2.0.1.0 - Production Copyright 1996, 2009 Oracle. All rights reserved.
    2011-09-23 19:06:41.501: [    CSSD][1812336384]clssscmain: Starting CSS daemon, version 11.2.0.1.0, in (exclusive) mode with uniqueness value 1316776001
    2011-09-23 19:06:41.502: [    CSSD][1812336384]clssscmain: Environment is production
    2011-09-23 19:06:41.502: [    CSSD][1812336384]clssscmain: Core file size limit extended
    2011-09-23 19:06:41.515: [    CSSD][1812336384]clssscGetParameterOLR: OLR fetch for parameter logsize (8) failed with rc 21
    2011-09-23 19:06:41.515: [    CSSD][1812336384]clssscSetPrivEnv: IPMI device not installed on this node
    2011-09-23 19:06:41.517: [    CSSD][1812336384]clssscGetParameterOLR: OLR fetch for parameter priority (15) failed with rc 21
    2011-09-23 19:06:41.539: [    CSSD][1812336384]clssscExtendLimits: The current soft limit for file descriptors is 65536, hard limit is 65536
    2011-09-23 19:06:41.539: [    CSSD][1812336384]clssscExtendLimits: The current soft limit for locked memory is 4294967295, hard limit is 4294967295
    2011-09-23 19:06:41.541: [    CSSD][1812336384]clssscmain: Running as user grid
    anybody can help me fix it?

    I opened on SR for this case.
    it's ok now.
    Below is from Oracle Global Service request:
    === ODM Action Plan ===
    Dear customer, after went through the uploaded log files, we found the issue looks like
    bug 9732641 : The clusterware gpnpd process crashes when there is more than 1 cluster with the same name.
    To narrow down the issue, pls apply the following steps.
    1. Pls clean the previous configuration with below steps, then run root.sh script on node1 again.
    1.1 remove current configuration.
    $GRID_HOME/crs/install/rootcrs.pl -verbose -deconfig -force
    1.2 remove other related files.
    if $GI_BASE/Clusterware/ckptGridHA_.xml still there, please remove it manually with "rm" command on all nodes
    If the gpnp profile is still there, pls clean up them, then rebuild require directories.
    $ rm -rf $GRID_HOME/gpnp/*
    $ mkdir -p $GRID_HOME/gpnp/profiles/peer $GRID_HOME/gpnp/wallets/peer $GRID_HOME/gpnp/wallets/prdr $GRID_HOME/gpnp/wallets/pa $GRID_HOME/gpnp/wallets/root
    2. After the previous configuration was cleaned up, pls rerun the root.sh script again. If the issue still there, pls upload the following:
    Everything under <GI_HOME>/log
    Everything under <ORACLE_BAES for grid user>/cfgtoollogs
    Everything under <GI_HOME>/cfgtolllogs/crsconfig
    OS log(/var/log/messages)
    3. Pls also make sure there is only one GI running on your cluster.
    See /opt/app/11.2.0/grid/cfgtoollogs/crsconfig/rootcrs_dmdb1.log for details

  • CRS restarting - OCR inaccessible 10.2.0.4

    Hi all,
    i'm facing this problem and i don't understand why node2 and node1 "sometimes" (1 or 2 days a week) gives this type of error and crs restarts.
    The ocr files are in an OCFS2 filesystem on a dedicated LUN (mpath):
    /dev/mapper/mpath2 /ocr_voting ocfs2 _netdev,datavolume,nointr 0 0
    I'm on itanium platform:
    Linux 2.6.18-194.3.1.el5 #1 SMP Sun May 2 04:23:11 EDT 2010 ia64 ia64 ia64 GNU/Linux
    Red Hat Enterprise Linux Server release 5.5 (Tikanga)
    CRS LOG:
    [crsd(4430)]CRS-1006:The OCR location /ocr_voting/OCRfile is inaccessible. Details in /u01/app/oracle/product/10.2.0/crs/log/srvorcl02/crsd/crsd.log.
    2011-08-05 18:43:32.894
    CRSD.LOG
    2011-08-05 18:43:29.449: [ OCRRAW][551547456]rtnode:3: invalid tnode 475
    2011-08-05 18:43:29.449: [ OCRRAW][551547456]proprsetvali: problem reading the tnode
    2011-08-05 18:43:29.449: [ OCRRAW][551547456]rrecover:1:problem syncing mirrors [26]
    2011-08-05 18:43:29.449: [ OCRRAW][551547456]proprseterror: Error in accessing physical storage [26] Marking context invalid.
    2011-08-05 18:43:29.449: [ OCRRAW][551547456]proprdc: backend_ctx->prop_ctx_tag=PROPCTXT
    2011-08-05 18:43:29.449: [ OCRRAW][551547456]proprdc: backend_ctx->prop_valid=0
    2011-08-05 18:43:29.449: [ OCRRAW][551547456]proprdc: backend_ctx->prop_boot_mode=1
    2011-08-05 18:43:29.449: [ OCRRAW][551547456]proprdc: begin dumping backenctx->prop_ctx
    2011-08-05 18:43:29.449: [ OCRRAW][551547456]proprdc_proprhandle: propb_ctx->proprhandle_sctx=[0xc1fb0]
    2011-08-05 18:43:29.449: [ OCRRAW][551547456]proprdc_proprhandle: propb_ctx->proprhandle_sctx=[0xc1fb0]
    2011-08-05 18:43:29.449: [ OCRRAW][551547456]proprdc_proprhandle: propb_ctx->proprhandle_native[0]=12
    2011-08-05 18:43:29.449: [ OCRRAW][551547456]proprdc_proprhandle: propb_ctx->proprhandle_native_state[0]=5
    2011-08-05 18:43:29.449: [ OCRRAW][551547456]proprdc_proprhandle: propb_ctx->proprhandle_native_numpage[0]=65536
    2011-08-05 18:43:29.449: [ OCRRAW][551547456]proprdc_proprhandle: propb_ctx->proprhandle_filename[0]=/ocr_voting/OCRfile
    2011-08-05 18:43:29.449: [ OCRRAW][551547456]proprdc_proprhandle: propb_ctx->proprhandle_native[1] is NULL
    2011-08-05 18:43:29.449: [ OCRRAW][551547456]proprdc_proprhandle: propb_ctx->proprhandle_native_state[1]=0
    2011-08-05 18:43:29.449: [ OCRRAW][551547456]proprdc_proprhandle: propb_ctx->proprhandle_native_numpage[1]=0
    2011-08-05 18:43:29.449: [ OCRRAW][551547456]proprdc_proprhandle: propb_ctx->proprhandle_filename[1]=
    2011-08-05 18:43:29.449: [ OCRRAW][551547456]proprdc_proprhandle: propb_ctx->proprhandle_read_device=0
    2011-08-05 18:43:29.450: [ OCRRAW][551547456]proprdc_proprhandle: propb_ctx->numpage=65530
    2011-08-05 18:43:29.450: [ OCRRAW][551547456]proprdc_proprhandle: propb_ctx->totalsize=268435456
    2011-08-05 18:43:29.450: [ OCRRAW][551547456]proprdc_proprhandle: propb_ctx->num_free=0
    2011-08-05 18:43:29.450: [ OCRRAW][551547456]proprdc_proprhandle: propb_ctx->proprhandle_ocrid=440645862
    2011-08-05 18:43:29.450: [ OCRRAW][551547456]proprdc_proprhandle: propb_ctx->version[0]=2
    2011-08-05 18:43:29.450: [ OCRRAW][551547456]proprdc_proprhandle: propb_ctx->version[1]=0
    2011-08-05 18:43:29.450: [ OCRRAW][551547456]proprdc_proprhandle: propb_ctx->bootbuf=[0x107cc0]
    2011-08-05 18:43:29.450: [ OCRRAW][551547456]proprdc_proprhandle: propb_ctx->bootbuf[0]=0x1
    2011-08-05 18:43:29.450: [ OCRRAW][551547456]proprdc_proprhandle: propb_ctx->bootbuf[1]=0x82
    2011-08-05 18:43:29.450: [ OCRRAW][551547456]proprdc_proprhandle: propb_ctx->bootbuf[2]=0x28
    2011-08-05 18:43:29.864: [ OCRRAW][551547456]proprdc_proprhandle: propb_ctx->proprhandle_num_gid=3
    2011-08-05 18:43:29.864: [ OCRRAW][551547456]proprdc_proprhandle: propb_ctx->proprhandle_ocrctx=[0xfd738]
    2011-08-05 18:43:29.864: [ OCRRAW][551547456]proprdc_proprhandle: propb_ctx->proprhandle_os_min_block_size=512
    2011-08-05 18:43:29.864: [ OCRRAW][551547456]proprdc_proprhandle: propb_ctx->proprhandle_islocal_only=0
    2011-08-05 18:43:29.864: [ OCRRAW][551547456]proprdc: end dumping backenctx->propb_ctx
    2011-08-05 18:43:29.864: [ OCRRAW][551547456]proprdc: backend_ctx->metactx=[0xca450]
    2011-08-05 18:43:29.864: [ OCRRAW][551547456]proprdc: backend_ctx->prop_sctx=[0xc1fb0]
    2011-08-05 18:43:29.864: [ OCRRAW][551547456]proprdc: backend_ctx->prop_sltsmx=[0x0]
    2011-08-05 18:43:29.864: [ OCRRAW][551547456]proprdc: backend_ctx->prop_sclsctx=[0xe69f8]
    2011-08-05 18:43:29.864: [ OCRRAW][551547456]proprdc: backend_ctx->prop_ctx_ocrctx=[0xfd738]
    [ OCRAPI][551547456]procr_ctx_set_invalid_no_abort: ctx set to invalid
    [ OCRAPI][551547456]procr_ctx_set_invalid: aborting...
    2011-08-05 18:43:32.471: [ default][49043984][ENTER]0
    Oracle Database 10g CRS Release 10.2.0.4.0 Production Copyright 1996, 2004, Oracle. All rights reserved
    2011-08-05 18:43:32.471: [ default][49043984]0CRS Daemon Starting
    2011-08-05 18:43:32.472: [ CRSMAIN][49043984]0Checking the OCR device
    2011-08-05 18:43:32.474: [ CRSMAIN][49043984]0Connecting to the CSS Daemon
    2011-08-05 18:43:32.860: [ CLSVER][49043984]0Active Version from OCR:10.2.0.4.0
    2011-08-05 18:43:32.861: [ CLSVER][49043984]0Active Version and Software Version are same
    2011-08-05 18:43:32.861: [ CRSMAIN][49043984]0Initializing OCR
    2011-08-05 18:43:32.869: [ OCRRAW][49043984]proprioo: for disk 0 (/ocr_voting/OCRfile), id match (1), my id set (1513150135,1028247821) total id sets (1), 1st set (1
    513150135,1028247821), 2nd set (0,0) my votes (2), total votes (2)
    2011-08-05 18:43:32.904: [ CRSD][49043984]0ENV Logging level for Module: allcomp 0
    2011-08-05 18:43:32.912: [ CRSD][49043984]0ENV Logging level for Module: default 0
    2011-08-05 18:43:32.930: [ CRSD][49043984]0ENV Logging level for Module: COMMCRS 0
    2011-08-05 18:43:32.950: [ CRSD][49043984]0ENV Logging level for Module: COMMNS 0
    2011-08-05 18:43:32.973: [ CRSD][49043984]0ENV Logging level for Module: CRSUI 0
    2011-08-05 18:43:33.001: [ CRSD][49043984]0ENV Logging level for Module: CRSCOMM 0
    2011-08-05 18:43:33.014: [ CRSD][49043984]0ENV Logging level for Module: CRSRTI 0
    2011-08-05 18:43:33.027: [ CRSD][49043984]0ENV Logging level for Module: CRSMAIN 0
    2011-08-05 18:43:33.039: [ CRSD][49043984]0ENV Logging level for Module: CRSPLACE 0
    2011-08-05 18:43:33.053: [ CRSD][49043984]0ENV Logging level for Module: CRSAPP 0
    2011-08-05 18:43:33.064: [ CRSD][49043984]0ENV Logging level for Module: CRSRES 0
    2011-08-05 18:43:33.073: [ CRSD][49043984]0ENV Logging level for Module: CRSOCR 0
    2011-08-05 18:43:33.076: [ CRSD][49043984]0ENV Logging level for Module: CRSTIMER 0
    2011-08-05 18:43:33.085: [ CRSD][49043984]0ENV Logging level for Module: CRSEVT 0
    2011-08-05 18:43:33.087: [ CRSD][49043984]0ENV Logging level for Module: CRSD 0
    2011-08-05 18:43:33.096: [ CRSD][49043984]0ENV Logging level for Module: CLUCLS 0
    2011-08-05 18:43:33.099: [ CRSD][49043984]0ENV Logging level for Module: CLSVER 0
    2011-08-05 18:43:33.108: [ CRSD][49043984]0ENV Logging level for Module: OCRRAW 0
    2011-08-05 18:43:33.111: [ CRSD][49043984]0ENV Logging level for Module: OCROSD 0
    2011-08-05 18:43:32.904: [ CRSD][49043984]0ENV Logging level for Module: allcomp 0
    2011-08-05 18:43:32.912: [ CRSD][49043984]0ENV Logging level for Module: default 0
    2011-08-05 18:43:32.930: [ CRSD][49043984]0ENV Logging level for Module: COMMCRS 0
    2011-08-05 18:43:32.950: [ CRSD][49043984]0ENV Logging level for Module: COMMNS 0
    2011-08-05 18:43:32.973: [ CRSD][49043984]0ENV Logging level for Module: CRSUI 0
    2011-08-05 18:43:33.001: [ CRSD][49043984]0ENV Logging level for Module: CRSCOMM 0
    2011-08-05 18:43:33.014: [ CRSD][49043984]0ENV Logging level for Module: CRSRTI 0
    2011-08-05 18:43:33.027: [ CRSD][49043984]0ENV Logging level for Module: CRSMAIN 0
    2011-08-05 18:43:33.039: [ CRSD][49043984]0ENV Logging level for Module: CRSPLACE 0
    2011-08-05 18:43:33.053: [ CRSD][49043984]0ENV Logging level for Module: CRSAPP 0
    2011-08-05 18:43:33.064: [ CRSD][49043984]0ENV Logging level for Module: CRSRES 0
    2011-08-05 18:43:33.073: [ CRSD][49043984]0ENV Logging level for Module: CRSOCR 0
    2011-08-05 18:43:33.076: [ CRSD][49043984]0ENV Logging level for Module: CRSTIMER 0
    2011-08-05 18:43:33.085: [ CRSD][49043984]0ENV Logging level for Module: CRSEVT 0
    2011-08-05 18:43:33.087: [ CRSD][49043984]0ENV Logging level for Module: CRSD 0
    2011-08-05 18:43:33.096: [ CRSD][49043984]0ENV Logging level for Module: CLUCLS 0
    2011-08-05 18:43:33.099: [ CRSD][49043984]0ENV Logging level for Module: CLSVER 0
    2011-08-05 18:43:33.108: [ CRSD][49043984]0ENV Logging level for Module: OCRRAW 0
    2011-08-05 18:43:33.111: [ CRSD][49043984]0ENV Logging level for Module: OCROSD 0
    2011-08-05 18:43:33.120: [ CRSD][49043984]0ENV Logging level for Module: CSSCLNT 0
    2011-08-05 18:43:33.123: [ CRSD][49043984]0ENV Logging level for Module: OCRAPI 0
    2011-08-05 18:43:33.132: [ CRSD][49043984]0ENV Logging level for Module: OCRUTL 0
    2011-08-05 18:43:33.135: [ CRSD][49043984]0ENV Logging level for Module: OCRMSG 0
    2011-08-05 18:43:33.144: [ CRSD][49043984]0ENV Logging level for Module: OCRCLI 0
    2011-08-05 18:43:33.147: [ CRSD][49043984]0ENV Logging level for Module: OCRCAC 0
    2011-08-05 18:43:33.156: [ CRSD][49043984]0ENV Logging level for Module: OCRSRV 0
    2011-08-05 18:43:33.159: [ CRSD][49043984]0ENV Logging level for Module: OCRMAS 0
    2011-08-05 18:43:33.159: [ CRSMAIN][49043984]0Filename is /u01/app/oracle/product/10.2.0/crs/crs/init/srvorcl02.pid
    [ clsdmt][450884160]Listening to (ADDRESS=(PROTOCOL=ipc)(KEY=srvorcl02DBG_CRSD))
    2011-08-05 18:43:33.201: [ CRSMAIN][49043984]0Using Authorizer location: /u01/app/oracle/product/10.2.0/crs/crs/auth/
    2011-08-05 18:43:33.230: [ CRSMAIN][49043984]0Initializing RTI
    2011-08-05 18:43:33.256: [CRSTIMER][471855680]0Timer Thread Starting.
    2011-08-05 18:43:33.259: [ CRSRES][49043984]0Parameter SECURITY = 1, running in USER Mode
    2011-08-05 18:43:33.259: [ CRSMAIN][49043984]0Initializing EVMMgr
    2011-08-05 18:43:33.814: [ CRSMAIN][49043984]0CRSD locked during state recovery, please wait.
    Resources ONLINE
    2011-08-05 18:43:54.782: [ CRSMAIN][49043984]0CRSD recovered, unlocked.
    2011-08-05 18:43:54.783: [ CRSMAIN][49043984]0QS socket on: (ADDRESS=(PROTOCOL=ipc)(KEY=ora_crsqs))
    2011-08-05 18:43:54.783: [ CRSMAIN][49043984]0QS socket on: (ADDRESS=(PROTOCOL=ipc)(KEY=ora_crsqs))
    2011-08-05 18:43:54.802: [ CRSMAIN][49043984]0CRSD UI socket on: (ADDRESS=(PROTOCOL=ipc)(KEY=CRSD_UI_SOCKET))
    2011-08-05 18:43:54.816: [ CRSMAIN][49043984]0E2E socket on: (ADDRESS=(PROTOCOL=tcp)(HOST=orapriv2)(PORT=49896))
    2011-08-05 18:43:54.816: [ CRSMAIN][49043984]0Starting Threads
    2011-08-05 18:43:54.816: [ CRSMAIN][49043984]0CRS Daemon Started.
    2011-08-05 18:43:54.817: [ CRSMAIN][526381632]0Starting runCommandServer for (UI = 1, E2E = 0). 0
    2011-08-05 18:43:54.817: [ CRSMAIN][528478784]0Starting runCommandServer for (UI = 1, E2E = 0). 1
    OCRCHECK:
    Status of Oracle Cluster Registry is as follows :
    Version : 2
    Total space (kbytes) : 262120
    Used space (kbytes) : 7856
    Available space (kbytes) : 254264
    ID : 440645862
    Device/File Name : /ocr_voting/OCRfile
    Device/File integrity check succeeded
    Device/File not configured
    Cluster registry integrity check succeeded
    Verified /etc/hosts of the 2 nodes , are ok.
    Jumbo frames, on the interconnected interfaces are not enabled.
    [oracle@srvorcl01 ~]$ crsctl query crs activeversion
    CRS active version on the cluster is [10.2.0.4.0]
    checked ocr_file permissions:
    [oracle@srvorcl02 ~]$ ls -la /ocr_voting
    total 18504
    drwxr-xr-x 4 oracle oinstall 3896 Nov 19 2010 .
    drwxr-xr-x 32 root root 4096 May 11 20:11 ..
    -rw-r--r-- 1 oracle oinstall 10240000 Jul 1 2010 CSSfile
    drwxr-xr-x 2 oracle oinstall 3896 Nov 19 2010 dbs
    drwxr-xr-x 2 oracle oinstall 3896 Jun 30 2010 lost+found
    -rw-r----- 1 root oinstall 8765440 Nov 15 2010 OCRfile
    [oracle@srvorcl02 ~]$
    I'm looking for some suggestion and where to focus attention.
    Thanks in advance
    Roby

    i'm facing this problem and i don't understand why node2 and node1 "sometimes" (1 or 2 days a week) gives this type of error and crs restartsHow did you come to know this ?
    Was there any network delay ? Did you check that?
    I think it may be because of the netwrok traffic and can you please post /etc/ocfs.conf and also /var/log/messages .. Did you find any thing odd in the /var/log/messages file?
    GoodLuck!

  • SQL Error using cachedrowSet.populate.

    Hi,
    I am trying to use cachedrowset to pass my result set into my jsp.
    I use request.setAttribute and pass my cachedrowset and in my jsp I use <jsp:usebean> tag to retrieve it.
    This usually works for me. However, I have one query which when I am trying to populate the cachedrowset with its result set (that is cr2 in code below )
    rs2 = stmt.executeQuery(semSql);
    rs3 = stmt.executeQuery(countSql);
    crs2 = new CachedRowSet();
    crs3 = new CachedRowSet();
    crs2.populate(rs2);
    crs3.populate(rs3);
    is throwing an sql error.
    I ran the query in my query analyzer tool and it runs fine. But when I try to populate it in cachedrowset it throws sql error.
    I have more queries in the same java which I am passing to the jsp as cachedrowset (for example cr3 in the above code) And they all are working fine. Only this particular one is causing the issue.
    I was also looking at some other posts with the same issue. One post said if the data is a negative number then it can cause issue while trying to populate a CRS. However, in my case there is no negative data.
    I am clueless. Please help !!

    Apparently noone replied to this.
    Well, this one is odd so cant blame you guys.
    I finally found the answer after losing lots of my hair.
    It looked like somewhere my connection was getting closed. I dont know why it was getting close at the first place because i didnt have any rs.close() or so statement in there.
    One of the reasons that I have in mind is that after getting the results of my first query in a cachedrowset (CRS) , I moved the cursur of CRS and that may have caused some problem. But then also my second query was totally independant of my first query. And my third query which apparently was working fine and didnt thru an error on crs.populate was dependant on the first one,.
    Finally, I rearraged the code, so that the operations i was doing on the first CRS was after I populate my second CRS. And that solved the problem.
    Hope this solution helps somebody like me out there.

  • RAC -- CRS-0254: authorization failure

    Hi,
    i m trying to start 1 instance in rac env using srvctl command i m getting following error.
    CRS-0254: authorization failure

    Hi Pawell,
    I am not sure whether your problem has been resolved or not.
    But unfortunately even we are facing the same issue. Till today morning everything was fine. Suddenly users started complaining that they can't connect to the database.
    When we tried log into database using sqlplus command it gave us TNS:protocol Adapter error which is weird. (every service relates to oracle and cluster are running from windows services and even when we checked crs_stat -t ==> all the services are up and running)
    and when we tried to stop the services on the cluster level it gave us CRS-254 which is authorization failure.
    Though restarting the server fixed the problem as of at this moment, We don't really know what caused that problem.
    If your problem has been resolved can you give me some information in relates to this.
    Regards
    Balaji

  • Oracle 10g to 11g Upgrade - Oracle Clusterware problem

    Oracle10g RAC (2 Nodes) RHEL 4 64bit
    Hi All,
    I have began the procedure for upgrading Oracle Clusterware to 11g. However, during the install OUI was giving me certain error messages like it couldn't transfer the OUI installlogs to node 2. Well, I kept pushing through the install and after I ran the last rootupgrade script on node 2 it gave me the following error:
    Checking the existence of nodeapps on this node
    Exception in thread "main" java.lang.UnsupportedClassVersionError: oracle/ops/opsctl/OPSCTLDriver (Unsupported major.minor version 49.0)
    at java.lang.ClassLoader.defineClass0(Native Method)
    at java.lang.ClassLoader.defineClass(ClassLoader.java:539)
    at java.security.SecureClassLoader.defineClass(SecureClassLoader.java:123)
    at java.net.URLClassLoader.defineClass(URLClassLoader.java:251)
    at java.net.URLClassLoader.access$100(URLClassLoader.java:55)
    at java.net.URLClassLoader$1.run(URLClassLoader.java:194)
    at java.security.AccessController.doPrivileged(Native Method)
    at java.net.URLClassLoader.findClass(URLClassLoader.java:187)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:289)
    at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:274)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:235)
    at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:302)
    Creating '/crs/home/install/paramfile.crs' with data used for CRS configuration
    Exception in thread "main" java.lang.UnsupportedClassVersionError: oracle/ops/opsctl/OPSCTLDriver (Unsupported major.minor version 49.0)
    at java.lang.ClassLoader.defineClass0(Native Method)
    at java.lang.ClassLoader.defineClass(ClassLoader.java:539)
    at java.security.SecureClassLoader.defineClass(SecureClassLoader.java:123)
    at java.net.URLClassLoader.defineClass(URLClassLoader.java:251)
    at java.net.URLClassLoader.access$100(URLClassLoader.java:55)
    at java.net.URLClassLoader$1.run(URLClassLoader.java:194)
    at java.security.AccessController.doPrivileged(Native Method)
    at java.net.URLClassLoader.findClass(URLClassLoader.java:187)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:289)
    at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:274)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:235)
    at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:302)
    Failed to retrieve VIP details
    Exception in thread "main" java.lang.UnsupportedClassVersionError: oracle/ops/opsctl/OPSCTLDriver (Unsupported major.minor version 49.0)
    at java.lang.ClassLoader.defineClass0(Native Method)
    at java.lang.ClassLoader.defineClass(ClassLoader.java:539)
    at java.security.SecureClassLoader.defineClass(SecureClassLoader.java:123)
    at java.net.URLClassLoader.defineClass(URLClassLoader.java:251)
    at java.net.URLClassLoader.access$100(URLClassLoader.java:55)
    at java.net.URLClassLoader$1.run(URLClassLoader.java:194)
    at java.security.AccessController.doPrivileged(Native Method)
    at java.net.URLClassLoader.findClass(URLClassLoader.java:187)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:289)
    at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:274)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:235)
    at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:302)
    Failed to retrieve VIP details
    Setting CRS configuration values in /crs/home/install/paramfile.crs
    So I ignored the error for the time being and after that I checked the status of crs and it gave me the following:
    [oracle@vtl-rac2 crsd]$ crsstatus
    HA Resource Target State
    ora.VMRACDEV.VMRACDEV1.inst ONLINE ONLINE on vtl-rac1
    ora.VMRACDEV.VMRACDEV2.inst ONLINE ONLINE on vtl-rac2
    ora.VMRACDEV.db ONLINE ONLINE on vtl-rac1
    ora.vtl-rac1.ASM1.asm ONLINE ONLINE on vtl-rac1
    ora.vtl-rac1.LISTENER_VTL-RAC1.lsnr ONLINE ONLINE on vtl-rac1
    ora.vtl-rac1.gsd ONLINE ONLINE on vtl-rac1
    ora.vtl-rac1.ons ONLINE OFFLINE
    ora.vtl-rac1.vip ONLINE ONLINE on vtl-rac1
    ora.vtl-rac2.ASM2.asm ONLINE ONLINE on vtl-rac2
    ora.vtl-rac2.LISTENER_VTL-RAC2.lsnr ONLINE ONLINE on vtl-rac2
    ora.vtl-rac2.gsd ONLINE ONLINE on vtl-rac2
    ora.vtl-rac2.ons ONLINE OFFLINE
    ora.vtl-rac2.vip ONLINE ONLINE on vtl-rac2
    So i tried to bring it back up by doing a crs_stop -all and crs_start -all and it gave me the following error:
    vtl-rac1 : CRS-1019: Resource ora.vtl-rac2.ons (application) cannot run on vtl-rac1
    Start of `ora.vtl-rac1.ons` on member `vtl-rac1` failed.
    vtl-rac2 : CRS-1019: Resource ora.vtl-rac1.ons (application) cannot run on vtl-rac2
    CRS-0223: Resource 'ora.VMRACDEV.db' has placement error.
    CRS-0215: Could not start resource 'ora.vtl-rac1.ons'.
    CRS-0215: Could not start resource 'ora.vtl-rac2.ons'.
    I am thinking that all of this is caused by the various issues I had with the install. If I am incorrect, then please let me know. If it is true, I would like to know if there are any 11g docs on how to clean up a failed clusterware upgrade. Any advice would be greatly appreciated on any of the situations I am having.
    Thank you

    Hi Chandra,
    Did CVU report any problems before the upgrade?No, there were no errors reported by CVU before the upgrade.
    I don't there is note out there for cleaning 11g CRS
    install...and I think can very use the 10g CRS note -
    239998.1.Yeah I might have to go that way.
    I have both the 11g CRS install and upgrade from 10g
    to 11CRS at
    http://chandradba.blogspot.com/2007/08/oracle-11g-rac-
    install-on-red-hat-50.html
    and
    http://chandradba.blogspot.com/2008/02/oracle-10g-crs-
    upgrade-to-11g-crs.html
    see if it helps.Yup, your guide is very simple, clear and error proof :) That's how mine when pretty much except right around 75% I started getting these strange errors of files not being able to be transferred to node 2. Anyways, it shouldn't be a problem as none of those errors were configuration related...or else I would have a messed up cluster.
    Well, I actually rebooted both machines and now the whole CRS stack is up!! So I guess I am ok. We'll just have to wait and see.
    Thanks for your help Chandra...I always appreciate it.

  • 10g RAC on Oracle VM/Windows 2003 server

    Is there any documentation/thread/blog which describes installation of 10g clusterware on Windows 2003 VM on Oracle VM 2.1.2 using just direct attached storage? I created 2 Windows 2003 VMs. For OCR and Voting disks, I created shared virtual disks. These disks are visible from both VMs. When I try to install clusterware, both VMs blue screen about 50% into install. The error in CRS logs points to OCR disks not being in correct format. I have tested same process with VMWare server and it works fine. Do I need to do something different for Oracle VM?
    BTW this is not my first time installing RAC on Windows 2003. I have done more installations than I care to remember but always on physical servers. I followed the same process as I do for physical servers but it seems that Oracle VM does not like the shared virtual disks.
    Thanks...

    Check out my articles at http://dbasupport.com on 10g R2 RAC Clusterware setup. I was able to do that on my vmware BUT I hope to have the very irritating ASM scenario done before my 4th Article.
    Check it out.

  • Root.sh fails inf 11gr2 2 node hp installation

    Hello,
    Env Details:
    This is an 2node RAC 11gR2 installation on HP 11.3.
    Following is the issue:
    The GRid infrastructure installation fails at the point of running root.sh with the following errors on node 1,
    CRS-2677: Stop of 'ora.cssdmonitor' on 'vpar1' succeeded
    CRS-2673: Attempting to stop 'ora.gpnpd' on 'vpar1'
    CRS-2677: Stop of 'ora.gpnpd' on 'vpar1' succeeded
    CRS-2673: Attempting to stop 'ora.mdnsd' on 'vpar1'
    CRS-2677: Stop of 'ora.mdnsd' on 'vpar1' succeeded
    CRS-2673: Attempting to stop 'ora.gipcd' on 'vpar1'
    CRS-2677: Stop of 'ora.gipcd' on 'vpar1' succeeded
    CRS-4000: Command Start failed, or completed with errors.
    CRS-2672: Attempting to start 'ora.gipcd' on 'vpar1'
    CRS-2672: Attempting to start 'ora.mdnsd' on 'vpar1'
    CRS-2676: Start of 'ora.gipcd' on 'vpar1' succeeded
    CRS-2676: Start of 'ora.mdnsd' on 'vpar1' succeeded
    CRS-2672: Attempting to start 'ora.gpnpd' on 'vpar1'
    CRS-2676: Start of 'ora.gpnpd' on 'vpar1' succeeded
    CRS-2672: Attempting to start 'ora.cssdmonitor' on 'vpar1'
    CRS-2676: Start of 'ora.cssdmonitor' on 'vpar1' succeeded
    CRS-2672: Attempting to start 'ora.cssd' on 'vpar1'
    CRS-2672: Attempting to start 'ora.diskmon' on 'vpar1'
    CRS-2676: Start of 'ora.diskmon' on 'vpar1' succeeded
    CRS-2674: Start of 'ora.cssd' on 'vpar1' failed
    CRS-2679: Attempting to clean 'ora.cssd' on 'vpar1'
    CRS-2678: 'ora.cssd' on 'vpar1' has experienced an unrecoverable failure
    CRS-0267: Human intervention required to resume its availability.
    CRS-2673: Attempting to stop 'ora.diskmon' on 'vpar1'
    CRS-2677: Stop of 'ora.diskmon' on 'vpar1' succeeded
    CRS-2673: Attempting to stop 'ora.gpnpd' on 'vpar1'
    CRS-2677: Stop of 'ora.gpnpd' on 'vpar1' succeeded
    CRS-2673: Attempting to stop 'ora.mdnsd' on 'vpar1'
    CRS-2677: Stop of 'ora.mdnsd' on 'vpar1' succeeded
    CRS-2673: Attempting to stop 'ora.gipcd' on 'vpar1'
    CRS-2677: Stop of 'ora.gipcd' on 'vpar1' succeeded
    *CRS-4000: Command Start failed, or completed with errors.
    Command return code of 1 (256) from command: /orabinary1/cluster/bin/crsctl start resource ora.ctssd -init
    Start of resource "ora.ctssd -init" failed
    Clusterware exclusive mode start of resource ora.ctssd failed
    CRS-2500: Cannot stop resource 'ora.crsd' as it is not running
    CRS-4000: Command Stop failed, or completed with errors.
    Command return code of 1 (256) from command: /orabinary1/cluster/bin/crsctl stop resource ora.crsd -init
    Stop of resource "ora.crsd -init" failed
    Failed to stop CRSD
    CRS-2500: Cannot stop resource 'ora.asm' as it is not running
    CRS-4000: Command Stop failed, or completed with errors.
    Command return code of 1 (256) from command: /orabinary1/cluster/bin/crsctl stop resource ora.asm -init
    Stop of resource "ora.asm -init" failed
    Failed to stop ASM*
    CRS-2679: Attempting to clean 'ora.cssd' on 'vpar1'
    CRS-2681: Clean of 'ora.cssd' on 'vpar1' succeeded
    Initial cluster configuration failed.
    the ocrcheck command fails with :
    2010-02-25 14:57:08.610: [  OCRASM][1]proprasmo: Failed to open file in dirty mode
    2010-02-25 14:57:08.610: [  OCRASM][1]proprasmo: Error in open/create file in dg [newgrid]
    [  OCRASM][1]SLOS : SLOS: cat=8, opn=kgfolclcpi1, dep=210, loc=kgfokge
    AMDU-00210: No disks found in diskgroup NEWGRID
    AMDU-00210: No disks found in diskgroup NEWGRID
    2010-02-25 14:57:08.630: [  OCRASM][1]proprasmo: kgfoCheckMount returned [7]
    2010-02-25 14:57:08.630: [  OCRASM][1]proprasmo: The ASM instance is down
    the disks are already owned by grid:asmadmin group i have already done chmod 660 for all of them.
    the precheck during the installation does not fail with any particular error and goes ahead to the point of asking to run root.sh
    kindly help.
    regards
    pg

    Unfortunately I can't run any -post checks because the CRS doesn't install correctly. The error occurs during the intial root.sh run on the first node, and doens't allow me to continue.
    cluvfy stage -post crsinst -n sun277z1,sun278z1
    Performing post-checks for cluster services setup
    Checking node reachability...
    Node reachability check passed from node "sun277z1"
    Checking user equivalence...
    User equivalence check passed for user "oracle"
    ERROR:
    CRS is not installed on any of the nodes
    Verification cannot proceed

Maybe you are looking for