Ancient RHEL3 Running Oracle Rac 10G - memory utilization question

As all good things must happen the crappy old systems that never get upgraded come back to bite you.
I have a 4 node RAC cluster running Linux RHEL3. I know .. would love to upgrade it .. but that will take time. Looking for at survival at this point. The system is experiencing High I/O wait. Now, my background is mainly Solaris/AIX and not Linux. So as I work through this problem I am unsure of what I am seeing, since Linux maybe handling memory differently on this OS.
This is what I am seeing:
High I/O wait as shown by TOP
Disk Access Time and Utilization : pretty good .. no device utilized over 30% and <20 millisecond response times from the drives
The real Question is in memory usage:
Host: 32GB
OS: Red Hat Enterprise Linux AS release 3 (Taroon Update 9)
model name : AMD Opteron (tm) Processor 880
Please .. I know its old but try and not laugh.......
The box has 32GB of Memory and I am told by the DBAs that OEM is reporting that SGA is sized correctly and memory ISN"T the problem. But disk access time/utilization isn't really pointing to a particular problem with the OS. The disks are all provided by a SAN.
However, when I look at TOP .. I see that the largest oracle process in RSS size is 8G .. now on all other platforms .. AIX/Solaris when using TOP .. all oracle processes that connect to the SGA will show the full size of SGA. So this is my question. Does Linux do this differently... for the DBAs to tell me SGA is set to 20GB and to only see top showing process with 8GB .. this has me confused. Is the SGA really being set to 20GB????
I can see in a pmap <oracle process> that it appears to be attached but just wanting to rule out a simple Oracle / Linux configuration problem first.
I've included a pmap of both a current Linux process on the troubled system and a pmap of a current oracle solaris host.
Linux
[root@lnxracbo2a proc]# pmap 15013
15013: oracle
Start Size Perm Mapping
00400000 94192K r-xp /oracle/product/10.2.0.4apr09/bin/oracle
060fc000 436K rw-p /oracle/product/10.2.0.4apr09/bin/oracle
06169000 792K rwxp [ anon ]
60000000 24119296K rw-s /SYSVfa491508
2a95556000 1108K r-xp /lib64/ld-2.3.2.so
2a9566b000 4K rw-p /lib64/ld-2.3.2.so
2a9566c000 4K rw-p [ anon ]
2a9566d000 164K r-xp /oracle/product/10.2.0.4apr09/lib/libskgxp10.so
2a95696000 1024K ---p /oracle/product/10.2.0.4apr09/lib/libskgxp10.so
2a95796000 8K rw-p /oracle/product/10.2.0.4apr09/lib/libskgxp10.so
2a95798000 944K r-xp /oracle/product/10.2.0.4apr09/lib/libhasgen10.so
2a95884000 1024K ---p /oracle/product/10.2.0.4apr09/lib/libhasgen10.so
2a95984000 24K rw-p /oracle/product/10.2.0.4apr09/lib/libhasgen10.so
2a9598a000 24K rw-p [ anon ]
2a95990000 8K r-xp /oracle/product/10.2.0.4apr09/lib/libskgxn2.so
2a95992000 1020K ---p /oracle/product/10.2.0.4apr09/lib/libskgxn2.so
2a95a91000 4K rw-p /oracle/product/10.2.0.4apr09/lib/libskgxn2.so
2a95a92000 428K r-xp /oracle/product/10.2.0.4apr09/lib/libocr10.so
2a95afd000 1024K ---p /oracle/product/10.2.0.4apr09/lib/libocr10.so
2a95bfd000 8K rw-p /oracle/product/10.2.0.4apr09/lib/libocr10.so
2a95bff000 256K r-xp /oracle/product/10.2.0.4apr09/lib/libocrb10.so
2a95c3f000 1024K ---p /oracle/product/10.2.0.4apr09/lib/libocrb10.so
2a95d3f000 4K rw-p /oracle/product/10.2.0.4apr09/lib/libocrb10.so
2a95d40000 4K rw-p [ anon ]
2a95d41000 444K r-xp /oracle/product/10.2.0.4apr09/lib/libocrutl10.so
2a95db0000 1020K ---p /oracle/product/10.2.0.4apr09/lib/libocrutl10.so
2a95eaf000 20K rw-p /oracle/product/10.2.0.4apr09/lib/libocrutl10.so
2a95eb4000 8K rw-p [ anon ]
2a95eb6000 8492K r-xp /oracle/product/10.2.0.4apr09/lib/libjox10.so
2a96701000 1020K ---p /oracle/product/10.2.0.4apr09/lib/libjox10.so
2a96800000 1568K rw-p /oracle/product/10.2.0.4apr09/lib/libjox10.so
2a96988000 32K r-xp /oracle/product/10.2.0.4apr09/lib/libclsra10.so
2a96990000 1024K ---p /oracle/product/10.2.0.4apr09/lib/libclsra10.so
2a96a90000 4K rw-p /oracle/product/10.2.0.4apr09/lib/libclsra10.so
2a96a91000 4K rw-p [ anon ]
2a96a92000 112K r-xp /oracle/product/10.2.0.4apr09/lib/libdbcfg10.so
2a96aae000 1024K ---p /oracle/product/10.2.0.4apr09/lib/libdbcfg10.so
2a96bae000 8K rw-p /oracle/product/10.2.0.4apr09/lib/libdbcfg10.so
2a96bb0000 3004K r-xp /oracle/product/10.2.0.4apr09/lib/libnnz10.so
2a96e9f000 1020K ---p /oracle/product/10.2.0.4apr09/lib/libnnz10.so
2a96f9e000 708K rw-p /oracle/product/10.2.0.4apr09/lib/libnnz10.so
2a9704f000 12K rw-p [ anon ]
2a97069000 4K r-xp /usr/lib64/libaio.so.1
2a9706a000 1020K ---p /usr/lib64/libaio.so.1
2a97169000 4K rw-p /usr/lib64/libaio.so.1
2a9716a000 4K rw-p [ anon ]
2a9716b000 12K r-xp /lib64/libdl-2.3.2.so
2a9716e000 1020K ---p /lib64/libdl-2.3.2.so
2a9726d000 4K rw-p /lib64/libdl-2.3.2.so
2a9726e000 540K r-xp /lib64/tls/libm-2.3.2.so
2a972f5000 1024K ---p /lib64/tls/libm-2.3.2.so
2a973f5000 4K rw-p /lib64/tls/libm-2.3.2.so
2a973f6000 60K r-xp /lib64/tls/libpthread-0.60.so
2a97405000 1024K ---p /lib64/tls/libpthread-0.60.so
2a97505000 4K rw-p /lib64/tls/libpthread-0.60.so
2a97506000 20K rw-p [ anon ]
2a9750b000 80K r-xp /lib64/libnsl-2.3.2.so
2a9751f000 1020K ---p /lib64/libnsl-2.3.2.so
2a9761e000 8K rw-p /lib64/libnsl-2.3.2.so
2a97620000 8K rw-p [ anon ]
2a97622000 1264K r-xp /lib64/tls/libc-2.3.2.so
2a9775e000 1020K ---p /lib64/tls/libc-2.3.2.so
2a9785d000 20K rw-p /lib64/tls/libc-2.3.2.so
2a97862000 1480K rw-p [ anon ]
2a979d4000 48K rw-p /dev/zero
2a979e0000 64K rw-p /dev/zero
2a979f0000 64K rw-p /dev/zero
2a97a00000 64K rw-p /dev/zero
2a97a10000 64K rw-p /dev/zero
2a97a20000 64K rw-p /dev/zero
2a97a30000 64K rw-p /dev/zero
2a97a40000 64K rw-p /dev/zero
2a97a50000 16K rw-p /dev/zero
2a97a54000 640K rw-p /dev/zero
2a97af4000 640K rw-p /dev/zero
2a97b94000 128K rw-p /dev/zero
2a97bb4000 128K rw-p /dev/zero
2a97bd4000 128K rw-p /dev/zero
2a97bf4000 128K rw-p /dev/zero
2a97c14000 128K rw-p /dev/zero
2a97c34000 128K rw-p /dev/zero
2a97c54000 64K rw-p /dev/zero
2a97c64000 64K rw-p /dev/zero
2a97c74000 512K ---p /dev/zero
7fbffe4000 112K rwxp [ stack ]
mapped: 24255304K writeable/private: 8000K shared: 24119296K
Solaris
admin-srv403[2]/ # pmap 5467
5467: oracleorprd26a (LOCAL=NO)
0000000100000000 97696K r-x-- /oracle/product/10.2.0.4.4/bin/oracle
0000000106066000 672K rwx-- /oracle/product/10.2.0.4.4/bin/oracle
000000010610E000 1952K rwx-- [ heap ]
0000000380000000 8388632K rwxsR [ ism shmid=0x4268 ]
FFFFFFFF7B070000 64K rw--- [ anon ]
FFFFFFFF7B100000 64K rw--- [ anon ]
FFFFFFFF7B110000 64K rw--- [ anon ]
FFFFFFFF7B120000 64K rw--- [ anon ]
FFFFFFFF7B130000 64K rw--- [ anon ]
FFFFFFFF7B140000 64K rw--- [ anon ]
FFFFFFFF7B150000 64K rw--- [ anon ]
FFFFFFFF7B160000 64K rw--- [ anon ]
FFFFFFFF7B170000 64K rw--- [ anon ]
FFFFFFFF7B19E000 8K rwxs- [ anon ]
FFFFFFFF7B200000 8K rwx-- [ anon ]
FFFFFFFF7B300000 8K r-x-- /usr/lib/sparcv9/libmd5.so.1
FFFFFFFF7B402000 8K rwx-- /usr/lib/sparcv9/libmd5.so.1
FFFFFFFF7B500000 8K rwx-- [ anon ]
FFFFFFFF7B600000 16K r-x-- /usr/lib/sparcv9/libmp.so.2
FFFFFFFF7B704000 8K rwx-- /usr/lib/sparcv9/libmp.so.2
FFFFFFFF7B800000 8K rwx-- [ anon ]
FFFFFFFF7B900000 216K r-x-- /usr/lib/sparcv9/libm.so.1
FFFFFFFF7BA34000 16K rwx-- /usr/lib/sparcv9/libm.so.1
FFFFFFFF7BB00000 32K r-x-- /usr/lib/sparcv9/librt.so.1
FFFFFFFF7BC08000 8K rwx-- /usr/lib/sparcv9/librt.so.1
FFFFFFFF7BD00000 32K r-x-- /usr/lib/sparcv9/libaio.so.1
FFFFFFFF7BE08000 8K rwx-- /usr/lib/sparcv9/libaio.so.1
FFFFFFFF7BE0A000 8K rwx-- /usr/lib/sparcv9/libaio.so.1
FFFFFFFF7BF00000 728K r-x-- /usr/lib/sparcv9/libc.so.1
FFFFFFFF7C0B6000 56K rwx-- /usr/lib/sparcv9/libc.so.1
FFFFFFFF7C0C4000 8K rwx-- /usr/lib/sparcv9/libc.so.1
FFFFFFFF7C100000 8K rwx-- [ anon ]
FFFFFFFF7C200000 8K r-x-- /usr/lib/sparcv9/libsched.so.1
FFFFFFFF7C302000 8K rwx-- /usr/lib/sparcv9/libsched.so.1
FFFFFFFF7C400000 8K rwx-- /usr/lib/sparcv9/libdl.so.1
FFFFFFFF7C500000 32K r-x-- /usr/lib/sparcv9/libgen.so.1
FFFFFFFF7C608000 8K rwx-- /usr/lib/sparcv9/libgen.so.1
FFFFFFFF7C700000 48K r-x-- /usr/lib/sparcv9/libsocket.so.1
FFFFFFFF7C80C000 16K rwx-- /usr/lib/sparcv9/libsocket.so.1
FFFFFFFF7C900000 672K r-x-- /usr/lib/sparcv9/libnsl.so.1
FFFFFFFF7CAA8000 56K rwx-- /usr/lib/sparcv9/libnsl.so.1
FFFFFFFF7CAB6000 40K rwx-- /usr/lib/sparcv9/libnsl.so.1
FFFFFFFF7CB00000 8K rwx-- [ anon ]
FFFFFFFF7CC00000 8K r-x-- /usr/lib/sparcv9/libkstat.so.1
FFFFFFFF7CD02000 8K rwx-- /usr/lib/sparcv9/libkstat.so.1
FFFFFFFF7CE00000 2184K r-x-- /oracle/product/10.2.0.4.4/lib/libnnz10.so
FFFFFFFF7D120000 240K rwx-- /oracle/product/10.2.0.4.4/lib/libnnz10.so
FFFFFFFF7D15C000 8K rwx-- /oracle/product/10.2.0.4.4/lib/libnnz10.so
FFFFFFFF7D200000 72K r-x-- /oracle/product/10.2.0.4.4/lib/libdbcfg10.so
FFFFFFFF7D310000 8K rwx-- /oracle/product/10.2.0.4.4/lib/libdbcfg10.so
FFFFFFFF7D400000 1072K r-x-- /oracle/product/10.2.0.4.4/lib/libclsra10.so
FFFFFFFF7D60A000 56K rwx-- /oracle/product/10.2.0.4.4/lib/libclsra10.so
FFFFFFFF7D618000 8K rwx-- /oracle/product/10.2.0.4.4/lib/libclsra10.so
FFFFFFFF7D700000 8K rwx-- [ anon ]
FFFFFFFF7D800000 9272K r-x-- /oracle/product/10.2.0.4.4/lib/libjox10.so
FFFFFFFF7E20C000 560K rwx-- /oracle/product/10.2.0.4.4/lib/libjox10.so
FFFFFFFF7E300000 1072K r-x-- /oracle/product/10.2.0.4.4/lib/libocrutl10.so
FFFFFFFF7E50A000 56K rwx-- /oracle/product/10.2.0.4.4/lib/libocrutl10.so
FFFFFFFF7E518000 8K rwx-- /oracle/product/10.2.0.4.4/lib/libocrutl10.so
FFFFFFFF7E600000 1376K r-x-- /oracle/product/10.2.0.4.4/lib/libocrb10.so
FFFFFFFF7E856000 64K rwx-- /oracle/product/10.2.0.4.4/lib/libocrb10.so
FFFFFFFF7E866000 8K rwx-- /oracle/product/10.2.0.4.4/lib/libocrb10.so
FFFFFFFF7E900000 1536K r-x-- /oracle/product/10.2.0.4.4/lib/libocr10.so
FFFFFFFF7EB7E000 64K rwx-- /oracle/product/10.2.0.4.4/lib/libocr10.so
FFFFFFFF7EB8E000 8K rwx-- /oracle/product/10.2.0.4.4/lib/libocr10.so
FFFFFFFF7EC00000 8K rwx-- [ anon ]
FFFFFFFF7ED00000 8K r-x-- /oracle/product/10.2.0.4.4/lib/libskgxn2.so
FFFFFFFF7EE00000 8K rwx-- /oracle/product/10.2.0.4.4/lib/libskgxn2.so
FFFFFFFF7EF00000 1752K r-x-- /oracle/product/10.2.0.4.4/lib/libhasgen10.so
FFFFFFFF7F1B4000 72K rwx-- /oracle/product/10.2.0.4.4/lib/libhasgen10.so
FFFFFFFF7F1C6000 16K rwx-- /oracle/product/10.2.0.4.4/lib/libhasgen10.so
FFFFFFFF7F200000 144K r-x-- /oracle/product/10.2.0.4.4/lib/libskgxp10.so
FFFFFFFF7F322000 16K rwx-- /oracle/product/10.2.0.4.4/lib/libskgxp10.so
FFFFFFFF7F400000 8K r-x-- /usr/platform/sun4u-us3/lib/sparcv9/libc_psr.so.1
FFFFFFFF7F500000 8K rwx-- [ anon ]
FFFFFFFF7F600000 184K r-x-- /usr/lib/sparcv9/ld.so.1
FFFFFFFF7F72E000 16K rwx-- /usr/lib/sparcv9/ld.so.1
FFFFFFFF7FFDC000 144K rw--- [ stack ]
total 8511704K

834881 wrote:
I have a 4 node RAC cluster running Linux RHEL3. I know .. would love to upgrade it .. but that will take time. Looking for at survival at this point. The system is experiencing High I/O wait. How/why do you relate this to a memory problem that needs memory utilisation analysed?
It could be that you have a dual fibre via HBA to the SAN and that one port is faulty (e.g. bad cable), thus reducing your I/O to the SAN to a single I/O path.
It could be caused by hotspots on a LUN - and likely because ASM is not being used, this hotspot cannot be automatically load balanced.
Or it could be a number of other factors, such as poorly designed and written app code that performs multiple passes through the same data sets, abuse of PQ slaves, etc.
How does your storage layer look? What do you use for SAN connectivity? What diver s/w is used? How are the LUNs used (cooked/raw)? Is ASM used? What does Oracle session and instance reports ito I/O wait times? Which datafiles are being hit the hardest? Is acrhive logging used and what is the frequency of log switches? Etc. etc.
Memory utilisation does not impact I/O, unless it is swap I/O. And these symptoms are easily seen and easily diagnosed. So I would expect that high memory utilisation may be a symptom, as is I/O wait times, of a potential underlying problem. But it would be premature to blame one (e.g. I/O wait times) on the other (e.g. memory utilisation).

Similar Messages

  • Oracle RAC 10g on Solaris 10 in a non-global zone

    I need to run Oracle RAC 10g on Solaris 10 in a non-global zone as I must cap the CPUs used for Oracle licensing limitations. My question is a simple one, but one for which I'm getting conflicting information depending upon whom I ask.
    If I want to run RAC in a non-global zone on two nodes, does this require the use of Solaris Cluster?
    I know there are good reasons to use Solaris Cluster, but the company for which I work cannot afford the additional expense of Solaris Cluster at this time. Is it possible to run Oracle RAC 10g in a capped container without Solaris Cluster or is Solaris Cluster absolutely required?
    Thanks in advance for any insight you can provide.

    AFAIK, Oracle 10g RAC is not supported in solaris containers.
    It is however supported in Solaris zone clusters...in order to use it, you would have to use Sun Cluster 3.2 (iinm).

  • Running Oracle database 10g and 11g on same 5 RAC nodes

    Hello Gurus,
    Could any body throw light if I can install and sucessfully run Oracle database 10g and 11g on the same Oracle RAC installation setup.My setup is below
    Number of nodes-5
    OS- windows 2003 or RHEL5
    storage- DELL EMC SAN
    Clusterware- oracle version11g
    File system-Automatic storage management(ASM)
    After I successfully setup clusterware,ASM on the nodes,I would want to install 11g database on all 5 nodes .
    Then Install 10g database on only 3 of the nodes using the same clusterware.
    What are your views on the same.
    Also FYI... as per metalink node 220970.1(RAC: Frequently Asked Questions) one can do such a setup.
    what iam looking for is practical experience if anyone has implemented this in production system,if yes any issues faced and how tough it is to support.
    Thanks,
    Imtiyaz

    You could run an 11g database and 10g database on the same cluster as long as you use Clusterware 11g.
    The administration aspect will drastically change according to the platform you run on. As of now, it appears you don't know whether it will be Linux or Windows.
    It would be practical to support the same database release.

  • Install Oracle RAC 10g (10.2.0.1) on HP-UX  B.11.31 U ia64 failed

    Hi All
    I am installing Oracle RAC 10g 10.2.0.1 on HP-UX B.11.31 U ia64 but can not complete
    hosts file
    #Public IPs
    10.144.1.111 spgdb01
    10.144.1.112 spgdb02
    #Private IPs
    10.144.2.2 spgdb01p
    10.144.2.3 spgdb02p
    #Virtual IPs
    10.144.1.113 spgdb01v
    10.144.1.114 spgdb02v
    I do installation with runInstaller without error. It copy and link is ok. When I run root.sh then It cannot complete as following
    Checking to see if Oracle CRS stack is already configured
    Checking to see if any 9i GSD is up
    Setting the permissions on OCR backup directory
    Setting up NS directories
    Oracle Cluster Registry configuration upgraded successfully
    WARNING: directory '/oracle/product/10.2.0' is not owned by root
    WARNING: directory '/oracle/product' is not owned by root
    WARNING: directory '/oracle' is not owned by root
    Successfully accumulated necessary OCR keys.
    Using ports: CSS=49895 CRS=49896 EVMC=49898 and EVMR=49897.
    node <nodenumber>: <nodename> <private interconnect name> <hostname>
    node 0: spgdb01 spgdb01p spgdb01
    node 1: spgdb02 spgdb02p spgdb02
    Creating OCR keys for user 'root', privgrp 'sys'..
    Operation successful.
    Now formatting voting device: /ora/crs/votedisk01
    waitpid(-1, 0x7fffdf50, WUNTRACED) .................................................................................................... [sleeping]
    Now formatting voting device: /oracle/oradata1/crs/votedisk02
    Now formatting voting device: /oracle/oradata2/crs/votedisk03
    Format of 3 voting devices complete.
    Startup will be queued to init within 30 seconds.
    ====================
    I have waited for 10 mins but still not complete
    Additionally, log from runInstaller, I got
    Preparing to launch Oracle Universal Installer from /tmp/OraInstall2011-04-28_12-13-31AM. Please wait ...-bash-4.2$ Oracle Universal Installer, Version 10.2.0.1.0 Production
    Copyright (C) 1999, 2005, Oracle. All rights reserved.
    Private Interconnect : null
    Private Interconnect : null
    Private Interconnect : null
    Private Interconnect : null
    So, please help me fix this issue
    Thank you

    I had this problem and resolved it by transporting the file to the installation server with the correct ftp datatype (binary).
    On page 54 of the install guide (..Server\Oracle_Business_Intelligence\doc\doc\bi.1013\b31765.pdf) that comes with the installation files, there is an instruction to make sure that any ftp activity is done in binary.
    This may not have occured with the license.xml file if you use a tool which offers the "feature" of automatic datatype recognition.
    Hope this helps.

  • Failover not happening the Oracle RAC 10g

    Hi All,
    I am new to RAC.
    I have installed Oracle RAC 10g on Redhat Linux 4.0. Till yesterday failover was happening that is when i stopped one instance on node01 the vip of node01 was transferred to node02.This was shown using ifconfig -a but now that is now happening.Don't know as what has happened.Can you please help me out
    Below information is given:
    [oracle@node01 ~]$ crs_stat -t
    Name Type Target State Host
    ora.hitesh.db application ONLINE ONLINE node02
    ora....h1.inst application ONLINE ONLINE node01
    ora....h2.inst application OFFLINE OFFLINE
    ora....SM1.asm application ONLINE ONLINE node01
    ora....01.lsnr application ONLINE ONLINE node01
    ora.node01.gsd application ONLINE ONLINE node01
    ora.node01.ons application ONLINE ONLINE node01
    ora.node01.vip application ONLINE ONLINE node01
    ora....SM2.asm application ONLINE ONLINE node02
    ora....02.lsnr application ONLINE ONLINE node02
    ora.node02.gsd application ONLINE ONLINE node02
    ora.node02.ons application ONLINE ONLINE node02
    ora.node02.vip application ONLINE ONLINE node02
    Listner status on node01 is given:
    [oracle@node01 ~]$ lsnrctl status
    LSNRCTL for Linux: Version 10.2.0.1.0 - Production on 06-APR-2013 12:59:29
    Copyright (c) 1991, 2005, Oracle. All rights reserved.
    Connecting to (ADDRESS=(PROTOCOL=tcp)(HOST=)(PORT=1521))
    STATUS of the LISTENER
    Alias LISTENER_NODE01
    Version TNSLSNR for Linux: Version 10.2.0.1.0 - Production
    Start Date 06-APR-2013 11:59:03
    Uptime 0 days 1 hr. 0 min. 25 sec
    Trace Level off
    Security ON: Local OS Authentication
    SNMP OFF
    Listener Parameter File /home/oracle/oracle/product/10.2.0/db_1/network/admin/listener.ora
    Listener Log File /home/oracle/oracle/product/10.2.0/db_1/network/log/listener_node01.log
    Listening Endpoints Summary...
    (DESCRIPTION=(ADDRESS=(PROTOCOL=tcp)(HOST=192.168.1.131)(PORT=1521)))
    (DESCRIPTION=(ADDRESS=(PROTOCOL=tcp)(HOST=127.0.0.1)(PORT=1521)))
    Services Summary...
    Service "+ASM" has 1 instance(s).
    Instance "+ASM1", status BLOCKED, has 1 handler(s) for this service...
    Service "+ASM_XPT" has 1 instance(s).
    Instance "+ASM1", status BLOCKED, has 1 handler(s) for this service...
    Service "PLSExtProc" has 1 instance(s).
    Instance "PLSExtProc", status UNKNOWN, has 1 handler(s) for this service...
    Service "hitesh" has 2 instance(s).
    Instance "hitesh1", status READY, has 2 handler(s) for this service...
    Instance "hitesh2", status READY, has 1 handler(s) for this service...
    Service "hiteshXDB" has 2 instance(s).
    Instance "hitesh1", status READY, has 1 handler(s) for this service...
    Instance "hitesh2", status READY, has 1 handler(s) for this service...
    Service "hitesh_XPT" has 2 instance(s).
    Instance "hitesh1", status READY, has 2 handler(s) for this service...
    Instance "hitesh2", status READY, has 1 handler(s) for this service...
    The command completed successfully
    [root@node01 oracle]# crsctl check crs
    CSS appears healthy
    CRS appears healthy
    EVM appears healthy
    [root@node01 oracle]# ps -ef | grep lmon
    oracle 5741 1 0 12:07 ? 00:00:03 ora_lmon_hitesh1
    root 22582 20805 0 13:01 pts/2 00:00:00 grep lmon
    oracle 23643 1 0 11:58 ? 00:00:01 asm_lmon_+ASM1
    Please let me know what information else is required
    Edited by: user12924280 on Apr 6, 2013 12:36 AM

    Since you didn't say "thank you", I assumed my time was of no value to you.
    However, I shall try again.
    There is no relationship between instance failure and VIP failover. How can there be? What if you are running ten instances on each node, and one fails? Would you want the VIP to relocate? And I've already told you how to test it: kill the node. Just reboot it.

  • Solaris x86 with Oracle RAC 10g Enterprise Edition Release 10.2.0.3.0

    Hello,
    Maybe you can help me (new on RMAN backup) in doing this.
    I have configured a single Oracle 10g database to have backup with RMAN with following steps:
    1. $ mkdir $ORACLE_BASE/rman_scripts
    2. $ mkdir $ORACLE_BASE/logs
    3. $ mkdir $ORACLE_BASE/tracking
    4. $ mkdir $ORACLE_BASE/c_backup
    5. $ sqlplus sys/<password> as sysdba
    6. SQL> alter system set db_recovery_file_dest_size = 50G scope=both;
    7. SQL> alter system set db_recovery_file_dest='${ ORACLE_BASE}/flash_recovery_ area' scope=both;
    8. SQL> alter system set log_archive_dest_10='location= use_db_recovery_file_dest';
    9. SQL> shutdown immediate
    10. SQL> startup nomount
    11. SQL> alter database archivelog;
    12. SQL> alter database open;
    13. SQL> alter database enable block change tracking using file '${ORACLE_BASE}/tracking/rman_ change_track.f';
    14. $ rman target /
    15. RMAN> CONFIGURE CONTROLFILE AUTOBACKUP FORMAT FOR DEVICE TYPE DISK
    TO '/var/opt/oracle/flash_ recovery_area/ORCL/c_backup/% F';
    16. RMAN> CONFIGURE CONTROLFILE AUTOBACKUP ON;
    17. RMAN> CONFIGURE BACKUP OPTIMIZATION ON;
    18. RMAN> CONFIGURE RETENTION POLICY TO RECOVERY WINDOW OF 7 DAYS;
    19. RMAN> exit
    I need to configure incremental backup with RMAN on a two node Solaris x86 with Oracle RAC 10g Enterprise Edition Release 10.2.0.3.0 installation.
    We also use ASM to store database files, and have Oracle software installed on separate file systems (two Oracle roots for Node1 and Node2).
    I have following questions:
    1) where to put Flash Recovery Area (FRA)?
    I saw recommendations to put FRA on the ASM, is this the best way to do it?
    2) Can I put FRA on another file system (not on the ASM) which is available only from Node1? This way I can save space on the ASM.
    3) Is it possible/recommended to run RMAN from Node1 only?
    Below is the script used to run RMAN on the normal Oracle database (without RAC) which I need to change :
    =============================================================================================
    2.0 Oracle backup script: /opt/app/oracle/rman_scripts/backup.sh
    Use this for daily backups, possiblly as a cron job.
    Once a week run this: /opt/app/oracle/rman_scripts/backup.sh FULL
    All other days of the week: /opt/app/oracle/rman_scripts/backup.sh INCREMENTAL
    Note: You may have to change ORACLE_SID, ORACLE_BASE below to match your database.
    =============================================================================================
    #!/usr/bin/ksh
    ORACLE_SID=orcl
    ORACLE_BASE=/opt/app/oracle
    ORACLE_HOME=${ORACLE_BASE}/product/10.2.0/db_1
    PATH=${ORACLE_HOME}/bin:/usr/bin
    LOGDIR=${ORACLE_BASE}/logs
    LOGFILE=${LOGDIR}/rman.log
    if [[ $# < 1 ]]
    then
    echo "usage: backup.sh FULL|INCREMENTAL"
    exit;
    fi
    BACKUPTYPE=${1}
    full='FULL'
    incremental='INCREMENTAL'
    if [[ $BACKUPTYPE == $full ]]
    then
    $ORACLE_HOME/bin/rman target / nocatalog log ${LOGFILE} append << eof
    run {
    backup database;
    SQL 'alter system archive log current';
    backup archivelog all;
    delete noprompt obsolete;
    exit;
    eof
    echo ''
    fi
    if [[ $BACKUPTYPE == $incremental ]]
    then
    $ORACLE_HOME/bin/rman target / nocatalog log ${LOGFILE} append << eof
    run {
    backup database;
    backup incremental level 1 database;
    SQL 'alter system archive log current';
    backup archivelog all;
    delete noprompt obsolete;
    exit;
    eof
    echo ''
    fi

    Hi [email protected],
    Q1) where to put Flash Recovery Area (FRA)?
    A1) With RAC: on the shared storage
    I saw recommendations to put FRA on the ASM, is this the best way to do it?
    If you want your backups to be available for both nodes you have to use shared storage or tape using an mml library.
    So if you want to use the FRA for rman backups and the database is on ASM just make ASM the standard for the FRA as well.
    Q2) Can I put FRA on another file system (not on the ASM) which is available only from Node1? This way I can save space on the ASM.
    A2) Than you cannot recover in case Node1 is down. Best would be to send your storage admin to a training course so he can manage the clustered raw devices needed for ASM.
    Q3) Is it possible/recommended to run RMAN from Node1 only?
    A3) No see A2.
    Regards,
    Tycho

  • Getting Error when running oracle form 10g

    Hi all, i have a problem when i run oracle form 10g.
    in the applet show like this :
    Loading http://abc:8889/forms/java/frmwebutil.jar from JAR cache
    RegisterWebUtil - Loading WebUtil Version 10.1.2.0
    Loading http://abc:8889/forms/java/frmall_jinit.jar from JAR cache
    Loading http://abc:8889/forms/java/jacob.jar from JAR cache
    Loading http://abc:8889/forms/java/printtext.jar from JAR cache
    proxyHost=null
    proxyPort=0
    connectMode=HTTP, native.
    Forms Applet version is : 10.1.2.0
    java.lang.ClassNotFoundException: java.io.IOException: open HTTP connection failed.
         at sun.applet.AppletClassLoader.getBytes(Unknown Source)
         at sun.applet.AppletClassLoader.access$100(Unknown Source)
         at sun.applet.AppletClassLoader$1.run(Unknown Source)
         at java.security.AccessController.doPrivileged(Native Method)
         at sun.applet.AppletClassLoader.findClass(Unknown Source)
         at sun.plugin.security.PluginClassLoader.findClass(Unknown Source)
         at java.lang.ClassLoader.loadClass(Unknown Source)
         at sun.applet.AppletClassLoader.loadClass(Unknown Source)
         at java.lang.ClassLoader.loadClass(Unknown Source)
         at java.lang.ClassLoader.loadClassInternal(Unknown Source)
         at java.lang.Class.forName0(Native Method)
         at java.lang.Class.forName(Unknown Source)
         at oracle.forms.handler.UICommon.instantiate(Unknown Source)
         at oracle.forms.handler.UICommon.onCreate(Unknown Source)
         at oracle.forms.handler.TextFieldItem.onCreate(Unknown Source)
         at oracle.forms.engine.Runform.onCreateHandler(Unknown Source)
         at oracle.forms.engine.Runform.processMessage(Unknown Source)
         at oracle.forms.engine.Runform.processSet(Unknown Source)
         at oracle.forms.engine.Runform.onMessageReal(Unknown Source)
         at oracle.forms.engine.Runform.onMessage(Unknown Source)
         at oracle.forms.engine.Runform.sendInitialMessage(Unknown Source)
         at oracle.forms.engine.Runform.startRunform(Unknown Source)
         at oracle.forms.engine.Main.createRunform(Unknown Source)
         at oracle.forms.engine.Main.start(Unknown Source)
         at sun.applet.AppletPanel.run(Unknown Source)
         at java.lang.Thread.run(Unknown Source)
    java.lang.ClassNotFoundException: java.io.IOException: open HTTP connection failed.
         at sun.applet.AppletClassLoader.getBytes(Unknown Source)
         at sun.applet.AppletClassLoader.access$100(Unknown Source)
         at sun.applet.AppletClassLoader$1.run(Unknown Source)
         at java.security.AccessController.doPrivileged(Native Method)
         at sun.applet.AppletClassLoader.findClass(Unknown Source)
         at sun.plugin.security.PluginClassLoader.findClass(Unknown Source)
         at java.lang.ClassLoader.loadClass(Unknown Source)
         at sun.applet.AppletClassLoader.loadClass(Unknown Source)
         at java.lang.ClassLoader.loadClass(Unknown Source)
         at java.lang.ClassLoader.loadClassInternal(Unknown Source)
         at java.lang.Class.forName0(Native Method)
         at java.lang.Class.forName(Unknown Source)
         at oracle.forms.handler.UICommon.instantiate(Unknown Source)
         at oracle.forms.handler.UICommon.onCreate(Unknown Source)
         at oracle.forms.handler.ButtonItem.onCreate(Unknown Source)
         at oracle.forms.engine.Runform.onCreateHandler(Unknown Source)
         at oracle.forms.engine.Runform.processMessage(Unknown Source)
         at oracle.forms.engine.Runform.processSet(Unknown Source)
         at oracle.forms.engine.Runform.onMessageReal(Unknown Source)
         at oracle.forms.engine.Runform.onMessage(Unknown Source)
         at oracle.forms.engine.Runform.sendInitialMessage(Unknown Source)
         at oracle.forms.engine.Runform.startRunform(Unknown Source)
         at oracle.forms.engine.Main.createRunform(Unknown Source)
         at oracle.forms.engine.Main.start(Unknown Source)
         at sun.applet.AppletPanel.run(Unknown Source)
         at java.lang.Thread.run(Unknown Source)
    Can anybody help me how to solve this problem ?
    Thanks,
    Iwan

    Loading http://abc:8889/forms/java/printtext.jar from JAR cache
    This tells me you are using a 3rd party or locally developed Java Bean to perform some type of print function. Is this correct?
    java.lang.ClassNotFoundException: java.io.IOException: open HTTP connection failed.Does your printtext.jar Java Bean need to open an HTTP connection in order to print?
    Have you been able to print in the past using this Java Bean? Where did you get the Java Bean?
    RegisterWebUtil - Loading WebUtil Version 10.1.2.0Your form appears to be using WebUtil. Has it been successfully configured?
    Honestly, you need to list the following minimum information when you post a question; it gives us all or most of the information we need to help you and it eliminates the need for us to ask for this information. Please always include:
    * Forms Version (eg; 10.1.2.0.0 not 10g)
    * Java Version
    * Client OS version
    * What you were doing when the error occured.
    Craig...

  • Oracle RAC 10g on Windows XP Professional

    Hi All,
    I read many articlaes that we can not install Oracle 10g RAC on Windows xp professional but the problem is I have a laptop where I am installing VMWARE with Unix O/S I can not upgrade my XP to Server edition as I do not have money o buy license.
    Please help me what all files I need to change to make my XP one of the nodes os RAC 10g.

    Thanks for replying.
    Can by downloading the kit,I will be able to install Oracle RAC?
    My question was:
    I have windows xp on my machine.I have vmware software also.I need to install Oracle RAC 10g on winxp and an guest opertaing system which will be linux.I want to test RAC by making 1 node on linux and one node on guest operating system winxp.
    Problem is RAC can only be installed on Server edition.Can it be possible to do it on WinXP?

  • Upgrade oracle rac 10g r2 10.2.0.3 to 10.2.0.4

    Hi all,
    I goint to upgrade oracle rac 10g r2 10.2.0.3 to 10.2.0.4 on Solaris 9, in the README file(patchset) does not say that upgrade the OCR, but int he Doc ID 316889.1 to say; it is necessary to upgrade or nothing happens if Iit does not upgrade?
    Mexman
    Edited by: ACS on 28/10/2009 12:19 PM

    Hi!
    I suppose if you have a Metalink note on which explains is necessary update OCR you must follow it. Software maker always are in reason!
    Chiao!

  • Compatibility with Oracle RAC 10g and E-business 11i ?

    Hi netpros,
    I am currently helping the sales guys with a tender. The customer requires the solution to be compatible for delivering Oracle RAC 10g and e-business 11i. we are proposing a combination of Cat6509E for the core with Infiniband server switches. Are these devices OK for use with Oracle. I have not much experience with Data centers and so any help is much appreciated.

    Hi,
    It just so happens Cisco have a paper on exactly this subject (Oracle and e-business 11i) here:
    http://www.cisco.com/application/pdf/en/us/guest/netsol/ns50/c649/ccmigration_09186a00807688ce.pdf
    The design is somewhat OTT as it includes everything which Cisco thinks may be even vaguely useful, including ACE and FWSM modules. However, it's very useful as a comparison document and does include some good design tips, and the references at the end are also worth following up.
    I wouldn't want to get into the whole Infiniband vs Fiber Channel argument (the doc uses MDS switches) but both work just fine in the DC environment.
    HTH
    Andrew.

  • Gracefully Shutting all the services pertaining to Oracle RAC 10g R2

    Hi !!
    Can anyone guide me in Gracefully Shutting Down All the services, processes pertaining to Oracle RAC 10g R2 - Clusterware, Oracle Software, Oracle RAC Database, Netservices, EMConsoles......
    Any Scripts / Metalink ID's / Comments would be very much helpful....
    Cheers n Thanks

    If its for both Linux and Windows .... Then it would be better ...

  • Regarding Hangcheck timer configuration in Oracle RAC 10g r2 installation

    Hi,
    Is it necessary to configure hangcheck timer in Oracle RAC 10g R2 installation .
    Can somebody guide when we should install the hangcheck timer in Linux oracle 10g R2.
    Best Regards
    Gupteswar Prasad Mishra
    Edited by: Gupteswar on Jan 25, 2010 8:42 PM

    yes, its recommended to configure hangcheck timer in RAC configuration
    Configure the Hangcheck Timer
    The hang-check timer is loaded into the Linux kernel and checks if the system hangs. It will set a timer and check the timer after a certain amount of time. There is a configurable threshold to hang-check that, if exceeded will reboot the machine. Although the hangcheck-timer module is not required for Oracle Clusterware (Cluster Manager) operation, it is highly recommended by Oracle.
    cat /etc/rc.local
    modprobe hangcheck-timer hangcheck_tick=1 hangcheck_margin=10 hangcheck_reboot=1

  • Installation Guide needed for Oracle RAC 10G R2 Linux x86-64

    Hello All,
    Can someone point me to the Oracle documentation on installing Oracle RAC 10G R2 (10.2.1.0) for Linux x86-64?
    Seem unable to find the required doc.
    I greatly appreciate your help!
    Thanks!

    Additional to documentation which you can access and search from http://tahiti.oracle.com there are several good step by step installation articles which summaries documentation.
    http://www.oracle.com/technology/pub/articles/tech_dba.html#linux
    And you can find more similar articles at
    http://www.puschitz.com/
    http://www.oracle-base.com/articles/linux/ArticlesLinux.php

  • Oracle RAC 10g on Sun clustor

    Dear Friends,
    Did any body can expain installing Oracle RAC 10g on Sun clustor.
    is there any checklist or step by step procedure availbile for it.
    if we are using Sun cluster, is it required to install oracle ClusterWare on it..
    what will be the architecture for it..
    Thanks

    Hi,
    Refer the Metalink Note _160120.1_ :Oracle Real Application Clusters on Sun Cluster v3
    Hope helps
    Regards,
    Xaheer

  • Installing Oracle RAC 10g

    Dears,,
    Please , it is the first time for me to install Oracle RAC 10g Release 2 on Linux x86
    It is mandatory to have two machines to install RAC and test it?
    Or can i install and test RAC on one machine? and How this?
    Please , provide to me installation guides for this practice and your advises
    Thanks & Best regards,,

    step by step installation of Rac on linux - single node
    user metalink note 241114.1

Maybe you are looking for

  • #REGION_STATIC_ID# does not work in report template for PPR

    I was hoping to use the new substitution string #REGION_STATIC_ID# for a PPR report, because when we do Export/Import of the app the Region ID changes and we have to manually change the Pager Header Javascript to get the PPR to work. A real pain. So

  • Message error when sending to multiple recipients/contacts

    Ever since 3.0 I can't send messages to multiple recipients. I'm on Optus in Australia using a 16gb 3G. Anyone else having this problem? Any fixes?

  • Oracle 8.0.5 ADT's passed as parameters SQLJ

    Hello, I have a data model in Oracle 8.0.5 that uses abstract data types (objects) and collections (nested tables). I would like to be able to pass parameters of these types into database stored packages from within SQLJ code. Is this possible with O

  • Select on VBRK

    Hi Xperts, very simple, following query takes long time.......pls suggest alternative. SELECT * INTO TABLE IT_VBRK FROM VBRK      WHERE  ( FKDAT >= FIRST_DATE AND FKDAT <= LAST_DATE )           and VBTYP = 'M' AND FKSTO <> 'X'.

  • Keyword replacement

    I would like some keyword replacement feauture. Where I should be able to specify what to be replaced with what. Lets say I give Bridge a txt file with the format like this player14 Niklas Andersson Then in the keywords and description as well if I e