3 node RAC -1 instnance getting down automatically in one node

Hi,
We have 3 node RAC system.
We are facing issue every week that one of the instance in one node among three node getting automatically restart.
During the time our transaction missing happened. Kindly advice why one node itself getting down and start automatically.
Thanks
Raj

Hi,
As you are facing node eviction issue, to find out reason please share following details:
1. clusterware alert log file
2. cssd.log file
3. crsd.log file
4. No. of voting disks (*sometimes if you have only one voting disk, one node will be evicted automatically as i have observed*)
Regards,
Ashish Shukla

Similar Messages

Odisrv services getting down automatically

odisrv services getting down automatically even though I have started services manually.
Please suggest

Please refer to the piece of log:
2012-01-06 04:11:03,543 INFO [main] CSS is initialized as client. The default logger properties will be loaded com.hyperion.css.CSSSystem.<init>(Unknown Source)
2012-01-06 04:11:03,543 INFO [main] CSS Log file will be generated at E:\Hyperion\logs\essbase\SharedServices_Security_Client.log com.hyperion.css.CSSSystem.<init>(Unknown Source)
2012-01-06 04:11:03,558 INFO [main] Configure CSS with registry com.hyperion.css.CSSSystem.initCSSSystem(Unknown Source)
2012-01-06 04:11:03,558 INFO [main] Initializing CSS from Registry. com.hyperion.css.common.configuration.CSSConfigurationManager.getConfiguration(Unknown Source)
2012-01-06 04:11:03,590 INFO [main] Trying to get Registry Instance com.hyperion.css.registry.RegistryManager.<init>(Unknown Source)
2012-01-06 04:11:05,777 INFO [main] Got Registry Instance com.hyperion.css.registry.RegistryManager.<init>(Unknown Source)
2012-01-06 04:11:06,324 INFO [main] Got hub location from Registry:http://US1SAWN00077.wmservice.corpnet1.com:28080 com.hyperion.css.registry.RegistryManager.getHubLocationFromRegistry(Unknown Source)
2012-01-06 04:11:06,527 INFO [main] Got native directory location from Registry:US1SAWN00077.wmservice.corpnet1.com:28089 com.hyperion.css.registry.RegistryManager.getNativeProviderLocationFromRegistry(Unknown Source)
2012-01-06 04:11:06,527 INFO [main] URL constructed out of values in Registry database:ldap://US1SAWN00077.wmservice.corpnet1.com:28089/dc=css,dc=hyperion,dc=com com.hyperion.css.common.configuration.CSSConfigurationImplXML.initConfiguration(Unknown Source)

In 2 node RAC. After shutting down database not able to connect.

I have 2 node Oracle 10g RAC (RAC-1 and RAC-2) on Windows 2003 Server.
After shutting down instance on RAC-2
I am not able to connect to database from any node.
I did this on RAC-2 :
SQL>shutdown immediate;
Database went down smoothly.
SQL>conn sys/oracle@rac as sysdba
ERROR:
ORA-12514: TNS:listener does not currnetly know of services requested in connect descriptor.
My first node is running fine but I am not able to connect to database from first node or from client.
Any suggestion???
Regards:
Sushil

One question I want to ask, what should be the Listener Services startup mode in RAC? MANUAL or AUTOMATIC???Ideally, if you are instances and other oracle resources are set to autostart then there is no reason for you to set the listener to MANUAL. You may like to change it to AUTOMATIC so that on reboot it comes up without manual intervention.

Oracle RAC 10g: ASM can't start in one node.

Hi all,
I succesfully installed RAC in Enterprise Linux. Node1 starts correctly (ASM and DB) but Node2 doesn´t. This is the error in Node2 when I try to startup de ASM instance:
SQL> startup
ASM instance started
Total System Global Area 92274688 bytes
Fixed Size 1217884 bytes
Variable Size 65890980 bytes
ASM Cache 25165824 bytes
ORA-15032: not all alterations performed
ORA-15130: diskgroup "DG1" is being dismounted
ORA-15066: offlining disk "VOL1" may result in a data loss
Any ideas?
Thanks!

Hi, you will must check the configuration of your shared storage, maybe the problem is there, you can verify the some log information in the clusterware layer, and you can find more information in the bdump directory of ASM Instance.
Please paste here the alert logfile of ASM Instance.
Luck.
Have a good day.

10gRAC VIP get down frequently on VM....

Hi All,
I have setup oracle10gR2 RAC (10.2.0.4.0) EE on VM. During the installation there is no issues , infact going very smoothly.
When I handover this envrionment to my QA/QA department there is always complaint about VIP. VIP frequently gets down on both the nodes. I have no option except reboot both the RAC VMs. CAn you please suggest me what could be the reason to get VIP frequently down on VM ? Is this known issue on VM?
Please suggest me.
Thanks...

Hi,
You need to have minimum 3 voting disk to determine the survival in case on node eviction. So add 2 more voting disk.
Always ODD number of Voting disks.
http://docs.oracle.com/cd/B19306_01/rac.102/b28759/adminoc.htm#TDPRC055
And ownership should be oracle:dba with 640 permission.
Anand

Admin Server getting down

I m new in weblogic, please help me,
I have two managed server both are clustered with running ssl port. when i m trying to stop any managed server, the admin server also getting down automatically, and I could't able to stop / start my managed server. Can any one please help me to troubleshoot. it is in weblogic 10.3.1.

Hi user736859,
Seems that your Core team donot listen to your comments.... Even after your instructions to them they didnot put any comment here.
Thanks
Jay SenSharma

How to apply Bundle Patch in Rolling Mode for 2 Node RAC

Hi Guys,
I have a 2 node RAC environment (11.2.0.3) where each node has there own local Grid_home and RDBMS_home.
I am installing a Rolling Bundle Patch with OPatch in this environment. The installation document says that "The order of patching in RAC install is GRID_HOME, then RDBMS_HOME" so i did the following.
1. stopped all oracle related services on node1
2. set oracle_home=<Grid_home>
3. applied the opatch
4. opatch succeeded on node1 and it says "The node 'NODE2' will be patched next... Is the node ready for patching? y
Here i am bit confused.
1. Should i shutdown the oracle services in Node2 and continue to patch the Grid_home ? If yes then the DB will be completely down for user access. This defeats the purpose of rolling mode which says there is no downtime.
2. Should i patch the RDBMS_home on node1 , start all the oracle services on node1 , stop the oracle services on node2 and then resume the opatch on node1 which is waiting to patch the Grid_home on node2 ?
Please advice.
Thanks,
Ashok Kumar.G

Hi Sebastian,
14613223 patch install instruction did not mention about opatch -local option.
Here is what i followed and completed the installation successfully.
1. Shutdown all oracle services on node 1
2. applied opatch for grid home and then rdbms home using "opatch apply -local" on node1
3. Started all oracle services on node 1
4. Shutdown all oracle services on node 2
5. applied opatch for gridhome and then rdbms home using "opatch apply -local" on node 2
6. Started all oracle services on node 2
7. executed post installation steps on the DB (@catwinbundle.sql & @utlrp.sql )
Thanks,
Ashok Kumar.G

Automatic restart of services on a 1 node rac cluster with Clusterware

How do we enable a service to automaticly start-up when the db starts up?
Thanks,
Dave

srvctl enable service -d DBThanks for your reply M. Nauman. I researched that command and found we do have it enabled and that it only works if the database instance was previously taken down. Since the database does not go down on an Archiver Hung error as we are using FRA with an alt location, this never kicks in and brings up the service. What we are looking for something that will trigger off of when the archive logs error and switch from FRA(Flash Recovery Area) to our Alternate disk location. Or more presicely, when it goes back to a Valid status(on the FRA - after we've run an archive log backup to clear it).
I found out from our 2 senior dba's that our other 2 node rac environment does not suffer from this problem, only the newly created 1 node rac cluster environment. The problem is we don't know what that is(a parameter on the db or cluster or what) and how do we set it?
Anyone know?
Thanks,
Gib
Message was edited by:
Gib2008
Message was edited by:
Gib2008

File system getting full and Server node getting down.

Hi Team,
Currently we are using IBM Power 6 AIX operating system.
And in our environment, for development system, file system is getting full and development system is getting slow while accessing.
Can you please let me know , what exactly the problem & which command is used to see the file system size and how to resolve the issue by deleting the core files or some ting. Please help me .
Thanks
Manoj K

Hi      Orkun Gedik,
When i executed the command df -lg and find . -name core noting is displayed, but if i execute the command df is showed me the below information. below is an original file which i have modified the sid.
Filesystem    512-blocks      Free %Used    Iused %Iused Mounted on
/dev/fslv10     52428800 16279744   69%   389631    15% /usr/sap/SID
Server 0 node is giving the problem. its getting down all the times.
And if i check it in the /usr/sap/SID/<Instance>/work for the server node "std_server0.out file , the below information is written in the file.
framework started for 73278 ms.
SAP J2EE Engine Version 7.00   PatchLevel 81863.450 is running! PatchLevel 81863.450 March 10, 2010 11:48 GMT
94.539: [GC 94.539: [ParNew: 239760K->74856K(261888K), 0.2705150 secs] 239760K->74856K(2009856K), 0.2708720 secs] [Times: user=0.00 sys=0.36, real=0.27 secs]
105.163: [GC 105.164: [ParNew: 249448K->80797K(261888K), 0.2317650 secs] 249448K->80797K(2009856K), 0.2320960 secs] [Times: user=0.00 sys=0.44, real=0.23 secs]
113.248: [GC 113.248: [ParNew: 255389K->87296K(261888K), 0.3284190 secs] 255389K->91531K(2009856K), 0.3287400 secs] [Times: user=0.00 sys=0.58, real=0.33 secs]
Please advise.
thanks in advance
Manoj K

How can I get firefox to shut down automatically when not in use for an hour

How can I get firefox to shut down automatically when not in use for an hour

Sorry, there is no feature for that built into Firefox, and I haven't seen an add-on to add that feature to Firefox.

Sys Time in Node 2 gets decreased automatically.

Hi,
We are using OEL 6.3,
Oracle Database Version : 11g Enterprise Edition Release 11.2.0.3.0 - 64bit Production.
2 Node RAC with ASM.
In the 2nd Node, the time gets decreased without changing it.
Approximately, 5 Minutes gets decreased in one week.
Is this related to Oracle or OS (No Time Difference in Node 1).
Now we are manually changing time time in node 2.
Output:
Node 1:
SQL> select systimestamp from dual;
SYSTIMESTAMP
27-JUN-13 02.05.29.575406 PM +05:30
Node 2 :
SYSTIMESTAMP
27-JUN-13 02.01.45.124407 PM +05:30

Cancel the portal assistant. You can re-run it latter. The issue here is that the Net8 supplied with Rel1 cannot connect to a 9i DB. Apply the Oracle 8i DB 8.1.7.4 patchset to the 9ias Rel1 home and then re-run the configuration assistant...
Have fun!
ben

On a sx40. When I turn on camera I get Lens Error Will shut down automatically. Restart camera

I need help. I bought a sx40 camera on ebay. After only a month of occassional use I now get a lens error message.
It states Lens Error, shutting down automatically Restart Camera. I have not dropped the camera or abused it in any way. But there is a really loud screeching sound as the lens tries to come out but can't. Anyone have any answers.

yes first see if you can get the extended warranty thru Square Trade if its not to late or what the return agreement with the seller was...do that first. If you used PayPal they also offer automatic purchase protection too. Lens problems are not cheap to repair. Second use some compressed air and see if you can gently blow out and thing that may have gotten inside the lens assembly. Blow the air from inside the battery compartment and any other open space...the key it to blow anything out. Also blow the air around the lens assembly. That sound you hear is not a good sign.

Database is getting shutting down automatically

Hi,
Since a month database is getting down at 19:00 hours daily automatically.
and in alert log it shows the followoing error:
Shutting down instance: further logons disabled
Shutting down instance (immediate)
License high water mark = 56
Mon Sep 22 19:00:42 2008
with diff high water mark....and processes are 700 and sessions are defined 750 in init.para file...could you please suggest why is it happening ?
Thanks

user644122 wrote:
Hi,
Since a month database is getting down at 19:00 hours daily automatically.
and in alert log it shows the followoing error:
Shutting down instance: further logons disabled
Shutting down instance (immediate)
License high water mark = 56
Mon Sep 22 19:00:42 2008
with diff high water mark....and processes are 700 and sessions are defined 750 in init.para file...could you please suggest why is it happening ?
ThanksCheck cron job and other scheduled jobs on your database server. The database is shutdown gracefully not by accident or crash. Maybe a old backup script?

Both instances of rac is getting start automatically

Earlier we use to start both the instances of RAC manually but from last one week
both instances of rac is getting start automatically when we starts the unix machine
DB Name - Kumaondb
instance1=Kumaondb1
instance2=Kumaondb2
I want to start them manually,
May someone help me ?
Thanx !
Deep

If you not using ASM with your database then simply change the Y to N in the /etc/oratab file.

Bex query is getting hanged, when trying to drill down only for one hierarchy node.

Hi All,
We have a bex query, in which we have multiple nodes. And we are able to expand almost all nodes except one hierarchy node called "BD1".
when we trying expand the BD1 node, the report is executing on and on and getting hanged up.
In RSRT the read mode is "H"
The report is based on a multiprovider and it has 7 cubes of which 6 of them have aggregates.
The characteristic for which we have issue is also having BWA.
So, I am not sure why the issue is with only 1 node in the entire report. Can someone let me know the possible reasons and solutions.

Hi Shilpa,
The only way to show long text is to maintain only long text for the info object. Otherwise system always defaults to short text.
Jaya.

3 node RAC -1 instnance getting down automatically in one node

Similar Messages

Maybe you are looking for