RAC crashed - errors in messages log

2 node RAC. running 1 node config.
OEL 5.
Oracle 11.2.0.2.0
RAC crashed this morning with following errors in ASM log
ORA-27300: OS system dependent operation:semget failed with status: 28
ORA-27301: OS failure message: No space left on device
ORA-27302: failure occurred at: sskgpsemsper
Found blog notes to up the semaphores in the kernel. http://arjudba.blogspot.ie/2008/09/database-startup-fails-with-ora-27302.html
bumped up to the following as per note but didnt fix
from: kernel.sem = 256 32000 100 128
to: kernel.sem = 256 32768 100 228
then tried 258 - didnt work
found another blog note that said to try 288 and that DID work so appears to be a semaphore issue. 2 questions:
1: How can this happen all of a sudden? no changes on box for last 5-6 weeks, nothing else running except RAC.
2. Error in /var/log/messages log file. RAC came down at 10:02, messges in the log file from 10:01, must be related. anyone know what they are? Looks like storage to me.
Jan 10 10:01:48 orcldub817 kernel: lpfc 0000:08:00.0: 0:(0):0713 SCSI layer issued Device Reset (0, 23) return x2002
Jan 10 10:02:17 orcldub817 kernel: INFO: task MpxPeriodicCall:28484 blocked for more than 120 seconds.
Jan 10 10:02:17 orcldub817 kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
Jan 10 10:02:17 orcldub817 kernel: MpxPeriodicCa D ffffffff80151248 0 28484 1 28485 28483 (L-TLB)
Jan 10 10:02:17 orcldub817 kernel: ffff810c0d8e78a0 0000000000000046 ffff810095560840 ffff810c2f7b14f8
Jan 10 10:02:17 orcldub817 kernel: ffff810c2f7b1000 000000000000000a ffff810c28a96100 ffff81062fd6a100
Jan 10 10:02:17 orcldub817 kernel: 00267af542a39442 0000000000008106 ffff810c28a962e8 000000072e01a0c8
Jan 10 10:02:17 orcldub817 kernel: Call Trace:
Jan 10 10:02:17 orcldub817 kernel: [<ffffffff80064167>] wait_for_completion+0x79/0xa2
Jan 10 10:02:17 orcldub817 kernel: [<ffffffff8008e16d>] default_wake_function+0x0/0xe
Jan 10 10:02:17 orcldub817 kernel: [<ffffffff801459cc>] blk_execute_rq_nowait+0x86/0x9a
Jan 10 10:02:17 orcldub817 kernel: [<ffffffff80145a78>] blk_execute_rq+0x98/0xc0
Jan 10 10:02:17 orcldub817 kernel: [<ffffffff8840b90d>] :emcp:emcp_scsi_cmd_ioctl+0x2ad/0x400
Jan 10 10:02:17 orcldub817 kernel: [<ffffffff88412cb5>] :emcp:PowerPlatformBottomDispatch+0x3d5/0x760
Jan 10 10:02:17 orcldub817 kernel: [<ffffffff884130d8>] :emcp:PowerSyncIoBottomDispatch+0x78/0xd0
Jan 10 10:02:17 orcldub817 kernel: [<ffffffff88413626>] :emcp:PowerDispatchX+0x356/0x410
Jan 10 10:02:17 orcldub817 kernel: [<ffffffff884147fd>] :emcp:EmsInquiry+0x9d/0x1a0
Jan 10 10:02:17 orcldub817 kernel: [<ffffffff8863245a>] :emcpmpx:ClariionKLam_getPathLunStatus+0x8a/0x110
Jan 10 10:02:17 orcldub817 kernel: [<ffffffff88622391>] :emcpmpx:MpxDefaultTestPath+0x21/0x80
Jan 10 10:02:17 orcldub817 kernel: [<ffffffff88631bf3>] :emcpmpx:MpxLnxTestPath+0x43/0x270
Jan 10 10:02:17 orcldub817 kernel: [<ffffffff800a1bad>] autoremove_wake_function+0x9/0x2e
Jan 10 10:02:17 orcldub817 kernel: [<ffffffff8008c597>] __wake_up_common+0x3e/0x68
Jan 10 10:02:17 orcldub817 kernel: [<ffffffff8002e511>] __wake_up+0x38/0x4f
Jan 10 10:02:17 orcldub817 kernel: [<ffffffff88407e9e>] :emcp:PowerPutSema+0x4e/0x60
Jan 10 10:02:17 orcldub817 kernel: [<ffffffff8006f1f5>] do_gettimeofday+0x40/0x90
Jan 10 10:02:17 orcldub817 kernel: [<ffffffff8862a054>] :emcpmpx:MpxTestPath+0x234/0x1fc0
Jan 10 10:02:17 orcldub817 kernel: [<ffffffff80063ff8>] thread_return+0x62/0xfe
Jan 10 10:02:17 orcldub817 kernel: [<ffffffff8862e8cb>] :emcpmpx:MpxPeriodicTestPath+0x9b/0x230
Jan 10 10:02:17 orcldub817 kernel: [<ffffffff8840e9c4>] :emcp:PowerTimeout+0x1a4/0x1e0
Jan 10 10:02:17 orcldub817 kernel: [<ffffffff8006f1f5>] do_gettimeofday+0x40/0x90
Jan 10 10:02:17 orcldub817 kernel: [<ffffffff8862ed5a>] :emcpmpx:MpxPeriodicCallout+0x2fa/0x410
Jan 10 10:02:17 orcldub817 kernel: [<ffffffff8862ea60>] :emcpmpx:MpxPeriodicCallout+0x0/0x410
Jan 10 10:02:17 orcldub817 kernel: [<ffffffff8841164d>] :emcp:PowerServiceDaemonQ+0xad/0xd0
Jan 10 10:02:17 orcldub817 kernel: [<ffffffff8005efb1>] child_rip+0xa/0x11
Jan 10 10:02:17 orcldub817 kernel: [<ffffffff88411670>] :emcp:PowerDaemonStart+0x0/0x20
Jan 10 10:02:17 orcldub817 kernel: [<ffffffff8005efa7>] child_rip+0x0/0x11
Jan 10 10:02:17 orcldub817 kernel:second node messages log has exact same...
Jan 10 10:01:48 orcldub818 kernel: lpfc 0000:08:00.0: 0:(0):0713 SCSI layer issued Device Reset (1, 23) return x2002
Jan 10 10:02:11 orcldub818 kernel: INFO: task MpxPeriodicCall:28298 blocked for more than 120 seconds.
Jan 10 10:02:11 orcldub818 kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
Jan 10 10:02:11 orcldub818 kernel: MpxPeriodicCa D ffffffff80151248 0 28298 1 28299 28297 (L-TLB)
Jan 10 10:02:11 orcldub818 kernel: ffff810626d7d8a0 0000000000000046 ffff8107adac6500 ffff810c2ff7e4f8
Jan 10 10:02:11 orcldub818 kernel: ffff810c2ff7e000 000000000000000a ffff81062a2ad7a0 ffff81062fcf80c0
Jan 10 10:02:11 orcldub818 kernel: 00267d060c8f888d 000000000002ac41 ffff81062a2ad988 0000000676dd2cd8
and same messages as per node 1 above.Edited by: 961469 on Jan 10, 2013 5:46 AM

Dude wrote:
Why do you think it's a problem with kernel semaphores?
There are 2 other issues that I suggest to look into first:
SCSI layer issued Device Reset (0, 23)
ORA-27301: OS failure message: No space left on device
To me this looks like a hardware problem with your EMC storage
Also please provide exact details about your OS version and system.See the errors in the ASM first of all. A few notes are thrown up when we look for those errors. Upping the semaphores resolved. My task now is to get to root cause.
versions: x86_64 2.6.18-194.el5
While increasing the semaphores resolved, I too think it looks like a problem with the storage as we get the same issue in the messages fil eon both nodes at same time.
couple of things looking at ipcs that dont make sense
[root@orcld818 proc]# ipcs -sa | wc -l
242
[root@orcl818 proc]# ipcs -sa
242 listed -
0x45116b13 7241949    root      666        1
0x45116ab3 7274718    root      666        1
0x45116a13 7307487    root      666        1
0x45116a73 7340256    root      666        1
0x45116a93 7373025    root      666        1
0x45119ca9 7405794    root      666        1
0x451187f7 7438563    root      666        1      All those returned are root owned, this doesnt make sense to me, I thought there should be only a few listed owned by oracle
If I try to identify any the processes associated with those, theres a PID listed, yet the pid doesnt exist when I try to query it e.g. the last one listed above...
[root@orcl818 proc]# ipcs -i 7438563 -s
Semaphore Array semid=7438563
uid=0    gid=0   cuid=0 cgid=0
mode=0666, access_perms=0666
nsems = 1
otime = Thu Jan 10 11:15:13 2013
ctime = Thu Jan 10 11:15:12 2013
semnum     value      ncount     zcount     pid
0          0          0          0          22922
[root@orcl818 proc]# ps -ef | grep 22922
root     19611 9740 0 14:54 pts/2    00:00:00 grep 22922
[root@orcl818 proc]#
[root@orcl818 proc]# ls /proc/22922
ls: /proc/22922: No such file or directory
[root@orcl818 proc]#

Similar Messages

Getting Error ATP message log while availability check for document

Dear Experts,
Would you kindly help me to rectify the below problem which i am getting while avaialblity check for the sales docuemnt in ECC.
Message : TM scheduling : Error while calling service: Internal.client-Receive_Failed
Error while receiving by HTTP( error code 400, error text)
ICM_HTTP_CONNECTION _FAILED
Best reagrds,
Guatam

Hi
Yes as Eltan says you need to consider there are two blocks of abap program:
- the first one is the driver program (but it seems there's no problem here because it called the smartform quickly)
- the second one is inside the smartform (It's possible to write abap routine in the smartform), and it seems the problem could be here
The variable c_form_name has the name of the smartform, you can manage it by transaction SMARTFORMS
but now it's not possible to say you why the print takes too long time, you need to do a trace
Max

After Effects CS5.5 error: crash in progress last logged message was 3300 DynamicLink 5

Randomly when I start after effects CS5.5 and premiere pro CS5.5 I get the following error:
After effects error: crash in progress last logged message was <3300> <DynamicLink> <5> 000000001AAB2080
I have all programs updated.
PC Specs:
i7 930 @ 2.8GHz
12GB RAM
Nvidia GTX 570
Windows 7 Proffesional 64bit
Thanks in advance guys!

What does "randomly" mean? What do you do, when the issue appears? Do you run games before? Use other programs? Also check the Event Viewer for the exact cause...
Mylenium

Please Help After Effects Error:Crash in progrss.Last logged message was: 8020 GPU manager Sniffer Result Code:3

Tell us about your computer hardware.
A:Here is my specs:
i-7 4770 motherboard
8 gb of Ram
What operating system?
A:Windows 7 64 bit OS
If you are getting error message(s), what is the full text of the error message(s)?
A:After Effects Error:Crash in progrss.Last logged message was:<8020><GPU manager>Sniffer Result Code:3
What were you doing when the problem occurred? What is the exact sequence of steps that you are taking?
A: Opened it and the error started

@Todd_Kopriva
thank you very much it works now

After Effects error: Crash in progress.Last logged message was: 7748 ae.blitpipe 2 Making New context

After Effects error: Crash in progress.Last logged message was:<7748> <ae.blitpipe><2>Making New context ....how can i Fix it??help me!!place

Try the forum for After Effects.

After effects error:crash in progress.Last logged message was: 4344 GPUManager 2 Sniffer Result Code:3 What is this?

after effects error:crash in progress.Last logged message was:<4344><GPUManager><2>Sniffer Result Code:3 What is this?

It's the same as always: Update your graphics driver.
Mylenium

When i load ae i get this after effects error crash in progress last logged message was

after effects error crash in progress last logged message was 420
dynamiclink 5 c/program files x86 common
files/adobe/dynamiclink/cs6/dynamiclinkmanager.exe
i am using a acer laptop 64bit running windows 8 any help would be great thankscrashing

Has After Effects worked before? If it's worked before, what changed between then and now? Have you installed something or updated something?
What is the exact version number of your After Effects? And before you say, "CS6", I mean the exact version number, such as 11.0.4
What are the specs of your machine?
And any other information you think might be useful to know.

After Effects error : Crash in progress.Last logged message was: 4444 GPUManger 2 Sniffer Result Code:3

Hi
I have one question.
I was Install after effect, but I saw the this message in my PC.
please let know solution.
After Effects error : Crash in progress.Last logged message was:
<4444><GPUManger><2>Sniffer Result Code:3
My system info
cpu :i7
graphic card : gtx 750 Ti
ram:16G

Standard answer: Update your graphics driver and configure it suitably.
Mylenium

Affter Effect error crash in progress last logged message was 4888 DynamicLink 5

Everytime I start affter effect I get the following error (affter effect error crash in progress last logged message was <4888> <DynamicLink> <5>)
I have tried uninstalling affter effect and did an online search but have found no answers.
Can anybody enlighten me or give some suggestions on how I might solve this problem.
Thank you in advance

I had the same problem for months.
I changed my whole pc, mouse, keyboard, monitor, including the OS, version of adobe pack, everything except one thing ...
-> A Genius 8x6 tablet
I never would have thought, until I disconnected and error magically disappeared.
Someone explain to me how this element can cause such a big mistake.
I think the error is caused in the Windows registry.
yo tuve el mismo problema durante meses.
cambié de pc entera, mouse, teclado, monitor, incluso el OS, la versión del pack adobe, todo menos una sola cosa...
una tableta 8x6 genius
nunca me lo hubiera imaginado, hasta que la desconecté y el error desapareció magicamente.
que alguien me explique como este elemento, puede provocar un error tan grande.
creo que el error se ocasiona en el registro de windows.

Receive an error in alert log after successful porpagated aq message

Hi experts,
I have a problem with the propagation feature of Oracle Advanced Queues!
First of all I use a 10gR1 RAC database.
After creating my queue and schedule I get the following error in alert log but the message will be successful propagated.
After 16 runs the job will be set broken. Ok this is clear but so works DBMS_JOB. But why I get this message below? Is it possible that grants are missing?
Errors in file /u01/app/oracle/admin/rdstest/bdump/rdsts1_j000_385024.trc:
ORA-12012: error on auto execute of job 5523173
ORA-06521: PL/SQL: Error mapping function
ORA-00604: error occurred at recursive SQL level 2
ORA-06521: PL/SQL: Error mapping function
ORA-06512: at "SYS.DBMS_AQADM_SYSCALLS", line 574
ORA-06512: at "SYS.DBMS_PRVTAQIP", line 2054
ORA-06512: at line 1
ORA-25254: time-out in LISTEN while waiting for a message
ORA-06512: at "SYS.DBMS_AQADM_SYSCALLS", line 574
ORA-06512: at "SYS.DBMS_PRVTAQIP", line 2054
ORA-06512: at line 1
ORA-06512: at "SYS.DBMS_AQADM_SYS", line 6662
ORA-06512: at "SYS.DBMS_AQADM_SYS", line 6913
ORA-06512: at "SYS.DBMS_AQADM", line 915
ORA-06512: at line 1
Thank you for helping and best regards!!

I found that Babylon had changed the proxy setting. Try going to Tools/Options/Advanced/Network/Settings and select "No proxy".
This has helped but things are still slow and I suspect that some other changes have been made to the Firefox settings.
Installing unauthorised software on your PC should be made illegal. I will avoid Babylon forever so they have done themselves no favours by trying to be smart!

No display of error message log in dialog box

Dear MM Experts,
During enter incoming invoice (MIRO), when we click simulate after entering all necessary data, all error & warning messages are displayed in a dialog box if there is red traffic light. In our case despite red traffic light error messages are not displayed as shown in below screen shot. Only warning messages are displayed & document canu2019t be posted. Please let me know if anyone has encountered such behavior & knows the solution. We just want to see the error messages in dialog boxes so that necessary data can be entered and document can be posted.
Additional information: 1. No GR needs to be done, 2. GR based IV is unchecked in PO, 3. No validation is active for the company code,
Thanks & regards,
Avinash

Hi,
Thanks for your response.
Our problem is not to post a particular invoice doument, the main problem is that error log is not displayed in MIRO. For example if balance is not zero then this error should be displayed in error log dialog box, which is not happening due to which we are not able to post any invoice document as error is not known to the user. Please let me know if any suggestions.
Additional information: We have deactivated all validations & BADis. We also tried to compare with other systems where error log is displayed properly however our ABAP consultant could not find any difference. Any Input on how to compare is also welcome.
Thanks & best regards,
Avinash

Error message: "Logging into the account failed because an error occurred."

Hello,
We had an XServe G5 2.0 DP 5GB/80/2x250 running Mac OS X 10.3.9 Server with all updates as a main server for a school. The server provides Open Directory Master as well as File-Sharing (AFP and SMB) and e-mail services to about 30 teachers and 300 students. The user home directories reside on the server. A web server also runs on the machine. The students use a pool of laptops, which are configured with a local guest and admin account as well as access to the server-based home directories with Directory Access. The server had the OS running on the 80 GB hard drive and all data (Home directories, mail database, website, etc. were on the two mirrored 250 GB drives.) All was working well until...
A few weeks ago, one of the two 250 GB died. We decided to use the opportunity to upgrade the server and set it up with 3 x 750 GB, two drives running as a mirrored pair to hold OS AND Data, the other as a stand-by unit to help replace a failing drive.
We migrated the OS and all data from the previous drives without a problem. Since now, all data is residing on one pair of drives, we put the data from the old "Data" drive in a folder on the root level of the new HD pair. We wrote a script that launches at startup which creates the symlink in /Volumes/Data to link to /Data. We thought that with this, all would be well.
However: When any user tries to log into his account from any iBook (10.3.9 or 10.4.11) (wirelessly), he gets the message:
"Logging into the account failed because an error occurred. The home folder for the user account is located on an afp or smb server. contact your system administrator for help"
If the user logs in to the guest account on the iBook, then accesses his home directory via file-sharing, he can see (read/write) all his data. So, the data and privileges seem to be OK, as well as Open Directory working correctly. Mail and the web work well also, as does logging in to a user account from one of the PC's (wired).
Can anyone make any suggestions as to how to fix the situation? Currently, the users are using the guest accounts and accessing their data via filesharing, as well as using webmail for their e-mail, but this is a major nuisance.
Any help will be greatly appreciated.
Best regards,
Alain Chammas
A user trying to access his account from a PC (wired) has no problems.

A good number of folks are having problems with this same error message at login, and nobody seems to have found a fix.
I believe I have stumbled upon, if not a solution, at least part of the answer. If you're logged into a 10.4 workstation, open a Finder window and click the "Network" icon. The first time you do this, you'll only see "Library" and "Servers" icons, but if you let it sit for a moment, other folders will magically appear. One of these is "My Network" which is the critical part.
In Workgroup Manager, edit one of your users' home directory configuration. There's a URL piece, usually "afp://server.domain.com/Users" (which is what shows up in the window when you click on the "Home" tab for that user), and then there's a "Home" path that is usually something like "/Network/Servers/servername/Users/username". Trouble is, you've noticed that 10.4 doesn't put servers into the "Servers" path, but rather into the "My Network" path.
So, if you change that "Home" path to read "/Network/My Network/servername/Users/username", it should work--with one caveat. Apparently 10.4 doesn't create the "My Network" path on a given client until you actually browse the network on that client. If you haven't logged into a 10.4 workstation and browsed the network, the "My Network" path won't be there, and you'll still get the error. Login as a local user, browse the network (so that the "My Network" folder shows up), logout, and then login as an Open Directory user, and it should work.
I'm betting that 10.3, 10.4, and 10.5 all handle this issue differently, so if you're in a mixed-version situation, you may have to experiment to find a workable fix.
Derndest thing I ever saw.

I keep get an "Error (-50)" message when I log into iTunes on my MAC

I didn't have this as a problem before, but all of a sudden I cannot log into my iTunes account on my MAC. When I try to go into Store and then Sign in, I get an "Error (-50)" message. I have tried going in and changing the parental controls (something I saw elsewhere), but that didn't work.
I updated both my Mac OS and itunes, but that didn't change anything. I have restarted my computer and even done a hard reset by turning it off. When I opened iTunes again, before I even did anything, it gave me and "Error (-49)" message.
Also, I have some program called Safe-Eyes on my computer as a parental control, and went in and added all the different websites associated with iTunes (per another help page), but that hasn't worked either.
Because of this, I cannot get any of my songs from iTunes Match, except those that had already been downloaded onto the computer (1/16 of my music library). Sure I can access them on my iPhone, but now I can't transfer that music onto my Nano.
One additional note: I saw on the communities the recommendation to delete your iTunes Download file, but I don't appear to have one in my iTunes Media folder.
Thanks!

Launch the Console application in any of the following ways:
☞ Enter the first few letters of its name into a Spotlight search. Select it in the results (it should be at the top.)
☞ In the Finder, select Go ▹ Utilities from the menu bar, or press the key combination shift-command-U. The application is in the folder that opens.
☞ Open LaunchPad. Click Utilities, then Console in the icon grid.
The title of the Console window should be All Messages. If it isn't, select
SYSTEM LOG QUERIES ▹ All Messages
from the log list on the left. If you don't see that list, select
View ▹ Show Log List
from the menu bar at the top of the screen.
Click the Clear Display icon in the toolbar. Then try the action that you're having trouble with again. Select any messages that appear in the Console window. Copy them to the Clipboard by pressing the key combination command-C. Paste into a reply to this message by pressing command-V.
☞ The log contains a vast amount of information, almost all of which is irrelevant to solving any particular problem. When posting a log extract, be selective. A few dozen lines are almost always more than enough.
Please don't indiscriminately dump thousands of lines from the log into this discussion.
Please don't post screenshots of log messages—post the text.
☞ Some private information, such as your name, may appear in the log. Anonymize before posting.

FaceTime and Messages log in error on Mac

FaceTime and Messages log in error on my iMac and Mac Mini. (OS X 10.8.2)
Getting a 'registration cannot be completed at this time message', but both worked fine before (when the iMac was in my office).
Both FaceTime and iMessage work on the iPad.
Running the home network through a near-new, still functioning Time Capsule.
Have logged out, tried logging in with a new Apple ID, and get the same result.
Help, please.

Sorry, I'm at a loss...
Try Apple's Express Lane...
https://expresslane.apple.com/

Found the errors in CSSD logs of RAC node

Found the below error in CSSD logs in One of RAC nodes from 5:15 to 5:18 PM, after this the error got disappeared. Could anyone please have an idea what could be the reason of this error.
Also, at that time we didn't find any errors in the alert log.
[    CSSD]2009-07-19 17:15:51.048 [3600] >TRACE: Authorization failed (112bd2a70), timed out, start 17:13:51.041, duration 120009
[    CSSD]2009-07-19 17:15:51.048 [3600] >TRACE: Authorization prepare time: 2 ms
[    CSSD]2009-07-19 17:15:51.233 [3086] >TRACE: clssgmClientConnectMsg: Connect from con(112b67930) proc(112b680b0) pid(1049540) proto(10:2:1:1)
[    CSSD]2009-07-19 17:15:51.268 [3600] >TRACE: Authorization failed (112bd4a10), timed out, start 17:13:51.268, duration 120003
[    CSSD]2009-07-19 17:15:51.268 [3600] >TRACE: Authorization prepare time: 3 ms
[    CSSD]2009-07-19 17:15:52.544 [3086] >TRACE: clssgmClientConnectMsg: Connect from con(112b67930) proc(112b680b0) pid(786918) proto(10:2:1:1)
[    CSSD]2009-07-19 17:15:53.297 [3600] >TRACE: Authorization failed (112c38af0), timed out, start 17:13:53.290, duration 120009
[    CSSD]2009-07-19 17:15:53.297 [3600] >TRACE: Authorization prepare time: 3 ms
[    CSSD]2009-07-19 17:15:53.317 [3600] >TRACE: Authorization failed (112d356f0), timed out, start 17:13:53.320, duration 120000
[    CSSD]2009-07-19 17:15:53.317 [3600] >TRACE: Authorization prepare time: 2 ms
[    CSSD]2009-07-19 17:16:02.342 [3086] >TRACE: clssgmClientConnectMsg: Connect from con(112b932b0) proc(112b67d10) pid(1336252) proto(10:2:1:1)
[    CSSD]2009-07-19 17:16:02.977 [3600] >TRACE: Authorization failed (112d04f70), timed out, start 17:14:02.978, duration 120001
[    CSSD]2009-07-19 17:16:02.977 [3600] >TRACE: Authorization prepare time: 2 ms
[    CSSD]2009-07-19 17:16:03.007 [3600] >TRACE: Authorization failed (112d38210), timed out, start 17:14:03.006, duration 120002
[    CSSD]2009-07-19 17:16:03.007 [3600] >TRACE: Authorization prepare time: 2 ms
[    CSSD]2009-07-19 17:16:10.447 [3600] >TRACE: Authorization failed (112bd7e30), timed out, start 17:14:10.441, duration 120007
[    CSSD]2009-07-19 17:16:10.447 [3600] >TRACE: Authorization prepare time: 2 ms
[    CSSD]2009-07-19 17:16:10.847 [3600] >TRACE: Authorization failed (112d3ee70), timed out, start 17:14:10.840, duration 120008
[    CSSD]2009-07-19 17:16:10.847 [3600] >TRACE: Authorization prepare time: 2 ms
Thanks,
Mahi

Check the metalink note:
6996694-OCSSD.BIN CONSUMING 100% CPU AND ASM/DB HANGING

RAC crashed - errors in messages log

Similar Messages

Maybe you are looking for