AWR report problem after cluster node switch.

Question

Hello all. I have some strange problem, can any one advice what to do....
I have OracleDB (Oracle Database 10g Enterprise Edition Release 10.2.0.3.0 on Solaris x86_64), we have two server nodes and one shared storage attached to them, db is running on node1 and if it dies db will be switched to node2, classic cluster.
Some time ago we tested this switching, so i shut downed db and switch it to node2, and startup it there (oracle_homes are identical), every thing was ok, soo i switched it back to node1. But now i can't run awrrpt.sql or awrinfo.sql, it gives error like this:
Using the report name awrinfo.txt
No errors.
create or replace package body AWRINFO_UTIL as
ERROR at line 1:
ORA-03113: end-of-file on communication channel
No errors.
ERROR:
ORA-03114: not connected to ORACLE
And in alert log:
ORA-07445: exception encountered: core dump [SIGSEGV] [Address not mapped to object] [509] [] [] []
I tried to drop AWR with catnoawr.sql and recreate it with catawrtb.sql, everything seems to be fine, but still can't run awrrpt.sql or awrinfo.sql, same error.
Any one familiar with such problem ?
Thanks for advice.

Answer 1

I understand that I provided less than satisfactory amount of info.
So here is more.
I am installing the two node cluster and during scinstall one of the nodes is being rebooted
and goes through (what I am suppose to be) an initial configuration. At the very end of the
boot process there is a message
obtaining access to all attached disksAt this point the boot disk activity LED is lit constantly. After some longish timeout
the following message is printed to console
NOTICE: /pci@0,0/pci1014,2dd@1f,2: port 0: device reset
WARNING: /pci@0,0/pci1014,2dd@1f,2/disk@0,0 (sd1):
     Error for Command: read(10)          Error Level: Retryable
     Requested Block: 135323318          Error Block: 135323318
     Vendor: ATA                    Serial Number:
     Sense Key: No Additional Sense
     ASC: 0x0 (no additional sense info), ASCQ: 0x0, FRU: 0x0and the disk activity LED is turned off. After that nothing more happens. The system isn't
hard hang, since the keyboard is working, and it responds to ping, but other than that
nothing seems to be functioning.
I understand that diagnosing such a problem isn't easy, but I am willing to invest some
time into getting it working. I would rally appreciate some help with this issue.
Regards,
Cyril