SC 3.2 Solaris 10 x86. When one node reboot, the other one does also
Configured a two node cluster with a EMC clariion san (Raid 6) for holding a zpool and use as quorum device.
When one node goes down, the other one does also.
There seems a problem with the quorum.
I can not understand or figure out what actually goes wrong.
When starting up:
Booting as part of a cluster
NOTICE: CMM: Node cnode01 (nodeid = 1) with votecount = 1 added.
NOTICE: CMM: Node cnode02 (nodeid = 2) with votecount = 1 added.
NOTICE: CMM: Quorum device 1 (/dev/did/rdsk/d1s2) added; votecount = 1, bitmask of nodes with configured paths = 0x3.
NOTICE: clcomm: Adapter nge3 constructed
NOTICE: clcomm: Adapter nge2 constructed
NOTICE: CMM: Node cnode01: attempting to join cluster.
NOTICE: nge3: link down
NOTICE: nge2: link down
NOTICE: nge3: link up 1000Mbps Full-Duplex
NOTICE: nge2: link up 1000Mbps Full-Duplex
NOTICE: nge3: link down
NOTICE: nge2: link down
NOTICE: nge3: link up 1000Mbps Full-Duplex
NOTICE: nge2: link up 1000Mbps Full-Duplex
NOTICE: CMM: Node cnode02 (nodeid: 2, incarnation #: 1248284052) has become reachable.
NOTICE: clcomm: Path cnode01:nge2 - cnode02:nge2 online
NOTICE: clcomm: Path cnode01:nge3 - cnode02:nge3 online
NOTICE: CMM: Cluster has reached quorum.
NOTICE: CMM: Node cnode01 (nodeid = 1) is up; new incarnation number = 1248284001.
NOTICE: CMM: Node cnode02 (nodeid = 2) is up; new incarnation number = 1248284052.
NOTICE: CMM: Cluster members: cnode01 cnode02.
NOTICE: CMM: node econfiguration #1 completed.
NOTICE: CMM: Node cnode01: joined cluster.
ip: joining multicasts failed (18) on clprivnet0 - will use link layer broadcasts for multicast
/dev/rdsk/c2t0d0s5 is clean
Reading ZFS config: done.
obtaining access to all attached disks
cnode01 console login:
Then this on the second node:
Booting as part of a cluster
NOTICE: CMM: Node cnode01 (nodeid = 1) with votecount = 1
NOTICE: CMM: Node cnode02 (nodeid = 2) with votecount = 1
NOTICE: CMM: Quorum device 1 (/dev/did/rdsk/d1s2) added; votecount = 1, bitmask of nodes with configured paths = 0x3.
NOTICE: clcomm: Adapter nge3 constructed
NOTICE: clcomm: Adapter nge2 constructed
NOTICE: CMM: Node cnode02: attempting to join cluster.
NOTICE: CMM: Node cnode01 (nodeid: 1, incarnation #: 1248284001) has become reachable.
NOTICE: clcomm: Path cnode02:nge2 - cnode01:nge2 online
NOTICE: clcomm: Path cnode02:nge3 - cnode01:nge3 online
WARNING: CMM: Issuing a NULL Preempt failed on quorum device /dev/did/rdsk/d1s2 with error 2.
NOTICE: CMM: Cluster has reached quorum.ion ratio 4.77, dump succeeded
NOTICE: CMM: Node cnode01 (nodeid = 1) is up; new incarnation number = 1248284001.
NOTICE: CMM: Node cnode02 (nodeid = 2) is up; new incarnation number = 1248284052.
NOTICE: CMM: Cluster members: cnode01 cnode02.
NOTICE: CMM: node reconfiguration #1 completed.
NOTICE: CMM: Node cnode02: joined cluster.
NOTICE: CCR: Waiting for repository synchronization to finish.
*{color:#ff0000}WARNING: CMM: Issuing a NULL Preempt failed on quorum device /dev/did/rdsk/d1s2 with error 2.{color}*
ip: joining multicasts failed (18) on clprivnet0 - will use link layer broadcasts for multicast
/dev/rdsk/c2t0d0s5 is clean
Reading ZFS config: done.
obtaining access to all attached disks
cnode02 console login:
But when the first node reboot, on the second node this message:
Jul 22 19:24:48 cnode02 genunix: [ID 936769 kern.info] devinfo0 is /pseudo/devinfo@0
Jul 22 19:30:57 cnode02 nge: [ID 812601 kern.notice] NOTICE: nge3: link down
Jul 22 19:30:57 cnode02 nge: [ID 812601 kern.notice] NOTICE: nge2: link down
Jul 22 19:30:59 cnode02 nge: [ID 812601 kern.notice] NOTICE: nge3: link up 1000Mbps Full-Duplex
Jul 22 19:31:00 cnode02 nge: [ID 812601 kern.notice] NOTICE: nge2: link up 1000Mbps Full-Duplex
Jul 22 19:31:06 cnode02 genunix: [ID 489438 kern.notice] NOTICE: clcomm: Path cnode02:nge2 - cnode01:nge2 being drained
{color:#ff0000}Jul 22 19:31:06 cnode02 scsi_vhci: [ID 734749 kern.warning] WARNING: vhci_scsi_reset 0x0{color}
Jul 22 19:31:06 cnode02 genunix: [ID 489438 kern.notice] NOTICE: clcomm: Path cnode02:nge3 - cnode01:nge3 being drained
Jul 22 19:31:11 cnode02 nge: [ID 812601 kern.notice] NOTICE: nge3: link down
{color:#ff0000}Jul 22 19:31:12 cnode02 genunix: [ID 414208 kern.warning] WARNING: QUORUM_GENERIC: quorum preempt error in CMM: Error 5 --- QUORUM_GENERIC Tkown ioctl failed on quorum device /dev/did/rdsk/d1s2.{color}
{color:#ff0000}Jul 22 19:31:12 cnode02 cl_dlpitrans: [ID 624622 kern.notice] Notifying cluster that this node is panicking
Jul 22 19:31:12 cnode02 unix: [ID 836849 kern.notice]
Jul 22 19:31:12 cnode02 ^Mpanic[cpu3]/thread=ffffffff8b5c06e0:
Jul 22 19:31:12 cnode02 genunix: [ID 265925 kern.notice] CMM: Cluster lost operational quorum; aborting.{color}
Jul 22 19:31:12 cnode02 unix: [ID 100000 kern.notice]
Jul 22 19:31:12 cnode02 genunix: [ID 655072 kern.notice] fffffe8002651b40 genunix:vcmn_err+13 ()
Jul 22 19:31:12 cnode02 genunix: [ID 655072 kern.notice] fffffe8002651b50 cl_runtime:__1cZsc_syslog_msg_log_no_args6FpviipkcpnR__va_list_element__nZsc_syslog_msg_status_enum__+24 ()
Jul 22 19:31:12 cnode02 genunix: [ID 655072 kern.notice] fffffe8002651c30 cl_runtime:__1cCosNsc_syslog_msgDlog6MiipkcE_nZsc_syslog_msg_status_enum__+9d ()
Jul 22 19:31:12 cnode02 genunix: [ID 655072 kern.notice] fffffe8002651e20 cl_haci:__1cOautomaton_implbAstate_machine_qcheck_state6M_nVcmm_automaton_event_t__+3bc ()
Jul 22 19:31:12 cnode02 genunix: [ID 655072 kern.notice] fffffe8002651e60 cl_haci:__1cIcmm_implStransitions_thread6M_v_+de ()
Jul 22 19:31:12 cnode02 genunix: [ID 655072 kern.notice] fffffe8002651e70 cl_haci:__1cIcmm_implYtransitions_thread_start6Fpv_v_+b ()
Jul 22 19:31:12 cnode02 genunix: [ID 655072 kern.notice] fffffe8002651ed0 cl_orb:cllwpwrapper+106 ()
Jul 22 19:31:13 cnode02 genunix: [ID 655072 kern.notice] fffffe8002651ee0 unix:thread_start+8 ()
Jul 22 19:31:13 cnode02 unix: [ID 100000 kern.notice]
Jul 22 19:31:13 cnode02 genunix: [ID 672855 kern.notice] syncing file systems...
Jul 22 19:31:13 cnode02 genunix: [ID 733762 kern.notice] 1
Jul 22 19:31:34 cnode02 last message repeated 20 times
Jul 22 19:31:35 cnode02 genunix: [ID 622722 kern.notice] done (not all i/o completed)
Jul 22 19:31:36 cnode02 genunix: [ID 111219 kern.notice] dumping to /dev/dsk/c2t0d0s1, offset 3436511232, content: kernel
Jul 22 19:31:45 cnode02 genunix: [ID 409368 kern.notice] ^M100% done: 136950 pages dumped, compression ratio 4.77,
Jul 22 19:31:45 cnode02 genunix: [ID 851671 kern.notice] dump succeeded
Jul 22 19:33:18 cnode02 genunix: [ID 540533 kern.notice] ^M
Hi,
the problem lies in the error message around the quorum device. The SC documentation, specifically the Sun Cluster Error Messages Guide at http://docs.sun.com/app/docs/doc/820-4681 explains this as follows:
414208 QUORUM_GENERIC: quorum preempt error in CMM: Error %d --- QUORUM_GENERIC Tkown ioctl failed on quorum device %s.
Description:
This node encountered an error when issuing a QUORUM_GENERIC Take Ownership operation on a quorum device. This error indicates that the node was unsuccessful in preempting keys from the quorum device, and the partition to which it belongs was preempted. If a cluster is divided into two or more disjoint subclusters, one of these must survive as the operational cluster. The surviving cluster forces the other subclusters to abort by gathering enough votes to grant it majority quorum. This action is called "preemption of the losing subclusters".
Solution:
Other related messages identify the quorum device where the error occurred. If an EACCES error occurs, the QUORUM_GENERIC command might have failed because of the SCSI3 keys on the quorum device. Scrub the SCSI3 keys off the quorum device and reboot the preempted nodes."
You should try to follow this advice. I would propose to chose a different QD before trying to do this, if you have one available. Is it possible that this LUN has been in use by a different cluster?
To scrub SCSI3 keys you should use the scsi command in /usr/cluster/lib/sc: ./scsi -c inkeys -d <device> to check for the existence of keys, and ...-c scrub.. to remove any SCSI3 keys.
Regards
Hartmut
Similar Messages
-
Asking the Bridge Team: Bridge "working color space" setting when one does not have the Suite?
Common sense tells me there is really no such thing as a
"working color space" in Bridge, because
Bridge is not an image editor, just a browser
Therefore, this may turn out to be a purely academic question; but that doesn't keep my curiosity from forcing me to ask it anyway. ;)
Is there a way to set the Bridge
"color settings" when one does not have the suite?
The only Adobe program I keep up to date is Photoshop, so I've never had the suite. My version of Photoshop is 11 (CS4) and I run updated
(not upgraded) versions of Adobe Acrobat 7.x, Illustrator 10.x and InDesign 2.x. Consequently, the Synchronize color settings command is not available to me.
It seems to me that Bridge is behaving like a proper color-managed browser (e.g. Firefox with color management enabled), in that it displays tagged image files correctly and assumes sRGB for untagged image files. This normally works fine.
But what if I wanted Bridge to assume my
Photoshop color working space for untagged images
so that it behaves the same as Photoshop? I'm just curious, as I deal with a minuscule, practically negligible amount of untagged files.
My reason for bringing it up now is that I don't recall this being explicitly mentioned in forum replies when users inquire about color settings in Bridge. A recent post regarding Version Cue in the Photoshop Macintosh forum got me thinking about this. Just wanting to make sure that I'm right in my assumption that
there is really no such thing as a
"working color space" in Bridge, because Bridge is not an image editor, just a browser.
Thanks in advance.Hi Ramón,
Thanks for sharing the outcome of your tests. However, I may have found a bug/exception to Bridge's colour management policy!
It appears that CMYK EPS photoshop files are not colour managed in Adobe Bridge, even if they contain an embedded ICC profile.
I've tried every combination in the EPS 'Save As' dialogue box, so it doesn't seem to be an issue with file encoding. Also, Bridge doesn't rely on the low-res preview that is held within the EPS itself.
My guess is that Bridge is previewing the CMYK EPS with a Bridge-generated RGB image, but it's being displayed as monitor RGB (assigned) rather than colour managed (converted to monitor RGB). For most users the difference will be barely perceptible, but the problem became very noticeable when using Bridge to preview Newsprint CMYK images on a wide-gamut monitor (images that should have appeared muted really leapt off the screen!).
How do I report this to the Colour Police at Adobe?!? -
iPhone 5. Prior to the iPhone 5, I could listen to podcasts one after the other without doing anything. Now it will only play one podcast at a time, then I have to click on the next one. Not a great feature when driving. TIA, Sarah
How do I get it to just play through all the podcasts that I've downloaded just like my 1st gen?
Group and order your podcasts to a playlist. Then play them from the playlist. -
I've a new account on iMac. When composing an email the contact list does not show up on the bar, which would allow me to select the persons I want to include on the distribution of the email. When I start keying in a name in the email, it comes up with the person's address, which shows it is synced. How do I engage the contact list from the email like I do on my old account (where a contact list icon shows up, along with the "attach" and other icons) ?
With the New Message window open, go to the View menu and select "Customize Toolbar...".
In the screen that opens, drag the item labelled "Address" into the Toolbar area of the New Message window, then click the "Done" button.
That item should be then added to the Toolbar for the New Message window.
Note that the main Mail window and the New Message window (as well as the separate message window if you open a message that way) use different toolbars - the settings/inclusions for one do not carry over to another. -
Hello, I just activated another iphone4 on my account and it is now linked to my other iphone. If I delete a contact on one it deletes it on the other. Does anyone know how to fix?
One of the phones can keep the current account; on the one that will be moving go to Settings>iCloud and turn all data that is syncing with iCloud (contacts, calendars, etc.) to Off. When prompted choose to keep the data on the iPhone. After everything is turned off, scroll to the bottom and tap Delete Account. (This will only delete the account from this phone, not from iCloud. The other phone will not be effected by this.) Next, set up a new iCloud account on this phone using a different Apple ID and turn iCloud data syncing for contacts, etc. back to On. When prompted, choose Merge. This will upload the data to this new account. At this point you will have two different iCloud accounts, one for each phone, with identical data on them.
You will then have to go to icloud.com on your computer and sign into each iCloud account separately and manually delete the unwanted data (such as deleting the original phone's contacts from the new phone's account, and vice versa). These changes will be reflected on each phone. -
how do I share movies/music between my computers. I have opened shared on both computers and both are on, but i am not able to drag anything from one to the other. Does anyone know where the settings button is on the bottom of the itunes screen?
Oops, I forgot a step between 7 and 8 ... before syncing the iPhone I need to explicitly send the document back to iTunes on the iPhone, or the changes won't come over at all ...
and then one more thing ... Numbers on iOS does NOT recognize a number of key features of the OSX app, such as conditional formatting ... so after editing my document on iOS and syncing it back to OSX on my Mac, all of those settings are lost (no more conditional formatting, have to do it all over again)
What am I doing wrong ? -
Just purchased a office jet 6500A Plus so that I can print from my iPhone and iPad. I can print form my iPhone but my iPad 2 tells me there is no air printer available. Why does one device recognize the air printer but the other device does not?
I have the 6500A without plus and it is with a LAN cable connected with my Router.
First make sure you have the latest printer firmware installed.
Next restart the printer and the Router.
I had the same. Problem but it went away after rebooting the Router. -
When i call someone, the other person hears echo of his own voice.This happens all the time in all locations.
I am using STC network in Saudi arabia.(KSA) but i have also tried this using other networks in KSA and also with networks in INDIA.
Any help would be highly appreciated. ??When i call someone, the other person hears echo of his own voice.This happens all the time in all locations.
I am using STC network in Saudi arabia.(KSA) but i have also tried this using other networks in KSA and also with networks in INDIA.
Any help would be highly appreciated. ?? -
i have 2 laptops both with iTunes installed but on one my source list includes 'Movies' and the other 'films' does anyone know why this would be?
sorry all - disregard I've identified the issue in the language settings with one set to 'English - United States' and one to 'English - United Kingdom' - now fixed.
Cheers -
Why when i buy books on my ipad, when i log onto the store it does not show that i have purchased them?
how many books and songs were therefore lost when i had to wipe my ipad?
this is SHOCKING from Apple... this is not in my domain of settings!!!In the iBooks application on the Mac, there is a checkbox to sync highlights and notes across devices.
I don't see a similar setting in the iBooks app on my iPad. It may require iBooks on the Mac as a mediator.
Also:
Can I highlight text and make notes?
Yes, iBooks includes built-in Highlight and Note features. Highlight any word or passage of text within a book. You can also create a Note from your highlighted selection. Review your Highlights and Notes by tapping the Table of Contents button and then tapping Bookmarks. Highlights and Notes appear in their own section under Bookmarks. -
on the drop down menu for firefox(in my bookmarks) I used to be able to customize firefox to change my themes. Now when I click on it, it only loads words, no pictures or thumb tabs to hover over or anything. When I click on the words, it does nothing. I have uninstalled and reinstalled Java. What is going on? What else can I do to fix this. And I have Windows Vista, just in case you need to know. Thanks Sharon
Clear the cache and cookies only from websites that cause problems.
"Clear the Cache":
*Firefox/Tools > Options > Advanced > Network > Cached Web Content: "Clear Now"
"Remove Cookies" from sites causing problems:
*Firefox/Tools > Options > Privacy > "Use custom settings for history" > Cookies: "Show Cookies"
You can remove all data stored in Firefox from a specific domain (addons.mozilla.org) via "Forget About This Site" in the right-click context menu of an history entry ("History > Show All History" or "View > Sidebar > History") or via the about:permissions page.
Using "Forget About This Site" will remove all data stored in Firefox from that domain like bookmarks, cookies, passwords, cache, history, and exceptions, so be cautious and if you have a password or other data from that domain that you do not want to lose then make sure to backup this data or make a note.
You can't recover from this 'forget' unless you have a backup of the involved files.
It doesn't have any lasting effect, so if you revisit such a 'forgotten' website then data from that website will be saved once again. -
I am trying to view my pay stubs online but nothing happens when I click on the link. Does anyone know why, I never had a problem viewing them with my pc?
Nobody knows why because you have not provided sufficient information. Web site? Browser? How do you see your pay stubs online? Company web site? Unsecure?
-
i downloaded a movie to my ipad, when synced with computer, the computer is now also downloading the movie. why? and how do i stop the movie from being downloaded again
Do you not want a backup of the iTunes content on your computer in the event the iPad is lost, stolen, or simply fails?
-
I have problem with my mic when i make call the others cannot hear me but the mic is ok
i have problem with my mic when i make call the others cannot hear me but the mic is ok i checked it out and it works dont know what to do help me !!
Hello Sabbir Khan,
Thanks for using Apple Support Communities.
For more information on this, take a look at:
iPhone: Hardware troubleshooting
http://support.apple.com/kb/ts2802
Can't hear through the receiver or through speaker, and can't be heard
iPhone: Can't hear through the receiver or speakers
http://support.apple.com/kb/TS1630
Best of luck,
Mario -
When you turn on the ipad2 it does not start up properly. The rotating disk that happens when you turn off the ipad appears after the apple logo comes up during start-up and stays there for ten minutes. Then, the ipad will start up properly.
Have you tried a reset ? Press and hold both the sleep and home buttons for about 10 to 15 seconds (ignore the red slider), after which the Apple logo should appear - you won't lose any content, it's the iPad equivalent of a reboot.
Maybe you are looking for
-
I replaced the hard drive to a 30gig on my Ipod 4th gen. click wheel but it is still not recognized on my computer or in itunes......I get an error message with a folder and "!"....what can I do to fix??
-
Unable to find Admin tab in OBIEE 11G BI Publisher
hi all, i am unable to find the Administrator tab in OBIEE 11G BI Publisher. even if i login through the administrator privileges. can some one provide solution for this how to enable the Administration tab in BI Publisher. Thanks Yogi.
-
Mail Configuration in Nokia C5-00
I am facing problem in configuring Email in my new Nokia C5-00. I am following below steps, Menu->Application->Email->New mail box, Entering Mailid (with domain [email protected], [email protected]) & Password, Next screen is getting with "Validating
-
Hi, I have some data organised into a header (main) table, 3 subsidiary (detail) tables and a version table. Whenever a row is inserted into one of the detail tables a new version is created. A detail table doesn't have to have any rows, but the main
-
Share Typekit fonts with CC team
Hello, I am beginning to roll out Creative Cloud to our web and print desigers. I want to know if it is possible to share our Typekit fonts, that are accessed with our corporate Typekit account, with our designers that have different Adobe CC account