Can't create HAStoragePlus resource

Question

Hello.
I'm trying to create cluster with failover solaris container and take a problem - can't create HAStoragePlus resource
A have a two sparc nodes (h2 h3) with latest patched Solaris 10u6 and Sun Cluster 3.2u2 and Fibre Channel storage.
$ cldevice show d13
=== DID Device Instances ===
DID Device Name: /dev/did/rdsk/d13
Full Device Path: h2:/dev/rdsk/c2t60060480000290102925533030304142d0
Full Device Path: h3:/dev/rdsk/c4t60060480000290102925533030304142d0
Replication: none
default_fencing: global
$ clrg show
=== Resource Groups and Resources ===
Resource Group: vh1-rg
RG_description: <NULL>
RG_mode: Failover
RG_state: Unmanaged
Failback: False
Nodelist: h3 h2
* on h2
$ grep d13 /etc/vfstab
/dev/did/dsk/d13s0 /dev/did/rdsk/d13s0 /global/vh1 ufs 2 no logging
* on h3
$ grep d13 /etc/vfstab
/dev/did/dsk/d13s0 /dev/did/rdsk/d13s0 /global/vh1 ufs 2 no logging
$ mount /global/vh1
$ df -k | grep d13
/dev/did/dsk/d13s0 247779831 65553 245236480 1% /global/vh1
$ clrs create -g vh1-rg -t SUNW.HAStoragePlus -p FilesystemMountPoints=/global/vh1 -p Affinityon=true vh1-hasp-rs
clrs: h3:global - Invalid global device path /dev/did/dsk/d13s0 detected for mount point /global/vh1.
clrs: (C189917) VALIDATE on resource vh1-hasp-rs, resource group vh1-rg, exited with non-zero exit status.
clrs: (C720144) Validation of resource vh1-hasp-rs in resource group vh1-rg on node h3 failed.
clrs: (C891200) Failed to create resource "vh1-hasp-rs".
I don't understand what's wrong. Please help me!
Thanks,
Alexander

Answer 1

OK. The clue has appeared.
[root@h3 /]$ cat /etc/vfstab
/dev/global/dsk/d13s0 /dev/global/rdsk/d13s0 /global/vh1 ufs 2 no logging
[root@h3 /]$ clrs create -g vh1-rg -t SUNW.HAStoragePlus -p FilesystemMountPoints=/global/vh1 -p Affinityon=true vh1-hasp-rs
clrs: h2:global - Failed to analyze the device file /dev/global/dsk/d13s0: No such file or directory.
clrs: h2:global - Failed to obtain the global service name of device /dev/global/dsk/d13s0 for mount point /global/vh1.
clrs: (C189917) VALIDATE on resource vh1-hasp-rs, resource group vh1-rg, exited with non-zero exit status.
clrs: (C720144) Validation of resource vh1-hasp-rs in resource group vh1-rg on node h2 failed.
clrs: (C891200) Failed to create resource "vh1-hasp-rs".
[root@h3 /]$ ls -l /dev/did/dsk/d13s0
lrwxrwxrwx 1 root root 42 Feb 3 15:41 /dev/did/dsk/d13s0 -> ../../../devices/pseudo/did@13:13,13s0,blk
[root@h3 /]$ ls -l /dev/global/dsk/d13s0
lrwxrwxrwx 1 root root 42 Jan 30 13:48 /dev/global/dsk/d13s0 -> ../../../devices/pseudo/did@13:13,13s0,blk
[root@h2 /]$ ls -l /dev/did/dsk/d13s0
lrwxrwxrwx 1 root root 42 Feb 3 16:27 /dev/did/dsk/d13s0 -> ../../../devices/pseudo/did@13:13,13s0,blk
[root@h2 /]$ ls -l /dev/global/dsk/d13s0
/dev/global/dsk/d13s0: No such file or directory
h3 - node@1
h2 - node@2
[root@h2 /]$ ls -l /global/.devices/node@2/
total 0
[root@h2 /]$ ls -l /global/.devices/node@1/
total 26
drwxrwxr-x 17 root root 3584 Feb 5 19:07 dev
drwxrwxr-x 3 root root 512 Jan 30 13:48 devices
drwx------ 2 root root 8192 Jan 28 18:31 lost+found
$ mount | grep node
/global/.devices/node@1 on /dev/md/dsk/d20 read/write/setuid/devices/intr/largefiles/logging/noquota/global/xattr/nodfratime/onerror=panic/dev=1540014 on Wed Feb 4 19:57:41 2009
[root@h3 /]$ mount | grep node
/global/.devices/node@1 on /dev/md/dsk/d20 read/write/setuid/devices/intr/largefiles/logging/noquota/global/xattr/nodfratime/onerror=panic/dev=1540014 on Wed Feb 4 19:57:41 2009
[root@h2 /]$ mount | grep node
/global/.devices/node@1 on /dev/md/dsk/d20 read/write/setuid/devices/intr/largefiles/logging/noquota/global/xattr/nodfratime/onerror=panic/dev=1540014 on Wed Feb 4 19:57:41 2009
/global/.devices/node@2 is not mounted, but I don't care how it should look as a result
[root@h2 /]$ grep node /etc/vfstab
/dev/md/dsk/d20 /dev/md/rdsk/d20 /global/.devices/node@2 ufs 2 no global
[root@h2 /]$ mount | grep node
/global/.devices/node@1 on /dev/md/dsk/d20 read/write/setuid/devices/intr/largefiles/logging/noquota/global/xattr/nodfratime/onerror=panic/dev=1540014 on Fri Feb 6 16:27:23 2009
[root@h2 /]$ mount /global/.devices/node@2
mount: /dev/md/dsk/d20 is already mounted or /global/.devices/node@2 is busy
/dev/md/dsk/d20 - it's a mirrored slice on local disks