Pre-check for cluster services setup was unsuccessful on all the nodes.

Question

hi
when i am running the fixup script getting:
if i run cluvfy again i am getting another fixup script.what exactly to do?
[root@rac-1 grid1]# sh /tmp/CVU_11.2.0.1.0_grid1/runfixup.sh
Response file being used is :/tmp/CVU_11.2.0.1.0_grid1/fixup.response
Enable file being used is :/tmp/CVU_11.2.0.1.0_grid1/fixup.enable
Log file location: /tmp/CVU_11.2.0.1.0_grid1/orarun.log
uid=1100(grid1) gid=1000(oinstall) groups=1000(oinstall),1100(dba),1200(asmdba),1300(asmadmin),1202(asmoper)
grid1     hard    nproc    16384
Value of MAX PROCESSES HARDLIMIT in response file is not greater than value in/etc/security/limits.conf. Hence not changing it.
grid1     hard    nofile   65536
Value of FILE OPEN MAX HARDLIMIT in response file is not greater than value in /etc/security/limits.conf.Hence not changing it.
uid=1100(grid1) gid=1000(oinstall) groups=1000(oinstall),1100(dba),1200(asmdba),1300(asmadmin),1202(asmoper)
[root@rac-1 grid1]#
Performing pre-checks for cluster services setup
Checking node reachability...
Check: Node reachability from node "rac-1"
  Destination Node                      Reachable?             
  rac-2                                 yes                    
  rac-1                                 yes                    
Result: Node reachability check passed from node "rac-1"
Checking user equivalence...
Check: User equivalence for user "grid1"
  Node Name                             Comment                
  rac-2                                 passed                 
  rac-1                                 passed                 
Result: User equivalence check passed for user "grid1"
Checking node connectivity...
Checking hosts config file...
  Node Name     Status                    Comment                
  rac-2         passed                                           
  rac-1         passed                                           
Verification of the hosts config file successful
Interface information for node "rac-2"
Name   IP Address      Subnet          Gateway         Def. Gateway    HW Address        MTU  
eth0   192.168.1.3     192.168.1.0     0.0.0.0         192.168.1.1     00:1D:72:39:3A:E4 1500 
virbr0 192.168.122.1   192.168.122.0   0.0.0.0         192.168.1.1     00:00:00:00:00:00 1500 
eth1   192.168.181.20  192.168.181.0   0.0.0.0         192.168.1.1     00:00:00:00:00:00 1500 
Interface information for node "rac-1"
Name   IP Address      Subnet          Gateway         Def. Gateway    HW Address        MTU  
eth0   192.168.1.2     192.168.1.0     0.0.0.0         192.168.1.1     00:00:E8:F7:02:B0 1500 
eth1   192.168.181.10  192.168.181.0   0.0.0.0         192.168.1.1     00:26:18:59:EE:49 1500 
virbr0 192.168.122.1   192.168.122.0   0.0.0.0         192.168.1.1     00:00:00:00:00:00 1500 
Check: Node connectivity of subnet "192.168.1.0"
  Source                          Destination                     Connected?     
  rac-2:eth0                      rac-1:eth0                      yes            
Result: Node connectivity passed for subnet "192.168.1.0" with node(s) rac-2,rac-1
Check: TCP connectivity of subnet "192.168.1.0"
  Source                          Destination                     Connected?     
  rac-1:192.168.1.2               rac-2:192.168.1.3               passed         
Result: TCP connectivity check passed for subnet "192.168.1.0"
Check: Node connectivity of subnet "192.168.122.0"
  Source                          Destination                     Connected?     
  rac-2:virbr0                    rac-1:virbr0                    yes            
Result: Node connectivity passed for subnet "192.168.122.0" with node(s) rac-2,rac-1
Check: TCP connectivity of subnet "192.168.122.0"
Result: TCP connectivity check failed for subnet "192.168.122.0"
Check: Node connectivity of subnet "192.168.181.0"
  Source                          Destination                     Connected?     
  rac-2:eth1                      rac-1:eth1                      yes            
Result: Node connectivity passed for subnet "192.168.181.0" with node(s) rac-2,rac-1
Check: TCP connectivity of subnet "192.168.181.0"
  Source                          Destination                     Connected?     
  rac-1:192.168.181.10            rac-2:192.168.181.20            passed         
Result: TCP connectivity check passed for subnet "192.168.181.0"
Interfaces found on subnet "192.168.1.0" that are likely candidates for VIP are:
rac-2 eth0:192.168.1.3
rac-1 eth0:192.168.1.2
Interfaces found on subnet "192.168.122.0" that are likely candidates for a private interconnect are:
rac-2 virbr0:192.168.122.1
rac-1 virbr0:192.168.122.1
Interfaces found on subnet "192.168.181.0" that are likely candidates for a private interconnect are:
rac-2 eth1:192.168.181.20
rac-1 eth1:192.168.181.10
Result: Node connectivity check passed
Check: Total memory
  Node Name     Available                 Required                  Comment  
  rac-2         1.96GB (2050416.0KB)      1.5GB (1572864.0KB)       passed   
  rac-1         1.96GB (2058984.0KB)      1.5GB (1572864.0KB)       passed   
Result: Total memory check passed
Check: Available memory
  Node Name     Available                 Required                  Comment  
  rac-2         1.7GB (1780600.0KB)       50MB (51200.0KB)          passed   
  rac-1         1.56GB (1636896.0KB)      50MB (51200.0KB)          passed   
Result: Available memory check passed
Check: Swap space
  Node Name     Available                 Required                  Comment  
  rac-2         4GB (4194296.0KB)         2.93GB (3075624.0KB)      passed   
  rac-1         4GB (4192956.0KB)         2.95GB (3088476.0KB)      passed   
Result: Swap space check passed
Check: Free disk space for "rac-2:/tmp"
  Path              Node Name     Mount point   Available     Required      Comment    
  /tmp              rac-2         /             24.03GB       1GB           passed     
Result: Free disk space check passed for "rac-2:/tmp"
Check: Free disk space for "rac-1:/tmp"
  Path              Node Name     Mount point   Available     Required      Comment    
  /tmp              rac-1         /             16.54GB       1GB           passed     
Result: Free disk space check passed for "rac-1:/tmp"
Check: User existence for "grid1"
  Node Name     Status                    Comment                
  rac-2         exists                    passed                 
  rac-1         exists                    passed                 
Result: User existence check passed for "grid1"
Check: Group existence for "oinstall"
  Node Name     Status                    Comment                
  rac-2         exists                    passed                 
  rac-1         exists                    passed                 
Result: Group existence check passed for "oinstall"
Check: Group existence for "dba"
  Node Name     Status                    Comment                
  rac-2         exists                    passed                 
  rac-1         exists                    passed                 
Result: Group existence check passed for "dba"
Check: Membership of user "grid1" in group "oinstall" [as Primary]
  Node Name         User Exists   Group Exists  User in Group  Primary       Comment    
  rac-2             yes           yes           yes           yes           passed     
  rac-1             yes           yes           yes           yes           passed     
Result: Membership check for user "grid1" in group "oinstall" [as Primary] passed
Check: Membership of user "grid1" in group "dba"
  Node Name         User Exists   Group Exists  User in Group  Comment        
  rac-2             yes           yes           no            failed         
  rac-1             yes           yes           yes           passed         
Result: Membership check for user "grid1" in group "dba" failed
Check: Run level
  Node Name     run level                 Required                  Comment  
  rac-2         5                         3,5                       passed   
  rac-1         5                         3,5                       passed   
Result: Run level check passed
Check: Hard limits for "maximum open file descriptors"
  Node Name         Type          Available     Required      Comment        
  rac-2             hard          65536         65536         passed         
  rac-1             hard          65536         65536         passed         
Result: Hard limits check passed for "maximum open file descriptors"
Check: Soft limits for "maximum open file descriptors"
  Node Name         Type          Available     Required      Comment        
  rac-2             soft          1024          1024          passed         
  rac-1             soft          65536         1024          passed         
Result: Soft limits check passed for "maximum open file descriptors"
Check: Hard limits for "maximum user processes"
  Node Name         Type          Available     Required      Comment        
  rac-2             hard          16384         16384         passed         
  rac-1             hard          16384         16384         passed         
Result: Hard limits check passed for "maximum user processes"
Check: Soft limits for "maximum user processes"
  Node Name         Type          Available     Required      Comment        
  rac-2             soft          2047          2047          passed         
  rac-1             soft          16384         2047          passed         
Result: Soft limits check passed for "maximum user processes"
Check: System architecture
  Node Name     Available                 Required                  Comment  
  rac-2         x86_64                    x86_64                    passed   
  rac-1         x86_64                    x86_64                    passed   
Result: System architecture check passed
Check: Kernel version
  Node Name     Available                 Required                  Comment  
  rac-2         2.6.18-92.el5             2.6.18                    passed   
  rac-1         2.6.18-164.el5            2.6.18                    passed   
WARNING:
PRVF-7524 : Kernel version is not consistent across all the nodes.
Kernel version = "2.6.18-164.el5" found on nodes: rac-1.
Kernel version = "2.6.18-92.el5" found on nodes: rac-2.
Result: Kernel version check passed
Check: Kernel parameter for "semmsl"
  Node Name     Configured                Required                  Comment  
  rac-2         250                       250                       passed   
  rac-1         250                       250                       passed   
Result: Kernel parameter check passed for "semmsl"
Check: Kernel parameter for "semmns"
  Node Name     Configured                Required                  Comment  
  rac-2         32000                     32000                     passed   
  rac-1         32000                     32000                     passed   
Result: Kernel parameter check passed for "semmns"
Check: Kernel parameter for "semopm"
  Node Name     Configured                Required                  Comment  
  rac-2         100                       100                       passed   
  rac-1         100                       100                       passed   
Result: Kernel parameter check passed for "semopm"
Check: Kernel parameter for "semmni"
  Node Name     Configured                Required                  Comment  
  rac-2         142                       128                       passed   
  rac-1         142                       128                       passed   
Result: Kernel parameter check passed for "semmni"
Check: Kernel parameter for "shmmax"
  Node Name     Configured                Required                  Comment  
  rac-2         1049812992                536870912                 passed   
  rac-1         4398046511104             536870912                 passed   
Result: Kernel parameter check passed for "shmmax"
Check: Kernel parameter for "shmmni"
  Node Name     Configured                Required                  Comment  
  rac-2         4096                      4096                      passed   
  rac-1         4096                      4096                      passed   
Result: Kernel parameter check passed for "shmmni"
Check: Kernel parameter for "shmall"
  Node Name     Configured                Required                  Comment  
  rac-2         3279547                   2097152                   passed   
  rac-1         1073741824                2097152                   passed   
Result: Kernel parameter check passed for "shmall"
Check: Kernel parameter for "file-max"
  Node Name     Configured                Required                  Comment  
  rac-2         6815744                   6815744                   passed   
  rac-1         6815744                   6815744                   passed   
Result: Kernel parameter check passed for "file-max"
Check: Kernel parameter for "ip_local_port_range"
  Node Name     Configured                Required                  Comment  
  rac-2         between 9000 & 65500      between 9000 & 65500      passed   
  rac-1         between 9000 & 65500      between 9000 & 65500      passed   
Result: Kernel parameter check passed for "ip_local_port_range"
Check: Kernel parameter for "rmem_default"
  Node Name     Configured                Required                  Comment  
  rac-2         262144                    262144                    passed   
  rac-1         4194304                   262144                    passed   
Result: Kernel parameter check passed for "rmem_default"
Check: Kernel parameter for "rmem_max"
  Node Name     Configured                Required                  Comment  
  rac-2         4194304                   4194304                   passed   
  rac-1         4194304                   4194304                   passed   
Result: Kernel parameter check passed for "rmem_max"
Check: Kernel parameter for "wmem_default"
  Node Name     Configured                Required                  Comment  
  rac-2         262144                    262144                    passed   
  rac-1         262144                    262144                    passed   
Result: Kernel parameter check passed for "wmem_default"
Check: Kernel parameter for "wmem_max"
  Node Name     Configured                Required                  Comment  
  rac-2         1048576                   1048576                   passed   
  rac-1         1048576                   1048576                   passed   
Result: Kernel parameter check passed for "wmem_max"
Check: Kernel parameter for "aio-max-nr"
  Node Name     Configured                Required                  Comment  
  rac-2         3145728                   1048576                   passed   
  rac-1         3145728                   1048576                   passed   
Result: Kernel parameter check passed for "aio-max-nr"
Check: Package existence for "ocfs2-tools-1.2.7"
  Node Name     Available                 Required                  Comment  
  rac-2         ocfs2-tools-1.2.7-1.el5   ocfs2-tools-1.2.7         passed   
  rac-1         ocfs2-tools-1.4.2-1.el5   ocfs2-tools-1.2.7         passed   
Result: Package existence check passed for "ocfs2-tools-1.2.7"
Check: Package existence for "make-3.81"
  Node Name     Available                 Required                  Comment  
  rac-2         make-3.81-3.el5           make-3.81                 passed   
  rac-1         make-3.81-3.el5           make-3.81                 passed   
Result: Package existence check passed for "make-3.81"
Check: Package existence for "binutils-2.17.50.0.6"
  Node Name     Available                 Required                  Comment  
  rac-2         binutils-2.17.50.0.6-6.el5  binutils-2.17.50.0.6      passed   
  rac-1         binutils-2.17.50.0.6-12.el5  binutils-2.17.50.0.6      passed   
Result: Package existence check passed for "binutils-2.17.50.0.6"
Check: Package existence for "gcc-4.1.2"
  Node Name     Available                 Required                  Comment  
  rac-2         gcc-4.1.2-42.el5          gcc-4.1.2                 passed   
  rac-1         gcc-4.1.2-46.el5          gcc-4.1.2                 passed   
Result: Package existence check passed for "gcc-4.1.2"
Check: Package existence for "libaio-0.3.106 (i386)"
  Node Name     Available                 Required                  Comment  
  rac-2         libaio-0.3.106-3.2 (i386)  libaio-0.3.106 (i386)     passed   
  rac-1         libaio-0.3.106-3.2 (i386)  libaio-0.3.106 (i386)     passed   
Result: Package existence check passed for "libaio-0.3.106 (i386)"
Check: Package existence for "libaio-0.3.106 (x86_64)"
  Node Name     Available                 Required                  Comment  
  rac-2         libaio-0.3.106-3.2 (x86_64)  libaio-0.3.106 (x86_64)   passed   
  rac-1         libaio-0.3.106-3.2 (x86_64)  libaio-0.3.106 (x86_64)   passed   
Result: Package existence check passed for "libaio-0.3.106 (x86_64)"
Check: Package existence for "glibc-2.5-24 (i686)"
  Node Name     Available                 Required                  Comment  
  rac-2         glibc-2.5-24 (i686)       glibc-2.5-24 (i686)       passed   
  rac-1         glibc-2.5-42 (i686)       glibc-2.5-24 (i686)       passed   
Result: Package existence check passed for "glibc-2.5-24 (i686)"
Check: Package existence for "glibc-2.5-24 (x86_64)"
  Node Name     Available                 Required                  Comment  
  rac-2         glibc-2.5-24 (x86_64)     glibc-2.5-24 (x86_64)     passed   
  rac-1         glibc-2.5-42 (x86_64)     glibc-2.5-24 (x86_64)     passed   
Result: Package existence check passed for "glibc-2.5-24 (x86_64)"
Check: Package existence for "compat-libstdc++-33-3.2.3 (i386)"
  Node Name     Available                 Required                  Comment  
  rac-2         compat-libstdc++-33-3.2.3-61 (i386)  compat-libstdc++-33-3.2.3 (i386)  passed   
  rac-1         compat-libstdc++-33-3.2.3-61 (i386)  compat-libstdc++-33-3.2.3 (i386)  passed   
Result: Package existence check passed for "compat-libstdc++-33-3.2.3 (i386)"
Check: Package existence for "compat-libstdc++-33-3.2.3 (x86_64)"
  Node Name     Available                 Required                  Comment  
  rac-2         compat-libstdc++-33-3.2.3-61 (x86_64)  compat-libstdc++-33-3.2.3 (x86_64)  passed   
  rac-1         compat-libstdc++-33-3.2.3-61 (x86_64)  compat-libstdc++-33-3.2.3 (x86_64)  passed   
Result: Package existence check passed for "compat-libstdc++-33-3.2.3 (x86_64)"
Check: Package existence for "elfutils-libelf-0.125 (x86_64)"
  Node Name     Available                 Required                  Comment  
  rac-2         elfutils-libelf-0.125-3.el5 (x86_64)  elfutils-libelf-0.125 (x86_64)  passed   
  rac-1         elfutils-libelf-0.137-3.el5 (x86_64)  elfutils-libelf-0.125 (x86_64)  passed   
Result: Package existence check passed for "elfutils-libelf-0.125 (x86_64)"
Check: Package existence for "elfutils-libelf-devel-0.125"
  Node Name     Available                 Required                  Comment  
  rac-2         elfutils-libelf-devel-0.125-3.el5  elfutils-libelf-devel-0.125  passed   
  rac-1         elfutils-libelf-devel-0.137-3.el5  elfutils-libelf-devel-0.125  passed   
Result: Package existence check passed for "elfutils-libelf-devel-0.125"
Check: Package existence for "glibc-common-2.5"
  Node Name     Available                 Required                  Comment  
  rac-2         glibc-common-2.5-24       glibc-common-2.5          passed   
  rac-1         glibc-common-2.5-42       glibc-common-2.5          passed   
Result: Package existence check passed for "glibc-common-2.5"
Check: Package existence for "glibc-devel-2.5 (i386)"
  Node Name     Available                 Required                  Comment  
  rac-2         glibc-devel-2.5-24 (i386)  glibc-devel-2.5 (i386)    passed   
  rac-1         glibc-devel-2.5-42 (i386)  glibc-devel-2.5 (i386)    passed   
Result: Package existence check passed for "glibc-devel-2.5 (i386)"
Check: Package existence for "glibc-devel-2.5 (x86_64)"
  Node Name     Available                 Required                  Comment  
  rac-2         glibc-devel-2.5-24 (x86_64)  glibc-devel-2.5 (x86_64)  passed   
  rac-1         glibc-devel-2.5-42 (x86_64)  glibc-devel-2.5 (x86_64)  passed   
Result: Package existence check passed for "glibc-devel-2.5 (x86_64)"
Check: Package existence for "glibc-headers-2.5"
  Node Name     Available                 Required                  Comment  
  rac-2         glibc-headers-2.5-24      glibc-headers-2.5         passed   
  rac-1         glibc-headers-2.5-42      glibc-headers-2.5         passed   
Result: Package existence check passed for "glibc-headers-2.5"
Check: Package existence for "gcc-c++-4.1.2"
  Node Name     Available                 Required                  Comment  
  rac-2         gcc-c++-4.1.2-42.el5      gcc-c++-4.1.2             passed   
  rac-1         gcc-c++-4.1.2-46.el5      gcc-c++-4.1.2             passed   
Result: Package existence check passed for "gcc-c++-4.1.2"
Check: Package existence for "libaio-devel-0.3.106 (i386)"
  Node Name     Available                 Required                  Comment  
  rac-2         libaio-devel-0.3.106-3.2 (i386)  libaio-devel-0.3.106 (i386)  passed   
  rac-1         libaio-devel-0.3.106-3.2 (i386)  libaio-devel-0.3.106 (i386)  passed   
Result: Package existence check passed for "libaio-devel-0.3.106 (i386)"
Check: Package existence for "libaio-devel-0.3.106 (x86_64)"
  Node Name     Available                 Required                  Comment  
  rac-2         libaio-devel-0.3.106-3.2 (x86_64)  libaio-devel-0.3.106 (x86_64)  passed   
  rac-1         libaio-devel-0.3.106-3.2 (x86_64)  libaio-devel-0.3.106 (x86_64)  passed   
Result: Package existence check passed for "libaio-devel-0.3.106 (x86_64)"
Check: Package existence for "libgcc-4.1.2 (i386)"
  Node Name     Available                 Required                  Comment  
  rac-2         libgcc-4.1.2-42.el5 (i386)  libgcc-4.1.2 (i386)       passed   
  rac-1         libgcc-4.1.2-46.el5 (i386)  libgcc-4.1.2 (i386)       passed   
Result: Package existence check passed for "libgcc-4.1.2 (i386)"
Check: Package existence for "libgcc-4.1.2 (x86_64)"
  Node Name     Available                 Required                  Comment  
  rac-2         libgcc-4.1.2-42.el5 (x86_64)  libgcc-4.1.2 (x86_64)     passed   
  rac-1         libgcc-4.1.2-46.el5 (x86_64)  libgcc-4.1.2 (x86_64)     passed   
Result: Package existence check passed for "libgcc-4.1.2 (x86_64)"
Check: Package existence for "libstdc++-4.1.2 (i386)"
  Node Name     Available                 Required                  Comment  
  rac-2         libstdc++-4.1.2-42.el5 (i386)  libstdc++-4.1.2 (i386)    passed   
  rac-1         libstdc++-4.1.2-46.el5 (i386)  libstdc++-4.1.2 (i386)    passed   
Result: Package existence check passed for "libstdc++-4.1.2 (i386)"
Check: Package existence for "libstdc++-4.1.2 (x86_64)"
  Node Name     Available                 Required                  Comment  
  rac-2         libstdc++-4.1.2-42.el5 (x86_64)  libstdc++-4.1.2 (x86_64)  passed   
  rac-1         libstdc++-4.1.2-46.el5 (x86_64)  libstdc++-4.1.2 (x86_64)  passed   
Result: Package existence check passed for "libstdc++-4.1.2 (x86_64)"
Check: Package existence for "libstdc++-devel-4.1.2 (x86_64)"
  Node Name     Available                 Required                  Comment  
  rac-2         libstdc++-devel-4.1.2-42.el5 (x86_64)  libstdc++-devel-4.1.2 (x86_64)  passed   
  rac-1         libstdc++-devel-4.1.2-46.el5 (x86_64)  libstdc++-devel-4.1.2 (x86_64)  passed   
Result: Package existence check passed for "libstdc++-devel-4.1.2 (x86_64)"
Check: Package existence for "sysstat-7.0.2"
  Node Name     Available                 Required                  Comment  
  rac-2         sysstat-7.0.2-1.el5       sysstat-7.0.2

Answer 1

In both node oracle user & group should be same but in your case looks different.
Once again check your user & group.
Babu