其實rac已經安裝好了，我使用cluvfy命令時發現一個有意思的問題(安裝前需要使用runcluvfy來驗證，因為cluvfy命令還沒有被安裝進來），安裝crs之後cluvfy就可以正常使用了。[@more@]

透過root驗證失敗，錯誤提示主要是：Result: Membership check for user "root" in group "oinstall" [as Primary] failed.原因就是說oinstall組不是root使用者的主組，執行下面命令把root加到oinstall和dba組裡：

# usermod -G root,oinstall,dba -U root

並且root使用者登出之後：

[root@node1 ~]# groups
root oinstall dba
[root@node1 ~]#

很顯然oinstall已經是root使用者的Primary組了，但是依然驗證不成功。

[root@node1 ~]# cluvfy stage -pre crsinst -n node1,node2 -verbose

Performing pre-checks for cluster services setup

Checking node reachability...

Check: Node reachability from node "node1"
Destination Node Reachable?
------------------------------------ ------------------------
node1 yes
node2 yes
Result: Node reachability check passed from node "node1".

Checking user equivalence...

Check: User equivalence for user "root"
Node Name Comment
------------------------------------ ------------------------
node2 passed
node1 passed
Result: User equivalence check passed for user "root".

Checking administrative privileges...

Check: Existence of user "root"
Node Name User Exists Comment
------------ ------------------------ ------------------------
node2 yes passed
node1 yes passed
Result: User existence check passed for "root".

Check: Existence of group "oinstall"
Node Name Status Group ID
------------ ------------------------ ------------------------
node2 exists 501
node1 exists 501
Result: Group existence check passed for "oinstall".

Check: Membership of user "root" in group "oinstall" [as Primary]
Node Name User Exists Group Exists User in Group Primary Comment
---------------- ------------ ------------ ------------ ------------ ------------
node2 yes yes yes no failed
node1 yes yes yes no failed
Result: Membership check for user "root" in group "oinstall" [as Primary] failed.

Administrative privileges check failed.

Checking node connectivity...

Interface information for node "node2"
Interface Name IP Address Subnet
------------------------------ ------------------------------ ----------------
eth0 143.168.0.3 143.168.0.0
eth0 143.168.0.5 143.168.0.0
eth1 10.10.10.2 10.10.10.0

Interface information for node "node1"
Interface Name IP Address Subnet
------------------------------ ------------------------------ ----------------
eth0 143.168.0.2 143.168.0.0
eth0 143.168.0.4 143.168.0.0
eth1 10.10.10.1 10.10.10.0

Check: Node connectivity of subnet "143.168.0.0"
Source Destination Connected?
------------------------------ ------------------------------ ----------------
node2:eth0 node2:eth0 yes
node2:eth0 node1:eth0 yes
node2:eth0 node1:eth0 yes
node2:eth0 node1:eth0 yes
node2:eth0 node1:eth0 yes
node1:eth0 node1:eth0 yes
Result: Node connectivity check passed for subnet "143.168.0.0" with node(s) node2,node1.

Check: Node connectivity of subnet "10.10.10.0"
Source Destination Connected?
------------------------------ ------------------------------ ----------------
node2:eth1 node1:eth1 yes
Result: Node connectivity check passed for subnet "10.10.10.0" with node(s) node2,node1.

Suitable interfaces for VIP on subnet "143.168.0.0":
node2 eth0:143.168.0.3 eth0:143.168.0.5
node1 eth0:143.168.0.2 eth0:143.168.0.4

Suitable interfaces for the private interconnect on subnet "10.10.10.0":
node2 eth1:10.10.10.2
node1 eth1:10.10.10.1

Result: Node connectivity check passed.

Checking system requirements for 'crs'...

Check: Total memory
Node Name Available Required Comment
------------ ------------------------ ------------------------ ----------
node2 1.01GB (1064128KB) 512MB (524288KB) passed
node1 1.02GB (1068192KB) 512MB (524288KB) passed
Result: Total memory check passed.

Check: Free disk space in "/tmp" dir
Node Name Available Required Comment
------------ ------------------------ ------------------------ ----------
node2 12.89GB (13516452KB) 400MB (409600KB) passed
node1 12.22GB (12812408KB) 400MB (409600KB) passed
Result: Free disk space check passed.

Check: Swap space
Node Name Available Required Comment
------------ ------------------------ ------------------------ ----------
node2 1.92GB (2008084KB) 1GB (1048576KB) passed
node1 1.92GB (2008084KB) 1GB (1048576KB) passed
Result: Swap space check passed.

Check: System architecture
Node Name Available Required Comment
------------ ------------------------ ------------------------ ----------
node2 i686 i686 passed
node1 i686 i686 passed
Result: System architecture check passed.

Check: Kernel version
Node Name Available Required Comment
------------ ------------------------ ------------------------ ----------
node2 2.6.9-42.EL 2.4.21-15EL passed
node1 2.6.9-42.EL 2.4.21-15EL passed
Result: Kernel version check passed.

Check: Package existence for "make-3.79"
Node Name Status Comment
------------------------------ ------------------------------ ----------------
node2 make-3.80-6.EL4 passed
node1 make-3.80-6.EL4 passed
Result: Package existence check passed for "make-3.79".

Check: Package existence for "binutils-2.14"
Node Name Status Comment
------------------------------ ------------------------------ ----------------
node2 binutils-2.15.92.0.2-21 passed
node1 binutils-2.15.92.0.2-21 passed
Result: Package existence check passed for "binutils-2.14".

Check: Package existence for "gcc-3.2"
Node Name Status Comment
------------------------------ ------------------------------ ----------------
node2 gcc-3.4.6-3 passed
node1 gcc-3.4.6-3 passed
Result: Package existence check passed for "gcc-3.2".

Check: Package existence for "glibc-2.3.2-95.27"
Node Name Status Comment
------------------------------ ------------------------------ ----------------
node2 glibc-2.3.4-2.25 passed
node1 glibc-2.3.4-2.25 passed
Result: Package existence check passed for "glibc-2.3.2-95.27".

Check: Package existence for "compat-db-4.0.14-5"
Node Name Status Comment
------------------------------ ------------------------------ ----------------
node2 compat-db-4.1.25-9 passed
node1 compat-db-4.1.25-9 passed
Result: Package existence check passed for "compat-db-4.0.14-5".

Check: Package existence for "compat-gcc-7.3-2.96.128"
Node Name Status Comment
------------------------------ ------------------------------ ----------------
node2 compat-gcc-7.3-2.96.128 passed
node1 compat-gcc-7.3-2.96.128 passed
Result: Package existence check passed for "compat-gcc-7.3-2.96.128".

Check: Package existence for "compat-gcc-c++-7.3-2.96.128"
Node Name Status Comment
------------------------------ ------------------------------ ----------------
node2 compat-gcc-c++-7.3-2.96.128 passed
node1 compat-gcc-c++-7.3-2.96.128 passed
Result: Package existence check passed for "compat-gcc-c++-7.3-2.96.128".

Check: Package existence for "compat-libstdc++-7.3-2.96.128"
Node Name Status Comment
------------------------------ ------------------------------ ----------------
node2 compat-libstdc++-7.3-2.96.128 passed
node1 compat-libstdc++-7.3-2.96.128 passed
Result: Package existence check passed for "compat-libstdc++-7.3-2.96.128".

Check: Package existence for "compat-libstdc++-devel-7.3-2.96.128"
Node Name Status Comment
------------------------------ ------------------------------ ----------------
node2 compat-libstdc++-devel-7.3-2.96.128 passed
node1 compat-libstdc++-devel-7.3-2.96.128 passed
Result: Package existence check passed for "compat-libstdc++-devel-7.3-2.96.128".

Check: Package existence for "openmotif-2.2.3"
Node Name Status Comment
------------------------------ ------------------------------ ----------------
node2 openmotif-2.2.3-10.RHEL4.5 passed
node1 openmotif-2.2.3-10.RHEL4.5 passed
Result: Package existence check passed for "openmotif-2.2.3".

Check: Package existence for "setarch-1.3-1"
Node Name Status Comment
------------------------------ ------------------------------ ----------------
node2 setarch-1.6-1 passed
node1 setarch-1.6-1 passed
Result: Package existence check passed for "setarch-1.3-1".

Check: Group existence for "dba"
Node Name Status Comment
------------ ------------------------ ------------------------
node2 exists passed
node1 exists passed
Result: Group existence check passed for "dba".

Check: Group existence for "oinstall"
Node Name Status Comment
------------ ------------------------ ------------------------
node2 exists passed
node1 exists passed
Result: Group existence check passed for "oinstall".

Check: User existence for "nobody"
Node Name Status Comment
------------ ------------------------ ------------------------
node2 exists passed
node1 exists passed
Result: User existence check passed for "nobody".

System requirement passed for 'crs'

Pre-check for cluster services setup was unsuccessful on all the nodes.

--========================================

透過oracle使用者登入來驗證一下發現成功了：

[oracle@node1 bin]$ who am i
oracle pts/3 Jun 8 08:30 (143.168.0.6)
[oracle@node1 bin]$ groups
oinstall dba
[oracle@node1 bin]$

[oracle@node1 bin]$ cluvfy stage -pre crsinst -n node1,node2 -verbose

Performing pre-checks for cluster services setup

Checking node reachability...

Check: Node reachability from node "node1"
Destination Node Reachable?
------------------------------------ ------------------------
node1 yes
node2 yes
Result: Node reachability check passed from node "node1".

Checking user equivalence...

Check: User equivalence for user "oracle"
Node Name Comment
------------------------------------ ------------------------
node2 passed
node1 passed
Result: User equivalence check passed for user "oracle".

Checking administrative privileges...

Check: Existence of user "oracle"
Node Name User Exists Comment
------------ ------------------------ ------------------------
node2 yes passed
node1 yes passed
Result: User existence check passed for "oracle".

Check: Existence of group "oinstall"
Node Name Status Group ID
------------ ------------------------ ------------------------
node2 exists 501
node1 exists 501
Result: Group existence check passed for "oinstall".

Check: Membership of user "oracle" in group "oinstall" [as Primary]
Node Name User Exists Group Exists User in Group Primary Comment
---------------- ------------ ------------ ------------ ------------ ------------
node2 yes yes yes yes passed
node1 yes yes yes yes passed
Result: Membership check for user "oracle" in group "oinstall" [as Primary] passed.

Administrative privileges check passed.

Checking node connectivity...

Interface information for node "node2"
Interface Name IP Address Subnet
------------------------------ ------------------------------ ----------------
eth0 143.168.0.3 143.168.0.0
eth0 143.168.0.5 143.168.0.0
eth1 10.10.10.2 10.10.10.0

Interface information for node "node1"
Interface Name IP Address Subnet
------------------------------ ------------------------------ ----------------
eth0 143.168.0.2 143.168.0.0
eth0 143.168.0.4 143.168.0.0
eth1 10.10.10.1 10.10.10.0

Check: Node connectivity of subnet "143.168.0.0"
Source Destination Connected?
------------------------------ ------------------------------ ----------------
node2:eth0 node2:eth0 yes
node2:eth0 node1:eth0 yes
node2:eth0 node1:eth0 yes
node2:eth0 node1:eth0 yes
node2:eth0 node1:eth0 yes
node1:eth0 node1:eth0 yes
Result: Node connectivity check passed for subnet "143.168.0.0" with node(s) node2,node1.

Check: Node connectivity of subnet "10.10.10.0"
Source Destination Connected?
------------------------------ ------------------------------ ----------------
node2:eth1 node1:eth1 yes
Result: Node connectivity check passed for subnet "10.10.10.0" with node(s) node2,node1.

Suitable interfaces for VIP on subnet "143.168.0.0":
node2 eth0:143.168.0.3 eth0:143.168.0.5
node1 eth0:143.168.0.2 eth0:143.168.0.4

Suitable interfaces for the private interconnect on subnet "10.10.10.0":
node2 eth1:10.10.10.2
node1 eth1:10.10.10.1

Result: Node connectivity check passed.

Checking system requirements for 'crs'...

Check: Total memory
Node Name Available Required Comment
------------ ------------------------ ------------------------ ----------
node2 1.01GB (1064128KB) 512MB (524288KB) passed
node1 1.02GB (1068192KB) 512MB (524288KB) passed
Result: Total memory check passed.

Check: Free disk space in "/tmp" dir
Node Name Available Required Comment
------------ ------------------------ ------------------------ ----------
node2 12.87GB (13492720KB) 400MB (409600KB) passed
node1 12.2GB (12788656KB) 400MB (409600KB) passed
Result: Free disk space check passed.