vip offline的解決 CRS_1006 CRS_0215

察看crs/bin/racgvip檔案


[root@inth-rac02 oracle]# /opt/crs/product/10.2.0.1/crs_1/bin/racgvip
There is no VIP name

[root@inth-rac02 oracle]# /opt/crs/product/10.2.0.1/crs_1/bin/oifcfg getif -global
eth0 192.168.8.0 global public
eth1 192.168.1.0 global cluster_interconnect

[root@inth-rac02 oracle]# /opt/crs/product/10.2.0.1/crs_1/bin/cluvfy stage -post crsinst -n inth-rac02

[root@inth-rac02 oracle]# /opt/crs/product/10.2.0.1/crs_1/bin/crsctl check crs
CSS appears healthy
CRS appears healthy
EVM appears healthy

檢視vip.log

[root@inth-rac01 ~]# vi /opt/crs/product/10.2.0.1/crs_1/log/inth-rac01/racg/ora.inth-rac01.vip.log
2009-11-25 13:07:49.037: [ RACG][3086912256] [10425][3086912256][ora.inth-rac01.vip]:01.vip]: Interface eth0 checked failed (host=inth-rac01)Invalid parameters, or failed to bring up VIP (host=inth-rac01)
結合網上的一些資料，是沒有配置預設閘道器導致的，所以這裡eth0在啟動vip的時候沒有check成功。

[root@inth-rac01 ~]# /sbin/ifconfig -a
現在找不到eth0:1的vip虛擬IP
root@inth-rac01 ~]# /sbin/ifconfig -a
eth0 Link encap:Ethernet HWaddr 00:0C:29:47:66:67
inet addr:192.168.8.129 Bcast:192.168.8.255 Mask:255.255.255.0
inet6 addr: fe80::20c:29ff:fe47:6667/64 Scope:Link
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
RX packets:2334 errors:0 dropped:0 overruns:0 frame:0
TX packets:1996 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:1000
RX bytes:261342 (255.2 KiB) TX bytes:287548 (280.8 KiB)
Interrupt:169 Base address:0x14a4

eth1 Link encap:Ethernet HWaddr 00:0C:29:47:66:71
inet addr:192.168.1.206 Bcast:192.168.1.255 Mask:255.255.255.0
inet6 addr: fe80::20c:29ff:fe47:6671/64 Scope:Link
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
RX packets:25 errors:0 dropped:0 overruns:0 frame:0
TX packets:12 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:1000
RX bytes:3166 (3.0 KiB) TX bytes:1014 (1014.0 b)
Interrupt:193 Base address:0x1824


用crs_stat檢視狀態
[root@inth-rac01 ~]# /opt/crs/product/10.2.0.1/crs_1/bin/crs_stat -t
Name Type Target State Host
------------------------------------------------------------
ora....c01.gsd application ONLINE ONLINE inth-rac01
ora....c01.ons application ONLINE ONLINE inth-rac01
ora....c01.vip application ONLINE OFFLINE
ora....c02.gsd application ONLINE OFFLINE
ora....c02.ons application ONLINE OFFLINE
ora....c02.vip application OFFLINE OFFLINE

VIP是OFFLINE的

解決方法
新增預設閘道器

route add default gw 192.168.8.1

或者用另一種方法 修改racgvip
將引數FAIL_WHEN_DEFAULTGW_NOT_FOUND=0
[root@inth-rac01 ~]# vi /opt/crs/product/10.2.0.1/crs_1/bin/racgvip
將引數FAIL_WHEN_DEFAULTGW_NOT_FOUND=0


[root@inth-rac01 ~]# /opt/crs/product/10.2.0.1/crs_1/bin/crs_start ora.inth-rac01.vip
Attempting to start `ora.inth-rac01.vip` on member `inth-rac01`
Start of `ora.inth-rac01.vip` on member `inth-rac01` succeeded.

檢視現在的ifconfig
[root@inth-rac01 ~]# /sbin/ifconfig -a
eth0 Link encap:Ethernet HWaddr 00:0C:29:47:66:67
inet addr:192.168.8.129 Bcast:192.168.8.255 Mask:255.255.255.0
inet6 addr: fe80::20c:29ff:fe47:6667/64 Scope:Link
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
RX packets:2466 errors:0 dropped:0 overruns:0 frame:0
TX packets:2131 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:1000
RX bytes:273195 (266.7 KiB) TX bytes:306026 (298.8 KiB)
Interrupt:169 Base address:0x14a4

eth0:1 Link encap:Ethernet HWaddr 00:0C:29:47:66:67
inet addr:192.168.8.29 Bcast:192.168.8.255 Mask:255.255.255.0
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
Interrupt:169 Base address:0x14a4

eth1 Link encap:Ethernet HWaddr 00:0C:29:47:66:71
inet addr:192.168.1.206 Bcast:192.168.1.255 Mask:255.255.255.0
inet6 addr: fe80::20c:29ff:fe47:6671/64 Scope:Link
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
RX packets:27 errors:0 dropped:0 overruns:0 frame:0
TX packets:12 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:1000
RX bytes:3473 (3.3 KiB) TX bytes:1014 (1014.0 b)
Interrupt:193 Base address:0x1824


[root@inth-rac01 ~]# /opt/crs/product/10.2.0.1/crs_1/bin/crs_stat -t
Name Type Target State Host
------------------------------------------------------------
ora....c01.gsd application ONLINE ONLINE inth-rac01
ora....c01.ons application ONLINE ONLINE inth-rac01
ora....c01.vip application ONLINE ONLINE inth-rac02
ora....c02.gsd application ONLINE UNKNOWN inth-rac02
ora....c02.ons application ONLINE UNKNOWN inth-rac02
ora....c02.vip application ONLINE ONLINE inth-rac02


不過還是有些問題，導致另一個節點GSD和ONS的狀態是unknown的，也就是還咩有通訊到。

但是此時的CRS還是健康的
[root@inth-rac02 ~]# /opt/crs/product/10.2.0.1/crs_1/bin/olsnodes
inth-rac01
inth-rac02

[root@inth-rac02 ~]# /opt/crs/product/10.2.0.1/crs_1/bin/oifcfg iflist
eth0 192.168.8.0
eth1 192.168.1.0


[root@inth-rac02 ~]# /opt/crs/product/10.2.0.1/crs_1/bin/crsctl check crs
CSS appears healthy
CRS appears healthy
EVM appears healthy

日誌裡也很正常
2009-11-25 00:07:51.203
[cssd(7919)]CRS-1601:CSSD Reconfiguration complete. Active nodes are inth-rac02 .
2009-11-25 00:07:52.154
[evmd(7779)]CRS-1401:EVMD started on node inth-rac02.
2009-11-25 00:07:52.160
[crsd(6684)]CRS-1012:The OCR service started on node inth-rac02.
2009-11-25 00:07:56.740
[crsd(6684)]CRS-1201:CRSD started on node inth-rac02.
2009-11-25 15:19:51.290
[cssd(9945)]CRS-1605:CSSD voting file is online: /dev/raw/raw1. Details in /opt/crs/product/10.2.0.1/crs_1/log/inth-rac02/cssd/ocssd.log.
2009-11-25 15:19:59.278
[cssd(9945)]CRS-1601:CSSD Reconfiguration complete. Active nodes are inth-rac01 inth-rac02 .
2009-11-25 15:20:19.107
[crsd(6977)]CRS-1012:The OCR service started on node inth-rac02.
2009-11-25 15:20:30.953
[evmd(9804)]CRS-1401:EVMD started on node inth-rac02.
2009-11-25 15:20:53.798
[crsd(6977)]CRS-1201:CRSD started on node inth-rac02.

不過GSD和OTS確實有問題
[root@inth-rac02 ~]# /opt/crs/product/10.2.0.1/crs_1/bin/srvctl status nodeapps
-n inth-rac02
VIP is running on node: inth-rac02
GSD is not running on node: inth-rac02
PRKO-2016 : Error in checking condition of listener on node: inth-rac02
ONS daemon is not running on node: inth-rac02


檢視ons的log
[root@inth-rac02 ~]# vi /opt/crs/product/10.2.0.1/crs_1/log/inth-rac02/racg/ora.inth-rac02.ons.log

Adding remote host inth-rac01:2009-11-25 00:08:23.787: [ RACG][3086912256] [8925][3086912256][ora.inth-rac02.ons]: 6200
onsctl: ons started
2009-11-25 15:21:16.873: [ RACG][3086912256] [11319][3086912256][ora.inth-rac02.ons]: onsctl: shutting down ons daemon ...
CONNECT: Connection refused
Number of onsconfiguration retrieved, numcfg = 1
onscfg[0]
{node = inth-rac01, port = 6200}Adding remote host inth-rac01:6200
onsctl: shutdown of ons failed!

$ORA_CRS_HOME/bin/crsctl check crs用於檢查後臺程式狀態
$ORA_CRS_HOME/bin/crsctl start resources啟動crs資源
$ORA_CRS_HOME/bin/crsctl start crs啟動crs，需要超級使用者操作。
$ORA_CRS_HOME/bin/crsctl stop crs關閉crs，需要超級使用者操作。
$ORA_CRS_HOME/bin/crs_unregister取消註冊crs
$ORA_CRS_HOME/bin/ocrcheck檢查ocr設定資訊用ocrcheck
$ORA_CRS_HOME/bin/crsctl query css votedisk檢查表決磁碟資訊