[oracle@rac1 ~]$ crs_stop -all
Attempting to stop `ora.rac1.gsd` on member `rac1`
Attempting to stop `ora.rac1.ons` on member `rac1`
Attempting to stop `ora.rac2.gsd` on member `rac2`
Attempting to stop `ora.ora9i.db` on member `rac1`
Attempting to stop `ora.rac2.ons` on member `rac2`
Stop of `ora.rac1.gsd` on member `rac1` succeeded.
Stop of `ora.rac2.gsd` on member `rac2` succeeded.
Stop of `ora.rac2.ons` on member `rac2` succeeded.
Stop of `ora.rac1.ons` on member `rac1` succeeded.
Stop of `ora.ora9i.db` on member `rac1` succeeded.
Attempting to stop `ora.rac1.LISTENER_RAC1.lsnr` on member `rac1`
Attempting to stop `ora.rac2.LISTENER_RAC2.lsnr` on member `rac2`
`ora.rac1.LISTENER_RAC1.lsnr` on member `rac1` has experienced an unrecoverable failure.
Human intervention required to resume its availability.
`ora.ora9i.ora9i1.inst` is already OFFLINE.
`ora.rac2.LISTENER_RAC2.lsnr` on member `rac2` has experienced an unrecoverable failure.
Human intervention required to resume its availability.
`ora.ora9i.ora9i2.inst` is already OFFLINE.
Attempting to stop `ora.rac1.ASM1.asm` on member `rac1`
`ora.rac1.ASM1.asm` on member `rac1` has experienced an unrecoverable failure.
Human intervention required to resume its availability.
Attempting to stop `ora.rac2.ASM2.asm` on member `rac2`
Attempting to stop `ora.rac1.LISTENER_RAC1.lsnr` on member `rac1`
`ora.rac2.ASM2.asm` on member `rac2` has experienced an unrecoverable failure.
Human intervention required to resume its availability.
`ora.rac1.LISTENER_RAC1.lsnr` on member `rac1` has experienced an unrecoverable failure.
Human intervention required to resume its availability.
Attempting to stop `ora.rac1.ASM1.asm` on member `rac1`
`ora.rac1.ASM1.asm` on member `rac1` has experienced an unrecoverable failure.
Human intervention required to resume its availability.
Attempting to stop `ora.rac2.LISTENER_RAC2.lsnr` on member `rac2`
Attempting to stop `ora.rac1.vip` on member `rac1`
`ora.rac2.LISTENER_RAC2.lsnr` on member `rac2` has experienced an unrecoverable failure.
Human intervention required to resume its availability.
Attempting to stop `ora.rac2.ASM2.asm` on member `rac2`
`ora.rac2.ASM2.asm` on member `rac2` has experienced an unrecoverable failure.
Human intervention required to resume its availability.
Attempting to stop `ora.rac2.vip` on member `rac2`
Stop of `ora.rac1.vip` on member `rac1` succeeded.
Stop of `ora.rac2.vip` on member `rac2` succeeded.
CRS-0216: Could not stop resource 'ora.ora9i.ora9i1.inst'.

CRS-0216: Could not stop resource 'ora.ora9i.ora9i2.inst'.

CRS-0216: Could not stop resource 'ora.rac1.ASM1.asm'.

CRS-0216: Could not stop resource 'ora.rac1.LISTENER_RAC1.lsnr'.

CRS-0216: Could not stop resource 'ora.rac1.vip'.

CRS-0216: Could not stop resource 'ora.rac2.ASM2.asm'.

CRS-0216: Could not stop resource 'ora.rac2.LISTENER_RAC2.lsnr'.

CRS-0216: Could not stop resource 'ora.rac2.vip'.

在UNKNOWN狀態下，使用crs_start -all命令不會把RAC啟動起來，啟動的時候會報錯。

[oracle@rac1 ~]$ crs_start -all
Attempting to start `ora.rac1.vip` on member `rac1`
Attempting to start `ora.rac2.vip` on member `rac2`
Attempting to start `ora.rac2.gsd` on member `rac2`
Attempting to start `ora.rac2.ons` on member `rac2`
Attempting to start `ora.rac1.gsd` on member `rac1`
Attempting to start `ora.rac1.ons` on member `rac1`
`ora.rac2.gsd` on member `rac2` has experienced an unrecoverable failure.
Human intervention required to resume its availability.
`ora.rac2.ons` on member `rac2` has experienced an unrecoverable failure.
Human intervention required to resume its availability.
Attempting to start `ora.ora9i.db` on member `rac1`
`ora.rac1.ons` on member `rac1` has experienced an unrecoverable failure.
Human intervention required to resume its availability.
`ora.rac1.gsd` on member `rac1` has experienced an unrecoverable failure.
Human intervention required to resume its availability.
`ora.ora9i.db` on member `rac1` has experienced an unrecoverable failure.
Human intervention required to resume its availability.
Start of `ora.rac1.vip` on member `rac1` succeeded.
CRS-1028: Dependency analysis failed because of:
'Resource in UNKNOWN state: ora.rac1.ASM1.asm'

Start of `ora.rac2.vip` on member `rac2` succeeded.
CRS-1028: Dependency analysis failed because of:
'Resource in UNKNOWN state: ora.rac2.ASM2.asm'

CRS-0215: Could not start resource 'ora.ora9i.db'.

CRS-0223: Resource 'ora.ora9i.ora9i1.inst' has placement error.

CRS-0223: Resource 'ora.ora9i.ora9i2.inst' has placement error.

CRS-0215: Could not start resource 'ora.rac1.gsd'.

CRS-0215: Could not start resource 'ora.rac1.ons'.

CRS-0215: Could not start resource 'ora.rac2.gsd'.

CRS-0215: Could not start resource 'ora.rac2.ons'.

此時crs_stat -t的狀態還是有很多的UNKNOWN
（煩、煩、煩，rac中真奇怪，正常啟動關閉服務時，
狀態只有online和offline兩種（啟動與未啟動），結果RAC中給你來了個UNKNOWN）：
[oracle@rac1 ~]$ crs_stat -t
Name          Type          Target   State    Host
------------------------------------------------------------
ora.ora9i.db  application   ONLINE   UNKNOWN  rac1
ora....i1.inst application   OFFLINE  OFFLINE
ora....i2.inst application   OFFLINE  OFFLINE
ora....SM1.asm application   OFFLINE  UNKNOWN  rac1
ora....C1.lsnr application   OFFLINE  UNKNOWN  rac1
ora.rac1.gsd  application   ONLINE   UNKNOWN  rac1
ora.rac1.ons  application   ONLINE   UNKNOWN  rac1
ora.rac1.vip  application   ONLINE   ONLINE   rac1
ora....SM2.asm application   OFFLINE  UNKNOWN  rac2
ora....C2.lsnr application   OFFLINE  UNKNOWN  rac2
ora.rac2.gsd  application   ONLINE   UNKNOWN  rac2
ora.rac2.ons  application   ONLINE   UNKNOWN  rac2
ora.rac2.vip  application   ONLINE   ONLINE   rac2
[oracle@rac1 ~]$ sqlplus /nolog

SQL*Plus: Release 10.2.0.1.0 - Production on Thu Aug 7 13:42:36 2008

SQL> conn /as sysdba
Connected to an idle instance.
顯示資料庫已經連線不上；

此時可有兩種方法來解決：

方法一：先禁用crs服務，後啟用crs服務
（相當於從新啟動系統，因為crs是隨系統自動啟動的），需要在兩臺節點上都執行；

具體步驟：
節點1：
1、[root@rac1 ~]# /etc/init.d/init.crs stop
Shutting down Oracle Cluster Ready Services (CRS):
Stopping resources.
Successfully stopped CRS resources
Stopping CSSD.
Shutting down CSS daemon.
Shutdown request successfully issued.
Shutdown has begun. The daemons should exit soon.
2、[root@rac1 ~]# su - oracle
[oracle@rac1 ~]$ crs_stat -t
CRS-0184: Cannot communicate with the CRS daemon.

3、[oracle@rac1 ~]$ exit
logout
[root@rac1 ~]# /etc/init.d/init.crs start
Startup will be queued to init within 90 seconds.
4、[root@rac1 ~]# su - oracle
[oracle@rac1 ~]$ crs_stat -t
Name          Type          Target   State    Host
------------------------------------------------------------
ora.ora9i.db  application   ONLINE   ONLINE   rac1
ora....i1.inst application   ONLINE   ONLINE   rac1
ora....i2.inst application   ONLINE   ONLINE   rac2
ora....SM1.asm application   ONLINE   ONLINE   rac1
ora....C1.lsnr application   ONLINE   ONLINE   rac1
ora.rac1.gsd  application   ONLINE   ONLINE   rac1
ora.rac1.ons  application   ONLINE   ONLINE   rac1
ora.rac1.vip  application   ONLINE   ONLINE   rac1
ora....SM2.asm application   ONLINE   ONLINE   rac2
ora....C2.lsnr application   ONLINE   ONLINE   rac2
ora.rac2.gsd  application   ONLINE   ONLINE   rac2
ora.rac2.ons  application   ONLINE   ONLINE   rac2
ora.rac2.vip  application   ONLINE   ONLINE   rac2
[oracle@rac1 ~]$

節點2：
1、[root@rac2 ~]# /etc/init.d/init.crs stop
Shutting down Oracle Cluster Ready Services (CRS):
Stopping resources.
Successfully stopped CRS resources
Stopping CSSD.
Shutting down CSS daemon.
Shutdown request successfully issued.
Shutdown has begun. The daemons should exit soon.
2、[root@rac2 ~]# su - oracle
[oracle@rac2 ~]$ crs_stat -t
CRS-0184: Cannot communicate with the CRS daemon.

[oracle@rac2 ~]$ exit
logout
3、[root@rac2 ~]# /etc/init.d/init.crs start
Startup will be queued to init within 90 seconds.
4、[root@rac2 ~]# su - oracle
[oracle@rac2 ~]$ crs_stat -t
Name          Type          Target   State    Host
------------------------------------------------------------
ora.ora9i.db  application   ONLINE   ONLINE   rac1
ora....i1.inst application   ONLINE   ONLINE   rac1
ora....i2.inst application   ONLINE   ONLINE   rac2
ora....SM1.asm application   ONLINE   ONLINE   rac1
ora....C1.lsnr application   ONLINE   ONLINE   rac1
ora.rac1.gsd  application   ONLINE   ONLINE   rac1
ora.rac1.ons  application   ONLINE   ONLINE   rac1
ora.rac1.vip  application   ONLINE   ONLINE   rac1
ora....SM2.asm application   ONLINE   ONLINE   rac2
ora....C2.lsnr application   ONLINE   ONLINE   rac2
ora.rac2.gsd  application   ONLINE   ONLINE   rac2
ora.rac2.ons  application   ONLINE   ONLINE   rac2
ora.rac2.vip  application   ONLINE   ONLINE   rac2
[oracle@rac2 ~]$

方法二：可以使用crs_stop -f先強制停止服務，在啟動服務（在一臺節點上執行即可）；
具體步驟：

[oracle@rac2 ~]$ crs_stop -f ora.rac1.ons
Attempting to stop `ora.rac1.ons` on member `rac1`
Stop of `ora.rac1.ons` on member `rac1` succeeded.
[oracle@rac2 ~]$ crs_start -f ora.rac1.ons
Attempting to start `ora.rac1.ons` on member `rac1`
Start of `ora.rac1.ons` on member `rac1` succeeded.
[oracle@rac2 ~]$ crs_stop -f ora.rac2.ons
Attempting to stop `ora.rac2.ons` on member `rac2`
Stop of `ora.rac2.ons` on member `rac2` succeeded.
[oracle@rac2 ~]$ crs_start -f ora.rac2.ons
Attempting to start `ora.rac2.ons` on member `rac2`
Start of `ora.rac2.ons` on member `rac2` succeeded.
[oracle@rac2 ~]$ crs_stop -f ora.rac1.gsd
Attempting to stop `ora.rac1.gsd` on member `rac1`
Stop of `ora.rac1.gsd` on member `rac1` succeeded.
[oracle@rac2 ~]$ crs_start -f ora.rac1.gsd
Attempting to start `ora.rac1.gsd` on member `rac1`
Start of `ora.rac1.gsd` on member `rac1` succeeded.
[oracle@rac2 ~]$ crs_stop -f ora.rac2.gsd
Attempting to stop `ora.rac2.gsd` on member `rac2`
Stop of `ora.rac2.gsd` on member `rac2` succeeded.
[oracle@rac2 ~]$ crs_start -f ora.rac2.gsd
Attempting to start `ora.rac2.gsd` on member `rac2`
Start of `ora.rac2.gsd` on member `rac2` succeeded.
[oracle@rac2 ~]$ crs_stop -f ora.rac1.LISTENER_RAC1.lsnr
Attempting to stop `ora.rac1.LISTENER_RAC1.lsnr` on member `rac1`
Stop of `ora.rac1.LISTENER_RAC1.lsnr` on member `rac1` succeeded.
[oracle@rac2 ~]$ crs_start -f ora.rac1.LISTENER_RAC1.lsnr
Attempting to start `ora.rac1.LISTENER_RAC1.lsnr` on member `rac1`
Start of `ora.rac1.LISTENER_RAC1.lsnr` on member `rac1` succeeded.
[oracle@rac2 ~]$ crs_stop -f ora.rac2.LISTENER_RAC2.lsnr
Attempting to stop `ora.rac2.LISTENER_RAC2.lsnr` on member `rac2`
Stop of `ora.rac2.LISTENER_RAC2.lsnr` on member `rac2` succeeded.
[oracle@rac2 ~]$ crs_start -f ora.rac2.LISTENER_RAC2.lsnr
Attempting to start `ora.rac2.LISTENER_RAC2.lsnr` on member `rac2`
Start of `ora.rac2.LISTENER_RAC2.lsnr` on member `rac2` succeeded.
[oracle@rac2 ~]$ crs_stop -f ora.rac1.ASM1.asm
Attempting to stop `ora.rac1.ASM1.asm` on member `rac1`
Stop of `ora.rac1.ASM1.asm` on member `rac1` succeeded.
[oracle@rac2 ~]$ crs_start -f ora.rac1.ASM1.asm
Attempting to start `ora.rac1.ASM1.asm` on member `rac1`
Start of `ora.rac1.ASM1.asm` on member `rac1` succeeded.
[oracle@rac2 ~]$ crs_stop -f ora.rac2.ASM2.asm
Attempting to stop `ora.rac2.ASM2.asm` on member `rac2`
Stop of `ora.rac2.ASM2.asm` on member `rac2` succeeded.
[oracle@rac2 ~]$ crs_start -f ora.rac2.ASM2.asm
Attempting to start `ora.rac2.ASM2.asm` on member `rac2`
Start of `ora.rac2.ASM2.asm` on member `rac2` succeeded.
[oracle@rac2 ~]$ crs_stop -f ora.ora9i.ora9i1.inst
`ora.ora9i.ora9i1.inst` is already OFFLINE.
CRS-0216: Could not stop resource 'ora.ora9i.ora9i1.inst'.

[oracle@rac2 ~]$ crs_start -f ora.ora9i.ora9i1.inst
Attempting to start `ora.ora9i.ora9i1.inst` on member `rac1`
Start of `ora.ora9i.ora9i1.inst` on member `rac1` succeeded.
[oracle@rac2 ~]$ crs_stop -f ora.ora9i.ora9i2.inst
`ora.ora9i.ora9i2.inst` is already OFFLINE.
CRS-0216: Could not stop resource 'ora.ora9i.ora9i2.inst'.

[oracle@rac2 ~]$ crs_start -f ora.ora9i.ora9i2.inst
Attempting to start `ora.ora9i.ora9i2.inst` on member `rac2`
Start of `ora.ora9i.ora9i2.inst` on member `rac2` succeeded.
[oracle@rac2 ~]$ crs_stop -f ora.ora9i.db
Attempting to stop `ora.ora9i.db` on member `rac2`
Stop of `ora.ora9i.db` on member `rac2` succeeded.
[oracle@rac2 ~]$ crs_start -f ora.ora9i.db
Attempting to start `ora.ora9i.db` on member `rac1`
Start of `ora.ora9i.db` on member `rac1` succeeded.

[oracle@rac2 ~]$ crs_stat -t
Name          Type          Target   State    Host
------------------------------------------------------------
ora.ora9i.db  application   ONLINE   ONLINE   rac1
ora....i1.inst application   ONLINE   ONLINE   rac1
ora....i2.inst application   ONLINE   ONLINE   rac2
ora....SM1.asm application   ONLINE   ONLINE   rac1
ora....C1.lsnr application   ONLINE   ONLINE   rac1
ora.rac1.gsd  application   ONLINE   ONLINE   rac1
ora.rac1.ons  application   ONLINE   ONLINE   rac1
ora.rac1.vip  application   ONLINE   ONLINE   rac1
ora....SM2.asm application   ONLINE   ONLINE   rac2
ora....C2.lsnr application   ONLINE   ONLINE   rac2
ora.rac2.gsd  application   ONLINE   ONLINE   rac2
ora.rac2.ons  application   ONLINE   ONLINE   rac2
ora.rac2.vip  application   ONLINE   ONLINE   rac2

總結：在rac環境中如果使用crs_stop -all去停rac服務時，很有可能會出現crs中的一些服務的狀態是UNKNOWN，這時我們可以採用兩種方法去重新啟動crs服務：

1：轉換到root使用者下用/etc/init.d/init.crs stop先禁用crs，然後再用/etc/init.d/init.crs start去啟用crs，啟用crs後會自動啟動crs的一系列服務，注意此種方法需要在兩臺節點上都執行；

2：是用crs_stop -f 引數把crs中狀態是UNKNOWN的服務關掉，然後再用crs_start -f （加一個-f的引數）啟動所有的服務就可以。參考：

以下要分別在兩個節點上執行:
在啟動的過程中最好檢測著crs、ASM和資料庫的日誌：

crs日誌：
[oracle@rac1 ~]$ tail -f /u01/app/oracle/product/10.2.0/crs_1/log/rac1/alertrac1.log
[oracle@rac2 ~]$ tail -f /u01/app/oracle/product/10.2.0/crs_1/log/rac2/alertrac2.log

ASM日誌：
[oracle@rac1 ~]$ tail -f /u01/app/oracle/admin/+ASM/bdump/alert_+ASM1.log
[oracle@rac2 ~]$ tail -f /u01/app/oracle/admin/+ASM/bdump/alert_+ASM2.log
資料庫日誌：
[oracle@rac1 ~]$ tail -f /u01/app/oracle/admin/ora9i/bdump/alert_ora9i1.log
[oracle@rac2 ~]$ tail -f /u01/app/oracle/admin/ora9i/bdump/alert_ora9i2.log

ORACLE 10G RAC故障: crs_stop -all 命令後遇到 UNKNOW，一頓折騰後好了

相關文章