oracle rac遇到了問題：報錯：

CRS-4535: Cannot communicate with Cluster Ready Services

CRS-4534: Cannot communicate with Event Manager‘

問題分析：由於網站上雲，oracle有一套rac從idc機房撤回到了公司本地，，按著步驟關閉了資料庫，領導關閉的，只是su - oracle 然後shu immediate,關閉了oracle例項，asm例項則沒有關閉，然後搬到公司按著原來的位置插好了網線並嘗試啟動，我只嘗試著把ora010的例項起來了，然後就不管了，後來要用這套庫的時候，我才看ora102的狀態，才意識到資料庫例項和asm例項都沒有啟動，於是嘗試啟動，但是報錯如下：

首先先說下oracle rac伺服器需要重啟的時候，oracle相關資源關閉的的流程：

方法一：

1）關閉oracle例項

[ ~]$ srvctl stop database -d ORCL

2）關閉asm例項

[ ~]$ srvctl stop asm -n ora102

[ ~]$ srvctl stop asm -n ora101

如果報錯就強制關閉，如下

[root@ora101 bin]# ./srvctl stop asm

PRCR-1065 : Failed to stop resource ora.asm

CRS-2529: Unable to act on 'ora.asm' because that would require stopping or relocating 'ora.DATA.dg', but the force option was not specified

加上強制關閉即可：

[grid@ora101 ~]$ srvctl stop asm -f

[grid@ora101 ~]$ srvctl status asm

ASM is not running.

3)最後還需要關閉crs

[root@ora101 bin]# ./crsctl stop cluster -all

方法二：

1)關閉oracle例項,兩個節點都執行

su - oracle

sqlplus / as sysdba

shu immediate

2）關閉asm例項，兩個節點都執行

su - grid

sqlplus / as sysasm

shu immediate

sqlplu abort強制關閉

[grid@ora101 ~]$ sqlplus / as sysasm

SQL> shu abort

ASM instance shutdown

3)最後還需要關閉crs

[root@ora101 bin]# ./crsctl stop cluster -all

檢查資料庫和asm例項的狀態，以及crs的狀態

[grid@ora101 ~]$ srvctl status asm

ASM is running on ora101,ora102

[grid@ora101 ~]$ srvctl status database -d ORCL

Instance orcl1 is not running on node ora101

Instance orcl2 is not running on node ora102

好了言歸正傳，繼續說遇到的問題。

[root@ora102 ~]# su - grid

[grid@ora102 ~]$ sqlplus / as sysasm

SQL*Plus: Release 11.2.0.4.0 Production on Wed Nov 29 22:28:20 2017

Connected to:

Oracle Database 11g Enterprise Edition Release 11.2.0.4.0 - 64bit Production

With the Real Application Clusters and Automatic Storage Management options

SQL> startup

報錯。。。

在ora102節點上檢查叢集服務的狀態，報錯

[root@ora102 ~]# /u01/app/11.2.0/grid/bin/crs_stat -t

CRS-0184: Cannot communicate with the CRS daemon.

根據上面報錯，可以判斷出crs是有問題。

嘗試啟動也報錯：注意需要使用root

[root@ora102 ~]# /u01/app/11.2.0/grid/bin/crsctl start crs

CRS-4640: Oracle High Availability Services is already active

CRS-4000: Command Start failed, or completed with errors.

正常情況是：

[root@ora102 bin]# /u01/app/11.2.0/grid/bin/crsctl start crs

CRS-4123: Oracle High Availability Services has been started.

檢查crs服務，發現有問題：

[grid@ora102 ~]$ crsctl check crs

CRS-4638: Oracle High Availability Services is online

CRS-4535: Cannot communicate with Cluster Ready Services

CRS-4530: Communications failure contacting Cluster Synchronization Services demon

CRS-4534: Cannot communicate with Event Manager‘

然後節點ora102檢視ip情況，發現vip和scan ip都已經不在，vip在節點ora101上了，可以判斷出節點ora102已經脫離了叢集。

檢視ip配置。。。

[root@ora102 ~]# cat /etc/hosts

127.0.0.1 localhost localhost.localdomain localhost4 localhost4.localdomain4

::1 localhost localhost.localdomain localhost6 localhost6.localdomain6

192.168.0.44 ora101

192.168.0.45 ora102

192.168.0.46 ora101-vip

192.168.0.47 ora102-vip

192.168.0.48 ora-cluster-scan

172.168.56.101 ora101-priv

172.168.56.102 ora102-priv

檢視節點的ip情況，發現只有物理ip（192.168.0.45 ）了。

[root@ora102 ~]# ip a

1: lo: mtu 65536 qdisc noqueue state UNKNOWN qlen 1

link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00

inet 127.0.0.1/8 scope host lo