oracle 11gR2 RAC for linux x86_64 grid執行root.sh 失敗問題處理

    昨天一個朋友問到我，在oracle 11gR2 RAC for linux x86_64安裝過程中，grid使用者執行root.sh在第一節點可以成功，但在第二節點不成功,報錯如下：

CRS-2674: Start of 'ora.cssd' on 'racnode2' failed
CRS-2679: Attempting to clean 'ora.cssd' on 'racnode2'
CRS-2681: Clean of 'ora.cssd' on 'racnode2' succeeded
CRS-2673: Attempting to stop 'ora.diskmon' on 'racnode2'
CRS-2677: Stop of 'ora.diskmon' on 'racnode2' succeeded
CRS-4000: Command Start failed, or completed with errors.
CRS-2672: Attempting to start 'ora.cssd' on 'racnode2'
CRS-2672: Attempting to start 'ora.diskmon' on 'racnode2'
CRS-2674: Start of 'ora.diskmon' on 'racnode2' failed
CRS-2679: Attempting to clean 'ora.diskmon' on 'racnode2'
CRS-5016: Process "/opt/oracle/11.2.0/grid/bin/diskmon" spawned by agent "/opt/oracle/11.2.0/grid/bin/orarootagent.bin" for action "clean" failed: details at "(:CLSN00010:)" in "/opt/oracle/11.2.0/grid/log/racnode2/agent/ohasd/orarootagent_root/orarootagent_root.log"
CRS-2681: Clean of 'ora.diskmon' on 'racnode2' succeeded
CRS-2674: Start of 'ora.cssd' on 'racnode2' failed
CRS-2679: Attempting to clean 'ora.cssd' on 'racnode2'
CRS-2681: Clean of 'ora.cssd' on 'racnode2' succeeded
CRS-4000: Command Start failed, or completed with errors.
Command return code of 1 (256) from command: /opt/oracle/11.2.0/grid/bin/crsctl start resource ora.ctssd -init -env USR_ORA_ENV=CTSS_REBOOT=TRUE
Start of resource "ora.ctssd -init -env USR_ORA_ENV=CTSS_REBOOT=TRUE" failed
Failed to start CTSS
Failed to start Oracle Clusterware stack

檢查GRID_HOME/log//cssd/ocssd.log ，裡面記錄下面內容：

2010-05-18 11:20:23.418: [    CSSD][2511965952]clssnmvDHBValidateNCopy: node 1, , has a disk HB, but no network HB, DHB has rcfg 169642893, wrtcnt, 1013, LATS 4141244, lastSeqNo 1013, uniqueness 1274151780, timestamp 1274152822/4138854

主要是節點2與節點1不能建立網路連線，導致節點2 CSS daemon啟動失敗，找到問題原因，解決方法就很容易

1.ssh能成功，説明網路設定正確，最大的可能性是linux下的防火牆了

linux下停止防火牆

service iptables stop
service ip6tables stop

禁用防火牆

chkconfig iptables off
chkconfig ip6tables off

結果從朋友那得到答覆：

緣分 17:55:32
防火牆關掉沒
緣分 17:55:39
linux防火牆
緣分 17:55:53
service iptables stop
service ip6tables stop
緣分 17:56:01
chkconfig iptables off
chkconfig ip6tables off
緣分 17:56:39
GRID_HOME/log//cssd/ocssd.log
緣分 17:56:52
把這個日誌發給我看下
緣分 17:57:12
可以先把所有節點防火牆都關閉
朋友 17:57:32
==
朋友 17:59:15
防火牆是沒有關，鬱悶。
朋友 17:59:30
我給你找日誌。
緣分 18:01:01
好的
緣分 18:01:18
把防火牆關了，再來一次吧 應該問題不大
緣分 18:01:33
然後你把日誌發給我，我再確認下是不是這個問題

  朋友要傳送給您檔案“ocssd.rar(1543KB)”,您是要接收，另存為還是謝絕該檔案

朋友 18:02:42
這個日誌還挺大，呵呵。
朋友 18:02:56
可以了，
朋友 18:03:03
  
朋友 18:03:16
說不出的感動啊，謝謝。