Oracle10203RAC環境刪除節點（二）

前面關閉了節點3上的資料庫例項和ASM例項，這篇文章繼續介紹清除CLUSTER節點的操作。

bash-2.03$ /data/oracle/product/10.2/crs/bin/crs_stat -t
名稱           型別           目標      狀態      主機       
------------------------------------------------------------
ora....SM1.asm application    ONLINE    ONLINE    racnode1   
ora....E1.lsnr application    ONLINE    ONLINE    racnode1   
ora....E1.lsnr application    ONLINE    OFFLINE              
ora....de1.gsd application    ONLINE    ONLINE    racnode1   
ora....de1.ons application    ONLINE    ONLINE    racnode1   
ora....de1.vip application    ONLINE    ONLINE    racnode1   
ora....SM2.asm application    ONLINE    ONLINE    racnode2   
ora....E2.lsnr application    ONLINE    ONLINE    racnode2   
ora....E2.lsnr application    ONLINE    OFFLINE              
ora....de2.gsd application    ONLINE    ONLINE    racnode2   
ora....de2.ons application    ONLINE    ONLINE    racnode2   
ora....de2.vip application    ONLINE    ONLINE    racnode2   
ora....SM3.asm application    OFFLINE   OFFLINE              
ora....E3.lsnr application    ONLINE    ONLINE    racnode3   
ora....de3.gsd application    ONLINE    ONLINE    racnode3   
ora....de3.ons application    ONLINE    ONLINE    racnode3   
ora....de3.vip application    ONLINE    ONLINE    racnode3   
ora....TRAC.cs application    OFFLINE   OFFLINE              
ora....ac1.srv application    OFFLINE   OFFLINE              
ora....ac2.srv application    OFFLINE   OFFLINE              
ora.testrac.db application    ONLINE    ONLINE    racnode1   
ora....c1.inst application    ONLINE    ONLINE    racnode1   
ora....c2.inst application    ONLINE    ONLINE    racnode2   
ora....c3.inst application    OFFLINE   OFFLINE              

檢查當前的CLUSTER狀態。

首先清除srvctl工具中的例項和ASM配置資訊。

bash-3.00$ srvctl status db -d testrac
例項 testrac1 正在節點 racnode1 上執行
例項 testrac2 正在節點 racnode2 上執行
例項 testrac3 沒有在 racnode3 節點上執行
bash-3.00$ srvctl remove inst -d testrac -i testrac3
是否從資料庫 testrac 中刪除例項 testrac3? (y/[n]) y
bash-3.00$ srvctl status asm -n racnode3
ASM 例項 +ASM3 不在節點 racnode3 上執行。
bash-3.00$ srvctl remove asm -n racnode3

在清除rac節點前，需要利用netca來刪除監聽，否則會報錯：

# ./rootdelete.sh
CRS resources for listeners are still configured. You must remove the CRS listener resources before deconfiging CRS stack. Use NETCA to remove them.
1

啟動netca，選擇CLUSTER操作，選擇監聽，最後選擇刪除監聽。

bash-3.00$ netca

Oracle Net Services Configuration:
racnode3...
    Deleted listener: LISTENER_RACNODE3
Oracle Net Services configuration successful. The exit code is 0

利用racgons清除rac的配置資訊，其中遠端埠資訊可以從$CRS_HOME/opmn/conf/ons.config檔案中獲取：

bash-2.03$ more /data/oracle/product/10.2/crs/opmn/conf/ons.config
localport=6100
remoteport=6200
loglevel=3
useocr=on
bash-3.00$ ./racgons remove_config racnode3:6200
racgons: Existing key value on racnode3 = 6200.
racgons: racnode3:6200 removed from OCR.

下面利用root執行rootdelete.sh：

bash-3.00$ su -
口令:
Sun Microsystems Inc.   SunOS 5.10      Generic January 2005
# bash
bash-3.00# cd /data/oracle/product/10.2/crs/install
bash-3.00# ./rootdelete.sh
Shutting down Oracle Cluster Ready Services (CRS):
Jun 16 16:46:12.850 | INF | daemon shutting down
Stopping resources.
Successfully stopped CRS resources
Stopping CSSD.
Shutting down CSS daemon.
Shutdown request successfully issued.
Shutdown has begun. The daemons should exit soon.
Checking to see if Oracle CRS stack is down...
Oracle CRS stack is not running.
Oracle CRS stack is down now.
Removing script. for Oracle Cluster Ready services
Updating ocr file for downgrade
Cleaning up SCR settings in '/var/opt/oracle/scls_scr'

在CLUSTER的安裝節點racnode1上執行指令碼：

# bash
bash-2.03# cd /data/oracle/product/10.2/crs/install
bash-2.03# ./rootdeletenode.sh racnode3,3
CRS-0210: Could not find resource 'ora.racnode3.LISTENER_RACNODE3.lsnr'.
PRKO-2112 : Some or all node applications are not removed successfully on node: racnode3
CRS nodeapps are deleted successfully
clscfg: EXISTING configuration version 3 detected.
clscfg: version 3 is 10G Release 2.
Successfully deleted 14 values from OCR.
Key SYSTEM.css.interfaces.noderacnode3 marked for deletion is not there. Ignoring.
Successfully deleted 5 keys from OCR.
Node deletion operation successful.
'racnode3,3' deleted successfully

再次檢查CLUSTER配置：

bash-2.03$ crs_stat -t
名稱           型別           目標      狀態      主機       
------------------------------------------------------------
ora....SM1.asm application    ONLINE    ONLINE    racnode1   
ora....E1.lsnr application    ONLINE    ONLINE    racnode1   
ora....E1.lsnr application    ONLINE    OFFLINE              
ora....de1.gsd application    ONLINE    ONLINE    racnode1   
ora....de1.ons application    ONLINE    ONLINE    racnode1   
ora....de1.vip application    ONLINE    ONLINE    racnode1   
ora....SM2.asm application    ONLINE    ONLINE    racnode2   
ora....E2.lsnr application    ONLINE    ONLINE    racnode2   
ora....E2.lsnr application    ONLINE    OFFLINE              
ora....de2.gsd application    ONLINE    ONLINE    racnode2   
ora....de2.ons application    ONLINE    ONLINE    racnode2   
ora....de2.vip application    ONLINE    ONLINE    racnode2   
ora....TRAC.cs application    OFFLINE   OFFLINE              
ora....ac1.srv application    OFFLINE   OFFLINE              
ora....ac2.srv application    OFFLINE   OFFLINE              
ora.testrac.db application    ONLINE    ONLINE    racnode1   
ora....c1.inst application    ONLINE    ONLINE    racnode1   
ora....c2.inst application    ONLINE    ONLINE    racnode2   
bash-2.03$ olsnodes -n
racnode1        1
racnode2        2

至此，CLUSTER清除的手工操作完成。