11g rac新增節點容易遇到的問題

新增節點容易遇到的問題：

$ ./addNode.sh "CLUSTER_NEW_NODES={ rac2}" "CLUSTER_NEW_VIRTUAL_HOSTNAMES={ rac2-vip}"

報錯1：

出現如下報錯：

    PRCF-2022 : The file "/u01/11.2.0/grid/javavm/admin/classes.bin" became smaller while being transferred

    PRCF-2022 : The file "/u01/11.2.0/grid/lib/libserver11.a" became smaller while being transferred

    PRCF-2022 : The file "/u01/11.2.0/grid/install/usm/Novell/SLES11/x86_64/2.6.32.12-0.7/xen/bin/oracleacfs.ko" became smaller while being transferred

但此三個檔案在節點 2 上又都可以找到，檔案大小以及許可權屬性都和一節點一樣，懷疑跟節點 2 有關（節點 2 本來是屬於叢集的，根據刪除 RAC 節點刪除節點 2 後，然後再新增的，可能跟這個有關）

 

解決辦法：

在節點 1 的 grid 使用者的 $ORACLE_HOME/crs/install/install.excl 檔案中，新增如下：

javavm/admin/classes.bin

lib/libserver11.a

install/usm/Novell/SLES11/x86_64/2.6.32.12-0.7/xen/bin/oracleacfs.ko

不需要刪除節點 2 上的 grid 目錄，直接在節點 1 再跑一遍 addnode.sh 即可

 

報錯2：

出現報錯：

PRKC-1025 : Failed to create a file under the filepath /opt because the filepath is not executable or writable

java.lang.OutOfMemoryError

 

解決辦法：

Increase JRE_MEMORY_OPTIONS=" -mx1024m" or greater value in the oraparam.ini located in:  $GRID_HOME/oui/

參考文件： Addnode.sh or Fresh Install Fails With PRKC-1025 and Java.Lang.OutOfMemoryError ( 文件  ID 1085893.1)

 

報錯3:

如果出現以下報錯：

Performing tests to see whether nodes  rac2,rac3 are available

.................SEVERE:OUI-35000: Fatal cluster error encountered (PRKN-1034 : Failed to retrieve IP address of host "rac2"). Correct the problem and try the operation again.

 

解決方案：

原因是由於 inventory 裡面有 rac 的資訊，根據實際根據更新 inventory 內容：

$ cd $ORACLE_HOME/oui/bin

$ ./runInstaller -updateNodeList ORACLE_HOME=<Oracle_home_location> "CLUSTER_NODES={remaining_node_list}"   --- remaining_node_list表示所有其它節點

 

報錯4:

如果跑root.sh出現以下報錯：

[root@hisrac01 grid]# /oracle/app/oraInventory/orainstRoot.sh

[064110]Start of resource "ora.cssd" failed

[064110]CRS-2672: Attempting to start 'ora.cssdmonitor' on 'hisrac01'

[064110]CRS-2672: Attempting to start 'ora.gipcd' on 'hisrac01'

[064110]CRS-2676: Start of 'ora.cssdmonitor' on 'hisrac01' succeeded

[064110]CRS-2676: Start of 'ora.gipcd' on 'hisrac01' succeeded

[064110]CRS-2672: Attempting to start 'ora.cssd' on 'hisrac01'

[064110]CRS-2672: Attempting to start 'ora.diskmon' on 'hisrac01'

[064110]CRS-2676: Start of 'ora.diskmon' on 'hisrac01' succeeded

[064110]CRS-2674: Start of 'ora.cssd' on 'hisrac01' failed

[064110]CRS-2679: Attempting to clean 'ora.cssd' on 'hisrac01'

[064110]CRS-2681: Clean of 'ora.cssd' on 'hisrac01' succeeded

[064110]CRS-2673: Attempting to stop 'ora.gipcd' on 'hisrac01'

[064110]CRS-2677: Stop of 'ora.gipcd' on 'hisrac01' succeeded

[064110]CRS-2673: Attempting to stop 'ora.cssdmonitor' on 'hisrac01'

[064110]CRS-2677: Stop of 'ora.cssdmonitor' on 'hisrac01' succeeded

[064110]CRS-5804: Communication error with agent process

[064110]CRS-4000: Command Start failed, or completed with errors.

[064110]Failed to start Oracle Grid Infrastructure stack

[064111]Failed to start Cluster Synchorinisation Service in clustered mode at /oracle/11.2.0/grid/crs/install/crsconfig_lib.pm line 1278.

[064111]/oracle/11.2.0/grid/perl/bin/perl -I/oracle/11.2.0/grid/perl/lib -I/oracle/11.2.0/grid/crs/install /oracle/11.2.0/grid/crs/install/rootcrs.pl execution failed

 

解決方案：

檢查心跳網路卡兩邊配置是否一樣，子網掩碼需要一致

 

報錯5:

如果跑root.sh出現以下報錯：

[root@hisrac01 /]# /oracle/11.2.0/grid/root.sh

Entries will be added to the /etc/oratab file as needed by

Database Configuration Assistant when a database is created

Finished running generic part of root script.

Now product-specific root actions will be performed.

Using configuration parameter file: /oracle/11.2.0/grid/crs/install/crsconfig_params

User ignored Prerequisites during installation

Installing Trace File Analyzer

OLR initialization - successful

Adding Clusterware entries to upstart

CRS-4402: The CSS daemon was started in exclusive mode but found an active CSS daemon on node hisrac02, number 2, and is terminating

An active cluster was found during exclusive startup, restarting to join the cluster

Start of resource "ora.asm" failed

CRS-2672: Attempting to start 'ora.drivers.acfs' on 'hisrac01'

CRS-2676: Start of 'ora.drivers.acfs' on 'hisrac01' succeeded

CRS-2672: Attempting to start 'ora.asm' on 'hisrac01'

CRS-5017: The resource action "ora.asm start" encountered the following error: 

ORA-48189: OS command to create directory failed

Linux-x86_64 Error: 13: Permission denied

Additional information: 2

. For details refer to "(:CLSN00107:)" in "/oracle/11.2.0/grid/log/hisrac01/agent/ohasd/oraagent_grid/oraagent_grid.log".

CRS-2674: Start of 'ora.asm' on 'hisrac01' failed

CRS-2679: Attempting to clean 'ora.asm' on 'hisrac01'

CRS-2681: Clean of 'ora.asm' on 'hisrac01' succeeded

CRS-2673: Attempting to stop 'ora.drivers.acfs' on 'hisrac01'

CRS-2677: Stop of 'ora.drivers.acfs' on 'hisrac01' succeeded

CRS-4000: Command Start failed, or completed with errors.

Failed to start Oracle Grid Infrastructure stack

Failed to start ASM at /oracle/11.2.0/grid/crs/install/ crsconfig_lib.pm line 1339.

/oracle/11.2.0/grid/perl/bin/perl -I/oracle/11.2.0/grid/perl/lib -I/oracle/11.2.0/grid/crs/install /oracle/11.2.0/grid/crs/install/rootcrs.pl execution failed

 

解決方案：

  ORA-48141: error creating directory during ADR initialization [<oracle_base>/base/diag]

ORA-48189: OS command to create directory failed

 

建立$ORACLE_BASE/base/diag資料夾

 

 

報錯6:

PRCR-1079 : Failed to start resource ora.rac1.vip

CRS-2674: Start of 'ora.net1.network' on 'rac1' failed

CRS-2674: Start of 'ora.net1.network' on 'rac2' failed

CRS-2632: There are no more servers to try to place resource 'ora.rac1.vip' on that would satisfy its placement policy

start VIP on node:rac1 ... failed

Failed to perform new node configuration at /oracle/grid/crs_1/crs/install/crsconfig_lib.pm line 9209.

/oracle/grid/crs_1/perl/bin/perl -I/oracle/grid/crs_1/perl/lib -I/oracle/grid/crs_1/crs/install /oracle/grid/crs_1/crs/install/rootcrs.pl execution failed

 

解決方案：

這裡是因為我在後面修改了 rac2 的 NETMASK ，雖然 service network restart 了，但是沒有在叢集裡做修改，所以報了這個錯，可以用下面的方法解決：

./srvctl modify nodeapps -n rac2 -A 10.0.0.101/255.255.255.0/eth0     ###public ip

./srvctl modify nodeapps -n rac2 -A 10.0.0.103/255.255.255.0/eth0     ###vip

修改完後，重啟叢集。