RAC-rac+dg step2--設定共享磁碟-udev

1. 設定共享磁碟

這裡可以採用asmlib也可以採用udev來管理，我安裝的時候asmlib沒有透過一直報錯，最後採用了udev來管理，推薦採用udev來管理，asmlib最高支援到rhel5.9，所以這裡只演示採用udev來管理，當然使用raw也可以的，有興趣的可以聯絡我，，，

 

 

1. 可以使用udev來 共享儲存規劃

 

 

1. 配置 udev 繫結的 scsi_id

注意以下兩點：

首先切換到root使用者下：

5.1. 不同的作業系統，scsi_id 命令的位置不同。

[root@localhost ~]# cat /etc/issue

Oracle Linux Server release 6.5

Kernel \r on an \m

 

注意：rhel 6 之後只支援 --whitelisted --replace-whitespace 引數，之前的 -g -u -s 引數已經不支援了。

 

[root@localhost ~]# which scsi_id

/sbin/scsi_id

[root@localhost ~]#

5.2. 編輯 /etc/scsi_id.config 檔案，如果該檔案不存在，則建立該檔案並新增如下行：

 

[root@localhost ~]# vi /etc/scsi_id.config

options=--whitelisted --replace-whitespace

[root@localhost ~]#

5.3. 如果是使用 VMware 虛擬機器，直接輸入 scsi_id 命令可能無法獲取 id，需修改 VMware 檔案引數，這一步如果在新增磁碟的時候做過這一步的話就可以跳過了，直接獲取uuid即可

[root@RMSDB01 ~]# scsi_id --whitelisted --replace-whitespace --device=/dev/emcpowera
360000970000498700140533030373937
[root@RMSDB01 ~]# scsi_id --whitelisted --replace-whitespace --device=/dev/emcpowerb
360000970000498700140533030343837
[root@RMSDB01 ~]# scsi_id --whitelisted --replace-whitespace --device=/dev/emcpowerc
360000970000498700140533030343838

1. 建立並配置 udev rules 檔案

[root@localhost ~]# vi /etc/udev/rules.d/99-oracle-asmdevices.rules

KERNEL=="sd*", BUS=="scsi", PROGRAM=="/sbin/scsi_id --whitelisted --replace-whitespace --device=/dev/$name",RESULT=="360000970000498700140533030373937", NAME="asm-diska", OWNER="grid",GROUP="oinstall", MODE="0660"
KERNEL=="sd*", BUS=="scsi", PROGRAM=="/sbin/scsi_id --whitelisted --replace-whitespace --device=/dev/$name",RESULT=="360000970000498700140533030343837", NAME="asm-diskb", OWNER="grid",GROUP="oinstall", MODE="0660"
KERNEL=="sd*", BUS=="scsi", PROGRAM=="/sbin/scsi_id --whitelisted --replace-whitespace --device=/dev/$name",RESULT=="360000970000498700140533030343838", NAME="asm-diskc", OWNER="grid",GROUP="oinstall", MODE="0660"

 

 

根據步驟 5 獲取的 ID 修改 RESULT 值

這裡需要注意，一個KERNEL就是一行，不能換行的，我之前就是犯了這個錯誤的

 

 

1. 傳送到rac2

scp /etc/udev/rules.d/99-oracle-asmdevices.rules rac2:/etc/udev/rules.d

 123.asd

 

1. 新增完成後，重啟 udev，不同 Linux 發行版本重啟方式不一樣。

該步驟慢一點，大約可能需要30秒左右吧，等等等等。。。。。。

[root@localhost ~]# start_udev

Starting udev: [ OK ]

[root@localhost ~]#

1. 檢視繫結的 asm，如果此時還是看不到 asm disk，請重啟作業系統後再檢視。

[root@localhost ~]# ll /dev/asm*

brw-rw---- 1 grid asmadmin 8, 17 Oct 17 14:26 /dev/asm-diskb

brw-rw---- 1 grid asmadmin 8, 33 Oct 17 14:26 /dev/asm-diskc

1. 對硬碟進行分割槽

[root@localhost share]# fdisk -l | grep "Disk /dev/sd"

 

 

 

以下操作在節點1完成：

[root@rac01 ~]# fdisk /dev/sdb

Command (m for help): p

 

Disk /dev/sdb: 8589 MB, 8589934592 bytes

255 heads, 63 sectors/track, 1044 cylinders

Units = cylinders of 16065 * 512 = 8225280 bytes

 

Device Boot Start End Blocks Id System

 

Command (m for help): n

Command action

e extended

p primary partition (1-4)

p

Partition number (1-4): 1

First cylinder (1-1044, default 1):

Using default value 1

Last cylinder or +size or +sizeM or +sizeK (1-1044, default 1044):

Using default value 1044

 

Command (m for help): p

 

Disk /dev/sdb: 8589 MB, 8589934592 bytes

255 heads, 63 sectors/track, 1044 cylinders

Units = cylinders of 16065 * 512 = 8225280 bytes

 

Device Boot Start End Blocks Id System

/dev/sdb1 1 1044 8385898+ 83 Linux

 

Command (m for help): w

The partition table has been altered!

 

Calling ioctl() to re-read partition table.

Syncing disks.

 

...

 

fdisk /dev/sdc

fdisk /dev/sdd

 

 

 

1. 共享磁碟設定不正確報錯

執行root指令碼報錯：

 

第一種：

DiskGroup CRS creation failed with the following message:

ORA-15018: diskgroup cannot be created

ORA-15080: synchronous I/O operation to a disk failed

 

第二種：

Configuration of ASM failed, see logs for details

Did not succssfully configure and start ASM

CRS-2500: Cannot stop resource 'ora.crsd' as it is not running

CRS-4000: Command Stop failed, or completed with errors.

Command return code of 1 (256) from command: /u01/app/grid/11.2.0/bin/crsctl stop resource ora.crsd -init

Stop of resource "ora.crsd -init" failed

Failed to stop CRSD

 

 

第三種：

2014-06-05 06:39:01: Did not succssfully configure and start ASM

2014-06-05 06:39:01: Exiting exclusive mode

2014-06-05 06:39:01: Command return code of 1 (256) from command: /u01/app/grid/11.2.0/bin/crsctl stop resource ora.crsd -init

2014-06-05 06:39:01: Stop of resource "ora.crsd -init" failed

2014-06-05 06:39:01: Failed to stop CRSD

2014-06-05 06:39:32: Initial cluster configuration failed. See /u01/app/grid/11.2.0/cfgtoollogs/crsconfig/rootcrs_rac1.log for details

 

 

2013-01-21 11:19:25.396: [ CRSOCR][1] OCR context init failure. Error: PROC-26: Error while accessing the physical storage ASM error [SLOS: cat=8, opn=kgfoOpenFile01, dep=15056, loc=kgfokge

ORA-17503: ksfdopnGOpenFile05 Failed to open file +OCR.255.4294967295

ORA-17503: ksfdopn:2 Failed to open file +OCR.255.4294967295

ORA-15001: diskgroup "OCR"

] [8]

2013-01-21 11:19:25.396: [ CRSD][1][PANIC] CRSD exiting: Could not init OCR, code: 26

2013-01-21 11:19:25.396: [ CRSD][1] Done.

 

 

 

2014-06-06 23:20:23.442: [ OCRRAW][2849145568]propriogid:1_2: INVALID FORMAT

2014-06-06 23:20:23.442: [ OCRRAW][2849145568]proprioini: all disks are not OCR/OLR formatted

2014-06-06 23:20:23.442: [ OCRRAW][2849145568]proprinit: Could not open raw device

2014-06-06 23:20:23.445: [ OCRAPI][2849145568]a_init:16!: Backend init unsuccessful : [26]

2014-06-06 23:20:23.445: [ CRSOCR][2849145568] OCR context init failure. Error: PROC-26: Error while accessing the physical storage

2014-06-06 23:20:23.445: [ CRSD][2849145568][PANIC] CRSD exiting: Could not init OCR, code: 26

2014-06-06 23:20:23.446: [ CRSD][2849145568] Done.