Sector size導致ORA-27061: waiting for async I/Os failed with root.sh

測試環境：

資料庫節點系統：rhel 6.8 x86_64

資料庫版本：Oracle 11.2.0.4 RAC

背景：

對比分散式儲存和IBM傳統儲存效能對比。

共三塊磁碟，冗餘模式採取normal。

在安裝資料庫叢集時，節點一執行root.sh執行失敗，提示ORA-27061: waiting for async I/Os failed  with root.sh

初步懷疑由於磁碟屬性或陣列問題，對比兩臺資料庫主機對映磁碟正常，許可權正確。

使用grid使用者讀寫共享盤，驗證透過

dd if=/dev/urandom of=/dev/asm/asm-diskb bs=4096 count=1000

dd if= =/dev/asm/asm-diskb of=/dev/zero   bs=4096 count=1000

多次搜尋無果，打算採取外部冗餘，測試每塊磁碟，此時分散式管理人員該問題可能由於三塊共享盤sector size不一致導致。

檢查分散式磁碟，發現一塊磁碟sector size 是4096，其他兩臺為512。

[root@htdb01 ~]# fdisk -l

......

Disk /dev/mapper/c1p1: 1600.3 GB, 1600321314816 bytes

255 heads, 63 sectors/track, 194561 cylinders

Units = cylinders of 16065 * 512 = 8225280 bytes

Sector size (logical/physical): 512 bytes / 512 bytes

I/O size (minimum/optimal): 4096 bytes / 524288 bytes

Disk identifier: 0x00000000

Disk /dev/mapper/c2p1: 1600.3 GB, 1600321314816 bytes

255 heads, 63 sectors/track, 194561 cylinders

Units = cylinders of 16065 * 512 = 8225280 bytes

Sector size (logical/physical): 512 bytes / 512 bytes

I/O size (minimum/optimal): 4096 bytes / 524288 bytes

Disk identifier: 0x00000000

Disk /dev/mapper/c3p1: 1600.3 GB, 1600321314816 bytes

255 heads, 63 sectors/track, 194561 cylinders

Units = cylinders of 16065 * 512 = 8225280 bytes

Sector size (logical/physical): 4096 bytes / 4096  bytes

I/O size (minimum/optimal): 4096 bytes / 524288 bytes

Disk identifier: 0x00000000

確認問題後，調整分散式系統上磁碟屬性，涉及命令為hdm，軟體為：hdm-core-3.3.0-25.ga-x86_64.rpm

安裝後檢查分散式磁碟資訊：

[root@yxcel03 soft]# hdm scan

[1C58SDM00001F5A7HUSMR7632BHP3010023]

  Product Name        = Ultrastar SN260

  Device Type         = NVMe Controller

  Device Path         = /dev/nvme0

  UID                 = 1C58SDM00001F5A7HUSMR7632BHP3010023

  Alias               = @nvme0

  Vendor Name         = HGST

  Model Name          = HUSMR7632BHP301

  Vendor ID           = 1C58

  Device ID           = 0023

  NVM Subsystem UID   = 1C58SDM00001F5A7HUSMR7632BHP301

[000CCA0B018E1280]

  Device Type         = NVMe Namespace

  Device Path         = /dev/nvme0n1

  UID                 = 000CCA0B018E1280

  Alias               = @nvmens0

  Parent Product Name = Ultrastar SN260

  Parent Device Type  = NVMe Controller

  Parent Device Path  = /dev/nvme0

  Parent UID          = 1C58SDM00001F5A7HUSMR7632BHP3010023

  NVM Subsystem UID   = 1C58SDM00001F5A7HUSMR7632BHP301

  Namespace ID        = 1

......

調整磁碟sector大小

[root@htcel02 soft]# hdm format --sector-size 512 -p /dev/nvme0

This operation will erase all user data on the specified devices. Before starting this operation, unmount any mounted file

systems on the devices or take the devices offline. After this operation is complete, the specified devices will be reset,

which may cause other operations to be interrupted.

Press 'y' to continue: y

[Notes]

  A system restart or shutdown is required to complete the operation.

    Device Reference = /dev/nvme0

Results for format: Operation succeeded. See Notes.

[root@htcel02 soft]# reboot

重啟系統後，資料庫叢集root.sh指令碼執行完成。