Linux Multipath多路徑配置與使用案例
在Linux平臺一部分儲存產品使用作業系統自帶的多路徑軟體,包括最常見的HP和IBM的部分儲存產品,在Linux自帶的多路徑軟體叫做multipath,這篇文章以HP EVA系列儲存在Linux平臺的使用為例,詳細的在Linux平臺配置和使用多路徑。
那麼問題就來了,到底什麼是多路徑?
普通的電腦主機都是一個硬碟掛接到一個匯流排上,這裡是一對一的關係。而到了有光纖組成的SAN環境,或者由iSCSI組成的IPSAN環境,由於主機和儲存透過了光纖交換機或者多塊網路卡及IP來連線,這樣的話,就構成了多對多的關係。也就是說,主機到儲存可以有多條路徑可以選擇。主機到儲存之間的IO由多條路徑可以選擇。每個主機到所對應的儲存可以經過幾條不同的路徑,如果是同時使用的話,I/O流量如何分配?其中一條路徑壞掉了,如何處理?從在作業系統的角度來看,每條路徑,作業系統會認為是一個實際存在的物理盤,但實際上只是通向同一個物理盤的不同路徑而已,這樣是在使用的時候,就給使用者帶來了困惑。多路徑軟體就是為了解決上面的問題應運而生的。
多路徑的主要功能就是和儲存裝置一起配合實現如下功能:
1、故障的切換和恢復
2、IO流量的負載均衡
3、磁碟的虛擬化
由於多路徑軟體是需要和儲存在一起配合使用的,不同的廠商基於不同的作業系統,都提供了不同的版本。並且有的廠商,軟體和硬體也不是一起賣的,如果要使用多路徑軟體的話,可能還需要向廠商購買license才行。比如EMC公司基於linux下的多路徑軟體,就需要單獨的購買license。好在, RedHat和Suse的2.6的核心中都自帶了免費的多路徑軟體包,並且可以免費使用,同時也是一個比較通用的包,可以支援大多數儲存廠商的裝置,即使是一些不是出名的廠商,透過對配置檔案進行稍作修改,也是可以支援並執行的很好的。
一、Linux下multipath介紹
在redhat中,安裝作業系統的時候multipath已經預設被安裝,檢視安裝情況:
[root@seaing ~]# rpm -qa | grep device-mapper
device-mapper-multipath-0.4.7-34.el5
device-mapper-1.02.39-1.el5
device-mapper-1.02.39-1.el5
device-mapper-event-1.02.39-1.el5
1、device-mapper-multipath:即multipath-tools。主要提供multipathd和multipath等工具和 multipath.conf等配置檔案。這些工具透過device mapper的ioctr的介面建立和配置multipath裝置(呼叫device-mapper的使用者空間庫。建立的多路徑裝置會在/dev /mapper中)。
2、 device-mapper:主要包括兩大部分:核心部分和使用者部分。核心部分主要由device mapper核心(dm.ko)和一些target driver(md-multipath.ko)。核心完成裝置的對映,而target根據對映關係和自身特點具體處理從mappered device 下來的i/o。同時,在核心部分,提供了一個介面,使用者透過ioctr可和核心部分通訊,以指導核心驅動的行為,比如如何建立mappered device,這些divece的屬性等。linux device mapper的使用者空間部分主要包括device-mapper這個包。其中包括dmsetup工具和一些幫助建立和配置mappered device的庫。這些庫主要抽象,封裝了與ioctr通訊的介面,以便方便建立和配置mappered device。multipath-tool的程式中就需要呼叫這些庫。
3、dm-multipath.ko和dm.ko:dm.ko是device mapper驅動。它是實現multipath的基礎。dm-multipath其實是dm的一個target驅動。
4、scsi_id: 包含在udev程式包中,可以在multipath.conf中配置該程式來獲取scsi裝置的序號。透過序號,便可以判斷多個路徑對應了同一裝置。這個是多路徑實現的關鍵。scsi_id是透過sg驅動,向裝置傳送EVPD
page80或page83 的inquery命令來查詢scsi裝置的標識。但一些裝置並不支援EVPD 的inquery命令,所以他們無法被用來生成multipath裝置。但可以改寫scsi_id,為不能提供scsi裝置標識的裝置虛擬一個識別符號,並輸出到標準輸出。multipath程式在建立multipath裝置時,會呼叫scsi_id,從其標準輸出中獲得該裝置的scsi id。在改寫時,需要修改scsi_id程式的返回值為0。因為在multipath程式中,會檢查該直來確定scsi id是否已經成功得到。
想了解更多關於Device Mapper Multipath(DM-Multipath),請參考博文:http://blog.csdn.net/holandstone/article/details/7050234
二、Linux下multipath詳細配置
首先,我們本次Linux下multipath的整體的拓撲結構,如下所示:
因為在安裝作業系統的時候,multipath的軟體包已經那裝好了,所以這裡就不在需要安裝,如果沒有安裝的話,需要手動的進行安裝。
1、檢查安裝是否正常
[root@seaing ~]# lsmod |grep dm_multipath
dm_multipath 56921 2 dm_round_robin
scsi_dh 42177 1 dm_multipath
dm_mod 101649 19 dm_multipath,dm_raid45,dm_snapshot,dm_zero,dm_mirror,dm_log
如果模組沒有載入成功,請使用下面的命令初始化DM:
[root@seaing
~]#modprobe
dm-multipath
[root@seaing ~]#modprobe
dm-round-robin
[root@seaing ~]#service
multipathd start
[root@seaing ~]#multipath –v2
2、編輯配置檔案
[root@seaing ~]# cat /etc/multipath.conf
blacklist {
devnode "^sda"
}
defaults {
user_friendly_names no
}
multipaths {
multipath {
wwid 3600508b4000892b90002a00000050000 #磁碟的WWID
alias comsys-dm0 #對映後的別名,自己命名
path_grouping_policy multibus #路徑組策略
path_checker tur #決定路徑狀態的方法
path_selector "round-robin 0" #選擇那一條路徑進行下次IO操作
}
multipath {
wwid 3600508b4000892b90002a00000090000
alias comsys-dm1
path_grouping_policy multibus
path_checker tur
path_selector "round-robin 0"
}
multipath {
wwid 3600508b4000892b90002a00000140000
alias comsys-backup
path_grouping_policy multibus
path_checker tur
path_selector "round-robin 0"
}
}
devices {
device {
vendor "HP" #廠商名稱,可透過multipath –v3獲取到
product "HSV300" #產品型號
path_grouping_policy multibus #預設的路徑組策略
getuid_callout "/sbin/scsi_id -g -u -s /block/%n" #獲得唯一裝置號使用的預設程式
path_checker readsector0 #決定路徑狀態的方法
path_selector "round-robin 0" #選擇那條路徑進行下一個IO操作的方法
#failback immediate #故障恢復的模式
#no_path_retry queue #在disable queue之前系統嘗試使用失效路徑的次數的數值
#rr_min_io 100 #在當前的使用者組中,在切換到另外一條路徑之前的IO請求的數目
}
}
備註:
其中 wwid,vendor,product, getuid_callout這些引數可以透過:multipath -v3命令來獲取。如果在/etc/multipath.conf中有設定各wwid別名,別名會覆蓋此設定。
下面是兩種方法來獲取WWID
(1)預設情況下,將使用 /var/lib/multipath/bindings 內的配置設定具體每個多路徑裝置名,如果在/etc/multipath.conf中有設定各wwid 別名,別名會覆蓋此設定。
[root@seaing ~]# cat /var/lib/multipath/bindings
# Multipath bindings, Version : 1.0
# NOTE: this file is automatically maintained by the multipath program.
# You should not need to edit this file in normal circumstances.
#
# Format:
# alias wwid
#
mpath0 SATA_WDC_WD5003ABYX-_WD-WMAYP4135415
mpath1 3600508b4000892b90002a00000050000
mpath2 3600508b4000892b90002a00000090000
(2)透過multipath -v3命令來獲取
[root@seaing ~]# multipath -v3
dm-0: blacklisted
dm-1: blacklisted
dm-2: blacklisted
dm-3: blacklisted
dm-4: blacklisted
loop0: blacklisted
loop1: blacklisted
loop2: blacklisted
loop3: blacklisted
loop4: blacklisted
loop5: blacklisted
loop6: blacklisted
loop7: blacklisted
md0: blacklisted
ram0: blacklisted
ram10: blacklisted
ram11: blacklisted
ram12: blacklisted
ram13: blacklisted
ram14: blacklisted
ram15: blacklisted
ram1: blacklisted
ram2: blacklisted
ram3: blacklisted
ram4: blacklisted
ram5: blacklisted
ram6: blacklisted
ram7: blacklisted
ram8: blacklisted
ram9: blacklisted
sda: blacklisted
sdb: not found in pathvec
sdb: mask = 0x1f
sdb: bus = 1
sdb: dev_t = 8:16
sdb: size = 209715200
sdb: vendor = HP
sdb: product = HSV300
sdb: rev = 0952
sdb: h:b:t:l = 4:0:0:1
sdb: tgt_node_name = 0x50014380013be3f0
sdb: serial = P5512G29SVP02Q
sdb: path checker = readsector0 (controller setting)
sdb: checker timeout = 60000 ms (sysfs setting)
sdb: state = 2
sdb: getuid = /sbin/scsi_id -g -u -s /block/%n (controller setting)
sdb: uid = 3600508b4000892b90002a00000050000 (callout)
sdb: getprio = NULL (internal default)
sdb: prio = 1
sdc: not found in pathvec
sdc: mask = 0x1f
sdc: bus = 1
sdc: dev_t = 8:32
sdc: size = 419430400
sdc: vendor = HP
sdc: product = HSV300
sdc: rev = 0952
sdc: h:b:t:l = 4:0:0:2
sdc: tgt_node_name = 0x50014380013be3f0
sdc: serial = P5512G29SVP02Q
sdc: path checker = readsector0 (controller setting)
sdc: checker timeout = 60000 ms (sysfs setting)
sdc: state = 2
sdc: getuid = /sbin/scsi_id -g -u -s /block/%n (controller setting)
sdc: uid = 3600508b4000892b90002a00000090000 (callout)
sdc: getprio = NULL (internal default)
sdc: prio = 1
sdd: not found in pathvec
sdd: mask = 0x1f
sdd: bus = 1
sdd: dev_t = 8:48
sdd: size = 209715200
sdd: vendor = HP
sdd: product = HSV300
sdd: rev = 0952
sdd: h:b:t:l = 4:0:0:3
sdd: tgt_node_name = 0x50014380013be3f0
sdd: serial = P5512G29SVP02Q
sdd: path checker = readsector0 (controller setting)
sdd: checker timeout = 60000 ms (sysfs setting)
sdd: state = 2
sdd: getuid = /sbin/scsi_id -g -u -s /block/%n (controller setting)
sdd: uid = 3600508b4000892b90002a00000140000 (callout)
sdd: getprio = NULL (internal default)
sdd: prio = 1
sde: not found in pathvec
sde: mask = 0x1f
sde: bus = 1
sde: dev_t = 8:64
sde: size = 209715200
sde: vendor = HP
sde: product = HSV300
sde: rev = 0952
sde: h:b:t:l = 4:0:1:1
sde: tgt_node_name = 0x50014380013be3f0
sde: serial = P5512G29SVP01O
sde: path checker = readsector0 (controller setting)
sde: checker timeout = 60000 ms (sysfs setting)
sde: state = 2
sde: getuid = /sbin/scsi_id -g -u -s /block/%n (controller setting)
sde: uid = 3600508b4000892b90002a00000050000 (callout)
sde: getprio = NULL (internal default)
sde: prio = 1
sdf: not found in pathvec
sdf: mask = 0x1f
sdf: bus = 1
sdf: dev_t = 8:80
sdf: size = 419430400
sdf: vendor = HP
sdf: product = HSV300
sdf: rev = 0952
sdf: h:b:t:l = 4:0:1:2
sdf: tgt_node_name = 0x50014380013be3f0
sdf: serial = P5512G29SVP01O
sdf: path checker = readsector0 (controller setting)
sdf: checker timeout = 60000 ms (sysfs setting)
sdf: state = 2
sdf: getuid = /sbin/scsi_id -g -u -s /block/%n (controller setting)
sdf: uid = 3600508b4000892b90002a00000090000 (callout)
sdf: getprio = NULL (internal default)
sdf: prio = 1
sdg: not found in pathvec
sdg: mask = 0x1f
sdg: bus = 1
sdg: dev_t = 8:96
sdg: size = 209715200
sdg: vendor = HP
sdg: product = HSV300
sdg: rev = 0952
sdg: h:b:t:l = 4:0:1:3
sdg: tgt_node_name = 0x50014380013be3f0
sdg: serial = P5512G29SVP01O
sdg: path checker = readsector0 (controller setting)
sdg: checker timeout = 60000 ms (sysfs setting)
sdg: state = 2
sdg: getuid = /sbin/scsi_id -g -u -s /block/%n (controller setting)
sdg: uid = 3600508b4000892b90002a00000140000 (callout)
sdg: getprio = NULL (internal default)
sdg: prio = 1
sdh: not found in pathvec
sdh: mask = 0x1f
sdh: bus = 1
sdh: dev_t = 8:112
sdh: size = 209715200
sdh: vendor = HP
sdh: product = HSV300
sdh: rev = 0952
sdh: h:b:t:l = 5:0:0:1
sdh: tgt_node_name = 0x50014380013be3f0
sdh: serial = P5512G29SVP02Q
sdh: path checker = readsector0 (controller setting)
sdh: checker timeout = 60000 ms (sysfs setting)
sdh: state = 2
sdh: getuid = /sbin/scsi_id -g -u -s /block/%n (controller setting)
sdh: uid = 3600508b4000892b90002a00000050000 (callout)
sdh: getprio = NULL (internal default)
sdh: prio = 1
sdi: not found in pathvec
sdi: mask = 0x1f
sdi: bus = 1
sdi: dev_t = 8:128
sdi: size = 419430400
sdi: vendor = HP
sdi: product = HSV300
sdi: rev = 0952
sdi: h:b:t:l = 5:0:0:2
sdi: tgt_node_name = 0x50014380013be3f0
sdi: serial = P5512G29SVP02Q
sdi: path checker = readsector0 (controller setting)
sdi: checker timeout = 60000 ms (sysfs setting)
sdi: state = 2
sdi: getuid = /sbin/scsi_id -g -u -s /block/%n (controller setting)
sdi: uid = 3600508b4000892b90002a00000090000 (callout)
sdi: getprio = NULL (internal default)
sdi: prio = 1
sdj: not found in pathvec
sdj: mask = 0x1f
sdj: bus = 1
sdj: dev_t = 8:144
sdj: size = 209715200
sdj: vendor = HP
sdj: product = HSV300
sdj: rev = 0952
sdj: h:b:t:l = 5:0:0:3
sdj: tgt_node_name = 0x50014380013be3f0
sdj: serial = P5512G29SVP02Q
sdj: path checker = readsector0 (controller setting)
sdj: checker timeout = 60000 ms (sysfs setting)
sdj: state = 2
sdj: getuid = /sbin/scsi_id -g -u -s /block/%n (controller setting)
sdj: uid = 3600508b4000892b90002a00000140000 (callout)
sdj: getprio = NULL (internal default)
sdj: prio = 1
sdk: not found in pathvec
sdk: mask = 0x1f
sdk: bus = 1
sdk: dev_t = 8:160
sdk: size = 209715200
sdk: vendor = HP
sdk: product = HSV300
sdk: rev = 0952
sdk: h:b:t:l = 5:0:1:1
sdk: tgt_node_name = 0x50014380013be3f0
sdk: serial = P5512G29SVP01O
sdk: path checker = readsector0 (controller setting)
sdk: checker timeout = 60000 ms (sysfs setting)
sdk: state = 2
sdk: getuid = /sbin/scsi_id -g -u -s /block/%n (controller setting)
sdk: uid = 3600508b4000892b90002a00000050000 (callout)
sdk: getprio = NULL (internal default)
sdk: prio = 1
sdl: not found in pathvec
sdl: mask = 0x1f
sdl: bus = 1
sdl: dev_t = 8:176
sdl: size = 419430400
sdl: vendor = HP
sdl: product = HSV300
sdl: rev = 0952
sdl: h:b:t:l = 5:0:1:2
sdl: tgt_node_name = 0x50014380013be3f0
sdl: serial = P5512G29SVP01O
sdl: path checker = readsector0 (controller setting)
sdl: checker timeout = 60000 ms (sysfs setting)
sdl: state = 2
sdl: getuid = /sbin/scsi_id -g -u -s /block/%n (controller setting)
sdl: uid = 3600508b4000892b90002a00000090000 (callout)
sdl: getprio = NULL (internal default)
sdl: prio = 1
sdm: not found in pathvec
sdm: mask = 0x1f
sdm: bus = 1
sdm: dev_t = 8:192
sdm: size = 209715200
sdm: vendor = HP
sdm: product = HSV300
sdm: rev = 0952
sdm: h:b:t:l = 5:0:1:3
sdm: tgt_node_name = 0x50014380013be3f0
sdm: serial = P5512G29SVP01O
sdm: path checker = readsector0 (controller setting)
sdm: checker timeout = 60000 ms (sysfs setting)
sdm: state = 2
sdm: getuid = /sbin/scsi_id -g -u -s /block/%n (controller setting)
sdm: uid = 3600508b4000892b90002a00000140000 (callout)
sdm: getprio = NULL (internal default)
sdm: prio = 1
sr0: blacklisted
===== paths list =====
uuid hcil dev dev_t pri dm_st chk_st vend/pr
3600508b4000892b90002a00000050000 4:0:0:1 sdb 8:16 1 [undef][ready] HP,HSV3
3600508b4000892b90002a00000090000 4:0:0:2 sdc 8:32 1 [undef][ready] HP,HSV3
3600508b4000892b90002a00000140000 4:0:0:3 sdd 8:48 1 [undef][ready] HP,HSV3
3600508b4000892b90002a00000050000 4:0:1:1 sde 8:64 1 [undef][ready] HP,HSV3
3600508b4000892b90002a00000090000 4:0:1:2 sdf 8:80 1 [undef][ready] HP,HSV3
3600508b4000892b90002a00000140000 4:0:1:3 sdg 8:96 1 [undef][ready] HP,HSV3
3600508b4000892b90002a00000050000 5:0:0:1 sdh 8:112 1 [undef][ready] HP,HSV3
3600508b4000892b90002a00000090000 5:0:0:2 sdi 8:128 1 [undef][ready] HP,HSV3
3600508b4000892b90002a00000140000 5:0:0:3 sdj 8:144 1 [undef][ready] HP,HSV3
3600508b4000892b90002a00000050000 5:0:1:1 sdk 8:160 1 [undef][ready] HP,HSV3
3600508b4000892b90002a00000090000 5:0:1:2 sdl 8:176 1 [undef][ready] HP,HSV3
3600508b4000892b90002a00000140000 5:0:1:3 sdm 8:192 1 [undef][ready] HP,HSV3
params = 0 0 1 1 round-robin 0 4 1 8:32 1000 8:80 1000 8:128 1000 8:176 1000
status = 2 0 0 0 1 1 A 0 4 0 8:32 A 0 8:80 A 0 8:128 A 0 8:176 A 0
params = 0 0 1 1 round-robin 0 4 1 8:16 1000 8:64 1000 8:112 1000 8:160 1000
status = 2 0 0 0 1 1 A 0 4 0 8:16 A 0 8:64 A 0 8:112 A 0 8:160 A 0
params = 0 0 1 1 round-robin 0 4 1 8:48 1000 8:96 1000 8:144 1000 8:192 1000
status = 2 0 0 0 1 1 A 0 4 0 8:48 A 0 8:96 A 0 8:144 A 0 8:192 A 0
sdb: ownership set to comsys-dm0
sdb: not found in pathvec
sdb: mask = 0xc
sdb: state = 2
sdb: prio = 1
sde: ownership set to comsys-dm0
sde: not found in pathvec
sde: mask = 0xc
sde: state = 2
sde: prio = 1
sdh: ownership set to comsys-dm0
sdh: not found in pathvec
sdh: mask = 0xc
sdh: state = 2
sdh: prio = 1
sdk: ownership set to comsys-dm0
sdk: not found in pathvec
sdk: mask = 0xc
sdk: state = 2
sdk: prio = 1
comsys-dm0: pgfailover = -1 (internal default)
comsys-dm0: pgpolicy = multibus (LUN setting)
comsys-dm0: selector = round-robin 0 (LUN setting)
comsys-dm0: features = 0 (internal default)
comsys-dm0: hwhandler = 0 (internal default)
comsys-dm0: rr_weight = 1 (internal default)
comsys-dm0: minio = 1000 (config file default)
comsys-dm0: no_path_retry = NONE (internal default)
pg_timeout = NONE (internal default)
comsys-dm0: set ACT_NOTHING (map unchanged)
sdc: ownership set to comsys-dm1
sdc: not found in pathvec
sdc: mask = 0xc
sdc: state = 2
sdc: prio = 1
sdf: ownership set to comsys-dm1
sdf: not found in pathvec
sdf: mask = 0xc
sdf: state = 2
sdf: prio = 1
sdi: ownership set to comsys-dm1
sdi: not found in pathvec
sdi: mask = 0xc
sdi: state = 2
sdi: prio = 1
sdl: ownership set to comsys-dm1
sdl: not found in pathvec
sdl: mask = 0xc
sdl: state = 2
sdl: prio = 1
comsys-dm1: pgfailover = -1 (internal default)
comsys-dm1: pgpolicy = multibus (LUN setting)
comsys-dm1: selector = round-robin 0 (LUN setting)
comsys-dm1: features = 0 (internal default)
comsys-dm1: hwhandler = 0 (internal default)
comsys-dm1: rr_weight = 1 (internal default)
comsys-dm1: minio = 1000 (config file default)
comsys-dm1: no_path_retry = NONE (internal default)
pg_timeout = NONE (internal default)
comsys-dm1: set ACT_NOTHING (map unchanged)
sdd: ownership set to comsys-backup
sdd: not found in pathvec
sdd: mask = 0xc
sdd: state = 2
sdd: prio = 1
sdg: ownership set to comsys-backup
sdg: not found in pathvec
sdg: mask = 0xc
sdg: state = 2
sdg: prio = 1
sdj: ownership set to comsys-backup
sdj: not found in pathvec
sdj: mask = 0xc
sdj: state = 2
sdj: prio = 1
sdm: ownership set to comsys-backup
sdm: not found in pathvec
sdm: mask = 0xc
sdm: state = 2
sdm: prio = 1
comsys-backup: pgfailover = -1 (internal default)
comsys-backup: pgpolicy = multibus (LUN setting)
comsys-backup: selector = round-robin 0 (LUN setting)
comsys-backup: features = 0 (internal default)
comsys-backup: hwhandler = 0 (internal default)
comsys-backup: rr_weight = 1 (internal default)
comsys-backup: minio = 1000 (config file default)
comsys-backup: no_path_retry = NONE (internal default)
pg_timeout = NONE (internal default)
comsys-backup: set ACT_NOTHING (map unchanged)
下面是相關引數的標準文件的介紹:
Attribute |
Description |
|||||||||
wwid |
Specifies the WWID of the multipath device to which themultipath attributes apply. This parameter is mandatory for this section of themultipath.conf file. |
|||||||||
alias |
Specifies the symbolic name for the multipath device to which themultipath attributes apply. If you are usinguser_friendly_names, do not set this value tompathn; this may conflict with an automatically assigned user friendly name and give you incorrect device node names. |
|||||||||
path_grouping_policy |
|
|||||||||
path_selector |
|
|||||||||
failback |
|
|||||||||
prio |
|
|||||||||
no_path_retry |
|
|||||||||
rr_min_io |
Specifies the number of I/O requests to route to a path before switching to the next path in the current path group. This setting is only for systems running kernels older that 2.6.31. Newer systems should userr_min_io_rq. The default value is 1000. |
|||||||||
rr_min_io_rq |
Specifies the number of I/O requests to route to a path before switching to the next path in the current path group, using request-based device-mapper-multipath. This setting should be used on systems running current kernels. On systems running kernels older than 2.6.31, use rr_min_io. The default value is 1. |
|||||||||
rr_weight |
If set to priorities, then instead of sending rr_min_iorequests to a path before calling path_selector to choose the next path, the number of requests to send is determined byrr_min_io times the path's priority, as determined by theprio function. If set to uniform, all path weights are equal. |
|||||||||
flush_on_last_del |
If set to yes, then multipath will disable queueing when the last path to a device has been deleted. |
3、啟動multipathd服務並設定其自動啟動
[root@seaing ~]#service multipathd restart
[root@seaing ~]#chkconfig --level 345 multipathd on
[root@seaing ~]#chkconfig --list | grep multipathd
4、檢查multipath聚合後的裝置名,以及裝置對應的鏈路情況
[root@seaing ~]# multipath -ll
comsys-dm1 (3600508b4000892b90002a00000090000) dm-3 HP,HSV300
[size=200G][features=0][hwhandler=0][rw]
\_ round-robin 0 [prio=4][active]
\_ 4:0:0:2 sdc 8:32 [active][ready]
\_ 4:0:1:2 sdf 8:80 [active][ready]
\_ 5:0:0:2 sdi 8:128 [active][ready]
\_ 5:0:1:2 sdl 8:176 [active][ready]
comsys-dm0 (3600508b4000892b90002a00000050000) dm-2 HP,HSV300
[size=100G][features=0][hwhandler=0][rw]
\_ round-robin 0 [prio=4][active]
\_ 4:0:0:1 sdb 8:16 [active][ready]
\_ 4:0:1:1 sde 8:64 [active][ready]
\_ 5:0:0:1 sdh 8:112 [active][ready]
\_ 5:0:1:1 sdk 8:160 [active][ready]
comsys-backup (3600508b4000892b90002a00000140000) dm-4 HP,HSV300
[size=100G][features=0][hwhandler=0][rw]
\_ round-robin 0 [prio=4][active]
\_ 4:0:0:3 sdd 8:48 [active][ready]
\_ 4:0:1:3 sdg 8:96 [active][ready]
\_ 5:0:0:3 sdj 8:144 [active][ready]
\_ 5:0:1:3 sdm 8:192 [active][ready]
5、檢查配置是否成功
如果配置正確的話就會在/dev/mapper/目錄下多出mpath0、mpath1(自動分配的名稱)等之類裝置,但是因為作者在配置的時候,起了別名,所以會使用別名來代替自動分配的名稱
[root@seaing ~]# ll /dev/mapper/
total 0
brw-rw---- 1 root disk 253, 4 Oct 26 14:30 comsys-backup
brw-rw---- 1 root disk 253, 2 Oct 26 14:30 comsys-dm0
brw-rw---- 1 root disk 253, 3 Oct 26 14:30 comsys-dm1
crw------- 1 root root 10, 63 Oct 26 14:30 control
brw-rw---- 1 root disk 253, 0 Oct 26 14:30 VolGroup00-LogVol00
brw-rw---- 1 root disk 253, 1 Oct 26 14:30 VolGroup00-LogVol01
用fdisk -l命令可以看到多路徑軟體建立的磁碟,如下圖中的/dev/dm-[0-3]
[root@seaing ~]# fdisk -l
Disk /dev/sda: 500.1 GB, 500107862016 bytes
255 heads, 63 sectors/track, 60801 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Device Boot Start End Blocks Id System
/dev/sda1 * 1 13 104391 83 Linux
/dev/sda2 14 60801 488279610 8e Linux LVM
Disk /dev/sdb: 107.3 GB, 107374182400 bytes
255 heads, 63 sectors/track, 13054 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Disk /dev/sdb doesn't contain a valid partition table
Disk /dev/sdc: 214.7 GB, 214748364800 bytes
255 heads, 63 sectors/track, 26108 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Disk /dev/sdc doesn't contain a valid partition table
Disk /dev/sdd: 107.3 GB, 107374182400 bytes
255 heads, 63 sectors/track, 13054 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Disk /dev/sdd doesn't contain a valid partition table
Disk /dev/sde: 107.3 GB, 107374182400 bytes
255 heads, 63 sectors/track, 13054 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Disk /dev/sde doesn't contain a valid partition table
Disk /dev/sdf: 214.7 GB, 214748364800 bytes
255 heads, 63 sectors/track, 26108 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Disk /dev/sdf doesn't contain a valid partition table
Disk /dev/sdg: 107.3 GB, 107374182400 bytes
255 heads, 63 sectors/track, 13054 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Disk /dev/sdg doesn't contain a valid partition table
Disk /dev/sdh: 107.3 GB, 107374182400 bytes
255 heads, 63 sectors/track, 13054 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Disk /dev/sdh doesn't contain a valid partition table
Disk /dev/sdi: 214.7 GB, 214748364800 bytes
255 heads, 63 sectors/track, 26108 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Disk /dev/sdi doesn't contain a valid partition table
Disk /dev/sdj: 107.3 GB, 107374182400 bytes
255 heads, 63 sectors/track, 13054 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Disk /dev/sdj doesn't contain a valid partition table
Disk /dev/sdk: 107.3 GB, 107374182400 bytes
255 heads, 63 sectors/track, 13054 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Disk /dev/sdk doesn't contain a valid partition table
Disk /dev/sdl: 214.7 GB, 214748364800 bytes
255 heads, 63 sectors/track, 26108 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Disk /dev/sdl doesn't contain a valid partition table
Disk /dev/sdm: 107.3 GB, 107374182400 bytes
255 heads, 63 sectors/track, 13054 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Disk /dev/sdm doesn't contain a valid partition table
Disk /dev/dm-2: 107.3 GB, 107374182400 bytes
255 heads, 63 sectors/track, 13054 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Disk /dev/dm-2 doesn't contain a valid partition table
Disk /dev/dm-3: 214.7 GB, 214748364800 bytes
255 heads, 63 sectors/track, 26108 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Disk /dev/dm-3 doesn't contain a valid partition table
Disk /dev/dm-4: 107.3 GB, 107374182400 bytes
255 heads, 63 sectors/track, 13054 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Disk /dev/dm-4 doesn't contain a valid partition table
[root@seaing ~]# ll /dev/mpath/
total 0
lrwxrwxrwx 1 root root 7 Oct 26 14:30 comsys-backup -> ../dm-4
lrwxrwxrwx 1 root root 7 Oct 26 14:30 comsys-dm0 -> ../dm-2
lrwxrwxrwx 1 root root 7 Oct 26 14:30 comsys-dm1 -> ../dm-3
multipath基本操作命令
[root@seaing ~]#/etc/init.d/multipathd
start #開啟mulitipath服務
[root@seaing ~]#multipath -F #刪除現有路徑
[root@seaing ~]#multipath -v2 #格式化路徑
[root@seaing ~]#multipath -ll #檢視多路徑
三、multipath的使用案例
要對多路徑軟體生成的磁碟進行操作直接操作/dev/mapper/目錄下的磁碟就行。在對多路徑軟體生成的磁碟進行分割槽之前最好執行一下pvcreate命令:
[root@seaing ~]# pvcreate /dev/mapper/comsys-dm0
Physical volume "/dev/mapper/comsys-dm0" successfully created
[root@seaing ~]#
[root@seaing ~]# pvs
PV VG Fmt Attr PSize PFree
/dev/dm-2 lvm2 -- 100.00G 100.00G
/dev/sda2 VolGroup00 lvm2 a- 465.66G 0
[root@seaing ~]# fdisk /dev/mapper/comsys-dm0
Device contains neither a valid DOS partition table, nor Sun, SGI or OSF disklabel
Building a new DOS disklabel. Changes will remain in memory only,
until you decide to write them. After that, of course, the previous
content won't be recoverable.
The number of cylinders for this disk is set to 13054.
There is nothing wrong with that, but this is larger than 1024,
and could in certain setups cause problems with:
1) software that runs at boot time (e.g., old versions of LILO)
2) booting and partitioning software from other OSs
(e.g., DOS FDISK, OS/2 FDISK)
Warning: invalid flag 0x0000 of partition table 4 will be corrected by w(rite)
Command (m for help): n
Command action
e extended
p primary partition (1-4)
p
Partition number (1-4): 1
First cylinder (1-13054, default 1):
Using default value 1
Last cylinder or +size or +sizeM or +sizeK (1-13054, default 13054): +10G
Command (m for help): p
Disk /dev/mapper/comsys-dm0: 107.3 GB, 107374182400 bytes
255 heads, 63 sectors/track, 13054 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Device Boot Start End Blocks Id System
/dev/mapper/comsys-dm0p1 1 1217 9775521 83 Linux
Command (m for help): n
Command action
e extended
p primary partition (1-4)
p
Partition number (1-4): 2
First cylinder (1218-13054, default 1218):
Using default value 1218
Last cylinder or +size or +sizeM or +sizeK (1218-13054, default 13054): +20G
Command (m for help): p
Disk /dev/mapper/comsys-dm0: 107.3 GB, 107374182400 bytes
255 heads, 63 sectors/track, 13054 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Device Boot Start End Blocks Id System
/dev/mapper/comsys-dm0p1 1 1217 9775521 83 Linux
/dev/mapper/comsys-dm0p2 1218 3650 19543072+ 83 Linux
Command (m for help): w
The partition table has been altered!
Calling ioctl() to re-read partition table.
WARNING: Re-reading the partition table failed with error 22: Invalid argument.
The kernel still uses the old table.
The new table will be used at the next reboot.
Syncing disks.
用fdisk對多路徑軟體生成的磁碟進行分割槽儲存時會有一個報錯,此報錯不用理會。
[root@seaing ~]# fdisk -l
Disk /dev/sda: 500.1 GB, 500107862016 bytes
255 heads, 63 sectors/track, 60801 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Device Boot Start End Blocks Id System
/dev/sda1 * 1 13 104391 83 Linux
/dev/sda2 14 60801 488279610 8e Linux LVM
Disk /dev/sdb: 107.3 GB, 107374182400 bytes
255 heads, 63 sectors/track, 13054 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Device Boot Start End Blocks Id System
Disk /dev/sdc: 214.7 GB, 214748364800 bytes
255 heads, 63 sectors/track, 26108 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Disk /dev/sdc doesn't contain a valid partition table
Disk /dev/sdd: 107.3 GB, 107374182400 bytes
255 heads, 63 sectors/track, 13054 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Disk /dev/sdd doesn't contain a valid partition table
Disk /dev/sde: 107.3 GB, 107374182400 bytes
255 heads, 63 sectors/track, 13054 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Device Boot Start End Blocks Id System
Disk /dev/sdf: 214.7 GB, 214748364800 bytes
255 heads, 63 sectors/track, 26108 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Disk /dev/sdf doesn't contain a valid partition table
Disk /dev/sdg: 107.3 GB, 107374182400 bytes
255 heads, 63 sectors/track, 13054 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Disk /dev/sdg doesn't contain a valid partition table
Disk /dev/sdh: 107.3 GB, 107374182400 bytes
255 heads, 63 sectors/track, 13054 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Device Boot Start End Blocks Id System
Disk /dev/sdi: 214.7 GB, 214748364800 bytes
255 heads, 63 sectors/track, 26108 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Disk /dev/sdi doesn't contain a valid partition table
Disk /dev/sdj: 107.3 GB, 107374182400 bytes
255 heads, 63 sectors/track, 13054 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Disk /dev/sdj doesn't contain a valid partition table
Disk /dev/sdk: 107.3 GB, 107374182400 bytes
255 heads, 63 sectors/track, 13054 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Device Boot Start End Blocks Id System
Disk /dev/sdl: 214.7 GB, 214748364800 bytes
255 heads, 63 sectors/track, 26108 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Disk /dev/sdl doesn't contain a valid partition table
Disk /dev/sdm: 107.3 GB, 107374182400 bytes
255 heads, 63 sectors/track, 13054 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Disk /dev/sdm doesn't contain a valid partition table
Disk /dev/dm-2: 107.3 GB, 107374182400 bytes
255 heads, 63 sectors/track, 13054 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Device Boot Start End Blocks Id System
/dev/dm-2p1 1 1217 9775521 83 Linux
/dev/dm-2p2 1218 3650 19543072+ 83 Linux
Disk /dev/dm-3: 214.7 GB, 214748364800 bytes
255 heads, 63 sectors/track, 26108 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Disk /dev/dm-3 doesn't contain a valid partition table
Disk /dev/dm-4: 107.3 GB, 107374182400 bytes
255 heads, 63 sectors/track, 13054 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Disk /dev/dm-4 doesn't contain a valid partition table
fdisk對多路徑軟體生成的磁碟進行分割槽之後,所生成的磁碟分割槽並沒有馬上新增到/dev/目錄下,此時我們要重啟IPSAN或者FCSAN的驅動,如果是用iscsi-initiator來連線IPSAN的重啟ISCSI服務就可以發現所生成的磁碟分割槽了;如果是FCSAN的話,需要重新啟動作業系統才能識別到。
[root@seaing ~]# ll /dev/dm*
brw-rw---- 1 root root 253, 2 Oct 26 14:20 /dev/dm-2
brw-rw---- 1 root root 253, 3 Oct 26 14:15 /dev/dm-3
brw-rw---- 1 root root 253, 4 Oct 26 14:15 /dev/dm-4
[root@seaing ~]#
[root@seaing ~]# ll /dev/mapper/
total 0
brw-rw---- 1 root disk 253, 4 Oct 26 14:15 comsys-backup
brw-rw---- 1 root disk 253, 2 Oct 26 14:22 comsys-dm0
brw-rw---- 1 root disk 253, 3 Oct 26 14:15 comsys-dm1
crw------- 1 root root 10, 63 Oct 26 14:15 control
brw-rw---- 1 root disk 253, 0 Oct 26 14:15 VolGroup00-LogVol00
brw-rw---- 1 root disk 253, 1 Oct 26 14:15 VolGroup00-LogVol01
重啟作業系統之後
如下的comsys-dm0p1和comsys-dm0p2就是我們對multipath磁碟進行的分割槽
[root@seaing ~]# ll /dev/mapper/
total 0
brw-rw---- 1 root disk 253, 4 Oct 26 14:30 comsys-backup
brw-rw---- 1 root disk 253, 2 Oct 26 14:30 comsys-dm0
brw-rw---- 1 root disk 253, 5 Oct 26 14:35 comsys-dm0p1
brw-rw---- 1 root disk 253, 6 Oct 26 14:30 comsys-dm0p2
brw-rw---- 1 root disk 253, 3 Oct 26 14:30 comsys-dm1
crw------- 1 root root 10, 63 Oct 26 14:30 control
[root@seaing ~]# ll /dev/dm*
brw-rw---- 1 root root 253, 2 Oct 26 14:30 /dev/dm-2
brw-rw---- 1 root root 253, 3 Oct 26 14:30 /dev/dm-3
brw-rw---- 1 root root 253, 4 Oct 26 14:30 /dev/dm-4
brw-rw---- 1 root root 253, 5 Oct 26 14:30 /dev/dm-5
brw-rw---- 1 root root 253, 6 Oct 26 14:30 /dev/dm-6
[root@seaing ~]# ll /dev/mpath/
total 0
lrwxrwxrwx 1 root root 7 Oct 26 14:30 comsys-backup -> ../dm-4
lrwxrwxrwx 1 root root 7 Oct 26 14:30 comsys-dm0 -> ../dm-2
lrwxrwxrwx 1 root root 7 Oct 26 14:30 comsys-dm0p1 -> ../dm-5
lrwxrwxrwx 1 root root 7 Oct 26 14:30 comsys-dm0p2 -> ../dm-6
lrwxrwxrwx 1 root root 7 Oct 26 14:30 comsys-dm1 -> ../dm-3
[root@seaing ~]# fdisk -l
Disk /dev/sda: 500.1 GB, 500107862016 bytes
255 heads, 63 sectors/track, 60801 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Device Boot Start End Blocks Id System
/dev/sda1 * 1 13 104391 83 Linux
/dev/sda2 14 60801 488279610 8e Linux LVM
Disk /dev/sdb: 107.3 GB, 107374182400 bytes
255 heads, 63 sectors/track, 13054 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Device Boot Start End Blocks Id System
/dev/sdb1 1 1217 9775521 83 Linux
/dev/sdb2 1218 3650 19543072+ 83 Linux
Disk /dev/sdc: 214.7 GB, 214748364800 bytes
255 heads, 63 sectors/track, 26108 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Disk /dev/sdc doesn't contain a valid partition table
Disk /dev/sdd: 107.3 GB, 107374182400 bytes
255 heads, 63 sectors/track, 13054 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Disk /dev/sdd doesn't contain a valid partition table
Disk /dev/sde: 107.3 GB, 107374182400 bytes
255 heads, 63 sectors/track, 13054 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Device Boot Start End Blocks Id System
/dev/sde1 1 1217 9775521 83 Linux
/dev/sde2 1218 3650 19543072+ 83 Linux
Disk /dev/sdf: 214.7 GB, 214748364800 bytes
255 heads, 63 sectors/track, 26108 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Disk /dev/sdf doesn't contain a valid partition table
Disk /dev/sdg: 107.3 GB, 107374182400 bytes
255 heads, 63 sectors/track, 13054 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Disk /dev/sdg doesn't contain a valid partition table
Disk /dev/sdh: 107.3 GB, 107374182400 bytes
255 heads, 63 sectors/track, 13054 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Device Boot Start End Blocks Id System
/dev/sdh1 1 1217 9775521 83 Linux
/dev/sdh2 1218 3650 19543072+ 83 Linux
Disk /dev/sdi: 214.7 GB, 214748364800 bytes
255 heads, 63 sectors/track, 26108 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Disk /dev/sdi doesn't contain a valid partition table
Disk /dev/sdj: 107.3 GB, 107374182400 bytes
255 heads, 63 sectors/track, 13054 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Disk /dev/sdj doesn't contain a valid partition table
Disk /dev/sdk: 107.3 GB, 107374182400 bytes
255 heads, 63 sectors/track, 13054 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Device Boot Start End Blocks Id System
/dev/sdk1 1 1217 9775521 83 Linux
/dev/sdk2 1218 3650 19543072+ 83 Linux
Disk /dev/sdl: 214.7 GB, 214748364800 bytes
255 heads, 63 sectors/track, 26108 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Disk /dev/sdl doesn't contain a valid partition table
Disk /dev/sdm: 107.3 GB, 107374182400 bytes
255 heads, 63 sectors/track, 13054 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Disk /dev/sdm doesn't contain a valid partition table
Disk /dev/dm-2: 107.3 GB, 107374182400 bytes
255 heads, 63 sectors/track, 13054 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Device Boot Start End Blocks Id System
/dev/dm-2p1 1 1217 9775521 83 Linux
/dev/dm-2p2 1218 3650 19543072+ 83 Linux
Disk /dev/dm-3: 214.7 GB, 214748364800 bytes
255 heads, 63 sectors/track, 26108 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Disk /dev/dm-3 doesn't contain a valid partition table
Disk /dev/dm-4: 107.3 GB, 107374182400 bytes
255 heads, 63 sectors/track, 13054 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Disk /dev/dm-4 doesn't contain a valid partition table
Disk /dev/dm-5: 10.0 GB, 10010133504 bytes
255 heads, 63 sectors/track, 1216 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Disk /dev/dm-5 doesn't contain a valid partition table
Disk /dev/dm-6: 20.0 GB, 20012106240 bytes
255 heads, 63 sectors/track, 2433 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Disk /dev/dm-6 doesn't contain a valid partition table
對comsys-dm0p1分割槽格式化成ext3檔案系統
[root@seaing ~]# mkfs.ext3 /dev/mapper/comsys-dm0p1
mke2fs 1.39 (29-May-2006)
Filesystem label=
OS type: Linux
Block size=4096 (log=2)
Fragment size=4096 (log=2)
1224000 inodes, 2443880 blocks
122194 blocks (5.00%) reserved for the super user
First data block=0
Maximum filesystem blocks=2503999488
75 block groups
32768 blocks per group, 32768 fragments per group
16320 inodes per group
Superblock backups stored on blocks:
32768, 98304, 163840, 229376, 294912, 819200, 884736, 1605632
Writing inode tables: done
Creating journal (32768 blocks): done
Writing superblocks and filesystem accounting information: done
This filesystem will be automatically checked every 27 mounts or
180 days, whichever comes first. Use tune2fs -c or -i to override.
[root@seaing ~]#
[root@seaing ~]#
[root@seaing ~]# df -h
Filesystem Size Used Avail Use% Mounted on
/dev/mapper/VolGroup00-LogVol00
434G 8.4G 404G 3% /
/dev/sda1 99M 18M 77M 19% /boot
tmpfs 7.9G 0 7.9G 0% /dev/shm
/software/rhel5.5-x86_64.iso
3.5G 3.5G 0 100% /mnt/dvd
將/dev/mapper/comsys-dm0p1掛載到/comsys目錄下
[root@seaing ~]# mount /dev/mapper/comsys-dm0p1 /comsys/
[root@seaing ~]#
[root@seaing ~]# df -h
Filesystem Size Used Avail Use% Mounted on
/dev/mapper/VolGroup00-LogVol00
434G 8.4G 404G 3% /
/dev/sda1 99M 18M 77M 19% /boot
tmpfs 7.9G 0 7.9G 0% /dev/shm
/software/rhel5.5-x86_64.iso
3.5G 3.5G 0 100% /mnt/dvd
/dev/mapper/comsys-dm0p1
9.2G 150M 8.6G 2% /comsys
當然,也可以將磁碟建立成物理卷,然後在物理卷基礎上建立卷組,然後建立邏輯卷,最後在格式化成檔案系統進行掛載,下面的案例就是透過這種方法實現的(注意:下面的案例與上面的案例並沒有聯絡,讀者朋友請注意!)
[root@seaing ~]# ll /dev/mapper/
total 0
brw-rw---- 1 root disk 253, 4 Oct 25 11:14 comsys-backup
brw-rw---- 1 root disk 253, 2 Oct 25 11:14 comsys-dm0
brw-rw---- 1 root disk 253, 5 Oct 25 11:14 comsys-dm0p1
brw-rw---- 1 root disk 253, 6 Oct 25 11:14 comsys-dm0p2
brw-rw---- 1 root disk 253, 7 Oct 25 11:14 comsys-dm0p3
brw-rw---- 1 root disk 253, 3 Oct 25 11:14 comsys-dm1
crw------- 1 root root 10, 63 Oct 25 11:14 control
brw-rw---- 1 root disk 253, 0 Oct 25 11:14 VolGroup00-LogVol00
brw-rw---- 1 root disk 253, 1 Oct 25 11:14 VolGroup00-LogVol01
[root@seaing ~]#
[root@seaing ~]#
[root@seaing ~]# mkdir /backup
[root@seaing ~]#
[root@seaing ~]# mount /dev/mapper/comsys-backup /backup
mount: you must specify the filesystem type
[root@seaing ~]# pvs
PV VG Fmt Attr PSize PFree
/dev/sda2 VolGroup00 lvm2 a- 465.66G 0
[root@seaing ~]#
[root@seaing ~]# vgs
VG #PV #LV #SN Attr VSize VFree
VolGroup00 1 2 0 wz--n- 465.66G 0
[root@seaing ~]#
[root@seaing ~]# lvs
LV VG Attr LSize Origin Snap% Move Log Copy% Convert
LogVol00 VolGroup00 -wi-ao 448.03G
LogVol01 VolGroup00 -wi-ao 17.62G
[root@seaing ~]#
[root@seaing ~]# pvcreate /dev/mapper/comsys-backup
Physical volume "/dev/mapper/comsys-backup" successfully created
[root@seaing ~]#
[root@seaing ~]# pvs
PV VG Fmt Attr PSize PFree
/dev/dm-4 lvm2 -- 100.00G 100.00G
/dev/sda2 VolGroup00 lvm2 a- 465.66G 0
[root@seaing ~]#
[root@seaing ~]# vgcreate vg_backup /dev/mapper/comsys-backup
Volume group "vg_backup" successfully created
[root@seaing ~]#
[root@seaing ~]#
[root@seaing ~]# vgs
VG #PV #LV #SN Attr VSize VFree
VolGroup00 1 2 0 wz--n- 465.66G 0
vg_backup 1 0 0 wz--n- 100.00G 100.00G
[root@seaing ~]#
[root@seaing ~]# pvs
PV VG Fmt Attr PSize PFree
/dev/dm-4 vg_backup lvm2 a- 100.00G 100.00G
/dev/sda2 VolGroup00 lvm2 a- 465.66G 0
[root@seaing ~]#
[root@seaing ~]#
[root@seaing ~]# lvcreate -L 20G -n lv_backup vg_backup
Logical volume "lv_backup" created
[root@seaing ~]#
[root@seaing ~]# lvs
LV VG Attr LSize Origin Snap% Move Log Copy% Convert
LogVol00 VolGroup00 -wi-ao 448.03G
LogVol01 VolGroup00 -wi-ao 17.62G
lv_backup vg_backup -wi-a- 20.00G
[root@seaing ~]#
[root@seaing ~]#
[root@seaing ~]# mkfs.ext3 /dev/vg_backup/lv_backup
mke2fs 1.39 (29-May-2006)
Filesystem label=
OS type: Linux
Block size=4096 (log=2)
Fragment size=4096 (log=2)
2621440 inodes, 5242880 blocks
262144 blocks (5.00%) reserved for the super user
First data block=0
Maximum filesystem blocks=4294967296
160 block groups
32768 blocks per group, 32768 fragments per group
16384 inodes per group
Superblock backups stored on blocks:
32768, 98304, 163840, 229376, 294912, 819200, 884736, 1605632, 2654208,
4096000
Writing inode tables: done
Creating journal (32768 blocks): done
Writing superblocks and filesystem accounting information: done
This filesystem will be automatically checked every 20 mounts or
180 days, whichever comes first. Use tune2fs -c or -i to override.
[root@seaing ~]#
[root@seaing ~]#
[root@seaing ~]# mount /dev/vg_backup/lv_backup /backup
[root@seaing ~]# df -h
Filesystem Size Used Avail Use% Mounted on
/dev/mapper/VolGroup00-LogVol00
434G 4.9G 407G 2% /
/dev/sda1 99M 18M 77M 19% /boot
tmpfs 7.9G 0 7.9G 0% /dev/shm
/dev/mapper/vg_backup-lv_backup
20G 173M 19G 1% /backup
關於Linux多路徑故障切換與負載均衡測試案例,請關注作者的另一篇博文《Linux多路徑故障切換與負載均衡測試》!
作者:SEian.G(苦練七十二變,笑對八十一難)
來自 “ ITPUB部落格 ” ,連結:http://blog.itpub.net/31015730/viewspace-2146732/,如需轉載,請註明出處,否則將追究法律責任。
相關文章
- linux多路徑multipath配置Linux
- multipath多路徑配置
- Linux平臺的多路徑軟體multipath的使用案例Linux
- linux之 multipath 多路徑Linux
- Linux配置和管理裝置對映多路徑multipathLinux
- linux iscsi multipath多路徑及名稱持久化配置Linux持久化
- redhat multipath多路徑 DMRedhat
- LINUX 多路徑對映Multipath與正規表示式Linux
- rhel 6 對映多路徑(DM Multipath)配置及管理
- Oracle Linux 7.8 多路徑(Multipath)+Udev繫結磁碟OracleLinuxdev
- centos上iscsi+multipath多路徑儲存配置手冊CentOS
- Linux 下配置多路徑Linux
- linux redhat 6.5 多路徑配置LinuxRedhat
- 【多路徑】EMC儲存多路徑軟體配置
- 使用OpenFiler來模擬儲存配置RAC中ASM共享盤及多路徑(multipath)的測試ASM
- Redhat5.4 Linux多路徑dm-multipath之multi-path詳解RedhatLinux
- Redhat7 Udev繫結(DM multipath)多路徑裝置Redhatdev
- 儲存-配置多路徑
- RedHat 5.4上iscsi+multipath多路徑儲存配置獲取裝置的wwidRedhat
- LINUX LOG(多路徑)Linux
- Linux環境iSCSI儲存及多路徑功能配置Linux
- linux_unix_aix_hp_solaris multi path多路徑配置LinuxAI
- Linux平臺上配置Oracle ASMLib和磁碟多路徑LinuxOracleASM
- linux 儲存多路徑軟體Linux
- linux多路徑下線上新增磁碟Linux
- linux配置multipath 並安裝racLinux
- 多路徑時99-oracle-asmdevices.rules的配置OracleASMdev
- 儲存多路徑故障導致資料庫死掉案例資料庫
- 記錄下物理機bond配置及物理機多路徑配置
- 多路徑軟體安裝使用方法
- 華為儲存多路徑
- 多路徑軟體介紹
- iscsi與multipath搭建
- Linux的multipath for ASMLinuxASM
- multipath配置詳細參考
- UDEV掛載EMC多路徑盤dev
- 多路徑重用歸檔日誌
- IBM儲存多路徑軟體IBM