md3600i存储服务器连接 iscsi+multipath配置
生活随笔
收集整理的這篇文章主要介紹了
md3600i存储服务器连接 iscsi+multipath配置
小編覺得挺不錯的,現在分享給大家,幫大家做個參考.
md3600i存儲服務器連接 iscsi+multipath配置
存儲器:dell ms3600i
?? ?管理IP:192.168.128.101
?? ?RAID0 iSCSI ip1:192.168.10.11
?? ?RAID0 iSCSI ip2:192.168.10.12
?? ?RAID1 iSCSI ip1:192.168.10.13
?? ?RAID1 iSCSI ip2:192.168.10.14
操作系統:centos6.3
?? ?/etc/hosts
?? ?192.168.10.101? rac1
?? ?192.168.10.111 rac1-vip
?? ?192.168.20.101? rac1-private
?? ?192.168.10.102? rac2
?? ?192.168.20.102? rac2-private
?? ?192.168.10.112 rac2-vip
?? ?#scan ip
?? ?192.168.10.100????? rac-scan
存儲器IP端口無法ping ,找到原因:此端口設置了一個ipv4: [Y]以太網優先級
以致無法ping
******************************************************************************
iscsi 命令:
1.發現iscsi存儲: iscsiadm -m discovery -t st -p ISCSI_IP
2.查看iscsi發現記錄 iscsiadm -m node
3.刪除iscsi發現記錄 iscsiadm -m node -o delete -T LUN_NAME -p ISCSI_IP
4.登錄iscsi存儲 iscsiadm -m node -T LUN_NAME -p ISCSI_IP -l
5.登出iscsi存儲 iscsiadm -m node -T LUN_NAME -p ISCSI_IP -u
---------------------------------------------------------------------
安裝步驟:
1.檢查是否安裝iscsi-initiator-utils
[root@localhost ~]# rpm -qa iscsi-initiator-utils
iscsi-initiator-utils-6.2.0.872-41.el6.x86_64
2.添加連接
[root@localhost ~]# iscsiadm -m discovery -t sendtargets -p 192.168.10.11:3260
注:此命令會把所有端口都保存到可以訪問的線路列表中。系統在重啟時,會從此列表中,各個線路進行測試檢查。如果不能訪問,會出
錯誤提示:
?? ??? ?Mar 20 13:20:22 rac2 kernel: sd 8:0:0:3: SCSI error: return code = 0x08000002
?? ??? ?Mar 20 13:20:22 rac2 kernel: Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE,SUGGEST_OK
?? ??? ?Mar 20 13:20:22 rac2 kernel: sdu: Current: sense key: Illegal Request
?? ??? ?Mar 20 13:20:22 rac2 kernel:???? <<vendor>> ASC=0x94 ASCQ=0x1ASC=0x94 ASCQ=0x1
192.168.10.11:3260,1 iqn.1984-05.com.dell:powervault.md3600i.690b11c0002be7310000000051197871
192.168.10.12:3260,1 iqn.1984-05.com.dell:powervault.md3600i.690b11c0002be7310000000051197871
192.168.10.13:3260,2 iqn.1984-05.com.dell:powervault.md3600i.690b11c0002be7310000000051197871
192.168.10.14:3260,2 iqn.1984-05.com.dell:powervault.md3600i.690b11c0002be7310000000051197871
#刪除用不到的控制器2的兩個接口
[root@rac2 ~]# iscsiadm -m node -o delete -T iqn.1984-05.com.dell:powervault.md3600i.690b11c0002be7310000000051197871? -p 192.168.10.13:3260
[root@rac2 ~]# iscsiadm -m node -o delete -T iqn.1984-05.com.dell:powervault.md3600i.690b11c0002be7310000000051197871? -p 192.168.10.14:3260
#用控制器1的兩個接口的IP登錄
[root@localhost ~]# iscsiadm -m node -T iqn.1984-05.com.dell:powervault.md3600i.690b11c0002be7310000000051197871? -p 192.168.10.11:3260 --login
[root@localhost ~]# iscsiadm -m node -T iqn.1984-05.com.dell:powervault.md3600i.690b11c0002be7310000000051197871? -p 192.168.10.12:3260 --login
[root@localhost ~]# iscsiadm -m session?? #訪問路徑,這只是說明,這個列表中的路徑,已在訪問成功中。
tcp: [1] 192.168.10.13:3260,2 iqn.1984-05.com.dell:powervault.md3600i.690b11c0002be7310000000051197871
tcp: [2] 192.168.10.11:3260,1 iqn.1984-05.com.dell:powervault.md3600i.690b11c0002be7310000000051197871
*******************************************************************
Linux系統用device-mapper multipathing driver管理
http://www.aixchina.net/home/space.php?uid=2947&do=blog&id=31276
REDHAT 官方說明
https://access.redhat.com/knowledge/docs/en-US/Red_Hat_Enterprise_Linux/5/html/DM_Multipath/config_file_defaults.html
1、multipath.conf文件的配置
# This is a basic configuration file with some examples, for device mapper
# multipath.
# For a complete list of the default configuration values, see
# /usr/share/doc/device-mapper-multipath-0.4.9/multipath.conf.defaults
# For a list of configuration options with descriptions, see
# /usr/share/doc/device-mapper-multipath-0.4.9/multipath.conf.annotated
#注:因各版本的配置不太一樣,千萬不能使用網絡上看到的別人的配置文件拷貝過來就用,有些參數在各版本中不支持。
#會出錯,但錯誤信息又不顯示。
blacklist {
? devnode "^sda"
}
defaults {
? user_friendly_names?? yes
? path_grouping_policy? multibus multibus #默認的路徑組策略
? failback?? ??? ?immediate#故障恢復的模式
? no_path_retry ?? ?fail#在disable queue之前系統嘗試使用失效路徑的次數的數值
?
? #加上后面3個參數后,無法初始化多路,可能是此版本不支持
? #getuid_callout "/sbin/scsi_id -g -u -s /block/%n" #獲得唯一設備號使用的默認程序
? #prio_callout????? "/sbin/acs_prio_alua %d" #獲取有限級數值使用的默認程序
? #path_selector "round-robin 0" #選擇那條路徑進行下一個IO操作的方法
}
multipaths {
?? ?multipath {
?? ?wwid 3690b11c0002be80e00000ce3514380db
?? ?alias asm-crs01
?? ?}
?? ?multipath {
?? ?wwid 3690b11c0002be80e00000ce5514380f8
?? ?alias asm-data01
?? ?}
?? ?multipath {
?? ?wwid 3690b11c0002be80e00000ce75143810c
?? ?alias asm-data02
?? ?}
?? ?multipath {
?? ?wwid 3690b11c0002be80e00000ce95143811c
?? ?alias asm-recovery01
?? ?}
?? ?multipath {
?? ?wwid 3690b11c0002be7310000099851438137
?? ?alias asm-recovery02
?? ?}
}
# vi /etc/multipath.conf
#/usr/share/doc/device-mapper-multipath-0.4.9/multipath.conf.defaults
----------------------------------------------------------------------------------
4、常用的一些multipath工具
清空已有的multipath記錄
multipath -F
掃描磁盤,系統中會出現鏈路聚合之后的dm設備,同時也會在/dev/mapper/、/dev/mpath/目錄下生成相應的設備。
multipath -v2
查看multipath拓撲結構
multipath -ll
--------------------------------------------------------------------
[root@rac1-private mapper]# multipath -ll
Mar 06 15:13:50 | DM multipath kernel driver not loaded
Mar 06 15:13:50 | DM multipath kernel driver not loaded
如果模塊沒有加載成功請使用下列命初始化DM,或重啟系統
[root@rac1-private mapper]# modprobe dm-multipath
[root@rac1-private mapper]# modprobe dm-round-robin
[root@rac1-private mapper]# service multipathd start
正在啟動守護進程multipathd:
[root@rac1-private mapper]# multipath –v2
[root@rac1-private mapper]# multipath -ll
?modprobe dm-multipath
?modprobe dm-round-robin
?service multipathd start
?multipath –v2
初始化完了之后再通過multipath -ll命令查看是否加載成功
[root@rac2 ~]# multipath -ll
mpathr (3690b11c0002be80e000005285136a6f9) dm-2 DELL,MD36xxi
size=2.0T features='0' hwhandler='0' wp=rw
`-+- policy='round-robin 0' prio=1 status=active
? |- 2:0:0:1 sdf 8:80? active ready? running
? |- 5:0:0:1 sdi 8:128 active ready? running
? |- 3:0:0:1 sdg 8:96? failed faulty running
? `- 4:0:0:1 sdh 8:112 failed faulty running
mpathq (3690b11c0002be731000004b25136a708) dm-1 DELL,MD36xxi
size=2.0T features='0' hwhandler='0' wp=rw
`-+- policy='round-robin 0' prio=1 status=active
? |- 3:0:0:2 sdl 8:176 active ready? running
? |- 4:0:0:2 sdk 8:160 active ready? running
? |- 2:0:0:2 sdj 8:144 failed faulty running
? `- 5:0:0:2 sdm 8:192 failed faulty running
mpathp (3690b11c0002be731000004b05136a6d9) dm-0 DELL,MD36xxi
size=4.1G features='0' hwhandler='0' wp=rw
`-+- policy='round-robin 0' prio=1 status=active
? |- 3:0:0:0 sdc 8:32? active ready? running
? |- 4:0:0:0 sdd 8:48? active ready? running
? |- 2:0:0:0 sdb 8:16? failed faulty running
? `- 5:0:0:0 sde 8:64? failed faulty running
#? 看到只有兩條線路是正常的。后來撥插了網線,看到兩張控制卡,各工作一條網線。
測試多路的速度及負載均衡
dd if=/dev/zero if=/dev/mapper/mpatha bs=1M count=200
iostat
multipath磁盤的基本操作
要對多路徑軟件生成的磁盤進行操作直接操作/dev/mapper/目錄下的磁盤就行.
在對多路徑軟件生成的磁盤進行分區之前最好運行一下pvcreate命令
(原因:http://book.51cto.com/art/201012/240911.htm):
# pvcreate /dev/mapper/mpath0
# fdisk /dev/mapper/mpath0
[root@rac2 ~]# /etc/init.d/oracleasm createdisk CRS1 /dev/mapper/asmvol1
Marking disk "CRS1" as an ASM disk:??????????????????????? [? OK? ]
存儲器:dell ms3600i
?? ?管理IP:192.168.128.101
?? ?RAID0 iSCSI ip1:192.168.10.11
?? ?RAID0 iSCSI ip2:192.168.10.12
?? ?RAID1 iSCSI ip1:192.168.10.13
?? ?RAID1 iSCSI ip2:192.168.10.14
操作系統:centos6.3
?? ?/etc/hosts
?? ?192.168.10.101? rac1
?? ?192.168.10.111 rac1-vip
?? ?192.168.20.101? rac1-private
?? ?192.168.10.102? rac2
?? ?192.168.20.102? rac2-private
?? ?192.168.10.112 rac2-vip
?? ?#scan ip
?? ?192.168.10.100????? rac-scan
存儲器IP端口無法ping ,找到原因:此端口設置了一個ipv4: [Y]以太網優先級
以致無法ping
******************************************************************************
iscsi 命令:
1.發現iscsi存儲: iscsiadm -m discovery -t st -p ISCSI_IP
2.查看iscsi發現記錄 iscsiadm -m node
3.刪除iscsi發現記錄 iscsiadm -m node -o delete -T LUN_NAME -p ISCSI_IP
4.登錄iscsi存儲 iscsiadm -m node -T LUN_NAME -p ISCSI_IP -l
5.登出iscsi存儲 iscsiadm -m node -T LUN_NAME -p ISCSI_IP -u
---------------------------------------------------------------------
安裝步驟:
1.檢查是否安裝iscsi-initiator-utils
[root@localhost ~]# rpm -qa iscsi-initiator-utils
iscsi-initiator-utils-6.2.0.872-41.el6.x86_64
2.添加連接
[root@localhost ~]# iscsiadm -m discovery -t sendtargets -p 192.168.10.11:3260
注:此命令會把所有端口都保存到可以訪問的線路列表中。系統在重啟時,會從此列表中,各個線路進行測試檢查。如果不能訪問,會出
錯誤提示:
?? ??? ?Mar 20 13:20:22 rac2 kernel: sd 8:0:0:3: SCSI error: return code = 0x08000002
?? ??? ?Mar 20 13:20:22 rac2 kernel: Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE,SUGGEST_OK
?? ??? ?Mar 20 13:20:22 rac2 kernel: sdu: Current: sense key: Illegal Request
?? ??? ?Mar 20 13:20:22 rac2 kernel:???? <<vendor>> ASC=0x94 ASCQ=0x1ASC=0x94 ASCQ=0x1
192.168.10.11:3260,1 iqn.1984-05.com.dell:powervault.md3600i.690b11c0002be7310000000051197871
192.168.10.12:3260,1 iqn.1984-05.com.dell:powervault.md3600i.690b11c0002be7310000000051197871
192.168.10.13:3260,2 iqn.1984-05.com.dell:powervault.md3600i.690b11c0002be7310000000051197871
192.168.10.14:3260,2 iqn.1984-05.com.dell:powervault.md3600i.690b11c0002be7310000000051197871
#刪除用不到的控制器2的兩個接口
[root@rac2 ~]# iscsiadm -m node -o delete -T iqn.1984-05.com.dell:powervault.md3600i.690b11c0002be7310000000051197871? -p 192.168.10.13:3260
[root@rac2 ~]# iscsiadm -m node -o delete -T iqn.1984-05.com.dell:powervault.md3600i.690b11c0002be7310000000051197871? -p 192.168.10.14:3260
#用控制器1的兩個接口的IP登錄
[root@localhost ~]# iscsiadm -m node -T iqn.1984-05.com.dell:powervault.md3600i.690b11c0002be7310000000051197871? -p 192.168.10.11:3260 --login
[root@localhost ~]# iscsiadm -m node -T iqn.1984-05.com.dell:powervault.md3600i.690b11c0002be7310000000051197871? -p 192.168.10.12:3260 --login
[root@localhost ~]# iscsiadm -m session?? #訪問路徑,這只是說明,這個列表中的路徑,已在訪問成功中。
tcp: [1] 192.168.10.13:3260,2 iqn.1984-05.com.dell:powervault.md3600i.690b11c0002be7310000000051197871
tcp: [2] 192.168.10.11:3260,1 iqn.1984-05.com.dell:powervault.md3600i.690b11c0002be7310000000051197871
*******************************************************************
Linux系統用device-mapper multipathing driver管理
http://www.aixchina.net/home/space.php?uid=2947&do=blog&id=31276
REDHAT 官方說明
https://access.redhat.com/knowledge/docs/en-US/Red_Hat_Enterprise_Linux/5/html/DM_Multipath/config_file_defaults.html
1、multipath.conf文件的配置
# This is a basic configuration file with some examples, for device mapper
# multipath.
# For a complete list of the default configuration values, see
# /usr/share/doc/device-mapper-multipath-0.4.9/multipath.conf.defaults
# For a list of configuration options with descriptions, see
# /usr/share/doc/device-mapper-multipath-0.4.9/multipath.conf.annotated
#注:因各版本的配置不太一樣,千萬不能使用網絡上看到的別人的配置文件拷貝過來就用,有些參數在各版本中不支持。
#會出錯,但錯誤信息又不顯示。
blacklist {
? devnode "^sda"
}
defaults {
? user_friendly_names?? yes
? path_grouping_policy? multibus multibus #默認的路徑組策略
? failback?? ??? ?immediate#故障恢復的模式
? no_path_retry ?? ?fail#在disable queue之前系統嘗試使用失效路徑的次數的數值
?
? #加上后面3個參數后,無法初始化多路,可能是此版本不支持
? #getuid_callout "/sbin/scsi_id -g -u -s /block/%n" #獲得唯一設備號使用的默認程序
? #prio_callout????? "/sbin/acs_prio_alua %d" #獲取有限級數值使用的默認程序
? #path_selector "round-robin 0" #選擇那條路徑進行下一個IO操作的方法
}
multipaths {
?? ?multipath {
?? ?wwid 3690b11c0002be80e00000ce3514380db
?? ?alias asm-crs01
?? ?}
?? ?multipath {
?? ?wwid 3690b11c0002be80e00000ce5514380f8
?? ?alias asm-data01
?? ?}
?? ?multipath {
?? ?wwid 3690b11c0002be80e00000ce75143810c
?? ?alias asm-data02
?? ?}
?? ?multipath {
?? ?wwid 3690b11c0002be80e00000ce95143811c
?? ?alias asm-recovery01
?? ?}
?? ?multipath {
?? ?wwid 3690b11c0002be7310000099851438137
?? ?alias asm-recovery02
?? ?}
}
# vi /etc/multipath.conf
#/usr/share/doc/device-mapper-multipath-0.4.9/multipath.conf.defaults
----------------------------------------------------------------------------------
4、常用的一些multipath工具
清空已有的multipath記錄
multipath -F
掃描磁盤,系統中會出現鏈路聚合之后的dm設備,同時也會在/dev/mapper/、/dev/mpath/目錄下生成相應的設備。
multipath -v2
查看multipath拓撲結構
multipath -ll
--------------------------------------------------------------------
[root@rac1-private mapper]# multipath -ll
Mar 06 15:13:50 | DM multipath kernel driver not loaded
Mar 06 15:13:50 | DM multipath kernel driver not loaded
如果模塊沒有加載成功請使用下列命初始化DM,或重啟系統
[root@rac1-private mapper]# modprobe dm-multipath
[root@rac1-private mapper]# modprobe dm-round-robin
[root@rac1-private mapper]# service multipathd start
正在啟動守護進程multipathd:
[root@rac1-private mapper]# multipath –v2
[root@rac1-private mapper]# multipath -ll
?modprobe dm-multipath
?modprobe dm-round-robin
?service multipathd start
?multipath –v2
初始化完了之后再通過multipath -ll命令查看是否加載成功
[root@rac2 ~]# multipath -ll
mpathr (3690b11c0002be80e000005285136a6f9) dm-2 DELL,MD36xxi
size=2.0T features='0' hwhandler='0' wp=rw
`-+- policy='round-robin 0' prio=1 status=active
? |- 2:0:0:1 sdf 8:80? active ready? running
? |- 5:0:0:1 sdi 8:128 active ready? running
? |- 3:0:0:1 sdg 8:96? failed faulty running
? `- 4:0:0:1 sdh 8:112 failed faulty running
mpathq (3690b11c0002be731000004b25136a708) dm-1 DELL,MD36xxi
size=2.0T features='0' hwhandler='0' wp=rw
`-+- policy='round-robin 0' prio=1 status=active
? |- 3:0:0:2 sdl 8:176 active ready? running
? |- 4:0:0:2 sdk 8:160 active ready? running
? |- 2:0:0:2 sdj 8:144 failed faulty running
? `- 5:0:0:2 sdm 8:192 failed faulty running
mpathp (3690b11c0002be731000004b05136a6d9) dm-0 DELL,MD36xxi
size=4.1G features='0' hwhandler='0' wp=rw
`-+- policy='round-robin 0' prio=1 status=active
? |- 3:0:0:0 sdc 8:32? active ready? running
? |- 4:0:0:0 sdd 8:48? active ready? running
? |- 2:0:0:0 sdb 8:16? failed faulty running
? `- 5:0:0:0 sde 8:64? failed faulty running
#? 看到只有兩條線路是正常的。后來撥插了網線,看到兩張控制卡,各工作一條網線。
測試多路的速度及負載均衡
dd if=/dev/zero if=/dev/mapper/mpatha bs=1M count=200
iostat
multipath磁盤的基本操作
要對多路徑軟件生成的磁盤進行操作直接操作/dev/mapper/目錄下的磁盤就行.
在對多路徑軟件生成的磁盤進行分區之前最好運行一下pvcreate命令
(原因:http://book.51cto.com/art/201012/240911.htm):
# pvcreate /dev/mapper/mpath0
# fdisk /dev/mapper/mpath0
[root@rac2 ~]# /etc/init.d/oracleasm createdisk CRS1 /dev/mapper/asmvol1
Marking disk "CRS1" as an ASM disk:??????????????????????? [? OK? ]
總結
以上是生活随笔為你收集整理的md3600i存储服务器连接 iscsi+multipath配置的全部內容,希望文章能夠幫你解決所遇到的問題。
- 上一篇: sql server 修改IDENTIT
- 下一篇: multipathd: sdn: rea