前言
本文記錄了具體如何從VMware官方網站檢查硬體(BIOS/RAID/NIC/HBA)等相容性資訊,提前確認VMware軟硬體相容性結果避免資料中心建設規劃時候採坑回退。說一句不相關的想法,整個IT行業從VMware轉投OpenStack的程式越來越快,而VMware面對的競爭者會越來越多,Nutanix/OpenStack/Docker等一波接著一波,VMware確實很成熟也很好用,但企業規模不斷擴大之後也抵擋不住成本的壓力和新技術的降維攻擊。
VMware Compatibility Guide
更新歷史
2018年04月22日 - 初稿
閱讀原文 - https://wsgzao.github.io/post/vmware-compatibility-guide/
擴充套件閱讀
VMware Compatibility Guide - https://www.vmware.com/resources/compatibility/
VMware相容性檢查概述
VMware Compatibility Guide
登入VMware Compatibility Guide網站,輸入已知硬體關鍵字資訊如DL980 https://www.vmware.com/resources/compatibility/search.php
根據型號和CPU判斷硬體所支援的版本,以下內容以HP DL980 Gen7為例 https://www.vmware.com/resources/compatibility/detail.php?deviceCategory=server&productid=19802&deviceCategory=server&details=1&keyword=dl980&page=1&display_interval=10&sortColumn=Partner&sortOrder=Asc
根據查詢結果我們可以得出這樣的結論 HP DL980 Gen7支援的最高版本為ESXi 6.0 U3,BIOS版本要求為P66
VMware Lifecycle Product Matrix
根據第一步得到了ESXi的版本資訊,需要了解VMware當前的生命週期技術支援政策 https://www.vmware.com/support/policies/lifecycle.html https://www.vmware.com/content/dam/digitalmarketing/vmware/en/pdf/support/product-lifecycle-matrix.pdf
VMware Product Interoperability Matrices
將ESXi 6.0 U3作為已知條件,增加你需要部署的元件進一步瞭解相容性上的安裝建議,比如下面是增加了VMware vCenter Server和VMware Horizon,由這個頁面我們可以大致確認元件的安裝版本對應關係
https://www.vmware.com/resources/compatibility/sim/interop_matrix.php
VMware ESXi 6.0 U3 VMware vCenter Server 6.5 U1e or 6.0 U3d VMware Horizon 7.4.
Firmware
BIOS/RAID/NIC/HBA等資訊獲取請往下看
Checking your firmware and BIOS levels to ensure compatibility with ESX/ESXi (1037257) https://kb.vmware.com/kb/1037257
Determining Network/Storage firmware and driver version in ESXi 4.x and later (1027206) https://kb.vmware.com/kb/1027206
Identifying the firmware of a Qlogic or Emulex FC HBA (1002413) https://kb.vmware.com/kb/1002413
ESXi相容性資訊收集
基礎配置
開啟ESXi Shell和SSH
- 完成ESXi系統安裝
- 按 Customize System/Viewlogs
- Troubleshooting Options
- Enable ESXi Shell
- Enable SSH
圖形化與命令列切換快捷鍵
# 切換至命令列
Alt + F1
# 切換至圖形化
Alt + F2
複製程式碼
BIOS
# 查詢BIOS微碼和CPU型號
smbiosDump | more
[root@DESK-VIEW1:~] smbiosDump | more
Dumping live SMBIOS data!
BIOS Info: #0
Size: 0x00018
Vendor: "HP"
Version: "P66"
Date: "07/29/2013"
Start Address: 0xf0000
ROM Size: 8192 kB
Features: 0x0703000000007dc9da80
PCI supported
PnP supported
BIOS flashable
BIOS shadowing allowed
ESCD supported
CD boot supported
Selectable boot supported
EDD spec supported
360kB Floppy supported
1.2MB Floppy supported
720kB Floppy supported
Print Screen supported
8042 Keyboard Services supported
Serial Services supported
Printer Services supported
CGA/Mono Video supported
ACPI supported
USB Legacy supported
BIOS Boot Spec supported
F12 Network boot supported
Enable targeted content distribution
System Info: #256
Manufacturer: "HP"
Product: "ProLiant DL980 G7"
Serial: "SGH3301F85"
UUID: 35384631303333484753413135344d41
Wake-up: 0x06 (Power Switch)
Chassis Info: #768
Manufacturer: "Hewlett-Packard"
Serial: "SGH3301F85"
Type: 0x17 (Rack Mount Chassis)
Bootup State: 0x03 (Safe)
Power Supply State: 0x03 (Safe)
Thermal State: 0x03 (Safe)
Security Status: 0x02 (Unknown)
Processor Info: #1024
Payload length: 0x2a
Socket: "Proc 1 (Upper Tray, Processor 1)"
Socket Type: 0x1e (Socket LGA1567)
Socket Status: Populated
Type: 0x03 (CPU)
Family: 0xb3 (Xeon)
Manufacturer: "Intel"
Version: "Intel(R) Xeon(R) CPU E7- 2860 @ 2.27GHz"
Processor ID: 0xbfebfbff000206f2
Status: 0x01 (Enabled)
Voltage: 1.4 V
External Clock: 133 MHz
Max. Speed: 4800 MHz
Current Speed: 2267 MHz
L1 Cache: #1808
L2 Cache: #1824
L3 Cache: #1840
Core Count: #10
Core Enabled Count: #10
Thread Count: #20
複製程式碼
RAID
# 檢視RAID微碼
cat /proc/driver/hpsa/hpsa0
[root@DESK-VIEW1:~] cat /proc/driver/hpsa/hpsa0
hpsa0: HP Smart Array P410i Controller
Board ID: 0x3245103c
Firmware Version: 6.40
Driver Version: HP HPSA Driver (v 6.0.0.44-4vmw)
Driver Build: 01
IRQ: 45
Logical drives: 1
Current Q depth: 0
Current # commands on controller: 0
Max Q depth since init: 0
Max # commands on controller since init: 6
Max SG entries since init: 128
Max Commands supported: 1020
SCSI host number: 12
Offline volume monitoring: Not running
hpsa0/C12:B0:T0:L1 Direct-Access LOGICAL VOLUME 6.40 RAID 1(1+0)
複製程式碼
NIC
# 檢視當前網路卡列表
vmkchdev -l | grep vmnic
# 檢視某塊網路卡具體資訊
ethtool -i vmnic0
[root@DESK-VIEW1:~] vmkchdev -l | grep vmnic
0000:04:00.0 4040:0100 103c:705a vmkernel vmnic0
0000:04:00.1 4040:0100 103c:705a vmkernel vmnic1
0000:04:00.2 4040:0100 103c:705a vmkernel vmnic2
0000:04:00.3 4040:0100 103c:705a vmkernel vmnic3
0000:54:00.0 14e4:1639 103c:7059 vmkernel vmnic4
0000:54:00.1 14e4:1639 103c:7059 vmkernel vmnic5
0000:57:00.0 14e4:1639 103c:7059 vmkernel vmnic6
0000:57:00.1 14e4:1639 103c:7059 vmkernel vmnic7
0000:5d:00.0 14e4:1639 103c:7059 vmkernel vmnic8
0000:5d:00.1 14e4:1639 103c:7059 vmkernel vmnic9
0000:60:00.0 14e4:1639 103c:7059 vmkernel vmnic10
0000:60:00.1 14e4:1639 103c:7059 vmkernel vmnic11
[root@DESK-VIEW1:~] ethtool -i vmnic0
driver: nx_nic
version: 5.0.621
firmware-version: 4.0.593
bus-info: 0000:04:00.0
[root@DESK-VIEW1:~] ethtool -i vmnic11
driver: bnx2
version: 2.2.4f.v60.10
firmware-version: bc 5.2.3
bus-info: 0000:60:00.1
# 使用esxcli command可以檢視更多裝置描述資訊
esxcli network nic list
# 使用esxcli 檢視更加詳細的網路卡資訊
esxcli network nic get -n vmnic0
[root@DESK-VIEW1:~] esxcli network nic list
Name PCI Device Driver Admin Status Link Status Speed Duplex MAC Address MTU Description
------- ------------ ------ ------------ ----------- ----- ------ ----------------- ---- ------------------------------------------------------------------------------------
vmnic0 0000:04:00.0 nx_nic Up Down 0 Full d8:9d:67:77:99:38 1500 NetXen HP NC375i Integrated Quad Port Multifunction Gigabit Server Adapter
vmnic1 0000:04:00.1 nx_nic Up Down 0 Full d8:9d:67:77:99:39 1500 NetXen HP NC375i Integrated Quad Port Multifunction Gigabit Server Adapter
vmnic10 0000:60:00.0 bnx2 Up Up 1000 Full 10:60:4b:a2:4a:90 1500 QLogic Corporation NC382T PCI Express Dual Port Multifunction Gigabit Server Adapter
vmnic11 0000:60:00.1 bnx2 Up Up 1000 Full 10:60:4b:a2:4a:92 1500 QLogic Corporation NC382T PCI Express Dual Port Multifunction Gigabit Server Adapter
vmnic2 0000:04:00.2 nx_nic Up Down 0 Full d8:9d:67:77:99:3a 1500 NetXen HP NC375i Integrated Quad Port Multifunction Gigabit Server Adapter
vmnic3 0000:04:00.3 nx_nic Up Down 0 Full d8:9d:67:77:99:3b 1500 NetXen HP NC375i Integrated Quad Port Multifunction Gigabit Server Adapter
vmnic4 0000:54:00.0 bnx2 Up Up 1000 Full 10:60:4b:a2:03:70 1500 QLogic Corporation NC382T PCI Express Dual Port Multifunction Gigabit Server Adapter
vmnic5 0000:54:00.1 bnx2 Up Up 1000 Full 10:60:4b:a2:03:72 1500 QLogic Corporation NC382T PCI Express Dual Port Multifunction Gigabit Server Adapter
vmnic6 0000:57:00.0 bnx2 Up Up 1000 Full 10:60:4b:a2:ca:08 1500 QLogic Corporation NC382T PCI Express Dual Port Multifunction Gigabit Server Adapter
vmnic7 0000:57:00.1 bnx2 Up Up 1000 Full 10:60:4b:a2:ca:0a 1500 QLogic Corporation NC382T PCI Express Dual Port Multifunction Gigabit Server Adapter
vmnic8 0000:5d:00.0 bnx2 Up Up 1000 Full 10:60:4b:a2:d9:bc 1500 QLogic Corporation NC382T PCI Express Dual Port Multifunction Gigabit Server Adapter
vmnic9 0000:5d:00.1 bnx2 Up Up 1000 Full 10:60:4b:a2:d9:be 1500 QLogic Corporation NC382T PCI Express Dual Port Multifunction Gigabit Server Adapter
[root@DESK-VIEW1:~] esxcli network nic get -n vmnic11
Advertised Auto Negotiation: true
Advertised Link Modes: 10baseT/Half, 10baseT/Full, 100baseT/Half, 100baseT/Full, 1000baseT/Full
Auto Negotiation: true
Cable Type: Twisted Pair
Current Message Level: 0
Driver Info:
Bus Info: 0000:60:00.1
Driver: bnx2
Firmware Version: bc 5.2.3
Version: 2.2.4f.v60.10
Link Detected: true
Link Status: Up
Name: vmnic11
PHYAddress: 1
Pause Autonegotiate: true
Pause RX: true
Pause TX: true
Supported Ports: TP
Supports Auto Negotiation: true
Supports Pause: true
Supports Wakeon: true
Transceiver: internal
Virtual Address: 00:50:56:54:71:e6
Wakeon: MagicPacket(tm)
複製程式碼
HBA
# 檢視HBA卡驅動型別
esxcfg-scsidevs -a
# 查詢HBA卡具體驅動程式
vmkload_mod -s <HBADriver> | grep Version
vmkload_mod -s qlnativefc | grep Version
# 檢視HBA卡供應商資訊,便於之後確認VMware推薦HBA驅動
vmkchdev -l | grep vmhba2
000:0b:00.0 1077:2532 103c:3263 vmkernel vmhba2
Vendor ID(VID): 1077
Device ID(DID): 2532
Sub-Vendor ID(SVID): 103c
Sub-Device ID(SDID): 3263
[root@DESK-VIEW1:~] esxcfg-scsidevs -a
vmhba38 bnx2i unbound iscsi.vmhba38 QLogic NetXtreme II iSCSI Adapter
vmhba39 bnx2i unbound iscsi.vmhba39 QLogic NetXtreme II iSCSI Adapter
vmhba0 ata_piix link-n/a sata.vmhba0 (0000:00:1f.2) Intel Corporation ICH10 4 port SATA IDE Controller
vmhba1 hpsa link-n/a sas.500143802597a240 (0000:03:00.0) Hewlett-Packard Company Smart Array P410i
vmhba2 qlnativefc link-up fc.5001438024275201:5001438024275200 (0000:0b:00.0) QLogic Corp ISP2532-based 8Gb Fibre Channel to PCI Express HBA
vmhba3 qlnativefc link-n/a fc.5001438024275203:5001438024275202 (0000:0b:00.1) QLogic Corp ISP2532-based 8Gb Fibre Channel to PCI Express HBA
vmhba4 qlnativefc link-up fc.5001438024274bc1:5001438024274bc0 (0000:11:00.0) QLogic Corp ISP2532-based 8Gb Fibre Channel to PCI Express HBA
vmhba40 ata_piix link-n/a sata.vmhba40 (0000:00:1f.2) Intel Corporation ICH10 4 port SATA IDE Controller
vmhba5 qlnativefc link-n/a fc.5001438024274bc3:5001438024274bc2 (0000:11:00.1) QLogic Corp ISP2532-based 8Gb Fibre Channel to PCI Express HBA
vmhba32 bnx2i unbound iscsi.vmhba32 QLogic NetXtreme II iSCSI Adapter
vmhba33 bnx2i unbound iscsi.vmhba33 QLogic NetXtreme II iSCSI Adapter
vmhba34 bnx2i unbound iscsi.vmhba34 QLogic NetXtreme II iSCSI Adapter
vmhba35 bnx2i unbound iscsi.vmhba35 QLogic NetXtreme II iSCSI Adapter
vmhba36 bnx2i unbound iscsi.vmhba36 QLogic NetXtreme II iSCSI Adapter
vmhba37 bnx2i unbound iscsi.vmhba37 QLogic NetXtreme II iSCSI Adapter
[root@DESK-VIEW1:~] vmkload_mod -s qlnativefc | grep Version
Version: 2.1.50.0-1vmw.600.3.57.5050593
[root@DESK-VIEW1:~] vmkchdev -l | grep vmhba2
0000:0b:00.0 1077:2532 103c:3263 vmkernel vmhba2
# In ESXi 5.5 and later, you do not see native drivers in the /proc nodes. To view native driver information, run the command:
/usr/lib/vmware/vmkmgmt_keyval/vmkmgmt_keyval -a
[root@DESK-VIEW1:~] /usr/lib/vmware/vmkmgmt_keyval/vmkmgmt_keyval -a | more
Listing all system keys:
Key Value Instance: vmhba3/qlogic
Listing keys:
Name: ADAPTER
Type: string
value:
QLogic PCI to Fibre Channel Host Adapter for HPAJ764A:
FC Firmware version 8.02.00 (90d5), Driver version 2.1.50.0
Host Device Name vmhba3
BIOS version 3.13
FCODE version N/A
EFI version 6.15
Flash FW version 5.09.00
ISP: ISP2532, Serial# MY532922UB
MSI-X enabled
Request Queue = 0x430c04a9e000, Response Queue = 0x430c04abf000
Request Queue count = 2048, Response Queue count = 512
Number of response queues for CPU affinity operation: 8
CPU Affinity mode enabled
複製程式碼
IO Devices
登入VMware Compatibility Guide選擇查詢內容中的IO Devices https://www.vmware.com/resources/compatibility/search.php
在右側可以選擇匹配VID/DID/SVID/Max SSID資訊,輸入上述案例中的DL980的HBA卡資訊則可以得到更加精確的結果,1077:2532 103c:3263
ESXi
# 檢視ESXi版本
[root@DESK-VIEW1:~] vmware -v
VMware ESXi 6.0.0 build-5572656
複製程式碼
vm-support
如果需要做應急處置,直接使用vm-support命令收集打包交付給VMware工程師分析也會包含上述硬體微碼資訊
“vm-support” command in ESX/ESXi to collect diagnostic information (1010705) https://kb.vmware.com/kb/1010705