Lenovo x2650 M5 and IBM v3700 San, SAS connected only one path

[infusednz]

Hi.

New installation. We have the following:

IBM vb3700 San connected via SAS

3x Lenovo x3650 M5's with N2225 HBA's (two in each host).

So each host connects via two separate HBAs to each SAN controller.

On the san, each HBA is showing and mapped to the correct host. However, in VMWare, it is only seeing one path, and one HBA.

On the san, the OS type selected for each host is generic (as specified in IBM document).

Am I missing something? I should be seeing two connections from each host to the v3700, only the one active path shows.

[rcporto]

Can you attach a image including your storage adapters ?

[infusednz]

Ok, so from the san

within vmware

Each host is the same. Only one HBA seems to be working.

The setup is like the following with each host

had vmware support look at it and they are stumped. I have followed the redbooks setup guide for this

Here is the information VMWare has collected in-case it helps anyone else (note the driver is a later version)

ESXi Version : VMware ESXi 6.0.0 Update 2 build-3620759

Hostname : localhost

Host IP : 127.0.0.1

Date : Tue Aug  2 01:32:58 UTC 2016

Uptime : 1:32:58 up 2 days, 21:24:06, load average: 0.01, 0.01, 0.01

Hardware : Lenovo System x3650 M5: -[5462AC1]-

[root@localhost:~] esxcfg-scsidevs -a

vmhba0  lsi_msgpt3        link-n/a sas.500605b00b8935f0 (0000:0b:00.0) Avago (LSI Logic) Fusion-MPT 12GSAS SAS3008 PCI-Express

vmhba1  lsi_msgpt3        link-n/a sas.500605b00b893750 (0000:01:00.0) Avago (LSI Logic) Fusion-MPT 12GSAS SAS3008 PCI-Express

vmhba2  lsi_mr3 link-n/a  sas.500605b00baf13e0 (0000:15:00.0) Avago (LSI / Symbios Logic) MegaRAID SAS Fury Controller

vmhba32 usb-storage       link-n/a usb.vmhba32 () USB

[root@localhost:~] vmkload_mod -s lsi_msgpt3 | grep Version

Version: 12.00.00.00-1OEM.600.0.0.2768847

[root@localhost:~] vmkchdev -l | grep -i vmhba0

0000:0b:00.0 1000:0097 1014:04be vmkernel vmhba0

+ As per the VMware HCL, the driver is not compatible

http://www.vmware.com/resources/compatibility/detail.php?deviceCategory=io&productid=39344&deviceCat...

esxcfg-scsidevs -A

vmhba1 naa.6005076300808e0c5800000000000000

vmhba1 naa.6005076300808e0c5800000000000001

vmhba1 naa.6005076300808e0c5800000000000002

vmhba32     mpx.vmhba32:C0:T0:L0

[root@localhost:/vmfs/volumes/5782af9e-9b746f00-7f35-0894ef133f28/Logs/Host3] esxcli software vib list | grep -i lsi-msgpt3

lsi-msgpt3 12.00.00.00-1OEM.600.0.0.2768847 Avago   VMwareCertified   2016-07-10

lsu-lsi-lsi-msgpt3-plugin 1.0.0-1vmw.600.0.0.2494585 VMware  VMwareCertified   2016-07-10

[rcporto]

That is really strange, anyway have you tried reboot your hosts ? Reboot the host worked in this another thread: dW:Eserver:IBM System Storage:v3700 Direct SAS Host Attach - IBM System Storage Forum

[infusednz]

Yes, rebooted all the hosts. I have IBM looking in to it now. They recommended the following IBM Port Mapping Instructions For Direct-Attached SAS Hosts - United States which I did, but makes no difference, even after a reboot.

[rcporto]

Have you tried invert the cables ? For example, the cable connected on node canister 1 change to connect to canister #2 ?

[infusednz]

Not yet. I'm about to start removing cables as I'm getting no-where with support.

[IvicaVugrinec]

Hi,

were you able to find the solution to the problem?

[infusednz]

Not yet.

One thing I have noticed. From the BIOS of the server, I can load each HBA's bios and see the connected SAN. In this state, the SAN correctly reports both HBA's as active. As soon as ESXi starts booting, HBA0 goes inactive, and HBA1 active.

Flicked this back to vmware support.

In the meantime, I am going to attempt to upgrade the firmware and drivers.

[IvicaVugrinec]

Can you please update this post with results? How are things with VMware support go? Are they of any help?

[infusednz]

I'll update when I hear back from VMWare. it's looking like a VMWare driver/firmware issue with the hba's.

not sure if you can help, but what's the easiest way to upgrade the drivers in vmware, and actually flash the firmware? Seems I can only do it directly from a linux/windows machiene.

[infusednz · Accepted solution]

I have resolved the issue.

It seems the Lenovo VMWware Image is shipping with the wrong driver.

Installed the following as an update: VMware Compatibility Guide - I/O Device Search

I used the lsi-msgpt3 version, as the mpt3sas version was not being used?

Updated from version 12 to version 13 https://my.vmware.com/group/vmware/details?downloadGroup=DT-ESXI60-AVAGO-LSI-MSGPT3-13000000-1OEM&pr...

Rebooted and now I have multipathing. The adapter has changed in VMWare from MT Fusion 12GB SAS to Avago (LSI) 3008. Not sure what's going on there, since it is an MT Fusion?

Both paths now show.

Here is another host I have not updated yet for comparison

Thanks for your help.

[GRS55]

Hi,

The same problem.

- 2 Servers x3550 M5 with HBA SAS N2225.

- 1 Storwize V3700

I update the Driver.