srwsol
Hot Shot
Hot Shot

Success!!  I finally figured out what the problem was and got it corrected.  The problem was the fact that although the latest driver vib from LSI was installed, for some reason it would not automatically replace the default ESXi driver lsi_mr3.  I didn't notice that although the latest driver package vib from LSI installed properly the controller was still using the original driver.  This could be seen by doing a "esxcfg-scsidev -a" command which still showed "vmhba1  lsi_mr3           link-n/a  sas.5001e67ca647e000                    (0000:0a:00.0) LSI MegaRAID SAS Fury Controller" .  The second field after the controller (vmhba1) is the current driver being used.  The driver that needed to be used was:  "vmhba1    megaraid_sas    link-n/a  unknown.vmhba   (0000:03:00.0) Avago (LSI / Symbios Logic) MegaRAID SAS Invader Controller"  .

To fix this problem I had to disable the lsi_mr3 driver so that ESXi was forced to use the other one.  The procedure to do that is as follows:

1).  Verify that you have the new driver that you want EXSi to use already installed.  I'm assuming that bad things would happen if you disabled the only driver that could operate your disk controller.  Use this command to see the installed drivers:  "esxcli software vib list"  and you should get something similar to the following:

[root@intelserver:~] esxcli software vib list

Name                           Version                               Vendor  Acceptance Level  Install Date

-----------------------------  ------------------------------------  ------  ----------------  ------------

scsi-megaraid-sas              6.608.11.00-1OEM.600.0.0.2494585      Avago   VMwareCertified   2015-07-19

lsi-mr3                        6.606.10.00-1OEM.550.0.0.1391871      LSI     VMwareCertified   2015-06-19

mtip32xx-native                3.8.5-1vmw.600.0.0.2494585            VMWARE  VMwareCertified   2015-04-28

ata-pata-amd                   0.3.10-3vmw.600.0.0.2494585           VMware  VMwareCertified   2015-04-28

ata-pata-atiixp                0.4.6-4vmw.600.0.0.2494585            VMware  VMwareCertified   2015-04-28

ata-pata-cmd64x                0.2.5-3vmw.600.0.0.2494585            VMware  VMwareCertified   2015-04-28

ata-pata-hpt3x2n               0.3.4-3vmw.600.0.0.2494585            VMware  VMwareCertified   2015-04-28

ata-pata-pdc2027x              1.0-3vmw.600.0.0.2494585              VMware  VMwareCertified   2015-04-28

ata-pata-serverworks           0.4.3-3vmw.600.0.0.2494585            VMware  VMwareCertified   2015-04-28

ata-pata-sil680                0.4.8-3vmw.600.0.0.2494585            VMware  VMwareCertified   2015-04-28

ata-pata-via                   0.3.3-2vmw.600.0.0.2494585            VMware  VMwareCertified   2015-04-28

block-cciss                    3.6.14-10vmw.600.0.0.2494585          VMware  VMwareCertified   2015-04-28

cpu-microcode                  6.0.0-0.0.2494585                     VMware  VMwareCertified   2015-04-28

ehci-ehci-hcd                  1.0-3vmw.600.0.0.2494585              VMware  VMwareCertified   2015-04-28

elxnet                         10.2.309.6v-1vmw.600.0.0.2494585      VMware  VMwareCertified   2015-04-28

emulex-esx-elxnetcli           10.2.309.6v-0.0.2494585               VMware  VMwareCertified   2015-04-28

esx-base                       6.0.0-0.11.2809209                    VMware  VMwareCertified   2015-07-21

esx-dvfilter-generic-fastpath  6.0.0-0.0.2494585                     VMware  VMwareCertified   2015-04-28

esx-tboot                      6.0.0-0.0.2494585                     VMware  VMwareCertified   2015-04-28

esx-xserver                    6.0.0-0.0.2494585                     VMware  VMwareCertified   2015-04-28

ima-qla4xxx                    2.02.18-1vmw.600.0.0.2494585          VMware  VMwareCertified   2015-04-28

ipmi-ipmi-devintf              39.1-4vmw.600.0.0.2494585             VMware  VMwareCertified   2015-04-28

ipmi-ipmi-msghandler           39.1-4vmw.600.0.0.2494585             VMware  VMwareCertified   2015-04-28

ipmi-ipmi-si-drv               39.1-4vmw.600.0.0.2494585             VMware  VMwareCertified   2015-04-28

lpfc                           10.2.309.8-2vmw.600.0.0.2494585       VMware  VMwareCertified   2015-04-28

lsi-msgpt3                     06.255.12.00-7vmw.600.0.0.2494585     VMware  VMwareCertified   2015-04-28

lsu-hp-hpsa-plugin             1.0.0-1vmw.600.0.0.2494585            VMware  VMwareCertified   2015-04-28

lsu-lsi-lsi-mr3-plugin         1.0.0-2vmw.600.0.11.2809209           VMware  VMwareCertified   2015-07-21

lsu-lsi-lsi-msgpt3-plugin      1.0.0-1vmw.600.0.0.2494585            VMware  VMwareCertified   2015-04-28

lsu-lsi-megaraid-sas-plugin    1.0.0-2vmw.600.0.11.2809209           VMware  VMwareCertified   2015-07-21

lsu-lsi-mpt2sas-plugin         1.0.0-1vmw.600.0.0.2494585            VMware  VMwareCertified   2015-04-28

lsu-lsi-mptsas-plugin          1.0.0-1vmw.600.0.0.2494585            VMware  VMwareCertified   2015-04-28

misc-cnic-register             1.78.75.v60.7-1vmw.600.0.0.2494585    VMware  VMwareCertified   2015-04-28

misc-drivers                   6.0.0-0.11.2809209                    VMware  VMwareCertified   2015-07-21

net-bnx2                       2.2.4f.v60.10-1vmw.600.0.0.2494585    VMware  VMwareCertified   2015-04-28

net-bnx2x                      1.78.80.v60.12-1vmw.600.0.0.2494585   VMware  VMwareCertified   2015-04-28

net-cnic                       1.78.76.v60.13-2vmw.600.0.0.2494585   VMware  VMwareCertified   2015-04-28

net-e1000                      8.0.3.1-5vmw.600.0.0.2494585          VMware  VMwareCertified   2015-04-28

net-e1000e                     2.5.4-6vmw.600.0.0.2494585            VMware  VMwareCertified   2015-04-28

net-enic                       2.1.2.38-2vmw.600.0.0.2494585         VMware  VMwareCertified   2015-04-28

net-forcedeth                  0.61-2vmw.600.0.0.2494585             VMware  VMwareCertified   2015-04-28

net-igb                        5.0.5.1.1-5vmw.600.0.0.2494585        VMware  VMwareCertified   2015-04-28

net-ixgbe                      3.7.13.7.14iov-20vmw.600.0.0.2494585  VMware  VMwareCertified   2015-04-28

net-mlx4-core                  1.9.7.0-1vmw.600.0.0.2494585          VMware  VMwareCertified   2015-04-28

net-mlx4-en                    1.9.7.0-1vmw.600.0.0.2494585          VMware  VMwareCertified   2015-04-28

net-nx-nic                     5.0.621-5vmw.600.0.0.2494585          VMware  VMwareCertified   2015-04-28

net-tg3                        3.131d.v60.4-1vmw.600.0.0.2494585     VMware  VMwareCertified   2015-04-28

net-vmxnet3                    1.1.3.0-3vmw.600.0.0.2494585          VMware  VMwareCertified   2015-04-28

nmlx4-core                     3.0.0.0-1vmw.600.0.0.2494585          VMware  VMwareCertified   2015-04-28

nmlx4-en                       3.0.0.0-1vmw.600.0.0.2494585          VMware  VMwareCertified   2015-04-28

nmlx4-rdma                     3.0.0.0-1vmw.600.0.0.2494585          VMware  VMwareCertified   2015-04-28

nvme                           1.0e.0.35-1vmw.600.0.0.2494585        VMware  VMwareCertified   2015-04-28

ohci-usb-ohci                  1.0-3vmw.600.0.0.2494585              VMware  VMwareCertified   2015-04-28

qlnativefc                     2.0.12.0-5vmw.600.0.0.2494585         VMware  VMwareCertified   2015-04-28

rste                           2.0.2.0088-4vmw.600.0.0.2494585       VMware  VMwareCertified   2015-04-28

sata-ahci                      3.0-21vmw.600.0.11.2809209            VMware  VMwareCertified   2015-07-21

sata-ata-piix                  2.12-10vmw.600.0.0.2494585            VMware  VMwareCertified   2015-04-28

sata-sata-nv                   3.5-4vmw.600.0.0.2494585              VMware  VMwareCertified   2015-04-28

sata-sata-promise              2.12-3vmw.600.0.0.2494585             VMware  VMwareCertified   2015-04-28

sata-sata-sil24                1.1-1vmw.600.0.0.2494585              VMware  VMwareCertified   2015-04-28

sata-sata-sil                  2.3-4vmw.600.0.0.2494585              VMware  VMwareCertified   2015-04-28

sata-sata-svw                  2.3-3vmw.600.0.0.2494585              VMware  VMwareCertified   2015-04-28

scsi-aacraid                   1.1.5.1-9vmw.600.0.0.2494585          VMware  VMwareCertified   2015-04-28

scsi-adp94xx                   1.0.8.12-6vmw.600.0.0.2494585         VMware  VMwareCertified   2015-04-28

scsi-aic79xx                   3.1-5vmw.600.0.0.2494585              VMware  VMwareCertified   2015-04-28

scsi-bnx2fc                    1.78.78.v60.8-1vmw.600.0.0.2494585    VMware  VMwareCertified   2015-04-28

scsi-bnx2i                     2.78.76.v60.8-1vmw.600.0.11.2809209   VMware  VMwareCertified   2015-07-21

scsi-fnic                      1.5.0.45-3vmw.600.0.0.2494585         VMware  VMwareCertified   2015-04-28

scsi-hpsa                      6.0.0.44-4vmw.600.0.0.2494585         VMware  VMwareCertified   2015-04-28

scsi-ips                       7.12.05-4vmw.600.0.0.2494585          VMware  VMwareCertified   2015-04-28

scsi-megaraid-mbox             2.20.5.1-6vmw.600.0.0.2494585         VMware  VMwareCertified   2015-04-28

scsi-megaraid2                 2.00.4-9vmw.600.0.0.2494585           VMware  VMwareCertified   2015-04-28

scsi-mpt2sas                   19.00.00.00-1vmw.600.0.0.2494585      VMware  VMwareCertified   2015-04-28

scsi-mptsas                    4.23.01.00-9vmw.600.0.0.2494585       VMware  VMwareCertified   2015-04-28

scsi-mptspi                    4.23.01.00-9vmw.600.0.0.2494585       VMware  VMwareCertified   2015-04-28

scsi-qla4xxx                   5.01.03.2-7vmw.600.0.0.2494585        VMware  VMwareCertified   2015-04-28

uhci-usb-uhci                  1.0-3vmw.600.0.0.2494585              VMware  VMwareCertified   2015-04-28

vmware-esx-dvfilter-maclearn   1.00-1.00                             VMware  VMwareCertified   2015-05-12

xhci-xhci                      1.0-2vmw.600.0.0.2494585              VMware  VMwareCertified   2015-04-28

tools-light                    6.0.0-0.11.2809209                    VMware  VMwareCertified   2015-07-21

[root@intelserver:~

Verify that the scsi-megaraid-sas driver is installed prior to proceeding. 

2).  To disable the lsi_mr3 driver do the following:  "esxcli system module set --enabled=false --module=lsi_mr3" 

3).  Reboot

After rebooting do: "esxcfg-scsidev -a"  to verify that megaraid_sas driver is assigned to your disk controller.  

I don't know how ESXi decides the order of precedence if two or more drivers are applicable to a single hardware device, or if the install process of the new LSI driver is supposed to disable or remove the default lsi_mr3 driver and simply failed to do so.  I also don't know what's going to happen when I put on the next ESXi patch, specifically if the lsi_mr3 driver will once again take precedence.  If anyone knows how the driver install process is supposed to work in this situation please let me know.  I am happy though that I finally got this fixed as the server was seriously gimped by having the datastore become unaccessable for 5-10 seconds everytime a VM started or stopped, and the old driver on at least one occasion did something bad enough to fool the controller into thinking that one of the disks had gone bad and started a RAID resynch.   

View solution in original post

Reply
0 Kudos