1 2 3 4 5 Previous Next 64 Replies Latest reply on Nov 20, 2019 3:01 AM by TKnijn Go to original post
      • 15. Re: vsphere 6.7 LSI raid card, can't get drive status
        ctsherman Novice

        This ("use storcli") is actually Broadcom support's official suggestion, in the interim, so you've hit the nail on the head.  With the discovery of the data corruption bug in SEsparse simply waiting it out on an out-of-date build of ESXi is becoming more untenable by the day.

        • 17. Re: vsphere 6.7 LSI raid card, can't get drive status
          ctsherman Novice

          I haven't tried that NEC version, so far.  I have tried the newer Broadcom version 00.71.V0.04 (MR 7.7) and it does not work with any of the cards under 6.7, at least for standard LSI/Avago/Broadcom cards on standard systems (vs. any customized NEC cards on NEC systems).  I do know that MR 7.7 works on my current hardware, under 6.5, and I'm dealing with new-ish hardware here (9271i-8cc in the lab system, 9361-8i in the primary).  Neither system picks up anything under 6.7, however. 

           

          With any luck MR 7.8 will be out soon and will hopefully still support the 92xx and 93xx series cards, at least (MR 7.7 officially supports 93xx and 94xx but 92xx works as well).  As for hardware older than those models, I guess we have to wait and find out (I'm hopefully that the software will function for the 2308 onboard chips as well as I have to support several installs that use this for raid1 boot devices).

          • 18. Re: vsphere 6.7 LSI raid card, can't get drive status
            Geelenbert Lurker

            I'm trying to reproduce this setup.

             

            I have LSI 9260-8i cards with the lastest firmware.

             

            What exact versions are you using ? (SIMS, MSM etc?)

             

            Currently i'm not getting it to work. I'm running ESXI 6.5 U1

            • VMware-VMvisor-Installer-6.5.0.update01-5969303.x86_64
            • lsiprovider    LSI Provider for ESX Server    500.04.V0.66-0002
            • Megaraid Storage Manager V15.03.01.00

             

             

            The driver is working in Vmware, but the Megaraid Sotorage manager can't find it.

            • 19. Re: vsphere 6.7 LSI raid card, can't get drive status
              Muckman Lurker

              What RAID Controllers / Health Status / Management systems DO work with ESXi 6.7? It's difficult to choose a RAID controller when you use the HCL only to find certain aspects are still unsupported by vSphere.

              • 20. Re: vsphere 6.7 LSI raid card, can't get drive status
                AlexJoda Novice

                There are  not many options left at the moment. The available CIM providers for 6.7 are very few and not one of independent RAID big players are left. We stayed at the moment with 6.5U1 which is the last version able to monitor the disks of the hosts with LSI controllers. Without disk monitoring you cannot operate a productive vSphere host in any way! I don’t understand why nobody is taken care of this!

                 

                The only option left might be to use Areca controllers because they have an independent ethernet interface to setup and monitor the RAID and they have at least a controller driver for 6.7...

                • 21. Re: vsphere 6.7 LSI raid card, can't get drive status
                  peetz Master
                  vExpertUser Moderators

                  Greetings all,

                   

                  I'm late to the party, but I want to share with you an alternate method to detect errors reported by LSI MegaRAID adapters.

                  I also noticed that the LSI CIM provider is no longer working with ESXi 6.7 and looked in the ESXi host log files for other useful information.

                  In /var/log/vmkernel.log you can find messages like this one

                   

                  2018-12-16T13:42:23.459Z cpu0:2097613)<6>megasas_hotplug_work[1]: event code 0x0023

                   

                  You can look up the meaning of the event codes in the LSI User Guides, but I found a helpful list readily compiled here:

                  MegaRAID Event Messages – Thomas-Krenn-Wiki

                  According to this list code 23 means that the scheduled Patrol read has completed, so this is a pretty harmless and expected message.

                  However, if disk or controller errors etc. are detected then other events will be generated.

                   

                  I'm forwarding my host logs to vRealize Log Insight (you could also use another free syslog server) and have set up a custom alert there that sends me an e-mail when this message appears with an unexpected event code.

                  This works well for my "LSI MegaRAID SAS 9260-4i" adapter and should also work for other controllers using the megaraid_sas driver, but your mileage may vary.

                   

                  I hope this helps

                  Andreas

                  • 22. Re: vsphere 6.7 LSI raid card, can't get drive status
                    AlexJoda Novice

                    Do you really want to search the vmkernel logs the whole day to find some LSI Controller errors? The must be a better solution for that! Are there any news regarding the updated CIM providers or any other LSI tools to fix this? We are still stuck with 6.5U1 and are not able to upgrade because of this....

                    • 23. Re: vsphere 6.7 LSI raid card, can't get drive status
                      MysteryX Lurker

                      I managed to install MegaCLI and made some changes to an megaclisas-status file i found on the internet.

                      Now i'm getting this output:

                       

                      -- Controller information --

                      -- ID | H/W Model                | RAM    | Temp | BBU    | Firmware    

                      c0    | LSI MegaRAID SAS 9260-8i | 512MB  | N/A  | Good   | FW: 12.15.0-0239

                       

                       

                      -- Array information --

                      -- ID | Type   |    Size |  Strpsz | Flags | DskCache |   Status |  OS Path | CacheCade |InProgress  

                      c0u0  | RAID-1 |   3637G |  1.0 MB | RA,WB |  Enabled |  Optimal |      N/A | None      |None        

                      c0u1  | RAID-1 |    232G |  256 KB | RA,WT |  Enabled |  Optimal |      N/A | None      |None        

                       

                       

                      -- Disk information --

                      -- ID  | Type | Drive Model                                        | Size     | Status          | Speed    | Temp | Slot ID  | LSI ID 

                      c0u0p0 | HDD  | WD-WCC7K4DJYN7RWDC WD40EFRX-68N32N0 82.00A82       | 3.637 TB | Online, Spun Up | 6.0Gb/s  | 27C  | [252:1]  | 2      

                      c0u0p1 | HDD  | WD-WCC7K2XS6SYZWDC WD40EFRX-68N32N0 82.00A82       | 3.637 TB | Online, Spun Up | 6.0Gb/s  | 27C  | [252:0]  | 3      

                      c0u1p0 | SSD  | S21PNSAG950842K Samsung SSD 850 EVO 250GB EMT01B6Q | 232.3 Gb | Online, Spun Up | 6.0Gb/s  | 28C  | [252:4]  | 4      

                      c0u1p1 | SSD  | S21PNSAG947444X Samsung SSD 850 EVO 250GB EMT01B6Q | 232.3 Gb | Online, Spun Up | 6.0Gb/s  | 28C  | [252:5]  | 5 

                       

                      Now every reboot my files/modifications are gone again.

                      Can anyone put me in the right direction on how to create an vib file so they remain even after reboot.

                      Perhaps an nice web interfance would be nice...

                       

                      Kind Regards,

                      • 24. Re: vsphere 6.7 LSI raid card, can't get drive status
                        peetz Master
                        User ModeratorsvExpert

                        Broadcom/LSI provides a VIB file for the storcli utility (which is the successor to megacli).

                        You can download it here: https://docs.broadcom.com/docs/1.23.02_StorCLI

                        • 25. Re: vsphere 6.7 LSI raid card, can't get drive status
                          JeffWDH Lurker

                          I was unable to get storcli or MegaCLI to display my H200 (crossflashed to 9211-8i in IR mode) adapter information:

                           

                              [root@hostname:~] esxcli storage core adapter list | grep mpt

                              vmhba2    mpt2sas    link-n/a    sas.xx     (0000:02:00.0) LSI Logic / Symbios Logic Dell 6Gbps SAS HBA Adapter

                             

                             

                              [root@hostname:~]  /opt/lsi/storcli/storcli /c0 show

                              CLI Version = 007.0606.0000.0000 Mar 20, 2018

                              Operating system = VMkernel 6.7.0

                              Controller = 0

                              Status = Failure

                              Description = Controller 0 not found

                             

                              [root@hostname:/opt/lsi/MegaCLI] ./MegaCli -adpCount

                             

                              Controller Count: 0.

                           

                          I found sas2ircu P20 on the Broadcom website which seems to work (as of 6.7.0 Update 1 Build 11675023):

                           

                          Download location: https://docs.broadcom.com/docs-and-downloads/host-bus-adapters/host-bus-adapters-common-files/sas_sata_6g_p20/SAS2IRCU_P20.zip

                           

                          Extract the vmware-esx-sas2ircu.vib from this file and upload it to your ESXi host. Install it using the following command (change path to match your datastore):

                           

                              [root@hostname:~] esxcli software vib install -v /vmfs/volumes/Datastore/vmware-esx-sas2ircu.vib --no-sig-check

                             

                              Installation Result

                                 Message: Operation finished successfully.

                                 Reboot Required: false

                                 VIBs Installed: LSI_bootbank_vmware-esx-sas2ircu_20.00.00.00-03

                                 VIBs Removed:

                                 VIBs Skipped:

                           

                          I was then able to use sas2ircu to display my adapter information:

                           

                              [root@hostname:~] /opt/lsi/bin/sas2ircu 0 display

                              LSI Corporation SAS2 IR Configuration Utility.

                              Version 20.00.00.00 (2014.09.18)

                              Copyright (c) 2008-2014 LSI Corporation. All rights reserved.

                             

                              Read configuration has been initiated for controller 0

                              ------------------------------------------------------------------------

                              Controller information

                              ------------------------------------------------------------------------

                                Controller type                         : SAS2008

                                BIOS version                            : 7.39.02.00

                                Firmware version                        : 20.00.07.00

                                Channel description                     : 1 Serial Attached SCSI

                                Initiator ID                            : 0

                                Maximum physical devices                : 255

                                Concurrent commands supported           : 1720

                                Slot                                    : 4

                                Segment                                 : 0

                                Bus                                     : 2

                                Device                                  : 0

                                Function                                : 0

                                RAID Support                            : Yes

                              ------------------------------------------------------------------------

                              IR Volume information

                              ------------------------------------------------------------------------

                              IR volume 1

                                Volume ID                               : 286

                                Status of volume                        : Okay (OKY)

                                Volume wwid                             :

                                RAID level                              : RAID1

                                Size (in MB)                            : 113487

                                Physical hard disks                     :

                                PHY[0] Enclosure#/Slot#                 : 1:4

                                PHY[1] Enclosure#/Slot#                 : 1:5

                              ------------------------------------------------------------------------

                              Physical device information

                              ------------------------------------------------------------------------

                              Initiator at ID #0

                             

                              Device is a Hard disk

                                Enclosure #                             : 1

                                Slot #                                  : 4

                                SAS Address                             :

                                State                                   : Optimal (OPT)

                                Size (in MB)/(in sectors)               : 114473/234441647

                                Manufacturer                            : ATA

                                Model Number                            : KINGSTON SA400S3

                                Firmware Revision                       : B1D1

                                Serial No                               :

                                GUID                                    :

                                Protocol                                : SATA

                                Drive Type                              : SATA_SSD

                             

                              Device is a Hard disk

                                Enclosure #                             : 1

                                Slot #                                  : 5

                                SAS Address                             :

                                State                                   : Optimal (OPT)

                                Size (in MB)/(in sectors)               : 114473/234441647

                                Manufacturer                            : ATA

                                Model Number                            : KINGSTON SA400S3

                                Firmware Revision                       : B1D1

                                Serial No                               :

                                GUID                                    :

                                Protocol                                : SATA

                                Drive Type                              : SATA_SSD

                              ------------------------------------------------------------------------

                              Enclosure information

                              ------------------------------------------------------------------------

                                Enclosure#                              : 1

                                Logical ID                              :

                                Numslots                                : 8

                                StartSlot                               : 0

                              ------------------------------------------------------------------------

                              SAS2IRCU: Command DISPLAY Completed Successfully.

                              SAS2IRCU: Utility Completed Successfully.

                           

                           

                          This doesn't help with the UI view but I'll grab this information via SSH and monitor my array this way.

                          • 26. Re: vsphere 6.7 LSI raid card, can't get drive status
                            jefferson342 Novice

                            it probably on LSI update the driver when an existing driver stops working in the same major exsi release number, it's VMware fault, the existing working 6.5 driver shouldn't be prevented from working.

                            • 27. Re: vsphere 6.7 LSI raid card, can't get drive status
                              ipv6 Novice
                              VMware Employees

                              > as well as a ton of other non-storage hardware components

                               

                              This should get cleaned up  in 6.5U3, PR PR 2297764 where LSI CIM Provider

                              classes are directly queried instead of base classes which dragged in non-storage

                              health related cim classes. (from ESX shell) visible as:

                               

                              enum_instances CIM_Controller
                                           enum_instances CIM_Battery
                                           enum_instances CIM_StorageExtent
                                           enum_instances CIM_StorageVolume
                                           enum_instances CIM_SASSATAPort

                               

                              vs:

                              LSIESG_PCIDevice

                              LSIESG_PhysicalCard

                              LSIESG_FirmwarePackageIdentity

                              LSIESG_MegaRAIDHBA

                              LSIESG_DiskDrive

                              LSIESG_DiskDriveProduct

                               

                              Mike

                              1 person found this helpful
                              • 28. Re: vsphere 6.7 LSI raid card, can't get drive status
                                ipv6 Novice
                                VMware Employees

                                Then this KB would be of keen interest:  kb.vmware.com/s/article/52583

                                • 29. Re: vsphere 6.7 LSI raid card, can't get drive status
                                  ipv6 Novice
                                  VMware Employees

                                  kb.vmware.com/s/article/52583  lists ESXi 6.7 depreciated/unsupported devices

                                  Basically no support for HBA megaraid_sas, so would not expect CIM provider either.

                                   

                                  Here's the search I used to locate Avago HBA cards that would be supported.

                                  www.vmware.com/resources/compatibility/search.php?deviceCategory=io&details=1&partner=625&releases=369&page=1&display_interval=500&sortColumn=Partner