10 Replies Latest reply on Dec 25, 2019 2:19 AM by a.p.

    Unable to install ESXi 5.5 or 6 after ServeRAID M5110e firmware upgrade

    palphonso Novice

      We were in the process of upgrading our ESXi 5.1 to 5.5 U3 and before we were upgrading the firmware on our IBM System x3650 M4 servers using the IBM BOMC. Doing so, it upgraded the RAID controller firmware to version 23.31.0-0023.

       

      After the upgrade, the host booted but the local datastore didn't mount and gave an error when trying to mount it. We were also unable to delete it. The RAID configuration showed no errors. It was a RAID1 composed of 2 HDD and 1 Hot Spare. Easy enough right.

       

      2017-06-19_13-49-10.png

       

      We contacted VMware and they suspected something was wrong with the storage on this server. Everything was working fine before we upgraded the firmwares.

       

      VMware recommended we rebuilt the RAID configuration and try to do a clean install of ESXi 5.5 U3 using the Lenovo custom image.. It fails.

       

      2017-06-20_8-58-08.png

       

      I even tried to install 6.0 U2 using the Lenovo custom image.

       

      The DSA, IMM2 and UEFI versions running are shown below.

       

      2017-06-20_9-11-06.png

       

      This is the first time this has ever happened to us and we are at lost and praying for ideas.

       

      Anyone's help would be welcomed.

        • 1. Re: Unable to install ESXi 5.5 or 6 after ServeRAID M5110e firmware upgrade
          Andy90 Novice

          We have the same issue with version 23.34.0-0023.

          Do you have any solution?

          • 2. Re: Unable to install ESXi 5.5 or 6 after ServeRAID M5110e firmware upgrade
            Andy90 Novice

            We had the same issue with IBM x3650 M4 ServeRaid M5110e Firmware 23.34.0-0023.

            The following error was shown during the Installation of ESXi:

            This program has encountered an error:

            (Use the arrow keys to scroll)

            Error (see log for more info):

            Command '/sbin/partedUtil setptbl /vmfs/devices/disks/naa.60.....

            Error: Input/output error during read on /dev/disks/naa.60...

            WriteNewPtable: Unable to commit to disk

             

             

             

            The following workaround fixed my problem:

             

            • Boot from Vmware ISO image (doesn’t matter which version – 5.5 or 6.0 or 6.5)
            • During the boot process (booting from ISO), press “Shift+O”
            • Remove the boot-option „runweazel“ in the command-line and press Enter to boot the ISO Image into the RAM

             

            • ESXi will be running within the RAM (root password is blank)
            • - Assign an IP-Address (to be able to connect via SSH later on)
            • - Enable ESXi Shell and Enable Shell

             

            • Download the attached ibm_fw_sraidmr_6gb-23.34.0-0018_linux_32-64.bin (see attached files)
            • Extract the “image” folder from that file
            • Copy this “image” folder via WinSCP (or other application) onto the ESXi-Server into the following directory: /opt/MegaCli
            • If /opt/MegaCli does not exist, create that folder.

             

            • Download attached “MegaCli” and “Libstorelib.so” file
            • Copy these two files also into “/opt/MegaCli”
            • Modify the permission of the MegaCli and Libstorelib.so files to read/write/execute (7777)

             

            • Connect via SSH to the server and use the following commands to downgrade the RaidController
              • Check if the RaidController is recognized:

            [root@localhost:/opt/MegaCli] ./MegaCli -ldinfo -lall -aall

             

            Adapter 0 -- Virtual Drive Information:

            Virtual Drive: 0 (Target Id: 0)

            Name                :

            RAID Level          : Primary-5, Secondary-0, RAID Level Qualifier-3

            Size                : 7.626 TB

            Parity Size         : 557.861 GB

            State               : Optimal

            Strip Size          : 128 KB

            Number Of Drives    : 15

            Span Depth          : 1

            Default Cache Policy: WriteBack, ReadAhead, Direct, Write Cache OK if Bad BBU

            Current Cache Policy: WriteBack, ReadAhead, Direct, Write Cache OK if Bad BBU

            Default Access Policy: Read/Write

            Current Access Policy: Read/Write

            Disk Cache Policy   : Disabled

            Encryption Type     : None

            PI type: No PI

            Is VD Cached: No

             

             

            • Downgrade the Controller to the according version (file lsi2208.rom must be copied before)

             

            [root@localhost:/opt/MegaCli] ./MegaCli -AdpFwFlash -f lsi2208.rom -NoVerChk -a0

             

            Adapter 0: ServeRAID M5110e

            Vendor ID: 0x1000, Device ID: 0x005B

            Download Completed.

            Flashing image to adapter...

            Adapter 0: Flash Completed.

            Exit Code: 0x00

             

            • After rebooting the server, you should be able to install VMware ESXi.
            • After completed Installation of VMware ESXi, you can update the RaidController again (edit: Is does NOT work. Also after updating the Controller again, the storage can not be found.)
            3 people found this helpful
            • 3. Re: Unable to install ESXi 5.5 or 6 after ServeRAID M5110e firmware upgrade
              GoranK Lurker

              Hi,

               

              I had exact same issue last week - IBM system x3650 M4 with M5110, upgrade from 5.5  U3 to 6.0 U2.

              Problem is with RAID controller driver included in ESXi 6.x.

              I noticed that 6.5 goes OK so I investigated deeper.

               

              After all, I did clean reinstall of host using 6.0 U2 RollupISO which has new driver in it.

              I attend to do the same with other hosts in environment.

               

              Following driver is included in 6.0 U2 ESXi ISO :

              scsi-megaraid-sas version 6.603.55

               

              And this driver doesnt work.

               

              Following driver is in 6.0 U2 Driver RollupISO:

              scsi-megaraid-sas version 6.611.03

               

              And this driver works. So, I recomend to do clean install with Driver Rolup ISO.

               

              Hope this helps.

               

              Regarding custom isos and upgrade / install proces...

              According Lenovo, Lenovo doesnt support custom images for IBM system X servers anymore (that is written in custom ISO documentation and picture below), so if you need to upgrade host previously installed with custom IBM / Lenovo ISO you need to do that using VMware ESXi image and remove IBM / Lenovo vibs from host.

               

              pic1.jpg

               

              https://support.lenovo.com/hr/en/solutions/ht502599

               

              When I did like this, I could not uninstall IBM / lenovo vibs so I decided to do clean install.

               

              I dont know how community see this install upgarde process for IBM servers installed with custom image.

              Any advice is welcome.

               

              Best regards

              Goran

              • 4. Re: Unable to install ESXi 5.5 or 6 after ServeRAID M5110e firmware upgrade
                palphonso Novice

                After being unsuccessfull at installing ESXi 5.5 or 6.0, we decided to try and Windows Server 2012 R2. It worked.

                 

                From this OS, we installed STORCLI and rolled back the ServerRAID M5110e firmware to 23.16.0-0027 from 23.34.0-0023.

                 

                STORCLI: lsi_utl_sraidmr_storcli-1.14.12_windows_32-64.zip

                 

                FIRMWARE: ibm_fw_sraidmr_5100-23.16.0-0027_windows_32-64.exe

                 

                I extracted the ROM file from the EXE above which gave me lsi2208.rom.

                 

                I ran storcli /cx download file=C:\TEMP\lsi2208.rom noverchk

                 

                I rebooted and did a clean install of ESXi 6.0 U3 and it worked.

                • 5. Re: Unable to install ESXi 5.5 or 6 after ServeRAID M5110e firmware upgrade
                  itmanpro Lurker

                  I had the same issue today.

                  As Gorank said, I downloaded the ESXi 6.0 Update 3 Driver Rollup ISO and installed on IBM x3650M4(which RaidCard Firmware is up to date) and everything are going fine for me.

                   

                  The problem seems like old sas mpt driver issue.

                  The new sas mpt driver in this ISO support LSI chipset with new brend "Avago Technologies".

                   

                  ESXi_6.0.0U3a_Rollup.jpg

                  • 6. Re: Unable to install ESXi 5.5 or 6 after ServeRAID M5110e firmware upgrade
                    Sridhar_Vimal Lurker

                    great article, that helps and saved me lot of time, Thanks for the publisher.

                    • 7. Re: Unable to install ESXi 5.5 or 6 after ServeRAID M5110e firmware upgrade
                      Aziz_Husain Novice

                      Sir i tried to ran "storcli /cx download file=C:\TEMP\lsi2208.rom noverchk" but ios not working

                      • 8. Re: Unable to install ESXi 5.5 or 6 after ServeRAID M5110e firmware upgrade
                        Aziz_Husain Novice

                        Tried to do the same got below error

                         

                        • 9. Re: Unable to install ESXi 5.5 or 6 after ServeRAID M5110e firmware upgrade
                          gerip03 Lurker

                          We had the same issue with IBM x3650 M4 ServeRaid M5110e Firmware 23.34.0-0023.

                          The following error was shown during the Installation of ESXi:

                          This program has encountered an error:

                          (Use the arrow keys to scroll)

                          Error (see log for more info):

                          Command '/sbin/partedUtil setptbl /vmfs/devices/disks/naa.60.....

                          Error: Input/output error during read on /dev/disks/naa.60...

                          WriteNewPtable: Unable to commit to disk

                           

                           

                           

                          The following workaround fixed my problem:

                           

                          • Boot from Vmware ISO image (doesn’t matter which version – 5.5 or 6.0 or 6.5)
                          • During the boot process (booting from ISO), press “Shift+O”
                          • Remove the boot-option „runweazel“ in the command-line and press Enter to boot the ISO Image into the RAM

                           

                          • ESXi will be running within the RAM (root password is blank)
                          • - Assign an IP-Address (to be able to connect via SSH later on)
                          • - Enable ESXi Shell and Enable Shell

                           

                          • Download the attached ibm_fw_sraidmr_6gb-23.34.0-0018_linux_32-64.bin (see attached files)
                          • Extract the “image” folder from that file
                          • Copy this “image” folder via WinSCP (or other application) onto the ESXi-Server into the following directory: /opt/MegaCli
                          • If /opt/MegaCli does not exist, create that folder.

                           

                          • Download attached “MegaCli” and “Libstorelib.so” file
                          • Copy these two files also into “/opt/MegaCli”
                          • Modify the permission of the MegaCli and Libstorelib.so files to read/write/execute (7777)

                           

                          • Connect via SSH to the server and use the following commands to downgrade the RaidController
                            • Check if the RaidController is recognized:

                          [root@localhost:/opt/MegaCli] ./MegaCli -ldinfo -lall -aall Adapter 0 -- Virtual Drive Information:Virtual Drive: 0 (Target Id: 0)Name                :RAID Level          : Primary-5, Secondary-0, RAID Level Qualifier-3Size                : 7.626 TBParity Size         : 557.861 GBState               : onewalmartSize          : 128 KBNumber Of Drives    : 15Span Depth          : 1Default Cache Policy: WriteBack, ReadAhead, Direct, Write Cache OK if Bad BBUCurrent Cache Policy: WriteBack, ReadAhead, Direct, Write Cache OK if Bad BBUDefault Access Policy: Read/WriteCurrent Access Policy: Read/WriteDisk Cache Policy   : DisabledEncryption Type     : NonePI type: No PIIs VD Cached: No 

                          • Downgrade the Controller to the according version (file lsi2208.rom must be copied before)

                          [root@localhost:/opt/MegaCli] ./MegaCli -AdpFwFlash -f lsi2208.rom -NoVerChk -a0 Adapter 0: ServeRAID M5110eVendor ID: 0x1000, Device ID: 0x005BDownload Completed.Flashing image to adapter...Adapter 0: Flash Completed.Exit Code: 0x00

                          • After rebooting the server, you should be able to install VMware ESXi.
                          • After completed Installation of VMware ESXi, you can update the RaidController again (edit: Is does NOT work. Also after updating the Controller again, the storage can not be found.)

                          It did not work for me