VMware Cloud Community
palphonso
Enthusiast
Enthusiast

Unable to install ESXi 5.5 or 6 after ServeRAID M5110e firmware upgrade

We were in the process of upgrading our ESXi 5.1 to 5.5 U3 and before we were upgrading the firmware on our IBM System x3650 M4 servers using the IBM BOMC. Doing so, it upgraded the RAID controller firmware to version 23.31.0-0023.

After the upgrade, the host booted but the local datastore didn't mount and gave an error when trying to mount it. We were also unable to delete it. The RAID configuration showed no errors. It was a RAID1 composed of 2 HDD and 1 Hot Spare. Easy enough right.

2017-06-19_13-49-10.png

We contacted VMware and they suspected something was wrong with the storage on this server. Everything was working fine before we upgraded the firmwares.

VMware recommended we rebuilt the RAID configuration and try to do a clean install of ESXi 5.5 U3 using the Lenovo custom image.. It fails.

2017-06-20_8-58-08.png

I even tried to install 6.0 U2 using the Lenovo custom image.

The DSA, IMM2 and UEFI versions running are shown below.

2017-06-20_9-11-06.png

This is the first time this has ever happened to us and we are at lost and praying for ideas.

Anyone's help would be welcomed.

Tags (3)
10 Replies
Andy90
Enthusiast
Enthusiast

We have the same issue with version 23.34.0-0023.

Do you have any solution?

Reply
0 Kudos
Andy90
Enthusiast
Enthusiast

We had the same issue with IBM x3650 M4 ServeRaid M5110e Firmware 23.34.0-0023.

The following error was shown during the Installation of ESXi:

This program has encountered an error:

(Use the arrow keys to scroll)

Error (see log for more info):

Command '/sbin/partedUtil setptbl /vmfs/devices/disks/naa.60.....

Error: Input/output error during read on /dev/disks/naa.60...

WriteNewPtable: Unable to commit to disk

The following workaround fixed my problem:

  • Boot from Vmware ISO image (doesn’t matter which version – 5.5 or 6.0 or 6.5)
  • During the boot process (booting from ISO), press “Shift+O”
  • Remove the boot-option „runweazel“ in the command-line and press Enter to boot the ISO Image into the RAM

  • ESXi will be running within the RAM (root password is blank)
  • - Assign an IP-Address (to be able to connect via SSH later on)
  • - Enable ESXi Shell and Enable Shell

  • Download the attached ibm_fw_sraidmr_6gb-23.34.0-0018_linux_32-64.bin (see attached files)
  • Extract the “image” folder from that file
  • Copy this “image” folder via WinSCP (or other application) onto the ESXi-Server into the following directory: /opt/MegaCli
  • If /opt/MegaCli does not exist, create that folder.

  • Download attached “MegaCli” and “Libstorelib.so” file
  • Copy these two files also into “/opt/MegaCli”
  • Modify the permission of the MegaCli and Libstorelib.so files to read/write/execute (7777)

  • Connect via SSH to the server and use the following commands to downgrade the RaidController
    • Check if the RaidController is recognized:

[root@localhost:/opt/MegaCli] ./MegaCli -ldinfo -lall -aall

Adapter 0 -- Virtual Drive Information:

Virtual Drive: 0 (Target Id: 0)

Name                :

RAID Level          : Primary-5, Secondary-0, RAID Level Qualifier-3

Size                : 7.626 TB

Parity Size         : 557.861 GB

State               : Optimal

Strip Size          : 128 KB

Number Of Drives    : 15

Span Depth          : 1

Default Cache Policy: WriteBack, ReadAhead, Direct, Write Cache OK if Bad BBU

Current Cache Policy: WriteBack, ReadAhead, Direct, Write Cache OK if Bad BBU

Default Access Policy: Read/Write

Current Access Policy: Read/Write

Disk Cache Policy   : Disabled

Encryption Type     : None

PI type: No PI

Is VD Cached: No

  • Downgrade the Controller to the according version (file lsi2208.rom must be copied before)

[root@localhost:/opt/MegaCli] ./MegaCli -AdpFwFlash -f lsi2208.rom -NoVerChk -a0

Adapter 0: ServeRAID M5110e

Vendor ID: 0x1000, Device ID: 0x005B

Download Completed.

Flashing image to adapter...

Adapter 0: Flash Completed.

Exit Code: 0x00

  • After rebooting the server, you should be able to install VMware ESXi.
  • After completed Installation of VMware ESXi, you can update the RaidController again (edit: Is does NOT work. Also after updating the Controller again, the storage can not be found.)
GoranK
Contributor
Contributor

Hi,

I had exact same issue last week - IBM system x3650 M4 with M5110, upgrade from 5.5  U3 to 6.0 U2.

Problem is with RAID controller driver included in ESXi 6.x.

I noticed that 6.5 goes OK so I investigated deeper.

After all, I did clean reinstall of host using 6.0 U2 RollupISO which has new driver in it.

I attend to do the same with other hosts in environment.

Following driver is included in 6.0 U2 ESXi ISO :

scsi-megaraid-sas version 6.603.55

And this driver doesnt work.

Following driver is in 6.0 U2 Driver RollupISO:

scsi-megaraid-sas version 6.611.03

And this driver works. So, I recomend to do clean install with Driver Rolup ISO.

Hope this helps.

Regarding custom isos and upgrade / install proces...

According Lenovo, Lenovo doesnt support custom images for IBM system X servers anymore (that is written in custom ISO documentation and picture below), so if you need to upgrade host previously installed with custom IBM / Lenovo ISO you need to do that using VMware ESXi image and remove IBM / Lenovo vibs from host.

pic1.jpg

https://support.lenovo.com/hr/en/solutions/ht502599

When I did like this, I could not uninstall IBM / lenovo vibs so I decided to do clean install.

I dont know how community see this install upgarde process for IBM servers installed with custom image.

Any advice is welcome.

Best regards

Goran

palphonso
Enthusiast
Enthusiast

After being unsuccessfull at installing ESXi 5.5 or 6.0, we decided to try and Windows Server 2012 R2. It worked.

From this OS, we installed STORCLI and rolled back the ServerRAID M5110e firmware to 23.16.0-0027 from 23.34.0-0023.

STORCLI: lsi_utl_sraidmr_storcli-1.14.12_windows_32-64.zip

FIRMWARE: ibm_fw_sraidmr_5100-23.16.0-0027_windows_32-64.exe

I extracted the ROM file from the EXE above which gave me lsi2208.rom.

I ran storcli /cx download file=C:\TEMP\lsi2208.rom noverchk

I rebooted and did a clean install of ESXi 6.0 U3 and it worked.

itmanpro
Contributor
Contributor

I had the same issue today.

As Gorank said, I downloaded the ESXi 6.0 Update 3 Driver Rollup ISO and installed on IBM x3650M4(which RaidCard Firmware is up to date) and everything are going fine for me.

The problem seems like old sas mpt driver issue.

The new sas mpt driver in this ISO support LSI chipset with new brend "Avago Technologies".

ESXi_6.0.0U3a_Rollup.jpg

Reply
0 Kudos
Sridhar_Vimal
Contributor
Contributor

great article, that helps and saved me lot of time, Thanks for the publisher.

Reply
0 Kudos
Aziz_Husain
Contributor
Contributor

Sir i tried to ran "storcli /cx download file=C:\TEMP\lsi2208.rom noverchk" but ios not working

Reply
0 Kudos
Aziz_Husain
Contributor
Contributor

Tried to do the same got below error

pastedImage_2.png

Reply
0 Kudos
gerip03
Contributor
Contributor

We had the same issue with IBM x3650 M4 ServeRaid M5110e Firmware 23.34.0-0023.

The following error was shown during the Installation of ESXi:

This program has encountered an error:

(Use the arrow keys to scroll)

Error (see log for more info):

Command '/sbin/partedUtil setptbl /vmfs/devices/disks/naa.60.....

Error: Input/output error during read on /dev/disks/naa.60...

WriteNewPtable: Unable to commit to disk

The following workaround fixed my problem:

  • Boot from Vmware ISO image (doesn’t matter which version – 5.5 or 6.0 or 6.5)
  • During the boot process (booting from ISO), press “Shift+O”
  • Remove the boot-option „runweazel“ in the command-line and press Enter to boot the ISO Image into the RAM

  • ESXi will be running within the RAM (root password is blank)
  • - Assign an IP-Address (to be able to connect via SSH later on)
  • - Enable ESXi Shell and Enable Shell

  • Download the attached ibm_fw_sraidmr_6gb-23.34.0-0018_linux_32-64.bin (see attached files)
  • Extract the “image” folder from that file
  • Copy this “image” folder via WinSCP (or other application) onto the ESXi-Server into the following directory: /opt/MegaCli
  • If /opt/MegaCli does not exist, create that folder.

  • Download attached “MegaCli” and “Libstorelib.so” file
  • Copy these two files also into “/opt/MegaCli”
  • Modify the permission of the MegaCli and Libstorelib.so files to read/write/execute (7777)

  • Connect via SSH to the server and use the following commands to downgrade the RaidController
    • Check if the RaidController is recognized:

[root@localhost:/opt/MegaCli] ./MegaCli -ldinfo -lall -aall Adapter 0 -- Virtual Drive Information:Virtual Drive: 0 (Target Id: 0)Name                :RAID Level          : Primary-5, Secondary-0, RAID Level Qualifier-3Size                : 7.626 TBParity Size         : 557.861 GBState               : onewalmartSize          : 128 KBNumber Of Drives    : 15Span Depth          : 1Default Cache Policy: WriteBack, ReadAhead, Direct, Write Cache OK if Bad BBUCurrent Cache Policy: WriteBack, ReadAhead, Direct, Write Cache OK if Bad BBUDefault Access Policy: Read/WriteCurrent Access Policy: Read/WriteDisk Cache Policy   : DisabledEncryption Type     : NonePI type: No PIIs VD Cached: No 

  • Downgrade the Controller to the according version (file lsi2208.rom must be copied before)

[root@localhost:/opt/MegaCli] ./MegaCli -AdpFwFlash -f lsi2208.rom -NoVerChk -a0 Adapter 0: ServeRAID M5110eVendor ID: 0x1000, Device ID: 0x005BDownload Completed.Flashing image to adapter...Adapter 0: Flash Completed.Exit Code: 0x00

  • After rebooting the server, you should be able to install VMware ESXi.
  • After completed Installation of VMware ESXi, you can update the RaidController again (edit: Is does NOT work. Also after updating the Controller again, the storage can not be found.)

It did not work for me Smiley Sad

Reply
0 Kudos
a_p_
Leadership
Leadership

gerip03

You forgot to post the link to the original post ...

Re: Unable to install ESXi 5.5 or 6 after ServeRAID M5110e firmware upgrade

André

Reply
0 Kudos