ESXi Upgrade to 7.0u2c failure

[aholzhammer]

Hi,

I am having several 7.0u2a hosts with the dreaded USB-issue and was happy to see the patch announced.

Unfortunately the installation fails both online or offline:

[root@esxi01:] esxcli software profile update -p ESXi-7.0U2c-18426014-standard -d `pwd`/VMware-ESXi-7.0U2c-18426014-depot.zip

[KeyError]
"filename 'var/db/payloads/text/OSS-Info.txt' not found"
Please refer to the log file for more details.

Not sure which logfile the error refers to, esxcli.log does not add any more information:

[2021-09-10 06:24:49,813 root ERROR] update failed: [KeyError]
"filename 'var/db/payloads/text/OSS-Info.txt' not found"
Please refer to the log file for more details.

Any help greatly appreciated. I tried opening a ticket on customerconnect, but the website reload constantly.

Regards
Andreas

[a_p_]

Please try specifying the full path to the .zip offline bundle instead of using `pwd`.

André

[nmiklebost]

Does it fail for the other hosts or just this one?

[aholzhammer]

It fails all hosts with the same error.

[aholzhammer]

Tried specifying the full path, but this did not change the error.

I also tried to run the upgrade from the root level, as the error doesn't include a trailing "/". Same error

[a_p_]

Just to rule that out, did you verify the downloaded .zip file's checksum to ensure that it's not corrupted?

André

[aholzhammer]

I verified the zip file, and also get the same error with the online update. I tried that several times already.

Still puzzled which logfile the error refers to.

[a_p_]

The log file that might contain related information is /var/log/esxupdate.log.

André

[aholzhammer]

Good point! Here's the log, minus INFO and DEBUG:

2021-09-10T15:05:02Z esxupdate: 2120253: Bulletin: WARNING: Cannot find VIB(s) VMware_locker_tools-light_11.1.1.16303738-16850804 in the given VIB collection for component VMware-VM-Tools_11.1.1.16303738-16850804
2021-09-10T15:05:02Z esxupdate: 2120253: imageprofile: WARNING: Ignoring missing reserved VIBs VMware_locker_tools-light_11.1.1.16303738-16850804, they are removed from reserved VIB IDs
2021-09-10T15:05:08Z esxupdate: 2120253: Bulletin: WARNING: Cannot find VIB(s) VMware_locker_tools-light_11.1.1.16303738-16850804 in the given VIB collection for component VMware-VM-Tools_11.1.1.16303738-16850804
2021-09-10T15:05:08Z esxupdate: 2120253: imageprofile: WARNING: Ignoring missing reserved VIBs VMware_locker_tools-light_11.1.1.16303738-16850804, they are removed from reserved VIB IDs
2021-09-10T15:05:10Z esxupdate: 2120253: upgrade_precheck: WARNING: Precheck Warnings(s). <CPU_SUPPORT WARNING: The CPU in this host may not be supported in future ESXi releases. Please plan accordingly.>
2021-09-10T15:05:10Z esxupdate: 2120253: Transaction: WARNING: Hardware precheck warnings are ignored with --no-hardware-warning
2021-09-10T15:05:11Z esxupdate: 5vmw.702.0.0.17867351, LSI_bootbank_vmware-esx-storcli-1.15.05_1.15.05-01, VMware_bootbank_vmware-fdm_7.0.1-17004997, VMW_bootbank_lsi-msgpt3_17.00.10.00-2vmw.702.0.0.17867351, VMW_bootbank_qedrntv_3.40.5.53-17vmw.702.0.20.18426014, VMW_bootbank_vmkata_0.1-1vmw.702.0.0.17867351, VMware_bootbank_lsuv2-nvme-pcie-plugin_1.0.0-1vmw.702.0.0.17867351, VMware_bootbank_lsuv2-oem-lenovo-plugin_1.0.0-1vmw.702.0.0.17867351, VMW_bootbank_nmlx5-rdma_4.19.16.10-1vmw.702.0.0.17867351, VMW_bootbank_nmlx5-core_4.19.16.10-1vmw.702.0.0.17867351, VMware_bootbank_esx-dvfilter-generic-fastpath_7.0.2-0.20.18426014, VMW_bootbank_qcnic_1.0.15.0-11vmw.702.0.0.17867351, VMware_bootbank_lsuv2-intelv2-nvme-vmd-plugin_2.0.0-2vmw.702.0.0.17867351, VMware_bootbank_esx-update_7.0.2-0.20.18426014, VMware_bootbank_clusterstore_7.0.2-0.20.18426014, VMware_bootbank_esx-base_7.0.2-0.20.18426014, VMW_bootbank_rste_2.0.2.0088-7vmw.702.0.0.17867351, VMW_bootbank_lpnic_11.4.62.0-1vmw.702.0.0.17867351, VMware_bootbank_vsanhealth_7.0.2-
2021-09-10T15:05:11Z esxupdate: 0.20.18426014, VMW_bootbank_nhpsa_70.0051.0.100-2vmw.702.0.0.17867351, VMW_bootbank_nmlx4-rdma_3.19.16.8-2vmw.702.0.0.17867351, VMW_bootbank_nmlx4-core_3.19.16.8-2vmw.702.0.0.17867351, VMW_bootbank_qfle3_1.0.67.0-14vmw.702.0.0.17867351, VMW_bootbank_nvmerdma_1.0.2.1-1vmw.702.0.0.17867351, VMware_bootbank_vdfs_7.0.2-0.20.18426014, QLogic_bootbank_qlogic-adapter-provider_1.6.54-1045108, VMW_bootbank_qedentv_3.40.5.53-20vmw.702.0.20.18426014, VMW_bootbank_lsi-msgpt35_17.00.02.00-1vmw.702.0.0.17867351, VMW_bootbank_vmw-ahci_2.0.9-1vmw.702.0.0.17867351, VMW_bootbank_nvmxnet3_2.0.0.30-1vmw.702.0.0.17867351, Fujitsu_bootbank_svscimprovider_7.01-10.60, VMW_bootbank_qfle3f_1.0.51.0-19vmw.702.0.0.17867351, VMW_bootbank_nfnic_4.0.0.63-1vmw.702.0.0.17867351, VMW_bootbank_nvmxnet3-ens_2.0.0.22-1vmw.702.0.0.17867351, EMU_bootbank_emulex-cim-provider_10.6.171.0-01OEM.600.0.0.2768847, VMW_bootbank_lsi-mr3_7.716.03.00-1vmw.702.0.0.17867351, VMware_bootbank_lsuv2-oem-hp-plugin_1.0.0-1vmw.702.0.0.17867351, VMwar
2021-09-10T15:05:11Z esxupdate: e_bootbank_esx-ui_1.34.8-17417756, VMware_bootbank_gc_7.0.2-0.20.18426014, VMW_bootbank_iser_1.1.0.1-1vmw.702.0.0.17867351, VMware_locker_tools-light_11.2.6.17901274-18295176, VMW_bootbank_nvme-pcie_1.2.3.11-1vmw.702.0.0.17867351, VMW_bootbank_nmlx4-en_3.19.16.8-2vmw.702.0.0.17867351, VMW_bootbank_i40enu_1.8.1.137-1vmw.702.0.20.18426014, VMW_bootbank_brcmfcoe_12.0.1500.1-2vmw.702.0.0.17867351, VMware_bootbank_native-misc-drivers_7.0.2-0.20.18426014, VMW_bootbank_elxnet_12.0.1250.0-5vmw.702.0.0.17867351, VMware_bootbank_qlnativefc_4.1.14.0-5vmw.702.0.0.17867351, Fujitsu_bootbank_fujitsu-conf_6.0.0-361.1.0, VMW_bootbank_irdman_1.3.1.19-1vmw.702.0.0.17867351, VMware_bootbank_crx_7.0.2-0.20.18426014, VMware_bootbank_loadesx_7.0.2-0.20.18426014, VMW_bootbank_qfle3i_1.0.15.0-12vmw.702.0.0.17867351, VMW_bootbank_atlantic_1.0.3.0-8vmw.702.0.0.17867351, VMW_bootbank_vmkfcoe_1.0.0.2-1vmw.702.0.0.17867351, VMW_bootbank_ne1000_0.8.4-11vmw.702.0.0.17867351, VMW_bootbank_vmkusb_0.1-4vmw.702.0.20.18426014, V
2021-09-10T15:05:11Z esxupdate: Mware_bootbank_esx-xserver_7.0.2-0.20.18426014, VMW_bootbank_ntg3_4.1.5.0-0vmw.702.0.0.17867351, VMW_bootbank_mtip32xx-native_3.9.8-1vmw.702.0.0.17867351, VMware_bootbank_cpu-microcode_7.0.2-0.20.18426014, VMware_bootbank_vmware-esx-esxcli-nvme-plugin_1.2.0.42-1vmw.702.0.0.17867351, VMW_bootbank_icen_1.0.0.10-1vmw.702.0.0.17867351, VMW_bootbank_lpfc_12.8.298.3-2vmw.702.0.20.18426014, LSI_bootbank_lsiprovider_500.04.V0.56-0005, VMW_bootbank_bnxtnet_216.0.50.0-34vmw.702.0.20.18426014, VMW_bootbank_elxiscsi_12.0.1200.0-8vmw.702.0.0.17867351
2021-09-10T15:05:11Z esxupdate: edrntv_3.40.5.53-17vmw.702.0.20.18426014 cannot be live installed.', 'VIB VMW_bootbank_bnxtnet_216.0.50.0-34vmw.702.0.20.18426014 cannot be live installed.', 'VIB VMW_bootbank_i40enu_1.8.1.137-1vmw.702.0.20.18426014 cannot be live installed.', 'VIB VMW_bootbank_lpfc_12.8.298.3-1vmw.702.0.0.17867351 cannot be removed live.', 'VIB VMW_bootbank_vmkusb_0.1-1vmw.702.0.0.17867351 cannot be removed live.', 'VIB VMware_bootbank_cpu-microcode_7.0.2-0.0.17867351 cannot be removed live.', 'VIB VMware_bootbank_native-misc-drivers_7.0.2-0.0.17867351 cannot be removed live.', 'VIB VMW_bootbank_qedentv_3.40.5.53-20vmw.702.0.0.17867351 cannot be removed live.', 'VIB VMware_bootbank_esx-dvfilter-generic-fastpath_7.0.2-0.0.17867351 cannot be removed live.', 'VIB VMW_bootbank_i40enu_1.8.1.136-1vmw.702.0.0.17867351 cannot be removed live.', 'VIB VMware_bootbank_gc_7.0.2-0.0.17867351 cannot be removed live.', 'VIB VMW_bootbank_qedrntv_3.40.5.53-16vmw.702.0.0.17867351 cannot be removed live.', 'VIB VMW_bootbank_bnx
2021-09-10T15:05:11Z esxupdate: tnet_216.0.50.0-34vmw.702.0.0.17867351 cannot be removed live.', 'VIB VMW_bootbank_bnxtroce_216.0.58.0-19vmw.702.0.0.17867351 cannot be removed live.', 'VIB VMware_bootbank_esx-base_7.0.2-0.0.17867351 cannot be removed live.', 'VIB VMware_bootbank_esx-update_7.0.2-0.0.17867351 cannot be removed live.', 'VIB VMware_bootbank_vsan_7.0.2-0.0.17867351 cannot be removed live.']
2021-09-10T15:05:11Z esxupdate: 2120253: BootBankInstaller.py: WARNING: Ignoring error when loading bootbank: Error in loading boot.cfg from bootbank /tmp/stagebootbank: [Errno 2] No such file or directory: '/tmp/stagebootbank/boot.cfg'
2021-09-10T15:05:15Z esxupdate: 2120253: root: ERROR: Traceback (most recent call last):
2021-09-10T15:05:15Z esxupdate: 2120253: root: ERROR: File "/usr/lib/vmware/esxcli-software", line 794, in <module>
2021-09-10T15:05:15Z esxupdate: 2120253: root: ERROR: main()
2021-09-10T15:05:15Z esxupdate: 2120253: root: ERROR: File "/usr/lib/vmware/esxcli-software", line 785, in main
2021-09-10T15:05:15Z esxupdate: 2120253: root: ERROR: ret = CMDTABLE[command](options)
2021-09-10T15:05:15Z esxupdate: 2120253: root: ERROR: File "/usr/lib/vmware/esxcli-software", line 252, in ProfileUpdateCmd
2021-09-10T15:05:15Z esxupdate: 2120253: root: ERROR: res = t.UpdateProfileFromDepot([], opts.profile, depotUrls=depoturls,
2021-09-10T15:05:15Z esxupdate: 2120253: root: ERROR: File "/lib64/python3.8/site-packages/vmware/esximage/Transaction.py", line 365, in UpdateProfileFromDepot
2021-09-10T15:05:15Z esxupdate: 2120253: root: ERROR: return t.InstallVibsFromProfile(metadataUrls, profileName, depotUrls,
2021-09-10T15:05:15Z esxupdate: 2120253: root: ERROR: File "/tmp/esx-update-2120253/lib64/python3.8/site-packages/vmware/esximage/Transaction.py", line 1713, in InstallVibsFromProfile
2021-09-10T15:05:15Z esxupdate: 2120253: root: ERROR: File "/tmp/esx-update-2120253/lib64/python3.8/site-packages/vmware/esximage/Transaction.py", line 1146, in _installVibs
2021-09-10T15:05:15Z esxupdate: 2120253: root: ERROR: File "/tmp/esx-update-2120253/lib64/python3.8/site-packages/vmware/esximage/Transaction.py", line 1336, in _validateAndInstallProfile
2021-09-10T15:05:15Z esxupdate: 2120253: root: ERROR: File "/tmp/esx-update-2120253/lib64/python3.8/site-packages/vmware/esximage/HostImage.py", line 1033, in Stage
2021-09-10T15:05:15Z esxupdate: 2120253: root: ERROR: File "/tmp/esx-update-2120253/lib64/python3.8/site-packages/vmware/esximage/Installer/BootBankInstaller.py", line 908, in StartTransaction
2021-09-10T15:05:15Z esxupdate: 2120253: root: ERROR: File "/tmp/esx-update-2120253/lib64/python3.8/site-packages/vmware/esximage/Installer/BootBankInstaller.py", line 389, in Stage
2021-09-10T15:05:15Z esxupdate: 2120253: root: ERROR: File "/tmp/esx-update-2120253/lib64/python3.8/site-packages/vmware/esximage/Installer/BootBankInstaller.py", line 451, in _stageBaseMiscPayloads
2021-09-10T15:05:15Z esxupdate: 2120253: root: ERROR: File "/lib64/python3.8/tarfile.py", line 1778, in getmember
2021-09-10T15:05:15Z esxupdate: 2120253: root: ERROR: KeyError: "filename 'var/db/payloads/text/OSS-Info.txt' not found"

I've performed this update on another cluster without issues, both from 7.0u2. The only difference is the CPU-generation. This one requires the "--no-hardware-warning", but is still supported hardware.

[a_p_]

I can't tell you what exactly causes the issue, and how to fix this.
However, I found a post from another user who was able to apply an update in a similar situation after putting the host into Maintenance Mode, and rebooting it.

André

[albatros99]

ESXi 7.0U2c is only in beta available, not for production machines

Have look on 2021 September 10!

Wich version have you installed and where do you finde this version?

Vcenter is actually in Version 7.0U2c!

cg

[aholzhammer]

@albatros99 

7.0u2c has been released on August 27th:
https://docs.vmware.com/en/VMware-vSphere/7.0/rn/vsphere-esxi-70u2c-release-notes.html

I will try in maintenance mode once back from vacation

[albatros99]

How do you have install the update of this?
a) manually

b) over lifecycle management

what are you steps!

yes, i have Seen this file on my Customer Center, in the past i have Look only on the iso file, as for vcenter!
thanks foryour Information, Customer help Customer, this is Great!

[kostjaaa]

Hi,

was this ever solved? I have the same problem installing patches 7.0U3j and 7.0U3k