VMware Cloud Community
PiotrBerent
Contributor
Contributor

vRealize Suite Lifecycle Manager update from 8.8.2.3 to 8.10 stuck at install

Hello, I'm in process of upgradeing VCF up to 4.5 from 4.4.1.1 - besides plenty of issues with NSX update and vCenter as well, now I'm stuck with updating lifecycle manager from 8.8.2.3 up to 8.10. It just stuck at installation stage, just throwing every 4 seconds to the logs following info:


2022-10-21 16:37:27.391 INFO [http-nio-8080-exec-1] c.v.v.l.u.ShellExecutor - -- Executing shell command: /opt/vmware/bin/vamicli update --progress --detail
2022-10-21 16:37:27.391 INFO [http-nio-8080-exec-1] c.v.v.l.u.ProcessUtil - -- Execute /opt/vmware/bin/vamicli
2022-10-21 16:37:27.423 INFO [http-nio-8080-exec-1] c.v.v.l.u.ShellExecutor - -- Result: [56 packages have been downloaded.
Installing...].
2022-10-21 16:37:31.394 INFO [http-nio-8080-exec-9] c.v.v.l.u.ShellExecutor - -- Executing shell command: /opt/vmware/bin/vamicli update --progress --detail
2022-10-21 16:37:31.395 INFO [http-nio-8080-exec-9] c.v.v.l.u.ProcessUtil - -- Execute /opt/vmware/bin/vamicli
2022-10-21 16:37:31.427 INFO [http-nio-8080-exec-9] c.v.v.l.u.ShellExecutor - -- Result: [56 packages have been downloaded.
Installing...].

I've raised ticket to support, but I need to wait until Monday. I've already tried the trick with removing /etc/upgradeprogress file, restarted installation and stuck (now it is stuck for arround 8 hours) exactly at the same stage.

Labels (1)
7 Replies
viquarhcimca
Enthusiast
Enthusiast

can you try follow this steps : https://www.nukescloud.com/post/upgrade-vrlscm-8-8-2-3-to-8-10vRSLCM upgrade to 8.x stuck on downloa...

Thanks & Regards,

Mohammed Viquar Ahmed
PiotrBerent
Contributor
Contributor

Yup, I've already tried that.

My situation is described here (kb adviced by VMWare Support): https://kb.vmware.com/s/article/89606

It is a step in right direction however…

I’ve copied first package which was missing:

Stat file, file missing. filename=/opt/vmware/var/lib/vami/update/data/package-pool/package-pool/audit-2.8.5-19.ph3.x86_64.rpm

 

So i’ve revert snapshot, copied file to location from KB article, but next run was failed with another missing file:

Stat file, file missing. filename=/opt/vmware/var/lib/vami/update/data/package-pool/package-pool/bash-4.4.18-3.ph3.x86_64.rpm

 

So, I’ve just check how mnay files are on cd, and how many are in /opt…. Update folder, but here it seems all files are there – and they are, I’ve checked

root@vrslcm [ ~ ]# ls /opt/vmware/var/lib/vami/update/data/package-pool/package-pool/ | wc -l

56

But I did check if the file is really missing, and it is not, file is there.

root@vrslcm [ ~ ]# ls -al /opt/vmware/var/lib/vami/update/data/package-pool/package-pool/bash-4.4.18-3.ph3.x86_64.rpm

-r-------- 1 root root 1038794 Oct 23 22:04 /opt/vmware/var/lib/vami/update/data/package-pool/package-pool/bash-4.4.18-3.ph3.x86_64.rpm

But I didn’t give up yet, and I was able to copy  those two packages (audit, and bash), and.. it turns out, that it doesnt help at all, since surpisingly, there was another missing package:

23/10/2022 22:34:14 [INFO] Using update pre-install script

23/10/2022 22:34:14 [DEBUG] Writing to file: pre_install

23/10/2022 22:34:14 [DEBUG] Running CheckPackageSet

23/10/2022 22:34:14 [DEBUG] Stat file, file exists. filename=/opt/vmware/var/lib/vami/update/data/package-pool/package-pool/audit-2.8.5-19.ph3.x86_64.rpm

23/10/2022 22:34:14 [DEBUG] Stat file, file exists. filename=/opt/vmware/var/lib/vami/update/data/package-pool/package-pool/bash-4.4.18-3.ph3.x86_64.rpm

23/10/2022 22:34:14 [DEBUG] Stat file, file missing. filename=/opt/vmware/var/lib/vami/update/data/package-pool/package-pool/bindutils-9.16.33-1.ph3.x86_64.rpm

23/10/2022 22:34:14 [DEBUG] Download Cache Miss: /package-pool/bindutils-9.16.33-1.ph3.x86_64.rpm

23/10/2022 22:34:14 [ERROR] Unable to install updates because package files are missing.

It is a bit of madness here since earlier in the log I can find following:

23/10/2022 22:34:08 [DEBUG] Downloading file. name=audit

23/10/2022 22:34:08 [DEBUG] Opening local file named: /tmp/update_agent_cdrom_ZlJ788/update/package-pool/audit-2.8.5-19.ph3.x86_64.rpm

23/10/2022 22:34:08 [DEBUG] DownloadPackage success

23/10/2022 22:34:08 [DEBUG] Import file. [location,name]:  [/opt/vmware/var/lib/vami/update/data,/package-pool/package-pool/audit-2.8.5-19.ph3.x86_64.rpm]

23/10/2022 22:34:08 [DEBUG] Import successful. filename=/opt/vmware/var/lib/vami/update/data/package-pool/package-pool/audit-2.8.5-19.ph3.x86_64.rpm

23/10/2022 22:34:08 [INFO] Updating package audit status in /opt/vmware/var/lib/vami/update/data/update_progress.json

23/10/2022 22:34:08 [INFO] Downloaded file. url=/package-pool/audit-2.8.5-19.ph3.x86_64.rpm

23/10/2022 22:34:08 [DEBUG] Downloading file. name=bash

23/10/2022 22:34:08 [DEBUG] Opening local file named: /tmp/update_agent_cdrom_ZlJ788/update/package-pool/bash-4.4.18-3.ph3.x86_64.rpm

23/10/2022 22:34:08 [DEBUG] DownloadPackage success

23/10/2022 22:34:08 [DEBUG] Import file. [location,name]:  [/opt/vmware/var/lib/vami/update/data,/package-pool/package-pool/bash-4.4.18-3.ph3.x86_64.rpm]

23/10/2022 22:34:08 [DEBUG] Import successful. filename=/opt/vmware/var/lib/vami/update/data/package-pool/package-pool/bash-4.4.18-3.ph3.x86_64.rpm

23/10/2022 22:34:08 [INFO] Updating package bash status in /opt/vmware/var/lib/vami/update/data/update_progress.json

23/10/2022 22:34:08 [INFO] Downloaded file. url=/package-pool/bash-4.4.18-3.ph3.x86_64.rpm

23/10/2022 22:34:08 [DEBUG] Downloading file. name=bindutils

23/10/2022 22:34:08 [DEBUG] Opening local file named: /tmp/update_agent_cdrom_ZlJ788/update/package-pool/bindutils-9.16.33-1.ph3.x86_64.rpm

23/10/2022 22:34:08 [DEBUG] DownloadPackage success

23/10/2022 22:34:08 [DEBUG] Import file. [location,name]:  [/opt/vmware/var/lib/vami/update/data,/package-pool/package-pool/bindutils-9.16.33-1.ph3.x86_64.rpm]

23/10/2022 22:34:08 [DEBUG] Import successful. filename=/opt/vmware/var/lib/vami/update/data/package-pool/package-pool/bindutils-9.16.33-1.ph3.x86_64.rpm

23/10/2022 22:34:08 [INFO] Updating package bindutils status in /opt/vmware/var/lib/vami/update/data/update_progress.json

23/10/2022 22:34:08 [INFO] Downloaded file. url=/package-pool/bindutils-9.16.33-1.ph3.x86_64.rpm

 

Anyway – I’ve tried to copy all packages (marked in log file – total 56 packages) to copy at once – but seems that it require just a perfect timing since during copy all files at once I’ve ended up with following error:

 

23/10/2022 23:16:23 [DEBUG] Import file. [location,name]:  [/opt/vmware/var/lib/vami/update/data,/package-pool/package-pool/linux-4.19.256-2.ph3.x86_64.rpm]

23/10/2022 23:16:23 [ERROR] Exception while saving file /opt/vmware/var/lib/vami/update/data/package-pool/package-pool/linux-4.19.256-2.ph3.x86_64.rpm: boost::filesystem::copy_file: File exists: "/tmp/vmware_update_download_ANfMqY", "/opt/vmware/var/lib/vami/update/data/package-pool/package-pool/linux-4.19.256-2.ph3.x86_64.rpm"

23/10/2022 23:16:23 [ERROR] Failed to import file. filename=/opt/vmware/var/lib/vami/update/data/package-pool/package-pool/linux-4.19.256-2.ph3.x86_64.rpm

23/10/2022 23:16:23 [ERROR] Failed to write file. url=/package-pool/linux-4.19.256-2.ph3.x86_64.rpm

And here I’ve just give up. So, what is wrong there? Since for me it looks like the update script is poorly writen, or it has some bugs and errors.
Is there any command line tool to force that update? From the logs it looks like i have 2 seconds to fit in and copy all missing packages, which is just crazy. There is no way to copy all those packeges BEFORE upgrade process will start – because it thorws an error also.


viquarhcimca
Enthusiast
Enthusiast

PiotrBerent where u able resolve the issue ?

Thanks & Regards,

Mohammed Viquar Ahmed
Reply
0 Kudos
AughBT
Enthusiast
Enthusiast

Hi There

I'm having trouble with VCF upgrade to 4.5.0 - see my posting from today 15th Nov.

I cannot upgrade vrslcm from 8.6.2 to 8.8.2 - I'm using this method Upgrade vRealize Suite Lifecycle Manager 8.x (vmware.com)

How did you upgrade to 8.8.2 did you use the "System Upgrade" option in vrslcm (under Settings) - were there any problems?

 

thanks

 

AughBT
Enthusiast
Enthusiast

sorted this - I needed support pak4 for VRSLCM - 

After I installed that I could perfomr the upgrade

 

VMware vRealize Suite Lifecycle 8.6.2 PSPAK 4 Release Notes

PiotrBerent
Contributor
Contributor

Yes, In fact it turns that only 3 packets were missing: audit, bash and bindutils

But the copying procedure require just a PERFECT timing.

damtux1
Contributor
Contributor

Excellent thanks for the feedback - got the exact same issue - the reason for the Perfect timing is that the repo is mounted during the upgrade so if you try too soon it will say the directory doesn't exist - and then the file missing are the first one on the list so if you don't retry fast enough it will already failed the upgrade ... just re-try the cp command as fast as you can that's all ... 

Reply
0 Kudos