VMware Cloud Community
Tuteks
Enthusiast
Enthusiast
‎05-04-2021 11:19 PM

Power failure and "no healthy upstream" error

Hi,

my vcenter was power off because of power failure, after start I have on web browser such error "no healthy upstream". I have access to Vcenter Server Management.

I do ssh to server and in /bin executed:

 

root@vcsa [ /bin ]# service-control --start --all
Operation not cancellable. Please wait for it to finish...
Performing start operation on service lwsmd...
Successfully started service lwsmd
Performing start operation on service vmafdd...
Successfully started service vmafdd
Performing start operation on service vmdird...
Successfully started service vmdird
Performing start operation on service vmcad...
Successfully started service vmcad
Performing start operation on profile: ALL...
Service-control failed. Error: Failed to start services in profile ALL. RC=5, stderr=Failed to start eam, rhttpproxy, analytics, statsmonitor, sts, vmware-vpostgres services. Error: Operation not allowed in current service state

 

 

root@vcsa [ /bin ]# service-control --status
Running:
 applmgmt lookupsvc lwsmd observability observability-vapi pschealth vlcm vmafdd vmcad vmdird vmonapi vmware-analytics vmware-certificateauthority vmware-certificatemanagement vmware-cis-license vmware-eam vmware-envoy vmware-hvc vmware-infraprofile vmware-perfcharts vmware-pod vmware-postgres-archiver vmware-rhttpproxy vmware-sca vmware-statsmonitor vmware-stsd vmware-topologysvc vmware-trustmanagement vmware-vapi-endpoint vmware-vdtc vmware-vmon vmware-vpostgres vmware-vpxd-svcs vmware-vsm vsphere-ui vtsdb
StartPending:
 vmware-sps vmware-vsan-health
Stopped:
 vmcam vmware-content-library vmware-imagebuilder vmware-netdumper vmware-rbd-watchdog vmware-updatemgr vmware-vcha vmware-vpxd vstats wcp

 

 

root@vcsa [ /var/log/firstboot ]# service-control --start wcp
Operation not cancellable. Please wait for it to finish...
Performing start operation on service wcp...
^CError executing start on service wcp. Details {
    "detail": [
        {
            "id": "install.ciscommon.service.failstart",
            "translatable": "An error occurred while starting service '%(0)s'",
            "args": [
                "wcp"
            ],
            "localized": "An error occurred while starting service 'wcp'"
        }
    ],
    "componentKey": null,
    "problemId": null,
    "resolution": null
}
Service-control failed. Error: {
    "detail": [
        {
            "id": "install.ciscommon.service.failstart",
            "translatable": "An error occurred while starting service '%(0)s'",
            "args": [
                "wcp"
            ],
            "localized": "An error occurred while starting service 'wcp'"
        }
    ],
    "componentKey": null,
    "problemId": null,
    "resolution": null
}

 

as you can see I cannot start services that are not running.

0 Kudos
3 Replies
BuloZB
Contributor
Contributor
‎05-17-2021 03:02 PM

anyone can help with this? I have exact same issue after power failure

0 Kudos
Tuteks
Enthusiast
Enthusiast
‎05-25-2021 03:18 AM

Unfortunately I had to reinstall my Vcenter server from scratch,
We decided in our company to slowly switch to hyper-v solutions because lack of support on community.

0 Kudos
qq296015668
Contributor
Contributor
‎11-29-2021 04:28 AM

root@localhost [ ~ ]# service-control --start --all --verbose
Operation not cancellable. Please wait for it to finish...
Perform start operation. vmon_profile=ALL, svc_names=None, include_coreossvcs=True, include_leafossvcs=True
Performing start operation on service lwsmd...
2021-11-29T11:04:31.060Z Running command: ['/usr/bin/systemctl', 'is-enabled', 'lwsmd']
2021-11-29T11:04:31.074Z Done running command
2021-11-29T11:04:31.074Z Running command: ['/sbin/service', 'lwsmd', 'status']
2021-11-29T11:04:31.129Z Done running command
Successfully started service lwsmd
Performing start operation on service vmafdd...
2021-11-29T11:04:31.130Z Running command: ['/usr/bin/systemctl', 'is-enabled', 'vmafdd']
2021-11-29T11:04:31.143Z Done running command
2021-11-29T11:04:31.143Z Running command: ['/sbin/service', 'vmafdd', 'status']
2021-11-29T11:04:31.184Z Done running command
Successfully started service vmafdd
Performing start operation on service vmdird...
2021-11-29T11:04:31.185Z Running command: ['/usr/bin/systemctl', 'is-enabled', 'vmdird']
2021-11-29T11:04:31.198Z Done running command
2021-11-29T11:04:31.198Z Running command: ['/sbin/service', 'vmdird', 'status']
2021-11-29T11:04:31.247Z Done running command
Successfully started service vmdird
Performing start operation on service vmcad...
2021-11-29T11:04:31.248Z Running command: ['/usr/bin/systemctl', 'is-enabled', 'vmcad']
2021-11-29T11:04:31.260Z Done running command
2021-11-29T11:04:31.260Z Running command: ['/sbin/service', 'vmcad', 'status']
2021-11-29T11:04:31.303Z Done running command
Successfully started service vmcad
Performing start operation on profile: ALL...
2021-11-29T11:04:31.306Z Running command: ['/sbin/service', 'vmware-vmon', 'status']
2021-11-29T11:04:31.360Z Done running command
2021-11-29T11:04:31.360Z Running command: ['/usr/lib/vmware-vmon/vmon-cli', '--batchstart', 'ALL']
2021-11-29T11:04:33.713Z Done running command
Service-control failed. Error: Failed to start services in profile ALL. RC=2, stderr=Failed to start eam, vsphere-ui, envoy, vmware-vpostgres services. Error: Service crashed while starting

root@localhost [ ~ ]# /usr/lib/vmware-vmon/vmon-cli --batchstart ALL
Failed to start eam, vsphere-ui, envoy, vmware-vpostgres services. Error: Service crashed while starting

root@localhost [ ~ ]# /usr/lib/vmware-vmon/vmon-cli -i eam
Start service request failed. Error: Service crashed while starting

root@localhost [ ~ ]# tail -f /var/log/vmware/vmon/vmon.log -n 200

# Please check the log

 

 

0 Kudos