After I discovered that I couldn't retrieve any health sensors status as described here:
https://www.emware.nl/articles/vsphere-health-status-unknown.html
I ran:
[root@esxi60:~] services.sh restart
services.sh: stop /etc/init.d/vmtoolsd
Running vmtoolsd stop
vmtoolsd is not running
Errors:
Sysinfo error on operation returned status : Not found. Please see the VMkernel log for detailed error information
services.sh: stopped /etc/init.d/vmtoolsd
services.sh: stop /etc/init.d/vmsyslogd
Running vmsyslogd stop
Stopping vmsyslogd service using init is not supported
services.sh: stopped /etc/init.d/vmsyslogd
services.sh: stop /etc/init.d/xorg
Running xorg stop
services.sh: stopped /etc/init.d/xorg
services.sh: stop /etc/init.d/snmpd
Running snmpd stop
root: snmpd is not running.
services.sh: stopped /etc/init.d/snmpd
services.sh: stop /etc/init.d/wsman
Running wsman stop
Stopping openwsmand
services.sh: stopped /etc/init.d/wsman
services.sh: stop /etc/init.d/sfcbd
Running sfcbd stop
This operation is not supported.
Please use /etc/init.d/sfcbd-watchdog stop
services.sh: stopped /etc/init.d/sfcbd
services.sh: stop /etc/init.d/sfcbd-watchdog
Running sfcbd-watchdog stop
Getting Exclusive access, please wait...
Exclusive access granted.
services.sh: stopped /etc/init.d/sfcbd-watchdog
services.sh: stop /etc/init.d/lwsmd
Running lwsmd stop
watchdog-lwsmd: Terminating watchdog process with PID 35063
Stopping Likewise Service Manager [memory reservation released] ...ok
services.sh: stopped /etc/init.d/lwsmd
services.sh: stop /etc/init.d/vpxa
Running vpxa stop
watchdog-vpxa: Terminating watchdog process with PID 35000
vpxa stopped.
services.sh: stopped /etc/init.d/vpxa
services.sh: stop /etc/init.d/vobd
Running vobd stop
watchdog-vobd: Terminating watchdog process with PID 33247
vobd stopped
services.sh: stopped /etc/init.d/vobd
services.sh: stop /etc/init.d/memscrubd
Running memscrubd stop
memscrubd is not running
services.sh: stopped /etc/init.d/memscrubd
services.sh: stop /etc/init.d/lacp
Running lacp stop
watchdog-net-lacp: Terminating watchdog process with PID 33446
services.sh: stopped /etc/init.d/lacp
services.sh: stop /etc/init.d/nscd
Running nscd stop
watchdog-nscd: Terminating watchdog process with PID 34535
services.sh: stopped /etc/init.d/nscd
services.sh: stop /etc/init.d/cdp
Running cdp stop
watchdog-cdp: Terminating watchdog process with PID 34539
services.sh: stopped /etc/init.d/cdp
services.sh: stop /etc/init.d/dcbd
Running dcbd stop
watchdog-dcbd: Terminating watchdog process with PID 34545
services.sh: stopped /etc/init.d/dcbd
services.sh: stop /etc/init.d/smartd
Running smartd stop
watchdog-smartd: Terminating watchdog process with PID 34530
smartd stopped
services.sh: stopped /etc/init.d/smartd
services.sh: stop /etc/init.d/slpd
Running slpd stop
Stopping slpd
services.sh: stopped /etc/init.d/slpd
services.sh: stop /etc/init.d/rabbitmqproxy
Running rabbitmqproxy stop
rabbitmqproxy is not running
services.sh: stopped /etc/init.d/rabbitmqproxy
services.sh: stop /etc/init.d/nfcd
Running nfcd stop
nfcd is not running
services.sh: stopped /etc/init.d/nfcd
services.sh: stop /etc/init.d/rhttpproxy
Running rhttpproxy stop
watchdog-rhttpproxy: Terminating watchdog process with PID 34194
VMware HTTP reverse proxy stopped.
services.sh: stopped /etc/init.d/rhttpproxy
services.sh: stop /etc/init.d/hostd
Running hostd stop
watchdog-hostd: Terminating watchdog process with PID 34364
hostd stopped.
services.sh: stopped /etc/init.d/hostd
services.sh: stop /etc/init.d/lbtd
Running lbtd stop
watchdog-net-lbt: Terminating watchdog process with PID 34113
net-lbt stopped
services.sh: stopped /etc/init.d/lbtd
services.sh: stop /etc/init.d/sensord
Running sensord stop
watchdog-sensord: Terminating watchdog process with PID 34094
sensord stopped
services.sh: stopped /etc/init.d/sensord
services.sh: stop /etc/init.d/vvold
Running vvold stop
/etc/init.d/vvold stop, called by pid 1497346
vvold is not running.
services.sh: stopped /etc/init.d/vvold
services.sh: stop /etc/init.d/storageRM
Running storageRM stop
watchdog-storageRM: Terminating watchdog process with PID 34105
storageRM stopped
services.sh: stopped /etc/init.d/storageRM
services.sh: stop /etc/init.d/sdrsInjector
Running sdrsInjector stop
watchdog-sdrsInjector: Terminating watchdog process with PID 34088
sdrsInjector stopped
services.sh: stopped /etc/init.d/sdrsInjector
services.sh: stop /etc/init.d/vmfstraced
Running vmfstraced stop
watchdog-vmfstracegd: PID file /var/run/vmware/watchdog-vmfstracegd.PID does not exist
watchdog-vmfstracegd: Unable to terminate watchdog: No running watchdog process for vmfstracegd
vmfstracegd is not running
Failed to clear vmfstracegd memory reservation
services.sh: stopped /etc/init.d/vmfstraced
services.sh: stop /etc/init.d/usbarbitrator
Running usbarbitrator stop
UsbUtil: Releasing all USB adapters to VMkernelwatchdog-usbarbitrator: Terminating watchdog process with PID 33953
usbarbitrator stopped
services.sh: stopped /etc/init.d/usbarbitrator
services.sh: stop /etc/init.d/esxui
Running esxui stop
Running 'stop' action
services.sh: stopped /etc/init.d/esxui
services.sh: stop /etc/init.d/swapobjd
Running swapobjd stop
watchdog-swapobjd: Terminating watchdog process with PID 33922
Waiting for process to terminate...
swapobjd stopped
services.sh: stopped /etc/init.d/swapobjd
services.sh: stop /etc/init.d/DCUI
Running DCUI stop
Disabling DCUI logins
VobUserLib_Init failed with -1
services.sh: stopped /etc/init.d/DCUI
services.sh: stop /etc/init.d/SSH
Running SSH stop
SSH login disabled
VobUserLib_Init failed with -1
Connect to localhost failed: Connection failure.
Errors:
Invalid operation requested: This ruleset is required and connot be disabled
services.sh: stopped /etc/init.d/SSH
services.sh: stop /etc/init.d/ntpd
Running ntpd stop
Stopping ntpd
watchdog-ntpd: Terminating watchdog process with PID 33857
Connect to localhost failed: Connection failure.
services.sh: stopped /etc/init.d/ntpd
services.sh: stop /etc/init.d/vsandevicemonitord
Running vsandevicemonitord stop
watchdog-VSANDeviceMonitor: PID file /var/run/vmware/watchdog-VSANDeviceMonitor.PID does not exist
watchdog-VSANDeviceMonitor: Unable to terminate watchdog: No running watchdog process for VSANDeviceMonitor
/usr/lib/vmware/vsan/bin/VSANDeviceMonitor.py is not running
Failed to clear VSANDeviceMonitor memory reservation
services.sh: stopped /etc/init.d/vsandevicemonitord
services.sh: stop /etc/init.d/vsantraced
Running vsantraced stop
watchdog-vsantraced: PID file /var/run/vmware/watchdog-vsantraced.PID does not exist
watchdog-vsantraced: Unable to terminate watchdog: No running watchdog process for vsantraced
vsantraced is not running
watchdog-vsantracedUrgen: PID file /var/run/vmware/watchdog-vsantracedUrgen.PID does not exist
watchdog-vsantracedUrgen: Unable to terminate watchdog: No running watchdog process for vsantracedUrgen
vsantracedUrgen is not running
watchdog-vsanreaderd: PID file /var/run/vmware/watchdog-vsanreaderd.PID does not exist
watchdog-vsanreaderd: Unable to terminate watchdog: No running watchdog process for vsanreaderd
vsanreaderd is not running
Persisting traces to /scratch/vsantraces
cp: can't stat '/var/log/vsantraces/*.index': No such file or directory
ls: /var/log/vsantraces/*.gz: No such file or directory
Failed to clear vsantraced memory reservation
services.sh: stopped /etc/init.d/vsantraced
services.sh: stop /etc/init.d/vsanObserver
Running vsanObserver stop
services.sh: stopped /etc/init.d/vsanObserver
services.sh: stop /etc/init.d/vsanmgmtd
Running vsanmgmtd stop
vsanperfsvc is not running
services.sh: stopped /etc/init.d/vsanmgmtd
services.sh: start /etc/init.d/vsanmgmtd
services.sh: start /etc/init.d/vsanObserver
services.sh: start /etc/init.d/vsantraced
services.sh: start /etc/init.d/vsandevicemonitord
Running vsantraced start
Running vsanmgmtd start
Running vsandevicemonitord start
Running vsanObserver start
VSAN Cluster not configured, not starting vsanObserver
services.sh: started /etc/init.d/vsanObserver
VSAN Cluster not configured, not starting VSANDeviceMonitor
services.sh: started /etc/init.d/vsandevicemonitord
VSAN Cluster not configured, not starting vsantraced
services.sh: started /etc/init.d/vsantraced
VSAN Cluster not configured, not starting vsanperfsvc
services.sh: started /etc/init.d/vsanmgmtd
services.sh: start /etc/init.d/ntpd
services.sh: start /etc/init.d/SSH
services.sh: start /etc/init.d/DCUI
Running DCUI start
Running ntpd start
Running SSH start
Enabling DCUI login: runlevel =
VobUserLib_Init failed with -1
services.sh: started /etc/init.d/DCUI
Connect to localhost failed: Connection failure.
Connect to localhost failed: Connection failure.
SSH login enabled
VobUserLib_Init failed with -1
services.sh: started /etc/init.d/SSH
Starting ntpd
services.sh: started /etc/init.d/ntpd
services.sh: start /etc/init.d/swapobjd
services.sh: start /etc/init.d/esxui
services.sh: start /etc/init.d/usbarbitrator
Running usbarbitrator start
Running esxui start
Running swapobjd start
Running 'start' action
no /ui endpoint found
/ticket endpoint found
/etc/init.d/esxui: line 123: restart_rhttpproxy_if_needed: not found
Option with the name HostClient.SessionTimeout does not exist. Cannot delete.
didn't remove advanced option: HostClient.SessionTimeout
Option with the name HostClient.EnableVisualEffects does not exist. Cannot delete.
didn't remove advanced option: HostClient.EnableVisualEffects
Option with the name HostClient.EnableMOTDNotification does not exist. Cannot delete.
didn't remove advanced option: HostClient.EnableMOTDNotification
Option with the name HostClient.CEIPOptIn does not exist. Cannot delete.
didn't remove advanced option: HostClient.CEIPOptIn
Option with the name HostClient.ShowOnlyRecentObjects does not exist. Cannot delete.
didn't remove advanced option: HostClient.ShowOnlyRecentObjects
Option with the name HostClient.DefaultConsole does not exist. Cannot delete.
didn't remove advanced option: HostClient.DefaultConsole
Option with the name HostClient.WelcomeMessage does not exist. Cannot delete.
didn't remove advanced option: HostClient.WelcomeMessage
swapobjd started
services.sh: started /etc/init.d/swapobjd
didn't add advanced option: HostClientSessionTimeout
didn't add advanced option: HostClientEnableVisualEffects
didn't add advanced option: HostClientEnableMOTDNotification
didn't add advanced option: HostClientCEIPOptIn
didn't add advanced option: HostClientShowOnlyRecentObjects
didn't add advanced option: HostClientDefaultConsole
didn't add advanced option: HostClientWelcomeMessage
services.sh: started /etc/init.d/esxui
usbarbitrator started
services.sh: started /etc/init.d/usbarbitrator
services.sh: start /etc/init.d/vmfstraced
services.sh: start /etc/init.d/sdrsInjector
services.sh: start /etc/init.d/storageRM
services.sh: start /etc/init.d/vvold
services.sh: start /etc/init.d/sensord
services.sh: start /etc/init.d/lbtd
services.sh: start /etc/init.d/hostd
services.sh: start /etc/init.d/rhttpproxy
services.sh: start /etc/init.d/nfcd
services.sh: start /etc/init.d/rabbitmqproxy
Running vmfstraced start
Running sdrsInjector start
Running lbtd start
Running rhttpproxy start
Running nfcd start
Running vvold start
Running rabbitmqproxy start
Running hostd start
Running storageRM start
Running sensord start
VMFS Global Tracing is not enabled.
services.sh: started /etc/init.d/vmfstraced
/etc/init.d/vvold start, called by pid 1498036
nfcd started
sdrsInjector started
services.sh: started /etc/init.d/nfcd
services.sh: started /etc/init.d/sdrsInjector
net-lbt started
storageRM started
services.sh: started /etc/init.d/lbtd
services.sh: started /etc/init.d/storageRM
sensord started
services.sh: started /etc/init.d/sensord
vvold max reserve memory set to 200
VMware HTTP reverse proxy started.
services.sh: started /etc/init.d/rhttpproxy
Ramdisk 'hostd' with estimated size of 1053MB already exists
rabbitmqproxy not up, probably not unconfigured yet.
services.sh: started /etc/init.d/rabbitmqproxy
hostd started.
services.sh: started /etc/init.d/hostd
WaitVvoldToComeUp /var/run/vmware/.vmware-vvol.started created
vvold stopped after start!
/var/run/vmware/.vmware-vvol.started is not created
Successfully cleared vvold memory reservation
services.sh: started /etc/init.d/vvold
services.sh: start /etc/init.d/slpd
Running slpd start
Starting slpd
services.sh: started /etc/init.d/slpd
services.sh: start /etc/init.d/smartd
services.sh: start /etc/init.d/dcbd
services.sh: start /etc/init.d/cdp
services.sh: start /etc/init.d/nscd
services.sh: start /etc/init.d/lacp
services.sh: start /etc/init.d/memscrubd
Running dcbd start
Running smartd start
Running cdp start
Running nscd start
Running memscrubd start
Running lacp start
The checkPages boot option is FALSE, hence memscrubd could not be started.
services.sh: started /etc/init.d/memscrubd
nscd started
smartd started
services.sh: started /etc/init.d/nscd
services.sh: started /etc/init.d/smartd
dcbd started
cdp started
services.sh: started /etc/init.d/dcbd
services.sh: started /etc/init.d/cdp
LACP daemon started
services.sh: started /etc/init.d/lacp
services.sh: start /etc/init.d/vobd
Running vobd start
vobd started
services.sh: started /etc/init.d/vobd
services.sh: start /etc/init.d/vpxa
Running vpxa start
services.sh: started /etc/init.d/vpxa
services.sh: start /etc/init.d/lwsmd
Running lwsmd start
Starting Likewise Service Manager [memory reservation set] [Setting SMBv2 enabled to true] [starting lsass service] Starting service dependency: netlogon
Starting service dependency: lwio
Starting service dependency: rdr
Starting service: lsass
...ok
services.sh: started /etc/init.d/lwsmd
services.sh: start /etc/init.d/sfcbd-watchdog
Running sfcbd-watchdog start
Getting Exclusive access, please wait...
Exclusive access granted.
sfcbd is running.
services.sh: started /etc/init.d/sfcbd-watchdog
services.sh: start /etc/init.d/sfcbd
services.sh: start /etc/init.d/wsman
services.sh: start /etc/init.d/snmpd
Running sfcbd start
Running snmpd start
Running wsman start
Starting openwsmand
This operation is not supported.
Please use /etc/init.d/sfcbd-watchdog start
services.sh: started /etc/init.d/sfcbd
services.sh: started /etc/init.d/wsman
root: snmpd has not been enabled.
services.sh: started /etc/init.d/snmpd
services.sh: start /etc/init.d/xorg
services.sh: start /etc/init.d/vmsyslogd
services.sh: start /etc/init.d/vmtoolsd
Running vmsyslogd start
Running vmtoolsd start
Running xorg start
services.sh: started /etc/init.d/vmtoolsd
vmsyslogd is running.
services.sh: started /etc/init.d/vmsyslogd
services.sh: started /etc/init.d/xorg
[root@esxi60:~] /etc/init.d/sfcbd-watchdog start
Getting Exclusive access, please wait...
Exclusive access granted.
sfcbd is running.
This has made matters worse and now I can't even see any sensors listed:
Current status of my services:
Any idea what else to try before attempting a full reboot?
