VMware Cloud Community
mediatr
Contributor
Contributor

Esxi and all VMs stop responding

Hi,

My ESXi 5.5 reccurently and suddenly stop responding and all VMs are not pingable.

I can't fin a workaround for this. Please help.

This is what i found in my hostd.log :

2018-07-18T21:25:00.022Z [6C2E1B70 verbose 'Statssvc.vim.PerformanceManager'] HostCtl Exception in stats collection: Sysinfo error on operation returned status : Not initialized. Please see the VMkernel log for detailed error information

2018-07-18T21:25:00.022Z [6C2E1B70 verbose 'Statssvc.vim.PerformanceManager'] HostCtl Exception in stats collection.  Turn on 'trivia' log for details

2018-07-18T21:25:01.283Z [FFBCFB70 verbose 'Hostsvc.ResourcePool ha-root-pool'] Root pool capacity changed from 17500MHz/60725MB to 17500MHz/60734MB

2018-07-18T21:25:02.000Z [6C2E1B70 verbose 'SoapAdapter'] Responded to service state request

2018-07-18T21:25:08.283Z [6C8C1B70 info 'Solo.Vmomi' opID=hostd-d353 user=root] Activation [N5Vmomi10ActivationE:0x6c752a88] : Invoke done [waitForUpdates] on [vmodl.query.PropertyCollector:ha-property-collector]

2018-07-18T21:25:08.283Z [6C8C1B70 verbose 'Solo.Vmomi' opID=hostd-d353 user=root] Arg version:

--> "297"

2018-07-18T21:25:08.283Z [6C8C1B70 info 'Solo.Vmomi' opID=hostd-d353 user=root] Throw vmodl.fault.RequestCanceled

2018-07-18T21:25:08.283Z [6C8C1B70 info 'Solo.Vmomi' opID=hostd-d353 user=root] Result:

--> (vmodl.fault.RequestCanceled) {

-->    dynamicType = <unset>,

-->    faultCause = (vmodl.MethodFault) null,

-->    msg = "",

--> }

2018-07-18T21:25:08.284Z [FFBCFB70 error 'SoapAdapter.HTTPService.HttpConnection'] Failed to read header on stream <io_obj p:0x6c706508, h:84, <TCP '0.0.0.0:0'>, <TCP '0.0.0.0:0'>>: N7Vmacore15SystemExceptionE(Connection reset by peer)

2018-07-18T21:25:14.561Z [6CDC2B70 verbose 'Cimsvc'] Ticket issued for CIMOM version 1.0, user root

2018-07-18T21:25:20.021Z [6C2E1B70 verbose 'Statssvc.vim.PerformanceManager'] HostCtl Exception in stats collection: Sysinfo error on operation returned status : Not initialized. Please see the VMkernel log for detailed error information

2018-07-18T21:25:20.021Z [6C2E1B70 verbose 'Statssvc.vim.PerformanceManager'] HostCtl Exception in stats collection.  Turn on 'trivia' log for details

2018-07-18T21:25:40.021Z [6C2E1B70 verbose 'Statssvc.vim.PerformanceManager'] HostCtl Exception in stats collection: Sysinfo error on operation returned status : Not initialized. Please see the VMkernel log for detailed error information

2018-07-18T21:25:40.021Z [6C2E1B70 verbose 'Statssvc.vim.PerformanceManager'] HostCtl Exception in stats collection.  Turn on 'trivia' log for details

2018-07-18T21:26:00.021Z [6C2E1B70 verbose 'Statssvc.vim.PerformanceManager'] HostCtl Exception in stats collection: Sysinfo error on operation returned status : Not initialized. Please see the VMkernel log for detailed error information

2018-07-18T21:26:00.021Z [6C2E1B70 verbose 'Statssvc.vim.PerformanceManager'] HostCtl Exception in stats collection.  Turn on 'trivia' log for details

2018-07-18T21:26:01.284Z [6C8C1B70 verbose 'Hostsvc.ResourcePool ha-root-pool'] Root pool capacity changed from 17500MHz/60734MB to 17500MHz/60733MB

2018-07-18T21:26:20.022Z [6C860B70 verbose 'Statssvc.vim.PerformanceManager'] HostCtl Exception in stats collection: Sysinfo error on operation returned status : Not initialized. Please see the VMkernel log for detailed error information

2018-07-18T21:26:20.022Z [6C860B70 verbose 'Statssvc.vim.PerformanceManager'] HostCtl Exception in stats collection.  Turn on 'trivia' log for details

0 Kudos
27 Replies
Devi94
Hot Shot
Hot Shot

Where is your ESXi installed ? In USB, local disk or san ? can you run below command for me and share output ?

esxcfg-scsidevs -l

If possible please share events of host during the time of issue.

0 Kudos
mediatr
Contributor
Contributor

Attached the screen of command result.

logs files also attached.

hostd.log

usb.log

vmkdevmgr.log

vmkernel.log

vmkwarning.log

Please tell me if you need another logs file

0 Kudos
Devi94
Hot Shot
Hot Shot

I could see last logs on 29th June. No recent logs.

0 Kudos
mediatr
Contributor
Contributor

Sorry, it was my fault. Find attached the new file.

PS : the server was down at 25-07-2018 17:59 .

0 Kudos
Devi94
Hot Shot
Hot Shot

This is more of firmware/driver issue. your hardware is also not compatible with esxi 5.5. At this point I could say try upgrading your firmware and drivers to latest version and make sure your hardware is healthy.

I would recommend to migrate to new server as soon as possible. Because you will not get VMware/hardware vendor support in critical situation.

0 Kudos
mediatr
Contributor
Contributor

Thank you very much Devi94 for you time and conclusion.

One more question please, how can I update my firmware/drivers ?

0 Kudos
Devi94
Hot Shot
Hot Shot

below video can helpful to you.

Firmware Supermicro Ipmi Update - YouTube

you can download firmware from supermicro.com.

0 Kudos
mediatr
Contributor
Contributor

Thank you a lot.

0 Kudos