VMware

This Question is Possibly Answered

1 "correct" answer available (10 pts) 2 "helpful" answers available (6 pts)
8 Replies Last post: Nov 5, 2009 11:04 AM by hayesbrett10  

AsyncRead errors; SSL Handshake failed with unexpected EOF posted: Jul 28, 2009 1:07 PM

Click to view bigDavefromTrenton's profile Novice
bigDavefromTr…
14 posts since
Jul 28, 2009

I'm getting these errors in my hostd logs; can anyone pinpoint my issue?

VMware ESX Server 3.5.0 build-153875 connected to a MSA1000 storage array.

2009-07-24 15:05:00.751 'App' 74230704 error SSLStreamImpl::DoServerHandshake ( 959C0B8) SSL_accept failed with Unexpected EOF
2009-07-24 15:05:00.751 'Proxysvc' 74230704 warning SSL Handshake on client connection failed for peer 10.10.10.10, error=SSL Exception: Unexpected EOF
2009-07-24 15:05:01.296 'App' 24226736 error SSLStreamImpl::DoServerHandshake ( 959C0B8) SSL_accept failed with Unexpected EOF
2009-07-24 15:05:01.297 'Proxysvc' 24226736 warning SSL Handshake on client connection failed for peer 10.10.10.10, error=SSL Exception: Unexpected EOF
2009-07-24 15:05:10.100 'ha-eventmgr' 87055280 info Event 370 : User vizmon@127.0.0.1 logged in
2009-07-24 15:05:58.780 'App' 87055280 warning Closing stream UNIX(/var/run/vmware/proxy-sdk) due to timeout
2009-07-24 15:06:14.088 'App' 25496496 error ResponseCompleted Close or AsyncRead failed Bad file descriptor/N7Vmacore15SystemExceptionE

Re: AsyncRead errors; SSL Handshake failed with unexpected EOF

1. Jul 28, 2009 2:08 PM in response to: bigDavefromTr…
Click to view kjb007's profile Guru
kjb007
5,476 posts since
Sep 18, 2006
Are you seeing an error that is pointing you to these log entries? With regards to your log entries, have you enabled validating SSL certificates on the server side?

-KjB
VMware vExpert

Re: AsyncRead errors; SSL Handshake failed with unexpected EOF

2. Jul 30, 2009 6:37 AM in response to: kjb007
Click to view bigDavefromTrenton's profile Novice
bigDavefromTr…
14 posts since
Jul 28, 2009

The errors are only happening on 2 ESX hosts in a cluster of 8. We migrated the VM's off; rebooted the 2 affected hosts; and still see the errors come through. No VM's have been placed back on the hosts. The errors persist.

2009-07-29 10:26:43.127 'App' 22870960 error ResponseCompleted Close or AsyncRead failed Bad file descriptor/N7Vmacore15SystemExceptionE
2009-07-29 10:28:40.853 'App' 25369520 error ResponseCompleted Close or AsyncRead failed Bad file descriptor/N7Vmacore15SystemExceptionE
2009-07-29 10:31:40.857 'App' 22604720 error ResponseCompleted Close or AsyncRead failed Bad file descriptor/N7Vmacore15SystemExceptionE
2009-07-29 10:33:34.518 'App' 25369520 error ResponseCompleted Close or AsyncRead failed Bad file descriptor/N7Vmacore15SystemExceptionE

2009-07-29 10:26:50.925 'ha-eventmgr' 3076436896 info Event 23 : User vizmon@127.0.0.1 logged in
2009-07-29 10:27:06.789 'ha-eventmgr' 25369520 info Event 24 : User vizmon@127.0.0.1 logged in
2009-07-29 10:27:14.975 'ha-eventmgr' 22338480 info Event 25 : User vizmon@127.0.0.1 logged in
2009-07-29 10:27:19.070 'ha-eventmgr' 22338480 info Event 26 : User vizmon logged out
2009-07-29 10:27:27.144 'ha-eventmgr' 120785840 info Event 27 : User vizmon@127.0.0.1 logged in
2009-07-29 10:28:19.466 'App' 32705456 warning Closing stream UNIX(/var/run/vmware/proxy-sdk) due to timeout
2009-07-29 10:28:40.853 'App' 25369520 error ResponseCompleted Close or AsyncRead failed Bad file descriptor/N7Vmacore15Sys
temExceptionE
2009-07-29 10:28:44.973 'Vimsvc' 22604720 info Auth: User root
2009-07-29 10:28:44.973 'ha-eventmgr' 22604720 info Event 28 : User root@127.0.0.1 logged in
2009-07-29 10:28:44.985 'ha-eventmgr' 40369072 info Event 29 : User root@127.0.0.1 logged in
2009-07-29 10:28:44.995 'ha-eventmgr' 3076436896 info Event 30 : User root logged out
2009-07-29 10:28:45.032 'ha-eventmgr' 120785840 info Event 31 : User root logged out
2009-07-29 10:28:45.128 'Vimsvc' 22604720 info Auth: User root
2009-07-29 10:28:45.129 'ha-eventmgr' 22604720 info Event 32 : User root@127.0.0.1 logged in
2009-07-29 10:28:45.144 'ha-eventmgr' 120785840 info Event 33 : User root logged out
2009-07-29 10:28:57.591 'TaskManager' 40369072 info Task Created : haTask-ha-host-vim.host.FirewallSystem.disableRuleset-34
3
2009-07-29 10:28:58.442 'TaskManager' 40369072 info Task Completed : haTask-ha-host-vim.host.FirewallSystem.disableRuleset-
343
2009-07-29 10:29:05.519 'TaskManager' 22338480 info Task Created : haTask-ha-host-vim.host.NetworkSystem.refresh-346
2009-07-29 10:29:05.519 'NetworkProvider' 22338480 info Refreshing the entire network configuration...
2009-07-29 10:29:05.635 'NetworkProvider' 22338480 info Refreshed the entire network configuration.
2009-07-29 10:29:05.646 'TaskManager' 22338480 info Task Completed : haTask-ha-host-vim.host.NetworkSystem.refresh-346
2009-07-29 10:29:07.220 'PropertyCollector' 22870960 warning GetPropertyProvider failed for haTask--vim.host.AutoStartManag
er.autoPowerOn-262
2009-07-29 10:29:07.618 'ha-eventmgr' 32705456 info Event 34 : User vizmon logged out
2009-07-29 10:29:10.767 'TaskManager' 40369072 info Task Created : haTask-ha-host-vim.host.FirewallSystem.enableRuleset-351
2009-07-29 10:29:11.695 'TaskManager' 40369072 info Task Completed : haTask-ha-host-vim.host.FirewallSystem.enableRuleset-3
51
2009-07-29 10:29:19.228 'PropertyCollector' 3076436896 warning GetPropertyProvider failed for haTask-ha-host-vim.host.Servi
ceSystem.refresh-267
2009-07-29 10:29:19.709 'EnvironmentBrowser' 22338480 info Hw info file: /etc/vmware/hostd/hwInfo.xml
2009-07-29 10:29:19.713 'EnvironmentBrowser' 22338480 info Config target info loaded
2009-07-29 10:29:21.248 'PropertyCollector' 25369520 warning GetPropertyProvider failed for haTask-ha-compute-res-vim.Compu
teResource.reconfigureEx-276
2009-07-29 10:29:45.633 'Vimsvc' 22338480 info Auth: User root
2009-07-29 10:29:45.633 'ha-eventmgr' 22338480 info Event 35 : User root@127.0.0.1 logged in
2009-07-29 10:29:45.649 'ha-eventmgr' 22870960 info Event 36 : User root logged out
2009-07-29 10:29:45.783 'Vimsvc' 22338480 info Auth: User root

2009-07-29 10:29:45.784 'ha-eventmgr' 22338480 info Event 37 : User root@127.0.0.1 logged in
2009-07-29 10:29:45.794 'ha-eventmgr' 32705456 info Event 38 : User root logged out
2009-07-29 10:29:45.890 'Vimsvc' 22338480 info Auth: User root
2009-07-29 10:29:45.890 'ha-eventmgr' 22338480 info Event 39 : User root@127.0.0.1 logged in
2009-07-29 10:29:45.901 'ha-eventmgr' 120785840 info Event 40 : User root logged out
2009-07-29 10:29:45.995 'Vimsvc' 22338480 info Auth: User root
2009-07-29 10:29:45.995 'ha-eventmgr' 22338480 info Event 41 : User root@127.0.0.1 logged in
2009-07-29 10:29:46.006 'ha-eventmgr' 120785840 info Event 42 : User root logged out
2009-07-29 10:29:46.105 'Vimsvc' 22338480 info Auth: User root
2009-07-29 10:29:46.105 'ha-eventmgr' 22338480 info Event 43 : User root@127.0.0.1 logged in
2009-07-29 10:29:46.116 'ha-eventmgr' 120785840 info Event 44 : User root logged out
2009-07-29 10:29:54.577 'PropertyCollector' 120785840 warning GetPropertyProvider failed for haTask-ha-host-vim.HostSystem.
exitMaintenanceMode-284
2009-07-29 10:29:54.578 'PropertyCollector' 120785840 warning GetPropertyProvider failed for haTask-ha-host-vim.host.Networ
kSystem.refresh-286
2009-07-29 10:29:56.597 'PropertyCollector' 3076436896 warning GetPropertyProvider failed for haTask-ha-compute-res-vim.Com
puteResource.reconfigureEx-289
2009-07-29 10:30:01.548 'App' 32705456 error SSLStreamImpl::DoServerHandshake ( 8AF9C80) SSL_accept failed with Unexpected
EOF
2009-07-29 10:30:01.548 'Proxysvc' 32705456 warning SSL Handshake on client connection failed for peer 10.x.x.x, error=S
SL Exception: Unexpected EOF
2009-07-29 10:30:02.893 'App' 120785840 error SSLStreamImpl::DoServerHandshake ( 8AF9C80) SSL_accept failed with Unexpected
EOF
2009-07-29 10:30:02.893 'Proxysvc' 120785840 warning SSL Handshake on client connection failed for peer 10.x.x.x, error=
SSL Exception: Unexpected EOF
2009-07-29 10:30:03.667 'PropertyCollector' 25369520 warning GetPropertyProvider failed for haTask-ha-host-vim.host.Firewal
lSystem.enableRuleset-293
2009-07-29 10:30:13.852 'ha-eventmgr' 22338480 info Event 45 : User vizmon@127.0.0.1 logged in
2009-07-29 10:31:04.776 'App' 40369072 warning Closing stream UNIX(/var/run/vmware/proxy-sdk) due to timeout
2009-07-29 10:31:40.857 'App' 22604720 error ResponseCompleted Close or AsyncRead failed Bad file descriptor/N7Vmacore15Sys
temExceptionE
2009-07-29 10:31:52.606 'ha-eventmgr' 32705456 info Event 46 : User vizmon@127.0.0.1 logged in
2009-07-29 10:32:07.776 'ha-eventmgr' 22338480 info Event 47 : User vizmon@127.0.0.1 logged in
2009-07-29 10:32:22.468 'ha-eventmgr' 40369072 info Event 48 : User vizmon@127.0.0.1 logged in
2009-07-29 10:32:27.119 'ha-eventmgr' 3076436896 info Event 49 : User vizmon logged out
2009-07-29 10:32:35.897 'ha-eventmgr' 22338480 info Event 50 : User vizmon@127.0.0.1 logged in
2009-07-29 10:33:30.046 'App' 22604720 warning Closing stream UNIX(/var/run/vmware/proxy-sdk) due to timeout
2009-07-29 10:33:34.518 'App' 25369520 error ResponseCompleted Close or AsyncRead failed Bad file descriptor/N7Vmacore15Sys
temExceptionE

Re: AsyncRead errors; SSL Handshake failed with unexpected EOF

3. Jul 30, 2009 7:08 AM in response to: bigDavefromTr…
Click to view kjb007's profile Guru
kjb007
5,476 posts since
Sep 18, 2006

Can you connect to webaccess on those esx hosts? You can try recreating the ssl certificates on the host itself. Log into the console, 'cd /etc/vmware/ssl'. Move those two files to another location, 'mv * /tmp'. Then restart hostd, 'service mgmt-vmware restart'.


-KjB
VMware vExpert

Re: AsyncRead errors; SSL Handshake failed with unexpected EOF

4. Sep 9, 2009 1:40 PM in response to: kjb007
Click to view virtek's profile Hot Shot
virtek
120 posts since
Jul 18, 2006
I am getting same errors in hostd.log on one of two vsphere ESX hosts. They symptom is an inability to establish connection (as a result of the SSL failure). The message is attached. I can ping SC and putty into the host. I tried removing SSL files as you suggested and restarting mgmt-vmware service and no luck ?

Re: AsyncRead errors; SSL Handshake failed with unexpected EOF

5. Sep 9, 2009 2:12 PM in response to: kjb007
Click to view virtek's profile Hot Shot
virtek
120 posts since
Jul 18, 2006

Here is the error from viclient attached in word


Attachments:

Re: AsyncRead errors; SSL Handshake failed with unexpected EOF

6. Sep 9, 2009 2:27 PM in response to: bigDavefromTr…
Click to view virtek's profile Hot Shot
virtek
120 posts since
Jul 18, 2006


Check for a version mismatch between the client and ESX or vSphere by going to Help About from within the VI Client.

Re: AsyncRead errors; SSL Handshake failed with unexpected EOF

7. Sep 9, 2009 3:22 PM in response to: bigDavefromTr…
Click to view virtek's profile Hot Shot
virtek
120 posts since
Jul 18, 2006

Got it. It turned out to be a client (IE) Certificate issue. I must have previously told Vi Client to install the certificate for the host I was connecting to. I went into IE, removed the certificate for the host I was having an issue with and then cleared SSL cache and that fixed it for me.

Please award points for correct answers.

Re: AsyncRead errors; SSL Handshake failed with unexpected EOF

8. Nov 5, 2009 11:04 AM in response to: virtek
Click to view hayesbrett10's profile Lurker
hayesbrett10
1 posts since
Jul 9, 2008

This fixed my issue as well. Went to IE, tools, options, contect tab and clicked Clear SSL state. After this the server came back into the vCenter as connected and no issues. This happened to me after a simple reboot of the esxi server.

Thanks for the workaround. Anybody have an idea on a perm fix for this issue?

Actions

VMware Developer

SDKs, APIs, Videos, Learn and much more in the Developer community.

Learn More

Developer Sample Code

Increase your developer productivity with VMware API sample code.

Learn More

VMworld Sessions & Labs

Online access to the latest VMworld Sessions & Labs and online services.

Learn more

Purchase PSO Credits Online

Purchase credits to redeem training and consulting services online.

Buy Now

Community Hardware Software

View reported configurations or report your own.

Learn More

VMware vSphere

Come witness the next giant leap in virtualization.

Register Today

Communities