I had a similar issue and it turned out to be a DNS issue, with those hosts, which were having issues with HA.
As HA is linked to DNS, within ESXi5.
Hope this helps.
