Looks like the hosts are crashing in the RSS and Load Balancer module. Can you disable RSS and monitor the hosts? You can run the below command for all the uplinks one by one and disable RSS -
esxcli network nic queue loadbalancer set --rsslb=false -n vmnicX
Cheers,
Supreet