Are the VM server configured as Microsoft NLB server in Windows Operating system?
check if the Microsoft configured as a unicast NLB in that case you may face this issue.
