Have you found root cause of your problems ?
We’re struggling with something similar. So far we had several cases. Once it was awkward Cisco Switch behavior remediated by changing its configuration. In other cases we were migrating VMs to hosts connected to different switches and it did the magic. Arp’s were instantly in place.
You have verified that "Notify switches" is selected both on the vSwitch and on the Portgroup?