Welcome to the Community,
even though this sounds as being related to the one VM, I would actually take a look at the physical switch ports. Make sure spanning tree is set to portfast and there is no portsecurity enabled which would eventually limit the MAC addresses on each port. If it is a Cisco switch it should be set to "switchport mode access".
With the disconnecting/connecting you do, I guess the VM will be assigned to another physical NIC/switch port.
André