It sounds to me that a seperate management network might be needed.
Please award points to any useful answer.
as said, seperate the management Lan from the virtual maschine network with seperat hardware NICs.
Also try another switch. I once had random disconnects and the CDP (Cisco Discovery Protocoll) wasn't working as intended. Found out it was an old Switch causing me problems.
Regards