I suspect the ports on the vSwitch or vDS whichever you are using. Before rebooting, go find the port they are connected to and refresh it. See if the connection is restored.
I would also set static binding on the portgroup being used by the VDI desktops.