I have a 2 host cluster. I want all VM's to run on one host in the event of a host failure. To test this, I vMotion all virtual machines to a single host while monitoring esxtop. I see that my VMKMEM state goes from high, to soft, and quickly to hard, causing much memory to be swapped to disk. This is understandable, because page sharing and ballooning take some time to reclaim memory.
After everything is settled down, I see that my host has 4GB of free memory, presumable reclaimed from page sharing, ballooning, and swapping. But, now that we have this much free memory, my RAM could now comfortably hold this data that was swapped.
Is there such a thing as "unswapping" or swapping back to RAM?
What happens to this 1GB that is swapped? Will it stay swapped until the guest frees it, possibly indefinitely hurting my memory performance, or will VMware move this memory back to RAM? When?