Do you see any packet drops or ping latency when pinging from the outside PC to the destination VM? Check for a minimum of 30-50 packets.
Cheers,
Supreet
