I've noticed this in the past (and I apologize for not thinking of this possibility sooner). There's something about the name resolution of the hostname in the VM that delays if either the hosts file doesn't have an entry or it can't be resolved from DNS or zeroconf such as Bonjour. Not sure if it's the resolver on the VM or the DNS implementation within Fusion.