One thought. This smells network related but not Fusion related.

Double check /etc/hosts and make sure that the entry for the 127.0.1.1 interface reflects the hostname you selected for the VM. A mismatch here between the hostname and the hosts file will cause delays in network IP address resolutions, which both Firefox and apt rely on.