Have you tried enabling the VNC console built into Fusion and accessing your image with a VNC client? To be clear this isn't installing a VNC server in the guest. Its enabling an "alternative console" method, VNC and accessing your image this way. I have found that the VNC console is better at avoiding key repeats and gives accurate mouse tracking whenever running the Tools in the image is not possible. Eric has the how-to details for enabling VNC here A Power User's Guide to VMware Fusion
Thanks, I currently use the VNC connection - but I thought maybe there is a way to avoid VNC ..