I sometimes have double hit the caps lock to get it to be really where I want it to be when going back and forth between the guest and the host...
This is a little bit frustrating at times... or at last its a visible seam...