in Settings/USB Controller - I turned off 'Share Bluetooth devices with the virtual machine'. 
Set 'USB Compatibility' to 3.1
Seems to have got rid of the lag for me.

Speculation: My wireless host keyboard may have had multiple paths through to the guest. Or choppy buffer access