in Settings/USB Controller - I turned off 'Share Bluetooth devices with the virtual machine'.
Set 'USB Compatibility' to 3.1
Seems to have got rid of the lag for me.
Speculation: My wireless host keyboard may have had multiple paths through to the guest. Or choppy buffer access