I can confirm this exact same issue and that it is related to Numlock.

- VMWare 16.2.5

- Ubuntu 22.04 VM

- Nvidia T1200 GPU

None of the other fixes here worked. Turning off numlock fixes the arrow key input lag completely