What version of horizon view are you running with? Does it happen with all clients(windows/mac)?

Can you test with latest horizon view agent 7.11 or 7.12 and 5.4 client?

Also try enabling relative mouse feature and test once: Improve Mouse Performance in a Remote Desktop

Configure Horizon Client to Support Reversed Mouse Buttons