What version of horizon view are you running with? Does it happen with all clients(windows/mac)?
Can you test with latest horizon view agent 7.11 or 7.12 and 5.4 client?
Also try enabling relative mouse feature and test once: Improve Mouse Performance in a Remote Desktop
Configure Horizon Client to Support Reversed Mouse Buttons
