I've been able to repro this on my Mac mini M1, external Magic Trackpad v1, Fusion 13 and a Win 11 ARM 22H2 VM. I'd say it's a bug.

If you have access to open a support request, I'd do that. Something about how the trackpad is sending events and how Fusion is interpreting them before sending to the VM is not quite right.