OK, I don't see anything like that. When I first fire up the W10 VM, things are a little slow as Windows phones home and moogies around with stuff but that goes away in a minute or 3. Easy to see that if I immediately open a command prompt and type in it.

Hard to believe the  Linux versus Windows host would make any difference, but I have no way to compare.

Since I put the host and critical VM's on NVME drives (2), I am very pleased with performance. 

Are you sure your AV isn't slowing you down?