I've experienced the same issues

I have a Threadripper 3970x with 128GB RAM running Ubuntu 20.04 as the Host system.

I am using Workstation Pro 16.2 running Ubuntu 20.04 as a guest ( I use this for custom development environments and experimentation)

I found that removing the shared drives, limiting number of CPUs to 1 and cores to 8 gave the best performance and minimized the freezing effect