You're running an Alder Lake (12th gen) Core processor. Its performance/efficiency core architecture and Windows handling of scheduling threads across the two types of threads are giving Workstation users fits.
If you're running Windows 11 as a host, try changing its power profile from "Balanced" to "Performance" and see if that makes a difference.