I have same problems. I found a workaround, at least for my system (Windows 11 as host, Ubuntu 22.4 LTS as guest)
When Ubuntu is froozen please press Alt + Tab to switch between the open windows. If you do this to all open windows it defrozes Ubuntu and you can work with it as long as no screen saver starts again.
