So I think I figured it out. I had Geforce Experience on with Instant replay enabled. I turned off accelerate 3d graphics on the VMs and it looks to be working fine.
I think the issue was that Geforce Instant replay was trying to capture both VMs windows because they were using 3d graphics and that caused the crashes to happen.
