VMWare Workstation 17 Player, host eventually locks up with win11 guest

[alansrobotlab]

Weirdest thing, I can run the win11 guest for a little while before I start to see slowdowns both in the guest and in the host.  Eventually I need to hard reset the host to get things back to normal.

System config:

[ 0.000000] kernel: Linux version 6.6.10-76060610-generic (jenkins@warp.pop-os.org) (x86_64-linux-gnu-gcc-12 (Ubuntu 12.3.0-1ubuntu1~22.04) 12.3.0, GNU ld (GNU Binutils for Ubuntu) 2.38) #202401051437~1709764300~22.04~379e7a9 SMP PREEMPT_DYNAMIC Thu M

[ 0.000000] kernel: DMI: ASUS System Product Name/Pro WS WRX80E-SAGE SE WIFI II, BIOS 1106 02/10/2023

[ 0.623436] kernel: smpboot: CPU0: AMD Ryzen Threadripper PRO 5955WX 16-Cores (family: 0x19, model: 0x8, stepping: 0x2)

VMWare Workstation Player 17: 17.5.1 build-23298084

Here's a sample from kern.log where things start to get weird.

Mar 24 09:07:39 goliath kernel: [401004.801859] /dev/vmmon[1873273]: PTSC: initialized at 3992500000 Hz using TSC, TSCs are synchronized.

Mar 24 09:07:39 goliath kernel: [401004.857491] /dev/vmmon[1873273]: Monitor IPI vector: 0

Mar 24 09:07:39 goliath kernel: [401004.857496] /dev/vmmon[1873273]: HV IPI vector: 0

Mar 24 09:07:39 goliath kernel: [401004.862317] ------------[ cut here ]------------

Mar 24 09:07:39 goliath kernel: [401004.862320] WARNING: CPU: 30 PID: 1873273 at kernel/rcu/tree_plugin.h:734 rcu_sched_clock_irq+0x4ad/0x4c0

Mar 24 09:07:39 goliath kernel: [401004.862326] Modules linked in: uvcvideo videobuf2_vmalloc uvc videobuf2_memops videobuf2_v4l2 videodev videobuf2_common tls xt_conntrack nft_chain_nat xt_MASQUERADE nf_nat nf_conntrack_netlink nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 xfrm_user xt_addrtype nft_compat nf_tables nfnetlink br_netfilter bridge stp llc vmnet(OE) vmw_vsock_vmci_transport vsock vmw_vmci vmmon(OE) rfcomm snd_seq_dummy snd_hrtimer nvidia_uvm(POE) overlay zstd ipmi_ssif cmac algif_hash algif_skcipher af_alg nvidia_drm(POE) nvidia_modeset(POE) bnep zram snd_hda_codec_hdmi snd_hda_intel snd_intel_dspcfg snd_intel_sdw_acpi snd_usb_audio snd_hda_codec snd_usbmidi_lib nvidia(POE) snd_ump snd_hda_core mc snd_hwdep snd_pcm intel_rapl_msr snd_seq_midi intel_rapl_common snd_seq_midi_event binfmt_misc amd64_edac snd_rawmidi edac_mce_amd btusb btrtl snd_seq iwlmvm kvm_amd btintel eeepc_wmi btbcm nls_iso8859_1 asus_wmi btmtk snd_seq_device snd_timer ledtrig_audio mac80211 kvm bluetooth sparse_keymap drm_kms_helper snd irqbypass libarc4 platform_profile

Mar 24 09:07:39 goliath kernel: [401004.862405] ccp video joydev input_leds soundcore corsair_cpro bfq rapl ecdh_generic wmi_bmof iwlwifi cfg80211 ecc acpi_ipmi mxm_wmi ipmi_si k10temp sp5100_tco ipmi_devintf ipmi_msghandler mac_hid sch_fq_codel kyber_iosched msr parport_pc ppdev lp parport drm efi_pstore ip_tables x_tables autofs4 raid10 raid456 async_raid6_recov async_memcpy async_pq async_xor async_tx xor raid6_pq libcrc32c raid1 multipath linear system76_io(OE) system76_acpi(OE) hid_generic usbhid hid raid0 crct10dif_pclmul crc32_pclmul polyval_clmulni polyval_generic ghash_clmulni_intel sha256_ssse3 sha1_ssse3 aesni_intel nvme crypto_simd cryptd ixgbe nvme_core xfrm_algo ahci nvme_common dca libahci mdio xhci_pci i2c_piix4 xhci_pci_renesas wmi

Mar 24 09:07:39 goliath kernel: [401004.862468] CPU: 30 PID: 1873273 Comm: vmware-vmx Tainted: P OE 6.6.10-76060610-generic #202401051437~1709085277~22.04~31d73d8

Mar 24 09:07:39 goliath kernel: [401004.862470] Hardware name: ASUS System Product Name/Pro WS WRX80E-SAGE SE WIFI II, BIOS 1106 02/10/2023

Mar 24 09:07:39 goliath kernel: [401004.862472] RIP: 0010:rcu_sched_clock_irq+0x4ad/0x4c0

Mar 24 09:07:39 goliath kernel: [401004.862474] Code: 04 25 80 2b 03 00 f0 80 08 08 65 81 25 80 18 66 7c ff ff ff 7f e9 aa fe ff ff 8b 87 38 08 00 00 85 c0 0f 84 27 fc ff ff eb 85 <0f> 0b e9 f1 fb ff ff 66 66 2e 0f 1f 84 00 00 00 00 00 90 90 90 90

Mar 24 09:07:39 goliath kernel: [401004.862476] RSP: 0018:ffffc9000083ce50 EFLAGS: 00010082

Mar 24 09:07:39 goliath kernel: [401004.862478] RAX: ffff8881b94ab380 RBX: 0000000000000000 RCX: 0000000000000000

Mar 24 09:07:39 goliath kernel: [401004.862479] RDX: 00000000ffffffc2 RSI: ffffffff8516fcbe RDI: ffff8881b94ab380

Mar 24 09:07:39 goliath kernel: [401004.862481] RBP: ffffc9000083ce80 R08: 0000000000000000 R09: 0000000000000000

Mar 24 09:07:39 goliath kernel: [401004.862482] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000

Mar 24 09:07:39 goliath kernel: [401004.862483] R13: ffff88bf3ef23ce0 R14: ffffc90035467af8 R15: ffff88bf3ef237c0

Mar 24 09:07:39 goliath kernel: [401004.862484] FS: 0000765e77f8bc00(0000) GS:ffff88bf3ef00000(0000) knlGS:0000000000000000

Mar 24 09:07:39 goliath kernel: [401004.862486] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033

Mar 24 09:07:39 goliath kernel: [401004.862487] CR2: 0000765e74de6000 CR3: 0000000610cfe002 CR4: 0000000000f70ee0

Mar 24 09:07:39 goliath kernel: [401004.862488] PKRU: 55555554

Mar 24 09:07:39 goliath kernel: [401004.862489] Call Trace:

Mar 24 09:07:39 goliath kernel: [401004.862491] <IRQ>

Mar 24 09:07:39 goliath kernel: [401004.862494] ? show_regs+0x6d/0x80

Mar 24 09:07:39 goliath kernel: [401004.862498] ? __warn+0x89/0x160

Mar 24 09:07:39 goliath kernel: [401004.862501] ? rcu_sched_clock_irq+0x4ad/0x4c0

Mar 24 09:07:39 goliath kernel: [401004.862503] ? report_bug+0x17e/0x1b0

Mar 24 09:07:39 goliath kernel: [401004.862508] ? handle_bug+0x46/0x90

Mar 24 09:07:39 goliath kernel: [401004.862511] ? exc_invalid_op+0x18/0x80

Mar 24 09:07:39 goliath kernel: [401004.862514] ? asm_exc_invalid_op+0x1b/0x20

Mar 24 09:07:39 goliath kernel: [401004.862519] ? rcu_sched_clock_irq+0x4ad/0x4c0

Mar 24 09:07:39 goliath kernel: [401004.862522] ? srso_alias_return_thunk+0x5/0x7f

Mar 24 09:07:39 goliath kernel: [401004.862525] update_process_times+0x76/0xb0

Mar 24 09:07:39 goliath kernel: [401004.862529] tick_sched_handle+0x28/0x70

Mar 24 09:07:39 goliath kernel: [401004.862532] tick_sched_timer+0x78/0xa0

Mar 24 09:07:39 goliath kernel: [401004.862534] ? __pfx_tick_sched_timer+0x10/0x10

Mar 24 09:07:39 goliath kernel: [401004.862537] __hrtimer_run_queues+0x112/0x2a0

Mar 24 09:07:39 goliath kernel: [401004.862539] ? srso_alias_return_thunk+0x5/0x7f

Mar 24 09:07:39 goliath kernel: [401004.862542] hrtimer_interrupt+0xf6/0x250

Mar 24 09:07:39 goliath kernel: [401004.862545] __sysvec_apic_timer_interrupt+0x51/0x150

Mar 24 09:07:39 goliath kernel: [401004.862548] sysvec_apic_timer_interrupt+0x8d/0xd0

Mar 24 09:07:39 goliath kernel: [401004.862551] </IRQ>

Mar 24 09:07:39 goliath kernel: [401004.862551] <TASK>

Mar 24 09:07:39 goliath kernel: [401004.862553] asm_sysvec_apic_timer_interrupt+0x1b/0x20

Mar 24 09:07:39 goliath kernel: [401004.862555] RIP: 0010:copy_page_to_iter+0x8c/0xd0

Mar 24 09:07:39 goliath kernel: [401004.862559] Code: 29 f6 4c 39 fe 49 0f 47 f7 48 2b 3d b6 b5 29 01 48 c1 ff 06 48 c1 e7 0c 48 03 3d b7 b5 29 01 4c 01 f7 e8 07 f9 ff ff 49 01 c4 <49> 29 c7 74 1f 48 85 c0 74 1a 49 01 c6 49 81 fe 00 10 00 00 75 b4

Mar 24 09:07:39 goliath kernel: [401004.862560] RSP: 0018:ffffc90035467ba0 EFLAGS: 00000206

Mar 24 09:07:39 goliath kernel: [401004.862562] RAX: 0000000000001000 RBX: ffffea0016767a80 RCX: 0000000000000000

Mar 24 09:07:39 goliath kernel: [401004.862563] RDX: 0000000000000000 RSI: 0000000000000000 RDI: 0000000000000000

Mar 24 09:07:39 goliath kernel: [401004.862564] RBP: ffffc90035467bc8 R08: 0000000000000000 R09: 0000000000000000

Mar 24 09:07:39 goliath kernel: [401004.862565] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000001000

Mar 24 09:07:39 goliath kernel: [401004.862566] R13: ffffc90035467d78 R14: 0000000000000000 R15: 0000000000001000

Mar 24 09:07:39 goliath kernel: [401004.862571] filemap_read+0x236/0x480

Mar 24 09:07:39 goliath kernel: [401004.862577] generic_file_read_iter+0xbb/0x110

Mar 24 09:07:39 goliath kernel: [401004.862580] ext4_file_read_iter+0x63/0x210

Mar 24 09:07:39 goliath kernel: [401004.862583] ? security_file_permission+0x5f/0x70

Mar 24 09:07:39 goliath kernel: [401004.862587] vfs_read+0x20d/0x360

Mar 24 09:07:39 goliath kernel: [401004.862592] ksys_read+0x73/0x100

Mar 24 09:07:39 goliath kernel: [401004.862595] __x64_sys_read+0x19/0x30

Mar 24 09:07:39 goliath kernel: [401004.862597] do_syscall_64+0x5b/0x90

Mar 24 09:07:39 goliath kernel: [401004.862599] ? srso_alias_return_thunk+0x5/0x7f

Mar 24 09:07:39 goliath kernel: [401004.862601] ? count_memcg_events.constprop.0+0x2a/0x50

Mar 24 09:07:39 goliath kernel: [401004.862604] ? srso_alias_return_thunk+0x5/0x7f

Mar 24 09:07:39 goliath kernel: [401004.862606] ? handle_mm_fault+0xad/0x380

Mar 24 09:07:39 goliath kernel: [401004.862609] ? srso_alias_return_thunk+0x5/0x7f

Mar 24 09:07:39 goliath kernel: [401004.862611] ? do_user_addr_fault+0x22b/0x6b0

Mar 24 09:07:39 goliath kernel: [401004.862613] ? srso_alias_return_thunk+0x5/0x7f

Mar 24 09:07:39 goliath kernel: [401004.862615] ? exit_to_user_mode_prepare+0x30/0xb0

Mar 24 09:07:39 goliath kernel: [401004.862617] ? srso_alias_return_thunk+0x5/0x7f

Mar 24 09:07:39 goliath kernel: [401004.862619] ? irqentry_exit_to_user_mode+0x17/0x20

Mar 24 09:07:39 goliath kernel: [401004.862621] ? srso_alias_return_thunk+0x5/0x7f

Mar 24 09:07:39 goliath kernel: [401004.862623] ? irqentry_exit+0x43/0x50

Mar 24 09:07:39 goliath kernel: [401004.862625] ? srso_alias_return_thunk+0x5/0x7f

Mar 24 09:07:39 goliath kernel: [401004.862627] ? exc_page_fault+0x94/0x1b0

Mar 24 09:07:39 goliath kernel: [401004.862629] entry_SYSCALL_64_after_hwframe+0x6e/0xd8

Mar 24 09:07:39 goliath kernel: [401004.862631] RIP: 0033:0x765e77d1481c

Mar 24 09:07:39 goliath kernel: [401004.862656] Code: ec 28 48 89 54 24 18 48 89 74 24 10 89 7c 24 08 e8 e9 c1 f7 ff 48 8b 54 24 18 48 8b 74 24 10 41 89 c0 8b 7c 24 08 31 c0 0f 05 <48> 3d 00 f0 ff ff 77 34 44 89 c7 48 89 44 24 08 e8 2f c2 f7 ff 48

Mar 24 09:07:39 goliath kernel: [401004.862658] RSP: 002b:00007ffc1f665060 EFLAGS: 00000246 ORIG_RAX: 0000000000000000

Mar 24 09:07:39 goliath kernel: [401004.862660] RAX: ffffffffffffffda RBX: 0000000000553f88 RCX: 0000765e77d1481c

Mar 24 09:07:39 goliath kernel: [401004.862661] RDX: 0000000000553f88 RSI: 0000765e74aaa010 RDI: 000000000000004f

Mar 24 09:07:39 goliath kernel: [401004.862662] RBP: 000062b686dfe430 R08: 0000000000000000 R09: 0000765e74aaa010

Mar 24 09:07:39 goliath kernel: [401004.862663] R10: 0000000000000022 R11: 0000000000000246 R12: 0000000000553f88

Mar 24 09:07:39 goliath kernel: [401004.862664] R13: 0000000000000027 R14: 0000765e74aaa010 R15: 0000000000000001

Mar 24 09:07:39 goliath kernel: [401004.862668] </TASK>

Mar 24 09:07:39 goliath kernel: [401004.862669] ---[ end trace 0000000000000000 ]---