The machine has run VMware Workstation for about 5 years with zero VM crashes.
Then I update to latest version and have a crash/week. And then google and see lots of other people having the same issue with latest VMware Workstation release. There seem to be a pattern there, that does not point at the host machine suddenly becoming unstable. Especially since no other programs have started to magically fail. This is the sad last log lines before hang:
Spoiler (Highlight to read) 2022-03-04T03:45:10.037Z In(05) vmx MemSched: caller 0 numvm 1 locked pages: num 437212 max 6327946 2022-03-04T03:45:10.038Z In(05) vmx MemSched: locked Page Limit: host 6336138 config 7309568 2022-03-04T03:45:10.038Z In(05) vmx MemSched: minmempct 50 timestamp 2054824 2022-03-04T03:45:10.038Z In(05) vmx MemSched: VM 0 min 437212 max 833500 shares 792576 paged 421154 nonpaged 36578 anonymous 4346 locked 437212 touchedPct 3 dirtiedPct 1 timestamp 2054824 vmResponsive is 1 2022-03-04T03:45:10.038Z In(05) vmx MemSched: locked 437212 target 833500 balloon 0 0 490589 swapped 371949 0 allocd 0 512 state 0 100 2022-03-04T03:45:10.038Z In(05) vmx MemSched: states: 0 676801 : 1 0 : 2 0 : 3 0 2022-03-04T03:45:10.038Z In(05) vmx MemSched: Balloon enabled 1 guestType 1 maxSize 754753 2022-03-04T04:15:10.605Z In(05) vmx MemSched: caller 0 numvm 1 locked pages: num 437212 max 6321332 2022-03-04T04:15:10.605Z In(05) vmx MemSched: locked Page Limit: host 6329524 config 7309568 2022-03-04T04:15:10.605Z In(05) vmx MemSched: minmempct 50 timestamp 2056625 2022-03-04T04:15:10.605Z In(05) vmx MemSched: VM 0 min 437212 max 833500 shares 792576 paged 421154 nonpaged 36578 anonymous 4346 locked 437212 touchedPct 3 dirtiedPct 0 timestamp 2056625 vmResponsive is 1 2022-03-04T04:15:10.605Z In(05) vmx MemSched: locked 437212 target 833500 balloon 0 0 490589 swapped 371949 0 allocd 0 512 state 0 100 2022-03-04T04:15:10.605Z In(05) vmx MemSched: states: 0 678601 : 1 0 : 2 0 : 3 0 2022-03-04T04:15:10.605Z In(05) vmx MemSched: Balloon enabled 1 guestType 1 maxSize 754753 2022-03-04T04:45:11.706Z In(05) vmx MemSched: caller 0 numvm 1 locked pages: num 437212 max 5920924 2022-03-04T04:45:11.706Z In(05) vmx MemSched: locked Page Limit: host 5929116 config 7309568 2022-03-04T04:45:11.706Z In(05) vmx MemSched: minmempct 50 timestamp 2058426 2022-03-04T04:45:11.706Z In(05) vmx MemSched: VM 0 min 437212 max 833500 shares 792576 paged 421154 nonpaged 36578 anonymous 4346 locked 437212 touchedPct 2 dirtiedPct 0 timestamp 2058426 vmResponsive is 1 2022-03-04T04:45:11.706Z In(05) vmx MemSched: locked 437212 target 833500 balloon 0 0 490589 swapped 371949 0 allocd 0 512 state 0 100 2022-03-04T04:45:11.706Z In(05) vmx MemSched: states: 0 680401 : 1 0 : 2 0 : 3 0 2022-03-04T04:45:11.706Z In(05) vmx MemSched: Balloon enabled 1 guestType 1 maxSize 754753 2022-03-04T05:15:12.711Z In(05) vmx MemSched: caller 0 numvm 1 locked pages: num 437212 max 6213243 2022-03-04T05:15:12.711Z In(05) vmx MemSched: locked Page Limit: host 6221435 config 7309568 2022-03-04T05:15:12.711Z In(05) vmx MemSched: minmempct 50 timestamp 2060227 2022-03-04T05:15:12.711Z In(05) vmx MemSched: VM 0 min 437212 max 833500 shares 792576 paged 421154 nonpaged 36578 anonymous 4346 locked 437212 touchedPct 2 dirtiedPct 0 timestamp 2060227 vmResponsive is 1 2022-03-04T05:15:12.711Z In(05) vmx MemSched: locked 437212 target 833500 balloon 0 0 490589 swapped 371949 0 allocd 0 512 state 0 100 2022-03-04T05:15:12.711Z In(05) vmx MemSched: states: 0 682201 : 1 0 : 2 0 : 3 0 2022-03-04T05:15:12.711Z In(05) vmx MemSched: Balloon enabled 1 guestType 1 maxSize 754753 2022-03-04T05:45:13.794Z In(05) vmx MemSched: caller 0 numvm 1 locked pages: num 437212 max 6210365 2022-03-04T05:45:13.794Z In(05) vmx MemSched: locked Page Limit: host 6218557 config 7309568 2022-03-04T05:45:13.794Z In(05) vmx MemSched: minmempct 50 timestamp 2062028 2022-03-04T05:45:13.794Z In(05) vmx MemSched: VM 0 min 437212 max 833500 shares 792576 paged 421154 nonpaged 36578 anonymous 4346 locked 437212 touchedPct 5 dirtiedPct 1 timestamp 2062028 vmResponsive is 1 2022-03-04T05:45:13.794Z In(05) vmx MemSched: locked 437212 target 833500 balloon 0 0 490589 swapped 371949 0 allocd 0 512 state 0 100 2022-03-04T05:45:13.794Z In(05) vmx MemSched: states: 0 684001 : 1 0 : 2 0 : 3 0 2022-03-04T05:45:13.794Z In(05) vmx MemSched: Balloon enabled 1 guestType 1 maxSize 754753 2022-03-04T06:15:14.884Z In(05) vmx MemSched: caller 0 numvm 1 locked pages: num 437212 max 6293944 2022-03-04T06:15:14.884Z In(05) vmx MemSched: locked Page Limit: host 6302136 config 7309568 2022-03-04T06:15:14.884Z In(05) vmx MemSched: minmempct 50 timestamp 2063829 2022-03-04T06:15:14.884Z In(05) vmx MemSched: VM 0 min 437212 max 833500 shares 792576 paged 421154 nonpaged 36578 anonymous 4346 locked 437212 touchedPct 4 dirtiedPct 0 timestamp 2063829 vmResponsive is 1 2022-03-04T06:15:14.884Z In(05) vmx MemSched: locked 437212 target 833500 balloon 0 0 490589 swapped 371949 0 allocd 0 512 state 0 100 2022-03-04T06:15:14.884Z In(05) vmx MemSched: states: 0 685801 : 1 0 : 2 0 : 3 0 2022-03-04T06:15:14.884Z In(05) vmx MemSched: Balloon enabled 1 guestType 1 maxSize 754753 2022-03-04T07:23:40.743Z Wa(03) mouse Poll timeout: Something may be hung... ungrabbing 2022-03-04T07:23:40.749Z Wa(03) mouse Poll timeout: Something may be hung... ungrabbing
2022-03-04T03:45:10.037Z In(05) vmx MemSched: caller 0 numvm 1 locked pages: num 437212 max 63279462022-03-04T03:45:10.038Z In(05) vmx MemSched: locked Page Limit: host 6336138 config 73095682022-03-04T03:45:10.038Z In(05) vmx MemSched: minmempct 50 timestamp 20548242022-03-04T03:45:10.038Z In(05) vmx MemSched: VM 0 min 437212 max 833500 shares 792576 paged 421154 nonpaged 36578 anonymous 4346 locked 437212 touchedPct 3 dirtiedPct 1 timestamp 2054824 vmResponsive is 12022-03-04T03:45:10.038Z In(05) vmx MemSched: locked 437212 target 833500 balloon 0 0 490589 swapped 371949 0 allocd 0 512 state 0 1002022-03-04T03:45:10.038Z In(05) vmx MemSched: states: 0 676801 : 1 0 : 2 0 : 3 02022-03-04T03:45:10.038Z In(05) vmx MemSched: Balloon enabled 1 guestType 1 maxSize 7547532022-03-04T04:15:10.605Z In(05) vmx MemSched: caller 0 numvm 1 locked pages: num 437212 max 63213322022-03-04T04:15:10.605Z In(05) vmx MemSched: locked Page Limit: host 6329524 config 73095682022-03-04T04:15:10.605Z In(05) vmx MemSched: minmempct 50 timestamp 20566252022-03-04T04:15:10.605Z In(05) vmx MemSched: VM 0 min 437212 max 833500 shares 792576 paged 421154 nonpaged 36578 anonymous 4346 locked 437212 touchedPct 3 dirtiedPct 0 timestamp 2056625 vmResponsive is 12022-03-04T04:15:10.605Z In(05) vmx MemSched: locked 437212 target 833500 balloon 0 0 490589 swapped 371949 0 allocd 0 512 state 0 1002022-03-04T04:15:10.605Z In(05) vmx MemSched: states: 0 678601 : 1 0 : 2 0 : 3 02022-03-04T04:15:10.605Z In(05) vmx MemSched: Balloon enabled 1 guestType 1 maxSize 7547532022-03-04T04:45:11.706Z In(05) vmx MemSched: caller 0 numvm 1 locked pages: num 437212 max 59209242022-03-04T04:45:11.706Z In(05) vmx MemSched: locked Page Limit: host 5929116 config 73095682022-03-04T04:45:11.706Z In(05) vmx MemSched: minmempct 50 timestamp 20584262022-03-04T04:45:11.706Z In(05) vmx MemSched: VM 0 min 437212 max 833500 shares 792576 paged 421154 nonpaged 36578 anonymous 4346 locked 437212 touchedPct 2 dirtiedPct 0 timestamp 2058426 vmResponsive is 12022-03-04T04:45:11.706Z In(05) vmx MemSched: locked 437212 target 833500 balloon 0 0 490589 swapped 371949 0 allocd 0 512 state 0 1002022-03-04T04:45:11.706Z In(05) vmx MemSched: states: 0 680401 : 1 0 : 2 0 : 3 02022-03-04T04:45:11.706Z In(05) vmx MemSched: Balloon enabled 1 guestType 1 maxSize 7547532022-03-04T05:15:12.711Z In(05) vmx MemSched: caller 0 numvm 1 locked pages: num 437212 max 62132432022-03-04T05:15:12.711Z In(05) vmx MemSched: locked Page Limit: host 6221435 config 73095682022-03-04T05:15:12.711Z In(05) vmx MemSched: minmempct 50 timestamp 20602272022-03-04T05:15:12.711Z In(05) vmx MemSched: VM 0 min 437212 max 833500 shares 792576 paged 421154 nonpaged 36578 anonymous 4346 locked 437212 touchedPct 2 dirtiedPct 0 timestamp 2060227 vmResponsive is 12022-03-04T05:15:12.711Z In(05) vmx MemSched: locked 437212 target 833500 balloon 0 0 490589 swapped 371949 0 allocd 0 512 state 0 1002022-03-04T05:15:12.711Z In(05) vmx MemSched: states: 0 682201 : 1 0 : 2 0 : 3 02022-03-04T05:15:12.711Z In(05) vmx MemSched: Balloon enabled 1 guestType 1 maxSize 7547532022-03-04T05:45:13.794Z In(05) vmx MemSched: caller 0 numvm 1 locked pages: num 437212 max 62103652022-03-04T05:45:13.794Z In(05) vmx MemSched: locked Page Limit: host 6218557 config 73095682022-03-04T05:45:13.794Z In(05) vmx MemSched: minmempct 50 timestamp 20620282022-03-04T05:45:13.794Z In(05) vmx MemSched: VM 0 min 437212 max 833500 shares 792576 paged 421154 nonpaged 36578 anonymous 4346 locked 437212 touchedPct 5 dirtiedPct 1 timestamp 2062028 vmResponsive is 12022-03-04T05:45:13.794Z In(05) vmx MemSched: locked 437212 target 833500 balloon 0 0 490589 swapped 371949 0 allocd 0 512 state 0 1002022-03-04T05:45:13.794Z In(05) vmx MemSched: states: 0 684001 : 1 0 : 2 0 : 3 02022-03-04T05:45:13.794Z In(05) vmx MemSched: Balloon enabled 1 guestType 1 maxSize 7547532022-03-04T06:15:14.884Z In(05) vmx MemSched: caller 0 numvm 1 locked pages: num 437212 max 62939442022-03-04T06:15:14.884Z In(05) vmx MemSched: locked Page Limit: host 6302136 config 73095682022-03-04T06:15:14.884Z In(05) vmx MemSched: minmempct 50 timestamp 20638292022-03-04T06:15:14.884Z In(05) vmx MemSched: VM 0 min 437212 max 833500 shares 792576 paged 421154 nonpaged 36578 anonymous 4346 locked 437212 touchedPct 4 dirtiedPct 0 timestamp 2063829 vmResponsive is 12022-03-04T06:15:14.884Z In(05) vmx MemSched: locked 437212 target 833500 balloon 0 0 490589 swapped 371949 0 allocd 0 512 state 0 1002022-03-04T06:15:14.884Z In(05) vmx MemSched: states: 0 685801 : 1 0 : 2 0 : 3 02022-03-04T06:15:14.884Z In(05) vmx MemSched: Balloon enabled 1 guestType 1 maxSize 7547532022-03-04T07:23:40.743Z Wa(03) mouse Poll timeout: Something may be hung... ungrabbing2022-03-04T07:23:40.749Z Wa(03) mouse Poll timeout: Something may be hung... ungrabbing
So somewhere down the line I would probably need to add a network ping to spot the exact time it hung.
Moderator edit by wila: moved the log lines into a spoiler.