Hello,
I think I found a bug in Linux VMWare tools; more specifically in VMWGFX kernel module. I have 3 screens shared from the GUI (2x 2560x1440 + 1x 1920x1200). I wanted to connect another one: 1366x768. Unfortunately doing so throws invalid configuration error on Windows accompanied with the following logs on Linux side:
[ 42.940182] [drm:vmw_kms_update_layout_ioctl [vmwgfx]] *ERROR* Invalid GUI layout.
[ 142.908061] [drm:vmw_kms_update_layout_ioctl [vmwgfx]] *ERROR* Invalid GUI layout.
[ 164.869350] [drm:vmw_kms_update_layout_ioctl [vmwgfx]] *ERROR* Invalid GUI layout.
[ 176.614179] [drm:vmw_kms_update_layout_ioctl [vmwgfx]] *ERROR* Invalid GUI layout.
[ 180.666293] [drm:vmw_kms_update_layout_ioctl [vmwgfx]] *ERROR* Invalid GUI layout.
Google doesn't have any results for this error, except driver source code doing some checks. I think I hit the limit of horizontal resolution, because if I flip the 4th screen to 90* in Windows it connects to Linux and it works properly.
