In reviewing the VCF 4.x Ops and Admin Guide, there is a section for "Expand a Workload Domain", which includes a management or VI workload domain.

There is also a section for "Shrink a Workload Domain" which references only Workload Domains.  Does this mean you cannot shrink a management domain

by removing a management domain host, even if that leaves you with the minimum of four management hosts?