I also have a separate vCenter that is much smaller then this one (only 4 cluster and about 10 hosts), and like you said it does not have the same issues. The vCenter that is seeing this issue has close to 60 hosts and 8 different clusters.
I plan to reach out to VMWare today.