You can do this. Cloud Foundation does not limit the cluster size in the consolidated architecture. You can have as many hosts in the cluster as documented in the Configuration Maximums guide.
Just note that you would not have VI Workload Domain capabilities in this case. This is why we usually recommend switching to the full architecture if you have enough hosts. But this is not a requirement.
Thanks Frank for your timely reply!