Removing public ip will not impact on vCenter. Just to check local ip have internet access if you want to download update directly or you have to use proxy to reach internet.
Regards,
Sachchidanand
