what do you mean by remove host ? are you trying to disconnect or remove from inventory ?
to force cancel you can try to restart the services
before makng changes have a downtime and working backup of vCenter.
on vCenter
service-control vmware-vpxd --restart
on ESXi host
/etc/init.d/vpxa restart
above commands will make the vCenter and ESXi unavailable for couple of mins.