If your ESX server failed with hardware error and its disconnected from VC. Then you should be getting the option to remove it.
If you are not getting option still, try restarting your VC service and removing the host.
You could probably look for vpx_datastore table and vpx_ds_assignment table.
Kindly let me know if this information is useful.