You will have to know on which vCenter a VM is located.
Then use the Server parameter on the Get-View cmdlet, pointing to that specific vCenter.

You can find the vCenter for a VM with

([Uri]$vm.ExtensionData.Client.ServiceUrl).Host