Run Disconnect-VIServer -Server * -Force before running and after running on each vCenter. I had a similar issue where PowerCLI didn't understand that it should run in another vCenter. Even $defaultviserver indicating vCenter X, get-tag listed was returning tags on vCenter y