I set the WebOperationTimeoutSeconds to -1 (so it would be an infinite timeout) and it broke Get-TagAssigment. I returned it to the default value of 300 and Get-TagAssignment works again. I'll do more testing with just larger timeouts rather than infinite. Scope was set to AllUsers as the script will be ran by multiple users on the system.
