At a minimum Horizon will keep 1 VM in every pool powered on. You can overcome this by placing the VMs in maintenance mode.
Are you trying to access Horizon Administrator directly on the connection server? It looks like there is a policy on the server preventing internet access. Try accessing it remotely.
https://FQDNorIPofConnectionServer/admin
