topic Re: Upgraded to Horizon 7.3, pools no longer provision new VMs in Horizon Desktops and Apps

Upgraded to Horizon 7.3, pools no longer provision new VMs

jseide86 — Sat, 23 Sep 2017 11:35:00 GMT

Hello

As the title says, I've just upgraded my environment to Horizon 7.3 and now my pools are no longer creating new VMs. At all.

I've even created a new pool with a new template, but nothing is happening and there are no errors thrown anywhere. I've checked the view administrators, the connection servers and the view composer for logs and windows event log, but there is no trace as to where the process is stopping.

Environment details:

View Connection Servers: 7.3.0 build-6571861

View Composer: 7.3.0 build-6517251

vCenter: 6.5.0 build-5973321 (6.5u1)

ESXi: 6.5.0 build-5969303 (6.5u1) - still have a few hosts on ESXi 6.5.0 build-5310538 (6.5d) as well, but only in certain clusters and I've tested pool deployment in both pure 6.5u1 clusters and "mixed" clusters. It makes no difference.

Cloud Pod Federation is up and running, I've got 2+2 connection servers with 12 hosts in each pod.

The mentioned pools are Full Clones, so no Linked or Instant clones to complexify this scenario.

I still have snapshots of my horizon components on 7.2.0 so a rollback is possible, but I'd very much like to resolve this as 7.3 seems like a good release on paper.

Does anyone have a clue to where I should start digging? Have anyone seen this before? I'm a bit lost right now, but I though I'd swing by VMTN and post before I launch an SR with VMware.

Thanks!

Re: Upgraded to Horizon 7.3, pools no longer provision new VMs

jseide86 — Sat, 23 Sep 2017 14:56:14 GMT

I posted this thread on Reddit as well and got a few replies, but nothing conclusive:

https://www.reddit.com/r/vmware/comments/71xu7r/upgraded_to_horizon_73_pools_no_longer_provision/

Re: Upgraded to Horizon 7.3, pools no longer provision new VMs

jeffrobinson85 — Mon, 25 Sep 2017 00:49:16 GMT

So I've seen a similar issue in Horizon 6.2, but it did not occur after an upgrade. I opened a case with VMware support and after some troubleshooting they concluded it was an issue with VC Cache.

The recommendation was made to

Shutdown all Connection servers in the pod.
Shutdown Composer.
Restart vCenter
Bring back up Composer. (Wait until you see the log in screen)
Power on one connection server at a time.

Looking at your Reddit post you already did something similar and it did not resolve your issue.

Do you see any errors oin the View Admin console?

I have upgraded both my home lab and Production Horizon 7 environment at my work and have not seen the issue you describe. We are using all Instant Clones in our Horizon 7 environment. We are getting ready to move our user from our Horizon 6.2 environment to our Horizon 7.3 environment.

Restart order of the View environment to clear ADLDS (ADAM) synchronization in Horizon View (2068381) | VMware KB

Re: Upgraded to Horizon 7.3, pools no longer provision new VMs

alexf85 — Tue, 26 Sep 2017 08:47:05 GMT

Had the same issue, tried the shutdown->booting all servers in correct order, tried reinstall connection/security/composer servers including brand new setup of view-database and pools etc - nothing helped.

Had to reinstall my vcenter 6.5 to get my view-environment working again after 7.3 upgrade.

Re: Upgraded to Horizon 7.3, pools no longer provision new VMs

sappomannoz — Tue, 26 Sep 2017 15:56:14 GMT

The same happened to me. After a restart of everything, provisioning was working again.

Re: Upgraded to Horizon 7.3, pools no longer provision new VMs

uday_s — Tue, 26 Sep 2017 16:33:45 GMT

Is this issue seen with particular type of Pools?

Re: Upgraded to Horizon 7.3, pools no longer provision new VMs

jseide86 — Wed, 27 Sep 2017 07:57:31 GMT

jeffrobinson85

I followed this exact procedure, but it did not help for my environment. The environment stands still, just like before.

Thank you for your input, though.

Do you see any errors oin the View Admin console?

No, no errors at all.

alexf85

Had to reinstall my vcenter 6.5 to get my view-environment working again after 7.3 upgrade.

I really hope I don't have to do this :smileyconfused:

uday s

Is this issue seen with particular type of Pools?

The pools I'm testing with are Full Clone pools, two of them right now in different clusters.

Re: Upgraded to Horizon 7.3, pools no longer provision new VMs

angelage1 — Wed, 27 Sep 2017 17:50:04 GMT

Hi all, sorry you've encountered this issue. On behalf of Horizon 7 team, I wanted to let you know that engineering is working on rootcausing and resolving the issue. We will provide an update as soon as we can.

Thanks!

-Angela Ge, Horizon 7 Product Management

Re: Upgraded to Horizon 7.3, pools no longer provision new VMs

Akrietsch — Wed, 27 Sep 2017 19:15:01 GMT

I ran into this problem as well in our test environment (before stumbling on to this discussion). I guess it is a bit more wide spread. The upgrade itself went perfectly smooth, but provisioning is taking a nap. I will open a case with VMware.

Re: Upgraded to Horizon 7.3, pools no longer provision new VMs

krowczynski1980 — Thu, 28 Sep 2017 09:48:23 GMT

Hi.

so if such a problem exists, VMware should revoke the download of Horizon View 7.3!
Is there an active KB-Article that is describing the problem?

Re: Upgraded to Horizon 7.3, pools no longer provision new VMs

elyasme — Thu, 28 Sep 2017 12:35:40 GMT

Hello,

Is there already some more information available regarding this issue?

Thanks

Re: Upgraded to Horizon 7.3, pools no longer provision new VMs

Magneet — Thu, 28 Sep 2017 13:05:32 GMT

VMware has pulled 7.3 from the downloads. No official communication yet but we can safely asume this is one of the reasons + the bug in the installer. This problem has been reproduced in both new installations and upgrades.

Re: Upgraded to Horizon 7.3, pools no longer provision new VMs

jseide86 — Thu, 28 Sep 2017 13:33:22 GMT

Hey all.

I got an email from VMware Support through my support request that a bug has been identified in Horizon 7.3 and that the download has been temporarily removed from the website. An updated release will be available soon.

The bug is an issue that's rooted in communication problems between vCenter and Connection Server where CA signed root certificates are deployed. VMware self-signed certificates should work fine, although I did not get confirmation on this.

I also got instructions on how to work around the issue. See the following steps:

On the Connection Server VM/machine, remove the CA signed root certificate from the Trusted Root Certificates Store.
Restart the Connection Server service
Login to Horizon Administrator and manually accept the vCenter [and Composer] certificate thumbprint.
Provisioning should start working again as normal.
Note that Connection Servers will appear with Red status in the dashboard, listing the error "Server's certificate is not trusted". This is harmless and will not impact the system.
Note that if your server(s) receive root certificates via GPO, you'd either need to make an exception for your servers to avoid the root cert, or repeat the procedure of deleting and restarting each time a policy update/push takes place.
Note that if you're not comfortable with the work around you'll need to roll back to Horizon 7.2 (or whatever your previous version is)

I hope this helps some of you. It helped me get my environment back on track.

(BTW, Magneet, for next time if you ever encounter problems with the installer again: the installer bug can be worked around also by doing an install via command line. Google for "Connection Server silent install" and utilise the triggers to make the install happen without the GUI and prompts.)

Re: Upgraded to Horizon 7.3, pools no longer provision new VMs

Magneet — Thu, 28 Sep 2017 15:27:45 GMT

or enable CEIP first then it also works

Re: Upgraded to Horizon 7.3, pools no longer provision new VMs

angelage1 — Fri, 29 Sep 2017 02:01:22 GMT

Hi all,

Just wanted to give you an update on this issue that has impacted some users of Horizon 7.3. While we work on the fix, we have temporarily removed Horizon 7.3 from the product download page. We are working to resolve the issue and expect the solution to be available on October 5, 2017. Thank you for your patience.

-Angela Ge, Horizon Product Management