IaaS distributed installation error everytime on Server 2012R2

[jwhites]

I have tried literally everything in the world on google and even stuff that does not relate when trying to fix this...but basically install fails half way through and here is the log part where the error starts:  Anyone have any ideas? There are no firewalls anywhere.  The database gets created on the server everytime I run this.  Every pre-req is installed, everything shows up fine in the pre-req checker.

Info : 2015-02-09 02 50 13 182 PM :  "C:\Program Files (x86)\VMware\vCAC\Server\Model Manager Data\Cafe\Vcac-Config.exe" MoveRegistrationDataToDB --FileName "C:\Program Files (x86)\VMware\vCAC\Server\Model Manager Data\Cafe\Vcac-Config.data" -s "dbvraiaasprd" -d "vcac"  -v

Info : 2015-02-09 02 50 17 385 PM :  Command succeeded.

Info : 2015-02-09 02 50 17 401 PM :  Registering with Service Catalog

Info : 2015-02-09 02 50 17 401 PM :Done Building Project "C:\Program Files (x86)\VMware\vCAC\Server\Model Manager Data\DeployRepository.xml" (InitializeRepo target(s)).

Info : 2015-02-09 02 50 17 401 PM :Build succeeded.

Info : 2015-02-09 02 50 17 401 PM :    0 Warning(s)

Info : 2015-02-09 02 50 17 401 PM :    0 Error(s)

Info : 2015-02-09 02 50 17 401 PM :Time Elapsed 00:00:27.36

Info : 2015-02-09 02 50 17 416 PM :Executing C:\Windows\Microsoft.NET\Framework\v4.0.30319\MsBuild.exe "C:\Program Files (x86)\VMware\vCAC\Server\Model Manager Data\DeployRepository.xml" /t:InstallRepoModel /p:RepoUtilDir="C:\Program Files (x86)\VMware\vCAC\Server\Model Manager Data";AssemblyDir="C:\Program Files (x86)\VMware\vCAC\Server\Model Manager Data" /p:DBServer="dbvraiaasprd";DBName="vcac" /p:DBConnectParam="" /p:InstallType="Install"

Info : 2015-02-09 02 50 17 432 PM :Microsoft (R) Build Engine version 4.0.30319.34209

Info : 2015-02-09 02 50 17 432 PM :[Microsoft .NET Framework, version 4.0.30319.34209]

Info : 2015-02-09 02 50 17 432 PM :Copyright (C) Microsoft Corporation. All rights reserved.

Info : 2015-02-09 02 50 17 448 PM :Build started 2/9/2015 2:50:17 PM.

Info : 2015-02-09 02 50 17 463 PM :Project "C:\Program Files (x86)\VMware\vCAC\Server\Model Manager Data\DeployRepository.xml" on node 1 (InstallRepoModel target(s)).

Info : 2015-02-09 02 50 17 463 PM :InstallRepoModel:

Info : 2015-02-09 02 50 17 463 PM :  ##InstallRepoModel Install Repository Models

Info : 2015-02-09 02 50 17 479 PM :  "C:\Program Files (x86)\VMware\vCAC\Server\Model Manager Data\RepoUtil.exe" Assembly-SqlInstall -f  "C:\Program Files (x86)\VMware\vCAC\Server\Model Manager Data\DynamicOps.Core.Common.dll","C:\Program Files (x86)\VMware\vCAC\Server\Model Manager Data\DynamicOps.Core.External.dll","C:\Program Files (x86)\VMware\vCAC\Server\Model Manager Data\DynamicOps.Core.Licensing.dll","C:\Program Files (x86)\VMware\vCAC\Server\Model Manager Data\DynamicOps.ManagementModel.Common.dll","C:\Program Files (x86)\VMware\vCAC\Server\Model Manager Data\DynamicOps.VMWareModel.Common.dll","C:\Program Files (x86)\VMware\vCAC\Server\Model Manager Data\DynamicOps.ReportsModel.Common.dll" -s dbvraiaasprd -d "vcac"  --overwrite -v

Info : 2015-02-09 02 50 33 089 PM :  Command completed.

Info : 2015-02-09 02 50 34 729 PM :  "C:\Program Files (x86)\VMware\vCAC\Server\Model Manager Data\RepoUtil.exe" Model-Install -f "C:\Program Files (x86)\VMware\vCAC\Server\Model Manager Data\DynamicOps.ManagementModel.dll" -s "dbvraiaasprd" -d "vcac"  -c "C:\Program Files (x86)\VMware\vCAC\Server\Model Manager Data\ManagementModelSecurityConfig.xml" -v

Info : 2015-02-09 02 51 42 513 PM :  System.Net.WebException: The underlying connection was closed: The connection was closed unexpectedly.

Info : 2015-02-09 02 51 42 513 PM :     at System.Data.Services.Client.BatchSaveResult.BatchRequest()

Info : 2015-02-09 02 51 42 513 PM :     at System.Data.Services.Client.DataServiceContext.SaveChanges(SaveChangesOptions options)

Info : 2015-02-09 02 51 42 513 PM :     at DynamicOps.Repository.RepositoryServiceContext.SaveChanges(SaveChangesOptions options)

Info : 2015-02-09 02 51 42 513 PM :     at DynamicOps.Tools.Common.SecurityHelpers.InstallSecurityConfig(securityConfig config, String httpRootRepository)

Info : 2015-02-09 02 51 42 513 PM :     at DynamicOps.Tools.Common.ModelHelpers.InstallModel(String assemblyFileName, String securityFileName, String server, String catalog, String userName, String password, String httpRootRepository)

Info : 2015-02-09 02 51 42 513 PM :     at DynamicOps.Tools.Repoutil.Commands.ModelInstallCommand.Execute(CommandLineParser parser)

Info : 2015-02-09 02 51 42 513 PM :  Warning: Non-zero return code. Command failed.

Info : 2015-02-09 02 51 42 559 PM :C:\Program Files (x86)\VMware\vCAC\Server\Model Manager Data\DeployRepository.xml(624,5): error MSB3073: The command ""C:\Program Files (x86)\VMware\vCAC\Server\Model Manager Data\RepoUtil.exe" Model-Install -f "C:\Program Files (x86)\VMware\vCAC\Server\Model Manager Data\DynamicOps.ManagementModel.dll" -s "dbvraiaasprd" -d "vcac"  -c "C:\Program Files (x86)\VMware\vCAC\Server\Model Manager Data\ManagementModelSecurityConfig.xml" -v" exited with code 1.

Info : 2015-02-09 02 51 42 559 PM :Done Building Project "C:\Program Files (x86)\VMware\vCAC\Server\Model Manager Data\DeployRepository.xml" (InstallRepoModel target(s)) -- FAILED.

Info : 2015-02-09 02 51 42 559 PM :Build FAILED.

Info : 2015-02-09 02 51 42 559 PM :"C:\Program Files (x86)\VMware\vCAC\Server\Model Manager Data\DeployRepository.xml" (InstallRepoModel target) (1) ->

Info : 2015-02-09 02 51 42 559 PM :(InstallRepoModel target) ->

Info : 2015-02-09 02 51 42 559 PM :  C:\Program Files (x86)\VMware\vCAC\Server\Model Manager Data\DeployRepository.xml(624,5): error MSB3073: The command ""C:\Program Files (x86)\VMware\vCAC\Server\Model Manager Data\RepoUtil.exe" Model-Install -f "C:\Program Files (x86)\VMware\vCAC\Server\Model Manager Data\DynamicOps.ManagementModel.dll" -s "dbvraiaasprd" -d "vcac"  -c "C:\Program Files (x86)\VMware\vCAC\Server\Model Manager Data\ManagementModelSecurityConfig.xml" -v" exited with code 1.

Info : 2015-02-09 02 51 42 591 PM :    0 Warning(s)

Info : 2015-02-09 02 51 42 591 PM :    1 Error(s)

Info : 2015-02-09 02 51 42 591 PM :Time Elapsed 00:01:25.12

[SeanKohler]

Could you see if the Distributed Transaction Coordinator service is Auto and Running?

I ask because we had similar issues on our distributed install and this allowed us to continue.

[jwhites]

Yes sir, running on web box and the external sql box.

are there possibly any issues with using aliases for the database?

[sbeaver]

I was going to say the same thing where I had some issues before with DTS being able to communicate with everything it needed.  If I remember correctly I had to revisit the DNS Suffixes setup and things started working after that

[jwhites]

I Saw some mention of people having the suffix issues but are those related to non domain environments?

[SeanKohler]

The short names need to resolve...

(Both forward and reverse would be a good idea.)

[jwhites · Accepted solution]

For anyone who reads this, I was able to resolve the issue.

Through all of the blogs I read, I somehow made a stupid mistake of installing 4.5.2 on Server 2012R2.  DO NOT DO THAT.

To uninstall the 4.5.2 version from Server 2012R2 if you installed it like I did, go to programs and features, switch to the view installed updates view and remove Update for Windows KB2934520

After doing that I was able to smooth sail through the installation.  I realized this part way through my troubleshooting but given the compatibility of .net usually I didn't think it would be a huge issue and I though surely there would have been a vmware KB on such a stupid mistake but apparently not.

[VMSavvy]

Uninstalling the KB didn't work for me.. Anyone else having the same issue and a possible resolution for this? I'm facing the exact same problem.

VMSavvy

[JPeifer]

I too am getting the same error during installation, database is installed, program seems to install and must be uninstalled before rerunning the installer.  I have verified the Java version is 1.7 not 1.8; I  have verified that dot-net 4.5.1 is installed NOT 4.5.2; all pre-req checks come out green.  Same failure at the same point.  Any ideas beyond the dot-net 4.5 issue and Java?  I am installing on Windows Server 2012 R2 with all latest patches as of last night (except Dot-net 4.5.2 and Java, they were pulled out).

[sbeaver]

Have you checked all your logs on the sql server, IaaS and the management?  When I was battling something like this it ended up with being an issue with DTS and not being able to resolve both short and long name to the vip.  I had to change the DNS suffix setting in configuration of the nic

[pizzle85]

I also saw a DTC issue where a HA DTC was taking the request on the HA IP and return traffic was coming from the local SQL DTC. I had to open the firewall on my vCAC box from all DTC IPs.

[VMSavvy]

The issue I'm facing is related to the load balancer and its configuration somewhere. We are using F5 and there is a problem somewhere. Below is how I concluded that its an F5 issue..

Install with vRAC LB and IaaS Web LB - Fail.

Install with vRAC Node 1 name and IaaS Web Node 1 Name - Success.

Install with vRAC LB and IaaS Web Node 1 Name - Success.. (this shows there is no problem with vRAC LB).

Install with vRAC Node 1 name and IaaS Web LB - Fail.

Problem is somewhere with the IaaS Load Balancer VIP and its config. I'm using domain certificates in .pfx format and imported them to the IIS nodes and the load balancer certificate repositories. LB is configured with "Round Robin" and "Least Connections" but no change in the behavior. The installation fails with the following error while using IaaS Web LB during installation. Any ideas??

C:\Program Files (x86)\VMware\vCAC\Server\Model Manager Data\DeployRepository.xml(621,5): error MSB3073: The command ""C:\Program Files (x86)\VMware\vCAC\Server\Model Manager Data\RepoUtil.exe" Assembly-SqlInstall -f  "C:\Program Files (x86)\VMware\vCAC\Server\Model Manager Data\DynamicOps.Core.Common.dll","C:\Program Files (x86)\VMware\vCAC\Server\Model Manager Data\DynamicOps.Core.External.dll","C:\Program Files (x86)\VMware\vCAC\Server\Model Manager Data\DynamicOps.Core.Licensing.dll","C:\Program Files (x86)\VMware\vCAC\Server\Model Manager Data\DynamicOps.ManagementModel.Common.dll","C:\Program Files (x86)\VMware\vCAC\Server\Model Manager Data\DynamicOps.VMWareModel.Common.dll","C:\Program Files (x86)\VMware\vCAC\Server\Model Manager Data\DynamicOps.ReportsModel.Common.dll" -s SQLDB06 -d "IAASDB"  --overwrite -v" exited with code 1.

VMSavvy (not a smiley this time around)

[VMSavvy]

This is when the error trace starts following by the one given in the post above..

"C:\Program Files (x86)\VMware\vCAC\Server\Model Manager Data\RepoUtil.exe" Assembly-SqlInstall -f  "C:\Program Files (x86)\VMware\vCAC\Server\Model Manager Data\DynamicOps.Core.Common.dll","C:\Program Files (x86)\VMware\vCAC\Server\Model Manager Data\DynamicOps.Core.External.dll","C:\Program Files (x86)\VMware\vCAC\Server\Model Manager Data\DynamicOps.Core.Licensing.dll","C:\Program Files (x86)\VMware\vCAC\Server\Model Manager Data\DynamicOps.ManagementModel.Common.dll","C:\Program Files (x86)\VMware\vCAC\Server\Model Manager Data\DynamicOps.VMWareModel.Common.dll","C:\Program Files (x86)\VMware\vCAC\Server\Model Manager Data\DynamicOps.ReportsModel.Common.dll" -s KCMVCP06 -d "IAASDB"  --overwrite -v

Info : 2015-02-17 07 59 08 132 AM :  System.Data.Services.Client.DataServiceTransportException: The operation has timed out ---> System.Net.WebException: The operation has timed out

Info : 2015-02-17 07 59 08 132 AM :     at System.Net.HttpWebRequest.GetResponse()

Info : 2015-02-17 07 59 08 132 AM :     at System.Data.Services.Client.HttpWebRequestMessage.GetResponse()

Info : 2015-02-17 07 59 08 132 AM :     --- End of inner exception stack trace ---

Info : 2015-02-17 07 59 08 132 AM :     at System.Data.Services.Client.HttpWebRequestMessage.GetResponse()

Info : 2015-02-17 07 59 08 132 AM :     at System.Data.Services.Client.DataServiceContext.GetResponseHelper(ODataRequestMessageWrapper request, IAsyncResult asyncResult, Boolean handleWebException)

Info : 2015-02-17 07 59 08 132 AM :     at System.Data.Services.Client.QueryResult.ExecuteQuery()

Info : 2015-02-17 07 59 08 132 AM :     at System.Data.Services.Client.DataServiceRequest.GetQuerySetCount(DataServiceContext context)

Info : 2015-02-17 07 59 08 132 AM :     at System.Data.Services.Client.DataServiceQueryProvider.ReturnSingleton[TElement](Expression expression)

Info : 2015-02-17 07 59 08 132 AM :     at System.Linq.Queryable.Count[TSource](IQueryable`1 source)

Info : 2015-02-17 07 59 08 132 AM :     at DynamicOps.Tools.Common.AssemblyHelpers.InstallSqlAssembly(String assemblyFileName, String server, String catalog, String userName, String password, String httpRootRepository, Boolean overwrite)

Info : 2015-02-17 07 59 08 132 AM :     at DynamicOps.Tools.Repoutil.Commands.AssemblySqlInstallCommand.Execute(CommandLineParser parser)

Info : 2015-02-17 07 59 08 132 AM :  Warning: Non-zero return code. Command failed.

[pizzle85]

I'm not sure exactly what you're trying to do or at what point in your process its failing. Check out this post and see if it helps you out.

Anyone successful at upgrading 6.0.1 to 6.1 in a distributed install?

I have a fully HA build behind an F5 LTM 11.5 working great. I can share my install docs with you if it might help.

[sbeaver]

What did you do with the Cafe Postgres and HA?  Are you doing the standard Primary to Mirror or another configuration?  I have been playing with pgpool here and there but just could not get the active/active setup to work they way I was hoping

[VMSavvy]

Sure.. can you please send me the docs to vmsavvy@gmail.com. That will greatly help.

Thank you.

[VMSavvy]

Yeah.. I'm doing a standard Primary to mirror. I'm having enough with IaaS installation off late. Once I fix this and get the distributed setup running then comes in the Orchestrator integration with Infoblox and stuff.. I'll revisit the vPostgres setup sometime later.

[pizzle85]

were just doing the default primary to mirror. We have an RTO of four hours so that was acceptable.

[VMSavvy]

pizzle85 - If you can also get me the Send and Receive strings used in the LB health monitors, that'd be great. I somehow feel that the get response is where it is failing. Thanks in advance.

[pizzle85]

I also re-wrote the infoblox plugins to be pure vCO so you don't have to modify the vCAC workflow stubs. I can share those with you too if you'd like.