vRA 7 : Simple Install fails

[Rohitsanthosh]

vRA 7 : Simple Install fails .

Get the Following error during installation ( starting of services)

Healthcheck failed. Check /var/log/vmware/vcac/vcac-config.log for more details

Verify that all services are started

catalina.out :

2016-02-18 08:59:26,983 vcac: [component="cafe:advanced-designer" priority="INFO" thread="eventPublisherExecutor-1" tenant="" context="" token=""] com.vmware.vcac.platform.rest.client.support.RetriableOperation.call:76 - Retries left: [1

73]. Sleeping for [20] seconds before the next retry attempt.

2016-02-18 08:59:46,988 vcac: [component="cafe:advanced-designer" priority="WARN" thread="eventPublisherExecutor-1" tenant="" context="" token=""] com.vmware.vcac.platform.rest.client.support.RetriableOperation.call:74 - Exception handle

d during retry operation with message: 404 Not Found

2016-02-18 08:59:46,988 vcac: [component="cafe:advanced-designer" priority="INFO" thread="eventPublisherExecutor-1" tenant="" context="" token=""] com.vmware.vcac.platform.rest.client.support.RetriableOperation.call:76 - Retries left: [1

72]. Sleeping for [20] seconds before the next retry attempt.

2016-02-18 09:00:06,993 vcac: [component="cafe:advanced-designer" priority="WARN" thread="eventPublisherExecutor-1" tenant="" context="" token=""] com.vmware.vcac.platform.rest.client.support.RetriableOperation.call:74 - Exception handle

d during retry operation with message: 404 Not Found

2016-02-18 09:00:06,993 vcac: [component="cafe:advanced-designer" priority="INFO" thread="eventPublisherExecutor-1" tenant="" context="" token=""] com.vmware.vcac.platform.rest.client.support.RetriableOperation.call:76 - Retries left: [1

71]. Sleeping for [20] seconds before the next retry attempt.

2016-02-18 09:00:26,998 vcac: [component="cafe:advanced-designer" priority="WARN" thread="eventPublisherExecutor-1" tenant="" context="" token=""] com.vmware.vcac.platform.rest.client.support.RetriableOperation.call:74 - Exception handle

d during retry operation with message: 404 Not Found

2016-02-18 09:00:26,998 vcac: [component="cafe:advanced-designer" priority="INFO" thread="eventPublisherExecutor-1" tenant="" context="" token=""] com.vmware.vcac.platform.rest.client.support.RetriableOperation.call:76 - Retries left: [1

70]. Sleeping for [20] seconds before the next retry attempt.

vcac-config.log :

2016-02-17T08:07:35+00:00 localhost haproxy[12512]: Health check for server backend-vra-health/node1 failed, reason: Layer4 connection problem, info: "Connection refused", check duration: 0ms, status: 0/2 DOWN.

          liquibase/composition-service-master.xml : Not precondition failed

          liquibase/composition-service-master.xml : Not precondition failed

          liquibase/identity-master.xml : Not precondition failed

          liquibase/identity-master.xml : Not precondition failed

          liquibase/component-registry-master.xml : Not precondition failed

          liquibase/component-registry-master.xml : Not precondition failed

          liquibase/component-registry-master.xml : Not precondition failed

          liquibase/component-registry-master.xml : Not precondition failed

          liquibase/component-registry-master.xml : Not precondition failed

          liquibase/component-registry-master.xml : Not precondition failed

          liquibase/work-item-service-master.xml : Not precondition failed

          liquibase/work-item-service-master.xml : Not precondition failed

          liquibase/management-service-master.xml : Not precondition failed

          liquibase/management-service-master.xml : Not precondition failed

I see verify similiar error during distruibuted install also.

Please assist.

[Dandollars]

At what point did this fail?

[Rohitsanthosh]

[Rohitsanthosh]

Please find the details on the screen shot.

[Fwa]

Thanks for this discussion. I had similar issue with distributed install.

Is there anyone who know about what can be the solution or workaround for this issue?

[gradinka]

my guess is something's messed up on the networking side of the VA

are you using static IPs? can the hostname resolve properly from inside the VA as well as from outside?

worth checking /etc/hosts file

[Fwa]

Yes I'm using static IPs and the host name can be resolved from inside and outside of vRA va.

Certainly, the networking environment was having a burden but I couldn't unfortunately find out the root cause. Although the cause is still unclear, this verification was succeeded. Anyway thanks!

[BScott66]

Needless to say I am attempting a new install in my home lab with 7.0.1.150 and I am getting the same error!

I have had previous versions installed and even tried to use version 7.0.0.1460 and I get the same behavior.

This is not a one time thing as I have dropped the vRA server and the IAAS server multiple times and each time I am seeing the same behavior?

I do not find anything that would lead me to a resolution to be successful in installing vRealize Automation 7!

Errors found:

2016-07-22T16:15:41+00:00 localhost haproxy[29004]: Health check for server backend-vra-health/node1 failed, reason: Layer4 connection problem, info: "Connection refused", check duration: 0ms, status: 0/2 DOWN.

2016-07-22T16:49:02.961908+00:00 vra01.GreenScott.com vcac-config: INFO  liquibase.info:126 - liquibase/advanced-designer-service-master.xml: liquibase/advanced-designer-service-TA64460.xml::1392256086262::TA58421: Marking ChangeSet: liquibase/advanced-designer-service-TA64460.xml::1392256086262::TA58421 ran despite precondition failure due to onFail='MARK_RAN':

          liquibase/advanced-designer-service-master.xml : Not precondition failed

2016-07-22T16:49:18.759448+00:00 vra01.GreenScott.com vcac-config: INFO  liquibase.info:126 - liquibase/iaas-provider-master.xml: liquibase/iaas-provider-TA154369-token.xml::1::TA154369: Marking ChangeSet: liquibase/iaas-provider-TA154369-token.xml::1::TA154369 ran despite precondition failure due to onFail='MARK_RAN':

          liquibase/iaas-provider-master.xml : Not precondition failed

2016-07-22T16:49:18.783231+00:00 vra01.GreenScott.com vcac-config: INFO  liquibase.info:126 - liquibase/iaas-provider-master.xml: liquibase/iaas-provider-TA164430-i18n.xml::1::TA164430: Marking ChangeSet: liquibase/iaas-provider-TA164430-i18n.xml::1::TA164430 ran despite precondition failure due to onFail='MARK_RAN':

          liquibase/iaas-provider-master.xml : Not precondition failed

2016-07-22T16:49:19.372989+00:00 vra01.GreenScott.com vcac-config: INFO  liquibase.info:126 - liquibase/notification-service-master.xml: liquibase/notification-service-TA58494.xml::1391722717359-1::TA58494: Marking ChangeSet: liquibase/notification-service-TA58494.xml::1391722717359-1::TA58494 ran despite precondition failure due to onFail='MARK_RAN':

          liquibase/notification-service-master.xml : Not precondition failed

2016-07-22T16:49:20.979271+00:00 vra01.GreenScott.com vcac-config: INFO  liquibase.info:126 - liquibase/notification-service-master.xml: liquibase/notification-service-TA58493.xml::1392246526298-1::TA58493: Marking ChangeSet: liquibase/notification-service-TA58493.xml::1392246526298-1::TA58493 ran despite precondition failure due to onFail='MARK_RAN':

          liquibase/notification-service-master.xml : Not precondition failed

2016-07-22T16:49:29.998026+00:00 vra01.GreenScott.com vcac-config: INFO  liquibase.info:126 - liquibase/identity-master.xml: liquibase/identity-TA59809.xml::1392250788816-1::TA59809: Marking ChangeSet: liquibase/identity-TA59809.xml::1392250788816-1::TA59809 ran despite precondition failure due to onFail='MARK_RAN':

          liquibase/identity-master.xml : Not precondition failed

2016-07-22T16:49:30.020122+00:00 vra01.GreenScott.com vcac-config: INFO  liquibase.info:126 - liquibase/identity-master.xml: liquibase/identity-TA59809.xml::1392250788816-2::TA59809: Marking ChangeSet: liquibase/identity-TA59809.xml::1392250788816-2::TA59809 ran despite precondition failure due to onFail='MARK_RAN':

          liquibase/identity-master.xml : Not precondition failed

2016-07-22T16:49:58.458073+00:00 vra01.GreenScott.com vcac-config: INFO  liquibase.info:126 - liquibase/catalog-service-master.xml: liquibase/catalog-service-TA58442.xml::22::TA58442: Marking ChangeSet: liquibase/catalog-service-TA58442.xml::22::TA58442 ran despite precondition failure due to onFail='MARK_RAN':

          liquibase/catalog-service-master.xml : Not precondition failed

2016-07-22T16:49:59.360880+00:00 vra01.GreenScott.com vcac-config: INFO  liquibase.info:126 - liquibase/catalog-service-master.xml: liquibase/catalog-service-TA58443.xml::1::TA58443: Marking ChangeSet: liquibase/catalog-service-TA58443.xml::1::TA58443 ran despite precondition failure due to onFail='MARK_RAN':

          liquibase/catalog-service-master.xml : Not precondition failed

2016-07-22T16:50:10.744227+00:00 vra01.GreenScott.com vcac-config: INFO  liquibase.info:126 - liquibase/software-service-master.xml: liquibase/software-service-TA96816.xml::14::TA96816: Marking ChangeSet: liquibase/software-service-TA96816.xml::14::TA96816 ran despite precondition failure due to onFail='MARK_RAN':

          liquibase/software-service-master.xml : Not precondition failed

2016-07-22T16:50:10.772471+00:00 vra01.GreenScott.com vcac-config: INFO  liquibase.info:126 - liquibase/software-service-master.xml: liquibase/software-service-TA96816.xml::1392234319279::TA59805: Marking ChangeSet: liquibase/software-service-TA96816.xml::1392234319279::TA59805 ran despite precondition failure due to onFail='MARK_RAN':

          liquibase/software-service-master.xml : Not precondition failed

2016-07-22T16:50:12.469572+00:00 vra01.GreenScott.com vcac-config: INFO  liquibase.info:126 - liquibase/work-item-service-master.xml: liquibase/work-item-service-TA58516.xml::1392329839440-1::TA58516: Marking ChangeSet: liquibase/work-item-service-TA58516.xml::1392329839440-1::TA58516 ran despite precondition failure due to onFail='MARK_RAN':

          liquibase/work-item-service-master.xml : Not precondition failed

2016-07-22T16:50:34.157007+00:00 vra01.GreenScott.com vcac-config: INFO  liquibase.info:126 - liquibase/work-item-service-master.xml: liquibase/work-item-service-TA64472.xml::1392333054048-2::TA58518: Marking ChangeSet: liquibase/work-item-service-TA64472.xml::1392333054048-2::TA58518 ran despite precondition failure due to onFail='MARK_RAN':

          liquibase/work-item-service-master.xml : Not precondition failed

2016-07-22T16:50:34.413081+00:00 vra01.GreenScott.com vcac-config: INFO  liquibase.info:126 - liquibase/content-management-service-master.xml: liquibase/content-management-service-common.xml::1::TA145473: Marking ChangeSet: liquibase/content-management-service-common.xml::1::TA145473 ran despite precondition failure due to onFail='MARK_RAN':

          liquibase/content-management-service-master.xml : Not precondition failed

2016-07-22T16:50:34.438713+00:00 vra01.GreenScott.com vcac-config: INFO  liquibase.info:126 - liquibase/content-management-service-master.xml: liquibase/content-management-service-common.xml::2::TA145473: Marking ChangeSet: liquibase/content-management-service-common.xml::2::TA145473 ran despite precondition failure due to onFail='MARK_RAN':

          liquibase/content-management-service-master.xml : Not precondition failed

2016-07-22T16:50:40.282435+00:00 vra01.GreenScott.com vcac-config: INFO  liquibase.info:126 - liquibase/release-management-service-master.xml: liquibase/release-management-service-TA154223.xml::TA154223::vrcs: Marking ChangeSet: liquibase/release-management-service-TA154223.xml::TA154223::vrcs ran despite precondition failure due to onFail='MARK_RAN':

          liquibase/release-management-service-master.xml : Not precondition failed

2016-07-22T16:50:41.192136+00:00 vra01.GreenScott.com vcac-config: INFO  liquibase.info:126 - liquibase/management-service-master.xml: liquibase/management-service-TA58482.xml::2::TA58482: Marking ChangeSet: liquibase/management-service-TA58482.xml::2::TA58482 ran despite precondition failure due to onFail='MARK_RAN':

          liquibase/management-service-master.xml : Not precondition failed

2016-07-22T16:50:41.393143+00:00 vra01.GreenScott.com vcac-config: INFO  liquibase.info:126 - liquibase/management-service-master.xml: liquibase/management-service-TA58484.xml::2::TA58484: Marking ChangeSet: liquibase/management-service-TA58484.xml::2::TA58484 ran despite precondition failure due to onFail='MARK_RAN':

          liquibase/management-service-master.xml : Not precondition failed

2016-07-22T16:50:41.872104+00:00 vra01.GreenScott.com vcac-config: INFO  liquibase.info:126 - liquibase/portal-service-master.xml: liquibase/portal-service-TA58501.xml::1392329922982-1::TA58501: Marking ChangeSet: liquibase/portal-service-TA58501.xml::1392329922982-1::TA58501 ran despite precondition failure due to onFail='MARK_RAN':

          liquibase/portal-service-master.xml : Not precondition failed

2016-07-22T16:50:42.712164+00:00 vra01.GreenScott.com vcac-config: INFO  liquibase.info:126 - liquibase/portal-service-master.xml: liquibase/portal-service-TA58503.xml::1392405705628::TA58503: Marking ChangeSet: liquibase/portal-service-TA58503.xml::1392405705628::TA58503 ran despite precondition failure due to onFail='MARK_RAN':

          liquibase/portal-service-master.xml : Not precondition failed

2016-07-22T16:50:42.910661+00:00 vra01.GreenScott.com vcac-config: INFO  liquibase.info:126 - liquibase/reservation-service-master.xml: liquibase/reservation-service-common.xml::1::TA58460: Marking ChangeSet: liquibase/reservation-service-common.xml::1::TA58460 ran despite precondition failure due to onFail='MARK_RAN':

          liquibase/reservation-service-master.xml : Not precondition failed

2016-07-22T16:50:46.025051+00:00 vra01.GreenScott.com vcac-config: INFO  liquibase.info:126 - liquibase/component-registry-master.xml: liquibase/plugin-service-TA58496.xml::1391727363896-1::TA58496: Marking ChangeSet: liquibase/plugin-service-TA58496.xml::1391727363896-1::TA58496 ran despite precondition failure due to onFail='MARK_RAN':

          liquibase/component-registry-master.xml : Not precondition failed

2016-07-22T16:50:46.435729+00:00 vra01.GreenScott.com vcac-config: INFO  liquibase.info:126 - liquibase/component-registry-master.xml: liquibase/component-registry-TA58455.xml::1::TA58455: Marking ChangeSet: liquibase/component-registry-TA58455.xml::1::TA58455 ran despite precondition failure due to onFail='MARK_RAN':

          liquibase/component-registry-master.xml : Not precondition failed

2016-07-22T16:50:46.466686+00:00 vra01.GreenScott.com vcac-config: INFO  liquibase.info:126 - liquibase/component-registry-master.xml: liquibase/component-registry-TA58455.xml::2::TA58455: Marking ChangeSet: liquibase/component-registry-TA58455.xml::2::TA58455 ran despite precondition failure due to onFail='MARK_RAN':

          liquibase/component-registry-master.xml : Not precondition failed

2016-07-22T16:50:46.499728+00:00 vra01.GreenScott.com vcac-config: INFO  liquibase.info:126 - liquibase/component-registry-master.xml: liquibase/component-registry-TA58455.xml::3::TA58455: Marking ChangeSet: liquibase/component-registry-TA58455.xml::3::TA58455 ran despite precondition failure due to onFail='MARK_RAN':

          liquibase/component-registry-master.xml : Not precondition failed

2016-07-22T16:50:46.529169+00:00 vra01.GreenScott.com vcac-config: INFO  liquibase.info:126 - liquibase/component-registry-master.xml: liquibase/component-registry-TA58455.xml::4::TA58455: Marking ChangeSet: liquibase/component-registry-TA58455.xml::4::TA58455 ran despite precondition failure due to onFail='MARK_RAN':

          liquibase/component-registry-master.xml : Not precondition failed

2016-07-22T16:50:46.558179+00:00 vra01.GreenScott.com vcac-config: INFO  liquibase.info:126 - liquibase/component-registry-master.xml: liquibase/component-registry-TA58455.xml::5::TA58455: Marking ChangeSet: liquibase/component-registry-TA58455.xml::5::TA58455 ran despite precondition failure due to onFail='MARK_RAN':

          liquibase/component-registry-master.xml : Not precondition failed

2016-07-22T16:51:41.316451+00:00 vra01.GreenScott.com vcac-config: INFO  liquibase.info:126 - liquibase/eventlog-service-master.xml: liquibase/eventlog-service-TA58457.xml::12::TA58457: Marking ChangeSet: liquibase/eventlog-service-TA58457.xml::12::TA58457 ran despite precondition failure due to onFail='MARK_RAN':

          liquibase/eventlog-service-master.xml : Not precondition failed

2016-07-22T16:51:41.353664+00:00 vra01.GreenScott.com vcac-config: INFO  liquibase.info:126 - liquibase/eventlog-service-master.xml: liquibase/eventlog-service-TA58460.xml::1::TA58460: Marking ChangeSet: liquibase/eventlog-service-TA58460.xml::1::TA58460 ran despite precondition failure due to onFail='MARK_RAN':

          liquibase/eventlog-service-master.xml : Not precondition failed

2016-07-22T16:51:43.835561+00:00 vra01.GreenScott.com vcac-config: INFO  liquibase.info:126 - liquibase/composition-service-master.xml: liquibase/composition-service-TA79802.xml::2::TA79802: Marking ChangeSet: liquibase/composition-service-TA79802.xml::2::TA79802 ran despite precondition failure due to onFail='MARK_RAN':

          liquibase/composition-service-master.xml : Not precondition failed

2016-07-22T16:51:43.876376+00:00 vra01.GreenScott.com vcac-config: INFO  liquibase.info:126 - liquibase/composition-service-master.xml: liquibase/composition-service-TA79802.xml::3::TA79802: Marking ChangeSet: liquibase/composition-service-TA79802.xml::3::TA79802 ran despite precondition failure due to onFail='MARK_RAN':

          liquibase/composition-service-master.xml : Not precondition failed

2016-07-22T16:51:49.335796+00:00 vra01.GreenScott.com vcac-config: INFO  liquibase.info:126 - liquibase/approvals-server-master.xml: liquibase/approvals-server-TA59804.xml::1392234272567-3::TA59804: Marking ChangeSet: liquibase/approvals-server-TA59804.xml::1392234272567-3::TA59804 ran despite precondition failure due to onFail='MARK_RAN':

          liquibase/approvals-server-master.xml : Not precondition failed

2016-07-22T16:51:51.062324+00:00 vra01.GreenScott.com vcac-config: INFO  liquibase.info:126 - liquibase/approvals-server-master.xml: liquibase/approvals-server-TA64462.xml::1392234319279::TA59805: Marking ChangeSet: liquibase/approvals-server-TA64462.xml::1392234319279::TA59805 ran despite precondition failure due to onFail='MARK_RAN':

          liquibase/approvals-server-master.xml : Not precondition failed

2016-07-22T17:22:23.872022+00:00 vra01.GreenScott.com vcac-config: INFO  com.vmware.vcac.cli.configurator.services.cluster.impl.ClusterNodeCommunicatorImpl.isCurrentNodeAvailable:382 - Node unavailable. Error: [http://127.0.0.1:8082/vcac/services/api/health, 503 Service Unavailable]

[Fwa]

After I shut off some servers which aren't related to vRA, this problem didn't appear in my lab. It seemed that vSAN/nested ESXi environment is wrong and the resource for vRA/NSX is not enough, I guess. However this workaround might not be applicable to your problem. Does any expert have advice for Scott?

[vvenu]

I am having similar issue with vRA 7.2 and every time it fails at "Verify that all services are started".

There were NO dns/IP issues. I have checked nslookup from appliance and IaaS which seems to be resolvable.

vcac-config.log has these:

2017-01-09T19:57:20+00:00 localhost haproxy[24653]: Health check for server backend-vra-health/local succeeded, reason: Layer4 check passed, check duration: 0ms, status: 3/3 UP.

2017-01-09T19:57:20+00:00 localhost haproxy[24653]: Server backend-vra-health/local is UP. 1 active and 0 backup servers online. 0 sessions requeued, 0 total in queue.

2017-01-09T19:58:49.763838+00:00 localhost vcac-config: INFO  com.vmware.vcac.cli.configurator.commands.cluster.ClusterCommandGetNext.processRootCommand:91 - Command [healthcheck] is found.

>> Node Unavailable after sometime Node unavailable. Error: [http://127.0.0.1:8082/vcac/services/api/health, 404 null]

2017-01-09T19:59:05.756089+00:00 localhost vcac-config: INFO  com.vmware.vcac.cli.configurator.services.cluster.impl.ClusterNodeCommunicatorImpl.waitUntilCurrentNodeIsAvailable:370 - Checking status for current node: http://127.0.0.1:8082/vcac/services/api/health

2017-01-09T19:59:05.832009+00:00 localhost vcac-config: INFO  com.vmware.vcac.cli.configurator.services.cluster.impl.ClusterNodeCommunicatorImpl.isCurrentNodeAvailable:347 - Checking status for http://127.0.0.1:8082/vcac/services/api/health...

2017-01-09T19:59:06.082809+00:00 localhost vcac-config: INFO  com.vmware.vcac.platform.security.encryption.EncryptorService.readKey:165 - Key was read from [/etc/vcac/encryption.key].

2017-01-09T19:59:06.175058+00:00 localhost vcac-config: INFO  com.vmware.vcac.platform.service.config.ConfigurationData.initEnabledFeaturesFileLocation:719 - File /etc/vcac/enabled-features.properties located for enabled feature properties.

2017-01-09T19:59:06.283254+00:00 localhost vcac-config: INFO  com.vmware.vcac.configuration.utils.ConfigurationUtils.readXmlFile:295 - Parsing /etc/vcac/server.xml...

2017-01-09T19:59:06.300720+00:00 localhost vcac-config: INFO  com.vmware.vcac.configuration.utils.ConfigurationUtils.findNodes:350 - Finding node matching /Server/GlobalNamingResources/Resource[@name='jdbc/cafe']...

2017-01-09T19:59:06.326638+00:00 localhost vcac-config: INFO  com.vmware.vcac.cli.configurator.services.cluster.impl.VcacDataSourceImpl.getDatabaseRealUrl:255 - Requested url for jdbc:postgresql://127.0.0.1:5433/vcac?sslrootcert=/var/vmware/vpostgres/current/.postgresql/root.crt&sslmode=verify-ca...

2017-01-09T19:59:06.331121+00:00 localhost vcac-config: INFO  com.vmware.vcac.platform.security.encryption.EncryptorService.readKey:165 - Key was read from [/etc/vcac/encryption.key].

2017-01-09T19:59:06.404103+00:00 localhost vcac-config: INFO  com.vmware.vcac.platform.service.config.ConfigurationData.initEnabledFeaturesFileLocation:719 - File /etc/vcac/enabled-features.properties located for enabled feature properties.

2017-01-09T19:59:07.957290+00:00 localhost vcac-config: INFO  com.vmware.vcac.cli.configurator.services.cluster.impl.ClusterNodeCommunicatorImpl.isCurrentNodeAvailable:355 - Node unavailable. Error: [http://127.0.0.1:8082/vcac/services/api/health, 404 null]

2017-01-09T19:59:07.957290+00:00 localhost vcac-config: WARN  com.vmware.vcac.platform.rest.client.support.RetriableOperation.call:102 - Exception handled during retry operation with message: Current node is not available.

Can someone please share if you come across this issue before?

[ProsKong]

see my post on Re: VRA simple installation failure at 20%