VMware Cloud Community
jfs9112
Contributor
Contributor
‎09-06-2018 10:56 AM

Cannot Start ImageBuilder Service

I'm getting the following error when trying to start the ImageBuilder service:

TimedOut (com.vmware.vapi.std.errors.timed_out) => {

I have tried the following to resolve:

  1. Made sure Auto Deploy service is running
  2. Rebooted
  3. Updating to the latest 6.5 VCSA version - 22000
  4. Increasing RAM from 10GB to 12GB
  5. Tried manually starting via ssh using the service-control --start vmware-image-builder command but get teh same timeout error

Error executing start on service imagebuilder. Details {

    "resolution": null,

    "detail": [

        {

            "args": [

                "imagebuilder"

            ],

            "id": "install.ciscommon.service.failstart",

            "localized": "An error occurred while starting service 'imagebuilder                                                                                                                                                             '",

            "translatable": "An error occurred while starting service '%(0)s'"

        }

    ],

    "componentKey": null,

    "problemId": null

}

Service-control failed. Error {

    "resolution": null,

    "detail": [

        {

            "args": [

                "imagebuilder"

            ],

            "id": "install.ciscommon.service.failstart",

            "localized": "An error occurred while starting service 'imagebuilder                                                                                                                                                             '",

            "translatable": "An error occurred while starting service '%(0)s'"

        }

    ],

    "componentKey": null,

    "problemId": null

}

The VCSA is running in my home lab on a 6.7 ESXi host with 64GB of RAM and an E5-2620 CPU and the host has plenty of resources free. I believe I did the small or tiny deployment when deploying the VCSA. The host is also running 3 embedded ESXi 6.5 hosts with 8GB each, but the VCSA is not running on them, but is running on the physical host itself. I have a very simple setup and only 11 small linux VMs on the embedded hosts, and only one of them running at the moment.

I created a support bundle and tried going through the logs but I'm not seeing anything related to why the service start process would time out, although I'm probably not looking at the right logs.

Thanks for any help and let me know if I can provide more info.

0 Kudos
5 Replies
SupreetK
Commander
Commander
‎09-06-2018 11:33 AM

For starters, we should start with checking the ports if they are being used by some other application or process. image-builder by default uses ports 8098 and 8099. Run the command <lsof -i -P -n | grep -i :809> to check if any of the processes are already using these ports. Also, the log file 'main.log' from the location </storage/log/vmware/vmware-imagebuilder> might give more details on why the service is not starting.

Cheers,

Supreet

0 Kudos
jfs9112
Contributor
Contributor
‎09-06-2018 12:04 PM

Thank you Supreet. It doesn't look like anything is running on that port currently.

root@vcsa01 [ ~ ]# lsof -i -P -n | grep -i :809

root@vcsa01 [ ~ ]#

I only see one error in the main.log that it failed to login using extension, but it looks like it is successful with a SAML token. Below is the main.log and a screenshot of the service settings in the client:

vcsa01.PNG

2018-09-06T15:07:33 [18296][MainThread]INFO:database:start vacuum database

2018-09-06T15:07:33 [18296][MainThread]INFO:database:Finished VACUUMING the database taking 0.026456 sec.

2018-09-06T15:07:33 [18296][MainThread]INFO:cisutils:store vpxd-extension key and certificate, and trusted root certificate

2018-09-06T15:07:33 [18296][MainThread]INFO:cisutils:Getting vpxd-extension private key and certificate from VECS

2018-09-06T15:07:33 [18296][MainThread]INFO:cisutils:store vpxd-extension private key to file /storage/imagebuilder/vpxd-extension.key

2018-09-06T15:07:33 [18296][MainThread]INFO:cisutils:store vpxd-extension certificate to file /storage/imagebuilder/vpxd-extension.cert

2018-09-06T15:07:33 [18296][MainThread]INFO:cisutils:get trusted root certificate from VECS

2018-09-06T15:07:33 [18296][MainThread]INFO:cisutils:store trusted root certificate to file /storage/imagebuilder/TRUSTED_ROOTS.certs

2018-09-06T15:07:33 [18296][MainThread]INFO:plugins:getting install parameter cm.url

2018-09-06T15:07:33 [18296][MainThread]INFO:plugins:install parameter cm.url=http://localhost:18090/cm/sdk/?hostid=220d0d13-1003-46fc-aecd-c4dcd5bd118d

2018-09-06T15:07:33 [18296][MainThread]INFO:plugins:get sts url from cm

2018-09-06T15:07:33 [18296][MainThread]INFO:plugins:sts url is https://vcsa01.lab.local/sts/STSService/vsphere.local

2018-09-06T15:07:33 [18296][MainThread]INFO:plugins:store sts url to database https://vcsa01.lab.local/sts/STSService/vsphere.local

2018-09-06T15:07:33 [18296][MainThread]INFO:plugins:get hok saml token valid for 86400 sec

2018-09-06T15:07:34 [18296][MainThread]INFO:plugins:store saml token to file /storage/imagebuilder/sso-token.xml

2018-09-06T15:07:34 [18296][MainThread]INFO:plugins:store is, vc endpoint url to database

2018-09-06T15:07:34 [18296][MainThread]INFO:plugins:get vc service endpoint

2018-09-06T15:07:34 [18296][MainThread]INFO:plugins:login to cm successful

2018-09-06T15:07:34 [18296][MainThread]INFO:plugins:vc url https://vcsa01.lab.local:443/sdk

2018-09-06T15:07:34 [18296][MainThread]INFO:vc_server:client SSL material -- /storage/imagebuilder/vpxd-extension.key, /storage/imagebuilder/vpxd-extension.cert

2018-09-06T15:07:39 [18296][MainThread]INFO:plugins:Failed to login using extension. Trying with SAML token.

2018-09-06T15:07:39 [18296][MainThread]INFO:cisutils:login VC successfully

2018-09-06T15:07:39 [18296][MainThread]INFO:plugins:registering imagebuilder as a vc extension

2018-09-06T15:07:39 [18296][MainThread]INFO:plugins:Successfully register imagebuilder as a vc extension

2018-09-06T15:07:39 [18296][Thread-1]DEBUG:ibserver:config directory certs /usr/lib/vmware-imagebuilder/etc/certs, schemas /usr/lib/vmware-imagebuilder/etc/schemas

2018-09-06T15:10:14 [18296][MainThread]INFO:main:signal handler terminates service

2018-09-06T15:10:14 [18296][MainThread]INFO:main:Image Builder exiting

2018-09-06T15:10:14 [18296][MainThread]INFO:cisutils:deinitialize service

2018-09-06T15:10:45 [20275][MainThread]INFO:database:start vacuum database

2018-09-06T15:10:45 [20275][MainThread]INFO:database:Finished VACUUMING the database taking 0.027279 sec.

2018-09-06T15:10:45 [20275][MainThread]INFO:cisutils:store vpxd-extension key and certificate, and trusted root certificate

2018-09-06T15:10:45 [20275][MainThread]INFO:cisutils:Getting vpxd-extension private key and certificate from VECS

2018-09-06T15:10:45 [20275][MainThread]INFO:cisutils:store vpxd-extension private key to file /storage/imagebuilder/vpxd-extension.key

2018-09-06T15:10:45 [20275][MainThread]INFO:cisutils:store vpxd-extension certificate to file /storage/imagebuilder/vpxd-extension.cert

2018-09-06T15:10:45 [20275][MainThread]INFO:cisutils:get trusted root certificate from VECS

2018-09-06T15:10:45 [20275][MainThread]INFO:cisutils:store trusted root certificate to file /storage/imagebuilder/TRUSTED_ROOTS.certs

2018-09-06T15:10:45 [20275][MainThread]INFO:plugins:getting install parameter cm.url

2018-09-06T15:10:45 [20275][MainThread]INFO:plugins:install parameter cm.url=http://localhost:18090/cm/sdk/?hostid=220d0d13-1003-46fc-aecd-c4dcd5bd118d

2018-09-06T15:10:45 [20275][MainThread]INFO:plugins:get sts url from cm

2018-09-06T15:10:45 [20275][MainThread]INFO:plugins:sts url is https://vcsa01.lab.local/sts/STSService/vsphere.local

2018-09-06T15:10:45 [20275][MainThread]INFO:plugins:store sts url to database https://vcsa01.lab.local/sts/STSService/vsphere.local

2018-09-06T15:10:45 [20275][MainThread]INFO:plugins:get hok saml token valid for 86400 sec

2018-09-06T15:10:46 [20275][MainThread]INFO:plugins:store saml token to file /storage/imagebuilder/sso-token.xml

2018-09-06T15:10:46 [20275][MainThread]INFO:plugins:store is, vc endpoint url to database

2018-09-06T15:10:46 [20275][MainThread]INFO:plugins:get vc service endpoint

2018-09-06T15:10:46 [20275][MainThread]INFO:plugins:login to cm successful

2018-09-06T15:10:46 [20275][MainThread]INFO:plugins:vc url https://vcsa01.lab.local:443/sdk

2018-09-06T15:10:46 [20275][MainThread]INFO:vc_server:client SSL material -- /storage/imagebuilder/vpxd-extension.key, /storage/imagebuilder/vpxd-extension.cert

2018-09-06T15:10:46 [20275][MainThread]INFO:plugins:updating the extension manager because imagebuilder is already a vc extension

2018-09-06T15:10:46 [20275][MainThread]INFO:plugins:Successfully register imagebuilder as a vc extension

2018-09-06T15:10:46 [20275][Thread-1]DEBUG:ibserver:config directory certs /usr/lib/vmware-imagebuilder/etc/certs, schemas /usr/lib/vmware-imagebuilder/etc/schemas

2018-09-06T15:14:45 [20275][MainThread]INFO:main:signal handler terminates service

2018-09-06T15:14:45 [20275][MainThread]INFO:main:Image Builder exiting

2018-09-06T15:14:45 [20275][MainThread]INFO:cisutils:deinitialize service

2018-09-06T15:17:44 [22911][MainThread]INFO:database:start vacuum database

2018-09-06T15:17:44 [22911][MainThread]INFO:database:Finished VACUUMING the database taking 0.025185 sec.

2018-09-06T15:17:44 [22911][MainThread]INFO:cisutils:store vpxd-extension key and certificate, and trusted root certificate

2018-09-06T15:17:44 [22911][MainThread]INFO:cisutils:Getting vpxd-extension private key and certificate from VECS

2018-09-06T15:17:44 [22911][MainThread]INFO:cisutils:store vpxd-extension private key to file /storage/imagebuilder/vpxd-extension.key

2018-09-06T15:17:44 [22911][MainThread]INFO:cisutils:store vpxd-extension certificate to file /storage/imagebuilder/vpxd-extension.cert

2018-09-06T15:17:44 [22911][MainThread]INFO:cisutils:get trusted root certificate from VECS

2018-09-06T15:17:44 [22911][MainThread]INFO:cisutils:store trusted root certificate to file /storage/imagebuilder/TRUSTED_ROOTS.certs

2018-09-06T15:17:44 [22911][MainThread]INFO:plugins:getting install parameter cm.url

2018-09-06T15:17:44 [22911][MainThread]INFO:plugins:install parameter cm.url=http://localhost:18090/cm/sdk/?hostid=220d0d13-1003-46fc-aecd-c4dcd5bd118d

2018-09-06T15:17:44 [22911][MainThread]INFO:plugins:get sts url from cm

2018-09-06T15:17:44 [22911][MainThread]INFO:plugins:sts url is https://vcsa01.lab.local/sts/STSService/vsphere.local

2018-09-06T15:17:44 [22911][MainThread]INFO:plugins:store sts url to database https://vcsa01.lab.local/sts/STSService/vsphere.local

2018-09-06T15:17:44 [22911][MainThread]INFO:plugins:get hok saml token valid for 86400 sec

2018-09-06T15:17:44 [22911][MainThread]INFO:plugins:store saml token to file /storage/imagebuilder/sso-token.xml

2018-09-06T15:17:44 [22911][MainThread]INFO:plugins:store is, vc endpoint url to database

2018-09-06T15:17:44 [22911][MainThread]INFO:plugins:get vc service endpoint

2018-09-06T15:17:44 [22911][MainThread]INFO:plugins:login to cm successful

2018-09-06T15:17:44 [22911][MainThread]INFO:plugins:vc url https://vcsa01.lab.local:443/sdk

2018-09-06T15:17:44 [22911][MainThread]INFO:vc_server:client SSL material -- /storage/imagebuilder/vpxd-extension.key, /storage/imagebuilder/vpxd-extension.cert

2018-09-06T15:17:45 [22911][MainThread]INFO:plugins:updating the extension manager because imagebuilder is already a vc extension

2018-09-06T15:17:45 [22911][MainThread]INFO:plugins:Successfully register imagebuilder as a vc extension

2018-09-06T15:17:45 [22911][Thread-1]DEBUG:ibserver:config directory certs /usr/lib/vmware-imagebuilder/etc/certs, schemas /usr/lib/vmware-imagebuilder/etc/schemas

2018-09-06T15:21:44 [22911][MainThread]INFO:main:signal handler terminates service

2018-09-06T15:21:44 [22911][MainThread]INFO:main:Image Builder exiting

2018-09-06T15:21:44 [22911][MainThread]INFO:cisutils:deinitialize service

2018-09-06T15:29:37 [4809][MainThread]INFO:database:start vacuum database

2018-09-06T15:29:37 [4809][MainThread]INFO:database:Finished VACUUMING the database taking 0.038424 sec.

2018-09-06T15:29:37 [4809][MainThread]INFO:cisutils:store vpxd-extension key and certificate, and trusted root certificate

2018-09-06T15:29:37 [4809][MainThread]INFO:cisutils:Getting vpxd-extension private key and certificate from VECS

2018-09-06T15:29:37 [4809][MainThread]INFO:cisutils:store vpxd-extension private key to file /storage/imagebuilder/vpxd-extension.key

2018-09-06T15:29:37 [4809][MainThread]INFO:cisutils:store vpxd-extension certificate to file /storage/imagebuilder/vpxd-extension.cert

2018-09-06T15:29:37 [4809][MainThread]INFO:cisutils:get trusted root certificate from VECS

2018-09-06T15:29:37 [4809][MainThread]INFO:cisutils:store trusted root certificate to file /storage/imagebuilder/TRUSTED_ROOTS.certs

2018-09-06T15:29:37 [4809][MainThread]INFO:plugins:getting install parameter cm.url

2018-09-06T15:29:37 [4809][MainThread]INFO:plugins:install parameter cm.url=http://localhost:18090/cm/sdk/?hostid=220d0d13-1003-46fc-aecd-c4dcd5bd118d

2018-09-06T15:29:37 [4809][MainThread]INFO:plugins:get sts url from cm

2018-09-06T15:29:37 [4809][MainThread]INFO:plugins:sts url is https://vcsa01.lab.local/sts/STSService/vsphere.local

2018-09-06T15:29:37 [4809][MainThread]INFO:plugins:store sts url to database https://vcsa01.lab.local/sts/STSService/vsphere.local

2018-09-06T15:29:38 [4809][MainThread]INFO:plugins:get hok saml token valid for 86400 sec

2018-09-06T15:29:38 [4809][MainThread]INFO:plugins:store saml token to file /storage/imagebuilder/sso-token.xml

2018-09-06T15:29:38 [4809][MainThread]INFO:plugins:store is, vc endpoint url to database

2018-09-06T15:29:38 [4809][MainThread]INFO:plugins:get vc service endpoint

2018-09-06T15:29:38 [4809][MainThread]INFO:plugins:login to cm successful

2018-09-06T15:29:39 [4809][MainThread]INFO:plugins:vc url https://vcsa01.lab.local:443/sdk

2018-09-06T15:29:39 [4809][MainThread]INFO:vc_server:client SSL material -- /storage/imagebuilder/vpxd-extension.key, /storage/imagebuilder/vpxd-extension.cert

2018-09-06T15:29:39 [4809][MainThread]INFO:plugins:updating the extension manager because imagebuilder is already a vc extension

2018-09-06T15:29:39 [4809][MainThread]INFO:plugins:Successfully register imagebuilder as a vc extension

2018-09-06T15:29:39 [4809][Thread-1]DEBUG:ibserver:config directory certs /usr/lib/vmware-imagebuilder/etc/certs, schemas /usr/lib/vmware-imagebuilder/etc/schemas

2018-09-06T15:33:35 [4809][MainThread]INFO:main:signal handler terminates service

2018-09-06T15:33:35 [4809][MainThread]INFO:main:Image Builder exiting

2018-09-06T15:33:35 [4809][MainThread]INFO:cisutils:deinitialize service

2018-09-06T15:40:03 [11269][MainThread]INFO:database:start vacuum database

2018-09-06T15:40:03 [11269][MainThread]INFO:database:Finished VACUUMING the database taking 0.018929 sec.

2018-09-06T15:40:03 [11269][MainThread]INFO:cisutils:store vpxd-extension key and certificate, and trusted root certificate

2018-09-06T15:40:03 [11269][MainThread]INFO:cisutils:Getting vpxd-extension private key and certificate from VECS

2018-09-06T15:40:03 [11269][MainThread]INFO:cisutils:store vpxd-extension private key to file /storage/imagebuilder/vpxd-extension.key

2018-09-06T15:40:03 [11269][MainThread]INFO:cisutils:store vpxd-extension certificate to file /storage/imagebuilder/vpxd-extension.cert

2018-09-06T15:40:03 [11269][MainThread]INFO:cisutils:get trusted root certificate from VECS

2018-09-06T15:40:03 [11269][MainThread]INFO:cisutils:store trusted root certificate to file /storage/imagebuilder/TRUSTED_ROOTS.certs

2018-09-06T15:40:03 [11269][MainThread]INFO:plugins:getting install parameter cm.url

2018-09-06T15:40:03 [11269][MainThread]INFO:plugins:install parameter cm.url=http://localhost:18090/cm/sdk/?hostid=220d0d13-1003-46fc-aecd-c4dcd5bd118d

2018-09-06T15:40:03 [11269][MainThread]INFO:plugins:get sts url from cm

2018-09-06T15:40:03 [11269][MainThread]INFO:plugins:sts url is https://vcsa01.lab.local/sts/STSService/vsphere.local

2018-09-06T15:40:03 [11269][MainThread]INFO:plugins:store sts url to database https://vcsa01.lab.local/sts/STSService/vsphere.local

2018-09-06T15:40:03 [11269][MainThread]INFO:plugins:get hok saml token valid for 86400 sec

2018-09-06T15:40:03 [11269][MainThread]INFO:plugins:store saml token to file /storage/imagebuilder/sso-token.xml

2018-09-06T15:40:03 [11269][MainThread]INFO:plugins:store is, vc endpoint url to database

2018-09-06T15:40:03 [11269][MainThread]INFO:plugins:get vc service endpoint

2018-09-06T15:40:03 [11269][MainThread]INFO:plugins:login to cm successful

2018-09-06T15:40:03 [11269][MainThread]INFO:plugins:vc url https://vcsa01.lab.local:443/sdk

2018-09-06T15:40:03 [11269][MainThread]INFO:vc_server:client SSL material -- /storage/imagebuilder/vpxd-extension.key, /storage/imagebuilder/vpxd-extension.cert

2018-09-06T15:40:04 [11269][MainThread]INFO:plugins:updating the extension manager because imagebuilder is already a vc extension

2018-09-06T15:40:04 [11269][MainThread]INFO:plugins:Successfully register imagebuilder as a vc extension

2018-09-06T15:40:04 [11269][Thread-1]DEBUG:ibserver:config directory certs /usr/lib/vmware-imagebuilder/etc/certs, schemas /usr/lib/vmware-imagebuilder/etc/schemas

2018-09-06T15:44:03 [11269][MainThread]INFO:main:signal handler terminates service

2018-09-06T15:44:03 [11269][MainThread]INFO:main:Image Builder exiting

2018-09-06T15:44:03 [11269][MainThread]INFO:cisutils:deinitialize service

2018-09-06T16:08:56 [4652][MainThread]INFO:database:start vacuum database

2018-09-06T16:08:56 [4652][MainThread]INFO:database:Finished VACUUMING the database taking 0.036974 sec.

2018-09-06T16:08:56 [4652][MainThread]INFO:cisutils:store vpxd-extension key and certificate, and trusted root certificate

2018-09-06T16:08:56 [4652][MainThread]INFO:cisutils:Getting vpxd-extension private key and certificate from VECS

2018-09-06T16:08:56 [4652][MainThread]INFO:cisutils:store vpxd-extension private key to file /storage/imagebuilder/vpxd-extension.key

2018-09-06T16:08:56 [4652][MainThread]INFO:cisutils:store vpxd-extension certificate to file /storage/imagebuilder/vpxd-extension.cert

2018-09-06T16:08:56 [4652][MainThread]INFO:cisutils:get trusted root certificate from VECS

2018-09-06T16:08:56 [4652][MainThread]INFO:cisutils:store trusted root certificate to file /storage/imagebuilder/TRUSTED_ROOTS.certs

2018-09-06T16:08:56 [4652][MainThread]INFO:plugins:Got cm.url=https://vcsa01.lab.local/cm/sdk?hostid=220d0d13-1003-46fc-aecd-c4dcd5bd118d

2018-09-06T16:08:56 [4652][MainThread]INFO:plugins:get sts url from cm

2018-09-06T16:08:56 [4652][MainThread]INFO:plugins:sts url is https://vcsa01.lab.local/sts/STSService/vsphere.local

2018-09-06T16:08:56 [4652][MainThread]INFO:plugins:store sts url to database https://vcsa01.lab.local/sts/STSService/vsphere.local

2018-09-06T16:08:56 [4652][MainThread]INFO:plugins:get hok saml token valid for 86400 sec

2018-09-06T16:08:57 [4652][MainThread]INFO:plugins:store saml token to file /storage/imagebuilder/sso-token.xml

2018-09-06T16:08:57 [4652][MainThread]INFO:plugins:store is, vc endpoint url to database

2018-09-06T16:08:57 [4652][MainThread]INFO:plugins:get vc service endpoint

2018-09-06T16:08:57 [4652][MainThread]INFO:plugins:login to cm successful

2018-09-06T16:08:57 [4652][MainThread]INFO:plugins:vc url https://vcsa01.lab.local:443/sdk

2018-09-06T16:08:57 [4652][MainThread]INFO:vc_server:client SSL material -- /storage/imagebuilder/vpxd-extension.key, /storage/imagebuilder/vpxd-extension.cert

2018-09-06T16:08:58 [4652][MainThread]INFO:plugins:updating the extension manager because imagebuilder is already a vc extension

2018-09-06T16:08:58 [4652][MainThread]INFO:plugins:Successfully register imagebuilder as a vc extension

2018-09-06T16:08:58 [4652][Thread-1]DEBUG:ibserver:config directory certs /usr/lib/vmware-imagebuilder/etc/certs, schemas /usr/lib/vmware-imagebuilder/etc/schemas

2018-09-06T16:12:50 [4652][MainThread]INFO:main:signal handler terminates service

2018-09-06T16:12:50 [4652][MainThread]INFO:main:Image Builder exiting

2018-09-06T16:12:50 [4652][MainThread]INFO:cisutils:deinitialize service

2018-09-06T16:25:04 [12947][MainThread]INFO:database:start vacuum database

2018-09-06T16:25:04 [12947][MainThread]INFO:database:Finished VACUUMING the database taking 0.019133 sec.

2018-09-06T16:25:04 [12947][MainThread]INFO:cisutils:store vpxd-extension key and certificate, and trusted root certificate

2018-09-06T16:25:04 [12947][MainThread]INFO:cisutils:Getting vpxd-extension private key and certificate from VECS

2018-09-06T16:25:04 [12947][MainThread]INFO:cisutils:store vpxd-extension private key to file /storage/imagebuilder/vpxd-extension.key

2018-09-06T16:25:04 [12947][MainThread]INFO:cisutils:store vpxd-extension certificate to file /storage/imagebuilder/vpxd-extension.cert

2018-09-06T16:25:04 [12947][MainThread]INFO:cisutils:get trusted root certificate from VECS

2018-09-06T16:25:04 [12947][MainThread]INFO:cisutils:store trusted root certificate to file /storage/imagebuilder/TRUSTED_ROOTS.certs

2018-09-06T16:25:04 [12947][MainThread]INFO:plugins:Got cm.url=https://vcsa01.lab.local/cm/sdk?hostid=220d0d13-1003-46fc-aecd-c4dcd5bd118d

2018-09-06T16:25:04 [12947][MainThread]INFO:plugins:get sts url from cm

2018-09-06T16:25:04 [12947][MainThread]INFO:plugins:sts url is https://vcsa01.lab.local/sts/STSService/vsphere.local

2018-09-06T16:25:04 [12947][MainThread]INFO:plugins:store sts url to database https://vcsa01.lab.local/sts/STSService/vsphere.local

2018-09-06T16:25:04 [12947][MainThread]INFO:plugins:get hok saml token valid for 86400 sec

2018-09-06T16:25:04 [12947][MainThread]INFO:plugins:store saml token to file /storage/imagebuilder/sso-token.xml

2018-09-06T16:25:04 [12947][MainThread]INFO:plugins:store is, vc endpoint url to database

2018-09-06T16:25:04 [12947][MainThread]INFO:plugins:get vc service endpoint

2018-09-06T16:25:04 [12947][MainThread]INFO:plugins:login to cm successful

2018-09-06T16:25:04 [12947][MainThread]INFO:plugins:vc url https://vcsa01.lab.local:443/sdk

2018-09-06T16:25:04 [12947][MainThread]INFO:vc_server:client SSL material -- /storage/imagebuilder/vpxd-extension.key, /storage/imagebuilder/vpxd-extension.cert

2018-09-06T16:25:04 [12947][MainThread]INFO:plugins:updating the extension manager because imagebuilder is already a vc extension

2018-09-06T16:25:04 [12947][MainThread]INFO:plugins:Successfully register imagebuilder as a vc extension

2018-09-06T16:25:04 [12947][Thread-1]DEBUG:ibserver:config directory certs /usr/lib/vmware-imagebuilder/etc/certs, schemas /usr/lib/vmware-imagebuilder/etc/schemas

2018-09-06T16:29:03 [12947][MainThread]INFO:main:signal handler terminates service

2018-09-06T16:29:03 [12947][MainThread]INFO:main:Image Builder exiting

2018-09-06T16:29:03 [12947][MainThread]INFO:cisutils:deinitialize service

2018-09-06T16:59:51 [36385][MainThread]INFO:database:start vacuum database

2018-09-06T16:59:51 [36385][MainThread]INFO:database:Finished VACUUMING the database taking 0.020504 sec.

2018-09-06T16:59:51 [36385][MainThread]INFO:cisutils:store vpxd-extension key and certificate, and trusted root certificate

2018-09-06T16:59:51 [36385][MainThread]INFO:cisutils:Getting vpxd-extension private key and certificate from VECS

2018-09-06T16:59:51 [36385][MainThread]INFO:cisutils:store vpxd-extension private key to file /storage/imagebuilder/vpxd-extension.key

2018-09-06T16:59:51 [36385][MainThread]INFO:cisutils:store vpxd-extension certificate to file /storage/imagebuilder/vpxd-extension.cert

2018-09-06T16:59:51 [36385][MainThread]INFO:cisutils:get trusted root certificate from VECS

2018-09-06T16:59:51 [36385][MainThread]INFO:cisutils:store trusted root certificate to file /storage/imagebuilder/TRUSTED_ROOTS.certs

2018-09-06T16:59:51 [36385][MainThread]INFO:plugins:Got cm.url=https://vcsa01.lab.local/cm/sdk?hostid=220d0d13-1003-46fc-aecd-c4dcd5bd118d

2018-09-06T16:59:51 [36385][MainThread]INFO:plugins:get sts url from cm

2018-09-06T16:59:51 [36385][MainThread]INFO:plugins:sts url is https://vcsa01.lab.local/sts/STSService/vsphere.local

2018-09-06T16:59:51 [36385][MainThread]INFO:plugins:store sts url to database https://vcsa01.lab.local/sts/STSService/vsphere.local

2018-09-06T16:59:51 [36385][MainThread]INFO:plugins:get hok saml token valid for 86400 sec

2018-09-06T16:59:51 [36385][MainThread]INFO:plugins:store saml token to file /storage/imagebuilder/sso-token.xml

2018-09-06T16:59:51 [36385][MainThread]INFO:plugins:store is, vc endpoint url to database

2018-09-06T16:59:51 [36385][MainThread]INFO:plugins:get vc service endpoint

2018-09-06T16:59:51 [36385][MainThread]INFO:plugins:login to cm successful

2018-09-06T16:59:51 [36385][MainThread]INFO:plugins:vc url https://vcsa01.lab.local:443/sdk

2018-09-06T16:59:51 [36385][MainThread]INFO:vc_server:client SSL material -- /storage/imagebuilder/vpxd-extension.key, /storage/imagebuilder/vpxd-extension.cert

2018-09-06T16:59:51 [36385][MainThread]INFO:plugins:updating the extension manager because imagebuilder is already a vc extension

2018-09-06T16:59:52 [36385][MainThread]INFO:plugins:Successfully register imagebuilder as a vc extension

2018-09-06T16:59:52 [36385][Thread-1]DEBUG:ibserver:config directory certs /usr/lib/vmware-imagebuilder/etc/certs, schemas /usr/lib/vmware-imagebuilder/etc/schemas

2018-09-06T17:03:51 [36385][MainThread]INFO:main:signal handler terminates service

2018-09-06T17:03:51 [36385][MainThread]INFO:main:Image Builder exiting

2018-09-06T17:03:51 [36385][MainThread]INFO:cisutils:deinitialize service

2018-09-06T17:14:59 [4802][MainThread]INFO:database:start vacuum database

2018-09-06T17:14:59 [4802][MainThread]INFO:database:Finished VACUUMING the database taking 0.047503 sec.

2018-09-06T17:14:59 [4802][MainThread]INFO:cisutils:store vpxd-extension key and certificate, and trusted root certificate

2018-09-06T17:14:59 [4802][MainThread]INFO:cisutils:Getting vpxd-extension private key and certificate from VECS

2018-09-06T17:14:59 [4802][MainThread]INFO:cisutils:store vpxd-extension private key to file /storage/imagebuilder/vpxd-extension.key

2018-09-06T17:14:59 [4802][MainThread]INFO:cisutils:store vpxd-extension certificate to file /storage/imagebuilder/vpxd-extension.cert

2018-09-06T17:14:59 [4802][MainThread]INFO:cisutils:get trusted root certificate from VECS

2018-09-06T17:14:59 [4802][MainThread]INFO:cisutils:store trusted root certificate to file /storage/imagebuilder/TRUSTED_ROOTS.certs

2018-09-06T17:14:59 [4802][MainThread]INFO:plugins:Got cm.url=https://vcsa01.lab.local/cm/sdk?hostid=220d0d13-1003-46fc-aecd-c4dcd5bd118d

2018-09-06T17:14:59 [4802][MainThread]INFO:plugins:get sts url from cm

2018-09-06T17:14:59 [4802][MainThread]INFO:plugins:sts url is https://vcsa01.lab.local/sts/STSService/vsphere.local

2018-09-06T17:14:59 [4802][MainThread]INFO:plugins:store sts url to database https://vcsa01.lab.local/sts/STSService/vsphere.local

2018-09-06T17:14:59 [4802][MainThread]INFO:plugins:get hok saml token valid for 86400 sec

2018-09-06T17:15:00 [4802][MainThread]INFO:plugins:store saml token to file /storage/imagebuilder/sso-token.xml

2018-09-06T17:15:00 [4802][MainThread]INFO:plugins:store is, vc endpoint url to database

2018-09-06T17:15:00 [4802][MainThread]INFO:plugins:get vc service endpoint

2018-09-06T17:15:00 [4802][MainThread]INFO:plugins:login to cm successful

2018-09-06T17:15:01 [4802][MainThread]INFO:plugins:vc url https://vcsa01.lab.local:443/sdk

2018-09-06T17:15:01 [4802][MainThread]INFO:vc_server:client SSL material -- /storage/imagebuilder/vpxd-extension.key, /storage/imagebuilder/vpxd-extension.cert

2018-09-06T17:15:01 [4802][MainThread]INFO:plugins:updating the extension manager because imagebuilder is already a vc extension

2018-09-06T17:15:01 [4802][MainThread]INFO:plugins:Successfully register imagebuilder as a vc extension

2018-09-06T17:15:01 [4802][Thread-1]DEBUG:ibserver:config directory certs /usr/lib/vmware-imagebuilder/etc/certs, schemas /usr/lib/vmware-imagebuilder/etc/schemas

2018-09-06T17:18:57 [4802][MainThread]INFO:main:signal handler terminates service

2018-09-06T17:18:57 [4802][MainThread]INFO:main:Image Builder exiting

2018-09-06T17:18:57 [4802][MainThread]INFO:cisutils:deinitialize service

2018-09-06T17:24:54 [11078][MainThread]INFO:database:start vacuum database

2018-09-06T17:24:54 [11078][MainThread]INFO:database:Finished VACUUMING the database taking 0.022160 sec.

2018-09-06T17:24:54 [11078][MainThread]INFO:cisutils:store vpxd-extension key and certificate, and trusted root certificate

2018-09-06T17:24:54 [11078][MainThread]INFO:cisutils:Getting vpxd-extension private key and certificate from VECS

2018-09-06T17:24:54 [11078][MainThread]INFO:cisutils:store vpxd-extension private key to file /storage/imagebuilder/vpxd-extension.key

2018-09-06T17:24:54 [11078][MainThread]INFO:cisutils:store vpxd-extension certificate to file /storage/imagebuilder/vpxd-extension.cert

2018-09-06T17:24:54 [11078][MainThread]INFO:cisutils:get trusted root certificate from VECS

2018-09-06T17:24:54 [11078][MainThread]INFO:cisutils:store trusted root certificate to file /storage/imagebuilder/TRUSTED_ROOTS.certs

2018-09-06T17:24:54 [11078][MainThread]INFO:plugins:Got cm.url=https://vcsa01.lab.local/cm/sdk?hostid=220d0d13-1003-46fc-aecd-c4dcd5bd118d

2018-09-06T17:24:54 [11078][MainThread]INFO:plugins:get sts url from cm

2018-09-06T17:24:54 [11078][MainThread]INFO:plugins:sts url is https://vcsa01.lab.local/sts/STSService/vsphere.local

2018-09-06T17:24:54 [11078][MainThread]INFO:plugins:store sts url to database https://vcsa01.lab.local/sts/STSService/vsphere.local

2018-09-06T17:24:54 [11078][MainThread]INFO:plugins:get hok saml token valid for 86400 sec

2018-09-06T17:24:54 [11078][MainThread]INFO:plugins:store saml token to file /storage/imagebuilder/sso-token.xml

2018-09-06T17:24:54 [11078][MainThread]INFO:plugins:store is, vc endpoint url to database

2018-09-06T17:24:54 [11078][MainThread]INFO:plugins:get vc service endpoint

2018-09-06T17:24:54 [11078][MainThread]INFO:plugins:login to cm successful

2018-09-06T17:24:54 [11078][MainThread]INFO:plugins:vc url https://vcsa01.lab.local:443/sdk

2018-09-06T17:24:54 [11078][MainThread]INFO:vc_server:client SSL material -- /storage/imagebuilder/vpxd-extension.key, /storage/imagebuilder/vpxd-extension.cert

2018-09-06T17:24:54 [11078][MainThread]INFO:plugins:updating the extension manager because imagebuilder is already a vc extension

2018-09-06T17:24:54 [11078][MainThread]INFO:plugins:Successfully register imagebuilder as a vc extension

2018-09-06T17:24:54 [11078][Thread-1]DEBUG:ibserver:config directory certs /usr/lib/vmware-imagebuilder/etc/certs, schemas /usr/lib/vmware-imagebuilder/etc/schemas

2018-09-06T17:28:53 [11078][MainThread]INFO:main:signal handler terminates service

2018-09-06T17:28:54 [11078][MainThread]INFO:main:Image Builder exiting

2018-09-06T17:28:54 [11078][MainThread]INFO:cisutils:deinitialize service

2018-09-06T17:46:26 [18930][MainThread]INFO:database:start vacuum database

2018-09-06T17:46:26 [18930][MainThread]INFO:database:Finished VACUUMING the database taking 0.022398 sec.

2018-09-06T17:46:26 [18930][MainThread]INFO:cisutils:store vpxd-extension key and certificate, and trusted root certificate

2018-09-06T17:46:26 [18930][MainThread]INFO:cisutils:Getting vpxd-extension private key and certificate from VECS

2018-09-06T17:46:26 [18930][MainThread]INFO:cisutils:store vpxd-extension private key to file /storage/imagebuilder/vpxd-extension.key

2018-09-06T17:46:26 [18930][MainThread]INFO:cisutils:store vpxd-extension certificate to file /storage/imagebuilder/vpxd-extension.cert

2018-09-06T17:46:26 [18930][MainThread]INFO:cisutils:get trusted root certificate from VECS

2018-09-06T17:46:26 [18930][MainThread]INFO:cisutils:store trusted root certificate to file /storage/imagebuilder/TRUSTED_ROOTS.certs

2018-09-06T17:46:26 [18930][MainThread]INFO:plugins:Got cm.url=https://vcsa01.lab.local/cm/sdk?hostid=220d0d13-1003-46fc-aecd-c4dcd5bd118d

2018-09-06T17:46:26 [18930][MainThread]INFO:plugins:get sts url from cm

2018-09-06T17:46:26 [18930][MainThread]INFO:plugins:sts url is https://vcsa01.lab.local/sts/STSService/vsphere.local

2018-09-06T17:46:26 [18930][MainThread]INFO:plugins:store sts url to database https://vcsa01.lab.local/sts/STSService/vsphere.local

2018-09-06T17:46:26 [18930][MainThread]INFO:plugins:get hok saml token valid for 86400 sec

2018-09-06T17:46:26 [18930][MainThread]INFO:plugins:store saml token to file /storage/imagebuilder/sso-token.xml

2018-09-06T17:46:26 [18930][MainThread]INFO:plugins:store is, vc endpoint url to database

2018-09-06T17:46:26 [18930][MainThread]INFO:plugins:get vc service endpoint

2018-09-06T17:46:26 [18930][MainThread]INFO:plugins:login to cm successful

2018-09-06T17:46:26 [18930][MainThread]INFO:plugins:vc url https://vcsa01.lab.local:443/sdk

2018-09-06T17:46:26 [18930][MainThread]INFO:vc_server:client SSL material -- /storage/imagebuilder/vpxd-extension.key, /storage/imagebuilder/vpxd-extension.cert

2018-09-06T17:46:26 [18930][MainThread]INFO:plugins:updating the extension manager because imagebuilder is already a vc extension

2018-09-06T17:46:26 [18930][MainThread]INFO:plugins:Successfully register imagebuilder as a vc extension

2018-09-06T17:46:26 [18930][Thread-1]DEBUG:ibserver:config directory certs /usr/lib/vmware-imagebuilder/etc/certs, schemas /usr/lib/vmware-imagebuilder/etc/schemas

2018-09-06T17:50:25 [18930][MainThread]INFO:main:signal handler terminates service

2018-09-06T17:50:25 [18930][MainThread]INFO:main:Image Builder exiting

2018-09-06T17:50:25 [18930][MainThread]INFO:cisutils:deinitialize service

2018-09-06T18:28:51 [32498][MainThread]INFO:database:start vacuum database

2018-09-06T18:28:51 [32498][MainThread]INFO:database:Finished VACUUMING the database taking 0.021591 sec.

2018-09-06T18:28:51 [32498][MainThread]INFO:cisutils:store vpxd-extension key and certificate, and trusted root certificate

2018-09-06T18:28:51 [32498][MainThread]INFO:cisutils:Getting vpxd-extension private key and certificate from VECS

2018-09-06T18:28:51 [32498][MainThread]INFO:cisutils:store vpxd-extension private key to file /storage/imagebuilder/vpxd-extension.key

2018-09-06T18:28:51 [32498][MainThread]INFO:cisutils:store vpxd-extension certificate to file /storage/imagebuilder/vpxd-extension.cert

2018-09-06T18:28:51 [32498][MainThread]INFO:cisutils:get trusted root certificate from VECS

2018-09-06T18:28:51 [32498][MainThread]INFO:cisutils:store trusted root certificate to file /storage/imagebuilder/TRUSTED_ROOTS.certs

2018-09-06T18:28:51 [32498][MainThread]INFO:plugins:Got cm.url=https://vcsa01.lab.local/cm/sdk?hostid=220d0d13-1003-46fc-aecd-c4dcd5bd118d

2018-09-06T18:28:51 [32498][MainThread]INFO:plugins:get sts url from cm

2018-09-06T18:28:51 [32498][MainThread]INFO:plugins:sts url is https://vcsa01.lab.local/sts/STSService/vsphere.local

2018-09-06T18:28:51 [32498][MainThread]INFO:plugins:store sts url to database https://vcsa01.lab.local/sts/STSService/vsphere.local

2018-09-06T18:28:51 [32498][MainThread]INFO:plugins:get hok saml token valid for 86400 sec

2018-09-06T18:28:51 [32498][MainThread]INFO:plugins:store saml token to file /storage/imagebuilder/sso-token.xml

2018-09-06T18:28:51 [32498][MainThread]INFO:plugins:store is, vc endpoint url to database

2018-09-06T18:28:51 [32498][MainThread]INFO:plugins:get vc service endpoint

2018-09-06T18:28:51 [32498][MainThread]INFO:plugins:login to cm successful

2018-09-06T18:28:51 [32498][MainThread]INFO:plugins:vc url https://vcsa01.lab.local:443/sdk

2018-09-06T18:28:51 [32498][MainThread]INFO:vc_server:client SSL material -- /storage/imagebuilder/vpxd-extension.key, /storage/imagebuilder/vpxd-extension.cert

2018-09-06T18:28:51 [32498][MainThread]INFO:plugins:updating the extension manager because imagebuilder is already a vc extension

2018-09-06T18:28:51 [32498][MainThread]INFO:plugins:Successfully register imagebuilder as a vc extension

2018-09-06T18:28:51 [32498][Thread-1]DEBUG:ibserver:config directory certs /usr/lib/vmware-imagebuilder/etc/certs, schemas /usr/lib/vmware-imagebuilder/etc/schemas

2018-09-06T18:32:51 [32498][MainThread]INFO:main:signal handler terminates service

2018-09-06T18:32:51 [32498][MainThread]INFO:main:Image Builder exiting

2018-09-06T18:32:51 [32498][MainThread]INFO:cisutils:deinitialize service

0 Kudos
jfs9112
Contributor
Contributor
‎09-11-2018 01:58 PM

I spun up a new VCSA and the first thing I did was was enable Image Builder service and it is successful. Below is an excerpt of the imagebuilder main.log from the new VCSA and then the original that I'm having trouble with. It appears the successful one binds to IPV6 but the original VCSA does not?

New VCSA:

2018-09-08T20:32:09 [27893][MainThread]INFO:plugins:registering imagebuilder as a vc extension

2018-09-08T20:32:10 [27893][MainThread]INFO:plugins:Successfully register imagebuilder as a vc extension

2018-09-08T20:32:10 [27893][Thread-2]INFO:httpd:ImageBuilder HTTP server listening on ::1%1:8099.

2018-09-08T20:32:10 [27893][Thread-1]DEBUG:ibserver:config directory certs /usr/lib/vmware-imagebuilder/etc/certs, schemas /usr/lib/vmware-imagebuilder/etc/schemas

2018-09-08T20:32:10 [27893][Thread-1]INFO:ibserver:ImageBuilder Vmomi server listening on ::1%1:8098.

Original VCSA:

2018-09-06T15:07:39 [18296][MainThread]INFO:plugins:registering imagebuilder as a vc extension

2018-09-06T15:07:39 [18296][MainThread]INFO:plugins:Successfully register imagebuilder as a vc extension

2018-09-06T15:07:39 [18296][Thread-1]DEBUG:ibserver:config directory certs /usr/lib/vmware-imagebuilder/etc/certs, schemas /usr/lib/vmware-imagebuilder/etc/schemas

2018-09-06T15:10:14 [18296][MainThread]INFO:main:signal handler terminates service

Here are the network settings from the admin UI. They are both connected the the same switch.

New VCSA:

vcsa02-1.PNG

Old VCSA:

vcsa01-1.PNG

0 Kudos
jfs9112
Contributor
Contributor
‎09-11-2018 02:14 PM

I spoke too soon. Now the image builder service is timing out on the new VCSA. Probably an issue with my network setup. I will share if I find a solution.

0 Kudos
baljitbasra
Contributor
Contributor
‎06-17-2019 02:51 AM

Hi,

Did you find a solution to this issue?  Unfortunately, I'm experiencing the same issue.

Many thanks in advance.

0 Kudos