4 Replies Latest reply on Jul 13, 2018 7:39 AM by rbetelli

    VCSA 6.0u2 - vmware-eam fails to start

    rbetelli Lurker

      Hi everybody,

      I'm having some trouble with VCSA 6.0u2.

      Let's start from the beginning: in the first place, pointing the browser to vCenter FQDN brought a page with an error like this: 503 Service Unavailable (Failed to connect to endpoint: [N7Vmacore4Http20NamedPipeServiceSpecE:0x7f009c095810] _serverNamespace = / _isRedirect = false _pipeName =/var/run/vmware/vpxd-webserver-pipe).

      Then I tried to login as root directly to the VCSA VM, but the system refused to allow me in.

      I followed this KB to reset the password and also found out that /storage/log and /dev/sda3 were filled with unrotated logs and a really big audit.log.

      Cleaned up, applied suggestions from this KB, rebooted and then I could log in normally to the appliance vm, but still no luck with the web side.

      So I checked the stopped services and respective logs, and found the entry "invalid credentials LDAP Error 49" in inv-svc.log, so I followed this other KB to reset the password.

      Now vmware-invsvc started normally and web client started to show the login page (but giving a blank page after logging in); I checked again the stopped services and tried to start them one by one, and noticed that the one crashing was vmware-eam and that eam.properties was empty.

      I rebuilt the file with the help of this thread, but vmware-eam still crashes and I have no clue about how to solve.

       

       

      This is the output of service-control --start vmware-eam

      INFO:root:Service: vmware-eam, Action: start
      Service: vmware-eam, Action: start
      2018-07-12T14:44:02.873Z   Running command: ['/sbin/chkconfig', u'vmware-eam']
      2018-07-12T14:44:02.929Z   Done running command
      2018-07-12T14:44:02.929Z   Running command: ['/sbin/service', u'vmware-eam', 'status']
      2018-07-12T14:44:03.003Z   Done running command
      2018-07-12T14:44:03.003Z   Running command: ['/sbin/chkconfig', '--force', u'vmware-eam', 'on']
      2018-07-12T14:44:03.059Z   Done running command
      2018-07-12T14:44:03.059Z   Running command: ['/sbin/service', u'vmware-eam', 'start']
      2018-07-12T14:44:07.837Z   Done running command
      2018-07-12T14:44:07.837Z   Invoked command: ['/sbin/service', u'vmware-eam', 'start']
      2018-07-12T14:44:07.837Z   RC = 1
      Stdout = Starting VMware ESX Agent Manager...
      Waiting for VMware ESX Agent Manager.......
      WARNING: VMware ESX Agent Manager may have failed to start.
      Last login: Thu Jul 12 14:42:09 UTC 2018
      
      Stderr =
      2018-07-12T14:44:07.837Z   {
          "resolution": null,
          "detail": [
              {
                  "args": [
                      "Command: ['/sbin/service', u'vmware-eam', 'start']\nStderr: "
                  ],
                  "id": "install.ciscommon.command.errinvoke",
                  "localized": "An error occurred while invoking external command : 'Command: ['/sbin/service', u'vmware-eam', 'start']\nStderr: '",
                  "translatable": "An error occurred while invoking external command : '%(0)s'"
              }
          ],
          "componentKey": null,
          "problemId": null
      }
      ERROR:root:Unable to start service vmware-eam, Exception: {
          "resolution": null,
          "detail": [
              {
                  "args": [
                      "vmware-eam"
                  ],
                  "id": "install.ciscommon.service.failstart",
                  "localized": "An error occurred while starting service 'vmware-eam'",
                  "translatable": "An error occurred while starting service '%(0)s'"
              }
          ],
          "componentKey": null,
          "problemId": null
      }
      Unable to start service vmware-eam, Exception: {
          "resolution": null,
          "detail": [
              {
                  "args": [
                      "vmware-eam"
                  ],
                  "id": "install.ciscommon.service.failstart",
                  "localized": "An error occurred while starting service 'vmware-eam'",
                  "translatable": "An error occurred while starting service '%(0)s'"
              }
          ],
          "componentKey": null,
          "problemId": null
      }
      
      

       

      This is the log entry of /var/log/vmware/eam/wrapper.log related to the service start

      STATUS | wrapper  | 2018/07/12 14:44:03 | --> Wrapper Started as Daemon
      STATUS | wrapper  | 2018/07/12 14:44:03 | Java Service Wrapper Professional Edition 64-bit 3.5.24
      STATUS | wrapper  | 2018/07/12 14:44:03 |   Copyright (C) 1999-2014 Tanuki Software, Ltd. All Rights Reserved.
      STATUS | wrapper  | 2018/07/12 14:44:03 |     http://wrapper.tanukisoftware.com
      STATUS | wrapper  | 2018/07/12 14:44:03 |   Licensed to VMware Global, Inc. for VMware vCenter ESX Agent Manager
      STATUS | wrapper  | 2018/07/12 14:44:03 |
      INFO   | wrapper  | 2018/07/12 14:44:03 | Event Command 'wrapper_start': Command line[0] : /usr/sbin/cloudvm-ram-size
      INFO   | wrapper  | 2018/07/12 14:44:03 | Event Command 'wrapper_start': Command line[1] : -J
      INFO   | wrapper  | 2018/07/12 14:44:03 | Event Command 'wrapper_start': Command line[2] : vmware-eam
      INFO   | wrapper  | 2018/07/12 14:44:03 | Event Command 'wrapper_start': Command line[3] : -O
      INFO   | wrapper  | 2018/07/12 14:44:03 | Event Command 'wrapper_start': Command line[4] : /etc/vmware/java/vmware-eam_jvm.conf
      INFO   | wrapper  | 2018/07/12 14:44:03 | Event Command 'wrapper_start': Command launched (pid: 3617), blocking for up to 3600 seconds...
      INFO   | wrapper  | 2018/07/12 14:44:03 | Event Command 'wrapper_start': Command completed with exit code: 0
      INFO   | wrapper  | 2018/07/12 14:44:03 | Event Command 'wrapper_start': Command completed with exit code: 0  Continuing.
      INFO   | wrapper  | 2018/07/12 14:44:03 | Event Command 'jvm_prelaunch': Command line[0] : /opt/vmware/bin/python
      INFO   | wrapper  | 2018/07/12 14:44:03 | Event Command 'jvm_prelaunch': Command line[1] : ../wrapper/bin/update_pnid.py
      INFO   | wrapper  | 2018/07/12 14:44:03 | Event Command 'jvm_prelaunch': Command line[2] :
      INFO   | wrapper  | 2018/07/12 14:44:03 | Event Command 'jvm_prelaunch': Command line[3] :
      INFO   | wrapper  | 2018/07/12 14:44:03 | Event Command 'jvm_prelaunch': Command line[4] :
      INFO   | wrapper  | 2018/07/12 14:44:03 | Event Command 'jvm_prelaunch': Command launched (pid: 3620), blocking for up to 15 seconds...
      INFO   | wrapper  | 2018/07/12 14:44:03 | Event Command 'jvm_prelaunch': Command completed with exit code: 0
      INFO   | wrapper  | 2018/07/12 14:44:03 | Event Command 'jvm_prelaunch': Command completed with exit code: 0  Continuing.
      STATUS | wrapper  | 2018/07/12 14:44:03 | Launching a JVM...
      INFO   | jvm 1    | 2018/07/12 14:44:03 | Picked up JAVA_TOOL_OPTIONS: -Xms32M -Xmx128M
      INFO   | jvm 1    | 2018/07/12 14:44:03 | WrapperManager: Initializing...
      INFO   | jvm 1    | 2018/07/12 14:44:05 | WrapperSimpleApp:
      INFO   | jvm 1    | 2018/07/12 14:44:05 | WrapperSimpleApp Error: Encountered an error running main:
      INFO   | jvm 1    | 2018/07/12 14:44:05 | WrapperSimpleApp Error: org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'stsCertManager' defined in class path resource [eam-server-beans.xml]: Cannot resolve reference to bean 'cmClient' while setting constructor argument; nested exception is org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'cmClient' defined in class path resource [eam-server-beans.xml]: Cannot resolve reference to bean 'vcTrustStore' while setting constructor argument; nested exception is org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'vcTrustStore' defined in class path resource [eam-server-beans.xml]: Instantiation of bean failed; nested exception is org.springframework.beans.factory.BeanDefinitionStoreException: Factory method [public static java.security.KeyStore com.vmware.eam.identity.KeyStoreFactory.createKeyStore(java.lang.String,java.io.File,java.lang.String,java.lang.String)] threw exception; nested exception is com.vmware.eam.EamException: Unsupported keystore type: VKS
      INFO   | jvm 1    | 2018/07/12 14:44:05 | WrapperSimpleApp Error:       at org.springframework.beans.factory.support.BeanDefinitionValueResolver.resolveReference(BeanDefinitionValueResolver.java:275)
      INFO   | jvm 1    | 2018/07/12 14:44:05 | WrapperSimpleApp Error:       at org.springframework.beans.factory.support.BeanDefinitionValueResolver.resolveValueIfNecessary(BeanDefinitionValueResolver.java:104)
      INFO   | jvm 1    | 2018/07/12 14:44:05 | WrapperSimpleApp Error:       at org.springframework.beans.factory.support.ConstructorResolver.resolveConstructorArguments(ConstructorResolver.java:474)
      INFO   | jvm 1    | 2018/07/12 14:44:05 | WrapperSimpleApp Error:       at org.springframework.beans.factory.support.ConstructorResolver.instantiateUsingFactoryMethod(ConstructorResolver.java:342)
      INFO   | jvm 1    | 2018/07/12 14:44:05 | WrapperSimpleApp Error:       at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.instantiateUsingFactoryMethod(AbstractAutowireCapableBeanFactory.java:901)
      INFO   | jvm 1    | 2018/07/12 14:44:05 | WrapperSimpleApp Error:       at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBeanInstance(AbstractAutowireCapableBeanFactory.java:815)
      INFO   | jvm 1    | 2018/07/12 14:44:05 | WrapperSimpleApp Error:       at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.doCreateBean(AbstractAutowireCapableBeanFactory.java:440)
      INFO   | jvm 1    | 2018/07/12 14:44:05 | WrapperSimpleApp Error:       at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory$1.run(AbstractAutowireCapableBeanFactory.java:409)
      INFO   | jvm 1    | 2018/07/12 14:44:05 | WrapperSimpleApp Error:       at java.security.AccessController.doPrivileged(Native Method)
      INFO   | jvm 1    | 2018/07/12 14:44:05 | WrapperSimpleApp Error:       at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:380)
      INFO   | jvm 1    | 2018/07/12 14:44:05 | WrapperSimpleApp Error:       at org.springframework.beans.factory.support.AbstractBeanFactory$1.getObject(AbstractBeanFactory.java:264)
      INFO   | jvm 1    | 2018/07/12 14:44:05 | WrapperSimpleApp Error:       at org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:220)
      INFO   | jvm 1    | 2018/07/12 14:44:05 | WrapperSimpleApp Error:       at org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:261)
      INFO   | jvm 1    | 2018/07/12 14:44:05 | WrapperSimpleApp Error:       at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:185)
      INFO   | jvm 1    | 2018/07/12 14:44:05 | WrapperSimpleApp Error:       at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:164)
      INFO   | jvm 1    | 2018/07/12 14:44:05 | WrapperSimpleApp Error:       at org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:254)
      INFO   | jvm 1    | 2018/07/12 14:44:05 | WrapperSimpleApp Error:       at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:185)
      INFO   | jvm 1    | 2018/07/12 14:44:05 | WrapperSimpleApp Error:       at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:164)
      INFO   | jvm 1    | 2018/07/12 14:44:05 | WrapperSimpleApp Error:       at org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:254)
      INFO   | jvm 1    | 2018/07/12 14:44:05 | WrapperSimpleApp Error:       at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:185)
      INFO   | jvm 1    | 2018/07/12 14:44:05 | WrapperSimpleApp Error:       at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:164)
      INFO   | jvm 1    | 2018/07/12 14:44:05 | WrapperSimpleApp Error:       at org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:254)
      INFO   | jvm 1    | 2018/07/12 14:44:05 | WrapperSimpleApp Error:       at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:185)
      INFO   | jvm 1    | 2018/07/12 14:44:05 | WrapperSimpleApp Error:       at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:164)
      INFO   | jvm 1    | 2018/07/12 14:44:05 | WrapperSimpleApp Error:       at org.springframework.beans.factory.support.DefaultListableBeanFactory.preInstantiateSingletons(DefaultListableBeanFactory.java:429)
      INFO   | jvm 1    | 2018/07/12 14:44:05 | WrapperSimpleApp Error:       at org.springframework.context.support.AbstractApplicationContext.finishBeanFactoryInitialization(AbstractApplicationContext.java:729)
      INFO   | jvm 1    | 2018/07/12 14:44:05 | WrapperSimpleApp Error:       at org.springframework.context.support.AbstractApplicationContext.refresh(AbstractApplicationContext.java:381)
      INFO   | jvm 1    | 2018/07/12 14:44:05 | WrapperSimpleApp Error:       at org.springframework.context.support.ClassPathXmlApplicationContext.<init>(ClassPathXmlApplicationContext.java:139)
      INFO   | jvm 1    | 2018/07/12 14:44:05 | WrapperSimpleApp Error:       at org.springframework.context.support.ClassPathXmlApplicationContext.<init>(ClassPathXmlApplicationContext.java:83)
      INFO   | jvm 1    | 2018/07/12 14:44:05 | WrapperSimpleApp Error:       at com.vmware.eam.util.Main.main(Main.java:50)
      INFO   | jvm 1    | 2018/07/12 14:44:05 | WrapperSimpleApp Error:       at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
      INFO   | jvm 1    | 2018/07/12 14:44:05 | WrapperSimpleApp Error:       at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source)
      INFO   | jvm 1    | 2018/07/12 14:44:05 | WrapperSimpleApp Error:       at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source)
      INFO   | jvm 1    | 2018/07/12 14:44:05 | WrapperSimpleApp Error:       at java.lang.reflect.Method.invoke(Unknown Source)
      INFO   | jvm 1    | 2018/07/12 14:44:05 | WrapperSimpleApp Error:       at org.tanukisoftware.wrapper.WrapperSimpleApp.run(WrapperSimpleApp.java:290)
      INFO   | jvm 1    | 2018/07/12 14:44:05 | WrapperSimpleApp Error:       at java.lang.Thread.run(Unknown Source)
      INFO   | jvm 1    | 2018/07/12 14:44:05 | WrapperSimpleApp Error: Caused by: org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'cmClient' defined in class path resource [eam-server-beans.xml]: Cannot resolve reference to bean 'vcTrustStore' while setting constructor argument; nested exception is org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'vcTrustStore' defined in class path resource [eam-server-beans.xml]: Instantiation of bean failed; nested exception is org.springframework.beans.factory.BeanDefinitionStoreException: Factory method [public static java.security.KeyStore com.vmware.eam.identity.KeyStoreFactory.createKeyStore(java.lang.String,java.io.File,java.lang.String,java.lang.String)] threw exception; nested exception is com.vmware.eam.EamException: Unsupported keystore type: VKS
      INFO   | jvm 1    | 2018/07/12 14:44:05 | WrapperSimpleApp Error:       at org.springframework.beans.factory.support.BeanDefinitionValueResolver.resolveReference(BeanDefinitionValueResolver.java:275)
      INFO   | jvm 1    | 2018/07/12 14:44:05 | WrapperSimpleApp Error:       at org.springframework.beans.factory.support.BeanDefinitionValueResolver.resolveValueIfNecessary(BeanDefinitionValueResolver.java:104)
      INFO   | jvm 1    | 2018/07/12 14:44:05 | WrapperSimpleApp Error:       at org.springframework.beans.factory.support.ConstructorResolver.resolveConstructorArguments(ConstructorResolver.java:474)
      INFO   | jvm 1    | 2018/07/12 14:44:05 | WrapperSimpleApp Error:       at org.springframework.beans.factory.support.ConstructorResolver.instantiateUsingFactoryMethod(ConstructorResolver.java:342)
      INFO   | jvm 1    | 2018/07/12 14:44:05 | WrapperSimpleApp Error:       at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.instantiateUsingFactoryMethod(AbstractAutowireCapableBeanFactory.java:901)
      INFO   | jvm 1    | 2018/07/12 14:44:05 | WrapperSimpleApp Error:       at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBeanInstance(AbstractAutowireCapableBeanFactory.java:815)
      INFO   | jvm 1    | 2018/07/12 14:44:05 | WrapperSimpleApp Error:       at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.doCreateBean(AbstractAutowireCapableBeanFactory.java:440)
      INFO   | jvm 1    | 2018/07/12 14:44:05 | WrapperSimpleApp Error:       at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory$1.run(AbstractAutowireCapableBeanFactory.java:409)
      INFO   | jvm 1    | 2018/07/12 14:44:05 | WrapperSimpleApp Error:       at java.security.AccessController.doPrivileged(Native Method)
      INFO   | jvm 1    | 2018/07/12 14:44:05 | WrapperSimpleApp Error:       at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:380)
      INFO   | jvm 1    | 2018/07/12 14:44:05 | WrapperSimpleApp Error:       at org.springframework.beans.factory.support.AbstractBeanFactory$1.getObject(AbstractBeanFactory.java:264)
      INFO   | jvm 1    | 2018/07/12 14:44:05 | WrapperSimpleApp Error:       at org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:220)
      INFO   | jvm 1    | 2018/07/12 14:44:05 | WrapperSimpleApp Error:       at org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:261)
      INFO   | jvm 1    | 2018/07/12 14:44:05 | WrapperSimpleApp Error:       at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:185)
      INFO   | jvm 1    | 2018/07/12 14:44:05 | WrapperSimpleApp Error:       at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:164)
      INFO   | jvm 1    | 2018/07/12 14:44:05 | WrapperSimpleApp Error:       at org.springframework.beans.factory.support.BeanDefinitionValueResolver.resolveReference(BeanDefinitionValueResolver.java:269)
      INFO   | jvm 1    | 2018/07/12 14:44:05 | WrapperSimpleApp Error:       ... 35 more
      INFO   | jvm 1    | 2018/07/12 14:44:05 | WrapperSimpleApp Error: Caused by: org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'vcTrustStore' defined in class path resource [eam-server-beans.xml]: Instantiation of bean failed; nested exception is org.springframework.beans.factory.BeanDefinitionStoreException: Factory method [public static java.security.KeyStore com.vmware.eam.identity.KeyStoreFactory.createKeyStore(java.lang.String,java.io.File,java.lang.String,java.lang.String)] threw exception; nested exception is com.vmware.eam.EamException: Unsupported keystore type: VKS
      INFO   | jvm 1    | 2018/07/12 14:44:05 | WrapperSimpleApp Error:       at org.springframework.beans.factory.support.ConstructorResolver.instantiateUsingFactoryMethod(ConstructorResolver.java:423)
      INFO   | jvm 1    | 2018/07/12 14:44:05 | WrapperSimpleApp Error:       at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.instantiateUsingFactoryMethod(AbstractAutowireCapableBeanFactory.java:901)
      INFO   | jvm 1    | 2018/07/12 14:44:05 | WrapperSimpleApp Error:       at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBeanInstance(AbstractAutowireCapableBeanFactory.java:815)
      INFO   | jvm 1    | 2018/07/12 14:44:05 | WrapperSimpleApp Error:       at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.doCreateBean(AbstractAutowireCapableBeanFactory.java:440)
      INFO   | jvm 1    | 2018/07/12 14:44:05 | WrapperSimpleApp Error:       at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory$1.run(AbstractAutowireCapableBeanFactory.java:409)
      INFO   | jvm 1    | 2018/07/12 14:44:05 | WrapperSimpleApp Error:       at java.security.AccessController.doPrivileged(Native Method)
      INFO   | jvm 1    | 2018/07/12 14:44:05 | WrapperSimpleApp Error:       at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:380)
      INFO   | jvm 1    | 2018/07/12 14:44:05 | WrapperSimpleApp Error:       at org.springframework.beans.factory.support.AbstractBeanFactory$1.getObject(AbstractBeanFactory.java:264)
      INFO   | jvm 1    | 2018/07/12 14:44:05 | WrapperSimpleApp Error:       at org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:220)
      INFO   | jvm 1    | 2018/07/12 14:44:05 | WrapperSimpleApp Error:       at org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:261)
      INFO   | jvm 1    | 2018/07/12 14:44:05 | WrapperSimpleApp Error:       at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:185)
      INFO   | jvm 1    | 2018/07/12 14:44:05 | WrapperSimpleApp Error:       at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:164)
      INFO   | jvm 1    | 2018/07/12 14:44:05 | WrapperSimpleApp Error:       at org.springframework.beans.factory.support.BeanDefinitionValueResolver.resolveReference(BeanDefinitionValueResolver.java:269)
      INFO   | jvm 1    | 2018/07/12 14:44:05 | WrapperSimpleApp Error:       ... 50 more
      INFO   | jvm 1    | 2018/07/12 14:44:05 | WrapperSimpleApp Error: Caused by: org.springframework.beans.factory.BeanDefinitionStoreException: Factory method [public static java.security.KeyStore com.vmware.eam.identity.KeyStoreFactory.createKeyStore(java.lang.String,java.io.File,java.lang.String,java.lang.String)] threw exception; nested exception is com.vmware.eam.EamException: Unsupported keystore type: VKS
      INFO   | jvm 1    | 2018/07/12 14:44:05 | WrapperSimpleApp Error:       at org.springframework.beans.factory.support.SimpleInstantiationStrategy.instantiate(SimpleInstantiationStrategy.java:127)
      INFO   | jvm 1    | 2018/07/12 14:44:05 | WrapperSimpleApp Error:       at org.springframework.beans.factory.support.ConstructorResolver.instantiateUsingFactoryMethod(ConstructorResolver.java:414)
      INFO   | jvm 1    | 2018/07/12 14:44:05 | WrapperSimpleApp Error:       ... 62 more
      INFO   | jvm 1    | 2018/07/12 14:44:05 | WrapperSimpleApp Error: Caused by: com.vmware.eam.EamException: Unsupported keystore type: VKS
      INFO   | jvm 1    | 2018/07/12 14:44:05 | WrapperSimpleApp Error:       at com.vmware.eam.identity.KeyStoreFactory.createKeyStore(KeyStoreFactory.java:48)
      INFO   | jvm 1    | 2018/07/12 14:44:05 | WrapperSimpleApp Error:       at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
      INFO   | jvm 1    | 2018/07/12 14:44:05 | WrapperSimpleApp Error:       at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source)
      INFO   | jvm 1    | 2018/07/12 14:44:05 | WrapperSimpleApp Error:       at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source)
      INFO   | jvm 1    | 2018/07/12 14:44:05 | WrapperSimpleApp Error:       at java.lang.reflect.Method.invoke(Unknown Source)
      INFO   | jvm 1    | 2018/07/12 14:44:05 | WrapperSimpleApp Error:       at org.springframework.beans.factory.support.SimpleInstantiationStrategy.instantiate(SimpleInstantiationStrategy.java:115)
      INFO   | jvm 1    | 2018/07/12 14:44:05 | WrapperSimpleApp Error:       ... 63 more
      STATUS | wrapper  | 2018/07/12 14:44:07 | <-- Wrapper Stopped
      
      

       

      And this is /var/log/vmware/eam/eam.log

      2018-07-12T14:44:04.322Z |  INFO | WrapperSimpleAppMain | Main.java | 47 | Initializing Spring from 'standalone.xml' and 'eam.properties'
      2018-07-12T14:44:04.365Z |  INFO | WrapperSimpleAppMain | AbstractApplicationContext.java | 412 | Refreshing org.springframework.context.support.ClassPathXmlApplicationContext@8461829: display name [org.springframework.context.support.ClassPathXmlApplicationContext@8461829]; startup date [Thu Jul 12 14:44:04 UTC 2018]; root of context hierarchy
      2018-07-12T14:44:04.487Z |  INFO | WrapperSimpleAppMain | XmlBeanDefinitionReader.java | 323 | Loading XML bean definitions from class path resource [standalone.xml]
      2018-07-12T14:44:04.638Z |  INFO | WrapperSimpleAppMain | XmlBeanDefinitionReader.java | 323 | Loading XML bean definitions from class path resource [eam-server-beans.xml]
      2018-07-12T14:44:04.780Z |  INFO | WrapperSimpleAppMain | AbstractApplicationContext.java | 427 | Bean factory for application context [org.springframework.context.support.ClassPathXmlApplicationContext@8461829]: org.springframework.beans.factory.support.DefaultListableBeanFactory@8e89bed
      2018-07-12T14:44:04.949Z |  INFO | WrapperSimpleAppMain | PropertiesLoaderSupport.java | 178 | Loading properties file from class path resource [eam.properties]
      2018-07-12T14:44:05.014Z |  INFO | WrapperSimpleAppMain | DefaultListableBeanFactory.java | 414 | Pre-instantiating singletons in org.springframework.beans.factory.support.DefaultListableBeanFactory@8e89bed: defining beans [org.springframework.beans.factory.config.PropertyPlaceholderConfigurer#0,commonMapStore,vibServices,esxAgentMgr,vcTrustStore,eamKeyStore,eamKeyAccess,vimAndVumConnectionExecutor,vpxdConnection,vumConnection,vcOptions,serverAddr,serverAddrDepr,serverUrl,serverUrlDepr,vcListener,l10n,httpNfcLeaseTimeoutHandler,nameManager,vcDatastoreManager,vcEventManager,vcKeyValueStore,messageSource,vibServer,vibServerDepr,vibPackageDepot,vibPackageDepotDepr,secureHostsStartVersion,vibPackageDepots,vcInventory,springContext,scanForUnknownAgentVms,cmClient,stsCertManager,scheduler,heathStatusTaskScheduler,vmodlContext,versionFinder,clientAuthConnectionExecutor,clientAuthConnection,clientAuthenticator,localizationFilter,firstMobStep,mobConnectionExecutor,mobConnection,mobAuthenticator,localClient,localCorrelator,localFilterStartStep,localCompletionStep,sessionManager,dispatcher,adapterServer,eamVersion,bodyHandler,eamVersion2,bodyHandlerVersion2,eamVersion2_5,bodyHandlerVersion2_5,eamVersion3,bodyHandlerVersion3,eamVersion6,bodyHandlerVersion6,internalEamVersion1,internalBodyHandlerVersion1,internalEamVersion2,internalBodyHandlerVersion2,internalEamVersion2_5,internalBodyHandlerVersion2_5,internalEamVersion3,internalBodyHandlerVersion3,internalEamVersion6,internalBodyHandlerVersion6,httpResponseCorrelator,firstStep,validationStartStep,completionStep,filterStartStep,invocationStep,continuerStep,rejectedHandler,executor,httpServerEndpoint,listener,mob,jspServlet,fileServlet,health,log4j,managementUi,cmHealthServlet,cmResourceBundleServlet,vmomiService,mobService,jspService,filesService,healthService,managementService,vibService,vibdService,cmHealthService,cmResourceBundleService,logConfiguratorManualFilter,logConfiguratorAutoFilter,httpServer]; root of factory hierarchy
      2018-07-12T14:44:05.026Z |  INFO | WrapperSimpleAppMain | DefaultSingletonBeanRegistry.java | 396 | Destroying singletons in org.springframework.beans.factory.support.DefaultListableBeanFactory@8e89bed: defining beans [org.springframework.beans.factory.config.PropertyPlaceholderConfigurer#0,commonMapStore,vibServices,esxAgentMgr,vcTrustStore,eamKeyStore,eamKeyAccess,vimAndVumConnectionExecutor,vpxdConnection,vumConnection,vcOptions,serverAddr,serverAddrDepr,serverUrl,serverUrlDepr,vcListener,l10n,httpNfcLeaseTimeoutHandler,nameManager,vcDatastoreManager,vcEventManager,vcKeyValueStore,messageSource,vibServer,vibServerDepr,vibPackageDepot,vibPackageDepotDepr,secureHostsStartVersion,vibPackageDepots,vcInventory,springContext,scanForUnknownAgentVms,cmClient,stsCertManager,scheduler,heathStatusTaskScheduler,vmodlContext,versionFinder,clientAuthConnectionExecutor,clientAuthConnection,clientAuthenticator,localizationFilter,firstMobStep,mobConnectionExecutor,mobConnection,mobAuthenticator,localClient,localCorrelator,localFilterStartStep,localCompletionStep,sessionManager,dispatcher,adapterServer,eamVersion,bodyHandler,eamVersion2,bodyHandlerVersion2,eamVersion2_5,bodyHandlerVersion2_5,eamVersion3,bodyHandlerVersion3,eamVersion6,bodyHandlerVersion6,internalEamVersion1,internalBodyHandlerVersion1,internalEamVersion2,internalBodyHandlerVersion2,internalEamVersion2_5,internalBodyHandlerVersion2_5,internalEamVersion3,internalBodyHandlerVersion3,internalEamVersion6,internalBodyHandlerVersion6,httpResponseCorrelator,firstStep,validationStartStep,completionStep,filterStartStep,invocationStep,continuerStep,rejectedHandler,executor,httpServerEndpoint,listener,mob,jspServlet,fileServlet,health,log4j,managementUi,cmHealthServlet,cmResourceBundleServlet,vmomiService,mobService,jspService,filesService,healthService,managementService,vibService,vibdService,cmHealthService,cmResourceBundleService,logConfiguratorManualFilter,logConfiguratorAutoFilter,httpServer]; root of factory hierarchy
      

       

       

       

      Hope somebody can help

        • 1. Re: VCSA 6.0u2 - vmware-eam fails to start
          msripada Expert
          vExpert

          check if the file /etc/vmware-eam/eam.properties is empty or corrupted.

           

          If you have other VCSA , you can copy it but need to modify that file. Can you check the vmware-eam properties file is empty by any chance? I will guide you for other steps

           

          thanks,

          MS

          • 2. Re: VCSA 6.0u2 - vmware-eam fails to start
            rbetelli Lurker

            I first found it empty but, as stated in the first post, I rebuilt it.

            I post it here just to be sure

            #########################################################################
            # Copyright 2013-2017 VMware, Inc.  All rights reserved. VMware Confidential
            #########################################################################
            vc.proxy.host=localhost
            vc.proxy.port=80
            # Hostname or IP of the EAM server
            # Fill only if EAM is not running on the same host as VC
            eam.host=
            # EAM service port used to configure the HTTP connector of the application server.
            eam.int.http.port=15005
            # Port and scheme configuration which is used by the ESX 6.x hosts to reach EAM Vib
            # file server.
            eam.ext.port=443
            eam.ext.scheme=https
            # Port and scheme configuration which is used by the ESX 5.x hosts to reach EAM Vib
            # file server.
            eam.ext.port.deprecated=80
            eam.ext.scheme.deprecated=http
            eam.support_linked_clone=true
            eam.clear_db_on_startup=false
            eam.debug_ref_count=false
            eam.recent_event_size=20
            # Enable/disable VUM integration
            vum.integration=true
            # Value is specified in minutes (set to 24h = 1440m)
            eam.scan_for_unknown_agent_vms=1440
            # The timeout to wait for hostd to restart on a host (set to 5m=300s)
            eam.hostd_restart_timeout=300
            # The following entries will be added verbatim to the advanced options
            # of hosts on which EAM is enabled. All are optional.
            Net.DVFilterBindIpAddress=169.254.0.1
            Net.TrafficFilterIpAddress=
            #The IP for the VSWIF NIC on the dvFilter switch (for ESX classic).
            Net.DVFilterVswifIpAddress=169.254.0.2
            # Resource bundle configuration
            eam.resourcebundle.filename=eam-resourcebundle.jar
            # VLSI embedded tcServer configuration
            #
            tcserver.tmp.dir=/var/tmp/vmware/eam/tomcat
            eam.web.root=/usr/lib/vmware-eam/web
            # EAM SSL configuration
            #
            eam.keystore.type=VKS
            eam.key.alias=vpxd-extension
            eam.keystore.storename=vpxd-extension
            # CM configuration
            #
            cm.url=http://localhost:18090/cm/sdk/?hostid=a3ee74ca-c843-4edb-a202-facebe356cb4
            cm.wait.attempts=360
            cm.wait.intervalSeconds=5
            # SSO configuration
            #
            sso.wait.attempts=360
            sso.wait.intervalSeconds=5
            # VC SSL configuration
            #
            vc.truststore.type=VKS
            vc.truststore.storename=TRUSTED_ROOTS
            vc.tunnelSdkUri.template=https://##{VC_HOST_NAME}##:8089/sdk/vimService
            vc.tunnelSdkUri=https://vcenter001.RestOfTheFQDN:8089/sdk/vimService
            drs.demandCapacityRatio=100
            
            
            • 3. Re: VCSA 6.0u2 - vmware-eam fails to start
              msripada Expert
              vExpert

              sent a PM to you. Please check that and let me know the status

              • 4. Re: VCSA 6.0u2 - vmware-eam fails to start
                rbetelli Lurker

                I finally managed to solve this: eam.properties was filled with whitespaces (something like 2 spaces at the end of each line), probably because of the copy/paste from webpages.

                Whitespaces removed, vmware-eam started, vCenter available again.

                 

                Thanks for the help.