1 Reply Latest reply on Apr 15, 2014 9:39 AM by prburkis

    vCloud Hierarchy stopped syncing again....

    prburkis Lurker

      Hi Guys,

       

      Can anyone help shed some light on this. Our Chargeback setup has stopped syncing the vCloud Hierarchy again. I've worked with this product extensively for about 2 years now and have dug around under the hood a lot.

       

      Before I log a support request, I thought I'd see if anyone had any ideas. I've upgraded to VCB 2.6 to see if that would help...

       

      Basically, my main problem seems to be that the vCloud hierarchy sync isn't working. Therefore, it's trying to process events for servers that don't exist in any of its hierarchies. As a result, this means that every day we're losing machines to this, and therefore revenue. This problem seemed to appear on Sunday 13th and since then, there have been approx 350vm's deployed on the platform which I am currently unable to collect billing data for.

       

      By the looks of things everything else seems to be working. I've looked through all of the logs.

       

      Does anyone know how to force or at least monitor the hierarchy sync?

       

      Cheers

        • 1. Re: vCloud Hierarchy stopped syncing again....
          prburkis Lurker

          One of the errors I am seeing the in the vCloud collector log is:

           

          014-04-15T17:31:36.707+0100 ERROR [eventProcessorTimer] [jobs.EventProcessorJob] 1524: Chargeback API failed exception caught while running com.vmware.chargeback.integration.vcloud.jobs.EventProcessorJob 

          com.vmware.chargeback.integration.commons.exception.ChargebackApiFailedException: Exception while executing the API . Details: POST on url: /vCenter-CB/api/computingResource

            at com.vmware.chargeback.integration.commons.base.ChargebackApiExecutor.throwChargebackApiException(ChargebackApiExecutor.java:108)

            at com.vmware.chargeback.integration.commons.base.ChargebackApiExecutor.executeRequestBody(ChargebackApiExecutor.java:178)

            at com.vmware.chargeback.integration.commons.base.ChargebackApiExecutor.execute(ChargebackApiExecutor.java:137)

            at com.vmware.chargeback.integration.commons.apihandler.ChargebackCostingHandler.addComputingResource(ChargebackCostingHandler.java:326)

            at com.vmware.chargeback.integration.commons.apihandler.ChargebackCostingHandler$$FastClassByCGLIB$$c6fd6248.invoke(<generated>)

            at net.sf.cglib.proxy.MethodProxy.invoke(MethodProxy.java:149)

            at org.springframework.aop.framework.Cglib2AopProxy$CglibMethodInvocation.invokeJoinpoint(Cglib2AopProxy.java:700)

            at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:149)

            at org.springframework.aop.aspectj.MethodInvocationProceedingJoinPoint.proceed(MethodInvocationProceedingJoinPoint.java:77)

            at com.vmware.chargeback.integration.commons.apihandler.ChargebackSessionTimeoutAspect.monitorSessionTimeOut(ChargebackSessionTimeoutAspect.java:48)

            at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)

            at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source)

            at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source)

            at java.lang.reflect.Method.invoke(Unknown Source)

            at org.springframework.aop.aspectj.AbstractAspectJAdvice.invokeAdviceMethodWithGivenArgs(AbstractAspectJAdvice.java:627)

            at org.springframework.aop.aspectj.AbstractAspectJAdvice.invokeAdviceMethod(AbstractAspectJAdvice.java:616)

            at org.springframework.aop.aspectj.AspectJAroundAdvice.invoke(AspectJAroundAdvice.java:64)

            at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:171)

            at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:90)

            at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:171)

            at org.springframework.aop.framework.Cglib2AopProxy$DynamicAdvisedInterceptor.intercept(Cglib2AopProxy.java:635)

            at com.vmware.chargeback.integration.commons.apihandler.ChargebackCostingHandler$$EnhancerByCGLIB$$a5a3fc50.addComputingResource(<generated>)

            at com.vmware.chargeback.integration.commons.utils.CommonUtils.addComputingResource(CommonUtils.java:90)

            at com.vmware.chargeback.integration.commons.utils.CommonUtils.addComputingResource(CommonUtils.java:64)

            at com.vmware.chargeback.integration.vcloud.jobs.JobsHelper.addComputingResource(JobsHelper.java:42)

            at com.vmware.chargeback.integration.vcloud.jobs.JobsHelper.initChargebackResources(JobsHelper.java:313)

            at com.vmware.chargeback.integration.vcloud.jobs.EventProcessorJob.initConfiguration(EventProcessorJob.java:353)

            at com.vmware.chargeback.integration.vcloud.jobs.EventProcessorJob.executeInternal(EventProcessorJob.java:435)

            at com.vmware.chargeback.integration.vcloud.jobs.EventProcessorJob.execute(EventProcessorJob.java:369)

            at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)

            at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source)

            at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source)

            at java.lang.reflect.Method.invoke(Unknown Source)

            at org.springframework.util.MethodInvoker.invoke(MethodInvoker.java:275)

            at org.springframework.scheduling.support.MethodInvokingRunnable.run(MethodInvokingRunnable.java:76)

            at org.springframework.scheduling.timer.DelegatingTimerTask.run(DelegatingTimerTask.java:66)

            at java.util.TimerThread.mainLoop(Unknown Source)

            at java.util.TimerThread.run(Unknown Source)

          Caused by: java.net.ConnectException: Connection refused: connect

            at java.net.PlainSocketImpl.socketConnect(Native Method)

            at java.net.PlainSocketImpl.doConnect(Unknown Source)

            at java.net.PlainSocketImpl.connectToAddress(Unknown Source)

            at java.net.PlainSocketImpl.connect(Unknown Source)

            at java.net.SocksSocketImpl.connect(Unknown Source)

            at java.net.Socket.connect(Unknown Source)

            at com.sun.net.ssl.internal.ssl.SSLSocketImpl.connect(Unknown Source)

            at com.sun.net.ssl.internal.ssl.SSLSocketImpl.<init>(Unknown Source)

            at com.sun.net.ssl.internal.ssl.SSLSocketFactoryImpl.createSocket(Unknown Source)

            at com.vmware.chargeback.integration.commons.base.FakeSslCertificateSocketFactory.createSocket(FakeSslCertificateSocketFactory.java:67)

            at org.apache.commons.httpclient.HttpConnection.open(HttpConnection.java:707)

            at org.apache.commons.httpclient.MultiThreadedHttpConnectionManager$HttpConnectionAdapter.open(MultiThreadedHttpConnectionManager.java:1361)

            at org.apache.commons.httpclient.HttpMethodDirector.executeWithRetry(HttpMethodDirector.java:387)

            at org.apache.commons.httpclient.HttpMethodDirector.executeMethod(HttpMethodDirector.java:171)

            at org.apache.commons.httpclient.HttpClient.executeMethod(HttpClient.java:397)

            at org.apache.commons.httpclient.HttpClient.executeMethod(HttpClient.java:323)

            at com.vmware.chargeback.integration.commons.base.RestApiExecutor.execute(RestApiExecutor.java:216)

            at com.vmware.chargeback.integration.commons.base.RestApiExecutor.execute(RestApiExecutor.java:131)

            at com.vmware.chargeback.integration.commons.base.ChargebackApiExecutor.executeRequestBody(ChargebackApiExecutor.java:167)

            ... 36 more