VMware Cloud Community
prburkis
Contributor
Contributor

vCloud Hierarchy stopped syncing again....

Hi Guys,

Can anyone help shed some light on this. Our Chargeback setup has stopped syncing the vCloud Hierarchy again. I've worked with this product extensively for about 2 years now and have dug around under the hood a lot.

Before I log a support request, I thought I'd see if anyone had any ideas. I've upgraded to VCB 2.6 to see if that would help...

Basically, my main problem seems to be that the vCloud hierarchy sync isn't working. Therefore, it's trying to process events for servers that don't exist in any of its hierarchies. As a result, this means that every day we're losing machines to this, and therefore revenue. This problem seemed to appear on Sunday 13th and since then, there have been approx 350vm's deployed on the platform which I am currently unable to collect billing data for.

By the looks of things everything else seems to be working. I've looked through all of the logs.

Does anyone know how to force or at least monitor the hierarchy sync?

Cheers

Reply
0 Kudos
1 Reply
prburkis
Contributor
Contributor

One of the errors I am seeing the in the vCloud collector log is:

014-04-15T17:31:36.707+0100 ERROR [eventProcessorTimer] [jobs.EventProcessorJob] 1524: Chargeback API failed exception caught while running com.vmware.chargeback.integration.vcloud.jobs.EventProcessorJob 

com.vmware.chargeback.integration.commons.exception.ChargebackApiFailedException: Exception while executing the API . Details: POST on url: /vCenter-CB/api/computingResource

  at com.vmware.chargeback.integration.commons.base.ChargebackApiExecutor.throwChargebackApiException(ChargebackApiExecutor.java:108)

  at com.vmware.chargeback.integration.commons.base.ChargebackApiExecutor.executeRequestBody(ChargebackApiExecutor.java:178)

  at com.vmware.chargeback.integration.commons.base.ChargebackApiExecutor.execute(ChargebackApiExecutor.java:137)

  at com.vmware.chargeback.integration.commons.apihandler.ChargebackCostingHandler.addComputingResource(ChargebackCostingHandler.java:326)

  at com.vmware.chargeback.integration.commons.apihandler.ChargebackCostingHandler$$FastClassByCGLIB$$c6fd6248.invoke(<generated>)

  at net.sf.cglib.proxy.MethodProxy.invoke(MethodProxy.java:149)

  at org.springframework.aop.framework.Cglib2AopProxy$CglibMethodInvocation.invokeJoinpoint(Cglib2AopProxy.java:700)

  at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:149)

  at org.springframework.aop.aspectj.MethodInvocationProceedingJoinPoint.proceed(MethodInvocationProceedingJoinPoint.java:77)

  at com.vmware.chargeback.integration.commons.apihandler.ChargebackSessionTimeoutAspect.monitorSessionTimeOut(ChargebackSessionTimeoutAspect.java:48)

  at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)

  at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source)

  at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source)

  at java.lang.reflect.Method.invoke(Unknown Source)

  at org.springframework.aop.aspectj.AbstractAspectJAdvice.invokeAdviceMethodWithGivenArgs(AbstractAspectJAdvice.java:627)

  at org.springframework.aop.aspectj.AbstractAspectJAdvice.invokeAdviceMethod(AbstractAspectJAdvice.java:616)

  at org.springframework.aop.aspectj.AspectJAroundAdvice.invoke(AspectJAroundAdvice.java:64)

  at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:171)

  at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:90)

  at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:171)

  at org.springframework.aop.framework.Cglib2AopProxy$DynamicAdvisedInterceptor.intercept(Cglib2AopProxy.java:635)

  at com.vmware.chargeback.integration.commons.apihandler.ChargebackCostingHandler$$EnhancerByCGLIB$$a5a3fc50.addComputingResource(<generated>)

  at com.vmware.chargeback.integration.commons.utils.CommonUtils.addComputingResource(CommonUtils.java:90)

  at com.vmware.chargeback.integration.commons.utils.CommonUtils.addComputingResource(CommonUtils.java:64)

  at com.vmware.chargeback.integration.vcloud.jobs.JobsHelper.addComputingResource(JobsHelper.java:42)

  at com.vmware.chargeback.integration.vcloud.jobs.JobsHelper.initChargebackResources(JobsHelper.java:313)

  at com.vmware.chargeback.integration.vcloud.jobs.EventProcessorJob.initConfiguration(EventProcessorJob.java:353)

  at com.vmware.chargeback.integration.vcloud.jobs.EventProcessorJob.executeInternal(EventProcessorJob.java:435)

  at com.vmware.chargeback.integration.vcloud.jobs.EventProcessorJob.execute(EventProcessorJob.java:369)

  at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)

  at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source)

  at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source)

  at java.lang.reflect.Method.invoke(Unknown Source)

  at org.springframework.util.MethodInvoker.invoke(MethodInvoker.java:275)

  at org.springframework.scheduling.support.MethodInvokingRunnable.run(MethodInvokingRunnable.java:76)

  at org.springframework.scheduling.timer.DelegatingTimerTask.run(DelegatingTimerTask.java:66)

  at java.util.TimerThread.mainLoop(Unknown Source)

  at java.util.TimerThread.run(Unknown Source)

Caused by: java.net.ConnectException: Connection refused: connect

  at java.net.PlainSocketImpl.socketConnect(Native Method)

  at java.net.PlainSocketImpl.doConnect(Unknown Source)

  at java.net.PlainSocketImpl.connectToAddress(Unknown Source)

  at java.net.PlainSocketImpl.connect(Unknown Source)

  at java.net.SocksSocketImpl.connect(Unknown Source)

  at java.net.Socket.connect(Unknown Source)

  at com.sun.net.ssl.internal.ssl.SSLSocketImpl.connect(Unknown Source)

  at com.sun.net.ssl.internal.ssl.SSLSocketImpl.<init>(Unknown Source)

  at com.sun.net.ssl.internal.ssl.SSLSocketFactoryImpl.createSocket(Unknown Source)

  at com.vmware.chargeback.integration.commons.base.FakeSslCertificateSocketFactory.createSocket(FakeSslCertificateSocketFactory.java:67)

  at org.apache.commons.httpclient.HttpConnection.open(HttpConnection.java:707)

  at org.apache.commons.httpclient.MultiThreadedHttpConnectionManager$HttpConnectionAdapter.open(MultiThreadedHttpConnectionManager.java:1361)

  at org.apache.commons.httpclient.HttpMethodDirector.executeWithRetry(HttpMethodDirector.java:387)

  at org.apache.commons.httpclient.HttpMethodDirector.executeMethod(HttpMethodDirector.java:171)

  at org.apache.commons.httpclient.HttpClient.executeMethod(HttpClient.java:397)

  at org.apache.commons.httpclient.HttpClient.executeMethod(HttpClient.java:323)

  at com.vmware.chargeback.integration.commons.base.RestApiExecutor.execute(RestApiExecutor.java:216)

  at com.vmware.chargeback.integration.commons.base.RestApiExecutor.execute(RestApiExecutor.java:131)

  at com.vmware.chargeback.integration.commons.base.ChargebackApiExecutor.executeRequestBody(ChargebackApiExecutor.java:167)

  ... 36 more

Reply
0 Kudos