vCloud usage meter failing to obtain data from vCenter server

[mjha]

Hi All

I have vCloud usage meter 3.2 deployed in our environment and it has been configured to monitor vCenter server 5.0 and 4.1. Since last few days this vCloud appliance is unable to contact one of my vCenter server and kept failing with below errors:

A collection from x.x.x.x, begun at 2015-01-16 20:18:58, failed at 2015-01-16 20:19:10. com.sun.xml.internal.ws.client.ClientTransportException: The server sent HTTP status code 503: Service Unavailable

A collection from x.x.x.x, begun at 2015-01-16 20:24:10, failed at 2015-01-16 20:24:20. com.sun.xml.internal.ws.client.ClientTransportException: The server sent HTTP status code 503: Service Unavailable

A collection from x.x.x.x, begun at 2015-01-16 21:18:55, failed at 2015-01-16 21:19:07. com.sun.xml.internal.ws.client.ClientTransportException: The server sent HTTP status code 503: Service Unavailable

A collection from x.x.x.x, begun at 2015-01-17 01:18:38, failed at 2015-01-17 01:18:51. com.sun.xml.internal.ws.client.ClientTransportException: HTTP transport error: java.net.ConnectException: Connection refused

A collection from x.x.x.x, begun at 2015-01-17 01:23:51, failed at 2015-01-17 01:24:05. com.sun.xml.internal.ws.client.ClientTransportException: HTTP transport error: java.net.ConnectException: Connection refused

A collection from x.x.x.x, begun at 2015-01-17 01:29:05, failed at 2015-01-17 01:29:16. com.sun.xml.internal.ws.client.ClientTransportException: HTTP transport error: java.net.ConnectException: Connection refused

A collection from x.x.x.x, begun at 2015-01-17 02:18:40, failed at 2015-01-17 02:18:52. com.sun.xml.internal.ws.client.ClientTransportException: The server sent HTTP status code 503: Service Unavailable

A collection from x.x.x.x, begun at 2015-01-17 03:18:49, failed at 2015-01-17 03:19:01. com.sun.xml.internal.ws.client.ClientTransportException: The server sent HTTP status code 503: Service Unavailable

A collection from x.x.x.x, begun at 2015-01-17 05:18:40, failed at 2015-01-17 05:18:53. com.sun.xml.internal.ws.client.ClientTransportException: HTTP transport error: java.net.ConnectException: Connection refused

A collection from x.x.x.x, begun at 2015-01-17 05:23:53, failed at 2015-01-17 05:24:04. com.sun.xml.internal.ws.client.ClientTransportException: HTTP transport error: java.net.ConnectException: Connection refused

A collection from x.x.x.x, begun at 2015-01-17 05:29:05, failed at 2015-01-17 05:29:16. com.sun.xml.internal.ws.client.ClientTransportException: HTTP transport error: java.net.ConnectException: Connection refused

A collection from x.x.x.x, begun at 2015-01-17 06:18:45, failed at 2015-01-17 06:18:57. com.sun.xml.internal.ws.client.ClientTransportException: HTTP transport error: java.net.ConnectException: Connection refused

Can someone guide me how to start troubleshooting. I don't have much idea of how vCloud works and also Google and vmware kb are not helping much.

[IamTHEvilONE]

sounds like a firewall on the vCenter or between the vCenter and the usage meter appliance.

[mjha]

This issue also got resolved some times back but didn't got chance to share the steps which helped me.

The issue was with my dns entry in /etc/resolv.conf file of the usage meter server. The DNS servers were correctly specified in this file but the search path was missing.

We were adding all our vCenter Servers to usage meter using the FQDN and due to the missing search path usage meter was unable to poll to these vCenter Server.

I added "search xyz.com" to the /etc/resolv.conf file and restarted the network service once and bingo the usage meter start collecting the stats from vCenter server.