VMware Communities > VMTN > Archives > VMware Infrastructure Archives > ESX Server 2.x - VC 1.x Archives > Discussions
1 2 Previous Next
18 Replies Last post: May 26, 2006 11:34 AM by jasonboche

Virtual Center perfomance collector: black out gaps

Jul 26, 2005 1:39 AM

Click to view PepeVM's profile Expert PepeVM 562 posts since
Jul 6, 2005
Hi all, is it there any issue about VC performance (or rather VM information) collector???

We're experiencing something strange: if I give a look to performance graphs there are some 'holes' in time line as if VC lost connection (something similar) from VM.

Performance pages shows like that:

---- --/
or something similar...

Can be that related to a congestion on VM's NICS/VM's Virtual Switch???

Ops I draw lines ascii style but seems to be not supported...

Message was edited by: PepeVM

Re: Virtual Center perfomance collector: black out gaps Jul 26, 2005 11:00 AM
Click to view John Gibson's profile Expert John Gibson 396 posts since
Nov 3, 2004
I usually see this if there's been a problem with the ESX host or the the VC server.

Are the missing gaps just for one ESX Host, one VM Guest or for all hosts/guests at the same time?

If it's for just one ESX host, then it's probably a host problem, either it diconnected, there was a network outage, check the service console nic speed/full duplex settings are correct. Possibly try restarting the vmware-ccagent.

Just a few initial thoughts.

John
Re: Virtual Center perfomance collector: black out gaps Jul 26, 2005 11:09 AM
in response to: John Gibson
Click to view PepeVM's profile Expert PepeVM 562 posts since
Jul 6, 2005
Hi John,
seems have something to do with more than one esx and more than one vm.

The strange fact is that under same ESX 3 vm has no black outs while other 2 does...
If I look to graph comparison everything appens same time

M
Re: Virtual Center perfomance collector: black out gaps Jul 26, 2005 11:46 AM
in response to: PepeVM
Click to view John Gibson's profile Expert John Gibson 396 posts since
Nov 3, 2004
Has the service console got enough memory allocated to it?

try top/esxtop to see if anything is happening there.
Re: Virtual Center perfomance collector: black out gaps Jul 27, 2005 8:51 AM
in response to: John Gibson
Click to view PepeVM's profile Expert PepeVM 562 posts since
Jul 6, 2005
Yes SC is working properly.
HW has got 32gbyte ram
Re: Virtual Center perfomance collector: black out gaps Jul 27, 2005 3:01 PM
in response to: PepeVM
Click to view mtrouardriolle's profile Enthusiast mtrouardriolle 101 posts since
Nov 11, 2004
I get the same across all 13 host servers and 150 VMs, but only for the smallest timeframe - (1 hour) which is not configured by default. The default minimum timeframe is over 1 day and I added this other shorter timeframe to monitor hosts/VMs on.

I believe that larger timeframes average the smaller ones to get their average - ie if monitoring every minute for an hour, this is averaged out for the hourly entry within a day which is in turn averaged out for the daily over the week and so on...

I don't tend to worry about it too much as the way in which VirtualCenter seems to manage its database, the data won't be there in the next hour anyway and there are no issues looking at other timeframes (the bigger picture of what's been happening over the last week/month).

I don't know if any alerts at the host level in VC (ie CPU %) are affected by this, but I have those configured to alert for any dangerously high usage and I have to date been alerted when the appropriate conditions are met.

There do seem to be a few bugs/inconsistencies with VC (latest version that I'm using), so here's holding out for a significant update!...
Re: Virtual Center perfomance collector: black out gaps Jul 28, 2005 12:47 AM
in response to: mtrouardriolle
Click to view PepeVM's profile Expert PepeVM 562 posts since
Jul 6, 2005
That's what I was thinking of.

Maybe next VC update will fix this. Do you now anything about patch/update release yet to come???
Re: Virtual Center perfomance collector: black out gaps Jul 28, 2005 12:56 AM
in response to: PepeVM
Click to view mtrouardriolle's profile Enthusiast mtrouardriolle 101 posts since
Nov 11, 2004
I've not heard anything definite about any future releases (content/dates/etc..), however i have heard the rumour *unofficially* that the way in which monitoring works may change to the structure more reminiscent to other enterprise management applications, whereby instead of VC (the application) going to an ESX host and checking its condition, it would be the other way round, so that the host notifies VC when it has something to notify on.

I have also segmented each of my ESX host's console NIC on a separate VLAN from a core Cisco switch and put VC on this VLAN, yet I still get these breakages in performance data....

Roll on a future release of ESX/VC!... :)
Re: Virtual Center perfomance collector: black out gaps Jul 28, 2005 3:38 AM
in response to: mtrouardriolle
Click to view PepeVM's profile Expert PepeVM 562 posts since
Jul 6, 2005
Thanks for that experience sharing.
That relly helped me (or quite rassured!!)

M.
Re: Virtual Center perfomance collector: black out gaps Jul 29, 2005 10:54 AM
in response to: mtrouardriolle
Click to view noahj's profile Hot Shot noahj 271 posts since
Oct 28, 2004
My experience has been the same (almost exactly) as mtrouardriolle. I took it a step further though. My VC host was running as a VM and I moved it to a physical box to try to resolve the issue. It seemed to improve things but it still has the gaps in the data, just not as big or as much (sometimes i would be missing an entire hour before wheras now I will only miss up to 20 mins at a time). Truthfully however, the problem seems to be related to upgrading my ESX host version as well as my VC. I cannot pin the issue down however...
Re: Virtual Center perfomance collector: black out gaps Jul 29, 2005 1:23 PM
in response to: noahj
Click to view John Gibson's profile Expert John Gibson 396 posts since
Nov 3, 2004
My VC server runs on a physical blade and sucesfully captures stats from hosts spread across 4 geographically seperate data centers.

I'd be worried that something is wrong somewhere, I don't ever get gaps that are unexplained (the only gaps are due to me taking down a host, or a network failure.
Re: Virtual Center perfomance collector: black out gaps Jul 29, 2005 3:41 PM
in response to: noahj
Click to view PepeVM's profile Expert PepeVM 562 posts since
Jul 6, 2005
We're not running VC under ESX but as phi. machine.

Gaps still remaining even if network throughput is actually reduced for the fact many users are on vacation... continues to sound me so strange.

Seems there is something to do if that issues compares: to clear perf. statistic and force VC to reload ...

I don't actually know if it works but I've read something about that in another forum tread...
Re: Virtual Center perfomance collector: black out gaps Jul 31, 2005 5:09 PM
in response to: PepeVM
Click to view boydd's profile Champion boydd 5,707 posts since
Jun 15, 2004
Moderator
Make sure SQL (if MS SQL) is at SP3a and MDAC is at 2.8. I had similar drops - this seems to have cleared most of them up.

DB
Re: Virtual Center perfomance collector: black out gaps Mar 28, 2006 2:14 PM
in response to: boydd
Click to view benny.hauk's profile Hot Shot benny.hauk 198 posts since
Dec 6, 2004
Oh, so that Access Database I'm still having to compress every week or 2 may be the cause? ;)
Re: Virtual Center perfomance collector: black out gaps Mar 28, 2006 2:46 PM
Click to view jasonboche's profile Champion jasonboche 5,846 posts since
Jan 7, 2004
Moderator
I see this happen when I add "Past Hour" counter which does 1 minute interval collections over a span of 60 collections. Don't know what causes it.
1 2 Previous Next
Actions