VMware Communities > VMTN > VMware vCenter™ > VMware vCenter™ Server > Discussions

This Question is Answered

1 "correct" answer available (10 pts)
8 Replies Last post: Feb 25, 2009 5:32 AM by gregplou
Reply

VC 2.5 - Gaps in Performance Data (Missing Performance Data) for VMs after VMotion Migration

Oct 15, 2008 7:03 AM

Click to view gregplou's profile Novice gregplou 9 posts since
Jan 7, 2008
Greetings,
We have begun to see an odd issue in which the Real-Time Performance Data is missing for 10-20 minutes for VMs after they have been migrated from one ESX Host to another ESX Host. This does not happen after every migration, but it is affecting performance testing that is currently underway since we are not able to get consistent performance data. As I look at the Daily numbers, I also see data missing...gaps in the chart...throughout the day for every VM, even without a migration having occurred. The VMs are running fine...no outages. Has anyone seen this before? Ideas on why it might be happening?

We are running ESX 3.5 with VC 2.5 (build 64192). We have not recently applied any patches to the environment...

Thanks,
Greg

Performance_Data_Gaps.JPG

Reply Re: VC 2.5 - Gaps in Performance Data (Missing Performance Data) for VMs after VMotion Migration Oct 15, 2008 8:34 AM
Click to view kjb007's profile Guru kjb007 5,303 posts since
Sep 18, 2006
Have you validated that all of your ESX hosts and your vc are using the same time source and are sync'd?

-KjB
Reply Re: VC 2.5 - Gaps in Performance Data (Missing Performance Data) for VMs after VMotion Migration Oct 15, 2008 9:14 AM
in response to: kjb007
Click to view gregplou's profile Novice gregplou 9 posts since
Jan 7, 2008
Thank you for the response. The VC and ESX Hosts are synced to the second. Our internal sources are all synced to the same external source.
Greg
Reply Re: VC 2.5 - Gaps in Performance Data (Missing Performance Data) for VMs after VMotion Migration Oct 15, 2008 11:00 AM
in response to: gregplou
Click to view kjb007's profile Guru kjb007 5,303 posts since
Sep 18, 2006
Connect directly to your ESX host using the vi client, and take a look at the performance graphs there. If they don't have the gaps, then you may need to review your SQL mainenance jobs for the statistics rollup. If you have a large database, and are collecting heavy statistics, the jobs may be taking a long time to complete, which may explain some of the gaps, especially if your gaps occur at regular intervals.

-KjB
Reply Re: VC 2.5 - Gaps in Performance Data (Missing Performance Data) for VMs after VMotion Migration Oct 15, 2008 12:00 PM
in response to: kjb007
Click to view gregplou's profile Novice gregplou 9 posts since
Jan 7, 2008
There are no gaps in the performance data when connected directly to an ESX Host. I will have our DBA look at the SQL Jobs and their performance.
Greg
Reply Re: VC 2.5 - Gaps in Performance Data (Missing Performance Data) for VMs after VMotion Migration Oct 16, 2008 10:36 AM
in response to: kjb007
Click to view gregplou's profile Novice gregplou 9 posts since
Jan 7, 2008
We increased the Virtual Center's SQL memory to 6GB, and are still encountering 10+ minutes gaps in the performance data. The performance data on the individual ESX Hosts does not have the gaps. Other thoughts before we open a case with VMWare?
Greg
Reply Re: VC 2.5 - Gaps in Performance Data (Missing Performance Data) for VMs after VMotion Migration Oct 16, 2008 12:09 PM
in response to: gregplou
Click to view kjb007's profile Guru kjb007 5,303 posts since
Sep 18, 2006
Again, look at the stat rollup jobs in SQL. They should be running at a frequency that you may be able to correllate with the gaps. If you have large tables full of statistics, then you may need to adjust / recreate some indexes so the jobs finish quicker. Look at the history and see how long the sql jobs are taking to complete. The SQL agent history should have that information.

Increasing memory may not help if your sql server is still taking a long time to run through those jobs. How many hosts do you have, and what stat level are you collecting?

I think you should still open a case with VMware as it is always more efficient to look over your config directly, rather than the back and forth type of communication over the boards.

-KjB
Reply Re: VC 2.5 - Gaps in Performance Data (Missing Performance Data) for VMs after VMotion Migration Dec 15, 2008 3:14 AM
Click to view KyRoo's profile Novice KyRoo 4 posts since
Aug 11, 2008

Hi All.

I have a similar problem with one of my esx hosts.
But there are gaps on the vc and on the esx. I have cheched the time and that is not the problem.

As far as I know I did not have this problem 4 days ago...

Thanks,
Iwan

Reply Re: VC 2.5 - Gaps in Performance Data (Missing Performance Data) for VMs after VMotion Migration Feb 25, 2009 5:32 AM
in response to: KyRoo
Click to view gregplou's profile Novice gregplou 9 posts since
Jan 7, 2008

I opened a case with VMWare, and there is a known issue that sometimes occurs in which these Performance Data gaps occur. A patch for Virtual Center to correct this issue is being developed (patch 12 according to the VMWare Engineer who worked this case), but has not yet been released.

Greg

Actions