4 Hosts in Cluster running at 100 %

[marvinms]

I have 4 Dell 6850's in a Cluster that for some reason all the hosts just spiked to close to 100% CPU utilization each around the same time.

None of the VM's show any sign of duress, just the hosts.

Is it ESXTOP that will give me a clue to what may be causing this, and what do I look for?

Thanks,

[RParker]

Is it ESXTOP that will give me a clue to what may be causing this, and what do I look for?

Yes that will work. Look for 'console' process, or any process that is 100%. Post a screen shot of esxtop so we can help you identify.

[marvinms]

Ever have one of those days were things don't go right, well the screen print from xp is on the fritz, and the paste from the putty session is mis-aligned.

Things seem to be calming down now, \

login as: vmadmin

vmadmin@CITESX1's password:

Last login: Thu Jul 2 17:10:23 2009 from 10.6.57.55

vmadmin@citesx1 vmadmin$ su -

Password:

root@citesx1 root# esxtop

5:50:30pm up 82 days 14 min, 120 worlds; CPU load average: 1.03, 1.04, 1.20

PCPU(%): 100.00, 88.60, 87.58, 87.94 ; used total: 91.03

LCPU(%): 90.52, 14.64, 49.20, 39.40, 52.55, 35.03, 57.48, 30.46

CCPU(%): 49 us, 51 sy, 0 id, 0 wa ; cs/sec: 515

ID GID NAME NWLD %USED %RUN %SYS %WAIT %RDY %IDLE %O

1 1 idle 8 59.17 270.87 0.00 0.00 400.00 0.00

2 2 system 6 0.02 0.04 0.01 600.00 0.01 0.00

6 6 helper 23 0.09 0.14 0.00 2300.00 0.52 0.00

7 7 drivers 13 0.01 0.01 0.00 1300.00 0.00 0.00

8 8 vmotion 1 0.00 0.00 0.00 100.00 0.00 0.00

9 9 console 1 68.49 72.55 0.03 0.00 34.38 0.00

20 20 vmware-vmkauthd 1 0.00 0.00 0.00 100.00 0.00 0.00

22 22 CITYAPPS 5 8.72 9.61 0.00 500.00 8.36 93.12

27 27 OHM 5 4.15 5.04 0.01 500.00 5.00 96.08

200 200 MySQLTest 5 4.11 5.95 0.00 500.00 10.87 90.30

476 476 TANK 5 9.40 9.84 0.00 500.00 16.07 87.68

990 990 FPR2 5 14.10 14.98 0.02 500.00 12.41 81.90

1956 1956 FINAPPS 5 11.28 12.09 0.01 500.00 21.40 83.11

2193 2193 CITPRINT 5 47.75 48.83 0.71 446.90 38.78 34.88

2195 2195 CITYAPPS2 5 11.14 11.91 0.03 500.00 13.61 88.70

2201 2201 SPOTLIGHT1 5 13.15 13.64 0.00 499.82 21.16 81.57

2212 2212 RMXWEB 5 13.00 13.76 0.00 500.00 1.63 92.44

2264 2264 CityApps1 5 41.37 43.54 0.25 467.53 23.54 44.59

2481 2481 PM2 5 85.04 87.39 0.00 416.55 30.69 0.00

2549 2549 OOCSQL2 7 32.33 37.08 0.02 683.91 27.34 149.90

Thanks,

[RParker]

Ever have one of those days were things don't go right, well the screen print from xp is on the fritz, and the paste from the putty session is mis-aligned.

OH YEAH! I hear ya. That's why we have this 'community' the 'self help' isn't only technical issues

Did you install 3rd party apps on your ESX host?

What is cityapps and PM2? PM2 appears to be a low level runtime management system.. what are they used for? They shouldn't be on ESX, ESX should only be to host VM's not run 3rd party software, that may be part of the issue. Whatever is causing them to respond and spike is what is causing your ESX hosts CPU to spike.

[athlon_crazy]

Those %RDY on few of your VMs quite high. Do you set any cpu reservation on those VMs?

vcbMC-1.0.6 Beta

vcbMC-1.0.7 Lite