Storage

 View Only
  • 1.  IO Wait State over 96%

    Posted Jan 06, 2009 03:33 PM
      |   view attached

    I have a 6 node cluster with DRS running and 2 ESX hosts are experinceing over 96% iowait. How can I read either a "top" or "esxtop" to determine what process(s) are using up all the CPU cycles? Attcahed is the current process running - any help would be appreciated

    Attachment(s)

    txt
    processJan62008.txt   8 KB 1 version


  • 2.  RE: IO Wait State over 96%

    Posted Jan 06, 2009 03:45 PM

    This might help you...

    KB Article 1003496



  • 3.  RE: IO Wait State over 96%

    Posted Jan 07, 2009 12:51 AM

    Did you read the documents on this community? Any questions on them?

    Scott



  • 4.  RE: IO Wait State over 96%
    Best Answer

    Posted Jan 07, 2009 04:31 PM

    You shouldn't be looking for a process using up CPU cycles, you should be looking for a process or VM doing heavy disk, network, or memory writes. I/O wait is the percentage of CPU cycles spent waiting on something else to occur - usually disk transactions. The following process is a bit odd:

    root 11645 11266 0 2008 ? 00:00:00

    Were you doing something on the service console with vmkfstools? If so, it looks like it may have hung up. Also, you have several copies of the vmbackup script running, along with several defunct crond processes. I'm going to guess your backup routine/script is not working properly, and this is probably at least one of the things contributing to the high I/O wait. Unfortunately, you probably have a process hung on I/O, which are very, very difficult to get rid of. If you're running a cluster, it's time to migrate your VMs over to the other ESX machine and reboot. Then you'll want to spend some time figuring out why your backup script never exits properly.



  • 5.  RE: IO Wait State over 96%

    Posted Jan 07, 2009 07:09 PM

    Thanks to all. There were sevreal hung vmbk processes, killes them and now reworking the backup script. Also the document likes provided are oustanding - thanks