VMware Cloud Community
Kathirvelkrisha
Contributor
Contributor

VM disk Read/Write latency is more then 300ms

Hi,

I am facing latency issue in Particular VM in ESXi 6.0. The VM has Windows server 2012R2 OS. It contains AD user profiles and network share files.

Am facing issue only office working hours. While checking Performance Chart I found Disk read and write latency going more than 300ms.

Anyone tell me what is the normal disk latency? and any idea about this.

10 Replies
RickVerstegen
Expert
Expert

The normal disk latency depends on the workload.

Values that widely being used:

Good: < 10ms
Okay: 10 – 20ms

Anything over 20ms can be considered troublesome.

Some recommendations:

Use Storage VMotion to migrate I/O-intensive virtual machines across multiple hosts.

Check swap statistics in the guest operating system to verify that virtual machines have adequate memory. Increase the guest memory if needed.

Use the most current hypervisor software.

Was I helpful? Give a kudo for appreciation!
Blog: https://rickverstegen84.wordpress.com/
Twitter: https://twitter.com/verstegenrick
Kathirvelkrisha
Contributor
Contributor

Thanks, RickVerstegen

I have tried >Use Storage VMotion to migrate I/O-intensive virtual machines across multiple hosts.

Also, I have checked at the time of issue there is no huge memory utilization.

Check swap statistics in the guest operating system to verify that virtual machines have adequate memory. Increase the guest memory if needed.

Reply
0 Kudos
Kathirvelkrisha
Contributor
Contributor

Sample Image for your reference.

pastedImage_0.png

Reply
0 Kudos
Kathirvelkrisha
Contributor
Contributor

Sample2 Image for your reference,

pastedImage_0.png

Reply
0 Kudos
RickVerstegen
Expert
Expert

Can you provide details about the back-end storage and network that is being used?

Was I helpful? Give a kudo for appreciation!
Blog: https://rickverstegen84.wordpress.com/
Twitter: https://twitter.com/verstegenrick
Reply
0 Kudos
Kathirvelkrisha
Contributor
Contributor

I have created a separate virtual switch for this  VM and directly allocated a physical NIC to that VM. We are using IBM ds3512 ISCSI Storage. 

pastedImage_0.png

Physical NIC :-

pastedImage_1.png

VM NIC:-

pastedImage_2.png

pastedImage_4.png

pastedImage_5.png

Reply
0 Kudos
Dave_the_Wave
Hot Shot
Hot Shot

I had that problem on some HPE DL360 G6's because their old BBWC batteries were finished and disabled the smart array acceleration.

I saw the errors by selecting the Host, Monitor, Events, and got a lot of:

"Device naa.... performance has deteriorated. I/O latency increased from average value of ..."

After they were repaired with home-made cells, a few hours later they were charged up, and everything was as fast as expected.

Reply
0 Kudos
flynmooney
Enthusiast
Enthusiast

ESXTOP can help you identify where the problem is occurring.  https://kb.vmware.com/s/article/1008205 I've used this many times to help see where the problem is occurring.  VM, Host, Storage.  I hope this helps.

depping
Leadership
Leadership

I would recommend to look at ESXTOP first to identify where the issue is occuring:

http://www.yellow-bricks.com/esxtop/

Kathirvelkrisha
Contributor
Contributor

Hi,depping

See the output of esxtop.

pastedImage_9.png

Reply
0 Kudos