VMware Cloud Community
m1kkel84
Contributor
Contributor

Please help a newcommer - new FC san, latency issues.

Hello guys.

Im using you as last resort before i call HP.

Just installed a P2000G3 dual controller FC storage with 24 10K disks.

One brocade silkworm 300 refurbished switch.

Single port HBA in each ESX host (we have 4 in total)

As i understand, FC should be low latency. But we are experincing latency peaks of 200ms in evening hours, where almost no users are loggin into their terminal servers. We have 1 12disk raid10, 64K chunk. 1 12 disk raid50 conigured with 3 4disk raid 5. Chunk 64x3=192 kb.

as said, latency peaks at low hours - is this to be expected?

Testing with iometer in a 60/40 reallife test i get 541 IO/SEC, 4,18MB / sec avg. response on 46 MS and 1304 MS max response time. I dont think 541 IO's is good enough. In a 100% read test we get over 20.000 IO and above 600 MB / SEC, and 3.2 MS/avg wich is awesome. But things have to be balanced, and i cant use 20000 io's for anything if 60/40 is totally crap.

I have upgraded firmware on the hba's. Brocade 815. Using driver version 2.1.1.3 in vmware.

Changed queue depth to 64 on all ESX, aswell as DiskShecNumReqOutstanding to 64 on each esx host.

I have tried Raid5 12 and 16 disks, same problem.

Each HBA is zoned with each host port, so there should be no storms.

got 4 luns on the 12 disk raid50. 678 GB each, with only 2 vm's on each lun.

Maybe something is configured wrong at switch level? I dont know - maybe the spikes are all normal?

Path selection is MRU. Tried Round RObin and Fixed to each controller port. Didnt help either.

See attached screenshots and let me know what you think.

Thanks

0 Kudos
0 Replies