The test is designed to eliminate the cache from the equation.

The test file is supposed to be so large that cache will not matter. But cache will always matte a little, but in real life the 1GB extra cache should do you much good.

Here are my test results, one in a vm with jumbo frames, on in a vm without jumboframes (same host), on a psyhical machine with jumboframs, (all 3 have mpio rr)

I would love to hear what you think of these results, i worry abit about the servers without the jumboframes..

++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
TABLE oF RESULTS
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++

SERVER TYPE: PHYS.
CPU TYPE / NUMBER: CPU / 1, JUMBO FRAMES, MPIO RR
HOST TYPE: Dell PE2950, 4GB RAM; 2x XEON 5335, 2,00 GHz,
STORAGE TYPE / DISK NUMBER / RAID LEVEL: EQL PS5000 x 1 / 14+2 Disks (sata)/ R5

##################################################################################
TEST NAME-------------------Av. Resp. Time ms------Av. IOs/sek-------Av. MB/sek------
##################################################################################

Max Throughput-100%Read........____10,9___..........____5488__.........____171,5_

RealLife-60%Rand-65%Read......____39,4___..........____1107 __........._____13,2_

Max Throughput-50%Read..........____10,1 __.........._____5763_........._____180,1_

Random-8k-70%Read................._____32,7__.........._____1429_........._____11,1__

EXCEPTIONS: CPU Util.-XX%;

########################################################################

++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
TABLE oF RESULTS
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++

SERVER TYPE: VM .
CPU TYPE / NUMBER: VCPU / 1 )NO JUMBO FRAMES, MPIO RR
HOST TYPE: Dell PE2950, 32GB RAM; 2x XEON 5440, 2,83 GHz, DC
STORAGE TYPE / DISK NUMBER / RAID LEVEL:EQL PS5000 x 1 / 14+2 Disks (sata)/ R5

##################################################################################
TEST NAME-------------------Av. Resp. Time ms------Av. IOs/sek-------Av. MB/sek------
##################################################################################

Max Throughput-100%Read........____3,39___..........____1697__.........____53____

RealLife-60%Rand-65%Read......_____22,18_.........._____500__.........____3,9____

Max Throughput-50%Read.........._____4,2___.........._____695__.........____43____

Random-8k-70%Read................._____26,9__.........._____502__.........____3,9___

EXCEPTIONS: CPU Util.-XX%;

##################################################################################

++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
TABLE oF RESULTS
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++

SERVER TYPE: VM.
CPU TYPE / NUMBER: VCPU / 1 ) JUMBO FRAMES, MPIO RR
HOST TYPE: Dell PE2950, 32GB RAM; 2x XEON 5440, 2,83 GHz, DC
STORAGE TYPE / DISK NUMBER / RAID LEVEL:EQL PS5000 x 1 / 14+2 Disks (sata)/ R5

##################################################################################
TEST NAME-------------------Av. Resp. Time ms------Av. IOs/sek-------Av. MB/sek------
##################################################################################

Max Throughput-100%Read........____9,6___..........____5093___.........___159,00_

RealLife-60%Rand-65%Read......____26,6___..........___1678___.........___13,11__

Max Throughput-50%Read.........._____8,5__..........____4454___.........___139,20_

Random-8k-70%Read................._____31,3_..........____1483___.........___11,58____

EXCEPTIONS: CPU Util.-XX%;

##################################################################################

　

both vm`s have the same configuration except for jumbo frames.

Both are on the same 500GB lun, that lun is connected through 2 dedicated GB connections in a vswitch

Both vm`s have 2 nics for iscsi traffic (mpio round robin), each nic is a seperate vswitch which both also have 2 GB connections.

That all is connected to 2 in stack powerconnects 6224.

At the time there was almost no load of the rest of the servers....

I'm trying to obtain some benchmarks on accessing our HP EVA5000 and EVA6000 SAN using IOmeter, could someone please specify what parameters need to be set to get an accurate measurement of throughput on the HBA cards of my ESX & VCB servers ?

on the VCB Server I want to test HBA throughput to the EVA5000 LUN (NTFS) which is also my VMsnapshot staging area.

What do I set for AccessSpecification ?

How long should I run the test for ?

Thanks

TABLE SAMPLE

++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
TABLE oF RESULTS
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++

SERVER TYPE: Phys Windows Server 2003
CPU TYPE / NUMBER: CPU / AMD Opteron 2,4 Ghz / 1 CPU Dual-Core
HOST TYPE: HP BL465c G1, 4GB RAM
SAN Type: HP EVA 4100 / Disks: 4GB FATA 500GB 7200rpm / RAID LEVEL: Raid5 / 12 Disks / Qlogic QMH2462 Fiber

##################################################################################
TEST NAME-------------------Av. Resp. Time ms------Av. IOs/sek-------Av. MB/sek------
##################################################################################

Max Throughput-100%Read........______3____..........__16016___.........___500____

RealLife-60%Rand-65%Read......._____35____..........___1029___........._____8____

Max Throughput-50%Read........._____54____..........____903___.........____28____

Random-8k-70%Read.............._____36____..........___1045___........._____6____

EXCEPTIONS:

##################################################################################

Some results for a straight-out-of-the-box PS6000XV. I'm not sure what to make of this yet. Max throughput numbers are much lower than I've seen in other tests. Performance of R10 and R50 is almost identical. Real & random tests show 20% improvement when going from RAID 6 to RAID 50.


SERVER TYPE: PHYS
CPU TYPE / NUMBER: CPU / 2
HOST TYPE: DL380 G3, 4GB RAM; 2X XEON 3.20 GHZ
STORAGE TYPE / DISK NUMBER / RAID LEVEL: PS6000XV / 14+2 DISK (15K SAS) / R10)
NOTES: 2 NIC, MS iSCSI, no-jumbo, flowcontrol on

##################################################################################
TEST NAME-------------------Av. Resp. Time ms------Av. IOs/sek-------Av. MB/sek------
##################################################################################

Max Throughput-100%Read........___13.60____..........___3788____.........___118____

RealLife-60%Rand-65%Read.......___14.87____..........___3729____.........___29.14__

Max Throughput-50%Read.........___12.75____..........___4529____.........___141____

Random-8k-70%Read..............___15.42____..........___3580____.........___27.97__

EXCEPTIONS: CPU Util.-XX%;

##################################################################################

SERVER TYPE: PHYS
CPU TYPE / NUMBER: CPU / 2
HOST TYPE: DL380 G3, 4GB RAM; 2X XEON 3.20 GHZ
STORAGE TYPE / DISK NUMBER / RAID LEVEL: PS6000XV / 14+2 DISK (15K SAS) / R50)
NOTES: 2 NIC, MS iSCSI, no-jumbo, flowcontrol on

##################################################################################
TEST NAME-------------------Av. Resp. Time ms------Av. IOs/sek-------Av. MB/sek------
##################################################################################

Max Throughput-100%Read........___13.62____..........___3739____.........___117____

RealLife-60%Rand-65%Read.......___14.29____..........___3655____.........___28.55__

Max Throughput-50%Read.........___13.90____..........___4430____.........___138____

Random-8k-70%Read..............___14.78____..........___3724____.........___29.09__

EXCEPTIONS: CPU Util.-XX%;

##################################################################################

SERVER TYPE: PHYS
CPU TYPE / NUMBER: CPU / 2
HOST TYPE: DL380 G3, 4GB RAM; 2X XEON 3.20 GHZ
STORAGE TYPE / DISK NUMBER / RAID LEVEL: PS6000XV / 15+1 DISK (15K SAS) / R6)
NOTES: 2 NIC, MS iSCSI, no-jumbo, flowcontrol on

##################################################################################
TEST NAME-------------------Av. Resp. Time ms------Av. IOs/sek-------Av. MB/sek------
##################################################################################

Max Throughput-100%Read........___14.40____..........___3866____.........___121____

RealLife-60%Rand-65%Read.......___18.10____..........___3059____.........___23.90__

Max Throughput-50%Read.........___13.09____..........___3682____.........___115____

Random-8k-70%Read..............___18.45____..........___3039____.........___23.74__

EXCEPTIONS: CPU Util.-XX%;

##################################################################################

***UPDATE***

Here are the updated results after a few adjustments. The previous tests were ran while RAID Verification was still running.

Some findings from my tests:
flow control slightly decreased sequential throughput
jumbo frames slightly decreased performance while lowering cpu utilization
mpio-rr increased sequential throughput
ntfs 64k block size increased sequential throughput while slightly decreasing random throughput

SERVER TYPE: PHYS
CPU TYPE / NUMBER: CPU / 2
HOST TYPE: DL380 G3, 4GB RAM; 2X XEON 3.20 GHZ
STORAGE TYPE / DISK NUMBER / RAID LEVEL: PS6000XV / 14+2 DISK (15K SAS) / R50)
NOTES: 2 NIC, MS iSCSI, no-jumbo, flowcontrol off, ntfs aligned w/ 64k alloc, mpio-rr

##################################################################################
TEST NAME-------------------Av. Resp. Time ms------Av. IOs/sek-------Av. MB/sek------
##################################################################################

Max Throughput-100%Read........____9.84____..........___5677____.........___177_____

RealLife-60%Rand-65%Read.......___13.20____..........___3712____.........___29.00___

Max Throughput-50%Read.........____8.39____..........___6742____.........___211_____

Random-8k-70%Read..............___13.91____..........___3783____.........___29.55___

EXCEPTIONS: CPU Util.-XX%;

##################################################################################

Here's are report. It seems the RealLife-60%Rand-65%Read is not very good if anybody has comments I would love to hear them.

SERVER TYPE: VM
CPU TYPE / NUMBER: VCPU / 1
HOST TYPE: IBM HS21XM, 32GB RAM; 4x XEON 5300, 2,66 GHz, DC
STORAGE TYPE / DISK NUMBER / RAID LEVEL: Netapp 3140 / 14+2 Disks / Raid6-DP

##################################################################################
TEST NAME---FC ------Av. Resp. Time ms------Av. IOs/sek-------Av. MB/sek------
##################################################################################

Max Throughput-100%Read........____4.1_____..........____12003.6_______.........___375.1_______

RealLife-60%Rand-65%Read......___12.3_______..........___502.0_______.........____3.92______

Max Throughput-50%Read.........._.9_______..........___2514.8_______.........____78.5______

Random-8k-70%Read.................__4.0________..........__769.6________........._6.01________

EXCEPTIONS: CPU Util.-XX%;

###############################################################################

David Strebel

If you find this information useful, please award points for "correct" or "helpful"