VMware Communities > VMTN > Enterprise Strategy & Planning > Discussions
This thread is locked
1 2 3 ... 31 Previous Next
457 Replies Last post: Mar 5, 2009 6:56 AM by oreeh

Open unofficial storage performance thread

Mar 5, 2009 6:56 AM

Click to view christianZ's profile Virtuoso christianZ 2,251 posts since
Apr 21, 2006
Attention!
Since this thread is getting longer and longer, not to mention the load times, Christian and I decided to close this thread and start a new one.

The new thread is available here: New !! Open unofficial storage performance thread

Oliver Reeh
VMware Communities User Moderator


My idea is to create an open thread with uniform tests whereby the results will be all inofficial and w/o any
warranty.

If anybody shouldn't be agreed with some results then he can make own tests and presents
his/her results too.

I hope this way to classify the different systems and give a "neutral" performance comparison.

Additionally I will mention that the performance is one of many aspects to choose the right system.

The others could be e.g.
- costs for storage system and infrastructure, etc.


There are examples of IOMETER Tests:
=====================================

######## TEST NAME: Max Throughput-100%Read
size,% of size,% reads,% random,delay,burst,align,reply
32768,100,100,0,0,1,0,0

######## TEST NAME: RealLife-60%Rand-65%Read
size,% of size,% reads,% random,delay,burst,align,reply
8192,100,65,60,0,1,0,0

######## TEST NAME: Max Throughput-50%Read
size,% of size,% reads,% random,delay,burst,align,reply
32768,100,50,0,0,1,0,0

######## TEST NAME: Random-8k-70%Read
size,% of size,% reads,% random,delay,burst,align,reply
8192,100,70,100,0,1,0,0


The global options are:
=====================================

Worker
Worker 1
Worker type
DISK
Default target settings for worker
Number of outstanding IOs,test connection rate,transactions per connection
64,ENABLED,500
Disk maximum size,starting sector
8000000,0

Run time = 5 min

For testing the disk C is configured and the test file (8000000 sectors) will be created by
first running - you need free space on the disk.

The cache size has direct influence on results. By systems with cache over 2GB the test
file should be increased.

LINK TO IOMETER:
http://sourceforge.net/projects/iometer/

Significant results are: Av. Response time, Av. IOS/sek, Av. MB/s
To mention are: what server (vm or physical), Processor number/type; What storage system, How many disks


Here the config file *.icf
####################################### BEGIN of *.icf

Version 2004.07.30
'TEST SETUP ====================================================================
'Test Description
IO-Test
'Run Time
' hours minutes seconds
0 5 0
'Ramp Up Time (s)
0
'Default Disk Workers to Spawn
NUMBER_OF_CPUS
'Default Network Workers to Spawn
0
'Record Results
ALL
'Worker Cycling
' start step step type
1 5 LINEAR
'Disk Cycling
' start step step type
1 1 LINEAR
'Queue Depth Cycling
' start end step step type
8 128 2 EXPONENTIAL
'Test Type
NORMAL
'END test setup
'RESULTS DISPLAY ===============================================================
'Update Frequency,Update Type
4,WHOLE_TEST
'Bar chart 1 statistic
Total I/Os per Second
'Bar chart 2 statistic
Total MBs per Second
'Bar chart 3 statistic
Average I/O Response Time (ms)
'Bar chart 4 statistic
Maximum I/O Response Time (ms)
'Bar chart 5 statistic
% CPU Utilization (total)
'Bar chart 6 statistic
Total Error Count
'END results display
'ACCESS SPECIFICATIONS =========================================================
'Access specification name,default assignment
Max Throughput-100%Read,ALL
'size,% of size,% reads,% random,delay,burst,align,reply
32768,100,100,0,0,1,0,0
'Access specification name,default assignment
RealLife-60%Rand-65%Read,ALL
'size,% of size,% reads,% random,delay,burst,align,reply
8192,100,65,60,0,1,0,0
'Access specification name,default assignment
Max Throughput-50%Read,ALL
'size,% of size,% reads,% random,delay,burst,align,reply
32768,100,50,0,0,1,0,0
'Access specification name,default assignment
Random-8k-70%Read,ALL
'size,% of size,% reads,% random,delay,burst,align,reply
8192,100,70,100,0,1,0,0
'END access specifications
'MANAGER LIST ==================================================================
'Manager ID, manager name
1,PB-W2K3-04
'Manager network address
193.27.20.145
'Worker
Worker 1
'Worker type
DISK
'Default target settings for worker
'Number of outstanding IOs,test connection rate,transactions per connection
64,ENABLED,500
'Disk maximum size,starting sector
8000000,0
'End default target settings for worker
'Assigned access specs
'End assigned access specs
'Target assignments
'Target
C:
'Target type
DISK
'End target
'End target assignments
'End worker
'End manager
'END manager list
Version 2004.07.30

####################################### ENDE of *.icf


TABLE SAMPLE

++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
TABLE oF RESULTS
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++

SERVER TYPE: VM or PHYS.
CPU TYPE / NUMBER: VCPU / 1
HOST TYPE: Dell PE6850, 16GB RAM; 4x XEON 51xx, 2,66 GHz, DC
STORAGE TYPE / DISK NUMBER / RAID LEVEL: EQL PS3600 x 1 / 14+2 Disks / R50

##################################################################################
TEST NAME-------------------Av. Resp. Time ms------Av. IOs/sek-------Av. MB/sek------
##################################################################################

Max Throughput-100%Read........__________..........__________.........__________

RealLife-60%Rand-65%Read......__________..........__________.........__________

Max Throughput-50%Read..........__________..........__________.........__________

Random-8k-70%Read.................__________..........__________.........__________

EXCEPTIONS: CPU Util.-XX%;

##################################################################################


I hope YOU JOIN IN !

Regards
Christian

A Google Spreadsheet version is here:
http://spreadsheets.google.com/pub?key=p2IFgyUF_v5Jn-7QobgY9Fw

Message was edited by:
ken.cline@hp.com to remove ALL CAPS from thread title

Message was edited by:
RDPetruska
Added link to Atamido's Google Spreadsheet

Re: OPEN INOFFICIAL STORAGE PERFORMANCE THREAD Feb 26, 2007 12:45 AM
Click to view christianZ's profile Virtuoso christianZ 2,251 posts since
Apr 21, 2006
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
TABLE OF RESULTS
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++

SERVER TYPE: VM ON ESX 3.0.1
CPU TYPE / NUMBER: VCPU / 1
HOST TYPE: Dell PE6850, 16GB RAM; 4x XEON 7020, 2,66 GHz, DC
STORAGE TYPE / DISK NUMBER / RAID LEVEL: EQL PS3600 x 1 / 14+2 SAS10k / R50
SAN TYPE / HBAs : iSCSI, QLA4050 HBA

##################################################################################
TEST NAME-------------------Av. Resp. Time ms------Av. IOs/sek-------Av. MB/sek------
##################################################################################

Max Throughput-100%Read........__17______..........___3551___.........___111____

RealLife-60%Rand-65%Read......___21_____..........___2550___.........____20____

Max Throughput-50%Read..........____10____..........___5803___.........___181____

Random-8k-70%Read.................____23____..........___2410___.........____19____

EXCEPTIONS: VCPU Util. 60-46-75-46 %;

##################################################################################
Re: OPEN INOFFICIAL STORAGE PERFORMANCE THREAD Feb 27, 2007 7:07 AM
in response to: christianZ
Click to view christianZ's profile Virtuoso christianZ 2,251 posts since
Apr 21, 2006
HERE INTERESTING TEST WITH VM ON VMWARE SERVER 1.x

++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
TABLE OF RESULTS
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++

SERVER TYPE: Win2003 Std. VM ON VMWare Server 1.0.1 / SLES10
CPU TYPE / NUMBER: VCPU / 1
HOST TYPE: Dell PE1950, 4GB RAM, 2x XEON 5130, 2,0 GHz, DC
STORAGE TYPE / DISK NUMBER / RAID LEVEL: EQL PS3600 x 1 / 14+2 SAS10k / R50
SAN TYPE / HBAs : iSCSI; iSCSI softw. initiator in SLES10, 1XGb NIC for iSCSI

##################################################################################
TEST NAME-------------------Av. Resp. Time ms------Av. IOs/sek-------Av. MB/sek------
##################################################################################

Max Throughput-100%Read........____20____..........___3200___.........___105____

RealLife-60%Rand-65%Read......____36____..........___1630___.........____15____

Max Throughput-50%Read..........____30____..........___2170___.........____68____

Random-8k-70%Read.................____36____..........___1635___.........____13____

EXCEPTIONS: performance partial bumpy; by seq. tests "Connection Rate" set to off;
"Max. Response Time" much higher as VM on ESX; by 50%Read high level of CPU %Wait on host

##################################################################################
Re: OPEN INOFFICIAL STORAGE PERFORMANCE THREAD Feb 27, 2007 7:47 AM
in response to: christianZ
Click to view christianZ's profile Virtuoso christianZ 2,251 posts since
Apr 21, 2006
VMWare Server's VM seems to be much slower as VM on ESX with iscsi HBA but not so bad compared to ESX iscsi software initiator - doesn't it ??
Re: OPEN INOFFICIAL STORAGE PERFORMANCE THREAD Feb 27, 2007 8:51 AM
in response to: christianZ
Click to view eliot's profile Hot Shot eliot 145 posts since
Sep 29, 2005
To make life a little easier, here's the config file (from above):

http://www.mez.co.uk/OpenPerformanceTest.icf
Re: OPEN INOFFICIAL STORAGE PERFORMANCE THREAD Feb 27, 2007 10:19 AM
in response to: eliot
Click to view christianZ's profile Virtuoso christianZ 2,251 posts since
Apr 21, 2006
Thanks for that.
Re: OPEN INOFFICIAL STORAGE PERFORMANCE THREAD Feb 27, 2007 11:17 AM
in response to: christianZ
Click to view christianZ's profile Virtuoso christianZ 2,251 posts since
Apr 21, 2006
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
TABLE OF RESULTS
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++

SERVER TYPE: Win2003 Std. PHYS.
CPU TYPE / NUMBER: CPU / 2
HOST TYPE: Dell PE2650, 4GB RAM, 2x XEON, 2,8 GHz
STORAGE TYPE / DISK NUMBER / RAID LEVEL: INFORTREND S12F-R1420 / 6+1 SAS15k / R5
SAN TYPE / HBAs : FC, QLA2460

##################################################################################
TEST NAME-------------------Av. Resp. Time ms------Av. IOs/sek-------Av. MB/sek------
##################################################################################

Max Throughput-100%Read........____7_____..........___8350___.........___260____

RealLife-60%Rand-65%Read......____42____..........___1340___.........____11____

Max Throughput-50%Read..........____11____..........___5300___.........____165___

Random-8k-70%Read.................____40____..........___1450___.........____11____

EXCEPTIONS:
##################################################################################
Re: OPEN INOFFICIAL STORAGE PERFORMANCE THREAD Feb 27, 2007 1:00 PM
in response to: christianZ
Click to view happyhammer's profile Hot Shot happyhammer 181 posts since
Sep 7, 2006
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
TABLE OF RESULTS
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++

SERVER TYPE: VM ON ESX 3.0.1
CPU TYPE / NUMBER: VCPU / 1
HOST TYPE: Dell PE2950, 8GB RAM; 2x XEON 5355(Quad), 2,66 GHz,
STORAGE TYPE / DISK NUMBER / RAID LEVEL: EQL PS100e x 1 / 14+2 SATA / R50
SAN TYPE / HBAs : iSCSI, QLA4052 HBA Jumbo's and Flow Control

##################################################################################
TEST NAME-------------------Av. Resp. Time ms------Av. IOs/sek-------Av. MB/sek------
##################################################################################

Max Throughput-100%Read........__25______..........___2321___.........___72____

RealLife-60%Rand-65%Read......___37_____..........___1303___.........____10____

Max Throughput-50%Read..........____14____..........___4030___.........___126____

Random-8k-70%Read.................____42____..........___1174___.........____9____

EXCEPTIONS: VCPU Util. 22-35-35-33 %;
Re: OPEN INOFFICIAL STORAGE PERFORMANCE THREAD Feb 27, 2007 1:38 PM
in response to: happyhammer
Click to view doubleH's profile Expert doubleH 531 posts since
Dec 23, 2006
i am looking at purchasing the same storage array and hba as happyhammer. although this thread is nice i really don't know what the numbers mean. would someone be able to explain what they mean and provide an average number to compare against?
Re: OPEN INOFFICIAL STORAGE PERFORMANCE THREAD Feb 27, 2007 3:33 PM
Click to view davidbarclay's profile Master davidbarclay 1,100 posts since
Sep 20, 2006
Great idea mate. It's always nice to compare notes..just in case things aren't right! I hope a few more people get involved. I'll do both physical and virtual. Physical is running now. Will post when done.

Dave
Re: OPEN INOFFICIAL STORAGE PERFORMANCE THREAD Feb 27, 2007 3:59 PM
Click to view davidbarclay's profile Master davidbarclay 1,100 posts since
Sep 20, 2006
BTW, another very important factor will be the block size of the VMFS partition. Might want to add that to your results template.

Dave
Re: OPEN INOFFICIAL STORAGE PERFORMANCE THREAD Feb 27, 2007 7:22 PM
in response to: davidbarclay
Click to view davidbarclay's profile Master davidbarclay 1,100 posts since
Sep 20, 2006
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
TABLE OF RESULTS - PHYSICAL
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++

SERVER TYPE: Win2k3 Standard Physical
CPU TYPE / NUMBER: CPU / 2
HOST TYPE: HP BL460c Blade, 4GB RAM; 2x XEON 5150 (Dualcore), 2,66 GHz,
STORAGE TYPE / DISK NUMBER / RAID LEVEL: HP EVA4000 x 2 / 12 x 10k FC HDD on vRAID5
VMFS: 100GB LUN, 1MB Block Size
SAN TYPE / HBAs : 4GB FC, HP/QLogic QMH2462 Dual HBAs, Dual Brocade 4100 Switches

##################################################################################
TEST NAME-------------------Av. Resp. Time ms------Av. IOs/sek-------Av. MB/sek------
##################################################################################

Max Throughput-100%Read......._____2.91____.......___19573.45___....___610.64____

RealLife-60%Rand-65%Read......_____13.96___.......___2766.94____....___21.59_____

Max Throughput-50%Read........_____3.21____.......___18270.35___....___567.12____

Random-8k-70%Read............._____11.92___.......___2881.94____....___22.43_____

EXCEPTIONS:
Re: OPEN INOFFICIAL STORAGE PERFORMANCE THREAD Feb 27, 2007 7:22 PM
in response to: davidbarclay
Click to view davidbarclay's profile Master davidbarclay 1,100 posts since
Sep 20, 2006
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
TABLE OF RESULTS - VM on RDM
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++

SERVER TYPE: VM ON ESX 3.0.1
CPU TYPE / NUMBER: VCPU / 1
HOST TYPE: HP BL480c Blade, 16GB RAM; 2x XEON 5150 (Dualcore), 2,66 GHz,
STORAGE TYPE / DISK NUMBER / RAID LEVEL: HP EVA4000 x 2 / 12 x 10k FC HDD on vRAID5
VMFS: 100GB LUN, RDM
SAN TYPE / HBAs : 4GB FC, HP/QLogic QMH2462 Dual HBAs, Dual Brocade 4100 Switchesl

##################################################################################
TEST NAME-------------------Av. Resp. Time ms------Av. IOs/sek-------Av. MB/sek------
##################################################################################

Max Throughput-100%Read.......____5.68_____.......___10104.08___....___315.75____

RealLife-60%Rand-65%Read......____18.37____.......___2520.07_____....__19.69______

Max Throughput-50%Read........____3.64_____.......___15316.05___....___478.63_____

Random-8k-70%Read.............____17.41____.......___2661.18____....___20.79_____

EXCEPTIONS:
Re: OPEN INOFFICIAL STORAGE PERFORMANCE THREAD Feb 27, 2007 7:29 PM
in response to: davidbarclay
Click to view davidbarclay's profile Master davidbarclay 1,100 posts since
Sep 20, 2006
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
TABLE OF RESULTS - VM on 1MB Block Size VMFS
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++

SERVER TYPE: VM ON ESX 3.0.1
CPU TYPE / NUMBER: VCPU / 1
HOST TYPE: HP BL480c Blade, 16GB RAM; 2x XEON 5150 (Dualcore), 2,66 GHz,
STORAGE TYPE / DISK NUMBER / RAID LEVEL: HP EVA4000 x 2 / 12 x 10k FC HDD on vRAID5
VMFS: 100GB LUN, 1MB Block Size
SAN TYPE / HBAs : 4GB FC, HP/QLogic QMH2462 Dual HBAs, Dual Brocade 4100 Switchesl

##################################################################################
TEST NAME-------------------Av. Resp. Time ms------Av. IOs/sek-------Av. MB/sek------
##################################################################################

Max Throughput-100%Read.......___5.25______.......__10476.40____....__327.39_____

RealLife-60%Rand-65%Read......___17.73_____.......__2642.48______...._20.50_______

Max Throughput-50%Read........___39.51______......._1311.69_____....__40.99______

Random-8k-70%Read.............___18.61_____.......__2464.30_____....__19.28______

EXCEPTIONS:
Re: OPEN INOFFICIAL STORAGE PERFORMANCE THREAD Feb 27, 2007 7:37 PM
in response to: davidbarclay
Click to view davidbarclay's profile Master davidbarclay 1,100 posts since
Sep 20, 2006
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
TABLE OF RESULTS - VM on 2MB Block Size VMFS
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++

SERVER TYPE: VM ON ESX 3.0.1
CPU TYPE / NUMBER: VCPU / 1
HOST TYPE: HP BL480c Blade, 16GB RAM; 2x XEON 5150 (Dualcore), 2,66 GHz,
STORAGE TYPE / DISK NUMBER / RAID LEVEL: HP EVA4000 x 2 / 12 x 10k FC HDD on vRAID5
VMFS: 100GB LUN, 2MB Block Size
SAN TYPE / HBAs : 4GB FC, HP/QLogic QMH2462 Dual HBAs, Dual Brocade 4100 Switchesl

##################################################################################
TEST NAME-------------------Av. Resp. Time ms------Av. IOs/sek-------Av. MB/sek------
##################################################################################

Max Throughput-100%Read.......__6.25_______.......__9548.12____....__294.21_____

RealLife-60%Rand-65%Read......__16.21______.......__2815.03____....__21.08______

Max Throughput-50%Read........__43.81_______......._1239.55_____...._38.68_______

Random-8k-70%Read.............__18.74_____.......___2430.08____....__19.02______

EXCEPTIONS:
1 2 3 ... 31 Previous Next
Actions