VMware
This thread is locked
1 2 3 4 5 ... 31 Previous Next 457 Replies Last post: Mar 5, 2009 6:53 AM by oreeh   Go to original post

Re: OPEN INOFFICIAL STORAGE PERFORMANCE THREAD

30. Mar 1, 2007 4:09 AM in response to: happyhammer
Click to view christianZ's profile Virtuoso
christianZ
2,251 posts since
Apr 21, 2006
That is better (by sequential r/w) - as by me - it seems that "jumbos" don't do it faster - or by some switches "jumbo and flow control" shouldn't be enabled simultan.

Do you mean the performance from vm with iscsi hba is slower then physical server with nics ??

Re: OPEN INOFFICIAL STORAGE PERFORMANCE THREAD

31. Mar 1, 2007 4:30 AM in response to: christianZ
Click to view happyhammer's profile Hot Shot
happyhammer
181 posts since
Sep 7, 2006
sorry i meant just on Physical server(win 2003) to PS100, the nic's were outperforming the HBA's(tried all drivers, initiators, and combos and cant get nowhere near NIC performance) The HBA'a 4052 have latest firmware
On a 4K SEQ read was getting 102MBps/17%cpu on NIC and only 90MBps/8% on HBA

I would expect the HBA's to match or beat the nics in throughput and have less CPU overhead

Re: OPEN INOFFICIAL STORAGE PERFORMANCE THREAD

32. Mar 1, 2007 4:39 AM in response to: happyhammer
Click to view christianZ's profile Virtuoso
christianZ
2,251 posts since
Apr 21, 2006
I guess if you have strong server cpu - it can do the iscsi capsulation job (ip->tcp->iscsi->scsi) faster than the cpu on hba.

Re: OPEN INOFFICIAL STORAGE PERFORMANCE THREAD

33. Mar 1, 2007 4:46 AM in response to: christianZ
Click to view christianZ's profile Virtuoso
christianZ
2,251 posts since
Apr 21, 2006
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
TABLE OF RESULTS VM ON ESX / VM SNAPSHOT ON
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++

SERVER TYPE: VM ON ESX 3.0.1
CPU TYPE / NUMBER: VCPU / 1
HOST TYPE: Dell PE6850, 16GB RAM; 4x XEON 7020, 2,66 GHz, DC
STORAGE TYPE / DISK NUMBER / RAID LEVEL: EQL PS3600 x 1 / 14+2 SAS10k / R50
SAN TYPE / HBAs : iSCSI, QLA4050 HBA

##################################################################################
TEST NAME-------------------Av. Resp. Time ms--------Av. IOs/sek------------Av. MB/sek------
##################################################################################

Max Throughput-100%Read........__________..........__________.........__________

RealLife-60%Rand-65%Read......___22_____..........___1230___.........____10____

Max Throughput-50%Read..........__________..........__________.........__________

Random-8k-70%Read.................__________..........__________.........__________

EXCEPTIONS: VCPU Util. IN VM ~100%; IN VC 55%

##################################################################################

Re: OPEN INOFFICIAL STORAGE PERFORMANCE THREAD

34. Mar 1, 2007 5:00 AM in response to: christianZ
Click to view christianZ's profile Virtuoso
christianZ
2,251 posts since
Apr 21, 2006
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
TABLE OF RESULTS VM ON ESX / LUN SNAPSHOT ON (EQL)
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++

SERVER TYPE: VM ON ESX 3.0.1
CPU TYPE / NUMBER: VCPU / 1
HOST TYPE: Dell PE6850, 16GB RAM; 4x XEON 7020, 2,66 GHz, DC
STORAGE TYPE / DISK NUMBER / RAID LEVEL: EQL PS3600 x 1 / 14+2 SAS10k / R50
SAN TYPE / HBAs : iSCSI, QLA4050 HBA

##################################################################################
TEST NAME-------------------Av. Resp. Time ms--------Av. IOs/sek------------Av. MB/sek------
##################################################################################

Max Throughput-100%Read........__________..........__________.........__________

RealLife-60%Rand-65%Read......___31_____..........___1760___.........____14____

Max Throughput-50%Read..........__________..........__________.........__________

Random-8k-70%Read.................__________..........__________.........__________

EXCEPTIONS: VCPU Util. IN VM ~37%

##################################################################################

Re: OPEN INOFFICIAL STORAGE PERFORMANCE THREAD

35. Mar 1, 2007 5:06 AM in response to: christianZ
Click to view christianZ's profile Virtuoso
christianZ
2,251 posts since
Apr 21, 2006
Somebody asks if unload from vmfs2 makes any differences - I tested it and can't see any.

Re: OPEN INOFFICIAL STORAGE PERFORMANCE THREAD

36. Feb 8, 2009 11:15 PM in response to: christianZ
Click to view christianZ's profile Virtuoso
christianZ
2,251 posts since
Apr 21, 2006
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
TABLE OF RESULTS PHYS. WIN2003 / MS ISCSI INITIATOR
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++

SERVER TYPE: Win2003 Std. PHYS.
CPU TYPE / NUMBER: CPU / 2
HOST TYPE: Dell PE1950, 4GB RAM, 2x XEON 5130, 2,0 GHz, DC
STORAGE TYPE / DISK NUMBER / RAID LEVEL: EQL PS3600 x 1 / 14+2 SAS10k / R50
SAN TYPE / HBAs : iSCSI; iSCSI softw. initiator in WIN2003, 1XGb NIC for iSCSI

TEST NAME-------------------Av. Resp. Time ms------Av. IOs/sek-------Av. MB/sek------

Max Throughput-100%Read........____17____..........___3560___.........___112____

RealLife-60%Rand-65%Read......____13____..........___3550___.........____28____

Max Throughput-50%Read..........____10____..........___5950___.........____186___

Random-8k-70%Read.................____14____..........___3340___.........____26____

EXCEPTIONS:

Re: OPEN INOFFICIAL STORAGE PERFORMANCE THREAD

37. Feb 8, 2009 11:15 PM in response to: christianZ
Click to view christianZ's profile Virtuoso
christianZ
2,251 posts since
Apr 21, 2006
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
TABLE OF RESULTS PHYS. WIN2003 / MS ISCSI INITIATOR / 2 X PS3600X
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++

SERVER TYPE: Win2003 Std. PHYS.
CPU TYPE / NUMBER: CPU / 2
HOST TYPE: Dell PE1950, 4GB RAM, 2x XEON 5130, 2,0 GHz, DC
STORAGE TYPE / DISK NUMBER / RAID LEVEL: EQL PS3600 x 2 / 2x14+2x2 SAS10k / R50 / LUN STRIPPED
SAN TYPE / HBAs : iSCSI; iSCSI softw. initiator in WIN2003, 1XGb NIC for iSCSI

TEST NAME-------------------Av. Resp. Time ms------Av. IOs/sek-------Av. MB/sek------

Max Throughput-100%Read........____17____..........___3570___.........___112____

RealLife-60%Rand-65%Read......_____8____..........___5919___.........____46____

Max Throughput-50%Read..........____12____..........___4810___.........____150___

Random-8k-70%Read................._____8____..........___5720___.........____45____

EXCEPTIONS: Seq. r/w not as high as by single box

Re: OPEN INOFFICIAL STORAGE PERFORMANCE THREAD

38. Mar 3, 2007 11:39 AM in response to: christianZ
Click to view christianZ's profile Virtuoso
christianZ
2,251 posts since
Apr 21, 2006
My comments:

- as we can see here vm on iscsi compared to phys. server loses more throughput as its counterparts on fc

- iscsi can't equal fc by sequential r/w (as expected)

- iscsi "Response times" aren't higher than by fc

- VM on VMWare server reaches round 50% of VM on ESX

Re: OPEN INOFFICIAL STORAGE PERFORMANCE THREAD

39. Mar 4, 2007 9:34 AM in response to: christianZ
Click to view christianZ's profile Virtuoso
christianZ
2,251 posts since
Apr 21, 2006
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
TABLE OF RESULTS CORRECTION (LAST TEST BY CONCURRENT BACKUP)
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++

SERVER TYPE: Win2003 Std. PHYS.
CPU TYPE / NUMBER: CPU / 2
HOST TYPE: Dell PE2650, 4GB RAM, 2x XEON, 2,8 GHz
STORAGE TYPE / DISK NUMBER / RAID LEVEL: INFORTREND S12F-R1420 / 6+1 SAS15k / R5
SAN TYPE / HBAs : FC, QLA2460

##################################################################################
TEST NAME-------------------Av. Resp. Time ms------Av. IOs/sek-------Av. MB/sek------
##################################################################################

Max Throughput-100%Read........____5_____..........___11090__.........___346____

RealLife-60%Rand-65%Read......____38____..........___1522___.........____12____

Max Throughput-50%Read.........._____8____..........___7160___.........____224___

Random-8k-70%Read.................____39____..........___1512___.........____12____

EXCEPTIONS:
##################################################################################

Re: OPEN INOFFICIAL STORAGE PERFORMANCE THREAD

40. Mar 8, 2007 1:11 PM in response to: christianZ
Click to view CWedge@Amsa's profile Expert
CWedge@Amsa
385 posts since
Oct 25, 2005
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
TABLE oF RESULTS
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++

SERVER TYPE: VM Wink2k3 Sp1 Std 1GB ram
CPU TYPE / NUMBER: VCPU / 1 3 GHZ
HOST TYPE: HP DL580G4, 16GB RAM; 4x XEON 3.0 GHz, DC HT Enabled
STORAGE TYPE / DISK NUMBER / RAID LEVEL / Cache: DMX3000 / Lots of Disks / Raid 7+1 / 32Gb
VMFS: 512GB LUN, 8MB Block Size
SAN TYPE / HBAs : 4GB FC, Emulex lp11002e Dual Dual HBAs, Dual Brocade 2G Switches

##################################################################################
TEST NAME-------------------Av. Resp. Time ms------Av. IOs/sek-------Av. MB/sek------
##################################################################################

Max Throughput-100%Read........___4______..........____1500__.........___47_____

RealLife-60%Rand-65%Read......___1.8_____..........___2170___.........___17_____

Max Throughput-50%Read..........__6_______..........___1280___.........__40______

Random-8k-70%Read.................__1.9____..........__2240____........._18_____

EXCEPTIONS: CPU Util.-30%; Seams to be a limitation somewhere on the MB/s I'll play around a bit.

##################################################################################

Message was edited by:
CWedge@Amsa

Re: OPEN INOFFICIAL STORAGE PERFORMANCE THREAD

41. Mar 8, 2007 1:34 PM in response to: CWedge@Amsa
Click to view CWedge@Amsa's profile Expert
CWedge@Amsa
385 posts since
Oct 25, 2005
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
TABLE oF RESULTS EVA5000 Unit#1
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++

SERVER TYPE: VM Wink2k3 Sp1 Std 1GB ram
CPU TYPE / NUMBER: VCPU / 1 3 GHZ
HOST TYPE: HP DL580G4, 16GB RAM; 4x XEON 3.0 GHz, DC HT Enabled
STORAGE TYPE / DISK NUMBER / RAID LEVEL / Cache: EVA5000 / 66 Disks / Raid V5 / 2Gb
VMFS: 1TB LUN, 8MB Block Size
SAN TYPE / HBAs : 4GB FC, Emulex lp11002e Dual Dual HBAs, Dual Brocade 2G Switches

##################################################################################
TEST NAME-------------------Av. Resp. Time ms------Av. IOs/sek-------Av. MB/sek------
##################################################################################

Max Throughput-100%Read........__1.9___..........____1900__.........___59_____

RealLife-60%Rand-65%Read......___17_____..........___476___.........___4_____

Max Throughput-50%Read..........__25_______..........___479___.........__15______

Random-8k-70%Read.................__30____..........__339____........._3_____

EXCEPTIONS: CPU Util.-30%;

##################################################################################

Re: OPEN INOFFICIAL STORAGE PERFORMANCE THREAD

42. Mar 8, 2007 1:38 PM in response to: CWedge@Amsa
Click to view CWedge@Amsa's profile Expert
CWedge@Amsa
385 posts since
Oct 25, 2005
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
TABLE oF RESULTS EVA 5000 Unit #2 96 Drives
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++

SERVER TYPE: VM Wink2k3 Sp1 Std 1GB ram
CPU TYPE / NUMBER: VCPU / 1 3 GHZ
HOST TYPE: HP DL580G4, 16GB RAM; 4x XEON 3.0 GHz, DC HT Enabled
STORAGE TYPE / DISK NUMBER / RAID LEVEL / Cache: EVA5000 / 96 Disks / Raid V5 / 2Gb
VMFS: 1TB LUN, 8MB Block Size
SAN TYPE / HBAs : 4GB FC, Emulex lp11002e Dual Dual HBAs, Dual Brocade 2G Switches

##################################################################################
TEST NAME-------------------Av. Resp. Time ms------Av. IOs/sek-------Av. MB/sek------
##################################################################################

Max Throughput-100%Read........__1.7___..........____2188__.........___68_____

RealLife-60%Rand-65%Read......___12_____..........___498___.........___4_____

Max Throughput-50%Read..........__9_______..........___598___.........__19______

Random-8k-70%Read.................__15____..........__486____........._4_____

EXCEPTIONS: CPU Util.-30%;

##################################################################################

Re: OPEN INOFFICIAL STORAGE PERFORMANCE THREAD

43. Mar 8, 2007 2:02 PM in response to: CWedge@Amsa
Click to view CWedge@Amsa's profile Expert
CWedge@Amsa
385 posts since
Oct 25, 2005
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
TABLE oF RESULTS DMX3000, EVA5000 66-Drives, EVA5000 96-Drives
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++

SERVER TYPE: VM Wink2k3 Sp1 Std 1GB ram
CPU TYPE / NUMBER: VCPU / 1 3 GHZ
HOST TYPE: HP DL580G4, 16GB RAM; 4x XEON 3.0 GHz, DC HT Enabled
VMFS: 1TB LUN, 8MB Block Size
SAN TYPE / HBAs : 4GB FC, Emulex lp11002e Dual Dual HBAs, Dual Brocade 2G Switches

#######################################################################################
TEST NAME-------------------Av. Resp. Time ms------Av. IOs/sek-------Av. MB/sek--------
#######################################################################################
..........................................DMX3k|EVA#1|EVA#2 DMX3k|EVA#1 |EVA#2 DMX3k|EVA#1|EVA#2|
******************************************************************************************************************
Max Throughput-100%Read....._4__|_1.9_|_1.7_..._1500_|_1900_|_2188_..__47_|__59_|__68_|

RealLife-60%Rand-65%Read...._1.8|__17_|_12_...._2170_|__476_|__498_....17_|___4_|___4_|

Max Throughput-50%Read......._6_|__25_|_9_......1280_|__479_|__598_..._40_|__15_|__19_|

Random-8k-70%Read.........._1.9_|__30_|_15_.....2240_|__339_|__486_..._18_|___3_|___4_|

EXCEPTIONS: CPU Util.-30%;

#######################################################################################

*notes:
The DMX seams to work faster the harder you make it work, most likely due to its massive 32Gbs of cache.

Message was edited by:
CWedge@Amsa

Re: OPEN INOFFICIAL STORAGE PERFORMANCE THREAD

44. Mar 8, 2007 3:11 PM in response to: christianZ
Click to view acr's profile Virtuoso
acr
3,012 posts since
Nov 17, 2005
Nice thread Christian, has some interesting perf stats..

There always seems two interesting perf figures when measuring

1. Throughput in MB/s
2. IO/s

But when using either metric we really need to understand our needs..

When using these stats, MB/s and IO/s are almost inversely related. As overhead for block IO detracts from total throughput speed..

Deturmining which metric is best for real world performance critically depends upon the nature of the Data flowing through the SAN..

In a transactional-oriented environment IO/s are likely to be more important as transactions typically involve small blocks of data..

Where as video editing system will stress raw throughput and high MB/s values..

A real test of a SAN is its ability to support the relevant applications.

So you need to measure the characteristic that best characterizes your infrastructure, application mix and network.

IMHO..!
1 2 3 4 5 ... 31 Previous Next Go to original post

Actions

VMware Developer

SDKs, APIs, Videos, Learn and much more in the Developer community.

Learn More

Developer Sample Code

Increase your developer productivity with VMware API sample code.

Learn More

VMworld Sessions & Labs

Online access to the latest VMworld Sessions & Labs and online services.

Learn more

Purchase PSO Credits Online

Purchase credits to redeem training and consulting services online.

Buy Now

Community Hardware Software

View reported configurations or report your own.

Learn More

VMware vSphere

Come witness the next giant leap in virtualization.

Register Today

Communities