VMware Cloud Community
christianZ
Champion
Champion

New !! Open unofficial storage performance thread

Hello everybody,

the old thread seems to be sooooo looooong - therefore I decided (after a discussion with our moderator oreeh - thanks Oliver -) to start a new thread here.

Oliver will make a few links between the old and the new one and then he will close the old thread.

Thanks for joining in.

Reg

Christian

574 Replies
fredlr
Contributor
Contributor

Here are our results. The raid groups include 5 to 9 disks FC 15krpm or SATA 7.2krpm. 2 controler types : IBM DS5100 and DS4700

SERVER TYPE: Windows 2008 R2 64bits
CPU TYPE / NUMBER: X5570 / 2
HOST TYPE: M610
STORAGE TYPE / DISK NUMBER / RAID LEVEL: IBM DS5100 / FC 300 15krpm / RAID5 4+1

TEST NAMEAvg Resp. Time msAvg IOs/secAvg MB/sec% cpu load
Max Throughput-100%Read5.26113403542%
RealLife-60%Rand-65%Read27.6414851131%
Max Throughput-50%Read2.95201226284%
Random-8k-70%Read29.5314191130%

SERVER TYPE: Windows 2008 R2 64bits
CPU TYPE / NUMBER: X5570 / 2
HOST TYPE: M610
STORAGE TYPE / DISK NUMBER / RAID LEVEL: IBM DS5100 / FC 300 15krpm / RAID10 4+4

TEST NAMEAvg Resp. Time msAvg IOs/secAvg MB/sec% cpu load
Max Throughput-100%Read5.27113363543%
RealLife-60%Rand-65%Read31.461688133%
Max Throughput-50%Read2.932038563744%
Random-8k-70%Read33.961531113%

SERVER TYPE: Windows 2008 R2 64bits
CPU TYPE / NUMBER: X5570 / 2
HOST TYPE: M610
STORAGE TYPE / DISK NUMBER / RAID LEVEL: IBM DS5100 / SATA 1To 7200rpm / RAID5 8+1

TEST NAMEAvg Resp. Time msAvg IOs/secAvg MB/sec% cpu load
Max Throughput-100%Read5.331121335022%
RealLife-60%Rand-65%Read85.92616420%
Max Throughput-50%Read3.03197786182%
Random-8k-70%Read88.08571425%

SERVER TYPE: Windows 2008 R2 64bits
CPU TYPE / NUMBER: X5680 / 2
HOST TYPE: M610
STORAGE TYPE / DISK NUMBER / RAID LEVEL: IBM DS4700 / SATA 1To 7200rpm / RAID5 8+1

TEST NAMEAvg Resp. Time msAvg IOs/secAvg MB/sec% cpu load
Max Throughput-100%Read5.271135935422%
RealLife-60%Rand-65%Read64.0378962%
Max Throughput-50%Read6.38952229710%
Random-8k-70%Read64.0674153%
0 Kudos
ryatwork
Contributor
Contributor

I've read through about 20-30 pages from the original thread and this newer one and I haven't noticed anyone posting results from a virtualized SAN.

This is two seperate tests on the two hosts that I have. The vSAN are mirroed with each other via 1 Gb crossover cable. I ran test one, then failed the vm to the second host and ran it after waiting 5 minutes after boot. There isn't any other load on these hosts.

I'm sure it could be tweaked but just needed to get this up and running as I'm testing other solutions as well;

++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
TABLE OF RESULTS - VM on 8MB Block Size VMFS
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
SERVER TYPE: VM 2008r2 ON ESX 5u1
CPU TYPE / NUMBER: VCPU / 2
HOST TYPE: Supermicro X9SCI-LN4F-O, 16GB RAM; 1x XEON E3 1230, 3.2 GHz,
STORAGE TYPE / DISK NUMBER / RAID LEVEL: StorMagic SvSAN / Adaptec 2405 128 MB / 4 x 7.2k WD RE4 HDD on RAID10
VMFS: 1.79GB LUN, 8MB Block Size
SAN TYPE / HBAs : DAS/iSCSI through vSAN
##################################################################################
TEST NAME-- HOST 1
Av. Resp. Time ms--Av. IOs/sek---Av. MB/sek---- CPU%
##################################################################################
Max Throughput-100%Read.......__2.833_______.......__20993.81____....__656.05_____20.12%
RealLife-60%Rand-65%Read......__70.01______.......__771.93____....__6.03______13.68%
Max Throughput-50%Read........__8.17_______......._6820.42_____...._213.13_______16.12%
Random-8k-70%Read.............__76.80_____.......___675.00____....__5.27______15.94%
EXCEPTIONS:
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
TABLE OF RESULTS - VM on 8MB Block Size VMFS
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
SERVER TYPE: VM 2008r2 ON ESX 5u1
CPU TYPE / NUMBER: VCPU / 2
HOST TYPE: Supermicro X9SCI-LN4F-O, 16GB RAM; 1x XEON E3 1230, 3.2 GHz,
STORAGE TYPE / DISK NUMBER / RAID LEVEL: StorMagic SvSAN / Adaptec 2405 128 MB / 4 x 7.2k WD RE4 HDD on RAID10
VMFS: 1.79GB LUN, 8MB Block Size
SAN TYPE / HBAs : DAS/iSCSI through vSAN
##################################################################################
TEST NAME-- HOST 2
Av. Resp. Time ms--Av. IOs/sek---Av. MB/sek---- CPU%
##################################################################################
Max Throughput-100%Read.......__3.28_______.......__18031.46____....__563.48_____18.93%
RealLife-60%Rand-65%Read......__87.29______.......__617.13____....__4.82______15.35%
Max Throughput-50%Read........__8.17_______......._6815.04_____...._212.97_______16.15%
Random-8k-70%Read.............__92.19_____.......___551.62____....__4.30______17.58%
EXCEPTIONS:
0 Kudos
touimet
Enthusiast
Enthusiast

Hypervisor: ESXi   4.1, 433742



VM:  Windows 2008 R2, 8 vCPU, 32GB RAM


GOS iSCSI   initiator:  9000 MTU, RSS Enabled


NetApp   filer:  FAS6240, 48 GB RAM, two 64-bit   quad core CPUs, ONTap 8.1
LUN ID:    ntap007a, LUN 3



Aggregate:  aggr1, 112 disks (98 data, 14 parity)


HDD:  600 GB; Vendor: NETAPP; Model:   X422_HCOBD600A10 6 Gb/s SAS architecture
RAID:    RAID 6



RAID   Groups:  7 RAID groups total, ea. has   14 data & 2 parity






TEST NAMEAvg Resp. Time msAvg IOs/secAvg MB/sec% cpu load
Max   Throughput-100%Read4.491107134513%
RealLife-60%Rand-65%Read1.591992816314%
Max   Throughput-50%Read3.001615352914%
Random-8k-70%Read2.421726914111%
0 Kudos
mry
Contributor
Contributor

Jeg arbejder ikke for styrelsen mere. Kontakt drift@eogs.dk eller +45 3330 7587 I do not work for the agency anymore. Please contact drift@eogs.dk or 0045 33307587

0 Kudos
djciaro
Expert
Expert

TESTVM with VPLEX Distributed volumePhysical server with VPLEX distributed volume
Max Throughput -100% ReadMBpsMBps
13201274
RealLife-60% Rand -65% ReadMBpsMBps
4030
Max Throughput -50% ReadMBpsMBps
441294
Random-8k -70% ReadMBpsMBps
5029

These are the results to compare physical with virtual, it must be noted that the ESXi server have 6 paths available to the LUNs and are running PowerPath/VE whereas the Physical server only has 2 Paths with Round Robin.

If you found this information useful, please consider awarding points for "Correct" or "Helpful". Thanks!
0 Kudos
dennes
Enthusiast
Enthusiast

Geachte relatie,

Ik ben van dinsdag 2-10 t/m donderdag 4-10 niet op kantoor aanwezig.

Voor dringende zaken verzoek ik u contact op te nemen met kantoor: 013-5115088

Groeten,

Dennes

0 Kudos
sscheller
Contributor
Contributor

Sehr geehrte Damen und Herren,

ich befinde mich im Urlaub.

Bei drigenden Fragen wenden sie sich bitte an

Herr Becker Tel.: 06027409030.

Mit freundlichen Grüßen

Sven Scheller

0 Kudos
reesewon
Contributor
Contributor

SERVER TYPE: Windows 2012 64bits
CPU TYPE / NUMBER: Intel Core i7 930

HOST TYPE: Whitebox - Dev
STORAGE TYPE / DISK NUMBER / RAID LEVEL: FreeNAS appliance / 6x 500GB 7.2k ES.2 / RAID10

TEST NAMEAvg Resp. Time msAvg IOs/secAvg MB/sec% cpu load
Max Throughput-100%Read64.2093529.2214%
RealLife-60%Rand-65%Read273.262161.6813%
Max Throughput-50%Read56.96102832.1518%
Random-8k-70%Read362.711631.2813%

My FreeNAS is a virtual appliance, 9k jumbo frames enable with two ports using MPIO.  It has a sole thick lazy zeroed vmdk on a 3ware 9650SE 6 disk 500GB 7.2k RAID 10.  The FreeNAS VM is a 4 core Xeon E5410, with 4gb of allocated RAM.

Is this expected performance?  How many VM's could you possibly have running on this slow storage?

0 Kudos
Darking
Enthusiast
Enthusiast

Hejsa.

Du har prøvet at kontakte mig, men jeg er på ferie

Du bør derfor kontakte hotline istedet på 33 63 13 99 eller hotline@kab-bolig.dk

Hi.

You have tried to contact me, but im on vacation.

You should try and contact KAB's Hotline function instead on +45 33 63 13 99 or via e-mail hotline@kab-bolig.dk

På forhånd tak/ Regards

Christian Hansen

Netværkstekniker/Network tech.

0 Kudos
Joshwaa
Contributor
Contributor

Sorry for the newbness but could you tell me what benchmark you are running and how to go about running it. I am just building my first ESXi 4.1 server and would like to do some benches before and after I add the LSI Raid card. Thanks for your help.

0 Kudos
1538moss
Contributor
Contributor

Kurs, tilbake 12/11

0 Kudos
JRISC
Contributor
Contributor

Here is another test of a single Equallogic PS6110XS.

Test were run on a windows 2008 R2 VM hosted on Dell R720 Server. Server was connected to storage via 10GB iSCSI.

SERVER TYPE: Dell R720 CPU TYPE / NUMBER: E5-2650 HOST TYPE: Windows 2008 R2 VM STORAGE TYPE / DISK NUMBER / RAID LEVEL: PS6110XS /7 x 400GBSSD 17 x 600GB 10K SAS /Raid 6
Test nameLatencyAvg iopsAvg MBpscpu load
Max Throughput-100%Read2.36236917404%
RealLife-60%Rand-65%Read8.216279490%
Max Throughput-50%Read6.0095552980%
Random-8k-70%Read5.568816680%
0 Kudos
Adrian_Buchmann
Contributor
Contributor

Guten Tag

Besten Dank für Ihre E-Mail. Ich bin jeweils am Donnerstag und Freitag abwesend.

Ihre E-Mail wird nicht weitergeleitet.

Bei dringenden Fällen wenden Sie sich bitte an unseren ServiceDesk 041 228 69 99. Dort hilft man Ihnen gerne weiter.

Mit freundlichen Grüssen

Adrian Buchmann

0 Kudos
mikeyb79
Enthusiast
Enthusiast

Hi JRISC, what's the usable capacity on one of those XS arrays after RAID and hot sparing? I'm talking to Dell about an entry-level Compellent array with about 12TB usable and able to sustain 5k IOPS (70/30, 4k random). With the kind of pricing we can get on the GbE XS array, we can buy a vStart 100 and substitute one of these in for the PS6100X and come out only a little behind on cost.

0 Kudos
Jakobwill
Enthusiast
Enthusiast

Im currently on paternity leave.

Please contact my collegues

Pre-sales / Concept - Thomas.Hagedorn@arrowecs.dk

Sales / Qoutes - Sales@arrowecs.dk

See all contact here: https://ecs-nordic.arrow.com/Arrow%20Common%20DAM/VMware/Files/2012_10_VMware%20kontaktark.pdf

0 Kudos
Adrian_Buchmann
Contributor
Contributor

Guten Tag

Besten Dank für Ihre E-Mail. Ich bin jeweils am Donnerstag und Freitag abwesend.

Ihre E-Mail wird nicht weitergeleitet.

Bei dringenden Fällen wenden Sie sich bitte an unseren ServiceDesk 041 228 69 99. Dort hilft man Ihnen gerne weiter.

Mit freundlichen Grüssen

Adrian Buchmann

0 Kudos
JRISC
Contributor
Contributor

Hi mikeyb79,

9TB usable (13TB Raw).

0 Kudos
xevrebyc
Contributor
Contributor

Hey all

Looking for a bit of derection on troubleshooting thse low numbers.

SERVER TYPE:Windows 2008 R2 CPU TYPE / NUMBER: Xeon X5677, 2 HOST TYPE: Dell R710 STORAGE TYPE / DISK NUMBER / RAID LEVEL: PS6000E + PS6100E, 36 disks, RAID 50
Test nameLatencyAvg iopsAvg MBpscpu load
Max Throughput-100%Read31.321852574%
RealLife-60%Rand-65%Read21.4020501617%
Max Throughput-50%Read21.022793872%
Random-8k-70%Read23.9118381418%

used http://vmktree.org/iometer/OpenPerformanceTest32.icf


Current config.

3 x Dell R710 96Gb RAM each, 1 @ 2 x5677 3.47GHz, 2 @ E5620 2.40GHz

2 x Dell PowerConnect 5424 switches setup per http://www.interweb.org.uk/2011/06/06/dell-powerconnect-5400-series-iscsi-configuration/

1 x EQL PS6000E 16 @ 1TB 7500 SATA

1 x EQL PS6100E 24 @ 2TB 7500 SATA

All host running EXSi 5.0

All BroadCom nics 4 LAN, 3 iSCSI, 1 vMotion

Any and all help would be greatly appreciated.

0 Kudos
alexxdavid
Contributor
Contributor

Thank you for contacting Intework.

I am currently on leave and may not be able to attend to your query. For matters requiring immediate attention, You can contact me on my mobile on 0429 619 716

Regards

David Avice

IT Manager

0 Kudos