VMware Cloud Community
christianZ
Champion
Champion

New !! Open unofficial storage performance thread

Hello everybody,

the old thread seems to be sooooo looooong - therefore I decided (after a discussion with our moderator oreeh - thanks Oliver -) to start a new thread here.

Oliver will make a few links between the old and the new one and then he will close the old thread.

Thanks for joining in.

Reg

Christian

574 Replies
beckhamk
Enthusiast
Enthusiast

SERVER TYPE: Windows 2012 R2 64bit 1xvCPU 2GB

CPU TYPE / NUMBER: Intel Xeon E5680 Processor

HOST TYPE: PowerEdge R610 / QLE2562 8GB FC

STORAGE TYPE / DISK NUMBER / RAID LEVEL:  Tegile 2300 / 14HD (7x7) 7.2k RAID10 + 6 SSD

                                                                                                                                                                                                                                                                                                                                                                                    

Test nameLatencyAvg iopsAvg MBpscpu load
Max Throughput-100%Read2.41592443780037%
RealLife-60%Rand-65%Read3.080717359142.2042%
Max Throughput-50%Read2.092228036918.7145%
Random-8k-70%Read3.037417209140.9845%
Reply
0 Kudos
alexxdavid
Contributor
Contributor

SERVER TYPE: WIndows Server 2012 R2

CPU TYPE / NUMBER: 2 x E5-2630 2.3Ghz 128GB

HOST TYPE: Dell R720 2 x 6gbps SAS Card

STORAGE TYPE / DISK NUMBER / RAID LEVEL: Powervault MD3200 24 x 300GB 10K rpm RAID 6 Dynamic Disk Pool

Test nameLatencyAvg iopsAvg MBpscpu load
Max Throughput-100%Read1.443774111790%
RealLife-60%Rand-65%Read16.832513190%
Max Throughput-50%Read4.06141524420%
Random-8k-70%Read16.452326180%

Are those stats ok?

Reply
0 Kudos
alexxdavid
Contributor
Contributor

Results with same setup on Raid 10 with 22 Disks

Is it worth sticking to Raid 10 and losing half the size or the performance of the Raid 6 is decent enough?

SERVER TYPE: Windows Server 2012 R2

CPU TYPE / NUMBER: 2 x E5-2630 2.3Ghz 128Gb Ram

HOST TYPE: Dell R720 2 x 6gb Sas

STORAGE TYPE / DISK NUMBER / RAID LEVEL: Powervault MD 3220 22 x 300GB 10K rpm Raid 10 + 2 Spare

Test nameLatencyAvg iopsAvg MBpscpu load
Max Throughput-100%Read0.663768811770%
RealLife-60%Rand-65%Read7.585988460%
Max Throughput-50%Read4.13135964240%
Random-8k-70%Read7.585610430%
Reply
0 Kudos
alexxdavid
Contributor
Contributor

Is that even possible from a DELL Powervault MD3220 with 22 x 300GB 10K RPM Raid 10 ?

Using 2 workers doing the tests to 1 Virtual disk on each controller. Test file is 8 GB for each VD. There is 1 sas cable to each controller and don't understand how I am able to reach nearly 2400MB/s???

Test nameLatencyAvg iopsAvg MBpscpu load
Max Throughput-100%Read0.593774711790%
0.613764911760%
RealLife-60%Rand-65%Read13.063137240%
12.793236250%
Max Throughput-50%Read4.91114713580%
4.80115593610%
Random-8k-70%Read12.772892220%
12.393044230%
Reply
0 Kudos
dennes
Enthusiast
Enthusiast

Ik ben do 20 en vr 21 maart niet aanwezig en kan uw email niet beantwoorden.

Neem svp. contact op met kantoor bij dringende zaken.

013-5115088 / helpdesk@feju.nl

Groeten,

Dennes Meeusen

Bekijk hier<https://urldefense.proofpoint.com/v1/url?u=http://www.feju.nl/media/magazine/feju_magazine_2014_1.pdf&k=oIvRg1%2BdGAgOoM1BIlLLqw%3D%3D%0A&r=FGyPC8ZSvBkKihkoeKgCmjuZI2qYJ8xvSchS1aM1v%2Fc%3D%0A&m=TJ0B0E%2FPWRvL8ExWR7DoxVpnfGqvv%2F2Fnoh3aLSgRIQ%3D%0A&s=eb3e7d0dfa0a43c68d72aa113c91e183f637e724a686fe89468ccd5b6f434433> de eerste uitgave van ons Féju Magazine!

Reply
0 Kudos
dam09fr
Contributor
Contributor

Test of Synology DSM 5.0 RW SSH cache :


SERVER TYPE: Windows 2008 R2, 2 vCPU, 4GB RAM, 60GB hard disk

CPU TYPE / NUMBER: Intel X6550, 2 CPU

HOST TYPE: Dell PowerEdge R710, 64GB RAM, 2x E5-2660 (2.66 GHz), 4x1GB/s ISCSI ports

ISCSI LAN: 2x PowerConnect 6224 (MTU 9000)

STORAGE TYPE / DISK NUMBER / RAID LEVEL: Synology DS1813+ DSM 5.0 (3x1GB/s ISCSI ports) - 6 SATA 10K 500GB (WD Velociraptor) - RAID5

Test nameLatencyAvg iopsAvg MBpscpu load
Max Throughput-100%Read10.0658471822%
RealLife-60%Rand-65%Read62.5579060%
Max Throughput-50%Read16.1534831081%
Random-8k-70%Read71.2469350%

STORAGE TYPE / DISK NUMBER / RAID LEVEL: Synology DS1813+ DSM 5.0 (3x1GB/s ISCSI ports) - 6 SATA 10K 500GB (WD Velociraptor) - RAID5 + 2 SSD Crucial M4 256GB (RW cache)

Test nameLatencyAvg iopsAvg MBpscpu load
Max Throughput-100%Read22.862671831%
RealLife-60%Rand-65%Read177.2533120%
Max Throughput-50%Read65.26916280%
Random-8k-70%Read176.3332620%

I don't understant why these results are so bad ...

Reply
0 Kudos
pinkerton
Enthusiast
Enthusiast

Sehr geehrte Damen und Herren,

ich bin erst am 07.04.2014 wieder erreichbar. Bitte wenden Sie sich in dieser Zeit an support@mdm.de.

Freundliche Grüße

Michael Groß

Reply
0 Kudos
ercankorkmaz
Contributor
Contributor

SERVER TYPE: Windows Server 2012 R2 Standart                                                                                          

CPU TYPE / NUMBER: Intel Xeon CPU E5-2403 1.80 gHZ (2 CPUs)                                                           

HOST TYPE: Intel® Server System R1304BB4DC                                                                                              

STORAGE TYPE / DISK NUMBER / RAID LEVEL: Local Disks, INTEL INTEGRATED RAID MODULE RMS25PB080, 4x3 TB WD-Se-SATA-64MB-CACHE-WD3000F9YZ, RAID1

Test name

Latency

Avg iops

Avg MBps

Cpu load

Max Throughput-100%Read

  1. 0.26

73195

2287

0%

RealLife-60%Rand-65%Read

  1. 109.26

418

3

0%

Max Throughput-50%Read

  1. 4.81

11221

350

0%

Random-8k-70%Read

  1. 113.33

456

3

0%

SERVER TYPE: Windows Server 2012 R2 Standart                                                                                          

CPU TYPE / NUMBER: Intel Xeon CPU E5-2403 1.80 gHZ (2 CPUs)                                                           

HOST TYPE: Intel® Server System R1304BB4DC                                                                                              

STORAGE TYPE / DISK NUMBER / RAID LEVEL: Local Disks, INTEL INTEGRATED RAID MODULE RMS25PB080, 4x3 TB WD-Se-SATA-64MB-CACHE-WD3000F9YZ, RAID5

Test name

Latency

Avg iops

Avg MBps

Cpu load

Max Throughput-100%Read

  1. 0.23

70834

2213

6%

RealLife-60%Rand-65%Read

  1. 123.03

408

3

3%

Max Throughput-50%Read

  1. 8.05

7038

219

12%

Random-8k-70%Read

  1. 128.13

401

3

2%

SERVER TYPE: Windows Server 2012 R2 Standart                                                                                           

CPU TYPE / NUMBER: Intel Xeon CPU E5-2403 1.80 gHZ (2 CPUs)                                                           

HOST TYPE: Intel® Server System R1304BB4DC                                                                                              

STORAGE TYPE / DISK NUMBER / RAID LEVEL: Local Disks, INTEL INTEGRATED RAID MODULE RMS25PB080, 4x3 TB WD-Re-SATA-64MB-CACHE-WD3000FYYZ, RAID1                                                          

Test name

Latency

Avg iops

Avg MBps

Cpu load

Max Throughput-100%Read

  1. 0.36

76296

2384

0%

RealLife-60%Rand-65%Read

  1. 37.10

1201

9

0%

Max Throughput-50%Read

  1. 4.80

11642

363

0%

Random-8k-70%Read

  1. 44.59

1109

8

0%

SERVER TYPE: Windows Server 2012 R2 Standart                                                                                           

CPU TYPE / NUMBER: Intel Xeon CPU E5-2403 1.80 gHZ (2 CPUs)                                                           

HOST TYPE: Intel® Server System R1304BB4DC                                                                                              

STORAGE TYPE / DISK NUMBER / RAID LEVEL: Local Disks, INTEL INTEGRATED RAID MODULE RMS25PB080, 4x3 TB WD-Re-SATA-64MB-CACHE-WD3000FYYZ, RAID5                                                          

Test name

Latency

Avg iops

Avg MBps

Cpu load

Max Throughput-100%Read

  1. 0.28

75096

2346

8%

RealLife-60%Rand-65%Read

  1. 43.86

1087

8

4%

Max Throughput-50%Read

  1. 6.55

8670

270

5%

Random-8k-70%Read

  1. 52.48

978

7

0%

SERVER TYPE: Windows Server 2012 R2 Standart                                                                                           

CPU TYPE / NUMBER: Intel Xeon CPU E5-2403 1.80 gHZ (2 CPUs)                                                           

HOST TYPE: Intel® Server System R1304BB4DC                                                                                              

STORAGE TYPE / DISK NUMBER / RAID LEVEL: Local Disks, INTEL INTEGRATED RAID MODULE RMS25PB080, 4x3 TB WD-RE-SAS-32MB-CACHE-WD3001FYYG, RAID1      

                                                                                                                                    

Test name

Latency

Avg iops

Avg MBps

Cpu load

Max Throughput-100%Read

  1. 0.23

72735

2272

16%

RealLife-60%Rand-65%Read

  1. 17.95

2602

20

11%

Max Throughput-50%Read

  1. 15.03

3285

102

11%

Random-8k-70%Read

  1. 15.66

2846

22

8%

SERVER TYPE: Windows Server 2012 R2 Standart                                                                                           

CPU TYPE / NUMBER: Intel Xeon CPU E5-2403 1.80 gHZ (2 CPUs)                                                           

HOST TYPE: Intel® Server System R1304BB4DC                                                                                              

STORAGE TYPE / DISK NUMBER / RAID LEVEL: Local Disks, INTEL INTEGRATED RAID MODULE RMS25PB080, 4x3 TB WD-RE-SAS-32MB-CACHE-WD3001FYYG, RAID5             

Test name

Latency

Avg iops

Avg MBps

Cpu load

Max Throughput-100%Read

  1. 0.24

74963

2342

13%

RealLife-60%Rand-65%Read

  1. 19.39

2414

18

14%

Max Throughput-50%Read

  1. 41.10

1307

40

25%

Random-8k-70%Read

  1. 16.97

2611

20

14%

Reply
0 Kudos
yobhoohboy
Contributor
Contributor

Hi everyone, this has been a good thread to go through. Being a noob, I've learned a lot reading through some of the posts, despite the fact that I think some people need to be reminded of forum etiquette (why all the out of office posts?)...

Anyway, I'm trying to run the IOmeter script but I'm having trouble parsing the data here: http://vmktree.org/iometer/

When I open the CSV file, select ALL, copy, then paste in the window where it says "Paste content of results.csv file here", all the results are showing 0s.

I am running IOmeter 2007.06.27 under Windows.  Is there a trick to using that parser, I have gone through all 37 pages of this post to no avail.

What am I doing wrong???

Thanks in advance!

Reply
0 Kudos
larstr
Champion
Champion

Hi,

There should not be a trick to pasting the results.

Can you try open the csv file in Excel/Lotus123 and see if you see only zeros there as well? If not, can you try posting the csv file here?

Lars

Reply
0 Kudos
yobhoohboy
Contributor
Contributor

That is super weird, I also tried from home from another computer and I'm getting the same issue in the parser, all 0s.  Is the parser no Chrome friendly? I tried deleting the "Paste content of results.csv file here" and pasting the contents, as well as not deleting that line and then pasting the contents below it...

Attached is one of the result.csv files. I'm just playing around getting to know IOmeter a little big before I do some testing on the SAN.

Thank you in advance!

Reply
0 Kudos
larstr
Champion
Champion

I tested it from both Chrome and Firefox and get:

Test nameLatencyAvg iopsAvg MBpscpu load
RealLife-60%Rand-65%Read44.2733127%

It weird you're not getting the same results...

Lars

Reply
0 Kudos
yobhoohboy
Contributor
Contributor

Hey Lars, thanks for checking.  I watched that video on the page again thinking I'm doing something wrong... and I didn't seem to be.

Then I noticed that in the video, when the file contents is pasted, it doesn't include blank lines between the lines of data.

When I open the file in Excel, I hit CTRL-A and then CTRL-C, then I paste it in the parser, for some reason there is a blank line after each line of data. Not sure why it does that, but I opened it in Notepad instead, copied and pasted and now it works fine.

I'm using Excel 2007, just double clicking the CSV file as I have CSV associated with Excel.

In any case, it's now working and I appreciate you checking this!

Cheers,

Cris

Reply
0 Kudos
larstr
Champion
Champion

Cris,

It's great that you solved the problem. Good luck with your upcoming SAN testing!

Lars

Reply
0 Kudos
steait
Contributor
Contributor

Server: 2012R2 VM Guest on ESXi 5.1

Storage: ZFS on OmniOS

Protocol: iSER over Infiniband

Test NameAverage Response TimeIOpsMiBps (Binary)% CPU Utilization
Max Throughput-100%Read0.4345241141350
RealLife-60%Rand-65%Read1.991372710721
Max Throughput-50%Read1.252262170631
Random-8k-70%Read2.39119559318
Reply
0 Kudos
larstr
Champion
Champion

SERVER TYPE: Windows 7 x64 VM with single vcpu, Running on ESXi 5.5U2

CPU TYPE / NUMBER: 2 x Intel Xeon E-2695 v2

HOST TYPE: Dell R720

STORAGE TYPE / DISK NUMBER / RAID LEVEL: vSAN, 3 hosts, PERC H710p, 2 disk groups per host, 6x 10k rpm SAS+1 SLC SSD per disk group, 16 gigabyte iometer test file

Test nameLatencyAvg iopsAvg MBpscpu load
Max Throughput-100%Read7.72782024434%
RealLife-60%Rand-65%Read9.1854364245%
Max Throughput-50%Read11.48469314638%
Random-8k-70%Read11.2536542862%

Following is from vSAN Observer during the test that was run from a single VM. The huge write we see in the beginning is the creation of the iometer test file that is getting filled with zeros.

vsan observer.jpg

Lars

Reply
0 Kudos
Bulkas
Contributor
Contributor

Test nameLatencyAvg iopsAvg MBpscpu load
Max Throughput-100%Read1.2047686149021%
RealLife-60%Rand-65%Read12.0535722715%
Max Throughput-50%Read1.5836278113320%
Random-8k-70%Read11.9633612615%

SERVER TYPE: HP DL320e

CPU TYPE / NUMBER: e3-1230v2

HOST TYPE: ESXI5.5U2

STORAGE TYPE / DISK NUMBER / RAID LEVEL: 12GSAS DELL MD3420 RAID10 8x10K

OpenPerformanceTest32.icf (32GB) VMFS DATASTORE 200GB VMDK 40GB THICK EZ

Reply
0 Kudos
merkproctor
Contributor
Contributor

Anybody else testing a Flash Array?  I'm not seeing anyone posting anything close to this.  Thx

SERVER TYPE:  VMware 6.0 Windows 2012 Server R2 X64
CPU TYPE / NUMBER: 4 Intel Zeon E7-4850 2.40 GHz 12 core 30MB cache
HOST TYPE: Cisco UCS B420 M3 Server
STORAGE TYPE / DISK NUMBER / RAID LEVEL: Nimbus Gemini F400 All Flash Array 8GB>>UCS

Test nameLatencyAvg iopsAvg MBpscpu load
Max Throughput-100%Read2.302567080220%
RealLife-60%Rand-65%Read0.856113847720%
Max Throughput-50%Read1.3840469126421%
Random-8k-70%Read0.856181748220%

Reply
0 Kudos
shrklet
Contributor
Contributor

TYPE:  Physical

SERVER TYPE:  Windows 2012 R2

CPU TYPE / NUMBER: 2 x Intel E5-2630-V3

HOST TYPE: HP ML350 Gen9

STORAGE TYPE / DISK NUMBER / RAID LEVEL:  Datacore SSY-V10 PSP2 - All Flash (sharklet.ch designed and engineered)

power.jpg

Reply
0 Kudos
Mike_b79
Contributor
Contributor

SERVER TYPE: Windows Server 2012 R2, 4vCPU, 8GB RAM 
CPU TYPE / NUMBER: 2x Xeon E5-2670 v3
HOST TYPE: Cisco UCS B200 M4
STORAGE TYPE / DISK NUMBER / RAID LEVEL: EMC VNX 5400, 400GB SSD/900GB SAS/4TB NL-SAS pool, 400GB FAST Cache
Test nameLatencyAvg iopsAvg MBpscpu load
Max Throughput-100%Read2.99188035879%
RealLife-60%Rand-65%Read2.22144051126%
Max Throughput-50%Read3.001828757126%
Random-8k-70%Read1.99149061166%
Reply
0 Kudos