VMware
1 ... 7 8 9 10 11 Previous Next 150 Replies Last post: Nov 17, 2009 12:29 PM by Mindflux   Go to original post
Click to view Mnemonic's profile Enthusiast 53 posts since
Apr 13, 2005
Thank you. It is interesting to see the RAID comparisons.
Click to view sima3's profile Lurker 3 posts since
Sep 30, 2009
then it was worth testing it. thank you for your interrest.
Click to view meistermn's profile Master 1,158 posts since
Dec 7, 2004

So the raid raid triangle is still valid for different raid types . Raid 10 faster than Raid 5 faster than Raid 6. :)

This is still valid for harddisk. But what about the new sata ssd, pci ssd (fusion io) or flash storage (ramsan).

http://communities.vmware.com/servlet/JiveServlet/downloadImage/2-1130341-4793/raid-triangle.gif

Click to view Sebi!'s profile Novice 5 posts since
Aug 4, 2008

Hi,

so here are my test results. So that´s a productive environment with 16VMs on 3LUNs and 10VMs on local storage from the ESX Hosts. For the test I take a forth free LUN with 600GB and 265 segment size. So I´m new to the whole storage and IOps thing but I see that my performance isn´t very good. First i thought it´s my raid6 but then i saw the tests from sima3 which are much better.

Is there a difference between XP and 2003 for IOMeter tests? Does anyone have some tips for me? Thanks

SERVER TYPE: VM Windows XP, 2GB RAM
CPU TYPE / NUMBER: 2 VCPU
HOST TYPE: IBM x3650, 18GB RAM, 2x 5430, 2,6 GHz QC
STORAGE TYPE / DISK NUMBER / RAID LEVEL: IBM DS3400 (1024MB CACHE/Dual Cntr) 11x SAS 15k 300GB / R6
SAN TYPE / HBAs : FC, QLA2432 HBA

##################################################################################
TEST NAME-------------------Av. Resp. Time ms------Av. IOs/sek-------Av. MB/sek------
##################################################################################

Max Throughput-100%Read_____20_____2925_____91

RealLife-60%Rand-65%Read_____173_____345_____2

Max Throughput-50%Read_____35_____1687_____52

Random-8k-70%Read_____211_____283_____2

##################################################################################

regards

Sebastian

Click to view tfapps's profile Enthusiast 50 posts since
Aug 9, 2007
Try disabling your Antivirus sotware. I was surprisingly shocked when my numbers tripled just from disabling Symantec AV Auto Protect during the test.
Click to view Sebi!'s profile Novice 5 posts since
Aug 4, 2008

Hi again,

after tfapps gave me the AV tip I created a new VM with 2003 and wow my storage is fast. Here are my new results.

SERVER TYPE: VM Windows 2003, 1GB RAM
CPU TYPE / NUMBER: 1 VCPU
HOST TYPE: IBM x3650, 18GB RAM, 2x 5430, 2,6 GHz QC
STORAGE TYPE / DISK NUMBER / RAID LEVEL: IBM DS3400 (1024MB CACHE/Dual Cntr) 11x SAS 15k 300GB / R6
SAN TYPE / HBAs : FC, QLA2432 HBA

##################################################################################
TEST NAME-------------------Av. Resp. Time ms------Av. IOs/sek-------Av. MB/sek------
##################################################################################

Max Throughput-100%Read_____5_____11010_____344

RealLife-60%Rand-65%Read_____20_____1642_____12

Max Throughput-50%Read_____11_____5029_____157

Random-8k-70%Read_____20_____1790_____13

##################################################################################

Does anybody know how i can use the IOMeter to get the current IOps from a system? With the Idle Specification maybe? I wanna check some Notes and DB2 servers which are physical.

Thanks

Sebi


Click to view MKguy's profile Hot Shot 86 posts since
Sep 24, 2007
Just use esxtop or vscsistats for VMs.
http://communities.vmware.com/docs/DOC-10084
http://communities.vmware.com/docs/DOC-10095

For physical systems, use tools like iostat or perfmon. Note that IOPS are not always called that way in some tools.

Click to view manfriday's profile Enthusiast 55 posts since
May 17, 2007
SERVER TYPE: Windows XP VM w/ 1GB RAM on ESXi 4
CPU TYPE / NUMBER: VCPU / 1
HOST TYPE: Sun SunFire x4150, 48GB RAM; 2x XEON E5450, 2.992 GHz
STORAGE TYPE / DISK NUMBER / RAID LEVEL: Two EQL PS6000E's with / 14+2 SATA Disks / R50

##################################################################################
TEST NAME-------------------Av. Resp. Time ms------Av. IOs/sek-------Av. MB/sek------
##################################################################################

Max Throughput-100%Read….….15.025.……….…3915.89….....…..122.37

RealLife-60%Rand-65%Read……12.20..…..…..….3324.92.…..…….25.97

Max Throughput-50%Read….……13.18..………….4460.97….…..….139.40

Random-8k-70%Read….….….…..13.40….………..3033.14….…..…..23.69

EXCEPTIONS: CPU%= 44 - 66 - 40 - 63

Using iscsi w/ software initiator. 4 nics, each with a vmkernel assigned to it.

##################################################################################

This is from my pair of Equallogic PS6000E's.

The test was performed on a virtual disk that had not been formatted with NTFS.

I'm not sure if this was the right way to go about doing this test, or whether it should have been formatted with NTFS first.

Do these numbers seem right?

Click to view oparcollet's profile Enthusiast 105 posts since
Mar 14, 2006
SERVER TYPE: VM Windows Server 2008, 1GB RAM
CPU TYPE / NUMBER: 1 VCPU
HOST TYPE: SUN X4170, 24GB RAM, 2.5 GHz, Dual XEON NEHALEM
STORAGE TYPE / DISK NUMBER / RAID LEVEL: PILLAR DATA SYSTEMS AXIOM 500 (24 GB CACHE / 8 Ctrl) / 30 x SATA 7200 RPM /R5
SAN TYPE / HBAs : 1 x FC 4, QLOGIC 2432 using single path

##########################################################################
TEST NAME--------------------------Av. Resp. Time ms---------Av. IOs/sek---------------Av. MB/sek------
##########################################################################


Max Throughput-100%Read............ 5.4486.......................... 10965..................... 342.67 CPU=21%


RealLife-60%Rand-65%Read......... 1.4193......................... 34207..................... 286.78 CPU=47%


Max Throughput-50%Read.............. 4.7475.......................... 12176.................... 379.71 CPU=24%


Random-8k-70%Read..................... 1.3620.......................... 34443..................... 300.25 CPU=46%

############################################################################

Click to view s.buerger's profile Enthusiast 33 posts since
Jan 29, 2007

first test on new esx4.0, results as expected in compare to old tests with esx3.

SERVER TYPE:


Win2k8 64bit SP1 VM (4GB RAM, 100GB vmdk) on ESX 4.0


CPU TYPE /
NUMBER: VCPU / 4

HOST TYPE: HP
DL380G6 - 60GB RAM - 2x Xeon5560 2.8GHz Quadcore

STORAGE TYPE /
DISK NUMBER / RAID LEVEL: Equallogic PS3700X / 16x 400GB 10k 3,5" SAS /
Raid 50
SAN TYPE / HBAs : iSCSI; 3x vmk <-> 3x GB pNIC (3 different Intel ET 1000
Quad Port), Jumbo Frames, vmware Round Robin

##################################################################################
TEST NAME-------------------Av. Resp. Time ms------Av. IOs/sek-------Av.
MB/sek------
##################################################################################

Max Throughput-100%Read 14.3370 4169.41 130.18
VMWare shows 140MB read on that vmhba while
benchmark running
RealLife-60%Rand-65%Read 13.9840 3302.82 25.80
Max Throughput-50%Read 12.5621 4768.15 149.00
Random-8k-70%Read 14.8072 3104.66 24.26

EXCEPTIONS: CPU Util.-10-5-5-10%

Click to view slanger's profile Enthusiast 67 posts since
Jul 27, 2006
Hi all - heres the result of several tests over the course of the day averaged together for our EVA 6000.

What I can't figure out is why the "MAX Thoroughput-50%Read" IOPS are so low and response time so high... any ideas? the rest of the numbers lookgood AFAIK.

+++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
SERVER TYPE: VM – Windows 2003 STD r2 SP2
CPU TYPE / NUMBER: VCPU / 1
HOST TYPE: HP DL585 G2, 128GB RAM; 4x DualCore AMD Opteron 8220, 2.8GHz
STORAGE TYPE / DISK NUMBER / RAID: EVA 6100 / 98x 300GB 10k FC / R5
Notes: 12GB RDM attached to VM, IOMeter
run on RAW disk (no FS)

Test Name Av Resp Time ms Av IOPS Av MB/s Av CPU Utl
Max Throughput-100%Read 5.73 10361 24 41
RealLife-60%Rand-65%Read 10.16 3918 31 56
Max Throughput-50%Read 73.84 788 25 14
Random-8k-70%Read 11.89 2798 22 61

Click to view larstr's profile Virtuoso 2,382 posts since
Mar 11, 2004
Your results are similar (but slighly below) to those I had on a syncmirrored pair of EVA6400's with 23 and 48 disks here: http://communities.vmware.com/thread/197844?start=90&tstart=0

Do you have any HP agents installed on your ESX hosts? It seems they will per default issue scsi reservations every 60 seconds that will affect your performance negatively.

See here: http://docs.hp.com/en/5991-2731/ch02s04.html

hpimafcad polls the FC hbas which in turn results in scsi reservations.

Lars
Click to view slanger's profile Enthusiast 67 posts since
Jul 27, 2006

Lars... We are indeed running the HP agents (8.2.5) so I just went ahead and disabled all the SNMP agents during testing and im getting the same results so I don't think they are skewing anything.

I did however realise that I have read caching and write through enabled on the test lun so I turned that off and I'm now +getting MUCH lower IO readings and Much higher latencies. +

My question is are the results posted on this board... yours with the 6400 for instance, with read and write caching on or off for the lun? thanks.

My results are also going to be skewed becasue I am running the IOMETER test on production ESX boxes that are running workloads of 20-30VMs each at time of testing, thats why I tried to do tests at different times of the day and average them all together.

Click to view JRink's profile Hot Shot 151 posts since
Jan 10, 2007
Sorry for the ignorance. I am very new to IOMETER and I'm really trying to understand how to run these tests. Few questions...

1. When running these tests from inside a VM, should I be running them on a yellow icon (the VMs drive c: drive itself), or should I be creating a new unformatted drive that will show up in blue? Are people standardizing here?

2. Should I be using the .ICF file from the "original" storage performance thread?

3. When running these tests, are people running them on LUNs in production with VMs on them? Off-hours so disk activity is minimal? For example, my ESX box is connected to a iSCSI SAN with a single LUN/'Datastore on it that has 10 VMs. Should I just run the tests during normal hours? Or are people shutting down all VMs on the Datastore before running these, etc.??

4. I am really confused about the results people are posting. Everyone lists a Av. IOs/sek column, and a Av. MB/sek column, but I don't even see those in my csv results file (??). Are those the same as Total I/O's per second and Total MB's per second in my spreadsheet? If not, where am I supposed to look?

5. Which of the 4 tests are the best idea for how overall VM performance would be?

Sorry for the ignorance.

ESXi 4, Dell R610 & MD3000i Results

149. Nov 17, 2009 9:23 AM in response to: christianZ
Click to view smaat's profile Lurker 2 posts since
Jan 8, 2009
ESXi 4
MD3000i Dual Controller w/300GB 15K SAS (Hitachi)
2 x Dell R610 (32MB, 4xE5520@2.27GHz, 4xBroadcom Embeded, 1 Intel Quad GBe Card)
2 x PowerConnect 5424 dedicated to iSCSI

Using Configuration Guidelines from Dell Business Ready Solutions Guide:

http://content.dell.com/hk/en/business/d/business~solutions~engineering-docs~en/Documents~Dell_Virtualization_Availability_Solution.pdf.aspx

Windows 2003 Server R2 (32Bit)
6/1 Disk - Raid 5
Jumbo Frames
  IOPs MB/s Avg RT CPU
MAX Throughput-100%Read 3702.74 115.71 16.26 --
RealLife-60%Rand-65%Read 2019.69 15.78 23.47 --
Max Throughput-50%Read 3649.02 114.03 16.80 --
Random-8k-70%Read 2062.32 16.11 21.37 --

Windows 2003 Server R2 (32Bit)
4 Disk - Raid 10
Jumbo Frames

  IOPs MB/s Avg RT CPU
MAX Throughput-100%Read 4010.49 125.33 14.95 19.21
RealLife-60%Rand-65%Read 1766.44 13.80 28.42 33.38
Max Throughput-50%Read 3449.38 107.79 17.67 15.88
Random-8k-70%Read 1733.58 13.54 28.24 36.15

Windows 2008 Server R2 (64Bit)
8 Disk - Raid 10
Jumbo Frames

  IOPs MB/s Avg RT CPU
MAX Throughput-100%Read 4026.03 125.81 14.89 19.45
RealLife-60%Rand-65%Read 2959.78 23.12 16.69 34.38
Max Throughput-50%Read 3778.54 118.08 15.78 18.81
Random-8k-70%Read 3002.24 23.45 16.17 36.97


Windows 2008 Server R2 (64Bit)
8 Disk - Raid 10
No Jumbo Frames
  IOPs MB/s Avg RT CPU
MAX Throughput-100%Read 3991.21 124.21 15.02 19.95
RealLife-60%Rand-65%Read 2969.25 23.20 16.45 35.02
Max Throughput-50%Read 4984.29 155.76 12.01 20.39
Random-8k-70%Read 3078.36 24.05 15.68 38.43


Windows 2003 Server R2 (32Bit)
8 Disk - Raid 10
Jumbo Frames Enabled
  IOPs MB/s Avg RT CPU
MAX Throughput-100%Read 4012.90 125.40 14.95 18.72
RealLife-60%Rand-65%Read 3083.42 24.09 16.33 32.47
Max Throughput-50%Read 3453.48 107.92 17.66 15.84
Random-8k-70%Read 3218.32 25.14 15.30 36.15


Windows 2003 Server R2 (32Bit)
8 Disk - Raid 10
No Jumbo Frames
  IOPs MB/s Avg RT CPU
MAX Throughput-100%Read 3976.41 124.26 15.08 17.74
RealLife-60%Rand-65%Read 3081.79 24.08 16.33 32.59
Max Throughput-50%Read 3756.98 117.41 16.35 15.68
Random-8k-70%Read 3199.10 24.99 15.35 36.79


Simultaneous Tests (VM1 on ESX1 and VM2 on ESX2)

VM1(ESX1): Windows 2008 Server R2 (64Bit)
VM2(ESX2): Windows 2003 Server R2 (32Bit)
8 Disk - Raid 10
Jumbo Frames Enabled
  IOPs MB/s Avg RT CPU
VM1: RealLife-60%Rand-65%Read 1578.28 12.33 29.56 38.72
VM1: Max Throughput-50%Read 3497.63 109.30 16.30 18.56
VM2: RealLife-60%Rand-65%Read 1600.80 12.51 29.70 37.30
VM2: Max Throughput-50%Read 2928.81 91.53 20.15 18.69


VM1(ESX1): Windows 2008 Server R2 (64Bit)
VM2(ESX2): Windows 2003 Server R2 (32Bit)
8 Disk - Raid 10
No Jumbo Frames
  OPs MB/s Avg RT CPU
VM1: RealLife-60%Rand-65%Read 1633.00 12.76 28.40 38.79
VM1: Max Throughput-50%Read 4278.38 133.70 13.16 19.69
VM2: RealLife-60%Rand-65%Read 1552.82 12.13 30.94 36.87
VM2: Max Throughput-50%Read 2801.06 87.53 20.40 21.64

VMware Developer

SDKs, APIs, Videos, Learn and much more in the Developer community.

Learn More

Developer Sample Code

Increase your developer productivity with VMware API sample code.

Learn More

VMworld Sessions & Labs

Online access to the latest VMworld Sessions & Labs and online services.

Learn more

Purchase PSO Credits Online

Purchase credits to redeem training and consulting services online.

Buy Now

Community Hardware Software

View reported configurations or report your own.

Learn More

VMware vSphere

Come witness the next giant leap in virtualization.

Register Today

Communities