VMware
1 2 3 4 5 ... 11 Previous Next 150 Replies Last post: Nov 17, 2009 12:29 PM by Mindflux   Go to original post

Re: New !! Open unofficial storage performance thread

30. Apr 16, 2009 2:50 PM in response to: _VR_
Click to view ablej's profile Hot Shot 131 posts since
Feb 19, 2008
This is FC using VMFS LUN fr. I can't currently run a test om a physical box. We don’t have any physical host connected to the SAN.

Re: New !! Open unofficial storage performance thread

31. Apr 17, 2009 4:54 AM in response to: ablej
Click to view _VR_'s profile Novice 19 posts since
Apr 22, 2008
The latency is low and read throughput is good. 50% Read takes a big hit and the RealLife and Random tests are just awful. This indicates that the SAN can't keep up with the writes.

Was the system under heavy load from other hosts when you performed this test? I'm not too familiar with NetApp, but is it possible that it was running some cleanup/defrag/verification jobs in the background? I also heard that performance can degrade as the aggregate gets close to full capacity.

Maybe someone with better knowledge of NetApp can contribute.

Re: New !! Open unofficial storage performance thread

32. Apr 17, 2009 7:42 AM in response to: ablej
Click to view JohnADCO's profile Expert 245 posts since
Feb 9, 2009

How many VM's are you running on the same LUN? Any real hard hitting VM's? Only takes one sometimes. It could be iSCSI reservation issues. Being over cautious I tend to put really hard hitting VM's on a dedicated lun. In pre implementation testing we were seeing somewhat similar numbers when we put certain VM's on the same lun with other certain VM's.

Our testing on all this was with a completely different san, may have no relation to your issue.

Re: New !! Open unofficial storage performance thread

33. Apr 17, 2009 9:37 AM in response to: ablej
Click to view larstr's profile Virtuoso 2,382 posts since
Mar 11, 2004
If you want to view the performance as seen from the san, vmktree can provide you with both IO/s and other stats for your LUNs as seen from ontap.

Lars

Attachments:

intel SSDs + Nexenta ZFS raidZ1

34. Apr 21, 2009 2:11 PM in response to: christianZ
Click to view radimf's profile Novice 23 posts since
Nov 7, 2006

Hallo, here are my results for Nexenta storage appliance SUPERMICRO storage server with Intel X25-E SSDs.

I have trouble reaching better sequential results - any hints for config of MPIO welcommed.

Disks are dong 600mb/s seq. internally - so network missconfig is the trouble.

Random numbers are very nice as expected from SSDs :)

SERVER TYPE: PHYS
CPU TYPE / NUMBER: CPU / 2
HOST TYPE: DL380 G4, 8GB RAM; 2X old XEON 3.60 GHZ
STORAGE
TYPE / DISK NUMBER / RAID LEVEL: Nexenta 1.1.7 COMSTAR, Supermicro
storage server SAS backplane, LSI1068, 3 x intel X-25E SSDs raidZ1
(raid 5) , 8GB ram 1xXeon 2.5Ghz QC
NOTES: 2 intel onboard 1gbit NICs, MS iSCSI, jumbo, flowcontrol ON,
ntfs aligned at 64, default alloc, MSFT mpio on the same subnet
(probably wrong config)

##################################################################################
TEST NAME-------------------Av. Resp. Time ms------Av. IOs/sek-------Av. MB/sek------
##################################################################################

Max Throughput-100%Read........____17.7____..........___3344____.........___104_____ CPU 20.65

RealLife-60%Rand-65%Read.......___9.49____..........___5732____.........___44.8___ CPU 17.8

Max Throughput-50%Read.........____10.64____..........___5148____.........___160_____ CPU 26.6

Random-8k-70%Read..............___13.02____..........___4107____.........___32.08___ CPU 14.31

################################################################################

Click to view _VR_'s profile Novice 19 posts since
Apr 22, 2008
Impressive results on a new Nehalem based server. 45% improvement in RealLife & Random over a DL380 G5 with the same disk configuration. 100% improvement in Max Throughput-50%Read. Most likely thanks to DD3.

SERVER TYPE: PHYS (X5560)
CPU TYPE / NUMBER: CPU / 2
HOST TYPE: DL380 G6, 36GB RAM; 2X XEON 5560, 2.80 Ghz QC
STORAGE TYPE / DISK NUMBER / RAID LEVEL: DAS (Smart Array P410, 512MB BBWC) / 8 Disks (10K SAS) / R10


##################################################################################
TEST NAME-------------------Av. Resp. Time ms------Av. IOs/sek-------Av. MB/sek------
##################################################################################

Max Throughput-100%Read........____2.22____..........____26382___.........____824____

RealLife-60%Rand-65%Read.......___12.04____.........._____2886___.........____22.54__

Max Throughput-50%Read.........____1.49____..........____37100___.........____1159___

Random-8k-70%Read..............___13.49____.........._____2803___.........____21.90__

EXCEPTIONS: CPU Util.-XX%;

##################################################################################
Click to view eagleh's profile Hot Shot 166 posts since
May 14, 2008
Hi there,

I have done two tests on a physica server and a vm. Any comments? Is there anything that is very "unexpected"? It seems the Average Response Time is much higher comapred with other results people posted here. I may run other tests if you are interested. Thanks.


One comparison on my DG1 (16x500G, 7200 rpm FATA disks)

++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
TABLE of RESULTS - Physical Machine
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++

SERVER TYPE: PHYS.
CPU TYPE / NUMBER: 1 (dual core) Intel Xeon 3.4GHz
HOST TYPE: HP DL360 G4, 4GB RAM
STORAGE TYPE / DISK NUMBER / RAID LEVEL: HP SAN EVA4000 / 16x500G Disks FATA 7200 rpm / RAID5

##################################################################################
TEST NAME-------------------Av. Resp. Time ms------Av. IOs/sek-------Av. MB/sek------
##################################################################################

Max Throughput-100%Read........___4.86______..........___11678.58_______.........___364.95_______

RealLife-60%Rand-65%Read......___41.24_______..........____499.07______.........___3.89_______

Max Throughput-50%Read..........___17.59_______..........___498.37_______.........__15.57________

Random-8k-70%Read.................___47.65_______..........___500.71_______.........____3.91______

##################################################################################

++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
TABLE of RESULTS -Virtual Machine
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++

SERVER TYPE: VM on ESX3.5.
CPU TYPE / NUMBER: 1 vCPU
HOST TYPE: HP DL360 G5, 2GB RAM
STORAGE TYPE / DISK NUMBER / RAID LEVEL: HP SAN EVA4000 / 16x500G Disks FATA 7200 rpm / RAID5
DRIVE CONNECTION: raw mapping device

##################################################################################
TEST NAME-------------------Av. Resp. Time ms------Av. IOs/sek-------Av. MB/sek------
##################################################################################

Max Throughput-100%Read........___11.95______..........___4738.54_______.........___148.07_______

RealLife-60%Rand-65%Read......___58.57_______..........____499.91______.........___3.90_______

Max Throughput-50%Read..........___2.17_______..........___2080.48_______.........__65.01________

Random-8k-70%Read.................___68.63_______..........___463.551_______.........____3.62______

##################################################################################

Re: New !! Open unofficial storage performance thread

37. Apr 23, 2009 11:15 AM in response to: eagleh
Click to view radimf's profile Novice 23 posts since
Nov 7, 2006

Hallo,

any chance, that you could post RAID1 numbers for FC drives?

Regards,

Radim

Re: New !! Open unofficial storage performance thread

38. Apr 23, 2009 11:19 AM in response to: radimf
Click to view eagleh's profile Hot Shot 166 posts since
May 14, 2008

Sorry, all my SAN disks are configured in RAID5. There are two DG.

1>16 Disks (FATA 7200rpm)
2>32 Disks (FC 10krpm)

Thanks,

Eagle

Re: New !! Open unofficial storage performance thread

39. Apr 23, 2009 11:39 AM in response to: eagleh
Click to view eagleh's profile Hot Shot 166 posts since
May 14, 2008
Another comparison on my DG2 (32x146G, 10k rpm FC disks)

++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
TABLE of RESULTS - Physical Machine
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++

SERVER TYPE: PHYS.
CPU TYPE / NUMBER: 1 (dual core) Intel Xeon 3.4GHz
HOST TYPE: HP DL360 G4, 4GB RAM
STORAGE TYPE / DISK NUMBER / RAID LEVEL: HP SAN EVA4000 / 32x146G Disks FC 10k rpm / RAID5

##################################################################################
TEST NAME-------------------Av. Resp. Time ms------Av. IOs/sek-------Av. MB/sek------
##################################################################################

Max Throughput-100%Read........___4.88______..........___11704.48_______.........___365.76_______

RealLife-60%Rand-65%Read......___10.08_______..........____500.58______.........___3.91_______

Max Throughput-50%Read..........___6.10_______..........___918.49_______.........__28.70________

Random-8k-70%Read.................___11.98_______..........___502.17_______.........____3.92______

##################################################################################

++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
TABLE of RESULTS - Virtual Machine
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++

SERVER TYPE: VM on ESX3.5.
CPU TYPE / NUMBER: 1 vCPU
HOST TYPE: HP DL360 G5, 2GB RAM
STORAGE TYPE / DISK NUMBER / RAID LEVEL: HP SAN EVA4000 / 32x146G Disks FC 10k rpm / RAID5

##################################################################################
TEST NAME-------------------Av. Resp. Time ms------Av. IOs/sek-------Av. MB/sek------
##################################################################################

Max Throughput-100%Read........___11.38______..........___5066.89_______.........___158.34_______

RealLife-60%Rand-65%Read......___11.48_______..........____501.67______.........___3.91_______

Max Throughput-50%Read..........___1.65_______..........___2177.76_______.........__68.05________

Random-8k-70%Read.................___12.82_______..........___502.07_______.........____3.92______

##################################################################################

Click to view larstr's profile Virtuoso 2,382 posts since
Mar 11, 2004
Something must be wrong here. You get only 500 IOPS (Random & RealLife) with 32 FC drives. These numbers are not very good, so you should probably check if there's anything wrong with your SAN setup.

Lars
Click to view _VR_'s profile Novice 19 posts since
Apr 22, 2008
eagleh,

The performance numbers for the 32 disk SAN are very poor. You should be seeing much better numbers for RealLife/Random. The Max Throughput Read test looks good so I don't think the FC network is at fault. Were there any heavy writes from other systems while the test was performed? A failed disk in a RAID 5 can also have the same affect (fast reads/slow writes).

Re: New !! Open unofficial storage performance thread

42. Apr 28, 2009 7:35 AM in response to: _VR_
Click to view eagleh's profile Hot Shot 166 posts since
May 14, 2008

Thanks VR!!! I am engaging HP engineer to look into this issue now.
Click to view eagleh's profile Hot Shot 166 posts since
May 14, 2008

Thanks larstr. I am engaging HP to look into this issue now.
Click to view Valley911's profile Novice 7 posts since
Apr 6, 2009

Good thread, not sure if I am reading the output correctly in the CSV file. But here is what I get from my EMC CX4-120:

++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
TABLE OF RESULTS
++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++

SERVER TYPE: VM ON ESX 3.5 U3
CPU TYPE / NUMBER: VCPU / 1
HOST TYPE: HP DL380 G5, 24GB RAM; 4x XEON 5410(Quad), 2,33 GHz,
STORAGE TYPE / DISK NUMBER / RAID LEVEL: EMC CX4-120 / 4+1 / R5 / 14+1total disks

SAN TYPE / HBAs : 4GB FC HP StorageWorks FC1142SR (Qlogic)

MetaLUNS are configured with 200GB LUNs striped accross all 14 disks for total datastore size of 600GB

##################################################################################
TEST NAME-------------------Av. Resp. Time ms------Av. IOs/sek-------Av. MB/sek------
##################################################################################

Max Throughput-100%Read...............__6______..........___9320___.........___291____

RealLife-60%Rand-65%Read......___24_____..........__1638___.........____13____

Max Throughput-50%Read................____5____..........___11057___.........___345____

Random-8k-70%Read.................____23____..........___1800___.........____14____

EXCEPTIONS:

#################################################################################

-Jason

VMware Developer

SDKs, APIs, Videos, Learn and much more in the Developer community.

Learn More

Developer Sample Code

Increase your developer productivity with VMware API sample code.

Learn More

VMworld Sessions & Labs

Online access to the latest VMworld Sessions & Labs and online services.

Learn more

Purchase PSO Credits Online

Purchase credits to redeem training and consulting services online.

Buy Now

Community Hardware Software

View reported configurations or report your own.

Learn More

VMware vSphere

Come witness the next giant leap in virtualization.

Register Today

Communities