Part 3: Running 8 tests at one time on 2 ESX hosts (each with 4 VM's, each clones of each other).
The back-end for this test is split - I used 3 LeftHand DL320s, 36 x 15K 300GB SAS drives at
RAID 50 (at the host level) and then a both one-way (no replication) and two-way replicated volumes
for EACH host. (Eg, each host has its own volume to run off of). All tests run with a 3COM 4500G
as the switch.
All tests run on a non-formatted volume using
Microsoft iSCSI initaitor.
Sessions 1 -> 4 were on a 1-Way volume.
Session 1:
Frontend: IBM x3500, 2 Xeon 5140's, 5GB RAM, 2xIntel PCI-X teamed NICs, VMWare ESX 3.0.2, Win2K3 SP2 VM, 1MB BS, MS iSCSI Initiator
| TEST NAME |
Av. Resp. Time ms |
Av. IOs/sek |
Av. MB/sek |
CPU Use |
| Max Throughput-100%Read. |
32.990719 |
1,799.65 |
56.239195 |
52.94 |
| RealLife-60%Rand-65%Read |
44.732703 |
914.94 |
7.147985 |
58.46 |
| Max Throughput-50%Read |
29.608262 |
1,961.87 |
61.308413 |
54.70 |
| Random-8k-70%Read. |
44.877465 |
1,026.99 |
8.023367 |
50.79 |
Session 2:
Frontend: IBM x3500, 2 Xeon 5140's, 5GB RAM, 2xIntel PCI-X teamed NICs, VMWare ESX 3.0.2, Win2K3 SP2 VM, 1MB BS, MS iSCSI Initiator
| TEST NAME |
Av. Resp. Time ms |
Av. IOs/sek |
Av. MB/sek |
CPU Use |
| Max Throughput-100%Read. |
32.855391 |
1,806.96 |
56.467508 |
51.66 |
| RealLife-60%Rand-65%Read |
45.451255 |
909.93 |
7.108827 |
57.28 |
| Max Throughput-50%Read |
31.814684 |
1,865.16 |
58.286388 |
49.85 |
| Random-8k-70%Read. |
45.038477 |
1,015.53 |
7.933811 |
51.18 |
Session 3:
Frontend: HP DL385, 12GB RAM, 2xOpteron 2.6 DC, 2xIntel e1000 PCI-X teamed NICs, VMWare ESX 3.0.2, Win2K3 SP2 VM, 1MB BS, MS iSCSI Initiator
| TEST NAME |
Av. Resp. Time ms |
Av. IOs/sek |
Av. MB/sek |
CPU Use |
| Max Throughput-100%Read. |
38.523787 |
1,502.81 |
46.962704 |
50.29 |
| RealLife-60%Rand-65%Read |
46.062629 |
881.17 |
6.884125 |
57.69 |
| Max Throughput-50%Read |
62.866689 |
968.49 |
30.265301 |
31.65 |
| Random-8k-70%Read. |
45.212364 |
1,002.04 |
7.828432 |
51.38 |
Session 4:
Frontend: HP DL385, 12GB RAM, 2xOpteron 2.6 DC, 2xIntel e1000 PCI-X teamed NICs, VMWare ESX 3.0.2, Win2K3 SP2 VM, 1MB BS, MS iSCSI Initiator
| TEST NAME |
Av. Resp. Time ms |
Av. IOs/sek |
Av. MB/sek |
CPU Use |
| Max Throughput-100%Read. |
55.957563 |
1,070.46 |
33.451978 |
41.64 |
| RealLife-60%Rand-65%Read |
56.890474 |
790.74 |
6.177638 |
50.33 |
| Max Throughput-50%Read |
107.05434 |
554.62 |
17.331824 |
26.53 |
| Random-8k-70%Read. |
57.601321 |
830.74 |
6.490151 |
46.29 |
Sessios 5 -> 8 were on a 2-way volume:
Session 5:
Frontend: IBM x3500, 2 Xeon 5140's, 5GB RAM, 2xIntel PCI-X teamed NICs, VMWare ESX 3.0.2, Win2K3 SP2 VM, 1MB BS, MS iSCSI Initiator
| TEST NAME |
Av. Resp. Time ms |
Av. IOs/sek |
Av. MB/sek |
CPU Use |
| Max Throughput-100%Read. |
47.009389 |
1,268.83 |
39.650974 |
48.48 |
| RealLife-60%Rand-65%Read |
49.853864 |
878.28 |
6.861588 |
53.10 |
| Max Throughput-50%Read |
87.856369 |
691.62 |
21.613142 |
28.12 |
| Random-8k-70%Read. |
56.399108 |
834.95 |
6.523053 |
48.27 |
Session 6:
Frontend: IBM x3500, 2 Xeon 5140's, 5GB RAM, 2xIntel PCI-X teamed NICs, VMWare ESX 3.0.2, Win2K3 SP2 VM, 1MB BS, MS iSCSI Initiator
| TEST NAME |
Av. Resp. Time ms |
Av. IOs/sek |
Av. MB/sek |
CPU Use |
| Max Throughput-100%Read. |
47.319051 |
1,261.90 |
39.43428 |
49.67 |
| RealLife-60%Rand-65%Read |
104.975759 |
446.25 |
3.48632 |
42.61 |
| Max Throughput-50%Read |
54.936891 |
1,069.91 |
33.434719 |
43.62 |
| Random-8k-70%Read. |
109.253424 |
419.66 |
3.278631 |
44.73 |
Session 7:
Frontend: IBM x3500, 2 Xeon 5140's, 5GB RAM, 2xIntel PCI-X teamed NICs, VMWare ESX 3.0.2, Win2K3 SP2 VM, 1MB BS, MS iSCSI Initiator
| TEST NAME |
Av. Resp. Time ms |
Av. IOs/sek |
Av. MB/sek |
CPU Use |
| Max Throughput-100%Read. |
27.050811 |
2,209.13 |
69.03526 |
53.81 |
| RealLife-60%Rand-65%Read |
87.214384 |
508.69 |
3.974111 |
46.15 |
| Max Throughput-50%Read |
37.742076 |
1,578.58 |
49.330604 |
42.86 |
| Random-8k-70%Read. |
80.979612 |
535.10 |
4.180488 |
48.50 |
Session 8:
Frontend: IBM x3500, 2 Xeon 5140's, 5GB RAM, 2xIntel PCI-X teamed NICs, VMWare ESX 3.0.2, Win2K3 SP2 VM, 1MB BS, MS iSCSI Initiator
| TEST NAME |
Av. Resp. Time ms |
Av. IOs/sek |
Av. MB/sek |
CPU Use |
| Max Throughput-100%Read. |
38.51754 |
1,497.39 |
46.793515 |
49.15 |
| RealLife-60%Rand-65%Read |
113.306869 |
416.15 |
3.25118 |
41.35 |
| Max Throughput-50%Read |
43.552626 |
1,301.15 |
40.660856 |
46.37 |
| Random-8k-70%Read. |
119.105131 |
396.74 |
3.099504 |
40.83 |
Result summary:
Session Totals From 1-Way Sessions (1 ->4) - Response Time & CPU Use is AVERAGE, I/O's and MB/sec are SUMS
| TEST NAME |
Av. Resp. Time ms |
Av. IOs/sek |
Av. MB/sek |
CPU Use |
| Max Throughput-100%Read. |
40.081865 |
6,179.88 |
193.12139 |
49.13 |
| RealLife-60%Rand-65%Read |
48.28426525 |
3,496.78 |
27.318575 |
55.94 |
| Max Throughput-50%Read |
57.83599375 |
5,350.14 |
167.19193 |
40.68 |
| Random-8k-70%Read. |
48.18240675 |
3,875.30 |
30.275761 |
49.91 |
Session Totals From 2-Way Sessions (5 ->8) - Response Time & CPU Use is AVERAGE, I/O's and MB/sec are SUMS
| TEST NAME |
Av. Resp. Time ms |
Av. IOs/sek |
Av. MB/sek |
CPU Use |
| Max Throughput-100%Read. |
39.97419775 |
6,237.25 |
194.91403 |
50.44 |
| RealLife-60%Rand-65%Read |
88.44531931 |
4,867.86 |
38.030186 |
46.51 |
| Max Throughput-50%Read |
48.51689669 |
9,299.78 |
290.61811 |
43.38 |
| Random-8k-70%Read. |
89.38014344 |
5,226.80 |
40.834384 |
45.99 |
Session Totals From All Sessions (1 ->8) - Response Time & CPU Use is AVERAGE, I/O's and MB/sec are SUMS
| TEST NAME |
Av. Resp. Time ms |
Av. IOs/sek |
Av. MB/sek |
CPU Use |
| Max Throughput-100%Read. |
40.02803138 |
12,417.13 |
388.03541 |
49.79 |
| RealLife-60%Rand-65%Read |
68.36479228 |
8,364.64 |
65.348761 |
51.22 |
| Max Throughput-50%Read |
53.17644522 |
14,649.92 |
457.81003 |
42.03 |
| Random-8k-70%Read. |
68.78127509 |
9,102.10 |
71.110145 |
47.95 |
This was the best 'speed' test of all the bunches. With 388+ MB/sec for the 100% test, the MS iSCSI initator bested the ESX initator by about 60MB/sec with a similar test run. Also, with 12,400+ I/O sec - that's not too shabby. Best ESX iSCSI initator could pull with an 8-session test was just under 10,000. Random test was almost 20MB/sec faster as well - using ESX initiator, best result from an 8-session test was 45 MB/sec (with almost 6,000 I/O sec).