First (of a few) posts from my findings from Lefthand's iSCSI solution. This set of results is based upon a single VM running against a single volume on various hardware configurations.
Summary from these posts: HP DL385 seemed to push better numbers thanan IBM x3500. PCI-X cards did MUCH better than PCI-E, and Intel-based NICs beat the 3COM based NICs.
Backend: Lefthand - 3xDL 320s, 36x15K 300GB SAS, 1-Way Volume, 2xbonded on-board NICs, 3COM 4500G
Frontend: IBM x3500, 2 Xeon 5140's, 5GB RAM, 2x3COM PCI-X teamed NICs, VMWare ESX 3.0.2, Win2K3 SP2 VM, 1MB BS, ESX iSCSI Initiator
| TEST NAME |
Av. Resp. Time ms |
Av. IOs/sek |
Av. MB/sek |
CPU Use |
| Max Throughput-100%Read. |
16.892014 |
3,320.53 |
103.76661 |
38.89 |
| RealLife-60%Rand-65%Read |
20.443687 |
2,732.92 |
21.350962 |
30.53 |
| Max Throughput-50%Read |
16.81863 |
3,314.06 |
103.56453 |
35.93 |
| Random-8k-70%Read. |
19.378037 |
2,844.44 |
22.22215 |
32.08 |
Backend: Lefthand - 3xDL 320s, 36x15K 300GB SAS, 1-Way Volume, 1 on-board NIC, 3COM 4500G
Frontend: IBM x3500, 2 Xeon 5140's, 5GB RAM, 2x3COM PCI-X teamed NICs, VMWare ESX 3.0.2, Win2K3 SP2 VM, 1MB BS, ESX iSCSI Initiator
| TEST NAME |
Av. Resp. Time ms |
Av. IOs/sek |
Av. MB/sek |
CPU Use |
| Max Throughput-100%Read. |
18.118919 |
3,139.80 |
98.118723 |
40.79 |
| RealLife-60%Rand-65%Read |
20.61234 |
2,684.31 |
20.971201 |
34.57 |
| Max Throughput-50%Read |
18.00176 |
3,073.97 |
96.061636 |
39.96 |
| Random-8k-70%Read. |
19.780298 |
2,774.99 |
21.67958 |
36.35 |
(Note: difference between this test and one above is using 1 vs 2 on-board NICs on the Lefthand units).
Backend: Lefthand - 3xDL 320s, 36x15K 300GB SAS, 2-Way Volume, 2xbonded on-board NICs, 3COM 4500G
Frontend: IBM x3500, 2 Xeon 5140's, 5GB RAM, 2x3COM PCI-X teamed NICs, VMWare ESX 3.0.2, Win2K3 SP2 VM, 1MB BS, ESX iSCSI Initiator
| TEST NAME |
Av. Resp. Time ms |
Av. IOs/sek |
Av. MB/sek |
CPU Use |
| Max Throughput-100%Read. |
16.813312 |
3,366.40 |
105.19988 |
37.47 |
| RealLife-60%Rand-65%Read |
29.34655 |
1,881.29 |
14.697543 |
27.58 |
| Max Throughput-50%Read |
18.680861 |
3,069.82 |
95.931791 |
32.16 |
| Random-8k-70%Read. |
25.085427 |
2,176.13 |
17.001018 |
29.50 |
Backend: Lefthand - 3xDL 320s, 36x15K 300GB SAS, 2-Way Volume, 1 on-board NIC, 3COM 4500G
Frontend: IBM x3500, 2 Xeon 5140's, 5GB RAM, 2x3COM PCI-X teamed NICs, VMWare ESX 3.0.2, Win2K3 SP2 VM, 1MB BS, ESX iSCSI Initiator
| TEST NAME |
Av. Resp. Time ms |
Av. IOs/sek |
Av. MB/sek |
CPU Use |
| Max Throughput-100%Read. |
18.073136 |
3,156.20 |
98.631239 |
39.90 |
| RealLife-60%Rand-65%Read |
28.022059 |
1,980.81 |
15.475073 |
30.49 |
| Max Throughput-50%Read |
24.293573 |
2,395.75 |
74.867232 |
30.47 |
| Random-8k-70%Read. |
24.907659 |
2,200.19 |
17.188989 |
32.73 |
Backend: Lefthand - 3xDL 320s, 36x15K 300GB SAS, 3-Way Volume, 2xbonded on-board NICs, 3COM 4500G
Frontend: IBM x3500, 2 Xeon 5140's, 5GB RAM, 2x3COM PCI-X teamed NICs, VMWare ESX 3.0.2, Win2K3 SP2 VM, 1MB BS, ESX iSCSI Initiator
| TEST NAME |
Av. Resp. Time ms |
Av. IOs/sek |
Av. MB/sek |
CPU Use |
| Max Throughput-100%Read. |
16.754199 |
3,344.42 |
104.51324 |
41.98 |
| RealLife-60%Rand-65%Read |
31.829165 |
1,766.70 |
13.802307 |
26.68 |
| Max Throughput-50%Read |
21.750049 |
2,662.46 |
83.201824 |
35.04 |
| Random-8k-70%Read. |
28.743989 |
1,915.24 |
14.962834 |
29.32 |
Backend: Lefthand - 3xDL 320s, 36x15K 300GB SAS, 3-Way Volume, 1 on-board NIC, 3COM 4500G
Frontend: IBM x3500, 2 Xeon 5140's, 5GB RAM, 2x3COM PCI-X teamed NICs, VMWare ESX 3.0.2, Win2K3 SP2 VM, 1MB BS, ESX iSCSI Initiator
| TEST NAME |
Av. Resp. Time ms |
Av. IOs/sek |
Av. MB/sek |
CPU Use |
| Max Throughput-100%Read. |
17.250795 |
3,198.41 |
99.950318 |
42.42 |
| RealLife-60%Rand-65%Read |
32.346983 |
1,731.03 |
13.52365 |
26.51 |
| Max Throughput-50%Read |
30.307202 |
1,943.30 |
60.728241 |
26.01 |
| Random-8k-70%Read. |
28.757412 |
1,914.67 |
14.958361 |
28.68 |
Backend: Lefthand - 3xDL 320s, 36x15K 300GB SAS, 2-Way Volume, 2xbonded on-board NICs, 3COM 4500G
Frontend: HP DL385, 12GB RAM, 2xOpteron 2.6 DC, 2xIntel e1000 PCI-X teamed NICs, VMWare ESX 3.0.2, Win2K3 SP2 VM, 1MB BS, ESX iSCSI Initiator
| TEST NAME |
Av. Resp. Time ms |
Av. IOs/sek |
Av. MB/sek |
CPU Use |
| Max Throughput-100%Read. |
17.12225 |
3,196.70 |
99.896827 |
34.79 |
| RealLife-60%Rand-65%Read |
27.626576 |
2,014.94 |
15.741728 |
26.41 |
| Max Throughput-50%Read |
20.620568 |
2,752.33 |
86.010156 |
29.10 |
| Random-8k-70%Read. |
24.564162 |
2,238.29 |
17.486643 |
28.32 |
Backend: Lefthand - 3xDL 320s, 36x15K 300GB SAS, 2-Way Volume, 2xbonded on-board NICs, 3COM 4500G
Frontend: IBM x3500, 2 Xeon 5140's, 5GB RAM, 2xIntel PCI-E teamed NICs, VMWare ESX 3.0.2, Win2K3 SP2 VM, 1MB BS, ESX iSCSI Initiator
| TEST NAME |
Av. Resp. Time ms |
Av. IOs/sek |
Av. MB/sek |
CPU Use |
| Max Throughput-100%Read. |
19.8412 |
2,753.38 |
86.043215 |
47.88 |
| RealLife-60%Rand-65%Read |
32.484661 |
1,641.27 |
12.822457 |
45.13 |
| Max Throughput-50%Read |
26.160281 |
2,111.47 |
65.983492 |
47.71 |
| Random-8k-70%Read. |
28.381288 |
1,841.63 |
14.387739 |
46.50 |
Backend: Lefthand - 3xDL 320s, 36x15K 300GB SAS, 2-Way Volume, 2xbonded on-board NICs, 3COM 4500G
Frontend: IBM x3500, 2 Xeon 5140's, 5GB RAM, 2xIntel PCI-X teamed NICs, VMWare ESX 3.0.2, Win2K3 SP2 VM, 1MB BS, ESX iSCSI Initiator
| TEST NAME |
Av. Resp. Time ms |
Av. IOs/sek |
Av. MB/sek |
CPU Use |
| Max Throughput-100%Read. |
16.790365 |
3,362.68 |
105.08382 |
38.62 |
| RealLife-60%Rand-65%Read |
31.189811 |
1,770.48 |
13.831869 |
28.35 |
| Max Throughput-50%Read |
19.868966 |
2,888.53 |
90.266672 |
30.79 |
| Random-8k-70%Read. |
27.76598 |
1,937.46 |
15.136426 |
30.57 |