VMware Cloud Community
andreaspa
Hot Shot
Hot Shot

VSAN design guidance

Hi,

So, I'm kind of new to the entire VSAN concept, and I'm looking for guidelines on a design for VSAN.

The environment in question is used for internal IT and is about to be converted to a Metro Cluster setup.

At the moment, we have 3 ESX hosts (HPE D380 Gen9) and 4 HPE P4500 nodes, plus a bunch of standalone hosts (Dell R720) with SSD-drives for those machines that need performance.

This is all good for the past requirements, but now we are in need to spread data across multiple sites and increase availability for internal servers.

Spreading the current P4500 nodes across two sites is quite easy, just spread them out and add a FOM on a third site and Network RAID10 will take care of the data, but what to do with the SSD-hosts?

My idea here is to add a fourth DL380 Gen9, add controller cards (HPE H240ar) to all four servers and add a bunch of SSD's (3x800GB) to them (plus add witness ESXi on the same site as the FOM resides on); this would give us replicated regular storage and SSD performance with redundancy as well.

I did some reading on VSAN sizing, and found out that in a all flash solution one of the SSD's would be used for caching in each host, and perhaps it's a bit overkill to have 800GB as cache and 1.6TB as data. I was thinking about adding a fourth SSD (480GB) to each host and have that as a cache drive.

Networking will be done with a fiber ring with 2x10Gbit on each link, so each DC will have 20Gbit between them in Mesh setup, so bandwidth is not an issue for this (latency is ~1ms, so we're in the clear for that as well). SSDs are for Mixed Use, so they should be fine. All of the HW are on the HCL.

Any inputs on the above solution? Am I thinking right about the sizing (I have no VMs to reference, we just want an estimate of the space we can use for VMs), or have I missed anything crucial?

/Andreas

0 Kudos
7 Replies
douglasarcidino
Hot Shot
Hot Shot

The basic design of VSAN is to have your flash cache be 10% of your usable data. So with 1.6TB of capacity space, a 200GB cache SSD would be fine.

Slightly out of date, but a good starting point. Page 10.

http://www.vmware.com/files/pdf/products/vsan/VSAN_Design_and_Sizing_Guide.pdf

Doug

If you found this reply helpful, please mark as answer VCP-DCV 4/5/6 VCP-DTM 5/6
0 Kudos
douglasarcidino
Hot Shot
Hot Shot

One other thing to consider, is using the VSAN ready node configuration page since you have a current gen host.

HPAF-6: HP DL380 Gen9Ready Node Generation: Gen2 - 12G
Profile: AF-6 Series
Raw Storage Capacity: 8 TB

Click here for Ready Node Model details : AF-6: HP DL380 Gen9

ComponentsDetailsQuantity
SKUSystem Reference ID: DL380Gen9AF6 - 1
SystemHP ProLiant DL380 Gen9 Server1
CPUHP DL380 Gen9 Intel® Xeon® E5-2670v3 (2.3GHz/12-core/30MB/120W) Processor Kit 719046-L21/719046-B212
MemoryHP 32GB (1x32GB) Dual Rank x4 DDR4-2133 CAS-15-15-15 Registered Memory Kit 728629-B218
Caching TierHP 200GB 12G SAS Mainstream Endurance SFF 2.5-in ENT Mainstream SC 3yr Wty H2 Solid State Drive 7791...2
Capacity TierHP 1.6TB 6G SATA Value Endurance SFF 2.5-in SC Enterprise Value 757339-B215
ControllerHP Smart Array P440ar/2GB FBWC 12Gb 2-ports Int FIO SAS Controller 749974-B21 (OR) HP H240ar 12Gb 2-ports Int FIO Smart Host Bus Adapter 749976-B211
NICHP FlexFabric 10Gb 2-port 556FLR-SFP+ Adapter 727060-B211
Boot DeviceHP Dual 8GB microSD Enterprise Midline USB Kit 741279-B21/741281-0011

If you found this reply helpful, please mark as answer VCP-DCV 4/5/6 VCP-DTM 5/6
0 Kudos
andreaspa
Hot Shot
Hot Shot

Thanks for the feedback!

It was the same document as I was reading before writing here, so it seems most of my assumptions are correct 🙂

In terms of cache, using a 480GB drive seems more logical, that way there is no need to alter cache configuration when increasing the amount of regular drives. I was looking at using 12*800GB or 16*480GB drives in total for this design, seems like 12*800GB + 4*480GB will be the way to go.

0 Kudos
douglasarcidino
Hot Shot
Hot Shot

Yes, if you are going to use three 800GB SSD drives per host then a 480GB cache drive would be ideal. What networking configuration are you planning?

If you found this reply helpful, please mark as answer VCP-DCV 4/5/6 VCP-DTM 5/6
0 Kudos
andreaspa
Hot Shot
Hot Shot

Each host already has 2x10Gbit to the SAN network, so same network will be used for VSAN.

If that is not enough BW, I'll add an additional 2x10Gbit for exklusive use with VSAN Smiley Happy

0 Kudos
douglasarcidino
Hot Shot
Hot Shot

That should be good. 10Gb is required for all flash which is why I asked. Good luck.

If you found this reply helpful, please mark as answer VCP-DCV 4/5/6 VCP-DTM 5/6
0 Kudos
andreaspa
Hot Shot
Hot Shot

Thanks, I'll try to remember to keep this thread updated once everything is set, will probably take 2-3 months.. 😃

0 Kudos