VMware Cloud Community
TheVMinator
Expert
Expert

VSAN Networking

I have a cluster of ESXi Servers where servers with 10Gb uplinks are mixed with servers with 1Gb uplinks.  Are there any issues with this in deploying VSAN on every host in the cluster?

Reply
0 Kudos
8 Replies
AnatolyVilchins

Not from what I know. Just make sure that datalink throughput will fit the IOPS requirements.

Also, here are few Best Practices, might be helpful:

https://pubs.vmware.com/vsphere-50/index.jsp?topic=%2Fcom.vmware.vsphere.avail.doc_50%2FGUID-B1906BC...

https://www.vmware.com/files/pdf/support/landing_pages/Virtual-Support-Day-Best-Practices-Virtual-Ne...

Kind Regards, Anatoly Vilchinsky
zdickinson
Expert
Expert

Good afternoon, I believe it would work.  I might actually dial the 10 Gb links to 1 Gb, just to be uniform.  Thank you, Zach.

Reply
0 Kudos
TheVMinator
Expert
Expert

Ok thanks - I'm particularly interested in networking as it pertains to VSAN though...

Reply
0 Kudos
Jasemccarty
Immortal
Immortal

For a hybrid config (SDD cache with traditional drives for Capacity) you'll need a dedicated 1GbE uplink for the VMkernel interface that has VSAN Traffic Enabled.

For an all-flash config, you'll need at least a 10GbE connection (overall).

Remember that Virtual SAN 6 includes the ability to run Distributed Switches (vDS) and you can use Network IO Control if you'd like.

Also, all hosts (contributing disk groups or not) will need to meet this requirement.

Jase McCarty - @jasemccarty
TheVMinator
Expert
Expert

OK great - thanks.  Does VMware officiallly list 10Gb connections as a requirement if I have all flash drives in my VSAN enabled server?

Reply
0 Kudos
zdickinson
Expert
Expert

Good morning, yes, AFA requires 10 Gb.  Thank you, Zach.

Page 18.  http://www.vmware.com/files/pdf/products/vsan/VSAN_Design_and_Sizing_Guide.pdf

Reply
0 Kudos
Jasemccarty
Immortal
Immortal

Hybrid required a dedicated 1GbE connection.

All-Flash requires 10GbE, but not a dedicated 10GbE connection. It can be partial.

Jase McCarty - @jasemccarty
Reply
0 Kudos
pfuhli
Enthusiast
Enthusiast

I think "it depends" on the workload.

We have VSAN hybrid cluster where each host has a dedicated 10GE NIC for VSAN (we changed this from the initial design where we wanted to have also VM and management traffic as a standby config for this NIC).

During our load testing we saw spikes where the 10GE VSAN link is nearly saturated.

Driving VSAN with only 1GE NICs from my point of view would only be possible for small workload szenarios.

Reply
0 Kudos