VMware Cloud Community
NhutVu
Contributor
Contributor
Jump to solution

vSAN Networking Design - 10GbE Base-T

Hi all,

Our team currently building a vSAN All Flash Cluster (around 4 nodes) but still in consideration of networking part.

As the requirement for vSAN All Flash network is 10GbE shared or dedicated with low latency of RTT.

pastedImage_6.png

So our team is considering to use 10GbE Base-T (copper) NIC as well as Cisco Nexus 93108TC-EX 48 x 100M/1/10GBASE-T ports and 6 x 40/100-Gbps QSFP28 ports as our ToR switches for these 4 nodes (each nodes will have 4x 10GbE copper link to the Switches) to ensure it will compatible with our main 1Gb copper network as well as saving cost.

pastedImage_5.png

So i've been wondering if anyone have experienced in using All-Flash vSAN Cluster with 10GbE Base-T Network design?

Thank you all.

1 Solution

Accepted Solutions
Sreejesh_D
Virtuoso
Virtuoso
Jump to solution

The requirement is 10GB end-to-end (Between all the hosts in the vSAN cluster) connectivity, that includes Physical NIC, ToR switches etc. If its available then all flash vSAN should be fine. We've multiple all flash vSAN environments with 10Gig network.

---------------------------------------------------------------------------------------------------------

Was it helpful? Let us know by completing this short survey here.

View solution in original post

4 Replies
Sreejesh_D
Virtuoso
Virtuoso
Jump to solution

The requirement is 10GB end-to-end (Between all the hosts in the vSAN cluster) connectivity, that includes Physical NIC, ToR switches etc. If its available then all flash vSAN should be fine. We've multiple all flash vSAN environments with 10Gig network.

---------------------------------------------------------------------------------------------------------

Was it helpful? Let us know by completing this short survey here.

MikeStoica
Expert
Expert
Jump to solution

I'm also running some AF vSAN environments. Definitely go for the 10Gb

NhutVu
Contributor
Contributor
Jump to solution

Yes, as we also understood that the connection just need to be 10GbE, does not need to be a specific 10GbE like Fiber, DAC or Base-T.

What our team worrying is the latency of network. As the 10Gb BASE-T network latency is usually a little bit higher than 10GbE Fiber or 10GbE DAC connection.

Reply
0 Kudos
Sreejesh_D
Virtuoso
Virtuoso
Jump to solution

Our all flash vSAN environments are on 10GB Base-T network.  I couldn't find best practice articles on vSAN Network design which compares 10GbE Fiber cs 10GbE Base-T. The vSAN network design guide doesnt say to not to use copper. But definitely you can reach out to VMware and ask their recommendation.

https://storagehub.vmware.com/t/vmware-vsan/vmware-r-vsan-tm-network-design/