VMware Networking Community
KarthikeyanK
Contributor
Contributor

how to communicate NSX VXLAN Infrastructure VMs with normal VLAN infrastructure VMs ?

how to communicate NSX VXLAN Infrastructure  VMs with normal VLAN infrastructure VMs ?

I have two type of VMware environment in my company. One Infrastructure
(DC - A) is have NSX and VXLAN implemented
for all vms. Another Infrastructure (DC – B) have only VDS with VLAN,

But we need both infrastructure vms to communicate each
other. Can anyone can explain how we can archive this. I tried with L2
bridging, it is not worked .

Please help me on this.

Regards, karthi

0 Kudos
3 Replies
cnrz
Expert
Expert

Vlan based VMs, which device is configured as the default gteway? If it is a L3 switch or FW, then static routing to ESG router for the Vxlan port groups may be needed. Is DLR used for the topology?

0 Kudos
KarthikeyanK
Contributor
Contributor

In VLAN based VMs gateway is configured core L3 Switch of DC – B, No firewall
in between both environment. NSX infra VMs gateway is ESG devise IP (DC - A) and
DLR also available in my infra we used
DLR to communicate different subnets.

Where we need static routing for this ?

0 Kudos
cnrz
Expert
Expert

If DC-A and DC-B are on the same location, there could be a common vlan between the ESG External Interface and L3 Switch(Router). This vlan (Blue subnet ) is generally named ESG-External subnet, and the Classical Vlan Port Groups and vXlan based logical switch portgroups need to communicate passing through L3 Switch(Router) --> ESG --> DLR, and the reverse path DLR-->ESG-->L3 Switch. The  DC-B Vlan Based Port groups could be considered as an External Network, although the Vlan based VMs and Vxlan based VMs could be on the same Physical ESX host.  Vlan based port groups should first reach their default gateway L3 switch.

For this to achieve the routing table of the L3 switch should include an entry for the Logical Switch Vxlan Subnets pointing to the ESG External Interface as the next-hop. This could be OSPF and BGP, but for the simplest topology as below diagram static route is sufficient. This static entry should make the L3 switch forward the Vxlan port group directed packets towards the ESG.

ESG is similar to the L3 switch or router, it has its own routing table. ESG routing table needs at least 2 entries, 1 default route towards the L3 switch, and similar to L3 switch, static routes pointing south towards DLR External IP Address which is  in the generally another Logical switch (Black VXLAN). These static entries would make ESG forward the Packets towards DLR.

DLR Receiving the Packets knows how to send the packets to Vxlan VMs because they are already directly connected. DLR Does not need static routes for the VMs, but it needs a default route pointing north to the ESG Internal IP address (Black Interface of ESG) as the next hop.

If the topology is more complex (i.e if there is an mpls cloud between DC-A and DC-B, or ECMP Load balancing is used for ESG HA Redundancy), then static routing would not be sufficient. Bridging could be helpful between a Vlan-Based Port group VMs and Vxlan-Based Logical switches, if both VMs share a common IP Subnet or for P-V conversion.

More detailed could be as below links:

https://communities-gbot.vmware.com/thread/574292

Simple_Routed_Topology_ESG_HA.png

DLR, ESG what is the difference

http://www.dasblinkenlichten.com/working-with-vmware-nsx-logical-to-physical-connectivity/

http://www.vjenner.com/2016/01/nested_nsx6-2-part_5_north-south_routing/

https://blogs.vmware.com/networkvirtualization/2014/07/getting-started-vmware-nsx-part-ii-building-v...

https://blogs.vmware.com/networkvirtualization_orig/2013/11/distributed-virtual-and-physical-routing...

VMware® NSX for vSphere Network Virtualization Design Guide ver 3.0

https://www.slideshare.net/PoojaPatel144/nsx-for-vsphere-logical-routing-deep-dive

http://www.routetocloud.com/2014/06/nsx-distributed-logical-router/

0 Kudos