Site vMotion

[nbctcp3]

Hi,

I have few questions in my mind

HW/SW INFO

2 Sites HQ and BRANCH

ESXi 6.7

VLAN DMZ 20

VLAN SVR 30

VLAN USR 40

VLAN VMOTION 80

VLAN MGMT 100

Each ESXi has 2x10GB NIC for VM traffic and 2x1GB for vMotion + Management traffic

Create  2x vSwitches (vSwitch0 for vMotion+management) and (vSwitch1 for vm)

Cisco Switch 3650

QUESTIONS

1. let say I have 2 sites HQ and BRANCH. Both have different public ip.

Should I use same vlan, if I want to failover vm between sites and vm should retain their ip

2. I enable Jumbo frame globally in Cisco switch

I set jumbo frame MTU to 9000 on vmkernel0 and vSwitch0 (for vMotion+Management)

but set MTU 1500 for vmkernel1 vSwitch1 (for VM network)
Should I set jumbo frame MTU 9000 for VM network as well?

thanks

[daphnissov]

Ok, so a few pieces missing here. You say "ESXi" but in talking about vMotion, this implies vCenter. So you are using vCenter, correct?

1. let say I have 2 sites HQ and BRANCH. Both have different public ip.

Should I use same vlan, if I want to failover vm between sites and vm should retain their ip

Public IPs for what? VMs running at HQ? Are you really assigning public IPs directly to VMs and not using NAT? Regardless, unless you're either doing stretched storage (vMSC) or have replication going on from your HQ to BRANCH, you won't get failover.

2. I enable Jumbo frame globally in Cisco switch

Do you *need* jumbo frames? There is an argument to be made for enabling it on vMotion, but not for Management and possibly not for your workloads (unless you know their network characteristics).

[nbctcp3]

1. Ok, so a few pieces missing here. You say "ESXi" but in talking about vMotion, this implies vCenter. So you are using vCenter, correct?

Yes VCSA 6.7

2. Public IPs for what? VMs running at HQ?

HQ and BRANCH connecting thrugh public ip with different ISP

Are you really assigning public IPs directly to VMs and not using NAT?

Using NAT

3. Regardless, unless you're either doing stretched storage (vMSC) or have replication going on from your HQ to BRANCH, you won't get failover.

Do you mean I need L2 connection between vm and need same subnets in both HQ and BRANCH

I need to check what stretched storage (vMSC) work in here https://vinfrastructure.it/2017/12/dark-side-stretched-clusters/

4. Do you *need* jumbo frames? There is an argument to be made for enabling it on vMotion, but not for Management and possibly not for your workloads (unless you know their network characteristics).

Yes, I enable jumbo frame in vMotion only. But since I combining vMotion+Management (different VLAN) in 2x 1GB NICs.

I am thinking what's the impact if I enable jumbo frame in MGMT VLAN too

tq