Hello all,
I have ESXi Hosts with 4 NICs (vmnic0-3) which should be bundled in one LAG (with LACP in mode "Active") - see outputs below.
vmnic0 and vmnic2 are connected to the 1st Cisco Nexus N9K (Eth1/1 resp. 1/2), vmnic1 and vmnic3 to the 2nd Nexus N9K (Eth1/1 resp. 1/2) - both Nexus forming a VPC.
Now, CURRENTLY, on the Nexus side, Eth1/1 on both switches is configured with a EtherChannel and VPC ID, and Eth1/2 on both switches is configured in ANOTHER EtherChannel with ANOTHER VPC ID than for Eth1/1 - see switch outputs at the end.
So, I am a bit confused now, because from my point of view, only 2 of these 4 ports (either vmnic0 and vmnic2 or vmnic1 and vmnic3) should be in status "Bundled" because the advertised LACP System ID should differ for vmnic0/2 and vmnic1/3. But actually all 4 ports are in status "Bundled". And I am also confused that, on the Nexus side, all port channels are in status "Switched + Up (port-channel)" and the switchports in status "P - Up in port-channel (members)".
What I noted: the partner oper key are different (33869 for vmnic0&2, 33870 for vmnic1&3).
What do I miss?
Kind regards,
Lukas
[root@MyESXI:~] esxcli network vswitch dvs vmware lacp status get
MyDVS
DVSwitch: MyDVS
Flags: S - Device is sending Slow LACPDUs, F - Device is sending fast LACPDUs, A - Device is in active mode, P - Device is in passive mode
LAGID: 846754279
Mode: Active
Nic List:
Local Information:
Admin Key: 15
Flags: SA
Oper Key: 15
Port Number: 32771
Port Priority: 255
Port State: ACT,AGG,SYN,COL,DIST,
Nic: vmnic3
Partner Information:
Age: 00:00:08
Device ID: 00:23:04:ee:be:3d
Flags: SA
Oper Key: 33870
Port Number: 261
Port Priority: 32768
Port State: ACT,AGG,SYN,COL,DIST,
State: Bundled
Local Information:
Admin Key: 15
Flags: SA
Oper Key: 15
Port Number: 32769
Port Priority: 255
Port State: ACT,AGG,SYN,COL,DIST,
Nic: vmnic1
Partner Information:
Age: 00:00:21
Device ID: 00:23:04:ee:be:3d
Flags: SA
Oper Key: 33870
Port Number: 16645
Port Priority: 32768
Port State: ACT,AGG,SYN,COL,DIST,
State: Bundled
Local Information:
Admin Key: 15
Flags: SA
Oper Key: 15
Port Number: 32770
Port Priority: 255
Port State: ACT,AGG,SYN,COL,DIST,
Nic: vmnic2
Partner Information:
Age: 00:00:24
Device ID: 00:23:04:ee:be:3d
Flags: SA
Oper Key: 33869
Port Number: 257
Port Priority: 32768
Port State: ACT,AGG,SYN,COL,DIST,
State: Bundled
Local Information:
Admin Key: 15
Flags: SA
Oper Key: 15
Port Number: 32768
Port Priority: 255
Port State: ACT,AGG,SYN,COL,DIST,
Nic: vmnic0
Partner Information:
Age: 00:00:18
Device ID: 00:23:04:ee:be:3d
Flags: SA
Oper Key: 33869
Port Number: 16641
Port Priority: 32768
Port State: ACT,AGG,SYN,COL,DIST,
State: Bundled
[root@MyESXI:~] esxcli network vswitch dvs vmware lacp stats get
DVSwitch LAGID NIC Rx Errors Rx LACPDUs Tx Errors Tx LACPDUs
---------- --------- ------ --------- ---------- --------- ----------
MyDVS 846754279 vmnic3 728 728 0 727
MyDVS 846754279 vmnic1 727 729 0 726
MyDVS 846754279 vmnic2 730 731 0 729
MyDVS 846754279 vmnic0 49072 49153 0 49071
[root@MyESXI:~]
[root@MyESXI:~] esxcli network vswitch dvs vmware lacp config get
DVS Name LAG Name LAG ID NICs Enabled Mode Load balance
---------- ------------- --------- --------------------------- ------- ------ --------------------------
MyDVS MyUplinkGroup 846754279 vmnic0,vmnic1,vmnic2,vmnic3 true Active Src and dst ip, port, vlan
[root@MyESXI:~]
############################################################################
Switch1# sh port-channel summary
Flags: D - Down P - Up in port-channel (members)
I - Individual H - Hot-standby (LACP only)
s - Suspended r - Module-removed
b - BFD Session Wait
S - Switched R - Routed
U - Up (port-channel)
p - Up in delay-lacp mode (member)
M - Not in use. Min-links not met
--------------------------------------------------------------------------------
Group Port- Type Protocol Member Ports
Channel
--------------------------------------------------------------------------------
...
1101 Po1101(SU) Eth LACP Eth1/1(P)
1102 Po1102(SU) Eth LACP Eth1/2(P)
...
Switch1#
Switch2# sh port-channel summary
Flags: D - Down P - Up in port-channel (members)
I - Individual H - Hot-standby (LACP only)
s - Suspended r - Module-removed
b - BFD Session Wait
S - Switched R - Routed
U - Up (port-channel)
p - Up in delay-lacp mode (member)
M - Not in use. Min-links not met
--------------------------------------------------------------------------------
Group Port- Type Protocol Member Ports
Channel
--------------------------------------------------------------------------------
...
1101 Po1101(SU) Eth LACP Eth1/1(P)
1102 Po1102(SU) Eth LACP Eth1/2(P)
...
Switch2#
