I have an environment that I'm able to poke around in for learning purposes but I don't manage it. Since I can't make any changes to the environment and experiment, I wanted to ask some questions here. I'm trying to figure out what the failback option virtual portgroups should be set to when using FCoE and etherchannel.
The environment consist of:
- FCoE
- 2 CNA cards
- Etherchannel
- vPLEX
- Metro Cluster
- Nexus 5000
Each host connects to a single vDS and each portgroup is configured to use:
- Load balancing policy: Route based on IP hash
- Active uplinks: the two 10 GbE CNAs
- Standby & Used uplinks: none
- Physical switch is configured for etherchannel.
The vSphere 5.5 networking guide says the following for the failback option on vDS portgroups:
Failback Select Yes or No to disable or enable failback. This option determines how a physical adapter is returned to active duty after recovering from a failure. If failback is set to Yes (default), the adapter is returned to active duty immediately upon recovery, displacing the standby adapter that took over its slot, if any. If failback is set to No, a failed adapter is left inactive even after recovery until another currently active adapter fails, requiring its replacement.
This mentions active & standby links and since using etherchannel requires that all links be active with no standby links, does this mean that the failback option doesn't apply to etherchannel configurations? Or does it apply to the way load is re-distributed when a link comes back after being down?
For example, say we have a portgroup with two uplinks (uplink1 & uplink2), load balancing policy set to IP hash and the physical switch ports are in an etherchannel configuration. During normal operation the IP hash calculations (http://blogs.vmware.com/kb/2013/03/troubleshooting-network-teaming-problems-with-ip-hash.html) are performed and load is spread across both uplinks. Let's say that the physical switch that uplink2 connects to goes down. Do the ESXi hosts connected to this vDS immediately take uplink2 out of the equation which means uplink1 would be the only result from the IP hash calculations? What's the impact of the failback option when uplink2 is back up? If failback is set to No, would uplink2 still not be in the equation? If so, how would you get it back in the equation? Or when the link is back up is load immediately sent down it regardless of the failback option? It feels like I'm missing something here.
Also, I read that setting Failback to No is recommended when using IP-based storage because it can result in port flapping which can cause performance issues with the storage. But I also read that traffic from an etherchannel appears as a single MAC address/connection. Would this recommendation apply in an etherchannel configuration? Are port and MAC flapping the same thing? Or is port flapping just when the link goes up and down and MAC flapping is when the MAC flips between two ports?
Sorry if these are basic questions, but not being a networking guy and not being able to experiment makes it hard. Thanks for any help.