NIC teaming is designed to keep connections avaliable wether a switch or adapter goes down, etc. I am not sure you will be able to direct NIC traffic based on the type of failure. The vSwitch will not know the difference between the adapter or your primary switch going down, it will just see a link failure and bring up the adapter listed first in "Standby".