Solved but root-cause unknown. The customer upgraded the firmware on their Cisco Nexus 9k switches and viola, everything started working again.
View solution in original post
