Since I have a similiar issue: check the supported driver version for the specific card!
VMware Compatibility Guide - System Search
In my case (HPE FlexFabric 554M card) I had to use an "older" driver (at least by version number); the latest driver is unstable (and not listed on VMware compatibility page).
If the 12* driver is listed, I would try it (the 11* is maybe a hotfix for an older driver branch).