Just wanted to close this thread, it only started to work again after the existing NSX installation has been deleted and a fresh NSX-T 3.1 installation was deployed. This was done with PSO assistance, besides reviewing the NSX and vSphere configuration, we have also checked the configuration of the network hardware but sadly we could not find the origin of the issue.

Since this was not production, redeploying NSX was a viable solution.