Just want to add that it was disruptive (requires downtime) prior NSX 6.2.3 and was only available through REST API.
But starting NSX version 6.2.3, VXLAN port change can now be performed from the UI and non-disruptive as per the NSX doc/upgrade guide and NSX for vSphere API Guide document
Unfortunately I couldn't find what are the three phase processes that makes it possible to change VXLAN in a non-disruptive fashion.