We currently have the VMware view Environment at version 7.10. We've had a 5 second one way audio delay for quite some time and have finally narrowed down the issue to the version of the VMware Client. Any version above 4.10 will cause a 5 second delay on Microphone traffic from the VDI to the caller. The issue is really only noticed on received calls. Outbound calls don't see the issue in my testing.
On the VMware Horizon Client 4.9, everything works great with no delay whatsoever.
I've been doing more testing and can get the issue to go away if you do not install the Skype For Business Virtualization Plugin on any version of the VMWare agent that wasn't working before.