I have actually. And that does not change anything.
I have also removed the vGPU from the VDI and created a new pool and tried it. That works.
So some interaction between the NVidia vGPU Driver and the Blast protocol that does not seem to be working.