For a device to be recognized within a VM, it has to be firstly recognized by the host. There is no Xbox gamepad driver for ESXi available so you probably won't be able to do that.
On top of that, what would be the use of such setup? You can't realistically expect any games to be responsive/playable this way. Unless you're operating on a enterprise level equipment, the amount of lag would be astonishing.
You could potentially "hack" the controller to use a flash disk driver and then pass it through the the VM however this would require excessive amount of effort which I presume wouldn't be worth the outcome...
In summary, I think there's no option for this setup to work.
Cheers,
Paul Wilk