Hi,
You wouldn't use VMware Fusion for this at all.
You would either use KVM (when running linux directly on the MBP) or vSphere.
William posted an article about doing this with vSphere the other day and I thought about this thread, but forgot, so thanks for reminding me.
See here:
https://www.virtuallyghetto.com/2020/12/gpu-passthrough-with-esxi-on-the-apple-2019-mac-pro-71.html
You can find a bunch of other articles about running vSphere directly on apple hardware on that site.
For links about using KVM I suggest to google on things like "proxmox" + "macOS" and maybe hackintosh.
Not something I can help you out with here, nor do I have experience with this (although it sounds like fun, I do lack the time to look into it)
--
Wil