Let me make sure I understand what you're saying
You have configured a virtual hard drive for your VM with a maximum size of 500 GB (I hope wherever you stored this VM on your Mac has free space of at least 500 GB).
Here's how to figure out what's going on.
By default, virtual disks on Fusion are configured to only consume disk space on your Mac when the VM uses it. If only 80 GB of data is used in the VM, then only about 80 GB of disk is consumed in the file system where you've stored the VM. If you decide to use all of that 500GB virtual disk in your VM, you better make sure you have 500GB+ of space available on the file system that the VM is stored on. More space will be needed if you decide you're going to use snapshots.
This is in contrast to how the Guest OS sees the virtual disk. For a macOS VM, you can see what's going on by: