Solved my own problem but this might be helpful for someone else.
The copy of Windows Server 2012 I downloaded from the Microsoft Volume Licensing Site seems to not work. (2.6GB in size)
I tried using the copy I got from Microsoft Action Pack (3.6GB in size) is installing without issue.
What type of disk controller do you have selected on your virtual machine?
I would try another option.