You are installing as root, right? Did you try to install from a tar package too?
You cannot install VMware Server on a system running a xen kernel.Execution
So it looks like our rpm installer doesn't conflict with the Xen kernel. I'll file a bug internally. In the meantime, install a non-Xen kernel.