Okay I was able to get the installer to view the system has not having the agent installed finally. I had to pull out the following registry keys
HKEY_CLASSES_ROOT\Installer\Products\BAE225D8889C29745A69A75EB43D0C28
HKEY_LOCAL_MACHINE\SOFTWARE\Microsoft\Windows\CurrentVersion\Installer\UserData\S-1-5-18\Products\BAE225D8889C29745A69A75EB43D0C28
HKEY_LOCAL_MACHINE\SOFTWARE\Microsoft\Windows\CurrentVersion\Installer\Folders
Search for the guid found in the other mentioned regkeys
HKEY_LOCAL_MACHINE\SOFTWARE\Microsoft\Windows\CurrentVersion\Uninstall{8D522EAB-C988-4792-A596-7AE54BD3C082
Then I had to stop all vmware services while installing and it finally worked.