I forgot to mention that I'm running vCenter 5.0 with ESX 3.5 update 5.
you may want to try to "reconfigure for HA' because vCenter5 will not push the AAM agent any longer but instead uses FDM (fault domain manager)
I just upgraded ESX 3.5 to 4.1 and that solved the issue.