SDDC Manager UI Issue

[robinsonjl3]

SDDC Manager is broken.  I was following along with the VVD documentation and was installing the certificates.  Everything was going just fine until I ran this:

sh /opt/vmware/vcf/operationsmanager/scripts/cli/sddcmanager_restart_services.sh

Now when I try to login to SDDC Manager I get this

{"message":"500 - \"{\\\"errorCode\\\":\\\"IDENTITY_INTERNAL_SERVER_ERROR\\\",\\\"arguments\\\":[],\\\"message\\\":\\\"Identity Internal Server Error\\\",\\\"referenceToken\\\":\\\"CSQLJJ\\\"}\""}

The URL is showing https://vcf01.lab.io/ui/api/internal/login/callback and if I try to change it to https://vcf01.lab.io/ui the UI looks like the attached image.

Any ideas of where to look?

[cynack]

Did you ever resolve this issue?

[nachogonzalez]

Hey, hope you are doing well.

I have the same issue, right now it's with VMware Engineering team.
So far what i know is that the certificate keystore got emptied 
You can validate by running this command:

keytool -list -v -keystore /etc/vmware/vcf/commonsvcs/trusted_certificates.store
ls -lh /etc/vmware/vcf/commonsvcs/trusted_certificates.store

If the command returns a 0 it means the keystore is empty. 
then you can try a restore from a backup or snapshot (in case you have) 
Else escalate with VMware. 

[viquarhcimca]

if you can check the logs

/var/log/vmware/vcf/sddc-manager-ui-app/sddcManagerServer.log

also make sure the root partition on the SDDC is full there is known issue in VCF 4.2.x where root partition gets full which will cause this login issues . 

SDDC Manager uses SSO from PSC . Make sure the Services are all start and PSC and VC is up and running fine. 

[cynack]

If your vCSA/vCenter is up and running without issue. Run the following:

"/opt/vmware/vcf/operationsmanager/scripts/cli/pm_lookup_passwords.sh -u administrator@vsphere.local -e PSC -n 1 -s 0"

Set your vCenter administrator@vsphere.local to the password supplied. Restart vCF.

[nachogonzalez]

Thanks for the support.
Basically the problem was that our certificate store lost the trust with both vCenters.
VMware had to manually re-trust the vCenters