Have you imported the host certificate and SSO server certificate (from URL xxx.xxx and xxx.xxx:7444, respectively)?
Also, check if there is no big time skew between vRO and SSO machines. And check if there are some exceptions/errors in vRO configurator and SSO server logs.