8 Replies Latest reply on Nov 26, 2019 8:58 PM by MichaelVavilovNGT

    Unable to open Web Console in 6.7U3 HTML Client

    MichaelVavilovNGT Lurker

      Unable to open Web Console in vCenter 6.7U3 HTML Client.

       

      "Launch Web Console" as well as "Launch remote Console" options get a pop-up windows "Open VMware Remote Console Option?" with 2 options available: "Open VMware Remote Console" and "Cancel", see print-screen below.

       

      33.png

       

      From ESXi hosts web-interface can choose and open both: Web-Console and Remote Console.

        • 1. Re: Unable to open Web Console in 6.7U3 HTML Client
          MichaelVavilovNGT Lurker

          The print-screen above is for Google Chrome Version 78.0.3904.87 (Official Build) (64-bit)

           

           

           

          I tested out in IE (ver. 11.418) and there is the same issue, see below

          44.png

          • 2. Re: Unable to open Web Console in 6.7U3 HTML Client
            sk591 Enthusiast

            Please let us know the following:

             

            - Did this start occurring after a recent upgrade of the vCenter?

            - Is this an issue with all the VMs?

            - Can you try launching the web console for any other VM hosted on any other host?

            - Confirm if port 9443 is open as this is used as a default port by the HTML5 virtual machine console.

            - Also can you provide the output of the following files when you are trying this action?

             

            1) vmware.log located under the VM directory.

             

            2) vsphere_client_virgo.log located under /var/log/vmware/vsphere-ui/logs

            • 3. Re: Unable to open Web Console in 6.7U3 HTML Client
              MichaelVavilovNGT Lurker

              Hello there,

               

              - Did this start occurring after a recent upgrade of the vCenter?

                   - No

               

              - Is this an issue with all the VMs?

                  - Yes

               

              - Can you try launching the web console for any other VM hosted on any other host?

                   - Yes, the same issue

               

              - Confirm if port 9443 is open as this is used as a default port by the HTML5 virtual machine console.

                   - It is opened

               

              - Also can you provide the output of the following files when you are trying this action?

                   - Please find the output below. I tried to open web-console at 8:57am and 8:58am AEDT.

               

              vmware.log under the VM directory

              2019-11-11T21:57:11.011Z| mks| I125: SOCKET 6 (112) AsyncTCPSocketSetOption: Option layer/level [6], option/name [1]: successfully set OS option for TCP socket.

              2019-11-11T21:57:11.318Z| mks| I125: SOCKET 6 (112) AsyncTCPSocketSetOption: sendLowLatencyMode set to [1].

              2019-11-11T21:57:11.318Z| mks| I125: SOCKET 6 (112) Creating VNC remote connection.

              2019-11-11T21:57:11.318Z| mks| I125: MKSControlMgr: New VNC connection 2

              2019-11-11T21:57:11.320Z| svga| I125: VNCENCODE 6 VNCEncode: VNCEncode_ServerSetTopology - original root: (0, 0) size: (1651, 779)

              2019-11-11T21:57:11.320Z| svga| I125: VNCENCODE 6 VNCEncode: Number of screens changed from 0 to 1

              2019-11-11T21:57:11.320Z| svga| I125: VNCENCODE 6 VNCEncode: screen: 0 BoundingBox: (1651x779) Screen (1651x779) @ (0,0) bytesPerLine: 6604

              2019-11-11T21:57:11.400Z| mks| W115: VNCENCODE 6 JPEG quality levels (min, mid, max). Input: (25, 35, 90) Clamped: (25, 35, 90)

              2019-11-11T21:57:11.400Z| mks| W115: VNCENCODE 6 failed to allocate VNCBlitDetect

              2019-11-11T21:57:11.400Z| mks| I125: VNCENCODE 6 VNCEncodeChooseRegionEncoder: region encoder adaptive. Screen 1/1 @ Resolution: 1651 x 779

              2019-11-11T21:57:12.636Z| mks| I125: SSL: syscall error 104: Connection reset by peer

              2019-11-11T21:57:12.636Z| mks| I125: SOCKET 6 (112) recv error 104: Connection reset by peer

              2019-11-11T21:57:12.636Z| mks| I125: SOCKET 6 (112) VNC Remote Disconnect.

              2019-11-11T21:57:12.636Z| mks| I125: MKSControlMgr: Remove VNC connection 2

              2019-11-11T21:57:37.791Z| svga| I125: MKSScreenShotMgr: Taking a screenshot

              2019-11-11T21:58:05.690Z| mks| I125: SOCKET 7 (112) AsyncTCPSocketSetOption: Option layer/level [6], option/name [1]: successfully set OS option for TCP socket.

              2019-11-11T21:58:06.019Z| mks| I125: SOCKET 7 (112) AsyncTCPSocketSetOption: sendLowLatencyMode set to [1].

              2019-11-11T21:58:06.019Z| mks| I125: SOCKET 7 (112) Creating VNC remote connection.

              2019-11-11T21:58:06.019Z| mks| I125: MKSControlMgr: New VNC connection 3

              2019-11-11T21:58:06.021Z| svga| I125: VNCENCODE 7 VNCEncode: VNCEncode_ServerSetTopology - original root: (0, 0) size: (1651, 779)

              2019-11-11T21:58:06.021Z| svga| I125: VNCENCODE 7 VNCEncode: Number of screens changed from 0 to 1

              2019-11-11T21:58:06.021Z| svga| I125: VNCENCODE 7 VNCEncode: screen: 0 BoundingBox: (1651x779) Screen (1651x779) @ (0,0) bytesPerLine: 6604

              2019-11-11T21:58:06.107Z| mks| W115: VNCENCODE 7 JPEG quality levels (min, mid, max). Input: (25, 35, 90) Clamped: (25, 35, 90)

              2019-11-11T21:58:06.107Z| mks| W115: VNCENCODE 7 failed to allocate VNCBlitDetect

              2019-11-11T21:58:06.107Z| mks| I125: VNCENCODE 7 VNCEncodeChooseRegionEncoder: region encoder adaptive. Screen 1/1 @ Resolution: 1651 x 779

              2019-11-11T21:58:07.438Z| mks| I125: SSL: syscall error 104: Connection reset by peer

              2019-11-11T21:58:07.438Z| mks| I125: SOCKET 7 (112) recv error 104: Connection reset by peer

              2019-11-11T21:58:07.438Z| mks| I125: SOCKET 7 (112) VNC Remote Disconnect.

              2019-11-11T21:58:07.438Z| mks| I125: MKSControlMgr: Remove VNC connection 3

              2019-11-11T21:58:13.317Z| svga| I125: MKSScreenShotMgr: Taking a screenshot

               

               

               

              /var/log/vmware/vsphere-ui/logs/vsphere_client_virgo.log

              [2019-11-12T08:57:01.976+11:00] [INFO ] soTokenRenewalExecutor-22346 ######## 100083 200003 com.vmware.vsphere.client.security.sso.SsoTokenLifetimeManager    Beginning renewal of token for sessionId

              100083, clientId 200003

              [2019-11-12T08:57:01.977+11:00] [INFO ] soTokenRenewalExecutor-22346 ######## 100083 200003 com.vmware.vise.vim.security.sso.impl.SsoLsLocatorImpl            Fetching SSO endpoints from LS

              [2019-11-12T08:57:02.003+11:00] [INFO ] soTokenRenewalExecutor-22346 ######## 100083 200003 com.vmware.vise.vim.security.sso.impl.SsoLsLocatorImpl            Retrieved locations of services from LS

              at https://INGT-M1-UTILS1.domain.com:443/lookupservice/sdk in 27 milliseconds:

              {vsphere.local(5e6ff3c0-a8cf-11e5-9ac3-000c292f5d25@L)=adminAppUrl: https://INGT-M1-UTILS1.domain.com/sso-adminserver/sdk/vsphere.local, stsUrl: https://INGT-M1-UTILS1.domain.com

              /sts/STSService/vsphere.local, metadataUrl: https://INGT-M1-UTILS1.domain.com/websso/SAML2/Metadata/vsphere.local, vmodlVersion: interface com.vmware.vim.binding.sso.version.version3_5}

              [2019-11-12T08:57:02.003+11:00] [INFO ] soTokenRenewalExecutor-22346 ######## 100083 200003 com.vmware.vise.vim.security.sso.impl.SsoUtilInternal             Renewing token _7e63d6f5-58a3-49e2-b2a7-

              8c094d65b5ea using https://INGT-M1-UTILS1.domain.com/sts/STSService/vsphere.local

              [2019-11-12T08:57:02.010+11:00] [INFO ] soTokenRenewalExecutor-22346 ######## 100083 200003 com.vmware.vim.sso.client.impl.SiteAffinityServiceDiscovery       Site affinity is disabled

              [2019-11-12T08:57:02.094+11:00] [INFO ] soTokenRenewalExecutor-22346 ######## 100083 200003 com.vmware.identity.token.impl.SamlTokenImpl                      SAML token for SubjectNameId [value=mv@domain.com, format=http://schemas.xmlsoap.org/claims/UPN] successfully parsed from Element

              [2019-11-12T08:57:02.095+11:00] [INFO ] soTokenRenewalExecutor-22346 ######## 100083 200003 com.vmware.vim.sso.client.impl.SecurityTokenServiceImpl           Successfully renewed token for user: {Na

              me: mv, Domain: domain.com}

              [2019-11-12T08:57:02.095+11:00] [INFO ] soTokenRenewalExecutor-22346 ######## 100083 200003 com.vmware.vise.vim.security.sso.AsyncTokenManager                Updated the token of domain vsphere.loca

              l(5e6ff3c0-a8cf-11e5-9ac3-000c292f5d25@L). Token's expiration time: Tue Nov 12 16:57:02 AEDT 2019

              [2019-11-12T08:57:02.095+11:00] [INFO ] soTokenRenewalExecutor-22346 ######## 100083 200003 com.vmware.vsphere.client.security.sso.SsoTokenLifetimeManager    Token renewed for sessionId 100083, clie

              ntId 200003. Used STS of domain vsphere.local(5e6ff3c0-a8cf-11e5-9ac3-000c292f5d25@L) for the renewal. Token expiration time: Tue Nov 12 16:57:02 AEDT 2019

              [2019-11-12T08:57:02.096+11:00] [INFO ] soTokenRenewalExecutor-22346 ######## 100083 200003 com.vmware.vsphere.client.security.sso.SsoTokenLifetimeManager    sessionId 100083, clientId 200003, Token

              expiration time: Tue Nov 12 16:57:02 AEDT 2019

              Token renewal scheduled approximately for: Tue Nov 12 16:52:02 AEDT 2019

              [2019-11-12T08:57:27.496+11:00] [INFO ] http-nio-5090-exec-8          com.vmware.vise.util.session.SessionUtil                          Generated hashed session id: 100092

              [2019-11-12T08:57:27.496+11:00] [INFO ] http-nio-5090-exec-8         70009327 100092 ###### com.vmware.vise.security.SessionListener                          Session 100092 created with context path

              : /ui

              [2019-11-12T08:57:27.496+11:00] [INFO ] http-nio-5090-exec-8         70009327 100092 ###### com.vmware.vsphere.client.security.websso.WebssoAssertionHandler  Received an SAML assertion from SSO serv

              er. Processing it now...

              [2019-11-12T08:57:27.496+11:00] [INFO ] http-nio-5090-exec-8         70009327 100092 ###### com.vmware.identity.websso.client.endpoint.SsoResponseListener    You have POST'ed to Websso client librar

              y!

              [2019-11-12T08:57:27.496+11:00] [INFO ] http-nio-5090-exec-8         70009327 100092 ###### com.vmware.identity.websso.client.SsoValidationState              Validating SAMLResponse..

              [2019-11-12T08:57:27.501+11:00] [INFO ] http-nio-5090-exec-8         70009327 100092 ###### com.vmware.identity.websso.client.ValidationState                 Validating request destination: Httpserv

              letRequest destination=https://ingt-m1-utils1.domain.com/ui/saml/websso/ssoSAML message destination=https://ingt-m1-utils1.domain.com/ui/saml/websso/sso

              [2019-11-12T08:57:27.501+11:00] [INFO ] http-nio-5090-exec-8         70009327 100092 ###### com.vmware.identity.websso.client.SsoValidationState              Validating optional request ID: _9dfde73

              5748637f6ba592cd6d2089113

              [2019-11-12T08:57:27.501+11:00] [ERROR] http-nio-5090-exec-8         70009327 100092 ###### com.vmware.identity.websso.client.MessageStoreImpl                No request with id=:%s found.  Message s

              tore size:%s

              [2019-11-12T08:57:27.501+11:00] [ERROR] http-nio-5090-exec-8         70009327 100092 ###### com.vmware.identity.websso.client.endpoint.SsoResponseListener    Authentication Exception: java.lang.IllegalArgumentException: No authentication request found matching InResponseTo attribute of SAML Response from IDP. No matching logon request found for SAML response: _9dfde735748637f6ba592cd6d2089113

                      at com.vmware.identity.websso.client.SsoValidationState.validateInResponseTo(SsoValidationState.java:162)

                      at com.vmware.identity.websso.client.SsoValidationState.validate(SsoValidationState.java:93)

                      at com.vmware.identity.websso.client.endpoint.SsoResponseListener.consumeResponse(SsoResponseListener.java:120)

                      at com.vmware.identity.websso.client.endpoint.SsoResponseListener.consumeResponse(SsoResponseListener.java:89)

                      at com.vmware.vsphere.client.security.websso.WebssoAssertionHandler.handleRequest(WebssoAssertionHandler.java:50)

                      at org.springframework.web.context.support.HttpRequestHandlerServlet.service(HttpRequestHandlerServlet.java:67)

                      at javax.servlet.http.HttpServlet.service(HttpServlet.java:742)

                      at org.eclipse.equinox.http.servlet.internal.HttpServiceRuntimeImpl$LegacyServlet.service(HttpServiceRuntimeImpl.java:1256)

                      at org.eclipse.equinox.http.servlet.internal.registration.EndpointRegistration.service(EndpointRegistration.java:153)

                      at org.eclipse.equinox.http.servlet.internal.servlet.FilterChainImpl.doFilter(FilterChainImpl.java:50)

                      at com.vmware.o6jia.context.web.filter.WelcomeFileFilter.doFilter(WelcomeFileFilter.java:48)

                      at org.eclipse.equinox.http.servlet.internal.HttpServiceRuntimeImpl$LegacyFilterFactory$LegacyFilter.doFilter(HttpServiceRuntimeImpl.java:1215)

                      at org.eclipse.equinox.http.servlet.internal.registration.FilterRegistration.doFilter(FilterRegistration.java:121)

                      at org.eclipse.equinox.http.servlet.internal.servlet.FilterChainImpl.doFilter(FilterChainImpl.java:45)

                      at com.vmware.vise.extensionfw.DeploymentFilter.doFilter(DeploymentFilter.java:55)

                      at com.vmware.o6jia.context.web.filter.ContextPathAwareDelegatingFilter.doFilter(ContextPathAwareDelegatingFilter.java:50)

                      at org.eclipse.equinox.http.servlet.internal.HttpServiceRuntimeImpl$LegacyFilterFactory$LegacyFilter.doFilter(HttpServiceRuntimeImpl.java:1215)

                      at org.eclipse.equinox.http.servlet.internal.registration.FilterRegistration.doFilter(FilterRegistration.java:121)

                      at org.eclipse.equinox.http.servlet.internal.servlet.FilterChainImpl.doFilter(FilterChainImpl.java:45)

                      at com.vmware.o6jia.context.web.filter.ContextPathAwareDelegatingFilter.doFilter(ContextPathAwareDelegatingFilter.java:46)

                      at org.eclipse.equinox.http.servlet.internal.HttpServiceRuntimeImpl$LegacyFilterFactory$LegacyFilter.doFilter(HttpServiceRuntimeImpl.java:1215)

                      at org.eclipse.equinox.http.servlet.internal.registration.FilterRegistration.doFilter(FilterRegistration.java:121)

                      at org.eclipse.equinox.http.servlet.internal.servlet.FilterChainImpl.doFilter(FilterChainImpl.java:45)

                      at com.vmware.vsphere.client.logging.MDCLogFilter.doFilterInternal(MDCLogFilter.java:41)

                      at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:107)

                      at com.vmware.o6jia.context.web.filter.ContextPathAwareDelegatingFilter.doFilter(ContextPathAwareDelegatingFilter.java:50)

                      at org.eclipse.equinox.http.servlet.internal.HttpServiceRuntimeImpl$LegacyFilterFactory$LegacyFilter.doFilter(HttpServiceRuntimeImpl.java:1215)

                      at org.eclipse.equinox.http.servlet.internal.registration.FilterRegistration.doFilter(FilterRegistration.java:121)

                      at org.eclipse.equinox.http.servlet.internal.servlet.FilterChainImpl.doFilter(FilterChainImpl.java:45)

                      at com.vmware.vise.util.i18n.I18nFilter.doFilterInternal(I18nFilter.java:43)

                      at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:107)

                      at com.vmware.o6jia.context.web.filter.ContextPathAwareDelegatingFilter.doFilter(ContextPathAwareDelegatingFilter.java:50)

                      at org.eclipse.equinox.http.servlet.internal.HttpServiceRuntimeImpl$LegacyFilterFactory$LegacyFilter.doFilter(HttpServiceRuntimeImpl.java:1215)

                      at org.eclipse.equinox.http.servlet.internal.registration.FilterRegistration.doFilter(FilterRegistration.java:121)

                      at org.eclipse.equinox.http.servlet.internal.servlet.FilterChainImpl.doFilter(FilterChainImpl.java:45)

                      at com.vmware.vise.security.SessionManagementFilter.doFilter(SessionManagementFilter.java:205)

                      at com.vmware.o6jia.context.web.filter.ContextPathAwareDelegatingFilter.doFilter(ContextPathAwareDelegatingFilter.java:50)

                      at org.eclipse.equinox.http.servlet.internal.HttpServiceRuntimeImpl$LegacyFilterFactory$LegacyFilter.doFilter(HttpServiceRuntimeImpl.java:1215)

                      at org.eclipse.equinox.http.servlet.internal.registration.FilterRegistration.doFilter(FilterRegistration.java:121)

                      at org.eclipse.equinox.http.servlet.internal.servlet.FilterChainImpl.doFilter(FilterChainImpl.java:45)

                      at com.vmware.o6jia.context.web.filter.ContextPathAwareDelegatingFilter.doFilter(ContextPathAwareDelegatingFilter.java:46)

                      at org.eclipse.equinox.http.servlet.internal.HttpServiceRuntimeImpl$LegacyFilterFactory$LegacyFilter.doFilter(HttpServiceRuntimeImpl.java:1215)

                      at org.eclipse.equinox.http.servlet.internal.registration.FilterRegistration.doFilter(FilterRegistration.java:121)

                      at org.eclipse.equinox.http.servlet.internal.servlet.FilterChainImpl.doFilter(FilterChainImpl.java:45)

                      at org.springframework.security.web.FilterChainProxy.doFilterInternal(FilterChainProxy.java:208)

                      at org.springframework.security.web.FilterChainProxy.doFilter(FilterChainProxy.java:177)

                      at org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(DelegatingFilterProxy.java:347)

                      at org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java:263)

                      at com.vmware.o6jia.context.web.filter.ContextPathAwareDelegatingFilter.doFilter(ContextPathAwareDelegatingFilter.java:50)

                      at org.eclipse.equinox.http.servlet.internal.HttpServiceRuntimeImpl$LegacyFilterFactory$LegacyFilter.doFilter(HttpServiceRuntimeImpl.java:1215)

                      at org.eclipse.equinox.http.servlet.internal.registration.FilterRegistration.doFilter(FilterRegistration.java:121)

                      at org.eclipse.equinox.http.servlet.internal.servlet.FilterChainImpl.doFilter(FilterChainImpl.java:45)

                      at com.vmware.o6jia.context.web.filter.ContextPathAwareDelegatingFilter.doFilter(ContextPathAwareDelegatingFilter.java:46)

                      at org.eclipse.equinox.http.servlet.internal.HttpServiceRuntimeImpl$LegacyFilterFactory$LegacyFilter.doFilter(HttpServiceRuntimeImpl.java:1215)

                      at org.eclipse.equinox.http.servlet.internal.registration.FilterRegistration.doFilter(FilterRegistration.java:121)

                      at org.eclipse.equinox.http.servlet.internal.servlet.FilterChainImpl.doFilter(FilterChainImpl.java:45)

                      at com.vmware.o6jia.context.web.filter.ContextPathAwareDelegatingFilter.doFilter(ContextPathAwareDelegatingFilter.java:46)

                      at org.eclipse.equinox.http.servlet.internal.HttpServiceRuntimeImpl$LegacyFilterFactory$LegacyFilter.doFilter(HttpServiceRuntimeImpl.java:1215)

                      at org.eclipse.equinox.http.servlet.internal.registration.FilterRegistration.doFilter(FilterRegistration.java:121)

                      at org.eclipse.equinox.http.servlet.internal.servlet.FilterChainImpl.doFilter(FilterChainImpl.java:45)

                      at com.vmware.o6jia.context.web.filter.ContextPathAwareDelegatingFilter.doFilter(ContextPathAwareDelegatingFilter.java:46)

                      at org.eclipse.equinox.http.servlet.internal.HttpServiceRuntimeImpl$LegacyFilterFactory$LegacyFilter.doFilter(HttpServiceRuntimeImpl.java:1215)

                      at org.eclipse.equinox.http.servlet.internal.registration.FilterRegistration.doFilter(FilterRegistration.java:121)

                      at org.eclipse.equinox.http.servlet.internal.servlet.FilterChainImpl.doFilter(FilterChainImpl.java:45)

                      at org.springframework.web.filter.RequestContextFilter.doFilterInternal(RequestContextFilter.java:99)

                      at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:107)

                      at com.vmware.o6jia.context.web.filter.ContextPathAwareDelegatingFilter.doFilter(ContextPathAwareDelegatingFilter.java:50)

                      at org.eclipse.equinox.http.servlet.internal.HttpServiceRuntimeImpl$LegacyFilterFactory$LegacyFilter.doFilter(HttpServiceRuntimeImpl.java:1215)

                      at org.eclipse.equinox.http.servlet.internal.registration.FilterRegistration.doFilter(FilterRegistration.java:121)

                      at org.eclipse.equinox.http.servlet.internal.servlet.FilterChainImpl.doFilter(FilterChainImpl.java:45)

                      at com.vmware.o6jia.context.web.filter.ContextPathAwareDelegatingFilter.doFilter(ContextPathAwareDelegatingFilter.java:46)

                      at org.eclipse.equinox.http.servlet.internal.HttpServiceRuntimeImpl$LegacyFilterFactory$LegacyFilter.doFilter(HttpServiceRuntimeImpl.java:1215)

                      at org.eclipse.equinox.http.servlet.internal.registration.FilterRegistration.doFilter(FilterRegistration.java:121)

                      at org.eclipse.equinox.http.servlet.internal.registration.FilterRegistration.doFilter(FilterRegistration.java:121)

                      at org.eclipse.equinox.http.servlet.internal.servlet.FilterChainImpl.doFilter(FilterChainImpl.java:45)

                      at com.vmware.o6jia.context.web.filter.ContextPathAwareDelegatingFilter.doFilter(ContextPathAwareDelegatingFilter.java:46)

                      at org.eclipse.equinox.http.servlet.internal.HttpServiceRuntimeImpl$LegacyFilterFactory$LegacyFilter.doFilter(HttpServiceRuntimeImpl.java:1215)

                      at org.eclipse.equinox.http.servlet.internal.registration.FilterRegistration.doFilter(FilterRegistration.java:121)

                      at org.eclipse.equinox.http.servlet.internal.servlet.FilterChainImpl.doFilter(FilterChainImpl.java:45)

                      at org.eclipse.equinox.http.servlet.internal.servlet.ResponseStateHandler.processRequest(ResponseStateHandler.java:70)

                      at org.eclipse.equinox.http.servlet.internal.context.DispatchTargets.doDispatch(DispatchTargets.java:132)

                      at org.eclipse.equinox.http.servlet.internal.servlet.ProxyServlet.service(ProxyServlet.java:100)

                      at javax.servlet.http.HttpServlet.service(HttpServlet.java:742)

                      at org.eclipse.equinox.servletbridge.BridgeServlet.service(BridgeServlet.java:152)

                      at com.vmware.vsphere.bridge.BridgeServletEx.service(BridgeServletEx.java:21)

                      at javax.servlet.http.HttpServlet.service(HttpServlet.java:742)

                      at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:231)

                      at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166)

                      at org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:52)

                      at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:193)

                      at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166)

                      at com.vmware.vsphere.bridge.DenyConfigurationFilesFilter.doFilter(DenyConfigurationFilesFilter.java:45)

                      at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:193)

                      at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166)

                      at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:199)

                      at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:96)

                      at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:493)

                      at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:137)

                      at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:81)

                      at org.apache.catalina.valves.RemoteIpValve.invoke(RemoteIpValve.java:679)

                      at org.apache.catalina.valves.AbstractAccessLogValve.invoke(AbstractAccessLogValve.java:660)

                      at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:87)

                      at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:343)

                      at org.apache.coyote.http11.Http11Processor.service(Http11Processor.java:798)

                      at org.apache.coyote.AbstractProcessorLight.process(AbstractProcessorLight.java:66)

                      at org.apache.coyote.AbstractProtocol$ConnectionHandler.process(AbstractProtocol.java:808)

                      at org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.doRun(NioEndpoint.java:1498)

                      at org.apache.tomcat.util.net.SocketProcessorBase.run(SocketProcessorBase.java:49)

                      at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)

                      at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)

                      at org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)

                      at java.lang.Thread.run(Thread.java:748)

               

               

              [2019-11-12T08:57:27.501+11:00] [INFO ] http-nio-5090-exec-8         70009327 100092 ###### com.vmware.identity.websso.client.Message                         Incoming or outgoing SAML message.

              Message Type:AUTHN_RESPONSE

              ID:_799c8d80c489c7be1de54e0f4753b903

              SessionIndex:null

              Message source:https://INGT-M1-UTILS1.domain.com/websso/SAML2/Metadata/vsphere.local

              Message destination:https://ingt-m1-utils1.domain.com/ui/saml/websso/sso

              Message validation result (for incoming messages):urn:oasis:names:tc:SAML:2.0:status:Success

               

               

              [2019-11-12T08:57:27.501+11:00] [INFO ] http-nio-5090-exec-8         70009327 100092 ###### com.vmware.vsphere.client.security.websso.WebssoUtil              [authenticationError] Message details: id=_799c8d80c489c7be1de54e0f4753b903, type=AUTHN_RESPONSE, source='https://INGT-M1-UTILS1.domain.com/websso/SAML2/Metadata/vsphere.local', target='https://ingt-m1-utils1.domain.com/ui/saml/websso/sso', issueInstant='2019-11-11T21:57:27.440Z'

              [2019-11-12T08:57:27.562+11:00] [INFO ] http-nio-5090-exec-3         70009328 100092 ###### c.v.vsphere.client.security.websso.WebssoLogoutRequestHandler     Received WebSSO logout request

              [2019-11-12T08:57:27.562+11:00] [INFO ] http-nio-5090-exec-3         70009328 100092 ###### com.vmware.vsphere.client.security.websso.MetadataGeneratorImpl   Processing WebSSO metadata

              [2019-11-12T08:57:27.562+11:00] [INFO ] http-nio-5090-exec-3         70009328 100092 ###### com.vmware.vsphere.client.security.websso.MetadataGeneratorImpl   SP url generated is https://ingt-m1-utils1.domain.com/ui

              [2019-11-12T08:57:27.562+11:00] [INFO ] http-nio-5090-exec-3         70009328 100092 ###### com.vmware.vsphere.client.security.websso.MetadataGeneratorImpl   Processed WebSSO metadata

              [2019-11-12T08:57:27.562+11:00] [WARN ] http-nio-5090-exec-3         70009328 100092 ###### c.v.vsphere.client.security.websso.WebssoLogoutRequestHandler     Username not found in browser cookies, will skip logging out of SSO.

              [2019-11-12T08:57:33.094+11:00] [INFO ] http-nio-5090-exec-2         70009329 100092 ###### com.vmware.vsphere.client.security.util.Util                      getUserSession called on an inactive session.

              [2019-11-12T08:57:33.094+11:00] [INFO ] http-nio-5090-exec-2         70009329 100092 ###### com.vmware.vise.util.PropertyUtil                                 Property 'local.development' is missing. Will use the default: false

              [2019-11-12T08:57:33.229+11:00] [INFO ] http-nio-5090-exec-4         70009330 100092 ###### c.v.vsphere.client.security.websso.WebssoLoginRequestHandler      Received WebSSO login request

              [2019-11-12T08:57:33.229+11:00] [INFO ] http-nio-5090-exec-4         70009330 100092 ###### com.vmware.vsphere.client.security.websso.MetadataGeneratorImpl   Processing WebSSO metadata

              [2019-11-12T08:57:33.229+11:00] [INFO ] http-nio-5090-exec-4         70009330 100092 ###### com.vmware.vsphere.client.security.websso.MetadataGeneratorImpl   SP url generated is https://ingt-m1-utils1.domain.com/ui

              [2019-11-12T08:57:33.229+11:00] [INFO ] http-nio-5090-exec-4         70009330 100092 ###### com.vmware.vsphere.client.security.websso.MetadataGeneratorImpl   Processed WebSSO metadata

              [2019-11-12T08:57:33.230+11:00] [INFO ] http-nio-5090-exec-4         70009330 100092 ###### c.v.vsphere.client.security.websso.WebssoLoginRequestHandler      SP alias for the login request is ingt-m1-utils1.domain.com:443

              [2019-11-12T08:57:33.230+11:00] [INFO ] http-nio-5090-exec-4         70009330 100092 ###### c.v.vsphere.client.security.websso.WebssoLoginRequestHandler      Sending authentication request to the SSO server

              [2019-11-12T08:57:33.230+11:00] [INFO ] http-nio-5090-exec-4         70009330 100092 ###### com.vmware.identity.websso.client.endpoint.SsoRequestSender       Producing redirect url

              [2019-11-12T08:57:33.231+11:00] [INFO ] http-nio-5090-exec-4         70009330 100092 ###### com.vmware.identity.websso.client.SiteAffinity                    getAffinitizedDC: INGT-M1-UTILS1.domain.com

              [2019-11-12T08:57:33.231+11:00] [INFO ] http-nio-5090-exec-4         70009330 100092 ###### com.vmware.identity.websso.client.endpoint.SsoRequestSender       Added Renewable condition

              [2019-11-12T08:57:33.231+11:00] [INFO ] http-nio-5090-exec-4         70009330 100092 ###### com.vmware.identity.websso.client.endpoint.SsoRequestSender       Added Delegable condition

              [2019-11-12T08:57:33.231+11:00] [INFO ] http-nio-5090-exec-4         70009330 100092 ###### com.vmware.identity.websso.client.endpoint.SsoRequestSender       Destination URL: https://INGT-M1-UTILS1.domain.com/websso/SAML2/SSO/vsphere.local

              [2019-11-12T08:57:33.232+11:00] [INFO ] http-nio-5090-exec-4         70009330 100092 ###### com.vmware.identity.websso.client.endpoint.SsoRequestSender       Relay State value is: null

              [2019-11-12T08:57:33.234+11:00] [INFO ] http-nio-5090-exec-4         70009330 100092 ###### com.vmware.identity.websso.client.Message                         Incoming or outgoing SAML message.

              Message Type:AUTHN_REQUEST

              ID:_78bd186886ef261715ca39d006a67f07

              SessionIndex:null

              Message source:https://ingt-m1-utils1.domain.com/ui/saml/websso/metadata

              Message destination:https://INGT-M1-UTILS1.domain.com/websso/SAML2/SSO/vsphere.local

              Message validation result (for incoming messages):null

               

               

              [2019-11-12T08:57:33.357+11:00] [INFO ] http-nio-5090-exec-1         70009331 100092 ###### com.vmware.vsphere.client.security.websso.WebssoAssertionHandler  Received an SAML assertion from SSO server. Processing it now...

              [2019-11-12T08:57:33.357+11:00] [INFO ] http-nio-5090-exec-1         70009331 100092 ###### com.vmware.identity.websso.client.endpoint.SsoResponseListener    You have POST'ed to Websso client library!

              [2019-11-12T08:57:33.357+11:00] [INFO ] http-nio-5090-exec-1         70009331 100092 ###### com.vmware.identity.websso.client.SsoValidationState              Validating SAMLResponse..

              [2019-11-12T08:57:33.362+11:00] [INFO ] http-nio-5090-exec-1         70009331 100092 ###### com.vmware.identity.websso.client.ValidationState                 Validating request destination: HttpservletRequest destination=https://ingt-m1-utils1.domain.com/ui/saml/websso/ssoSAML message destination=https://ingt-m1-utils1.domain.com/ui/saml/websso/sso

              [2019-11-12T08:57:33.362+11:00] [INFO ] http-nio-5090-exec-1         70009331 100092 ###### com.vmware.identity.websso.client.SsoValidationState              Validating optional request ID: _78bd186886ef261715ca39d006a67f07

              [2019-11-12T08:57:33.362+11:00] [INFO ] http-nio-5090-exec-1         70009331 100092 ###### com.vmware.identity.websso.client.SsoValidationState              Validating assertion..

              [2019-11-12T08:57:33.362+11:00] [INFO ] http-nio-5090-exec-1         70009331 100092 ###### com.vmware.identity.websso.client.SsoValidationState              Parsing assertion..

              [2019-11-12T08:57:33.369+11:00] [INFO ] http-nio-5090-exec-1         70009331 100092 ###### com.vmware.identity.websso.client.SamlUtils                       Validate assertion condition with clock tolerance = 600

              [2019-11-12T08:57:33.369+11:00] [INFO ] http-nio-5090-exec-1         70009331 100092 ###### com.vmware.identity.websso.client.SsoValidationState              NameID: mv@domain.com

              [2019-11-12T08:57:33.369+11:00] [INFO ] http-nio-5090-exec-1         70009331 100092 ###### com.vmware.identity.websso.client.SsoValidationState              NameIDFormat: http://schemas.xmlsoap.org/claims/UPN

              [2019-11-12T08:57:33.369+11:00] [INFO ] http-nio-5090-exec-1         70009331 100092 ###### com.vmware.identity.websso.client.SamlUtils                       Validate sessionNotOnOrAfter with clock tolerance = 600

              [2019-11-12T08:57:33.369+11:00] [INFO ] http-nio-5090-exec-1         70009331 100092 ###### com.vmware.identity.websso.client.SsoValidationState              Successfully validated SSO Assertion

              [2019-11-12T08:57:33.369+11:00] [INFO ] http-nio-5090-exec-1         70009331 100092 ###### com.vmware.identity.websso.client.SsoValidationState              Successfully validated received SAMLResponse

              [2019-11-12T08:57:33.369+11:00] [INFO ] http-nio-5090-exec-1         70009331 100092 ###### com.vmware.identity.websso.client.Message                         Incoming or outgoing SAML message.

              Message Type:AUTHN_RESPONSE

              ID:_d1a09fa1d63286e4bd0c7059a0bf0673

              SessionIndex:_278ac8f79169bdae1f1f40270daa348d

              Message source:https://INGT-M1-UTILS1.domain.com/websso/SAML2/Metadata/vsphere.local

              Message destination:https://ingt-m1-utils1.domain.com/ui/saml/websso/sso

              Message validation result (for incoming messages):urn:oasis:names:tc:SAML:2.0:status:Success

               

               

              [2019-11-12T08:57:33.369+11:00] [INFO ] http-nio-5090-exec-1         70009331 100092 ###### com.vmware.vsphere.client.security.websso.LogonProcessorImpl      Websso authentication successful.

              [2019-11-12T08:57:33.370+11:00] [INFO ] http-nio-5090-exec-1         70009331 100092 ###### com.vmware.vsphere.client.security.websso.LogonProcessorImpl      Parsing the XML token

              [2019-11-12T08:57:33.372+11:00] [INFO ] http-nio-5090-exec-1         70009331 100092 ###### com.vmware.vise.vim.security.sso.impl.SsoLsLocatorImpl            Retrieved locations of services from LS at https://INGT-M1-UTILS1.domain.com:443/lookupservice/sdk in 1 milliseconds:

              {vsphere.local(5e6ff3c0-a8cf-11e5-9ac3-000c292f5d25@L)=adminAppUrl: https://INGT-M1-UTILS1.domain.com/sso-adminserver/sdk/vsphere.local, stsUrl: https://INGT-M1-UTILS1.domain.com/sts/STSService/vsphere.local, metadataUrl: https://INGT-M1-UTILS1.domain.com/websso/SAML2/Metadata/vsphere.local, vmodlVersion: interface com.vmware.vim.binding.sso.version.version3_5}

              [2019-11-12T08:57:33.375+11:00] [INFO ] http-nio-5090-exec-1         70009331 100092 ###### com.vmware.identity.token.impl.SamlTokenImpl                      SAML token for SubjectNameId [value=mv@domain.com, format=http://schemas.xmlsoap.org/claims/UPN] successfully parsed from Element

              [2019-11-12T08:57:33.376+11:00] [INFO ] http-nio-5090-exec-1         70009331 100092 ###### com.vmware.vsphere.client.security.websso.LogonProcessorImpl      Websso handshake done, forwarding to /ngc_spring_security_check

              [2019-11-12T08:57:33.376+11:00] [INFO ] http-nio-5090-exec-1         70009331 100092 ###### com.vmware.vise.security.spring.DefaultAuthenticationProvider     authentication starting

              [2019-11-12T08:57:33.376+11:00] [INFO ] http-nio-5090-exec-1         70009331 100092 ###### com.vmware.vise.security.spring.DefaultAuthenticationProvider     Authenticating user: null using authentication handler: com.vmware.vsphere.client.security.sso.SsoAuthenticationHandler@1294bf3f

              [2019-11-12T08:57:33.376+11:00] [INFO ] http-nio-5090-exec-1         70009331 100092 ###### com.vmware.vsphere.client.security.sso.SsoAuthenticationHandler   Exchanging the websso token for a Hok token.

              [2019-11-12T08:57:33.378+11:00] [INFO ] http-nio-5090-exec-1         70009331 100092 ###### com.vmware.vise.vim.security.sso.impl.SsoLsLocatorImpl            Retrieved locations of services from LS at https://INGT-M1-UTILS1.domain.com:443/lookupservice/sdk in 2 milliseconds:

              {vsphere.local(5e6ff3c0-a8cf-11e5-9ac3-000c292f5d25@L)=adminAppUrl: https://INGT-M1-UTILS1.domain.com/sso-adminserver/sdk/vsphere.local, stsUrl: https://INGT-M1-UTILS1.domain.com/sts/STSService/vsphere.local, metadataUrl: https://INGT-M1-UTILS1.domain.com/websso/SAML2/Metadata/vsphere.local, vmodlVersion: interface com.vmware.vim.binding.sso.version.version3_5}

              [2019-11-12T08:57:33.378+11:00] [INFO ] tokenAcqExec-22351           70009331 100092 ###### com.vmware.vise.vim.security.sso.AsyncTokenManager                Acquiring token from token for SSO domain vsphere.local(5e6ff3c0-a8cf-11e5-9ac3-000c292f5d25@L) from STS server https://INGT-M1-UTILS1.domain.com/sts/STSService/vsphere.local

              [2019-11-12T08:57:33.380+11:00] [INFO ] tokenAcqExec-22351           70009331 100092 ###### com.vmware.vise.vim.security.sso.impl.SsoLsLocatorImpl            Retrieved locations of services from LS at https://INGT-M1-UTILS1.domain.com:443/lookupservice/sdk in 2 milliseconds:

              {vsphere.local(5e6ff3c0-a8cf-11e5-9ac3-000c292f5d25@L)=adminAppUrl: https://INGT-M1-UTILS1.domain.com/sso-adminserver/sdk/vsphere.local, stsUrl: https://INGT-M1-UTILS1.domain.com/sts/STSService/vsphere.local, metadataUrl: https://INGT-M1-UTILS1.domain.com/websso/SAML2/Metadata/vsphere.local, vmodlVersion: interface com.vmware.vim.binding.sso.version.version3_5}

              [2019-11-12T08:57:33.380+11:00] [INFO ] tokenAcqExec-22351           70009331 100092 ###### com.vmware.vise.vim.security.sso.impl.SsoUtilInternal             Exchanging token _cb7f64db-c661-48d9-8ec3-908cb3cf2bd0 for a new one using https://INGT-M1-UTILS1.domain.com/sts/STSService/vsphere.local from domain vsphere.local(5e6ff3c0-a8cf-11e5-9ac3-000c292f5d25@L)

              [2019-11-12T08:57:33.392+11:00] [INFO ] tokenAcqExec-22351           70009331 100092 ###### com.vmware.vim.sso.client.impl.SiteAffinityServiceDiscovery       Site affinity is disabled

              [2019-11-12T08:57:33.473+11:00] [INFO ] tokenAcqExec-22351           70009331 100092 ###### com.vmware.identity.token.impl.SamlTokenImpl                      SAML token for SubjectNameId [value=mv@domain.com, format=http://schemas.xmlsoap.org/claims/UPN] successfully parsed from Element

              [2019-11-12T08:57:33.474+11:00] [INFO ] tokenAcqExec-22351           70009331 100092 ###### com.vmware.vim.sso.client.impl.SecurityTokenServiceImpl           Successfully acquired token for user: {Name: mv, Domain: domain.com}

              [2019-11-12T08:57:33.474+11:00] [INFO ] tokenAcqExec-22351           70009331 100092 ###### com.vmware.vise.vim.security.sso.AsyncTokenManager                Acquired token. Expiration time: Tue Nov 12 09:01:18 AEDT 2019

              [2019-11-12T08:57:33.474+11:00] [INFO ] http-nio-5090-exec-1         70009331 100092 ###### com.vmware.vsphere.client.security.sso.SsoAuthenticationHandler   New token data: start time=Tue Nov 12 08:57:33 AEDT 2019, expiration time=Tue Nov 12 09:01:18 AEDT 2019, conf.type=HOLDER_OF_KEY

              [2019-11-12T08:57:33.474+11:00] [INFO ] http-nio-5090-exec-1         70009331 100092 ###### com.vmware.vise.util.session.SessionUtil                          Added clientId 200004. Total clientIds so far (incl. the newly added one): 3

              [2019-11-12T08:57:33.474+11:00] [INFO ] http-nio-5090-exec-1         70009331 100092 200004 com.vmware.vise.util.session.SessionUtil                          Associated sessionId 100092 with clientId 200004. Context path: /ui. This session can destroy the client data container when it expires

              [2019-11-12T08:57:33.474+11:00] [INFO ] http-nio-5090-exec-1         70009331 100092 200004 com.vmware.vise.util.session.SessionUtil                          Assigned clientId 200004 to session 100092 with context path: /ui

              [2019-11-12T08:57:33.474+11:00] [INFO ] http-nio-5090-exec-1         70009331 100092 200004 com.vmware.vise.util.session.SessionUtil                          ClientId 200004 was automatically generated

              [2019-11-12T08:57:33.474+11:00] [INFO ] http-nio-5090-exec-1         70009331 100092 200004 com.vmware.vsphere.client.security.sso.SsoAuthenticationHandler   Username=mv@domain.com has clientId=200004. Use that clientId to track user activities below.

              [2019-11-12T08:57:33.476+11:00] [INFO ] http-nio-5090-exec-1         70009331 100092 200004 com.vmware.vise.vim.security.sso.impl.SsoLsLocatorImpl            Retrieved locations of services from LS at https://INGT-M1-UTILS1.domain.com:443/lookupservice/sdk in 2 milliseconds:

              {vsphere.local(5e6ff3c0-a8cf-11e5-9ac3-000c292f5d25@L)=adminAppUrl: https://INGT-M1-UTILS1.domain.com/sso-adminserver/sdk/vsphere.local, stsUrl: https://INGT-M1-UTILS1.domain.com/sts/STSService/vsphere.local, metadataUrl: https://INGT-M1-UTILS1.domain.com/websso/SAML2/Metadata/vsphere.local, vmodlVersion: interface com.vmware.vim.binding.sso.version.version3_5}

              [2019-11-12T08:57:33.476+11:00] [INFO ] http-nio-5090-exec-1         70009331 100092 200004 com.vmware.vsphere.client.security.sso.SsoAuthenticationHandler   SSO authentication successful for sessionId 100092, clientId 200004

              [2019-11-12T08:57:33.476+11:00] [INFO ] http-nio-5090-exec-1         70009331 100092 200004 com.vmware.vise.security.spring.DefaultAuthenticationProvider     Authenticating user: null using authentication handler: com.vmware.vsphere.client.security.VimAuthenticationHandler@3a9de0c4

              [2019-11-12T08:57:33.476+11:00] [INFO ] http-nio-5090-exec-1         70009331 100092 200004 com.vmware.vsphere.client.security.VimAuthenticationHandler       Logging in to LinkedVcGroupRegistry for session 100092

              [2019-11-12T08:57:33.521+11:00] [INFO ] http-nio-5090-exec-1         70009331 100092 200004 com.vmware.vsphere.client.security.impl.LookupServiceVcSource     Found vCenter Server https://INGT-M1-UTILS1.domain.com:443/sdk with id 95664431-2508-4b2a-9f35-dbfa7aa5559b in from Lookup Service. SSO domain: vsphere.local(5e6ff3c0-a8cf-11e5-9ac3-000c292f5d25@L)

              [2019-11-12T08:57:33.521+11:00] [INFO ] http-nio-5090-exec-1         70009331 100092 200004 com.vmware.vise.util.concurrent.ExecutorUtil                      Processing task connectAndLoginToVcServer:https://INGT-M1-UTILS1.domain.com:443/sdk

              [2019-11-12T08:57:33.521+11:00] [INFO ] http-nio-5090-exec-1         70009331 100092 200004 com.vmware.vise.util.concurrent.ExecutorUtil                      Executing task connectAndLoginToVcServer:https://INGT-M1-UTILS1.domain.com:443/sdk

              [2019-11-12T08:57:33.523+11:00] [INFO ] im-authentication-pool-22352 70009331 100092 200004 com.vmware.vise.vim.commons.vcservice.impl.VcServiceImpl          Initializing vmomi for VC https://INGT-M1-UTILS1.domain.com:443/sdk at VMODL version com.vmware.vim.binding.vim.version.internal.version14 with ID '6.7.2'

              [2019-11-12T08:57:33.530+11:00] [WARN ] im-authentication-pool-22352 70009331 100092 200004 com.vmware.vise.vim.commons.vcservice.impl.VcServiceImpl          VC https://INGT-M1-UTILS1.domain.com:443/sdk doesn't support the requested locale "en_US". Will use "en" instead.

              [2019-11-12T08:57:33.530+11:00] [INFO ] im-authentication-pool-22352 70009331 100092 200004 com.vmware.vise.vim.commons.vcservice.impl.VcServiceImpl          Vmomi initialization successful for VC https://INGT-M1-UTILS1.domain.com:443/sdk (95664431-2508-4b2a-9f35-dbfa7aa5559b), locale=en

              [2019-11-12T08:57:33.530+11:00] [INFO ] im-authentication-pool-22352 70009331 100092 200004 com.vmware.vise.vim.commons.vcservice.impl.LinkedVcGroupImpl      Processing peer vc servers - https://INGT-M1-UTILS1.domain.com:443/sdk

              [2019-11-12T08:57:33.530+11:00] [INFO ] im-authentication-pool-22352 70009331 100092 200004 com.vmware.vise.vim.commons.vcservice.impl.LinkedVcGroupImpl      Peer VC servers: []

              [2019-11-12T08:57:33.530+11:00] [INFO ] im-authentication-pool-22352 70009331 100092 200004 com.vmware.vise.vim.commons.vcservice.impl.LinkedVcGroupImpl      Created VC registry: https://INGT-M1-UTILS1.domain.com:443/sdk(95664431-2508-4b2a-9f35-dbfa7aa5559b)

              [2019-11-12T08:57:33.530+11:00] [INFO ] im-authentication-pool-22352 70009331 100092 200004 com.vmware.vise.vim.commons.vcservice.impl.LinkedVcGroupImpl      Created a linked VC group: [https://INGT-M1-UTILS1.domain.com:443/sdk(95664431-2508-4b2a-9f35-dbfa7aa5559b)]

              [2019-11-12T08:57:33.530+11:00] [INFO ] im-authentication-pool-22352 70009331 100092 200004 com.vmware.vise.vim.commons.vcservice.impl.LinkedVcGroupImpl      Logging into startup VC: https://INGT-M1-UTILS1.domain.com:443/sdk

              [2019-11-12T08:57:33.554+11:00] [INFO ] im-authentication-pool-22352 70009331 100092 200004 com.vmware.vise.vim.commons.vcservice.impl.VcServiceImpl          loginByToken successful on vc https://INGT-M1-UTILS1.domain.com:443/sdk

              [2019-11-12T08:57:33.554+11:00] [INFO ] im-authentication-pool-22352 70009331 100092 200004 com.vmware.vise.vim.commons.vcservice.impl.VcServiceImpl          logged in VC with id 3000006

              [2019-11-12T08:57:33.554+11:00] [INFO ] im-authentication-pool-22352 70009331 100092 200004 com.vmware.vise.vim.commons.vcservice.impl.VcServiceImpl          Successfully logged into VC https://INGT-M1-UTILS1.domain.com:443/sdk for session: 100092

              [2019-11-12T08:57:33.554+11:00] [INFO ] im-authentication-pool-22352 70009331 100092 200004 com.vmware.vise.vim.commons.vcservice.impl.LinkedVcGroupImpl      Login successful to start-up VC: https://INGT-M1-UTILS1.domain.com:443/sdk

              [2019-11-12T08:57:33.554+11:00] [INFO ] im-authentication-pool-22352 70009331 100092 200004 com.vmware.vise.vim.commons.vcservice.impl.LinkedVcGroupImpl      Login to peer vc servers for startup VC https://INGT-M1-UTILS1.domain.com:443/sdk

              [2019-11-12T08:57:33.554+11:00] [INFO ] im-authentication-pool-22352 70009331 100092 200004 com.vmware.vise.vim.commons.vcservice.impl.LinkedVcGroupImpl      Peer vc servers for https://INGT-M1-UTILS1.domain.com:443/sdk:

              []

              [2019-11-12T08:57:33.554+11:00] [INFO ] im-authentication-pool-22352 70009331 100092 200004 com.vmware.vise.vim.commons.vcservice.impl.LinkedVcGroupImpl      There are no peers

              [2019-11-12T08:57:33.555+11:00] [INFO ] im-authentication-pool-22352 70009331 100092 200004 c.v.vise.vim.commons.extensions.impl.LinkedVcGroupRegistryImpl    Added a linked VC group to registry. Endpoints: https://INGT-M1-UTILS1.domain.com:443/sdk(95664431-2508-4b2a-9f35-dbfa7aa5559b,vsphere.local(5e6ff3c0-a8cf-11e5-9ac3-000c292f5d25@L))

              [2019-11-12T08:57:33.555+11:00] [INFO ] http-nio-5090-exec-1         70009331 100092 200004 com.vmware.vsphere.client.security.VimAuthenticationHandler       LinkedVcGroupRegistry login complete 100092

              [2019-11-12T08:57:33.555+11:00] [INFO ] http-nio-5090-exec-1         70009331 100092 200004 com.vmware.vsphere.client.security.VimAuthenticationHandler       Authentication successful for session : 100092

              [2019-11-12T08:57:33.555+11:00] [INFO ] http-nio-5090-exec-1         70009331 100092 200004 com.vmware.vsphere.client.security.VimAuthenticationHandler       3 authenticated VIM session(s).

              [2019-11-12T08:57:33.555+11:00] [INFO ] http-nio-5090-exec-1         70009331 100092 200004 com.vmware.vsphere.client.security.VimAuthenticationHandler       VIM authentication successful for sessionId 100092, clientId 200004

              [2019-11-12T08:57:33.557+11:00] [INFO ] http-nio-5090-exec-1         70009331 100092 200004 com.vmware.vise.security.SessionListener                          sessionDestroyed invoked for sessionId 100092

              [2019-11-12T08:57:33.557+11:00] [INFO ] http-nio-5090-exec-1         70009331 100092 200004 com.vmware.vise.security.SessionListener                          Session 100092 with context-path {/ui} associated with client 200004 is destroyed.

              [2019-11-12T08:57:33.557+11:00] [INFO ] http-nio-5090-exec-1         70009331 com.vmware.vise.util.session.SessionUtil                          Generated hashed session id: 100093

              [2019-11-12T08:57:33.557+11:00] [INFO ] http-nio-5090-exec-1         70009331 100093 ###### com.vmware.vise.security.SessionListener                          Session 100093 created with context path: /ui

              [2019-11-12T08:57:33.557+11:00] [INFO ] http-nio-5090-exec-1         70009331 100093 ###### com.vmware.vise.security.spring.DefaultAuthenticationProvider     Successful authentication handler running for sessionId 100093, clientId 200004

              [2019-11-12T08:57:33.557+11:00] [INFO ] http-nio-5090-exec-1         70009331 100093 ###### com.vmware.vise.security.spring.DefaultAuthenticationProvider     Starting authhandlers for sessionId 100093, clientId 200004

              [2019-11-12T08:57:33.557+11:00] [INFO ] http-nio-5090-exec-1         70009331 100093 ###### com.vmware.vise.security.spring.DefaultAuthenticationProvider     Running initSession for sessionId 100093, clientId 200004

              [2019-11-12T08:57:33.557+11:00] [INFO ] http-nio-5090-exec-1         70009331 100093 ###### com.vmware.vise.security.spring.DefaultAuthenticationProvider     Initializing Session: sessionId 100093, clientId 200004

              [2019-11-12T08:57:33.557+11:00] [INFO ] http-nio-5090-exec-1         70009331 100093 ###### com.vmware.vise.security.spring.DefaultAuthenticationProvider     Retrieving session listeners for sessionId 100093, clientId 200004

              [2019-11-12T08:57:33.557+11:00] [INFO ] http-nio-5090-exec-1         70009331 100093 ###### com.vmware.vise.security.spring.DefaultAuthenticationProvider     Invoking session listeners

              [2019-11-12T08:57:33.557+11:00] [INFO ] ncPluginDeploymentExecutor-1 70009243 100083 200003 c.vmware.vise.vim.extension.login.LoginPluginDeploymentInitiator  Checking for new plugins...

              [2019-11-12T08:57:33.558+11:00] [INFO ] taskExecutor-1               70009331 100093 200004 c.vmware.license.client.management.adapter.LicenseInventoryCache  Retrieving license inventory...

              [2019-11-12T08:57:33.559+11:00] [INFO ] session-init-pool-22355      70009331 100093 200004 com.vmware.vsphere.client.security.sso.SsoTokenLifetimeManager    Registering session: 100093

              [2019-11-12T08:57:33.559+11:00] [WARN ] session-init-pool-22355      70009331 100093 200004 com.vmware.vsphere.client.security.sso.SsoTokenLifetimeManager    Token has less than 5 minutes left. sessionId 100093, clientId 200004

              [2019-11-12T08:57:33.559+11:00] [INFO ] session-init-pool-22355      70009331 100093 200004 com.vmware.vsphere.client.security.sso.SsoTokenLifetimeManager    sessionId 100093, clientId 200004, Token expiration time: Tue Nov 12 09:01:18 AEDT 2019

              Token renewal scheduled approximately for: Tue Nov 12 08:59:48 AEDT 2019

              [2019-11-12T08:57:33.580+11:00] [INFO ] http-nio-5090-exec-1         70009331 100093 ###### com.vmware.vise.security.spring.DefaultAuthenticationProvider     Session initialization complete for sessionId 100093, clientId 200004

              [2019-11-12T08:57:33.589+11:00] [INFO ] http-nio-5090-exec-6         70009332 100093 200004 com.vmware.vise.util.PropertyUtil                                 Property 'remote.plugin.updateOnBrowserRefresh' is missing. Will use the default: false

              [2019-11-12T08:57:33.590+11:00] [INFO ] http-nio-5090-exec-6         70009332 100093 200004 com.vmware.vise.util.PropertyUtil                                 Property 'local.development' is missing. Will use the default: false

              [2019-11-12T08:57:33.603+11:00] [INFO ] http-nio-5090-exec-6         70009332 100093 200004 com.vmware.vise.util.PropertyUtil                                 Property 'codecapture.disabled' is missing. Will use the default: false

              [2019-11-12T08:57:33.657+11:00] [INFO ] ce-extension-mngr-pool-22361 70009331 100093 200004 com.vmware.vise.util.PropertyUtil                                 Property 'plugin.signature.check.enabled' is missing. Will use the default: true

              [2019-11-12T08:57:33.657+11:00] [WARN ] ce-extension-mngr-pool-22361 70009331 100093 200004 c.vmware.vise.vim.directory.extensions.DirectoryExtensionManager  Detected an invalid signature for plugin: com.vmware.fallback.mixed:6.5.0 - com.vmware.vise.extensionfw.signing.PluginSignatureException: No META-INF/MANIFEST.MF entry found in the plugin zip file.

              [2019-11-12T08:57:33.657+11:00] [INFO ] ce-extension-mngr-pool-22361 70009331 100093 200004 com.vmware.vise.vim.extension.PluginStatusTaskManager             DEPLOYING: Deploying plugin package com.vmware.fallback.mixed:6.5.0 ...

              [2019-11-12T08:57:33.667+11:00] [INFO ] ce-extension-mngr-pool-22361 70009331 100093 200004 com.vmware.vise.vim.extension.PluginStatusTaskManager             DEPLOYMENT_FAILED: Error deploying plugin package com.vmware.fallback.mixed:6.5.0. Reason: Incompatible. This is a vSphere Web Client (Flash) only plugin indicated by the missing type="html" plugin manifest attribute.

              [2019-11-12T08:57:33.667+11:00] [INFO ] plugin-validation1            com.vmware.vise.extensionfw.impl.OsgiUsageValidationService       Started validation of OSGi bad practices.

              [2019-11-12T08:57:33.667+11:00] [INFO ] plugin-validation1            com.vmware.vise.extensionfw.impl.OsgiUsageValidationService       Finished validation of OSGi bad practices.

              [2019-11-12T08:57:33.676+11:00] [INFO ] ce-extension-mngr-pool-22362 70009331 100093 200004 com.vmware.vise.util.PropertyUtil                                 Property 'plugin.signature.check.enabled' is missing. Will use the default: true

              [2019-11-12T08:57:33.676+11:00] [WARN ] ce-extension-mngr-pool-22362 70009331 100093 200004 c.vmware.vise.vim.directory.extensions.DirectoryExtensionManager  Detected an invalid signature for plugin: com.vmware.vcIntegrity.vcIntegrity:6.7.0.41905 - com.vmware.vise.extensionfw.signing.PluginSignatureException: No META-INF/MANIFEST.MF entry found in the plugin zip file.

              [2019-11-12T08:57:33.677+11:00] [INFO ] ce-extension-mngr-pool-22362 70009331 100093 200004 com.vmware.vise.vim.extension.PluginStatusTaskManager             DEPLOYING: Deploying plugin package com.

              vmware.vcIntegrity.vcIntegrity:6.7.0.41905 ...

              [2019-11-12T08:57:33.681+11:00] [INFO ] m-catalog-manager-pool-22354 70009331 100093 200004 com.vmware.vise.vim.lookup.LsCatalogManager                       detectServiceProviders took (ms):122

              [2019-11-12T08:57:33.696+11:00] [INFO ] m-catalog-manager-pool-22354 70009331 100093 200004 com.vmware.vise.vim.lookup.LsCatalogManager                       processResourceBundles took (ms):15

              [2019-11-12T08:57:33.696+11:00] [INFO ] m-catalog-manager-pool-22364 70009334 100093 200004 com.vmware.vise.vim.lookup.LsCatalogManager                       Loading properties for /etc/vmware/vsphere-ui/cmCatalog/com.vmware.cis.com.vmware.vsan.health.zip:US

              [2019-11-12T08:57:33.698+11:00] [WARN ] ce-extension-mngr-pool-22361 70009331 100093 200004 c.vmware.vise.vim.directory.extensions.DirectoryExtensionManager  Could not download bundle com.vmware.imagebuilder.imagebuilder from https://INGT-M1-UTILS1.domain.com:443/vmw/imagebuilder/httpd/autodeploy-modules-plugins.zip.

              [2019-11-12T08:57:33.701+11:00] [INFO ] m-catalog-manager-pool-22365 70009336 100093 200004 com.vmware.vise.vim.lookup.LsCatalogManager                       Loading properties for /etc/vmware/vsphere-ui/cmCatalog/com.vmware.vim.sms.sms-6.7.0.0.zip:US

              [2019-11-12T08:57:33.701+11:00] [INFO ] m-catalog-manager-pool-22365 70009336 100093 200004 com.vmware.vise.vim.lookup.LsCatalogManager                       Time waiting for csp info (ms) for /etc/vmware/vsphere-ui/cmCatalog/com.vmware.vim.sms.sms-6.7.0.0.zip:US: 0

              [2019-11-12T08:57:33.701+11:00] [INFO ] m-catalog-manager-pool-22363 70009335 100093 200004 com.vmware.vise.vim.lookup.LsCatalogManager                       downloadResourceBundle: Trying https://INGT-M1-UTILS1.domain.com:443/catalog/com.vmware.vsan.health_catalog.zip

              [2019-11-12T08:57:33.701+11:00] [INFO ] m-catalog-manager-pool-22365 70009336 100093 200004 com.vmware.vise.vim.lookup.LocalizedMessageDictionary             Loaded Resource bundle cis.sms.ResourceBundle

              [2019-11-12T08:57:33.702+11:00] [WARN ] m-catalog-manager-pool-22365 70009336 100093 200004 com.vmware.vise.vim.lookup.LocalizedMessageDictionary             135 Resource Bundle entry conflicts found for: /etc/vmware/vsphere-ui/cmCatalog/com.vmware.vim.sms.sms-6.7.0.0.zip/cis.sms.ResourceBundle:US

              [2019-11-12T08:57:33.702+11:00] [INFO ] m-catalog-manager-pool-22365 70009336 100093 200004 com.vmware.vise.vim.lookup.LocalizedMessageDictionary             Loaded 135 elements from bundle: /etc/vmware/vsphere-ui/cmCatalog/com.vmware.vim.sms.sms-6.7.0.0.zip/cis.sms.ResourceBundle:US

              [2019-11-12T08:57:33.702+11:00] [INFO ] m-catalog-manager-pool-22365 70009336 100093 200004 com.vmware.vise.vim.lookup.LsCatalogManager                       Time to load properties (ms)/etc/vmware/vsphere-ui/cmCatalog/com.vmware.vim.sms.sms-6.7.0.0.zip:US: 1

              [2019-11-12T08:57:33.709+11:00] [INFO ] taskExecutor-1               70009331 100093 200004 c.vmware.license.client.management.adapter.LicenseInventoryCache  Retrieved 2 licenses.

              [2019-11-12T08:57:33.711+11:00] [WARN ] ce-extension-mngr-pool-22362 70009331 100093 200004 com.vmware.vise.extensionfw.impl.PackageManifestParser            Plugin id mismatch between the registered extension key (com.vmware.vcIntegrity.vcIntegrity)

              and the id specified in plugin-package.xml (com.vmware.vumclient). The registration id will be used but you should keep them in sync.

              [2019-11-12T08:57:33.711+11:00] [WARN ] ce-extension-mngr-pool-22362 70009331 100093 200004 com.vmware.vise.extensionfw.impl.PackageManifestParser            Plugin version mismatch for com.vmware.vcIntegrity.vcIntegrity between the plugin registration info (6.7.0.41905)

              and the version specified in plugin-package.xml (6.7.0). The registration version will be used but you should keep them in sync.

              [2019-11-12T08:57:33.723+11:00] [ERROR] m-catalog-manager-pool-22363 70009335 100093 200004 com.vmware.vise.vim.lookup.LsCatalogManager                       Invoking 'downloadResourceBundle(com.vmware.cis.com.vmware.vsan.health from https://INGT-M1-UTILS1.domain.com:443/catalog/com.vmware.vsan.health_catalog.zip)' unsuccessful, retry time left = None. Returning default result org.apache.http.HttpException: HttpStatus is not SC_OK. statusCode = 404

                      at com.vmware.vise.vim.lookup.LsCatalogManager.executeDownload(LsCatalogManager.java:1568)

                      at com.vmware.vise.vim.lookup.LsCatalogManager.downloadResourceBundle(LsCatalogManager.java:1509)

                      at com.vmware.vise.vim.lookup.LsCatalogManager.access$1300(LsCatalogManager.java:98)

                      at com.vmware.vise.vim.lookup.LsCatalogManager$7.call(LsCatalogManager.java:1437)

                      at com.vmware.vise.vim.lookup.LsCatalogManager$7.call(LsCatalogManager.java:1435)

                      at com.vmware.vise.vim.lookup.LsCatalogManager.retryUntil(LsCatalogManager.java:1708)

                      at com.vmware.vise.vim.lookup.LsCatalogManager.initializeCatalogServiceProviderInfo(LsCatalogManager.java:1442)

                      at com.vmware.vise.vim.lookup.LsCatalogManager.access$1200(LsCatalogManager.java:98)

                      at com.vmware.vise.vim.lookup.LsCatalogManager$6.call(LsCatalogManager.java:1251)

                      at com.vmware.vise.vim.lookup.LsCatalogManager$6.call(LsCatalogManager.java:1239)

                      at java.util.concurrent.FutureTask.run(FutureTask.java:266)

                      at com.vmware.vise.util.concurrent.QueuingCachedThreadPool$2.call(QueuingCachedThreadPool.java:831)

                      at java.util.concurrent.FutureTask.run(FutureTask.java:266)

                      at com.vmware.vise.util.concurrent.QueuingCachedThreadPool$QueueProcessor.run(QueuingCachedThreadPool.java:1229)

                      at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)

                      at java.util.concurrent.FutureTask.run(FutureTask.java:266)

                      at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)

                      at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)

                      at com.vmware.vise.util.concurrent.WorkerThreadFactory$1.run(WorkerThreadFactory.java:64)

                      at java.lang.Thread.run(Thread.java:748)

               

               

              [2019-11-12T08:57:33.723+11:00] [WARN ] m-catalog-manager-pool-22363 70009335 100093 200004 com.vmware.vise.vim.lookup.LsCatalogManager                       Failed to download /etc/vmware/vsphere-ui/cmCatalog/com.vmware.cis.com.vmware.vsan.health.zip from https://INGT-M1-UTILS1.domain.com:443/catalog/com.vmware.vsan.health_catalog.zip.

              [2019-11-12T08:57:33.723+11:00] [INFO ] m-catalog-manager-pool-22363 70009335 100093 200004 com.vmware.vise.vim.lookup.LsCatalogManager                       The HttpClient is no longer used. Will Close it.

              [2019-11-12T08:57:33.723+11:00] [INFO ] m-catalog-manager-pool-22364 70009334 100093 200004 com.vmware.vise.vim.lookup.LsCatalogManager                       Time waiting for csp info (ms) for /etc/vmware/vsphere-ui/cmCatalog/com.vmware.cis.com.vmware.vsan.health.zip:US: 27

              [2019-11-12T08:57:33.723+11:00] [INFO ] m-catalog-manager-pool-22364 70009334 100093 200004 com.vmware.vise.vim.lookup.LsCatalogManager                       Unable to get catalogServiceProviderInfo for /etc/vmware/vsphere-ui/cmCatalog/com.vmware.cis.com.vmware.vsan.health.zip:US

              [2019-11-12T08:57:33.723+11:00] [INFO ] m-catalog-manager-pool-22364 70009334 100093 200004 com.vmware.vise.vim.lookup.LsCatalogManager                       Time to load properties (ms)/etc/vmware/vsphere-ui/cmCatalog/com.vmware.cis.com.vmware.vsan.health.zip:US: 0

              [2019-11-12T08:57:34.040+11:00] [INFO ] ce-extension-mngr-pool-22362 70009331 100093 200004 com.vmware.vise.vim.extension.PluginStatusTaskManager             DEPLOYMENT_FAILED: Error deploying plugin package com.vmware.vcIntegrity.vcIntegrity:6.7.0.41905. Reason: Incompatible. This is a vSphere Web Client (Flash) only plugin indicated by the missing type="html" plugin manifest attribute.

              [2019-11-12T08:57:34.046+11:00] [INFO ] plugin-validation1            com.vmware.vise.extensionfw.impl.OsgiUsageValidationService       Started validation of OSGi bad practices.

              [2019-11-12T08:57:34.046+11:00] [INFO ] ncPluginDeploymentExecutor-1 70009331 100093 200004 c.vmware.vise.vim.extension.login.LoginPluginDeploymentInitiator  Check for new plugins completed in 489 ms.

              [2019-11-12T08:57:34.046+11:00] [INFO ] plugin-validation1            com.vmware.vise.extensionfw.impl.OsgiUsageValidationService       Finished validation of OSGi bad practices.

              [2019-11-12T08:57:36.158+11:00] [INFO ] http-nio-5090-exec-6          com.vmware.vise.util.session.SessionUtil                          Generated hashed session id: 100094

              [2019-11-12T08:57:36.158+11:00] [INFO ] http-nio-5090-exec-6         70009343 100094 200004 com.vmware.vise.util.session.SessionUtil                          Mapping: /websocket: sessionid to -> 100094 with clientId: 200004

              [2019-11-12T08:57:36.166+11:00] [INFO ] data-service-pool-771         com.vmware.vise.util.session.SessionUtil                          Generated hashed session id: 100095

              [2019-11-12T08:57:36.166+11:00] [INFO ] data-service-pool-771         com.vmware.vise.util.session.SessionUtil                          Mapping: /websocket: sessionid to -> 100095 with clientId: 200004

              [2019-11-12T08:57:36.253+11:00] [INFO ] data-service-pool-771         com.vmware.vise.util.session.SessionUtil                          Generated hashed session id: 100096

              [2019-11-12T08:57:36.253+11:00] [INFO ] data-service-pool-771         com.vmware.vise.util.session.SessionUtil                          Mapping: /websocket: sessionid to -> 100096 with clientId: 200004

              [2019-11-12T08:57:36.253+11:00] [INFO ] data-service-pool-771        70009346 100096 200004 c.v.v.client.folder.LazyLoadingDataMigrationPropertyProvider      [getProperties] startedTime -- '2019-11-11T21:57:36.253Z'

              [2019-11-12T08:57:36.819+11:00] [WARN ] http-nio-5090-exec-10        70009354 100093 200004 com.vmware.vise.mvc.tree.TreeNodeStateManagerImpl                 Failed to load user preferences.

              [2019-11-12T08:57:37.437+11:00] [WARN ] data-service-pool-797        70009365 100093 200004 c.v.v.c.vsandp.core.sessionmanager.resource.util.VersionService   Version 'urn:vsan:6.9.0' not supported by the server.

              [2019-11-12T08:57:37.437+11:00] [INFO ] data-service-pool-797        70009365 100093 200004 c.vmware.vsphere.client.vsan.base.service.VsanServiceFactoryBase  Using VMODL version: com.vmware.vim.vsan.binding.vsan.version.version11

              [2019-11-12T08:57:37.492+11:00] [INFO ] data-service-pool-797        70009365 100093 200004 com.vmware.vsan.client.util.Measure                               VsanCapabilitySystem.getCapabilities (0.08 s):

              VsanCapabilitySystem.getCapabilities77

              [2019-11-12T08:57:37.507+11:00] [WARN ] data-service-pool-759        70009365 100093 200004 c.v.v.c.vsandp.core.sessionmanager.resource.util.VersionService   Version 'urn:vsan:6.9.0' not supported by the server.

              [2019-11-12T08:57:37.508+11:00] [WARN ] data-service-pool-759        70009365 100093 200004 c.v.v.c.vsandp.core.sessionmanager.resource.util.VersionService   Version 'urn:vsan:vSAN 6.7U3' not supported by the server.

              [2019-11-12T08:57:37.508+11:00] [WARN ] data-service-pool-759        70009365 100093 200004 c.v.v.c.vsandp.core.sessionmanager.resource.util.VersionService   Version 'urn:vsan:6.8.7' not supported by the server.

              [2019-11-12T08:57:37.508+11:00] [WARN ] data-service-pool-759        70009365 100093 200004 c.v.v.c.vsandp.core.sessionmanager.resource.util.VersionService   Version 'urn:vsan:vSAN 6.7U1' not supported by the server.

              [2019-11-12T08:57:37.508+11:00] [WARN ] data-service-pool-759        70009365 100093 200004 c.v.v.c.vsandp.core.sessionmanager.resource.util.VersionService   Version 'urn:vsan:VMC M5' not supported by the server.

              [2019-11-12T08:57:37.508+11:00] [WARN ] data-service-pool-759        70009365 100093 200004 c.v.v.c.vsandp.core.sessionmanager.resource.util.VersionService   Version 'urn:vsan:6.7' not supported by the server.

              [2019-11-12T08:57:37.508+11:00] [WARN ] data-service-pool-759        70009365 100093 200004 c.v.v.c.vsandp.core.sessionmanager.resource.util.VersionService   Version 'urn:vsan:6.7.0' not supported by the server.

              [2019-11-12T08:57:37.508+11:00] [WARN ] data-service-pool-759        70009365 100093 200004 c.v.v.c.vsandp.core.sessionmanager.resource.util.VersionService   Version 'urn:vsan:6.6.2' not supported by the server.

              [2019-11-12T08:57:37.508+11:00] [WARN ] data-service-pool-759        70009365 100093 200004 c.v.v.c.vsandp.core.sessionmanager.resource.util.VersionService   Version 'urn:vsan:6.6.1' not supported by the server.

              [2019-11-12T08:57:37.508+11:00] [WARN ] data-service-pool-759        70009365 100093 200004 c.v.v.c.vsandp.core.sessionmanager.resource.util.VersionService   Version 'urn:vsan:6.6' not supported by the server.

              [2019-11-12T08:57:37.508+11:00] [WARN ] data-service-pool-759        70009365 100093 200004 c.v.v.c.vsandp.core.sessionmanager.resource.util.VersionService   Version 'urn:vim25:unstable' not supported by the server.

              [2019-11-12T08:57:37.508+11:00] [WARN ] data-service-pool-759        70009365 100093 200004 c.v.v.c.vsandp.core.sessionmanager.resource.util.VersionService   Version 'urn:vim25:stable' not supported by the server.

              [2019-11-12T08:57:37.508+11:00] [WARN ] data-service-pool-797        70009365 100093 200004 c.v.v.c.vsandp.core.sessionmanager.resource.util.VersionService   Version 'urn:vsan:6.9.0' not supported by the server.

              [2019-11-12T08:57:37.572+11:00] [INFO ] data-service-pool-759        70009365 100093 200004 com.vmware.identity.token.impl.SamlTokenImpl                      SAML token for SubjectNameId [value=mv@domain.com, format=http://schemas.xmlsoap.org/claims/UPN] successfully parsed from XML

              [2019-11-12T08:57:37.631+11:00] [INFO ] data-service-pool-759        70009365 100093 200004 com.vmware.vsan.client.util.Measure                               VsanCapabilitySystem.getCapabilities (0.04 s):

              VsanCapabilitySystem.getCapabilities40

              [2019-11-12T08:57:38.690+11:00] [INFO ] data-service-pool-771        70009346 100096 200004 c.v.v.client.folder.LazyLoadingDataMigrationPropertyProvider      [getProperties] execution finished and timeTaken to get lazyImportData for '1' vCenters is 'PT2.437S'

              [2019-11-12T08:57:38.691+11:00] [INFO ] data-service-pool-771         com.vmware.vise.util.session.SessionUtil                          Generated hashed session id: 100097

              [2019-11-12T08:57:38.691+11:00] [INFO ] data-service-pool-771         com.vmware.vise.util.session.SessionUtil                          Mapping: /websocket: sessionid to -> 100097 with clientId: 200004

              [2019-11-12T08:57:38.691+11:00] [INFO ] data-service-pool-771         com.vmware.vise.util.session.SessionUtil                          Generated hashed session id: 100098

              [2019-11-12T08:57:38.691+11:00] [INFO ] data-service-pool-771         com.vmware.vise.util.session.SessionUtil                          Mapping: /websocket: sessionid to -> 100098 with clientId: 200004

              [2019-11-12T08:57:38.693+11:00] [INFO ] data-service-pool-771        70009381 100098 200004 com.vmware.vise.vim.security.sso.impl.SsoLsLocatorImpl            Retrieved locations of services from LS at https://INGT-M1-UTILS1.domain.com:443/lookupservice/sdk in 2 milliseconds:

              {vsphere.local(5e6ff3c0-a8cf-11e5-9ac3-000c292f5d25@L)=adminAppUrl: https://INGT-M1-UTILS1.domain.com/sso-adminserver/sdk/vsphere.local, stsUrl: https://INGT-M1-UTILS1.domain.com/sts/STSService/vsphere.local, metadataUrl: https://INGT-M1-UTILS1.domain.com/websso/SAML2/Metadata/vsphere.local, vmodlVersion: interface com.vmware.vim.binding.sso.version.version3_5}

              [2019-11-12T08:57:38.748+11:00] [INFO ] data-service-pool-771         com.vmware.vise.util.session.SessionUtil                          Generated hashed session id: 100099

              [2019-11-12T08:57:38.748+11:00] [INFO ] data-service-pool-771         com.vmware.vise.util.session.SessionUtil                          Mapping: /websocket: sessionid to -> 100099 with clientId: 200004

              [2019-11-12T08:57:38.751+11:00] [INFO ] data-service-pool-771         com.vmware.vise.util.session.SessionUtil                          Generated hashed session id: 100100

              [2019-11-12T08:57:38.751+11:00] [INFO ] data-service-pool-771         com.vmware.vise.util.session.SessionUtil                          Mapping: /websocket: sessionid to -> 100100 with clientId: 200004

              [2019-11-12T08:57:38.758+11:00] [INFO ] data-service-pool-754         com.vmware.vise.util.session.SessionUtil                          Generated hashed session id: 100101

              [2019-11-12T08:57:38.758+11:00] [INFO ] data-service-pool-754         com.vmware.vise.util.session.SessionUtil                          Mapping: /websocket: sessionid to -> 100101 with clientId: 200004

              [2019-11-12T08:57:56.060+11:00] [INFO ] health-status-59              com.vmware.vise.vim.cm.healthstatus.AppServerHealthService        Memory usage: used=320,071,536; max=796,393,472; percentage=40.19012551624733%. Status: GREEN

              [2019-11-12T08:57:56.060+11:00] [INFO ] health-status-59              c.v.v.v.cm.HealthStatusRequestHandler$HealthStatusCollectorTask   Determined health status 'GREEN' in 0 ms

              [2019-11-12T08:58:09.567+11:00] [INFO ] http-nio-5090-exec-7         70009389 100093 200004 com.vmware.vise.util.PropertyUtil                                 Property 'remote.plugin.updateOnBrowserRefresh' is missing. Will use the default: false

              [2019-11-12T08:58:09.568+11:00] [INFO ] http-nio-5090-exec-7         70009389 100093 200004 com.vmware.vise.util.PropertyUtil                                 Property 'local.development' is missing. Will use the default: false

              [2019-11-12T08:58:09.573+11:00] [INFO ] http-nio-5090-exec-7         70009389 100093 200004 com.vmware.vise.util.PropertyUtil                                 Property 'codecapture.disabled' is missing. Will use the default: false

              [2019-11-12T08:58:11.936+11:00] [INFO ] data-service-pool-771         com.vmware.vise.util.session.SessionUtil                          Generated hashed session id: 100102

              [2019-11-12T08:58:11.936+11:00] [INFO ] data-service-pool-771         com.vmware.vise.util.session.SessionUtil                          Mapping: /websocket: sessionid to -> 100102 with clientId: 200004

              [2019-11-12T08:58:11.940+11:00] [INFO ] data-service-pool-771         com.vmware.vise.util.session.SessionUtil                          Generated hashed session id: 100103

              [2019-11-12T08:58:11.940+11:00] [INFO ] data-service-pool-771         com.vmware.vise.util.session.SessionUtil                          Mapping: /websocket: sessionid to -> 100103 with clientId: 200004

              [2019-11-12T08:58:11.940+11:00] [INFO ] data-service-pool-771        70009398 100103 200004 c.v.v.client.folder.LazyLoadingDataMigrationPropertyProvider      [getProperties] startedTime -- '2019-11-11T21:58:11.940Z'

              [2019-11-12T08:58:14.305+11:00] [INFO ] data-service-pool-771        70009398 100103 200004 c.v.v.client.folder.LazyLoadingDataMigrationPropertyProvider      [getProperties] execution finished and timeTaken to get lazyImportData for '1' vCenters is 'PT2.365S'

              [2019-11-12T08:58:14.306+11:00] [INFO ] data-service-pool-771         com.vmware.vise.util.session.SessionUtil                          Generated hashed session id: 100104

              [2019-11-12T08:58:14.306+11:00] [INFO ] data-service-pool-771         com.vmware.vise.util.session.SessionUtil                          Mapping: /websocket: sessionid to -> 100104 with clientId: 200004

              [2019-11-12T08:58:14.307+11:00] [INFO ] data-service-pool-771         com.vmware.vise.util.session.SessionUtil                          Generated hashed session id: 100105

              [2019-11-12T08:58:14.307+11:00] [INFO ] data-service-pool-771         com.vmware.vise.util.session.SessionUtil                          Mapping: /websocket: sessionid to -> 100105 with clientId: 200004

              [2019-11-12T08:58:14.336+11:00] [INFO ] data-service-pool-771         com.vmware.vise.util.session.SessionUtil                          Generated hashed session id: 100106

              [2019-11-12T08:58:14.337+11:00] [INFO ] data-service-pool-771         com.vmware.vise.util.session.SessionUtil                          Mapping: /websocket: sessionid to -> 100106 with clientId: 200004

              [2019-11-12T08:58:14.337+11:00] [INFO ] data-service-pool-771         com.vmware.vise.util.session.SessionUtil                          Generated hashed session id: 100107

              [2019-11-12T08:58:14.337+11:00] [INFO ] data-service-pool-771         com.vmware.vise.util.session.SessionUtil                          Mapping: /websocket: sessionid to -> 100107 with clientId: 200004

              [2019-11-12T08:58:14.345+11:00] [INFO ] data-service-pool-772         com.vmware.vise.util.session.SessionUtil                          Generated hashed session id: 100108

              [2019-11-12T08:58:14.345+11:00] [INFO ] data-service-pool-772         com.vmware.vise.util.session.SessionUtil                          Mapping: /websocket: sessionid to -> 100108 with clientId: 200004

              • 4. Re: Unable to open Web Console in 6.7U3 HTML Client
                sk591 Enthusiast

                It does look like your VC is unable to connect with the VMs over port 9443:

                 

                2019-11-11T21:57:12.636Z| mks| I125: SSL: syscall error 104: Connection reset by peer

                2019-11-11T21:57:12.636Z| mks| I125: SOCKET 6 (112) recv error 104: Connection reset by peer

                 

                 

                Has this ever worked before? If yes, what was the last change done?

                Also, is the VC in a different subnet or sits in a DMZ unlike the host through which you are able to connect to the VM web console successfully?

                 

                Other steps that can be tried if not done already:

                - vMotion one VM to another host and try this.

                - Reboot the VM from the vCenter or the host.

                - Restart the host once.

                • 5. Re: Unable to open Web Console in 6.7U3 HTML Client
                  MichaelVavilovNGT Lurker

                  Thank you for the assistance.

                   

                  I tried to connect to VMs hosted by each of my 4 hosts - the same issue.

                   

                  I reboot my VMs time to time from VC when doing maintenance. Earlier this month I upgraded all VMs HW level (to 15) and VMware Tools (to 10.3.10) so all VMs were restarted.

                  The last month I upgraded ESXi hosts from 6.5U1 to 6.7U3 (as well as VC) so all hosts have been restarted.

                   

                  VC and all 4 x ESXi hosts are in the same subnet. Some VMs are in the same subnet whereas some in different ones but web-console won't be opened for any. As far as I understand the console uses VIX API to connect to VM, so network connection is disregarded anyway, is that right? Again I can connect to the web-console from any hosts with no issues.

                   

                  I have a feeling that there is a cookie prevent the web-console to be opened. I don't want to clean all my cookies as I don't want to loose hundreds of other useful settings. Any idea how VC cookies can be swept out without touching all cookies in the latest Chrome ?

                   

                  Port 9443 is opened

                  9443.png

                  • 6. Re: Unable to open Web Console in 6.7U3 HTML Client
                    sk591 Enthusiast

                    cookie.PNG

                     

                     

                    You can go to Google Chrome Settings>Advanced> Privace and security>Site Settings> Cookies and site Data> Search for vc fqdn/ip and start clearing the cookies. Also, you might want to try installing firefox and check once.

                    • 7. Re: Unable to open Web Console in 6.7U3 HTML Client
                      MichaelVavilovNGT Lurker

                      Thank you.

                       

                      I found and removed the vCenter cookie, restarted Chrome but got the same issue when trying to open a WEB-Console.

                       

                      The same problem persists in IE and Firefox.

                       

                      After some testings I found out that the issue is in HTML client only. The flash client is deprecated in 6.7 but still works and I can open web-console with no issues in teh flash client.

                       

                      I opened a SR with VMware, they advised it is a known issue in 6.5 but not sure about 6.7, they have been checking with relevant atm.

                      • 8. Re: Unable to open Web Console in 6.7U3 HTML Client
                        MichaelVavilovNGT Lurker

                        The issue has been resolved by cleaning /etc/vmware/vsphere-ui/vc-packages/vsphere-client-serenity/

                         

                        - connect to the VCSA shell prompt
                        -  cd /etc/vmware/vsphere-ui/vc-packages/vsphere-client-serenity
                        - clear all the files, --> command : rm --rf *
                        - restart the VC services --> service-control --stop --all