Unable to open Web Console in vCenter 6.7U3 HTML Client.
"Launch Web Console" as well as "Launch remote Console" options get a pop-up windows "Open VMware Remote Console Option?" with 2 options available: "Open VMware Remote Console" and "Cancel", see print-screen below.
From ESXi hosts web-interface can choose and open both: Web-Console and Remote Console.
The issue has been resolved by cleaning /etc/vmware/vsphere-ui/vc-packages/vsphere-client-serenity/
- connect to the VCSA shell prompt
- cd /etc/vmware/vsphere-ui/vc-packages/vsphere-client-serenity
- clear all the files, --> command : rm --rf *
- restart the VC services --> service-control --stop --all
The print-screen above is for Google Chrome Version 78.0.3904.87 (Official Build) (64-bit)
I tested out in IE (ver. 11.418) and there is the same issue, see below
Please let us know the following:
- Did this start occurring after a recent upgrade of the vCenter?
- Is this an issue with all the VMs?
- Can you try launching the web console for any other VM hosted on any other host?
- Confirm if port 9443 is open as this is used as a default port by the HTML5 virtual machine console.
- Also can you provide the output of the following files when you are trying this action?
1) vmware.log located under the VM directory.
2) vsphere_client_virgo.log located under /var/log/vmware/vsphere-ui/logs
Hello there,
- Did this start occurring after a recent upgrade of the vCenter?
- No
- Is this an issue with all the VMs?
- Yes
- Can you try launching the web console for any other VM hosted on any other host?
- Yes, the same issue
- Confirm if port 9443 is open as this is used as a default port by the HTML5 virtual machine console.
- It is opened
- Also can you provide the output of the following files when you are trying this action?
- Please find the output below. I tried to open web-console at 8:57am and 8:58am AEDT.
vmware.log under the VM directory
2019-11-11T21:57:11.011Z| mks| I125: SOCKET 6 (112) AsyncTCPSocketSetOption: Option layer/level [6], option/name [1]: successfully set OS option for TCP socket.
2019-11-11T21:57:11.318Z| mks| I125: SOCKET 6 (112) AsyncTCPSocketSetOption: sendLowLatencyMode set to [1].
2019-11-11T21:57:11.318Z| mks| I125: SOCKET 6 (112) Creating VNC remote connection.
2019-11-11T21:57:11.318Z| mks| I125: MKSControlMgr: New VNC connection 2
2019-11-11T21:57:11.320Z| svga| I125: VNCENCODE 6 VNCEncode: VNCEncode_ServerSetTopology - original root: (0, 0) size: (1651, 779)
2019-11-11T21:57:11.320Z| svga| I125: VNCENCODE 6 VNCEncode: Number of screens changed from 0 to 1
2019-11-11T21:57:11.320Z| svga| I125: VNCENCODE 6 VNCEncode: screen: 0 BoundingBox: (1651x779) Screen (1651x779) @ (0,0) bytesPerLine: 6604
2019-11-11T21:57:11.400Z| mks| W115: VNCENCODE 6 JPEG quality levels (min, mid, max). Input: (25, 35, 90) Clamped: (25, 35, 90)
2019-11-11T21:57:11.400Z| mks| W115: VNCENCODE 6 failed to allocate VNCBlitDetect
2019-11-11T21:57:11.400Z| mks| I125: VNCENCODE 6 VNCEncodeChooseRegionEncoder: region encoder adaptive. Screen 1/1 @ Resolution: 1651 x 779
2019-11-11T21:57:12.636Z| mks| I125: SSL: syscall error 104: Connection reset by peer
2019-11-11T21:57:12.636Z| mks| I125: SOCKET 6 (112) recv error 104: Connection reset by peer
2019-11-11T21:57:12.636Z| mks| I125: SOCKET 6 (112) VNC Remote Disconnect.
2019-11-11T21:57:12.636Z| mks| I125: MKSControlMgr: Remove VNC connection 2
2019-11-11T21:57:37.791Z| svga| I125: MKSScreenShotMgr: Taking a screenshot
2019-11-11T21:58:05.690Z| mks| I125: SOCKET 7 (112) AsyncTCPSocketSetOption: Option layer/level [6], option/name [1]: successfully set OS option for TCP socket.
2019-11-11T21:58:06.019Z| mks| I125: SOCKET 7 (112) AsyncTCPSocketSetOption: sendLowLatencyMode set to [1].
2019-11-11T21:58:06.019Z| mks| I125: SOCKET 7 (112) Creating VNC remote connection.
2019-11-11T21:58:06.019Z| mks| I125: MKSControlMgr: New VNC connection 3
2019-11-11T21:58:06.021Z| svga| I125: VNCENCODE 7 VNCEncode: VNCEncode_ServerSetTopology - original root: (0, 0) size: (1651, 779)
2019-11-11T21:58:06.021Z| svga| I125: VNCENCODE 7 VNCEncode: Number of screens changed from 0 to 1
2019-11-11T21:58:06.021Z| svga| I125: VNCENCODE 7 VNCEncode: screen: 0 BoundingBox: (1651x779) Screen (1651x779) @ (0,0) bytesPerLine: 6604
2019-11-11T21:58:06.107Z| mks| W115: VNCENCODE 7 JPEG quality levels (min, mid, max). Input: (25, 35, 90) Clamped: (25, 35, 90)
2019-11-11T21:58:06.107Z| mks| W115: VNCENCODE 7 failed to allocate VNCBlitDetect
2019-11-11T21:58:06.107Z| mks| I125: VNCENCODE 7 VNCEncodeChooseRegionEncoder: region encoder adaptive. Screen 1/1 @ Resolution: 1651 x 779
2019-11-11T21:58:07.438Z| mks| I125: SSL: syscall error 104: Connection reset by peer
2019-11-11T21:58:07.438Z| mks| I125: SOCKET 7 (112) recv error 104: Connection reset by peer
2019-11-11T21:58:07.438Z| mks| I125: SOCKET 7 (112) VNC Remote Disconnect.
2019-11-11T21:58:07.438Z| mks| I125: MKSControlMgr: Remove VNC connection 3
2019-11-11T21:58:13.317Z| svga| I125: MKSScreenShotMgr: Taking a screenshot
/var/log/vmware/vsphere-ui/logs/vsphere_client_virgo.log
[2019-11-12T08:57:01.976+11:00] [INFO ] soTokenRenewalExecutor-22346 ######## 100083 200003 com.vmware.vsphere.client.security.sso.SsoTokenLifetimeManager Beginning renewal of token for sessionId
100083, clientId 200003
[2019-11-12T08:57:01.977+11:00] [INFO ] soTokenRenewalExecutor-22346 ######## 100083 200003 com.vmware.vise.vim.security.sso.impl.SsoLsLocatorImpl Fetching SSO endpoints from LS
[2019-11-12T08:57:02.003+11:00] [INFO ] soTokenRenewalExecutor-22346 ######## 100083 200003 com.vmware.vise.vim.security.sso.impl.SsoLsLocatorImpl Retrieved locations of services from LS
at https://INGT-M1-UTILS1.domain.com:443/lookupservice/sdk in 27 milliseconds:
{vsphere.local(5e6ff3c0-a8cf-11e5-9ac3-000c292f5d25@L)=adminAppUrl: https://INGT-M1-UTILS1.domain.com/sso-adminserver/sdk/vsphere.local, stsUrl: https://INGT-M1-UTILS1.domain.com
/sts/STSService/vsphere.local, metadataUrl: https://INGT-M1-UTILS1.domain.com/websso/SAML2/Metadata/vsphere.local, vmodlVersion: interface com.vmware.vim.binding.sso.version.version3_5}
[2019-11-12T08:57:02.003+11:00] [INFO ] soTokenRenewalExecutor-22346 ######## 100083 200003 com.vmware.vise.vim.security.sso.impl.SsoUtilInternal Renewing token _7e63d6f5-58a3-49e2-b2a7-
8c094d65b5ea using https://INGT-M1-UTILS1.domain.com/sts/STSService/vsphere.local
[2019-11-12T08:57:02.010+11:00] [INFO ] soTokenRenewalExecutor-22346 ######## 100083 200003 com.vmware.vim.sso.client.impl.SiteAffinityServiceDiscovery Site affinity is disabled
[2019-11-12T08:57:02.094+11:00] [INFO ] soTokenRenewalExecutor-22346 ######## 100083 200003 com.vmware.identity.token.impl.SamlTokenImpl SAML token for SubjectNameId [value=mv@domain.com, format=http://schemas.xmlsoap.org/claims/UPN] successfully parsed from Element
[2019-11-12T08:57:02.095+11:00] [INFO ] soTokenRenewalExecutor-22346 ######## 100083 200003 com.vmware.vim.sso.client.impl.SecurityTokenServiceImpl Successfully renewed token for user: {Na
me: mv, Domain: domain.com}
[2019-11-12T08:57:02.095+11:00] [INFO ] soTokenRenewalExecutor-22346 ######## 100083 200003 com.vmware.vise.vim.security.sso.AsyncTokenManager Updated the token of domain vsphere.loca
l(5e6ff3c0-a8cf-11e5-9ac3-000c292f5d25@L). Token's expiration time: Tue Nov 12 16:57:02 AEDT 2019
[2019-11-12T08:57:02.095+11:00] [INFO ] soTokenRenewalExecutor-22346 ######## 100083 200003 com.vmware.vsphere.client.security.sso.SsoTokenLifetimeManager Token renewed for sessionId 100083, clie
ntId 200003. Used STS of domain vsphere.local(5e6ff3c0-a8cf-11e5-9ac3-000c292f5d25@L) for the renewal. Token expiration time: Tue Nov 12 16:57:02 AEDT 2019
[2019-11-12T08:57:02.096+11:00] [INFO ] soTokenRenewalExecutor-22346 ######## 100083 200003 com.vmware.vsphere.client.security.sso.SsoTokenLifetimeManager sessionId 100083, clientId 200003, Token
expiration time: Tue Nov 12 16:57:02 AEDT 2019
Token renewal scheduled approximately for: Tue Nov 12 16:52:02 AEDT 2019
[2019-11-12T08:57:27.496+11:00] [INFO ] http-nio-5090-exec-8 com.vmware.vise.util.session.SessionUtil Generated hashed session id: 100092
[2019-11-12T08:57:27.496+11:00] [INFO ] http-nio-5090-exec-8 70009327 100092 ###### com.vmware.vise.security.SessionListener Session 100092 created with context path
: /ui
[2019-11-12T08:57:27.496+11:00] [INFO ] http-nio-5090-exec-8 70009327 100092 ###### com.vmware.vsphere.client.security.websso.WebssoAssertionHandler Received an SAML assertion from SSO serv
er. Processing it now...
[2019-11-12T08:57:27.496+11:00] [INFO ] http-nio-5090-exec-8 70009327 100092 ###### com.vmware.identity.websso.client.endpoint.SsoResponseListener You have POST'ed to Websso client librar
y!
[2019-11-12T08:57:27.496+11:00] [INFO ] http-nio-5090-exec-8 70009327 100092 ###### com.vmware.identity.websso.client.SsoValidationState Validating SAMLResponse..
[2019-11-12T08:57:27.501+11:00] [INFO ] http-nio-5090-exec-8 70009327 100092 ###### com.vmware.identity.websso.client.ValidationState Validating request destination: Httpserv
letRequest destination=https://ingt-m1-utils1.domain.com/ui/saml/websso/ssoSAML message destination=https://ingt-m1-utils1.domain.com/ui/saml/websso/sso
[2019-11-12T08:57:27.501+11:00] [INFO ] http-nio-5090-exec-8 70009327 100092 ###### com.vmware.identity.websso.client.SsoValidationState Validating optional request ID: _9dfde73
5748637f6ba592cd6d2089113
[2019-11-12T08:57:27.501+11:00] [ERROR] http-nio-5090-exec-8 70009327 100092 ###### com.vmware.identity.websso.client.MessageStoreImpl No request with id=:%s found. Message s
tore size:%s
[2019-11-12T08:57:27.501+11:00] [ERROR] http-nio-5090-exec-8 70009327 100092 ###### com.vmware.identity.websso.client.endpoint.SsoResponseListener Authentication Exception: java.lang.IllegalArgumentException: No authentication request found matching InResponseTo attribute of SAML Response from IDP. No matching logon request found for SAML response: _9dfde735748637f6ba592cd6d2089113
at com.vmware.identity.websso.client.SsoValidationState.validateInResponseTo(SsoValidationState.java:162)
at com.vmware.identity.websso.client.SsoValidationState.validate(SsoValidationState.java:93)
at com.vmware.identity.websso.client.endpoint.SsoResponseListener.consumeResponse(SsoResponseListener.java:120)
at com.vmware.identity.websso.client.endpoint.SsoResponseListener.consumeResponse(SsoResponseListener.java:89)
at com.vmware.vsphere.client.security.websso.WebssoAssertionHandler.handleRequest(WebssoAssertionHandler.java:50)
at org.springframework.web.context.support.HttpRequestHandlerServlet.service(HttpRequestHandlerServlet.java:67)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:742)
at org.eclipse.equinox.http.servlet.internal.HttpServiceRuntimeImpl$LegacyServlet.service(HttpServiceRuntimeImpl.java:1256)
at org.eclipse.equinox.http.servlet.internal.registration.EndpointRegistration.service(EndpointRegistration.java:153)
at org.eclipse.equinox.http.servlet.internal.servlet.FilterChainImpl.doFilter(FilterChainImpl.java:50)
at com.vmware.o6jia.context.web.filter.WelcomeFileFilter.doFilter(WelcomeFileFilter.java:48)
at org.eclipse.equinox.http.servlet.internal.HttpServiceRuntimeImpl$LegacyFilterFactory$LegacyFilter.doFilter(HttpServiceRuntimeImpl.java:1215)
at org.eclipse.equinox.http.servlet.internal.registration.FilterRegistration.doFilter(FilterRegistration.java:121)
at org.eclipse.equinox.http.servlet.internal.servlet.FilterChainImpl.doFilter(FilterChainImpl.java:45)
at com.vmware.vise.extensionfw.DeploymentFilter.doFilter(DeploymentFilter.java:55)
at com.vmware.o6jia.context.web.filter.ContextPathAwareDelegatingFilter.doFilter(ContextPathAwareDelegatingFilter.java:50)
at org.eclipse.equinox.http.servlet.internal.HttpServiceRuntimeImpl$LegacyFilterFactory$LegacyFilter.doFilter(HttpServiceRuntimeImpl.java:1215)
at org.eclipse.equinox.http.servlet.internal.registration.FilterRegistration.doFilter(FilterRegistration.java:121)
at org.eclipse.equinox.http.servlet.internal.servlet.FilterChainImpl.doFilter(FilterChainImpl.java:45)
at com.vmware.o6jia.context.web.filter.ContextPathAwareDelegatingFilter.doFilter(ContextPathAwareDelegatingFilter.java:46)
at org.eclipse.equinox.http.servlet.internal.HttpServiceRuntimeImpl$LegacyFilterFactory$LegacyFilter.doFilter(HttpServiceRuntimeImpl.java:1215)
at org.eclipse.equinox.http.servlet.internal.registration.FilterRegistration.doFilter(FilterRegistration.java:121)
at org.eclipse.equinox.http.servlet.internal.servlet.FilterChainImpl.doFilter(FilterChainImpl.java:45)
at com.vmware.vsphere.client.logging.MDCLogFilter.doFilterInternal(MDCLogFilter.java:41)
at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:107)
at com.vmware.o6jia.context.web.filter.ContextPathAwareDelegatingFilter.doFilter(ContextPathAwareDelegatingFilter.java:50)
at org.eclipse.equinox.http.servlet.internal.HttpServiceRuntimeImpl$LegacyFilterFactory$LegacyFilter.doFilter(HttpServiceRuntimeImpl.java:1215)
at org.eclipse.equinox.http.servlet.internal.registration.FilterRegistration.doFilter(FilterRegistration.java:121)
at org.eclipse.equinox.http.servlet.internal.servlet.FilterChainImpl.doFilter(FilterChainImpl.java:45)
at com.vmware.vise.util.i18n.I18nFilter.doFilterInternal(I18nFilter.java:43)
at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:107)
at com.vmware.o6jia.context.web.filter.ContextPathAwareDelegatingFilter.doFilter(ContextPathAwareDelegatingFilter.java:50)
at org.eclipse.equinox.http.servlet.internal.HttpServiceRuntimeImpl$LegacyFilterFactory$LegacyFilter.doFilter(HttpServiceRuntimeImpl.java:1215)
at org.eclipse.equinox.http.servlet.internal.registration.FilterRegistration.doFilter(FilterRegistration.java:121)
at org.eclipse.equinox.http.servlet.internal.servlet.FilterChainImpl.doFilter(FilterChainImpl.java:45)
at com.vmware.vise.security.SessionManagementFilter.doFilter(SessionManagementFilter.java:205)
at com.vmware.o6jia.context.web.filter.ContextPathAwareDelegatingFilter.doFilter(ContextPathAwareDelegatingFilter.java:50)
at org.eclipse.equinox.http.servlet.internal.HttpServiceRuntimeImpl$LegacyFilterFactory$LegacyFilter.doFilter(HttpServiceRuntimeImpl.java:1215)
at org.eclipse.equinox.http.servlet.internal.registration.FilterRegistration.doFilter(FilterRegistration.java:121)
at org.eclipse.equinox.http.servlet.internal.servlet.FilterChainImpl.doFilter(FilterChainImpl.java:45)
at com.vmware.o6jia.context.web.filter.ContextPathAwareDelegatingFilter.doFilter(ContextPathAwareDelegatingFilter.java:46)
at org.eclipse.equinox.http.servlet.internal.HttpServiceRuntimeImpl$LegacyFilterFactory$LegacyFilter.doFilter(HttpServiceRuntimeImpl.java:1215)
at org.eclipse.equinox.http.servlet.internal.registration.FilterRegistration.doFilter(FilterRegistration.java:121)
at org.eclipse.equinox.http.servlet.internal.servlet.FilterChainImpl.doFilter(FilterChainImpl.java:45)
at org.springframework.security.web.FilterChainProxy.doFilterInternal(FilterChainProxy.java:208)
at org.springframework.security.web.FilterChainProxy.doFilter(FilterChainProxy.java:177)
at org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(DelegatingFilterProxy.java:347)
at org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java:263)
at com.vmware.o6jia.context.web.filter.ContextPathAwareDelegatingFilter.doFilter(ContextPathAwareDelegatingFilter.java:50)
at org.eclipse.equinox.http.servlet.internal.HttpServiceRuntimeImpl$LegacyFilterFactory$LegacyFilter.doFilter(HttpServiceRuntimeImpl.java:1215)
at org.eclipse.equinox.http.servlet.internal.registration.FilterRegistration.doFilter(FilterRegistration.java:121)
at org.eclipse.equinox.http.servlet.internal.servlet.FilterChainImpl.doFilter(FilterChainImpl.java:45)
at com.vmware.o6jia.context.web.filter.ContextPathAwareDelegatingFilter.doFilter(ContextPathAwareDelegatingFilter.java:46)
at org.eclipse.equinox.http.servlet.internal.HttpServiceRuntimeImpl$LegacyFilterFactory$LegacyFilter.doFilter(HttpServiceRuntimeImpl.java:1215)
at org.eclipse.equinox.http.servlet.internal.registration.FilterRegistration.doFilter(FilterRegistration.java:121)
at org.eclipse.equinox.http.servlet.internal.servlet.FilterChainImpl.doFilter(FilterChainImpl.java:45)
at com.vmware.o6jia.context.web.filter.ContextPathAwareDelegatingFilter.doFilter(ContextPathAwareDelegatingFilter.java:46)
at org.eclipse.equinox.http.servlet.internal.HttpServiceRuntimeImpl$LegacyFilterFactory$LegacyFilter.doFilter(HttpServiceRuntimeImpl.java:1215)
at org.eclipse.equinox.http.servlet.internal.registration.FilterRegistration.doFilter(FilterRegistration.java:121)
at org.eclipse.equinox.http.servlet.internal.servlet.FilterChainImpl.doFilter(FilterChainImpl.java:45)
at com.vmware.o6jia.context.web.filter.ContextPathAwareDelegatingFilter.doFilter(ContextPathAwareDelegatingFilter.java:46)
at org.eclipse.equinox.http.servlet.internal.HttpServiceRuntimeImpl$LegacyFilterFactory$LegacyFilter.doFilter(HttpServiceRuntimeImpl.java:1215)
at org.eclipse.equinox.http.servlet.internal.registration.FilterRegistration.doFilter(FilterRegistration.java:121)
at org.eclipse.equinox.http.servlet.internal.servlet.FilterChainImpl.doFilter(FilterChainImpl.java:45)
at org.springframework.web.filter.RequestContextFilter.doFilterInternal(RequestContextFilter.java:99)
at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:107)
at com.vmware.o6jia.context.web.filter.ContextPathAwareDelegatingFilter.doFilter(ContextPathAwareDelegatingFilter.java:50)
at org.eclipse.equinox.http.servlet.internal.HttpServiceRuntimeImpl$LegacyFilterFactory$LegacyFilter.doFilter(HttpServiceRuntimeImpl.java:1215)
at org.eclipse.equinox.http.servlet.internal.registration.FilterRegistration.doFilter(FilterRegistration.java:121)
at org.eclipse.equinox.http.servlet.internal.servlet.FilterChainImpl.doFilter(FilterChainImpl.java:45)
at com.vmware.o6jia.context.web.filter.ContextPathAwareDelegatingFilter.doFilter(ContextPathAwareDelegatingFilter.java:46)
at org.eclipse.equinox.http.servlet.internal.HttpServiceRuntimeImpl$LegacyFilterFactory$LegacyFilter.doFilter(HttpServiceRuntimeImpl.java:1215)
at org.eclipse.equinox.http.servlet.internal.registration.FilterRegistration.doFilter(FilterRegistration.java:121)
at org.eclipse.equinox.http.servlet.internal.registration.FilterRegistration.doFilter(FilterRegistration.java:121)
at org.eclipse.equinox.http.servlet.internal.servlet.FilterChainImpl.doFilter(FilterChainImpl.java:45)
at com.vmware.o6jia.context.web.filter.ContextPathAwareDelegatingFilter.doFilter(ContextPathAwareDelegatingFilter.java:46)
at org.eclipse.equinox.http.servlet.internal.HttpServiceRuntimeImpl$LegacyFilterFactory$LegacyFilter.doFilter(HttpServiceRuntimeImpl.java:1215)
at org.eclipse.equinox.http.servlet.internal.registration.FilterRegistration.doFilter(FilterRegistration.java:121)
at org.eclipse.equinox.http.servlet.internal.servlet.FilterChainImpl.doFilter(FilterChainImpl.java:45)
at org.eclipse.equinox.http.servlet.internal.servlet.ResponseStateHandler.processRequest(ResponseStateHandler.java:70)
at org.eclipse.equinox.http.servlet.internal.context.DispatchTargets.doDispatch(DispatchTargets.java:132)
at org.eclipse.equinox.http.servlet.internal.servlet.ProxyServlet.service(ProxyServlet.java:100)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:742)
at org.eclipse.equinox.servletbridge.BridgeServlet.service(BridgeServlet.java:152)
at com.vmware.vsphere.bridge.BridgeServletEx.service(BridgeServletEx.java:21)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:742)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:231)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166)
at org.apache.tomcat.websocket.server.WsFilter.doFilter(WsFilter.java:52)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:193)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166)
at com.vmware.vsphere.bridge.DenyConfigurationFilesFilter.doFilter(DenyConfigurationFilesFilter.java:45)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:193)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:166)
at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:199)
at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:96)
at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:493)
at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:137)
at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:81)
at org.apache.catalina.valves.RemoteIpValve.invoke(RemoteIpValve.java:679)
at org.apache.catalina.valves.AbstractAccessLogValve.invoke(AbstractAccessLogValve.java:660)
at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:87)
at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:343)
at org.apache.coyote.http11.Http11Processor.service(Http11Processor.java:798)
at org.apache.coyote.AbstractProcessorLight.process(AbstractProcessorLight.java:66)
at org.apache.coyote.AbstractProtocol$ConnectionHandler.process(AbstractProtocol.java:808)
at org.apache.tomcat.util.net.NioEndpoint$SocketProcessor.doRun(NioEndpoint.java:1498)
at org.apache.tomcat.util.net.SocketProcessorBase.run(SocketProcessorBase.java:49)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at org.apache.tomcat.util.threads.TaskThread$WrappingRunnable.run(TaskThread.java:61)
at java.lang.Thread.run(Thread.java:748)
[2019-11-12T08:57:27.501+11:00] [INFO ] http-nio-5090-exec-8 70009327 100092 ###### com.vmware.identity.websso.client.Message Incoming or outgoing SAML message.
Message Type:AUTHN_RESPONSE
ID:_799c8d80c489c7be1de54e0f4753b903
SessionIndex:null
Message source:https://INGT-M1-UTILS1.domain.com/websso/SAML2/Metadata/vsphere.local
Message destination:https://ingt-m1-utils1.domain.com/ui/saml/websso/sso
Message validation result (for incoming messages):urn:oasis:names:tc:SAML:2.0:status:Success
[2019-11-12T08:57:27.501+11:00] [INFO ] http-nio-5090-exec-8 70009327 100092 ###### com.vmware.vsphere.client.security.websso.WebssoUtil [authenticationError] Message details: id=_799c8d80c489c7be1de54e0f4753b903, type=AUTHN_RESPONSE, source='https://INGT-M1-UTILS1.domain.com/websso/SAML2/Metadata/vsphere.local', target='https://ingt-m1-utils1.domain.com/ui/saml/websso/sso', issueInstant='2019-11-11T21:57:27.440Z'
[2019-11-12T08:57:27.562+11:00] [INFO ] http-nio-5090-exec-3 70009328 100092 ###### c.v.vsphere.client.security.websso.WebssoLogoutRequestHandler Received WebSSO logout request
[2019-11-12T08:57:27.562+11:00] [INFO ] http-nio-5090-exec-3 70009328 100092 ###### com.vmware.vsphere.client.security.websso.MetadataGeneratorImpl Processing WebSSO metadata
[2019-11-12T08:57:27.562+11:00] [INFO ] http-nio-5090-exec-3 70009328 100092 ###### com.vmware.vsphere.client.security.websso.MetadataGeneratorImpl SP url generated is https://ingt-m1-utils1.domain.com/ui
[2019-11-12T08:57:27.562+11:00] [INFO ] http-nio-5090-exec-3 70009328 100092 ###### com.vmware.vsphere.client.security.websso.MetadataGeneratorImpl Processed WebSSO metadata
[2019-11-12T08:57:27.562+11:00] [WARN ] http-nio-5090-exec-3 70009328 100092 ###### c.v.vsphere.client.security.websso.WebssoLogoutRequestHandler Username not found in browser cookies, will skip logging out of SSO.
[2019-11-12T08:57:33.094+11:00] [INFO ] http-nio-5090-exec-2 70009329 100092 ###### com.vmware.vsphere.client.security.util.Util getUserSession called on an inactive session.
[2019-11-12T08:57:33.094+11:00] [INFO ] http-nio-5090-exec-2 70009329 100092 ###### com.vmware.vise.util.PropertyUtil Property 'local.development' is missing. Will use the default: false
[2019-11-12T08:57:33.229+11:00] [INFO ] http-nio-5090-exec-4 70009330 100092 ###### c.v.vsphere.client.security.websso.WebssoLoginRequestHandler Received WebSSO login request
[2019-11-12T08:57:33.229+11:00] [INFO ] http-nio-5090-exec-4 70009330 100092 ###### com.vmware.vsphere.client.security.websso.MetadataGeneratorImpl Processing WebSSO metadata
[2019-11-12T08:57:33.229+11:00] [INFO ] http-nio-5090-exec-4 70009330 100092 ###### com.vmware.vsphere.client.security.websso.MetadataGeneratorImpl SP url generated is https://ingt-m1-utils1.domain.com/ui
[2019-11-12T08:57:33.229+11:00] [INFO ] http-nio-5090-exec-4 70009330 100092 ###### com.vmware.vsphere.client.security.websso.MetadataGeneratorImpl Processed WebSSO metadata
[2019-11-12T08:57:33.230+11:00] [INFO ] http-nio-5090-exec-4 70009330 100092 ###### c.v.vsphere.client.security.websso.WebssoLoginRequestHandler SP alias for the login request is ingt-m1-utils1.domain.com:443
[2019-11-12T08:57:33.230+11:00] [INFO ] http-nio-5090-exec-4 70009330 100092 ###### c.v.vsphere.client.security.websso.WebssoLoginRequestHandler Sending authentication request to the SSO server
[2019-11-12T08:57:33.230+11:00] [INFO ] http-nio-5090-exec-4 70009330 100092 ###### com.vmware.identity.websso.client.endpoint.SsoRequestSender Producing redirect url
[2019-11-12T08:57:33.231+11:00] [INFO ] http-nio-5090-exec-4 70009330 100092 ###### com.vmware.identity.websso.client.SiteAffinity getAffinitizedDC: INGT-M1-UTILS1.domain.com
[2019-11-12T08:57:33.231+11:00] [INFO ] http-nio-5090-exec-4 70009330 100092 ###### com.vmware.identity.websso.client.endpoint.SsoRequestSender Added Renewable condition
[2019-11-12T08:57:33.231+11:00] [INFO ] http-nio-5090-exec-4 70009330 100092 ###### com.vmware.identity.websso.client.endpoint.SsoRequestSender Added Delegable condition
[2019-11-12T08:57:33.231+11:00] [INFO ] http-nio-5090-exec-4 70009330 100092 ###### com.vmware.identity.websso.client.endpoint.SsoRequestSender Destination URL: https://INGT-M1-UTILS1.domain.com/websso/SAML2/SSO/vsphere.local
[2019-11-12T08:57:33.232+11:00] [INFO ] http-nio-5090-exec-4 70009330 100092 ###### com.vmware.identity.websso.client.endpoint.SsoRequestSender Relay State value is: null
[2019-11-12T08:57:33.234+11:00] [INFO ] http-nio-5090-exec-4 70009330 100092 ###### com.vmware.identity.websso.client.Message Incoming or outgoing SAML message.
Message Type:AUTHN_REQUEST
ID:_78bd186886ef261715ca39d006a67f07
SessionIndex:null
Message source:https://ingt-m1-utils1.domain.com/ui/saml/websso/metadata
Message destination:https://INGT-M1-UTILS1.domain.com/websso/SAML2/SSO/vsphere.local
Message validation result (for incoming messages):null
[2019-11-12T08:57:33.357+11:00] [INFO ] http-nio-5090-exec-1 70009331 100092 ###### com.vmware.vsphere.client.security.websso.WebssoAssertionHandler Received an SAML assertion from SSO server. Processing it now...
[2019-11-12T08:57:33.357+11:00] [INFO ] http-nio-5090-exec-1 70009331 100092 ###### com.vmware.identity.websso.client.endpoint.SsoResponseListener You have POST'ed to Websso client library!
[2019-11-12T08:57:33.357+11:00] [INFO ] http-nio-5090-exec-1 70009331 100092 ###### com.vmware.identity.websso.client.SsoValidationState Validating SAMLResponse..
[2019-11-12T08:57:33.362+11:00] [INFO ] http-nio-5090-exec-1 70009331 100092 ###### com.vmware.identity.websso.client.ValidationState Validating request destination: HttpservletRequest destination=https://ingt-m1-utils1.domain.com/ui/saml/websso/ssoSAML message destination=https://ingt-m1-utils1.domain.com/ui/saml/websso/sso
[2019-11-12T08:57:33.362+11:00] [INFO ] http-nio-5090-exec-1 70009331 100092 ###### com.vmware.identity.websso.client.SsoValidationState Validating optional request ID: _78bd186886ef261715ca39d006a67f07
[2019-11-12T08:57:33.362+11:00] [INFO ] http-nio-5090-exec-1 70009331 100092 ###### com.vmware.identity.websso.client.SsoValidationState Validating assertion..
[2019-11-12T08:57:33.362+11:00] [INFO ] http-nio-5090-exec-1 70009331 100092 ###### com.vmware.identity.websso.client.SsoValidationState Parsing assertion..
[2019-11-12T08:57:33.369+11:00] [INFO ] http-nio-5090-exec-1 70009331 100092 ###### com.vmware.identity.websso.client.SamlUtils Validate assertion condition with clock tolerance = 600
[2019-11-12T08:57:33.369+11:00] [INFO ] http-nio-5090-exec-1 70009331 100092 ###### com.vmware.identity.websso.client.SsoValidationState NameID: mv@domain.com
[2019-11-12T08:57:33.369+11:00] [INFO ] http-nio-5090-exec-1 70009331 100092 ###### com.vmware.identity.websso.client.SsoValidationState NameIDFormat: http://schemas.xmlsoap.org/claims/UPN
[2019-11-12T08:57:33.369+11:00] [INFO ] http-nio-5090-exec-1 70009331 100092 ###### com.vmware.identity.websso.client.SamlUtils Validate sessionNotOnOrAfter with clock tolerance = 600
[2019-11-12T08:57:33.369+11:00] [INFO ] http-nio-5090-exec-1 70009331 100092 ###### com.vmware.identity.websso.client.SsoValidationState Successfully validated SSO Assertion
[2019-11-12T08:57:33.369+11:00] [INFO ] http-nio-5090-exec-1 70009331 100092 ###### com.vmware.identity.websso.client.SsoValidationState Successfully validated received SAMLResponse
[2019-11-12T08:57:33.369+11:00] [INFO ] http-nio-5090-exec-1 70009331 100092 ###### com.vmware.identity.websso.client.Message Incoming or outgoing SAML message.
Message Type:AUTHN_RESPONSE
ID:_d1a09fa1d63286e4bd0c7059a0bf0673
SessionIndex:_278ac8f79169bdae1f1f40270daa348d
Message source:https://INGT-M1-UTILS1.domain.com/websso/SAML2/Metadata/vsphere.local
Message destination:https://ingt-m1-utils1.domain.com/ui/saml/websso/sso
Message validation result (for incoming messages):urn:oasis:names:tc:SAML:2.0:status:Success
[2019-11-12T08:57:33.369+11:00] [INFO ] http-nio-5090-exec-1 70009331 100092 ###### com.vmware.vsphere.client.security.websso.LogonProcessorImpl Websso authentication successful.
[2019-11-12T08:57:33.370+11:00] [INFO ] http-nio-5090-exec-1 70009331 100092 ###### com.vmware.vsphere.client.security.websso.LogonProcessorImpl Parsing the XML token
[2019-11-12T08:57:33.372+11:00] [INFO ] http-nio-5090-exec-1 70009331 100092 ###### com.vmware.vise.vim.security.sso.impl.SsoLsLocatorImpl Retrieved locations of services from LS at https://INGT-M1-UTILS1.domain.com:443/lookupservice/sdk in 1 milliseconds:
{vsphere.local(5e6ff3c0-a8cf-11e5-9ac3-000c292f5d25@L)=adminAppUrl: https://INGT-M1-UTILS1.domain.com/sso-adminserver/sdk/vsphere.local, stsUrl: https://INGT-M1-UTILS1.domain.com/sts/STSService/vsphere.local, metadataUrl: https://INGT-M1-UTILS1.domain.com/websso/SAML2/Metadata/vsphere.local, vmodlVersion: interface com.vmware.vim.binding.sso.version.version3_5}
[2019-11-12T08:57:33.375+11:00] [INFO ] http-nio-5090-exec-1 70009331 100092 ###### com.vmware.identity.token.impl.SamlTokenImpl SAML token for SubjectNameId [value=mv@domain.com, format=http://schemas.xmlsoap.org/claims/UPN] successfully parsed from Element
[2019-11-12T08:57:33.376+11:00] [INFO ] http-nio-5090-exec-1 70009331 100092 ###### com.vmware.vsphere.client.security.websso.LogonProcessorImpl Websso handshake done, forwarding to /ngc_spring_security_check
[2019-11-12T08:57:33.376+11:00] [INFO ] http-nio-5090-exec-1 70009331 100092 ###### com.vmware.vise.security.spring.DefaultAuthenticationProvider authentication starting
[2019-11-12T08:57:33.376+11:00] [INFO ] http-nio-5090-exec-1 70009331 100092 ###### com.vmware.vise.security.spring.DefaultAuthenticationProvider Authenticating user: null using authentication handler: com.vmware.vsphere.client.security.sso.SsoAuthenticationHandler@1294bf3f
[2019-11-12T08:57:33.376+11:00] [INFO ] http-nio-5090-exec-1 70009331 100092 ###### com.vmware.vsphere.client.security.sso.SsoAuthenticationHandler Exchanging the websso token for a Hok token.
[2019-11-12T08:57:33.378+11:00] [INFO ] http-nio-5090-exec-1 70009331 100092 ###### com.vmware.vise.vim.security.sso.impl.SsoLsLocatorImpl Retrieved locations of services from LS at https://INGT-M1-UTILS1.domain.com:443/lookupservice/sdk in 2 milliseconds:
{vsphere.local(5e6ff3c0-a8cf-11e5-9ac3-000c292f5d25@L)=adminAppUrl: https://INGT-M1-UTILS1.domain.com/sso-adminserver/sdk/vsphere.local, stsUrl: https://INGT-M1-UTILS1.domain.com/sts/STSService/vsphere.local, metadataUrl: https://INGT-M1-UTILS1.domain.com/websso/SAML2/Metadata/vsphere.local, vmodlVersion: interface com.vmware.vim.binding.sso.version.version3_5}
[2019-11-12T08:57:33.378+11:00] [INFO ] tokenAcqExec-22351 70009331 100092 ###### com.vmware.vise.vim.security.sso.AsyncTokenManager Acquiring token from token for SSO domain vsphere.local(5e6ff3c0-a8cf-11e5-9ac3-000c292f5d25@L) from STS server https://INGT-M1-UTILS1.domain.com/sts/STSService/vsphere.local
[2019-11-12T08:57:33.380+11:00] [INFO ] tokenAcqExec-22351 70009331 100092 ###### com.vmware.vise.vim.security.sso.impl.SsoLsLocatorImpl Retrieved locations of services from LS at https://INGT-M1-UTILS1.domain.com:443/lookupservice/sdk in 2 milliseconds:
{vsphere.local(5e6ff3c0-a8cf-11e5-9ac3-000c292f5d25@L)=adminAppUrl: https://INGT-M1-UTILS1.domain.com/sso-adminserver/sdk/vsphere.local, stsUrl: https://INGT-M1-UTILS1.domain.com/sts/STSService/vsphere.local, metadataUrl: https://INGT-M1-UTILS1.domain.com/websso/SAML2/Metadata/vsphere.local, vmodlVersion: interface com.vmware.vim.binding.sso.version.version3_5}
[2019-11-12T08:57:33.380+11:00] [INFO ] tokenAcqExec-22351 70009331 100092 ###### com.vmware.vise.vim.security.sso.impl.SsoUtilInternal Exchanging token _cb7f64db-c661-48d9-8ec3-908cb3cf2bd0 for a new one using https://INGT-M1-UTILS1.domain.com/sts/STSService/vsphere.local from domain vsphere.local(5e6ff3c0-a8cf-11e5-9ac3-000c292f5d25@L)
[2019-11-12T08:57:33.392+11:00] [INFO ] tokenAcqExec-22351 70009331 100092 ###### com.vmware.vim.sso.client.impl.SiteAffinityServiceDiscovery Site affinity is disabled
[2019-11-12T08:57:33.473+11:00] [INFO ] tokenAcqExec-22351 70009331 100092 ###### com.vmware.identity.token.impl.SamlTokenImpl SAML token for SubjectNameId [value=mv@domain.com, format=http://schemas.xmlsoap.org/claims/UPN] successfully parsed from Element
[2019-11-12T08:57:33.474+11:00] [INFO ] tokenAcqExec-22351 70009331 100092 ###### com.vmware.vim.sso.client.impl.SecurityTokenServiceImpl Successfully acquired token for user: {Name: mv, Domain: domain.com}
[2019-11-12T08:57:33.474+11:00] [INFO ] tokenAcqExec-22351 70009331 100092 ###### com.vmware.vise.vim.security.sso.AsyncTokenManager Acquired token. Expiration time: Tue Nov 12 09:01:18 AEDT 2019
[2019-11-12T08:57:33.474+11:00] [INFO ] http-nio-5090-exec-1 70009331 100092 ###### com.vmware.vsphere.client.security.sso.SsoAuthenticationHandler New token data: start time=Tue Nov 12 08:57:33 AEDT 2019, expiration time=Tue Nov 12 09:01:18 AEDT 2019, conf.type=HOLDER_OF_KEY
[2019-11-12T08:57:33.474+11:00] [INFO ] http-nio-5090-exec-1 70009331 100092 ###### com.vmware.vise.util.session.SessionUtil Added clientId 200004. Total clientIds so far (incl. the newly added one): 3
[2019-11-12T08:57:33.474+11:00] [INFO ] http-nio-5090-exec-1 70009331 100092 200004 com.vmware.vise.util.session.SessionUtil Associated sessionId 100092 with clientId 200004. Context path: /ui. This session can destroy the client data container when it expires
[2019-11-12T08:57:33.474+11:00] [INFO ] http-nio-5090-exec-1 70009331 100092 200004 com.vmware.vise.util.session.SessionUtil Assigned clientId 200004 to session 100092 with context path: /ui
[2019-11-12T08:57:33.474+11:00] [INFO ] http-nio-5090-exec-1 70009331 100092 200004 com.vmware.vise.util.session.SessionUtil ClientId 200004 was automatically generated
[2019-11-12T08:57:33.474+11:00] [INFO ] http-nio-5090-exec-1 70009331 100092 200004 com.vmware.vsphere.client.security.sso.SsoAuthenticationHandler Username=mv@domain.com has clientId=200004. Use that clientId to track user activities below.
[2019-11-12T08:57:33.476+11:00] [INFO ] http-nio-5090-exec-1 70009331 100092 200004 com.vmware.vise.vim.security.sso.impl.SsoLsLocatorImpl Retrieved locations of services from LS at https://INGT-M1-UTILS1.domain.com:443/lookupservice/sdk in 2 milliseconds:
{vsphere.local(5e6ff3c0-a8cf-11e5-9ac3-000c292f5d25@L)=adminAppUrl: https://INGT-M1-UTILS1.domain.com/sso-adminserver/sdk/vsphere.local, stsUrl: https://INGT-M1-UTILS1.domain.com/sts/STSService/vsphere.local, metadataUrl: https://INGT-M1-UTILS1.domain.com/websso/SAML2/Metadata/vsphere.local, vmodlVersion: interface com.vmware.vim.binding.sso.version.version3_5}
[2019-11-12T08:57:33.476+11:00] [INFO ] http-nio-5090-exec-1 70009331 100092 200004 com.vmware.vsphere.client.security.sso.SsoAuthenticationHandler SSO authentication successful for sessionId 100092, clientId 200004
[2019-11-12T08:57:33.476+11:00] [INFO ] http-nio-5090-exec-1 70009331 100092 200004 com.vmware.vise.security.spring.DefaultAuthenticationProvider Authenticating user: null using authentication handler: com.vmware.vsphere.client.security.VimAuthenticationHandler@3a9de0c4
[2019-11-12T08:57:33.476+11:00] [INFO ] http-nio-5090-exec-1 70009331 100092 200004 com.vmware.vsphere.client.security.VimAuthenticationHandler Logging in to LinkedVcGroupRegistry for session 100092
[2019-11-12T08:57:33.521+11:00] [INFO ] http-nio-5090-exec-1 70009331 100092 200004 com.vmware.vsphere.client.security.impl.LookupServiceVcSource Found vCenter Server https://INGT-M1-UTILS1.domain.com:443/sdk with id 95664431-2508-4b2a-9f35-dbfa7aa5559b in from Lookup Service. SSO domain: vsphere.local(5e6ff3c0-a8cf-11e5-9ac3-000c292f5d25@L)
[2019-11-12T08:57:33.521+11:00] [INFO ] http-nio-5090-exec-1 70009331 100092 200004 com.vmware.vise.util.concurrent.ExecutorUtil Processing task connectAndLoginToVcServer:https://INGT-M1-UTILS1.domain.com:443/sdk
[2019-11-12T08:57:33.521+11:00] [INFO ] http-nio-5090-exec-1 70009331 100092 200004 com.vmware.vise.util.concurrent.ExecutorUtil Executing task connectAndLoginToVcServer:https://INGT-M1-UTILS1.domain.com:443/sdk
[2019-11-12T08:57:33.523+11:00] [INFO ] im-authentication-pool-22352 70009331 100092 200004 com.vmware.vise.vim.commons.vcservice.impl.VcServiceImpl Initializing vmomi for VC https://INGT-M1-UTILS1.domain.com:443/sdk at VMODL version com.vmware.vim.binding.vim.version.internal.version14 with ID '6.7.2'
[2019-11-12T08:57:33.530+11:00] [WARN ] im-authentication-pool-22352 70009331 100092 200004 com.vmware.vise.vim.commons.vcservice.impl.VcServiceImpl VC https://INGT-M1-UTILS1.domain.com:443/sdk doesn't support the requested locale "en_US". Will use "en" instead.
[2019-11-12T08:57:33.530+11:00] [INFO ] im-authentication-pool-22352 70009331 100092 200004 com.vmware.vise.vim.commons.vcservice.impl.VcServiceImpl Vmomi initialization successful for VC https://INGT-M1-UTILS1.domain.com:443/sdk (95664431-2508-4b2a-9f35-dbfa7aa5559b), locale=en
[2019-11-12T08:57:33.530+11:00] [INFO ] im-authentication-pool-22352 70009331 100092 200004 com.vmware.vise.vim.commons.vcservice.impl.LinkedVcGroupImpl Processing peer vc servers - https://INGT-M1-UTILS1.domain.com:443/sdk
[2019-11-12T08:57:33.530+11:00] [INFO ] im-authentication-pool-22352 70009331 100092 200004 com.vmware.vise.vim.commons.vcservice.impl.LinkedVcGroupImpl Peer VC servers: []
[2019-11-12T08:57:33.530+11:00] [INFO ] im-authentication-pool-22352 70009331 100092 200004 com.vmware.vise.vim.commons.vcservice.impl.LinkedVcGroupImpl Created VC registry: https://INGT-M1-UTILS1.domain.com:443/sdk(95664431-2508-4b2a-9f35-dbfa7aa5559b)
[2019-11-12T08:57:33.530+11:00] [INFO ] im-authentication-pool-22352 70009331 100092 200004 com.vmware.vise.vim.commons.vcservice.impl.LinkedVcGroupImpl Created a linked VC group: [https://INGT-M1-UTILS1.domain.com:443/sdk(95664431-2508-4b2a-9f35-dbfa7aa5559b)]
[2019-11-12T08:57:33.530+11:00] [INFO ] im-authentication-pool-22352 70009331 100092 200004 com.vmware.vise.vim.commons.vcservice.impl.LinkedVcGroupImpl Logging into startup VC: https://INGT-M1-UTILS1.domain.com:443/sdk
[2019-11-12T08:57:33.554+11:00] [INFO ] im-authentication-pool-22352 70009331 100092 200004 com.vmware.vise.vim.commons.vcservice.impl.VcServiceImpl loginByToken successful on vc https://INGT-M1-UTILS1.domain.com:443/sdk
[2019-11-12T08:57:33.554+11:00] [INFO ] im-authentication-pool-22352 70009331 100092 200004 com.vmware.vise.vim.commons.vcservice.impl.VcServiceImpl logged in VC with id 3000006
[2019-11-12T08:57:33.554+11:00] [INFO ] im-authentication-pool-22352 70009331 100092 200004 com.vmware.vise.vim.commons.vcservice.impl.VcServiceImpl Successfully logged into VC https://INGT-M1-UTILS1.domain.com:443/sdk for session: 100092
[2019-11-12T08:57:33.554+11:00] [INFO ] im-authentication-pool-22352 70009331 100092 200004 com.vmware.vise.vim.commons.vcservice.impl.LinkedVcGroupImpl Login successful to start-up VC: https://INGT-M1-UTILS1.domain.com:443/sdk
[2019-11-12T08:57:33.554+11:00] [INFO ] im-authentication-pool-22352 70009331 100092 200004 com.vmware.vise.vim.commons.vcservice.impl.LinkedVcGroupImpl Login to peer vc servers for startup VC https://INGT-M1-UTILS1.domain.com:443/sdk
[2019-11-12T08:57:33.554+11:00] [INFO ] im-authentication-pool-22352 70009331 100092 200004 com.vmware.vise.vim.commons.vcservice.impl.LinkedVcGroupImpl Peer vc servers for https://INGT-M1-UTILS1.domain.com:443/sdk:
[]
[2019-11-12T08:57:33.554+11:00] [INFO ] im-authentication-pool-22352 70009331 100092 200004 com.vmware.vise.vim.commons.vcservice.impl.LinkedVcGroupImpl There are no peers
[2019-11-12T08:57:33.555+11:00] [INFO ] im-authentication-pool-22352 70009331 100092 200004 c.v.vise.vim.commons.extensions.impl.LinkedVcGroupRegistryImpl Added a linked VC group to registry. Endpoints: https://INGT-M1-UTILS1.domain.com:443/sdk(95664431-2508-4b2a-9f35-dbfa7aa5559b,vsphere.local(5e6ff3c...))
[2019-11-12T08:57:33.555+11:00] [INFO ] http-nio-5090-exec-1 70009331 100092 200004 com.vmware.vsphere.client.security.VimAuthenticationHandler LinkedVcGroupRegistry login complete 100092
[2019-11-12T08:57:33.555+11:00] [INFO ] http-nio-5090-exec-1 70009331 100092 200004 com.vmware.vsphere.client.security.VimAuthenticationHandler Authentication successful for session : 100092
[2019-11-12T08:57:33.555+11:00] [INFO ] http-nio-5090-exec-1 70009331 100092 200004 com.vmware.vsphere.client.security.VimAuthenticationHandler 3 authenticated VIM session(s).
[2019-11-12T08:57:33.555+11:00] [INFO ] http-nio-5090-exec-1 70009331 100092 200004 com.vmware.vsphere.client.security.VimAuthenticationHandler VIM authentication successful for sessionId 100092, clientId 200004
[2019-11-12T08:57:33.557+11:00] [INFO ] http-nio-5090-exec-1 70009331 100092 200004 com.vmware.vise.security.SessionListener sessionDestroyed invoked for sessionId 100092
[2019-11-12T08:57:33.557+11:00] [INFO ] http-nio-5090-exec-1 70009331 100092 200004 com.vmware.vise.security.SessionListener Session 100092 with context-path {/ui} associated with client 200004 is destroyed.
[2019-11-12T08:57:33.557+11:00] [INFO ] http-nio-5090-exec-1 70009331 com.vmware.vise.util.session.SessionUtil Generated hashed session id: 100093
[2019-11-12T08:57:33.557+11:00] [INFO ] http-nio-5090-exec-1 70009331 100093 ###### com.vmware.vise.security.SessionListener Session 100093 created with context path: /ui
[2019-11-12T08:57:33.557+11:00] [INFO ] http-nio-5090-exec-1 70009331 100093 ###### com.vmware.vise.security.spring.DefaultAuthenticationProvider Successful authentication handler running for sessionId 100093, clientId 200004
[2019-11-12T08:57:33.557+11:00] [INFO ] http-nio-5090-exec-1 70009331 100093 ###### com.vmware.vise.security.spring.DefaultAuthenticationProvider Starting authhandlers for sessionId 100093, clientId 200004
[2019-11-12T08:57:33.557+11:00] [INFO ] http-nio-5090-exec-1 70009331 100093 ###### com.vmware.vise.security.spring.DefaultAuthenticationProvider Running initSession for sessionId 100093, clientId 200004
[2019-11-12T08:57:33.557+11:00] [INFO ] http-nio-5090-exec-1 70009331 100093 ###### com.vmware.vise.security.spring.DefaultAuthenticationProvider Initializing Session: sessionId 100093, clientId 200004
[2019-11-12T08:57:33.557+11:00] [INFO ] http-nio-5090-exec-1 70009331 100093 ###### com.vmware.vise.security.spring.DefaultAuthenticationProvider Retrieving session listeners for sessionId 100093, clientId 200004
[2019-11-12T08:57:33.557+11:00] [INFO ] http-nio-5090-exec-1 70009331 100093 ###### com.vmware.vise.security.spring.DefaultAuthenticationProvider Invoking session listeners
[2019-11-12T08:57:33.557+11:00] [INFO ] ncPluginDeploymentExecutor-1 70009243 100083 200003 c.vmware.vise.vim.extension.login.LoginPluginDeploymentInitiator Checking for new plugins...
[2019-11-12T08:57:33.558+11:00] [INFO ] taskExecutor-1 70009331 100093 200004 c.vmware.license.client.management.adapter.LicenseInventoryCache Retrieving license inventory...
[2019-11-12T08:57:33.559+11:00] [INFO ] session-init-pool-22355 70009331 100093 200004 com.vmware.vsphere.client.security.sso.SsoTokenLifetimeManager Registering session: 100093
[2019-11-12T08:57:33.559+11:00] [WARN ] session-init-pool-22355 70009331 100093 200004 com.vmware.vsphere.client.security.sso.SsoTokenLifetimeManager Token has less than 5 minutes left. sessionId 100093, clientId 200004
[2019-11-12T08:57:33.559+11:00] [INFO ] session-init-pool-22355 70009331 100093 200004 com.vmware.vsphere.client.security.sso.SsoTokenLifetimeManager sessionId 100093, clientId 200004, Token expiration time: Tue Nov 12 09:01:18 AEDT 2019
Token renewal scheduled approximately for: Tue Nov 12 08:59:48 AEDT 2019
[2019-11-12T08:57:33.580+11:00] [INFO ] http-nio-5090-exec-1 70009331 100093 ###### com.vmware.vise.security.spring.DefaultAuthenticationProvider Session initialization complete for sessionId 100093, clientId 200004
[2019-11-12T08:57:33.589+11:00] [INFO ] http-nio-5090-exec-6 70009332 100093 200004 com.vmware.vise.util.PropertyUtil Property 'remote.plugin.updateOnBrowserRefresh' is missing. Will use the default: false
[2019-11-12T08:57:33.590+11:00] [INFO ] http-nio-5090-exec-6 70009332 100093 200004 com.vmware.vise.util.PropertyUtil Property 'local.development' is missing. Will use the default: false
[2019-11-12T08:57:33.603+11:00] [INFO ] http-nio-5090-exec-6 70009332 100093 200004 com.vmware.vise.util.PropertyUtil Property 'codecapture.disabled' is missing. Will use the default: false
[2019-11-12T08:57:33.657+11:00] [INFO ] ce-extension-mngr-pool-22361 70009331 100093 200004 com.vmware.vise.util.PropertyUtil Property 'plugin.signature.check.enabled' is missing. Will use the default: true
[2019-11-12T08:57:33.657+11:00] [WARN ] ce-extension-mngr-pool-22361 70009331 100093 200004 c.vmware.vise.vim.directory.extensions.DirectoryExtensionManager Detected an invalid signature for plugin: com.vmware.fallback.mixed:6.5.0 - com.vmware.vise.extensionfw.signing.PluginSignatureException: No META-INF/MANIFEST.MF entry found in the plugin zip file.
[2019-11-12T08:57:33.657+11:00] [INFO ] ce-extension-mngr-pool-22361 70009331 100093 200004 com.vmware.vise.vim.extension.PluginStatusTaskManager DEPLOYING: Deploying plugin package com.vmware.fallback.mixed:6.5.0 ...
[2019-11-12T08:57:33.667+11:00] [INFO ] ce-extension-mngr-pool-22361 70009331 100093 200004 com.vmware.vise.vim.extension.PluginStatusTaskManager DEPLOYMENT_FAILED: Error deploying plugin package com.vmware.fallback.mixed:6.5.0. Reason: Incompatible. This is a vSphere Web Client (Flash) only plugin indicated by the missing type="html" plugin manifest attribute.
[2019-11-12T08:57:33.667+11:00] [INFO ] plugin-validation1 com.vmware.vise.extensionfw.impl.OsgiUsageValidationService Started validation of OSGi bad practices.
[2019-11-12T08:57:33.667+11:00] [INFO ] plugin-validation1 com.vmware.vise.extensionfw.impl.OsgiUsageValidationService Finished validation of OSGi bad practices.
[2019-11-12T08:57:33.676+11:00] [INFO ] ce-extension-mngr-pool-22362 70009331 100093 200004 com.vmware.vise.util.PropertyUtil Property 'plugin.signature.check.enabled' is missing. Will use the default: true
[2019-11-12T08:57:33.676+11:00] [WARN ] ce-extension-mngr-pool-22362 70009331 100093 200004 c.vmware.vise.vim.directory.extensions.DirectoryExtensionManager Detected an invalid signature for plugin: com.vmware.vcIntegrity.vcIntegrity:6.7.0.41905 - com.vmware.vise.extensionfw.signing.PluginSignatureException: No META-INF/MANIFEST.MF entry found in the plugin zip file.
[2019-11-12T08:57:33.677+11:00] [INFO ] ce-extension-mngr-pool-22362 70009331 100093 200004 com.vmware.vise.vim.extension.PluginStatusTaskManager DEPLOYING: Deploying plugin package com.
vmware.vcIntegrity.vcIntegrity:6.7.0.41905 ...
[2019-11-12T08:57:33.681+11:00] [INFO ] m-catalog-manager-pool-22354 70009331 100093 200004 com.vmware.vise.vim.lookup.LsCatalogManager detectServiceProviders took (ms):122
[2019-11-12T08:57:33.696+11:00] [INFO ] m-catalog-manager-pool-22354 70009331 100093 200004 com.vmware.vise.vim.lookup.LsCatalogManager processResourceBundles took (ms):15
[2019-11-12T08:57:33.696+11:00] [INFO ] m-catalog-manager-pool-22364 70009334 100093 200004 com.vmware.vise.vim.lookup.LsCatalogManager Loading properties for /etc/vmware/vsphere-ui/cmCatalog/com.vmware.cis.com.vmware.vsan.health.zip:US
[2019-11-12T08:57:33.698+11:00] [WARN ] ce-extension-mngr-pool-22361 70009331 100093 200004 c.vmware.vise.vim.directory.extensions.DirectoryExtensionManager Could not download bundle com.vmware.imagebuilder.imagebuilder from https://INGT-M1-UTILS1.domain.com:443/vmw/imagebuilder/httpd/autodeploy-modules-plugins.zip.
[2019-11-12T08:57:33.701+11:00] [INFO ] m-catalog-manager-pool-22365 70009336 100093 200004 com.vmware.vise.vim.lookup.LsCatalogManager Loading properties for /etc/vmware/vsphere-ui/cmCatalog/com.vmware.vim.sms.sms-6.7.0.0.zip:US
[2019-11-12T08:57:33.701+11:00] [INFO ] m-catalog-manager-pool-22365 70009336 100093 200004 com.vmware.vise.vim.lookup.LsCatalogManager Time waiting for csp info (ms) for /etc/vmware/vsphere-ui/cmCatalog/com.vmware.vim.sms.sms-6.7.0.0.zip:US: 0
[2019-11-12T08:57:33.701+11:00] [INFO ] m-catalog-manager-pool-22363 70009335 100093 200004 com.vmware.vise.vim.lookup.LsCatalogManager downloadResourceBundle: Trying https://INGT-M1-UTILS1.domain.com:443/catalog/com.vmware.vsan.health_catalog.zip
[2019-11-12T08:57:33.701+11:00] [INFO ] m-catalog-manager-pool-22365 70009336 100093 200004 com.vmware.vise.vim.lookup.LocalizedMessageDictionary Loaded Resource bundle cis.sms.ResourceBundle
[2019-11-12T08:57:33.702+11:00] [WARN ] m-catalog-manager-pool-22365 70009336 100093 200004 com.vmware.vise.vim.lookup.LocalizedMessageDictionary 135 Resource Bundle entry conflicts found for: /etc/vmware/vsphere-ui/cmCatalog/com.vmware.vim.sms.sms-6.7.0.0.zip/cis.sms.ResourceBundle:US
[2019-11-12T08:57:33.702+11:00] [INFO ] m-catalog-manager-pool-22365 70009336 100093 200004 com.vmware.vise.vim.lookup.LocalizedMessageDictionary Loaded 135 elements from bundle: /etc/vmware/vsphere-ui/cmCatalog/com.vmware.vim.sms.sms-6.7.0.0.zip/cis.sms.ResourceBundle:US
[2019-11-12T08:57:33.702+11:00] [INFO ] m-catalog-manager-pool-22365 70009336 100093 200004 com.vmware.vise.vim.lookup.LsCatalogManager Time to load properties (ms)/etc/vmware/vsphere-ui/cmCatalog/com.vmware.vim.sms.sms-6.7.0.0.zip:US: 1
[2019-11-12T08:57:33.709+11:00] [INFO ] taskExecutor-1 70009331 100093 200004 c.vmware.license.client.management.adapter.LicenseInventoryCache Retrieved 2 licenses.
[2019-11-12T08:57:33.711+11:00] [WARN ] ce-extension-mngr-pool-22362 70009331 100093 200004 com.vmware.vise.extensionfw.impl.PackageManifestParser Plugin id mismatch between the registered extension key (com.vmware.vcIntegrity.vcIntegrity)
and the id specified in plugin-package.xml (com.vmware.vumclient). The registration id will be used but you should keep them in sync.
[2019-11-12T08:57:33.711+11:00] [WARN ] ce-extension-mngr-pool-22362 70009331 100093 200004 com.vmware.vise.extensionfw.impl.PackageManifestParser Plugin version mismatch for com.vmware.vcIntegrity.vcIntegrity between the plugin registration info (6.7.0.41905)
and the version specified in plugin-package.xml (6.7.0). The registration version will be used but you should keep them in sync.
[2019-11-12T08:57:33.723+11:00] [ERROR] m-catalog-manager-pool-22363 70009335 100093 200004 com.vmware.vise.vim.lookup.LsCatalogManager Invoking 'downloadResourceBundle(com.vmware.cis.com.vmware.vsan.health from https://INGT-M1-UTILS1.domain.com:443/catalog/com.vmware.vsan.health_catalog.zip)' unsuccessful, retry time left = None. Returning default result org.apache.http.HttpException: HttpStatus is not SC_OK. statusCode = 404
at com.vmware.vise.vim.lookup.LsCatalogManager.executeDownload(LsCatalogManager.java:1568)
at com.vmware.vise.vim.lookup.LsCatalogManager.downloadResourceBundle(LsCatalogManager.java:1509)
at com.vmware.vise.vim.lookup.LsCatalogManager.access$1300(LsCatalogManager.java:98)
at com.vmware.vise.vim.lookup.LsCatalogManager$7.call(LsCatalogManager.java:1437)
at com.vmware.vise.vim.lookup.LsCatalogManager$7.call(LsCatalogManager.java:1435)
at com.vmware.vise.vim.lookup.LsCatalogManager.retryUntil(LsCatalogManager.java:1708)
at com.vmware.vise.vim.lookup.LsCatalogManager.initializeCatalogServiceProviderInfo(LsCatalogManager.java:1442)
at com.vmware.vise.vim.lookup.LsCatalogManager.access$1200(LsCatalogManager.java:98)
at com.vmware.vise.vim.lookup.LsCatalogManager$6.call(LsCatalogManager.java:1251)
at com.vmware.vise.vim.lookup.LsCatalogManager$6.call(LsCatalogManager.java:1239)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at com.vmware.vise.util.concurrent.QueuingCachedThreadPool$2.call(QueuingCachedThreadPool.java:831)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at com.vmware.vise.util.concurrent.QueuingCachedThreadPool$QueueProcessor.run(QueuingCachedThreadPool.java:1229)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at com.vmware.vise.util.concurrent.WorkerThreadFactory$1.run(WorkerThreadFactory.java:64)
at java.lang.Thread.run(Thread.java:748)
[2019-11-12T08:57:33.723+11:00] [WARN ] m-catalog-manager-pool-22363 70009335 100093 200004 com.vmware.vise.vim.lookup.LsCatalogManager Failed to download /etc/vmware/vsphere-ui/cmCatalog/com.vmware.cis.com.vmware.vsan.health.zip from https://INGT-M1-UTILS1.domain.com:443/catalog/com.vmware.vsan.health_catalog.zip.
[2019-11-12T08:57:33.723+11:00] [INFO ] m-catalog-manager-pool-22363 70009335 100093 200004 com.vmware.vise.vim.lookup.LsCatalogManager The HttpClient is no longer used. Will Close it.
[2019-11-12T08:57:33.723+11:00] [INFO ] m-catalog-manager-pool-22364 70009334 100093 200004 com.vmware.vise.vim.lookup.LsCatalogManager Time waiting for csp info (ms) for /etc/vmware/vsphere-ui/cmCatalog/com.vmware.cis.com.vmware.vsan.health.zip:US: 27
[2019-11-12T08:57:33.723+11:00] [INFO ] m-catalog-manager-pool-22364 70009334 100093 200004 com.vmware.vise.vim.lookup.LsCatalogManager Unable to get catalogServiceProviderInfo for /etc/vmware/vsphere-ui/cmCatalog/com.vmware.cis.com.vmware.vsan.health.zip:US
[2019-11-12T08:57:33.723+11:00] [INFO ] m-catalog-manager-pool-22364 70009334 100093 200004 com.vmware.vise.vim.lookup.LsCatalogManager Time to load properties (ms)/etc/vmware/vsphere-ui/cmCatalog/com.vmware.cis.com.vmware.vsan.health.zip:US: 0
[2019-11-12T08:57:34.040+11:00] [INFO ] ce-extension-mngr-pool-22362 70009331 100093 200004 com.vmware.vise.vim.extension.PluginStatusTaskManager DEPLOYMENT_FAILED: Error deploying plugin package com.vmware.vcIntegrity.vcIntegrity:6.7.0.41905. Reason: Incompatible. This is a vSphere Web Client (Flash) only plugin indicated by the missing type="html" plugin manifest attribute.
[2019-11-12T08:57:34.046+11:00] [INFO ] plugin-validation1 com.vmware.vise.extensionfw.impl.OsgiUsageValidationService Started validation of OSGi bad practices.
[2019-11-12T08:57:34.046+11:00] [INFO ] ncPluginDeploymentExecutor-1 70009331 100093 200004 c.vmware.vise.vim.extension.login.LoginPluginDeploymentInitiator Check for new plugins completed in 489 ms.
[2019-11-12T08:57:34.046+11:00] [INFO ] plugin-validation1 com.vmware.vise.extensionfw.impl.OsgiUsageValidationService Finished validation of OSGi bad practices.
[2019-11-12T08:57:36.158+11:00] [INFO ] http-nio-5090-exec-6 com.vmware.vise.util.session.SessionUtil Generated hashed session id: 100094
[2019-11-12T08:57:36.158+11:00] [INFO ] http-nio-5090-exec-6 70009343 100094 200004 com.vmware.vise.util.session.SessionUtil Mapping: /websocket: sessionid to -> 100094 with clientId: 200004
[2019-11-12T08:57:36.166+11:00] [INFO ] data-service-pool-771 com.vmware.vise.util.session.SessionUtil Generated hashed session id: 100095
[2019-11-12T08:57:36.166+11:00] [INFO ] data-service-pool-771 com.vmware.vise.util.session.SessionUtil Mapping: /websocket: sessionid to -> 100095 with clientId: 200004
[2019-11-12T08:57:36.253+11:00] [INFO ] data-service-pool-771 com.vmware.vise.util.session.SessionUtil Generated hashed session id: 100096
[2019-11-12T08:57:36.253+11:00] [INFO ] data-service-pool-771 com.vmware.vise.util.session.SessionUtil Mapping: /websocket: sessionid to -> 100096 with clientId: 200004
[2019-11-12T08:57:36.253+11:00] [INFO ] data-service-pool-771 70009346 100096 200004 c.v.v.client.folder.LazyLoadingDataMigrationPropertyProvider [getProperties] startedTime -- '2019-11-11T21:57:36.253Z'
[2019-11-12T08:57:36.819+11:00] [WARN ] http-nio-5090-exec-10 70009354 100093 200004 com.vmware.vise.mvc.tree.TreeNodeStateManagerImpl Failed to load user preferences.
[2019-11-12T08:57:37.437+11:00] [WARN ] data-service-pool-797 70009365 100093 200004 c.v.v.c.vsandp.core.sessionmanager.resource.util.VersionService Version 'urn:vsan:6.9.0' not supported by the server.
[2019-11-12T08:57:37.437+11:00] [INFO ] data-service-pool-797 70009365 100093 200004 c.vmware.vsphere.client.vsan.base.service.VsanServiceFactoryBase Using VMODL version: com.vmware.vim.vsan.binding.vsan.version.version11
[2019-11-12T08:57:37.492+11:00] [INFO ] data-service-pool-797 70009365 100093 200004 com.vmware.vsan.client.util.Measure VsanCapabilitySystem.getCapabilities (0.08 s):
VsanCapabilitySystem.getCapabilities77
[2019-11-12T08:57:37.507+11:00] [WARN ] data-service-pool-759 70009365 100093 200004 c.v.v.c.vsandp.core.sessionmanager.resource.util.VersionService Version 'urn:vsan:6.9.0' not supported by the server.
[2019-11-12T08:57:37.508+11:00] [WARN ] data-service-pool-759 70009365 100093 200004 c.v.v.c.vsandp.core.sessionmanager.resource.util.VersionService Version 'urn:vsan:vSAN 6.7U3' not supported by the server.
[2019-11-12T08:57:37.508+11:00] [WARN ] data-service-pool-759 70009365 100093 200004 c.v.v.c.vsandp.core.sessionmanager.resource.util.VersionService Version 'urn:vsan:6.8.7' not supported by the server.
[2019-11-12T08:57:37.508+11:00] [WARN ] data-service-pool-759 70009365 100093 200004 c.v.v.c.vsandp.core.sessionmanager.resource.util.VersionService Version 'urn:vsan:vSAN 6.7U1' not supported by the server.
[2019-11-12T08:57:37.508+11:00] [WARN ] data-service-pool-759 70009365 100093 200004 c.v.v.c.vsandp.core.sessionmanager.resource.util.VersionService Version 'urn:vsan:VMC M5' not supported by the server.
[2019-11-12T08:57:37.508+11:00] [WARN ] data-service-pool-759 70009365 100093 200004 c.v.v.c.vsandp.core.sessionmanager.resource.util.VersionService Version 'urn:vsan:6.7' not supported by the server.
[2019-11-12T08:57:37.508+11:00] [WARN ] data-service-pool-759 70009365 100093 200004 c.v.v.c.vsandp.core.sessionmanager.resource.util.VersionService Version 'urn:vsan:6.7.0' not supported by the server.
[2019-11-12T08:57:37.508+11:00] [WARN ] data-service-pool-759 70009365 100093 200004 c.v.v.c.vsandp.core.sessionmanager.resource.util.VersionService Version 'urn:vsan:6.6.2' not supported by the server.
[2019-11-12T08:57:37.508+11:00] [WARN ] data-service-pool-759 70009365 100093 200004 c.v.v.c.vsandp.core.sessionmanager.resource.util.VersionService Version 'urn:vsan:6.6.1' not supported by the server.
[2019-11-12T08:57:37.508+11:00] [WARN ] data-service-pool-759 70009365 100093 200004 c.v.v.c.vsandp.core.sessionmanager.resource.util.VersionService Version 'urn:vsan:6.6' not supported by the server.
[2019-11-12T08:57:37.508+11:00] [WARN ] data-service-pool-759 70009365 100093 200004 c.v.v.c.vsandp.core.sessionmanager.resource.util.VersionService Version 'urn:vim25:unstable' not supported by the server.
[2019-11-12T08:57:37.508+11:00] [WARN ] data-service-pool-759 70009365 100093 200004 c.v.v.c.vsandp.core.sessionmanager.resource.util.VersionService Version 'urn:vim25:stable' not supported by the server.
[2019-11-12T08:57:37.508+11:00] [WARN ] data-service-pool-797 70009365 100093 200004 c.v.v.c.vsandp.core.sessionmanager.resource.util.VersionService Version 'urn:vsan:6.9.0' not supported by the server.
[2019-11-12T08:57:37.572+11:00] [INFO ] data-service-pool-759 70009365 100093 200004 com.vmware.identity.token.impl.SamlTokenImpl SAML token for SubjectNameId [value=mv@domain.com, format=http://schemas.xmlsoap.org/claims/UPN] successfully parsed from XML
[2019-11-12T08:57:37.631+11:00] [INFO ] data-service-pool-759 70009365 100093 200004 com.vmware.vsan.client.util.Measure VsanCapabilitySystem.getCapabilities (0.04 s):
VsanCapabilitySystem.getCapabilities40
[2019-11-12T08:57:38.690+11:00] [INFO ] data-service-pool-771 70009346 100096 200004 c.v.v.client.folder.LazyLoadingDataMigrationPropertyProvider [getProperties] execution finished and timeTaken to get lazyImportData for '1' vCenters is 'PT2.437S'
[2019-11-12T08:57:38.691+11:00] [INFO ] data-service-pool-771 com.vmware.vise.util.session.SessionUtil Generated hashed session id: 100097
[2019-11-12T08:57:38.691+11:00] [INFO ] data-service-pool-771 com.vmware.vise.util.session.SessionUtil Mapping: /websocket: sessionid to -> 100097 with clientId: 200004
[2019-11-12T08:57:38.691+11:00] [INFO ] data-service-pool-771 com.vmware.vise.util.session.SessionUtil Generated hashed session id: 100098
[2019-11-12T08:57:38.691+11:00] [INFO ] data-service-pool-771 com.vmware.vise.util.session.SessionUtil Mapping: /websocket: sessionid to -> 100098 with clientId: 200004
[2019-11-12T08:57:38.693+11:00] [INFO ] data-service-pool-771 70009381 100098 200004 com.vmware.vise.vim.security.sso.impl.SsoLsLocatorImpl Retrieved locations of services from LS at https://INGT-M1-UTILS1.domain.com:443/lookupservice/sdk in 2 milliseconds:
{vsphere.local(5e6ff3c0-a8cf-11e5-9ac3-000c292f5d25@L)=adminAppUrl: https://INGT-M1-UTILS1.domain.com/sso-adminserver/sdk/vsphere.local, stsUrl: https://INGT-M1-UTILS1.domain.com/sts/STSService/vsphere.local, metadataUrl: https://INGT-M1-UTILS1.domain.com/websso/SAML2/Metadata/vsphere.local, vmodlVersion: interface com.vmware.vim.binding.sso.version.version3_5}
[2019-11-12T08:57:38.748+11:00] [INFO ] data-service-pool-771 com.vmware.vise.util.session.SessionUtil Generated hashed session id: 100099
[2019-11-12T08:57:38.748+11:00] [INFO ] data-service-pool-771 com.vmware.vise.util.session.SessionUtil Mapping: /websocket: sessionid to -> 100099 with clientId: 200004
[2019-11-12T08:57:38.751+11:00] [INFO ] data-service-pool-771 com.vmware.vise.util.session.SessionUtil Generated hashed session id: 100100
[2019-11-12T08:57:38.751+11:00] [INFO ] data-service-pool-771 com.vmware.vise.util.session.SessionUtil Mapping: /websocket: sessionid to -> 100100 with clientId: 200004
[2019-11-12T08:57:38.758+11:00] [INFO ] data-service-pool-754 com.vmware.vise.util.session.SessionUtil Generated hashed session id: 100101
[2019-11-12T08:57:38.758+11:00] [INFO ] data-service-pool-754 com.vmware.vise.util.session.SessionUtil Mapping: /websocket: sessionid to -> 100101 with clientId: 200004
[2019-11-12T08:57:56.060+11:00] [INFO ] health-status-59 com.vmware.vise.vim.cm.healthstatus.AppServerHealthService Memory usage: used=320,071,536; max=796,393,472; percentage=40.19012551624733%. Status: GREEN
[2019-11-12T08:57:56.060+11:00] [INFO ] health-status-59 c.v.v.v.cm.HealthStatusRequestHandler$HealthStatusCollectorTask Determined health status 'GREEN' in 0 ms
[2019-11-12T08:58:09.567+11:00] [INFO ] http-nio-5090-exec-7 70009389 100093 200004 com.vmware.vise.util.PropertyUtil Property 'remote.plugin.updateOnBrowserRefresh' is missing. Will use the default: false
[2019-11-12T08:58:09.568+11:00] [INFO ] http-nio-5090-exec-7 70009389 100093 200004 com.vmware.vise.util.PropertyUtil Property 'local.development' is missing. Will use the default: false
[2019-11-12T08:58:09.573+11:00] [INFO ] http-nio-5090-exec-7 70009389 100093 200004 com.vmware.vise.util.PropertyUtil Property 'codecapture.disabled' is missing. Will use the default: false
[2019-11-12T08:58:11.936+11:00] [INFO ] data-service-pool-771 com.vmware.vise.util.session.SessionUtil Generated hashed session id: 100102
[2019-11-12T08:58:11.936+11:00] [INFO ] data-service-pool-771 com.vmware.vise.util.session.SessionUtil Mapping: /websocket: sessionid to -> 100102 with clientId: 200004
[2019-11-12T08:58:11.940+11:00] [INFO ] data-service-pool-771 com.vmware.vise.util.session.SessionUtil Generated hashed session id: 100103
[2019-11-12T08:58:11.940+11:00] [INFO ] data-service-pool-771 com.vmware.vise.util.session.SessionUtil Mapping: /websocket: sessionid to -> 100103 with clientId: 200004
[2019-11-12T08:58:11.940+11:00] [INFO ] data-service-pool-771 70009398 100103 200004 c.v.v.client.folder.LazyLoadingDataMigrationPropertyProvider [getProperties] startedTime -- '2019-11-11T21:58:11.940Z'
[2019-11-12T08:58:14.305+11:00] [INFO ] data-service-pool-771 70009398 100103 200004 c.v.v.client.folder.LazyLoadingDataMigrationPropertyProvider [getProperties] execution finished and timeTaken to get lazyImportData for '1' vCenters is 'PT2.365S'
[2019-11-12T08:58:14.306+11:00] [INFO ] data-service-pool-771 com.vmware.vise.util.session.SessionUtil Generated hashed session id: 100104
[2019-11-12T08:58:14.306+11:00] [INFO ] data-service-pool-771 com.vmware.vise.util.session.SessionUtil Mapping: /websocket: sessionid to -> 100104 with clientId: 200004
[2019-11-12T08:58:14.307+11:00] [INFO ] data-service-pool-771 com.vmware.vise.util.session.SessionUtil Generated hashed session id: 100105
[2019-11-12T08:58:14.307+11:00] [INFO ] data-service-pool-771 com.vmware.vise.util.session.SessionUtil Mapping: /websocket: sessionid to -> 100105 with clientId: 200004
[2019-11-12T08:58:14.336+11:00] [INFO ] data-service-pool-771 com.vmware.vise.util.session.SessionUtil Generated hashed session id: 100106
[2019-11-12T08:58:14.337+11:00] [INFO ] data-service-pool-771 com.vmware.vise.util.session.SessionUtil Mapping: /websocket: sessionid to -> 100106 with clientId: 200004
[2019-11-12T08:58:14.337+11:00] [INFO ] data-service-pool-771 com.vmware.vise.util.session.SessionUtil Generated hashed session id: 100107
[2019-11-12T08:58:14.337+11:00] [INFO ] data-service-pool-771 com.vmware.vise.util.session.SessionUtil Mapping: /websocket: sessionid to -> 100107 with clientId: 200004
[2019-11-12T08:58:14.345+11:00] [INFO ] data-service-pool-772 com.vmware.vise.util.session.SessionUtil Generated hashed session id: 100108
[2019-11-12T08:58:14.345+11:00] [INFO ] data-service-pool-772 com.vmware.vise.util.session.SessionUtil Mapping: /websocket: sessionid to -> 100108 with clientId: 200004
It does look like your VC is unable to connect with the VMs over port 9443:
2019-11-11T21:57:12.636Z| mks| I125: SSL: syscall error 104: Connection reset by peer
2019-11-11T21:57:12.636Z| mks| I125: SOCKET 6 (112) recv error 104: Connection reset by peer
Has this ever worked before? If yes, what was the last change done?
Also, is the VC in a different subnet or sits in a DMZ unlike the host through which you are able to connect to the VM web console successfully?
Other steps that can be tried if not done already:
- vMotion one VM to another host and try this.
- Reboot the VM from the vCenter or the host.
- Restart the host once.
Thank you for the assistance.
I tried to connect to VMs hosted by each of my 4 hosts - the same issue.
I reboot my VMs time to time from VC when doing maintenance. Earlier this month I upgraded all VMs HW level (to 15) and VMware Tools (to 10.3.10) so all VMs were restarted.
The last month I upgraded ESXi hosts from 6.5U1 to 6.7U3 (as well as VC) so all hosts have been restarted.
VC and all 4 x ESXi hosts are in the same subnet. Some VMs are in the same subnet whereas some in different ones but web-console won't be opened for any. As far as I understand the console uses VIX API to connect to VM, so network connection is disregarded anyway, is that right? Again I can connect to the web-console from any hosts with no issues.
I have a feeling that there is a cookie prevent the web-console to be opened. I don't want to clean all my cookies as I don't want to loose hundreds of other useful settings. Any idea how VC cookies can be swept out without touching all cookies in the latest Chrome ?
Port 9443 is opened
You can go to Google Chrome Settings>Advanced> Privace and security>Site Settings> Cookies and site Data> Search for vc fqdn/ip and start clearing the cookies. Also, you might want to try installing firefox and check once.
Thank you.
I found and removed the vCenter cookie, restarted Chrome but got the same issue when trying to open a WEB-Console.
The same problem persists in IE and Firefox.
After some testings I found out that the issue is in HTML client only. The flash client is deprecated in 6.7 but still works and I can open web-console with no issues in teh flash client.
I opened a SR with VMware, they advised it is a known issue in 6.5 but not sure about 6.7, they have been checking with relevant atm.
The issue has been resolved by cleaning /etc/vmware/vsphere-ui/vc-packages/vsphere-client-serenity/
- connect to the VCSA shell prompt
- cd /etc/vmware/vsphere-ui/vc-packages/vsphere-client-serenity
- clear all the files, --> command : rm --rf *
- restart the VC services --> service-control --stop --all