Update 6.1 : Request error : The data specified within the request is invalid

[CKloseFUM]

We updated from 6.0.1 to 6.1 in a test environment and the update process was successfull.

After restarting the machines and logging into vCAC 6.1 we've seen all our catalog services and Blueprints.

Requesting a blueprint prings an Error directly to the Request mask. The Request is not executed.

The data specified within the request is invalid. No HTTP resource was found that matches the request URI 'https://IAAS-SERVER.customer.net/WAPI/api/Currency/'.

the catalina.out LOG show following error:

2014-09-10 14:18:13,625 vcac: [component="cafe:iaas-proxy" priority="ERROR" thread="tomcat-http--45" tenant="DEVCLOUD"] com.vmware.vcac.iaas.gateway.impl.BaseGatewayImpl.mapIaasGatewayException:55 - Exception thrown for IaaS endpoint: https://IAAS-SERVER.customer.net/WAPI/

2014-09-10 14:18:13,626 vcac: [component="cafe:iaas-proxy" priority="ERROR" thread="tomcat-http--45" tenant="DEVCLOUD"] com.vmware.vcac.iaas.gateway.impl.BaseGatewayImpl.mapIaasGatewayException:69 - [Error code: 42000 ] - [Error Msg: Infrastructure service provider error]

2014-09-10 14:18:13,629 vcac: [component="cafe:catalog" priority="WARN" thread="tomcat-http--35" tenant="DEVCLOUD"] com.vmware.vcac.platform.rest.RestTemplateIpv6.handleResponseError:581 - POST request for "https://CAFE-SERVER.CUSTOMER.net/iaas-proxy-provider/api/services/e103fccb-d40b-41d0-9f9e-da2103bb7b..." resulted in 400 (Bad Request); invoking error handler

2014-09-10 14:18:13,630 vcac: [component="cafe:catalog" priority="ERROR" thread="tomcat-http--35" tenant="DEVCLOUD"] com.vmware.vcac.platform.rest.client.error.ResponseErrorHandler.handleError:55 - [Rest Error]: {Status code: 400}, {Error code: 42000} , {Error Source: null}, {Error Msg: No HTTP resource was found that matches the request URI 'https://IAAS-SERVER.customer.net/WAPI/api/Currency/'.}, {System Msg: Infrastructure service provider error}

2014-09-10 14:18:13,630 vcac: [component="cafe:catalog" priority="WARN" thread="tomcat-http--35" tenant="DEVCLOUD"] com.vmware.vcac.catalog.provider.gateway.impl.ProviderRequestGatewayImpl.validateRequest:83 - The provider [e103fccb-d40b-41d0-9f9e-da2103bb7b34] determined that request [null] was invalid

[Rest Error]: {Status code: 400}, {Error code: 42000} , {Error Source: null}, {Error Msg: No HTTP resource was found that matches the request URI 'https://IAAS-SERVER.customer.net/WAPI/api/Currency/'.}, {System Msg: Infrastructure service provider error}

  at com.vmware.vcac.platform.rest.client.error.ResponseErrorHandler.mapRestException(ResponseErrorHandler.java:71)

  at com.vmware.vcac.platform.rest.client.error.ResponseErrorHandler.handleError(ResponseErrorHandler.java:54)

  at org.springframework.web.client.RestTemplate.handleResponseError(RestTemplate.java:588)

  at org.springframework.web.client.RestTemplate.doExecute(RestTemplate.java:546)

  at com.vmware.vcac.platform.rest.RestTemplateIpv6.execute(RestTemplateIpv6.java:31)

  at org.springframework.web.client.RestTemplate.postForObject(RestTemplate.java:330)

  at com.vmware.vcac.platform.rest.client.impl.RestClientImpl.post(RestClientImpl.java:314)

  at com.vmware.vcac.catalog.provider.gateway.impl.ProviderRequestGatewayImpl.validateRequest(ProviderRequestGatewayImpl.java:75)

  at com.vmware.vcac.catalog.service.impl.RequestServiceImpl.applyProviderValidation(RequestServiceImpl.java:646)

  at com.vmware.vcac.catalog.service.impl.RequestServiceImpl.submitRequest(RequestServiceImpl.java:563)

  at com.vmware.vcac.catalog.service.impl.RequestServiceImpl.createOrUpdateRequest(RequestServiceImpl.java:428)

  at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)

  at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)

  at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)

  at java.lang.reflect.Method.invoke(Method.java:606)

  at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:317)

  at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:190)

  at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:157)

  at org.springframework.transaction.interceptor.TransactionInterceptor$1.proceedWithInvocation(TransactionInterceptor.java:98)

  at org.springframework.transaction.interceptor.TransactionAspectSupport.invokeWithinTransaction(TransactionAspectSupport.java:262)

  at org.springframework.transaction.interceptor.TransactionInterceptor.invoke(TransactionInterceptor.java:95)

  at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:179)

  at org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:92)

  at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:179)

  at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:207)

  at com.sun.proxy.$Proxy559.createOrUpdateRequest(Unknown Source)

  at com.vmware.vcac.catalog.controller.consumer.ConsumerRequestController.create(ConsumerRequestController.java:71)

  at com.vmware.vcac.catalog.controller.consumer.ConsumerRequestController$$FastClassBySpringCGLIB$$60f2cac8.invoke(<generated>)

  at org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:204)

  at org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:711)

  at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:157)

  at org.springframework.security.access.intercept.aopalliance.MethodSecurityInterceptor.invoke(MethodSecurityInterceptor.java:64)

  at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:179)

  at org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:644)

  at com.vmware.vcac.catalog.controller.consumer.ConsumerRequestController$$EnhancerBySpringCGLIB$$eca195af.create(<generated>)

  at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)

  at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)

  at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)

  at java.lang.reflect.Method.invoke(Method.java:606)

  at org.springframework.web.method.support.InvocableHandlerMethod.invoke(InvocableHandlerMethod.java:215)

  at org.springframework.web.method.support.InvocableHandlerMethod.invokeForRequest(InvocableHandlerMethod.java:132)

  at org.springframework.web.servlet.mvc.method.annotation.ServletInvocableHandlerMethod.invokeAndHandle(ServletInvocableHandlerMethod.java:104)

  at org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.invokeHandleMethod(RequestMappingHandlerAdapter.java:749)

  at org.springframework.web.servlet.mvc.method.annotation.RequestMappingHandlerAdapter.handleInternal(RequestMappingHandlerAdapter.java:689)

  at org.springframework.web.servlet.mvc.method.AbstractHandlerMethodAdapter.handle(AbstractHandlerMethodAdapter.java:83)

  at org.springframework.web.servlet.DispatcherServlet.doDispatch(DispatcherServlet.java:938)

  at org.springframework.web.servlet.DispatcherServlet.doService(DispatcherServlet.java:870)

  at org.springframework.web.servlet.FrameworkServlet.processRequest(FrameworkServlet.java:961)

  at org.springframework.web.servlet.FrameworkServlet.doPost(FrameworkServlet.java:863)

  at javax.servlet.http.HttpServlet.service(HttpServlet.java:647)

  at org.springframework.web.servlet.FrameworkServlet.service(FrameworkServlet.java:837)

  at javax.servlet.http.HttpServlet.service(HttpServlet.java:728)

  at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:305)

  at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:210)

  at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:330)

  at org.springframework.security.web.access.intercept.FilterSecurityInterceptor.invoke(FilterSecurityInterceptor.java:118)

  at org.springframework.security.web.access.intercept.FilterSecurityInterceptor.doFilter(FilterSecurityInterceptor.java:84)

  at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342)

  at org.springframework.security.web.access.ExceptionTranslationFilter.doFilter(ExceptionTranslationFilter.java:113)

  at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342)

  at org.springframework.security.web.authentication.AnonymousAuthenticationFilter.doFilter(AnonymousAuthenticationFilter.java:113)

  at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342)

  at org.springframework.security.web.servletapi.SecurityContextHolderAwareRequestFilter.doFilter(SecurityContextHolderAwareRequestFilter.java:154)

  at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342)

  at com.vmware.vcac.authentication.http.spring.BaseTokenAuthenticationFilter.doFilter(BaseTokenAuthenticationFilter.java:45)

  at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342)

  at com.vmware.vcac.authentication.http.spring.BaseTokenAuthenticationFilter.doFilter(BaseTokenAuthenticationFilter.java:70)

  at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342)

  at com.vmware.vcac.authentication.http.tenancy.TenancyContextFilter.doFilterWithTenancyContext(TenancyContextFilter.java:67)

  at com.vmware.vcac.authentication.http.tenancy.TenancyContextFilter.doFilter(TenancyContextFilter.java:54)

  at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342)

  at org.springframework.security.web.context.request.async.WebAsyncManagerIntegrationFilter.doFilterInternal(WebAsyncManagerIntegrationFilter.java:50)

  at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:108)

  at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342)

  at org.springframework.security.web.context.SecurityContextPersistenceFilter.doFilter(SecurityContextPersistenceFilter.java:87)

  at org.springframework.security.web.FilterChainProxy$VirtualFilterChain.doFilter(FilterChainProxy.java:342)

  at org.springframework.security.web.FilterChainProxy.doFilterInternal(FilterChainProxy.java:192)

  at org.springframework.security.web.FilterChainProxy.doFilter(FilterChainProxy.java:160)

  at org.springframework.web.filter.DelegatingFilterProxy.invokeDelegate(DelegatingFilterProxy.java:344)

  at org.springframework.web.filter.DelegatingFilterProxy.doFilter(DelegatingFilterProxy.java:261)

  at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:243)

  at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:210)

  at org.springframework.web.filter.CharacterEncodingFilter.doFilterInternal(CharacterEncodingFilter.java:88)

  at org.springframework.web.filter.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:108)

  at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:243)

  at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:210)

  at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:222)

  at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:123)

  at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:502)

  at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:171)

  at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:100)

  at org.apache.catalina.valves.AccessLogValve.invoke(AccessLogValve.java:953)

  at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:118)

  at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:408)

  at org.apache.coyote.ajp.AjpProcessor.process(AjpProcessor.java:200)

  at org.apache.coyote.AbstractProtocol$AbstractConnectionHandler.process(AbstractProtocol.java:603)

  at org.apache.tomcat.util.net.JIoEndpoint$SocketProcessor.run(JIoEndpoint.java:310)

  at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)

  at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)

  at java.lang.Thread.run(Thread.java:745)

[BryanHalter]

Is there anything in the logs for the IaaS web API?

The logs are in C:\Program Files (x86)\VMware\vCAC\Web API\Logs on the web server machine for the IaaS components

[CKloseFUM]

Thanks Bryan,

but this location is empty. This folder exists but there are no files in it.

[CKloseFUM]

i also checked the Update/Installation Log for errors In C:\Program Files (x86)\VMware\vCAC\InstallLogs\Server-Setup.log

Last entry before reboot

MSI (s) (E8:4C) [12:40:17:717]: Product: VMware vCloud Automation Center Server -- Configuration completed successfully.

MSI (s) (E8:4C) [12:40:17:717]: Windows Installer reconfigured the product. Product Name: VMware vCloud Automation Center Server. Product Version: 6.1.0.1200. Product Language: 1033. Manufacturer: VMware, Inc.. Reconfiguration success or error status: 0.

[CKloseFUM]

In the vCACSuiteInstaller.log the last entry pointed to the vSphere agent update which failed.

After that failure we restarted the IaaS component and checked the Agent which was updated and running.

Login to the tenant was also possible. Maybe there were any further steps in the setup which have been interrupted by this error?

[10/09/2014 12:53:59 PM]System.ArgumentException: Service name VMware vCloud Automation Center Agent - Vmware vcloud Automation Center Agent –VsphereAgent- madcldvc01 contains invalid characters, is empty, or is too long (max length = 80).

   at System.ServiceProcess.ServiceControllerPermissionEntry..ctor(ServiceControllerPermissionAccess permissionAccess, String machineName, String serviceName)

   at System.ServiceProcess.ServiceController.GenerateStatus()

   at System.ServiceProcess.ServiceController.get_Status()

   at DynamicOps.Setup.Helper.WindowsServiceHelpers.StopWindowsService(String svcName, Double timeoutSeconds, VcacLogger logger, MessageEventHandler messagehandler)

   at DynamicOps.Setup.Helper.WindowsServiceHelpers.RestartWindowsService(String serviceName, Double timeoutSeconds, VcacLogger logger, MessageEventHandler messageHandler)

   at VcacSuiteInstaller.VcacSuiteConfigMainForm.UpgradeAgents(String userName, String password, Int32 progressStep, Boolean simulateInstall)

   at VcacSuiteInstaller.VcacSuiteConfigMainForm.<UpgradeVcacComponents>d__31.MoveNext()

[10/09/2014 12:53:59 PM]Installation failed. For more information, see log file.

[admin]

my guess would be that this service failed before the web api service could be updated, i'd guess if you went to localhost/WAPI you'd see that it's still running version 6.0.

off the top of my head i'm not sure how'd you'd run the remaining upgrade components

[vgk99]

Hi,

I am facing same issue even. The vCAC 6.1 is all setup with no errors during setup or configuration. But while requesting a machine from catalog its giving a same error as above and same logs inside catalina.out. Please help me out as this is really difficult to diagnose and find root cause of issue. I am guessing this is something bug ib new version of vCAC 6.1 as I have not seen such issues in earlier version of vCAC 6.0

[Filin_K]

Hi!

Can you describe test and prod enviroment? Do you replace self signed cert in test and prod enviroment?

What status of all 21 services at vCAC Appliance after upgrade?

Kirill

[BryanHalter]

Engaging with GSS on troubleshooting this part of the upgrade will provide the best assurance of follow through to completion. 

[vgk99]

Hi Sui and BryanHalter,

Thanks for the reply. This is test environment and I am not doing upgrade from vCAC 6.0 to 6.1. This setup is completely new that I am doing with vCAC 6.1. Tried doing setup thrice with this release of vCAC but every time receiving same error. I have replaced self signed certificates on Identity and vCAC appliance. Please note, I have not received a single error during installation and configuration of vCAC and its components.

Thanks.

[Filin_K]

When you replace self-signed certs, do you import data from PEM file? (while imprort cert to certificate chain box?)

If yes - this is your problem (look like import data from pem file doesn't work in 6.1).

Yes, its work in 6.0.2.

So, what you need.

The Certificate Chain key needs to be in the format of the image below: first paste in the contents of .cer, then the contents of any Base64 encoded intermediate and finally the Root CA, again in Base64. Make sure there’s no whitespace in between.

---Begin cert---

Leaf Cert

---End Cert---

---Begin cert---

Issuing CA cert

---End Cert---

---Begin cert---

Root CA Cert

---End Cert---

So, you must replace certs again on both ide and vcac app.

Kirill

[vgk99]

I have not used "Import PEM encoded Certificate option". I have generated self signed certificates using "Generate Self Signed Certificate" option. on both the appliances Identity and vCAC.

[Filin_K]

What is the status of all 22 services in vcac app? All registered?

If you replace self-signed cert on identity app, you need reconnect (accept new cert) vCAC app to identity app again.

vCAC app starting (time to start of all services) aprox 10 minutes.

[vgk99]

I can see in vCAC appliance that 21 services are registered whereas the status of  'iaas-service' is blank mean there is nothing in status column in front of the service.

[Filin_K]

Looks like all good and you can istall iaas server.

Try to logon https://vcac_fqdn/shell-ui-app/

[vgk99]

But iaas server installation and configuration was successful and it didn't give any error in log. I have tried complete setup thrice and wondering what I am missing and if missing anything then it should be tracked in logs Or installation should fail.

I am able to logon to https://vcac_fqdn/shell-ui-app/ with default administrator credentials.

[Filin_K]

Do you have any erros in logs - Infrastructure - > Monitoring - > Log (by tenant administrator)?

And if you replace self-signed cert on vcac and ide appl, you must update cert on iass server.

vCloud Automation Center Documentation Center

[vgk99]

No logs at - Infrastructure - > Monitoring - > Log. Catalina.out from vCAC appliance giving error "[Rest Error]: {Status code: 400}, {Error code: 50505} , {Error Source: null}, {Error Msg: java.lang.IllegalStateException: Expected BEGIN_OBJECT but was STRING}, {System Msg: Infrastructure service provider error}"

Even there is no log inside WEB API folder on iaas server.

[Filin_K]

Logs must exist. For example, events from DEM-Worker, DEM-Orchestrator, VRM-agent and information events.

How you prepare server for IAAS? Do you use official scripts? VCAC 6.1 Pre-req Automation Script Released! | VMware PowerCLI Blog - VMware Blogs

[vgk99]

I mean no error logs at - Infrastructure - > Monitoring. Got iaas installer from Iaas install tab on vCAC appliance, ran that installer , completed all the per-requisites and proceeded the installation. Not used official pre-req scripts but fulfilled all the per-requisites that were shown during installation by installer.