vCD 9.7 / The requested operation on VM "CentOS-7.6.1810" is not supported since the VM is in an inconsistent state.

[SebastianGrugel]

Im System Administrator.

This issue related to template which we are using in catalog.

This worked few days ago before upgradeed from vCD 9.5.0.3 to 9.7.

Maybe not related but...

VM (template) is OFF in vSphere Client

Sebastian

[sk84]

What's in the logs (/opt/vmware/vmware/vcloud-director/logs/vcloud-container-debug.log) when you search for the request ID f6688eb..... ?  There must be several events corresponding to this request ID, and usually you will find detailed information or a Java stack trace between these events.

[SebastianGrugel]

i FOUND SOMETHING... but this is not clear for me...

i replaced some domain information and IP special for this post...

[root@VCD~]# cat /opt/vmware/vcloud-director/logs/vcloud-container-debug.log | grep 2de09646-f0cd-4bf7-a70d-42d32c337feb

2019-04-12 14:14:26,245 | DEBUG    | pool-jetty-66             | CSecurityManager               | Building security context for user [loginUserId = 2fd8ec4a-b2c8-4069-8715-4de2160f7b39, operatingOrgId = a93c9db9-7471-3192-8d09-a8f7eeda85f9, isSystemAdministrator = true, canSwitchOrgContext= true] | requestId=2de09646-f0cd-4bf7-a70d-42d32c337feb,request=POST https://vCD-DOMAIN/api/vdc/cc8ee2e4-6e26-4f39-b9ca-cc1f62c82e1f/action/instantiateVmFromTemplate,req... (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 ...,accept=application/*+xml;version 32.0

2019-04-12 14:14:26,257 | DEBUG    | pool-jetty-66             | CSecurityManager               | Building security context for user [loginUserId = 2fd8ec4a-b2c8-4069-8715-4de2160f7b39, operatingOrgId = e82cc056-7949-4b90-b973-8c696104a812, isSystemAdministrator = true, canSwitchOrgContext= true] | requestId=2de09646-f0cd-4bf7-a70d-42d32c337feb,request=POST https://vCD-DOMAIN/api/vdc/cc8ee2e4-6e26-4f39-b9ca-cc1f62c82e1f/action/instantiateVmFromTemplate,req... (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 ...,accept=application/*+xml;version 32.0

2019-04-12 14:14:26,258 | DEBUG    | pool-jetty-66             | CSecurityManager               | Impersonating admin [2fd8ec4a-b2c8-4069-8715-4de2160f7b39] to a hidden system user [f1f8cf19-ad56-4393-abfb-c7bd650dcf77] in an org [e82cc056-7949-4b90-b973-8c696104a812] | requestId=2de09646-f0cd-4bf7-a70d-42d32c337feb,request=POST https://vCD-DOMAIN/api/vdc/cc8ee2e4-6e26-4f39-b9ca-cc1f62c82e1f/action/instantiateVmFromTemplate,req... (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 ...,accept=application/*+xml;version 32.0

2019-04-12 14:14:26,316 | DEBUG    | pool-jetty-66             | OrgSwitchInterceptor           | Switching from org e82cc056-7949-4b90-b973-8c696104a812 to org 90f3ccca-ad6a-4980-8d3c-f33140191d63 | requestId=2de09646-f0cd-4bf7-a70d-42d32c337feb,request=POST https://vCD-DOMAIN/api/vdc/cc8ee2e4-6e26-4f39-b9ca-cc1f62c82e1f/action/instantiateVmFromTemplate,req... (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 ...,accept=application/*+xml;version 32.0

2019-04-12 14:14:26,317 | DEBUG    | pool-jetty-66             | CSecurityManager               | Building security context for user [loginUserId = 2fd8ec4a-b2c8-4069-8715-4de2160f7b39, operatingOrgId = 90f3ccca-ad6a-4980-8d3c-f33140191d63, isSystemAdministrator = true, canSwitchOrgContext= true] | requestId=2de09646-f0cd-4bf7-a70d-42d32c337feb,request=POST https://vCD-DOMAIN/api/vdc/cc8ee2e4-6e26-4f39-b9ca-cc1f62c82e1f/action/instantiateVmFromTemplate,req... (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 ...,accept=application/*+xml;version 32.0

2019-04-12 14:14:26,317 | DEBUG    | pool-jetty-66             | CSecurityManager               | Impersonating admin [2fd8ec4a-b2c8-4069-8715-4de2160f7b39] to a hidden system user [3cfe72c5-ba4f-4ecb-9ffb-fa975b5e5c05] in an org [90f3ccca-ad6a-4980-8d3c-f33140191d63] | requestId=2de09646-f0cd-4bf7-a70d-42d32c337feb,request=POST https://vCD-DOMAIN/api/vdc/cc8ee2e4-6e26-4f39-b9ca-cc1f62c82e1f/action/instantiateVmFromTemplate,req... (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 ...,accept=application/*+xml;version 32.0

2019-04-12 14:14:26,614 | DEBUG    | pool-jetty-66             | OrgSwitchInterceptor           | Switching from org 90f3ccca-ad6a-4980-8d3c-f33140191d63 to org e82cc056-7949-4b90-b973-8c696104a812 | requestId=2de09646-f0cd-4bf7-a70d-42d32c337feb,request=POST https://vCD-DOMAIN/api/vdc/cc8ee2e4-6e26-4f39-b9ca-cc1f62c82e1f/action/instantiateVmFromTemplate,req... (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 ...,accept=application/*+xml;version 32.0

2019-04-12 14:14:26,614 | DEBUG    | pool-jetty-66             | CSecurityManager               | Building security context for user [loginUserId = 2fd8ec4a-b2c8-4069-8715-4de2160f7b39, operatingOrgId = e82cc056-7949-4b90-b973-8c696104a812, isSystemAdministrator = true, canSwitchOrgContext= true] | requestId=2de09646-f0cd-4bf7-a70d-42d32c337feb,request=POST https://vCD-DOMAIN/api/vdc/cc8ee2e4-6e26-4f39-b9ca-cc1f62c82e1f/action/instantiateVmFromTemplate,req... (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 ...,accept=application/*+xml;version 32.0

2019-04-12 14:14:26,615 | DEBUG    | pool-jetty-66             | CSecurityManager               | Impersonating admin [2fd8ec4a-b2c8-4069-8715-4de2160f7b39] to a hidden system user [f1f8cf19-ad56-4393-abfb-c7bd650dcf77] in an org [e82cc056-7949-4b90-b973-8c696104a812] | requestId=2de09646-f0cd-4bf7-a70d-42d32c337feb,request=POST https://vCD-DOMAIN/api/vdc/cc8ee2e4-6e26-4f39-b9ca-cc1f62c82e1f/action/instantiateVmFromTemplate,req... (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 ...,accept=application/*+xml;version 32.0

2019-04-12 14:14:26,642 | DEBUG    | pool-jetty-66             | NetworkFabricExtensionUtils    | Extension not found for phase CREATE_TRANSPORT_ZONE | requestId=2de09646-f0cd-4bf7-a70d-42d32c337feb,request=POST https://vCD-DOMAIN/api/vdc/cc8ee2e4-6e26-4f39-b9ca-cc1f62c82e1f/action/instantiateVmFromTemplate,req... (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 ...,accept=application/*+xml;version 32.0

2019-04-12 14:14:26,652 | DEBUG    | pool-jetty-66             | NetworkFabricExtensionUtils    | Extension not found for phase CREATE_TRANSPORT_ZONE | requestId=2de09646-f0cd-4bf7-a70d-42d32c337feb,request=POST https://vCD-DOMAIN/api/vdc/cc8ee2e4-6e26-4f39-b9ca-cc1f62c82e1f/action/instantiateVmFromTemplate,req... (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 ...,accept=application/*+xml;version 32.0

2019-04-12 14:14:26,702 | INFO     | pool-jetty-66             | Conversation                   | Transaction rolled back; session has been closed [Conversation: 05fcb6af-a63e-44c3-9909-f440bcbe071e, transaction null, transactionDepth: 0] | requestId=2de09646-f0cd-4bf7-a70d-42d32c337feb,request=POST https://vCD-DOMAIN/api/vdc/cc8ee2e4-6e26-4f39-b9ca-cc1f62c82e1f/action/instantiateVmFromTemplate,req... (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 ...,accept=application/*+xml;version 32.0

2019-04-12 14:14:26,702 | DEBUG    | pool-jetty-66             | AbstractEventBuilder           | Pre-update source object was null when constructing com/vmware/vcloud/event/vapp/create_request | requestId=2de09646-f0cd-4bf7-a70d-42d32c337feb,request=POST https://vCD-DOMAIN/api/vdc/cc8ee2e4-6e26-4f39-b9ca-cc1f62c82e1f/action/instantiateVmFromTemplate,req... (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 ...,accept=application/*+xml;version 32.0

2019-04-12 14:14:26,702 | DEBUG    | pool-jetty-66             | AbstractEventBuilder           | Source object was null when constructing com/vmware/vcloud/event/vapp/create_request | requestId=2de09646-f0cd-4bf7-a70d-42d32c337feb,request=POST https://vCD-DOMAIN/api/vdc/cc8ee2e4-6e26-4f39-b9ca-cc1f62c82e1f/action/instantiateVmFromTemplate,req... (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 ...,accept=application/*+xml;version 32.0

2019-04-12 14:14:26,721 | DEBUG    | pool-jetty-66             | RestApiVersionSupportFilter    | Filtering object of type com.vmware.vcloud.api.rest.schema_v1_5.ErrorType | requestId=2de09646-f0cd-4bf7-a70d-42d32c337feb,request=POST https://vCD-DOMAIN/api/vdc/cc8ee2e4-6e26-4f39-b9ca-cc1f62c82e1f/action/instantiateVmFromTemplate,req... (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 ...,accept=application/*+xml;version 32.0

Sebastian

[sk84]

2019-04-12 14:14:26,652 | DEBUG    | pool-jetty-66             | NetworkFabricExtensionUtils    | Extension not found for phase CREATE_TRANSPORT_ZONE | requestId=2de09646-f0cd-4bf7-a70d-42d32c337feb,request=POST https://vCD-DOMAIN/api/vdc/cc8ee2e4-6e26-4f39-b9ca-cc1f62c82e1f/action/instantiateVmFromTemplate,req... (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 ...,accept=application/*+xml;version 32.0

It seems there is something wrong with the NSX integration.

But go inside the log and look at the messages between this error message and "Transaction rolled back". Not all related events are marked with the request ID, so with the use of "grep" you will miss important error messages, details and java stack traces.

[SebastianGrugel]

OK i will try check logs.

Strange because this is related only to some specific VM template.

Sebastian