Create host profile failed because vpxd services terminated unexpected

[Alexei_Zhang]

Hi Experts,

I met a problem recently with vCenter host profile. When I was creating the host profile, the vpxd services was terminated unexpected. Appreciate any suggestion for this question. thx

My vCenter version is 5.1.0, 947673 and license is vCenter Server 5 Standard.

My vSphere version is 5.1.0, 1065491 and license is VMware vSphere 5 Enterprise Plus.

thx

Alexei

[virtualdive]

Hi Alexei,

Is it happening every time you create a host profile or it just happened once?

[Alexei_Zhang]

Hi Expert,

It happens every time I create a host profile.

thx

Alexei

[virtualdive]

Sure, please can you post the vpxd logs to have a look,

By the time you are posting the logs, not sure if you tried restarting the vCenter server?

Thanks,

[Alexei_Zhang]

Here is the vpxd logs.

I have already tried to restart the vCenter server, the problem still exsits. thx

Thx

Alexei

[virtualdive]

So as far as I understood, whenever you try to create the Host Profiles the vSphere client disconnects because vpxd is terminated, and then you have to manually start the vCenter service (vpxd) to get vCenter back to working state? Is this correct?

The logs seems to be vi-client logs, did you change the name or something? Are these vpxd logs available at: C:\ProgramData\VMware\VMware VirtualCenter\Logs\ ?

Thanks,

[Alexei_Zhang]

Your description is very exact. Sorry, I update the vpxd log again. thx

Alexei

[virtualdive]

Hi Alexei,

Are you trying to create Hot Profile using the host: apzbjgesx001.apz.mccormick.com. Do you see anything wrong with this host?

____________________________________________________________________________________________________________

2014-04-14T18:14:06.512+10:00 [04584 info 'vpxdvpxdInvtHostCnx' opID=HB-host-245@56923-12ef75c4] [VpxdHostSync] Retrieved host update to 56923 for host-245

2014-04-14T18:14:06.527+10:00 [04584 info 'vpxdvpxdInvtHostDb' opID=HB-host-245@56923-12ef75c4] [VpxdInvtHost::SaveFieldsToDb] IPMI info of host apzgzpesx001.apz.mccormick.com is not set

2014-04-14T18:14:06.527+10:00 [04584 info 'vpxdvpxdInvtHostCnx' opID=HB-host-245@56923-12ef75c4] [VpxdHostSync] Completed host synchronization for host-245

2014-04-14T18:14:06.527+10:00 [04584 warning 'VpxProfiler' opID=HB-host-245@56923-12ef75c4] [VpxdHostSync] DoHostSync:0000000009D2DCB0 [DoHostSyncTime] took 2372 ms

2014-04-14T18:14:06.527+10:00 [04584 warning 'VpxProfiler' opID=HB-host-245@56923-12ef75c4] InvtHostSyncLRO::StartWork [HostSyncTime] took 2372 ms

2014-04-14T18:14:06.527+10:00 [04584 info 'commonvpxLro' opID=HB-host-245@56923-12ef75c4] [VpxLRO] -- FINISH task-internal-1338 -- host-245 -- VpxdInvtHostSyncHostLRO.Synchronize --

2014-04-14T18:14:06.543+10:00 [06224 error 'vpxdvpxdHostAccess'] [VpxdHostAccess] Failed to connect to apzbjgesx001.apz.mccormick.com:902: A connection attempt failed because the connected party did not properly respond after a period of time, or established connection failed because connected host has failed to respond.

2014-04-14T18:14:06.543+10:00 [06224 error 'vpxdvpxdInvtHostCnx'] [VpxdInvtHost::FixNotRespondingHost] Failed to determine vpxd's IP from perspective of host host-673 (apzbjgesx001.apz.mccormick.com): A connection attempt failed because the connected party did not properly respond after a period of time, or established connection failed because connected host has failed to respond.

--> Backtrace: backtrace[00] rip 000000018018a8ca

--> backtrace[01] rip 0000000180102f28

--> backtrace[02] rip 000000018010423e

--> backtrace[03] rip 000000018008e00b

--> backtrace[04] rip 0000000180189de3

--> backtrace[05] rip 00000001801a5b5f

--> backtrace[06] rip 00000001801ad2dd

--> backtrace[07] rip 000000018019c72a

--> backtrace[08] rip 0000000073f02fdf

--> backtrace[09] rip 0000000073f03080

--> backtrace[10] rip 0000000076cc652d

--> backtrace[11] rip 0000000076dfc541

-->

2014-04-14T18:14:06.543+10:00 [06224 warning 'vpxdvpxdInvtHostCnx'] [VpxdInvtHostSyncHostLRO] Failed to fix not responding host host-673

2014-04-14T18:14:06.543+10:00 [06224 warning 'vpxdvpxdInvtHostCnx'] [VpxdInvtHostSyncHostLRO] Connection not alive for host host-673

2014-04-14T18:14:06.543+10:00 [06224 error 'vpxdvpxdInvtHostCnx'] [VpxdInvtHostSyncHostLRO] FixNotRespondingHost failed for host host-673, marking host as notResponding

2014-04-14T18:14:06.543+10:00 [06224 warning 'vpxdvpxdMoHost'] [HostMo] host connection state changed to [NO_RESPONSE] for host-673

_______________________________________________________________________________________________________________________________________

[Alexei_Zhang]

The apzbjgesx001.apz.mccormick.com is not responding because self resion reason, but I was not create host profile from this host. Now I removed this server from vCenter, then did this action again, and upload the log again. Please help me to check it again. thx

Alexei

[DanielOprea]

Hi,

Please check the ODBC for SQL:

VpxProfiler' opID=205F81FC-00000068-99] ClientAdapterBase::InvokeOnSoap: (cnshpesx002.apz.mccormick.com, vim.profile.host.profileEngine.ComplianceManager.getDefaultCompliance) [SoapRpcTime] took 10671 ms

mem> 2014-04-14T19:51:21.430+10:00 [06468 info 'vpxdvpxdVmomi' opID=205F81FC-00000068-99] [ClientAdapterBase::InvokeOnSoap] Invoke done (cnshpesx002.apz.mccormick.com, vim.profile.host.profileEngine.ComplianceManager.getDefaultCompliance)

mem> 2014-04-14T19:51:21.430+10:00 [06468 verbose 'PropertyProvider' opID=205F81FC-00000068-99] RecordOp ASSIGN: name, hostprofile-2301

mem> 2014-04-14T19:51:21.430+10:00 [06468 verbose 'Default' opID=205F81FC-00000068-99] [VdbSchemaLoader::LookupSchema] Found schema/index information for: VPX_PROFILE

mem> 2014-04-14T19:51:21.445+10:00 [06468 warning 'Default' opID=205F81FC-00000068-99] [VdbStatement] SQL execution failed: insert into VPX_TABLE (TABLE_NAME, COL_NAME, COL_TYPE, COL_LEN, PK_FLG) values (?, ?, ?, ?, ?)

mem> 2014-04-14T19:51:21.445+10:00 [06468 warning 'Default' opID=205F81FC-00000068-99] [VdbStatement] Execution elapsed time: 0 ms

mem> 2014-04-14T19:51:21.445+10:00 [06468 warning 'Default' opID=205F81FC-00000068-99] [VdbStatement] Diagnostic data from driver is 07002:1:0:[Microsoft][SQL Server Native Client 10.0]COUNT field incorrect or syntax error

mem> 2014-04-14T19:51:21.445+10:00 [06468 warning 'Default' opID=205F81FC-00000068-99] [VdbStatement] Bind parameters:

mem> 2014-04-14T19:51:21.445+10:00 [06468 error 'Default' opID=205F81FC-00000068-99] [Vdb::IsRecoverableErrorCode] Unable to recover from 07002:0

mem> 2014-04-14T19:51:21.445+10:00 [06468 error 'Default' opID=205F81FC-00000068-99] [VdbStatement] SQLError was thrown: "ODBC error: (07002) - [Microsoft][SQL Server Native Client 10.0]COUNT field incorrect or syntax error" is returned when executing SQL statement "insert into VPX_TABLE (TABLE_NAME, COL_NAME, COL_TYPE, COL_LEN, PK_FLG) values (?, ?, ?, ?, ?)"

mem> 2014-04-14T19:51:21.461+10:00 [06468 error 'Default' opID=205F81FC-00000068-99] [VdbSchemaLoader::StoreTableSchemaInfoToDB] Error inserting into VPX_TABLE for table VPX_PROFILE: "ODBC error: (07002) - [Microsoft][SQL Server Native Client 10.0]COUNT field incorrect or syntax error" is returned when executing SQL statement "insert into VPX_TABLE (TABLE_NAME, COL_NAME, COL_TYPE, COL_LEN, PK_FLG) values (?, ?, ?, ?, ?)"

mem> 2014-04-14T19:51:21.461+10:00 [06468 error 'Default' opID=205F81FC-00000068-99] [VdbTableDef::PopulateSchemaInfo] Failed to retrieve column information for table VPX_PROFILE. Usually this is the result of a mismatch between the DB schema and the product/build.

mem> 2014-04-14T19:51:51.741+10:00 [06468 panic 'Default' opID=205F81FC-00000068-99] (Log recursion level 2) [VdbTableDef::PopulateSchemaInfo] Exiting. Unable to retrieve schema information.

------ In-memory logs end   --------

2014-04-14T19:51:51.741+10:00 [06468 panic 'Default' opID=205F81FC-00000068-99] Section for VMware VirtualCenter, pid=6120, version=5.1.0, build=947673, option=Release

-->

2014-04-14T19:51:51.756+10:00 [06468 info 'vpxdvpxdSupportManager' opID=205F81FC-00000068-99] Wrote uptime information

Please check the configuration the server NTP in ESXi

VMware KB: All ESX hosts simultaneously show a status of Not Responding in vCenter Server

[Alexei_Zhang]

You mean this problem causes by the NTP setting?

I check the NTP setting, and I sure the NTP setting is correct. But begin your reply, you metion the odbc problem, should I check what for the odbc? I sure I can connect the database successful by odbc.

thx

alexei

[DanielOprea]

Hi,

If the NTP is misconfigured you too can fail. If you look at the log, there are errors odbc tables in the DB. Please check the DB and the ODBC configuration

And look at you the diagnostic link connectivity.

VMware KB: Diagnosing an ESXi/ESX host that is disconnected or not responding in VMware vCenter Serv...

[DanielOprea]

Hello,

VC has updated to version 5.1?

Since when you have this problem?

Do the following:

1 - Enabling show hidden files and system files

2 -Enter in this path: C: \ Windows \ System32 \ config \ systemprofile \ AppData \ Local \ crashdumps

Tellme if there is a dump file inside.

If not, create one of the process vpxd (WHEN FAILURE) and upload.

To create the dump takes the following steps: