VCenter -I did something stupid and need help

[athemiya1]

Hi all,

I was going through the stages of replacing my SSL certificates on VCenter server, and got into a muddle and ended up running this command:

vpxd -p (in directory VMware\Infrastructure\VirtualCenter Server. Windows 2008 R2 with VCenter 5)

On the VCenter server! Needless to say, I changed the password of the VCenter database and now services:

VMware VirtualCenter Server and VirtualCenter Management Webservices

Will no longer start!

Can anyone kindly tell me how I can amend the VCenter database password so that I can get these services running again? No VCenter until I get it up and running!

Forever in all your debt....

Best,

Hesan

[memaad]

Hi,

Is it vCenter 5.1 or 5.0. Would like to see what is going on vpxd.log when service fails. Can you put latest vpxd.log file content here.

Also have you change password or same password you have update with new certificate.

Regards

Mohammed

[athemiya1]

Hi Mohammed,

Thanks for a reply, the log is as follows:

Section for VMware VirtualCenter, pid=3300, version=5.0.0, build=build-804277, option=Release

------ In-memory logs start --------

2013-01-14T18:28:30.696Z [04052 info 'Hooks'] Hooks Initialized

------ In-memory logs end   --------

2013-01-14T18:28:30.727Z [04052 info 'Default'] Initialized channel manager

2013-01-14T18:28:30.727Z [04052 info 'Default'] Current working directory: C:\Windows\system32

2013-01-14T18:28:30.759Z [04052 info 'Default'] Log path: C:\ProgramData\VMware\VMware VirtualCenter\Logs

2013-01-14T18:28:30.759Z [04052 info 'Default'] Initializing SSL

2013-01-14T18:28:31.851Z [04052 info 'Default'] Vmacore::InitSSL: doVersionCheck = true, handshakeTimeoutUs = 120000000

2013-01-14T18:28:31.882Z [04052 info 'Default'] Starting VMware VirtualCenter 5.0.0 build-804277

2013-01-14T18:28:31.882Z [04052 info 'Default'] Log directory: C:\ProgramData\VMware\VMware VirtualCenter\Logs.

2013-01-14T18:28:31.882Z [04052 info 'Default'] Account name: SYSTEM

2013-01-14T18:28:31.882Z [04052 info 'Default'] Total virtual memory available for the process 8589934464 KB

2013-01-14T18:28:31.882Z [04052 info 'Default'] [VpxOsLayer] Enabled low-frag process heap.

-->

2013-01-14T18:28:31.882Z [04052 info 'Default'] [VpxOsLayer] Enabled low-frag crt heap.

-->

2013-01-14T18:28:31.882Z [04052 info 'Default'] [Vpxd::ServerApp::Init:835] Calling: InfoDeclSchema(gDB)

2013-01-14T18:28:31.882Z [04052 info 'Default'] [Vpxd::ServerApp::Init:837] Calling: VpxCallbackDesc::Init(MakeFunctor(this, &ServerApp::RequestShutdown))

2013-01-14T18:28:31.882Z [04052 info 'Default'] [Vpxd::ServerApp::Init:838] Calling: VpxCryptInit()

2013-01-14T18:28:31.882Z [04052 info 'Default'] [Vpxd::ServerApp::Init:839] Calling: VpxLRO::Init()

2013-01-14T18:28:31.882Z [04052 info 'Default'] [Vpxd::ServerApp::Init:840] Calling: VpxLroList::Init(ltud)

2013-01-14T18:28:31.882Z [04052 info 'Default'] [VpxLRO] 640 max LROs

2013-01-14T18:28:31.882Z [04052 info 'Default'] [VpxLRO] 12 reserved internal LROs

2013-01-14T18:28:31.882Z [04052 info 'Default'] [VpxLRO] 12 reserved blocker LROs

2013-01-14T18:28:31.882Z [04052 info 'Default'] [VpxLRO] 12 reserved short LROs

2013-01-14T18:28:31.882Z [04052 info 'Default'] [VpxLRO] 8 reserved long LROs

2013-01-14T18:28:31.882Z [04052 info 'Default'] [VpxLRO] 600-second completed task lifetime

2013-01-14T18:28:31.882Z [04052 info 'Default'] [VpxLRO] 60-second minimum completed task lifetime

2013-01-14T18:28:31.882Z [04052 info 'Default'] [VpxLRO] 200 maximum completed tasks

2013-01-14T18:28:31.882Z [04052 info 'Default'] [VpxLRO] 600-second unregistered task lifetime

2013-01-14T18:28:31.882Z [04052 info 'Default'] [Vpxd::ServerApp::Init:841] Calling: VpxdCharacterizeThreadpool(ltud)

2013-01-14T18:28:31.882Z [04052 info 'Default'] [Vpxd::ServerApp::Init:842] Calling: VpxdCertificate_Load(gDB, CERTIFICATE_VMDBPATH )

2013-01-14T18:28:31.882Z [04052 info 'Default'] [Vpxd::ServerApp::Init:843] Calling: VpxdVdb::Init(VpxdVdb::GetVcVdbInstId(), false, false, NULL)

2013-01-14T18:28:31.882Z [04052 info 'Default'] Registry Item DB 5 value is '50'

2013-01-14T18:28:31.882Z [04052 info 'Default'] [VpxdVdb::SetDBType] Logging in to DSN: VMware vCenter with username

2013-01-14T18:28:31.898Z [04052 error 'Default'] [VpxKey::Decrypt] crypto failure: error:00000000:lib(0):func(0):reason(0)

2013-01-14T18:28:31.898Z [04052 error 'Default'] [VpxdCert] Failed to decrypt password: applying key to encrypted data failed (likely the wrong key)

2013-01-14T18:28:31.898Z [04052 error 'Default'] [VpxdVdb::SetDBType]: Database error: ODBC error: () -

2013-01-14T18:28:31.898Z [04052 error 'Default'] Error getting configuration info from the database

2013-01-14T18:28:31.898Z [04052 error 'Default'] [Vpxd::ServerApp::Init] Init failed: VpxdVdb::Init(VpxdVdb::GetVcVdbInstId(), false, false, NULL)

2013-01-14T18:28:31.898Z [04052 error 'Default'] Failed to intialize VMware VirtualCenter. Shutting down...

2013-01-14T18:28:31.898Z [04052 info 'Default'] Wrote uptime information

2013-01-14T18:28:31.898Z [04052 error 'Default'] Alert:false@ d:/build/ob/bora-804277/bora/vpx/vpxd/util/vpxdVdb.cpp:408

--> Backtrace:

--> backtrace[00] rip 000000018013deba (no symbol)

--> backtrace[01] rip 0000000180101518 (no symbol)

--> backtrace[02] rip 0000000180101a5e (no symbol)

--> backtrace[03] rip 000000018009684a (no symbol)

--> backtrace[04] rip 000000013f548603 (no symbol)

--> backtrace[05] rip 000000013fe91e3e (no symbol)

--> backtrace[06] rip 000000013fe92023 (no symbol)

--> backtrace[07] rip 00000001400b2177 (no symbol)

--> backtrace[08] rip 000007fefdc2a82d (no symbol)

--> backtrace[09] rip 00000000777f652d (no symbol)

--> backtrace[10] rip 000000007792c521 (no symbol)

-->

2013-01-14T18:28:31.898Z [04052 info 'Default'] Registry Item DB 5 value is '50'

2013-01-14T18:28:31.898Z [04052 info 'Default'] [VpxdVdb::SetDBType] Logging in to DSN: VMware vCenter with username

2013-01-14T18:28:31.913Z [04052 error 'Default'] [VpxKey::Decrypt] crypto failure: error:00000000:lib(0):func(0):reason(0)

2013-01-14T18:28:31.913Z [04052 error 'Default'] [VpxdCert] Failed to decrypt password: applying key to encrypted data failed (likely the wrong key)

2013-01-14T18:28:31.913Z [04052 error 'Default'] [VpxdVdb::SetDBType]: Database error: ODBC error: () -

2013-01-14T18:28:31.913Z [04052 error 'Default'] Error getting configuration info from the database

2013-01-14T18:28:31.913Z [04052 warning 'Default'] [VpxUnhandledException] Win32 Exception (0xe06d7363) detected at 7FEFDA0A49D

-->

2013-01-14T18:28:31.913Z [04052 warning 'Default']    rip: 0x000000fda0a49d rsp: 0x00000004aaf4e0 rbp: 0x0000000381bba0

-->

2013-01-14T18:28:31.913Z [04052 warning 'Default']    rax: 0x000000735719e4 rbx: 0x00000004aaf6a0 rcx: 0x00000004aaeed0

-->    rdx: 0x000000000000d0 rdi: 0x00000042470850 rsi: 0x0000000378e6c0

-->    r8:  0000000000000000 r9:  0000000000000000 r10: 0x0000003f2d0000

-->    r11: 0x00000004aaf520 r12: 0x0000000378e6c0 r13: 0x00000004aaf770

-->    r14: 0000000000000000 r15: 0000000000000000

-->

2013-01-14T18:28:31.913Z [04052 warning 'Default'] [VpxUnhandledException] Backtrace

--> backtrace[00] rip 000000018013deba (no symbol)

--> backtrace[01] rip 0000000180101518 (no symbol)

--> backtrace[02] rip 0000000180101a5e (no symbol)

--> backtrace[03] rip 00000001400c52cf (no symbol)

--> backtrace[04] rip 0000000077879490 (no symbol)

--> backtrace[05] rip 00000000779943b8 (no symbol)

--> backtrace[06] rip 00000000779185a8 (no symbol)

--> backtrace[07] rip 0000000077929d0d (no symbol)

--> backtrace[08] rip 00000000779191af (no symbol)

--> backtrace[09] rip 00000000779197a8 (no symbol)

--> backtrace[10] rip 000007fefda0a49d (no symbol)

--> backtrace[11] rip 0000000074f154ca (no symbol)

--> backtrace[12] rip 000000013f54863d (no symbol)

--> backtrace[13] rip 000000013fe91e3e (no symbol)

--> backtrace[14] rip 000000013fe92023 (no symbol)

--> backtrace[15] rip 00000001400b2177 (no symbol)

--> backtrace[16] rip 000007fefdc2a82d (no symbol)

--> backtrace[17] rip 00000000777f652d (no symbol)

--> backtrace[18] rip 000000007792c521 (no symbol)

-->

2013-01-14T18:28:31.913Z [04052 warning 'Default'] [VpxUnhandledException] Generating minidump ...

2013-01-14T18:28:39.901Z [04052 info 'Default'] CoreDump: Writing minidump

2013-01-14T18:28:40.291Z [04052 error 'Default'] (Log recursion level 2) VpxUnhandledException

------ In-memory logs start --------

2013-01-14T18:28:30.696Z [04052 info 'Hooks'] Hooks Initialized

2013-01-14T18:28:30.727Z [04052 info 'Default'] Section for VMware VirtualCenter, pid=3300, version=5.0.0, build=build-804277, option=Release

-->

2013-01-14T18:28:30.727Z [04052 info 'Default'] Initialized channel manager

2013-01-14T18:28:30.727Z [04052 info 'Default'] Current working directory: C:\Windows\system32

2013-01-14T18:28:30.727Z [04052 verbose 'ThreadPool'] TaskMax=30, IoMin=1, IoMax=200

2013-01-14T18:28:30.759Z [04052 info 'Default'] Log path: C:\ProgramData\VMware\VMware VirtualCenter\Logs

2013-01-14T18:28:30.759Z [04052 info 'Default'] Initializing SSL

2013-01-14T18:28:31.851Z [04052 info 'Default'] Vmacore::InitSSL: doVersionCheck = true, handshakeTimeoutUs = 120000000

2013-01-14T18:28:31.851Z [04052 verbose 'Default'] Uptime Log: C:\ProgramData\VMware\VMware VirtualCenter\Logs/1358188111851202.vpxduptime

2013-01-14T18:28:31.851Z [04052 verbose 'Default'] Moved 1 uptime log(s) to cache dir

2013-01-14T18:28:31.866Z [04052 verbose 'Default'] Recd:1358188111851202|VCENTER.leia.ussu.susx.ac.uk|4ba6f533-3ecf-4ebd-af8e-4a52f8a23c84|build-804277|10|:

2013-01-14T18:28:31.866Z [04052 verbose 'Default'] Initing Support Manager

2013-01-14T18:28:31.866Z [04052 verbose 'Default'] Support Manager Monitor invoked

2013-01-14T18:28:31.882Z [04052 info 'Default'] Starting VMware VirtualCenter 5.0.0 build-804277

2013-01-14T18:28:31.882Z [04052 info 'Default'] Log directory: C:\ProgramData\VMware\VMware VirtualCenter\Logs.

2013-01-14T18:28:31.882Z [04052 info 'Default'] Account name: SYSTEM

2013-01-14T18:28:31.882Z [04052 info 'Default'] Total virtual memory available for the process 8589934464 KB

2013-01-14T18:28:31.882Z [04052 info 'Default'] [VpxOsLayer] Enabled low-frag process heap.

-->

2013-01-14T18:28:31.882Z [04052 info 'Default'] [VpxOsLayer] Enabled low-frag crt heap.

-->

2013-01-14T18:28:31.882Z [04052 info 'Default'] [Vpxd::ServerApp::Init:835] Calling: InfoDeclSchema(gDB)

2013-01-14T18:28:31.882Z [04052 info 'Default'] [Vpxd::ServerApp::Init:837] Calling: VpxCallbackDesc::Init(MakeFunctor(this, &ServerApp::RequestShutdown))

2013-01-14T18:28:31.882Z [04052 info 'Default'] [Vpxd::ServerApp::Init:838] Calling: VpxCryptInit()

2013-01-14T18:28:31.882Z [04052 info 'Default'] [Vpxd::ServerApp::Init:839] Calling: VpxLRO::Init()

2013-01-14T18:28:31.882Z [04052 info 'Default'] [Vpxd::ServerApp::Init:840] Calling: VpxLroList::Init(ltud)

2013-01-14T18:28:31.882Z [04052 info 'Default'] [VpxLRO] 640 max LROs

2013-01-14T18:28:31.882Z [04052 info 'Default'] [VpxLRO] 12 reserved internal LROs

2013-01-14T18:28:31.882Z [04052 info 'Default'] [VpxLRO] 12 reserved blocker LROs

2013-01-14T18:28:31.882Z [04052 info 'Default'] [VpxLRO] 12 reserved short LROs

2013-01-14T18:28:31.882Z [04052 info 'Default'] [VpxLRO] 8 reserved long LROs

2013-01-14T18:28:31.882Z [04052 info 'Default'] [VpxLRO] 600-second completed task lifetime

2013-01-14T18:28:31.882Z [04052 info 'Default'] [VpxLRO] 60-second minimum completed task lifetime

2013-01-14T18:28:31.882Z [04052 info 'Default'] [VpxLRO] 200 maximum completed tasks

2013-01-14T18:28:31.882Z [04052 info 'Default'] [VpxLRO] 600-second unregistered task lifetime

2013-01-14T18:28:31.882Z [04052 info 'Default'] [Vpxd::ServerApp::Init:841] Calling: VpxdCharacterizeThreadpool(ltud)

2013-01-14T18:28:31.882Z [04052 verbose 'ThreadPool'] [SetConfig] TaskMax: 1930, IoMin: 1, IoMax: 1930

2013-01-14T18:28:31.882Z [04052 info 'Default'] [Vpxd::ServerApp::Init:842] Calling: VpxdCertificate_Load(gDB, CERTIFICATE_VMDBPATH )

2013-01-14T18:28:31.882Z [04052 info 'Default'] [Vpxd::ServerApp::Init:843] Calling: VpxdVdb::Init(VpxdVdb::GetVcVdbInstId(), false, false, NULL)

2013-01-14T18:28:31.882Z [04052 info 'Default'] Registry Item DB 5 value is '50'

2013-01-14T18:28:31.882Z [04052 info 'Default'] [VpxdVdb::SetDBType] Logging in to DSN: VMware vCenter with username

2013-01-14T18:28:31.898Z [04052 error 'Default'] [VpxKey::Decrypt] crypto failure: error:00000000:lib(0):func(0):reason(0)

2013-01-14T18:28:31.898Z [04052 error 'Default'] [VpxdCert] Failed to decrypt password: applying key to encrypted data failed (likely the wrong key)

2013-01-14T18:28:31.898Z [04052 error 'Default'] [VpxdVdb::SetDBType]: Database error: ODBC error: () -

2013-01-14T18:28:31.898Z [04052 error 'Default'] Error getting configuration info from the database

2013-01-14T18:28:31.898Z [04052 error 'Default'] [Vpxd::ServerApp::Init] Init failed: VpxdVdb::Init(VpxdVdb::GetVcVdbInstId(), false, false, NULL)

2013-01-14T18:28:31.898Z [04052 error 'Default'] Failed to intialize VMware VirtualCenter. Shutting down...

2013-01-14T18:28:31.898Z [04052 info 'Default'] Wrote uptime information

2013-01-14T18:28:31.898Z [04052 error 'Default'] Alert:false@ d:/build/ob/bora-804277/bora/vpx/vpxd/util/vpxdVdb.cpp:408

--> Backtrace:

--> backtrace[00] rip 000000018013deba (no symbol)

--> backtrace[01] rip 0000000180101518 (no symbol)

--> backtrace[02] rip 0000000180101a5e (no symbol)

--> backtrace[03] rip 000000018009684a (no symbol)

--> backtrace[04] rip 000000013f548603 (no symbol)

--> backtrace[05] rip 000000013fe91e3e (no symbol)

--> backtrace[06] rip 000000013fe92023 (no symbol)

--> backtrace[07] rip 00000001400b2177 (no symbol)

--> backtrace[08] rip 000007fefdc2a82d (no symbol)

--> backtrace[09] rip 00000000777f652d (no symbol)

--> backtrace[10] rip 000000007792c521 (no symbol)

-->

2013-01-14T18:28:31.898Z [04052 info 'Default'] Registry Item DB 5 value is '50'

2013-01-14T18:28:31.898Z [04052 info 'Default'] [VpxdVdb::SetDBType] Logging in to DSN: VMware vCenter with username

2013-01-14T18:28:31.913Z [04052 error 'Default'] [VpxKey::Decrypt] crypto failure: error:00000000:lib(0):func(0):reason(0)

2013-01-14T18:28:31.913Z [04052 error 'Default'] [VpxdCert] Failed to decrypt password: applying key to encrypted data failed (likely the wrong key)

2013-01-14T18:28:31.913Z [04052 error 'Default'] [VpxdVdb::SetDBType]: Database error: ODBC error: () -

2013-01-14T18:28:31.913Z [04052 error 'Default'] Error getting configuration info from the database

2013-01-14T18:28:31.913Z [04052 warning 'Default'] [VpxUnhandledException] Win32 Exception (0xe06d7363) detected at 7FEFDA0A49D

-->

2013-01-14T18:28:31.913Z [04052 warning 'Default']    rip: 0x000000fda0a49d rsp: 0x00000004aaf4e0 rbp: 0x0000000381bba0

-->

2013-01-14T18:28:31.913Z [04052 warning 'Default']    rax: 0x000000735719e4 rbx: 0x00000004aaf6a0 rcx: 0x00000004aaeed0

-->    rdx: 0x000000000000d0 rdi: 0x00000042470850 rsi: 0x0000000378e6c0

-->    r8:  0000000000000000 r9:  0000000000000000 r10: 0x0000003f2d0000

-->    r11: 0x00000004aaf520 r12: 0x0000000378e6c0 r13: 0x00000004aaf770

-->    r14: 0000000000000000 r15: 0000000000000000

-->

2013-01-14T18:28:31.913Z [04052 warning 'Default'] [VpxUnhandledException] Backtrace

--> backtrace[00] rip 000000018013deba (no symbol)

--> backtrace[01] rip 0000000180101518 (no symbol)

--> backtrace[02] rip 0000000180101a5e (no symbol)

--> backtrace[03] rip 00000001400c52cf (no symbol)

--> backtrace[04] rip 0000000077879490 (no symbol)

--> backtrace[05] rip 00000000779943b8 (no symbol)

--> backtrace[06] rip 00000000779185a8 (no symbol)

--> backtrace[07] rip 0000000077929d0d (no symbol)

--> backtrace[08] rip 00000000779191af (no symbol)

--> backtrace[09] rip 00000000779197a8 (no symbol)

--> backtrace[10] rip 000007fefda0a49d (no symbol)

--> backtrace[11] rip 0000000074f154ca (no symbol)

--> backtrace[12] rip 000000013f54863d (no symbol)

--> backtrace[13] rip 000000013fe91e3e (no symbol)

--> backtrace[14] rip 000000013fe92023 (no symbol)

--> backtrace[15] rip 00000001400b2177 (no symbol)

--> backtrace[16] rip 000007fefdc2a82d (no symbol)

--> backtrace[17] rip 00000000777f652d (no symbol)

--> backtrace[18] rip 000000007792c521 (no symbol)

-->

2013-01-14T18:28:31.913Z [04052 warning 'Default'] [VpxUnhandledException] Generating minidump ...

2013-01-14T18:28:39.901Z [04052 info 'Default'] CoreDump: Writing minidump

2013-01-14T18:28:40.291Z [04052 error 'Default'] (Log recursion level 2) VpxUnhandledException

------ In-memory logs end   --------

2013-01-14T18:28:40.291Z [04052 error 'Default'] Section for VMware VirtualCenter, pid=3300, version=5.0.0, build=build-804277, option=Release

-->

I have changed the password, (stupidly) and I think this is the reason why the services are not starting back up again.

Help!

Many thanks,

Hesan

[memaad]

Hi ,

Here is problem

2013-01-14T18:28:31.898Z [04052 error 'Default'] [VpxKey::Decrypt] crypto failure: error:00000000:lib(0):func(0):reason(0)

2013-01-14T18:28:31.898Z [04052 error 'Default'] [VpxdCert] Failed to decrypt password: applying key to encrypted data failed (likely the wrong key)

2013-01-14T18:28:31.898Z [04052 error 'Default'] [VpxdVdb::SetDBType]: Database error: ODBC error: () -

2013-01-14T18:28:31.898Z [04052 error 'Default'] Error getting configuration info from the database

2013-01-14T18:28:31.898Z [04052 error 'Default'] [Vpxd::ServerApp::Init] Init failed: VpxdVdb::Init(VpxdVdb::GetVcVdbInstId(), false, false, NULL)

2013-01-14T18:28:31.898Z [04052 error 'Default'] Failed to intialize VMware VirtualCenter. Shutting down...

2013-01-14T18:28:31.898Z [04052 info 'Default'] Wrote uptime information

2013-01-14T18:28:31.898Z [04052 error 'Default'] Alert:false@ d:/build/ob/bora-804277/bora/vpx/vpxd/util/vpxdVdb.cpp:408

Not able to access vCenter server database password after replacing  SSL certificate.

I would like to know what version of VC  5.0 or 5.1 . Also would like to know if you have  changed SSL certificate for VC, from log it says that you have replaced the certificate.

Is vCenter server is in virtual machine or physical machine.

Apply this action plan if you have vCenter server  in virtual machine.

Take snapshot of vCenter server  machine.

take back-up of vCenter server database

and update vCenter server password again using vpxd -p.

Regards

Mohammed

[athemiya1]

Hi Mohammed,

Thanks again for a response.

Its VCenter 5.1 in a VM Windows 2008 R2.

I did replace the SSL certificate.

If I do change the database password by doing that command, do I not have to change the password elsewhere in order for VCenter to continue working again and the services to start up?

Many thanks,

Hesan

[memaad]

Hi,

Do not change password, use the same password which you had  for vcenter server databse user before SSL certfficate was replaced.

Here is KB http://kb.vmware.com/selfservice/microsites/search.do?language=en_US&cmd=displayKC&externalId=203500...

Which does not says to change password, just to update password with new SSL certificate keys.

Steps number 17.

Regards

Mohammed

[athemiya1]

Hi,

I do not recollect what I used as a password prior for the VCenter database! When would I have been asked for this? At what stage? During installation of VCenter or through another setup process?

This is my problem, I have changed the password by following those instructions, specifically in Step 17 and now I am unsure of WHICH password I need to go back to in order to connect to the VCenter database.

Regards,

Hesan

[memaad]

Hi,

I would recomend you to try recall the original password. If not Try using the latest password that you used at step 17. Then update  again using ODBC connection with password.

Regards

Mohammed