Updating from Windows 6.5 to VCSA 6.7, VC password auth failed

[smolt11]

Updating Windows Server 2012 R2 vSphere install to 6.7U2a VCSA.

The error is "Internal error occurs during the VMware vCenter Server Database pre-upgrade checks".

Specifically in the CollectRequirements_com.vmware.vcdb_* file:

2019-07-10T15:44:59.446Z INFO __main__ Set root upgrade folder to: C:\mig2668.tmp\PFiles\VMware\CIS\cis_upgrade_runner\payload\component-scripts
2019-07-10T15:44:59.489Z INFO sdk_utils Loading external install configuration from C:\mig2668.tmp\PFiles\VMware\CIS\cis_upgrade_runner\config\vcsa_install_config.json
2019-07-10T15:44:59.538Z INFO install_param_utils Retrieve install-parameter feature.states=
2019-07-10T15:44:59.538Z INFO featureState_utils Found FSS 'DeferHistoryImport' with value 'True'
2019-07-10T15:44:59.546Z INFO __main__ Context file C:\mig2668.tmp\PFiles\VMware\CIS\cis_upgrade_runner\upgrade_working_directory\system-data\upgrade-com.vmware.vcdb-upgradeContext does not exist. Use default context
2019-07-10T15:44:59.546Z INFO extensions Found upgrade phase <module 'vcdb' from 'C:\mig2668.tmp\PFiles\VMware\CIS\cis_upgrade_runner\payload\component-scripts\vcdb\__init__.py'>:CollectRequirements'
2019-07-10T15:44:59.546Z INFO extensions Executing upgrade phase '<module 'vcdb' from 'C:\mig2668.tmp\PFiles\VMware\CIS\cis_upgrade_runner\payload\component-scripts\vcdb\__init__.py'>:CollectRequirements' with context {u'resourceDir': u'C:\\mig2668.tmp\\PFiles\\VMware\\CIS\\cis_upgrade_runner\\upgrade_working_directory', u'sourceSsoPassword': 'CENSORED', u'devMode': False, u'sourcePlatform': u'Windows', u'destinationPlatform': u'Linux', u'destinationVcVersion': u'6.7', u'sourceSsoUsername': None, u'locale': u'en', 'logDir': u'C:\\Users\\ADMINI~1.RTP\\AppData\\Local\\Temp\\vcsMigration', u'sourceVcVersion': u'6.5', u'sourceSsoVersion': u'6.5', u'vcdb.migrateSet': u'all', u'destinationSsoVersion': u'6.7', u'systemExportDir': u'C:\\mig2668.tmp\\PFiles\\VMware\\CIS\\cis_upgrade_runner\\upgrade_working_directory\\system-data'}.
2019-07-10T15:44:59.598Z INFO vcdb.const Configuring log folder paths in C:\Users\ADMINI~1.RTP\AppData\Local\Temp\vcsMigration
2019-07-10T15:44:59.598Z INFO vcdb.const Python 2
2019-07-10T15:44:59.598Z INFO vcdb.const Retrieving DB type...
2019-07-10T15:44:59.604Z INFO vcdb.const Retrived DB type: postgresql
2019-07-10T15:44:59.608Z INFO vcdb.const Getting vCenter Server DSN...
2019-07-10T15:44:59.608Z INFO vcdb.const vCenter Server uses DSN: VMware VirtualCenter
2019-07-10T15:44:59.609Z INFO vcdb.const Retrieving DB user...
2019-07-10T15:44:59.611Z INFO vcdb.const DB user retrieved: vc
2019-07-10T15:44:59.615Z INFO vcdb.const Retrieving DB password...
2019-07-10T15:45:00.743Z INFO vcdb.const DB password retrieved: ****
2019-07-10T15:45:00.746Z INFO vcdb.const crossPlatform: yes
2019-07-10T15:45:00.749Z INFO vcdb.const VCDB: embedded
2019-07-10T15:45:00.749Z INFO vcdb.const DB type: embedded
2019-07-10T15:45:00.750Z INFO vcdb.const Validating source embedded schema...
2019-07-10T15:46:43.322Z INFO vcdb.const Source embedded schema validation completed.
2019-07-10T15:46:43.387Z ERROR __main__ Upgrade Phase 'vcdb:CollectRequirements' failed. Exception: (u'08001', u'[08001] FATAL:  password authentication failed for user "vc"\n')
Traceback (most recent call last):
  File "C:\mig2668.tmp\PFiles\VMware\CIS\cis_upgrade_runner\payload\componentPhaseLauncher.py", line 461, in main
    executionResult = systemExtension(exeContext)
  File "C:\mig2668.tmp\PFiles\VMware\CIS\cis_upgrade_runner\libs\sdk\extensions.py", line 94, in __call__
    result = self.extension(*args)
  File "C:\mig2668.tmp\PFiles\VMware\CIS\cis_upgrade_runner\libs\sdk\extensions.py", line 110, in _func
    return func(*args)
  File "C:\mig2668.tmp\PFiles\VMware\CIS\cis_upgrade_runner\payload\component-scripts\vcdb\__init__.py", line 25, in do_collect_upgrade_requirements
    req = do_windows_collect_req(context)
  File "C:\mig2668.tmp\PFiles\VMware\CIS\cis_upgrade_runner\payload\component-scripts\vcdb\vcdb_collect_requirements_functions.py", line 1171, in do_windows_collect_req
    calc_estimates_oracle_external(dsn_name_org, vc_user_org, vc_pass_org, "False")
  File "C:\mig2668.tmp\PFiles\VMware\CIS\cis_upgrade_runner\payload\component-scripts\vcdb\ms2pg\estimateOracle.py", line 189, in calc_estimates_oracle_external
    connection = get_connection(dsn_name, vc_user, vc_pass)
  File "C:\mig2668.tmp\PFiles\VMware\CIS\cis_upgrade_runner\payload\component-scripts\vcdb\ms2pg\connection_util.py", line 15, in get_connection
    return pypyodbc.connect(con_str)
  File "C:\mig2668.tmp\PFiles\VMware\CIS\cis_upgrade_runner\payload\component-scripts\vcdb\ms2pg\pypyodbc.py", line 2439, in __init__
    self.connect(connectString, autocommit, ansi, timeout, unicode_results, readonly)
  File "C:\mig2668.tmp\PFiles\VMware\CIS\cis_upgrade_runner\payload\component-scripts\vcdb\ms2pg\pypyodbc.py", line 2488, in connect
    check_success(self, ret)
  File "C:\mig2668.tmp\PFiles\VMware\CIS\cis_upgrade_runner\payload\component-scripts\vcdb\ms2pg\pypyodbc.py", line 1008, in check_success
    ctrl_err(SQL_HANDLE_DBC, ODBC_obj.dbc_h, ret, ODBC_obj.ansi)
  File "C:\mig2668.tmp\PFiles\VMware\CIS\cis_upgrade_runner\payload\component-scripts\vcdb\ms2pg\pypyodbc.py", line 986, in ctrl_err
    raise DatabaseError(state,err_text)
DatabaseError: (u'08001', u'[08001] FATAL:  password authentication failed for user "vc"\n')

Any ideas?

[smolt11]

Additionally, the closest KB article i can find is https://kb.vmware.com/s/article/2147466

Mentioned in that article is %appdata%\postgresql\pgpass.conf, but the file does not exist.

[birend1988]

Open case with VMware. They have internal KB available for this error.

[smolt11]

No support. An update:

ODBC Data Sources (in administrative tools) had a connection to VMware but a bad password. I updated this password and it now can connect.

I also added the pgpass.conf file in the format

127.0.0.1:5432:VCDB:vc:<password>

to the following directories:

C:\Users\<Username>\AppData\Roaming\postgresql\pgpass.conf
C:\windows\system32\config\systemprofile\appdata\roaming\postgresql\pgpass.conf

Updating the password in ODBC Data Sources didn't seem to make a difference. Adding pgpass.conf to the above directories makes the migration assistant timeout after 15 minutes.

Further investigation shows the following:

INFO upgrade.states.component_states vcdb:CollectRequirements: didn't have progress. Next report will come after 60 seconds

Until it ultimately fails. Any ideas?

[timbiotic]

Did you ever get this fixed or did you just end up creating one from scratch and importing the hosts? I am having same issue going from 6.0 to 6.7

[MattTheDuck]

I was having password issues as well after an upgrade.  The upgrade suceeded and everything seemed to be working, until months later.

When I went to 64 bit ODBC and tested the connection, it failed.  I followed the steps in https://kb.vmware.com/s/article/2108848 to get the password and test postgreSQL and after it worked, I just put the password back into the ODBC settings and did another test and it worked, so I saved the settings and was good.