Hello,
VMware Appliance Monitoring Service refuses to start, from vCenter Appliance Management services tab or through Bash. I captured /var/log/vmware/applmgmt/StatsMonitor.log
Looks there is an issue with SQLite DB. I checked on the internet and I did not found the way to rebuild it, or even drop it and rebuild from scratch. I don't care about loosing historical monitoring data (we are a small manufacturing plant), but what I want to avoid is rebuilding the vCenter from scratch.
As Monitoring Service refuses to start since a long time ago (Im not aware when it stopped working), I do not have backups of vCenter as automatic backup was failing.
Any support is highly appreciated 🙂
2021-05-21T07:21:14.231Z - time the service was last started, Section for StatsMonitor, pid=42730, version=1.0, build=17713310, option=Release
2021-05-21T07:21:14.224Z info -[42730] [Originator@6876 sub=Default] Glibc malloc guards disabled.
2021-05-21T07:21:14.224Z info -[42730] [Originator@6876 sub=Default] Initialized SystemFactory
2021-05-21T07:21:14.231Z info StatsMonitor[42730] [Originator@6876 sub=Default] Logging uses fast path: true
2021-05-21T07:21:14.231Z info StatsMonitor[42730] [Originator@6876 sub=Default] The bora/lib logs WILL be handled by VmaCore
2021-05-21T07:21:14.231Z info StatsMonitor[42730] [Originator@6876 sub=Default] Initialized channel manager
2021-05-21T07:21:14.231Z info StatsMonitor[42730] [Originator@6876 sub=Default] Current working directory: /storage/log/vmware/vmon
2021-05-21T07:21:14.231Z info StatsMonitor[42730] [Originator@6876 sub=ThreadPool] Catch work item exceptions disabled.
2021-05-21T07:21:14.231Z info StatsMonitor[42730] [Originator@6876 sub=FairScheduler] Priority level 4 is now active.
2021-05-21T07:21:14.231Z info StatsMonitor[42730] [Originator@6876 sub=WorkQueue.vmacoreDefaultIOCompletionQueue] Created: WorkQueue.vmacoreDefaultIOCompletionQueue, type = fair, priority = 4 , itemWeight = 1
2021-05-21T07:21:14.231Z info StatsMonitor[42730] [Originator@6876 sub=FairScheduler] Priority level 8 is now active.
2021-05-21T07:21:14.231Z info StatsMonitor[42730] [Originator@6876 sub=WorkQueue.vmacoreDefaultIOQueue] Created: WorkQueue.vmacoreDefaultIOQueue, type = fair, priority = 8 , itemWeight = 1
2021-05-21T07:21:14.232Z info StatsMonitor[42730] [Originator@6876 sub=FairScheduler] Priority level 16 is now active.
2021-05-21T07:21:14.232Z info StatsMonitor[42730] [Originator@6876 sub=WorkQueue.vmacoreDefaultLongTaskQueue] Created: WorkQueue.vmacoreDefaultLongTaskQueue, type = fair, priority = 16 , itemWeight = 1
2021-05-21T07:21:14.232Z info StatsMonitor[42730] [Originator@6876 sub=ThreadPool] Registered foreign worker - allocated: 1, idle: 0
2021-05-21T07:21:14.232Z info StatsMonitor[42730] [Originator@6876 sub=ThreadPool] Registered foreign worker - allocated: 2, idle: 0
2021-05-21T07:21:14.232Z info StatsMonitor[42730] [Originator@6876 sub=ThreadPool] Registered foreign worker - allocated: 3, idle: 0
2021-05-21T07:21:14.232Z info StatsMonitor[42730] [Originator@6876 sub=ThreadPool] Registered foreign worker - allocated: 4, idle: 0
2021-05-21T07:21:14.232Z info StatsMonitor[42730] [Originator@6876 sub=ThreadPool] Thread pool fair initial threads spawned. IO: 2, Min workers: 4, Max workers: 13, Reservation ratio: 9
2021-05-21T07:21:14.232Z info StatsMonitor[42730] [Originator@6876 sub=ThreadPool] Thread enlisted
2021-05-21T07:21:14.232Z info StatsMonitor[42730] [Originator@6876 sub=Default] Syscommand enabled: true
2021-05-21T07:21:14.232Z info StatsMonitor[42730] [Originator@6876 sub=Default] ReaperManager Initialized
2021-05-21T07:21:14.232Z info StatsMonitor[42730] [Originator@6876 sub=StatsMonitor] Setting up signal handlers
2021-05-21T07:21:14.232Z error StatsMonitor[42730] [Originator@6876 sub=StatsMonitor] Failed to register handler for signal: 0
2021-05-21T07:21:14.232Z info StatsMonitor[42732] [Originator@6876 sub=ThreadPool] Thread enlisted
2021-05-21T07:21:14.232Z info StatsMonitor[42732] [Originator@6876 sub=ThreadPool] Entering worker thread loop
2021-05-21T07:21:14.232Z info StatsMonitor[42735] [Originator@6876 sub=ThreadPool] Thread enlisted
2021-05-21T07:21:14.232Z info StatsMonitor[42735] [Originator@6876 sub=ThreadPool] Entering worker thread loop
2021-05-21T07:21:14.232Z info StatsMonitor[42734] [Originator@6876 sub=ThreadPool] Thread enlisted
2021-05-21T07:21:14.232Z info StatsMonitor[42734] [Originator@6876 sub=ThreadPool] Entering worker thread loop
2021-05-21T07:21:14.232Z info StatsMonitor[42738] [Originator@6876 sub=ThreadPool] Thread enlisted
2021-05-21T07:21:14.232Z info StatsMonitor[42738] [Originator@6876 sub=ThreadPool] Entering fair thread loop
2021-05-21T07:21:14.232Z info StatsMonitor[42732] [Originator@6876 sub=ThreadPool] Spawning additional worker - allocated: 5, idle: 0
2021-05-21T07:21:14.232Z info StatsMonitor[42737] [Originator@6876 sub=ThreadPool] Thread enlisted
2021-05-21T07:21:14.232Z info StatsMonitor[42737] [Originator@6876 sub=ThreadPool] Entering IO thread loop
2021-05-21T07:21:14.232Z info StatsMonitor[42736] [Originator@6876 sub=ThreadPool] Thread enlisted
2021-05-21T07:21:14.232Z info StatsMonitor[42736] [Originator@6876 sub=ThreadPool] Entering IO thread loop
2021-05-21T07:21:14.232Z info StatsMonitor[42733] [Originator@6876 sub=ThreadPool] Thread enlisted
2021-05-21T07:21:14.232Z info StatsMonitor[42733] [Originator@6876 sub=ThreadPool] Entering worker thread loop
2021-05-21T07:21:14.232Z info StatsMonitor[42739] [Originator@6876 sub=ThreadPool] Thread enlisted
2021-05-21T07:21:14.232Z info StatsMonitor[42739] [Originator@6876 sub=ThreadPool] Entering worker thread loop
2021-05-21T07:21:14.233Z info StatsMonitor[42730] [Originator@6876 sub=StatsMonitor] Initializing
2021-05-21T07:21:14.233Z info StatsMonitor[42730] [Originator@6876 sub=LinuxStatsProvider(00005558d6ee21f0)] Created
2021-05-21T07:21:14.237Z info StatsMonitor[42730] [Originator@6876 sub=LinuxStatsProvider(00005558d6ee21f0)] RegisterInt: 166 stats registered for handler: 00005558d6f15b28(ZN5Stats9Providers18LinuxStatsProvider8RegisterEPNS_13StatsRegistryEEUlRKSt6vectorINS_9StatQueryESaIS5_EEPNS_11StatsResultEE_)
2021-05-21T07:21:14.237Z info StatsMonitor[42730] [Originator@6876 sub=LinuxStatsProvider(00005558d6ee21f0)] Registered 166 stats (sources:116, derivatives:50)
2021-05-21T07:21:14.237Z info StatsMonitor[42730] [Originator@6876 sub=StatsMonitor] Found 12 file systems and 7 dirs in config for monitoring.
2021-05-21T07:21:14.237Z info StatsMonitor[42730] [Originator@6876 sub=LinuxStorageStatsProvider(00005558d6ee4250)] Created
2021-05-21T07:21:14.237Z info StatsMonitor[42730] [Originator@6876 sub=LinuxStorageStatsProvider(00005558d6ee4250)] RegisterInt: 3 stats registered for handler: 00005558d6f17488(ZN5Stats9Providers25LinuxStorageStatsProvider8RegisterEPNS_13StatsRegistryEEUlRKSt6vectorINS_9StatQueryESaIS5_EEPNS_11StatsResultEE_)
2021-05-21T07:21:14.237Z info StatsMonitor[42730] [Originator@6876 sub=LinuxStorageStatsProvider(00005558d6ee4250)] RegisterInt: 1 stats registered for handler: 00005558d6f17488(ZN5Stats9Providers25LinuxStorageStatsProvider8RegisterEPNS_13StatsRegistryEEUlRKSt6vectorINS_9StatQueryESaIS5_EEPNS_11StatsResultEE_)
2021-05-21T07:21:14.237Z info StatsMonitor[42730] [Originator@6876 sub=LinuxStorageStatsProvider(00005558d6ee4250)] Registered 4 stats
2021-05-21T07:21:14.237Z info StatsMonitor[42730] [Originator@6876 sub=StatsMonitor] SqliteStorageEngine using SQLite version: 3.34.0
2021-05-21T07:21:37.051Z error StatsMonitor[42730] [Originator@6876 sub=StatsMonitor] Failed to execute SQL PRAGMA quick_check;
2021-05-21T07:21:37.051Z error StatsMonitor[42730] [Originator@6876 sub=StatsMonitor] Unable to open and initialize storage engine: database disk image is malformed
2021-05-21T07:21:37.052Z info StatsMonitor[42730] [Originator@6876 sub=StatsMonitor] Initialization took 22829ms with status=false.
2021-05-21T07:21:37.052Z info StatsMonitor[42730] [Originator@6876 sub=StatsMonitor] Exiting with status=false.
