3 Replies Latest reply on Aug 8, 2019 7:39 AM by larstr

    vSAN health alarms are suppressed

    larstr Virtuoso
    vExpert

      I have this warning for several of my vSAN clusters, but can't figure out what have been suppressed.

       

      I've tried to use RVC to check why we have this alarm. No matter which of the 5 vSAN clusters I check RVC reports no alarms with Silent status other than Normal.

       

      > vsan.health.silent_health_check_status 1/DC/computers/clusterXXX/
      Silent Status of Cluster clusterXXX:
      +---------------------------------------------------------------------------------------------+-------------------------------------+---------------+
      | Health Check                                                                                | Health Check Id                     | Silent Status |
      +---------------------------------------------------------------------------------------------+-------------------------------------+---------------+
      | Cloud Health                                                                                |                                     |               |
      |   Advanced vSAN configuration supported                                                     | unsupportedadvparameters            | Normal        |
      |   Controller utility is installed on host                                                   | vendortoolpresence                  | Normal        |
      |   Controller with pass-through and RAID disks                                               | mixedmode                           | Normal        |
      |   Coredump partition size check                                                             | coredumpartitionsize                | Normal        |
      |   Customer experience improvement program (CEIP)                                            | vsancloudhealthceipexception        | Normal        |
      |   Disks usage on storage controller                                                         | diskusage                           | Normal        |
      |   Dual encryption applied to VMs on vSAN                                                    | dualencryption                      | Normal        |
      |   Network adapter is VMware certified                                                       | pnichcl                             | Normal        |
      |   Online health connectivity                                                                | vsancloudhealthconnectionexception  | Normal        |
      |   Patch available for critical vSAN issue for All-Flash clusters with deduplication enabled | patchalert                          | Normal        |
      |   Physical network adapter link speed consistency                                           | pnicconsistent                      | Normal        |
      |   RAID controller configuration                                                             | controllercacheconfig               | Normal        |
      |   Thick-provisioned VMs on vSAN                                                             | thickprovision                      | Normal        |
      |   vCenter Server up to date                                                                 | vcuptodate                          | Normal        |
      |   vSAN Critical Alert - Patch available for critical vSAN issue                             | lilypatchalert                      | Normal        |
      |   vSAN Critical Alert - vSAN Advanced Configuration Check                                   | lilyadvparametercheck               | Normal        |
      |   vSAN and VMFS datastores on a Dell H730 controller with the lsi_mr3 driver                | mixedmodeh730                       | Normal        |
      |   vSAN configuration for LSI-3108 based controller                                          | h730                                | Normal        |
      |   vSAN max component size                                                                   | smalldiskstest                      | Normal        |
      +---------------------------------------------------------------------------------------------+-------------------------------------+---------------+
      | Cluster                                                                                     |                                     |               |
      |   Advanced vSAN configuration in sync                                                       | advcfgsync                          | Normal        |
      |   Advanced vSAN configuration supported                                                     | unsupportedadvparameters            | Normal        |
      |   Coredump partition size check                                                             | coredumpartitionsize                | Normal        |
      |   Deduplication and compression configuration consistency                                   | physdiskdedupconfig                 | Normal        |
      |   Deduplication and compression usage health                                                | physdiskdedupusage                  | Normal        |
      |   Disk format version                                                                       | upgradelowerhosts                   | Normal        |
      |   ESXi vSAN Health service installation                                                     | healtheaminstall                    | Normal        |
      |   Host Maintenance Mode                                                                     | mmdecominsync                       | Normal        |
      |   Resync operations throttling                                                              | resynclimit                         | Normal        |
      |   Software version compatibility                                                            | upgradesoftware                     | Normal        |
      |   Time is synchronized across hosts and VC                                                  | timedrift                           | Normal        |
      |   vCenter state is authoritative                                                            | vcauthoritative                     | Normal        |
      |   vSAN CLOMD liveness                                                                       | clomdliveness                       | Normal        |
      |   vSAN Disk Balance                                                                         | diskbalance                         | Normal        |
      |   vSAN Health Service up-to-date                                                            | healthversion                       | Normal        |
      |   vSAN cluster configuration consistency                                                    | consistentconfig                    | Normal        |
      |   vSAN extended configuration in sync                                                       | extendedconfig                      | Normal        |
      |   vSphere cluster members match vSAN cluster members                                        | clustermembership                   | Normal        |
      +---------------------------------------------------------------------------------------------+-------------------------------------+---------------+
      | Data                                                                                        |                                     |               |
      |   vSAN VM health                                                                            | vmhealth                            | Normal        |
      |   vSAN object health                                                                        | objecthealth                        | Normal        |
      +---------------------------------------------------------------------------------------------+-------------------------------------+---------------+
      | Data protection                                                                             |                                     |               |
      |   Data protection service version check                                                     | dataprotectionversion               | Normal        |
      |   vSAN DPD liveness                                                                         | dpdliveness                         | Normal        |
      |   vSAN data protection archival target accessibility                                        | archivalaccessibility               | Normal        |
      |   vSAN data protection service configuration in sync                                        | dpcfgsync                           | Normal        |
      |   vSAN datastore usage threshold check                                                      | datastoreusage                      | Normal        |
      |   vSAN object data protection health                                                        | objectdphealth                      | Normal        |
      +---------------------------------------------------------------------------------------------+-------------------------------------+---------------+
      | Encryption                                                                                  |                                     |               |
      |   CPU AES-NI is enabled on hosts                                                            | hostcpuaesni                        | Normal        |
      |   vCenter and all hosts are connected to Key Management Servers                             | kmsconnection                       | Normal        |
      +---------------------------------------------------------------------------------------------+-------------------------------------+---------------+
      | Hardware compatibility                                                                      |                                     |               |
      |   Controller disk group mode is VMware certified                                            | controllerdiskmode                  | Normal        |
      |   Controller driver is VMware certified                                                     | controllerdriver                    | Normal        |
      |   Controller firmware is VMware certified                                                   | controllerfirmware                  | Normal        |
      |   Controller is VMware certified for ESXi release                                           | controllerreleasesupport            | Normal        |
      |   Controller utility is installed on host                                                   | vendortoolpresence                  | Normal        |
      |   Controller with pass-through and RAID disks                                               | mixedmode                           | Normal        |
      |   Host issues retrieving hardware info                                                      | hclhostbadstate                     | Normal        |
      |   Network adapter driver is VMware certified                                                | pnicdriver                          | Normal        |
      |   Network adapter firmware is VMware certified                                              | pnicfirmware                        | Normal        |
      |   Network adapter is VMware certified                                                       | pniconhcl                           | Normal        |
      |   Network adapter is VMware certified                                                       | pnichcl                             | Normal        |
      |   Network adapter is VMware certified for ESXi release                                      | pnicreleasesupport                  | Normal        |
      |   RAID controller configuration                                                             | controllercacheconfig               | Normal        |
      |   SCSI controller is VMware certified                                                       | controlleronhcl                     | Normal        |
      |   vSAN HCL DB Auto Update                                                                   | autohclupdate                       | Normal        |
      |   vSAN HCL DB up-to-date                                                                    | hcldbuptodate                       | Normal        |
      |   vSAN and VMFS datastores on a Dell H730 controller with the lsi_mr3 driver                | mixedmodeh730                       | Normal        |
      |   vSAN configuration for LSI-3108 based controller                                          | h730                                | Normal        |
      |   vSAN firmware provider health                                                             | firmwareproviderhealth              | Normal        |
      |   vSAN firmware version recommendation                                                      | fwrecommendation                    | Normal        |
      +---------------------------------------------------------------------------------------------+-------------------------------------+---------------+
      | Hyperconverged cluster configuration compliance                                             |                                     |               |
      |   Host compliance check for hyperconverged cluster configuration                            | hosthciconfig                       | Normal        |
      |   VDS compliance check for hyperconverged cluster configuration                             | dvshciconfig                        | Normal        |
      +---------------------------------------------------------------------------------------------+-------------------------------------+---------------+
      | Limits                                                                                      |                                     |               |
      |   After 1 additional host failure                                                           | limit1hf                            | Normal        |
      |   Current cluster situation                                                                 | limit0hf                            | Normal        |
      |   Host component limit                                                                      | nodecomponentlimit                  | Normal        |
      +---------------------------------------------------------------------------------------------+-------------------------------------+---------------+
      | Network                                                                                     |                                     |               |
      |   Active multicast connectivity check                                                       | multicastdeepdive                   | Normal        |
      |   All hosts have a vSAN vmknic configured                                                   | vsanvmknic                          | Normal        |
      |   All hosts have matching multicast settings                                                | multicastsettings                   | Normal        |
      |   Hosts disconnected from VC                                                                | hostdisconnected                    | Normal        |
      |   Hosts with connectivity issues                                                            | hostconnectivity                    | Normal        |
      |   Multicast assessment based on other checks                                                | multicastsuspected                  | Normal        |
      |   Network latency check                                                                     | hostlatencycheck                    | Normal        |
      |   Physical network adapter link speed consistency                                           | pnicconsistent                      | Normal        |
      |   vMotion: Basic (unicast) connectivity check                                               | vmotionpingsmall                    | Normal        |
      |   vMotion: MTU check (ping with large packet size)                                          | vmotionpinglarge                    | Normal        |
      |   vSAN cluster partition                                                                    | clusterpartition                    | Normal        |
      |   vSAN: Basic (unicast) connectivity check                                                  | smallping                           | Normal        |
      |   vSAN: MTU check (ping with large packet size)                                             | largeping                           | Normal        |
      +---------------------------------------------------------------------------------------------+-------------------------------------+---------------+
      | Performance service                                                                         |                                     |               |
      |   All hosts contributing stats                                                              | hostsmissing                        | Normal        |
      |   Performance data collection                                                               | collection                          | Normal        |
      |   Performance service status                                                                | perfsvcstatus                       | Normal        |
      |   Stats DB object                                                                           | statsdb                             | Normal        |
      |   Stats DB object conflicts                                                                 | renameddirs                         | Normal        |
      |   Stats master election                                                                     | masterexist                         | Normal        |
      |   Verbose mode                                                                              | verbosemode                         | Normal        |
      +---------------------------------------------------------------------------------------------+-------------------------------------+---------------+
      | Physical disk                                                                               |                                     |               |
      |   Component limit health                                                                    | physdiskcomplimithealth             | Normal        |
      |   Component metadata health                                                                 | componentmetadata                   | Normal        |
      |   Congestion                                                                                | physdiskcongestion                  | Normal        |
      |   Disk capacity                                                                             | physdiskcapacity                    | Normal        |
      |   Disks usage on storage controller                                                         | diskusage                           | Normal        |
      |   Memory pools (heaps)                                                                      | lsomheap                            | Normal        |
      |   Memory pools (slabs)                                                                      | lsomslab                            | Normal        |
      |   Operation health                                                                          | physdiskoverall                     | Normal        |
      |   Physical disk health retrieval issues                                                     | physdiskhostissues                  | Normal        |
      |   vSAN max component size                                                                   | smalldiskstest                      | Normal        |
      +---------------------------------------------------------------------------------------------+-------------------------------------+---------------+
      | Stretched cluster                                                                           |                                     |               |
      |   Invalid preferred fault domain on witness host                                            | witnesspreferredfaultdomaininvalid  | Normal        |
      |   Invalid unicast agent                                                                     | hostwithinvalidunicastagent         | Normal        |
      |   No disk claimed on witness host                                                           | witnesswithnodiskmapping            | Normal        |
      |   Preferred fault domain unset                                                              | witnesspreferredfaultdomainnotexist | Normal        |
      |   Site latency health                                                                       | siteconnectivity                    | Normal        |
      |   Unexpected number of fault domains                                                        | clusterwithouttwodatafaultdomains   | Normal        |
      |   Unicast agent configuration inconsistent                                                  | clusterwithmultipleunicastagents    | Normal        |
      |   Unicast agent not configured                                                              | hostunicastagentunset               | Normal        |
      |   Unsupported host version                                                                  | hostwithnostretchedclustersupport   | Normal        |
      |   Witness host fault domain misconfigured                                                   | witnessfaultdomaininvalid           | Normal        |
      |   Witness host not found                                                                    | clusterwithoutonewitnesshost        | Normal        |
      |   Witness host within vCenter cluster                                                       | witnessinsidevccluster              | Normal        |
      +---------------------------------------------------------------------------------------------+-------------------------------------+---------------+
      | vSAN Build Recommendation                                                                   |                                     |               |
      |   Patch available for critical vSAN issue for All-Flash clusters with deduplication enabled | patchalert                          | Normal        |
      |   vSAN Build Recommendation Engine Health                                                   | vumconfig                           | Normal        |
      |   vSAN build recommendation                                                                 | vumrecommendation                   | Normal        |
      |   vSAN release catalog up-to-date                                                           | releasecataloguptodate              | Normal        |
      +---------------------------------------------------------------------------------------------+-------------------------------------+---------------+
      | vSAN iSCSI target service                                                                   |                                     |               |
      |   Home object                                                                               | iscsihomeobjectstatustest           | Normal        |
      |   Network configuration                                                                     | iscsiservicenetworktest             | Normal        |
      |   Service runtime status                                                                    | iscsiservicerunningtest             | Normal        |
      +---------------------------------------------------------------------------------------------+-------------------------------------+---------------+
      >
      

       

      Anyone else seen this issue? Are there other alarms than those in RVC's vsan.health.silent_health_check_status causing this issue?

       

      Lars

       

      vsan.health.silent_health_check_status

       

        • 1. Re: vSAN health alarms are suppressed
          TheBobkin Virtuoso
          VMware EmployeesvExpert

          Hello Lars,

           

          "Are there other alarms than those in RVC's vsan.health.silent_health_check_status causing this issue?"

          No, they should be all there.

           

          "Anyone else seen this issue?"

          From reviewing this internally it appears to be a known issue which our engineering teams are aware of and working on resolving in a future release, I unfortunately can not currently provide a date/release in which it will be resolved - I will aim to create/delegate creation of some external documentation regarding this but for now it is safe to acknowledge/silence this alarm.

           

          Bob

          • 2. Re: vSAN health alarms are suppressed
            JasonNash Novice

            We also have this same alarm on one of our new vSAN clusters running vCenter 6.7.0 (14070654). I am able to acknowledge the alert but is there a way of restoring/enabling the vSAN related alarms?

             

            At present if an issue such as a disk failure occurs this does not trigger and alarm, the issue is only visible if you access the vSAN Health page.

             

            Edit 01/08/19

             

            I now have a workaround/fix for this one. This alert appears when the quickstart wizard is in progress/not complete. Go to "Cluster > Configure > Configuration > Quickstart > Skip Quickstart". This cleared the alarm for me and enabled the vSAN health alarms.

            3 people found this helpful
            • 3. Re: vSAN health alarms are suppressed
              larstr Virtuoso
              vExpert

              Thanks alot, Jason.

              Skip Quickstart really did the trick.

               

              Lars