3 Replies Latest reply on Feb 13, 2019 7:28 PM by DonDavid

    NSX Host Preparation fails if not enough disk space

    ferdis Hot Shot
    ferdis Jul 25, 2018 5:18 AM

      Today I have fixed failed process of NSX 6.4 Host Preparation on Nested vSAN ESXi hosts in my Lab. Software versions used NSX 6.4.0 Build 7564187 / vSphere 6.5.0.13000 Build 7515524.

      I have originally stripped ESXi hosts to minimum possible configuration. For each nested ESXi installation I have used 5GB Disk. For vSAN datastore I have used one 7 GB Disk as Cache Tier and two 10GB disks for Capacity Tier per each nested ESXi host in 3 node vSAN Cluster. As far as vSAN was tested it worked perfectly fine.

       

       

      Problem appeared when I tried to prepare same nested hosts for NSX. First I have successfully deployed NSX Manager and Controller. Then I initiated Host Preparation for NSX on each nested ESXi. It scanned nested ESXi hosts then proceeded with Install task but didnt proceed with Install agent Task on ESXi hosts (as you can see on picture).

       

      NSX Host Preparation Install agent Task didnt proceed on nested ESXi hosts

       

      In /var/log/esxupdate.log there was this message:

      2018-07-25T07:25:35Z esxupdate: 79906: esxupdate: ERROR: vmware.esximage.Errors.LiveInstallationError: ([], "Error in running ['/etc/init.d/netcpad', 'start', 'install']:\nReturn code: 1\nOutput: ERROR: ld.so: object '/lib/libMallocArenaFix.so' from LD_PRELOAD cannot be preloaded: ignored.\nFailed to set memory reservation for netcpa, retrying...

       

       

      After some troubleshooting + googling for similar error messages I have created fresh new nested ESXi without vSAN. I have created bigger 40GB local disk to be sure there is enough space. And voilà suddenly magically NSX Host Preparation finished successfully.

       

      Successful NSX Host Preparation on fresh new nested ESXi with proper size of local disk

        • 1. Re: NSX Host Preparation fails if not enough disk space
          latelanzh Lurker
          latelanzh Jul 28, 2018 12:51 AM (in response to ferdis)

          Or maybe not enough memory of host, I have fixed the similar problem with  memory addition.

           

          [root@sa-esxi-02:~] esxcli software vib install -d /tmp/vxlan.zip  --force

          [LiveInstallationError]

          Error in running ['/etc/init.d/vShield-Stateful-Firewall', 'start', 'install']:

          Return code: 1

          Output: vShield-Stateful-Firewall is not running

          watchdog-dfwpktlogs: PID file /var/run/vmware/watchdog-dfwpktlogs.PID does not exist

          watchdog-dfwpktlogs: Unable to terminate watchdog: No running watchdog process for dfwpktlogs

          ERROR: ld.so: object '/lib/libMallocArenaFix.so' from LD_PRELOAD cannot be preloaded: ignored.

          Failed to release memory reservation for vsfwd

          Resource pool 'host/vim/vmvisor/vsfwd' release failed. retrying..

          Resource pool 'host/vim/vmvisor/vsfwd' release failed. retrying..

          Resource pool 'host/vim/vmvisor/vsfwd' release failed. retrying..

          Resource pool 'host/vim/vmvisor/vsfwd' release failed. retrying..

          Resource pool 'host/vim/vmvisor/vsfwd' release failed. retrying..

          Set memory minlimit for vsfwd to 512MB

          ERROR: ld.so: object '/lib/libMallocArenaFix.so' from LD_PRELOAD cannot be preloaded: ignored.

          Failed to set memory reservation for vsfwd to 512MB

          ERROR: ld.so: object '/lib/libMallocArenaFix.so' from LD_PRELOAD cannot be preloaded: ignored.

          Failed to release memory reservation for vsfwd

          Resource pool 'host/vim/vmvisor/vsfwd' released.

          Resource pool creation failed. Not starting vShield-Stateful-Firewall

          It is not safe to continue. Please reboot the host immediately to discard the unfinished update.

          Please refer to the log file for more details.

          • 2. Re: NSX Host Preparation fails if not enough disk space
            shind0chaa Lurker
            shind0chaa Feb 1, 2019 8:53 AM (in response to ferdis)

            I was in the same place when building POC in someones homelab.

             

            As latelanzh confirmed its just due to low memory, I was using nested esxi with 6GB RAM, up'd first host to 8GB and it worked and tried another nested esxi with 7GB and that worked too.

            • 3. Re: NSX Host Preparation fails if not enough disk space
              DonDavid Lurker
              VMware Employees
              DonDavid Feb 13, 2019 7:28 PM (in response to ferdis)

              Yep, adding more memory to my nested ESXi hosts did the trick as well!