VMware Horizon Community
mcrampton
Enthusiast
Enthusiast
Jump to solution

Updating NVIDIA VIBS fails with error "Device or resource busy"

Hi, we have come across an error where we are unable to get the density we should be able to on our Nvidia K1 cards. Specifically, with allocating 512MB of Video RAM to desktops, we are not approaching 64 VM's per GPU, as we should be able to. I have a case open with VMware and they have suggested that I should update my Nvidia drivers on ESXi host. Currently running 304.76-1OEM.510.0.0.802205, and I found the version 319.65-1OEM.510.0.0.802205 on the Nvidia site. If I try to run esxcli software vib install -v NVIDIA-VMware_ESXi_5.1_Host_Driver_319.65-1OEM.510.0.0.802205.vib then I get the error:

[InstallationError]

Error in running rm /tardisks/NVIDIA_V.v00:

Return code: 1

Output: rm: can't remove '/tardisks/NVIDIA_V.v00': Device or resource busy

If I try to run:

esxcli software vib remove --vibname=NVIDIA-VMware_ESXi_5.1_Host_Driver

then I get the same error.

All VM's are stopped and my host is in maintenance mode. How do I uninstall 304.76 driver so I can install 319.65 driver? Is there a service I need to stop first or something?

Reply
0 Kudos
1 Solution

Accepted Solutions
Linjo
Leadership
Leadership
Jump to solution

Here is the full procedure:

To update the NVIDIA GPU VIB, you must uninstall the currently installed VIB and install the new VIB, as described above.To uninstall the currently installed VIB:

  1. Stop all virtual machines using 3D acceleration.
  2. Place the ESXi host in maintenance mode.
  3. Open a command prompt on the ESXi host.
  4. Disable Xserver by running the command:

    /etc/init.d/xorg stop

  5. Remove the NVIDIA VMkernel driver by running the command:

    vmkload_mod -u nvidia

  6. Remove the VIB by running the command:

    esxcli software vib remove -n NVIDIA-VMware

    You can now install a newer NVIDIA GPU VIB.
Best regards, Linjo Please follow me on twitter: @viewgeek If you find this information useful, please award points for "correct" or "helpful".

View solution in original post

Reply
0 Kudos
8 Replies
Linjo
Leadership
Leadership
Jump to solution

Try stopping the xorg service:

/etc/init.d/xorg stop

Best regards, Linjo Please follow me on twitter: @viewgeek If you find this information useful, please award points for "correct" or "helpful".
mcrampton
Enthusiast
Enthusiast
Jump to solution

Ok, that worked to allow me to install the new driver. However, I cannot access GPU resources on the host.

When I run 'nvidia-smi list' I get the message:

NVIDIA: API mismatch: the NVIDIA kernel module has version 304.76,

but this NVIDIA driver component has version 319.65.  Please make

sure that the kernel module and all NVIDIA driver components have the same version.

Failed to initialize NVML: Unknown Error

The driver install said I didn't need to reboot the host, but should I reboot it anyway? Or is there something else I need to do to update the kernel module?

Reply
0 Kudos
mcrampton
Enthusiast
Enthusiast
Jump to solution

Also, I did run /etc/init.d/xorg start after the install and it said Xorg 0 through 7 started.

Reply
0 Kudos
mcrampton
Enthusiast
Enthusiast
Jump to solution

Hmm, but when I run xorg status, it says it's not started. I'm going to reboot the host and see if that resolves.

Reply
0 Kudos
Linjo
Leadership
Leadership
Jump to solution

Did you download the right driver? There is one for vSphere 5.1 and another for vSphere 5.5

Best regards, Linjo Please follow me on twitter: @viewgeek If you find this information useful, please award points for "correct" or "helpful".
Reply
0 Kudos
Linjo
Leadership
Leadership
Jump to solution

Here is the full procedure:

To update the NVIDIA GPU VIB, you must uninstall the currently installed VIB and install the new VIB, as described above.To uninstall the currently installed VIB:

  1. Stop all virtual machines using 3D acceleration.
  2. Place the ESXi host in maintenance mode.
  3. Open a command prompt on the ESXi host.
  4. Disable Xserver by running the command:

    /etc/init.d/xorg stop

  5. Remove the NVIDIA VMkernel driver by running the command:

    vmkload_mod -u nvidia

  6. Remove the VIB by running the command:

    esxcli software vib remove -n NVIDIA-VMware

    You can now install a newer NVIDIA GPU VIB.
Best regards, Linjo Please follow me on twitter: @viewgeek If you find this information useful, please award points for "correct" or "helpful".
Reply
0 Kudos
mcrampton
Enthusiast
Enthusiast
Jump to solution

I do have the right download, yes. However I did not run step 5, which could be my problem. I will try and report back. Thanks.

Reply
0 Kudos
Linjo
Leadership
Leadership
Jump to solution

If you have bad consolidation ratios I would also recommend to update the vBios on the GPU, you need to contact you oem vendor to get it. (HP, IBM, Dell etc)

Best regards, Linjo Please follow me on twitter: @viewgeek If you find this information useful, please award points for "correct" or "helpful".
Reply
0 Kudos