Nvidia Tesla M60 GPU does not show passthrough capable.

[Ryan425]

I tried to find a video card that showed to be compatible to ESXi 6.7.  We purchased the Nvidia Tesla M60.  When I go into the hardware tab it sees the video card but passthrough is grayed out and not capable...  Really hoping I'm just missing something because we thought this was one of those most compatible cards we could get and it still doesn't want to work.

The computer has a Xeon E7 v3/Xeon E5 v3/Core i7.  I have 120 items on the hardware list and not sure what I could type to help.

[IRIX201110141]

We have a couple of these in our Dell PowerEdge Servers. Can you confirm that Host deliver the necessary Power for the card?  With the base 75watt of a PCIe slot the card powered up and is visible on the Host but not usable. 

The  nvidia-smi tool on ESXI command line shows that.  Keep in mind that special BIOS settings are also required... the 12TB memory whole option or similar.

BTW.

the PCI passtrough has to be supported by the Host/System.

Regards,
Joerg

[Ryan425]

Power...  So this Y splitter that came with the M60.  There was no manual for it so I'm now trying to figure this out.  I had to use the Y splitter to get power from the power supply,  but I only plugged in 1 8-pin VGA cable.  The 2nd one is unplugged.  The card ran so I didn't think it was a problem but now that you've told me that I'm assuming I need to run a 2nd 8-pin VGA cable to the other part of the splitter.  I'm a little hesitant to until I find confirmation in a manual that I'm supposed to do that.  I didn't want to miswire and burn up the card.  Looking at it though,  I don't see any other way it would work.

[Ryan425]

Oh and by the way,  this is what I get.when I call:  nvidia-smi

NVIDIA-SMI has failed because it couldn't communicate with the NVIDIA driver. Make sure that the latest NVIDIA driver is installed and running.

It said earlier that I successfully installed the NVDIA file,  so I'm hoping I just didn't have enough power to it.

[IRIX201110141]

Again....  without enough power the card will initialize but cant use it.

1. Without right BIOS settings

nvidia-smi  reports initialization error or so

2. With the right BIOS settings but without 300 watt

nvidia-smi reports card doesnt have enough power

3. With the right BIOS settings and enough power

nvidia-smi reports card information

[root@esx-node-99:~] nvidia-smi
Thu Sep 24 21:37:49 2020
+-----------------------------------------------------------------------------+
| NVIDIA-SMI 450.55       Driver Version: 450.55       CUDA Version: N/A      |
|-------------------------------+----------------------+----------------------+
| GPU  Name        Persistence-M| Bus-Id        Disp.A | Volatile Uncorr. ECC |
| Fan  Temp  Perf  Pwr:Usage/Cap|         Memory-Usage | GPU-Util  Compute M. |
|                               |                      |               MIG M. |
|===============================+======================+======================|
|   0  Tesla M60           On   | 00000000:3D:00.0 Off |                  Off |
| N/A   32C    P8    24W / 150W |   2050MiB /  8191MiB |      0%      Default |
|                               |                      |                  N/A |
+-------------------------------+----------------------+----------------------+
|   1  Tesla M60           On   | 00000000:3E:00.0 Off |                  Off |
| N/A   28C    P8    24W / 150W |   2050MiB /  8191MiB |      1%      Default |
|                               |                      |                  N/A |
+-------------------------------+----------------------+----------------------+
+-----------------------------------------------------------------------------+
| Processes:                                                                  |
|  GPU   GI   CI        PID   Type   Process name                  GPU Memory |
|        ID   ID                                                   Usage      |
|=============================================================================|
|    0   N/A  N/A   2211221    C+G   tng-srv-94                       2031MiB |
|    1   N/A  N/A   2127311    C+G   tng-ws-w10-116                   2031MiB |
+-----------------------------------------------------------------------------+