1 4 5 6 7 8 Previous Next 202 Replies Latest reply on May 30, 2016 1:14 PM by kazimnaim Go to original post
      • 75. Re: Nvidia Quadro <3 vSphere 5.1?
        winjet1 Novice

        If you are using View 5.2 (which supports graphics virtualization) you should be on at least ESXi build 838463 (5.1.0a).

         

        https://my.vmware.com/web/vmware/details?downloadGroup=VCL-VSP510-ESXI-510A-EN&productId=320&rPId=3540

        • 76. Re: Nvidia Quadro <3 vSphere 5.1?
          siggebasse Novice

          It is now upgraded to ESXi build 838463.  I still cant start xorg with this command "/etc/init.d/xorg start"

           

          gpuvm -> still no result 

           

          Esxcli software vib install –v /path-to-vib/name-of-vib.vib ->

          Installation Result
             Message: Host is not changed.
             Reboot Required: false
             VIBs Installed:
             VIBs Removed:
             VIBs Skipped: NVIDIA_bootbank_NVIDIA-VMware_ESXi_5.1_Host_Driver_304.76-1OEM.510.0.0.802205

          esxcli software vib list | grep NVIDIA->

          NVIDIA-VMware_ESXi_5.1_Host_Driver  304.76-1OEM.510.0.0.802205          NVIDIA  VMwareAccepted    2013-04-04

           

          Esxcli system module load –module nvidia -> "esxcli system module load –m nvidia"  i use "-m" instead

          Unable to load module /usr/lib/vmware/vmkmod/nvidia: Busy

           

          Esxcli hardware pci list –c 0x300 –m 0xff ->

          000:004:00.0
             Address: 000:004:00.0
             Segment: 0x0000
             Bus: 0x04
             Slot: 0x00
             Function: 0x00
             VMkernel Name:
             Vendor Name: Matrox Graphics, Inc.
             Device Name: G200eR2
             Configured Owner: Unknown
             Current Owner: VMkernel
             Vendor ID: 0x102b
             Device ID: 0x0534
             SubVendor ID: 0x1014
             SubDevice ID: 0x0405
             Device Class: 0x0300
             Device Class Name: VGA compatible controller
             Programming Interface: 0x00
             Revision ID: 0x00
             Interrupt Line: 0x0b
             IRQ: 11
             Interrupt Vector: 0x21
             PCI Pin: 0x78
             Spawned Bus: 0x00
             Flags: 0x0221
             Module ID: -1
             Module Name: None
             Chassis: 0
             Physical Slot: 0
             Slot Description: Matrox G200
             Passthru Capable: true
             Parent Device: PCI 0:3:0:0
             Dependent Device: PCI 0:3:0:0
             Reset Method: Bridge reset
             FPT Sharable: true

           

          000:08b:00.0
             Address: 000:08b:00.0
             Segment: 0x0000
             Bus: 0x8b
             Slot: 0x00
             Function: 0x00
             VMkernel Name:
             Vendor Name: NVIDIA Corporation
             Device Name: NVIDIAQuadro 4000
             Configured Owner: Unknown
             Current Owner: VMkernel
             Vendor ID: 0x10de
             Device ID: 0x06dd
             SubVendor ID: 0x10de
             SubDevice ID: 0x0780
             Device Class: 0x0300
             Device Class Name: VGA compatible controller
             Programming Interface: 0x00
             Revision ID: 0xa3
             Interrupt Line: 0xff
             IRQ: 255
             Interrupt Vector: 0x61
             PCI Pin: 0x28
             Spawned Bus: 0x00
             Flags: 0x0201
             Module ID: -1
             Module Name: None
             Chassis: 0
             Physical Slot: 5
             Slot Description: PCI-Express Slot 5
             Passthru Capable: true
             Parent Device: PCI 0:128:2:2
             Dependent Device: PCI 0:128:2:2
             Reset Method: Bridge reset
             FPT Sharable: true

           

          nvidia-smi->

          Failed to initialize NVML: Unknown Error

           

          conclusion = no differents. I really can´t figure it out. 

          • 77. Re: Nvidia Quadro <3 vSphere 5.1?
            winjet1 Novice

            Try to start it from vSphere.  It took about 5 minutes for mine to start up.

             

            Also check to make sure you put the VIB in as an extension and not a patch.

            • 78. Re: Nvidia Quadro <3 vSphere 5.1?
              siggebasse Novice

              What do you mean by "put the VIB in as an extension and not a patch"?

              • 79. Re: Nvidia Quadro <3 vSphere 5.1?
                winjet1 Novice

                If you used UpdateManager you can create a baseline to install the nvidia drivers (.zip file).  You want to make sure you select the option of extension and not patch when asked.

                 

                With XORG not starting that usually is a driver installation problem (maybe indicated by the "skipped" category?).

                • 80. Re: Nvidia Quadro <3 vSphere 5.1?
                  siggebasse Novice

                  Well the VIB is already loaded that why its skipped.  I find intformation level very poor about whats going on. Its dead end street. I will try the bios update and the vmware support.

                   

                  Thx for the help so far!

                  • 81. Re: Nvidia Quadro <3 vSphere 5.1?
                    siggebasse Novice

                    I downloaded the CIM update from IBM packed that incl  ESXi 5.1 Patch 2, build 1021289.

                    ESXi 5.1 Patch 22013-03-071021289N/A

                     

                     

                     

                     

                    http://www-933.ibm.com/support/fixcentral/systemx/downloadFixes?parent=System+x3650+M4&product=ibm/systemx/7915&&platform=All&function=fixId&fixids=ibm_sw_hyper_provbundv1_vmwaresx51_32-64&includeRequisites=1&includeSupersedes=0&downloadMethod=http

                     

                    That trigged it to work. Have a nice weekend!

                    • 82. Re: Nvidia Quadro <3 vSphere 5.1?
                      Linjo Champion
                      User Moderators

                      Great news! (Sorry for the lack or respons from me, been out travelling for a few days...)

                       

                      // Linjo

                      • 83. Re: Nvidia Quadro <3 vSphere 5.1?
                        bdx0 Lurker

                        Can someone please specify some sort of semi-formal checklist needed in order to get xorg started as well as the nvidia module loaded, also in what order the operations need to be performed to get things functoning correctly concerning gpu acceleration?

                         

                        Thanks!!

                        • 84. Re: Nvidia Quadro <3 vSphere 5.1?
                          Bhargava_Shrivathsa Novice

                          Ensure the following

                          • GPU installed should not be primary display. It should be secondary display.
                          • GPU should not be pass through.
                          • Then start xorg. Restart and check should be running.
                          • Then install nvidia VIB file in order to achieve vSGA.
                          • 85. Re: Nvidia Quadro <3 vSphere 5.1?
                            Bhargava_Shrivathsa Novice

                            Hi Guys,

                             

                            In our environment we are using Auto CAD and Revit. We have achieved vSGA but not working as expected.

                             

                            GPU performance state varies from P0 to P12.

                             

                            Performance State of nvidia GPU

                            The current performance state for the GPU. States range from P0 (maximum performance) to P12 (mini-mum performance).

                             

                            Now we need set GPU performance to P0. In order to get maximum performance of nvidia GPU.

                             

                            Thanks in advance

                            • 86. Re: Nvidia Quadro <3 vSphere 5.1?
                              Linjo Champion
                              User Moderators

                              Hi.

                               

                              Could you tell us some more about your setup?

                               

                              1. What OS are you running on the client and virtual desktop?

                              2. How is the virtual desktop configures? vCPUs, Memory and vRAM?

                              3. What GPU are you using and what driver-version?

                              4. What ESX builds?

                              5. How did you verify that vSGA is working properly?

                              6. Do you experince the same if you are accessing the vCenter console?

                              7. How do you measure and detect that the performance is changing? Are you using some tool in the desktop?

                              8. How many vm:s are sharing the GPU?

                              9. Could you post an output from the command: "nvidia-smi" from a console session on the host?

                               

                              Thanks.

                              Linjo

                              • 87. Re: Nvidia Quadro <3 vSphere 5.1?
                                Bhargava_Shrivathsa Novice

                                Could you tell us some more about your setup?

                                Environment is running on all latest patches and latest build of ESXi 5.1 with VMware View 5.2

                                 

                                1. What OS are you running on the client and virtual desktop?

                                Client is Dell P25. VM OS windows 7 x64.

                                1. How is the virtual desktop configures? vCPUs, Memory and vRAM?

                                VMs are fully cloned and manual pool. 2v CPU, 16 GB RAM and 512MB vRAM.

                                1. What GPU are you using and what driver-version?

                                Nvidia Quadro 4000.  Driver version NVD.NVIDIA_bootbank_NVIDIA-VMware_304.76-1OEM.510.0.0.802205-999851.

                                1. What ESX builds?

                                ESXi,5.1.0,1021289

                                1. How did you verify that vSGA is working properly?

                                By entering following commands and you see the current status as well

                                ~ # gpuvm

                                Xserver unix:0, GPU maximum memory 2076672KB

                                        pid 10428, VM "SME-VW-36", reserved 262144KB of GPU memory.

                                        pid 11030, VM "SME-VW-24", reserved 262144KB of GPU memory.

                                        pid 11063, VM "SME-VW-34", reserved 262144KB of GPU memory.

                                        pid 11088, VM "SME-VW-52", reserved 262144KB of GPU memory.

                                        pid 11114, VM "SME-VW-54", reserved 262144KB of GPU memory.

                                        pid 11131, VM "SME-VW-56", reserved 262144KB of GPU memory.

                                        GPU memory left 503808KB.

                                Xserver unix:1, GPU maximum memory 2076672KB

                                        pid 11013, VM "SME-VW-23", reserved 262144KB of GPU memory.

                                        pid 11049, VM "SME-VW-32", reserved 262144KB of GPU memory.

                                        pid 11076, VM "SME-VW-51", reserved 262144KB of GPU memory.

                                        pid 11101, VM "SME-VW-53", reserved 262144KB of GPU memory.

                                        pid 11118, VM "SME-VW-55", reserved 262144KB of GPU memory.

                                        pid 11144, VM "SME-VW-72", reserved 131072KB of GPU memory.

                                        GPU memory left 634880KB.

                                 

                                ~ # nvidia-smi

                                Tue Apr  9 07:00:25 2013

                                +------------------------------------------------------+

                                | NVIDIA-SMI 4.304.76   Driver Version: 304.76         |

                                |-------------------------------+----------------------+----------------------+

                                | GPU  Name                     | Bus-Id        Disp.  | Volatile Uncorr. ECC |

                                | Fan  Temp  Perf  Pwr:Usage/Cap| Memory-Usage         | GPU-Util  Compute M. |

                                |===============================+======================+======================|

                                |   0  Quadro 4000              | 0000:05:00.0     Off |                  N/A |

                                | 38%   84C    P1    N/A /  N/A |  20%  406MB / 2047MB |     12%      Default |

                                +-------------------------------+----------------------+----------------------+

                                |   1  Quadro 4000              | 0000:42:00.0     Off |                  N/A |

                                | 36%   73C    P1    N/A /  N/A |  32%  662MB / 2047MB |      0%      Default |

                                +-------------------------------+----------------------+----------------------+

                                 

                                +-----------------------------------------------------------------------------+

                                | Compute processes:                                               GPU Memory |

                                |  GPU       PID  Process name                                     Usage      |

                                |=============================================================================|

                                |  No running compute processes found                                         |

                                +-----------------------------------------------------------------------------+

                                ~ #

                                 

                                1. Do you experince the same if you are accessing the vCenter console?

                                Yes even on RDP as well. We can see that each GPU is handling 5-6 VMs but there is no such GPU utilization is happening.

                                1. How do you measure and detect that the performance is changing? Are you using some tool in the desktop?

                                We can detect performance by open GL tools we are getting 30FPS. But 3D application will take too long to perform certain tasks.

                                1. How many vm:s are sharing the GPU?

                                As you can see above 5-6. Max we can allocate per VM is 256. 256 will be s/w GPU and another 256 will be h/w GPU.

                                1. Could you post an output from the command: "nvidia-smi" from a console session on the host?

                                                You can find it in 5th answer

                                • 88. Re: Nvidia Quadro <3 vSphere 5.1?
                                  Linjo Champion
                                  User Moderators

                                  Thanks for the information, great stuff!

                                   

                                  Could you try this registry change on the VM:

                                  [HKEY_LOCAL_MACHINE\SOFTWARE\VMware, Inc.\VMware SVGA DevTap]

                                  “MaxAppFrameRate”=dword:00000000

                                   

                                  (If it does not exist it defaults to 30. Set it to 0 to disable any frame cap.)

                                   

                                  // Linjo

                                  • 89. Re: Nvidia Quadro <3 vSphere 5.1?
                                    Bhargava_Shrivathsa Novice

                                    Thanks

                                     

                                    Kindly confirm as we are using x64 bit OS. Do we have to create 32 bit DWORD or 64 bit. It should be hexadecimal / decimal.

                                     

                                    I tried with 32 it didn’t help me.

                                     

                                    Currently if we observer GPU performance state is varying from P1 to P12. Here I am trying to set for P0 that is maximum value / maximum performance state.

                                     

                                    Can you help me out with this

                                    1 4 5 6 7 8 Previous Next