1 2 3 Previous Next 275 Replies Latest reply on Dec 17, 2014 11:39 PM by ripeed

    Esxi 5.1 pci passthrough broken

    HellMind Novice

      I got a purple screen when I start up a vm with a pci device

       

      http://ft.trillian.im/940e0c6710303f7966cf57a2bcc043251745ed62/6aBIiJHevbPWvWRlZ3Q8XDKJCNbhS.jpg

       

       

      With Esxi5 was working fine.

       

       

      I tested it with 2 vm on different hosts ( but same hardware)

       

      http://ft.trillian.im/940e0c6710303f7966cf57a2bcc043251745ed62/6aBIHwqu0xJF5VWcS7HooQWupa9Ly.jpg

       

      http://ft.trillian.im/940e0c6710303f7966cf57a2bcc043251745ed62/6aBIODLiCWadA8FYb57ZlMvwVctSh.jpg

       

       

      http://ft.trillian.im/940e0c6710303f7966cf57a2bcc043251745ed62/6aBIWlBZlQXgImSaCnmpX2necw5yb.jpg

       

      i7 2600 32gb

      mb: dq67sw

       

      What can I try

        • 1. Re: Esxi 5.1 pci passthrough broken
          HellMind Novice

          fixing up photos

           

          http://fastdown.com.ar/1.jpg

           

           

          http://fastdown.com.ar/2.jpg

           

           

           

          http://fastdown.com.ar/3.jpg

           

           

          http://fastdown.com.ar/4.jpg

          • 2. Re: Esxi 5.1 pci passthrough broken
            RandomUser1234 Novice

            I second that. I'm getting a similar purple screen of death (nearly identical stack-trace) with 5.1.

             

            Esxi 5.0 up to the latest patch-level worked fine.

             

            Hardware:

            MB: Intel DQ35JO

            PCIe devices passed through:

            2x JMicron JMB363 sata/ide controller

            1x Intel 82541PI Network card

            1x LSI Megaraid 9240-8i sas/sata controller

            • 3. Re: Esxi 5.1 pci passthrough broken
              dariusd Virtuoso
              VMware EmployeesUser Moderators

              Hi HellMind,

               

              We've isolated the problem and have an internal bug report open to track the fix.

               

              The problem should (mostly?) only affect PCI devices as opposed to PCIe devices; I would expect that your onboard SATA controller should be PCIe, but we generally don't support PCI[e] passthrough of motherboard devices.  You may have to wait for an update/patch with a fix for the issue and see if it allows you to pass-through your SATA controller again.

              --

              Darius

              • 4. Re: Esxi 5.1 pci passthrough broken
                dariusd Virtuoso
                User ModeratorsVMware Employees

                Hi RandomUser1234,

                 

                Is your Intel 82541PI NIC really PCIe?  My quick google search seemed to indicate that it is PCI.

                 

                We've isolated the cause of the problem, but AFAICT it should only affect PCI devices.  Is it possible for you to test whether temporarily disabling passthrough for your Intel 82541PI NIC allows you to power on VMs?

                --

                Darius

                • 5. Re: Esxi 5.1 pci passthrough broken
                  RandomUser1234 Novice

                  Hi Darius,

                   

                  thanks for the quick response. Indeed the Intel 82541PI NIC is a PCI addon card. Sorry for that inaccuracy. The rest of the devices are PCIe addon cards. I will try to start the guest-VM without the PCI NIC to see whether this prevents the crash.

                  • 6. Re: Esxi 5.1 pci passthrough broken
                    RandomUser1234 Novice

                    Darius Davis schrieb:

                     

                    [...] we generally don't support PCI[e] passthrough of motherboard devices.  You may have to wait for an update/patch with a fix for the issue and see if it allows you to pass-through your SATA controller again.

                    --

                    Darius

                     

                    I have been using the onboard sata controller (Intel ICH) on another server for the past year now and it always worked fine. Please tell me this won't change now. Passthrough in general and passthrough of onboard components in particular are some of the best features of the vmware hypervisor (for me anyways).

                    • 7. Re: Esxi 5.1 pci passthrough broken
                      RandomUser1234 Novice

                      RandomUser1234 schrieb:

                       

                      [...] I will try to start the guest-VM without the PCI NIC to see whether this prevents the crash.

                       

                      I can confirm with the PCI NIC taken out of the guest-VMs config the host doesn't crash anymore.

                      • 8. Re: Esxi 5.1 pci passthrough broken
                        dariusd Virtuoso
                        User ModeratorsVMware Employees

                        Hi RandomUser1234,

                         

                        Don't panic... there is a lot of gear that lives somewhere between works and supported, and the device in question here probably falls into that space: expected to be working even if we don't explicitly test and support that configuration.  I seem to recall the existence of a short-ish official list of compatible PCI[e] passthrough devices, those being the ones we fully test, certify/qualify, and support, but we broadly expect passthrough to work with a much wider range of devices than given on that list.

                         

                        Having said that, motherboard devices can be difficult to properly pass through – in particular motherboard SATA controllers – since they are essentially an integrated part of the host platform and don't always cleanly "untangle" for passthrough.  It often ends up working just fine, but some configurations can't be sensibly made to work.  It's somewhat more likely that a PCI[e] passthrough scenario will be successful if add-in PCI[e] cards are used instead of motherboard devices.

                         

                        Even though HellMind's configuration is (to my understanding) not supported, I'm quite confident that the cause of the problem there is the same, such that it will be addressed by the same fix that will take care of the other affected PCI devices.

                         

                        Hope that helps!

                        --

                        Darius

                        • 9. Re: Esxi 5.1 pci passthrough broken
                          RandomUser1234 Novice

                          Hi Darius,

                           

                          thank you for this piece of information. It's much apprectiated.

                           

                          Btw. I tested 5.1 on the second host (the one with the onboard sata controller) - it also crashes (see screenshot attached).

                           

                          System details:

                          MB: Intel S3200SHLC

                          Devices passed through (also see 2nd attachment):

                          1x Onboard Intel NIC 82566DM-2 (according to tech. specs. from intel it is connected to the ICH9R SB via something called GLCI/LCI)

                          1x Onboard Intel sata AHCI controller (part of the ICH9R SB)

                          2x LSI 9211-8i sas/sata controllers (PCIe addin cards)

                           

                          Matthias

                          • 10. Re: Esxi 5.1 pci passthrough broken
                            MrFabius Lurker

                            Same here. After 2 hours fighting with 5.1 and my MB. I discovered this tread.

                            Exactly the same problem. Passthrough was working perfectly wit ESXi 5.0u1.

                            Now, as soon as I start a vm with attached my on-board sata passtrough device I get the pink screen.

                            My Spec:

                            MB Supermicro X8STi with:

                            Intel ICH10R SATA (3.0Gbps) Controller.

                            The passthrough device is the on-board SATA ICH10R.

                            Had to roll back to ESXi 5.0u1. Can't live without the sata.

                            Kind Regards

                            • 11. Re: Esxi 5.1 pci passthrough broken
                              srwsol Enthusiast

                              Another aspect of this problem, I think, is that you can no longer assign a USB controller as a passthrough device.  It shows in the list of eligible devices and both the vcenter 5.1 web gui and the vsphere client allow you to select a USB controller as a passthrough device, but when you reboot ESXi the USB controller is still assigned to ESXi as if you had never selected it.  If you select other devices at the same time they are correctly marked as passthrough devices after the reboot so this isn't a user interface problem.  During the limited time I played with it, on an Intel DQ77KB motherboard, I did notice that there were more devices listed as eligible for passthrough, and the description of what each device is was better (some devices on this motherboard under 5.0u1 showed as "unknown").

                              • 12. Re: Esxi 5.1 pci passthrough broken
                                sofakng Enthusiast

                                I'm having this EXACT same problem.

                                 

                                When using ESXi 5.0, I was able to pass the entire USB controller to a guest, but like srwsol mentioned, in ESXi 5.1 you can select the controller for pass-through but after rebooting it is no longer selected for pass-through.

                                 

                                Hope this gets fixed ASAP as this is critical for one of my hosts...

                                 

                                EDIT: I believe the USB controllers are PCI (and not PCIe) devices so it makes sense that these are affected by the same bug.

                                 

                                Is there a bug or ticket number that I can track to see the progress of getting this fixed?

                                • 13. Re: Esxi 5.1 pci passthrough broken
                                  fusionken Enthusiast

                                  Probably related to the same thing I am seeing: http://communities.vmware.com/thread/418224

                                  • 14. Re: Esxi 5.1 pci passthrough broken
                                    FastLaneJB Novice

                                    Also can not longer pass an entire USB controller through to a guest. I need this for a VM to function correctly but I was also looking at deploying Server 2012 VM's which while they work on 5.0U1 are a tech preview.

                                     

                                    I've tried a PCI Express USB 3.0 card and also the on board USB controller, both select and it reboots to them being unelected again. Both worked fine on 5.0.

                                     

                                    Any idea when the PCI Passthrough will be fixed so it works like it did in 5.0 as it was flawless in that version.

                                    1 2 3 Previous Next