SLCK
Contributor
Contributor

IOMMU fault type 5

Hi,

I've encountered an issue on ESXi 6.5 U1 where my vm would just power off randomly. The error i'm getting on the event log is VMware ESX unrecoverable error: (vmx) PCI passthru device 0000:86:02.0 caused an IOMMU fault type 5 at address 0x10d24a000). After that, any vm with that pcie device would not power on. Has anyone encountered this before? or does anyone know what IOMMU fault type 5 relates to?

Regards,

Sheen

Tags (1)
0 Kudos
4 Replies
DavoudTeimouri
Virtuoso
Virtuoso

Please send your hardware specifications (Details) and also ESXi build number.

Also let us know that what's the guest OS and virtual machine configuration as well.

** If you found this note/reply useful, please consider awarding points for "Correct" or "Helpful" ** Davoud Teimouri - https://www.teimouri.net - Twitter: @davoud_teimouri Facebook: https://www.facebook.com/teimouri.net/
0 Kudos
SLCK
Contributor
Contributor

Hardware config:

Supermicro X9DRG-QF (Intel Xeon E5-2640 0 @2.50GHz)

AMD FirePro S7150

VMware ESXi, 6.5.0, 5969303

Guest config:

RS2

4x1 cores, 8 GB sys mem (all reserved)

S7150VF

Attached files are the detailed host config and vm config.

Thanks

0 Kudos
Hnet1
Contributor
Contributor

hello,

i also have a firepro s7150 (s7150x2).

i have exactly the same problem.
did you find any solution for that?
googled for hours and tested all settings:

  • pciHole.start 2048..
    pcihole.end 3072...
  • firmware=“efi"...
  • pciPassthru.use64bitMMIO="TRUE"
  • pciPassthru.64bitMMIOSizeGB = “128"

nothing worked... my win10 64 bit vm always restarts when i install the "win10-64bit-radeon-pro-software-enterprise-18.q1.1-march22.exe"

i allways got hte error: "(vmx) PCI passthru device 0000:8d:02.0 caused an IOMMU fault type 5 at address 0xfffff5f000.  Powering off the virtual machine.  If the problem persists please contact the device's vendor."

can anybody help me?

thanks.

0 Kudos
gguest64
Contributor
Contributor

Hi,

I've got the same message :

2018-06-11T19:01:21.520Z| vmx| I125+ PCI passthru device 0000:00:02.0 caused an IOMMU fault type 5 at address 0x3a11728000.  Powering off the virtual machine.  If the problem persists please contact the device's vendor.

Interesting part if that it has worked for several weeks before a reboot (no configuration change). I've used the GPU without issue.

And now, it's impossible to boot the machine. I use a CentOS 7 guest VM, the VM poweroff just after grub loader.

I've used ESXi 6.5.0 and try to upgrade to ESXi 6.7, same issue with same error message.
I've a setup a new VM CentOS 7 with EFI, same issue with passthrough enabled.

Debug information :

[root@esxi:~] vmware -v

VMware ESXi 6.7.0 build-8169922

[root@esxi:~] vim-cmd hostsvc/hostsummary | grep cpuModel

      cpuModel = "Intel(R) Core(TM) i7-5557U CPU @ 3.10GHz",

[root@esxi:~] lspci -vvv

[...]

0000:00:02.0 VGA compatible controller Display controller: Intel Corporation Iris Graphics 6100

     Class 0300: 8086:162b

[root@esxi:~] esxcli hardware cpu global get

   CPU Packages: 1

   CPU Cores: 2

   CPU Threads: 4

   Hyperthreading Active: true

   Hyperthreading Supported: true

   Hyperthreading Enabled: true

   HV Support: 3

   HV Replay Capable: false

   HV Replay Disabled Reasons: incompatible CPU

[root@esxi:~] esxcfg-info

+Host :

   \==+Hardware Info :

      |----BIOS UUID................................................0x3 0x0 0x2 0x0 0x4 0x0 0x5 0x0 0x0 0x6 0x0 0x7 0x0 0x8 0x0 0x9

      |----BIOS Vendor..............................................American Megatrends Inc.

      |----BIOS Version.............................................5.6.5

      |----BIOS ReleaseDate.........................................2015-08-29T00:00:00

[...]

      \==+PCI Info :

         \==+All Pci Devices :

[...]
            \==+PCI Device :

               |----Segment.........................................0x0000

               |----Bus.............................................0x00

               |----Slot............................................0x02

               |----Function........................................0x00

               |----Runtime Owner...................................VM passthru

               |----Has Configured Owner............................true

               |----Configured Owner................................VM passthru

               |----Vendor Id.......................................0x8086

               |----Device Id.......................................0x162b

               |----Sub-Vendor Id...................................0x8086

               |----Sub-Device Id...................................0x162b

               |----Vendor Name.....................................Intel Corporation

               |----Device Name.....................................Iris Graphics 6100

               |----Device Class....................................768

               |----Device Class Name...............................VGA compatible controller

               |----PIC Line........................................11

               |----Old IRQ.........................................255

               |----Vector..........................................0

               |----PCI Pin.........................................0

               |----Spawned Bus.....................................0

               |----Flags...........................................13313

               \==+BAR Info :

                  \==+BAR0 :

                     |----Type......................................0x00000003

                     |----Address...................................0x00000000f6000000

                     |----Size......................................16777216

                     |----Flags.....................................0x00000004

                  \==+BAR1 :

                     |----Type......................................0x00000004

                     |----Address...................................0

                     |----Size......................................0

                     |----Flags.....................................0

                  \==+BAR2 :

                     |----Type......................................0x00000003

                     |----Address...................................0x00000000e0000000

                     |----Size......................................268435456

                     |----Flags.....................................0x0000000c

                  \==+BAR3 :

                     |----Type......................................0x00000004

                     |----Address...................................0

                     |----Size......................................0

                     |----Flags.....................................0

                  \==+BAR4 :

                     |----Type......................................0x00000001

                     |----Address...................................0x000000000000f000

                     |----Size......................................64

                     |----Flags.....................................0x00000001

                  \==+BAR5 :

                     |----Type......................................0

                     |----Address...................................0

                     |----Size......................................0

                     |----Flags.....................................0

               |----Module Id.......................................17

               |----Chassis.........................................0

               |----Physical Slot...................................4294967295

               |----Numa Node.......................................4294967295

               |----VmKernel Device Name............................

               |----Slot Description................................ Onboard IGD

               |----Device Layer Bus Address........................m00008301

               |----Passthru Disabled...............................false

               |----Passthru Capable................................true

               |----Parent Device...................................

               |----Dependent Device................................PCI 0:0:2:0

               |----Reset Method....................................1

               |----FPT Shareable...................................true

Thank you very much.

0 Kudos