VMware Cloud Community
A_Vorderegger
Contributor
Contributor

SCSI attached tape drives connected to guest through ESXi host crash

Hi all,


We've got an issue where our HP LTO3 SCSI attached tape drives connected to an ESXi guest via paravirtual SCSI controller are throwing kernel errors and ultimately being sent offline after issuing command to them such as:


mt -f /dev/nst0 status


The command just hangs and cannot cntrl C or Z out of it.

Rather than an problem with the actual tape drives, at this stage I am under the impression that the SCSI host adapter is in fact responsible as it sends both the tape drives in our MSL4048 tape library offline, one after the other.

Sep  2 15:23:02 abackupserver kernel: st 2:0:2:0: Device offlined - not ready after error recovery

Sep  2 15:27:03 abackupserver kernel: st 2:0:3:0: Device offlined - not ready after error recovery

Sep  2 15:47:29 abackupserver kernel: st 2:0:2:0: Device offlined - not ready after error recovery

Sep  2 15:51:30 abackupserver kernel: st 2:0:3:0: Device offlined - not ready after error recovery

Sep  2 16:43:42 abackupserver kernel: st 2:0:2:0: Device offlined - not ready after error recovery

Sep  2 16:47:43 abackupserver kernel: st 2:0:3:0: Device offlined - not ready after error recovery

The devices are attached to the guest vm as follows:

abackupserver.fm.internal settings.png

DMESG from the ESXi guest (abackupserver):

Sep  4 10:37:29 abackupserver kernel: SCSI subsystem initialized

Sep  4 10:37:29 abackupserver kernel: usbcore: registered new interface driver usbfs

Sep  4 10:37:29 abackupserver kernel: usbcore: registered new interface driver hub

Sep  4 10:37:29 abackupserver kernel: usbcore: registered new device driver usb

Sep  4 10:37:29 abackupserver kernel: PCI: Using ACPI for IRQ routing

Sep  4 10:37:29 abackupserver kernel: NetLabel: Initializing

Sep  4 10:37:29 abackupserver kernel: NetLabel:  domain hash size = 128

Sep  4 10:37:29 abackupserver kernel: NetLabel:  protocols = UNLABELED CIPSOv4

Sep  4 10:37:29 abackupserver kernel: NetLabel:  unlabeled traffic allowed by default

Sep  4 10:37:29 abackupserver kernel: hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0

Sep  4 10:37:29 abackupserver kernel: hpet0: 16 comparators, 64-bit 14.318180 MHz counter

Sep  4 10:37:29 abackupserver kernel: Switching to clocksource tsc

Sep  4 10:37:29 abackupserver kernel: pnp: PnP ACPI init

Sep  4 10:37:29 abackupserver kernel: ACPI: bus type pnp registered

Sep  4 10:37:29 abackupserver kernel: pnp: PnP ACPI: found 14 devices

Sep  4 10:37:29 abackupserver kernel: ACPI: ACPI bus type pnp unregistered

Sep  4 10:37:29 abackupserver kernel: system 00:01: ioport range 0x1000-0x103f has been reserved

Sep  4 10:37:29 abackupserver kernel: system 00:01: ioport range 0x1040-0x104f has been reserved

Sep  4 10:37:29 abackupserver kernel: system 00:01: ioport range 0xcf0-0xcf1 has been reserved

Sep  4 10:37:29 abackupserver kernel: system 00:08: iomem range 0xfed00000-0xfed003ff has been reserved

Sep  4 10:37:29 abackupserver kernel: system 00:0d: ioport range 0xfce0-0xfcff has been reserved

Sep  4 10:37:29 abackupserver kernel: system 00:0d: iomem range 0xf0000000-0xf7ffffff has been reserved

Sep  4 10:37:29 abackupserver kernel: system 00:0d: iomem range 0xfe800000-0xfe9fffff has been reserved

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:15.3: BAR 13: can't allocate I/O resource [0x1000-0x1fff]

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:15.4: BAR 13: can't allocate I/O resource [0x1000-0x1fff]

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:15.5: BAR 13: can't allocate I/O resource [0x1000-0x1fff]

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:15.6: BAR 13: can't allocate I/O resource [0x1000-0x1fff]

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:15.7: BAR 13: can't allocate I/O resource [0x1000-0x1fff]

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:16.3: BAR 13: can't allocate I/O resource [0x1000-0x1fff]

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:16.4: BAR 13: can't allocate I/O resource [0x1000-0x1fff]

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:16.5: BAR 13: can't allocate I/O resource [0x1000-0x1fff]

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:16.6: BAR 13: can't allocate I/O resource [0x1000-0x1fff]

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:16.7: BAR 13: can't allocate I/O resource [0x1000-0x1fff]

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:17.3: BAR 13: can't allocate I/O resource [0x1000-0x1fff]

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:17.4: BAR 13: can't allocate I/O resource [0x1000-0x1fff]

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:17.5: BAR 13: can't allocate I/O resource [0x1000-0x1fff]

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:17.6: BAR 13: can't allocate I/O resource [0x1000-0x1fff]

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:17.7: BAR 13: can't allocate I/O resource [0x1000-0x1fff]

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:18.2: BAR 13: can't allocate I/O resource [0x1000-0x1fff]

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:18.3: BAR 13: can't allocate I/O resource [0x1000-0x1fff]

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:18.4: BAR 13: can't allocate I/O resource [0x1000-0x1fff]

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:18.5: BAR 13: can't allocate I/O resource [0x1000-0x1fff]

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:18.6: BAR 13: can't allocate I/O resource [0x1000-0x1fff]

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:18.7: BAR 13: can't allocate I/O resource [0x1000-0x1fff]

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:01.0: PCI bridge to [bus 01-01]

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:01.0: PCI bridge, secondary bus 0000:01

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:01.0:   bridge window [io  disabled]

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:01.0:   bridge window [mem disabled]

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:01.0:   bridge window [mem pref disabled]

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:11.0: PCI bridge to [bus 02-02]

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:11.0: PCI bridge, secondary bus 0000:02

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:11.0:   bridge window [0x2000-0x3fff]

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:11.0:   bridge window [0xfd600000-0xfdffffff]

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:11.0:   bridge window [0xebb00000-0xebffffff]

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:15.0: PCI bridge to [bus 03-03]

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:15.0: PCI bridge, secondary bus 0000:03

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:15.0:   bridge window [0x4000-0x4fff]

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:15.0:   bridge window [0xfd500000-0xfd5fffff]

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:15.0:   bridge window [0xeba00000-0xebafffff]

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:15.1: PCI bridge to [bus 04-04]

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:15.1: PCI bridge, secondary bus 0000:04

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:15.1:   bridge window [0x8000-0x8fff]

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:15.1:   bridge window [0xfd100000-0xfd1fffff]

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:15.1:   bridge window [0xeb600000-0xeb6fffff]

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:15.2: PCI bridge to [bus 05-05]

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:15.2: PCI bridge, secondary bus 0000:05

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:15.2:   bridge window [0xc000-0xcfff]

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:15.2:   bridge window [0xfcd00000-0xfcdfffff]

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:15.2:   bridge window [0xeb200000-0xeb2fffff]

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:15.3: PCI bridge to [bus 06-06]

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:15.3: PCI bridge, secondary bus 0000:06

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:15.3:   bridge window [io  disabled]

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:15.3:   bridge window [0xfc900000-0xfc9fffff]

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:15.3:   bridge window [0xeae00000-0xeaefffff]

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:15.4: PCI bridge to [bus 07-07]

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:15.4: PCI bridge, secondary bus 0000:07

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:15.4:   bridge window [io  disabled]

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:15.4:   bridge window [0xfc500000-0xfc5fffff]

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:15.4:   bridge window [0xeaa00000-0xeaafffff]

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:15.5: PCI bridge to [bus 08-08]

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:15.5: PCI bridge, secondary bus 0000:08

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:15.5:   bridge window [io  disabled]

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:15.5:   bridge window [0xfc100000-0xfc1fffff]

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:15.5:   bridge window [0xea600000-0xea6fffff]

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:15.6: PCI bridge to [bus 09-09]

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:15.6: PCI bridge, secondary bus 0000:09

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:15.6:   bridge window [io  disabled]

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:15.6:   bridge window [0xfbd00000-0xfbdfffff]

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:15.6:   bridge window [0xea200000-0xea2fffff]

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:15.7: PCI bridge to [bus 0a-0a]

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:15.7: PCI bridge, secondary bus 0000:0a

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:15.7:   bridge window [io  disabled]

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:15.7:   bridge window [0xfb900000-0xfb9fffff]

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:15.7:   bridge window [0xe9e00000-0xe9efffff]

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:16.0: PCI bridge to [bus 0b-0b]

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:16.0: PCI bridge, secondary bus 0000:0b

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:16.0:   bridge window [0x5000-0x5fff]

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:16.0:   bridge window [0xfd400000-0xfd4fffff]

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:16.0:   bridge window [0xeb900000-0xeb9fffff]

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:16.1: PCI bridge to [bus 0c-0c]

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:16.1: PCI bridge, secondary bus 0000:0c

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:16.1:   bridge window [0x9000-0x9fff]

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:16.1:   bridge window [0xfd000000-0xfd0fffff]

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:16.1:   bridge window [0xeb500000-0xeb5fffff]

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:16.2: PCI bridge to [bus 0d-0d]

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:16.2: PCI bridge, secondary bus 0000:0d

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:16.2:   bridge window [0xd000-0xdfff]

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:16.2:   bridge window [0xfcc00000-0xfccfffff]

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:16.2:   bridge window [0xeb100000-0xeb1fffff]

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:16.3: PCI bridge to [bus 0e-0e]

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:16.3: PCI bridge, secondary bus 0000:0e

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:16.3:   bridge window [io  disabled]

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:16.3:   bridge window [0xfc800000-0xfc8fffff]

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:16.3:   bridge window [0xead00000-0xeadfffff]

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:16.4: PCI bridge to [bus 0f-0f]

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:16.4: PCI bridge, secondary bus 0000:0f

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:16.4:   bridge window [io  disabled]

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:16.4:   bridge window [0xfc400000-0xfc4fffff]

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:16.4:   bridge window [0xea900000-0xea9fffff]

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:16.5: PCI bridge to [bus 10-10]

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:16.5: PCI bridge, secondary bus 0000:10

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:16.5:   bridge window [io  disabled]

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:16.5:   bridge window [0xfc000000-0xfc0fffff]

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:16.5:   bridge window [0xea500000-0xea5fffff]

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:16.6: PCI bridge to [bus 11-11]

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:16.6: PCI bridge, secondary bus 0000:11

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:16.6:   bridge window [io  disabled]

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:16.6:   bridge window [0xfbc00000-0xfbcfffff]

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:16.6:   bridge window [0xea100000-0xea1fffff]

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:16.7: PCI bridge to [bus 12-12]

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:16.7: PCI bridge, secondary bus 0000:12

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:16.7:   bridge window [io  disabled]

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:16.7:   bridge window [0xfb800000-0xfb8fffff]

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:16.7:   bridge window [0xe9d00000-0xe9dfffff]

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:17.0: PCI bridge to [bus 13-13]

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:17.0: PCI bridge, secondary bus 0000:13

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:17.0:   bridge window [0x6000-0x6fff]

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:17.0:   bridge window [0xfd300000-0xfd3fffff]

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:17.0:   bridge window [0xeb800000-0xeb8fffff]

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:17.1: PCI bridge to [bus 14-14]

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:17.1: PCI bridge, secondary bus 0000:14

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:17.1:   bridge window [0xa000-0xafff]

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:17.1:   bridge window [0xfcf00000-0xfcffffff]

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:17.1:   bridge window [0xeb400000-0xeb4fffff]

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:17.2: PCI bridge to [bus 15-15]

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:17.2: PCI bridge, secondary bus 0000:15

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:17.2:   bridge window [0xe000-0xefff]

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:17.2:   bridge window [0xfcb00000-0xfcbfffff]

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:17.2:   bridge window [0xeb000000-0xeb0fffff]

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:17.3: PCI bridge to [bus 16-16]

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:17.3: PCI bridge, secondary bus 0000:16

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:17.3:   bridge window [io  disabled]

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:17.3:   bridge window [0xfc700000-0xfc7fffff]

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:17.3:   bridge window [0xeac00000-0xeacfffff]

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:17.4: PCI bridge to [bus 17-17]

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:17.4: PCI bridge, secondary bus 0000:17

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:17.4:   bridge window [io  disabled]

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:17.4:   bridge window [0xfc300000-0xfc3fffff]

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:17.4:   bridge window [0xea800000-0xea8fffff]

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:17.5: PCI bridge to [bus 18-18]

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:17.5: PCI bridge, secondary bus 0000:18

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:17.5:   bridge window [io  disabled]

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:17.5:   bridge window [0xfbf00000-0xfbffffff]

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:17.5:   bridge window [0xea400000-0xea4fffff]

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:17.6: PCI bridge to [bus 19-19]

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:17.6: PCI bridge, secondary bus 0000:19

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:17.6:   bridge window [io  disabled]

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:17.6:   bridge window [0xfbb00000-0xfbbfffff]

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:17.6:   bridge window [0xea000000-0xea0fffff]

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:17.7: PCI bridge to [bus 1a-1a]

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:17.7: PCI bridge, secondary bus 0000:1a

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:17.7:   bridge window [io  disabled]

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:17.7:   bridge window [0xfb700000-0xfb7fffff]

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:17.7:   bridge window [0xe9c00000-0xe9cfffff]

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:18.0: PCI bridge to [bus 1b-1b]

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:18.0: PCI bridge, secondary bus 0000:1b

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:18.0:   bridge window [0x7000-0x7fff]

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:18.0:   bridge window [0xfd200000-0xfd2fffff]

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:18.0:   bridge window [0xeb700000-0xeb7fffff]

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:18.1: PCI bridge to [bus 1c-1c]

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:18.1: PCI bridge, secondary bus 0000:1c

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:18.1:   bridge window [0xb000-0xbfff]

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:18.1:   bridge window [0xfce00000-0xfcefffff]

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:18.1:   bridge window [0xeb300000-0xeb3fffff]

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:18.2: PCI bridge to [bus 1d-1d]

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:18.2: PCI bridge, secondary bus 0000:1d

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:18.2:   bridge window [io  disabled]

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:18.2:   bridge window [0xfca00000-0xfcafffff]

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:18.2:   bridge window [0xeaf00000-0xeaffffff]

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:18.3: PCI bridge to [bus 1e-1e]

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:18.3: PCI bridge, secondary bus 0000:1e

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:18.3:   bridge window [io  disabled]

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:18.3:   bridge window [0xfc600000-0xfc6fffff]

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:18.3:   bridge window [0xeab00000-0xeabfffff]

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:18.4: PCI bridge to [bus 1f-1f]

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:18.4: PCI bridge, secondary bus 0000:1f

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:18.4:   bridge window [io  disabled]

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:18.4:   bridge window [0xfc200000-0xfc2fffff]

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:18.4:   bridge window [0xea700000-0xea7fffff]

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:18.5: PCI bridge to [bus 20-20]

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:18.5: PCI bridge, secondary bus 0000:20

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:18.5:   bridge window [io  disabled]

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:18.5:   bridge window [0xfbe00000-0xfbefffff]

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:18.5:   bridge window [0xea300000-0xea3fffff]

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:18.6: PCI bridge to [bus 21-21]

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:18.6: PCI bridge, secondary bus 0000:21

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:18.6:   bridge window [io  disabled]

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:18.6:   bridge window [0xfba00000-0xfbafffff]

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:18.6:   bridge window [0xe9f00000-0xe9ffffff]

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:18.7: PCI bridge to [bus 22-22]

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:18.7: PCI bridge, secondary bus 0000:22

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:18.7:   bridge window [io  disabled]

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:18.7:   bridge window [0xfb600000-0xfb6fffff]

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:18.7:   bridge window [0xe9b00000-0xe9bfffff]

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:15.0: PCIe errors handled by OS.

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:15.0: ACPI _OSC control granted for 0x15

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:15.1: PCIe errors handled by OS.

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:15.1: ACPI _OSC control granted for 0x15

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:15.2: PCIe errors handled by OS.

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:15.2: ACPI _OSC control granted for 0x15

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:15.3: PCIe errors handled by OS.

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:15.3: ACPI _OSC control granted for 0x15

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:15.4: PCIe errors handled by OS.

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:15.4: ACPI _OSC control granted for 0x15

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:15.5: PCIe errors handled by OS.

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:15.5: ACPI _OSC control granted for 0x15

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:15.6: PCIe errors handled by OS.

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:15.6: ACPI _OSC control granted for 0x15

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:15.7: PCIe errors handled by OS.

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:15.7: ACPI _OSC control granted for 0x15

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:16.0: PCIe errors handled by OS.

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:16.0: ACPI _OSC control granted for 0x15

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:16.1: PCIe errors handled by OS.

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:16.1: ACPI _OSC control granted for 0x15

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:16.2: PCIe errors handled by OS.

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:16.2: ACPI _OSC control granted for 0x15

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:16.3: PCIe errors handled by OS.

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:16.3: ACPI _OSC control granted for 0x15

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:16.4: PCIe errors handled by OS.

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:16.4: ACPI _OSC control granted for 0x15

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:16.5: PCIe errors handled by OS.

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:16.5: ACPI _OSC control granted for 0x15

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:16.6: PCIe errors handled by OS.

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:16.6: ACPI _OSC control granted for 0x15

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:16.7: PCIe errors handled by OS.

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:16.7: ACPI _OSC control granted for 0x15

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:17.0: PCIe errors handled by OS.

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:17.0: ACPI _OSC control granted for 0x15

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:17.1: PCIe errors handled by OS.

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:17.1: ACPI _OSC control granted for 0x15

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:17.2: PCIe errors handled by OS.

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:17.2: ACPI _OSC control granted for 0x15

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:17.3: PCIe errors handled by OS.

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:17.3: ACPI _OSC control granted for 0x15

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:17.4: PCIe errors handled by OS.

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:17.4: ACPI _OSC control granted for 0x15

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:17.5: PCIe errors handled by OS.

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:17.5: ACPI _OSC control granted for 0x15

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:17.6: PCIe errors handled by OS.

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:17.6: ACPI _OSC control granted for 0x15

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:17.7: PCIe errors handled by OS.

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:17.7: ACPI _OSC control granted for 0x15

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:18.0: PCIe errors handled by OS.

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:18.0: ACPI _OSC control granted for 0x15

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:18.1: PCIe errors handled by OS.

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:18.1: ACPI _OSC control granted for 0x15

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:18.2: PCIe errors handled by OS.

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:18.2: ACPI _OSC control granted for 0x15

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:18.3: PCIe errors handled by OS.

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:18.3: ACPI _OSC control granted for 0x15

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:18.4: PCIe errors handled by OS.

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:18.4: ACPI _OSC control granted for 0x15

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:18.5: PCIe errors handled by OS.

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:18.5: ACPI _OSC control granted for 0x15

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:18.6: PCIe errors handled by OS.

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:18.6: ACPI _OSC control granted for 0x15

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:18.7: PCIe errors handled by OS.

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:18.7: ACPI _OSC control granted for 0x15

Sep  4 10:37:29 abackupserver kernel: NET: Registered protocol family 2

Sep  4 10:37:29 abackupserver kernel: IP route cache hash table entries: 32768 (order: 6, 262144 bytes)

Sep  4 10:37:29 abackupserver kernel: TCP established hash table entries: 131072 (order: 9, 2097152 bytes)

Sep  4 10:37:29 abackupserver kernel: TCP bind hash table entries: 65536 (order: 8, 1048576 bytes)

Sep  4 10:37:29 abackupserver kernel: TCP: Hash tables configured (established 131072 bind 65536)

Sep  4 10:37:29 abackupserver kernel: TCP reno registered

Sep  4 10:37:29 abackupserver kernel: NET: Registered protocol family 1

Sep  4 10:37:29 abackupserver kernel: pci 0000:00:00.0: Limiting direct PCI/PCI transfers

Sep  4 10:37:29 abackupserver kernel: Trying to unpack rootfs image as initramfs...

Sep  4 10:37:29 abackupserver kernel: Freeing initrd memory: 14373k freed

Sep  4 10:37:29 abackupserver kernel: Simple Boot Flag at 0x36 set to 0x80

Sep  4 10:37:29 abackupserver kernel: audit: initializing netlink socket (disabled)

Sep  4 10:37:29 abackupserver kernel: type=2000 audit(1409783836.591:1): initialized

Sep  4 10:37:29 abackupserver kernel: HugeTLB registered 2 MB page size, pre-allocated 0 pages

Sep  4 10:37:29 abackupserver kernel: VFS: Disk quotas dquot_6.5.2

Sep  4 10:37:29 abackupserver kernel: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)

Sep  4 10:37:29 abackupserver kernel: msgmni has been set to 1987

Sep  4 10:37:29 abackupserver kernel: alg: No test for stdrng (krng)

Sep  4 10:37:29 abackupserver kernel: ksign: Installing public key data

Sep  4 10:37:29 abackupserver kernel: Loading keyring

Sep  4 10:37:29 abackupserver kernel: - Added public key C9F0DFBFCE81A817

Sep  4 10:37:29 abackupserver kernel: - User ID: Red Hat, Inc. (Kernel Module GPG key)

Sep  4 10:37:29 abackupserver kernel: - Added public key D4A26C9CCD09BEDA

Sep  4 10:37:29 abackupserver kernel: - User ID: Red Hat Enterprise Linux Driver Update Program <secalert@redhat.com>

Sep  4 10:37:29 abackupserver kernel: Block layer SCSI generic (bsg) driver version 0.4 loaded (major 252)

Sep  4 10:37:29 abackupserver kernel: io scheduler noop registered

Sep  4 10:37:29 abackupserver kernel: io scheduler anticipatory registered

Sep  4 10:37:29 abackupserver kernel: io scheduler deadline registered

Sep  4 10:37:29 abackupserver kernel: io scheduler cfq registered (default)

Sep  4 10:37:29 abackupserver kernel: pci_hotplug: PCI Hot Plug PCI Core version: 0.5

Sep  4 10:37:29 abackupserver kernel: pciehp 0000:00:15.0:pciec84: HPC vendor_id 15ad device_id 7a0 ss_vid 0 ss_did 0

Sep  4 10:37:29 abackupserver kernel: pciehp 0000:00:15.1:pciec84: HPC vendor_id 15ad device_id 7a0 ss_vid 0 ss_did 0

Sep  4 10:37:29 abackupserver kernel: pciehp 0000:00:15.2:pciec84: HPC vendor_id 15ad device_id 7a0 ss_vid 0 ss_did 0

Sep  4 10:37:29 abackupserver kernel: pciehp 0000:00:15.3:pciec84: HPC vendor_id 15ad device_id 7a0 ss_vid 0 ss_did 0

Sep  4 10:37:29 abackupserver kernel: pciehp 0000:00:15.4:pciec84: HPC vendor_id 15ad device_id 7a0 ss_vid 0 ss_did 0

Sep  4 10:37:29 abackupserver kernel: pciehp 0000:00:15.5:pciec84: HPC vendor_id 15ad device_id 7a0 ss_vid 0 ss_did 0

Sep  4 10:37:29 abackupserver kernel: pciehp 0000:00:15.6:pcieffffffc4: HPC vendor_id 15ad device_id 7a0 ss_vid 0 ss_did 0

Sep  4 10:37:29 abackupserver kernel: pciehp 0000:00:15.7:pciec84: HPC vendor_id 15ad device_id 7a0 ss_vid 0 ss_did 0

Sep  4 10:37:29 abackupserver kernel: pciehp 0000:00:16.0:pcie7d4: HPC vendor_id 15ad device_id 7a0 ss_vid 0 ss_did 0

Sep  4 10:37:29 abackupserver kernel: pciehp 0000:00:16.1:pciec84: HPC vendor_id 15ad device_id 7a0 ss_vid 0 ss_did 0

Sep  4 10:37:29 abackupserver kernel: pciehp 0000:00:16.2:pcie7d4: HPC vendor_id 15ad device_id 7a0 ss_vid 0 ss_did 0

Sep  4 10:37:29 abackupserver kernel: pciehp 0000:00:16.3:pciec84: HPC vendor_id 15ad device_id 7a0 ss_vid 0 ss_did 0

Sep  4 10:37:29 abackupserver kernel: pciehp 0000:00:16.4:pcieffffffc4: HPC vendor_id 15ad device_id 7a0 ss_vid 0 ss_did 0

Sep  4 10:37:29 abackupserver kernel: pciehp 0000:00:16.5:pciec84: HPC vendor_id 15ad device_id 7a0 ss_vid 0 ss_did 0

Sep  4 10:37:29 abackupserver kernel: pciehp 0000:00:16.6:pcieffffffc4: HPC vendor_id 15ad device_id 7a0 ss_vid 0 ss_did 0

Sep  4 10:37:29 abackupserver kernel: pciehp 0000:00:16.7:pciec84: HPC vendor_id 15ad device_id 7a0 ss_vid 0 ss_did 0

Sep  4 10:37:29 abackupserver kernel: pciehp 0000:00:17.0:pcieffffffc4: HPC vendor_id 15ad device_id 7a0 ss_vid 0 ss_did 0

Sep  4 10:37:29 abackupserver kernel: pciehp 0000:00:17.1:pciec84: HPC vendor_id 15ad device_id 7a0 ss_vid 0 ss_did 0

Sep  4 10:37:29 abackupserver kernel: pciehp 0000:00:17.2:pcieffffffc4: HPC vendor_id 15ad device_id 7a0 ss_vid 0 ss_did 0

Sep  4 10:37:29 abackupserver kernel: pciehp 0000:00:17.3:pciec84: HPC vendor_id 15ad device_id 7a0 ss_vid 0 ss_did 0

Sep  4 10:37:29 abackupserver kernel: pciehp 0000:00:17.4:pcieffffffc4: HPC vendor_id 15ad device_id 7a0 ss_vid 0 ss_did 0

Sep  4 10:37:29 abackupserver kernel: pciehp 0000:00:17.5:pciec84: HPC vendor_id 15ad device_id 7a0 ss_vid 0 ss_did 0

Sep  4 10:37:29 abackupserver kernel: pciehp 0000:00:17.6:pcieffffffc4: HPC vendor_id 15ad device_id 7a0 ss_vid 0 ss_did 0

Sep  4 10:37:29 abackupserver kernel: pciehp 0000:00:17.7:pciec84: HPC vendor_id 15ad device_id 7a0 ss_vid 0 ss_did 0

Sep  4 10:37:29 abackupserver kernel: pciehp 0000:00:18.0:pciec84: HPC vendor_id 15ad device_id 7a0 ss_vid 0 ss_did 0

Sep  4 10:37:29 abackupserver kernel: pciehp 0000:00:18.1:pciec84: HPC vendor_id 15ad device_id 7a0 ss_vid 0 ss_did 0

Sep  4 10:37:29 abackupserver kernel: pciehp 0000:00:18.2:pcieffffffc4: HPC vendor_id 15ad device_id 7a0 ss_vid 0 ss_did 0

Sep  4 10:37:29 abackupserver kernel: pciehp 0000:00:18.3:pciec84: HPC vendor_id 15ad device_id 7a0 ss_vid 0 ss_did 0

Sep  4 10:37:29 abackupserver kernel: pciehp 0000:00:18.4:pcieffffffc4: HPC vendor_id 15ad device_id 7a0 ss_vid 0 ss_did 0

Sep  4 10:37:29 abackupserver kernel: pciehp 0000:00:18.5:pciec84: HPC vendor_id 15ad device_id 7a0 ss_vid 0 ss_did 0

Sep  4 10:37:29 abackupserver kernel: pciehp 0000:00:18.6:pcieffffffc4: HPC vendor_id 15ad device_id 7a0 ss_vid 0 ss_did 0

Sep  4 10:37:29 abackupserver kernel: pciehp 0000:00:18.7:pciec84: HPC vendor_id 15ad device_id 7a0 ss_vid 0 ss_did 0

Sep  4 10:37:29 abackupserver kernel: pciehp: PCI Express Hot Plug Controller Driver version: 0.4

Sep  4 10:37:29 abackupserver kernel: acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5

Sep  4 10:37:29 abackupserver kernel: acpiphp: Slot [32] registered

Sep  4 10:37:29 abackupserver kernel: acpiphp: Slot [33] registered

Sep  4 10:37:29 abackupserver kernel: acpiphp: Slot [34] registered

Sep  4 10:37:29 abackupserver kernel: acpiphp: Slot [35] registered

Sep  4 10:37:29 abackupserver kernel: acpiphp: Slot [36] registered

Sep  4 10:37:29 abackupserver kernel: acpiphp: Slot [37] registered

Sep  4 10:37:29 abackupserver kernel: acpiphp: Slot [38] registered

Sep  4 10:37:29 abackupserver kernel: acpiphp: Slot [39] registered

Sep  4 10:37:29 abackupserver kernel: acpiphp: Slot [40] registered

Sep  4 10:37:29 abackupserver kernel: acpiphp: Slot [41] registered

Sep  4 10:37:29 abackupserver kernel: acpiphp: Slot [42] registered

Sep  4 10:37:29 abackupserver kernel: acpiphp: Slot [43] registered

Sep  4 10:37:29 abackupserver kernel: acpiphp: Slot [44] registered

Sep  4 10:37:29 abackupserver kernel: acpiphp: Slot [45] registered

Sep  4 10:37:29 abackupserver kernel: acpiphp: Slot [46] registered

Sep  4 10:37:29 abackupserver kernel: acpiphp: Slot [47] registered

Sep  4 10:37:29 abackupserver kernel: acpiphp: Slot [48] registered

Sep  4 10:37:29 abackupserver kernel: acpiphp: Slot [49] registered

Sep  4 10:37:29 abackupserver kernel: acpiphp: Slot [50] registered

Sep  4 10:37:29 abackupserver kernel: acpiphp: Slot [51] registered

Sep  4 10:37:29 abackupserver kernel: acpiphp: Slot [52] registered

Sep  4 10:37:29 abackupserver kernel: acpiphp: Slot [53] registered

Sep  4 10:37:29 abackupserver kernel: acpiphp: Slot [54] registered

Sep  4 10:37:29 abackupserver kernel: acpiphp: Slot [55] registered

Sep  4 10:37:29 abackupserver kernel: acpiphp: Slot [56] registered

Sep  4 10:37:29 abackupserver kernel: acpiphp: Slot [57] registered

Sep  4 10:37:29 abackupserver kernel: acpiphp: Slot [58] registered

Sep  4 10:37:29 abackupserver kernel: acpiphp: Slot [59] registered

Sep  4 10:37:29 abackupserver kernel: acpiphp: Slot [60] registered

Sep  4 10:37:29 abackupserver kernel: acpiphp: Slot [61] registered

Sep  4 10:37:29 abackupserver kernel: acpiphp: Slot [62] registered

Sep  4 10:37:29 abackupserver kernel: acpiphp: Slot [63] registered

Sep  4 10:37:29 abackupserver kernel: acpiphp_glue: Slot 160 already registered by another hotplug driver

Sep  4 10:37:29 abackupserver kernel: acpiphp_glue: Slot 192 already registered by another hotplug driver

Sep  4 10:37:29 abackupserver kernel: acpiphp_glue: Slot 224 already registered by another hotplug driver

Sep  4 10:37:29 abackupserver kernel: acpiphp_glue: Slot 256 already registered by another hotplug driver

Sep  4 10:37:29 abackupserver kernel: acpiphp_glue: Slot 161 already registered by another hotplug driver

Sep  4 10:37:29 abackupserver kernel: acpiphp_glue: Slot 162 already registered by another hotplug driver

Sep  4 10:37:29 abackupserver kernel: acpiphp_glue: Slot 163 already registered by another hotplug driver

Sep  4 10:37:29 abackupserver kernel: acpiphp_glue: Slot 164 already registered by another hotplug driver

Sep  4 10:37:29 abackupserver kernel: acpiphp_glue: Slot 165 already registered by another hotplug driver

Sep  4 10:37:29 abackupserver kernel: acpiphp_glue: Slot 166 already registered by another hotplug driver

Sep  4 10:37:29 abackupserver kernel: acpiphp_glue: Slot 167 already registered by another hotplug driver

Sep  4 10:37:29 abackupserver kernel: acpiphp_glue: Slot 193 already registered by another hotplug driver

Sep  4 10:37:29 abackupserver kernel: acpiphp_glue: Slot 194 already registered by another hotplug driver

Sep  4 10:37:29 abackupserver kernel: acpiphp_glue: Slot 195 already registered by another hotplug driver

Sep  4 10:37:29 abackupserver kernel: acpiphp_glue: Slot 196 already registered by another hotplug driver

Sep  4 10:37:29 abackupserver kernel: acpiphp_glue: Slot 197 already registered by another hotplug driver

Sep  4 10:37:29 abackupserver kernel: acpiphp_glue: Slot 198 already registered by another hotplug driver

Sep  4 10:37:29 abackupserver kernel: acpiphp_glue: Slot 199 already registered by another hotplug driver

Sep  4 10:37:29 abackupserver kernel: acpiphp_glue: Slot 225 already registered by another hotplug driver

Sep  4 10:37:29 abackupserver kernel: acpiphp_glue: Slot 226 already registered by another hotplug driver

Sep  4 10:37:29 abackupserver kernel: acpiphp_glue: Slot 227 already registered by another hotplug driver

Sep  4 10:37:29 abackupserver kernel: acpiphp_glue: Slot 228 already registered by another hotplug driver

Sep  4 10:37:29 abackupserver kernel: acpiphp_glue: Slot 229 already registered by another hotplug driver

Sep  4 10:37:29 abackupserver kernel: acpiphp_glue: Slot 230 already registered by another hotplug driver

Sep  4 10:37:29 abackupserver kernel: acpiphp_glue: Slot 231 already registered by another hotplug driver

Sep  4 10:37:29 abackupserver kernel: acpiphp_glue: Slot 257 already registered by another hotplug driver

Sep  4 10:37:29 abackupserver kernel: acpiphp_glue: Slot 258 already registered by another hotplug driver

Sep  4 10:37:29 abackupserver kernel: acpiphp_glue: Slot 259 already registered by another hotplug driver

Sep  4 10:37:29 abackupserver kernel: acpiphp_glue: Slot 260 already registered by another hotplug driver

Sep  4 10:37:29 abackupserver kernel: acpiphp_glue: Slot 261 already registered by another hotplug driver

Sep  4 10:37:29 abackupserver kernel: acpiphp_glue: Slot 262 already registered by another hotplug driver

Sep  4 10:37:29 abackupserver kernel: acpiphp_glue: Slot 263 already registered by another hotplug driver

Sep  4 10:37:29 abackupserver kernel: pci-stub: invalid id string ""

Sep  4 10:37:29 abackupserver kernel: ACPI: AC Adapter [ACAD] (on-line)

Sep  4 10:37:29 abackupserver kernel: input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input0

Sep  4 10:37:29 abackupserver kernel: ACPI: Power Button [PWRF]

Sep  4 10:37:29 abackupserver kernel: processor LNXCPU:00: registered as cooling_device0

Sep  4 10:37:29 abackupserver kernel: ERST: Table is not found!

Sep  4 10:37:29 abackupserver kernel: Non-volatile memory driver v1.3

Sep  4 10:37:29 abackupserver kernel: Linux agpgart interface v0.103

Sep  4 10:37:29 abackupserver kernel: agpgart-intel 0000:00:00.0: Intel 440BX Chipset

Sep  4 10:37:29 abackupserver kernel: agpgart-intel 0000:00:00.0: AGP aperture is 256M @ 0x0

Sep  4 10:37:29 abackupserver kernel: crash memory driver: version 1.1

Sep  4 10:37:29 abackupserver kernel: Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled

Sep  4 10:37:29 abackupserver kernel: serial8250: ttyS0 at I/O 0x3f8 (irq = 4) is a 16550A

Sep  4 10:37:29 abackupserver kernel: serial8250: ttyS1 at I/O 0x2f8 (irq = 3) is a 16550A

Sep  4 10:37:29 abackupserver kernel: 00:0a: ttyS0 at I/O 0x3f8 (irq = 4) is a 16550A

Sep  4 10:37:29 abackupserver kernel: 00:0b: ttyS1 at I/O 0x2f8 (irq = 3) is a 16550A

Sep  4 10:37:29 abackupserver kernel: brd: module loaded

Sep  4 10:37:29 abackupserver kernel: loop: module loaded

Sep  4 10:37:29 abackupserver kernel: input: Macintosh mouse button emulation as /devices/virtual/input/input1

Sep  4 10:37:29 abackupserver kernel: Fixed MDIO Bus: probed

Sep  4 10:37:29 abackupserver kernel: ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver

Sep  4 10:37:29 abackupserver kernel: ohci_hcd: USB 1.1 'Open' Host Controller (OHCI) Driver

Sep  4 10:37:29 abackupserver kernel: uhci_hcd: USB Universal Host Controller Interface driver

Sep  4 10:37:29 abackupserver kernel: PNP: PS/2 Controller [PNP0303:KBC,PNP0f13:MOUS] at 0x60,0x64 irq 1,12

Sep  4 10:37:29 abackupserver kernel: serio: i8042 KBD port at 0x60,0x64 irq 1

Sep  4 10:37:29 abackupserver kernel: serio: i8042 AUX port at 0x60,0x64 irq 12

Sep  4 10:37:29 abackupserver kernel: mice: PS/2 mouse device common for all mice

Sep  4 10:37:29 abackupserver kernel: rtc_cmos 00:04: rtc core: registered rtc_cmos as rtc0

Sep  4 10:37:29 abackupserver kernel: rtc0: alarms up to one month, y3k, 114 bytes nvram, hpet irqs

Sep  4 10:37:29 abackupserver kernel: cpuidle: using governor ladder

Sep  4 10:37:29 abackupserver kernel: cpuidle: using governor menu

Sep  4 10:37:29 abackupserver kernel: usbcore: registered new interface driver hiddev

Sep  4 10:37:29 abackupserver kernel: usbcore: registered new interface driver usbhid

Sep  4 10:37:29 abackupserver kernel: usbhid: v2.6:USB HID core driver

Sep  4 10:37:29 abackupserver kernel: TCP cubic registered

Sep  4 10:37:29 abackupserver kernel: Initializing XFRM netlink socket

Sep  4 10:37:29 abackupserver kernel: NET: Registered protocol family 17

Sep  4 10:37:29 abackupserver kernel: registered taskstats version 1

Sep  4 10:37:29 abackupserver kernel: input: AT Translated Set 2 keyboard as /devices/platform/i8042/serio0/input/input2

Sep  4 10:37:29 abackupserver kernel: input: ImPS/2 Generic Wheel Mouse as /devices/platform/i8042/serio1/input/input3

Sep  4 10:37:29 abackupserver kernel: rtc_cmos 00:04: setting system clock to 2014-09-03 22:37:18 UTC (1409783838)

Sep  4 10:37:29 abackupserver kernel: Initalizing network drop monitor service

Sep  4 10:37:29 abackupserver kernel: Freeing unused kernel memory: 1232k freed

Sep  4 10:37:29 abackupserver kernel: Write protecting the kernel read-only data: 10240k

Sep  4 10:37:29 abackupserver kernel: Freeing unused kernel memory: 1112k freed

Sep  4 10:37:29 abackupserver kernel: Freeing unused kernel memory: 1796k freed

Sep  4 10:37:29 abackupserver kernel: dracut: dracut-004-53.el6

Sep  4 10:37:29 abackupserver kernel: dracut: rd_NO_LUKS: removing cryptoluks activation

Sep  4 10:37:29 abackupserver kernel: device-mapper: uevent: version 1.0.3

Sep  4 10:37:29 abackupserver kernel: device-mapper: ioctl: 4.20.6-ioctl (2011-02-02) initialised: dm-devel@redhat.com

Sep  4 10:37:29 abackupserver kernel: udev: starting version 147

Sep  4 10:37:29 abackupserver kernel: dracut: Starting plymouth daemon

Sep  4 10:37:29 abackupserver kernel: dracut: rd_NO_DM: removing DM RAID activation

Sep  4 10:37:29 abackupserver kernel: dracut: rd_NO_MD: removing MD RAID activation

Sep  4 10:37:29 abackupserver kernel: scsi0 : ata_piix

Sep  4 10:37:29 abackupserver kernel: scsi1 : ata_piix

Sep  4 10:37:29 abackupserver kernel: ata1: PATA max UDMA/33 cmd 0x1f0 ctl 0x3f6 bmdma 0x1060 irq 14

Sep  4 10:37:29 abackupserver kernel: ata2: PATA max UDMA/33 cmd 0x170 ctl 0x376 bmdma 0x1068 irq 15

Sep  4 10:37:29 abackupserver kernel: ata2.00: ATAPI: VMware Virtual IDE CDROM Drive, 00000001, max UDMA/33

Sep  4 10:37:29 abackupserver kernel: ata2.00: configured for UDMA/33

Sep  4 10:37:29 abackupserver kernel: scsi 1:0:0:0: CD-ROM            NECVMWar VMware IDE CDR10 1.00 PQ: 0 ANSI: 5

Sep  4 10:37:29 abackupserver kernel: VMware vmxnet3 virtual NIC driver - version 1.0.14.0-k-NAPI

Sep  4 10:37:29 abackupserver kernel: vmxnet3 0000:0b:00.0: PCI INT A -> GSI 19 (level, low) -> IRQ 19

Sep  4 10:37:29 abackupserver kernel: features: sg csum vlan jf tso tsoIPv6 lro highDMA

Sep  4 10:37:29 abackupserver kernel: eth0: NIC Link is Up 10000 Mbps

Sep  4 10:37:29 abackupserver kernel: VMware PVSCSI driver - version 1.0.1.0-k

Sep  4 10:37:29 abackupserver kernel: vmw_pvscsi 0000:03:00.0: PCI INT A -> GSI 18 (level, low) -> IRQ 18

Sep  4 10:37:29 abackupserver kernel: vmw_pvscsi: using 64bit dma

Sep  4 10:37:29 abackupserver kernel: vmw_pvscsi: using MSI-X

Sep  4 10:37:29 abackupserver kernel: scsi2 : VMware PVSCSI storage adapter rev 2, req/cmp/msg rings: 8/8/1 pages, cmd_per_lun=64

Sep  4 10:37:29 abackupserver kernel: vmw_pvscsi 0000:03:00.0: VMware PVSCSI rev 2 host #2

Sep  4 10:37:29 abackupserver kernel: scsi 2:0:0:0: Direct-Access     VMware   Virtual disk     1.0  PQ: 0 ANSI: 2

Sep  4 10:37:29 abackupserver kernel: scsi 2:0:1:0: Medium Changer    HP       MSL G3 Series    7.20 PQ: 0 ANSI: 5

Sep  4 10:37:29 abackupserver kernel: scsi 2:0:2:0: Sequential-Access HP       Ultrium 3-SCSI   M63W PQ: 0 ANSI: 3

Sep  4 10:37:29 abackupserver kernel: scsi 2:0:3:0: Sequential-Access HP       Ultrium 3-SCSI   M63W PQ: 0 ANSI: 3

Sep  4 10:37:29 abackupserver kernel: scsi 2:0:4:0: Direct-Access     VMware   Virtual disk     1.0  PQ: 0 ANSI: 2

Sep  4 10:37:29 abackupserver kernel: scsi 2:0:5:0: Direct-Access     VMware   Virtual disk     1.0  PQ: 0 ANSI: 2

Sep  4 10:37:29 abackupserver kernel: scsi 2:0:6:0: Direct-Access     VMware   Virtual disk     1.0  PQ: 0 ANSI: 2

Sep  4 10:37:29 abackupserver kernel: scsi 2:0:8:0: Direct-Access     VMware   Virtual disk     1.0  PQ: 0 ANSI: 2

Sep  4 10:37:29 abackupserver kernel: sr0: scsi3-mmc drive: 1x/1x writer dvd-ram cd/rw xa/form2 cdda tray

Sep  4 10:37:29 abackupserver kernel: Uniform CD-ROM driver Revision: 3.20

Sep  4 10:37:29 abackupserver kernel: sd 2:0:0:0: [sda] 419430400 512-byte logical blocks: (214 GB/200 GiB)

Sep  4 10:37:29 abackupserver kernel: sd 2:0:0:0: [sda] Write Protect is off

Sep  4 10:37:29 abackupserver kernel: sd 2:0:0:0: [sda] Cache data unavailable

Sep  4 10:37:29 abackupserver kernel: sd 2:0:0:0: [sda] Assuming drive cache: write through

Sep  4 10:37:29 abackupserver kernel: sd 2:0:0:0: [sda] Cache data unavailable

Sep  4 10:37:29 abackupserver kernel: sd 2:0:0:0: [sda] Assuming drive cache: write through

Sep  4 10:37:29 abackupserver kernel: sda:

Sep  4 10:37:29 abackupserver kernel: sd 2:0:4:0: [sdb] 44040192 512-byte logical blocks: (22.5 GB/21.0 GiB)

Sep  4 10:37:29 abackupserver kernel: sd 2:0:4:0: [sdb] Write Protect is off

Sep  4 10:37:29 abackupserver kernel: sd 2:0:4:0: [sdb] Cache data unavailable

Sep  4 10:37:29 abackupserver kernel: sd 2:0:4:0: [sdb] Assuming drive cache: write through

Sep  4 10:37:29 abackupserver kernel: sd 2:0:4:0: [sdb] Cache data unavailable

Sep  4 10:37:29 abackupserver kernel: sd 2:0:4:0: [sdb] Assuming drive cache: write through

Sep  4 10:37:29 abackupserver kernel: sdb:

Sep  4 10:37:29 abackupserver kernel: sd 2:0:5:0: [sdc] 4230542786 512-byte logical blocks: (2.16 TB/1.96 TiB)

Sep  4 10:37:29 abackupserver kernel: sd 2:0:5:0: [sdc] Write Protect is off

Sep  4 10:37:29 abackupserver kernel: sd 2:0:5:0: [sdc] Cache data unavailable

Sep  4 10:37:29 abackupserver kernel: sd 2:0:5:0: [sdc] Assuming drive cache: write through

Sep  4 10:37:29 abackupserver kernel: sd 2:0:5:0: [sdc] Cache data unavailable

Sep  4 10:37:29 abackupserver kernel: sd 2:0:5:0: [sdc] Assuming drive cache: write through

Sep  4 10:37:29 abackupserver kernel: sdc:

Sep  4 10:37:29 abackupserver kernel: sd 2:0:6:0: [sdd] 2147483648 512-byte logical blocks: (1.09 TB/1.00 TiB)

Sep  4 10:37:29 abackupserver kernel: sd 2:0:6:0: [sdd] Write Protect is off

Sep  4 10:37:29 abackupserver kernel: sd 2:0:6:0: [sdd] Cache data unavailable

Sep  4 10:37:29 abackupserver kernel: sd 2:0:6:0: [sdd] Assuming drive cache: write through

Sep  4 10:37:29 abackupserver kernel: sdb1

Sep  4 10:37:29 abackupserver kernel: sd 2:0:4:0: [sdb] Cache data unavailable

Sep  4 10:37:29 abackupserver kernel: sd 2:0:4:0: [sdb] Assuming drive cache: write through

Sep  4 10:37:29 abackupserver kernel: sd 2:0:4:0: [sdb] Attached SCSI disk

Sep  4 10:37:29 abackupserver kernel: sd 2:0:8:0: [sde] 4230542786 512-byte logical blocks: (2.16 TB/1.96 TiB)

Sep  4 10:37:29 abackupserver kernel: sd 2:0:8:0: [sde] Write Protect is off

Sep  4 10:37:29 abackupserver kernel: sd 2:0:8:0: [sde] Cache data unavailable

Sep  4 10:37:29 abackupserver kernel: sd 2:0:8:0: [sde] Assuming drive cache: write through

Sep  4 10:37:29 abackupserver kernel: sd 2:0:8:0: [sde] Cache data unavailable

Sep  4 10:37:29 abackupserver kernel: sd 2:0:8:0: [sde] Assuming drive cache: write through

Sep  4 10:37:29 abackupserver kernel: sde: sdc1

Sep  4 10:37:29 abackupserver kernel: sd 2:0:5:0: [sdc] Cache data unavailable

Sep  4 10:37:29 abackupserver kernel: sd 2:0:5:0: [sdc] Assuming drive cache: write through

Sep  4 10:37:29 abackupserver kernel: sd 2:0:5:0: [sdc] Attached SCSI disk

Sep  4 10:37:29 abackupserver kernel: sd 2:0:6:0: [sdd] Cache data unavailable

Sep  4 10:37:29 abackupserver kernel: sd 2:0:6:0: [sdd] Assuming drive cache: write through

Sep  4 10:37:29 abackupserver kernel: sdd: sde1

Sep  4 10:37:29 abackupserver kernel: sd 2:0:8:0: [sde] Cache data unavailable

Sep  4 10:37:29 abackupserver kernel: sd 2:0:8:0: [sde] Assuming drive cache: write through

Sep  4 10:37:29 abackupserver kernel: sd 2:0:8:0: [sde] Attached SCSI disk

Sep  4 10:37:29 abackupserver kernel: sdd1

Sep  4 10:37:29 abackupserver kernel: sd 2:0:6:0: [sdd] Cache data unavailable

Sep  4 10:37:29 abackupserver kernel: sd 2:0:6:0: [sdd] Assuming drive cache: write through

Sep  4 10:37:29 abackupserver kernel: sd 2:0:6:0: [sdd] Attached SCSI disk

Sep  4 10:37:29 abackupserver kernel: sda1 sda2

Sep  4 10:37:29 abackupserver kernel: sd 2:0:0:0: [sda] Cache data unavailable

Sep  4 10:37:29 abackupserver kernel: sd 2:0:0:0: [sda] Assuming drive cache: write through

Sep  4 10:37:29 abackupserver kernel: sd 2:0:0:0: [sda] Attached SCSI disk

Sep  4 10:37:29 abackupserver kernel: dracut: Scanning devices sda2 sdc1 sdd1 sde1  for LVM logical volumes vg00/lv_root vg00/lv_swap

Sep  4 10:37:29 abackupserver kernel: dracut: inactive '/dev/vg-backup-disks/lv_backups' [4.93 TiB] inherit

Sep  4 10:37:29 abackupserver kernel: dracut: inactive '/dev/vg00/lv_root' [10.00 GiB] inherit

Sep  4 10:37:29 abackupserver kernel: dracut: inactive '/dev/vg00/lv_u01' [187.54 GiB] inherit

Sep  4 10:37:29 abackupserver kernel: dracut: inactive '/dev/vg00/lv_swap' [1.97 GiB] inherit

Sep  4 10:37:29 abackupserver kernel: EXT4-fs (dm-0): INFO: recovery required on readonly filesystem

Sep  4 10:37:29 abackupserver kernel: EXT4-fs (dm-0): write access will be enabled during recovery

Sep  4 10:37:29 abackupserver kernel: EXT4-fs (dm-0): recovery complete

Sep  4 10:37:29 abackupserver kernel: EXT4-fs (dm-0): mounted filesystem with ordered data mode

Sep  4 10:37:29 abackupserver kernel: dracut: Mounted root filesystem /dev/mapper/vg00-lv_root

Sep  4 10:37:29 abackupserver kernel: dracut: Loading SELinux policy

Sep  4 10:37:29 abackupserver kernel: SELinux:  Disabled at runtime.

Sep  4 10:37:29 abackupserver kernel: type=1404 audit(1409783840.242:2): selinux=0 auid=4294967295 ses=4294967295

Sep  4 10:37:29 abackupserver kernel: dracut: /sbin/load_policy: Can't load policy: No such file or directory

Sep  4 10:37:29 abackupserver kernel: dracut: Switching root

Sep  4 10:37:29 abackupserver kernel: udev: starting version 147

Sep  4 10:37:29 abackupserver kernel: shpchp: Standard Hot Plug PCI Controller Driver version: 0.4

Sep  4 10:37:29 abackupserver kernel: sr 1:0:0:0: Attached scsi generic sg0 type 5

Sep  4 10:37:29 abackupserver kernel: sd 2:0:0:0: Attached scsi generic sg1 type 0

Sep  4 10:37:29 abackupserver kernel: scsi 2:0:1:0: Attached scsi generic sg2 type 8

Sep  4 10:37:29 abackupserver kernel: scsi 2:0:2:0: Attached scsi generic sg3 type 1

Sep  4 10:37:29 abackupserver kernel: scsi 2:0:3:0: Attached scsi generic sg4 type 1

Sep  4 10:37:29 abackupserver kernel: sd 2:0:4:0: Attached scsi generic sg5 type 0

Sep  4 10:37:29 abackupserver kernel: sd 2:0:5:0: Attached scsi generic sg6 type 0

Sep  4 10:37:29 abackupserver kernel: sd 2:0:6:0: Attached scsi generic sg7 type 0

Sep  4 10:37:29 abackupserver kernel: sd 2:0:8:0: Attached scsi generic sg8 type 0

Sep  4 10:37:29 abackupserver kernel: piix4_smbus 0000:00:07.3: Host SMBus controller not enabled!

Sep  4 10:37:29 abackupserver kernel: Probing for vmci/PCI.

Sep  4 10:37:29 abackupserver kernel: vmci 0000:00:07.7: PCI INT A -> GSI 16 (level, low) -> IRQ 16

Sep  4 10:37:29 abackupserver kernel: Found vmci/PCI at 0x1080, irq 16.

Sep  4 10:37:29 abackupserver kernel: VMCI: using capabilities 0xc.

Sep  4 10:37:29 abackupserver kernel: Registered vmci device.

Sep  4 10:37:29 abackupserver kernel: SCSI Media Changer driver v0.25

Sep  4 10:37:29 abackupserver kernel: ch0: type #1 (mt): 0x0+1 [medium transport]

Sep  4 10:37:29 abackupserver kernel: ch0: type #2 (st): 0x3e9+48 [storage]

Sep  4 10:37:29 abackupserver kernel: ch0: type #3 (ie): 0x65+0 [import/export]

Sep  4 10:37:29 abackupserver kernel: ch0: type #4 (dt): 0x1+2 [data transfer]

Sep  4 10:37:29 abackupserver kernel: ch0: dt 0x1: ID/LUN unknown

Sep  4 10:37:29 abackupserver kernel: ch0: dt 0x2: ID/LUN unknown

Sep  4 10:37:29 abackupserver kernel: ch0: INITIALIZE ELEMENT STATUS, may take some time ...

Sep  4 10:37:29 abackupserver kernel: ch0: ... finished

Sep  4 10:37:29 abackupserver kernel: ch 2:0:1:0: Attached scsi changer ch0

Sep  4 10:37:29 abackupserver kernel: st: Version 20081215, fixed bufsize 32768, s/g segs 256

Sep  4 10:37:29 abackupserver kernel: st 2:0:2:0: Attached scsi tape st0

Sep  4 10:37:29 abackupserver kernel: st 2:0:2:0: st0: try direct i/o: yes (alignment 4 B)

Sep  4 10:37:29 abackupserver kernel: st 2:0:3:0: Attached scsi tape st1

Sep  4 10:37:29 abackupserver kernel: st 2:0:3:0: st1: try direct i/o: yes (alignment 4 B)

Sep  4 10:37:29 abackupserver kernel: osst :I: Tape driver with OnStream support version 0.99.4

Sep  4 10:37:29 abackupserver kernel: osst :I: $Id: osst.c,v 1.73 2005/01/01 21:13:34 wriede Exp $

Sep  4 10:37:29 abackupserver kernel: microcode: CPU0 sig=0x20651, pf=0x1, revision=0x13

Sep  4 10:37:29 abackupserver kernel: platform microcode: firmware: requesting intel-ucode/06-25-01

Sep  4 10:37:29 abackupserver kernel: Microcode Update Driver: v2.00 <tigran@aivazian.fsnet.co.uk>, Peter Oruba

Sep  4 10:37:29 abackupserver kernel: parport_pc 00:09: reported by Plug and Play ACPI

Sep  4 10:37:29 abackupserver kernel: parport0: PC-style at 0x378, irq 7 [PCSPP,TRISTATE]

Sep  4 10:37:29 abackupserver kernel: ppdev: user-space parallel port driver

Sep  4 10:37:29 abackupserver kernel: EXT4-fs (sda1): mounted filesystem with ordered data mode

Sep  4 10:37:29 abackupserver kernel: EXT4-fs (dm-3): mounted filesystem with ordered data mode

Sep  4 10:37:29 abackupserver kernel: EXT4-fs (sdb1): mounted filesystem with ordered data mode

Sep  4 10:37:29 abackupserver kernel: EXT4-fs (dm-2): mounted filesystem with ordered data mode

Sep  4 10:37:29 abackupserver kernel: Adding 2064376k swap on /dev/mapper/vg00-lv_swap.  Priority:-1 extents:1 across:2064376k

Sep  4 10:38:14 abackupserver abrtd: Done checking for unsaved crashes

Sep  4 10:38:14 abackupserver abrtd: Init complete, entering main loop

Sep  4 10:42:31 abackupserver ntpd[1797]: synchronized to 172.16.4.1, stratum 3

Sep  4 10:42:31 abackupserver ntpd[1797]: kernel time sync status change 2001

Sep  4 10:51:19 abackupserver kernel: INFO: task mt:2284 blocked for more than 120 seconds.

Sep  4 10:51:19 abackupserver kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.

Sep  4 10:51:19 abackupserver kernel: mt            D 0000000000000000     0  2284   2250 0x00000000

Sep  4 10:51:19 abackupserver kernel: ffff88003b18ba48 0000000000000082 ffff88003b18b9c8 ffffffff8134efea

Sep  4 10:51:19 abackupserver kernel: ffff880037416000 0000000000000000 ffff880037e61000 0000000100056153

Sep  4 10:51:19 abackupserver kernel: ffff88003ab03ab8 ffff88003b18bfd8 000000000000f598 ffff88003ab03ab8

Sep  4 10:51:19 abackupserver kernel: Call Trace:

Sep  4 10:51:19 abackupserver kernel: [<ffffffff8134efea>] ? scsi_pool_alloc_command+0x4a/0x80

Sep  4 10:51:19 abackupserver kernel: [<ffffffff8134f2b1>] ? __scsi_get_command+0x21/0xc0

Sep  4 10:51:19 abackupserver kernel: [<ffffffff814dc065>] schedule_timeout+0x215/0x2e0

Sep  4 10:51:19 abackupserver kernel: [<ffffffff8134e610>] ? scsi_done+0x0/0x60

Sep  4 10:51:19 abackupserver kernel: [<ffffffff814dbce3>] wait_for_common+0x123/0x180

Sep  4 10:51:19 abackupserver kernel: [<ffffffff8105dc60>] ? default_wake_function+0x0/0x20

Sep  4 10:51:19 abackupserver kernel: [<ffffffff81247b52>] ? __generic_unplug_device+0x32/0x40

Sep  4 10:51:19 abackupserver kernel: [<ffffffff814dbdfd>] wait_for_completion+0x1d/0x20

Sep  4 10:51:19 abackupserver kernel: [<ffffffffa0180503>] st_do_scsi.clone.0+0x213/0x380 [st]

Sep  4 10:51:19 abackupserver kernel: [<ffffffffa0181ae8>] check_tape+0xf8/0x6c0 [st]

Sep  4 10:51:19 abackupserver kernel: [<ffffffffa0182218>] st_open+0x168/0x290 [st]

Sep  4 10:51:19 abackupserver kernel: [<ffffffff81176845>] chrdev_open+0x125/0x230

Sep  4 10:51:19 abackupserver kernel: [<ffffffff81176720>] ? chrdev_open+0x0/0x230

Sep  4 10:51:19 abackupserver kernel: [<ffffffff8116fa9a>] __dentry_open+0x10a/0x360

Sep  4 10:51:19 abackupserver kernel: [<ffffffff8120630f>] ? security_inode_permission+0x1f/0x30

Sep  4 10:51:19 abackupserver kernel: [<ffffffff8116fe04>] nameidata_to_filp+0x54/0x70

Sep  4 10:51:19 abackupserver kernel: [<ffffffff81182a40>] do_filp_open+0x700/0xd90

Sep  4 10:51:19 abackupserver kernel: [<ffffffff810415d4>] ? __do_page_fault+0x1e4/0x480

Sep  4 10:51:19 abackupserver kernel: [<ffffffff811910b0>] ? mntput_no_expire+0x30/0x110

Sep  4 10:51:19 abackupserver kernel: [<ffffffff811740a1>] ? __fput+0x1a1/0x210

Sep  4 10:51:19 abackupserver kernel: [<ffffffff8118f0a2>] ? alloc_fd+0x92/0x160

Sep  4 10:51:19 abackupserver kernel: [<ffffffff8116f849>] do_sys_open+0x69/0x140

Sep  4 10:51:19 abackupserver kernel: [<ffffffff8116f960>] sys_open+0x20/0x30

Sep  4 10:51:19 abackupserver kernel: [<ffffffff8100b172>] system_call_fastpath+0x16/0x1b

Sep  4 10:53:19 abackupserver kernel: INFO: task mt:2284 blocked for more than 120 seconds.

Sep  4 10:53:19 abackupserver kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.

Sep  4 10:53:19 abackupserver kernel: mt            D 0000000000000000     0  2284   2250 0x00000000

Sep  4 10:53:19 abackupserver kernel: ffff88003b18ba48 0000000000000082 ffff88003b18b9c8 ffffffff8134efea

Sep  4 10:53:19 abackupserver kernel: ffff880037416000 0000000000000000 ffff880037e61000 0000000100056153

Sep  4 10:53:19 abackupserver kernel: ffff88003ab03ab8 ffff88003b18bfd8 000000000000f598 ffff88003ab03ab8

Sep  4 10:53:19 abackupserver kernel: Call Trace:

Sep  4 10:53:19 abackupserver kernel: [<ffffffff8134efea>] ? scsi_pool_alloc_command+0x4a/0x80

Sep  4 10:53:19 abackupserver kernel: [<ffffffff8134f2b1>] ? __scsi_get_command+0x21/0xc0

Sep  4 10:53:19 abackupserver kernel: [<ffffffff814dc065>] schedule_timeout+0x215/0x2e0

Sep  4 10:53:19 abackupserver kernel: [<ffffffff8134e610>] ? scsi_done+0x0/0x60

Sep  4 10:53:19 abackupserver kernel: [<ffffffff814dbce3>] wait_for_common+0x123/0x180

Sep  4 10:53:19 abackupserver kernel: [<ffffffff8105dc60>] ? default_wake_function+0x0/0x20

Sep  4 10:53:19 abackupserver kernel: [<ffffffff81247b52>] ? __generic_unplug_device+0x32/0x40

Sep  4 10:53:19 abackupserver kernel: [<ffffffff814dbdfd>] wait_for_completion+0x1d/0x20

Sep  4 10:53:19 abackupserver kernel: [<ffffffffa0180503>] st_do_scsi.clone.0+0x213/0x380 [st]

Sep  4 10:53:19 abackupserver kernel: [<ffffffffa0181ae8>] check_tape+0xf8/0x6c0 [st]

Sep  4 10:53:19 abackupserver kernel: [<ffffffffa0182218>] st_open+0x168/0x290 [st]

Sep  4 10:53:19 abackupserver kernel: [<ffffffff81176845>] chrdev_open+0x125/0x230

Sep  4 10:53:19 abackupserver kernel: [<ffffffff81176720>] ? chrdev_open+0x0/0x230

Sep  4 10:53:19 abackupserver kernel: [<ffffffff8116fa9a>] __dentry_open+0x10a/0x360

Sep  4 10:53:19 abackupserver kernel: [<ffffffff8120630f>] ? security_inode_permission+0x1f/0x30

Sep  4 10:53:19 abackupserver kernel: [<ffffffff8116fe04>] nameidata_to_filp+0x54/0x70

Sep  4 10:53:19 abackupserver kernel: [<ffffffff81182a40>] do_filp_open+0x700/0xd90

Sep  4 10:53:19 abackupserver kernel: [<ffffffff810415d4>] ? __do_page_fault+0x1e4/0x480

Sep  4 10:53:19 abackupserver kernel: [<ffffffff811910b0>] ? mntput_no_expire+0x30/0x110

Sep  4 10:53:19 abackupserver kernel: [<ffffffff811740a1>] ? __fput+0x1a1/0x210

Sep  4 10:53:19 abackupserver kernel: [<ffffffff8118f0a2>] ? alloc_fd+0x92/0x160

Sep  4 10:53:19 abackupserver kernel: [<ffffffff8116f849>] do_sys_open+0x69/0x140

Sep  4 10:53:19 abackupserver kernel: [<ffffffff8116f960>] sys_open+0x20/0x30

Sep  4 10:53:19 abackupserver kernel: [<ffffffff8100b172>] system_call_fastpath+0x16/0x1b

Sep  4 10:55:19 abackupserver kernel: INFO: task mt:2284 blocked for more than 120 seconds.

Sep  4 10:55:19 abackupserver kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.

Sep  4 10:55:19 abackupserver kernel: mt            D 0000000000000000     0  2284   2250 0x00000000

Sep  4 10:55:19 abackupserver kernel: ffff88003b18ba48 0000000000000082 ffff88003b18b9c8 ffffffff8134efea

Sep  4 10:55:19 abackupserver kernel: ffff880037416000 0000000000000000 ffff880037e61000 0000000100056153

Sep  4 10:55:19 abackupserver kernel: ffff88003ab03ab8 ffff88003b18bfd8 000000000000f598 ffff88003ab03ab8

Sep  4 10:55:19 abackupserver kernel: Call Trace:

Sep  4 10:55:19 abackupserver kernel: [<ffffffff8134efea>] ? scsi_pool_alloc_command+0x4a/0x80

Sep  4 10:55:19 abackupserver kernel: [<ffffffff8134f2b1>] ? __scsi_get_command+0x21/0xc0

Sep  4 10:55:19 abackupserver kernel: [<ffffffff814dc065>] schedule_timeout+0x215/0x2e0

Sep  4 10:55:19 abackupserver kernel: [<ffffffff8134e610>] ? scsi_done+0x0/0x60

Sep  4 10:55:19 abackupserver kernel: [<ffffffff814dbce3>] wait_for_common+0x123/0x180

Sep  4 10:55:19 abackupserver kernel: [<ffffffff8105dc60>] ? default_wake_function+0x0/0x20

Sep  4 10:55:19 abackupserver kernel: [<ffffffff81247b52>] ? __generic_unplug_device+0x32/0x40

Sep  4 10:55:19 abackupserver kernel: [<ffffffff814dbdfd>] wait_for_completion+0x1d/0x20

Sep  4 10:55:19 abackupserver kernel: [<ffffffffa0180503>] st_do_scsi.clone.0+0x213/0x380 [st]

Sep  4 10:55:19 abackupserver kernel: [<ffffffffa0181ae8>] check_tape+0xf8/0x6c0 [st]

Sep  4 10:55:19 abackupserver kernel: [<ffffffffa0182218>] st_open+0x168/0x290 [st]

Sep  4 10:55:19 abackupserver kernel: [<ffffffff81176845>] chrdev_open+0x125/0x230

Sep  4 10:55:19 abackupserver kernel: [<ffffffff81176720>] ? chrdev_open+0x0/0x230

Sep  4 10:55:19 abackupserver kernel: [<ffffffff8116fa9a>] __dentry_open+0x10a/0x360

Sep  4 10:55:19 abackupserver kernel: [<ffffffff8120630f>] ? security_inode_permission+0x1f/0x30

Sep  4 10:55:19 abackupserver kernel: [<ffffffff8116fe04>] nameidata_to_filp+0x54/0x70

Sep  4 10:55:19 abackupserver kernel: [<ffffffff81182a40>] do_filp_open+0x700/0xd90

Sep  4 10:55:19 abackupserver kernel: [<ffffffff810415d4>] ? __do_page_fault+0x1e4/0x480

Sep  4 10:55:19 abackupserver kernel: [<ffffffff811910b0>] ? mntput_no_expire+0x30/0x110

Sep  4 10:55:19 abackupserver kernel: [<ffffffff811740a1>] ? __fput+0x1a1/0x210

Sep  4 10:55:19 abackupserver kernel: [<ffffffff8118f0a2>] ? alloc_fd+0x92/0x160

Sep  4 10:55:19 abackupserver kernel: [<ffffffff8116f849>] do_sys_open+0x69/0x140

Sep  4 10:55:19 abackupserver kernel: [<ffffffff8116f960>] sys_open+0x20/0x30

Sep  4 10:55:19 abackupserver kernel: [<ffffffff8100b172>] system_call_fastpath+0x16/0x1b

Sep  4 10:57:19 abackupserver kernel: INFO: task mt:2284 blocked for more than 120 seconds.

Sep  4 10:57:19 abackupserver kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.

Sep  4 10:57:19 abackupserver kernel: mt            D 0000000000000000     0  2284   2250 0x00000000

Sep  4 10:57:19 abackupserver kernel: ffff88003b18ba48 0000000000000082 ffff88003b18b9c8 ffffffff8134efea

Sep  4 10:57:19 abackupserver kernel: ffff880037416000 0000000000000000 ffff880037e61000 0000000100056153

Sep  4 10:57:19 abackupserver kernel: ffff88003ab03ab8 ffff88003b18bfd8 000000000000f598 ffff88003ab03ab8

Sep  4 10:57:19 abackupserver kernel: Call Trace:

Sep  4 10:57:19 abackupserver kernel: [<ffffffff8134efea>] ? scsi_pool_alloc_command+0x4a/0x80

Sep  4 10:57:19 abackupserver kernel: [<ffffffff8134f2b1>] ? __scsi_get_command+0x21/0xc0

Sep  4 10:57:19 abackupserver kernel: [<ffffffff814dc065>] schedule_timeout+0x215/0x2e0

Sep  4 10:57:19 abackupserver kernel: [<ffffffff8134e610>] ? scsi_done+0x0/0x60

Sep  4 10:57:19 abackupserver kernel: [<ffffffff814dbce3>] wait_for_common+0x123/0x180

Sep  4 10:57:19 abackupserver kernel: [<ffffffff8105dc60>] ? default_wake_function+0x0/0x20

Sep  4 10:57:19 abackupserver kernel: [<ffffffff81247b52>] ? __generic_unplug_device+0x32/0x40

Sep  4 10:57:19 abackupserver kernel: [<ffffffff814dbdfd>] wait_for_completion+0x1d/0x20

Sep  4 10:57:19 abackupserver kernel: [<ffffffffa0180503>] st_do_scsi.clone.0+0x213/0x380 [st]

Sep  4 10:57:19 abackupserver kernel: [<ffffffffa0181ae8>] check_tape+0xf8/0x6c0 [st]

Sep  4 10:57:19 abackupserver kernel: [<ffffffffa0182218>] st_open+0x168/0x290 [st]

Sep  4 10:57:19 abackupserver kernel: [<ffffffff81176845>] chrdev_open+0x125/0x230

Sep  4 10:57:19 abackupserver kernel: [<ffffffff81176720>] ? chrdev_open+0x0/0x230

Sep  4 10:57:19 abackupserver kernel: [<ffffffff8116fa9a>] __dentry_open+0x10a/0x360

Sep  4 10:57:19 abackupserver kernel: [<ffffffff8120630f>] ? security_inode_permission+0x1f/0x30

Sep  4 10:57:19 abackupserver kernel: [<ffffffff8116fe04>] nameidata_to_filp+0x54/0x70

Sep  4 10:57:19 abackupserver kernel: [<ffffffff81182a40>] do_filp_open+0x700/0xd90

Sep  4 10:57:19 abackupserver kernel: [<ffffffff810415d4>] ? __do_page_fault+0x1e4/0x480

Sep  4 10:57:19 abackupserver kernel: [<ffffffff811910b0>] ? mntput_no_expire+0x30/0x110

Sep  4 10:57:19 abackupserver kernel: [<ffffffff811740a1>] ? __fput+0x1a1/0x210

Sep  4 10:57:19 abackupserver kernel: [<ffffffff8118f0a2>] ? alloc_fd+0x92/0x160

Sep  4 10:57:19 abackupserver kernel: [<ffffffff8116f849>] do_sys_open+0x69/0x140

Sep  4 10:57:19 abackupserver kernel: [<ffffffff8116f960>] sys_open+0x20/0x30

Sep  4 10:57:19 abackupserver kernel: [<ffffffff8100b172>] system_call_fastpath+0x16/0x1b

Sep  4 10:59:19 abackupserver kernel: INFO: task mt:2284 blocked for more than 120 seconds.

Sep  4 10:59:19 abackupserver kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.

Sep  4 10:59:19 abackupserver kernel: mt            D 0000000000000000     0  2284   2250 0x00000000

Sep  4 10:59:19 abackupserver kernel: ffff88003b18ba48 0000000000000082 ffff88003b18b9c8 ffffffff8134efea

Sep  4 10:59:19 abackupserver kernel: ffff880037416000 0000000000000000 ffff880037e61000 0000000100056153

Sep  4 10:59:19 abackupserver kernel: ffff88003ab03ab8 ffff88003b18bfd8 000000000000f598 ffff88003ab03ab8

Sep  4 10:59:19 abackupserver kernel: Call Trace:

Sep  4 10:59:19 abackupserver kernel: [<ffffffff8134efea>] ? scsi_pool_alloc_command+0x4a/0x80

Sep  4 10:59:19 abackupserver kernel: [<ffffffff8134f2b1>] ? __scsi_get_command+0x21/0xc0

Sep  4 10:59:19 abackupserver kernel: [<ffffffff814dc065>] schedule_timeout+0x215/0x2e0

Sep  4 10:59:19 abackupserver kernel: [<ffffffff8134e610>] ? scsi_done+0x0/0x60

Sep  4 10:59:19 abackupserver kernel: [<ffffffff814dbce3>] wait_for_common+0x123/0x180

Sep  4 10:59:19 abackupserver kernel: [<ffffffff8105dc60>] ? default_wake_function+0x0/0x20

Sep  4 10:59:19 abackupserver kernel: [<ffffffff81247b52>] ? __generic_unplug_device+0x32/0x40

Sep  4 10:59:19 abackupserver kernel: [<ffffffff814dbdfd>] wait_for_completion+0x1d/0x20

Sep  4 10:59:19 abackupserver kernel: [<ffffffffa0180503>] st_do_scsi.clone.0+0x213/0x380 [st]

Sep  4 10:59:19 abackupserver kernel: [<ffffffffa0181ae8>] check_tape+0xf8/0x6c0 [st]

Sep  4 10:59:19 abackupserver kernel: [<ffffffffa0182218>] st_open+0x168/0x290 [st]

Sep  4 10:59:19 abackupserver kernel: [<ffffffff81176845>] chrdev_open+0x125/0x230

Sep  4 10:59:19 abackupserver kernel: [<ffffffff81176720>] ? chrdev_open+0x0/0x230

Sep  4 10:59:19 abackupserver kernel: [<ffffffff8116fa9a>] __dentry_open+0x10a/0x360

Sep  4 10:59:19 abackupserver kernel: [<ffffffff8120630f>] ? security_inode_permission+0x1f/0x30

Sep  4 10:59:19 abackupserver kernel: [<ffffffff8116fe04>] nameidata_to_filp+0x54/0x70

Sep  4 10:59:19 abackupserver kernel: [<ffffffff81182a40>] do_filp_open+0x700/0xd90

Sep  4 10:59:19 abackupserver kernel: [<ffffffff810415d4>] ? __do_page_fault+0x1e4/0x480

Sep  4 10:59:19 abackupserver kernel: [<ffffffff811910b0>] ? mntput_no_expire+0x30/0x110

Sep  4 10:59:19 abackupserver kernel: [<ffffffff811740a1>] ? __fput+0x1a1/0x210

Sep  4 10:59:19 abackupserver kernel: [<ffffffff8118f0a2>] ? alloc_fd+0x92/0x160

Sep  4 10:59:19 abackupserver kernel: [<ffffffff8116f849>] do_sys_open+0x69/0x140

Sep  4 10:59:19 abackupserver kernel: [<ffffffff8116f960>] sys_open+0x20/0x30

Sep  4 10:59:19 abackupserver kernel: [<ffffffff8100b172>] system_call_fastpath+0x16/0x1b

Sep  4 11:01:19 abackupserver kernel: INFO: task mt:2284 blocked for more than 120 seconds.

Sep  4 11:01:19 abackupserver kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.

Sep  4 11:01:19 abackupserver kernel: mt            D 0000000000000000     0  2284   2250 0x00000000

Sep  4 11:01:19 abackupserver kernel: ffff88003b18ba48 0000000000000082 ffff88003b18b9c8 ffffffff8134efea

Sep  4 11:01:19 abackupserver kernel: ffff880037416000 0000000000000000 ffff880037e61000 0000000100056153

Sep  4 11:01:19 abackupserver kernel: ffff88003ab03ab8 ffff88003b18bfd8 000000000000f598 ffff88003ab03ab8

Sep  4 11:01:19 abackupserver kernel: Call Trace:

Sep  4 11:01:19 abackupserver kernel: [<ffffffff8134efea>] ? scsi_pool_alloc_command+0x4a/0x80

Sep  4 11:01:19 abackupserver kernel: [<ffffffff8134f2b1>] ? __scsi_get_command+0x21/0xc0

Sep  4 11:01:19 abackupserver kernel: [<ffffffff814dc065>] schedule_timeout+0x215/0x2e0

Sep  4 11:01:19 abackupserver kernel: [<ffffffff8134e610>] ? scsi_done+0x0/0x60

Sep  4 11:01:19 abackupserver kernel: [<ffffffff814dbce3>] wait_for_common+0x123/0x180

Sep  4 11:01:19 abackupserver kernel: [<ffffffff8105dc60>] ? default_wake_function+0x0/0x20

Sep  4 11:01:19 abackupserver kernel: [<ffffffff81247b52>] ? __generic_unplug_device+0x32/0x40

Sep  4 11:01:19 abackupserver kernel: [<ffffffff814dbdfd>] wait_for_completion+0x1d/0x20

Sep  4 11:01:19 abackupserver kernel: [<ffffffffa0180503>] st_do_scsi.clone.0+0x213/0x380 [st]

Sep  4 11:01:19 abackupserver kernel: [<ffffffffa0181ae8>] check_tape+0xf8/0x6c0 [st]

Sep  4 11:01:19 abackupserver kernel: [<ffffffffa0182218>] st_open+0x168/0x290 [st]

Sep  4 11:01:19 abackupserver kernel: [<ffffffff81176845>] chrdev_open+0x125/0x230

Sep  4 11:01:19 abackupserver kernel: [<ffffffff81176720>] ? chrdev_open+0x0/0x230

Sep  4 11:01:19 abackupserver kernel: [<ffffffff8116fa9a>] __dentry_open+0x10a/0x360

Sep  4 11:01:19 abackupserver kernel: [<ffffffff8120630f>] ? security_inode_permission+0x1f/0x30

Sep  4 11:01:19 abackupserver kernel: [<ffffffff8116fe04>] nameidata_to_filp+0x54/0x70

Sep  4 11:01:19 abackupserver kernel: [<ffffffff81182a40>] do_filp_open+0x700/0xd90

Sep  4 11:01:19 abackupserver kernel: [<ffffffff810415d4>] ? __do_page_fault+0x1e4/0x480

Sep  4 11:01:19 abackupserver kernel: [<ffffffff811910b0>] ? mntput_no_expire+0x30/0x110

Sep  4 11:01:19 abackupserver kernel: [<ffffffff811740a1>] ? __fput+0x1a1/0x210

Sep  4 11:01:19 abackupserver kernel: [<ffffffff8118f0a2>] ? alloc_fd+0x92/0x160

Sep  4 11:01:19 abackupserver kernel: [<ffffffff8116f849>] do_sys_open+0x69/0x140

Sep  4 11:01:19 abackupserver kernel: [<ffffffff8116f960>] sys_open+0x20/0x30

Sep  4 11:01:19 abackupserver kernel: [<ffffffff8100b172>] system_call_fastpath+0x16/0x1b

Sep  4 11:03:19 abackupserver kernel: INFO: task mt:2284 blocked for more than 120 seconds.

Sep  4 11:03:19 abackupserver kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.

Sep  4 11:03:19 abackupserver kernel: mt            D 0000000000000000     0  2284   2250 0x00000000

Sep  4 11:03:19 abackupserver kernel: ffff88003b18ba48 0000000000000082 ffff88003b18b9c8 ffffffff8134efea

Sep  4 11:03:19 abackupserver kernel: ffff880037416000 0000000000000000 ffff880037e61000 0000000100056153

Sep  4 11:03:19 abackupserver kernel: ffff88003ab03ab8 ffff88003b18bfd8 000000000000f598 ffff88003ab03ab8

Sep  4 11:03:19 abackupserver kernel: Call Trace:

Sep  4 11:03:19 abackupserver kernel: [<ffffffff8134efea>] ? scsi_pool_alloc_command+0x4a/0x80

Sep  4 11:03:19 abackupserver kernel: [<ffffffff8134f2b1>] ? __scsi_get_command+0x21/0xc0

Sep  4 11:03:19 abackupserver kernel: [<ffffffff814dc065>] schedule_timeout+0x215/0x2e0

Sep  4 11:03:19 abackupserver kernel: [<ffffffff8134e610>] ? scsi_done+0x0/0x60

Sep  4 11:03:19 abackupserver kernel: [<ffffffff814dbce3>] wait_for_common+0x123/0x180

Sep  4 11:03:19 abackupserver kernel: [<ffffffff8105dc60>] ? default_wake_function+0x0/0x20

Sep  4 11:03:19 abackupserver kernel: [<ffffffff81247b52>] ? __generic_unplug_device+0x32/0x40

Sep  4 11:03:19 abackupserver kernel: [<ffffffff814dbdfd>] wait_for_completion+0x1d/0x20

Sep  4 11:03:19 abackupserver kernel: [<ffffffffa0180503>] st_do_scsi.clone.0+0x213/0x380 [st]

Sep  4 11:03:19 abackupserver kernel: [<ffffffffa0181ae8>] check_tape+0xf8/0x6c0 [st]

Sep  4 11:03:19 abackupserver kernel: [<ffffffffa0182218>] st_open+0x168/0x290 [st]

Sep  4 11:03:19 abackupserver kernel: [<ffffffff81176845>] chrdev_open+0x125/0x230

Sep  4 11:03:19 abackupserver kernel: [<ffffffff81176720>] ? chrdev_open+0x0/0x230

Sep  4 11:03:19 abackupserver kernel: [<ffffffff8116fa9a>] __dentry_open+0x10a/0x360

Sep  4 11:03:19 abackupserver kernel: [<ffffffff8120630f>] ? security_inode_permission+0x1f/0x30

Sep  4 11:03:19 abackupserver kernel: [<ffffffff8116fe04>] nameidata_to_filp+0x54/0x70

Sep  4 11:03:19 abackupserver kernel: [<ffffffff81182a40>] do_filp_open+0x700/0xd90

Sep  4 11:03:19 abackupserver kernel: [<ffffffff810415d4>] ? __do_page_fault+0x1e4/0x480

Sep  4 11:03:19 abackupserver kernel: [<ffffffff811910b0>] ? mntput_no_expire+0x30/0x110

Sep  4 11:03:19 abackupserver kernel: [<ffffffff811740a1>] ? __fput+0x1a1/0x210

Sep  4 11:03:19 abackupserver kernel: [<ffffffff8118f0a2>] ? alloc_fd+0x92/0x160

Sep  4 11:03:19 abackupserver kernel: [<ffffffff8116f849>] do_sys_open+0x69/0x140

Sep  4 11:03:19 abackupserver kernel: [<ffffffff8116f960>] sys_open+0x20/0x30

Sep  4 11:03:19 abackupserver kernel: [<ffffffff8100b172>] system_call_fastpath+0x16/0x1b

Sep  4 11:05:19 abackupserver kernel: INFO: task mt:2284 blocked for more than 120 seconds.

Sep  4 11:05:19 abackupserver kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.

Sep  4 11:05:19 abackupserver kernel: mt            D 0000000000000000     0  2284   2250 0x00000000

Sep  4 11:05:19 abackupserver kernel: ffff88003b18ba48 0000000000000082 ffff88003b18b9c8 ffffffff8134efea

Sep  4 11:05:19 abackupserver kernel: ffff880037416000 0000000000000000 ffff880037e61000 0000000100056153

Sep  4 11:05:19 abackupserver kernel: ffff88003ab03ab8 ffff88003b18bfd8 000000000000f598 ffff88003ab03ab8


Previously, before I reattached the SCSI device 1 & 2 - the following occurred at the end of the error calls


Sep  2 16:43:42 abackupserver kernel: st 2:0:2:0: Device offlined - not ready after error recovery

Sep  2 16:47:43 abackupserver kernel: st 2:0:3:0: Device offlined - not ready after error recovery


DMESG the ESXi host:

2014-09-03T23:48:09.350Z cpu1:33510)WARNING: NMP: nmpCompleteRetryForPath:382: Logical device "naa.500110a0008f5e29": awaiting fast path state update before retrying failed command again...

2014-09-03T23:48:10.349Z cpu13:33480)WARNING: NMP: nmpDeviceAttemptFailover:603: Retry world failover device "naa.500110a0008f5e29" - issuing command 0x412e8c48be00

2014-09-03T23:48:10.351Z cpu6:33510)WARNING: NMP: nmpCompleteRetryForPath:352: Retry cmd 0x0 (0x412e8c48be00) to dev "naa.500110a0008f5e29" failed on path "vmhba3:C0:T0:L0" H:0x0 D:0x2 P:0x0 Valid sense data: 0x2 0x3a 0x0.

2014-09-03T23:48:10.351Z cpu6:33510)WARNING: NMP: nmpCompleteRetryForPath:382: Logical device "naa.500110a0008f5e29": awaiting fast path state update before retrying failed command again...

2014-09-03T23:48:11.346Z cpu15:1602450)WARNING: NMP: nmpDeviceAttemptFailover:603: Retry world failover device "naa.500110a0008f5e29" - issuing command 0x412e8c48be00

2014-09-03T23:48:11.348Z cpu0:33510)WARNING: NMP: nmpCompleteRetryForPath:352: Retry cmd 0x0 (0x412e8c48be00) to dev "naa.500110a0008f5e29" failed on path "vmhba3:C0:T0:L0" H:0x0 D:0x2 P:0x0 Valid sense data: 0x2 0x3a 0x0.


The following screenshots attempt to provide some understanding of the logical configuration:


cat proc abackupserver.png

Storage Map abackupserver.png



Can anyone shed some light on what might be happening here? Is there additional information I can provide that may assist in identifying the cause of failure? Thank you kindly in advance for any assistance you might be willing to provide!


Reply
0 Kudos
1 Reply
mathanmailid
Enthusiast
Enthusiast

Reply
0 Kudos