VMware Cloud Community
ChrisPBC
Contributor
Contributor
‎01-15-2016 09:24 AM

BUG: soft lockup - CPU#0 stuck for 49s! [vmtoolsd]

The issue is with a crash of vmtoolsd on SUSE (3.0.101-0.7.23-default #1 SMP Tue Aug 19 15:56:19 UTC 2014 (26d8f4e)). Let me know if there might be other diagnostic info else where on the system to collect.  Gathered the info below from the console.

I'm looking for assistance to help identifying a root cause for why vmtoolsd crashed.  No, it's not reproducible on demand and this is the first occurrence in ~10 months on this specific server.

Jan  4 04:47:15 SERVERNAME kernel: [17275671.000998] BUG: soft lockup - CPU#0 stuck for 49s! [vmtoolsd:1319]

Jan  4 04:47:15 SERVERNAME kernel: [17275671.001005] Modules linked in: bluetooth rfkill crc16 af_packet arc4 ecb md4 md5 nls_utf8 cifs(X) ip6t_REJECT nf_conntrack_ipv6 nf_defrag_ipv6 ip6table_filter ip6table_raw ip6_tables xt_tcpudp ipt_REJECT xt_pkttype xt_state iptable_nat nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_NOTRACK nf_conntrack iptable_raw iptable_filter ip_tables x_tables mperf vsock(X) vmmemctl(X) loop dm_mod ata_generic ppdev parport_pc ata_piix parport ipv6 ahci ipv6_lib floppy e1000 libahci button container vmci(X) intel_agp libata pciehp shpchp pci_hotplug i2c_piix4 i2c_core pcspkr sg intel_gtt ac rtc_cmos ext3 jbd mbcache sd_mod crc_t10dif mptspi mptscsih mptbase scsi_transport_spi processor thermal_sys hwmon scsi_dh_alua scsi_dh_hp_sw scsi_dh_rdac scsi_dh_emc scsi_dh scsi_mod vmxnet(X) vmxnet3(X) xhci_hcd uhci_hcd ohci_hcd ehci_hcd usbcore usb_common

Jan  4 04:47:15 SERVERNAME kernel: [17275671.001093] Supported: Yes, External

Jan  4 04:47:15 SERVERNAME kernel: [17275671.001095] CPU 0

Jan  4 04:47:15 SERVERNAME kernel: [17275671.001095] Modules linked in: bluetooth rfkill crc16 af_packet arc4 ecb md4 md5 nls_utf8 cifs(X) ip6t_REJECT nf_conntrack_ipv6 nf_defrag_ipv6 ip6table_filter ip6table_raw ip6_tables xt_tcpudp ipt_REJECT xt_pkttype xt_state iptable_nat nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_NOTRACK nf_conntrack iptable_raw iptable_filter ip_tables x_tables mperf vsock(X) vmmemctl(X) loop dm_mod ata_generic ppdev parport_pc ata_piix parport ipv6 ahci ipv6_lib floppy e1000 libahci button container vmci(X) intel_agp libata pciehp shpchp pci_hotplug i2c_piix4 i2c_core pcspkr sg intel_gtt ac rtc_cmos ext3 jbd mbcache sd_mod crc_t10dif mptspi mptscsih mptbase scsi_transport_spi processor thermal_sys hwmon scsi_dh_alua scsi_dh_hp_sw scsi_dh_rdac scsi_dh_emc scsi_dh scsi_mod vmxnet(X) vmxnet3(X) xhci_hcd uhci_hcd ohci_hcd ehci_hcd usbcore usb_common

Jan  4 04:47:15 SERVERNAME kernel: [17275671.001123] Supported: Yes, External

Jan  4 04:47:15 SERVERNAME kernel: [17275671.001125]

Jan  4 04:47:15 SERVERNAME kernel: [17275671.001127] Pid: 1319, comm: vmtoolsd Tainted: G            X 3.0.101-0.7.23-default #1 VMware, Inc. VMware Virtual Platform/440BX Desktop Reference Platform

Jan  4 04:47:15 SERVERNAME kernel: [17275671.001132] RIP: 0010:[<ffffffff81449fad>]  [<ffffffff81449fad>] retint_careful+0xb/0x32

Jan  4 04:47:15 SERVERNAME kernel: [17275671.001144] RSP: 0000:ffff8802310d7f88  EFLAGS: 00000203

Jan  4 04:47:15 SERVERNAME kernel: [17275671.001146] RAX: 0000000000000000 RBX: ffffffff81071aa5 RCX: ffff8802310d6000

Jan  4 04:47:15 SERVERNAME kernel: [17275671.001147] RDX: 0000000000000008 RSI: 0000000000000008 RDI: 000000000000fe2e

Jan  4 04:47:15 SERVERNAME kernel: [17275671.001148] RBP: 00000000006c7fb0 R08: ffffffff81605300 R09: 0000000000000000

Jan  4 04:47:15 SERVERNAME kernel: [17275671.001149] R10: 0000000000000000 R11: ffffffff81048ab0 R12: ffffffff814522ee

Jan  4 04:47:15 SERVERNAME kernel: [17275671.001151] R13: 0000000000000000 R14: ffff8802310d7f48 R15: ffff88022f8ac580

Jan  4 04:47:15 SERVERNAME kernel: [17275671.001153] FS:  00007f604a79b700(0000) GS:ffff88023fc00000(0000) knlGS:0000000000000000

Jan  4 04:47:15 SERVERNAME kernel: [17275671.001154] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b

Jan  4 04:47:15 SERVERNAME kernel: [17275671.001156] CR2: 00007f70cc14b000 CR3: 00000002314a2000 CR4: 00000000000006f0

Jan  4 04:47:15 SERVERNAME kernel: [17275671.001164] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000

Jan  4 04:47:15 SERVERNAME kernel: [17275671.001200] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400

Jan  4 04:47:15 SERVERNAME kernel: [17275671.001204] Process vmtoolsd (pid: 1319, threadinfo ffff8802310d6000, task ffff88022f8ac580)

Jan  4 04:47:15 SERVERNAME kernel: [17275671.001205] Stack:

Jan  4 04:47:22 SERVERNAME kernel: [17275671.002858]  00007f60487f3e20 0000000000000001 0000000000000527 00000000006c16d8

Jan  4 04:47:22 SERVERNAME kernel: [17275671.002861]  0000000000000000 0000000000010000 0000000000005658 00000000ed76cd77

Jan  4 04:47:22 SERVERNAME kernel: [17275671.002864]  00007f6082e9b3b6 ffffffffffffff02 00007f604885429d 0000000000000033

Jan  4 04:47:22 SERVERNAME kernel: [17275671.002866] Call Trace:

Jan  4 04:47:22 SERVERNAME kernel: [17275671.003442]  [<00007f604885429d>] 0x7f604885429c

Jan  4 04:47:22 SERVERNAME kernel: [17275671.003443] Code: 24 30 48 8b 74 24 38 48 8b 7c 24 40 48 83 c4 50 48 cf 66 66 66 90 0f 1f 84 00 00 00 00 00 48 cf 0f ba e2 03 73 2c fb 66 66 66 90

Jan  4 04:47:22 SERVERNAME kernel: <66>[17275671.004090]  66 90 57 e8 2a dc ff ff 5f 65 48 8b 0c 25 08 b6 00 00 48 81

Jan  4 04:47:22 SERVERNAME kernel: [17275671.004598] Call Trace:

Jan  4 04:47:22 SERVERNAME kernel: [17275671.004611]  [<00007f604885429d>] 0x7f604885429c

Jan  4 04:47:22 SERVERNAME kernel: klogd 1.4.1, ---------- state change ----------

0 Kudos
0 Replies