Re: Emulex LPe32000 NVMe over Fabric path is Dead

kp3k · ‎05-17-2021

Configuration:

ESX 7.0.1

Emulex LPe32000 (storage adapther)

Brocade G620 (switch)

Fujitsu AB6100 (storage)

I see on ESX Controllers and also Namespaces, but I can't create datastore, because the path status is "dead"

vmkernel log show some failures, but not clear for me what is wrong

Thanks for any help

Peter

Spoiler

2021-05-12T11:31:41.779Z cpu6:2098263)NVMFDEV:159 Controller 287, connecting using parameters:
2021-05-12T11:31:41.779Z cpu16:2098262)WARNING: NVMFEVT:1019 Failed to connect controller nqn.1992-08.com.netapp:6000.6d039ea0003eb25a000000006081254c, status: Failure
2021-05-12T11:31:41.779Z cpu6:2098263)NVMFDEV:161 kato: 30000
2021-05-12T11:31:41.779Z cpu6:2098263)NVMFDEV:162 subtype: 2
2021-05-12T11:31:41.779Z cpu6:2098263)NVMFDEV:163 vmkParams.asqsize: 4096
2021-05-12T11:31:41.779Z cpu6:2098263)NVMFDEV:164 vmkParams.cntlid: 0xffff
2021-05-12T11:31:41.779Z cpu6:2098263)NVMFDEV:166 vmkParams.hostid: 609249a2-41ed-c5f6-912f-4c52624dd08f
2021-05-12T11:31:41.779Z cpu6:2098263)NVMFDEV:167 vmkParams.hostnqn: nqn.2014-08.org.nvmexpress:uuid:609249a2-41ed-c5f6-912f-4c52624dd08f
2021-05-12T11:31:41.779Z cpu6:2098263)NVMFDEV:168 vmkParams.subnqn: nqn.1992-08.com.netapp:6000.6d039ea0003eb25a000000006081254c
2021-05-12T11:31:41.779Z cpu6:2098263)NVMFDEV:178 vmkParams.trType: FC
2021-05-12T11:31:41.779Z cpu6:2098263)NVMFDEV:180 vmkParams.trwwnn: 2002d039ea3ef40b
2021-05-12T11:31:41.779Z cpu6:2098263)NVMFDEV:182 vmkParams.trwwpn: 2063d039ea3ef40b
2021-05-12T11:31:41.779Z cpu25:2098264)NVMEDEV:1018 Ctlr 288 allocated, maximum queues 32
2021-05-12T11:31:41.779Z cpu6:2098263)WARNING: lpfc: lpfc_remoteport_add:2606: 1:6067 No match 2063d039ea3ef40b
2021-05-12T11:31:41.779Z cpu6:2098263)WARNING: brcmnvmefc: nvmefcGetRemotePort:2605: 1073 - Get Remote Port Failed
2021-05-12T11:31:41.779Z cpu6:2098263)WARNING: brcmnvmefc: nvmefcConnectCtrlr:2653: 1076 - Failed in Remote Port Get WWNN : x2002d039ea3ef40b WWPN : x2063d039ea 3ef40b

2021-05-12T11:31:41.987Z cpu26:2098229)NvmeDiscover: 1715: Scan operation 0 completed on adapter vmhba64
2021-05-12T11:31:41.987Z cpu6:2098250)NVMEDEV:877 Ctlr 274, queue 3, update queue size to 1024
2021-05-12T11:31:41.987Z cpu26:2098229)NVMEDEV:3058 discovering namespaces...
2021-05-12T11:31:41.987Z cpu6:2098250)NVMEDEV:1523 Ctlr 274, creating IO queue 4 (qsize 1024)
2021-05-12T11:31:41.987Z cpu6:2098250)NVMFDEV:2160 controller 274, queue 4
2021-05-12T11:31:41.987Z cpu26:2098229)NVMEDEV:4244 Discover namespace on controller 261
2021-05-12T11:31:41.987Z cpu6:2098250)lpfc: lpfc_nvme_create_queue:98: 1:6075 Binding IO HdwQueue 4 to io_channel 4 qhandle 0x430f0052c760
2021-05-12T11:31:41.987Z cpu17:2098258)NVMFDEV:1837 controller 282, queue 3
2021-05-12T11:31:41.987Z cpu17:2098258)WARNING: NVMEIO:2707 Ctlr 282, nvmeCmd 0x45d9883ffa00 (opc 7f), queue 3 (expect 3) not available, nvmeStatus 805
2021-05-12T11:31:41.987Z cpu23:2098237)NVMFDEV:1837 controller 269, queue 2
2021-05-12T11:31:41.987Z cpu23:2098237)WARNING: NVMEIO:2707 Ctlr 269, nvmeCmd 0x45d9883ff880 (opc 7f), queue 2 (expect 2) not available, nvmeStatus 805
2021-05-12T11:31:41.987Z cpu17:2098258)NVMFDEV:1910 Connected to queue 3, successfully
2021-05-12T11:31:41.987Z cpu17:2098258)NVMFDEV:2224 CTLR 282 queue 3 (qsize 1024) created successfully.
2021-05-12T11:31:41.987Z cpu17:2098258)NVMEDEV:1530 Ctlr 282, queue 3 created
2021-05-12T11:31:41.987Z cpu17:2098258)NVMEDEV:877 Ctlr 282, queue 3, update queue size to 1024
2021-05-12T11:31:41.987Z cpu17:2098258)NVMEDEV:1523 Ctlr 282, creating IO queue 4 (qsize 1024)
2021-05-12T11:31:41.987Z cpu17:2098258)NVMFDEV:2160 controller 282, queue 4
2021-05-12T11:31:41.987Z cpu17:2098258)lpfc: lpfc_nvme_create_queue:98: 1:6075 Binding IO HdwQueue 4 to io_channel 4 qhandle 0x430f0051aa20
2021-05-12T11:31:41.987Z cpu6:2098250)NVMFDEV:1837 controller 274, queue 4
2021-05-12T11:31:41.987Z cpu23:2098237)NVMFDEV:1910 Connected to queue 2, successfully
2021-05-12T11:31:41.987Z cpu6:2098250)WARNING: NVMEIO:2707 Ctlr 274, nvmeCmd 0x45b9d35ffb80 (opc 7f), queue 4 (expect 4) not available, nvmeStatus 805
2021-05-12T11:31:41.987Z cpu23:2098237)NVMFDEV:2224 CTLR 269 queue 2 (qsize 1024) created successfully.
2021-05-12T11:31:41.987Z cpu23:2098237)NVMEDEV:1530 Ctlr 269, queue 2 created
2021-05-12T11:31:41.987Z cpu23:2098237)NVMEDEV:877 Ctlr 269, queue 2, update queue size to 1024
2021-05-12T11:31:41.987Z cpu23:2098237)NVMEDEV:1523 Ctlr 269, creating IO queue 3 (qsize 1024)
2021-05-12T11:31:41.987Z cpu23:2098237)NVMFDEV:2160 controller 269, queue 3
2021-05-12T11:31:41.987Z cpu23:2098237)lpfc: lpfc_nvme_create_queue:98: 0:6075 Binding IO HdwQueue 3 to io_channel 3 qhandle 0x430f00515fe0
2021-05-12T11:31:41.987Z cpu6:2098250)NVMFDEV:1910 Connected to queue 4, successfully
2021-05-12T11:31:41.987Z cpu6:2098250)NVMFDEV:2224 CTLR 274 queue 4 (qsize 1024) created successfully.
2021-05-12T11:31:41.987Z cpu6:2098250)NVMEDEV:1530 Ctlr 274, queue 4 created
2021-05-12T11:31:41.987Z cpu6:2098250)NVMEDEV:877 Ctlr 274, queue 4, update queue size to 1024
2021-05-12T11:31:41.987Z cpu6:2098250)NVMEDEV:1553 Ctlr 274, 4 IO queues created.
2021-05-12T11:31:41.987Z cpu6:2098250)NVMEDEV:1430 Ctlr 274, numaNode 0, baseQueueID 1, queueMask 3
2021-05-12T11:31:41.987Z cpu6:2098250)NVMEDEV:1430 Ctlr 274, numaNode 1, baseQueueID 1, queueMask 3
2021-05-12T11:31:41.987Z cpu6:2098250)NVMEDEV:1430 Ctlr 274, numaNode 2, baseQueueID 1, queueMask 3
2021-05-12T11:31:41.987Z cpu6:2098250)NVMEDEV:1430 Ctlr 274, numaNode 3, baseQueueID 1, queueMask 3
2021-05-12T11:31:41.987Z cpu17:2098258)NVMFDEV:1837 controller 282, queue 4
2021-05-12T11:31:41.987Z cpu17:2098258)WARNING: NVMEIO:2707 Ctlr 282, nvmeCmd 0x45d9883ffa00 (opc 7f), queue 4 (expect 4) not available, nvmeStatus 805
2021-05-12T11:31:41.987Z cpu6:2098250)NvmeDiscover: 1691: Scan operation 0 received on adapter vmhba65
2021-05-12T11:31:41.987Z cpu6:2098250)NvmeDiscover: 639: controller = nqn.1992-08.com.netapp:6000.6d039ea0003eb25a000000006081254c#vmhba65#2002d039ea3ef40b:2012 d039ea3ef40b
2021-05-12T11:31:41.987Z cpu6:2098250)NvmeDiscover: 577: Controller nqn.1992-08.com.netapp:6000.6d039ea0003eb25a000000006081254c#vmhba65#2002d039ea3ef40b:2012d0 39ea3ef40b fuseOp 0 oncs 20 cmic 3 nscnt ff
2021-05-12T11:31:41.987Z cpu6:2098250)NvmeDiscover: 777: controller Added = nqn.1992-08.com.netapp:6000.6d039ea0003eb25a000000006081254c#vmhba65#2002d039ea3ef40 b:2012d039ea3ef40b
2021-05-12T11:31:41.987Z cpu6:2098250)NvmeDiscover: 1715: Scan operation 0 completed on adapter vmhba65
2021-05-12T11:31:41.987Z cpu6:2098250)NVMEDEV:3058 discovering namespaces...
2021-05-12T11:31:41.987Z cpu6:2098250)NVMEDEV:4244 Discover namespace on controller 274
2021-05-12T11:31:41.987Z cpu23:2098237)NVMFDEV:1837 controller 269, queue 3
2021-05-12T11:31:41.987Z cpu23:2098237)WARNING: NVMEIO:2707 Ctlr 269, nvmeCmd 0x45d9883ff880 (opc 7f), queue 3 (expect 3) not available, nvmeStatus 805
2021-05-12T11:31:41.987Z cpu17:2098258)NVMFDEV:1910 Connected to queue 4, successfully
2021-05-12T11:31:41.987Z cpu17:2098258)NVMFDEV:2224 CTLR 282 queue 4 (qsize 1024) created successfully.
2021-05-12T11:31:41.987Z cpu17:2098258)NVMEDEV:1530 Ctlr 282, queue 4 created
2021-05-12T11:31:41.987Z cpu17:2098258)NVMEDEV:877 Ctlr 282, queue 4, update queue size to 1024
2021-05-12T11:31:41.987Z cpu17:2098258)NVMEDEV:1553 Ctlr 282, 4 IO queues created.
2021-05-12T11:31:41.987Z cpu17:2098258)NVMEDEV:1430 Ctlr 282, numaNode 0, baseQueueID 1, queueMask 3
2021-05-12T11:31:41.987Z cpu17:2098258)NVMEDEV:1430 Ctlr 282, numaNode 1, baseQueueID 1, queueMask 3
2021-05-12T11:31:41.987Z cpu17:2098258)NVMEDEV:1430 Ctlr 282, numaNode 2, baseQueueID 1, queueMask 3
2021-05-12T11:31:41.987Z cpu17:2098258)NVMEDEV:1430 Ctlr 282, numaNode 3, baseQueueID 1, queueMask 3
2021-05-12T11:31:41.987Z cpu17:2098258)NvmeDiscover: 1691: Scan operation 0 received on adapter vmhba65
2021-05-12T11:31:41.987Z cpu17:2098258)NvmeDiscover: 639: controller = nqn.1992-08.com.netapp:6000.6d039ea0003eb25a000000006081254c#vmhba65#2002d039ea3ef40b:201 3d039ea3ef40b
2021-05-12T11:31:41.987Z cpu17:2098258)NvmeDiscover: 577: Controller nqn.1992-08.com.netapp:6000.6d039ea0003eb25a000000006081254c#vmhba65#2002d039ea3ef40b:2013d 039ea3ef40b fuseOp 0 oncs 20 cmic 3 nscnt ff
2021-05-12T11:31:41.987Z cpu17:2098258)NvmeDiscover: 777: controller Added = nqn.1992-08.com.netapp:6000.6d039ea0003eb25a000000006081254c#vmhba65#2002d039ea3ef4 0b:2013d039ea3ef40b
2021-05-12T11:31:41.987Z cpu17:2098258)NvmeDiscover: 1715: Scan operation 0 completed on adapter vmhba65
2021-05-12T11:31:41.987Z cpu17:2098258)NVMEDEV:3058 discovering namespaces...
2021-05-12T11:31:41.987Z cpu17:2098258)NVMEDEV:4244 Discover namespace on controller 282
2021-05-12T11:31:41.987Z cpu23:2098237)NVMFDEV:1910 Connected to queue 3, successfully
2021-05-12T11:31:41.987Z cpu23:2098237)NVMFDEV:2224 CTLR 269 queue 3 (qsize 1024) created successfully.
2021-05-12T11:31:41.987Z cpu23:2098237)NVMEDEV:1530 Ctlr 269, queue 3 created
2021-05-12T11:31:41.987Z cpu23:2098237)NVMEDEV:877 Ctlr 269, queue 3, update queue size to 1024
2021-05-12T11:31:41.987Z cpu23:2098237)NVMEDEV:1523 Ctlr 269, creating IO queue 4 (qsize 1024)
2021-05-12T11:31:41.987Z cpu23:2098237)NVMFDEV:2160 controller 269, queue 4
2021-05-12T11:31:41.987Z cpu23:2098237)lpfc: lpfc_nvme_create_queue:98: 0:6075 Binding IO HdwQueue 4 to io_channel 4 qhandle 0x430f005155e0
2021-05-12T11:31:41.988Z cpu26:2098229)NVMEDEV:4384 Discover namespaces on controller 261 is complete
2021-05-12T11:31:41.988Z cpu26:2098229)NVMEDEV:5717 Configuring aec: 0x100 on controller 261.
2021-05-12T11:31:41.988Z cpu23:2098237)NVMFDEV:1837 controller 269, queue 4
2021-05-12T11:31:41.988Z cpu23:2098237)WARNING: NVMEIO:2707 Ctlr 269, nvmeCmd 0x45d9883ff880 (opc 7f), queue 4 (expect 4) not available, nvmeStatus 805
2021-05-12T11:31:41.988Z cpu23:2098237)NVMFDEV:1910 Connected to queue 4, successfully
2021-05-12T11:31:41.988Z cpu26:2098229)NVMEDEV:5748 Async event configuration value is 0x100 on controller 261.
2021-05-12T11:31:41.988Z cpu23:2098237)NVMFDEV:2224 CTLR 269 queue 4 (qsize 1024) created successfully.
2021-05-12T11:31:41.988Z cpu26:2098229)NVMFDEV:851 Controller 261 (nqn.1992-08.com.netapp:6000.6d039ea0003eb25a000000006081254c#vmhba64#2002d039ea3ef40b:2052d03 9ea3ef40b) registered successfully.
2021-05-12T11:31:41.988Z cpu23:2098237)NVMEDEV:1530 Ctlr 269, queue 4 created
2021-05-12T11:31:41.988Z cpu23:2098237)NVMEDEV:877 Ctlr 269, queue 4, update queue size to 1024
2021-05-12T11:31:41.988Z cpu23:2098237)NVMEDEV:1553 Ctlr 269, 4 IO queues created.
2021-05-12T11:31:41.988Z cpu23:2098237)NVMEDEV:1430 Ctlr 269, numaNode 0, baseQueueID 1, queueMask 3
2021-05-12T11:31:41.988Z cpu23:2098237)NVMEDEV:1430 Ctlr 269, numaNode 1, baseQueueID 1, queueMask 3
2021-05-12T11:31:41.988Z cpu23:2098237)NVMEDEV:1430 Ctlr 269, numaNode 2, baseQueueID 1, queueMask 3
2021-05-12T11:31:41.988Z cpu23:2098237)NVMEDEV:1430 Ctlr 269, numaNode 3, baseQueueID 1, queueMask 3
2021-05-12T11:31:41.988Z cpu23:2098237)NvmeDiscover: 1691: Scan operation 0 received on adapter vmhba64
2021-05-12T11:31:41.988Z cpu23:2098237)NvmeDiscover: 639: controller = nqn.1992-08.com.netapp:6000.6d039ea0003eb25a000000006081254c#vmhba64#2002d039ea3ef40b:205 3d039ea3ef40b
2021-05-12T11:31:41.988Z cpu23:2098237)NvmeDiscover: 577: Controller nqn.1992-08.com.netapp:6000.6d039ea0003eb25a000000006081254c#vmhba64#2002d039ea3ef40b:2053d 039ea3ef40b fuseOp 0 oncs 20 cmic 3 nscnt ff
2021-05-12T11:31:41.988Z cpu17:2098258)NVMEDEV:3565 Controller 282, construct namespace 1
2021-05-12T11:31:41.988Z cpu23:2098237)NvmeDiscover: 777: controller Added = nqn.1992-08.com.netapp:6000.6d039ea0003eb25a000000006081254c#vmhba64#2002d039ea3ef4 0b:2053d039ea3ef40b
2021-05-12T11:31:41.988Z cpu23:2098237)NvmeDiscover: 1715: Scan operation 0 completed on adapter vmhba64
2021-05-12T11:31:41.988Z cpu23:2098237)NVMEDEV:3058 discovering namespaces...
2021-05-12T11:31:41.988Z cpu23:2098237)NVMEDEV:4244 Discover namespace on controller 269
2021-05-12T11:31:41.988Z cpu17:2098258)NVMEDEV:3505 Namespace identifier type 0x2, length 0x10.
2021-05-12T11:31:41.988Z cpu17:2098258)NVMEDEV:3605 UUID is not supported by namespace 1
2021-05-12T11:31:41.988Z cpu17:2098258)NVMEDEV:3446 Set name of ns 1 to eui.00000100608a37e4d039ea00003eb25a
2021-05-12T11:31:41.988Z cpu17:2098258)NvmeDiscover: 1691: Scan operation 3 received on adapter vmhba65
2021-05-12T11:31:41.988Z cpu17:2098258)NvmeDiscover: 1103: controller = nqn.1992-08.com.netapp:6000.6d039ea0003eb25a000000006081254c#vmhba65#2002d039ea3ef40b:20 13d039ea3ef40b
2021-05-12T11:31:41.988Z cpu17:2098258)NvmeDiscover: 428: controller = nqn.1992-08.com.netapp:6000.6d039ea0003eb25a000000006081254c#vmhba65#2002d039ea3ef40b:201 3d039ea3ef40b
2021-05-12T11:31:41.988Z cpu17:2098258)NVMEPSA:1218 adpater: vmhba65, action: 0
2021-05-12T11:31:41.988Z cpu17:2098258)NvmeDiscover: 1336: Created path for NS (under nqn.1992-08.com.netapp:6000.6d039ea0003eb25a000000006081254c#vmhba65#2002d 039ea3ef40b:2013d039ea3ef40b) 0x43085c49a740 = 0x431554e1ed00 for ns = 1 for path
2021-05-12T11:31:41.988Z cpu17:2098258)vmhba65:C0:T1:L0
2021-05-12T11:31:41.988Z cpu17:2098258)NvmeDiscover: 1359: ANA enabled = 0 on ns=1
2021-05-12T11:31:41.988Z cpu17:2098258)NvmeDiscover: 1715: Scan operation 3 completed on adapter vmhba65
2021-05-12T11:31:41.988Z cpu17:2098258)NVMEDEV:3565 Controller 282, construct namespace 3
2021-05-12T11:31:41.988Z cpu23:2098237)NVMEDEV:3565 Controller 269, construct namespace 1
2021-05-12T11:31:41.988Z cpu6:2098250)NVMEDEV:4384 Discover namespaces on controller 274 is complete
2021-05-12T11:31:41.988Z cpu6:2098250)NVMEDEV:5717 Configuring aec: 0x100 on controller 274.
2021-05-12T11:31:41.988Z cpu17:2098258)NVMEDEV:3505 Namespace identifier type 0x2, length 0x10.
2021-05-12T11:31:41.988Z cpu17:2098258)NVMEDEV:3605 UUID is not supported by namespace 3
2021-05-12T11:31:41.988Z cpu17:2098258)NVMEDEV:3446 Set name of ns 3 to eui.0000016e60950d58d039ea00003eb25a
2021-05-12T11:31:41.988Z cpu17:2098258)NvmeDiscover: 1691: Scan operation 3 received on adapter vmhba65
2021-05-12T11:31:41.988Z cpu17:2098258)NvmeDiscover: 1103: controller = nqn.1992-08.com.netapp:6000.6d039ea0003eb25a000000006081254c#vmhba65#2002d039ea3ef40b:20 13d039ea3ef40b
2021-05-12T11:31:41.988Z cpu17:2098258)NvmeDiscover: 428: controller = nqn.1992-08.com.netapp:6000.6d039ea0003eb25a000000006081254c#vmhba65#2002d039ea3ef40b:201 3d039ea3ef40b
2021-05-12T11:31:41.988Z cpu17:2098258)NVMEPSA:1218 adpater: vmhba65, action: 0
2021-05-12T11:31:41.988Z cpu17:2098258)NvmeDiscover: 1336: Created path for NS (under nqn.1992-08.com.netapp:6000.6d039ea0003eb25a000000006081254c#vmhba65#2002d 039ea3ef40b:2013d039ea3ef40b) 0x43085c49b940 = 0x431554e27cc0 for ns = 3 for path
2021-05-12T11:31:41.988Z cpu6:2098250)NVMEDEV:5748 Async event configuration value is 0x100 on controller 274.
2021-05-12T11:31:41.988Z cpu17:2098258)vmhba65:C0:T1:L2
2021-05-12T11:31:41.988Z cpu23:2098237)NVMEDEV:3505 Namespace identifier type 0x2, length 0x10.
2021-05-12T11:31:41.988Z cpu6:2098250)NVMFDEV:851 Controller 274 (nqn.1992-08.com.netapp:6000.6d039ea0003eb25a000000006081254c#vmhba65#2002d039ea3ef40b:2012d039 ea3ef40b) registered successfully.
2021-05-12T11:31:41.988Z cpu17:2098258)NvmeDiscover: 1359: ANA enabled = 0 on ns=3
2021-05-12T11:31:41.988Z cpu23:2098237)NVMEDEV:3605 UUID is not supported by namespace 1
2021-05-12T11:31:41.988Z cpu23:2098237)NVMEDEV:3446 Set name of ns 1 to eui.00000100608a37e4d039ea00003eb25a
2021-05-12T11:31:41.988Z cpu23:2098237)NvmeDiscover: 1691: Scan operation 3 received on adapter vmhba64
2021-05-12T11:31:41.988Z cpu23:2098237)NvmeDiscover: 1103: controller = nqn.1992-08.com.netapp:6000.6d039ea0003eb25a000000006081254c#vmhba64#2002d039ea3ef40b:20 53d039ea3ef40b
2021-05-12T11:31:41.988Z cpu17:2098258)NvmeDiscover: 1715: Scan operation 3 completed on adapter vmhba65
2021-05-12T11:31:41.988Z cpu17:2098258)NVMEDEV:4384 Discover namespaces on controller 282 is complete
2021-05-12T11:31:41.988Z cpu23:2098237)NvmeDiscover: 428: controller = nqn.1992-08.com.netapp:6000.6d039ea0003eb25a000000006081254c#vmhba64#2002d039ea3ef40b:205 3d039ea3ef40b
2021-05-12T11:31:41.988Z cpu17:2098258)NVMEDEV:5717 Configuring aec: 0x100 on controller 282.
2021-05-12T11:31:41.988Z cpu23:2098237)NVMEPSA:1218 adpater: vmhba64, action: 0
2021-05-12T11:31:41.988Z cpu23:2098237)NvmeDiscover: 1336: Created path for NS (under nqn.1992-08.com.netapp:6000.6d039ea0003eb25a000000006081254c#vmhba64#2002d 039ea3ef40b:2053d039ea3ef40b) 0x43085c49f980 = 0x431554e61440 for ns = 1 for path
2021-05-12T11:31:41.988Z cpu23:2098237)vmhba64:C0:T1:L0
2021-05-12T11:31:41.988Z cpu23:2098237)NvmeDiscover: 1359: ANA enabled = 0 on ns=1
2021-05-12T11:31:41.988Z cpu23:2098237)NvmeDiscover: 1715: Scan operation 3 completed on adapter vmhba64
2021-05-12T11:31:41.988Z cpu23:2098237)NVMEDEV:3565 Controller 269, construct namespace 3
2021-05-12T11:31:41.988Z cpu17:2098258)NVMEDEV:5748 Async event configuration value is 0x100 on controller 282.
2021-05-12T11:31:41.988Z cpu17:2098258)NVMFDEV:851 Controller 282 (nqn.1992-08.com.netapp:6000.6d039ea0003eb25a000000006081254c#vmhba65#2002d039ea3ef40b:2013d03 9ea3ef40b) registered successfully.
2021-05-12T11:31:41.988Z cpu16:2098101)WARNING: brcmnvmefc: nvmefcRportEventCmpl:2832: 1154 Rport event 3
2021-05-12T11:31:41.988Z cpu16:2098101)NVMEDEV:1018 Ctlr 290 allocated, maximum queues 32
2021-05-12T11:31:41.988Z cpu16:2098101)NVMFDEV:159 Controller 290, connecting using parameters:
2021-05-12T11:31:41.988Z cpu16:2098101)NVMFDEV:161 kato: 0
2021-05-12T11:31:41.988Z cpu16:2098101)NVMFDEV:162 subtype: 1
2021-05-12T11:31:41.988Z cpu16:2098101)NVMFDEV:163 vmkParams.asqsize: 16
2021-05-12T11:31:41.988Z cpu16:2098101)NVMFDEV:164 vmkParams.cntlid: 0xffff
2021-05-12T11:31:41.988Z cpu16:2098101)NVMFDEV:166 vmkParams.hostid: 609249a2-41ed-c5f6-912f-4c52624dd08f
2021-05-12T11:31:41.988Z cpu23:2098237)NVMEDEV:3505 Namespace identifier type 0x2, length 0x10.
2021-05-12T11:31:41.988Z cpu16:2098101)NVMFDEV:167 vmkParams.hostnqn: nqn.2014-08.org.nvmexpress:uuid:609249a2-41ed-c5f6-912f-4c52624dd08f
2021-05-12T11:31:41.988Z cpu16:2098101)NVMFDEV:168 vmkParams.subnqn: nqn.2014-08.org.nvmexpress.discovery
2021-05-12T11:31:41.988Z cpu23:2098237)NVMEDEV:3605 UUID is not supported by namespace 3
2021-05-12T11:31:41.988Z cpu16:2098101)NVMFDEV:178 vmkParams.trType: FC
2021-05-12T11:31:41.988Z cpu16:2098101)NVMFDEV:180 vmkParams.trwwnn: 2002d039ea3ef40b
2021-05-12T11:31:41.988Z cpu23:2098237)NVMEDEV:3446 Set name of ns 3 to eui.0000016e60950d58d039ea00003eb25a
2021-05-12T11:31:41.988Z cpu16:2098101)NVMFDEV:182 vmkParams.trwwpn: 2013d039ea3ef40b
2021-05-12T11:31:41.988Z cpu23:2098237)NvmeDiscover: 1691: Scan operation 3 received on adapter vmhba64
2021-05-12T11:31:41.988Z cpu16:2098101)lpfc: lpfc_nvme_create_queue:98: 1:6075 Binding ADM HdwQueue 0 to io_channel 0 qhandle 0x430f005153e0
2021-05-12T11:31:41.988Z cpu23:2098237)NvmeDiscover: 1103: controller = nqn.1992-08.com.netapp:6000.6d039ea0003eb25a000000006081254c#vmhba64#2002d039ea3ef40b:20 53d039ea3ef40b
2021-05-12T11:31:41.988Z cpu23:2098237)NvmeDiscover: 428: controller = nqn.1992-08.com.netapp:6000.6d039ea0003eb25a000000006081254c#vmhba64#2002d039ea3ef40b:205 3d039ea3ef40b
2021-05-12T11:31:41.988Z cpu23:2098237)NVMEPSA:1218 adpater: vmhba64, action: 0
2021-05-12T11:31:41.988Z cpu23:2098237)NvmeDiscover: 1336: Created path for NS (under nqn.1992-08.com.netapp:6000.6d039ea0003eb25a000000006081254c#vmhba64#2002d 039ea3ef40b:2053d039ea3ef40b) 0x43085c4a0a80 = 0x431554e3a440 for ns = 3 for path
2021-05-12T11:31:41.988Z cpu23:2098237)vmhba64:C0:T1:L2
2021-05-12T11:31:41.988Z cpu23:2098237)NvmeDiscover: 1359: ANA enabled = 0 on ns=3
2021-05-12T11:31:41.988Z cpu23:2098237)NvmeDiscover: 1715: Scan operation 3 completed on adapter vmhba64
2021-05-12T11:31:41.988Z cpu23:2098237)NVMEDEV:4384 Discover namespaces on controller 269 is complete
2021-05-12T11:31:41.988Z cpu23:2098237)NVMEDEV:5717 Configuring aec: 0x100 on controller 269.
2021-05-12T11:31:41.988Z cpu16:2098101)WARNING: brcmnvmefc: nvmefcSendLsReq:1783: 1040 - NVMe Reject Reason(Code : x43 Explanation : x0) for LS_CMD : 3
2021-05-12T11:31:41.988Z cpu16:2098101)WARNING: brcmnvmefc: nvmefcConnectCtrlr:2747: 1082 - NVME Create Association Failed: Not supported
2021-05-12T11:31:41.988Z cpu16:2098101)lpfc: lpfc_nvme_delete_queue:128: 1:6001 ENTER. lpfc_pnvme qidx x0i qhandle 0x430f005153e0
2021-05-12T11:31:41.989Z cpu16:2098101)WARNING: NVMFDEV:800 Failed to transport connect controller 290, status: Not supported
2021-05-12T11:31:41.989Z cpu16:2098101)NVMEDEV:1095 Ctlr 290 freeing
2021-05-12T11:31:41.989Z cpu16:2098101)NVMEDEV:6117 Cancel requests of controller 290, 0 left.
2021-05-12T11:31:41.989Z cpu16:2098101)WARNING: NVMFDEV:1300 Failed to connect to controller, status: Not supported
2021-05-12T11:31:41.989Z cpu16:2098101)WARNING: NVMFEVT:1405 Failed to discover controllers, status: Not supported
2021-05-12T11:31:41.989Z cpu16:2098101)WARNING: NVMFEVT:1575 Discover and connect controller failed: Not supported
2021-05-12T11:31:41.989Z cpu16:2098101)WARNING: NVMFEVT:1745 Event handler for the event 3 failed with status : Not supported
2021-05-12T11:31:41.989Z cpu16:2098101)WARNING: brcmnvmefc: nvmefcRportEventCmpl:2832: 1154 Rport event 3
2021-05-12T11:31:41.989Z cpu23:2098237)NVMEDEV:5748 Async event configuration value is 0x100 on controller 269.
2021-05-12T11:31:41.989Z cpu23:2098237)NVMFDEV:851 Controller 269 (nqn.1992-08.com.netapp:6000.6d039ea0003eb25a000000006081254c#vmhba64#2002d039ea3ef40b:2053d03 9ea3ef40b) registered successfully.
2021-05-12T11:31:41.989Z cpu19:2098099)WARNING: brcmnvmefc: nvmefcRportEventCmpl:2832: 1154 Rport event 3
2021-05-12T11:31:41.989Z cpu19:2098099)NVMEDEV:1018 Ctlr 291 allocated, maximum queues 32
2021-05-12T11:31:41.989Z cpu19:2098099)NVMFDEV:159 Controller 291, connecting using parameters:
2021-05-12T11:31:41.989Z cpu19:2098099)NVMFDEV:161 kato: 0
2021-05-12T11:31:41.989Z cpu19:2098099)NVMFDEV:162 subtype: 1
2021-05-12T11:31:41.989Z cpu19:2098099)NVMFDEV:163 vmkParams.asqsize: 16
2021-05-12T11:31:41.989Z cpu19:2098099)NVMFDEV:164 vmkParams.cntlid: 0xffff
2021-05-12T11:31:41.989Z cpu19:2098099)NVMFDEV:166 vmkParams.hostid: 609249a2-41ed-c5f6-912f-4c52624dd08f
2021-05-12T11:31:41.989Z cpu19:2098099)NVMFDEV:167 vmkParams.hostnqn: nqn.2014-08.org.nvmexpress:uuid:609249a2-41ed-c5f6-912f-4c52624dd08f
2021-05-12T11:31:41.989Z cpu19:2098099)NVMFDEV:168 vmkParams.subnqn: nqn.2014-08.org.nvmexpress.discovery
2021-05-12T11:31:41.989Z cpu19:2098099)NVMFDEV:178 vmkParams.trType: FC
2021-05-12T11:31:41.989Z cpu19:2098099)NVMFDEV:180 vmkParams.trwwnn: 2002d039ea3ef40b
2021-05-12T11:31:41.989Z cpu19:2098099)NVMFDEV:182 vmkParams.trwwpn: 2053d039ea3ef40b
2021-05-12T11:31:41.989Z cpu19:2098099)lpfc: lpfc_nvme_create_queue:98: 0:6075 Binding ADM HdwQueue 0 to io_channel 0 qhandle 0x430f005153e0
2021-05-12T11:31:41.989Z cpu19:2098099)WARNING: brcmnvmefc: nvmefcSendLsReq:1783: 1040 - NVMe Reject Reason(Code : x43 Explanation : x0) for LS_CMD : 3
2021-05-12T11:31:41.989Z cpu19:2098099)WARNING: brcmnvmefc: nvmefcConnectCtrlr:2747: 1082 - NVME Create Association Failed: Not supported
2021-05-12T11:31:41.989Z cpu19:2098099)lpfc: lpfc_nvme_delete_queue:128: 0:6001 ENTER. lpfc_pnvme qidx x0i qhandle 0x430f005153e0
2021-05-12T11:31:41.989Z cpu19:2098099)WARNING: NVMFDEV:800 Failed to transport connect controller 291, status: Not supported
2021-05-12T11:31:41.989Z cpu19:2098099)NVMEDEV:1095 Ctlr 291 freeing
2021-05-12T11:31:41.989Z cpu19:2098099)NVMEDEV:6117 Cancel requests of controller 291, 0 left.
2021-05-12T11:31:41.989Z cpu19:2098099)WARNING: NVMFDEV:1300 Failed to connect to controller, status: Not supported
2021-05-12T11:31:41.989Z cpu19:2098099)WARNING: NVMFEVT:1405 Failed to discover controllers, status: Not supported
2021-05-12T11:31:41.989Z cpu19:2098099)WARNING: NVMFEVT:1575 Discover and connect controller failed: Not supported
2021-05-12T11:31:41.989Z cpu19:2098099)WARNING: NVMFEVT:1745 Event handler for the event 3 failed with status : Not supported
2021-05-12T11:31:41.989Z cpu19:2098099)WARNING: brcmnvmefc: nvmefcRportEventCmpl:2832: 1154 Rport event 3

2021-05-12T11:31:41.779Z cpu6:2098263)NVMFDEV:159 Controller 287, connecting using parameters:2021-05-12T11:31:41.779Z cpu16:2098262)WARNING: NVMFEVT:1019 Failed to connect controller nqn.1992-08.com.netapp:6000.6d039ea0003eb25a000000006081254c, status: Failure2021-05-12T11:31:41.779Z cpu6:2098263)NVMFDEV:161 kato: 300002021-05-12T11:31:41.779Z cpu6:2098263)NVMFDEV:162 subtype: 22021-05-12T11:31:41.779Z cpu6:2098263)NVMFDEV:163 vmkParams.asqsize: 40962021-05-12T11:31:41.779Z cpu6:2098263)NVMFDEV:164 vmkParams.cntlid: 0xffff2021-05-12T11:31:41.779Z cpu6:2098263)NVMFDEV:166 vmkParams.hostid: 609249a2-41ed-c5f6-912f-4c52624dd08f2021-05-12T11:31:41.779Z cpu6:2098263)NVMFDEV:167 vmkParams.hostnqn: nqn.2014-08.org.nvmexpress:uuid:609249a2-41ed-c5f6-912f-4c52624dd08f2021-05-12T11:31:41.779Z cpu6:2098263)NVMFDEV:168 vmkParams.subnqn: nqn.1992-08.com.netapp:6000.6d039ea0003eb25a000000006081254c2021-05-12T11:31:41.779Z cpu6:2098263)NVMFDEV:178 vmkParams.trType: FC2021-05-12T11:31:41.779Z cpu6:2098263)NVMFDEV:180 vmkParams.trwwnn: 2002d039ea3ef40b2021-05-12T11:31:41.779Z cpu6:2098263)NVMFDEV:182 vmkParams.trwwpn: 2063d039ea3ef40b2021-05-12T11:31:41.779Z cpu25:2098264)NVMEDEV:1018 Ctlr 288 allocated, maximum queues 322021-05-12T11:31:41.779Z cpu6:2098263)WARNING: lpfc: lpfc_remoteport_add:2606: 1:6067 No match 2063d039ea3ef40b2021-05-12T11:31:41.779Z cpu6:2098263)WARNING: brcmnvmefc: nvmefcGetRemotePort:2605: 1073 - Get Remote Port Failed2021-05-12T11:31:41.779Z cpu6:2098263)WARNING: brcmnvmefc: nvmefcConnectCtrlr:2653: 1076 - Failed in Remote Port Get WWNN : x2002d039ea3ef40b WWPN : x2063d039ea 3ef40b 2021-05-12T11:31:41.987Z cpu26:2098229)NvmeDiscover: 1715: Scan operation 0 completed on adapter vmhba642021-05-12T11:31:41.987Z cpu6:2098250)NVMEDEV:877 Ctlr 274, queue 3, update queue size to 10242021-05-12T11:31:41.987Z cpu26:2098229)NVMEDEV:3058 discovering namespaces...2021-05-12T11:31:41.987Z cpu6:2098250)NVMEDEV:1523 Ctlr 274, creating IO queue 4 (qsize 1024)2021-05-12T11:31:41.987Z cpu6:2098250)NVMFDEV:2160 controller 274, queue 42021-05-12T11:31:41.987Z cpu26:2098229)NVMEDEV:4244 Discover namespace on controller 2612021-05-12T11:31:41.987Z cpu6:2098250)lpfc: lpfc_nvme_create_queue:98: 1:6075 Binding IO HdwQueue 4 to io_channel 4 qhandle 0x430f0052c7602021-05-12T11:31:41.987Z cpu17:2098258)NVMFDEV:1837 controller 282, queue 32021-05-12T11:31:41.987Z cpu17:2098258)WARNING: NVMEIO:2707 Ctlr 282, nvmeCmd 0x45d9883ffa00 (opc 7f), queue 3 (expect 3) not available, nvmeStatus 8052021-05-12T11:31:41.987Z cpu23:2098237)NVMFDEV:1837 controller 269, queue 22021-05-12T11:31:41.987Z cpu23:2098237)WARNING: NVMEIO:2707 Ctlr 269, nvmeCmd 0x45d9883ff880 (opc 7f), queue 2 (expect 2) not available, nvmeStatus 8052021-05-12T11:31:41.987Z cpu17:2098258)NVMFDEV:1910 Connected to queue 3, successfully2021-05-12T11:31:41.987Z cpu17:2098258)NVMFDEV:2224 CTLR 282 queue 3 (qsize 1024) created successfully.2021-05-12T11:31:41.987Z cpu17:2098258)NVMEDEV:1530 Ctlr 282, queue 3 created2021-05-12T11:31:41.987Z cpu17:2098258)NVMEDEV:877 Ctlr 282, queue 3, update queue size to 10242021-05-12T11:31:41.987Z cpu17:2098258)NVMEDEV:1523 Ctlr 282, creating IO queue 4 (qsize 1024)2021-05-12T11:31:41.987Z cpu17:2098258)NVMFDEV:2160 controller 282, queue 42021-05-12T11:31:41.987Z cpu17:2098258)lpfc: lpfc_nvme_create_queue:98: 1:6075 Binding IO HdwQueue 4 to io_channel 4 qhandle 0x430f0051aa202021-05-12T11:31:41.987Z cpu6:2098250)NVMFDEV:1837 controller 274, queue 42021-05-12T11:31:41.987Z cpu23:2098237)NVMFDEV:1910 Connected to queue 2, successfully2021-05-12T11:31:41.987Z cpu6:2098250)WARNING: NVMEIO:2707 Ctlr 274, nvmeCmd 0x45b9d35ffb80 (opc 7f), queue 4 (expect 4) not available, nvmeStatus 8052021-05-12T11:31:41.987Z cpu23:2098237)NVMFDEV:2224 CTLR 269 queue 2 (qsize 1024) created successfully.2021-05-12T11:31:41.987Z cpu23:2098237)NVMEDEV:1530 Ctlr 269, queue 2 created2021-05-12T11:31:41.987Z cpu23:2098237)NVMEDEV:877 Ctlr 269, queue 2, update queue size to 10242021-05-12T11:31:41.987Z cpu23:2098237)NVMEDEV:1523 Ctlr 269, creating IO queue 3 (qsize 1024)2021-05-12T11:31:41.987Z cpu23:2098237)NVMFDEV:2160 controller 269, queue 32021-05-12T11:31:41.987Z cpu23:2098237)lpfc: lpfc_nvme_create_queue:98: 0:6075 Binding IO HdwQueue 3 to io_channel 3 qhandle 0x430f00515fe02021-05-12T11:31:41.987Z cpu6:2098250)NVMFDEV:1910 Connected to queue 4, successfully2021-05-12T11:31:41.987Z cpu6:2098250)NVMFDEV:2224 CTLR 274 queue 4 (qsize 1024) created successfully.2021-05-12T11:31:41.987Z cpu6:2098250)NVMEDEV:1530 Ctlr 274, queue 4 created2021-05-12T11:31:41.987Z cpu6:2098250)NVMEDEV:877 Ctlr 274, queue 4, update queue size to 10242021-05-12T11:31:41.987Z cpu6:2098250)NVMEDEV:1553 Ctlr 274, 4 IO queues created.2021-05-12T11:31:41.987Z cpu6:2098250)NVMEDEV:1430 Ctlr 274, numaNode 0, baseQueueID 1, queueMask 32021-05-12T11:31:41.987Z cpu6:2098250)NVMEDEV:1430 Ctlr 274, numaNode 1, baseQueueID 1, queueMask 32021-05-12T11:31:41.987Z cpu6:2098250)NVMEDEV:1430 Ctlr 274, numaNode 2, baseQueueID 1, queueMask 32021-05-12T11:31:41.987Z cpu6:2098250)NVMEDEV:1430 Ctlr 274, numaNode 3, baseQueueID 1, queueMask 32021-05-12T11:31:41.987Z cpu17:2098258)NVMFDEV:1837 controller 282, queue 42021-05-12T11:31:41.987Z cpu17:2098258)WARNING: NVMEIO:2707 Ctlr 282, nvmeCmd 0x45d9883ffa00 (opc 7f), queue 4 (expect 4) not available, nvmeStatus 8052021-05-12T11:31:41.987Z cpu6:2098250)NvmeDiscover: 1691: Scan operation 0 received on adapter vmhba652021-05-12T11:31:41.987Z cpu6:2098250)NvmeDiscover: 639: controller = nqn.1992-08.com.netapp:6000.6d039ea0003eb25a000000006081254c#vmhba65#2002d039ea3ef40b:2012 d039ea3ef40b2021-05-12T11:31:41.987Z cpu6:2098250)NvmeDiscover: 577: Controller nqn.1992-08.com.netapp:6000.6d039ea0003eb25a000000006081254c#vmhba65#2002d039ea3ef40b:2012d0 39ea3ef40b fuseOp 0 oncs 20 cmic 3 nscnt ff2021-05-12T11:31:41.987Z cpu6:2098250)NvmeDiscover: 777: controller Added = nqn.1992-08.com.netapp:6000.6d039ea0003eb25a000000006081254c#vmhba65#2002d039ea3ef40 b:2012d039ea3ef40b2021-05-12T11:31:41.987Z cpu6:2098250)NvmeDiscover: 1715: Scan operation 0 completed on adapter vmhba652021-05-12T11:31:41.987Z cpu6:2098250)NVMEDEV:3058 discovering namespaces...2021-05-12T11:31:41.987Z cpu6:2098250)NVMEDEV:4244 Discover namespace on controller 2742021-05-12T11:31:41.987Z cpu23:2098237)NVMFDEV:1837 controller 269, queue 32021-05-12T11:31:41.987Z cpu23:2098237)WARNING: NVMEIO:2707 Ctlr 269, nvmeCmd 0x45d9883ff880 (opc 7f), queue 3 (expect 3) not available, nvmeStatus 8052021-05-12T11:31:41.987Z cpu17:2098258)NVMFDEV:1910 Connected to queue 4, successfully2021-05-12T11:31:41.987Z cpu17:2098258)NVMFDEV:2224 CTLR 282 queue 4 (qsize 1024) created successfully.2021-05-12T11:31:41.987Z cpu17:2098258)NVMEDEV:1530 Ctlr 282, queue 4 created2021-05-12T11:31:41.987Z cpu17:2098258)NVMEDEV:877 Ctlr 282, queue 4, update queue size to 10242021-05-12T11:31:41.987Z cpu17:2098258)NVMEDEV:1553 Ctlr 282, 4 IO queues created.2021-05-12T11:31:41.987Z cpu17:2098258)NVMEDEV:1430 Ctlr 282, numaNode 0, baseQueueID 1, queueMask 32021-05-12T11:31:41.987Z cpu17:2098258)NVMEDEV:1430 Ctlr 282, numaNode 1, baseQueueID 1, queueMask 32021-05-12T11:31:41.987Z cpu17:2098258)NVMEDEV:1430 Ctlr 282, numaNode 2, baseQueueID 1, queueMask 32021-05-12T11:31:41.987Z cpu17:2098258)NVMEDEV:1430 Ctlr 282, numaNode 3, baseQueueID 1, queueMask 32021-05-12T11:31:41.987Z cpu17:2098258)NvmeDiscover: 1691: Scan operation 0 received on adapter vmhba652021-05-12T11:31:41.987Z cpu17:2098258)NvmeDiscover: 639: controller = nqn.1992-08.com.netapp:6000.6d039ea0003eb25a000000006081254c#vmhba65#2002d039ea3ef40b:201 3d039ea3ef40b2021-05-12T11:31:41.987Z cpu17:2098258)NvmeDiscover: 577: Controller nqn.1992-08.com.netapp:6000.6d039ea0003eb25a000000006081254c#vmhba65#2002d039ea3ef40b:2013d 039ea3ef40b fuseOp 0 oncs 20 cmic 3 nscnt ff2021-05-12T11:31:41.987Z cpu17:2098258)NvmeDiscover: 777: controller Added = nqn.1992-08.com.netapp:6000.6d039ea0003eb25a000000006081254c#vmhba65#2002d039ea3ef4 0b:2013d039ea3ef40b2021-05-12T11:31:41.987Z cpu17:2098258)NvmeDiscover: 1715: Scan operation 0 completed on adapter vmhba652021-05-12T11:31:41.987Z cpu17:2098258)NVMEDEV:3058 discovering namespaces...2021-05-12T11:31:41.987Z cpu17:2098258)NVMEDEV:4244 Discover namespace on controller 2822021-05-12T11:31:41.987Z cpu23:2098237)NVMFDEV:1910 Connected to queue 3, successfully2021-05-12T11:31:41.987Z cpu23:2098237)NVMFDEV:2224 CTLR 269 queue 3 (qsize 1024) created successfully.2021-05-12T11:31:41.987Z cpu23:2098237)NVMEDEV:1530 Ctlr 269, queue 3 created2021-05-12T11:31:41.987Z cpu23:2098237)NVMEDEV:877 Ctlr 269, queue 3, update queue size to 10242021-05-12T11:31:41.987Z cpu23:2098237)NVMEDEV:1523 Ctlr 269, creating IO queue 4 (qsize 1024)2021-05-12T11:31:41.987Z cpu23:2098237)NVMFDEV:2160 controller 269, queue 42021-05-12T11:31:41.987Z cpu23:2098237)lpfc: lpfc_nvme_create_queue:98: 0:6075 Binding IO HdwQueue 4 to io_channel 4 qhandle 0x430f005155e02021-05-12T11:31:41.988Z cpu26:2098229)NVMEDEV:4384 Discover namespaces on controller 261 is complete2021-05-12T11:31:41.988Z cpu26:2098229)NVMEDEV:5717 Configuring aec: 0x100 on controller 261.2021-05-12T11:31:41.988Z cpu23:2098237)NVMFDEV:1837 controller 269, queue 42021-05-12T11:31:41.988Z cpu23:2098237)WARNING: NVMEIO:2707 Ctlr 269, nvmeCmd 0x45d9883ff880 (opc 7f), queue 4 (expect 4) not available, nvmeStatus 8052021-05-12T11:31:41.988Z cpu23:2098237)NVMFDEV:1910 Connected to queue 4, successfully2021-05-12T11:31:41.988Z cpu26:2098229)NVMEDEV:5748 Async event configuration value is 0x100 on controller 261.2021-05-12T11:31:41.988Z cpu23:2098237)NVMFDEV:2224 CTLR 269 queue 4 (qsize 1024) created successfully.2021-05-12T11:31:41.988Z cpu26:2098229)NVMFDEV:851 Controller 261 (nqn.1992-08.com.netapp:6000.6d039ea0003eb25a000000006081254c#vmhba64#2002d039ea3ef40b:2052d03 9ea3ef40b) registered successfully.2021-05-12T11:31:41.988Z cpu23:2098237)NVMEDEV:1530 Ctlr 269, queue 4 created2021-05-12T11:31:41.988Z cpu23:2098237)NVMEDEV:877 Ctlr 269, queue 4, update queue size to 10242021-05-12T11:31:41.988Z cpu23:2098237)NVMEDEV:1553 Ctlr 269, 4 IO queues created.2021-05-12T11:31:41.988Z cpu23:2098237)NVMEDEV:1430 Ctlr 269, numaNode 0, baseQueueID 1, queueMask 32021-05-12T11:31:41.988Z cpu23:2098237)NVMEDEV:1430 Ctlr 269, numaNode 1, baseQueueID 1, queueMask 32021-05-12T11:31:41.988Z cpu23:2098237)NVMEDEV:1430 Ctlr 269, numaNode 2, baseQueueID 1, queueMask 32021-05-12T11:31:41.988Z cpu23:2098237)NVMEDEV:1430 Ctlr 269, numaNode 3, baseQueueID 1, queueMask 32021-05-12T11:31:41.988Z cpu23:2098237)NvmeDiscover: 1691: Scan operation 0 received on adapter vmhba642021-05-12T11:31:41.988Z cpu23:2098237)NvmeDiscover: 639: controller = nqn.1992-08.com.netapp:6000.6d039ea0003eb25a000000006081254c#vmhba64#2002d039ea3ef40b:205 3d039ea3ef40b2021-05-12T11:31:41.988Z cpu23:2098237)NvmeDiscover: 577: Controller nqn.1992-08.com.netapp:6000.6d039ea0003eb25a000000006081254c#vmhba64#2002d039ea3ef40b:2053d 039ea3ef40b fuseOp 0 oncs 20 cmic 3 nscnt ff2021-05-12T11:31:41.988Z cpu17:2098258)NVMEDEV:3565 Controller 282, construct namespace 12021-05-12T11:31:41.988Z cpu23:2098237)NvmeDiscover: 777: controller Added = nqn.1992-08.com.netapp:6000.6d039ea0003eb25a000000006081254c#vmhba64#2002d039ea3ef4 0b:2053d039ea3ef40b2021-05-12T11:31:41.988Z cpu23:2098237)NvmeDiscover: 1715: Scan operation 0 completed on adapter vmhba642021-05-12T11:31:41.988Z cpu23:2098237)NVMEDEV:3058 discovering namespaces...2021-05-12T11:31:41.988Z cpu23:2098237)NVMEDEV:4244 Discover namespace on controller 2692021-05-12T11:31:41.988Z cpu17:2098258)NVMEDEV:3505 Namespace identifier type 0x2, length 0x10.2021-05-12T11:31:41.988Z cpu17:2098258)NVMEDEV:3605 UUID is not supported by namespace 12021-05-12T11:31:41.988Z cpu17:2098258)NVMEDEV:3446 Set name of ns 1 to eui.00000100608a37e4d039ea00003eb25a2021-05-12T11:31:41.988Z cpu17:2098258)NvmeDiscover: 1691: Scan operation 3 received on adapter vmhba652021-05-12T11:31:41.988Z cpu17:2098258)NvmeDiscover: 1103: controller = nqn.1992-08.com.netapp:6000.6d039ea0003eb25a000000006081254c#vmhba65#2002d039ea3ef40b:20 13d039ea3ef40b2021-05-12T11:31:41.988Z cpu17:2098258)NvmeDiscover: 428: controller = nqn.1992-08.com.netapp:6000.6d039ea0003eb25a000000006081254c#vmhba65#2002d039ea3ef40b:201 3d039ea3ef40b2021-05-12T11:31:41.988Z cpu17:2098258)NVMEPSA:1218 adpater: vmhba65, action: 02021-05-12T11:31:41.988Z cpu17:2098258)NvmeDiscover: 1336: Created path for NS (under nqn.1992-08.com.netapp:6000.6d039ea0003eb25a000000006081254c#vmhba65#2002d 039ea3ef40b:2013d039ea3ef40b) 0x43085c49a740 = 0x431554e1ed00 for ns = 1 for path2021-05-12T11:31:41.988Z cpu17:2098258)vmhba65:C0:T1:L02021-05-12T11:31:41.988Z cpu17:2098258)NvmeDiscover: 1359: ANA enabled = 0 on ns=12021-05-12T11:31:41.988Z cpu17:2098258)NvmeDiscover: 1715: Scan operation 3 completed on adapter vmhba652021-05-12T11:31:41.988Z cpu17:2098258)NVMEDEV:3565 Controller 282, construct namespace 32021-05-12T11:31:41.988Z cpu23:2098237)NVMEDEV:3565 Controller 269, construct namespace 12021-05-12T11:31:41.988Z cpu6:2098250)NVMEDEV:4384 Discover namespaces on controller 274 is complete2021-05-12T11:31:41.988Z cpu6:2098250)NVMEDEV:5717 Configuring aec: 0x100 on controller 274.2021-05-12T11:31:41.988Z cpu17:2098258)NVMEDEV:3505 Namespace identifier type 0x2, length 0x10.2021-05-12T11:31:41.988Z cpu17:2098258)NVMEDEV:3605 UUID is not supported by namespace 32021-05-12T11:31:41.988Z cpu17:2098258)NVMEDEV:3446 Set name of ns 3 to eui.0000016e60950d58d039ea00003eb25a2021-05-12T11:31:41.988Z cpu17:2098258)NvmeDiscover: 1691: Scan operation 3 received on adapter vmhba652021-05-12T11:31:41.988Z cpu17:2098258)NvmeDiscover: 1103: controller = nqn.1992-08.com.netapp:6000.6d039ea0003eb25a000000006081254c#vmhba65#2002d039ea3ef40b:20 13d039ea3ef40b2021-05-12T11:31:41.988Z cpu17:2098258)NvmeDiscover: 428: controller = nqn.1992-08.com.netapp:6000.6d039ea0003eb25a000000006081254c#vmhba65#2002d039ea3ef40b:201 3d039ea3ef40b2021-05-12T11:31:41.988Z cpu17:2098258)NVMEPSA:1218 adpater: vmhba65, action: 02021-05-12T11:31:41.988Z cpu17:2098258)NvmeDiscover: 1336: Created path for NS (under nqn.1992-08.com.netapp:6000.6d039ea0003eb25a000000006081254c#vmhba65#2002d 039ea3ef40b:2013d039ea3ef40b) 0x43085c49b940 = 0x431554e27cc0 for ns = 3 for path2021-05-12T11:31:41.988Z cpu6:2098250)NVMEDEV:5748 Async event configuration value is 0x100 on controller 274.2021-05-12T11:31:41.988Z cpu17:2098258)vmhba65:C0:T1:L22021-05-12T11:31:41.988Z cpu23:2098237)NVMEDEV:3505 Namespace identifier type 0x2, length 0x10.2021-05-12T11:31:41.988Z cpu6:2098250)NVMFDEV:851 Controller 274 (nqn.1992-08.com.netapp:6000.6d039ea0003eb25a000000006081254c#vmhba65#2002d039ea3ef40b:2012d039 ea3ef40b) registered successfully.2021-05-12T11:31:41.988Z cpu17:2098258)NvmeDiscover: 1359: ANA enabled = 0 on ns=32021-05-12T11:31:41.988Z cpu23:2098237)NVMEDEV:3605 UUID is not supported by namespace 12021-05-12T11:31:41.988Z cpu23:2098237)NVMEDEV:3446 Set name of ns 1 to eui.00000100608a37e4d039ea00003eb25a2021-05-12T11:31:41.988Z cpu23:2098237)NvmeDiscover: 1691: Scan operation 3 received on adapter vmhba642021-05-12T11:31:41.988Z cpu23:2098237)NvmeDiscover: 1103: controller = nqn.1992-08.com.netapp:6000.6d039ea0003eb25a000000006081254c#vmhba64#2002d039ea3ef40b:20 53d039ea3ef40b2021-05-12T11:31:41.988Z cpu17:2098258)NvmeDiscover: 1715: Scan operation 3 completed on adapter vmhba652021-05-12T11:31:41.988Z cpu17:2098258)NVMEDEV:4384 Discover namespaces on controller 282 is complete2021-05-12T11:31:41.988Z cpu23:2098237)NvmeDiscover: 428: controller = nqn.1992-08.com.netapp:6000.6d039ea0003eb25a000000006081254c#vmhba64#2002d039ea3ef40b:205 3d039ea3ef40b2021-05-12T11:31:41.988Z cpu17:2098258)NVMEDEV:5717 Configuring aec: 0x100 on controller 282.2021-05-12T11:31:41.988Z cpu23:2098237)NVMEPSA:1218 adpater: vmhba64, action: 02021-05-12T11:31:41.988Z cpu23:2098237)NvmeDiscover: 1336: Created path for NS (under nqn.1992-08.com.netapp:6000.6d039ea0003eb25a000000006081254c#vmhba64#2002d 039ea3ef40b:2053d039ea3ef40b) 0x43085c49f980 = 0x431554e61440 for ns = 1 for path2021-05-12T11:31:41.988Z cpu23:2098237)vmhba64:C0:T1:L02021-05-12T11:31:41.988Z cpu23:2098237)NvmeDiscover: 1359: ANA enabled = 0 on ns=12021-05-12T11:31:41.988Z cpu23:2098237)NvmeDiscover: 1715: Scan operation 3 completed on adapter vmhba642021-05-12T11:31:41.988Z cpu23:2098237)NVMEDEV:3565 Controller 269, construct namespace 32021-05-12T11:31:41.988Z cpu17:2098258)NVMEDEV:5748 Async event configuration value is 0x100 on controller 282.2021-05-12T11:31:41.988Z cpu17:2098258)NVMFDEV:851 Controller 282 (nqn.1992-08.com.netapp:6000.6d039ea0003eb25a000000006081254c#vmhba65#2002d039ea3ef40b:2013d03 9ea3ef40b) registered successfully.2021-05-12T11:31:41.988Z cpu16:2098101)WARNING: brcmnvmefc: nvmefcRportEventCmpl:2832: 1154 Rport event 32021-05-12T11:31:41.988Z cpu16:2098101)NVMEDEV:1018 Ctlr 290 allocated, maximum queues 322021-05-12T11:31:41.988Z cpu16:2098101)NVMFDEV:159 Controller 290, connecting using parameters:2021-05-12T11:31:41.988Z cpu16:2098101)NVMFDEV:161 kato: 02021-05-12T11:31:41.988Z cpu16:2098101)NVMFDEV:162 subtype: 12021-05-12T11:31:41.988Z cpu16:2098101)NVMFDEV:163 vmkParams.asqsize: 162021-05-12T11:31:41.988Z cpu16:2098101)NVMFDEV:164 vmkParams.cntlid: 0xffff2021-05-12T11:31:41.988Z cpu16:2098101)NVMFDEV:166 vmkParams.hostid: 609249a2-41ed-c5f6-912f-4c52624dd08f2021-05-12T11:31:41.988Z cpu23:2098237)NVMEDEV:3505 Namespace identifier type 0x2, length 0x10.2021-05-12T11:31:41.988Z cpu16:2098101)NVMFDEV:167 vmkParams.hostnqn: nqn.2014-08.org.nvmexpress:uuid:609249a2-41ed-c5f6-912f-4c52624dd08f2021-05-12T11:31:41.988Z cpu16:2098101)NVMFDEV:168 vmkParams.subnqn: nqn.2014-08.org.nvmexpress.discovery2021-05-12T11:31:41.988Z cpu23:2098237)NVMEDEV:3605 UUID is not supported by namespace 32021-05-12T11:31:41.988Z cpu16:2098101)NVMFDEV:178 vmkParams.trType: FC2021-05-12T11:31:41.988Z cpu16:2098101)NVMFDEV:180 vmkParams.trwwnn: 2002d039ea3ef40b2021-05-12T11:31:41.988Z cpu23:2098237)NVMEDEV:3446 Set name of ns 3 to eui.0000016e60950d58d039ea00003eb25a2021-05-12T11:31:41.988Z cpu16:2098101)NVMFDEV:182 vmkParams.trwwpn: 2013d039ea3ef40b2021-05-12T11:31:41.988Z cpu23:2098237)NvmeDiscover: 1691: Scan operation 3 received on adapter vmhba642021-05-12T11:31:41.988Z cpu16:2098101)lpfc: lpfc_nvme_create_queue:98: 1:6075 Binding ADM HdwQueue 0 to io_channel 0 qhandle 0x430f005153e02021-05-12T11:31:41.988Z cpu23:2098237)NvmeDiscover: 1103: controller = nqn.1992-08.com.netapp:6000.6d039ea0003eb25a000000006081254c#vmhba64#2002d039ea3ef40b:20 53d039ea3ef40b2021-05-12T11:31:41.988Z cpu23:2098237)NvmeDiscover: 428: controller = nqn.1992-08.com.netapp:6000.6d039ea0003eb25a000000006081254c#vmhba64#2002d039ea3ef40b:205 3d039ea3ef40b2021-05-12T11:31:41.988Z cpu23:2098237)NVMEPSA:1218 adpater: vmhba64, action: 02021-05-12T11:31:41.988Z cpu23:2098237)NvmeDiscover: 1336: Created path for NS (under nqn.1992-08.com.netapp:6000.6d039ea0003eb25a000000006081254c#vmhba64#2002d 039ea3ef40b:2053d039ea3ef40b) 0x43085c4a0a80 = 0x431554e3a440 for ns = 3 for path2021-05-12T11:31:41.988Z cpu23:2098237)vmhba64:C0:T1:L22021-05-12T11:31:41.988Z cpu23:2098237)NvmeDiscover: 1359: ANA enabled = 0 on ns=32021-05-12T11:31:41.988Z cpu23:2098237)NvmeDiscover: 1715: Scan operation 3 completed on adapter vmhba642021-05-12T11:31:41.988Z cpu23:2098237)NVMEDEV:4384 Discover namespaces on controller 269 is complete2021-05-12T11:31:41.988Z cpu23:2098237)NVMEDEV:5717 Configuring aec: 0x100 on controller 269.2021-05-12T11:31:41.988Z cpu16:2098101)WARNING: brcmnvmefc: nvmefcSendLsReq:1783: 1040 - NVMe Reject Reason(Code : x43 Explanation : x0) for LS_CMD : 32021-05-12T11:31:41.988Z cpu16:2098101)WARNING: brcmnvmefc: nvmefcConnectCtrlr:2747: 1082 - NVME Create Association Failed: Not supported2021-05-12T11:31:41.988Z cpu16:2098101)lpfc: lpfc_nvme_delete_queue:128: 1:6001 ENTER. lpfc_pnvme qidx x0i qhandle 0x430f005153e02021-05-12T11:31:41.989Z cpu16:2098101)WARNING: NVMFDEV:800 Failed to transport connect controller 290, status: Not supported2021-05-12T11:31:41.989Z cpu16:2098101)NVMEDEV:1095 Ctlr 290 freeing2021-05-12T11:31:41.989Z cpu16:2098101)NVMEDEV:6117 Cancel requests of controller 290, 0 left.2021-05-12T11:31:41.989Z cpu16:2098101)WARNING: NVMFDEV:1300 Failed to connect to controller, status: Not supported2021-05-12T11:31:41.989Z cpu16:2098101)WARNING: NVMFEVT:1405 Failed to discover controllers, status: Not supported2021-05-12T11:31:41.989Z cpu16:2098101)WARNING: NVMFEVT:1575 Discover and connect controller failed: Not supported2021-05-12T11:31:41.989Z cpu16:2098101)WARNING: NVMFEVT:1745 Event handler for the event 3 failed with status : Not supported2021-05-12T11:31:41.989Z cpu16:2098101)WARNING: brcmnvmefc: nvmefcRportEventCmpl:2832: 1154 Rport event 32021-05-12T11:31:41.989Z cpu23:2098237)NVMEDEV:5748 Async event configuration value is 0x100 on controller 269.2021-05-12T11:31:41.989Z cpu23:2098237)NVMFDEV:851 Controller 269 (nqn.1992-08.com.netapp:6000.6d039ea0003eb25a000000006081254c#vmhba64#2002d039ea3ef40b:2053d03 9ea3ef40b) registered successfully.2021-05-12T11:31:41.989Z cpu19:2098099)WARNING: brcmnvmefc: nvmefcRportEventCmpl:2832: 1154 Rport event 32021-05-12T11:31:41.989Z cpu19:2098099)NVMEDEV:1018 Ctlr 291 allocated, maximum queues 322021-05-12T11:31:41.989Z cpu19:2098099)NVMFDEV:159 Controller 291, connecting using parameters:2021-05-12T11:31:41.989Z cpu19:2098099)NVMFDEV:161 kato: 02021-05-12T11:31:41.989Z cpu19:2098099)NVMFDEV:162 subtype: 12021-05-12T11:31:41.989Z cpu19:2098099)NVMFDEV:163 vmkParams.asqsize: 162021-05-12T11:31:41.989Z cpu19:2098099)NVMFDEV:164 vmkParams.cntlid: 0xffff2021-05-12T11:31:41.989Z cpu19:2098099)NVMFDEV:166 vmkParams.hostid: 609249a2-41ed-c5f6-912f-4c52624dd08f2021-05-12T11:31:41.989Z cpu19:2098099)NVMFDEV:167 vmkParams.hostnqn: nqn.2014-08.org.nvmexpress:uuid:609249a2-41ed-c5f6-912f-4c52624dd08f2021-05-12T11:31:41.989Z cpu19:2098099)NVMFDEV:168 vmkParams.subnqn: nqn.2014-08.org.nvmexpress.discovery2021-05-12T11:31:41.989Z cpu19:2098099)NVMFDEV:178 vmkParams.trType: FC2021-05-12T11:31:41.989Z cpu19:2098099)NVMFDEV:180 vmkParams.trwwnn: 2002d039ea3ef40b2021-05-12T11:31:41.989Z cpu19:2098099)NVMFDEV:182 vmkParams.trwwpn: 2053d039ea3ef40b2021-05-12T11:31:41.989Z cpu19:2098099)lpfc: lpfc_nvme_create_queue:98: 0:6075 Binding ADM HdwQueue 0 to io_channel 0 qhandle 0x430f005153e02021-05-12T11:31:41.989Z cpu19:2098099)WARNING: brcmnvmefc: nvmefcSendLsReq:1783: 1040 - NVMe Reject Reason(Code : x43 Explanation : x0) for LS_CMD : 32021-05-12T11:31:41.989Z cpu19:2098099)WARNING: brcmnvmefc: nvmefcConnectCtrlr:2747: 1082 - NVME Create Association Failed: Not supported2021-05-12T11:31:41.989Z cpu19:2098099)lpfc: lpfc_nvme_delete_queue:128: 0:6001 ENTER. lpfc_pnvme qidx x0i qhandle 0x430f005153e02021-05-12T11:31:41.989Z cpu19:2098099)WARNING: NVMFDEV:800 Failed to transport connect controller 291, status: Not supported2021-05-12T11:31:41.989Z cpu19:2098099)NVMEDEV:1095 Ctlr 291 freeing2021-05-12T11:31:41.989Z cpu19:2098099)NVMEDEV:6117 Cancel requests of controller 291, 0 left.2021-05-12T11:31:41.989Z cpu19:2098099)WARNING: NVMFDEV:1300 Failed to connect to controller, status: Not supported2021-05-12T11:31:41.989Z cpu19:2098099)WARNING: NVMFEVT:1405 Failed to discover controllers, status: Not supported2021-05-12T11:31:41.989Z cpu19:2098099)WARNING: NVMFEVT:1575 Discover and connect controller failed: Not supported2021-05-12T11:31:41.989Z cpu19:2098099)WARNING: NVMFEVT:1745 Event handler for the event 3 failed with status : Not supported2021-05-12T11:31:41.989Z cpu19:2098099)WARNING: brcmnvmefc: nvmefcRportEventCmpl:2832: 1154 Rport event 3

Moderator edit by wila: Moved post to ESXi discussions and put the log details into a spoiler.

scott28tt · ‎05-25-2021

1. This thread should be in the ESXi Discussions area - I've reported to to notify moderators

2. Use a "spoiler" when copying/pasting lots of log text - click the icon on the toolbar which has a triangle containing an exclamation mark, here's an example of the result:

Spoiler

Those who want to see the text can expand the spoiler, those who don't can easily scroll past it

-------------------------------------------------------------------------------------------------------------------------------------------------------------

Although I am a VMware employee I contribute to VMware Communities voluntarily (ie. not in any official capacity)
VMware Training & Certification blog

All

Emulex LPe32000 NVMe over Fabric path is Dead

o