The main symptom we notice is when BGP and OSPF sessions get dropped. But notice that something seems to be going on with the vNIC at the time of these problems. Has anyone seen vnic spontaneously change state? What was the root cause? Thank you.
2016-12-21T20:00:13+00:00 esg04-bos.internal.spangalang.com-0 routing[939]: [user.info] AUDIT 0x3e01-91 (0000): OSPF 1 Neighbor 10.81.14.6 (IP addr: 10.32.95.6) has gone down.
2016-12-21T20:00:17+00:00 esg04-bos.internal.spangalang.com-0 kernel[]: [default]: [kern.info] vNic_2: going to shrink rx ring.
2016-12-21T20:00:17+00:00 esg04-bos.internal.spangalang.com-0 routing[939]: [user.info] AUDIT 0x3e01-210 (0000): OSPF 1 i/f idx 0X00000003 rtr ID 10.81.14.6 IP addr 10.32.95.6 neighbor FSM state has deteriorated. Old state: AMB_OSPF_NBR_FULL New state: AMB_OSPF_NBR_INIT
2016-12-21T20:00:17+00:00 esg04-bos.internal.spangalang.com-0 routing[939]: [user.emerg] EXCEPTION 0x4102-71 (0000): Hold Timer Expired (Unspecific): BGP NOTIFICATION sent to neighbor 10.81.14.1 (AS: 65003)
2016-12-21T20:00:17+00:00 esg04-bos.internal.spangalang.com-0 routing[939]: [user.info] AUDIT 0x4102-49 (0000): BGP: A connection's FSM state has deteriorated. Remote address: 10.81.14.1 (Old State: Established New State: Idle)
2016-12-21T20:00:17+00:00 esg04-bos.internal.spangalang.com-0 routing[939]: [user.info] AUDIT 0x4102-48 (0001): BGP: A connection has left Established state. Remote address: 10.81.14.1 (Neg Hold Time:3)
2016-12-21T20:00:17+00:00 esg04-bos.internal.spangalang.com-0 routing[939]: [user.emerg] EXCEPTION 0x4102-71 (0000): Hold Timer Expired (Unspecific): BGP NOTIFICATION sent to neighbor 10.81.15.1 (AS: 65003)
2016-12-21T20:00:17+00:00 esg04-bos.internal.spangalang.com-0 routing[939]: [user.info] AUDIT 0x4102-49 (0000): BGP: A connection's FSM state has deteriorated. Remote address: 10.81.15.1 (Old State: Established New State: Idle)
2016-12-21T20:00:17+00:00 esg04-bos.internal.spangalang.com-0 routing[939]: [user.info] AUDIT 0x4102-48 (0001): BGP: A connection has left Established state. Remote address: 10.81.15.1 (Neg Hold Time:3)
2016-12-21T20:00:17+00:00 esg04-bos.internal.spangalang.com-0 kernel[]: [default]: [kern.info] vNic_2: intr type 3, mode 0, 5 vectors allocated
2016-12-21T20:00:17+00:00 esg04-bos.internal.spangalang.com-0 kernel[]: [default]: [kern.info] RSS indirection table :
2016-12-21T20:00:17+00:00 esg04-bos.internal.spangalang.com-0 kernel[]: [default]: [kern.warning] 0 1 2 3 0 1 2 3 0 1 2 3 0 1 2 3 0 1 2 3 0 1 2 3 0 1 2 3 0 1 2 3
2016-12-21T20:00:17+00:00 esg04-bos.internal.spangalang.com-0 kernel[]: [default]: [kern.info] vNic_2: NIC Link is Up 10000 Mbps
2016-12-21T20:00:17+00:00 esg04-bos.internal.spangalang.com-0 routing[939]: [user.info] AUDIT 0x0303-76 (0000): Closed a socket
2016-12-21T20:00:17+00:00 esg04-bos.internal.spangalang.com-0 routing[939]: [user.info] AUDIT 0x0303-76 (0000): Closed a socket
2016-12-21T20:00:17+00:00 esg04-bos.internal.spangalang.com-0 routing[939]: [user.info] AUDIT 0x3e01-91 (0000): OSPF 1 Neighbor 10.81.14.5 (IP addr: 10.32.1.5) has gone down.
2016-12-21T20:00:17+00:00 esg04-bos.internal.spangalang.com-0 routing[939]: [user.info] AUDIT 0x3e01-210 (0000): OSPF 1 i/f idx 0X00000006 rtr ID 10.81.14.5 IP addr 10.32.1.5 neighbor FSM state has deteriorated. Old state: AMB_OSPF_NBR_FULL New state: AMB_OSPF_NBR_DOWN
