HP SIM Agents Causing Host Failure Notifications

[UoGsys]

Recently installed HP SIM Agents (8.3.0 - URL) on an ESX host (4.0.0 208167). This has caused a constant notification to be sent out every 5 minutes referring to the following -

Stateless event alarm

Alarm Definition:

( OR [Event alarm

expression: Cannot connect host - network error] OR [Event alarm expression:

Cannot connect host - time-out] OR [Event alarm expression: Cannot connect host

• time-out] OR )

Event details:

I removed the HP SIM agents but the error remains - also noticed the following in log /var/log/vmware/vpx/vpxa.log

2010-01-18 17:51:37.029 0xf7be2b90 verbose 'App' HostChanged Event Fired, properties changed []

2010-01-18 17:51:43.473 0xf6ff4b90 verbose 'App' Monitoring AAM health: vpxdDasStateOnLastInvocation(running) currentVpxdDasState(running) forceRunOfListNodes(0) isDasEnabled(1) skipOperation(0)

Any ideas? Thanks!

[danm66]

did you open the firewall port(s) for HP SIM?

if you are seeing odd errors in vpxa, have you rebooted the host since the removal? If not, try restarting vpxa service (service vmware-vpxa restart).

[UoGsys]

The installer displays that it has been successful in opening the ports, but the only port I can see open through VC is 162 for SNMP. The port(s) must be open however, as I can get to the system management homepage for that server from another host. I've also noticed hundreds of message in the following log relating to SNMP - /var/log/messages -

Jan 19 12:54:21 xxxx snmpd[3533]: Received SNMP packet(s) from UDP: :36387

Jan 19 12:54:31 xxxx snmpd[3533]: Received SNMP packet(s) from UDP: :34734

Jan 19 12:54:40 xxxx snmpd[3533]: Received SNMP packet(s) from UDP: :58605

Jan 19 12:54:41 xxxx snmpd[3533]: Received SNMP packet(s) from UDP: :34653

Jan 19 12:54:43 xxxx snmpd[3533]: Received SNMP packet(s) from UDP: :33239

Jan 19 12:54:47 xxxx snmpd[3533]: Received SNMP packet(s) from UDP: :55021

Jan 19 12:54:50 xxxx snmpd[3533]: Received SNMP packet(s) from UDP: :45287

Jan 19 12:54:53 xxxx snmpd[3533]: Received SNMP packet(s) from UDP: :54376

Jan 19 12:54:57 xxxx snmpd[3533]: Received SNMP packet(s) from UDP: :60872

Jan 19 12:55:16 xxxx snmpd[3533]: Received SNMP packet(s) from UDP: :33617

I had also rebooted the server after installing the agents. Noticed now that the notifications have stopped, but the above log still gets consistently hammered. Is this normal behaviour?

[AWo]

Post "esxcfg-firewall -q".

AWo

\[:o]===\[o:]

=Would you like to have this posting as a ringtone on your cell phone?=

=Send "Posting" to 911 for only $999999,99!=

[UoGsys]

Thanks - see attached.

As mentioned, the notifications and events have stopped for the time being but the above log still gets absolutely hammered. I'm also now getting this little gem every 5 minutes relating to my vCentre server.

xxx (vCenter) status changed from red to green

Target: Datacenters

Stateless event alarm

Alarm Definition:

()

Event details:

xxx (vCenter) status changed from red to green

There's nothing helpful in the logs to describe exactly what is wrong. Any tips on how to troubleshoot this?

Thanks!

[UoGsys]

Sorted!

http://kb.vmware.com/selfservice/microsites/search.do?language=en_US&cmd=displayKC&externalId=101426...

Also re-configured the 'Health Status Changed' alarm from 'unset' which seems to generate an SNMP trap by default every 5 minutes to 'Alarm'. Fingers crossed, everything seems ok for the minute.