Check_Ping plugin not Incrementing Check Attempt Value

[Robert V. Bolton]

Over the weekend I had a weird event happen in my monitoring set. I have a
host that has an Infiniband interface, and we are running the IP protocol
over Infiniband, while using the check_ping plugin to verify network
connectivity. This weekend our Ethernet to Infiniband gateway went down and
the check_ping plugin reported that state as CRITICAL, however the it
didn't increment the check attempt value, and thus a notification wasn't
sent out since the max check attempts threshold was never reached. I've
included some of the output of /var/log/messages that indicates the
problem. Has anyone else seen this issue? As a side note I've since changed
my service check to use check_icmp instead of check_ping.

Jan 28 17:12:12 monitor nagios: SERVICE ALERT: hamrock.chpc.utah.edu;IPv4
IPoIB Ping Check;CRITICAL;HARD;1;CRITICAL - Host Unreachable
(172.21.10.170)
Jan 28 17:13:12 monitor nagios: SERVICE ALERT: hamrock.chpc.utah.edu;IPv4
IPoIB Ping Check;CRITICAL;HARD;1;CRITICAL - Host Unreachable
(172.21.10.170)
Jan 28 17:14:12 monitor nagios: SERVICE ALERT: hamrock.chpc.utah.edu;IPv4
IPoIB Ping Check;CRITICAL;HARD;1;CRITICAL - Host Unreachable
(172.21.10.170)
Jan 28 17:15:12 monitor nagios: SERVICE ALERT: hamrock.chpc.utah.edu;IPv4
IPoIB Ping Check;CRITICAL;HARD;1;CRITICAL - Host Unreachable
(172.21.10.170)

Jan 28 17:42:12 monitor nagios: SERVICE ALERT: hamrock.chpc.utah.edu;IPv4
IPoIB Ping Check;CRITICAL;HARD;1;CRITICAL - Host Unreachable
(172.21.10.170)
Jan 28 17:43:22 monitor nagios: SERVICE ALERT: hamrock.chpc.utah.edu;IPv4
IPoIB Ping Check;CRITICAL;HARD;1;CRITICAL - Host Unreachable
(172.21.10.170)
Jan 28 17:44:22 monitor nagios: SERVICE ALERT: hamrock.chpc.utah.edu;IPv4
IPoIB Ping Check;CRITICAL;HARD;1;CRITICAL - Host Unreachable
(172.21.10.170)
Jan 28 17:47:22 monitor nagios: SERVICE ALERT: hamrock.chpc.utah.edu;IPv4
IPoIB Ping Check;CRITICAL;HARD;1;CRITICAL - Host Unreachable
(172.21.10.170)
Jan 28 17:48:22 monitor nagios: SERVICE ALERT: hamrock.chpc.utah.edu;IPv4
IPoIB Ping Check;CRITICAL;HARD;1;CRITICAL - Host Unreachable
(172.21.10.170)
Jan 28 17:49:22 monitor nagios: SERVICE ALERT: hamrock.chpc.utah.edu;IPv4
IPoIB Ping Check;CRITICAL;HARD;1;CRITICAL - Host Unreachable
(172.21.10.170)
Jan 28 17:50:22 monitor nagios: SERVICE ALERT: hamrock.chpc.utah.edu;IPv4
IPoIB Ping Check;CRITICAL;HARD;1;CRITICAL - Host Unreachable
(172.21.10.170)

Jan 28 18:31:22 monitor nagios: SERVICE ALERT: hamrock.chpc.utah.edu;IPv4
IPoIB Ping Check;CRITICAL;HARD;1;CRITICAL - Host Unreachable
(172.21.10.170)
Jan 28 18:32:22 monitor nagios: SERVICE ALERT: hamrock.chpc.utah.edu;IPv4
IPoIB Ping Check;CRITICAL;HARD;1;CRITICAL - Host Unreachable
(172.21.10.170)
Jan 28 18:33:22 monitor nagios: SERVICE ALERT: hamrock.chpc.utah.edu;IPv4
IPoIB Ping Check;CRITICAL;HARD;1;CRITICAL - Host Unreachable
(172.21.10.170)

Jan 28 18:42:23 monitor nagios: SERVICE ALERT: hamrock.chpc.utah.edu;IPv4
IPoIB Ping Check;CRITICAL;HARD;1;CRITICAL - Host Unreachable
(172.21.10.170)
Jan 28 18:43:23 monitor nagios: SERVICE ALERT: hamrock.chpc.utah.edu;IPv4
IPoIB Ping Check;CRITICAL;HARD;1;CRITICAL - Host Unreachable
(172.21.10.170)
Jan 28 18:44:22 monitor nagios: SERVICE ALERT: hamrock.chpc.utah.edu;IPv4
IPoIB Ping Check;CRITICAL;HARD;1;CRITICAL - Host Unreachable
(172.21.10.170)
Jan 28 18:45:22 monitor nagios: SERVICE ALERT: hamrock.chpc.utah.edu;IPv4
IPoIB Ping Check;CRITICAL;HARD;1;CRITICAL - Host Unreachable
(172.21.10.170)


--
*Robert V. Bolton*
Email: robert at robertvbolton.com
Web: http://robertvbolton.com
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://www.monitoring-lists.org/archive/users/attachments/20120130/97b8a346/attachment.html>
-------------- next part --------------
------------------------------------------------------------------------------
Try before you buy = See our experts in action!
The most comprehensive online learning library for Microsoft developers
is just $99.99! Visual Studio, SharePoint, SQL - plus HTML5, CSS3, MVC3,
Metro Style Apps, more. Free future releases when you subscribe now!
http://p.sf.net/sfu/learndevnow-dev2
-------------- next part --------------
_______________________________________________
Nagios-users mailing list
Nagios-users at lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/nagios-users
::: Please include Nagios version, plugin version (-v) and OS when reporting any issue. 
::: Messages without supporting info will risk being sent to /dev/null