Nagios 2.03b, plugins 1.4 - no status changes

[bru1n at comcast.net]

Greetings all,

Short summary to date: 
When I force a service check to produce a critical or warning using check_by_ssh, The correct data appears in the "Status Information" column, however the "Status" does not change from "OK" in the Service detail view or any view for that matter. All local service checks function as expected.

More detail/troubleshooting info:

Monitor_host as nagios--
$ uname -a
SunOS miata 5.10 Generic sun4u sparc SUNW,Sun-Fire-V210
$ ssh -V
Sun_SSH_1.1, SSH protocols 1.5/2.0, OpenSSL 0x0090704f
$ ./check_by_ssh -V
check_by_ssh (nagios-plugins 1.4) 1.35
$ ../bin/nagios -V

Nagios 2.0b3
Copyright (c) 1999-2005 Ethan Galstad (www.nagios.org)
Last Modified: 04-03-2005
License: GPL

root @ miata: gcc --version
gcc (GCC) 3.4.3 (csl-sol210-3_4-branch+sol_rpath)

libiconv-1.8
...

Target Host--
root @ tbird: uname -a
SunOS tbird 5.9 Generic_117171-07 sun4u sparc SUNW,Sun-Fire-V240
root @ tbird: ssh -V
SSH Version Sun_SSH_1.0.1, protocol versions 1.5/2.0.
root @ tbird: ./check_by_ssh -V
check_by_ssh (nagios-plugins 1.4) 1.35
root @ tbird: /usr/local/bin/gcc --version
gcc (GCC) 3.4.2
root @ tbird: su nagios
$ ./check_disk -w 99% -c 90% -p /
DISK CRITICAL - free space: / 9574 MB (81%);| /=2245MB;118;1181;0;11818
$ echo $?
2


Heres the offending commands, with shell RC as Marc Powell suggested. I'm using regular ssh to test output, and proof that RC=2 is not stuck in the shell. :)

$ ./check_by_ssh -H tbird -C "/usr/local/nagios/libexec/check_disk -w 99% -c 90% -p /"
DISK CRITICAL - free space: / 9574 MB (81%);| /=2245MB;118;1181;0;11818
$ echo $?
2
$ ssh tbird /usr/local/nagios/libexec/check_disk -w 99% -c 90% -p /
DISK CRITICAL - free space: / 9574 MB (81%);| /=2245MB;118;1181;0;11818
$ echo $?
2
$ ./check_by_ssh -H tbird -C "df -k / "
Filesystem            kbytes    used   avail capacity  Mounted on
$ echo $?
0
$ ssh tbird df -k /
Filesystem            kbytes    used   avail capacity  Mounted on
/dev/dsk/c1t0d0s0    12101644 2177284 9803344    19%    /
$ echo $?
0
$

Cool huh? Weirdedness on check_by_ssh "df -k / " -- it only shows the top line, but the RC is consistant.

>From the web event log:
[04-22-2005 11:27:41] SERVICE ALERT: tbird;unix-swap-space;OK;SOFT;2;DISK WARNING - free space: /var/run 13086 MB (100%): /tmp 13086 MB (96%)
[04-22-2005 11:26:41] SERVICE ALERT:tbird;unix-swap-space;WARNING;SOFT;1;DISK WARNING - free space: /var/run 13086 MB (100%): /tmp 13086 MB (96%):

I have done the following, not neccesarily in order:
1. Restarted apache and nagios - many times
2. Observed the no status change condition with several different browsers
3. Recompiled check_by_ssh on monitor_host ./configure --with-correct-options; make; make install
4. Recompiled check_disk on target host (same as above)
5. Recompiled nagios-plugins-1.4 on two target hosts as follows:
  gunzip nagios-plugins-1.4.tar.gz
  tar xvf nagios-plugins-1.4.tar
  cd  nagios-plugins-1.4
  ./configure --prefix=/usr/local/nagios --with-nagios-user=nagios --with-nagios-group=nagios
  cd plugins;vi Makefile # I remove everything having to do with check_icmp
  cd ..
  make
  make install

6. ./configure; make; make install on a completly different target_host
7. Stupid me tried to snoop between monitor and target, but can't see inside ssh without (hrm, its chaos-something that opens this up), but I saw data going back and forth
8. Googled half the web
9. Read everything I could regarding check_by_ssh, plugins-1.4 and plugin-dev

My next plan I guess is to recompile nagios 2.03b on a different monitor host (not Solaris10 this time) and see what happens.

Any other thoughts will certainly be appreciated. I'm not sure what other info I could provide, but will do my best on that regard. Thanks again folks.

-Marc


-------------------------------------------------------
SF email is sponsored by - The IT Product Guide
Read honest & candid reviews on hundreds of IT Products from real users.
Discover which products truly live up to the hype. Start reading now.
http://ads.osdn.com/?ad_id=6595&alloc_id=14396&op=click
_______________________________________________
Nagios-users mailing list
Nagios-users at lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/nagios-users
::: Please include Nagios version, plugin version (-v) and OS when reporting any issue. 
::: Messages without supporting info will risk being sent to /dev/null