I added some checks, the check_sendmail being one of them. I've also successfully executed the following from the command line (as nagios user) : /usr/bin/printf "%b" "***** Nagios 2.9 *****\n\nNotification Type: NOTIFICATIONTYPE\nHost: HOSTNAME\nState: HOSTSTATE\nAddress: HOSTADDRESS\nInfo: HOSTOUTPUT\n\nDate/Time: NOW\n" | /bin/mail -s "Host DOWN alert for testmachine" (address obfuscated) mail is working on the machine. I'm getting absolutely no NOTIFICATION entries in the logs (nagios.log) so the nagios server isn't even trying to send 'em out. That's the part that perplexes me. TIA G.~ <div>On 5/16/07, Valdinger, Stephen (DOV, MSX) <<a href="mailto:stephen.valdinger@doverchem.com">stephen.valdinger@doverchem.com </a>> wrote:<blockquote class="gmail_quote" style="border-left: 1px solid rgb(204, 204, 204); margin: 0pt 0pt 0pt 0.8ex; padding-left: 1ex;"> <div link="blue" vlink="blue" lang="EN-US"> <div> Have any configuration changes been made to the system since yesterday that you are aware of? Because on the day it worked your logs show nothing about sendmail, and on the day it stopped working sendmail shows up in the log. That leaves me to believe there is something fishy with the mail piece and not nagios itself. Try emailing yourself thru the terminal with both mail and sendmail and see with works and also in your notify-host-by-email add /usr/sbin/mail and see if works then. <div> Stephen Valdinger MIS Helpdesk Coordinator Dover Chemical Corporation 3676 Davis Rd NW Dover, OH 44622 330-365-3622 <a href="mailto:stephen.valdinger@doverchem.com" target="_blank" onclick="return top.js.OpenExtLink(window,event,this)">stephen.valdinger@doverchem.com </a> "Ever notice how fast Windows runs ? — Neither did I." "If at first you don't succeed, work for Microsoft." </div> <div> <div style="text-align: center;" align="center"> <hr align="center" size="2" width="100%"> </div> From: Gary Every [mailto:<a href="mailto:gevery@gmail.com" target="_blank" onclick="return top.js.OpenExtLink(window,event,this)">gevery@gmail.com</a>] Sent: Wednesday, May 16, 2007 2:32 PM To: <a href="mailto:nagios-users@lists.sourceforge.net" target="_blank" onclick="return top.js.OpenExtLink(window,event,this)">nagios-users@lists.sourceforge.net</a> Subject: [Nagios-users] Hosts and services not sending mail </div><div> I'm pretty sure I've got everything set up correctly, as yesterday I was getting notifications sent out, and today there are none going out. I've added some services that I knew would go critical, and started watching nagios.log. Here is a snippet from yesterdays log [1179271433] EXTERNAL COMMAND: SCHEDULE_FORCED_HOST_SVC_CHECKS;devstack01;1179271433 [1179271440] EXTERNAL COMMAND: SCHEDULE_FORCED_HOST_SVC_CHECKS;devstack02;1179271440 [1179271445] HOST ALERT: devstack01;DOWN;SOFT;1;CRITICAL - Host Unreachable (<a href="http://10.0.0.160" target="_blank" onclick="return top.js.OpenExtLink(window,event,this)">10.0.0.160</a>) [1179271448] HOST ALERT: devstack01;DOWN;SOFT;2;CRITICAL - Host Unreachable (<a href="http://10.0.0.160" target="_blank" onclick="return top.js.OpenExtLink(window,event,this)"> 10.0.0.160</a>) [1179271451] HOST ALERT: devstack01;DOWN;SOFT;3;CRITICAL - Host Unreachable (<a href="http://10.0.0.160" target="_blank" onclick="return top.js.OpenExtLink(window,event,this)">10.0.0.160</a>) [1179271451] EXTERNAL COMMAND: SCHEDULE_FORCED_HOST_SVC_CHECKS;ilom-cp1;1179271449 [1179271454] HOST ALERT: devstack01;DOWN;SOFT;4;CRITICAL - Host Unreachable (<a href="http://10.0.0.160" target="_blank" onclick="return top.js.OpenExtLink(window,event,this)">10.0.0.160</a>) [1179271457] HOST ALERT: devstack01;DOWN;SOFT;5;CRITICAL - Host Unreachable (<a href="http://10.0.0.160" target="_blank" onclick="return top.js.OpenExtLink(window,event,this)"> 10.0.0.160</a>) [1179271460] HOST ALERT: devstack01;DOWN;SOFT;6;CRITICAL - Host Unreachable (<a href="http://10.0.0.160" target="_blank" onclick="return top.js.OpenExtLink(window,event,this)">10.0.0.160</a>) [1179271460] EXTERNAL COMMAND: SCHEDULE_FORCED_HOST_SVC_CHECKS;ilom-cp2;1179271459 [1179271463] HOST ALERT: devstack01;DOWN;SOFT;7;CRITICAL - Host Unreachable (<a href="http://10.0.0.160" target="_blank" onclick="return top.js.OpenExtLink(window,event,this)">10.0.0.160</a>) [1179271466] HOST ALERT: devstack01;DOWN;SOFT;8;CRITICAL - Host Unreachable (<a href="http://10.0.0.160" target="_blank" onclick="return top.js.OpenExtLink(window,event,this)"> 10.0.0.160</a>) [1179271469] HOST ALERT: devstack01;DOWN;SOFT;9;CRITICAL - Host Unreachable (<a href="http://10.0.0.160" target="_blank" onclick="return top.js.OpenExtLink(window,event,this)">10.0.0.160</a>) [1179271469] EXTERNAL COMMAND: SCHEDULE_FORCED_HOST_SVC_CHECKS;ilom-cp3;1179271467 [1179271472] HOST ALERT: devstack01;DOWN;HARD;10;CRITICAL - Host Unreachable (<a href="http://10.0.0.160" target="_blank" onclick="return top.js.OpenExtLink(window,event,this)">10.0.0.160</a>) [1179271472] HOST NOTIFICATION: lbeavers-pager;devstack01;DOWN;host-notify-by-epager;CRITICAL - Host Unreachable ( <a href="http://10.0.0.160" target="_blank" onclick="return top.js.OpenExtLink(window,event,this)">10.0.0.160</a>) [1179271472] HOST NOTIFICATION: lbeavers;devstack01;DOWN;host-notify-by-email;CRITICAL - Host Unreachable (<a href="http://10.0.0.160" target="_blank" onclick="return top.js.OpenExtLink(window,event,this)">10.0.0.160</a>) [1179271472] HOST NOTIFICATION: gpoly-pager;devstack01;DOWN;host-notify-by-epager;CRITICAL - Host Unreachable ( <a href="http://10.0.0.160" target="_blank" onclick="return top.js.OpenExtLink(window,event,this)">10.0.0.160</a>) [1179271472] HOST NOTIFICATION: gpoly;devstack01;DOWN;host-notify-by-email;CRITICAL - Host Unreachable (<a href="http://10.0.0.160" target="_blank" onclick="return top.js.OpenExtLink(window,event,this)">10.0.0.160</a>) [1179271472] SERVICE ALERT: devstack01;ping;CRITICAL;HARD;1;CRITICAL - Host Unreachable ( <a href="http://10.0.0.160" target="_blank" onclick="return top.js.OpenExtLink(window,event,this)">10.0.0.160</a>) ------------------------------------------- As you can see, host notifications are being sent out Today's log: --------------------------------------------------- [1179337965] EXTERNAL COMMAND: SCHEDULE_FORCED_SVC_CHECK;contactpoint3;var_disk;1179337960 [1179337974] SERVICE ALERT: contactpoint3;var_disk;UNKNOWN;SOFT;1;SNMP problem - No data received from host [1179338034] SERVICE ALERT: contactpoint3;var_disk;UNKNOWN;SOFT;2;SNMP problem - No data received from host [1179338094] SERVICE ALERT: contactpoint3;var_disk;UNKNOWN;HARD;3;SNMP problem - No data received from host [1179338408] EXTERNAL COMMAND: SCHEDULE_FORCED_SVC_CHECK;contactpoint3;sendmail_check;1179338407 [1179338414] SERVICE ALERT: contactpoint3;sendmail_check;CRITICAL;SOFT;1;sendmail Processes CRITICAL - *0* [1179338474] SERVICE ALERT: contactpoint3;sendmail_check;CRITICAL;SOFT;2;sendmail Processes CRITICAL - *0* [1179338484] EXTERNAL COMMAND: SCHEDULE_FORCED_SVC_CHECK;contactpoint3;sendmail_check;1179338481 [1179338494] SERVICE ALERT: contactpoint3;sendmail_check;CRITICAL;HARD;3;sendmail Processes CRITICAL - *0* [1179338604] Warning: The results of service 'ping' on host 'contactpoint4' are stale by 45 seconds (threshold=615 seconds). I'm forcing an immediate check of the service. [1179338604] Warning: The results of service 'sendmail_check' on host 'contactpoint4' are stale by 45 seconds (threshold=615 seconds). I'm forcing an immediate check of the service. [1179338604] Warning: The results of service 'ping' on host 'contactpoint5' are stale by 45 seconds (threshold=61 -------------------------- As can be seen, it went thru the three criticals, went to CRIT HARD, but no NOTIFICATIONS were sent, it just continued looking at other services. I've got enable_notifications=1 set in nagios.cfg In services.cfg, I've got: notification_period 24x7 notifications_enabled 1 ; Service notifications are enabled notification_interval 15 ; Default interval - change only if needed in the service config and the web frontend reports ALL notifications enabled. <table border="0" cellpadding="0" cellspacing="4"> <tbody><tr height="20"> <td colspan="5" style="padding: 0in;" height="20"> Monitoring Features </td> </tr> <tr> <td style="padding: 0in; width: 101.25pt;" width="135"> Flap Detection </td> <td style="padding: 0in; width: 101.25pt;" width="135"> Notifications </td> <td style="padding: 0in; width: 101.25pt;" width="135"> Event Handlers </td> <td style="padding: 0in; width: 101.25pt;" width="135"> Active Checks </td> <td style="padding: 0in; width: 101.25pt;" width="135"> Passive Checks </td> </tr> <tr> <td style="padding: 0in;" valign="top"> <table style="width: 101.25pt;" border="0" cellpadding="0" cellspacing="0" width="135"> <tbody><tr> <td style="padding: 0in;" valign="top"> <a href="http://nagios.quepasa.com/nagios/cgi-bin/cmd.cgi?cmd_typ=62" target="_blank" onclick="return top.js.OpenExtLink(window,event,this)"> <img alt="Flap Detection Enabled" title="Flap Detection Enabled" border="0" height="32" width="32"></a> </td> <td style="padding: 0in; width: 7.5pt;" width="10"> </td> <td style="padding: 0in; width: 100%;" valign="top" width="100%"> <table style="width: 100%;" border="0" cellpadding="0" width="100%"> <tbody><tr> <td style="padding: 0.75pt; width: 100%;" width="100%"> All Services Enabled </td> </tr> <tr> <td style="padding: 0.75pt; width: 100%;" width="100%"> No Services Flapping </td> </tr> <tr> <td style="padding: 0.75pt; width: 100%;" width="100%"> All Hosts Enabled </td> </tr> <tr> <td style="padding: 0.75pt; width: 100%;" width="100%"> No Hosts Flapping </td> </tr> </tbody></table> </td> </tr> </tbody></table> </td> <td style="padding: 0in;" valign="top"> <table style="width: 101.25pt;" border="0" cellpadding="0" cellspacing="0" width="135"> <tbody><tr> <td style="padding: 0in;" valign="top"> <a href="http://nagios.quepasa.com/nagios/cgi-bin/cmd.cgi?cmd_typ=11" target="_blank" onclick="return top.js.OpenExtLink(window,event,this)"> <img alt="Notifications Enabled" title="Notifications Enabled" border="0" height="32" width="32"></a> </td> <td style="padding: 0in; width: 7.5pt;" width="10"> </td> <td style="padding: 0in; width: 100%;" valign="top" width="100%"> <table style="width: 100%;" border="0" cellpadding="0" width="100%"> <tbody><tr> <td style="padding: 0.75pt; width: 100%;" width="100%"> All Services Enabled </td> </tr> <tr> <td style="padding: 0.75pt; width: 100%;" width="100%"> All Hosts Enabled </td> </tr> </tbody></table> </td> </tr> </tbody></table> </td> <td style="padding: 0in;" valign="top"> <table style="width: 101.25pt;" border="0" cellpadding="0" cellspacing="0" width="135"> <tbody><tr> <td style="padding: 0in;" valign="top"> <a href="http://nagios.quepasa.com/nagios/cgi-bin/cmd.cgi?cmd_typ=42" target="_blank" onclick="return top.js.OpenExtLink(window,event,this)"> <img alt="Event Handlers Enabled" title="Event Handlers Enabled" border="0" height="32" width="32"></a> </td> <td style="padding: 0in; width: 7.5pt;" width="10"> </td> <td style="padding: 0in; width: 100%;" valign="top" width="100%"> <table style="width: 100%;" border="0" cellpadding="0" width="100%"> <tbody><tr> <td style="padding: 0.75pt; width: 100%;" width="100%"> All Services Enabled </td> </tr> <tr> <td style="padding: 0.75pt; width: 100%;" width="100%"> All Hosts Enabled </td> </tr> </tbody></table> </td> </tr> </tbody></table> </td> <td style="padding: 0in;" valign="top"> <table style="width: 101.25pt;" border="0" cellpadding="0" cellspacing="0" width="135"> <tbody><tr> <td style="padding: 0in;" valign="top"> <a href="http://nagios.quepasa.com/nagios/cgi-bin/extinfo.cgi?type=0" target="_blank" onclick="return top.js.OpenExtLink(window,event,this)"> <img alt="Active Checks Enabled" title="Active Checks Enabled" border="0" height="32" width="32"></a> </td> <td style="padding: 0in; width: 7.5pt;" width="10"> </td> <td style="padding: 0in; width: 100%;" valign="top" width="100%"> <table style="width: 100%;" border="0" cellpadding="0" width="100%"> <tbody><tr> <td style="padding: 0.75pt; width: 100%;" width="100%"> All Services Enabled </td> </tr> <tr> <td style="padding: 0.75pt; width: 100%;" width="100%"> All Hosts Enabled </td> </tr> </tbody></table> </td> </tr> </tbody></table> </td> <td style="padding: 0in;" valign="top"> <table style="width: 101.25pt;" border="0" cellpadding="0" cellspacing="0" width="135"> <tbody><tr> <td style="padding: 0in;" valign="top"> <a href="http://nagios.quepasa.com/nagios/cgi-bin/extinfo.cgi?type=0" target="_blank" onclick="return top.js.OpenExtLink(window,event,this)"> <img alt="Passive Checks Enabled" title="Passive Checks Enabled" border="0" height="32" width="32"></a> </td> <td style="padding: 0in; width: 7.5pt;" width="10"> </td> <td style="padding: 0in; width: 100%;" valign="top" width="100%"> <table style="width: 100%;" border="0" cellpadding="0" width="100%"> <tbody><tr> <td style="padding: 0.75pt; width: 100%;" width="100%"> All Services Enabled </td> </tr> <tr> <td style="padding: 0.75pt; width: 100%;" width="100%"> All Hosts Enabled </td> </tr> </tbody></table> </td> </tr> </tbody></table> </td> </tr> </tbody></table> Any idea where else to check???? I've deleted my retention file and restarted nagios as well Pulling my hair out here G.~ -- Gary Every "Pay it Forward!" </div></div> </div> </blockquote></div> -- Gary Every "Pay it Forward!"