SOLVED<br><br>Well I created a new host, service etc, everything was exactly the same as one I was testing that had the broken service.  It worked fine.  I ended up removing the retention.dat file and restarting, and after everything, just under 2000 services :), ran everything was fine.  I plan to look at the old retention.dat file and compare it with was is currently saved for that host.<br>
<br><div class="gmail_quote">On Tue, Jan 13, 2009 at 3:11 PM, Matt Nelson <span dir="ltr"><<a href="mailto:matt@frozenatom.com">matt@frozenatom.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="border-left: 1px solid rgb(204, 204, 204); margin: 0pt 0pt 0pt 0.8ex; padding-left: 1ex;">
Hello,<br><br>We seem to be having an issue with our alert notifications.  From what I've determined the command 'notify-by-email' isn't even being called from commands.cfg. I verified this by:<br>1)replacing the current command with a simple echo "test" > /tmp/test.<br>

2)leaving the mail command in and checking my postfix log - which shows no attempts being made at all.<br><br>I also don't see anything about sending alerts in my nagios.log/syslog<br>Jan 13 13:13:26 nocnag02 nagios: SERVICE ALERT: mt-ubuntu;SMTP Availability;CRITICAL;HARD;2;Connection refused<br>

<br>I have the following configuration for this service:<br><br># templates_services.cfg<br>define service{<br>        name                            critical-service        <br>        active_checks_enabled           1                       <br>

        passive_checks_enabled          1                      <br>        parallelize_check               1                     <br>        obsess_over_service             0                    <br>        check_freshness                 0                   <br>

        notifications_enabled           1                  <br>        event_handler_enabled           1                       <br>        flap_detection_enabled          1                       <br>        failure_prediction_enabled      1                       <br>

        process_perf_data               1                       <br>        retain_status_information       1                       <br>        retain_nonstatus_information    1                       <br>        is_volatile                     0                       <br>

        check_period                    24x7                   <br>        max_check_attempts              2                      <br>        normal_check_interval           2                     <br>        retry_check_interval            1                      <br>

        notification_options            w,u,c,r                <br>        notification_interval           2                     <br>        notification_period             24x7                   <br>        register                        0                      <br>

}<br><br># services_social.cfg<br>define service {<br>        use                             critical-service<br>        host_name                       mt-ubuntu<br>        service_description             SMTP Availability<br>

        contact_groups                  individuals_group<br>        check_command                   check_smtp<br>      flap_detection_enabled          0<br>}<br><br># t_host.cfg<br>define host {<br>                 use                     no_icmp<br>

                 host_name               mt-ubuntu<br>                 alias                   mt-ubuntu<br>                 address                 10.2.23.23<br>                 contact_groups          individuals_group<br>

                }<br><br># individual_contacts.cfg<br>define contact{<br>        contact_name                      mt <br>        alias                           MT<br>        service_notification_period     24x7<br>        host_notification_period        24x7<br>

        service_notification_options    w,u,c<br>        host_notification_options       d,u,r<br>        service_notification_commands   notify-by-email<br>        host_notification_commands      host-notify-by-email<br>

        email                           <removed><br>        }<br><br>define contactgroup{<br>        contactgroup_name               individuals_group<br>        alias                           Individuals<br>        members                         mt<br>

}<br><br># commands.cfg<br># 'notify-by-email' command definition<br>define command{<br>      command_name      notify-by-email<br>      command_line      /usr/bin/printf "%b" "***** NOCNAG *****\n\nNotification Type: $NOTIFICATIONTYPE$\n\nService: $SERVICEDESC$\nHost: $HOSTALIAS$\nAddress: $HOSTADDRESS$\nState: $SERVICESTATE$\n\nDate/Time: $LONGDATETIME$\n\nAdditional Info:\n\n$SERVICEOUTPUT$" | /usr/bin/mail -s "** $NOTIFICATIONTYPE$ alert - $HOSTALIAS$/$SERVICEDESC$ is $SERVICESTATE$ **" $CONTACTEMAIL$<br>

      }<br><br><br>Any assistance would be appreciated.<br><font color="#888888"><br>Matt<br><br>
</font></blockquote></div><br>