There is something definitely not right here. We have about 10000 checks and the performance is lot better. Anyhow we are using the following values<br><font face="Verdana"><font size="3"><div style="text-indent: 4em;"><font face="@Terminal">check_result_reaper_frequency=10</font></div>
<div style="text-indent: 4em;"><font face="@Terminal">max_check_result_reaper_time=20<br><br><br>You should enabled debug mode and check the debug logs. Are you writing to any backend database? Are you using nsca to transfer service information to remote location. what is the value of your status_update_interval? what is your external_command_buffer_slots?<br>
<br></font></div></font></font><br><br><div class="gmail_quote">2010/6/28 wwanghongrui <span dir="ltr"><<a href="mailto:wwanghongrui@cebbank.com">wwanghongrui@cebbank.com</a>></span><br><blockquote class="gmail_quote" style="margin: 0pt 0pt 0pt 0.8ex; border-left: 1px solid rgb(204, 204, 204); padding-left: 1ex;">
<div>
<div><font face="Verdana"><font size="2">Hi,guys~</font></font></div>
<div><font face="Verdana"><font size="2"></font></font> </div>
<div style="text-indent: 2em;"><font face="Verdana"><font size="2">Our nagios server
envrionment: Nagios3.2.0 + Suse10-sp2 x86_64 + 8 GB mem + 4 x
( Xeon(R) CPU E7420 @ 2.13GHz )</font></font></div>
<div style="text-indent: 2em;"><font face="Verdana"><font size="2">We have 500+
active check hosts and 3k+ active check services. I have adjust some
perfomance parameters in nagios.cfg, like below:</font></font></div>
<div style="text-indent: 4em;">
<div><font face="@Terminal">use_large_installation_tweaks=1</font></div>
<div><font face="@Terminal">child_processes_fork_twice=0</font></div>
<div><font face="@Terminal">enable_environment_macros=0</font></div></div><font face="Verdana"><font size="3">
<div style="text-indent: 4em;"><font face="@Terminal">check_result_reaper_frequency=5</font></div>
<div style="text-indent: 4em;"><font face="@Terminal">max_check_result_reaper_time=30</font></div>
<div style="text-indent: 4em;" align="left"><font size="2"></font> </div>
<div style="text-indent: 4em;" align="left"><font size="2">But, The nagios
performance is still bad, like below:</font></div>
<div style="text-indent: 6em;" align="left"> </div></font><font size="2">
<div align="left">
<table border="0" cellpadding="10">
<tbody>
<tr>
<td valign="center">
<div>Services Actively Checked<font face="Terminal" size="2">:</font></div></td>
<td valign="top">
<table border="1" cellpadding="0" cellspacing="0">
<tbody>
<tr>
<td>
<table border="0">
<tbody>
<tr>
<th><font face="Terminal" size="2">Time Frame</font></th>
<th><font face="Terminal" size="2">Services
Checked</font></th></tr>
<tr>
<td><font face="Terminal" size="2"><= 1
minute:</font></td>
<td><font face="Terminal" size="2">271
(9.4%)</font></td></tr>
<tr>
<td><font face="Terminal" size="2"><= 5
minutes:</font></td>
<td><font face="Terminal" size="2">1749
(60.4%)</font></td></tr>
<tr>
<td><font face="Terminal" size="2"><= 15
minutes:</font></td>
<td><font face="Terminal" size="2">2824
(97.4%)</font></td></tr>
<tr>
<td><font face="Terminal" size="2"><= 1
hour:</font></td>
<td><font face="Terminal" size="2">2898
(100.0%)</font></td></tr>
<tr>
<td><font face="Terminal" size="2">Since program
start: </font></td>
<td><font face="Terminal" size="2">2869
(99.0%)</font></td></tr></tbody></table></td></tr></tbody></table></td>
<td valign="top">
<table border="1" cellpadding="0" cellspacing="0">
<tbody>
<tr>
<td>
<table border="0">
<tbody>
<tr>
<th><font face="Terminal" size="2">Metric</font></th>
<th><font face="Terminal" size="2">Min.</font></th>
<th><font face="Terminal" size="2">Max.</font></th>
<th><font face="Terminal" size="2">Average</font></th></tr>
<tr>
<td><font face="Terminal" size="2">Check Execution
Time: </font></td>
<td><font face="Terminal" size="2">0.09
sec</font></td>
<td><font face="Terminal" size="2">32.23
sec</font></td>
<td><font face="Terminal" size="2">1.113
sec</font></td></tr>
<tr>
<td><font face="Terminal" size="2">Check
Latency:</font></td>
<td><font face="Terminal" size="2">1.12
sec</font></td>
<td><font face="Terminal" size="2">212.59
sec</font></td>
<td><font face="Terminal" size="2">116.329
sec</font></td></tr>
<tr>
<td><font face="Terminal" size="2">Percent State
Change:</font></td>
<td><font face="Terminal" size="2">0.00%</font></td>
<td><font face="Terminal" size="2">23.88%</font></td>
<td><font face="Terminal" size="2">0.05%</font></td></tr></tbody></table></td></tr></tbody></table></td></tr>
<tr>
<td valign="center">
<div><font face="Terminal" size="2">Hosts Acrively
Checked:</font></div></td>
<td valign="top">
<table border="1" cellpadding="0" cellspacing="0">
<tbody>
<tr>
<td>
<table border="0">
<tbody>
<tr>
<th><font face="Terminal" size="2">Time Frame</font></th>
<th><font face="Terminal" size="2">Hosts
Checked</font></th></tr>
<tr>
<td><font face="Terminal" size="2"><= 1
minute:</font></td>
<td><font face="Terminal" size="2">32
(5.5%)</font></td></tr>
<tr>
<td><font face="Terminal" size="2"><= 5
minutes:</font></td>
<td><font face="Terminal" size="2">419
(71.5%)</font></td></tr>
<tr>
<td><font face="Terminal" size="2"><= 15
minutes:</font></td>
<td><font face="Terminal" size="2">586
(100.0%)</font></td></tr>
<tr>
<td><font face="Terminal" size="2"><= 1
hour:</font></td>
<td><font face="Terminal" size="2">586
(100.0%)</font></td></tr>
<tr>
<td><font face="Terminal" size="2">Since program
start: </font></td>
<td><font face="Terminal" size="2">586
(100.0%)</font></td></tr></tbody></table></td></tr></tbody></table></td>
<td valign="top">
<table border="1" cellpadding="0" cellspacing="0">
<tbody>
<tr>
<td>
<table border="0">
<tbody>
<tr>
<th><font face="Terminal" size="2">Metric</font></th>
<th><font face="Terminal" size="2">Min.</font></th>
<th><font face="Terminal" size="2">Max.</font></th>
<th><font face="Terminal" size="2">Average</font></th></tr>
<tr>
<td><font face="Terminal" size="2">Check Execution
Time: </font></td>
<td><font face="Terminal" size="2">0.08
sec</font></td>
<td><font face="Terminal" size="2">4.29
sec</font></td>
<td><font face="Terminal" size="2">3.035
sec</font></td></tr>
<tr>
<td><font face="Terminal" size="2">Check
Latency:</font></td>
<td><font face="Terminal" size="2">0.00
sec</font></td>
<td><font face="Terminal" size="2">135.25
sec</font></td>
<td><font face="Terminal" size="2">116.420
sec</font></td></tr>
<tr>
<td><font face="Terminal" size="2">Percent State
Change:</font></td>
<td><font face="Terminal" size="2">0.00%</font></td>
<td><font face="Terminal" size="2">11.32%</font></td>
<td><font face="Terminal" size="2">0.09%</font></td></tr></tbody></table></td></tr></tbody></table></td></tr></tbody></table></div></font>
<div><font color="#c0c0c0"><font size="2"><span></span></font></font> </div>
<div><font><font><span><font size="2"> How could I find which services
check or hosts check cause this seriously check latency?
</font></span></font></font></div>
<div><font><font size="2"><span></span></font></font> </div>
<div><font><font size="2"><span></span></font></font> </div>
<div><font><font size="2"><span>Regards </span></font></font></div>
<div><font><font size="2"><span></span></font></font> </div>
<div><font><font size="2"><span>HongRui Wang</span></font></font></div>
<div><font><font size="2"><span>mail: <a href="mailto:wwanghongrui@cebbank.com" target="_blank">wwanghongrui@cebbank.com</a></span></font></font></div>
<div><font><font size="2"><span>2010-06-28</span></font></font></div>
<div><font color="#c0c0c0"><font size="2"><span></span></font></font> </div>
<div><font color="#c0c0c0"><font size="2"></font></font> </div></font></div>
<br>------------------------------------------------------------------------------<br>
This SF.net email is sponsored by Sprint<br>
What will you do first with EVO, the first 4G phone?<br>
Visit <a href="http://sprint.com/first" target="_blank">sprint.com/first</a> -- <a href="http://p.sf.net/sfu/sprint-com-first" target="_blank">http://p.sf.net/sfu/sprint-com-first</a><br>_______________________________________________<br>
Nagios-users mailing list<br>
<a href="mailto:Nagios-users@lists.sourceforge.net">Nagios-users@lists.sourceforge.net</a><br>
<a href="https://lists.sourceforge.net/lists/listinfo/nagios-users" target="_blank">https://lists.sourceforge.net/lists/listinfo/nagios-users</a><br>
::: Please include Nagios version, plugin version (-v) and OS when reporting any issue.<br>
::: Messages without supporting info will risk being sent to /dev/null<br></blockquote></div><br><br clear="all"><br>-- <br>Cordially,<br>Shadhin Rahman<br>