Running 6K hosts

[Andreas Ericsson]

Ben wrote:
> A quick glance at the code makes it look like all the xodtemplate 
> functions spend most of their time list walking. Converting from a list to 
> a tree/hash should dramatically speed things up.
> 

Forget hashes. If objects were properly indexed in internal tables, this 
would be a much simpler issue where only host-names have to be hashed.
Services could then be organized in a 3D table indexed by size_t 
host_id, which would reside in the host object struct (in running 
config, that is). The one-time load penalty would be slightly higher, 
but not necessarily very much since the internal tables really don't 
have to bother with alphabetical sorting and such.

If one wants it even faster, it would be simple to put all objects 
referenced by others into such tables. For instance, a service object 
could have a serviceextinfo_id variable so as to quickly locate it in a 
map. With only very minor modifications to the CGI's and the daemon 
(printing total number of each object type at the top of objects.cache 
so it doesn't have to bother with reading, counting, allocating, 
indexing and tabulating in separate passes), one would notice a 
tremendous speedup.

> On Tue, 8 Feb 2005, Jason Martin wrote:
> 
> 
>>I'm looking ahead to running a 6K host / 60K service distributed
>>Nagios setup reporting up to a central Nagios host.  
>>
>>The test procedure was to write a config file consisting of X
>>hosts with 10 services per host.  
>>
>>On a 2 proc 2Ghz Intel machine, the preflight time for 1.1 and
>>2.0cvs comes out as:
>>
>>Hosts	v1.1(s)	v2.0(s)
>>100	0	1
>>400	5	4
>>500	7	6
>>1000	23	23
>>2000	149	117
>>3000	321	251
>>4000	526	431
>>5000	760	651
>>6000	1034	912
>>
>>The profile for the preflight is:
>>Each sample counts as 0.01 seconds.
>>  %   cumulative   self              self     total
>> time   seconds   seconds    calls  ms/call  ms/call  name
>> 84.24      4.33     4.33     5502     0.79     0.79  xodtemplate_find_service
>>  7.78      4.73     0.40        1   400.00   449.66  xodtemplate_sort_services
>>  4.09      4.94     0.21        1   210.00   210.00  pre_flight_check
>>  0.78      4.98     0.04     5501     0.01     0.01  find_service
>>
>>It looks like xodtemplate_find_service is still taking up a log of time. Can
>>anything be done to speed it up? Otherwise it looks like 6K hosts is going to be unatainable.
>>
>>Thanks,
>>-Jason Martin
>>-- 
>>This message is PGP/MIME signed.
>>
> 
> 
> 
> 
> 
> -------------------------------------------------------
> SF email is sponsored by - The IT Product Guide
> Read honest & candid reviews on hundreds of IT Products from real users.
> Discover which products truly live up to the hype. Start reading now.
> http://ads.osdn.com/?ad_id=6595&alloc_id=14396&op=click
> _______________________________________________
> Nagios-devel mailing list
> Nagios-devel at lists.sourceforge.net
> https://lists.sourceforge.net/lists/listinfo/nagios-devel
> 

-- 
Andreas Ericsson                   andreas.ericsson at op5.se
OP5 AB                             www.op5.se
Lead Developer


-------------------------------------------------------
SF email is sponsored by - The IT Product Guide
Read honest & candid reviews on hundreds of IT Products from real users.
Discover which products truly live up to the hype. Start reading now.
http://ads.osdn.com/?ad_id=6595&alloc_id=14396&op=click