Submit Your CMD.PHP vs. SPINE Metrics Here

Important information about Cacti developments that all users should be interested in.

Moderators: Developers, Moderators

Post Reply
kenfury
Posts: 3
Joined: Wed Dec 29, 2004 5:33 pm

Submit Your CMD.PHP vs. SPINE Metrics Here

Post by kenfury »

What a change. I ran cmd.php every 60 seconds and I was getting into 40 second range for the scripts to run. Now I am down to 2.3-2.7 seconds with cactid. Quick specs...

Network Devices
---------------------

24 Cisco 3600 with 4 interfaces
1 Cisco 7200 with over 40 interfaces
3 Cisco 3550 12 interfaces
5 Cisco 3750 48 interfaces
48 Printers
10 servers (just Eth monitoring)

The Server
-----------------
IBM 335
Dual 2.4 Xeon
1 gig ram
U160 SCSI
Fedora Core1
Cactid 8.6d
cmd.php 8.6c

Cmd.php was running in the 2.8 to 3.4 load range for 5 min avg. Now with cactid I am running in the .5 to.7 range. cactid is running 2 threads vs 8 poller process with cmd.php. What a great upgrade.
Mikf
Posts: 47
Joined: Fri Aug 13, 2004 11:35 am
Location: Paris, France

Post by Mikf »

Hello,

here my test :
01/27/2005 07:50:16 PM - SYSTEM STATS: Time: 15.5160 s, Method: cactid, Processes: 8, Threads: 8, Hosts: 162, Hosts/Process: 21
01/27/2005 07:45:17 PM - SYSTEM STATS: Time: 15.1279 s, Method: cactid, Processes: 8, Threads: 8, Hosts: 162, Hosts/Process: 21
01/27/2005 07:40:19 PM - SYSTEM STATS: Time: 17.1653 s, Method: cactid, Processes: 8, Threads: 8, Hosts: 162, Hosts/Process: 21
01/27/2005 07:35:24 PM - SYSTEM STATS: Time: 22.8908 s, Method: cactid, Processes: 8, Threads: 8, Hosts: 162, Hosts/Process: 21
01/27/2005 07:31:17 PM - SYSTEM STATS: Time: 75.8915 s, Method: cmd.php, Processes: 8, Threads: N/A, Hosts: 162, Hosts/Process: 21
01/27/2005 07:25:50 PM - SYSTEM STATS: Time: 49.4887 s, Method: cmd.php, Processes: 8, Threads: N/A, Hosts: 162, Hosts/Process: 21
01/27/2005 07:20:48 PM - SYSTEM STATS: Time: 46.9298 s, Method: cmd.php, Processes: 8, Threads: N/A, Hosts: 162, Hosts/Process: 21
01/27/2005 07:16:00 PM - SYSTEM STATS: Time: 59.3676 s, Method: cmd.php, Processes: 8, Threads: N/A, Hosts: 162, Hosts/Process: 21



for 162 hosts (2829 data sources)
(routers, filers, caches, firewalls, windows, linux, solaris)

IBM Bi-Xeon 2.8Ghz
1G RAM

cacti 0.8.6c
cactid 0.8.6d

edit : new stats
03/02/2005 10:15:56 AM - SYSTEM STATS: Time: 54.2769 s, Method: cactid, Processes: 1, Threads: 64, Hosts: 227, Hosts/Process: 227
03/02/2005 10:11:04 AM - SYSTEM STATS: Time: 63.4464 s, Method: cactid, Processes: 1, Threads: 64, Hosts: 227, Hosts/Process: 227
03/02/2005 10:06:09 AM - SYSTEM STATS: Time: 68.1267 s, Method: cactid, Processes: 1, Threads: 64, Hosts: 227, Hosts/Process: 227
03/02/2005 10:01:19 AM - SYSTEM STATS: Time: 78.2936 s, Method: cactid, Processes: 1, Threads: 64, Hosts: 227, Hosts/Process: 227
Last edited by Mikf on Wed Mar 02, 2005 4:19 am, edited 1 time in total.
User avatar
TheWitness
Developer
Posts: 16897
Joined: Tue May 14, 2002 5:08 pm
Location: MI, USA
Contact:

Post by TheWitness »

Hi, here are some production numbers:

Dell PowerEdge 6350
Quad Xenon 550
2 GBytes RAM
(Old Horse)

> 178 Hosts
> 5000 Data Sources
> Mixture of SNMPv1 and SNMPv2 Devices

CMD.PHP
8 Processes, Average: 160 Seconds

CACTID
4 Processes, 8 Threads Each, Average 40 Seconds
True understanding begins only when we realize how little we truly understand...

Life is an adventure, let yours begin with Cacti!

Author of dozens of Cacti plugins and customization's. Advocate of LAMP, MariaDB, IBM Spectrum LSF and the world of batch. Creator of IBM Spectrum RTM, author of quite a bit of unpublished work and most of Cacti's bugs.
_________________
Official Cacti Documentation
GitHub Repository with Supported Plugins
Percona Device Packages (no support)
Interesting Device Packages


For those wondering, I'm still here, but lost in the shadows. Yearning for less bugs. Who want's a Cacti 1.3/2.0? Streams anyone?
Ev
Cacti User
Posts: 104
Joined: Tue Jan 25, 2005 12:16 pm

Post by Ev »

Sun Ultra 60 (2* USparc 440 Mhz) 1 G ram. Under heavy load (another monitoring program + old rrd).

62 hosts, ~670 data sources.

4* cmd.php - 200..240 sec.
1* cactid * 5 threads - 28..40 sec.

78 hosts with cactid - same time, 30..40 sec.

Can anyone wrote about it's stability of Cactid under Solaris (and under other Unix) ?
User avatar
gandalf
Developer
Posts: 22383
Joined: Thu Dec 02, 2004 2:46 am
Location: Muenster, Germany
Contact:

Post by gandalf »

IBM Dual Xeon
RH Linux
Cactid 8.6d
cacti 0.8.6c

About 17 to 18 sec. for cactid, 2 Processes, 8 Threads, 133 Hosts, 1390 rrds. Cactid seems to be about 6 times faster than cmd.php.
The above contains some dozen data sources that are queried using perl scripts parsing html output (apache stats and so on)
aaa111
Posts: 3
Joined: Tue Nov 23, 2004 12:55 am

Re: >> Submit Your CMD.PHP vs. CACTID Metrics Here

Post by aaa111 »

SYSTEM STATS: Time: 250.9287 s, Method: cactid, Processes: 2, Threads: 2, Hosts: 62, Hosts/Process: 31
# ls -1 rra/ | wc -l
2286

FreeBSD 5.3-STABLE #6
CPU: Intel(R) Xeon(TM) CPU 2.40GHz (2392.29-MHz 686-class CPU)
real memory = 1073676288 (1023 MB)
User avatar
TheWitness
Developer
Posts: 16897
Joined: Tue May 14, 2002 5:08 pm
Location: MI, USA
Contact:

Post by TheWitness »

aaa111,

Increase your thread count to 10 and repost.

TheWitness
True understanding begins only when we realize how little we truly understand...

Life is an adventure, let yours begin with Cacti!

Author of dozens of Cacti plugins and customization's. Advocate of LAMP, MariaDB, IBM Spectrum LSF and the world of batch. Creator of IBM Spectrum RTM, author of quite a bit of unpublished work and most of Cacti's bugs.
_________________
Official Cacti Documentation
GitHub Repository with Supported Plugins
Percona Device Packages (no support)
Interesting Device Packages


For those wondering, I'm still here, but lost in the shadows. Yearning for less bugs. Who want's a Cacti 1.3/2.0? Streams anyone?
aaa111
Posts: 3
Joined: Tue Nov 23, 2004 12:55 am

Post by aaa111 »

TheWitness wrote:aaa111,

Increase your thread count to 10 and repost.

TheWitness
about system: virtual host, based on jail.
load averages: 7,41 4,38 3,80


before:
03/02/2005 08:54:08 AM - SYSTEM STATS: Time: 247.5776 s, Method: cactid, Processes: 2, Threads: 2, Hosts: 62, Hosts/Process: 31
03/02/2005 08:59:34 AM - SYSTEM STATS: Time: 273.4089 s, Method: cactid, Processes: 2, Threads: 2, Hosts: 62, Hosts/Process: 31
03/02/2005 09:04:21 AM - SYSTEM STATS: Time: 260.9941 s, Method: cactid, Processes: 2, Threads: 2, Hosts: 62, Hosts/Process: 31
03/02/2005 09:09:33 AM - SYSTEM STATS: Time: 272.8332 s, Method: cactid, Processes: 2, Threads: 2, Hosts: 62, Hosts/Process: 31

after:
03/02/2005 09:14:27 AM - SYSTEM STATS: Time: 267.1197 s, Method: cactid, Processes: 2, Threads: 10, Hosts: 62, Hosts/Process: 31
03/02/2005 09:19:49 AM - SYSTEM STATS: Time: 287.9956 s, Method: cactid, Processes: 2, Threads: 10, Hosts: 62, Hosts/Process: 31
03/02/2005 09:24:37 AM - SYSTEM STATS: Time: 276.7104 s, Method: cactid, Processes: 2, Threads: 10, Hosts: 62, Hosts/Process: 31
03/02/2005 09:29:52 AM - SYSTEM STATS: Time: 291.8246 s, Method: cactid, Processes: 2, Threads: 10, Hosts: 62, Hosts/Process: 31

PS: cacti has tools for profiling ?
Ev
Cacti User
Posts: 104
Joined: Tue Jan 25, 2005 12:16 pm

Post by Ev »

aaa111 wrote:
TheWitness wrote:aaa111,

Increase your thread count to 10 and repost.

TheWitness
about system: virtual host, based on jail.
load averages: 7,41 4,38 3,80
^^^^^^^^^^^^^^^^^^^

high load.
Mikf
Posts: 47
Joined: Fri Aug 13, 2004 11:35 am
Location: Paris, France

to increase the speed

Post by Mikf »

aaa111,

try with /usr/local/share/snmp/mibs empty. (or the good path to the mibs files of net-snmp)

- mikf
carcass
Posts: 4
Joined: Sun Jan 02, 2005 6:44 pm

Post by carcass »

P4 2.4 without HyperThreading

cactid one a minute:
03/10/2005 06:01:08 PM - SYSTEM STATS: Time: 7.4417 s, Method: cactid, Processes: 5, Threads: 10, Hosts: 63, Hosts/Process: 13
03/10/2005 06:02:05 PM - SYSTEM STATS: Time: 4.9023 s, Method: cactid, Processes: 5, Threads: 10, Hosts: 63, Hosts/Process: 13
03/10/2005 06:03:05 PM - SYSTEM STATS: Time: 4.8770 s, Method: cactid, Processes: 5, Threads: 10, Hosts: 63, Hosts/Process: 13
03/10/2005 06:04:06 PM - SYSTEM STATS: Time: 5.1839 s, Method: cactid, Processes: 5, Threads: 10, Hosts: 63, Hosts/Process: 13

all devices are cisco catalysts. 1251 rrds.

03/10/2005 06:08:27 PM - SYSTEM STATS: Time: 26.7298 s, Method: cmd.php, Processes: 5, Threads: N/A, Hosts: 63, Hosts/Process: 13
03/10/2005 06:09:25 PM - SYSTEM STATS: Time: 25.7774 s, Method: cmd.php, Processes: 5, Threads: N/A, Hosts: 63, Hosts/Process: 13

turning on 28 ZYXEL dslams:

cactid
03/10/2005 06:18:18 PM - SYSTEM STATS: Time: 17.7232 s, Method: cactid, Processes: 5, Threads: 10, Hosts: 91, Hosts/Process: 19
03/10/2005 06:19:17 PM - SYSTEM STATS: Time: 17.1713 s, Method: cactid, Processes: 5, Threads: 10, Hosts: 91, Hosts/Process: 19

cmd.php
03/10/2005 06:32:55 PM - SYSTEM STATS: Time: 51.0815 s, Method: cmd.php, Processes: 5, Threads: N/A, Hosts: 91, Hosts/Process: 19
03/10/2005 06:33:48 PM - SYSTEM STATS: Time: 47.9127 s, Method: cmd.php, Processes: 5, Threads: N/A, Hosts: 91, Hosts/Process: 19

3000 rrds now
Rossco
Cacti User
Posts: 76
Joined: Sat Jan 15, 2005 4:52 pm
Location: London, England

cacti speeds

Post by Rossco »

Never got cmd.php to work for some reason, but these are my stats using cactid on a dual 2.8Ghz(with Hyperthreading) with 1GB RAM(windows2k).

Majority of these are Cisco routers and switches across 34 sites polling every 5 mins, approx 50 windows boxes. Total of 12,210 seperate rrds/datasources.


3/15/2005 10:11:31 PM - SYSTEM STATS: Time: 91.0645 s, Method: cactid, Processes: 2, Threads: 25, Hosts: 346,Hosts/Process: 173
03/15/2005 10:07:32 PM - SYSTEM STATS: Time: 151.8085 s, Method: cactid, Processes: 2, Threads: 25, Hosts: 346, Hosts/Process: 173
03/15/2005 10:01:39 PM - SYSTEM STATS: Time: 99.5154 s, Method: cactid, Processes: 2, Threads: 25, Hosts: 346, Hosts/Process: 173
03/15/2005 09:56:31 PM - SYSTEM STATS: Time: 90.8879 s, Method: cactid, Processes: 2, Threads: 25, Hosts: 346, Hosts/Process: 173
03/15/2005 09:51:31 PM - SYSTEM STATS: Time: 91.3955 s, Method: cactid, Processes: 2, Threads: 25, Hosts: 346, Hosts/Process: 173

Kind regards
Ross
ssams
Cacti User
Posts: 65
Joined: Tue Feb 01, 2005 5:54 pm
Location: Texas
Contact:

Post by ssams »

1 thread
03/21/2005 01:31:40 PM - SYSTEM STATS: Time: 100.7504 s, Method: cactid, Processes:
1, Threads: 1, Hosts: 90, Hosts/Process: 90

10 threads
03/21/2005 01:35:23 PM - SYSTEM STATS: Time: 22.5106 s, Method: cactid, Processes: 1, Threads: 10, Hosts: 90, Hosts/Process: 90


cmd was failing on max time.

approximately 2000 rras and growing. will probably hit 10000 when i am done.
User avatar
fmangeant
Cacti Guru User
Posts: 2345
Joined: Fri Sep 19, 2003 8:36 am
Location: Sophia-Antipolis, France
Contact:

Post by fmangeant »

Hi all

I changed this morning from Cacti 0.8.6c cmd.php (20 pollers) :

Code: Select all

04/04/2005 09:47:50 AM - SYSTEM STATS: Time: 169.9051 s, Method: cmd.php, Processes: 20, Threads: N/A, Hosts: 537, Hosts/Process: 27
to Cacti 0.8.6c + cactid 0.8.6d (4 pollers w/ 15 threads) :

Code: Select all

04/04/2005 11:25:56 AM - SYSTEM STATS: Time: 44.6722 s, Method: cactid, Processes: 4, Threads: 15, Hosts: 537, Hosts/Process: 108
Total of 6000 rras (SNMP and Nagios, on Unix/NT hosts).

Here's an update, after 3 months running cactid :

Code: Select all

07/04/2005 03:46:11 PM - SYSTEM STATS: Time: 69.4416 s, Method: cactid, Processes: 4, Threads: 15, Hosts: 567, Hosts/Process: 142, Data Sources 7879, RRDs Processed 6042
I'm now having 7500 rras.
Last edited by fmangeant on Mon Jul 04, 2005 9:21 am, edited 2 times in total.
[size=84]
[color=green]HOWTOs[/color] :
[list][*][url=http://forums.cacti.net/viewtopic.php?t=15353]Install and configure the Net-SNMP agent for Unix[/url]
[*][url=http://forums.cacti.net/viewtopic.php?t=26151]Install and configure the Net-SNMP agent for Windows[/url]
[*][url=http://forums.cacti.net/viewtopic.php?t=28175]Graph multiple servers using an SNMP proxy[/url][/list]
[color=green]Templates[/color] :
[list][*][url=http://forums.cacti.net/viewtopic.php?t=15412]Multiple CPU usage for Linux[/url]
[*][url=http://forums.cacti.net/viewtopic.php?p=125152]Memory & swap usage for Unix[/url][/list][/size]
Kap
Posts: 1
Joined: Fri Feb 25, 2005 10:53 am

Post by Kap »

04/06/2005 12:12:50 PM - SYSTEM STATS: Time: 50.1300 s, Method: cmd.php, Processes: 4, Threads: N/A, Hosts: 112, Hosts/Process: 29

04/06/2005 12:37:07 PM - CACTID: Poller[0] Time: 7.3960 s, Threads: 4, Hosts: 29


112 Devices
2832 Data Sources
MySQL 4.0.24 | Net-SNMP 5.2.1 | IIS 6| PHP 5.0.3 | RRDtool 1.0.49 | ActivePerl 5.8.6.811 | Windows 2003 Standard | AMD Athlon 2400+, 512MB RAM
Post Reply

Who is online

Users browsing this forum: No registered users and 0 guests