Increasing Threads on Main Poller Causing errors

[mrheavydee95]

I'm trying to increase the Threads on my Main Poller from 8 to 32 because my SPINE poller is timing out. I have 136 Devices on Cacti and still need to add another 120. We're running the poller every minute and I'm trying to increase the thread so the poller doesn't time out. Errors Attached.

If I throttle down the Threads back to 8, the errors go away.

[macan]

Go to utilities -> System utilities -> summary tab -> check Minimum Connections:
I think that you need increase mysql max_connection

[mrheavydee95]

Thanks Macon, that did the trick.
I played around with the max_connections, join_buffer_size and sort_buffer_size and now I'm able to increase the Threads count from 8 to 40.

[bmfmancini]

40 threads is excessive!!

If anything I would lower the threads and Increase the process count

Also check for potential network issues slowing you down like a fw dropping udp thinking it's a flood

[Rno]

If that help, this is my system stat, and I have way more device than you:

Code: Select all

SYSTEM STATS: Time:13.9257 Method:spine Processes:8 Threads:16 Hosts:1255 HostsPerProcess:157 DataSources:22015 RRDsProcessed:0

Adding process or thread is not always the solution, and can be worst.

[mrheavydee95]

I updated my settings from 5/40 to 8/16 and the time for my poll to complete increased only 9 seconds. Thanks for the advice. Any other suggestions?

SYSTEM STATS: Time:24.1698 Method:spine Processes:5 Threads:40 Hosts:235 HostsPerProcess:47 DataSources:4219 RRDsProcessed:1562

SYSTEM STATS: Time:33.5299 Method:spine Processes:8 Threads:16 Hosts:235 HostsPerProcess:30 DataSources:4219 RRDsProcessed:1534

[TheWitness]

Enable boost Settings > Performance. With that many hosts, 1 process and 20 threads should be enough.

[mrheavydee95]

What would be the best settings if I enable it. Please note that the poller is running every 1 minute.