Nagios Conference 2011 - Mike Weber - Training: Reducing Nagios Server Load With Mod-Gearman
0 likes1,594 views
Mike Weber's training class on using mod-german to reduce the load on a Nagios monitoring server. The training session was held during the Nagios World Conference North America held Sept 27-29th, 2011 in Saint Paul, MN. For more information on the conference (including photos and videos), visit: http://go.nagios.com/nwcna
Ad
More Related Content
What's hot (19)
Viewers also liked (6)
Ad
Similar to Nagios Conference 2011 - Mike Weber - Training: Reducing Nagios Server Load With Mod-Gearman (20)
Ad
More from Nagios (20)
Recently uploaded (20)
Nagios Conference 2011 - Mike Weber - Training: Reducing Nagios Server Load With Mod-Gearman
- 1. Mod-Gearman Mike Weber mweber@spidertools.com
- 2. Mod-Gearman Basic Functionality What does Mod-Gearman do? How does it work? Self-Load Balancing Using Mod-Gearman to reduce load on XI. Load Balancing Use workers to reduce load on Nagios. Distributed Monitoring Specify load on numerous networks and workers. Passive Monitoring Receiving passive checks. 2011 2
- 3. Mod-Gearman: Basic Functionality Distributes tasks to multiple workers Mutiple Servers Multiple Workers Supports Multiple Programming Languages: C Java Perl PHP Python Shell 2011 3
- 4. Mod-Gearman 2011 4
- 5. NEB: Nagios Event Broker 2011 5
- 6. Mod-Gearman Advantages Reduce Overall Load on Nagios Move Problem Processes Off Nagios Eventhandler waiting/hung Plugin Delay – some plugins capture resources for up to 10 seconds Reduce Overhead when Forking Nagios Core When Nagios has to fork a new process and the core is large, the system can take a major hit. 2011 6
- 7. Mod-Gearman Queues 2011 7
- 8. Mod-Gearman Worker Configuration Worker Identifier Unique identifier for worker, hostname min-worker Minimum number of total workers max-worker Maximum number of total workers idle-timeout Time in seconds before idle worker exits max-jobs Maximum number of jobs before worker exits 2011 8
- 9. Install Process Install Nagios Event Broker broker_module=/usr/local/lib/mod_gearman/mod_gearman.o config=/usr/local/etc/mod_gearman.conf Install Server: gearmand /etc/init.d/gearmand start Install Worker: mod_gearman_worker /etc/init.d/mod_gearman_worker start Configuration File /usr/local/etc/mod_gearman.conf 2011 9
- 11. Avoiding Falling Dominos Mod-Gearman Server Monitoring and Distributing the Load Mod-Gearman Worker Using a Nagios Event Broker to Lighten the Load Using a Nagios Event Broker to Distribute the Load Reduce Latency Latency reduced by up to 37% Extend Life in Crisis Events Preparation for Load Balancing 2011 11
- 12. Self-Load Balancing: Before - After 2011 12
- 13. Mod-Gearman: Server and Worker PID PPID CPU RAM 13480 1 0.0 1328 03:14:05 /usr/local/bin/mod_gearman_worker -d – config=/usr/local/etc/mod_gearman.conf – pidfile=/usr/local/var/mod_gearman/mod_gearman_worker.pid 13481 13480 0.0 1328 03:14:05 /usr/local/bin/mod_gearman_worker -d --config=/usr/local/etc/mod_gearman.conf – pidfile=/usr/local/var/mod_gearman/mod_gearman_worker.pid 19734 1 0.0 114580 01:07:50 /usr/local/sbin/gearmand -p 4730 -P /usr/local/var/mod_gearman/gearmand.pid -d -j 0 -t 10 --log- file=/usr/local/var/mod_gearman/gearmand.log -v -v --l As you can see the worker uses very little in the way of resources (1328 KB of Memory) compared to the server which uses over 111 MB of Memory. When you look at these figures, you can see adding a worker to help shift the load on the local Nagios server is not a far fetched as you might originally think. 2011 13
- 14. Load Balancing
- 15. Load Balancing 2011 15
- 16. Load Balancing: Server and Worker Server Configuration: /usr/local/etc/mod_gearman.conf server=localhost:4730 eventhandler=yes services=yes hosts=yes encryption=yes key=linux23_Qg549K Worker Configuration: /usr/local/etc/mod_gearman.conf server=192.168.5.4:4730 eventhandler=yes services=yes hosts=yes encryption=yes key=linux23_Qg549K 2011 16
- 17. Load Balancing: 2 Workers 2011 17
- 19. Distributed Monitoring 2011 19
- 20. Distributed Monitoring: Hostgroups Server Configuration: /usr/local/etc/mod_gearman.conf server=localhost:4730 eventhandler=yes services=yes hosts=yes encryption=yes key=linux23_Qg549K Worker Configuration: /usr/local/etc/mod_gearman.conf server=192.168.5.4:4730 eventhandler=yes services=yes hosts=yes encryption=yes key=linux23_Qg549K hostgroups=debianservers 2011 20
- 22. Passive Monitoring 2011 22
- 24. Passive Monitoring: Service Check 2011 24