Zum Hauptinhalt springen
Scaling Icinga2 with
many heterogeneous projects
and still preserving configurability
Max Rosin - Systems Engineer Monitoring
06.11.2018
SysEleven
2
• Managed Hosting
• SysEleven Stack
• MetaKube
• Internet Service Provider
• 100+ Employees
Max Rosin
Twitter, GitHub, etc: @ekeih
Why am I here?
3
Infrastructure
4
• 2 datacenters
• 3.000 hosts
• 60.000 services
• Several hundred different setups
Technical Debt
5
Technical Debt
6
Technical Debt
7
Requirements
8
• 100% automated
• High available
• Stage setup
• Maintainable
• Full state migration
Icinga2 Configuration
9
• Puppet modules
• https://github.com/Icinga/puppet-icinga2
• https://github.com/Icinga/puppet-icingaweb2
• Icinga2 server: sys11icinga2 module
• All clients: sys11monitoring module
• Settings: Hiera (Puppet)
Icinga2 Configuration
10
Other Puppet Modules
11
Hiera - Override Defaults
12
Hiera - HTTP-Check
13
Hiera - NRPE-Check
14
Host
15
Apply Services
16
NRPE?
19
Migrating is harder
than building from scratch!
20
icinga2-migration-utils
21
• Compare running Icinga1 and Icinga2 instances
• Migrate acknowledgements, downtimes and comments
• MIT license
https://github.com/syseleven/icinga2-migration-utils
22
23
24
25
26
Tips After One Year
27
• Build a stage setup
• Automate everything
• Track all related issues
• Build a stage setup
Is it perfect?
28
Talk about your Setups!
29
Thanks for listening!
E-Mail: m.rosin@syseleven.de
Twitter: @ekeih - GitHub: ekeih
Questions?