Traditional server monitoring tools are not built for modern distributed database architectures. Let’s face it, most production databases today run in some kind of high availability setup - from simpler master-slave replication to multi-master clusters fronted by redundant load balancers. Operations teams deal with dozens, often hundreds of services that make up the database environment.
This is why we built ClusterControl - to address modern, highly distributed database setups based on replication or clustering. We wanted something that could provide a systems view of all the components of a distributed cluster, including load balancers.
Watch this replay of a webinar on free database monitoring using ClusterControl Community Edition. We show you how to monitor all your MySQL, MariaDB, PostgreSQL and MongoDB systems from a single point of control - whether they are deployed as Galera Clusters, sharded clusters or replication setups across on-prem and cloud data centers. We also see how to use Advisors in order to improve performance.
AGENDA
- Requirements for monitoring distributed database systems
- Cloud-based vs On-prem monitoring solutions
- Agent-based vs Agentless monitoring
- Deepdive into ClusterControl Community Edition
- Architecture
- Metrics Collection
- Trending
- Dashboards
- Queries
- Performance Advisors
- Other features available to Community users
SPEAKER
Bartlomiej Oles is a MySQL and Oracle DBA, with over 15 years experience in managing highly available production systems at IBM, Nordea Bank, Acxiom, Lufthansa, and other Fortune 500 companies. In the past five years, his focus has been on building and applying automation tools to manage multi-datacenter database environments.
Enjoy Night⚡Call Girls Dlf City Phase 3 Gurgaon >༒8448380779 Escort Service
Webinar slides: Free Monitoring (on Steroids) for MySQL, MariaDB, PostgreSQL and MongoDB
1. September 2018
Free monitoring for MySQL,
MariaDB, PostgreSQL and
MongoDB
Bartłomiej Oleś
Presenter
bart@severalnines.com
2. Copyright 2017 Severalnines AB
I'm Jean-Jérôme from the Severalnines Team and
I'm your host for today's webinar!
Feel free to ask any questions in the Questions
section of this application or via the Chat box.
You can also contact me directly via the chat box
or via email: info@severalnines.com during or
after the webinar.
Your host & some logistics
5. Copyright 2017 Severalnines AB
Free to download
Initial 30 days Enterprise trial
Converts into free Community Edition
Enterprise / paid versions available
9. Poll - Which of the following free monitoring tools
does your currently company use?
Copyright 2018 Severalnines AB
(choose many)
● Traditional (Nagios, Zabbix, ...)
● Saas based monitoring (MMS, ...)
● Specialized (PMM, MySQL OpsPack, ...)
● ClusterControl
● Other
10. Copyright 2017 Severalnines AB
Copyright 2018 Severalnines AB
Monitoring distributed database systems
- Requirements
11. Most databases are somehow distributed today
● Services running on multiple hosts
○ Replication
○ Sharding
○ Clustering
● Multiple Data Centers
○ Cloud and/or On-prem
○ Disaster Recovery
● Load balancing and Single point of contact IP
○ For workload management, HA, query caching...
○ E.g., HAProxy, KeepAlived/VIP, ProxySQL, MaxScale
12. Why we need a database monitoring system
● Data is a key asset of the organisation
● Databases are important as they manage the source of truth
● Database is complex - IO, transaction engine, query optimizer,
caches, locks, versioning,...
● Very dependent on OS, IO subsystems, network
● Distribution across multiple instances makes it even more complex
● Good database monitoring helps make sense of all that
13. A “good” monitoring system involves
● Collection, Correlation
● Presentation
● Interpretation/analysis
● Interactions between concurrently
executing processes
● Integration with other platforms
14. Who uses database monitoring
● Managers
○ To improve project implementation
○ Keep track on internal or external SLA’s
○ Track team performance
○ Budgeting
○ Monitor KPIs
● Business
○ To inform and improve future programmes and projects
○ Inform stakeholders
● DBA, DevOps, SysOps
○ Prevent and event
○ Query caching
○ DB Firewall
19. Comparing cloud-based vs on-prem
Cloud-based monitoring
● Benefits
○ Quick and easy configuration
○ Managing your solution over time
is also easier
○ Remote access from any location
or device with browsing
capabilities
● Drawbacks
○ Security
○ Reliability and stability
On-prem monitoring
● Benefits
○ A level of control that
cloud-based solutions just can't
provide
○ Performance reliability
○ Control over data, security
● Drawbacks
○ Installation and setup
○ Data access
23. Agentless vs Agent-based monitoring
Agentless Agent-based
Deployment
Software on ClusterControl host
only. Up and running within minutes
Agent installed on each monitored DB server
Admin. Overhead.
Only CC needs to be maintained Agents need to be maintained, updated, restarted in case of
failures
Configuration
Centralized Decentralized
Security
Controller to SSH into managed DBs,
requires certain privileges.
More secure. Agent communication to DB/OS is internal to
the server. No additional firewall rules.
Network Overhead
Additional traffic with more connections Local data collection, results processed and then shipped
to the server
Metrics resolution
High resolution at the cost of many
connections
High resolution, a lot of data can be collected locally by the
agent. No gaps in data if the network connection fails.
24. Copyright 2017 Severalnines AB
Copyright 2018 Severalnines AB
Deepdive into
ClusterControl Community Edition
25. ClusterControl Requirements
Copyright 2018 Severalnines AB
● Installed on a single machine
○ 2GB of RAM, 2CPU and 20GB disk space
running on x86 architecture
● Can run on-prem or in the cloud
● Web-GUI or Command Line
● With or without agents
● Supported platforms:
○ RedHat/CentOS 6.x/7.x
○ Ubuntu 12.04/14.04/16.04 LTS
○ Debian 7.x/8.x
29. Metrics Collection
Copyright 2018 Severalnines AB
SSH Host metrics collection (process, load balancers stats, resource usage and consumption, etc.) using
SSH library
Database client Database metrics collection (status, queries, variables, usage etc) using the respective database client
library
Advisor Mini programs written using ClusterControl Domain Specific Language (DSL)
Agent based uses Prometheus exporters to capture metrics data from the system it monitors. Statistics are then
stored in the time series DB
30. Technology specific dashboards
Copyright 2018 Severalnines AB
● MySQL
○ standalone, MySQL Replication, NDB
Cluster, InnoDB Cluster/Group
Replication
● MariaDB
○ standalone, Replication, Galera Cluster
● Percona Server for MySQL
○ standalone, Percona XtraDB Cluster
● PostgreSQL
○ standalone, Streaming Replication
● MongoDB Inc.
○ standalone, ReplicaSet, Sharded Cluster
● Percona Server for MongoDB
○ standalone, ReplicaSet, Sharded Cluster
33. Other features available to Community
users
Copyright 2018 Severalnines AB
● Deployment
○ 15+ DB topologies
○ Standalone
○ Replication setups
○ Cluster setups
● ClusterControl CLI
● Topology view
35. Poll - TBD
Copyright 2018 Severalnines AB
Are you currently using ClusterControl for monitoring and management?
● Yes
● I’m going to download it
● Not convinced yet