ClusterControl reduces complexity of managing your database infrastructure while adding support for new technologies; enabling you to truly automate multiple environments for next-level applications. This latest release further builds out the functionality of ClusterControl to allow you to manage and secure your 24/7, mission critical infrastructures.
In this webinar, Johan demonstrated how ClusterControl increases your efficiency by giving you a single interface to deploy and operate your databases, instead of searching for and cobbling together a combination of open source tools, utilities and scripts that need constant updates and maintenance. Watch as ClusterControl demystifies the complexity associated with database high availability, load balancing, recovery and your other everyday struggles.
To put it simply: learn how to be a database hero with ClusterControl!
AGENDA
- ClusterControl (1.4) Overview
- ‘Always on Databases’ with enhanced MySQL Replication functions
- ‘Safer NoSQL’ with MongoDB and larger sharded cluster deployments
- ‘Enabling the DBA’ with ProxySQL, HAProxy and MaxScale
- Backing up your open source databases
- Live Demo
- Q&A
SPEAKER
Johan Andersson, CTO, Severalnines - Johan's technical background and interest are in high performance computing as demonstrated by the work he did on main-memory clustered databases at Ericsson as well as his research on parallel Java Virtual Machines at Trinity College Dublin in Ireland. Prior to co-founding Severalnines, Johan was Principal Consultant and lead of the MySQL Clustering & High Availability consulting group at MySQL / Sun Microsystems / Oracle, where he designed and implemented large-scale MySQL systems for key customers. Johan is a regular speaker at MySQL User Conferences as well as other high profile community gatherings with popular talks and tutorials around architecting and tuning MySQL Clusters.
6. Confidential
What’s new in 1.4.0?
¤ MySQL Replication
¤ ProxySQL Support
¤ Group Replication (BETA)
¤ MongoDB
¤ ..and a number of other things
6
Copyright 2012 Severalnines AB
7. Confidential
MySQL Replication
¤ Create Master – Slave,
Multi-Master setups
¤ Automatic and Manual
Failover
¤ Rebuild failed replication
slaves
¤ Reconfiguration of the
topology.
Copyright 2012 Severalnines AB
7
M1
S1 S2
8. Confidential
MySQL Replication - Deploy
Copyright 2012 Severalnines AB
8
Data Center 1 Data Center 2
M1 M2
S1 S2
• M1 is the active master
and WRITABLE
• S1 and S2 are
read only slaves
• M2 is a stand by in case
DC1 fails hard. Read only.
9. Confidential
ClusterControl - Tips
¤ Manual operations (outside ClusterControl): Disable
Node/Cluster Recovery, Enter Maintenance Mode.
¤ Now you can do manual changes
¤ ClusterControl manages the Cluster (e.g read-only
settings)
¤ If you want to manage the read-only settings
then set ‘auto_manage_readonly=0’
in /etc/cmon.d/cmon_x.cnf and restart cmon.
9
Copyright 2012 Severalnines AB
10. Confidential
MySQL Replication - Failover
¤ Failover is automatic or manual
¤ Control with “Enable Cluster Recovery”
¤ On = Automatic
¤ Off = Manual
¤ One attempt to failover is made
¤ Checks for errant transactions
¤ Aborts failover if detected
¤ Elects a new master among the slave(s)
¤ Elect the slave with the least lag,
least problems, and most data.
¤ If no slave found, then failover will not happen.
Copyright 2012 Severalnines AB
10
M1
S1 S2
11. Confidential
MySQL Replication – Failover – More
Control!
¤ Fine tune the failover behavior:
¤ replication_stop_on_error = 1 (default)
Ignore errors like errant transactions and force the failover
¤ replication_failover_blacklist=<comma separated list of nodes>
Comma separated list of hostname:port pairs. Blacklisted servers will not
be considered as a candidate during failover. Ignored if
replication_failover_whitelist is set.
¤ replication_failover_whitelist=<comma separated list of nodes>
Comma separated list of hostname:port pairs. Only whitelisted servers will
be considered as a candidate during failover. Takes precedence over
replication_failover_blacklist.
¤ replication_failover_wait_to_apply_timeout=-1 (Default), candidate will
wait forever to try and apply outstanding transactions from another slave
and relay log in case of failover. 0 means failover immediately, else specify
a time limit in seconds.
¤ These options are set in /etc/cmon.d/cmon_x.cnf. Restart cmon.
Copyright 2012 Severalnines AB
11
12. Confidential
MySQL Replication – Rebuild Slave
Copyright 2012 Severalnines AB
12
Data Center 1
M1
S1 S2
• If a slave gets corrupted
then it can be rebuilt by a user command
• An xtrabackup is taken from the selected
server and streamed to the slave
• The backup is applied on the slave
• Replication is started (CHANGE MASTER,
START SLAVE)
13. Confidential
MySQL Replication – Topology
Change
Copyright 2012 Severalnines AB
13
Data Center 1
M1
S1 S2
Data Center 1
M1
S1
S2
14. Confidential
MySQL Replication – Topology
Change (Switchover)
Copyright 2012 Severalnines AB
14
Data Center 1
M1
S1 S2
Data Center 1
S2
S1 M1
15. Confidential
ProxySQL Support
¤ ProxySQL is a highly
customizable, high
performing load balancer
for MySQL supporting MySQL
Replication, Galera, Group
Replication
¤ Integrates with
ClusterControl-triggered
failover of MySQL
Replication
¤ Deployment
¤ Monitoring (phase 1)
Copyright 2012 Severalnines AB
15
17. Confidential
Group Replication (BETA)
¤ Create a Group Replication
Cluster
¤ Similar to Galera with a
slight difference:
¤ One writable master, the
rest are
super_read_only=true and
read_only = true
¤ Add replication slaves
¤ Experimental support for
¤ Rebuilding failed group
replication servers
¤ Automatic failure
handling
Copyright 2012 Severalnines AB
17
Data Center 1
M1 S1 S2
Virtual synchronous (like Galera)
• M1 writable (read_only=false
super_read_only=false)
• S1 read_only=true super_read_only=true
• S2 read_only=true super_read_only=true
18. Confidential
MongoDB
¤ Deploy in an automated and secure
way
¤ Single node / Replica Set /Shard
¤ Scale
¤ Add nodes to the Replica Set
¤ Convert a Replica Set to a Sharded
Cluster
¤ Add / Remove Shards
¤ Add/ Remove Mongos/Routers to a
Sharded Cluster
¤ Additional features includes:
¤ Backup/Restore
¤ Step down or Freeze a node
¤ New Advisors
Copyright 2012 Severalnines AB
18
P
P – PRIMARY, Sx = SECONDARY
P
S1 S2
19. Confidential
MongoDB - Convert a Replica Set to
a Sharded Cluster
Copyright 2012 Severalnines AB
19
P
S1 S2
P – PRIMARY, Sx = SECONDARY
P
S1 S2
Config Servers
Mongos/Routers
…
20. Confidential
MongoDB – Scale With Shards
Copyright 2012 Severalnines AB
20
P – PRIMARY, Sx = SECONDARY
P
S1 S2
Config Servers
Mongos/Routers
…
P
S1 S2
+
22. Confidential
MongoDb - Advisors
¤ Security
¤ Is Authentication enabled?
¤ Too Permissive passwords?
¤ Replication
¤ Is the Secondaries lagging?
¤ Connections
¤ Concurrency tickets
¤ # connections
¤ Sharding
¤ Are all collections sharded, and which ones are not?
Copyright 2012 Severalnines AB
22
23. Confidential
Other
¤ Backup
¤ New Improved UI
¤ New Operational Report:
¤ Packages upgrade report
¤ Get information if there are new database packages and other
security packages available (MySQL based clusters)
¤ Activity Viewer
¤ Send Clear notification when Cluster Fail/Node Fails have been
resolved.
¤ Maintenance Mode – Schedule maintenance.
¤ Silences alarm
¤ Best Practice: Disable Node/Cluster Recovery if you plan to make
manual changes.
23
Copyright 2012 Severalnines AB
25. Confidential
Getting Started
¤ Dedicated VM for the controller
¤ Specs
¤ 2 CPU cores
¤ 2-4GB RAM
¤ 20GB diskspace
¤ No agents
¤ Host stats gathered via SSH
¤ Installation
¤ YUM/APT
¤ Setup SSH access from the Controller to the DB nodes
¤ https://severalnines.com/download-clustercontrol-database-
management-system
25
Copyright Severalnines AB