Percona XtraBackup is a free, open source, complete online backup solution for all versions of Percona Server, MySQL® and MariaDB®. Percona XtraBackup provides: * Fast and reliable backups * Uninterrupted transaction processing during backups * Savings on disk space and network bandwidth with better compression * Automatic backup verification * Higher uptime due to faster restore time This talk will discuss the various different features of Percona XtraBackup, including: * Full & Incremental Backups * Compression, Streaming & Encryption of Backups * Backing Up To The Cloud (Swift). * Percona XtraDB Cluster / Galera Cluster. * Percona Server Specific features

1. Online Backups with
Percona Live Amsterdam - October 2016
1 / 42

2. Kenny Gryp
@gryp
MySQL Practice Manager
2 / 42

3. Agenda
What is Percona XtraBackup
Backup Process
Restore Process
Incremental
Compression, Streaming, Encryption
Cloud Backups - α
Percona Server Specific Features
3 / 42

4. 4 / 42
What is

5. What is
Backups for:
5 / 42

6. What is
Backups for:
6 / 42

7. Online (Non Blocking) InnoDB Backups
Physical Datafiles Copied
What is
https://www.percona.com/software/mysql-database/percona-xtrabackup
7 / 42

8. Online (Non Blocking) InnoDB Backups
Physical Datafiles Copied
Less Impact on Production
Faster Restore Time Than Logical Backups
What is
https://www.percona.com/software/mysql-database/percona-xtrabackup
8 / 42

9. Online (Non Blocking) InnoDB Backups
Physical Datafiles Copied
Less Impact on Production
Faster Restore Time Than Logical Backups
What is
https://www.percona.com/software/mysql-database/percona-xtrabackup
Open Source
Blocking Support MyISAM...
Incremental/Delta
Compression/Encryption
Cloud Backup
9 / 42

10. 10 / 42
(Data) Backup Process

11. (Data) Backup Process - 1. Backup
Backup .ibdfiles while in use
/var/lib/mysql/ibdata1
/var/lib/mysql/imdb/aka_name.ibd
/var/lib/mysql/imdb/aka_title.ibd
...
11 / 42

12. (Data) Backup Process - 1. Backup
Backup .ibdfiles while in use
/var/lib/mysql/ibdata1
/var/lib/mysql/imdb/aka_name.ibd
/var/lib/mysql/imdb/aka_title.ibd
...
track changes through trx logs
/var/lib/mysql/ib_log le0
/var/lib/mysql/ib_log le1
12 / 42

13. (Data) Backup Process - 2. Prepare
Apply changes from trx logs onto backupped .ibdfiles.
13 / 42

14. (Data) Backup Process - 1. Backup
#xtrabackup--backup--target-dir=/data/backups/
16100122:16:49ConnectingtoMySQLserverhost:localhost,user:root,password:not
Usingserverversion5.7.14-8-log
xtrabackupversion2.4.4basedonMySQLserver5.7.13Linux(x86_64)(revisionid
xtrabackup:usesposix_fadvise().
...
InnoDB:Numberofpools:1
16100122:16:49>>logscannedupto(5147619414)
xtrabackup:Generatingalistoftablespaces
InnoDB:AllocatedtablespaceID2formysql/plugin,oldmaximumwas0
16100122:16:50[01]Copying./ibdata1to/data/backups/ibdata1
16100122:16:50[01]Copying./mysql/plugin.ibdto/data/backups/mysql/plugin.ibd
16100122:16:50[01]Copying./mysql/servers.ibdto/data/backups/mysql/servers.ibd
16100122:16:50[01]Copying./mysql/help_topic.ibdto/data/backups/mysql/help_topic.i
...
16100122:17:13[01]Copying./imdb/users.ibdto/data/backups/imdb/users.ibd
16100122:17:13>>logscannedupto(5147619414)
16100122:17:14ExecutingFLUSHNO_WRITE_TO_BINLOGTABLES...
16100122:17:14ExecutingFLUSHTABLESWITHREADLOCK...
14 / 42

15. (Data) Backup Process - 1. Backup (2)
16100122:17:14Startingtobackupnon-InnoDBtablesand les
16100122:17:14[01]Copying./mysql/db.optto/data/backups/mysql/db.opt
16100122:17:14[01]Copying./mysql/db.frmto/data/backups/mysql/db.frm
16100122:17:14[01]Copying./mysql/db.MYIto/data/backups/mysql/db.MYI
16100122:17:14[01]Copying./mysql/db.MYDto/data/backups/mysql/db.MYD
16100122:17:17[01]Copying./imdb/users.frmto/data/backups/imdb/users.frm
16100122:17:17Finishedbackingupnon-InnoDBtablesand les
16100122:17:17ExecutingFLUSHNO_WRITE_TO_BINLOGENGINELOGS...
xtrabackup:Thelatestcheckpoint(forincremental):'5147619454'
xtrabackup:Stoppinglogcopyingthread.
.16100122:17:17>>logscannedupto(5147619463)
16100122:17:17ExecutingUNLOCKTABLES
16100122:17:17Alltablesunlocked
16100122:17:17[00]Copyingib_buffer_poolto/data/backups/ib_buffer_pool
16100122:17:17[00] ...done
16100122:17:17Backupcreatedindirectory'/data/backups/'
16100122:17:17[00]Writingbackup-my.cnf
16100122:17:17[00] ...done
16100122:17:17[00]Writingxtrabackup_info
16100122:17:17[00] ...done
xtrabackup:Transactionlogoflsn(5147619405)to(5147619463)wascopied.
16100122:17:18completedOK!
15 / 42

16. (Data) Backup Process - 2. Prepare (1)
#xtrabackup--prepare--target-dir=/data/backups/
xtrabackupversion2.4.4basedonMySQLserver5.7.13Linux(x86_64)(revisionid:df58
xtrabackup:cdto/data/backups
xtrabackup:Thistargetseemstobenotpreparedyet.
...
xtrabackup:StartingInnoDBinstanceforrecovery.
xtrabackup:Using104857600bytesforbufferpool(setby--use-memoryparameter)
...
InnoDB:Logscanprogressedpastthecheckpointlsn5147619405
InnoDB:Doingrecovery:scanneduptologsequencenumber5147619463(0%)
InnoDB:Doingrecovery:scanneduptologsequencenumber5147619463(0%)
InnoDB:Databasewasnotshutdownnormally!
InnoDB:Startingcrashrecovery.
InnoDB:xtrabackup:LastMySQLbinlog leposition333,
lenameperconaserver-bin.000007
...
InnoDB:96redorollbacksegment(s)found.1redorollbacksegment(s)areactive.
InnoDB:32non-redorollbacksegment(s)areactive.
InnoDB:Waitingforpurgetostart
InnoDB:5.7.13started;logsequencenumber5147619463
InnoDB:xtrabackup:LastMySQLbinlog leposition333, lenameperconaserver-bin.00
xtrabackup:startingshutdownwithinnodb_fast_shutdown=1
InnoDB:FTSoptimizethreadexiting.
InnoDB:Startingshutdown...
InnoDB:Shutdowncompleted;logsequencenumber5147619482
16 / 42

17. (Data) Backup Process - 2. Prepare (2)
...
InnoDB:Settinglog le./ib_log le101sizeto64MB
InnoDB:Settinglog le./ib_log le1sizeto64MB
InnoDB:Renaminglog le./ib_log le101to./ib_log le0
InnoDB:Newlog lescreated,LSN=5147619482
InnoDB:Highestsupported leformatisBarracuda.
InnoDB:Logscanprogressedpastthecheckpointlsn5147619852
InnoDB:Doingrecovery:scanneduptologsequencenumber5147619861(0%)
InnoDB:Doingrecovery:scanneduptologsequencenumber5147619861(0%)
InnoDB:Databasewasnotshutdownnormally!
InnoDB:Startingcrashrecovery.
InnoDB:xtrabackup:LastMySQLbinlog leposition333, lenameperconaserver-bin
...
InnoDB:96redorollbacksegment(s)found.1redorollbacksegment(s)areactive.
InnoDB:32non-redorollbacksegment(s)areactive.
InnoDB:Waitingforpurgetostart
InnoDB:5.7.13started;logsequencenumber5147619861
xtrabackup:startingshutdownwithinnodb_fast_shutdown=1
InnoDB:FTSoptimizethreadexiting.
InnoDB:Startingshutdown...
InnoDB:Shutdowncompleted;logsequencenumber5147619880
16100122:30:05completedOK!
17 / 42

18. 18 / 42
Restore Process

19. Restore Process
After preparation, the backup directory ==data directory
19 / 42

20. Restore Process
After preparation, the backup directory ==data directory
#cp-R/data/backup//var/lib/mysql
#chown-Rmysql:mysql/var/lib/mysql
#systemctlstartmysqld
20 / 42

21. 21 / 42
Incremental Backups

22. Incremental Backups
22 / 42

23. Incremental Backups
Only Copy InnoDB Pages That Changed
(still copies all non InnoDB Tables)
23 / 42

24. Pro:
Smaller backup size
Faster To Backup
Incremental & Delta
Incremental Backups
Only Copy InnoDB Pages That Changed
(still copies all non InnoDB Tables)
24 / 42

25. Pro:
Smaller backup size
Faster To Backup
Incremental & Delta
Con:
Slower to restore than full
On , all data is read
Incremental Backups
Only Copy InnoDB Pages That Changed
(still copies all non InnoDB Tables)
25 / 42

26. Incremental Backups - Process
26 / 42

27. Incremental Backups - Process
Take Incremental:
#xtrabackup--backup
--target-dir=/data/backups/inc/tuesday/
--incremental-basedir=/data/backups/full/sunday/
27 / 42

28. Incremental Backups - Process
Take Incremental:
#xtrabackup--backup
--target-dir=/data/backups/inc/tuesday/
--incremental-basedir=/data/backups/full/sunday/
Prepare Full
#xtrabackup--prepare
--apply-log-only
--target-dir=/data/backups/mysql/
28 / 42

29. Incremental Backups - Process
Take Incremental:
#xtrabackup--backup
--target-dir=/data/backups/inc/tuesday/
--incremental-basedir=/data/backups/full/sunday/
Prepare Full
#xtrabackup--prepare
--apply-log-only
--target-dir=/data/backups/mysql/
Apply Incremental
#xtrabackup--prepare--apply-log-only
--target-dir=/data/backups/full/sunday
--incremental-dir=/data/backups/inc/tuesday/
29 / 42

30. 30 / 42
Compression, Streaming, Encryption

31. Compression
Compress using qpress
#xtrabackup--backup--target-dir=/data/backups/
--compress--compress-threads=2
Decompress (before prepare)
#xtrabackup--decompress--target-dir=/data/backups/
31 / 42

32. Streaming
#xtrabackup--backup
--compress
--stream=xbstream> le.xb
32 / 42

33. Streaming
#xtrabackup--backup
--compress
--stream=xbstream> le.xb
Over Network
#xtrabackup--backup
--compress
--stream=xbstream./
|sshuser@otherhost"xbstream-x"
33 / 42

34. Encryption
# xtrabackup--backup--target-dir=/data/backups
--encrypt=AES256
--encrypt-key="GCHFLrDFVx6UAsRb88uLVbAVWbK+Yzfs"
--encrypt-threads=2
34 / 42

35. 35 / 42
Cloud Backups - α

36. Cloud Backups - α
Stream to Cloud directly
Swift
α
36 / 42

37. Cloud Backups - α
Put
#xtrabackup--backup--stream=xbstream--target-dir=/data/backups|
xbcloudput--storage=Swift
--swift-container=test--swift-user=test:tester
--swift-auth-url=http://192.168.8.80:8080/
--swift-key=testing
full_backup
37 / 42

38. Cloud Backups - α
Put
#xtrabackup--backup--stream=xbstream--target-dir=/data/backups|
xbcloudput--storage=Swift
--swift-container=test--swift-user=test:tester
--swift-auth-url=http://192.168.8.80:8080/
--swift-key=testing
full_backup
Get
#xbcloudget--storage=Swift
--swift-container=test--swift-user=test:tester
--swift-auth-url=http://192.168.8.80:8080/
--swift-key=testing
full_backup|xbstream-xv-C/tmp/downloaded_full
#xtrabackup--prepare--target-dir=/tmp/downloaded_full
#xtrabackup--copy-back--target-dir=/tmp/downloaded_full
38 / 42

39. 39 / 42
Features

40. Backup Locks
Implements LOCKTABLESFORBACKUPto
Avoid FLUSHTABLESWITHREADLOCK, used for:
Non-InnoDB Tables (mysqlschema... )
Binary Log Position
Blocks DML to non-InnoDB
Blocks DDL
Allows Reads/Writes to InnoDB tables during
40 / 42

41. Change Page Tracking - Incremental Backups
Incremental backup does no longer require reading all pages to determine if a page
changed since the last full backup
How:
Percona Server tracks pages changed in InnoDB Tablespaces
Incremental backup reads changed page file, only reads changed pages
Why:
Less load on database server (a lot less Disk IO)
41 / 42

42. Thank you !
Questions ?
42 / 42