Cloud Native talk about MySQL 8.0 and why you should use it. Also covering MySQL Database Service and HeatWave on OCI

1. 1 / 113

2. MySQL 8.0
Why to use 8.0 and How to use MDS on OCI
Frédéric Descamps
Community Manager
MySQL
January 2021
2 / 113

3. Safe Harbor Statement
The following is intended to outline our general product direction. It is intended for information purpose only, and
may not be incorporated into any contract. It is not a commitment to deliver any material, code, or functionality,
and should not be relied up in making purchasing decisions. The development, release, timing and pricing of any
features or functionality described for Oracle´s product may change and remains at the sole discretion of Oracle
Corporation.
Copyright @ 2021 Oracle and/or its affiliates.
3 / 113

4. about.me/lefred
Who am I ?
Copyright @ 2021 Oracle and/or its affiliates.
4 / 113

5. Frédéric Descamps
@lefred
MySQL Evangelist
Managing MySQL since 3.20
devops believer
living in Belgium
h ps://lefred.be
Copyright @ 2021 Oracle and/or its affiliates.
5 / 113

6. MySQL 8.0
Why ?
Copyright @ 2021 Oracle and/or its affiliates.
6 / 113

7. DB-Engines 2020
Database Ranking
Copyright @ 2021 Oracle and/or its affiliates.
7 / 113

8. DB-Engines 2020
Database Ranking
MySQL is the most popular Open Source database
Copyright @ 2021 Oracle and/or its affiliates.
8 / 113

9. MySQL Developer Popularity
Stack Overflow Developer Survey 2020
Copyright @ 2021 Oracle and/or its affiliates.
9 / 113

10. MySQL is the most popular database
with developers
MySQL Developer Popularity
Stack Overflow Developer Survey 2020
Copyright @ 2021 Oracle and/or its affiliates.
10 / 113

11. Happy 25th Anniversary MySQL
Copyright @ 2021 Oracle and/or its affiliates.
11 / 113

12. "This is a landmark release as MySQL
eventually evolved beyond SQL-92 and the
purely relational dogma. Among a few other
standard SQL features, MySQL now
supports window functions (over) and
common table expressions (with). Without a
doubt, these are the two most important
post-SQL-92 features.”
MySQL 8.0: one giant leap for SQL
Copyright @ 2021 Oracle and/or its affiliates.
12 / 113

13. and still innovating !
Credits: @MarkusWinand - @ModernSQL
Copyright @ 2021 Oracle and/or its affiliates.
13 / 113

14. MySQL 8.0 is ...
Many, many new features !
Copyright @ 2021 Oracle and/or its affiliates.
14 / 113

15. SQL DML
CTEs
Window Functions
LATERAL
...
SQL DDL
Instant ADD COLUMN
RESTART
SET PERSIST
CHECK constraints, ...
Indexes
invisible
descending
functional, ...
Functions
REGEXP_...
BIN_TO_UUID
GROUPING, ...
Many New Features
Copyright @ 2021 Oracle and/or its affiliates.
15 / 113

16. JSON
new functions JSON_...
in-place updates
faster sorting
JSON Array Indexes, ...
GIS
spacial reference systems
geographic R-trees
length units in ST_Distance
...
Character sets
UTF-8 (utf8mb4) as default
General Unicode 9.0
collations, ...
Information_schema
Views over Data Dictionary
...
More New Features
Copyright @ 2021 Oracle and/or its affiliates.
16 / 113

17. Performance_Schema
PFS Indexes
instrumnent server errors
statement latency histograms,
...
Optimizer
histograms
hash join
NOWAIT, ...
InnoDB
new redo log design
lock scheduler (CATS)
persistent auto_increments
CLONE plugin!!, ...
SHOW
list hidden columns
list index information
Even More New Features
Copyright @ 2021 Oracle and/or its affiliates.
17 / 113

18. Data Dictionary
transactional DD
atomic & crash safe DDL
automatic upgrade, ...
Error Logging
error logging in JSON
lters for error log
new --log-slow-extra, ...
Replication
MTS per channel lters
atomic DDL recovery binlog
binary log encryption at rest
server version in binlog, ...
Network
multiple bind addresses
new admin port, ...
Again More New Features
Copyright @ 2021 Oracle and/or its affiliates.
18 / 113

19. Group Replication
Online Primary Election
Online Mode Switch
Consistency Levels, ...
Security
SQL Roles
dual passwords
data masking (Enterprise)
SSL certi cates rollout
Router
extra routing strategy
reduced metadata-cache TTL
or push method
REST API, ...
Shell
upgrade checker
import JSON
UDR and Plugins, ...
And Finally More New Features
Copyright @ 2021 Oracle and/or its affiliates.
19 / 113

20. https://mysqlserverteam.com/the-complete-
list-of-new-features-in-mysql-8-0/
Copyright @ 2021 Oracle and/or its affiliates.
20 / 113

21. Not Only Features But Also Better Performance
!
Copyright @ 2021 Oracle and/or its affiliates.
21 / 113

22. What's new in MySQL 8.0
Overview of some hot topics !
Copyright @ 2021 Oracle and/or its affiliates.
22 / 113

23. What's new in MySQL 8.0
Overview of some hot topics !
Copyright @ 2021 Oracle and/or its affiliates.
23 / 113

24. NoSQL
Copyright @ 2021 Oracle and/or its affiliates.
24 / 113

25. * CREATE
* READ
* UPDATE
* DELETE
col->add({title: 'MySQL is Great', author: 'lefred' })
col-> nd()
collection.modify('author = "lefred"').set('author',
'kenny')
col.remove('author = "lefred"')
MySQL supports JSON & CRUD operations
Copyright @ 2021 Oracle and/or its affiliates.
25 / 113

26. * CREATE
* READ
* UPDATE
* DELETE
col->add({title: 'MySQL is Great', author: 'lefred' })
col-> nd()
collection.modify('author = "lefred"').set('author',
'kenny')
col.remove('author = "lefred"')
MySQL supports JSON & CRUD operations
It's possible to use MySQL without a single line
of SQL !
Copyright @ 2021 Oracle and/or its affiliates.
26 / 113

27. Migration from MongoDB to MySQL DS
For this example, I will use the well known restaurants collection:
Copyright @ 2021 Oracle and/or its affiliates.
27 / 113

28. Migration from MongoDB to MySQL DS
For this example, I will use the well known restaurants collection:
Copyright @ 2021 Oracle and/or its affiliates.
28 / 113

29. Let's make a query
Copyright @ 2021 Oracle and/or its affiliates.
29 / 113

30. Let's make a query
That's too much records to show in here... let's limit it
Copyright @ 2021 Oracle and/or its affiliates.
30 / 113

31. Copyright @ 2021 Oracle and/or its affiliates.
31 / 113

32. Some more examples
Copyright @ 2021 Oracle and/or its affiliates.
32 / 113

33. Let's add a selection criteria:
Copyright @ 2021 Oracle and/or its affiliates.
33 / 113

34. Simpler Syntax than other Document Store
Copyright @ 2021 Oracle and/or its affiliates.
34 / 113

35. Simpler Syntax than other Document Store
Copyright @ 2021 Oracle and/or its affiliates.
35 / 113

36. NoSQL + SQL =
MySQL
Copyright @ 2021 Oracle and/or its affiliates.
36 / 113

37. SQL
Copyright @ 2021 Oracle and/or its affiliates.
37 / 113

38. Credits: @MarkusWinand - @ModernSQL
SQL: RECURSION / CTEs
Copyright @ 2021 Oracle and/or its affiliates.
38 / 113

39. Credits: @MarkusWinand - @ModernSQL
SQL: LATERAL
Copyright @ 2021 Oracle and/or its affiliates.
39 / 113

40. Credits: @MarkusWinand - @ModernSQL
SQL: Analytical / Window Functions
Copyright @ 2021 Oracle and/or its affiliates.
40 / 113

41. Credits: @MarkusWinand - @ModernSQL
SQL: Analytical / Window Functions
Copyright @ 2021 Oracle and/or its affiliates.
41 / 113

42. Credits: @MarkusWinand - @ModernSQL
SQL: JSON_TABLE
Copyright @ 2021 Oracle and/or its affiliates.
42 / 113

43. Credits: @MarkusWinand - @ModernSQL
SQL: JSON_TABLE
Copyright @ 2021 Oracle and/or its affiliates.
43 / 113

44. This function is described in SQL 2016,
chapter 6.27 and is also implemented in:
Oracle
SQL Server
DB2
SQL: JSON_VALUE NEW in 8.0.21
Copyright @ 2021 Oracle and/or its affiliates.
44 / 113

45. List the best restaurant of each type of
food and show the top 10, with the best
one first !
Copyright @ 2021 Oracle and/or its affiliates.
45 / 113

46. And all together !
Copyright @ 2021 Oracle and/or its affiliates.
46 / 113

47. And all together !
Copyright @ 2021 Oracle and/or its affiliates.
47 / 113

48. More Validation
Copyright @ 2021 Oracle and/or its affiliates.
48 / 113

49. CHECK CONSTRAINTS
Copyright @ 2021 Oracle and/or its affiliates.
49 / 113

50. JSON SCHEMA VALIDATION
Copyright @ 2021 Oracle and/or its affiliates.
50 / 113

51. JSON SCHEMA VALIDATION
Copyright @ 2021 Oracle and/or its affiliates.
51 / 113

52. JSON SCHEMA VALIDATION
And the best of both worlds:
Copyright @ 2021 Oracle and/or its affiliates.
52 / 113

53. JSON SCHEMA VALIDATION
And the best of both worlds:
Copyright @ 2021 Oracle and/or its affiliates.
53 / 113

54. JSON SCHEMA VALIDATION
And the best of both worlds:
Copyright @ 2021 Oracle and/or its affiliates.
54 / 113

55. JSON Array
Indexes
Copyright @ 2021 Oracle and/or its affiliates.
55 / 113

56. Index of a JSON array
A functional index over a JSON
expression
The expression evaluates to an array
Several index entries per row
One index entry per array element
General mechanism, currently used
for JSON arrays
Used to speed up array lookups
JSON_CONTAINS(...)
JSON_OVERLAPS(...)
MEMBER OF (...)
JSON Array Indexes
Copyright @ 2021 Oracle and/or its affiliates.
56 / 113

57. JSON Array Indexes
Copyright @ 2021 Oracle and/or its affiliates.
57 / 113

58. JSON Array Indexes
Copyright @ 2021 Oracle and/or its affiliates.
58 / 113

59. JSON Array Indexes
Copyright @ 2021 Oracle and/or its affiliates.
59 / 113

60. MySQL refactoring
Copyright @ 2021 Oracle and/or its affiliates.
60 / 113

61. Modular
Easy to Extend
Each iterator encapsulates one operation
Same interface for all iterators
All operations can be connected
MySQL New Iterator Executor
Copyright @ 2021 Oracle and/or its affiliates.
61 / 113

62. Modular
Easy to Extend
Each iterator encapsulates one operation
Same interface for all iterators
All operations can be connected
MySQL New Iterator Executor
Copyright @ 2021 Oracle and/or its affiliates.
62 / 113

63. EXPLAIN FORMAT=TREE
Copyright @ 2021 Oracle and/or its affiliates.
63 / 113

64. EXPLAIN ANALYZE
Instruments and executes the query
Estimated cost
Actual execution statistics
Time to return rst row
Time to return all rows
Number of rows returned
Number of loops
Uses the new tree output format also available in EXPLAIN
Copyright @ 2021 Oracle and/or its affiliates.
64 / 113

65. EXPLAIN ANALYZE
Copyright @ 2021 Oracle and/or its affiliates.
65 / 113

66. EXPLAIN ANALYZE
Copyright @ 2021 Oracle and/or its affiliates.
66 / 113

67. EXPLAIN ANALYZE
Copyright @ 2021 Oracle and/or its affiliates.
67 / 113

68. EXPLAIN ANALYZE
Copyright @ 2021 Oracle and/or its affiliates.
68 / 113

69. EXPLAIN ANALYZE
Copyright @ 2021 Oracle and/or its affiliates.
69 / 113

70. Hash Join
Typically faster than nested loop for large result sets
In-memory if possible
Spill to disk if necessary
Used in all types of joins (inner, equi, outer, semi, anti)
Replaces BNL in query plan
More Info: h ps://slideshare.net/NorvaldRyeng/mysql-8018-latest-updates-hash-join-
and-explain-analyze
Copyright @ 2021 Oracle and/or its affiliates.
70 / 113

71. Hash Join: performance
Copyright @ 2021 Oracle and/or its affiliates.
71 / 113

72. Performance &
Scability
Copyright @ 2021 Oracle and/or its affiliates.
72 / 113

73. Redo logging can now be enabled and disable
Very useful during initial data load !
mysql> ALTER INSTANCE DISABLE INNODB REDO_LOG;
Copyright @ 2021 Oracle and/or its affiliates.
73 / 113

74. MySQL 8.0: Sysbench IO-bound OLTP_RW,
8 tables, 50M rows each
New Double Write Buffer 15x Faster !!
Copyright @ 2021 Oracle and/or its affiliates.
74 / 113

75. New Binlog Compression !
Credits: @JWKrogh -
h ps://mysql.wisborg.dk/2020/05/07/mysql-compressed-binary-logs/
Copyright @ 2021 Oracle and/or its affiliates.
75 / 113

76. New Binlog Compression !
Credits: @JWKrogh -
h ps://mysql.wisborg.dk/2020/05/07/mysql-compressed-binary-logs/
Copyright @ 2021 Oracle and/or its affiliates.
76 / 113

77. and of course MySQL Clone
Copyright @ 2021 Oracle and/or its affiliates.
77 / 113

78. Usability
Copyright @ 2021 Oracle and/or its affiliates.
78 / 113

79. Error log available in performance_schema !
Copyright @ 2021 Oracle and/or its affiliates.
79 / 113

80. Error log available in performance_schema !
Copyright @ 2021 Oracle and/or its affiliates.
80 / 113

81. Which supports Group Replication since
MySQL 8.0.23
SOURCE_CONNECTION_AUTO_FAILOVER
With MySQL 8.0.22 there is new asynchronous connection failover mechanism to
automatically establish an asynchronous (source to replica) replication connection to a new
source after the existing connection from a replica to its source fails.
Copyright @ 2021 Oracle and/or its affiliates.
81 / 113

82. Database
Architectures
Solutions Easy to Deploy
Copyright @ 2021 Oracle and/or its affiliates.
82 / 113

83. MySQL InnoDB Cluster
"A single product — MySQL — with high availability and scaling features baked in;
providing an integrated end-to-end solution that is easy to use."
Copyright @ 2021 Oracle and/or its affiliates.
83 / 113

84. MySQL InnoDB Cluster
"A single product — MySQL — with high availability and scaling features baked in;
providing an integrated end-to-end solution that is easy to use."
Copyright @ 2021 Oracle and/or its affiliates.
84 / 113

85. High Available Distributed MySQL DB
Fault tolerance
Automatic failover
Active/Active update anywhere (limits apply)
Automatic membership management
Adding/removing members
Network partitions, failures
Con ict detection and resolution
Prevents data loss
GPL
MySQL InnoDB Cluster
"A single product — MySQL — with high availability and scaling features baked in;
providing an integrated end-to-end solution that is easy to use."
Copyright @ 2021 Oracle and/or its affiliates.
85 / 113

86. Introducing MySQL InnoDB ReplicaSet!
8.0.19 Feature!
Fully integrated MySQL Router
Automatic Routing
Ease of use with MySQL Shell
Con guring, Adding, Removing members
Automatic Member Provisioning (CLONE)
MySQL InnoDB Replicaset
Copyright @ 2021 Oracle and/or its affiliates.
86 / 113

87. Replication Architecture:
(manual) Switchover & Failover
(asynchronous) Read Scaleout
'Simple' Replication architecture:
no network/hardware requirements
Providing Availability on PRIMARY when
issues with secondaries or network
MySQL InnoDB Replicaset
Copyright @ 2021 Oracle and/or its affiliates.
87 / 113

88. One Product: MySQL
All components developed together
Integration of all components
Full stack testing
MySQL InnoDB Cluster & ReplicaSet - Goals
Copyright @ 2021 Oracle and/or its affiliates.
88 / 113

89. One Product: MySQL
All components developed together
Integration of all components
Full stack testing
Easy to Use
One client: MySQL Shell
Integrated orchestration
Homogenous servers
MySQL InnoDB Cluster & ReplicaSet - Goals
Copyright @ 2021 Oracle and/or its affiliates.
89 / 113

90. One Product: MySQL
All components developed together
Integration of all components
Full stack testing
Easy to Use
One client: MySQL Shell
Integrated orchestration
Homogenous servers
MySQL InnoDB Cluster & ReplicaSet - Goals
Support DNS-SRV since 8.0.19 with our connectors
Copyright @ 2021 Oracle and/or its affiliates.
90 / 113

91. Solutions Easy to Deploy
Copyright @ 2021 Oracle and/or its affiliates.
91 / 113

92. MySQL InnoDB Cluster MySQL InnoDB ReplicaSet
js> c admin@mysql1
js> cluster = dba.createCluster('cluster')
js> c admin@mysql1
js> rs = dba.createReplicaSet('replicaset')
Solutions Easy to Deploy
Copyright @ 2021 Oracle and/or its affiliates.
92 / 113

93. MySQL InnoDB Cluster MySQL InnoDB ReplicaSet
js> c admin@mysql1
js> cluster = dba.createCluster('cluster')
js> c admin@mysql1
js> rs = dba.createReplicaSet('replicaset')
Con gure server to add later
js> dba.con gureInstance('admin@mysql2') js> dba.con gureReplicaSetInstance('admin@mysql2')
Solutions Easy to Deploy
Copyright @ 2021 Oracle and/or its affiliates.
93 / 113

94. MySQL InnoDB Cluster MySQL InnoDB ReplicaSet
js> c admin@mysql1
js> cluster = dba.createCluster('cluster')
js> c admin@mysql1
js> rs = dba.createReplicaSet('replicaset')
Con gure server to add later
js> dba.con gureInstance('admin@mysql2') js> dba.con gureReplicaSetInstance('admin@mysql2')
Add server to the Cluster
js> cluster.addInstance('admin@mysql2') js> rs.addInstance('admin@mysql2')
Solutions Easy to Deploy
Copyright @ 2021 Oracle and/or its affiliates.
94 / 113

95. MySQL InnoDB Cluster MySQL InnoDB ReplicaSet
js> c admin@mysql1
js> cluster = dba.createCluster('cluster')
js> c admin@mysql1
js> rs = dba.createReplicaSet('replicaset')
Con gure server to add later
js> dba.con gureInstance('admin@mysql2') js> dba.con gureReplicaSetInstance('admin@mysql2')
Add server to the Cluster
js> cluster.addInstance('admin@mysql2') js> rs.addInstance('admin@mysql2')
Bootstrap MySQL Router
$ sudo mysqlrouter --user=mysqlrouter --bootstrap
$ sudo systemctl start mysqlrouter
$ sudo mysqlrouter --user=mysqlrouter --bootstrap
$ sudo systemctl start mysqlrouter
Solutions Easy to Deploy
Copyright @ 2021 Oracle and/or its affiliates.
95 / 113

96. MySQL Database Architecture Summary
Single Region
Requirement Solution
RTO = hours, RPO = minutes MySQL Server w. Backups & Binary Log Sync
RTO = hours, RPO = less than a second MySQL Server w. Backups & Binary Log Stream
RTO = minutes, RPO = less than a second MySQL InnoDB ReplicaSet
RTO = seconds, RPO = 0 MySQL InnoDB Cluster
Multi Regions
Requirement Solution
RTO = minutes, RPO = seconds MySQL InnoDB Cluster w. asynchronous replica
RTO = seconds
and/or RPO = 0
Multi Region MySQL InnoDB Cluster w:
- 2 regions: consistency level AFTER
- 3 regions deployment
Copyright @ 2021 Oracle and/or its affiliates.
96 / 113

97. MySQL Database
Service
MDS in OCI
Copyright @ 2021 Oracle and/or its affiliates.
97 / 113

98. Various options but many questions
How to get the latest features, security xes?
How to provide security & regulatory compliance?
How to provide compatibility with on-premises?
How to integrate with Oracle technologies?
How to get expert MySQL technical support?
Only Oracle provides a MySQL Database Service
100% developed and managed by the MySQL team
100% built on MySQL Enterprise Edition
100% compatible with on-premises MySQL
100% compatible with Oracle technologies
100% supported by the MySQL Team
MySQL in the Cloud
Copyright @ 2021 Oracle and/or its affiliates.
98 / 113

99. MySQL Database Service
100% developed, managed, and supported by the MySQL team
Copyright @ 2021 Oracle and/or its affiliates.
99 / 113

100. MySQL Database Service
1 Year TCO
Copyright @ 2021 Oracle and/or its affiliates.
100 / 113

101. Cloud Regions
Situation as Jan 22nd 2021
Copyright @ 2021 Oracle and/or its affiliates.
101 / 113

102. MDS is integrated with other Oracle Services
End-to-end Integration from data ingestion to data visualization
Copyright @ 2021 Oracle and/or its affiliates.
102 / 113

103. HeatWave
MySQL Database Service Analytics
Engine
Copyright @ 2021 Oracle and/or its affiliates.
103 / 113

104. Comparing against Amazon Aurora
4TB
(*)Benchmark queries are derived from TPC-H benchmark, but results are not comparable to published TPC-H benchmark results since they do not comply with TPC-H speci cation.
Copyright @ 2021 Oracle and/or its affiliates.
104 / 113

105. Performance advantage increases with data size
(*)Benchmark queries are derived from TPC-H benchmark, but results are not comparable to published TPC-H benchmark results since they do not comply with TPC-H speci cation.
Copyright @ 2021 Oracle and/or its affiliates.
105 / 113

106. Comparing against Redshift's fastest shape
4TB
(*)Benchmark queries are derived from TPC-H benchmark, but results are not comparable to published TPC-H benchmark results since they do not comply with TPC-H speci cation.
Copyright @ 2021 Oracle and/or its affiliates.
106 / 113

107. Comparing against Redshift's low-cost shape
4TB
(*)Benchmark queries are derived from TPC-H benchmark, but results are not comparable to published TPC-H benchmark results since they do not comply with TPC-H speci cation.
Copyright @ 2021 Oracle and/or its affiliates.
107 / 113

108. Let's Try MDS !
Copyright @ 2021 Oracle and/or its affiliates.
108 / 113

109. OCI Resource Manager Stacks
You can nd several Terraform Stacks you can user in OCI on my GitHub Repository:
https://github.com/lefred
Copyright @ 2021 Oracle and/or its affiliates.
109 / 113

110. MySQL Database Service - links
h ps://docs.oracle.com/en/learn/wrdprs_mysqldbs/
h ps://docs.oracle.com/en/learn/drupal_mysqldbs/
h ps://lefred.be/?s=oci
h ps://lefred.be/my-mysql-youtube-channel/
Copyright @ 2021 Oracle and/or its affiliates.
110 / 113

111. MySQL Database Service - links (2)
h ps://www.slideshare.net/lefred.descamps/mysql-database-service-webinar-
installing-drupal-in-oci-with-mds
h ps://www.slideshare.net/lefred.descamps/mysql-database-service-webinar-
upgrading-from-onpremise-mysql-to-mds
h ps://www.slideshare.net/lefred.descamps/mysql-database-service-webinar-
installing-wordpress-in-oci-with-mds
h ps://www.slideshare.net/lefred.descamps/oracle-developer-live-deploying-mysql-
innodb-cluster-on-oci-with-terraform
Copyright @ 2021 Oracle and/or its affiliates.
111 / 113

112. MySQL Resources
h ps://mysqlserverteam.com/
h ps://mysqlhighavailability.com/
h ps://www.mysql.com/news-and-events/web-seminars/
h ps://videohub.oracle.com/channel/MySQL+Webinars+and+Videos/
h ps://planet.mysql.com
Copyright @ 2021 Oracle and/or its affiliates.
112 / 113

113. Questions ?
Copyright @ 2021 Oracle and/or its affiliates.
113 / 113