MySQL Document Store allows developers to work with SQL relational tables and schema-less JSON collections. To make that possible MySQL has created the X Dev API which puts a strong focus on CRUD by providing a fluent API allowing you to work with JSON documents in a natural way. The X Protocol is a highly extensible and is optimized for CRUD as well as SQL API operations.

1. Copyright © 2018, Oracle and/or its afliates. All rights reserved. |
MySQL Document StoreMySQL Document Store
Copyright © 2018, Oracle and/or its afliates. All rights reserved.
Olivier Dasini
MySQL Principal Solutons Architect EMEA
olivier.dasini@oracle.com
@freshdaz
A Document Store with all the benefts of a Transactonal RDBMSA Document Store with all the benefts of a Transactonal RDBMS

2. Copyright © 2018, Oracle and/or its afliates. All rights reserved. |
Safe Harbor Statement
The following is intended to outline our general product directon. It is intended for
informaton purposes only, and may not be incorporated into any contract. It is not a
commitment to deliver any material, code, or functonality, and should not be relied upon
in making purchasing decisions. The development, release, and tming of any features or
functonality described for Oracle’s products remains at the sole discreton of Oracle.
22

3. Copyright © 2018, Oracle and/or its afliates. All rights reserved. | 3
Me, Myself & I

MySQL Geek
 Addicted to MySQL for 15+ years!
 Playing with databases for 20+ years

MySQL Writer, Blogger and Speaker
 Also former : DBA, Consultant, Architect, Trainer, ...

MySQL Principal Solutons Architect EMEA at Oracle

Stay tuned! :
 Twiter: @freshdaz
 Blog: http:////dasini.net//blog
Olivier DASINI

4. Copyright © 2018, Oracle and/or its afliates. All rights reserved. | 4
Agenda
1
2
3
4
Introducton: SQL + NoSQL
MySQL Document Store Architecture
Live Demo using MySQL Shell
Conclusion

5. Copyright © 2018, Oracle and/or its afliates. All rights reserved. | 5
The world's most popular open source database

6. Copyright © 2018, Oracle and/or its afliates. All rights reserved. | 6
• Data Integrity
– Normalizaton
– Constraints (Foreign keys, …)
• Atomicity, Consistency, Isolaton, Durability
– ACID Compliant
– Transactons
• SQL
– Powerful Query Language
– Schema, Table, Row
– SELECT / UPDATE / DELETE / INSERT
Relatonal Databases
6

7. Copyright © 2018, Oracle and/or its afliates. All rights reserved. | 8
• An object that can represent structured data
• Structure is implicit in the document; usually no external/central schema
• Compact, popular and standardized
• Can be represented natvely in many languages (JavaScript,Python, etc.)
8
• JSON is a lightweight data-interchange format.
• It is easy for humans to read and write.
• It is easy for machines to parse and generate.
• It is based on a subset of the JavaScript Programming.
• Language, Standard ECMA-262 3rd Editon - December 1999.
• Use for storing and exchanging data.
What is a JSON Document ?
JavaScript Object Notaton

8. Copyright © 2018, Oracle and/or its afliates. All rights reserved. | 9
JSON Support
• Natve File Format
– Standardized as ECMA-404 (htp://json.org)
– Binary Storage
• Generated Columns
• 20+ Functons
 Search Functons
 Aggregatons Functons
• Query structured data and semi-structured JSON data

9. Copyright © 2018, Oracle and/or its afliates. All rights reserved. | 10
MySQL 5.7 and 8.0
JSON_ARRAY_APPEND()
JSON_ARRAY_INSERT()
JSON_ARRAY()
JSON_CONTAINS_PATH()
JSON_CONTAINS()
JSON_DEPTH()
JSON_EXTRACT()
JSON_INSERT()
JSON_KEYS()
JSON_LENGTH()
JSON_MERGE[_PRESERVE]()
JSON_OBJECT()
JSON_QUOTE()
JSON_REMOVE()
JSON_REPLACE()
JSON_SEARCH()
JSON_SET()
JSON_TYPE()
JSON_UNQUOTE()
JSON_VALID()
JSON_PRETTY()
JSON_STORAGE_SIZE()
JSON_STORAGE_FREE()
JSON_ARRAYAGG()
JSON_OBJECTAGG()
JSON_MERGE_PATCH()
JSON_TABLE()
https://mysqlserverteam.com/mysql-8-0-from-sql-tables-to-json-documents-and-back-again/
JSON Functons

10. Copyright © 2018, Oracle and/or its afliates. All rights reserved. | 11
• Schemaless
– No schema design, No normalizaton, No Foreign Keys, No data types, …
– Very quick inital development
• Flexible data structure
– Embedded arrays or objects
– Valid soluton when natural data can’t be medelized optmally into a relatonal model
– Objects persistence without the use of any ORM – Mapping Object-Oriented
• JSON
– Close to frontend
– Natve in JavaScript
– Easy to learn
NoSQL : Document Store
11

11. Copyright © 2018, Oracle and/or its afliates. All rights reserved. | 12
•Schema (Database)
•Collecton
– Group of JSON documents.
– Equivalent of table
•Document
– Set of key-value pairs in JSON
format
– Equivalent of row (tuple)
Document Store Databases
12
•CRUD (basic functons of persistent storage)
– CREATE
– READ
– UPDATE
– DELETE

12. Copyright © 2018, Oracle and/or its afliates. All rights reserved. | 13
Document Store
An easy, straight forward way to work with JSON documents in MySQL

13. Copyright © 2018, Oracle and/or its afliates. All rights reserved. | 14
RDBMS or NoSQL ?
Why not both ?

14. Copyright © 2018, Oracle and/or its afliates. All rights reserved. | 16
Document Store: Components
• MySQL X Plugin
• Introduces X Protocol for relatonal- and
document operatons
• Maps CRUD operatons to standard SQL
(relatonal tables, JSON datatype and
functons)
• X Protocol
• New MySQL client protocol based on top of
industry standard (Protobuf)
• Works for both, CRUD and SQL operatons
• InnoDB Cluster
• Read-Scaling, Write-Scaling, HA
• X DevAPI
• New, modern, async developer API for CRUD
and SQL operatons on top of X Protocol
• Introduces Collectons as new Schema obj.
• MySQL Shell
• Ofers interactve X DevAPI mode for app
prototyping
• MySQL Connectors
• Support for X DevAPI for
• JavaScript, Python, PHP, Java, C#, C++
16

15. Copyright © 2018, Oracle and/or its afliates. All rights reserved. | 17
Document Store: Architecture
17

16. Copyright © 2018, Oracle and/or its afliates. All rights reserved. | 18
Document Store
SQL is now optonal ! - Write applicatons using X DevAPIX DevAPI

17. Copyright © 2018, Oracle and/or its afliates. All rights reserved. | 19
Welcome to the X DevAPI!
MySQL X devAPI connector for:
• Java
– htps://insidemysql.com/connectorj-8-0-11-the-face-for-your-brand-new-document-oriented-database
• .NET
– htps://insidemysql.com/introducing-connectornet-with-full-support-for-mysql-8-0
• Node.JS
– htps://insidemysql.com/introducing-connectornode-js-for-mysql-8-0
• C++
– htps://insidemysql.com/what-is-new-in-connectorc-8-0
• Python
– htps://insidemysql.com/using-mysql-connectorpython-8-0-with-mysql-8-0
• PHP
– htps://insidemysql.com/introducing-the-mysqlx-php-extension-for-mysql-8-0
• ODBC
– htps://insidemysql.com/what-is-new-in-connectorodbc-8-0
https://insidemysql.com/mysql-8-0-welcome-to-the-devapi/
19
Motvaton
• We are doing something that has not been done before
• Document databases exist! Relatonal databases exist!
• We even see databases that support relatonal and document querying over the same data set
• However we have yet to see a relatonal database include a document model so that a user can use document objects alongside their
existng relatonal data.

18. Copyright © 2018, Oracle and/or its afliates. All rights reserved. | 20
Welcome to the X DevAPI! - Python Example
https://insidemysql.com/using-mysql-connector-python-8-0-with-mysql-8-0/
20
Writng a program using MySQL 8.0 Document Store
import mysqlx
session = mysqlx.get_session({
"host": "localhost",
"port": 33060,
"user": "my_user",
"password": "s0S3kR*T"
})
schema = session.get_schema("test")
collection = schema.get_collection("my_collection")
result = collection.find("name like :param").bind("param", "Olivier").limit(1).execute()
docs = result.fetch_all()
print("Name: {0}".format(docs[0]["name"]))
session.close()
Connector/Python 8.0 installaton
shell> pip install mysql-connector-python

19. Copyright © 2018, Oracle and/or its afliates. All rights reserved. | 21
Document Store
Live Demo

20. Copyright © 2018, Oracle and/or its afliates. All rights reserved. | 23
js> session.createSchema('demo')
js> use demo
js> db.getCollections()
js> db.createCollection('myCollection')
js> db.getCollections()
js> db.myCollection.add({"param1":"value1", "param2":"value2"})
js> db.myCollection.find()
js> db.myCollection.find().limit(1)
js> db.myCollection.find("_id = '00005af018430000000000000002'")
js> db.myCollection.modify("_id = '1234'").set("param","value")
js> db.myCollection.remove("_id = '1234'")
js> session.startTransaction()
js> …
js> session.rollback()
js> db.myCollection.createIndex("ageIdx",{fields:[{"field":"$.age","type":"INT",required:false}]})
Copyright @ 2018 Oracle and/or its affiliates. All rights reserved.
MySQL Document Store “cheat sheet”
CCreate
RRead
UUpdate
DDelete
Index
TTransacton

21. Copyright © 2018, Oracle and/or its afliates. All rights reserved. | 24
Document Store
Wrap-up

22. Copyright © 2018, Oracle and/or its afliates. All rights reserved. | 25
Document Store
✔ Built on Proven SQL/InnoDB/Replicaton technology
✔ Schema-less/Relatonal/Hybrid
✔ ACID/Transactons
✔ No SQL required - CRUD/JSON/Documents/Indexes
✔ Modern Dev API
✔ Modern/Efcient Protocol
✔ SQL Queries/Analytcs over JSON Documents
✔ Transparent and Easy HA/Scaling with MySQL InnoDB Cluster
25

23. Copyright © 2018, Oracle and/or its afliates. All rights reserved. | 26
Hybrid database that covers 4 core areas
Relatonal
MySQL Tables and SQL
Relatonal
MySQL Tables and SQL
Relatonal Analytcs
MySQL Tables and SQL
Relatonal Analytcs
MySQL Tables and SQL
Document Store
MySQL Collectons and
Table with JSON Datatytpe
Key//Value
MySQL Memcached
Document Store
MySQL Collectons and
Table with JSON Datatytpe
Key//Value
MySQL Memcached
Mass Scale Analytcs
Sharded MySQL
Relatonal and//or Document Store
Mass Scale Analytcs
Sharded MySQL
Relatonal and//or Document Store
Otperatonal Analytcal
Relatonal//SQL
NoSQL

24. Copyright © 2018, Oracle and/or its afliates. All rights reserved. | 27
Resources
Topic Link(s)
Top 10 reasons for NoSQL with MySQL htp://lefred.be/content/top-10-reasons-for-nosql-with-mysql/
MySQL as a Document Store htps://dev.mysql.com/doc/refman/8.0/en/document-store.html
MySQL Shell User Guide htps://dev.mysql.com/doc/mysql-shell-excerpt/8.0/en/index.html
MySQL Shell Documentaton htps://dev.mysql.com/doc/dev/mysqlsh-api-javascript/8.0/
htps://dev.mysql.com/doc/dev/mysqlsh-api-python/8.0/
X Dev API User Guide htps://dev.mysql.com/doc/x-devapi-userguide/en/
X Plugin htps://dev.mysql.com/doc/refman/8.0/en/x-plugin.html
MySQL Engineering Blog htps://insidemysql.com/mysql-8-0-welcome-to-the-devapi/
htps://insidemysql.com/mysql-document-store-crud-quick-start/
MySQL JSON Data Type htps://dev.mysql.com/doc/refman/8.0/en/json.html
Blogs htp://dasini.net/blog/2015/11/17/30-mins-avec-json-en-mysql/
htp://dasini.net/blog/2015/11/30/json-et-colonnes-generees-avec-mysql
htp://mysqlserverteam.com/tag/json/
htp://mysqlserverteam.com/category/docstore/

25. Copyright © 2018, Oracle and/or its afliates. All rights reserved. | 2828
Questons?

26. Copyright © 2018, Oracle and/or its afliates. All rights reserved. | 29
Thank you!