Splice Machine is a hybrid relational database management system (RDBMS) that allows for both online transaction processing (OLTP) and online analytical processing (OLAP) without the need for separate systems. It provides ANSI SQL support and transactional consistency for massive amounts of data while offering 10x faster performance at 1/4 the cost of other systems. Splice Machine can be deployed on-premises or in the cloud as a fully managed database as a service using the DC/OS platform, which provides container orchestration using Mesos and Docker along with networking and storage integration using CNI and RexRay.

1. 1 Copyright © 2017 splice machine
Powering Hybrid Applications
John Leach and Daniel Gomez Ferro
06/12/2017

2. 2 Copyright © 2017 splice machine
What is Splice Machine?
HYBRID RDBMS
CONTINUOUS DECISIONS
No need for high-latency, error-prone
ETL processes
OLTP AND OLAP
No need to pay for multiple systems
(like RDS and Redshift)
10X FASTER AT ¼ COST
Unparalleled price/performance
ANSI SQL
INDUSTRY STANDARD SQL
Easily migrate your existing skills and
applications, including PL/SQL
ENSURE CONSISTENCY
Support massive amounts of data and
users with ACID transaction control
SMART OPTIMIZATION
Cost-based optimizer delivers
best-in-class performance for every
workload
APP-SERVICES
MACHINE LEARNING
Develop, test and deploy models,
without coding, integrating directly with
application data
STREAMING
Ingest fast data, streaming from IoT
devices and all other data sources
INTEGRATIONS
Collaborate using notebooks, and
analyze data using industry leading
visualization tools
ELASTIC CLOUD
REDUCE MANAGEMENT
Deploy faster, perform better, reduce
risks, focus on your business needs
FRACTION OF THE COST
Provision only the capacity your
applications need
SCALE-AS-YOU-GROW
From Startup to Fortune 500, this
architecture supports your growth

3. 3 Copyright © 2017 splice machine
Splice Database As A Service Key Features
• Self Provisioning clusters of varying size and capabilities.

4. 4 Copyright © 2017 splice machine
Splice Database As A Service Key Features
• Once created, elastic with monitoring

5. 5 Copyright © 2017 splice machine
Splice Database As A Service Key Features
• SQL Based Notebooks

6. 6 Copyright © 2017 splice machine
Splice Database As A Service Key Features
• PL/SQL Notebooks

7. 7 Copyright © 2017 splice machine
Splice Database As A Service Key Features
• Streaming Integration with Spark Streaming and Kafka/Kinesis

8. 8 Copyright © 2017 splice machine
Splice Database As A Service Key Features
• Spark Based Notebooks with Spark SQL and Native Splice Machine Data Source

9. 9 Copyright © 2017 splice machine
Splice Database As A Service Key Features
• R Based Notebooks

10. 10 Copyright © 2017 splice machine
Splice Database As A Service Key Features
• Support Operational (Ex. UNICA) and AI Applications

11. 11 Copyright © 2017 splice machine
How do we build a service framework for Cloud and On Premise?
• Key Questions
• How do we build a service that can be deployed on premise and in the cloud
without building different frameworks for each?
• How can we isolate resources while efficiently using resources?
• Can we take advantage of different external storage capabilities on a per
container basis?
• How can we use external storage to decrease the overall cost?
• How can we elastically scale instances of Splice Machine and the underlying
infrastructure in a multi-tenant environment?
• How do we provide network isolation in a multi-tenant environment?
• How do we monitor what resources are used by whom and when?

12. 12 Copyright © 2017 splice machine
Current Infrastructure Landscape

13. 13 Copyright © 2017 splice machine
DCOS: Enabling Infrastructure for Cloud and On-Premise
• Provides installs on major clouds and on premise.

14. 14 Copyright © 2017 splice machine
DCOS: Combination of Existing Tools and Platforms

15. 15 Copyright © 2017 splice machine
DC/OS Components
• Master Nodes
• Cluster Management
• Container Orchestration
• DNS Networking
• Package Management
• Agent Nodes
• Rex-Ray
• Container Runtimes (Docker,Mesos)
• User Tasks
• All Nodes
• Calico Mesh
• Networking
• Package Management

16. 16 Copyright © 2017 splice machine
DCOS Commons: Software Development Kit
• Software Development Kit for Infrastructure
• YAML and Java -> Mesos Protocol Buffer
• Dynamic Endpoints for Hadoop
Configuration Changes (Mustache)

17. 17 Copyright © 2017 splice machine
Deploy Infrastructure: Deployment Plan in DCOS SDK

18. 18 Copyright © 2017 splice machine
Deploy Infrastructure: Deploy Scheduler Container

19. 19 Copyright © 2017 splice machine
Deploy Infrastructure: Deploy Zookeeper Containers

20. 20 Copyright © 2017 splice machine
Deploy Infrastructure: Deploy Journal Node Containers

21. 21 Copyright © 2017 splice machine
Deploy Infrastructure: Format Name Nodes

22. 22 Copyright © 2017 splice machine
Deploy Infrastructure: Deploy Name Node Containers

23. 23 Copyright © 2017 splice machine
Deploy Infrastructure: Deploy Data Node Containers

24. 24 Copyright © 2017 splice machine
Deploy Infrastructure: Deploy HMaster Containers

25. 25 Copyright © 2017 splice machine
Deploy Infrastructure: Deploy HRegion Containers

26. 26 Copyright © 2017 splice machine
Deploy Infrastructure: Deploy Zeppelin, PL/SQL, Kafka Containers

27. 27 Copyright © 2017 splice machine
Rexray: Storage Management for Container Runtimes
• Dynamic Allocation of External Storage
• Simple configuration to enable complex external storage choices.
• Container - > External Storage (wow!)

28. 28 Copyright © 2017 splice machine
Rexray in Action: Splice Machine Service on AWS
• EBS Volume Sizes/Specs different per application (Zookeeper, Data Node)

29. 29 Copyright © 2017 splice machine
Container Network Interface (CNI): Calico
• Node to Node Mesh
• Allows IP Per Container
• Tagged with Labels
• Integrated with Mesos-DNS
• Allows Application of Security Policies via
Labels
• Supports Ingress/Egress rules

30. 30 Copyright © 2017 splice machine
Calico Networking: Complex Topologies
• Example Simple Topology
• Each Line is a Connection between Containers (Scary)

31. 31 Copyright © 2017 splice machine
Spark on Mesos with Container Networking (CNI)
• Patched version of Spark
• Utilizes Mesos as Scheduler
• Interacts with Mesos not DCOS

32. 32 Copyright © 2017 splice machine
SQL Coverage

33. 33 Copyright © 2017 splice machine
THANK YOU – QUESTIONS?
John Leach - jleach@splicemachine.com
General Questions - info@splicemachine.com