Oss Summit - dropbox cloud native

1. © 2017 Mesosphere, Inc. All Rights Reserved. 1
Doing “DropBox” the
Cloud Native Way
@__krishnan @joerg_schad @dcos @Minio

2. © 2015 Mesosphere, Inc. All Rights Reserved. 2
Krishnan Parthasarathi
Distributed Systems Engineer
@__krishnan
Jörg Schad
Distributed Systems Engineer
@joerg_schad

3. © 2015 Mesosphere, Inc. All Rights Reserved. 3
In the beginning
there was a big
Monolith

4. © 2015 Mesosphere, Inc. All Rights Reserved.
Hardware
Operating System
Application
4
COMPUTERS

5. © 2015 Mesosphere, Inc. All Rights Reserved.
noun | ˈmīkrō/ /ˈsərvəs/ :
an approach to application development in which a
large application is built as a suite of modular services.
Each module supports a specific business goal and
uses a simple, well-defined interface to communicate
with other modules.*
Microservices are designed to be flexible, resilient,
efficient, robust, and individually scalable.
*From whatis.com
OVERVIEW

6. LEGACY STACK (LAMP)
Linux
Apache
MySQL
PHP
MODERN STACK
(Linux)
Container Runtime
Container Orchestration
Persistence
(Redis / ElasticSearch / Object Storage / etc)
6

7. © Gerard Julien/AFP
Run everything in containers!

8. STATELESS CONTAINERS
Application logic
Immutable (no state)
Think “functional” programming or SSA
Scalable instances:
single → thousands → millions
STATEFUL CONTAINERS
Use mix of technologies
depending on needs
8
PARADIGM: MANY STATELESS + FEW STATEFUL

9. © 2017 Mesosphere, Inc. All Rights Reserved.
ServiceApp ServiceServiceAppApp
OS
9
CONTAINER
S
- Rapid deployment
- Dependency
vendoring
- Container image
repositories
- Spreadsheet
scheduling
OS OS
Machine
Infrastructure
Machine Machine
Container Runtime Container Runtime Container Runtime
ServiceService ServiceServiceServiceService

10. © 2017 Mesosphere, Inc. All Rights Reserved. 10
CONTAINER
SCHEDULING
RESOURCE
MANAGEMENT
SERVICE
MANAGEMENT
- Load Balancing
- Readiness Checking
CONTAINER ORCHESTRATION

11. © 2017 Mesosphere, Inc. All Rights Reserved. 11
CONTAINER
SCHEDULING
- Placement
- Replication/Scaling
- Resurrection
- Rescheduling
- Rolling Deployment
- Upgrades
- Downgrades
- Collocation
RESOURCE
MANAGEMENT
- Memory
- CPU
- GPU
- Volumes
- Ports
- IPs
- Images/Artifacts
SERVICE
MANAGEMENT
- Labels
- Groups/Namespaces
- Dependencies
- Load Balancing
- Readiness Checking
CONTAINER ORCHESTRATION

12. © 2017 Mesosphere, Inc. All Rights Reserved.
Orchestration
12
Machine Infrastructure
Web Apps & Services
Scheduling
Resource Management
Container Runtime
Machine & OS
Service Management
CONTAINER
ORCHESTRA
TION
Machine & OS Machine & OS
Container Runtime Container Runtime

13. MINIO
Provision object storage as
containers
Infrastructure
Services
Orchestration Docker Swarm
13

14. © 2015 Mesosphere, Inc. All Rights Reserved. 14
Persistence

15. etc..
DIFFERENT KINDS OF STATE / DATA
15
SQL
AMQP Kafka
MESSAGES
TEXTJSONLARGE BLOBS KV DATA
Consul etcd
CONFIG DATA

16. USE OBJECT STORAGE FOR UNSTRUCTURED DATA/BLOBS
EXAMPLES:
16

17. MINIO SERVER MINIO CLIENT MINIO SDK
17
MINIO

18. 1 BINARY / 3 FLAVORS
FS backend
$ minio server /dir
XL backend with Erasure code & bitrot protection
$ minio server /disk1 /disk2 /disk3 /disk4 ... /disk16
Distributed up to 16 servers
$ minio server host1:/disk host2:/disk host3:/disk ... host16:/disk
18
MINIO

19. OBJECT ERASURE-CODED OVER 16 DRIVES
19

20. Minio 2 Minio 3 Minio 16
JBOD
Erasure Code (2x2, 4x4, 6x6, 8x8) - Maximum 16 Disks / Setup
JBODJBODJBOD
Minio 1
20

21. Minio constrained by design
Don’t worry about failed drives, designed to let things fail
16 disk/server: can stand up to 8 failed
Migrate data to new servers as servers age (think 5 years)
Deploy many Minio instances
Use KV store to keep track of Minio instance
Provision more instances as you grow
21

22. 22

23. © 2017 Mesosphere, Inc. All Rights Reserved. 23
NAIVE APPROACH
Typical Datacenter
siloed, over-provisioned servers,
low utilization
Industry Average
12-15% utilization
mySQL
microservice
Cassandra
Spark/Hadoop
Kafka

24. © 2017 Mesosphere, Inc. All Rights Reserved. 24

25. © 2017 Mesosphere, Inc. All Rights Reserved. 25
MULTIPLEXING OF DATA, SERVICES, USERS,
ENVIRONMENTS
Typical Datacenter
siloed, over-provisioned servers,
low utilization
Mesos/ DC/OS
automated schedulers, workload multiplexing onto the
same machines
mySQL
microservice
Cassandra
Spark/Hadoop
Kafka

26. © 2017 Mesosphere, Inc. All Rights Reserved.
• A top-level Apache project
• A cluster resource
negotiator
• Scalable to 10,000s of
nodes
• Fault-tolerant, battle-tested
• An SDK for distributed apps
• Native Docker support
26
Apache Mesos

27. © 2017 Mesosphere, Inc. All Rights Reserved.
Persistence
● Multiple storage requirements
for different apps & data
services
● Multiple storage technologies
and backends (SAN, NAS, DAS
Local Disk, NFS, iSCSI)
● Storage operations (Create,
Destroy, Mount, Unmount) not
traditionally automated
● Dynamically load the
appropriate driver/plug-ins
(Image source: DELL EMC {CODE} BLOG)

28. © 2017 Mesosphere, Inc. All Rights Reserved. 28

29. OSS Datacenter Operating System (DC/OS)
Distributed Systems Kernel (Mesos)
DC/OS ENABLES MODERN DISTRIBUTED APPS
Big Data + Analytics EnginesMicroservices (in containers)
Streaming
Batch
Machine Learning
Analytics
Functions &
Logic
Search
Time Series
SQL / NoSQL
Databases
Modern App Components
Any Infrastructure (Physical, Virtual, Cloud)
29

30. STATELESS STATEFUL
API Server
(golang)
Webserver
(node.js/angular)
(users)
(index)(blobs)
(text search)
30

31. © 2017 Mesosphere, Inc. All Rights Reserved. 31
Demo

32. © 2017 Mesosphere, Inc. All Rights Reserved. 32
Keep it running!

33. © 2017 Mesosphere, Inc. All Rights Reserved. 33
Operations
● Configuration Updates (ex: Scaling, re-configuration)
● Binary Upgrades
● Cluster Maintenance (ex: Backup, Restore, Restart)
● Monitor progress of operations
● Debugging any runtime blockages

34. © 2016 Mesosphere, Inc. All Rights Reserved. 34
Monitoring
- Collecting metrics
- Routing events
- Downstream processing
● Alerting
● Dashboards
● Storage (long-term retention)
Logging
- Scopes
- Local vs. Central
- Security considerations
DAY 2 OPERATIONS

35. © 2016 Mesosphere, Inc. All Rights Reserved. 35
Maintenance
- Cluster Upgrades
- Cluster Resizing
- Capacity Planning
- User & Package Management
- Networking Policies
- Auditing
- Backups & Disaster Recovery
Troubleshooting
- Debugging
● Services
● System
● Access?
- Tracing
- Chaos Engineering
DAY 2 OPERATIONS

36. © 2015 Mesosphere, Inc. All Rights Reserved. 36
/minio
slack.minio.io
@minio
@dcos
/dcos
/dcos/demos
chat.dcos.io
Questions?