Kirk Marty, Enterprise Sales Engineer at Mesosphere introduction to Hyperscale Computing, Enterprise Agility at Lightbend's Chicago Reactive Roundtable. Learn more: lightbend.com/reactive-roundtable

1. © 2016 Mesosphere, Inc. All Rights Reserved.
HYPERSCALE COMPUTING,
ENTERPRISE AGILITY
Mesosphere Datacenter Operating System
V6

2. “We wanted people to be able to
program for the datacenter just like they
program for their laptop”
— Benjamin Hindman,
Apache Mesos PMC Chair

3. © 2016 Mesosphere, Inc. All Rights Reserved. 3
THE FUTURE IS
ALREADY HERE...
...IT’S JUST NOT
EVENLY DISTRIBUTED
- WILLIAM FORD GIBSON

4. © 2016 Mesosphere, Inc. All Rights Reserved. 4
HYPERSCALE COMPUTING FOR MAINSTREAM ENTERPRISES
Definitive Apps
Enabling Technology
Unit of
Management
NEW FORM FACTOR FOR
DEVELOPING AND RUNNING APPS
Datacenter Operating System (DC/OS)
MAINFRAME
Data Processing
RISC Processor
Partition (LPAR)
PHYSICAL (x86)
ERP, CRM
X86 HW & OS
Physical Server
VIRTUAL
Web Client / Server
Hypervisor
(Partitioning)
Logical Server (VM)
HYPERSCALE
Modern Distributed Apps:
Big Data, Web Scale, IoT
Datacenter Operating System
(Aggregation)
Logical Datacenter

5. © 2016 Mesosphere, Inc. All Rights Reserved.
MICROSERVICES ARCHITECTURE
Traditional Architecture
Small number of large processes
with strong inter-dependencies
Many functions
in a single process
Siloed
teams
RESTAPIs
Microservices Architecture
Cross-functional teams creating new
microservices without interdependencies
Cross-functional
teams organized
around capabilities
Scales
individually
Each element of
functionality defined as
“microservices”
Scales
monolithically
Hyperscale Computing Properties

6. © 2016 Mesosphere, Inc. All Rights Reserved.
NOT JUST CONTAINERS...
Private Copy
Shared
User Code
Libraries
Virtual Processor
Operating System
Physical Processor
Virtual Machines Containers
User Code
Libraries
Virtual Processor
Operating System
Physical Processor
Start time 30-45 seconds < 50 ms
Stop time 5-10 seconds < 50 ms
Workload density 10 - 100x1x
Hyperscale Computing Properties

7. © 2016 Mesosphere, Inc. All Rights Reserved.
CONTAINER ORCHESTRATION
Hyperscale Computing Properties
RESTAPIs
Dependencies Between Microservices Running Multiple Microservices-based Apps

8. © 2016 Mesosphere, Inc. All Rights Reserved.
BIG DATA BUILT-IN
Who is
next?
New capabilities to meet unprecedented expectations
Predictive user
interface
Product
recommendations
Real-time
ads
Hyperscale Computing Properties

9. © 2016 Mesosphere, Inc. All Rights Reserved.
Functions & Logic
Microservices
(in containers)
Big Data + Analytics Engines
Streaming
Batch
Machine Learning
Analytics
Search
Time Series
SQL / NoSQL
Databases
HYPERSCALE MEANS: MODERN APPLICATIONS

10. © 2016 Mesosphere, Inc. All Rights Reserved.
IMPLICATIONS OF HYPERSCALE
VIRTUAL HYPERSCALE
Workload
pooling
Deploying
apps
Business
continuity
Ensuring
performance
● Partition physical servers to run
multiple VMs
● Place some VMs in server pool
(e.g., DB, App Svr, Web Svr)
● Restart VMs in right order
● Increase VM size;
clear host of other VMs
● Aggregate a logical DC to run
multiple distributed systems
● Launch hundreds of microservices;
service discovery automation
● Scale distributed microservices
programmatically
● Ensure microservices are fault
tolerant and self-healing

11. © 2016 Mesosphere, Inc. All Rights Reserved. 11
DETAILED ENTERPRISE DC/OS FEATURES
DC/OS Mesosphere Enterprise DC/OS
Features
Open source platform for modern apps Production-grade solution for mission-critical apps
SupportPricing
Scalability No limits No limits No limits
Production proven
Extensible architecture
Validated, tested architecture with best practices
Integrated solution (with service discovery, monitoring, etc.)
Guided on-premise and cloud installer
Powerful CLI and GUI with integrated troubleshooting/monitoring
Distributed services app store
Task log truncation
Non-disruptive DCOS upgrades
Health monitoring of system components
Distributed DNS Server for service discovery HA
Persistent volumes and external volumes
Distributed load balancer
Orchestrated rolling service upgrades
Multi-user identity and authentication with RBAC
Identity management integration (Active Directory/LDAP)
Access logs and permission management UI
Emergency patching
Training and help Knowledge base Knowledge base Professional in-depth training
Support options Community Community Standard, Premium
List price Open source Open source
Standard: $2,000
Premium: $2,750
Apache Mesos
Battle proven distributed system kernel
Core
1.7
Engine Troubleshooting/monitoring

12. © 2016 Mesosphere, Inc. All Rights Reserved. 12
THE DATACENTER
OPERATING SYSTEM

13. © 2016 Mesosphere, Inc. All Rights Reserved.
Datacenter Operating System (DC/OS)
● Provides infrastructure primitives to modern distributed
apps
● Orchestrates distributed applications against available
core within the datacenter
(physical, virtual, or cloud-based)
DC/OS
...
Agent 1 Agent 2 Agent 3 Agent n
Server VM Cloud VM
...Microservices
FROM SERVER TO DATACENTER-SCALE
PC / Server Operating System
● Provides common services for applications
● Assigns application processes to available
cores within the server
OS (e.g., Windows, OSX)
...
Core 0 Core 1 Core 2 Core n
Server
Process

14. © 2016 Mesosphere, Inc. All Rights Reserved.
Datacenter Operating System (DC/OS)
MODERN APPS RUNNING ON DC/OS
Abstraction & Aggregation
Servers VMs Azure, AWS, or GCP
Single logical
datacenter
App Functions Big Data + Analytics Engines
Data Storage Message QueueBig Data Processing
... ... ...
... Two-level
scheduling
Container Orchestration
Stateless and Stateful Services
Operations & Service Quality Automation
Reactive, Self-Healing Infrastructure
Turnkey setup
& operations

15. © 2016 Mesosphere, Inc. All Rights Reserved.
MESOSPHERE DATACENTER OPERATING SYSTEM (DC/OS)
1. Production proven
2. Extensible architecture for all modern apps
3. Simplified operational model
4. Hybrid cloud
Key benefits

16. © 2016 Mesosphere, Inc. All Rights Reserved.
1. PRODUCTION PROVEN:
DC/OS KERNEL APPLIES LESSONS FROM EARLY INNOVATORS
Tupperware/BistroBorg/Omega Apache Mesos
ProprietaryProprietary Open Source (Apache License)
~2007~2001 2010+
Production-proven Web Scale Cluster Managers
● Built at UC Berkeley AMPLab by Ben Hindman (Mesosphere Co-founder)
● Built in collaboration with Google to overcome some Borg Challenges
● Production proven at scale +80K hosts @ Twitter

17. © 2016 Mesosphere, Inc. All Rights Reserved.
2. EXTENSIBLE ARCHITECTURE
DC/OS BUILT ON THE HIGHLY FLEXIBLE MESOS KERNEL
DC/OS kernel was designed to be flexible
● Aggregate all resources in the datacenter
for modern apps
● Intentionally simple to enable massive
scalability
● Handles different types of tasks - long
running, batch & real-time
● Two-level scheduler architecture enable
multiple scheduling logics
(a key challenge at Google)
● Extensible to work with new technologies
Downloads
Mesos daily downloads, July 2014 - November 2015
Gaining massive adoption

18. © 2016 Mesosphere, Inc. All Rights Reserved.
2. EXTENSIBLE ARCHITECTURE
DC/OS EXTENSIBILITY FAR BEYOND “COMPETITION”
Next Gen Application Support
Supported Infrastructure
On Premise
Public Cloud
Core Technology Mesos
(Production proven)
Swarm
(Under development)
Kubernetes
(Nascent)
Kubernetes
Redhat
OpenShift Cloud Foundry
Docker
Datacenter
Mesosphere
DC/OS
Big Data
(e.g., Hadoop, Spark, Storm)
Distributed Services
(e.g., Kafka, Cassandra)
Extensible Architecture
Cloud Foundry
(Production proven)
PaaS
Containers
(e.g., Docker, rKt)
Strong Capability
Some Capability
Not Supported
Kubernetes
(Nascent)
OpenShift
(Production proven)

19. © 2016 Mesosphere, Inc. All Rights Reserved.
3. SIMPLIFIED OPERATING MODEL
FOR DEVELOPERS AND OPERATORS
Developers:
Program against a single form factor
● Run PaaS, containers, and distributed
apps at will
● Simplified continuous integration &
deployment with existing dev toolchain
● Experiment with new technologies with
less risk
Operators
Run a single form factor
● Single commands against the datacenter to
install common frameworks, or scale them
up or down
● Pool distributed systems (frameworks) with
different resource usage patterns
● Zero planned downtime upgrades

20. © 2016 Mesosphere, Inc. All Rights Reserved.
4. HYBRID CLOUD
IS DC/OS FOR ON PREMISES OR CLOUD SERVICE? - YES
● Application portability
● Identical developer and operator experience
● Growing set of cloud services on DC/OS

21. © 2016 Mesosphere, Inc. All Rights Reserved. 21
MESOSPHERE
MILESTONES
& CUSTOMER
OUTCOMES

22. © 2016 Mesosphere, Inc. All Rights Reserved. 22
MESOSPHERE: BORN OF THE HYPERSCALE ERA
Mesosphere is well funded
$50M by Tier 1 investors:
Andreessen Horowitz & Khosla Ventures
2009 2013 2014 2015
First Mesosphere DC/OS lighthouse
customers
Tens of thousands of containers launched
Expanded Operations
San Francisco (2013)
Hamburg (2014)
New York (2015)
Mesosphere Founded
Key engineering leaders from Twitter,
Airbnb - companies behind open-source
tech
Apache Mesos built at UC Berkeley
● Core technology from AMPlab
● Corporate large-scale production deployments
begin (e.g., Apple, Twitter, Salesforce)
Growing Ecosystem & DC/OS
General Availability
Now a breeze to install modern app
services (e.g., Hadoop, Spark, Cassandra)

23. © 2016 Mesosphere, Inc. All Rights Reserved. 23
DELIVERING OUTCOMES FOR ENTERPRISES
MESOSPHERE DATACENTER OPERATING SYSTEM (DC/OS)
DEVELOPER
AGILITY
HYPERSCALE
OPERATIONS
DATA
AGILITY
Highly Efficient & Scalable IT
Distributed Framework Pooling
Container Orchestration
Cont. Integration/Delivery
Developer Cloud
Self-Service Container Runtime
Big Data
Internet Of Things
Reactive applications

24. © 2016 Mesosphere, Inc. All Rights Reserved. 24
● NYC-based Hedge Fund
● $25 Billion AUM
● Uses a variety of technological
methods for its trading strategies:
● Artificial Intelligence
● Machine Learning
● Distributed Systems
TWO SIGMA
CUSTOMER HIGHLIGHT
Challenges
● Two Sigma OPS struggled with developer demands for
agile real-time analysis
● Already explored various IaaS & PaaS solutions
Mesosphere Solution
● After successful consulting services engagement
determined Mesosphere was the right fit
● Compelling reason to move fast;
Agility/Performance/Scalability
● 100s of servers moving to 1000s in next 6 months
HYPERSCALE
OPERATIONS

25. © 2016 Mesosphere, Inc. All Rights Reserved. 25
MICROSOFT AZURE CONTAINER SERVICE (ACS)
CUSTOMER HIGHLIGHT
Challenges
● Needed a production grade native container service that
would work on premises and on azure, at massive scale
● Must easily integrate with Azure CI/CD, app management
and auto scaling infrastructure
● Microsoft and Linux friendly technology
Mesosphere Solution
● After independent evaluation, MS team determined
Mesos/Mesosphere was the right fit
● Currently integrating Mesosphere DC/OS as a core
technology for Azure Container Service
HYPERSCALE
OPERATIONS

26. © 2016 Mesosphere, Inc. All Rights Reserved. 26
LEADING NORTH AMERICAN BANK
CUSTOMER HIGHLIGHT
Challenges
● 400 developers submitting jobs to Jenkins for CI/CD
builds experienced sizable delays in task completion
due to Jenkins job queueing
Mesosphere Solution
● Customer wanted to replicate the eBay use case1
of
running CI builds for eBay's applications in Mesos with
Docker containers
● Mesosphere DC/OS allowed Customer to move from an
enterprise Continuous Integration solution to open source
as Marathon provides equivalent HA functionality
● One of North America's leading
diversified financial services
companies
● Provides banking, wealth
management, insurance and
capital markets services on a
global basis
DEVELOPER
AGILITY
1
www.ebaytechblog.com/2014/04/04/delivering-ebays-ci-solution-with-apache-mesos-part-i/

27. © 2016 Mesosphere, Inc. All Rights Reserved. 27
VERIZON
CUSTOMER HIGHLIGHT
Larry Rau from @Verizon with @flo Launching 50,000
containers in seconds with @mesosphere #DC/OS
DATA
AGILITY
Challenges
● Verizon needed infrastructure that could handle the
volume and speed of data that its users generate
across video services and mobile apps
● Verizon was seeking to improve automation,
scalability and efficiency when deploying applications,
services and big data infrastructure
Mesosphere Solution
● Mesosphere DC/OS allowed Verizon to quickly launch
new products and services while reducing the IT
requirements in their datacenters
● Chose Mesosphere DC/OS for hybrid cloud capabilities, to
move from AWS to Verizon’s private datacenter

28. © 2016 Mesosphere, Inc. All Rights Reserved. 28
RECENT PARTNERSHIP ANNOUNCEMENTS

29. © 2016 Mesosphere, Inc. All Rights Reserved. 29
MESOSPHERE DC/OS:
HYPERSCALE COMPUTING, ENTERPRISE AGILITY
Hybrid Infrastructure
(Compute, Storage, Networking)
Modern Apps
(Big Data built-in)
The Modern Cloud Stack
Containers & Microservices
Orchestration
Mesosphere DC/OS
(Mesos, Marathon, Datacenter Operations)
HYPERSCALE OPERATIONS
Continuous Integration &
Continuous Delivery
Common CI/CD Tools on Mesosphere DC/OS
(GitHub, Jenkins) DEVELOPER AGILITY
Analytics & Database
● Streaming, Pipelines, Search, ML
● Relational, NoSQL, Data Warehouses
Mesosphere Infinity
(Spark, Kafka, Cassandra, Akka) DATA AGILITY

30. © 2016 Mesosphere, Inc. All Rights Reserved. 30
APPENDIX

31. © 2016 Mesosphere, Inc. All Rights Reserved.
DC/OS FRAMEWORKS PROVIDE APPLICATION OPERATIONAL LOGIC AND
BEST PRACTICES
- Multi-tenancy with different versions
- Simple deployment & upgrade
i.e Cassandra, if a node fails, try to restart it on the same server nodes
to reduce rebuild time, if not possible, create a new node, but do not
allow more than one new node at a time for performance
i.e HDFS Journal and Name roles should be together on the same
physical server, while Data node should NOT be on the same physical
node
- Simplified Installation of all app components
- Advanced node and role placement
- Easily scale resources up and down
- Configuration update across the cluster
- Software upgrade including rolling upgrades with
checkpoints and recovery points
- Graceful Migration for Infrastructure Maintenance
- Health checks and advanced failure monitoring
- Application specific recovery logic
- Backup and restore
- Resiliency: uptime/data protection

32. © 2016 Mesosphere, Inc. All Rights Reserved.
DC/OS
32
Application Orchestration
Container Orchestration
Job Scheduling
Containerization
Resource Management
Provisioning
CloudFoundry, Heroku,
OpenShift
Kubernetes, Marathon,
Swarm, Fleet, Lattice, ECS
Chronos, Kubernetes
Docker, Rkt, Garden, Mesos
Mesos
Vagrant, Otto, Puppet, Chef,
Ansible, Salt
Machine Management
AWS, Azure, GCE, OpenStack,
vSphere, VirtualBox, Fusion
MESOSPHERE
DATACENTER
OPERATING
SYSTEM (DC/OS)

33. © 2016 Mesosphere, Inc. All Rights Reserved.
Datacenter Operating System (DC/OS)
Distributed Systems Kernel (Mesos)
MESOSPHERE DC/OS ACCELERATES ENTERPRISES TO
A MODERN CLOUD STACK WITH THE DATACENTER FORM FACTOR
Big Data + Analytics EnginesMicroservices (in containers)
Streaming
Batch
Machine Learning
Analytics
Functions &
Logic
Search
Time Series
SQL / NoSQL
Databases
Modern App Components
Distributed systems kernel to
abstract resources
Killer “apps” ecosystem
Cont Integration/Cont Delivery
Framework “app” architecture
to consistently run on top of kernel
User Interface (GUI & CLI)
Core system services
(e.g., distributed init, cron, service
discovery, package mgt & installer,
storage)
Any Infrastructure (Physical, Virtual, Cloud)

34. © 2016 Mesosphere, Inc. All Rights Reserved. 34
DC/OS BRINGS HYPERSCALE TO MAINSTREAM
ENTERPRISES
Mac OS Android Datacenter OS (DC/OS)
Desktop Apps (e.g., Safari,
Adobe Photoshop, Itunes)
GUI (Aqua)/CLI
Personal computer
- App store
- OpenGL
- Advanced UI gestures
BSD Unix
Mobile Apps (e.g., Spotify,
Evernote, WhatsApp)
Android GUI
Mobile devices
- Telephony Manager
- Battery management
- External storage support
Linux
Distributed systems
(e.g., Docker, Spark,
Hadoop, Cassandra)
GUI/CLI (DC/OS CLI)
Full Datacenter / Cloud
- Container orchestration
- Distributed batch jobs
- Persistent storage mgmt
Apache MesosKernel
Applications
Form Factor
User Interface
OS Services
(highlights)
Computing for the masses Mobile apps for the masses Datacenter-scale apps for
mainstream enterprises
Benefits

35. © 2016 Mesosphere, Inc. All Rights Reserved.
CHALLENGES OF HYPERSCALE
Challenges in building modern cloud applications Microservices and interactions at Hailo
Design & deploy
Monitoring &
operations
● Developer access to production-like environments
● Service discovery between large number of services
● Complex deployment and rollback of services
● Ensuring API contract not broken between versions of various services
● Monitoring, tracing and root cause analysis to ensure end-to-end
performance across large number of services
● Low utilization of multiple distributed systems
Service quality &
continuity
● Fault tolerance and healing (in an always-on environment)
Security
● Secrets (key) management across large number of services
● Incident detection and remediation

36. © 2016 Mesosphere, Inc. All Rights Reserved.
ANATOMY OF A MODERN APP
App Functions & Logic Big Data + Analytics Engines
Data Storage Message QueueBig Data Processing
X
X X... ... ... ... X
Anything else
Two-level scheduling
via frameworks
DC/OS - Aggregation
VMs Azure, AWS, or GCPServers
Single logical datacenter via
distributed systems kernel
DC/OS - Container Orchestration

37. © 2016 Mesosphere, Inc. All Rights Reserved. 37
MESOSPHERE DC/OS, SIMPLIFYING THE OPERATION OF NEXT
GENERATION TECHNOLOGIES, AT MASSIVE SCALE
Services & Containers
Mesosphere DC/OS
Any Infrastructure
Build Apps once in DC/OS, and run it
anywhere
Runs distributed apps anywhere as simply
as running apps on your laptop.
Your favorite services, container
formats, and those yet to come.