SlideShare ist ein Scribd-Unternehmen logo
1 von 18
Downloaden Sie, um offline zu lesen
Thinking in Terms of a Data
Center Operating System
Weston Bassler
Systems Engineer, Klarna Inc
Who am I?
Weston Bassler, Systems Engineer, Klarna Inc
● currently working at Klarna, a new startup in Columbus, as a Systems Engineer.
Previous experience as a Cloud and Linux Engineer for LexisNexis and Verizon
Wireless.
● Highly Involved in Linux and Open Cloud Technologies
● Lover of Gifs and Memes
What I will be Discussing
● Data Center Operating System?
● Quick Introduction to Apache Mesos
● What makes it so interesting?
● Current ways we are trying to utilize
● Demos!!!!
○ Launching an App with Marathon
○ Scaling your App properly
○ Jenkins on Mesos
● Ways to get started using it
Data Center Operating System
● What is it and what do you mean?
○ All of the machines of your DC and treating it as a single Machine
○ Abstracting resources into a single pool
○ CLUSTER ALL THINGS
● What problem(s) does this solve?
○ Less complexity of managing multiple nodes
○ Better utilization of your resources
○ More control over resources
○ Ease of Deploying and Scaling Apps
● How do I acheive this concept of a “Data Center Operating System”?
Enters The Apache Mesos Project
Mesos Explained
● What exactly is Mesos?
○ From mesos.apache.com - “Apache Mesos abstracts CPU, memory, storage, and other compute
resources away from machines (physical or virtual), enabling fault-tolerant and elastic distributed
systems to easily be built and run effectively.”
● Master/Slave Architecture
○ Zookeeper elects a Leader
○ Masters tell the Slave(s) what to do
○ Slave(s) are the workers
● Frameworks Manage Tasks/Services
Bigger Picture
How Does Mesos Work?
source: Anton Kirillov
So why is this interesting?
● Get the most out of your infrastructure -- Utilization
● High Availability / Fault Tolerance / Peace of Mind
● Containers! -> Speed, Flexibility, Isolation, Docker, Docker, Docker
● Scalability -- Nodes and Apps
● Ease of Use -- Web UI for ALL & Native Clusterting
● Use of Frameworks -- Hadoop, Kubernetes, Chronos, Marathon, Spark……
Some Examples
“Launching a Docker
container is so yesterday.
Today, it's all about 50,000
Docker containers...
launched in 100 seconds...
on a Mesos-powered
cluster.”
Another Example
Apple and Siri - Apple
redesigned the Siri Infra to
run on Mesos. They
developed a Framework
called JARVIS which acts in
the same way as Marathon.
100 different Services
Stores Data on HDFS
What made me interested?
● The Use of Containers
● Being able to Scale and Manage Containers So Quickly
● Fault Tolerance
● Container Orchestration
● PaaS
Demo 1
● Launching an App with Marathon
○ What is Marathon? Overview
○ API/JSON
○ Docker/Mesos Containers
○ Launch Script
Demo 2
● Scaling an App on Marathon
○ From the UI
○ Killing Tasks
○ HAProxy
○ Marathon API -> Examples from Git Repo
● Jenkins Mesos Plugin
○ What is the Plugin?
○ Take through the process Jenkins Configuration
○ Create and Run a Jenkins Job --
■ Dreaded “Hello, World”
■ Using Docker to build Docker
○ Show Jenkins Job running on Mesos
Demo 3
Ways to Get Started
● http://mesos.apache.org/documentation/latest/
● Books:
○ Apache Mesos Essentials - By: Dharmesh Kakadia
○ Mesos In Action - By: Roger Ignazio
● Visit My Github Page
○ Mesos Sandbox: git clone https://github.com/geekbass/mesos-sandbox.git
● Contact Me!!!
○ wbassler@linux.com
○ LinkedIn: Weston Bassler
○ @w_bassler
● Companies Using Mesos
Questions?

Weitere ähnliche Inhalte

Was ist angesagt?

Hybrid cloud federation
Hybrid cloud federationHybrid cloud federation
Hybrid cloud federation
openstackindia
 
Openstack platform -Red Hat Pizza and technology event - Israel
Openstack platform -Red Hat Pizza and technology event - IsraelOpenstack platform -Red Hat Pizza and technology event - Israel
Openstack platform -Red Hat Pizza and technology event - Israel
Arthur Berezin
 
OpenStack Introduction
OpenStack IntroductionOpenStack Introduction
OpenStack Introduction
openstackindia
 
6 open stack_swift_panoramic_view
6 open stack_swift_panoramic_view6 open stack_swift_panoramic_view
6 open stack_swift_panoramic_view
openstackindia
 

Was ist angesagt? (20)

CloudStack vs OpenStack
CloudStack vs OpenStackCloudStack vs OpenStack
CloudStack vs OpenStack
 
The Future of SDN in CloudStack by Chiradeep Vittal
The Future of SDN in CloudStack by Chiradeep VittalThe Future of SDN in CloudStack by Chiradeep Vittal
The Future of SDN in CloudStack by Chiradeep Vittal
 
CloudStack vs Openstack
CloudStack vs OpenstackCloudStack vs Openstack
CloudStack vs Openstack
 
Hybrid cloud federation
Hybrid cloud federationHybrid cloud federation
Hybrid cloud federation
 
Openstack platform -Red Hat Pizza and technology event - Israel
Openstack platform -Red Hat Pizza and technology event - IsraelOpenstack platform -Red Hat Pizza and technology event - Israel
Openstack platform -Red Hat Pizza and technology event - Israel
 
PaaS Design & Architecture: A Deep Dive into Apache Stratos
PaaS Design & Architecture: A Deep Dive into Apache StratosPaaS Design & Architecture: A Deep Dive into Apache Stratos
PaaS Design & Architecture: A Deep Dive into Apache Stratos
 
Introduction to cloud and openstack
Introduction to cloud and openstackIntroduction to cloud and openstack
Introduction to cloud and openstack
 
How to power microservices with MariaDB
How to power microservices with MariaDBHow to power microservices with MariaDB
How to power microservices with MariaDB
 
Why SaltStack ?
Why SaltStack ?Why SaltStack ?
Why SaltStack ?
 
OpenNebula TechDay Boston 2015 - Hyperconvergence and OpenNebula
OpenNebula TechDay Boston 2015 - Hyperconvergence and OpenNebulaOpenNebula TechDay Boston 2015 - Hyperconvergence and OpenNebula
OpenNebula TechDay Boston 2015 - Hyperconvergence and OpenNebula
 
Building a Microsoft cloud with open technologies
Building a Microsoft cloud with open technologiesBuilding a Microsoft cloud with open technologies
Building a Microsoft cloud with open technologies
 
Openstack In Real Life
Openstack In Real LifeOpenstack In Real Life
Openstack In Real Life
 
ContainerDays NYC 2016: "Containers in Azure: Understanding the Microsoft Con...
ContainerDays NYC 2016: "Containers in Azure: Understanding the Microsoft Con...ContainerDays NYC 2016: "Containers in Azure: Understanding the Microsoft Con...
ContainerDays NYC 2016: "Containers in Azure: Understanding the Microsoft Con...
 
Getting started with Mantl
Getting started with MantlGetting started with Mantl
Getting started with Mantl
 
OpenStack Introduction
OpenStack IntroductionOpenStack Introduction
OpenStack Introduction
 
Containers and CloudStack
Containers and CloudStackContainers and CloudStack
Containers and CloudStack
 
6 open stack_swift_panoramic_view
6 open stack_swift_panoramic_view6 open stack_swift_panoramic_view
6 open stack_swift_panoramic_view
 
An Introduction to OpenStack
An Introduction to OpenStackAn Introduction to OpenStack
An Introduction to OpenStack
 
OpenNebulaconf2017US: Software defined networking with OpenNebula by Roy Keen...
OpenNebulaconf2017US: Software defined networking with OpenNebula by Roy Keen...OpenNebulaconf2017US: Software defined networking with OpenNebula by Roy Keen...
OpenNebulaconf2017US: Software defined networking with OpenNebula by Roy Keen...
 
Sebastien goasguen cloud stack and docker
Sebastien goasguen   cloud stack and dockerSebastien goasguen   cloud stack and docker
Sebastien goasguen cloud stack and docker
 

Ähnlich wie Thinking in Terms of a Data Center Operating System

Ähnlich wie Thinking in Terms of a Data Center Operating System (20)

Containerizing couchbase with microservice architecture on mesosphere.pptx
Containerizing couchbase with microservice architecture on mesosphere.pptxContainerizing couchbase with microservice architecture on mesosphere.pptx
Containerizing couchbase with microservice architecture on mesosphere.pptx
 
Choosing PaaS: Cisco and Open Source Options: an overview
Choosing PaaS:  Cisco and Open Source Options: an overviewChoosing PaaS:  Cisco and Open Source Options: an overview
Choosing PaaS: Cisco and Open Source Options: an overview
 
How to build an HA container orchestrator infrastructure for production – Giu...
How to build an HA container orchestrator infrastructure for production – Giu...How to build an HA container orchestrator infrastructure for production – Giu...
How to build an HA container orchestrator infrastructure for production – Giu...
 
Microservices: moving parts around
Microservices: moving parts aroundMicroservices: moving parts around
Microservices: moving parts around
 
Cloud infrastructure on Apache Mesos
Cloud infrastructure on Apache MesosCloud infrastructure on Apache Mesos
Cloud infrastructure on Apache Mesos
 
Meanstack overview
Meanstack overviewMeanstack overview
Meanstack overview
 
Musings on Mesos: Docker, Kubernetes, and Beyond.
Musings on Mesos: Docker, Kubernetes, and Beyond.Musings on Mesos: Docker, Kubernetes, and Beyond.
Musings on Mesos: Docker, Kubernetes, and Beyond.
 
Kubernetes solutions
Kubernetes solutionsKubernetes solutions
Kubernetes solutions
 
Introduction to Apache Mesos and DC/OS
Introduction to Apache Mesos and DC/OSIntroduction to Apache Mesos and DC/OS
Introduction to Apache Mesos and DC/OS
 
Containerization Principles Overview for app development and deployment
Containerization Principles Overview for app development and deploymentContainerization Principles Overview for app development and deployment
Containerization Principles Overview for app development and deployment
 
Manage Microservices & Fast Data Systems on One Platform w/ DC/OS
Manage Microservices & Fast Data Systems on One Platform w/ DC/OSManage Microservices & Fast Data Systems on One Platform w/ DC/OS
Manage Microservices & Fast Data Systems on One Platform w/ DC/OS
 
Openstack - Enterprise cloud management platform
Openstack - Enterprise cloud management platformOpenstack - Enterprise cloud management platform
Openstack - Enterprise cloud management platform
 
Breaking the Monolith Road to Containers
Breaking the Monolith Road to ContainersBreaking the Monolith Road to Containers
Breaking the Monolith Road to Containers
 
AWS re:Invent 2016: Running Microservices on Amazon ECS (CON309)
AWS re:Invent 2016: Running Microservices on Amazon ECS (CON309)AWS re:Invent 2016: Running Microservices on Amazon ECS (CON309)
AWS re:Invent 2016: Running Microservices on Amazon ECS (CON309)
 
2017 Microservices Practitioner Virtual Summit: Ancestry's Journey towards Mi...
2017 Microservices Practitioner Virtual Summit: Ancestry's Journey towards Mi...2017 Microservices Practitioner Virtual Summit: Ancestry's Journey towards Mi...
2017 Microservices Practitioner Virtual Summit: Ancestry's Journey towards Mi...
 
Mesosphere quick overview
Mesosphere quick overviewMesosphere quick overview
Mesosphere quick overview
 
Dockers and kubernetes
Dockers and kubernetesDockers and kubernetes
Dockers and kubernetes
 
Microservices and docker
Microservices and dockerMicroservices and docker
Microservices and docker
 
Containerization Report
Containerization ReportContainerization Report
Containerization Report
 
Webinar: OpenEBS - Still Free and now FASTEST Kubernetes storage
Webinar: OpenEBS - Still Free and now FASTEST Kubernetes storageWebinar: OpenEBS - Still Free and now FASTEST Kubernetes storage
Webinar: OpenEBS - Still Free and now FASTEST Kubernetes storage
 

Thinking in Terms of a Data Center Operating System

  • 1. Thinking in Terms of a Data Center Operating System Weston Bassler Systems Engineer, Klarna Inc
  • 2. Who am I? Weston Bassler, Systems Engineer, Klarna Inc ● currently working at Klarna, a new startup in Columbus, as a Systems Engineer. Previous experience as a Cloud and Linux Engineer for LexisNexis and Verizon Wireless. ● Highly Involved in Linux and Open Cloud Technologies ● Lover of Gifs and Memes
  • 3. What I will be Discussing ● Data Center Operating System? ● Quick Introduction to Apache Mesos ● What makes it so interesting? ● Current ways we are trying to utilize ● Demos!!!! ○ Launching an App with Marathon ○ Scaling your App properly ○ Jenkins on Mesos ● Ways to get started using it
  • 4. Data Center Operating System ● What is it and what do you mean? ○ All of the machines of your DC and treating it as a single Machine ○ Abstracting resources into a single pool ○ CLUSTER ALL THINGS ● What problem(s) does this solve? ○ Less complexity of managing multiple nodes ○ Better utilization of your resources ○ More control over resources ○ Ease of Deploying and Scaling Apps ● How do I acheive this concept of a “Data Center Operating System”?
  • 5. Enters The Apache Mesos Project
  • 6. Mesos Explained ● What exactly is Mesos? ○ From mesos.apache.com - “Apache Mesos abstracts CPU, memory, storage, and other compute resources away from machines (physical or virtual), enabling fault-tolerant and elastic distributed systems to easily be built and run effectively.” ● Master/Slave Architecture ○ Zookeeper elects a Leader ○ Masters tell the Slave(s) what to do ○ Slave(s) are the workers ● Frameworks Manage Tasks/Services
  • 8. How Does Mesos Work? source: Anton Kirillov
  • 9. So why is this interesting? ● Get the most out of your infrastructure -- Utilization ● High Availability / Fault Tolerance / Peace of Mind ● Containers! -> Speed, Flexibility, Isolation, Docker, Docker, Docker ● Scalability -- Nodes and Apps ● Ease of Use -- Web UI for ALL & Native Clusterting ● Use of Frameworks -- Hadoop, Kubernetes, Chronos, Marathon, Spark……
  • 10. Some Examples “Launching a Docker container is so yesterday. Today, it's all about 50,000 Docker containers... launched in 100 seconds... on a Mesos-powered cluster.”
  • 11.
  • 12. Another Example Apple and Siri - Apple redesigned the Siri Infra to run on Mesos. They developed a Framework called JARVIS which acts in the same way as Marathon. 100 different Services Stores Data on HDFS
  • 13. What made me interested? ● The Use of Containers ● Being able to Scale and Manage Containers So Quickly ● Fault Tolerance ● Container Orchestration ● PaaS
  • 14. Demo 1 ● Launching an App with Marathon ○ What is Marathon? Overview ○ API/JSON ○ Docker/Mesos Containers ○ Launch Script
  • 15. Demo 2 ● Scaling an App on Marathon ○ From the UI ○ Killing Tasks ○ HAProxy ○ Marathon API -> Examples from Git Repo
  • 16. ● Jenkins Mesos Plugin ○ What is the Plugin? ○ Take through the process Jenkins Configuration ○ Create and Run a Jenkins Job -- ■ Dreaded “Hello, World” ■ Using Docker to build Docker ○ Show Jenkins Job running on Mesos Demo 3
  • 17. Ways to Get Started ● http://mesos.apache.org/documentation/latest/ ● Books: ○ Apache Mesos Essentials - By: Dharmesh Kakadia ○ Mesos In Action - By: Roger Ignazio ● Visit My Github Page ○ Mesos Sandbox: git clone https://github.com/geekbass/mesos-sandbox.git ● Contact Me!!! ○ wbassler@linux.com ○ LinkedIn: Weston Bassler ○ @w_bassler ● Companies Using Mesos