SlideShare a Scribd company logo
1 of 14
Download to read offline
http://www.coord.org




Hybrid Cloud Enablement Technologies


Woohyun Kim
The creator of open source “Coord”
(http://www.coord.org)


2012-04-05
http://www.coord.org




The Advent of Hybrid Cloud
http://www.coord.org


The Cloud is DEAD
• Amazon Outage Ironically Raises the Public Cloud Doubts
   • On April 21st, 2011, Amazon made the
     worst outage in the cloud’s history
       • A networking glitch made its storage volumes
         automatically create back-ups of themselves,
         filling up storage capacity and causing
         connectivity issues, lasts two days

                                     • The affected sites could not help waiting
                                       for just Amazon’s repairs
                                          • Q&A site Quora posted “Sorry – it sucks for us
                                               too. We’d point fingers, …”
                                          • News aggregator Reddit posted “We are still
                                               waiting on Amazon to get to our volumes”
                                          • Location service Foursquare, and SCVNGR
                                               posted “The sky is falling! Amazon’s cloud
                                               seems to be down (raining?)”
http://www.coord.org


The Cloud is just a Tool
• How SmugMug Survived the Amazon Cloud Failure
   • All of services in Amazon were spread across multiple AZs
       • They just launched another identical ELB(Elastic Load Balancer), point it at the
         non-affected zones, and updated their DNS
       • Note that ELB was affected by the EBS outage
            •     Like RDS, ELBs would be also constructed on EC2 instances with EBS volumes ??!

   • The services were designed for failure
   • Fortunately, they didn’t use EBS, which was the main problem for
     Amazon crashes
       • Since EBS didn’t guarantee predictable performance, they didn’t use RDS running
         on it.
       • As a result, the exact types of data that would have potentially been disabled by
         the EBS meltdown don’t actually live at Amazon at all
       • Note that it all still lives in their own datacenters, where they can provide
         predictable performance
http://www.coord.org


A Better Alternative is Hybrid Cloud
• Zynga Makes Dramatic Shift From Public Cloud
   • Zynga has moved most of its users away from Amazon and onto its
     private cloud, called zCloud, to maximize the reliability and performance
     of its social games network
       • Zynga started out hosting games on its own servers in a collocation facility but
         moved to Amazon when it couldn’t keep pace with demand
       • A turning point was the 2009 launch of “Farmville,” which shot form zero to 10
         million users in six weeks
       • But from early 2011, Zynga launched all its new games in their own cloud only
         when demand became predictable
       • zCloud was built on top of CloudStack and RightScale
       • Nearly 80 percent of Zynga’s daily active users were hosted on its own
         infrastructure at the end of 2011, while 80 percent were hosted in Amazon at
         the start of 2011
   • Zynga now sees Amazon as a way to deal with unexpected surges in
     demand rather than as its primary platform
http://www.coord.org


Public Players are headed for Hybrid Cloud
• “The hybrid cloud is a little bit like sex
 in high school” – Michael Crandell
   • Everybody is talking about it, but not
     everybody is doing it – except us
                                                Michael Crandell, RightScale


• “RightScale is a little bit like a parasite in Amazon”
http://www.coord.org




Hybrid Cloud Enablement Technologies
http://www.coord.org


Auto-Scaling in Hybrid Cloud

                                    Register with LB’s:
                                    •    Using SSH
       Private Cloud                •    Using RightNet               Public Cloud
                                    •    Central repo

                                                                      CPU
                                                                            Scale Up
        LB      LB                                                          Scale Down




      App    App … App                Public Internet               App     App … App

                                                                        ServerArray

       Master    Slave


                         Security:                        Contact DB:
                         •  Access Control                •    Using DNS / IP
                         •  Encryption                    •    Executing a script
http://www.coord.org


Disaster Recovery in Hybrid Cloud

               Private Cloud                                         Public Cloud

                                                                    CPU
                                                                          Scale Up
                                                                          Scale Down
               LB     LB


        App         App … App            Public Internet            App    App … App

                                                                       ServerArray
     snap
      snap
       snap
        snap   Master Slave    snap
                                snap
                                 snap
                                  snap
                                                                                    snap
                                                                                     snap
                                                                            Slave     snap
                                                                                       snap




                                         S3/Cloudfiles
                                                           •   Global storage
                                                           •   Live replication + rsync
                                                           •   NoSQL
http://www.coord.org


Networking in Hybrid Cloud
http://www.coord.org


Application Virtualization in Hybrid Cloud

 • Why Application Virtualization?
    • Extreme Simplicity – copy and run
    • VM doesn’t solve the app/OS problem
        • VM images tie OS and apps together forever and must be
          managed as a whole
        • Separate app and OS images to reduce permutations
    • Adapting VM images for migration among differing
      infrastructures is difficult
    • App & OS patches done once – gold “images”
    • Simple copy for archive, release, DR, replication
http://www.coord.org


I/O Virtualization in Hybrid Cloud
http://www.coord.org


Hybrid Cloud Enablement Technologies
 • Image Storage
     • Racemi
     • rPath rBuilder
     • Glance
     • RightScale ServerTemplate & MCI(Multiple Cloud Image)
 • Cloud Bridge
     • Rackspace RackConnect
     • Vyatta-based SSL-VPN
     • RightScale Point-To-Point
 • Storage
     • NexentaStor – NexentaVDI at Citrix Synergey 2011
     • GlusterFS, Sheepdog
     • Abiquo Tiered Storage(SATA, SAS, SSD)
         •         High perf, replicated (tier 1)
         •         High perf (tier 2)
         •         Standard (tier 3)
         •         Low cost (tier 4)
http://www.coord.org




Thank You

More Related Content

What's hot

iPaas with Fuse Fabric Technology
iPaas with Fuse Fabric TechnologyiPaas with Fuse Fabric Technology
iPaas with Fuse Fabric TechnologyCharles Moulliard
 
CloudStack-Developer-Day
CloudStack-Developer-DayCloudStack-Developer-Day
CloudStack-Developer-DayKimihiko Kitase
 
Building clouds with apache cloudstack apache roadshow 2018
Building clouds with apache cloudstack   apache roadshow 2018Building clouds with apache cloudstack   apache roadshow 2018
Building clouds with apache cloudstack apache roadshow 2018ShapeBlue
 
CloudStack Architecture Future
CloudStack Architecture FutureCloudStack Architecture Future
CloudStack Architecture FutureKimihiko Kitase
 
CloudStack NVP Integration - BACD
CloudStack NVP Integration - BACDCloudStack NVP Integration - BACD
CloudStack NVP Integration - BACDHugo Trippaers
 
Virtualization in the Cloud @ Build a Cloud Day SFO May 2012
Virtualization in the Cloud @ Build a Cloud Day SFO May 2012Virtualization in the Cloud @ Build a Cloud Day SFO May 2012
Virtualization in the Cloud @ Build a Cloud Day SFO May 2012The Linux Foundation
 
Introduction to CloudStack Networking
Introduction to CloudStack NetworkingIntroduction to CloudStack Networking
Introduction to CloudStack NetworkingShapeBlue
 
CloudStack Networking Deepdive CCCEU13
CloudStack Networking Deepdive CCCEU13CloudStack Networking Deepdive CCCEU13
CloudStack Networking Deepdive CCCEU13Chiradeep Vittal
 
Supporting and Using EC2/CIMI on top of Cloud Environments via Deltacloud
Supporting and Using EC2/CIMI on top of Cloud Environments via DeltacloudSupporting and Using EC2/CIMI on top of Cloud Environments via Deltacloud
Supporting and Using EC2/CIMI on top of Cloud Environments via DeltacloudOved Ourfali
 
Cloudstack networking2
Cloudstack networking2Cloudstack networking2
Cloudstack networking2Hiroaki Kawai
 
2 architectural at CloudStack Developer Day
2  architectural at CloudStack Developer Day2  architectural at CloudStack Developer Day
2 architectural at CloudStack Developer DayKimihiko Kitase
 
Private cloud 201 how to build a private cloud
Private cloud 201 how to build a private cloud Private cloud 201 how to build a private cloud
Private cloud 201 how to build a private cloud Harold Wong
 
Huawei cloud bb solution introduction
Huawei cloud bb solution introductionHuawei cloud bb solution introduction
Huawei cloud bb solution introductionAhmedEmad222
 
Workshop eNovance/OpenStack 20-12-2012
Workshop eNovance/OpenStack 20-12-2012Workshop eNovance/OpenStack 20-12-2012
Workshop eNovance/OpenStack 20-12-2012eNovance
 

What's hot (20)

iPaas with Fuse Fabric Technology
iPaas with Fuse Fabric TechnologyiPaas with Fuse Fabric Technology
iPaas with Fuse Fabric Technology
 
CloudStack-Developer-Day
CloudStack-Developer-DayCloudStack-Developer-Day
CloudStack-Developer-Day
 
Chep2012
Chep2012Chep2012
Chep2012
 
Building clouds with apache cloudstack apache roadshow 2018
Building clouds with apache cloudstack   apache roadshow 2018Building clouds with apache cloudstack   apache roadshow 2018
Building clouds with apache cloudstack apache roadshow 2018
 
CloudStack Architecture Future
CloudStack Architecture FutureCloudStack Architecture Future
CloudStack Architecture Future
 
CloudStack technical overview
CloudStack technical overviewCloudStack technical overview
CloudStack technical overview
 
CloudStack NVP Integration - BACD
CloudStack NVP Integration - BACDCloudStack NVP Integration - BACD
CloudStack NVP Integration - BACD
 
CloudStack Hyderabad Meetup: Migrating applications to IaaS clouds
CloudStack Hyderabad Meetup: Migrating applications to IaaS cloudsCloudStack Hyderabad Meetup: Migrating applications to IaaS clouds
CloudStack Hyderabad Meetup: Migrating applications to IaaS clouds
 
Virtualization in the Cloud @ Build a Cloud Day SFO May 2012
Virtualization in the Cloud @ Build a Cloud Day SFO May 2012Virtualization in the Cloud @ Build a Cloud Day SFO May 2012
Virtualization in the Cloud @ Build a Cloud Day SFO May 2012
 
Introduction to CloudStack Networking
Introduction to CloudStack NetworkingIntroduction to CloudStack Networking
Introduction to CloudStack Networking
 
CloudStack Hyderabad Meetup: Using CloudStack to build IaaS clouds
CloudStack Hyderabad Meetup: Using CloudStack to build IaaS cloudsCloudStack Hyderabad Meetup: Using CloudStack to build IaaS clouds
CloudStack Hyderabad Meetup: Using CloudStack to build IaaS clouds
 
CloudStack Networking Deepdive CCCEU13
CloudStack Networking Deepdive CCCEU13CloudStack Networking Deepdive CCCEU13
CloudStack Networking Deepdive CCCEU13
 
Supporting and Using EC2/CIMI on top of Cloud Environments via Deltacloud
Supporting and Using EC2/CIMI on top of Cloud Environments via DeltacloudSupporting and Using EC2/CIMI on top of Cloud Environments via Deltacloud
Supporting and Using EC2/CIMI on top of Cloud Environments via Deltacloud
 
Cloudstack networking2
Cloudstack networking2Cloudstack networking2
Cloudstack networking2
 
2 architectural at CloudStack Developer Day
2  architectural at CloudStack Developer Day2  architectural at CloudStack Developer Day
2 architectural at CloudStack Developer Day
 
Private cloud 201 how to build a private cloud
Private cloud 201 how to build a private cloud Private cloud 201 how to build a private cloud
Private cloud 201 how to build a private cloud
 
Huawei cloud bb solution introduction
Huawei cloud bb solution introductionHuawei cloud bb solution introduction
Huawei cloud bb solution introduction
 
CloudStack + SDN
CloudStack + SDNCloudStack + SDN
CloudStack + SDN
 
Workshop eNovance/OpenStack 20-12-2012
Workshop eNovance/OpenStack 20-12-2012Workshop eNovance/OpenStack 20-12-2012
Workshop eNovance/OpenStack 20-12-2012
 
Apache CloudStack from API to UI
Apache CloudStack from API to UIApache CloudStack from API to UI
Apache CloudStack from API to UI
 

Similar to Hybrid Cloud Enablement Technologies

Amazon Web Services Building Blocks for Drupal Applications and Hosting
Amazon Web Services Building Blocks for Drupal Applications and HostingAmazon Web Services Building Blocks for Drupal Applications and Hosting
Amazon Web Services Building Blocks for Drupal Applications and HostingAcquia
 
Netflix on Cloud - combined slides for Dev and Ops
Netflix on Cloud - combined slides for Dev and OpsNetflix on Cloud - combined slides for Dev and Ops
Netflix on Cloud - combined slides for Dev and OpsAdrian Cockcroft
 
Patterns For Cloud Computing
Patterns For Cloud ComputingPatterns For Cloud Computing
Patterns For Cloud ComputingSimon Guest
 
Patterns for Cloud Computing
Patterns for Cloud ComputingPatterns for Cloud Computing
Patterns for Cloud ComputingSimon Guest
 
CloudFest Denver Windows Azure Design Patterns
CloudFest Denver Windows Azure Design PatternsCloudFest Denver Windows Azure Design Patterns
CloudFest Denver Windows Azure Design PatternsDavid Pallmann
 
AWS 2013 LA Media Event: Scalable Media Processing
AWS 2013 LA Media Event: Scalable Media ProcessingAWS 2013 LA Media Event: Scalable Media Processing
AWS 2013 LA Media Event: Scalable Media ProcessingDavid Sayed
 
Cloud computing benefits start-up companies
Cloud computing benefits start-up companiesCloud computing benefits start-up companies
Cloud computing benefits start-up companiesSang-il Jung
 
Cloud Computing from an Entrpreneur's Viewpoint
Cloud Computing from an Entrpreneur's ViewpointCloud Computing from an Entrpreneur's Viewpoint
Cloud Computing from an Entrpreneur's ViewpointJ Singh
 
Cloud Computing with .Net
Cloud Computing with .NetCloud Computing with .Net
Cloud Computing with .NetWesley Faler
 
Improving Availability & Lowering Costs with Auto Scaling & Amazon EC2 (CPN20...
Improving Availability & Lowering Costs with Auto Scaling & Amazon EC2 (CPN20...Improving Availability & Lowering Costs with Auto Scaling & Amazon EC2 (CPN20...
Improving Availability & Lowering Costs with Auto Scaling & Amazon EC2 (CPN20...Amazon Web Services
 
IEEE Cloud 2012: Clouds Hands-On Tutorial
IEEE Cloud 2012: Clouds Hands-On TutorialIEEE Cloud 2012: Clouds Hands-On Tutorial
IEEE Cloud 2012: Clouds Hands-On TutorialSrinath Perera
 
EMEA OpenStack Day, July 13th 2011 in London - Jim Curry intro
EMEA OpenStack Day, July 13th 2011 in London - Jim Curry introEMEA OpenStack Day, July 13th 2011 in London - Jim Curry intro
EMEA OpenStack Day, July 13th 2011 in London - Jim Curry introOpen Stack
 
OpenStack Boston User Group, OpenStack overview
OpenStack Boston User Group, OpenStack overviewOpenStack Boston User Group, OpenStack overview
OpenStack Boston User Group, OpenStack overviewOpen Stack
 
Cloud computing & lamp applications
Cloud computing & lamp applicationsCloud computing & lamp applications
Cloud computing & lamp applicationsCorley S.r.l.
 
EMEA OpenStack Day Intro, July 13th 2011 in London
EMEA OpenStack Day Intro, July 13th 2011 in LondonEMEA OpenStack Day Intro, July 13th 2011 in London
EMEA OpenStack Day Intro, July 13th 2011 in LondonMark Collier
 
Kaavo Introduction 08012011
Kaavo Introduction 08012011Kaavo Introduction 08012011
Kaavo Introduction 08012011sams2618
 
Cf intro for spring devs
Cf intro for spring devsCf intro for spring devs
Cf intro for spring devsEric Bottard
 
Is the Browser a Transitional Technology?
Is the Browser a Transitional Technology?Is the Browser a Transitional Technology?
Is the Browser a Transitional Technology?Allen Wirfs-Brock
 

Similar to Hybrid Cloud Enablement Technologies (20)

Amazon Web Services Building Blocks for Drupal Applications and Hosting
Amazon Web Services Building Blocks for Drupal Applications and HostingAmazon Web Services Building Blocks for Drupal Applications and Hosting
Amazon Web Services Building Blocks for Drupal Applications and Hosting
 
Netflix on Cloud - combined slides for Dev and Ops
Netflix on Cloud - combined slides for Dev and OpsNetflix on Cloud - combined slides for Dev and Ops
Netflix on Cloud - combined slides for Dev and Ops
 
Patterns For Cloud Computing
Patterns For Cloud ComputingPatterns For Cloud Computing
Patterns For Cloud Computing
 
Patterns for Cloud Computing
Patterns for Cloud ComputingPatterns for Cloud Computing
Patterns for Cloud Computing
 
CloudFest Denver Windows Azure Design Patterns
CloudFest Denver Windows Azure Design PatternsCloudFest Denver Windows Azure Design Patterns
CloudFest Denver Windows Azure Design Patterns
 
AWS 2013 LA Media Event: Scalable Media Processing
AWS 2013 LA Media Event: Scalable Media ProcessingAWS 2013 LA Media Event: Scalable Media Processing
AWS 2013 LA Media Event: Scalable Media Processing
 
Cloud computing benefits start-up companies
Cloud computing benefits start-up companiesCloud computing benefits start-up companies
Cloud computing benefits start-up companies
 
Cloud Computing from an Entrpreneur's Viewpoint
Cloud Computing from an Entrpreneur's ViewpointCloud Computing from an Entrpreneur's Viewpoint
Cloud Computing from an Entrpreneur's Viewpoint
 
Cloud Computing with .Net
Cloud Computing with .NetCloud Computing with .Net
Cloud Computing with .Net
 
Improving Availability & Lowering Costs with Auto Scaling & Amazon EC2 (CPN20...
Improving Availability & Lowering Costs with Auto Scaling & Amazon EC2 (CPN20...Improving Availability & Lowering Costs with Auto Scaling & Amazon EC2 (CPN20...
Improving Availability & Lowering Costs with Auto Scaling & Amazon EC2 (CPN20...
 
IEEE Cloud 2012: Clouds Hands-On Tutorial
IEEE Cloud 2012: Clouds Hands-On TutorialIEEE Cloud 2012: Clouds Hands-On Tutorial
IEEE Cloud 2012: Clouds Hands-On Tutorial
 
EMEA OpenStack Day, July 13th 2011 in London - Jim Curry intro
EMEA OpenStack Day, July 13th 2011 in London - Jim Curry introEMEA OpenStack Day, July 13th 2011 in London - Jim Curry intro
EMEA OpenStack Day, July 13th 2011 in London - Jim Curry intro
 
OpenStack Boston User Group, OpenStack overview
OpenStack Boston User Group, OpenStack overviewOpenStack Boston User Group, OpenStack overview
OpenStack Boston User Group, OpenStack overview
 
Cloud Computing
Cloud ComputingCloud Computing
Cloud Computing
 
Thunderstruck by serverless
Thunderstruck  by  serverlessThunderstruck  by  serverless
Thunderstruck by serverless
 
Cloud computing & lamp applications
Cloud computing & lamp applicationsCloud computing & lamp applications
Cloud computing & lamp applications
 
EMEA OpenStack Day Intro, July 13th 2011 in London
EMEA OpenStack Day Intro, July 13th 2011 in LondonEMEA OpenStack Day Intro, July 13th 2011 in London
EMEA OpenStack Day Intro, July 13th 2011 in London
 
Kaavo Introduction 08012011
Kaavo Introduction 08012011Kaavo Introduction 08012011
Kaavo Introduction 08012011
 
Cf intro for spring devs
Cf intro for spring devsCf intro for spring devs
Cf intro for spring devs
 
Is the Browser a Transitional Technology?
Is the Browser a Transitional Technology?Is the Browser a Transitional Technology?
Is the Browser a Transitional Technology?
 

Hybrid Cloud Enablement Technologies

  • 1. http://www.coord.org Hybrid Cloud Enablement Technologies Woohyun Kim The creator of open source “Coord” (http://www.coord.org) 2012-04-05
  • 3. http://www.coord.org The Cloud is DEAD • Amazon Outage Ironically Raises the Public Cloud Doubts • On April 21st, 2011, Amazon made the worst outage in the cloud’s history • A networking glitch made its storage volumes automatically create back-ups of themselves, filling up storage capacity and causing connectivity issues, lasts two days • The affected sites could not help waiting for just Amazon’s repairs • Q&A site Quora posted “Sorry – it sucks for us too. We’d point fingers, …” • News aggregator Reddit posted “We are still waiting on Amazon to get to our volumes” • Location service Foursquare, and SCVNGR posted “The sky is falling! Amazon’s cloud seems to be down (raining?)”
  • 4. http://www.coord.org The Cloud is just a Tool • How SmugMug Survived the Amazon Cloud Failure • All of services in Amazon were spread across multiple AZs • They just launched another identical ELB(Elastic Load Balancer), point it at the non-affected zones, and updated their DNS • Note that ELB was affected by the EBS outage • Like RDS, ELBs would be also constructed on EC2 instances with EBS volumes ??! • The services were designed for failure • Fortunately, they didn’t use EBS, which was the main problem for Amazon crashes • Since EBS didn’t guarantee predictable performance, they didn’t use RDS running on it. • As a result, the exact types of data that would have potentially been disabled by the EBS meltdown don’t actually live at Amazon at all • Note that it all still lives in their own datacenters, where they can provide predictable performance
  • 5. http://www.coord.org A Better Alternative is Hybrid Cloud • Zynga Makes Dramatic Shift From Public Cloud • Zynga has moved most of its users away from Amazon and onto its private cloud, called zCloud, to maximize the reliability and performance of its social games network • Zynga started out hosting games on its own servers in a collocation facility but moved to Amazon when it couldn’t keep pace with demand • A turning point was the 2009 launch of “Farmville,” which shot form zero to 10 million users in six weeks • But from early 2011, Zynga launched all its new games in their own cloud only when demand became predictable • zCloud was built on top of CloudStack and RightScale • Nearly 80 percent of Zynga’s daily active users were hosted on its own infrastructure at the end of 2011, while 80 percent were hosted in Amazon at the start of 2011 • Zynga now sees Amazon as a way to deal with unexpected surges in demand rather than as its primary platform
  • 6. http://www.coord.org Public Players are headed for Hybrid Cloud • “The hybrid cloud is a little bit like sex in high school” – Michael Crandell • Everybody is talking about it, but not everybody is doing it – except us Michael Crandell, RightScale • “RightScale is a little bit like a parasite in Amazon”
  • 8. http://www.coord.org Auto-Scaling in Hybrid Cloud Register with LB’s: • Using SSH Private Cloud • Using RightNet Public Cloud • Central repo CPU Scale Up LB LB Scale Down App App … App Public Internet App App … App ServerArray Master Slave Security: Contact DB: • Access Control • Using DNS / IP • Encryption • Executing a script
  • 9. http://www.coord.org Disaster Recovery in Hybrid Cloud Private Cloud Public Cloud CPU Scale Up Scale Down LB LB App App … App Public Internet App App … App ServerArray snap snap snap snap Master Slave snap snap snap snap snap snap Slave snap snap S3/Cloudfiles • Global storage • Live replication + rsync • NoSQL
  • 11. http://www.coord.org Application Virtualization in Hybrid Cloud • Why Application Virtualization? • Extreme Simplicity – copy and run • VM doesn’t solve the app/OS problem • VM images tie OS and apps together forever and must be managed as a whole • Separate app and OS images to reduce permutations • Adapting VM images for migration among differing infrastructures is difficult • App & OS patches done once – gold “images” • Simple copy for archive, release, DR, replication
  • 13. http://www.coord.org Hybrid Cloud Enablement Technologies • Image Storage • Racemi • rPath rBuilder • Glance • RightScale ServerTemplate & MCI(Multiple Cloud Image) • Cloud Bridge • Rackspace RackConnect • Vyatta-based SSL-VPN • RightScale Point-To-Point • Storage • NexentaStor – NexentaVDI at Citrix Synergey 2011 • GlusterFS, Sheepdog • Abiquo Tiered Storage(SATA, SAS, SSD) • High perf, replicated (tier 1) • High perf (tier 2) • Standard (tier 3) • Low cost (tier 4)