1. C R A S H CO U RS E O N
O P E N S O U RC E C LO U D CO M P U T I N G
Mark R. Hinkle
Director, Cloud Computing Community
CloudStack.org

2. AG E N DA
1. Introduction
2. Quick Cloud Computing Overview
3. Open Source Building Blocks for Cloud Computing
4. Open Source Tools for Cloud Management
5. Questions

3. % W H OA M I
•
•
•
•
•
•
•
•
•

4. Q U I C K C LO U D CO M P U T I N G OV E RV I E W :
O R T H E O B L I G ATO RY “ W H AT I S T H E
C LO U D ? ” S L I D ES

5. F I V E C H A R AC T E R I ST I C S O F C LO U D S

6. C LO U D CO M P U T I N G S E RV I C E M O D E L S
USER CLOUD a.k.a. SOFTWARE AS A SERVICE
Single application, multi-tenancy, network-based, one-to-many delivery of
applications, all users have same access to features.
Examples: Salesforce.com, Google Docs, Red Hat Network/RHEL
DEVELOPMENT CLOUD a.k.a. PLATFORM-AS-A-SERVICE
Application developer model, Application deployed to an elastic service that
autoscales, low administrative overhead. No concept of virtual machines or
operating system. Code it and deploy it.
Examples: Google AppEngine, Windows Azure, Rackspace Site, Red Hat
Makara
SYSTEMS CLOUD a.k.a INFRASTRUCTURE-AS-A-SERVICE
Servers and storage are made available in a scalable way over a network.
Examples: EC2,Rackspace
CloudFiles, OpenStack, CloudStack, Eucalyptus, Ubuntu Enterprise
Cloud, OpenNebula

7. D E P LOY M E N T M O D E L S
P U B L I C , P R I VAT E & H Y B R I D C LO U D S

8. C LO U D ST I L L R EQ U I R ES
A RC H I T EC T U R A L D ES I G N
 Cloud Computing isn’t a magical solution apps need to
be able to scale out
 Design your architecture with the end in mind
 Make your infrastructure easily replicable

9. B U I L D I N G CO M P U T E C LO U D S
W I T H O P E N S O U RC E S O F T WA R E

10. W H Y O P E N S O U RC E ?
 User-Driven Solutions to Real Problems
 Lower barrier to participation
 Larger user base, users helping users
 Aggressive release cycles stay current with the state-of-
the-art
 Open data, Open standards, Open APIs

11. O P E N V I RT UA L M AC H I N E FO R M AT S
Open Virtualization Format (OVF) is an open
standard for packaging and distributing virtual
appliances or more generally software to be run in
virtual machines.
Formats for hypervisors/cloud technologies:
• Amazon - AMI
• KVM – QCOW2
• VMware – VMDK
• Xen – IMG
• VHD – Virtual Hard Disk - Hyper-V

12. S O U RC I N G O S S
V M S A N D C LO U D A P P L I A N C ES

13. O P E N S O U RC E H Y P E RV I S O RS
Open Source
 Xen, Xen Cloud Platform (XCP)
 KVM – Kernel-based Virtualization
 VirtualBox* - Oracle supported Virtualization Solutions
 OpenVZ* - Container-based, Similar to Solaris Containers or BSD Zones
 LXC – User Space chrooted installs
Proprietary
 VMware
 Citrix Xenserver
 Microsoft Hyper-V
 OracleVM (Based on OS Xen)

14. O P E N S O U RC E CO M P U T E C LO U D S
Year Started License Hypervisors Supported
2008 GPL Xenserver, Xen Cloud
Platform, KVM, VMware
2006 GPL Xen, KVM, VMware
2010 Apache VMware ESX and ESXi,
(Developed by Microsoft Hyper-V, Xen,
NASA by Anso KVM and Virtual Box
Labs
previously)

15. SCALE-UP OR SCALE-OUT
 Vertical Scaling (Scale-Up) – Allocate additional
resources to VMs, requires a reboot, no need for
distributed app logic, single-point of OS failure
 Horizontal Scaling (Scale-Out) – Application needs logic
to work in distributed fashion (e.g. HA-Proxy and
Apache, Hadoop)

16. O P E N S O U RC E
P L AT FO R M - A S - A - S E RV I C E
Year Started Sponsors Hypervisors Supported
2011 VMware Spring, Rails, Node.js
2011 Joyent Node.js
2011 Red Hat Express – Ruby, Php and
Python
Flex – Jboss, Java EE6
2010 WSO2 Jboss, Java EE6

17. O P E N S O U RC E
C LO U D CO M P U T I N G STO R AG E
 GlusterFS – Scale Out NAS system aggregating storage over
Ethernet or Infiniband
 Ceph – Distributed file storage system developed by
DreamHost
 OpenStack Object Storage (SWIFT) – Long-term storage
object storage system
 Sheepdog – Distributed storage for KVM hypervisors
 NFS – Old standby, tried and true, not designed for cloud scale
or performance

18. C LO U D A P I S A R E N ’ T C R EAT E D EQ UA L
O P E N S O U RC E A B ST R AC T I O N S
 jclouds
 libcloud
 deltacloud
 fog

19. P R I VAT E C LO U D A RC H I T EC T U R E
API
Abstractions

20. M A N AG I N G C LO U D S W I T H
O P E N S O U RC E TO O L S

21. AU TO M AT I O N U N LO C KS
T H E P OT E N T I A L O F T H E C LO U D
•
•
•
•

22. T H E M Y T H O F T H E N I N ES
Availability % Downtime per Downtime per Downtime per
Year Month Week
99.9% (three nines) 8.76 hours 43.2 minutes 10.1 minutes
99.95% 4.38 hours 21.56 minutes 5.04 minutes
99.99% (four nines) 52.6 minutes 4.32 minutes 1.01 minutes
99.999% (five nines) 5.26 minutes 25.9 seconds 6.05 seconds
99.9999% (six nines) 31.5 seconds 2.59 seconds .0605 seconds

23. 4 T Y P ES O F M A N AG E M E N T TO O L S
Provisioning
Installation of operating systems and other software
Configuration Management
Sets the parameters for servers, can specify
installation parameters
Orchestration/Automation
Automate tasks across systems
Monitoring
Records errors and health of IT infrastructure

24. M A N AG E M E N T TO O LC H A I N S
Monitoring
Patching
and
Provisioning
Configuration

25. O P E N S O U RC E
P ROV I S I O N I N G TO O L S
Year Started License Installation
Targets
Kickstart ? GPL Most .dep and RPM
based Linux distros
Cobbler (Plus koan 2007 GPL Red Hat, OpenSUSE
for PXE boot of Fedora, Debian,
VMs) Ubuntu
Spacewalk 2008 GPL Fedora, Centos
Crowbar 2011 Apache (Bare metal
provisioning)

26. OPEN SOURCE
C O N F I G U R AT I O N M A N A G E M E N T TO O L S
Year Started Language License Client/Server
Cfengine 1993 C Apache Yes
Chef 2009 Ruby Apache Chef Solo – No
Chef Server -
Yes
Puppet 2004 Ruby GPL yes
Salt 2011 Python Apache yes

27. O P E N S O U RC E
M O N I TO R I N G TO O L S
License Type of Monitoring Collection
Methods
Cacti / RRDTool GPL Performance SNMP, syslog
Nagios GPL Availability SNMP,TCP, ICMP,
IPMI, syslog
Zabbix GPL Availability/ SNMP, TCP/ICMP,
Performance and IPMI, Synthetic
more Transactions
Zenoss GPL Availability, SNMP, ICMP, SSH,
Performance, Event syslog, WMI
Management

28. O P E N S O U RC E
AU TO M AT I O N / O RC H EST R AT I O N TO O L S
Year Started Language License Client/Server Support
Organization
Capistrano 2006 Ruby MIT Yes None
RunDeck 2010 Java Apache Yes DTO Solutions
Func 2007 Python GPL Yes Fedora Project
MCollective 2009 Ruby Apache Yes PuppetLabs
Salt 2011 Python Apache Yes SaltStack Inc.
?

29. CO N C E P T UA L AU TO M AT E D TO O LC H A I N
Generate Images BootStrapped Image Provision Configuration
SUSE Studio CloudStack Cobbler Puppet
BoxGrinder OpenStack Kickstart Chef
Monitoring
Nagios Start/Stop Services
Zenoss RunDeck
Cacti Capistrano
MCollective

30. Questions?
SLIDES CAN BE VIEWED AND DOWNLOADED
AT:
H T T P : / / W W W. S L I D E S H A R E . N E T/ S O C I A L I Z E D S
O F T WA R E /

31. CO N TAC T M E

32. A D D I T I O N A L R ES O U RC ES
 Devops Toolchains Group
 DevOps Wikipedia Page
 Open Cloud Initiative
 NIST Cloud Computing Platform
 Open Virtualization Format Specs
 Clouderati Twitter Account
 Planet DevOps

33. C R A S H CO U RS E I N O P E N S O U RC E C LO U D
CO M P U T I N G
B Y M A R K R . H I N K L E I S L I C E N S E D U N D E R A C R E AT I V E C O M M O N S
AT T R I B U T I O N - S H A R E A L I K E 3 . 0 U N I T E D S TAT E S L I C E N S E .