Sudden Cloud outages seem to happen every few months, with no major Cloud company successfully preventing them.
Each time, well known companies and websites who should know better are caught out. The cost is time, money, reputation, and trust.
This OSDC presentation will show how to stay up when Amazon's EC2 goes down. The setup and deployment of Linux applications to EC2 will be demonstrated using Aeolus, and then you will learn how to fail them over to a public OpenStack cloud when trouble strikes -- quickly and with minimal impact.
This presentation will be of _serious interest_ to everyone who needs their public cloud applications (running on Linux) to be resilient to cloud outages.
2. Introduction to OpenStack : OSDC.de 2013 : Justin Clift : jclift@redhat.com
Who is Justin Clift?
● Senior Software Engineer @ Red Hat
● Generally works in technical Community Building roles
● Moved to OSAS (Open Source and Standards) team in
Red Hat ~1 month ago
● Expanding GlusterFS Community atm, by integrating it
with complimentary projects
● OpenStack is present focus, other projects upcoming
● Suggestions for more good integration targets welcome
:)
● @realjustinclift / jclift@redhat.com / justin@postgresql.org
3. Introduction to OpenStack : OSDC.de 2013 : Justin Clift : jclift@redhat.com
So, what is this OpenStack thing all about?
5. Introduction to OpenStack : OSDC.de 2013 : Justin Clift : jclift@redhat.comCC-BY-SA flicker user docsearls
http://www.flickr.com/photos/52614599@N00/285501241/
6. Introduction to OpenStack : OSDC.de 2013 : Justin Clift : jclift@redhat.com
OpenStack view from the clouds...
● Building blocks for creating public / private clouds
● Massive scale
● Horizontally scalable services
● Illusion of infinite resources
● Rapid provisioning / tear down of resources
● Modular services with well defined APIs
7. Introduction to OpenStack : OSDC.de 2013 : Justin Clift : jclift@redhat.com
Node Node Node Node
NodeNode Node Node Node
Node
OpenStack
Web UI
OpenStack Core Services
REST API AMQP
8. Introduction to OpenStack : OSDC.de 2013 : Justin Clift : jclift@redhat.comCC-BY-SA flicker user r-butler
http://www.flickr.com/photos/r-butler/5092400656/
9. Introduction to OpenStack : OSDC.de 2013 : Justin Clift : jclift@redhat.com
What makes up OpenStack?
Nova
Compute
Node
Glance
Image
Service
Swift
Object
Store
Cinder
Volume
Service
Keystone
Identity
Service
Horizon
Dashboard
Quantum
Networking
10. Introduction to OpenStack : OSDC.de 2013 : Justin Clift : jclift@redhat.com
● Schedules virtual machines to run on a set of nodes
● Similar in concept to Amazon EC2
● Multiple hypervisor support: KVM, Xen, LXC, + more
● Storage: iSCSI, NetApp, Nexenta, XenSM, SAN
● Native OpenStack API + EC2 API Support
Nova
Compute
Node
Glance
Image
Service
Swift
Object
Store
Cinder
Volume
Service
Keystone
Identity
Service
Horizon
Dashboard
Quantum
Networking
Nova
Compute
Node
12. Introduction to OpenStack : OSDC.de 2013 : Justin Clift : jclift@redhat.com
● Mechanism for storing and retrieving disk images
● Backends: Swift, S3, filesystem
● Image Types: raw, qcow2, vmdk, vhd, iso, ami/aki, ovf
● Public or private images & image sharing
Nova
Compute
Node
Glance
Image
Service
Swift
Object
Store
Cinder
Volume
Service
Keystone
Identity
Service
Horizon
Dashboard
Quantum
Networking
Glance
Image
Service
13. Introduction to OpenStack : OSDC.de 2013 : Justin Clift : jclift@redhat.com
OpenStack Image Service (Glance)
Glance API Glance API Glance API
Glance Registry
REST
Glance Database
14. Introduction to OpenStack : OSDC.de 2013 : Justin Clift : jclift@redhat.com
● Mechanism for storing arbitrary data
● Similar to Amazon S3 (and supports S3 API)
● Data replication/redundancy
● Commodity Hardware (RAID etc not required)
● Linear performance (optimised for scale)
Nova
Compute
Node
Glance
Image
Service
Swift
Object
Store
Cinder
Volume
Service
Keystone
Identity
Service
Horizon
Dashboard
Quantum
Networking
Swift
Object
Store
15. Introduction to OpenStack : OSDC.de 2013 : Justin Clift : jclift@redhat.com
OpenStack Object Storage (Swift)
Swift API
(Proxy Node)
Swift API
(Proxy Node)
Swift API
(Proxy Node)
REST
Storage NodeStorage Node Storage Node
Replication (rsync based)
16. Introduction to OpenStack : OSDC.de 2013 : Justin Clift : jclift@redhat.com
● Self-service web UI for managing OpenStack services
● Modular Django web application
● Provides end-user and administrator interface
● Plugin architecture (so can support non-core projects)
Nova
Compute
Node
Glance
Image
Service
Swift
Object
Store
Cinder
Volume
Service
Keystone
Identity
Service
Horizon
Dashboard
Quantum
Networking
Horizon
Dashboard
18. Introduction to OpenStack : OSDC.de 2013 : Justin Clift : jclift@redhat.com
● Common authorization framework based on tokens
● Manages users, tenants, roles
● Provides service catalogs & endpoints
● Pluggable backends: SQL, PAM, LDAP, KVS
Nova
Compute
Node
Glance
Image
Service
Swift
Object
Store
Cinder
Volume
Service
Keystone
Identity
Service
Quantum
Networking
Keystone
Identity
Service
Horizon
Dashboard
19. Introduction to OpenStack : OSDC.de 2013 : Justin Clift : jclift@redhat.com
OpenStack Identity Service (Keystone)
Keystone API
Token Identity Policy Catalog
REST
20. Introduction to OpenStack : OSDC.de 2013 : Justin Clift : jclift@redhat.com
● Provides networking as a service
● Plugin architecture to allow integration with hardware
based networking solutions
● Implements Software Defined Networks (SDN)
● Will replace Nova's Network Service
Nova
Compute
Node
Glance
Image
Service
Swift
Object
Store
Cinder
Volume
Service
Keystone
Identity
Service
Horizon
Dashboard
Quantum
Networking
Quantum
Networking
21. Introduction to OpenStack : OSDC.de 2013 : Justin Clift : jclift@redhat.com
● Created from the Nova Volume service
● Provides block storage for runtime of instances
● Enables ability to do live migration of instances
● Similar to Amazon EBS
● GlusterFS support added in Grizzly
Nova
Compute
Node
Glance
Image
Service
Swift
Object
Store
Cinder
Volume
Service
Keystone
Identity
Service
Horizon
Dashboard
Quantum
Networking
Cinder
Volume
Service
22. Introduction to OpenStack : OSDC.de 2013 : Justin Clift : jclift@redhat.com
OpenStack related projects : Heat API
● Orchestration of OpenStack deployments
● Integrates with all OpenStack core projects
● Converts a JSON template into a cloud application
● Implements well known template and API (AWS
Cloudformation)
● Version your cloud applications like your software!
● Repeatable deployments, fully automated
23. Introduction to OpenStack : OSDC.de 2013 : Justin Clift : jclift@redhat.com
● Provides AWS CloudFormation and native ReST API
● Abstract configuration of services to single-template
● Monitoring/HA/Autoscaling features
● Was in OpenStack “incubation”, now graduated
Nova
Compute
Node
Glance
Image
Service
Swift
Object
Store
Cinder
Volume
Service
Keystone
Identity
Service
Horizon
Dashboard
Quantum
Networking
Heat
Orchestration
26. Introduction to OpenStack : OSDC.de 2013 : Justin Clift : jclift@redhat.com
So who should use OpenStack?
27. Introduction to OpenStack : OSDC.de 2013 : Justin Clift : jclift@redhat.com
OpenStack deployment
●Currently geared towards deployments managed by skilled
●Red Hat is introducing a fully supported OpenStack product
●Aiming to make OpenStack consumable by a much wider a
●For evaluation/development purposes it is actually really ea
28. Introduction to OpenStack : OSDC.de 2013 : Justin Clift : jclift@redhat.com
Austin
Oct 2010
Bexar
Feb 2011
Cactus
Apr 2011
Diablo
Sep 2011
Essex
Apr 2012
Folsom
Oct 2012
● Initial Release
● OpenStack Object Storage Production Ready
● OpenStack Compute in testing
● OpenStack Compute ready for deployment
● Initial release: OpenStack Image Service
● Installation & deployment enhancements, documentation
● Scaling enhancements
● Support: KVM/QEMU, XenServer, Xen, ESX, LXC
● Initial release: OpenStack Dashboard, OpenStack Identity
● New project: Quantum
● Quantum (Networking) full inclusion
● Cinder (Volume Service)
OpenStack Releases
● First “Production Ready” Release
Grizzly
Apr 2013
Havana
~Oct 2013
● New projects in incubation: Heat (orchestration/HA) and
Ceilometer (metering)
● GlusterFS drivers for Cinder
RDO launched here
too (April 2013)
29. Introduction to OpenStack : OSDC.de 2013 : Justin Clift : jclift@redhat.com
Getting Started the Easy Way - RDO
● Launched yesterday at the OpenStack Summit :)
● Website at openstack.redhat.com
● OpenStack Grizzly Community release, packaged for
Enterprise Linux 6
● Eg: RHEL 6.x, CentOS 6.x, Scientific Linux 6.x, etc.
● Working well with RHEL derivatives is a core feature
● Also available for Fedora 18/19
● The default OpenStack in Fedora 18 repos is the older
Folsom release. Use RDO if you use Fedora and want
the latest OpenStack.
30. Introduction to OpenStack : OSDC.de 2013 : Justin Clift : jclift@redhat.com
Getting Started the Easy Way – RDO Quickstart
● http://openstack.redhat.com/Quickstart
● Everything setup on one box for easy hands on experience
● Works fine in a VM, as long as nested virt is enabled
● Uses “PackStack” - OpenStack installer for EL6/Fedora
● 3 Step installation
● $ sudo yum install -y
http://rdo.fedorapeople.org/openstack/openstack-grizzly/rdo-
release-grizzly-1.noarch.rpm
● $ sudo yum install -y openstack-packstack
● $ packstack --allinone
31. Introduction to OpenStack : OSDC.de 2013 : Justin Clift : jclift@redhat.com
Useful Links / Getting Started
● Main OpenStack website - http://openstack.org
● openstack@lists.launchpad.net
● IRC: #openstack @ freenode.net
RDO - http://openstack.redhat.com
● QuickStart
● RDO Forums
● More in depth docs than just the QuickStart :)
● Links to useful extra pieces
● eg: How-to's for GlusterFS integration plus more