ICT role in 21st century education and its challenges
Dell Crowbar and OpenStack at OSCON
1. Prying the Cloud Open:
Dell Crowbar & OpenStack
Rob Hirschfeld (@zehicle), Principal Cloud Architect
Joseph B. George (@jbgeorge), Senior Cloud Strategist
July 2011, OSCON
2. Open Cloud Operations
Intersection of two major technology waves:
Operational Automation (DevOps)
Open Source Cloud (OpenStack)
Together, a practical approach to cloud scale
Manages elastic resources
Embraces constant change
Productizes best practices
Dell Cloud Solutions 2 July 20, 2011
3. Lessons from Hyper-scale
Hyper-scale (1000s of servers) forced customers to
change their core assumptions.
To operate large systems, customers
Embraced scale out design (inconsistency is OK)
Eliminated hardware redundancy (too expensive)
Shunned manual steps (too slow)
Dell Cloud Solutions 3 July 20, 2011
4. Lessons from Public Clouds
Cloud servers forced customers to change their core
assumptions.
To operate remote virtualized systems, customers
Embraced scale out design (to get elastic growth)
Lived with weak SLAs (that was all that was offered)
Worked around lack of physical access (not available)
Dell Cloud Solutions 4 July 21, 2011
5. Clouds require an Operational Focus
Clouds demand significant
operational and process controls
SW
Operational decisions drive
OPS
hardware and software decisions
HW
We are finding ways to productize
operations into best practices
Dell Cloud Solutions 5 July 20, 2011
6. DevOps Addresses Challenges
DevOps is an operational approach that automates
system configuration and management.
To manage cloud systems, customers
Need to manage servers as groups
Must respond to rapid infrastructure changes
Have repeatable automated deployments
Dell Cloud Solutions 6 July 21, 2011
7. Missing Cloud Infrastructure
The cloud market was highly fragmented
Amazon dominated but was not public domain
VMware was building on their enterprise base
Microsoft was taking the PaaS route
Many small players but no community projects
Service Providers could not agree on APIs
Dell Cloud Solutions 7 July 20, 2011
8. Community Cloud Infrastructure
We needed Cloud Infrastructure that
Had support from major industry players
Was collaboratively developed without a single owner
Had an API that was Service Provider license friendly
Could be demonstrated to run at scale
Was built on open source components
Had global reach and support
Dell Cloud Solutions 8 July 20, 2011
12. $ TECHNICAL CONTENT AHEAD $
How DevOps is Different
Images vs. Layers
Dell Cloud Solutions 12 July 20, 2011
13. Images vs. Layers: Overview
Images: Single Unit Layers: Stacked Pieces
Configuration Integrations
Configuration
Application Foo
Integrations + Application Bar
Applications +
Utilities + Utilities
Operating System
Operating System
Dell Cloud Solutions 13 July 20, 2011
14. Images vs. Layers: Lifecycle
Images: Replacement Layers: Upgrade
Config Config Config
I I
Foo Foo
Config
Config
I+A+U+ I+A+U+ I+A+U+
Bar v1 Bar v2
O/S O/S O/S
U U
OS OS
Config Bar v2
I+A+U+
O/S
Dell Cloud Solutions 14 July 20, 2011
15. Images vs. Layers: Details
Images Layers
Like a Compiled Language Like an Interpreted Language
Early Binding Late Binding
Tightly Coupled Loosely Coupled
Assembled as a package Assembled in parts
1-Step Deployment Multi-Step Deployment
Big Storage Footprint Small Footprint (packages)
Cloned from “Golden Image” Setup per instance
Single Version Discrete Versions
Dell Cloud Solutions 15 July 20, 2011
16. Images vs. Layers: Mo’ Details
Images Layers
Very Static Operations High Change Operations
Manual Setup Automated setup
Low Entry / High Maintenance High Entry / Low Maintenance
Works well in Enterprise Works well in Cloud
Hardware Sensitive Hardware Agnostic
Brittle Elastic
Typically: Windows Typically: Linux
Dell Cloud Solutions 16 July 20, 2011
17. Images vs. Layers
Soup Sandwich
Delicious! Delicious!
Fast! Fast!
Premixed Flexible
Hard to customize Easy to customize
Hard to change Configurable
Hard to carry Very portable
Every batch is unique Components can be common
Dell Cloud Solutions 17 July 20, 2011
18. Cloud Deployments are Complex
Crowbar has
scripts that install
the components
of OpenStack
Nova in a proven
pattern that can
be customized
after the fact.
Source: Ken Pepple
Confidential 18 7/21/2011
19. CloudOps for OpenStack
There are lot of pieces, but they share many elements!
I I I I I I
Crowbar Dash Nova Nova Nova
Config
Config
Config
Config
Config
Config
Nagios
Chef Board Cntrl DB API
U U U U U U
OS OS OS OS OS OS
I I I I I I
Nova Nova Nova Nova Nova Nova
Config
Config
Config
Config
Config
Config
Node Node Node Node Node Node
U U U U U U
OS OS OS OS OS OS
Dell Cloud Solutions 19 July 20, 2011
20. CloudOps for OpenStack
Plus interconnections are highly complex and dynamic
I I I I I I
Crowbar Dash Nova Nova Nova
Config
Config
Config
Config
Config
Config
Nagios
Chef Board Cntrl DB API
U U U U U U
OS OS OS OS OS OS
I I I I I I
Nova Nova Nova Nova Nova Nova
Config
Config
Config
Config
Config
Config
Node Node Node Node Node Node
U U U U U U
OS OS OS OS OS OS
Dell Cloud Solutions 20 July 20, 2011
22. $ WARNING: TECHNICAL CONTENT AHEAD $
Crowbar Deep Dive
Dell Cloud Solutions 22 July 20, 2011
23. What is Crowbar?
Mission: “A Zero Touch Cloud Installer”
Servers in boxes to full function cloud in under 2 hours
Fast & Flexible
Bare metal install including BIOS & RAID config
Users can choose how their system is configured (“barclamps”)
DevOps Embracing
Ongoing Operations Model (DevOps for Clouds)
Leverages & Wraps Opscode Chef
Open
Not specific to OpenStack – Dell using for other Apps
Not restricted to Dell hardware
Apache 2 licensed
Dell Cloud Solutions 23 July 20, 2011
24. Crowbar Stages of Deployment
APIs, User Access,
Includes all the components required to implement
& Ecosystem an entire cloud infrastructure including ecosystems
Partners partners
Ops Management
Pluggable components deploy cloud infrastructure.
Dell “Crowbar”
Cloud
Allow for addition of Dell IP and expansion by the
Infrastructure &
Dell IP Extensions community services and customers
Can integrate with Dell existing products
Core Components & Delivers basic data center services and required
Operating Systems cloud infrastructure.
Provision bare-metal servers from box to cloud
WITHOUT user intervention (other than
Physical Resources racking/cabling and some minimal configuration
questions) NOT EXCLUSIVE TO DELL HARDWARE
* Crowbar has potential to service other programs beyond OpenStack
Dell Cloud Solutions 24 July 20, 2011
25. Crowbar = Install State Machine
Dell Cloud Solutions 25 July 20, 2011
26. Modular Design: Barclamps
APIs, User Access, Nagios Ganglia Dashboard
& Ecosystem
Partners
Nova Swift Glace
Ops Management
Dell “Crowbar”
Cloud
Infrastructure &
Compellent EqualLogic
Dell IP Extensions
Crowbar DNS Logging
Core Components &
Operating Systems Deployer NTP
Provisioner BIOS IMPI
Physical Resources
Network RAID
* Crowbar has potential to service other programs beyond OpenStack
Dell Cloud Solutions 26 July 20, 2011