Driving Behavioral Change for Information Management through Data-Driven Gree...
Â
Operating the Hyperscale Cloud
1.
2. ď˝ Into cloud since 1999
ď˝ Principal Cloud Solution
Architect at Dell
ď˝ Based in DCS, the
hyperscale solutions
group
ď˝ Lead in Dellâs work with
Azure, Joyent, and
Eucalyptus
3. ď˝ Itâs Open, Capable, and Affordable
ď˝ Dell Leadership in Community
⢠First hardware solutions vendor
⢠Active community participation
⢠Solutions now being offered
ď˝ Working with Rackspace, Opscode,
Equinix and others
ď˝ Solution Available NOW
⢠Hyperscale whitepaper
⢠Reference Architecture
⢠âCrowbarâ bare metal installer
⢠Hardware & Services
⢠with Rackspace Cloud Builders
4. We started building an
OpenStack installer,
then, we discovered something
much more important.
5. VM mgmt Billing Portals Monitoring Security
Ecosystem
API Clients
Partner
& Perform.
Orchestrate Aggregate User Mgmt. Status Identity
Templates Charging Delegation Health IP Inspect
Provisioning Thresholds VM Mgmt. Alerts Log Monitor
Amazon API OpenStack Cloud API
Compatibility
Operations Nova Glance Swift
Network
Ecosystem
Mgmt.
Ops Infrastructure
VM Mmgt. Image Mgmt. Obj. Mgmt. Monitoring
Partner
Metering
Nagios
Console
Hypervisor (KVM, Security
LDAP Xen, etc)
Chef
Operating Systems (Ubuntu, RedHat, CentOS, Windows, etc)
Crowbar
Physical Infrastructure: Servers & Networks
Dellâs Destination
for OpenStack
6. ď˝ Build a cloud installer
⢠<4 hours from box to
cloud without Internet
⢠Enable complete refresh
from RAID & BIOS up
⢠Deploy multiple
components in parallel
⢠Grow to production scale
⢠Ship-ready ASAP
7. ď˝ A Cloud Installer
APIs
Cloud
ď˝ A way to deploy the taxonomy
Ops
O/S
ď˝ Technical
Physical
⢠Discovery Engine
⢠Hardware Configuration (BIOS)
⢠Imaging State Machine
ď˝ Process
⢠Pluggable Components
⢠Cloud Deployment Logic
⢠Cloud Maintenance Model
8. Ecosystem
+API
Two Sides
Ops
of Cloud Black Box
HW
Cloud = Ops OPS
SW
APIs
CloudOps Cloud
Ops
O/S
Physical
9. ď˝ NOT ABOUT
⢠Selecting technology
⢠An end state
⢠A single product
ď˝ IS ABOUT
⢠Process innovation
⢠Business acceleration
⢠Service
Cloud is always ready,
never finished.
10. Ecosystem
+API
Ops
Black Box
Clouds have 2 sides:
1) A public facing API and
2) A hidden elastic infrastructure
11. ď˝ APIs provide the smallest usable
Ecosystem
+API
âsurface areaâ
Ops
Black Box
⢠Creates resource abstraction
(cloud is infinitely elastic)
⢠Enables standards
⢠Limits providerâs exposure
ď˝ Ecosystem exists beyond the API
⢠Creates a cloud market
⢠Targeted use cases & usability
⢠Frees the cloud provider to
focus on scale
12. Ecosystem
+API
ď˝ Inside clouds should
Ops seem to be a
Black Box
⢠perfectly performing,
⢠strictly partitioned and
⢠totally elastic resource pool.
ď˝ To the API user, it does not
matter if the inside is ugly,
inefficient, or inelegant
ď˝ Except, of course, that it
does matter a great deal to
the cloud operator.
13. HW
OPS
SW
We have capable hardware &
software, the real question is how are
we going to operate it as a service?
14. ď˝ Weâve been calling this
CloudOps
ď˝ Different mindset to
infrastructure
⢠Software is constantly changing
⢠Fluid resources instead of
servers
⢠Manual touch is poison
âAutomate or Die!â
Ultimately, all the rules for
operating the data center become
encoded as automation software.
15. ď˝ Opscode Chef Server based
⢠Classic DevOps tool
⢠Crowbar deploys using
Cookbooks & Recipes
⢠General Community Scripts
ď˝ Flexible (not prescriptive)
⢠Pluggable modules (Barclamps)
⢠Expected to be site specific
ď˝ Agile (iterative)
⢠repeatable & highly scalable
ď˝ Deploy, Fix, Redeploy, Repeat!
16. APIs & User
Access
Ops Management
Cloud
Infrastructure
Operating Systems
Physical
Resources
Crowbar drives an Ops Model to deploy
components at all layers of the cloud taxonomy.
17. ď˝ Apache 2 license
ď˝ Release pending field trials
ď˝ Working with collaboration
partners including Rackspace,
Citrix and Opscode
ď˝ To be Site Validated
⢠Via DOSS customers
⢠Working with partners
ď˝ Released as an independent
project to be submitted for
inclusion in OS at next design
conference
18.
19. ď˝ Operational
Ownership
ď˝ Donât wait for all the
kingâs horses and
consultants to put your
cloud back together
again, butâŚ
ď˝ Asking for help is OK.
20. ď˝ Simple APIs
reduce the ways that consumers
can stress the system making
the scale challenges more
predictable.
ď˝ Efficiency based
financial incentives
customers will dramatically
modify their consumption if you
offer rewards that better match
your black boxâs capabilities.
21. ď˝ Automated processes &
verification
ensures that changes and fixes
can propagate at scale while
errors are self-correcting.
ď˝ Frequent incremental
rolling adjustments
prevents the great from being
the enemy of the good so that
systems are constantly
improving (learn more about
âsplit testingâ)
22. ď˝ Passion for operational
simplicity
Complexity translates into
increased risk and reduced
agility
ď˝ Hunger for feedback &
root-cause knowledge
The only thing more
frustrating than fixing a
problem at scale, is fixing the
same problem multiple
times.
23. ď˝ More Reading?
⢠RobHirschfeld.com
⢠Dell.com/OpenStack
⢠Hyperscale white paper
ď˝ More Action?
⢠Dell OpenStack Starter Solution
(DOSS)
⢠Crowbar collaboration
ď˝ More Dialog?