1. Cloud is such stuff
as dreams are made on
Patrick Chanezon
Senior Director
Developer Relations
chanezonp@vmware.com
@chanezon Montreal, October 2012

2. @chanezon
French
Polyglot
Server Side
San Francisco
Developer Relations

3. Dreams Of my childhood
3

4. Accelerando / Singularity, in a Galaxy far far away
§ Even if we automate ourselves out of a job every 10 years
§ ...I don’t think the singularity is near!
4

5. Moore's Law is for Hardware Only
§ Does not apply to software
§ Productivity gains not keeping up with hardware and bandwidth
§ Writing software is hard, painful, and still very much a craft
5

6. Predictions
“The future is already here
— it's just not very evenly
distributed”
William Gibson
6

7. Architecture Changes: 60’s Mainframe

8. Architecture Changes: 80’s Client-Server

9. Architecture Changes: 90’s Web

10. Architecture Changes: 2010’s Cloud, HTML5, Mobile

11. Back to Client Server: Groovy Baby!
11

12. What is Cloud Computing?
Cloud According to my daughter Eliette
12

13. Cloud Stack - Classic Pyramid
Software
As A Service
Platform As A Service
Infrastructure As A Service
13

14. Cloud Stack - By Value
Software
As A Service
Platform As A Service
Infrastructure
As A Service
14

15. Cloud Stack - History
§ What does cloud mean, 4 main angles
• Software 1994 Netscape
• Infrastructure 2002 Amazon AWS
• Platform 2008 Google
• Development now!
§ Industrialization of hardware and
software infrastructure
like electricity beginning of 20th century
§ But software development itself is moving towards craftmanship
15

16. Cloud started at Consumer websites solving their needs
• Google, Amazon, Yahoo, Facebook, Twitter
• Large Data Sets
• Storage Capacity growing faster than Moore’s Law
• Fast Networks
• Vertical -> Horizontal scalability
• Open Source Software
• Virtualization
• Cloud is a productization of these infrastructures
• Public Clouds Services: Google, Amazon
• Open Source Software: Hadoop, Eucalyptus, Ubuntu, Cloud Foundry

17. Infrastructure
17

18. IaaS/Virtualization getting mainstream
§ AWS, Joyent, Rackspace,...
§ Open Source projects: OpenStack, DeltaCloud, Eucalyptus
§ Automation: Chef, Juju, Cloud Foundry BOSH
§ Standardization? DMTF
§ Inside the Firewall, Virtualization: VMware, Microsoft, Xen, KVM
§ 50% of workloads are virtualized
§ Easy to provision, manage instance...BUT
§ Still need to manage backups, software stacks, monitor, upgrades
18

19. With Infrastructure, you still need to build your own platform
§ Need to build a distributed platform on top of you infrastructure
§ Story of the AWS meltdown from last summer
• http://blog.reddit.com/2011/03/why-reddit-was-down-for-6-of-last-24.html
• http://www.readwriteweb.com/cloud/2010/12/chaos-monkey-how-netflix-uses.php
• http://news.ycombinator.com/item?id=2477296
• http://stu.mp/2011/04/the-cloud-is-not-a-silver-bullet.html
§ Twilio, Smugmug, SimpleGeo survived it because they built their own
distributed platform on top of IaaS
§ Enterprise customers want to consider Infrastructure like CDNs
• Multi Cloud usage
• Based on Open Source de facto standards, or full standards whenever that happens
19

20. Platforms
20

21. Platforms
§ Raise the Unit of currency to be application & services instead of
infrastructure
§ Google App Engine, Cloud Foundry, Heroku, CloudBees, Amazon Elastic
Beanstalk, Microsoft Azure, AppFog
§ Single or a few languages, services
§ Start of Multi language Polyglot platforms
§ Enabler for Agile Developers -> Create Business value faster
§ Lack of standards: risk, vendor lock-in
§ Enterprise needs:
• Control, customizability
• Private/Hybrid Cloud
21

22. Agile Development Processes

23. Agility as a survival skill
§ Consumer software is becoming like fashion
• Phone apps, social apps, short lifetime, fast lifecycles
• A/B testing
§ Enterprise
• Clay shirky situational apps
§ Kent Beck, Usenix 2011 Talk, “Software G-Forces: the effects of acceleration”
change in software process when frequency grows
§ Cloud Platforms enables an Agile culture, driver for innovation
• Scalability is built in the platforms
• Can iterate faster
23

24. Main Risk: Lock-In
Welcome to the hotel california
Such a lovely place
Such a lovely face
Plenty of room at the hotel california
Any time of year, you can find it here
Last thing I remember, I was
Running for the door
I had to find the passage back
To the place I was before
’relax,’ said the night man,
We are programmed to receive.
You can checkout any time you like,
But you can never leave!
24

25. Cloud Foundry: The Open PaaS
• Open Source: Apache 2 Licensed
• multi language/frameworks
• multi services
• multi cloud
Ap
pli
vFabric
ce
Private
ca
Postgres
rfa
tio Clouds
nte
n
Data Services
Se
rI
Public
e
vFabric rvi
vid
RabbitMQTM ce
Clouds
ro
Msg Services
dP
Micro
ou
Clouds
Cl
Other Services
25

26. Lessons for
Developers
26

27. Predictions
• Software is becoming like fashion, design rules
• Welcome to Babel, use the best tool for the job, embrace
multiple language & heterogeneity
• Our jobs will change, build yourself out of your current job
• Sysadmin jobs will morph, there will be less of them
• Many opportunities open when you embrace change
27

28. Things to forget
• First normal form
• Waterfall model
• Single server deployment
• Single language skill
• Build everything from scratch
• Build custom infrastructure
28

29. Things to learn
• Agile
• Take risks, fail often, fail fast and learn
• API Design: create the API first
• UI Design, Javacript, HTML5, CSS3
• A/B Testing
• Open Source, Open Standards
• Architecture, Distributed Computing (CAP theorem, 8 fallacies)
• Cloud Platforms and APIs
• Multiple types of languages (imperative, object, functional, logic)
• Ability to encapsulate domain knowledge in a DSL
• Build on the shoulders of giants: reuse, REST APIs
• Pick your battles, choose what you need to build yourself to add
value
• Learn to live in a box (embrace platform limitations) to think
outside the box
• Use an App Store for distribution
29

30. The Open
Platform as a Service
Deploy and scale applications in
seconds, without locking yourself into a
single cloud
30

31. “I just want to deploy my code…”
31

32. What if…
target
<any
cloud>
push
<my
app>
bind
<my
services>
instances
<my
app>
+100
32

33. What’s Happening with Applications Today?
Frameworks are what really matter
• Developer productivity and innovation
• Reduce time to market
New application types
• Mobile, Social, SaaS
• Apps released early and often
Data intensive
• Emerging requirements: elasticity, multi-cloud
• Web orientation drives exponential data volumes
Deployed on virtual and cloud infrastructures
• Virtualization, Cloud, PaaS
33

34. Cloud Foundry – The Open Platform as a Service
Target a choice of
deployment clouds
Provide a choice of Bind a choice of
development application
frameworks services
github.com/cloudfoundry
34

35. Why Cloud Foundry?
Developer Agility
• Friction-free way to develop, test and deploy applications
• Focus on writing applications, not meddling with middleware and infrastructure
Portability without changes
• Write once, test-scale-deploy to private/public clouds without code changes
• Quickly build and test on a laptop and scale to the cloud
Open - The freedom to choose
• Choice of clouds for deployment, industry frameworks, and application services
• Extensible architecture to “future proof” for rapid cloud innovation
• Community open-source project - access, evaluate and contribute
35

36. CloudFoundry.COM – Multi-Tenant PaaS Operated by VMware
CloudFoundry.COM (beta)
Frameworks
Services
vCenter / vSphere
Infrastructure
36

37. Micro Cloud FoundryTM – Industry First Downloadable PaaS
Micro Cloud Foundry
Frameworks
Services
Your Laptop/PC
Single VM instance of
Cloud Foundry
that runs on a developer’s
MAC or PC
37

38. CloudFoundry.ORG – Community Open Source Project
github.com/cloudfoundry
§ .NET x 2 § Memcached
§ PHP § SQL Server
§ JRuby § Neo4j
§ Python § CouchDB
§ Rails 2.x § VirtualBox
§ Clojure § Mono
§ Erlang § Rack
§ Haskell
38

39. CloudFoundry.ORG – Community Open Source Project
CloudFoundry.ORG
Community Frameworks Contributions
Community Services Contributions
Your Infrastructure
Download Setup Tool Chain & Deploy Behind
Code Environment Scripts Firewall
Cloud
Foundry
BOSH
Apache2
license
39

40. Cloud Foundry Open Source Workflow
cloudfoundry.com
production updated ~2x/week
github
github.com/cloudfoundry
on +2 and ✓ change pushed to github
Reviewers +1/-1 Gerrit Code Review +2/-2 Committers
reviews.cloudfoundry.org
test verification score ✓ ✗ git push triggers test execution
Jenkins CI
ci.cloudfoundry.org
40

41. Open Source Advantage: moves faster
§ http://code.google.com/p/googleappengine/issues/detail?id=13
• https://github.com/cloudfoundry/vcap/pull/25
41

42. Open Source Advantage: diverse communities
§ Juju Charms to setup a multi node Cloud Foundry in 10 minutes
§ See Brian Thomason & Juan Negron’s UDS 2011 session
http://cloud.ubuntu.com/2011/09/from-zero-to-drawbridge-via-ubuntu-
server-ensemble-and-cloudfoundry-in-less-than-10-minutes/
42

43. Open Source Advantage: more innovation
43

44. Open Source Advantage: faster adoption
283% growth of Twitter followers in 2012
From Richard Seroter’s post
http://seroter.wordpress.com/2012/07/18/measuring-ecosystem-popularity-through-twitter-follower-count-growth/
44

45. Cloud Foundry turned 1 year old april 11
§ Services
• Caldecott – tunnel into your services, explore with standard client tools
• PostgreSQL, RabbitMQ
§ Frameworks, Runtimes, and Tools
• Java, Ruby, Node & Play Auto-Reconfiguration
• Scala, node.JS, Erlang, JRuby, PHP, Python, .NET, Spring 3.1, Grails 2.0, Play 2.0
• Multi-Node Chef based deployment tools
• Maven Plugin, Eclipse Integration
• VMC manifests, Java Debugging, Rails Console
• Standalone applications
• native npm support in Node
• Java 7, Node 0.8.2, Ruby 1.9
• Eclipse tunneling, better ruby gem support
§ Micro Cloud Foundry x 3
45

46. Cloud Foundry turned 1 year old april 11
§ Services
• Caldecott – tunnel into your services, explore with standard client tools
• PostgreSQL, RabbitMQ
§ Frameworks, Runtimes, and Tools
• Java, Ruby, Node & Play Auto-Reconfiguration
• Scala, node.JS, Erlang, JRuby, PHP, Python, .NET, Spring 3.1, Grails 2.0, Play 2.0
• Multi-Node Chef based deployment tools
• Maven Plugin, Eclipse Integration
• VMC manifests, Java Debugging, Rails Console
• Standalone applications
• native npm support in Node
• Java 7, Node 0.8.2, Ruby 1.9
• Eclipse tunneling, better ruby gem support
§ Micro Cloud Foundry x 3
45

47. Broad Industry Investment
46

48. Multi-Cloud Flexibility is Critical
§ Make use of both public and private clouds without rewriting your
applications
§ Protect against vendor lock-in
§ Meet different compliance and geographical needs
§ Manage your growth, accommodate peak loads & optimize costs
Public Private Micro
Clouds Clouds Clouds
47

49. Cloud Foundry - Making Multi-Cloud a Reality
Private Cloud Public Cloud
Management and
Distributions Operators
.COM
Bare metal
48

50. Cloud Foundry – Key Use Cases
New applications App modernization
Dev-test-trial SaaS extensibility
49

51. Cloud Foundry Logical View
Developers Users
vmc
Routers
CloudControllers App App
HealthManager
Execution Agents
Services
(DEA) Pool
Messaging

52. Cloud Foundry
BOSH
51

53. Production Grade Cloud Foundry Clusters
§ 500 – 5,000 VMs cloudfoundry.com
§ 40+ unique node types
§ 75+ unique software packages
§ 75+ unique environments
§ 2x/week cf.com updates
§ 24x7x365 non-stop operation
§ No-downtime deployments
§ Reliable, robust, repeatable
deployments, updates, capacity
adjustments
§ Small teams manage many
instances production, staging, stress, qa, dev
Google style problem è Google style solution
52

54. Cloud Foundry BOSH
§ Cloud Foundry BOSH is an open source tool-chain for release
engineering, deployment, and lifecycle management of large scale
distributed services
• Prescriptive way of creating releases and managing systems and services
• It is not a collection of shell scripts, not a pile of Perl
§ Built to deploy and manage production-class, large scale clusters
• Production grade Cloud Foundry clusters: 500+ VMs, 40+ jobs, 75+ packages
• Multi-node, multi-tier, complex clusters: e.g., our Gerrit/Jenkins Cluster
§ Built for devops usage and scale by a crack team of veterans
• A project, not a product: command line interface, YAML, etc.
• Continuous improvement, iterative development, rough edges
github.com/cloudfoundry/bosh
53

55. BOSH: under the hood
BOSH User
“BOSH is deployed by BOSH”
bosh cli director healthmon
cloudfoundry.com
db redis nats
workers blobs active jobs
agent
IaaS CPI stemcell disk
54

56. IaaS neutral by design
vSphere: battle tested implementation, thousands of
deployments CPI: code complete
vCloud Director: “work in progress”, 2H 2012 functional status: “work in progress”
Cloud Foundry BOSH
Cloud Provider Interface (CPI)
github.com/piston/openstack-bosh-cpi
contribute: github.com/cloudfoundry/bosh
55

57. BOSH Resources
@DrNic
http://drnicwilliams.com/2012/04/16/creating-a-bosh-from-scratch-on-aws/
@BrianMMcClain
http://www.brianmmcclain.com/2012/05/08/using-bosh-with-vsphere-part-2/
@VadimSpivak
http://www.youtube.com/watch?v=pASQT5mGc_g
https://github.com/cloudfoundry/bosh
https://groups.google.com/a/cloudfoundry.org/group/bosh-users/topics
https://github.com/piston/openstack-bosh-cpi
56

58. Key Takeaways
§ PaaS is the application platform for the Cloud era
§ Cloud Foundry is the Industry’s Open PaaS
• Developer agility
• Portability without changes
• Open system
§ What’s next?
• Free Signup: www.cloudfoundry.com
• Get started: docs.cloudfoundry.com/getting-started.html
• Learn more on the blog: blog.cloudfoundry.com
• Download your Micro Cloud Foundry: my.cloudfoundry.com/micro
• Get the source code: www.cloudfoundry.org
• Follow us: @cloudfoundry
• Watch us: www.youtube.com/cloudfoundry
57

59. Register today
http://cloudfoundry.com/signup
Use Promo Code montreal2012
To avoid approval queue waiting time
Come to our booth to get a T-shirt
Deploy an app to get a preshavedyack hoodie!
58