How to Troubleshoot Apps for the Modern Connected Worker
IBM Open Cloud Update XCITE Fall 2014
1. IBM Open Cloud Update
Why an Open Cloud Matters
IBM Distinguished Engineer, CTO Cloud Interoperability
Christopher Ferris
2. Open technologies: IBM is leading the way
Cloud
Computing
e-Business
Service Oriented
Architecture
Social
Business
Mobile
Computing
Open Cloud
Architecture
Dynamic
Cloud
3. Building the next generation of cloud
architecture on open technologies
OAuth
OSL
C
Software
as a Service
Platform
as a Service
Infrastructure
as a Service
API
economy
Cloud
operating
environment
Software-defined
environment
TOSCA
http://www.ibm.com/developerworks/cloud/library/cl-open-architecture/
4. IBM is building on open technologies across
its offerings portfolio
Think it. Build it. Tap into it.
Enabling business transformation
Marketplace of high value consumable business applications
TOSCA
Composable and integrated application development platform
Enterprise class, optimized infrastructure
OAuth
Public. Private. Dynamic Hybrid.
OSLC
Smarter
Commerce
Smarter
Analytics
Smarter
Cities
Social
Business
Watson
Solutions
Software
Solutions
API
economy
Cloud
operating
environment
Software-defined
environment
5. What we need is an open PaaS platform
5
Developers represent a diverse set of unique
skills & motivations individually tailored to
address specific challenges
Mobile Developer
•Python, JavaScript
& Objective-C
• Git, Jira
•CouchDB
•Cordova
PaaS offerings can help developers & operations meet that challenge with
their unique skills but not all PaaS offerings were created equal
Data Scientist
•Python & Java
•Hadoop & MongoDB
•Node.JS
•Rational Team
Concert
UI Designer
• JavaScript,
.NET & HTML5
•PostgreSQL
•jQuery, Dojo
•Drupal
Backend Developer
•Java, PHP, Perl, C,
& JavaScript
•SQL & NoSQL
•JSON, XML
•Subversion
Full Stack Developer
• JavaScript, .NET &
HTML5
•PostgreSQL
•jQuery, Dojo
•Drupal
6. Agile Composition and Continuous Delivery
6
Add Monitoring
service instance
5
4
3
2
Create app
Add database
service
Extract social media
data into database
Add social
analytics service
Secure the service
1
ITERATE
TASK:
Create a secure application that
analyses sentiment about certain
topics in social media
7. Why Cloud Foundry?
Deploy in seconds not weeks or months
No need to talk to anyone else
Polyglot runtimes
Java, Node.js, Ruby, Python, Go, PHP, …
Easily integrate internal and 3rd party services/APIs
Open Source runtime platform
IaaS independent – runs in the cloud or on-premise
Potential for vibrant community & ecosystem
8. Cloud Foundry Background
• Mid 2009: Cloud Foundry development begins
• April 2011: Public launch of Open Source PaaS / cloudfoundry.com
• April 2012: Public launch of Open Source BOSH
• April 2013: Pivotal created from EMC & VMware around SW and OSS assets including
Cloud Foundry, Rabbit, Spring, …
• February 2014: Announced move to establish open governance Foundation along
with seven Platinum Members and two Gold Members
• May 2014: Announced expanded Foundation Gold Membership with the addition
of eight new companies
• June 2014: Announced doubling of Foundation to a total of 35 participants
10. The Cloud Foundry Foundation
SPONSORS
35 739k
Platinum Members
Gold Members
Silver Members
LINES OF CODE
PULL REQ
1000+
CONTRIBUTING
COMPANIES
46+
Cloud Foundry is quickly becoming the de facto
open PaaS platform, on similar growth
trajectory as OpenStack
The addition of several new members signals a solid
commitment to create a truly open community &
ecosystem, one that accelerates development
& drives robust growth.
11. Cloud Foundry Foundation Mission Statement
To establish and sustain Cloud Foundry as the global
industry standard Platform-as-a-Service (PaaS)
technology with a thriving ecosystem; to deliver continuous
quality, value and innovation to users, operators and
providers of Cloud Foundry technology; and, to provide a
vibrant agile experience for the community's developers
that delivers the highest quality cloud-native applications
and software, at high velocity with global scale.
12. San Francisco Cloud Foundry Summit 2014: attendance doubles
Cloud Foundry Summit Twitter sentiment
•5100+ mentions of #CFSummit, CF Summit &
Cloud Foundry Summit
•3246 mentions of Cloud Foundry
•5000+ mentions of #PaaS during Summit
Summit growth signals dynamic ecosystem
904 in attendance (100% growth)
179 developers signed up for Java & CF Meet Ups
Bluemix a major summit feature w/ a successful signup drive
67 speakers delivered 60 keynotes, panels, talks & sessions
Conference organizers encountered many new dev candidates
13. Highlighting IBM’s contributions
• Community growth &
participation parity critical to
strong open governance of
the Cloud Foundry foundation
• A robust codebase written by
many developers grows the
ecosystem by attracting new
users, adoptors & contributors
• An active campaign to grow
the community strengthens
the ecosystem with new
skills, ideas & viewpoints
Build the
foundation
Develop a robust
codebase
Foster the
community
Positive feedback from analyst & press coverage
14. IBM Bluemix: Enterprise-grade PaaS
Composable services dev & runtime environment
built on Cloud Foundry for enterprise readiness
Leveraging open source API services, BlueMix
• Run apps in almost any language
• Built on open technologies
• Provides integration services to systems of record
• Designed for mobile
• Provides DevOps services for integrated dev
BlueMix
leverages
600+ Open
Source
Packages
IBM added
Enterprise
capabilities
Open
source
components
experience
App Development for Cloud
IBM’s Application Composition Environnent
(ACE UI)
Capabilities as a Service
IBM Services (SQLDB, JSONDB, Mobile backend
services, Monitoring, Map Reduce, Cloudant) &
runtimes (IBM WebSphere Liberty & the Node.js
buildpacks.
Cloud Integration
Build hybrid environments. Connect to on-premises
systems of record plus other public &
private clouds, e.g. Twilio & Pitney Bowes.
Built on IBM SoftLayer
Runs on top of IBM’s leading infrastructure
as a service.
Cloud Foundry
Vanilla Cloud Foundry including the community
services MySQL, PostgreSQL,
MongoDB & more
15. Cloud Foundry: Architecture Overview
Cloud Foundry Fabric
Warden Warden Syslog
BOSH / Outer Shell
DevOps environment for continuous updates of CloudFoundry Fabric components
Infrastructure
OpenStack, vSphere, Amazon EC2, etc.
Aggregator
Loggregator
16. What’s Been Delivered in the Last 12 Months
• Runtime
– v1 -> v2 transition and production quality
– High Availability of almost all components
– Removal of all SPOF in CF Runtime
– rewritten router in golang
– rewritten health manager in golang
– Switch to Buildpacks (much easier to extend the platform)
– Tolerate Outage of a full AZ (Thanks IBM)!
– Easy buildpack management
– No internet required for install/run/update
– Usage events(chargeback/showback)
– Audit Events
– progress towards extensible runtime with Diego and golang rewrite to
support enable.NET, Docker, as possible in future
– Many process types (web/worker/etc) in a single app
• Identity
– Easy LDAP / Active Directory integration
– Single Login server for User DB, LDAP/AD, SAML
– Easy to skin
• Logging (Loggregator)
– User configurable syslog drains for all app related logs
– All app related events are in the log
– CF components all support syslog draining
• CLI
– complete rewrite with native installers and lots of new features
BOSH
• AWS support is 1st class (before it was a demo)
• OpenStack support is 1st class
• vCloud support added in addition to vSphere
• Resurrector feature for HA
• Errands for 1-off tasks
• Co-location for mixing content from multiple releases
• cleaning up tons of debt
Community Support for additional clouds
(BOSH CPIs)
• Google Compute Engine
• Apache CloudStack
• CenturyLink/Savvis
• VMware vCloud
Services
• v2 Service Broker API
• SSO Dashboards
• MySQL release
• RiakCS release
Documentation infrastructure
• docs are much improved (still need more work, but made lots
of progress)
Infrastructure
• Continuous Integration
• Public Trackers
• Community Pair
18. Cloud Foundry Development Priorities
• Diego
• Organization buildpack policy
• Inbound access policy
• SNI support for custom TLS certs
• End to end protection for app interactions
• Key management/Credential Vault
• Deeper Docker integration
• .NET
• LDAP/AD integration
• Audit trail for all APIs
• Custom roles with permissions
• Asynch service provisioning
• Parameterized service provisioning
• Docker for BOSH release packaging
19. Get Involved
Try it!
http://cloudfoundry.org/about/index.html
Participate
Monthly Community Advisory Board open forums last Wednesday of
every month
Subscribe to vcap-dev and bosh-developer Google groups
Find or start a meetup group http://cloud-foundry.meetup.com/all/
Contribute
cloudfoundry - https://github.com/cloudfoundry
IBM Executive Leadership
IBM Sponsor Session: OpenStack is Rocking the Open Cloud movement
Danny Sabbah video featured in Canonical Keynote
6 Analyst 1:1 Meetings
IBM Booth Featuring:
Power8 Server – Several Warm Leads
BlueMix – 1,600 Registration Spike on Day 1
IBM OpenStack Products – Orchestrator, Cloud Manager, Power VC
Effective Attractions – Rockin’ T-shirts, Oculus Rift
Total of 100+ company visits
IBM Sponsored Track
200+ unique attendees (>100 per session)
4 IBM dedicated presentations – Open Cloud, Cloud Manager, Orchestrator,
and SoftLayer.
Significant Q&A Sessions
Expo Theater
SoftLayer demo – One of the more highly attended
Demo partnership with Cloud Manager team – end to end support
IBM Technical Leadership
12 Technical Sessions
15 Design Sessions
Average +250 interests for IBM Technical Sessions
Highest rated IBM session had over 500 interests
IBM design proposals very well received
Significant interlocks with other technical leaders
Major progress in closing design issues led by IBM in several areas
IBM Cross Brand Teaming
Daily Debrief Sessions
Over 120 IBMers from SWG, Research, GTS, STG, IBM Sales team
Team building event Tuesday evening - nearly all IBMers in attendance
IBM Executive Leadership
IBM Sponsor Session: OpenStack is Rocking the Open Cloud movement
Danny Sabbah video featured in Canonical Keynote
6 Analyst 1:1 Meetings
IBM Booth Featuring:
Power8 Server – Several Warm Leads
BlueMix – 1,600 Registration Spike on Day 1
IBM OpenStack Products – Orchestrator, Cloud Manager, Power VC
Effective Attractions – Rockin’ T-shirts, Oculus Rift
Total of 100+ company visits
IBM Sponsored Track
200+ unique attendees (>100 per session)
4 IBM dedicated presentations – Open Cloud, Cloud Manager, Orchestrator,
and SoftLayer.
Significant Q&A Sessions
Expo Theater
SoftLayer demo – One of the more highly attended
Demo partnership with Cloud Manager team – end to end support
IBM Technical Leadership
12 Technical Sessions
15 Design Sessions
Average +250 interests for IBM Technical Sessions
Highest rated IBM session had over 500 interests
IBM design proposals very well received
Significant interlocks with other technical leaders
Major progress in closing design issues led by IBM in several areas
IBM Cross Brand Teaming
Daily Debrief Sessions
Over 120 IBMers from SWG, Research, GTS, STG, IBM Sales team
Team building event Tuesday evening - nearly all IBMers in attendance
IBM Executive Leadership
IBM Sponsor Session: OpenStack is Rocking the Open Cloud movement
Danny Sabbah video featured in Canonical Keynote
6 Analyst 1:1 Meetings
IBM Booth Featuring:
Power8 Server – Several Warm Leads
BlueMix – 1,600 Registration Spike on Day 1
IBM OpenStack Products – Orchestrator, Cloud Manager, Power VC
Effective Attractions – Rockin’ T-shirts, Oculus Rift
Total of 100+ company visits
IBM Sponsored Track
200+ unique attendees (>100 per session)
4 IBM dedicated presentations – Open Cloud, Cloud Manager, Orchestrator,
and SoftLayer.
Significant Q&A Sessions
Expo Theater
SoftLayer demo – One of the more highly attended
Demo partnership with Cloud Manager team – end to end support
IBM Technical Leadership
12 Technical Sessions
15 Design Sessions
Average +250 interests for IBM Technical Sessions
Highest rated IBM session had over 500 interests
IBM design proposals very well received
Significant interlocks with other technical leaders
Major progress in closing design issues led by IBM in several areas
IBM Cross Brand Teaming
Daily Debrief Sessions
Over 120 IBMers from SWG, Research, GTS, STG, IBM Sales team
Team building event Tuesday evening - nearly all IBMers in attendance