To learn more about Pivotal Cloud Foundry, visit pivotal.io/platform-as-a-service/pivotal-cloud-foundry

1. © Copyright 2014 Pivotal. All rights reserved.
The image cannot be
displayed. Your computer may
not have enough memory to
Pivotal Cloud Platform Deep Dive
Architecture and The Operator Experience
1

2. © Copyright 2015 Pivotal. All rights reserved.
Architecture and the Operator Experience
• Pivotal Cloud Foundry Architecture
• Structured Platform for Cloud Native Apps
• One Click CenturyLink Ops Manager and CenturyLink Dashboard
• The Operator Experience

3. © Copyright 2014 Pivotal. All rights reserved. 3
This…. (not cool)."

4. © Copyright 2014 Pivotal. All rights reserved. 4
And this…(also not cool)

5. © Copyright 2014 Pivotal. All rights reserved. 5
Loggregator
DEA Pool
Router
Cloud Controller
BOSH Director BOSH Agent
UAA/Login Servers Health Manager
Service Broker Node(s)
Messaging (NATS)
!
IaaS
Cloud Foundry Architecture Stack"

6. © Copyright 2014 Pivotal. All rights reserved. 6
Router
Cloud Controller
Service Broker
Node(s)
DEA
DEA
DEA
DEA
Blobstore DB
Runtime
1. Upload bits/metadata
2. Create/bind services
3. Stage app
4. Deploy app
push app
+ app MD
SC
+ =
Pushing an application"

7. © Copyright 2014 Pivotal. All rights reserved. 7
Router
Cloud Controller
DEA
Blobstore DB
Runtime
Detect
Compile Upload
No
System
Buildpacks
+ =
Yes
`"
Runtime

8. © Copyright 2014 Pivotal. All rights reserved. 8
BlobstoreRouter Cloud Controller
DEA
Messaging (NATS)
DEA DEA
Runtime
Access
App
Application containers and scaling"

9. © Copyright 2014 Pivotal. All rights reserved. 9
DB
Router
Service
credentials
reserve resources
obtain connection data
CLI Cloud
Controller
Service
Broker
Data
Service
Runtime
create service (HTTP)
bind service (HTTP)
create service (HTTP)
bind service (HTTP)
Service create and bind"

10. © Copyright 2014 Pivotal. All rights reserved. 10
2 Key Components to Pivotal Cloud Foundry
• Ops Manager/ Operations Manager: A web application that
you use to deploy and manage a Pivotal Cloud Foundry
PaaS
• Elastic Runtime: The set of core Cloud Foundry services that
are installed, upgraded and scaled via Ops Manager

11. © Copyright 2014 Pivotal. All rights reserved.
Demo"

12. © Copyright 2014 Pivotal. All rights reserved. 12
Pivotal CF deployment on CenturyLink Cloud"

13. © Copyright 2014 Pivotal. All rights reserved. 13

14. © Copyright 2014 Pivotal. All rights reserved. 14

15. © Copyright 2014 Pivotal. All rights reserved. 15

16. © Copyright 2014 Pivotal. All rights reserved. 16

17. © Copyright 2014 Pivotal. All rights reserved. 17

18. © Copyright 2014 Pivotal. All rights reserved. 18

19. © Copyright 2014 Pivotal. All rights reserved. 19

20. © Copyright 2014 Pivotal. All rights reserved. 20

21. © Copyright 2014 Pivotal. All rights reserved. 21

22. © Copyright 2014 Pivotal. All rights reserved. 22

23. © Copyright 2014 Pivotal. All rights reserved. 23

24. © Copyright 2014 Pivotal. All rights reserved. 24

25. © Copyright 2014 Pivotal. All rights reserved. 25

26. © Copyright 2014 Pivotal. All rights reserved.
The image cannot be
displayed. Your computer may
not have enough memory to
© Copyright 2014 Pivotal. All rights reserved.
What’s on Pivotal Cloud Foundry
for an operator?
26

27. © Copyright 2014 Pivotal. All rights reserved. 27
Pivotal Cloud Foundry operations"
Developer
Operator

28. © Copyright 2014 Pivotal. All rights reserved. 28
Install runtime
and container
Deploy to dev

29. © Copyright 2014 Pivotal. All rights reserved. 29
Install runtime and
container
Install services (db,
messaging, hadoop, …)
Deploy to dev

30. © Copyright 2014 Pivotal. All rights reserved. 30
Install runtime and
container
Install services (db,
messaging, hadoop, …)
Setup load-balancing, SSL
termination and
dynamic routing
Deploy to dev

31. © Copyright 2014 Pivotal. All rights reserved. 31
Install runtime and
container
Setup load-balancing, SSL
termination and dynamic
routing
Setup / config High
Availability
Deploy to dev
Install services (db,
messaging, hadoop, …)

32. © Copyright 2014 Pivotal. All rights reserved. 32
Install runtime and
container
Setup load-balancing, SSL
termination and dynamic
routing
Setup / config High
Availability
Setup APM
Deploy to dev
Install services (db,
messaging, hadoop, …)

33. © Copyright 2014 Pivotal. All rights reserved. 33
Install runtime and
container
Setup load-balancing, SSL
termination and dynamic
routing
Setup / config High
Availability
Setup APM
Setup log
streaming
Deploy to dev
Install services (db,
messaging, hadoop, …)

34. © Copyright 2014 Pivotal. All rights reserved. 34
Install runtime and
container
Setup load-balancing, SSL
termination and dynamic
routing
Setup / config High
Availability
Setup APM
Setup log
streaming
Deploy to dev
App Deployed
Install services (db,
messaging, hadoop, …)

35. © Copyright 2014 Pivotal. All rights reserved. 35
Install runtime and
container
Install services (db,
messaging, hadoop, …)
Setup load-balancing and
dynamic routing
Setup / config High
Availability
Setup APM
Setup log
streaming
Deploy to dev
Deploy to Test
Deploy to QA
Promote to production
Scale up
Update app
Scale down
Redeploy
Unbind service
Bind service
Restart server
Change route
Scale Platform
Create service
Delete App
Blue-green deployment
Check logs
scale memory
Update app server
Change JDK
Upgrade app

36. © Copyright 2014 Pivotal. All rights reserved. 36
Install runtime and
container
Install services (db,
messaging, hadoop, …)
Setup load-balancing and
dynamic routing
Setup / config High
Availability
Setup APM
Setup log
streaming
Deploy to dev
Deploy to Test
Deploy to QA
Promote to production
Scale up
Update app
Scale down
Redeploy
Unbind service
Bind service
Restart server
Change route
Scale Platform
Create service
Delete App
Blue-green deployment
Check logs
Escale memory
Update app server
Change JDK
Upgrade app

37. © Copyright 2014 Pivotal. All rights reserved.
Deploy to dev
The Pivotal CF way"

38. © Copyright 2014 Pivotal. All rights reserved.
Deploy to dev
>cf push!
Cloud
Controller
Health
Manager
NATS
(message bus)
Router
App Deployed
The Pivotal CF way"

39. © Copyright 2014 Pivotal. All rights reserved. 39
The operator in the PaaS era"
Developer
Operator

40. © Copyright 2014 Pivotal. All rights reserved. 40
The operator in the PaaS era"

41. © Copyright 2014 Pivotal. All rights reserved. 41
Operator
Concerns
Monitor the
platform
Handle upgrades
and updates
Plan capacity
Manage users
and quotas
Install the
platform
Setup High
Availability

42. © Copyright 2014 Pivotal. All rights reserved. 42
IaaS
Pivotal CF
Install the
platform
Setup High
Availability
Handle live upgrades
and updates
Scale and
plan capacity
Install and
manage
servicesTarget multiple
clouds

43. © Copyright 2014 Pivotal. All rights reserved. 43
IaaS
BOSH Director BOSH Agent
Mobile Services
for Pivotal CF
ElasticSearch
for Pivotal CF
CloudBees Jenkins
Enterprise
Cassandra
for Pivotal CF

44. © Copyright 2014 Pivotal. All rights reserved. 44
IaaS
BOSH Director BOSH Agent
Mobile Services
for Pivotal CF
ElasticSearch
for Pivotal CF
CloudBees Jenkins
Enterprise
Cassandra
for Pivotal CF
Click to install
No downtime updates
Explore install logs
Click to scale the platform
Built-in High Availability
Built-in Platform Monitoring
Integrated services

45. © Copyright 2014 Pivotal. All rights reserved.
BOSH"

46. © Copyright 2014 Pivotal. All rights reserved. 46
Provision services,
not machines
Enables continuous
delivery
Cloud-agnostic view of
Platform Ops
Holistic Toolchain for
“rule them all"
Eliminate bespoke
automation on top of
config management
Why BOSH"

47. © Copyright 2014 Pivotal. All rights reserved. 47
Ops Manager + BOSH"
Blobstore
BOSH
Health
Monitor
DB
Deploy my
Services
Worker VMs
Messaging
Health Manager
Cloud Controller
BOSH Director
NATS
IaaS

48. © Copyright 2014 Pivotal. All rights reserved. 48
Operator
Concerns
Monitor the
platform
Handle upgrades
and updates
Plan capacity
Manage users
and quotas
Install the
platform
Setup High
Availability

49. © Copyright 2014 Pivotal. All rights reserved. 49
Orgs, Spaces, Users and Quotas"

50. © Copyright 2014 Pivotal. All rights reserved. 50
Organizations"
Logical division within a Pivotal CF
install / Foundation.
Each organization has its own users
and assigned quota
User permissions / roles are specified
per space within an organization
Sub-divided into Spaces

51. © Copyright 2014 Pivotal. All rights reserved. 51
Quotas and Plans"
Different quota limits (e.g. “small”,
“enterprise”, “default”, “runaway”)
can be assigned per Organization
Quota defines
• Total Memory
• Total # of Services
• Total # of Routes

52. © Copyright 2014 Pivotal. All rights reserved. 52
Spaces"
Logical sub-division within an
organization
Services and Applications are
created / specified per Space
Users authorized at an organization
level can have different roles per
space
Same Service can have different
meanings per space

53. © Copyright 2014 Pivotal. All rights reserved. 53

54. © Copyright 2014 Pivotal. All rights reserved. 54
Operator
Concerns
Monitor the
platform
Handle upgrades
and updates
Plan capacity
Manage users
and quotas
Install the
platform
Setup High
Availability

55. © Copyright 2014 Pivotal. All rights reserved. 55
Platform Monitoring"
How do I know when to scale DEAs?
How many requests each Router is servicing?
What is the current load of my Cloud Controllers?

56. © Copyright 2014 Pivotal. All rights reserved. 56
Platform Monitoring"
Pivotal Ops Metrics provides a single
JMX interface to access metrics for
each Pivotal CF component
• DEAs
• Cloud Controllers
• Routers
• Health Managers
• NATS, UAA, Login Server, …

57. © Copyright 2014 Pivotal. All rights reserved. 57
Platform Monitoring"
Collector
JMX
Provider
JMX Monitoring
Tool

58. © Copyright 2014 Pivotal. All rights reserved. 58
Platform Monitoring"
Collector
JMX
Provider
JMX Monitoring
Tool

59. © Copyright 2014 Pivotal. All rights reserved. 59
Operator
Concerns
Monitor the
platform
Handle upgrades
and updates
Plan capacity
Manage users
and quotas
Install the
platform
Setup High
Availability

60. © Copyright 2014 Pivotal. All rights reserved. 60
4 Layers of built-in High Availability"
Application Instance
Platform Processes
Platform VMs
Availability Zones

61. © Copyright 2014 Pivotal. All rights reserved. 61
4 Layers of built-in High Availability"
Application Instance
Platform Processes
Platform VMs
Availability Zones

62. © Copyright 2014 Pivotal. All rights reserved. 62
App Instance HA"
Blobstore
Router
Cloud Controller
DEA
Messaging (NATS)
DEA DEA
Runtime
Health Manager
Actual State
Cloud Foundry

63. © Copyright 2014 Pivotal. All rights reserved. 63
4 Layers of built-in High Availability"
Application Instance
Platform Processes
Platform VMs
Availability Zones

64. © Copyright 2014 Pivotal. All rights reserved. 64
Platform Processes HA"
Blobstore
BOSH
Health
Monitor
DB
Messaging
Health Manager
Target
VM
Cloud Controller
BOSH Director
NATS
Agent
Agent
Agent
Process
Process
Process
Pivotal CF
DEA
Agent Process

65. © Copyright 2014 Pivotal. All rights reserved. 65
Platform Processes HA"
Target
VMCloud Controller
Agent ProcessRestart

66. © Copyright 2014 Pivotal. All rights reserved. 66
4 Layers of built-in High Availability"
Application Instance
Platform Processes
Platform VMs
Availability Zones

67. © Copyright 2014 Pivotal. All rights reserved. 67
Platform VMs HA"
Blobstore
BOSH
Health
Monitor
DB
Messaging
Health Manager
BOSH Director
NATS
Agent
Agent
Cloud Controller
Agent Process
Process
Process
Pivotal CF
Cloud Controller
Agent Process
Ressurector
Re-create VM
VM is
missing…

68. © Copyright 2014 Pivotal. All rights reserved. 68
4 Layers of built-in High Availability"
Application Instance
Platform Processes
Platform VMs
Availability Zones

69. © Copyright 2014 Pivotal. All rights reserved.
Availability Zone #2
69
Availability Zones"
DEA
DEA
DEA
Router
Blobstore
Cloud Controller
Health Manager
Messaging (NATS)
Push app
Availability Zone #1
DEA
DEA

70. © Copyright 2014 Pivotal. All rights reserved. 70
Operator
Concerns
Monitor the
platform
Handle upgrades
and updates
Plan capacity
Manage users
and quotas
Install the
platform
Setup High
Availability

71. © Copyright 2014 Pivotal. All rights reserved. 71

72. © Copyright 2014 Pivotal. All rights reserved. 72

73. © Copyright 2014 Pivotal. All rights reserved.
Bonus Demo Time - Diego
73

74. © Copyright 2014 Pivotal. All rights reserved. 74
• Support for multiple backend implementations without warden rewrite
• Remove dependency between components
• Might as well be in Go
Diego?
DEA Pool
Cloud Controller
Health Manager

75. © Copyright 2014 Pivotal. All rights reserved.
So What?
75

76. © Copyright 2014 Pivotal. All rights reserved. 76
One Polyglot Cluster

77. © Copyright 2014 Pivotal. All rights reserved.
The image cannot be
displayed. Your computer may
not have enough memory to
THANK YOU!
See you after the break!
77