With AWS companies now have the ability to develop and run their applications with speed and flexibility like never before. Working with an infrastructure that can be 100% API driven enables businesses to use lean methodologies and realize these benefits. This in turn leads to greater success for those who make use of these practices. In this presentation we'll talk about some key concepts and design patterns for Continuous Deployment and Continuous Integration, two elements of lean development of applications and infrastructures. Carlos Conde, Manager, Solution Architecture, AWS Neil Jennings, Lead Architect, Orange Digital

1. Continuous Deployment Practices on AWS
Carlos Conde
Sr. Mgr. Solutions Architecture

2. CONTINUOUS
INTEGRATION

3. DEVELOPER

4. SOURCE CODE
REPOSITORY

5. SOURCE CODE
REPOSITORY
PROJECT MANAGEMENT
SERVER

6. SOURCE CODE
REPOSITORY
CONTINUOUS
INTEGRATION SERVER
PROJECT MANAGEMENT
SERVER

7. SOURCE CODE
REPOSITORY
CONTINUOUS
INTEGRATION SERVER
PROJECT MANAGEMENT
SERVER
PICK
TASKS

8. SOURCE CODE
REPOSITORY
SUBMIT
CODE
CONTINUOUS
INTEGRATION SERVER
PROJECT MANAGEMENT
SERVER

9. SOURCE CODE
REPOSITORY
CONTINUOUS
INTEGRATION SERVER
SCHEDULE
BUILD
PROJECT MANAGEMENT
SERVER

10. SOURCE CODE
REPOSITORY
CONTINUOUS
INTEGRATION SERVER
RECURRENT
BUILDS
PROJECT MANAGEMENT
SERVER

11. SOURCE CODE
REPOSITORY
CONTINUOUS
INTEGRATION SERVER
CODE
FETCH
PROJECT MANAGEMENT
SERVER

12. SOURCE CODE
REPOSITORY
CONTINUOUS
INTEGRATION SERVER
CODE QUALITY
TESTS
PROJECT MANAGEMENT
SERVER
TEST
RESULTS

13. SOURCE CODE
REPOSITORY
CONTINUOUS
INTEGRATION SERVER
BUILD OUTPUT
PROJECT MANAGEMENT
SERVER

14. SOURCE CODE
REPOSITORY
DOCS
CONTINUOUS
INTEGRATION SERVER
BINARIES
& PACKAGES
PROJECT MANAGEMENT
SERVER

16. SOURCE CODE
REPOSITORY
BUILDS
CONTINUOUS
INTEGRATION SERVER
DNS
PROJECT
MANAGEMENT SERVER

17. PAIN POINTS
• UNIT TESTS INCOMPLETE
• MOCK TESTS MAINTENANCE
• EXPENSIVE TEST ENVIRONMENT
• TEST ENVIRONMENT ≠ PRODUCTION
• DEPLOYMENT CYCLES

18. ON-DEMAND ELASTIC
PAY AS YOU GO

19. =
PROGRAMMABLE
PLATFORM

23. IF YOU CAN PROGRAM IT
YOU CAN AUTOMATE IT

24. CUSTOMER STORY
Neil Jennings – Orange Digital Lead Architect

25. Credit: nicholsoncartoons.com.au

27. Control via Configuration
AWS CloudFormation

28. Control via Configuration

29. Automate deployment
S3 Bucket

30. Automate deployment
S3 Bucket

31. Automated
1 hour

32. What’ s Next?
New Tools Better Testing
Continuous Deployment
Feature Flags

33. Thanks
Neil Jennings
@furbing

38. HTTP://SORCERY.SMUGMUG.COM/

39. AWS
CLOUDFORMATION
STACK-BASED DEPLOYMENT
SERVICE

40. CLOUDFORMATION
TEMPLATE

42. {
"Description" : "Create RDS with username and password",
"Resources" : {
"MyDB" : {
"Type" : "AWS::RDS::DBInstance",
"Properties" : {
"AllocatedStorage" : "500",
"DBInstanceClass" : "db.m1.small",
"Engine" : "MySQL",
"EngineVersion" : "5.5",
"MasterUsername" : "MyName",
"MasterUserPassword" : "MyPassword"
}
}
}
}

43. "AWS::CloudFormation::Init" : { "config" : {
"packages" : {
"yum" : {
"mysql" : [],
"mysql-server" : [],
"httpd" : [],
"php" : [],
"php-mysql" : []
}
},
"sources" : {
"/var/www/html" :
"https://s3.amazonaws.com/my-builds/build-v4.zip"
}
}

44. {
"Parameters" : {
"KeyName" : {
"Description" : "Name of an existing EC2
KeyPair to enable SSH
access to the instance",
"Type" : "String"
}
},
}

45. PROCEDURAL KNOWN
DEFINITION CONFIGURATION
Create it programmatically Store stack configuration in
source control
CLOUDFORMATION
TEMPLATE
PARAMETER COLLABORATION
DRIVEN Share templates with ease
Dynamic and user-driven as just files
templates

47. APPLICATION
VERSIONS
+
INFRASTRUCTURE
VERSIONS

48. CLOUDFORMATION
TEMPLATE

49. TEST ENVIRONMENTS

51. 30,000 REQUESTS / SECOND
1 TB TRAFFIC / DAY

52. “…AWS seemed to be the best solution available to allow a
small, independent company to rapidly develop and test a
completely new infrastructure, and host it.
We also loved the flexibility that AWS allowed us, when
spinning up smaller test environments, for beta trials, QA,
localization, and during development. The low initial cost
was also crucial.”
Alex Evans, CTO

53. LOAD TESTING

59. USING AMAZON EC2 TO SIMULATE
2.4 MILLION PLAYERS

60. CONTINUOUS
DEPLOYMENT
SMALL, FREQUENT CHANGES
CONSTANTLY INTEGRATING INTO
PRODUCTION.

62. KEY = ITERATION

63. ITERATION
=
MODIFY THE SYSTEM TO BETTER
MEET THE EXPECTATIONS OF
YOUR USERS

64. DEPLOYMENTS AT
AMAZON.COM
11.6s 1,079 10,000 30,000
Mean time Max number of Mean number of Max number of
between deployments in a hosts hosts
deployments single hour simultaneously simultaneously
(weekday) receiving a receiving a
deployment deployment

65. SOFTWARE DEPLOY
≠
PRODUCT LAUNCH

67. 1.5 BILLION PAGE VIEWS
$83 MILLION IN TRANSACTIONS
4.2 MILLION ITEMS SOLD
OCTOBER 2012

68. 30 DEPLOYS PER DAY
1 DEPLOY EVERY 20 MINUTES

69. "Production is truly the only place you
can validate your code."

74. AWS OPSWORKS
INTEGRATED APPLICATION
MANAGEMENT

76. 14 BILLION REQUESTS/MONTH
50 000 DATABASE UPDATES / SEC
NO CACHE

77. A / B TESTING

82. DATA-DRIVEN
ARCHITECTURES

83. METRICS @ETSY

84. COST-ORIENTED
ARCHITECTURES

85. PHP+APACHE+VARNISH
NGINX+NODEJS

87. CONTINUOUS
DEPLOYMENT
CONTINUOUS
INTEGRATION

88. CONTINUOUS
DEPLOYMENT
=
CONTINUOUS
EXPERIMENTATION

89. CONTINUOUS
DEPLOYMENT
=
CONTINUOUS
IMPROVEMENT

90. INNOVATE

91. « Want to increase innovation?
Lower the cost of failure »
Joi Ito

92. SPEED AND AGILITY
“ON-PREMISE”
Experiment Experiment
Infrequently Often
Failure is Fail quickly at
expensive a low cost
Less More
Innovation Innovation

93. THANK YOU
Continuous Deployment Practices on AWS