Video and slides synchronized, mp3 and slide download available at URL http://bit.ly/1bKUlRs. Alex Papadimoulis discusses various deployment strategies, scalable delivery, with examples from real-world organizations such as AllRecipes.com, Twitter, and Google. Filmed at qconlondon.com. Alex Papadimoulis is speaker and writer who's passionate about looking beyond the code to build great software. In addition to founding Inedo - the makers of BuildMaster, the popular DevOps platform - Alex also started The Daily WTF, a fun site dedicated to building software the wrong way. Twitter: @apapadimoulis

1. Racing Thru the Last Mile
Qcon London 2013
Alex Papadimoulis
@apapadimoulis
Cloud Delivery & Web-Scale Deployment

2. InfoQ.com: News & Community Site
• 750,000 unique visitors/month
• Published in 4 languages (English, Chinese, Japanese and Brazilian
Portuguese)
• Post content from our QCon conferences
• News 15-20 / week
• Articles 3-4 / week
• Presentations (videos) 12-15 / week
• Interviews 2-3 / week
• Books 1 / month
Watch the video with slide
synchronization on InfoQ.com!
http://www.infoq.com/presentations
/web-scale-cloud-deployment

3. Presented at QCon London
www.qconlondon.com
Purpose of QCon
- to empower software development by facilitating the spread of
knowledge and innovation
Strategy
- practitioner-driven conference designed for YOU: influencers of
change and innovation in your teams
- speakers and topics driving the evolution and innovation
- connecting and catalyzing the influencers and innovators
Highlights
- attended by more than 12,000 delegates since 2007
- held in 9 cities worldwide

4. My 3 Bullet Point Résumé
• Been in software for a while
• Worked on a bunch of different systems
• Worked at a bunch of different places

5. • I founded
• BuildMaster
–“DevOps in a box”
• ProGet
–“NuGet for the enterprise”

7. What is the Cloud?
EC2
Web Sites
Cloud Services
Virtual Machines
Beanstalk
Cloud Formation

8. What is Web Scale?

9. What is Web Scale?

10. What is Web Scale?

11. Scale of Web Scale
0
100000
200000
300000
400000
500000
600000
Google Facebook Twitter Wikipedia Growing Emerging
Number of Servers

12. Scale of Web Scale
1
10
100
1000
10000
100000
1000000
Google Facebook Twitter Wikipedia Growing Emerging
Number of Servers

13. Deployment Matters

14. Web-scale Deployments
• Fast
• Often
• Reliable

15. Google’s Secret Weapon
• Same as Facebook
• Same as Twitter

18. Twitter’s Murder

22. Applications
Services Auth
API User
Account
Web Logon Search Uploader
User Files
CDN
Proxy
Data
Access

23. Environments
Int Test Staging Prod

24. ReleasesInitial Release
• Perfect

25. Releases
Initial Release
Emergency Fix
• Crashes when Credit
Card is submitted

26. Releases
Initial Release
Emergency Fix
Another Emergency Fix
• Orders randomly go
missing

27. Releases
Initial Release
Emergency Fix
Another Emergency Fix
New Features
• RSS Feed
• Sub-categories
• Newsletter

28. Releases
Initial Release
Emergency Fix
Another Emergency Fix
New Features
More New Features
• One-click Buy
• Renewals
• Favorites List

29. Releases
1.0 - Initial Release
1.1 - Emergency Fix
1.2 - Another Emergency Fix
2.0 - New Features
2.5 - More New Features

30. Builds
Build 1 Integration Test Staging Prod

31. Builds
Build 5 Integration Test Staging Prod
Build 1 Integration Test Staging Prod

32. Builds
Build 13 Integration Test Staging Prod
Build 5 Integration Test Staging Prod
Build 1 Integration Test Staging Prod

33. Promotions
Integration Test Staging Prod
Before Staging:
 Automated Acceptance Test Passed
 Manual Smoke Test Passed
 Release Issues Resolved

34. Deployments
Integration Test Staging Prod
Before Staging:
 Automated Acceptance Test Passed
 Manual Smoke Test Passed
 Release Issues Resolved
Staging Deployment:
1. Transfer Files to tmpDir
2. Stop Web Services
3. Swap tmpDir and liveDir
4. Start Web Services

35. Common Terminology
Applications
Releases
Builds
Promotions
Deployments

36. Deployment
Distribution Delivery

37. Abstracting Delivery

38. Deliverables
• Files
• Database
• Environmental

39. File Components
• Staging Directory
• Changed Files Only
• Assets on CDN

40. Database Components
• Can’t Rollback
• Backwards Compatibility (Deploy First)
• Test via Staging

41. Environment Components
• Really can’t rollback
• Minimize
• Application-only

42. Delivery Mechanism

43. Push Basics
servers = ["appsv1", "appsv2", "appsv3"];
for each (s in servers) {
transfer_files(s);
copy_config_file(s);
deploy_database(s);
set_environment(s);
}

44. Pull Basics
There are no basics

45. Pull Challenges
• Instruction Complexity
• Orchestration
• Monitoring

46. Pull Helpers

47. Rollout Techniques

48. Live

49. Rolling

50. Rolling

51. Parallel

52. Parallel

53. Not Rollouts
• Piloting
• Feature Toggle

54. Cloud Delivery
• Not Much, Really
• Simplifies Environments
• Simplifies Mistakes

55. Build Your Own Plan
• Application Segregation
• Environments
• Release Workflow
• Delivery
– Components
– Push vs Pull
– Rollouts
• Cloud Application

56. Build Integration Test Staging Prod
Build Test Staging Prod

57. Deployment Matters
@apapadimoulis
apapadimoulis@inedo.com