AWS Tools for DevOps

1. ©2015,
Amazon
Web
Services,
Inc.
or
its
affiliates.
All
rights
reserved
Accelerating DevOps Pipelines with AWS
Zlatan Dzinic, Konstantin Wilms & Provanshu Dey

2. ‘Ops is slowing us down’

3. ‘Devs are going to break things’

4. ‘We can’t train everyone’

5. Background
The End to End Development Pipeline

7. Production
Build
QA,
Integration
& Test
Staging
Artifacts

8. Manage Store Build DeployCode

9. MonitorProvisionDeployTestBuildCode
Elastic Beanstalk
OpsWorks
Cloud
Watch
Cloud
Formation
Code
Deploy
Code
Commit
Code
Pipeline
Integration
Development / QA / I&T Operations
DeploymentAgile
Lambda
ECS
EC2
EFS

10. Goal

11. Artifacts – code, data, binaries,
containers? …

12. ‘Where do we start?’

13. Infrastructure
Baseline Design

14. MFA,
Users,
Groups,
Roles
Linked
Accounts,
Alerts
Resource
Separation
Log &
Audit
CloudFormation

15. Self Service
DIY –Sometimes at a Cost

16. • BYOS
– Flexibility -­ but sometimes at a time+complexity price
• Dependency Hell
– Cross-­functional – OSS + Commercial 3rd Party
• Integration
– Problematic -­ multiple GUIs, services, etc. often NAS bound
• Portable
– Most ‘compatible’ with lift and shift (in and out) – to a point

17. Custom AMIs CloudInitVM ImportMarketplace

18. Infrastructure Services
Overview & Application Areas

20. Elastic Beanstalk
Quickly Deploy & Manage Applications

21. • Fast and Simple
– Upload code and deploy in minutes, multi-­version capable
• Developer Productivity
– Focus on the code and not the infrastructure
• Impossible to Outgrow
– Resilience & scalability are built in
• Complete Resource Control
– Full control over deployed infrastructure

23. OpsWorks
Model & Manage the Entire Stack

24. • Supports any Application
– Any architecture via custom Chef recipes, bash scripts & configs
• Configuration as Code
– Define and deploy from source repositories
• Automation to run at Scale
– Dynamic configuration and orchestration
• Resource Organization
– Logically organize and apply permissions to resources

25. Stacks

26. Layers

27. Instances

28. APPS

29. APPS

31. CloudFormation
Infrastructure as Code

32. • Easy to Use & Repeatable
– ‘Describe anything’ via simple JSON-­based syntax
• Full Control
– Open-­ended template-­based deployment, Callbacks, Triggers
• Customized via Parameters
– Customize templates at run-­time for specific use cases
• Introspective Deployment
– Build by hand and abstract with CloudFormer

33. Create
Skeleton
Define
Resources
Execute

34. Code Services
CodeCommit, CodePipeline, CodeDeploy

35. • CodeCommit
– Fully managed source control service for hosting private Git
repositories
• CodePipeline
– Standardizes and automates your software release process,
allowing you to rapidly release new features to users
• CodeDeploy
– Deploys your released code to a "fleet" of EC2 instances

36. Code
Commit
Code
Pipeline
Code
Deploy

37. Lambda
Infrastructure-­less Code

38. • No Infrastructure to Manage
– Focus on logic, not infrastructure
– Start with code and let Lambda handle the rest
• Automatic Scaling
– Scales with your workload;; fine-­grained, 100ms pricing
• Build Modular Services
– Build and deploy event-­driven or stream processing code
– Easily couple with other AWS services

39. • Events
– Push Model for DevOps
• Integration
– Simple CI/CD workflows
– AWS API Gateway backend
– QA/I&T automated testing offload;; artifact generation
– Couple Java, Python, Node code with Task Runners
• Targets
– Process ancillary datatypes – images, media, etc.

40. EC2 Container Service
Infrastructure-­less Code

41. • Easily Manage Clusters at Any Scale
– Highly scalable, high performance
– Eliminate managing, scaling & operating your own clusters
– Focus on building Dockerized applications
• Flexible Container Placement
– Schedule long-­running applications and batch jobs
– Shared state, optimistic concurrency
• Extensible
– Integrate through APIs
– Use your own schedulers;; hook ECS into your delivery process

42. Bucket
CodeCommit
ECS
Cloudformation
ECS Cluster

43. Implementation
Sample Use Cases

44. CodeCommit CodePipeline CodeDeploy

45. Summary
Wrap Up & Things We Missed

46. • Amazon API Gateway
– Fully managed RESTful endpoint API service
– Build unified APIs for multiple segregated backend services
– Run APIs without services using Lambda
• AWS Device Farm
– Test on real devices -­ iOS, Android and Fire OS
– Upload your own or use your own Test Types (Appium, etc.)
– Generate high-­level results, low level logs & screenshots
• Amazon EFS
– Multi-­AZ highly performant NFS storage

48. Thank You