In this second technology focussed session from AWS Solutions Architect, Steve Bryen, we will explore techniques and tools for automating the test process and for enhancing application monitoring and management when operating at scale

1. AWS Services Enabling DevOps
Managing your AWS Infrastructure
at Scale
Steven Bryen
Solutions Architect, UK&I
@steven_bryen

2. 1 2 3
Testing Management Monitoring

3. 1 2 3
Testing
Management Monitoring

4. #1 CONSISTENT
ENVIRONMENTS

5. CloudFormation
Template
JSON Formatted File
Parameter Definition
!
Resource Creation
!
Configuration actions
CloudFormation
Framework
Stack creation
!
Stack updates
!
Error detection and rollback
Stack
Configured AWS Services
Comprehensive service support
!
Service event aware
!
Customisable

6. !
"Tags": [
{ "Key" : "Environment", "Value": "Staging" },
{ "Key" : "Role", "Value" : “Web” }
]
TAG RESOURCES WITH
ENVIRONMENT DETAILS

7. AUTOMATED ENVIRONMENT CREATION
+
AUTOMATED DEPLOYMENT
=
ON DEMAND TEST ENVIRONMENT

8. #2 LOAD TESTING

12. USING AMAZON EC2 TO SIMULATE
2.4 MILLION PLAYERS

14. 1 2 3
Testing
Management Monitoring

15. #1 TAG RESOURCES
role
owner
cost
center
What is the core function?
Which application or user owns it?
Who is responsible for cost?

16. #2 USER MANAGEMENT
Fine-grained control of your
AWS cloud with two-factor
authentication !
!
Integrated with your existing
corporate directory using SAML
2.0 and single sign-on!
!

17. #3 LOG MANAGEMENT
ACTIVATE AWS CLOUDTRAIL
Record AWS API Calls
and provide Logs

18. PARTNER INTEGRATION

19. #4 KEY PAIR MANAGEMENT
EC2 Instance
SSH

20. #4 KEY PAIR MANAGEMENT
EC2 Instance
SSH
Remove the Ability to
log into Instances
and reduce risk

21. #4 KEY PAIR MANAGEMENT
Move Logs/State
away from Instance
EC2 Instance
SSH

22. #4 KEY PAIR MANAGEMENT
CloudWatch Logs/
Partner Solution
SSH LOGS
EC2 Instance

23. 1 2 3
Testing
Management Monitoring

24. AWS CLOUDWATCH

25. SIMPLE MONITORING EXAMPLE
Availability Zone
Availability Zone
AutoScaling
Service
AutoScaling Group CloudWatch
Alar m

26. CUSTOM CLOUDWATCH METRICS
AutoScaling
Service
CloudWatch
Alarm
AWS CLI
EC2 Instance

27. NOTIFYING 3RD PARTY APPS
Availability Zone
Availability Zone
AutoScaling
Service
AutoScaling Group CloudWatch
Alarm
Simple Notification
Service

28. SELF HEALING
ARCHITECTURES

29. DEMO

30. Tightly Coupled Architecture
1
User uploads Image via web page
Server resizes images and stores edited images in S3 Bucket

31. Tightly Coupled Architecture
2
If any part of the code/process breaks, user experience is
affected

32. Loosely Coupled Architecture
1
1
User uploads Image via web page

33. Loosely Coupled Architecture
2
2
2
Original image is uploaded into S3 Bucket
S3 Object URI is added to SQS Queue

34. Loosely Coupled Architecture
3
3
3
Worker node polls queue for visible messages
Get object URI from message and retrieve original image

35. 4
Loosely Coupled Architecture
4
4
Worker node Resizes Image and stores new objects into S3
Instructs SQS Queue to delete message

36. Loosely Coupled Architecture
5
5
If Worker node fails, user experience is not affected.

37. Loosely Coupled Architecture
6
6
Autoscaling Re-spawns worker node and picks up messages

38. 7
Auto Scaling can also add/remove capacity as needed to catch
up on requests
7
Loosely Coupled Architecture