AWS Compute Evolved Week at the San Francisco Loft: Cost Optimize EC2 with Amazon EC2 Spot Instances Join this workshop to get hands-on experience deploying a web app on Amazon EC2 Spot Instances. Amazon EC2 Spot instances offer spare compute capacity in the AWS cloud available at steep discounts compared to On-Demand prices. Learn how to deploy an EC2 Spot Fleet behind a load balancer and scale it to handle peak demand with Spot Instances, all while saving up to 90% on your compute costs. Speaker: Shawn OConnor - Enterprise Solutions Architect, AWS

1. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Shawn O’Connor, Solutions Architect
August 7th, 2018
Cost Optimize EC2 with Amazon EC2
Spot Instances

2. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Agenda
ü Fundamentals of Amazon EC2 Spot Instances
ü Spot use cases
ü Recently launched EC2 Spot features
ü Workshop

3. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
What are EC2 Spot Instances?
Low Cost Faster Results Easy Access
Resource
Flexibility
The price changes
infrequently based on
supply and demand of
spare capacity
Just request capacity and
pay the current rate -
when we need the
capacity back you’ll get a
2 minute warning
Spare EC2 capacity with some great advantages

4. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Spot Use Cases
examples
• Experiments
• Development
• Testing
• One-time queries
• Model training
Time sensitiveTime insensitive
examples
• Web services
• APIs
• Big data
• Grid computing
• Containers

5. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
EC2 Spot Fleet
Automates the management of Spot instances – Simply tell Spot Fleet how
much capacity you need and Fleet does the rest.
Fast Access to
Capacity
• Launch Thousands of Spot
Instances with single API call
• Maintain capacity or scale up or
down based on metrics and
thresholds you set
Optimize Price vs.
Availability
• Find the lowest priced horsepower
that works for you or diversify your
fleet to increase availability
• Auto-attach to a Load Balancer
Customize Based
on Application
• Create your own capacity unit
based on your application
requirements

6. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Flexibility is crucial
Instance flexible Time flexible Region flexible

7. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
What does it mean to be instance flexible?
• m4.xlarge capacity is different from m4.large. Use as many sizes as you can
efficiently!
Instance Size
• If you’re using the c4.large, you can almost certainly use m4.large and r4.large.
They have the same number of vCPUs, just with some extra memory!
Instance Family
• Availability Zones consist of one or more discrete data centers. us-east-2a and
us-east-2b capacity is different! If your application can use multiple AZs, do it!
Availability Zone

8. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Understanding how to use EC2 Spot pools
Instance Flexibility and Diversification Made
Easy with Spot Fleet
0
10
20
30
40
50
60
70
2007 2012 2017
Each instance family, each instance size, in each Availability Zone, in every
Region is a separate Spot pool
100s of Instance Options
R4.8xlarge
M4.4xlarge
C5.9xlarge
C4.xlarge
C4.4xlarge
R4.2xlarge
M4.xlarge
M
4.xlarge

9. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
$0.37 $0.29$0.34
1b 1c1a
8XL
$0.18 $0.16$0.214XL
$0.13 $0.13$0.182XL
$0.05 $0.06$0.06XL
$0.01 $0.04$0.02L
R4
$2.128
On
Demand
$1.064
$0.532
$.266
$0.133
ü Each instance family
ü Each instance size
ü Each Availability Zone
ü In every region
ü Is a separate Spot pool
Show me the pools!

10. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Think Spot for almost every workload
Big Data?
Hadoop? Spark?
Analytics? EMR?
CI/CD?
Jenkins?
Bamboo?
Stateless Web
Services? Load
testing?
HPC / HTC?
Batch workloads?
Containers?
Kubernetes?
ECS?
Machine
Learning? Deep
Learning? AI?
Rendering?
Media streaming?
Transcoding?

11. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Get your applications ready for Spot
Fault tolerantStateless Multi-AZ
Loosely
coupled
Instance
flexibility
¢

12. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Integrated with AWS services
AWS
CloudFormation
AWS
OpsWorks
Amazon
EMR
Amazon
ECS / EKS
AWS Data
Pipeline
AWS BatchAuto Scaling
Thinkbox Deadline

13. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Integrated in Community and Partners

14. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Simplified access
Via existing EC2 API calls
such as RunInstances
Simplified Pricing
Set it & Forget it
Low predictable prices
without bidding
Pause & Resume
With hibernation and
stop-start options
Simplified access model, predictable prices, pause & resume
What’s new with EC2 Spot?

15. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Worried about interruptions? Don’t be.
Over the last 3 months, > 95% of Spot Instance interruptions
were from a customer manually terminating the instance
because the application had completed its work.

16. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Interruptions explained, part 1
Interruption
Max price

17. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Interruptions explained, part 2
Max price
Potential interruption if capacity
needs to be returned to On-Demand

18. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Thank You and let’s get started!

19. © 2018, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Amazon EC2 Spot Fleet web app workshop
ü There is no need to rush – finish the workshop in your own time
and at your own pace
ü Find someone to work with
ü Apply the credits after the workshop here:
ü https://aws.amazon.com/awscredits/
ü Go here to get started!
ü http://bit.ly/2toTDuW
ü Connect with me and let me know how the workshop went!
ü https://www.linkedin.com/in/oak2278/