SlideShare ist ein Scribd-Unternehmen logo
1 von 21
Significant discount compared to On-
Demand instance pricing.
Pay for compute capacity by the
second or hour with no long-term
commitments
On-Demand
Spare EC2 capacity for up to
90% off the On-Demand price
Reserved Spot
Steady state applications or predictable
usage, databases.
For fault tolerant, instance
flexible or time-insensitive
workloads.
For spiky workloads or to define
needs initially.
You can group your accounts into organizational units (OUs) and
attach different policies to each OU.
On-Demand
(2006)
Reserved Instance
(2009)
Spot Block
(2015)
Spot
(2009)
Spot Fleet
(2015)
No Upfront RI
(2014)
All Upfront RI
(2014)
Partial Upfront RI
(2014)
The prices changes infrequently
based on supply and demand of
spare capacity
Just request capacity and pay the
current rate.When AWS needs the
capacity back they give a 2 minute
warning.
Each Instance Family
Each Instance Size
Each Availability Zone
C3
8XL
4XL
2XL
XL
L
1A 1B 1C
On
Demand
$1.76
$0.88
$0.44
$0.22
$0.11
In Every Region
Is a separate Spot Market
$.50
$.21
$.08
$.27 $.29
$.04
$.01
$.30 $.16
$.07
$.05
$.01
$.08
$.04
$.04
* Pricing shown is for example purposes
only
Example CLI command
Spot instances with a specified duration are known as Spot Blocks.
They are designed not to be interrupted and will run continuously for the duration you select
You can specify a duration of 1, 2, 3, 4, 5, or 6 hours.
The price you pay depends on the specified duration.
aws ec2 request-spot-instances --instance-count 5 --block-duration-minutes 120 --type "one-time"
--launch-specification file://specification.json
Get Diversified Resources
Diversify your fleet. Grow your availability
AND
Get the Best Price
Find the lowest priced instance power that works for you
or
LaunchThousands of Spot Instances
With one RequestSpotFleet call
Apply Custom Weighting
Create your own capacity unit based on your application needs
• Multiple EC2 Spot Instances are Selected
• Multiple Availability Zones selected
• Pick the instances with similar performance
characteristics:
eg c3.large, m3 large, m4.large, r3.large, c4.large
Spot Fleet
capacityOptimized
The Spot Instances come from the pool with optimal capacity for
the number of instances that are launching.
diversified
The Spot Instances are distributed across all pools.
lowestPrice
The Spot Instances come from the pool with the lowest price.
This is the default strategy .
InstancePoolsToUseCount
The Spot Instances are distributed across the number of Spot pools
that you specify.This parameter is valid only when used in
combination with lowestPrice
https://aws.amazon.com/ec2/spot/instance-advisor/
The Spot Instance advisor helps you
determine pools with the least chance of
interruption and provides the savings you get
over on-demand rates.You should weigh your
application’s tolerance for interruption and
your cost saving goals when selecting a Spot
instance.The lower your interruption rate, the
longer your Spot instances are likely to run.
• When the Spot price exceeds your bid
price, the instance will receive a two-
minute warning
• Check for the 2 minute spot instance
termination notification every 5 seconds
leveraging a script invoked at instance
launch.
FlexibleFault-TolerantStateless
Multi-AZ and Instance
Flexibility
Loosely
Coupled
Cannot be stateless and fault tolerant? Running a Monolith or in-mem cache on the instance?
Running Dev/Test on Spot could still be successful as an interim step, risk vs cost calculation,
choose low interruption rate instance types
Running periodic benchmarks or load tests - Use Spot Blocks
To ensure that load does not decrease against app under test when
Spot is interrupted
Jenkins Build Slaves - use Spot Fleet Plugin
Jenkins will automatically increase Spot Fleet target capacity upon
pending jobs and scale in when no queue
Your instance type requirements, budget requirements, and application design will determine how to apply the
following best practices:
Be Flexible about InstanceTypes
Test your application on different instance types when possible.
Because prices fluctuate independently for each instances type in an Availability Zone, you can often get more
compute capacity for the same price when you have instance type flexibility. Request all instance types that meet
your requirements to further reduce costs and improve application performance.
Spot Fleets enable you to request multiple instance types simultaneously.
Minimize the impact of interruptions .
Amazon’s EC2 Spot’s Hibernate feature allows you to pause and then resume Amazon EBS backed instances when
capacity is available. Hibernate is just like closing and opening your laptop lid, with your application starting up right
where it left off.
CONTINUED
Choose pools where prices haven’t changed much
Because prices adjust based on long-term demand, popular instance types (such as recently launched instance
families), tend to have more price adjustments. Therefore, picking older-generation instance types that are less
popular tends to result in lower costs and fewer interruption. Similarly, the same instance type can have different
prices in different Availability Zones.
Start with LaunchTemplates sooner then later
These will be required for new features.
https://www.meetup.com/AWS-Atlanta/contribute/
Photo by Buro Millennial from Pexels
1. Open up the ElasticContainer Service Console using the link https://console.aws.amazon.com/ecs/ .
2. On the left hand menu under Amazon ECS click on Clusters
3. Now click on the blue Create Cluster Button.
4. Select the EC2 Linux + Networking template then click on the Next Step button at the bottom.
5. Enter the cluster name as SpotECScluster
6. Under the provisioning model - Select Spot
7. For the Spot Instance allocation strategy - choose Diversified
8. Choose an instance type(s) from the dropdown (suggested r3.large) and put in number of instances as 3
9. Under maximum price, check table - try to go for $0.02 per hour if you set (optional)
10. Leave the other values as default and then choose a keypair to launch the instances with
11. Choose create a new role for the ECS instances if you don’t already have a specified ECS role
12. Now click on the blue Create Button.
13. When the cluster completion creates you will be able to see the EcsSpotFleet logical ID
14. Copy this ID to your clipboard
15. Go to the EC2 services part of the Console https://console.aws.amazon.com/ec2/
Testing Spot Fleet
15. Under Instances choose Spot Requests on the Left Hand menu
16. Paste the resource id from your clipboard into the search bar at the top
17. If you expand the request you can see the EC2 instances which are part of the request
18. Go back to the ECS console and view your cluster
We will schedule a task
19. Click on the Services tab
20. Click the Blue Create tab under the Services tab
21. On the Configure Service screen - choose EC2 as the Launch type
22. Choose yourTask Definition and revision
23. Choose the SpotECScluster from the Cluster name Dropdown list
24. Change Minimum Healthy Percent to 50 (leave everything else defaults)
25. Click Next Step
26. Choose None for load balancer
27. Click Create Service
28. Go back to the EC2 Console -> Spot Requests and select the current Spot Fleet
29. At the top of the menu SelectActions -> Modify target Capacity
30. Set the new target capacity to 2 (from previous value of 3) , Click Submit
Testing Spot Fleet
AWS Atlanta Meetup -AWS Spot Blocks and Spot Fleet

Weitere ähnliche Inhalte

Ähnlich wie AWS Atlanta Meetup -AWS Spot Blocks and Spot Fleet

Introduction to Amazon EC2 Spot
Introduction to Amazon EC2 Spot Introduction to Amazon EC2 Spot
Introduction to Amazon EC2 Spot Amazon Web Services
 
AWS Cost Opt Meetup 2 - News corp - Spot On deep dive
AWS Cost Opt Meetup 2 - News corp - Spot On deep diveAWS Cost Opt Meetup 2 - News corp - Spot On deep dive
AWS Cost Opt Meetup 2 - News corp - Spot On deep divePeter Shi
 
(CMP311) This One Weird API Request Will Save You Thousands
(CMP311) This One Weird API Request Will Save You Thousands(CMP311) This One Weird API Request Will Save You Thousands
(CMP311) This One Weird API Request Will Save You ThousandsAmazon Web Services
 
Coding Apps in the Cloud to reduce costs up to 90% - September 2016 Webinar S...
Coding Apps in the Cloud to reduce costs up to 90% - September 2016 Webinar S...Coding Apps in the Cloud to reduce costs up to 90% - September 2016 Webinar S...
Coding Apps in the Cloud to reduce costs up to 90% - September 2016 Webinar S...Amazon Web Services
 
An introduction to Spot Instances and AWS Fleet - Webinar
An introduction to Spot Instances and AWS Fleet - WebinarAn introduction to Spot Instances and AWS Fleet - Webinar
An introduction to Spot Instances and AWS Fleet - WebinarCMPUTE
 
AWS re:Invent 2016: Save up to 90% and Run Production Workloads on Spot - Fea...
AWS re:Invent 2016: Save up to 90% and Run Production Workloads on Spot - Fea...AWS re:Invent 2016: Save up to 90% and Run Production Workloads on Spot - Fea...
AWS re:Invent 2016: Save up to 90% and Run Production Workloads on Spot - Fea...Amazon Web Services
 
Cloudreach Voices EC2 Making Sense of the Cost Options
Cloudreach Voices EC2 Making Sense of the Cost Options  Cloudreach Voices EC2 Making Sense of the Cost Options
Cloudreach Voices EC2 Making Sense of the Cost Options Cloudreach
 
AWS EMEA Online Summit - Blending Spot and On-Demand instances to optimizing ...
AWS EMEA Online Summit - Blending Spot and On-Demand instances to optimizing ...AWS EMEA Online Summit - Blending Spot and On-Demand instances to optimizing ...
AWS EMEA Online Summit - Blending Spot and On-Demand instances to optimizing ...Cobus Bernard
 
Introduction to EC2
Introduction to EC2Introduction to EC2
Introduction to EC2Mark Squires
 
Getting Started with EC2 Spot - November 2016 Webinar Series
Getting Started with EC2 Spot - November 2016 Webinar SeriesGetting Started with EC2 Spot - November 2016 Webinar Series
Getting Started with EC2 Spot - November 2016 Webinar SeriesAmazon Web Services
 
This One Weird API Request Will Save You Thousands
This One Weird API Request Will Save You ThousandsThis One Weird API Request Will Save You Thousands
This One Weird API Request Will Save You ThousandsAmazon Web Services
 
Cut AWS Costs: Using Spot Instances for More Than Batch
Cut AWS Costs: Using Spot Instances for More Than BatchCut AWS Costs: Using Spot Instances for More Than Batch
Cut AWS Costs: Using Spot Instances for More Than BatchRightScale
 
5 Important Points To Remember If You Want To Reduce AWS EC2 Cost
5 Important Points To Remember If You Want To Reduce AWS EC2 Cost5 Important Points To Remember If You Want To Reduce AWS EC2 Cost
5 Important Points To Remember If You Want To Reduce AWS EC2 Costdevopsjourney
 
AWS Interview Questions And Answers | AWS Solution Architect Interview Questi...
AWS Interview Questions And Answers | AWS Solution Architect Interview Questi...AWS Interview Questions And Answers | AWS Solution Architect Interview Questi...
AWS Interview Questions And Answers | AWS Solution Architect Interview Questi...Edureka!
 
5 Ways to Control your AWS Spending (or, How to Make Your CFO Happy)
5 Ways to Control your AWS Spending (or, How to Make Your CFO Happy)5 Ways to Control your AWS Spending (or, How to Make Your CFO Happy)
5 Ways to Control your AWS Spending (or, How to Make Your CFO Happy)parkmycloud
 
Amazon cloud intance launch3
Amazon cloud intance launch3Amazon cloud intance launch3
Amazon cloud intance launch3Zenita Smythe
 
Amazon cloud intance launch
Amazon cloud intance launchAmazon cloud intance launch
Amazon cloud intance launchZenita Smythe
 
Best Practices for Managing Hadoop Framework Based Workloads (on Amazon EMR) ...
Best Practices for Managing Hadoop Framework Based Workloads (on Amazon EMR) ...Best Practices for Managing Hadoop Framework Based Workloads (on Amazon EMR) ...
Best Practices for Managing Hadoop Framework Based Workloads (on Amazon EMR) ...Amazon Web Services
 

Ähnlich wie AWS Atlanta Meetup -AWS Spot Blocks and Spot Fleet (20)

Introduction to Amazon EC2 Spot
Introduction to Amazon EC2 SpotIntroduction to Amazon EC2 Spot
Introduction to Amazon EC2 Spot
 
Introduction to Amazon EC2 Spot
Introduction to Amazon EC2 Spot Introduction to Amazon EC2 Spot
Introduction to Amazon EC2 Spot
 
AWS Cost Opt Meetup 2 - News corp - Spot On deep dive
AWS Cost Opt Meetup 2 - News corp - Spot On deep diveAWS Cost Opt Meetup 2 - News corp - Spot On deep dive
AWS Cost Opt Meetup 2 - News corp - Spot On deep dive
 
(CMP311) This One Weird API Request Will Save You Thousands
(CMP311) This One Weird API Request Will Save You Thousands(CMP311) This One Weird API Request Will Save You Thousands
(CMP311) This One Weird API Request Will Save You Thousands
 
Coding Apps in the Cloud to reduce costs up to 90% - September 2016 Webinar S...
Coding Apps in the Cloud to reduce costs up to 90% - September 2016 Webinar S...Coding Apps in the Cloud to reduce costs up to 90% - September 2016 Webinar S...
Coding Apps in the Cloud to reduce costs up to 90% - September 2016 Webinar S...
 
Reduce Your Cloud Spending With AWS Spot Instances
Reduce Your Cloud Spending With AWS Spot InstancesReduce Your Cloud Spending With AWS Spot Instances
Reduce Your Cloud Spending With AWS Spot Instances
 
An introduction to Spot Instances and AWS Fleet - Webinar
An introduction to Spot Instances and AWS Fleet - WebinarAn introduction to Spot Instances and AWS Fleet - Webinar
An introduction to Spot Instances and AWS Fleet - Webinar
 
AWS re:Invent 2016: Save up to 90% and Run Production Workloads on Spot - Fea...
AWS re:Invent 2016: Save up to 90% and Run Production Workloads on Spot - Fea...AWS re:Invent 2016: Save up to 90% and Run Production Workloads on Spot - Fea...
AWS re:Invent 2016: Save up to 90% and Run Production Workloads on Spot - Fea...
 
Cloudreach Voices EC2 Making Sense of the Cost Options
Cloudreach Voices EC2 Making Sense of the Cost Options  Cloudreach Voices EC2 Making Sense of the Cost Options
Cloudreach Voices EC2 Making Sense of the Cost Options
 
AWS EMEA Online Summit - Blending Spot and On-Demand instances to optimizing ...
AWS EMEA Online Summit - Blending Spot and On-Demand instances to optimizing ...AWS EMEA Online Summit - Blending Spot and On-Demand instances to optimizing ...
AWS EMEA Online Summit - Blending Spot and On-Demand instances to optimizing ...
 
Introduction to EC2
Introduction to EC2Introduction to EC2
Introduction to EC2
 
Getting Started with EC2 Spot - November 2016 Webinar Series
Getting Started with EC2 Spot - November 2016 Webinar SeriesGetting Started with EC2 Spot - November 2016 Webinar Series
Getting Started with EC2 Spot - November 2016 Webinar Series
 
This One Weird API Request Will Save You Thousands
This One Weird API Request Will Save You ThousandsThis One Weird API Request Will Save You Thousands
This One Weird API Request Will Save You Thousands
 
Cut AWS Costs: Using Spot Instances for More Than Batch
Cut AWS Costs: Using Spot Instances for More Than BatchCut AWS Costs: Using Spot Instances for More Than Batch
Cut AWS Costs: Using Spot Instances for More Than Batch
 
5 Important Points To Remember If You Want To Reduce AWS EC2 Cost
5 Important Points To Remember If You Want To Reduce AWS EC2 Cost5 Important Points To Remember If You Want To Reduce AWS EC2 Cost
5 Important Points To Remember If You Want To Reduce AWS EC2 Cost
 
AWS Interview Questions And Answers | AWS Solution Architect Interview Questi...
AWS Interview Questions And Answers | AWS Solution Architect Interview Questi...AWS Interview Questions And Answers | AWS Solution Architect Interview Questi...
AWS Interview Questions And Answers | AWS Solution Architect Interview Questi...
 
5 Ways to Control your AWS Spending (or, How to Make Your CFO Happy)
5 Ways to Control your AWS Spending (or, How to Make Your CFO Happy)5 Ways to Control your AWS Spending (or, How to Make Your CFO Happy)
5 Ways to Control your AWS Spending (or, How to Make Your CFO Happy)
 
Amazon cloud intance launch3
Amazon cloud intance launch3Amazon cloud intance launch3
Amazon cloud intance launch3
 
Amazon cloud intance launch
Amazon cloud intance launchAmazon cloud intance launch
Amazon cloud intance launch
 
Best Practices for Managing Hadoop Framework Based Workloads (on Amazon EMR) ...
Best Practices for Managing Hadoop Framework Based Workloads (on Amazon EMR) ...Best Practices for Managing Hadoop Framework Based Workloads (on Amazon EMR) ...
Best Practices for Managing Hadoop Framework Based Workloads (on Amazon EMR) ...
 

Mehr von Adam Book

Aws meetup control_tower
Aws meetup control_towerAws meetup control_tower
Aws meetup control_towerAdam Book
 
Aws meetup s3_plus
Aws meetup s3_plusAws meetup s3_plus
Aws meetup s3_plusAdam Book
 
AWS Atlanta meetup Build Tools - Code Commit, Code Build, Code Deploy
AWS Atlanta meetup Build Tools - Code Commit, Code Build, Code DeployAWS Atlanta meetup Build Tools - Code Commit, Code Build, Code Deploy
AWS Atlanta meetup Build Tools - Code Commit, Code Build, Code DeployAdam Book
 
AWS Atlanta Meetup - June 19 - AWS organizations - Account Structure
AWS Atlanta Meetup - June 19 - AWS organizations - Account StructureAWS Atlanta Meetup - June 19 - AWS organizations - Account Structure
AWS Atlanta Meetup - June 19 - AWS organizations - Account StructureAdam Book
 
Aws meetup systems_manager
Aws meetup systems_managerAws meetup systems_manager
Aws meetup systems_managerAdam Book
 
AWS Atlanta meetup Secrets Manager
AWS Atlanta meetup Secrets ManagerAWS Atlanta meetup Secrets Manager
AWS Atlanta meetup Secrets ManagerAdam Book
 
AWS Atlanta meetup load-balancing
AWS Atlanta meetup load-balancingAWS Atlanta meetup load-balancing
AWS Atlanta meetup load-balancingAdam Book
 
AWS Atlanta meetup cognit Back to Basics
AWS Atlanta meetup cognit Back to BasicsAWS Atlanta meetup cognit Back to Basics
AWS Atlanta meetup cognit Back to BasicsAdam Book
 
AWS Atlanta meetup CloudFormation conditionals
AWS Atlanta meetup CloudFormation conditionals AWS Atlanta meetup CloudFormation conditionals
AWS Atlanta meetup CloudFormation conditionals Adam Book
 
Aws Atlanta meetup - Understanding AWS Config
Aws Atlanta meetup - Understanding AWS ConfigAws Atlanta meetup - Understanding AWS Config
Aws Atlanta meetup - Understanding AWS ConfigAdam Book
 
AWS Atlanta meetup 2/ 2017 Redshift WLM
AWS Atlanta meetup  2/ 2017 Redshift WLM AWS Atlanta meetup  2/ 2017 Redshift WLM
AWS Atlanta meetup 2/ 2017 Redshift WLM Adam Book
 
Aws Atlanta meetup Amazon Athena
Aws Atlanta meetup Amazon AthenaAws Atlanta meetup Amazon Athena
Aws Atlanta meetup Amazon AthenaAdam Book
 
Aws meetup aws_waf
Aws meetup aws_wafAws meetup aws_waf
Aws meetup aws_wafAdam Book
 
AWS Certification Paths And Tips for Getting Certified
AWS Certification Paths And Tips for Getting CertifiedAWS Certification Paths And Tips for Getting Certified
AWS Certification Paths And Tips for Getting CertifiedAdam Book
 
Aws meetup building_lambda
Aws meetup building_lambdaAws meetup building_lambda
Aws meetup building_lambdaAdam Book
 
AWS CloudFormation Intrinsic Functions and Mappings
AWS CloudFormation Intrinsic Functions and Mappings AWS CloudFormation Intrinsic Functions and Mappings
AWS CloudFormation Intrinsic Functions and Mappings Adam Book
 
Aws meetup managed_nat
Aws meetup managed_natAws meetup managed_nat
Aws meetup managed_natAdam Book
 
Aws meetup ssm
Aws meetup ssmAws meetup ssm
Aws meetup ssmAdam Book
 
Aws atlanta march_2015
Aws atlanta march_2015Aws atlanta march_2015
Aws atlanta march_2015Adam Book
 
Aws multi-region High Availability
Aws multi-region High Availability Aws multi-region High Availability
Aws multi-region High Availability Adam Book
 

Mehr von Adam Book (20)

Aws meetup control_tower
Aws meetup control_towerAws meetup control_tower
Aws meetup control_tower
 
Aws meetup s3_plus
Aws meetup s3_plusAws meetup s3_plus
Aws meetup s3_plus
 
AWS Atlanta meetup Build Tools - Code Commit, Code Build, Code Deploy
AWS Atlanta meetup Build Tools - Code Commit, Code Build, Code DeployAWS Atlanta meetup Build Tools - Code Commit, Code Build, Code Deploy
AWS Atlanta meetup Build Tools - Code Commit, Code Build, Code Deploy
 
AWS Atlanta Meetup - June 19 - AWS organizations - Account Structure
AWS Atlanta Meetup - June 19 - AWS organizations - Account StructureAWS Atlanta Meetup - June 19 - AWS organizations - Account Structure
AWS Atlanta Meetup - June 19 - AWS organizations - Account Structure
 
Aws meetup systems_manager
Aws meetup systems_managerAws meetup systems_manager
Aws meetup systems_manager
 
AWS Atlanta meetup Secrets Manager
AWS Atlanta meetup Secrets ManagerAWS Atlanta meetup Secrets Manager
AWS Atlanta meetup Secrets Manager
 
AWS Atlanta meetup load-balancing
AWS Atlanta meetup load-balancingAWS Atlanta meetup load-balancing
AWS Atlanta meetup load-balancing
 
AWS Atlanta meetup cognit Back to Basics
AWS Atlanta meetup cognit Back to BasicsAWS Atlanta meetup cognit Back to Basics
AWS Atlanta meetup cognit Back to Basics
 
AWS Atlanta meetup CloudFormation conditionals
AWS Atlanta meetup CloudFormation conditionals AWS Atlanta meetup CloudFormation conditionals
AWS Atlanta meetup CloudFormation conditionals
 
Aws Atlanta meetup - Understanding AWS Config
Aws Atlanta meetup - Understanding AWS ConfigAws Atlanta meetup - Understanding AWS Config
Aws Atlanta meetup - Understanding AWS Config
 
AWS Atlanta meetup 2/ 2017 Redshift WLM
AWS Atlanta meetup  2/ 2017 Redshift WLM AWS Atlanta meetup  2/ 2017 Redshift WLM
AWS Atlanta meetup 2/ 2017 Redshift WLM
 
Aws Atlanta meetup Amazon Athena
Aws Atlanta meetup Amazon AthenaAws Atlanta meetup Amazon Athena
Aws Atlanta meetup Amazon Athena
 
Aws meetup aws_waf
Aws meetup aws_wafAws meetup aws_waf
Aws meetup aws_waf
 
AWS Certification Paths And Tips for Getting Certified
AWS Certification Paths And Tips for Getting CertifiedAWS Certification Paths And Tips for Getting Certified
AWS Certification Paths And Tips for Getting Certified
 
Aws meetup building_lambda
Aws meetup building_lambdaAws meetup building_lambda
Aws meetup building_lambda
 
AWS CloudFormation Intrinsic Functions and Mappings
AWS CloudFormation Intrinsic Functions and Mappings AWS CloudFormation Intrinsic Functions and Mappings
AWS CloudFormation Intrinsic Functions and Mappings
 
Aws meetup managed_nat
Aws meetup managed_natAws meetup managed_nat
Aws meetup managed_nat
 
Aws meetup ssm
Aws meetup ssmAws meetup ssm
Aws meetup ssm
 
Aws atlanta march_2015
Aws atlanta march_2015Aws atlanta march_2015
Aws atlanta march_2015
 
Aws multi-region High Availability
Aws multi-region High Availability Aws multi-region High Availability
Aws multi-region High Availability
 

Kürzlich hochgeladen

The Codex of Business Writing Software for Real-World Solutions 2.pptx
The Codex of Business Writing Software for Real-World Solutions 2.pptxThe Codex of Business Writing Software for Real-World Solutions 2.pptx
The Codex of Business Writing Software for Real-World Solutions 2.pptxMalak Abu Hammad
 
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...Neo4j
 
Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024The Digital Insurer
 
Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...Enterprise Knowledge
 
Tata AIG General Insurance Company - Insurer Innovation Award 2024
Tata AIG General Insurance Company - Insurer Innovation Award 2024Tata AIG General Insurance Company - Insurer Innovation Award 2024
Tata AIG General Insurance Company - Insurer Innovation Award 2024The Digital Insurer
 
Top 5 Benefits OF Using Muvi Live Paywall For Live Streams
Top 5 Benefits OF Using Muvi Live Paywall For Live StreamsTop 5 Benefits OF Using Muvi Live Paywall For Live Streams
Top 5 Benefits OF Using Muvi Live Paywall For Live StreamsRoshan Dwivedi
 
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptxEIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptxEarley Information Science
 
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking MenDelhi Call girls
 
Presentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreterPresentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreternaman860154
 
A Call to Action for Generative AI in 2024
A Call to Action for Generative AI in 2024A Call to Action for Generative AI in 2024
A Call to Action for Generative AI in 2024Results
 
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...Miguel Araújo
 
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationFrom Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationSafe Software
 
Handwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed textsHandwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed textsMaria Levchenko
 
Developing An App To Navigate The Roads of Brazil
Developing An App To Navigate The Roads of BrazilDeveloping An App To Navigate The Roads of Brazil
Developing An App To Navigate The Roads of BrazilV3cube
 
GenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day PresentationGenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day PresentationMichael W. Hawkins
 
CNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of ServiceCNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of Servicegiselly40
 
Salesforce Community Group Quito, Salesforce 101
Salesforce Community Group Quito, Salesforce 101Salesforce Community Group Quito, Salesforce 101
Salesforce Community Group Quito, Salesforce 101Paola De la Torre
 
How to convert PDF to text with Nanonets
How to convert PDF to text with NanonetsHow to convert PDF to text with Nanonets
How to convert PDF to text with Nanonetsnaman860154
 
Injustice - Developers Among Us (SciFiDevCon 2024)
Injustice - Developers Among Us (SciFiDevCon 2024)Injustice - Developers Among Us (SciFiDevCon 2024)
Injustice - Developers Among Us (SciFiDevCon 2024)Allon Mureinik
 
Histor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slideHistor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slidevu2urc
 

Kürzlich hochgeladen (20)

The Codex of Business Writing Software for Real-World Solutions 2.pptx
The Codex of Business Writing Software for Real-World Solutions 2.pptxThe Codex of Business Writing Software for Real-World Solutions 2.pptx
The Codex of Business Writing Software for Real-World Solutions 2.pptx
 
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...
 
Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024
 
Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...
 
Tata AIG General Insurance Company - Insurer Innovation Award 2024
Tata AIG General Insurance Company - Insurer Innovation Award 2024Tata AIG General Insurance Company - Insurer Innovation Award 2024
Tata AIG General Insurance Company - Insurer Innovation Award 2024
 
Top 5 Benefits OF Using Muvi Live Paywall For Live Streams
Top 5 Benefits OF Using Muvi Live Paywall For Live StreamsTop 5 Benefits OF Using Muvi Live Paywall For Live Streams
Top 5 Benefits OF Using Muvi Live Paywall For Live Streams
 
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptxEIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
 
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
 
Presentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreterPresentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreter
 
A Call to Action for Generative AI in 2024
A Call to Action for Generative AI in 2024A Call to Action for Generative AI in 2024
A Call to Action for Generative AI in 2024
 
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
 
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationFrom Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
 
Handwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed textsHandwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed texts
 
Developing An App To Navigate The Roads of Brazil
Developing An App To Navigate The Roads of BrazilDeveloping An App To Navigate The Roads of Brazil
Developing An App To Navigate The Roads of Brazil
 
GenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day PresentationGenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day Presentation
 
CNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of ServiceCNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of Service
 
Salesforce Community Group Quito, Salesforce 101
Salesforce Community Group Quito, Salesforce 101Salesforce Community Group Quito, Salesforce 101
Salesforce Community Group Quito, Salesforce 101
 
How to convert PDF to text with Nanonets
How to convert PDF to text with NanonetsHow to convert PDF to text with Nanonets
How to convert PDF to text with Nanonets
 
Injustice - Developers Among Us (SciFiDevCon 2024)
Injustice - Developers Among Us (SciFiDevCon 2024)Injustice - Developers Among Us (SciFiDevCon 2024)
Injustice - Developers Among Us (SciFiDevCon 2024)
 
Histor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slideHistor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slide
 

AWS Atlanta Meetup -AWS Spot Blocks and Spot Fleet

  • 1.
  • 2.
  • 3.
  • 4. Significant discount compared to On- Demand instance pricing. Pay for compute capacity by the second or hour with no long-term commitments On-Demand Spare EC2 capacity for up to 90% off the On-Demand price Reserved Spot Steady state applications or predictable usage, databases. For fault tolerant, instance flexible or time-insensitive workloads. For spiky workloads or to define needs initially.
  • 5. You can group your accounts into organizational units (OUs) and attach different policies to each OU. On-Demand (2006) Reserved Instance (2009) Spot Block (2015) Spot (2009) Spot Fleet (2015) No Upfront RI (2014) All Upfront RI (2014) Partial Upfront RI (2014)
  • 6. The prices changes infrequently based on supply and demand of spare capacity Just request capacity and pay the current rate.When AWS needs the capacity back they give a 2 minute warning.
  • 7. Each Instance Family Each Instance Size Each Availability Zone C3 8XL 4XL 2XL XL L 1A 1B 1C On Demand $1.76 $0.88 $0.44 $0.22 $0.11 In Every Region Is a separate Spot Market $.50 $.21 $.08 $.27 $.29 $.04 $.01 $.30 $.16 $.07 $.05 $.01 $.08 $.04 $.04 * Pricing shown is for example purposes only
  • 8. Example CLI command Spot instances with a specified duration are known as Spot Blocks. They are designed not to be interrupted and will run continuously for the duration you select You can specify a duration of 1, 2, 3, 4, 5, or 6 hours. The price you pay depends on the specified duration. aws ec2 request-spot-instances --instance-count 5 --block-duration-minutes 120 --type "one-time" --launch-specification file://specification.json
  • 9. Get Diversified Resources Diversify your fleet. Grow your availability AND Get the Best Price Find the lowest priced instance power that works for you or LaunchThousands of Spot Instances With one RequestSpotFleet call Apply Custom Weighting Create your own capacity unit based on your application needs
  • 10. • Multiple EC2 Spot Instances are Selected • Multiple Availability Zones selected • Pick the instances with similar performance characteristics: eg c3.large, m3 large, m4.large, r3.large, c4.large Spot Fleet
  • 11. capacityOptimized The Spot Instances come from the pool with optimal capacity for the number of instances that are launching. diversified The Spot Instances are distributed across all pools. lowestPrice The Spot Instances come from the pool with the lowest price. This is the default strategy . InstancePoolsToUseCount The Spot Instances are distributed across the number of Spot pools that you specify.This parameter is valid only when used in combination with lowestPrice
  • 12. https://aws.amazon.com/ec2/spot/instance-advisor/ The Spot Instance advisor helps you determine pools with the least chance of interruption and provides the savings you get over on-demand rates.You should weigh your application’s tolerance for interruption and your cost saving goals when selecting a Spot instance.The lower your interruption rate, the longer your Spot instances are likely to run.
  • 13. • When the Spot price exceeds your bid price, the instance will receive a two- minute warning • Check for the 2 minute spot instance termination notification every 5 seconds leveraging a script invoked at instance launch.
  • 15. Cannot be stateless and fault tolerant? Running a Monolith or in-mem cache on the instance? Running Dev/Test on Spot could still be successful as an interim step, risk vs cost calculation, choose low interruption rate instance types Running periodic benchmarks or load tests - Use Spot Blocks To ensure that load does not decrease against app under test when Spot is interrupted Jenkins Build Slaves - use Spot Fleet Plugin Jenkins will automatically increase Spot Fleet target capacity upon pending jobs and scale in when no queue
  • 16. Your instance type requirements, budget requirements, and application design will determine how to apply the following best practices: Be Flexible about InstanceTypes Test your application on different instance types when possible. Because prices fluctuate independently for each instances type in an Availability Zone, you can often get more compute capacity for the same price when you have instance type flexibility. Request all instance types that meet your requirements to further reduce costs and improve application performance. Spot Fleets enable you to request multiple instance types simultaneously. Minimize the impact of interruptions . Amazon’s EC2 Spot’s Hibernate feature allows you to pause and then resume Amazon EBS backed instances when capacity is available. Hibernate is just like closing and opening your laptop lid, with your application starting up right where it left off.
  • 17. CONTINUED Choose pools where prices haven’t changed much Because prices adjust based on long-term demand, popular instance types (such as recently launched instance families), tend to have more price adjustments. Therefore, picking older-generation instance types that are less popular tends to result in lower costs and fewer interruption. Similarly, the same instance type can have different prices in different Availability Zones. Start with LaunchTemplates sooner then later These will be required for new features.
  • 19. 1. Open up the ElasticContainer Service Console using the link https://console.aws.amazon.com/ecs/ . 2. On the left hand menu under Amazon ECS click on Clusters 3. Now click on the blue Create Cluster Button. 4. Select the EC2 Linux + Networking template then click on the Next Step button at the bottom. 5. Enter the cluster name as SpotECScluster 6. Under the provisioning model - Select Spot 7. For the Spot Instance allocation strategy - choose Diversified 8. Choose an instance type(s) from the dropdown (suggested r3.large) and put in number of instances as 3 9. Under maximum price, check table - try to go for $0.02 per hour if you set (optional) 10. Leave the other values as default and then choose a keypair to launch the instances with 11. Choose create a new role for the ECS instances if you don’t already have a specified ECS role 12. Now click on the blue Create Button. 13. When the cluster completion creates you will be able to see the EcsSpotFleet logical ID 14. Copy this ID to your clipboard 15. Go to the EC2 services part of the Console https://console.aws.amazon.com/ec2/ Testing Spot Fleet
  • 20. 15. Under Instances choose Spot Requests on the Left Hand menu 16. Paste the resource id from your clipboard into the search bar at the top 17. If you expand the request you can see the EC2 instances which are part of the request 18. Go back to the ECS console and view your cluster We will schedule a task 19. Click on the Services tab 20. Click the Blue Create tab under the Services tab 21. On the Configure Service screen - choose EC2 as the Launch type 22. Choose yourTask Definition and revision 23. Choose the SpotECScluster from the Cluster name Dropdown list 24. Change Minimum Healthy Percent to 50 (leave everything else defaults) 25. Click Next Step 26. Choose None for load balancer 27. Click Create Service 28. Go back to the EC2 Console -> Spot Requests and select the current Spot Fleet 29. At the top of the menu SelectActions -> Modify target Capacity 30. Set the new target capacity to 2 (from previous value of 3) , Click Submit Testing Spot Fleet

Hinweis der Redaktion

  1. You simply submit a Spot instance request and use the new BlockDuration parameter to specify the number of hours your want your instance(s) to run, along with the maximum price that you are willing to pay. When Spot instance capacity is available for the the requested duration, your instances will launch and run continuously for a flat hourly price. They will be terminated automatically at the end of the time block (you can also terminate them manually). This model is a good for situations where you have jobs that need to run continuously for up to 6 hours.
  2. Either do Whitelisting or Blacklisting - but don’t do both
  3. Either do Whitelisting or Blacklisting - but don’t do both
  4. Even though you access the hub console from Oregon, you can move into any region as long as the migration tool supports it.
  5. Even though you access the hub console from Oregon, you can move into any region as long as the migration tool supports it.