SlideShare ist ein Scribd-Unternehmen logo
1 von 21
Downloaden Sie, um offline zu lesen
Best Practices in Cloud
Optimization
Lessons learned from 450 AWS cloud deployments




                               Cloud Computing Meetup, Silicon Valley
                               April 2013
About me



• Co-Founder & CEO, Cloudyn™
• Sr. Principal, Cloud BU, CA Technologies
• Sr. Director, Products, Oblicore (Acquired by CA)

       Cloud Economics

       @cloudyn_buzz

        Cloudyn.com | blog.cloudyn.com
        sharon@cloudyn.com
New clouds, old challenges




                     Dynamic environments result in over-
                     provisioning, wasted resources and
                     budget violations.
About Cloudyn™



Cloudyn analyzes, diagnoses and
optimizes cloud deployments.

• SaaS-based, non-intrusive
• Cloud analytics & predictive insights
• Sizing, location & pricing optimization
• Actionable recommendations
• Cloud Orchestration integration
Effective deployments require consistent monitoring



What should be monitored?
• Usage: Who is using what, where and when?
• Performance: What is the utilization rate?
• Cost: How much does it cost us?


• Life-cycle: What has been changed and when?
• Business metrics: How is it related to our business activities?
Effective deployment optimization



What can be optimized?
• Usage: Can we retire or reuse existing resources?
• Performance: Can we size resources better (up or down)?
• Cost: Can we pay less for each compute unit we use?
How can we find optimization opportunities?



Bringing real cloud usage data from 450 AWS cloud customers into the mix:



      ~2.5m
         Virtual instances, thousands of databases and
         billions of storage objects monitored in the survey.

                              Yearly Spend     % of customers
                              +1M                    4%
                              500K-1M                2%
                              100K-500K              22%
                              50K-100K               11%
                              50K                    61%
Usage trend : Storage



Surprise. You have storage (S3, EBS)

• Typically represents 14% of the cloud spend.
• Only 12% is using cheaper storage (Glacier) options
Usage optimization : S3 / Glacier



• Object Size best practice:
    • Store large objects on Glacier (40K overhead / Obj)
• Object pricing best practice:
    • Store long term (+3m) objects on Glacier
    • Penalty for early deletion!
• Daily backups best practice:
    • Keep on standard storage for 1 week
    • Move to Glacier afterwards
• Using S3 versioned buckets?
    • Nearly 10% of them have hidden objects
Usage optimization: EBS



Bad habits are hard to break…

                 Does it make sense to keep the light on when
                 you leave the room? Why do that to your EBS
                 Volumes?


• 16% of EBS volumes are unattached and subject
  to deletion or change (S3, Glacier)
• In some cases (0.5% of EBS), EBS volumes
  reported as attached but are not connected at all.
Usage trends : Compute / Database




One m1.large cappuccino with
extra espresso shot please…
Coffee customization,
Starbucks @ AWS Re:Invent



                            If you do it for your coffee, why not treat
                            your instances the same? It’s 20% of your
                            monthly bill.
Usage trend : Compute



By looking at CPU, Memory, I/O, Network:

Most instances are significantly
underutilized.
• Average yearly CPU utilization of 17%
• Max RAM utilization of 64%
• As instance size increase, utilization decreases

                              Size         % of Spend   CPU Util.
                              m1.large        27.5%          9%
                              m2.4xlarge      17.5%          6%
                              c1.xlarge        7.7%          9%
                              m1.xlarge        9.9%         14%
Optimization example: Compute



Comparing m1. large to m1.xlarge for RDBMS:
Spec              m1.large      m1.xlarge
RAM                7.5Gib         15 Gib
CPU               4 EC2 CU       8 EC2 CU
Storage            850 GB        1690 GB
I/O Perf          Moderate         High



• m1.large EBS-optimized + 500 Mbps provisioned IOPS
  performed better than single m1.xlarge
Pricing Optimization




Cloud vendors love
charging less…


                       Yep, this is not a typo, and you don’t
                       really leverage it.
Price optimization




Why they love charging you less?
• Capacity planning
• Customer satisfaction
• The Jevons paradox
• The upfront payment

                      Goal: Fast ROI, low cost per compute
                      unit using reserved capacity (AKA RIs).
Pricing Trend – Reserved, On-Demand, Spot



RIs - known and unknown facts:
• Requires one time payment
• Resource availability is guaranteed
• Pay less per hour
• 71% of instances run on-demand, 26% run reserved


                      93% of the on-demand instances
                      should be reserved.
Common mistake – breakeven point and commitment point



RI’s breakeven point and commitment
are not the same.
• Breakeven point :
   • The point you receive a return on your upfront payment
      and start to save on compute hours
• Commitment :
   • The cloud vendor’s commitment for resource availability
• Saving :
   • End of year On-Demand <MINUS >Reserved Instance cost
Breakeven point best practice



            M1.large Linux instance in Virginia for 1 year




                                                             Savings
                Breakeven after
             2.5mon, 30% Runtime
Common RI mistake




                      Optimal RI
                      Purchasing

                        Safe RI
                    Purchasing
Unused Reservation and Marketplace



Reuse / Recycle what you don’t need.
• 31% of Reservation are unused:
   • Relocate On-demand Instances
   • Sell on the marketplace
• Note:
   • On demand prices drop every quarter
   • Reserved instances drop every year
   • You always sell at your original purchase price!
www.cloudyn.com

Weitere ähnliche Inhalte

Was ist angesagt?

Optimizing Costs and Efficiency of AWS Services
Optimizing Costs and Efficiency of AWS ServicesOptimizing Costs and Efficiency of AWS Services
Optimizing Costs and Efficiency of AWS ServicesAmazon Web Services
 
AWS Cost optimization at scale
AWS Cost optimization at scaleAWS Cost optimization at scale
AWS Cost optimization at scaleBrett Pollak
 
Optimizing Your AWS Applications and Usage to Reduce Costs
Optimizing Your AWS Applications and Usage to Reduce CostsOptimizing Your AWS Applications and Usage to Reduce Costs
Optimizing Your AWS Applications and Usage to Reduce CostsAmazon Web Services
 
Optimizing for Cost in the AWS Cloud - 5 Ways to Further Save - AWS Summit 20...
Optimizing for Cost in the AWS Cloud - 5 Ways to Further Save - AWS Summit 20...Optimizing for Cost in the AWS Cloud - 5 Ways to Further Save - AWS Summit 20...
Optimizing for Cost in the AWS Cloud - 5 Ways to Further Save - AWS Summit 20...Amazon Web Services
 
2016 Utah Cloud Summit: TCO & Cost Optimization
2016 Utah Cloud Summit: TCO & Cost Optimization2016 Utah Cloud Summit: TCO & Cost Optimization
2016 Utah Cloud Summit: TCO & Cost Optimization1Strategy
 
Reducing Cost & Maximizing Efficiency: Tightening the Belt on AWS (CPN211) | ...
Reducing Cost & Maximizing Efficiency: Tightening the Belt on AWS (CPN211) | ...Reducing Cost & Maximizing Efficiency: Tightening the Belt on AWS (CPN211) | ...
Reducing Cost & Maximizing Efficiency: Tightening the Belt on AWS (CPN211) | ...Amazon Web Services
 
How Cost Optimization can help me reduce my Cloud bill by upto 75%
How Cost Optimization can help me reduce my Cloud bill by upto 75% How Cost Optimization can help me reduce my Cloud bill by upto 75%
How Cost Optimization can help me reduce my Cloud bill by upto 75% Centilytics
 
Mini conf 20-jan-18 delhi
Mini conf   20-jan-18 delhiMini conf   20-jan-18 delhi
Mini conf 20-jan-18 delhiAlbert Anthony
 
AWS Cost Optimization Strategy
AWS Cost Optimization StrategyAWS Cost Optimization Strategy
AWS Cost Optimization StrategyRobert Sell
 
Optimizing Your Infrastructure Costs on AWS
Optimizing Your Infrastructure Costs on AWSOptimizing Your Infrastructure Costs on AWS
Optimizing Your Infrastructure Costs on AWSAmazon Web Services
 
AWS S3 Cost Optimization
AWS S3 Cost OptimizationAWS S3 Cost Optimization
AWS S3 Cost OptimizationEric Kim
 
AWS December 2015 Webinar Series - Strategies to Quantify TCO & Optimize Cost...
AWS December 2015 Webinar Series - Strategies to Quantify TCO & Optimize Cost...AWS December 2015 Webinar Series - Strategies to Quantify TCO & Optimize Cost...
AWS December 2015 Webinar Series - Strategies to Quantify TCO & Optimize Cost...Amazon Web Services
 
Multi-Cloud Economics by Cloudyn Feb 2014
Multi-Cloud Economics by Cloudyn Feb 2014Multi-Cloud Economics by Cloudyn Feb 2014
Multi-Cloud Economics by Cloudyn Feb 2014Cloudyn
 
How to get the most out of your cloud - Microsoft Cloud Day
How to get the most out of your cloud - Microsoft Cloud DayHow to get the most out of your cloud - Microsoft Cloud Day
How to get the most out of your cloud - Microsoft Cloud DayCloudyn
 
The *New* Science Of Choosing AWS Reserved Instances
The *New* Science Of Choosing AWS Reserved InstancesThe *New* Science Of Choosing AWS Reserved Instances
The *New* Science Of Choosing AWS Reserved InstancesCloudability
 
Cloud Economics – Finding Your ROI
Cloud Economics – Finding Your ROICloud Economics – Finding Your ROI
Cloud Economics – Finding Your ROICloudyn
 
AWS Cloud Cost Optimization
AWS Cloud Cost OptimizationAWS Cloud Cost Optimization
AWS Cloud Cost OptimizationYogesh Sharma
 
Optimizing EC2 usage on AWS
Optimizing EC2 usage on AWSOptimizing EC2 usage on AWS
Optimizing EC2 usage on AWSCloudability
 
How to Set Up a Cloud Cost Optimization Process for your Enterprise
How to Set Up a Cloud Cost Optimization Process for your EnterpriseHow to Set Up a Cloud Cost Optimization Process for your Enterprise
How to Set Up a Cloud Cost Optimization Process for your EnterpriseRightScale
 

Was ist angesagt? (20)

Optimizing Costs and Efficiency of AWS Services
Optimizing Costs and Efficiency of AWS ServicesOptimizing Costs and Efficiency of AWS Services
Optimizing Costs and Efficiency of AWS Services
 
AWS Cost optimization at scale
AWS Cost optimization at scaleAWS Cost optimization at scale
AWS Cost optimization at scale
 
Optimizing Your AWS Applications and Usage to Reduce Costs
Optimizing Your AWS Applications and Usage to Reduce CostsOptimizing Your AWS Applications and Usage to Reduce Costs
Optimizing Your AWS Applications and Usage to Reduce Costs
 
Optimizing for Cost in the AWS Cloud - 5 Ways to Further Save - AWS Summit 20...
Optimizing for Cost in the AWS Cloud - 5 Ways to Further Save - AWS Summit 20...Optimizing for Cost in the AWS Cloud - 5 Ways to Further Save - AWS Summit 20...
Optimizing for Cost in the AWS Cloud - 5 Ways to Further Save - AWS Summit 20...
 
Cost Optimisation on AWS
Cost Optimisation on AWSCost Optimisation on AWS
Cost Optimisation on AWS
 
2016 Utah Cloud Summit: TCO & Cost Optimization
2016 Utah Cloud Summit: TCO & Cost Optimization2016 Utah Cloud Summit: TCO & Cost Optimization
2016 Utah Cloud Summit: TCO & Cost Optimization
 
Reducing Cost & Maximizing Efficiency: Tightening the Belt on AWS (CPN211) | ...
Reducing Cost & Maximizing Efficiency: Tightening the Belt on AWS (CPN211) | ...Reducing Cost & Maximizing Efficiency: Tightening the Belt on AWS (CPN211) | ...
Reducing Cost & Maximizing Efficiency: Tightening the Belt on AWS (CPN211) | ...
 
How Cost Optimization can help me reduce my Cloud bill by upto 75%
How Cost Optimization can help me reduce my Cloud bill by upto 75% How Cost Optimization can help me reduce my Cloud bill by upto 75%
How Cost Optimization can help me reduce my Cloud bill by upto 75%
 
Mini conf 20-jan-18 delhi
Mini conf   20-jan-18 delhiMini conf   20-jan-18 delhi
Mini conf 20-jan-18 delhi
 
AWS Cost Optimization Strategy
AWS Cost Optimization StrategyAWS Cost Optimization Strategy
AWS Cost Optimization Strategy
 
Optimizing Your Infrastructure Costs on AWS
Optimizing Your Infrastructure Costs on AWSOptimizing Your Infrastructure Costs on AWS
Optimizing Your Infrastructure Costs on AWS
 
AWS S3 Cost Optimization
AWS S3 Cost OptimizationAWS S3 Cost Optimization
AWS S3 Cost Optimization
 
AWS December 2015 Webinar Series - Strategies to Quantify TCO & Optimize Cost...
AWS December 2015 Webinar Series - Strategies to Quantify TCO & Optimize Cost...AWS December 2015 Webinar Series - Strategies to Quantify TCO & Optimize Cost...
AWS December 2015 Webinar Series - Strategies to Quantify TCO & Optimize Cost...
 
Multi-Cloud Economics by Cloudyn Feb 2014
Multi-Cloud Economics by Cloudyn Feb 2014Multi-Cloud Economics by Cloudyn Feb 2014
Multi-Cloud Economics by Cloudyn Feb 2014
 
How to get the most out of your cloud - Microsoft Cloud Day
How to get the most out of your cloud - Microsoft Cloud DayHow to get the most out of your cloud - Microsoft Cloud Day
How to get the most out of your cloud - Microsoft Cloud Day
 
The *New* Science Of Choosing AWS Reserved Instances
The *New* Science Of Choosing AWS Reserved InstancesThe *New* Science Of Choosing AWS Reserved Instances
The *New* Science Of Choosing AWS Reserved Instances
 
Cloud Economics – Finding Your ROI
Cloud Economics – Finding Your ROICloud Economics – Finding Your ROI
Cloud Economics – Finding Your ROI
 
AWS Cloud Cost Optimization
AWS Cloud Cost OptimizationAWS Cloud Cost Optimization
AWS Cloud Cost Optimization
 
Optimizing EC2 usage on AWS
Optimizing EC2 usage on AWSOptimizing EC2 usage on AWS
Optimizing EC2 usage on AWS
 
How to Set Up a Cloud Cost Optimization Process for your Enterprise
How to Set Up a Cloud Cost Optimization Process for your EnterpriseHow to Set Up a Cloud Cost Optimization Process for your Enterprise
How to Set Up a Cloud Cost Optimization Process for your Enterprise
 

Andere mochten auch

AWS Cost Management Lessons from the Private Sector
AWS Cost Management Lessons from the Private SectorAWS Cost Management Lessons from the Private Sector
AWS Cost Management Lessons from the Private SectorAmazon Web Services
 
Optimizing AWS S3 storage costs and usage
Optimizing AWS S3 storage costs and usageOptimizing AWS S3 storage costs and usage
Optimizing AWS S3 storage costs and usageCloudability
 
AWS re:Invent 2016: Cost Optimization at Scale (ENT209)
AWS re:Invent 2016: Cost Optimization at Scale (ENT209)AWS re:Invent 2016: Cost Optimization at Scale (ENT209)
AWS re:Invent 2016: Cost Optimization at Scale (ENT209)Amazon Web Services
 
AWS Partner Webcast - Advanced Strategies for AWS Cost Allocation with Tags a...
AWS Partner Webcast - Advanced Strategies for AWS Cost Allocation with Tags a...AWS Partner Webcast - Advanced Strategies for AWS Cost Allocation with Tags a...
AWS Partner Webcast - Advanced Strategies for AWS Cost Allocation with Tags a...Amazon Web Services
 
AWS June Webinar Series - Getting Started: Lowering Total Cost of Ownership w...
AWS June Webinar Series - Getting Started: Lowering Total Cost of Ownership w...AWS June Webinar Series - Getting Started: Lowering Total Cost of Ownership w...
AWS June Webinar Series - Getting Started: Lowering Total Cost of Ownership w...Amazon Web Services
 
AWS Cost Control
AWS Cost ControlAWS Cost Control
AWS Cost ControlBob Brown
 
Proactive Cost Management for AWS Cloud
Proactive Cost Management for AWS CloudProactive Cost Management for AWS Cloud
Proactive Cost Management for AWS CloudNutanix Beam
 
Cost Optimization on AWS - Pop-up Loft Tel Aviv
Cost Optimization on AWS - Pop-up Loft Tel AvivCost Optimization on AWS - Pop-up Loft Tel Aviv
Cost Optimization on AWS - Pop-up Loft Tel AvivAmazon Web Services
 
Data Warehousing in the Era of Big Data: Intro to Amazon Redshift
Data Warehousing in the Era of Big Data: Intro to Amazon RedshiftData Warehousing in the Era of Big Data: Intro to Amazon Redshift
Data Warehousing in the Era of Big Data: Intro to Amazon RedshiftAmazon Web Services
 
Introducing “Well-Architected” For Developers - Technical 101
Introducing “Well-Architected” For Developers - Technical 101Introducing “Well-Architected” For Developers - Technical 101
Introducing “Well-Architected” For Developers - Technical 101Amazon Web Services
 
(ARC302) Running Lean Architectures: How to Optimize for Cost Efficiency | AW...
(ARC302) Running Lean Architectures: How to Optimize for Cost Efficiency | AW...(ARC302) Running Lean Architectures: How to Optimize for Cost Efficiency | AW...
(ARC302) Running Lean Architectures: How to Optimize for Cost Efficiency | AW...Amazon Web Services
 
Finding hidden waste in your AWS infrastructure - 2/11/16
Finding hidden waste in your AWS infrastructure - 2/11/16Finding hidden waste in your AWS infrastructure - 2/11/16
Finding hidden waste in your AWS infrastructure - 2/11/16Cloudability
 
Strategies to Optimize Costs Using AWS - AWS May 2016 Webinar Series
Strategies to Optimize Costs Using AWS - AWS May 2016 Webinar SeriesStrategies to Optimize Costs Using AWS - AWS May 2016 Webinar Series
Strategies to Optimize Costs Using AWS - AWS May 2016 Webinar SeriesAmazon Web Services
 
AWS Cost Allocation best practices: How high-growth businesses succeed
AWS Cost Allocation best practices: How high-growth businesses succeedAWS Cost Allocation best practices: How high-growth businesses succeed
AWS Cost Allocation best practices: How high-growth businesses succeedCloudability
 
Introducing AWS IoT - Interfacing with the Physical World - Technical 101
Introducing AWS IoT - Interfacing with the Physical World - Technical 101Introducing AWS IoT - Interfacing with the Physical World - Technical 101
Introducing AWS IoT - Interfacing with the Physical World - Technical 101Amazon Web Services
 
(PFC306) Performance Tuning Amazon EC2 Instances | AWS re:Invent 2014
(PFC306) Performance Tuning Amazon EC2 Instances | AWS re:Invent 2014(PFC306) Performance Tuning Amazon EC2 Instances | AWS re:Invent 2014
(PFC306) Performance Tuning Amazon EC2 Instances | AWS re:Invent 2014Amazon Web Services
 
Creating a Culture of Cost Management in Your Organization
Creating a Culture of Cost Management in Your OrganizationCreating a Culture of Cost Management in Your Organization
Creating a Culture of Cost Management in Your OrganizationAmazon Web Services
 
AWS IoT - Best of re:Invent Tel Aviv
AWS IoT - Best of re:Invent Tel AvivAWS IoT - Best of re:Invent Tel Aviv
AWS IoT - Best of re:Invent Tel AvivAmazon Web Services
 
AWS re:Invent 2016: Big Data Architectural Patterns and Best Practices on AWS...
AWS re:Invent 2016: Big Data Architectural Patterns and Best Practices on AWS...AWS re:Invent 2016: Big Data Architectural Patterns and Best Practices on AWS...
AWS re:Invent 2016: Big Data Architectural Patterns and Best Practices on AWS...Amazon Web Services
 

Andere mochten auch (19)

AWS Cost Management Lessons from the Private Sector
AWS Cost Management Lessons from the Private SectorAWS Cost Management Lessons from the Private Sector
AWS Cost Management Lessons from the Private Sector
 
Optimizing AWS S3 storage costs and usage
Optimizing AWS S3 storage costs and usageOptimizing AWS S3 storage costs and usage
Optimizing AWS S3 storage costs and usage
 
AWS re:Invent 2016: Cost Optimization at Scale (ENT209)
AWS re:Invent 2016: Cost Optimization at Scale (ENT209)AWS re:Invent 2016: Cost Optimization at Scale (ENT209)
AWS re:Invent 2016: Cost Optimization at Scale (ENT209)
 
AWS Partner Webcast - Advanced Strategies for AWS Cost Allocation with Tags a...
AWS Partner Webcast - Advanced Strategies for AWS Cost Allocation with Tags a...AWS Partner Webcast - Advanced Strategies for AWS Cost Allocation with Tags a...
AWS Partner Webcast - Advanced Strategies for AWS Cost Allocation with Tags a...
 
AWS June Webinar Series - Getting Started: Lowering Total Cost of Ownership w...
AWS June Webinar Series - Getting Started: Lowering Total Cost of Ownership w...AWS June Webinar Series - Getting Started: Lowering Total Cost of Ownership w...
AWS June Webinar Series - Getting Started: Lowering Total Cost of Ownership w...
 
AWS Cost Control
AWS Cost ControlAWS Cost Control
AWS Cost Control
 
Proactive Cost Management for AWS Cloud
Proactive Cost Management for AWS CloudProactive Cost Management for AWS Cloud
Proactive Cost Management for AWS Cloud
 
Cost Optimization on AWS - Pop-up Loft Tel Aviv
Cost Optimization on AWS - Pop-up Loft Tel AvivCost Optimization on AWS - Pop-up Loft Tel Aviv
Cost Optimization on AWS - Pop-up Loft Tel Aviv
 
Data Warehousing in the Era of Big Data: Intro to Amazon Redshift
Data Warehousing in the Era of Big Data: Intro to Amazon RedshiftData Warehousing in the Era of Big Data: Intro to Amazon Redshift
Data Warehousing in the Era of Big Data: Intro to Amazon Redshift
 
Introducing “Well-Architected” For Developers - Technical 101
Introducing “Well-Architected” For Developers - Technical 101Introducing “Well-Architected” For Developers - Technical 101
Introducing “Well-Architected” For Developers - Technical 101
 
(ARC302) Running Lean Architectures: How to Optimize for Cost Efficiency | AW...
(ARC302) Running Lean Architectures: How to Optimize for Cost Efficiency | AW...(ARC302) Running Lean Architectures: How to Optimize for Cost Efficiency | AW...
(ARC302) Running Lean Architectures: How to Optimize for Cost Efficiency | AW...
 
Finding hidden waste in your AWS infrastructure - 2/11/16
Finding hidden waste in your AWS infrastructure - 2/11/16Finding hidden waste in your AWS infrastructure - 2/11/16
Finding hidden waste in your AWS infrastructure - 2/11/16
 
Strategies to Optimize Costs Using AWS - AWS May 2016 Webinar Series
Strategies to Optimize Costs Using AWS - AWS May 2016 Webinar SeriesStrategies to Optimize Costs Using AWS - AWS May 2016 Webinar Series
Strategies to Optimize Costs Using AWS - AWS May 2016 Webinar Series
 
AWS Cost Allocation best practices: How high-growth businesses succeed
AWS Cost Allocation best practices: How high-growth businesses succeedAWS Cost Allocation best practices: How high-growth businesses succeed
AWS Cost Allocation best practices: How high-growth businesses succeed
 
Introducing AWS IoT - Interfacing with the Physical World - Technical 101
Introducing AWS IoT - Interfacing with the Physical World - Technical 101Introducing AWS IoT - Interfacing with the Physical World - Technical 101
Introducing AWS IoT - Interfacing with the Physical World - Technical 101
 
(PFC306) Performance Tuning Amazon EC2 Instances | AWS re:Invent 2014
(PFC306) Performance Tuning Amazon EC2 Instances | AWS re:Invent 2014(PFC306) Performance Tuning Amazon EC2 Instances | AWS re:Invent 2014
(PFC306) Performance Tuning Amazon EC2 Instances | AWS re:Invent 2014
 
Creating a Culture of Cost Management in Your Organization
Creating a Culture of Cost Management in Your OrganizationCreating a Culture of Cost Management in Your Organization
Creating a Culture of Cost Management in Your Organization
 
AWS IoT - Best of re:Invent Tel Aviv
AWS IoT - Best of re:Invent Tel AvivAWS IoT - Best of re:Invent Tel Aviv
AWS IoT - Best of re:Invent Tel Aviv
 
AWS re:Invent 2016: Big Data Architectural Patterns and Best Practices on AWS...
AWS re:Invent 2016: Big Data Architectural Patterns and Best Practices on AWS...AWS re:Invent 2016: Big Data Architectural Patterns and Best Practices on AWS...
AWS re:Invent 2016: Big Data Architectural Patterns and Best Practices on AWS...
 

Ähnlich wie Best Practices for AWS Cloud Cost Optimization

AWS re:Invent re:Cap - 비용 최적화 - 모범사례와 아키텍처 설계 심화편 - 이원일
AWS re:Invent re:Cap - 비용 최적화 - 모범사례와 아키텍처 설계 심화편 - 이원일AWS re:Invent re:Cap - 비용 최적화 - 모범사례와 아키텍처 설계 심화편 - 이원일
AWS re:Invent re:Cap - 비용 최적화 - 모범사례와 아키텍처 설계 심화편 - 이원일Amazon Web Services Korea
 
AWS Cost Optimization
AWS Cost OptimizationAWS Cost Optimization
AWS Cost OptimizationMiles Ward
 
How to Find and Fix Waste to Optimize Your Cloud Spend
How to Find and Fix Waste to Optimize Your Cloud SpendHow to Find and Fix Waste to Optimize Your Cloud Spend
How to Find and Fix Waste to Optimize Your Cloud SpendRightScale
 
Running Lean Architectures: How to Optimize for Cost Efficiency
Running Lean Architectures: How to Optimize for Cost Efficiency Running Lean Architectures: How to Optimize for Cost Efficiency
Running Lean Architectures: How to Optimize for Cost Efficiency Amazon Web Services
 
AWS Meet-up Atlanta: AWS Economics
AWS Meet-up Atlanta: AWS EconomicsAWS Meet-up Atlanta: AWS Economics
AWS Meet-up Atlanta: AWS EconomicsAaron Klein
 
Strategies For Lasting Savings With AWS Reserved Instances
Strategies For Lasting Savings With AWS Reserved InstancesStrategies For Lasting Savings With AWS Reserved Instances
Strategies For Lasting Savings With AWS Reserved InstancesCloudability
 
Optimizing Costs and Efficiency of AWS Services
Optimizing Costs and Efficiency of AWS ServicesOptimizing Costs and Efficiency of AWS Services
Optimizing Costs and Efficiency of AWS ServicesAmazon Web Services
 
12 Ways to Manage Cloud Costs and Optimize Cloud Spend
12 Ways to Manage Cloud Costs and Optimize Cloud Spend12 Ways to Manage Cloud Costs and Optimize Cloud Spend
12 Ways to Manage Cloud Costs and Optimize Cloud SpendRightScale
 
Optimizing AWS Economics
Optimizing AWS EconomicsOptimizing AWS Economics
Optimizing AWS EconomicsAaron Klein
 
AWS Summit Tel Aviv - Enterprise Track - Cost Optimization & TCO
AWS Summit Tel Aviv - Enterprise Track - Cost Optimization & TCOAWS Summit Tel Aviv - Enterprise Track - Cost Optimization & TCO
AWS Summit Tel Aviv - Enterprise Track - Cost Optimization & TCOAmazon Web Services
 
AWS Summit Auckland 2014 | Moving to the Cloud. What does it Mean to your Bus...
AWS Summit Auckland 2014 | Moving to the Cloud. What does it Mean to your Bus...AWS Summit Auckland 2014 | Moving to the Cloud. What does it Mean to your Bus...
AWS Summit Auckland 2014 | Moving to the Cloud. What does it Mean to your Bus...Amazon Web Services
 
B4 - The TCO of cloud applications
B4 - The TCO of cloud applicationsB4 - The TCO of cloud applications
B4 - The TCO of cloud applicationsAmazon Web Services
 
AWS Summit Sydney 2014 | Moving to the Cloud. What does it Mean to your Business
AWS Summit Sydney 2014 | Moving to the Cloud. What does it Mean to your BusinessAWS Summit Sydney 2014 | Moving to the Cloud. What does it Mean to your Business
AWS Summit Sydney 2014 | Moving to the Cloud. What does it Mean to your BusinessAmazon Web Services
 
AWS Cloud Kata 2013 | Singapore - Achieving Profitability on AWS
AWS Cloud Kata 2013 | Singapore - Achieving Profitability on AWSAWS Cloud Kata 2013 | Singapore - Achieving Profitability on AWS
AWS Cloud Kata 2013 | Singapore - Achieving Profitability on AWSAmazon Web Services
 
AWS Cloud Kata | Manila - Getting to Profitability on AWS
AWS Cloud Kata | Manila - Getting to Profitability on AWSAWS Cloud Kata | Manila - Getting to Profitability on AWS
AWS Cloud Kata | Manila - Getting to Profitability on AWSAmazon Web Services
 
AWS Summit 2013 | Auckland - Optimizing Your AWS Applications and Usage to Re...
AWS Summit 2013 | Auckland - Optimizing Your AWS Applications and Usage to Re...AWS Summit 2013 | Auckland - Optimizing Your AWS Applications and Usage to Re...
AWS Summit 2013 | Auckland - Optimizing Your AWS Applications and Usage to Re...Amazon Web Services
 
Cost optimization at scale toronto v3
Cost optimization at scale toronto v3Cost optimization at scale toronto v3
Cost optimization at scale toronto v3Amazon Web Services
 

Ähnlich wie Best Practices for AWS Cloud Cost Optimization (20)

KGC 2013 AWS session
KGC 2013 AWS session KGC 2013 AWS session
KGC 2013 AWS session
 
AWS re:Invent re:Cap - 비용 최적화 - 모범사례와 아키텍처 설계 심화편 - 이원일
AWS re:Invent re:Cap - 비용 최적화 - 모범사례와 아키텍처 설계 심화편 - 이원일AWS re:Invent re:Cap - 비용 최적화 - 모범사례와 아키텍처 설계 심화편 - 이원일
AWS re:Invent re:Cap - 비용 최적화 - 모범사례와 아키텍처 설계 심화편 - 이원일
 
AWS Cost Optimization
AWS Cost OptimizationAWS Cost Optimization
AWS Cost Optimization
 
How to Find and Fix Waste to Optimize Your Cloud Spend
How to Find and Fix Waste to Optimize Your Cloud SpendHow to Find and Fix Waste to Optimize Your Cloud Spend
How to Find and Fix Waste to Optimize Your Cloud Spend
 
Running Lean Architectures: How to Optimize for Cost Efficiency
Running Lean Architectures: How to Optimize for Cost Efficiency Running Lean Architectures: How to Optimize for Cost Efficiency
Running Lean Architectures: How to Optimize for Cost Efficiency
 
AWS Meet-up Atlanta: AWS Economics
AWS Meet-up Atlanta: AWS EconomicsAWS Meet-up Atlanta: AWS Economics
AWS Meet-up Atlanta: AWS Economics
 
Strategies For Lasting Savings With AWS Reserved Instances
Strategies For Lasting Savings With AWS Reserved InstancesStrategies For Lasting Savings With AWS Reserved Instances
Strategies For Lasting Savings With AWS Reserved Instances
 
Optimizing Costs and Efficiency of AWS Services
Optimizing Costs and Efficiency of AWS ServicesOptimizing Costs and Efficiency of AWS Services
Optimizing Costs and Efficiency of AWS Services
 
12 Ways to Manage Cloud Costs and Optimize Cloud Spend
12 Ways to Manage Cloud Costs and Optimize Cloud Spend12 Ways to Manage Cloud Costs and Optimize Cloud Spend
12 Ways to Manage Cloud Costs and Optimize Cloud Spend
 
Optimizing AWS Economics
Optimizing AWS EconomicsOptimizing AWS Economics
Optimizing AWS Economics
 
Cost Optimisation on AWS
Cost Optimisation on AWSCost Optimisation on AWS
Cost Optimisation on AWS
 
AWS Summit Tel Aviv - Enterprise Track - Cost Optimization & TCO
AWS Summit Tel Aviv - Enterprise Track - Cost Optimization & TCOAWS Summit Tel Aviv - Enterprise Track - Cost Optimization & TCO
AWS Summit Tel Aviv - Enterprise Track - Cost Optimization & TCO
 
AWS Summit Auckland 2014 | Moving to the Cloud. What does it Mean to your Bus...
AWS Summit Auckland 2014 | Moving to the Cloud. What does it Mean to your Bus...AWS Summit Auckland 2014 | Moving to the Cloud. What does it Mean to your Bus...
AWS Summit Auckland 2014 | Moving to the Cloud. What does it Mean to your Bus...
 
B4 - The TCO of cloud applications
B4 - The TCO of cloud applicationsB4 - The TCO of cloud applications
B4 - The TCO of cloud applications
 
Optimize Cost Efficiency on AWS
Optimize Cost Efficiency on AWSOptimize Cost Efficiency on AWS
Optimize Cost Efficiency on AWS
 
AWS Summit Sydney 2014 | Moving to the Cloud. What does it Mean to your Business
AWS Summit Sydney 2014 | Moving to the Cloud. What does it Mean to your BusinessAWS Summit Sydney 2014 | Moving to the Cloud. What does it Mean to your Business
AWS Summit Sydney 2014 | Moving to the Cloud. What does it Mean to your Business
 
AWS Cloud Kata 2013 | Singapore - Achieving Profitability on AWS
AWS Cloud Kata 2013 | Singapore - Achieving Profitability on AWSAWS Cloud Kata 2013 | Singapore - Achieving Profitability on AWS
AWS Cloud Kata 2013 | Singapore - Achieving Profitability on AWS
 
AWS Cloud Kata | Manila - Getting to Profitability on AWS
AWS Cloud Kata | Manila - Getting to Profitability on AWSAWS Cloud Kata | Manila - Getting to Profitability on AWS
AWS Cloud Kata | Manila - Getting to Profitability on AWS
 
AWS Summit 2013 | Auckland - Optimizing Your AWS Applications and Usage to Re...
AWS Summit 2013 | Auckland - Optimizing Your AWS Applications and Usage to Re...AWS Summit 2013 | Auckland - Optimizing Your AWS Applications and Usage to Re...
AWS Summit 2013 | Auckland - Optimizing Your AWS Applications and Usage to Re...
 
Cost optimization at scale toronto v3
Cost optimization at scale toronto v3Cost optimization at scale toronto v3
Cost optimization at scale toronto v3
 

Best Practices for AWS Cloud Cost Optimization

  • 1. Best Practices in Cloud Optimization Lessons learned from 450 AWS cloud deployments Cloud Computing Meetup, Silicon Valley April 2013
  • 2. About me • Co-Founder & CEO, Cloudyn™ • Sr. Principal, Cloud BU, CA Technologies • Sr. Director, Products, Oblicore (Acquired by CA) Cloud Economics @cloudyn_buzz Cloudyn.com | blog.cloudyn.com sharon@cloudyn.com
  • 3. New clouds, old challenges Dynamic environments result in over- provisioning, wasted resources and budget violations.
  • 4. About Cloudyn™ Cloudyn analyzes, diagnoses and optimizes cloud deployments. • SaaS-based, non-intrusive • Cloud analytics & predictive insights • Sizing, location & pricing optimization • Actionable recommendations • Cloud Orchestration integration
  • 5. Effective deployments require consistent monitoring What should be monitored? • Usage: Who is using what, where and when? • Performance: What is the utilization rate? • Cost: How much does it cost us? • Life-cycle: What has been changed and when? • Business metrics: How is it related to our business activities?
  • 6. Effective deployment optimization What can be optimized? • Usage: Can we retire or reuse existing resources? • Performance: Can we size resources better (up or down)? • Cost: Can we pay less for each compute unit we use?
  • 7. How can we find optimization opportunities? Bringing real cloud usage data from 450 AWS cloud customers into the mix: ~2.5m Virtual instances, thousands of databases and billions of storage objects monitored in the survey. Yearly Spend % of customers +1M 4% 500K-1M 2% 100K-500K 22% 50K-100K 11% 50K 61%
  • 8. Usage trend : Storage Surprise. You have storage (S3, EBS) • Typically represents 14% of the cloud spend. • Only 12% is using cheaper storage (Glacier) options
  • 9. Usage optimization : S3 / Glacier • Object Size best practice: • Store large objects on Glacier (40K overhead / Obj) • Object pricing best practice: • Store long term (+3m) objects on Glacier • Penalty for early deletion! • Daily backups best practice: • Keep on standard storage for 1 week • Move to Glacier afterwards • Using S3 versioned buckets? • Nearly 10% of them have hidden objects
  • 10. Usage optimization: EBS Bad habits are hard to break… Does it make sense to keep the light on when you leave the room? Why do that to your EBS Volumes? • 16% of EBS volumes are unattached and subject to deletion or change (S3, Glacier) • In some cases (0.5% of EBS), EBS volumes reported as attached but are not connected at all.
  • 11. Usage trends : Compute / Database One m1.large cappuccino with extra espresso shot please… Coffee customization, Starbucks @ AWS Re:Invent If you do it for your coffee, why not treat your instances the same? It’s 20% of your monthly bill.
  • 12. Usage trend : Compute By looking at CPU, Memory, I/O, Network: Most instances are significantly underutilized. • Average yearly CPU utilization of 17% • Max RAM utilization of 64% • As instance size increase, utilization decreases Size % of Spend CPU Util. m1.large 27.5% 9% m2.4xlarge 17.5% 6% c1.xlarge 7.7% 9% m1.xlarge 9.9% 14%
  • 13. Optimization example: Compute Comparing m1. large to m1.xlarge for RDBMS: Spec m1.large m1.xlarge RAM 7.5Gib 15 Gib CPU 4 EC2 CU 8 EC2 CU Storage 850 GB 1690 GB I/O Perf Moderate High • m1.large EBS-optimized + 500 Mbps provisioned IOPS performed better than single m1.xlarge
  • 14. Pricing Optimization Cloud vendors love charging less… Yep, this is not a typo, and you don’t really leverage it.
  • 15. Price optimization Why they love charging you less? • Capacity planning • Customer satisfaction • The Jevons paradox • The upfront payment Goal: Fast ROI, low cost per compute unit using reserved capacity (AKA RIs).
  • 16. Pricing Trend – Reserved, On-Demand, Spot RIs - known and unknown facts: • Requires one time payment • Resource availability is guaranteed • Pay less per hour • 71% of instances run on-demand, 26% run reserved 93% of the on-demand instances should be reserved.
  • 17. Common mistake – breakeven point and commitment point RI’s breakeven point and commitment are not the same. • Breakeven point : • The point you receive a return on your upfront payment and start to save on compute hours • Commitment : • The cloud vendor’s commitment for resource availability • Saving : • End of year On-Demand <MINUS >Reserved Instance cost
  • 18. Breakeven point best practice M1.large Linux instance in Virginia for 1 year Savings Breakeven after 2.5mon, 30% Runtime
  • 19. Common RI mistake Optimal RI Purchasing Safe RI Purchasing
  • 20. Unused Reservation and Marketplace Reuse / Recycle what you don’t need. • 31% of Reservation are unused: • Relocate On-demand Instances • Sell on the marketplace • Note: • On demand prices drop every quarter • Reserved instances drop every year • You always sell at your original purchase price!