More Related Content More from Amazon Web Services (20) Budget management with Cloud Economics | AWS Summit Tel Aviv 20192. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Budget management with Cloud
Economics
Orel Strassman
Business Development Manager
Amazon Web Services
S K L 2 0 2
Dvir Mizrahi
Cloud Analyst
Wix.com
3. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Key takeaways from this session…
4. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
The cloud has changed the way
IT & finance operate
5. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Traditional planning & procurement
The disruption of IT procurement
6. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Traditional planning & procurement
The disruption of IT procurement
Disruption of procurement process
7. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Pay for what you use
and actually need
8. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
The three pillars of cost optimization
Right-sizing Pick the right
purchasing option
Increase elasticity
Tagging,
Measuring &
monitoring
9. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Broadest and deepest platform choice
Workloads Capabilities Options
+ + =
175
instance types
10. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon EC2 purchase options
11. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
To optimize Amazon EC2, combine purchase options
Spot for fault-tolerant,
flexible, stateless workloads
On-Demand
12. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Let someone else
do your work for you
13. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
To optimize EC2, combine purchase options
Amazon Elastic
Container Service
Amazon EC2
Auto Scaling
Amazon Elastic
Container Service
for Kubernetes
EC2 Fleet
Amazon EMR AWS
CloudFormation
AWS
Batch
AWS Thinkbox
14. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
save up to 60 percent save 74%
saving 75%
costs by 75%
75% reduction
save 68%
Milk VFX peaked at 130,000
cores while
100 billion
$3M per year
~80% cost savings
A job that took weeks in their data
center, due to limited resources, takes
hours, thanks to the great parallelism,
at a very cost-efficient price.
Validated a 70%
reduction in EMR costs
without impacting their
SLAs
15. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
save up to 60 percent save 74%
saving 75%
costs by 75%
75% reduction
save 68%
Milk VFX peaked at 130,000
cores while
100 billion
$3M per year
~80% cost savings
A job that took weeks in their data
center, due to limited resources, takes
hours, thanks to the great parallelism,
at a very cost-efficient price.
Validated a 70%
reduction in EMR costs
without impacting their
SLAs
16. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon EC2 Auto Scaling
Auto Scaling simplifies capacity provisioning through automation
Amazon EC2
Auto Scaling
17. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Include Spot, On-Demand and RIs in a Single ASG
m4.large Spot Instances
m5.large Spot Instances
c4.xlarge On-Demand instances
Availability
Zone 1
Availability
Zone 2
Availability
Zone3
Combine purchase
options, instance
types and AZs in a
single ASG
Single ASG
18. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Predictive scaling in EC2 Auto Scaling
Machine learning technology behind the scenes
Machine
learning model
Billions of data points
from Amazon.com
Load metric
and forecasts
next two days based on
the pre-trained model
Performs
regression analysis
between load metric
and scaling metric
Schedules
scaling actions
for the next
two days, hourly
Repeats
every day
Capacity provisioning On-Premises Capacity provisioning with Dynamic Scaling Capacity provisioning with Predictive Scaling and
Dynamic Scaling
Time
Load/Capacity
Time
Load/Capacity
Time
Load/Capacity
Provisioned Capacity Actual Capacity Demand
19. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Workloads examples
Take advantage of cost and capacity optimization, by blending
Spot, OD and RIs
20. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Big data
Amazon
EMR
21. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Big data reference architecture
Master Node
(OD or RI)
S3
EMRFS
Master Fleet
Task Node
(Spot)
Task Node
(Spot)
Task Node
(Spot)
Task Fleet
Instance
Store
EBS Volume
Instance
Store
EBS Volume
Instance
Store
EBS Volume
Core Fleet
HDFS
Instance Fleet
Core Node
(OD or RI)
Core Node
(OD or RI)
Core Node
(OD or RI)
Amazon EMR
22. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Workload example #2
Website & apps on containers
Deploy web apps or services on containers and easily
manage clusters at any scale at a
fraction of the cost with Fleet
Amazon EC2
Auto Scaling
Amazon
EC2 Fleet
Amazon Elastic
Container Service
Amazon Elastic Container
Service for Kubernetes
23. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Stateless web application on containers
Session State Data
Amazon EC2
Auto Scaling
ECS
container 1
ECS
container 2
ECS
container 1
ECS
container 2
https://github.com/awslabs/ec2-spot-labs/tree/master/workshops/ec2-spot-fleet-web-app
24. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
CI/CD
25. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
CI/CD Reference Architecture
https://github.com/awslabs/ec2-spot-jenkins-plugin/
Users Application
Load
Balancer
Jenkins
Master
(OD or RI)
Jenkins Master
(OD or RI)
Jenkins Agent
(Spot)
Jenkins Agent
(Spot)
Spot Fleet
VPC
Jenkins Agent
(Spot)
Jenkins Agent
(Spot)
Availability
Zone 1
Availability
Zone 2
26. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Measuring
& monitoring
27. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Cloud management challenges
Traditional IT toolset not
built for cloud scale
infrastructure
Deploying multiple
products is a
significant overhead
Licensing costs
and complexity
Maintaining
enterprise-wide visibility
is challenging
Managing cloud and hybrid environments using a traditional
toolset is complex and costly
28. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
AWS Organizations
Policy-based management for multiple AWS accounts
Control AWS service
use across accounts
Consolidate billing
and usage reporting
Automate account
creation
29. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Implementing general best practices
https://d1.awsstatic.com/aws-answers/AWS_Tagging_Strategies.pdf
30. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
AWS billing dashboard
31. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Set up your AWS budget
32. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
AWS Cost Explorer – Dashboard or API
33. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
The Road to Financial Success at
Wix.com
Dvir Mizrahi
Cloud Analyst
34. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Agenda
Wix.com overview
Road to financial success
Our Approach
35. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
2017
110M
Users
With Wix you can create a stunning website.
36. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
We are a
team of 2,500
amazing people
& growing.
37. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Worked in
On-Premises
data center
Migrated to
AWS “as-is”
Optimized our
data center
Deployed in
several regions
38. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Utilizing our AWS
39. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Visibility
How do I add
“business logic” to my
infrastructure?
How much am I
paying per agenda?
Why?
Multidimension
tagging / labels for
deep dive to costs
40. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Visibility
How do I add
“business logic” to my
infrastructure?
How much am I
paying per agenda?
Why?
Multidimension
tagging / labels for
deep dive to costs
Alerting
Project price changes
New activity
Changes in the existing
environment
41. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Am I utilizing EC2 resources properly?
Type Savings
EBS
gp2 (SSD) 15k IOP 250MBs/sec Baseline Throughput $500 / Month
io1 15k IOP 1000MBs/sec Baseline Throughput $975 iops + $31.25
Storage / Month
Hosts
c5.2xlarge 1k Hosts Skylake CPU, more memory and better IO $248,880
c4.2xlarge 1k Hosts 15% more expansive $291,340
Utilization
c4.8xlarge I/O Up to 10 Gbps $1164.62/month
c5n.large I/O Up to 25 Gbps $79.06/month
42. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Do my purchase plans
fit my server lifecycle?
Spot usage
Reserved agendas and workloads
Is my application
optimized?
Right memory allocation
CPU utilization
Can it share resources?
43. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
% of environment
Reserved
instances
47%
(Including Spot usage)
On-demand 17%
Spot Instances 36%
100% Utilization
On-going agendas, POCs, New activity, etc.
Auto scaling groups, Fleet, etc.
44. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Optimizing our AWS:
Our Approach
45. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Billing Portal
Deep dive with AWS APIs
CUR / DBR as data sources
Used with Grafana for visualization
Wix Portal for
Managing scheduled jobs
Running custom metrics
46. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Billing Portal
Scheduled jobs to digest data (x3 times a day)
Instance monitoring and tracking
RI management
Download center
Multipart incomplete uploads
Detached EBS volumes reports
Slack Integration
47. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Alerting
Price jumps notification per agenda
AWS Prices changes based on billing API
New expensive instance deployed
48. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
AWS tools we use
• Cost explorer
• Cost explorer API
Cost Explorer - 1 level of grouping
APIs give you 2
• Cost explorer Trends
• Trusted advisor
49. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
AWS tools we use
• Cost explorer
• Cost explorer API
Cost Explorer - 1 level of grouping
APIs give you 2
• Cost explorer Trends
• Trusted advisor
One consolidated
billing account
• One billing invoice per
organization
• Aggregated usage across
accounts to be eligible for tier
discounts
Reserve Instances purchase under
50. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Automatic optimization suggestion
• Decrease type sizes / a more suitable type
• Reduce underutilized EBS volumes
• Manage S3 object lifecycle
Regional calculator
• How much does my data center costs in different regions?
Education, Education, Education
What’s Next
51. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Dvir Mizrahi
dvirm@wix.com
https://www.wix.com/jobs/home
52. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Call to action
Look for workloads to optimize
53. Thank you!
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Orel Strassman
orelstra@amazon.com
http://bit.ly/2SD19go
54. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.