Weitere ähnliche Inhalte Ähnlich wie CPN202 More for Less - AWS re: Invent 2012 (20) Mehr von Amazon Web Services (20) CPN202 More for Less - AWS re: Invent 20122. Elasticity Scale
CapEx Datacenter
On- (0 to costs as I
moves in the
Premises 1000’s in scale my
to OpEx cloud
minutes) compute
© 2012 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified or distributed in whole or in part without the express consent of Amazon.com, Inc.
3. Part I:
© 2012 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified or distributed in whole or in part without the express consent of Amazon.com, Inc.
4. Lever I:
© 2012 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified or distributed in whole or in part without the express consent of Amazon.com, Inc.
5. Turn off your cloud resources
© 2012 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified or distributed in whole or in part without the express consent of Amazon.com, Inc.
6. Tip:
© 2012 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified or distributed in whole or in part without the express consent of Amazon.com, Inc.
7. Tip:
© 2012 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified or distributed in whole or in part without the express consent of Amazon.com, Inc.
8. © 2012 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified or distributed in whole or in part without the express consent of Amazon.com, Inc.
9. www.MyWebSite.com
(dynamic data)
Amazon Route 53
media.MyWebSite.com
(DNS)
(static data)
Elastic Load
Balancing
Amazon
Auto Scaling group : Web Tier CloudFront
Amazon EC2
Auto Scaling group : App Tier
Amazon RDS Amazon S3
Amazon
Availability Zone #1 RDS
Availability Zone #2
© 2012 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified or distributed in whole or in part without the express consent of Amazon.com, Inc.
10. © 2012 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified or distributed in whole or in part without the express consent of Amazon.com, Inc.
11. © 2012 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified or distributed in whole or in part without the express consent of Amazon.com, Inc.
12. Load
Minutes of the Hour
© 2012 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified or distributed in whole or in part without the express consent of Amazon.com, Inc.
13. Free Memory
PUT
Free CPU
Free HDD
At 1-min intervals
Amazon CloudWatch
Instance
Custom Metrics
© 2012 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified or distributed in whole or in part without the express consent of Amazon.com, Inc.
14. Lever 2:
© 2012 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified or distributed in whole or in part without the express consent of Amazon.com, Inc.
15. $0.025
per hour
DNS Elastic Load
Web Servers
Balancing
Availability Zone
$0.065
per hour
(small instance)
EC2 instance
DNS + software LB Web Servers
Availability Zone
© 2012 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified or distributed in whole or in part without the express consent of Amazon.com, Inc.
16. Consumers
Producer Amazon SQS queue
$0.01 per
10,000 Requests ($0.000001
per Request)
$0.065
per hour
(small instance) Producer
EC2 instance Consumers
+ software queue
© 2012 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified or distributed in whole or in part without the express consent of Amazon.com, Inc.
17. Lever 3:
© 2012 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified or distributed in whole or in part without the express consent of Amazon.com, Inc.
18. © 2012 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified or distributed in whole or in part without the express consent of Amazon.com, Inc.
19. On-Demand Reserved Spot
© 2012 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified or distributed in whole or in part without the express consent of Amazon.com, Inc.
20. Heavy
Utilization RI
1-year or Medium
3-year terms Utilization RI
Light
Utilization RI
© 2012 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified or distributed in whole or in part without the express consent of Amazon.com, Inc.
21. 14
12
On-Demand
10
8
Load
Light Utilization RIs
6
4
2 Heavy Utilization RIs
0
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24
Hour
© 2012 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified or distributed in whole or in part without the express consent of Amazon.com, Inc.
22. $14,000
$12,000
$10,000
Heavy Utilization m2.xlarge running Linux
$8,000
in US-East Region over 3
Cost
$6,000 Medium Utilization Year period
$4,000
$2,000 Light Utilization
$-
On-Demand
Utilization
Utilization Sweet Spot Feature Savings over On-Demand
<10% On-Demand No Upfront Commitment
10% - 39% Light Utilization RI Ideal for Disaster Recovery Up to 56% (3-Year)
40% - 74% Medium Utilization RI Standard Reserved Capacity Up to 66% (3-Year)
>75% Heavy Utilization RI Lowest Total Cost. Ideal for Baseline Servers Up to 71% (3-Year)
© 2012 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified or distributed in whole or in part without the express consent of Amazon.com, Inc.
23. © 2012 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified or distributed in whole or in part without the express consent of Amazon.com, Inc.
24. © 2012 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified or distributed in whole or in part without the express consent of Amazon.com, Inc.
25. Enable you to bid on unused EC2 capacity
© 2012 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified or distributed in whole or in part without the express consent of Amazon.com, Inc.
26. Use Case Types of Applications
Batch Processing Generic background processing (scale out computing)
Hadoop Hadoop/MapReduce processing type jobs (e.g., Search, Big
Data, etc.)
Scientific Computing Scientific trials/simulations/analysis in chemistry, physics, and
biology
Video and Image Transform videos into specific formats
Processing/Rendering
Testing Provide testing of software, websites, etc.
Web/Data Crawling Analyzing data and processing it
Financial Hedgefund analytics, energy trading, etc.
HPC Utilize HPC servers to do embarrassingly parallel jobs
Cheap Compute Backend servers for Facebook games
© 2012 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified or distributed in whole or in part without the express consent of Amazon.com, Inc.
27. CycleCloud runs 57%
a HPC
Cluster with 30000 cores at
Lucky Oyster crawled 3.4B
$1279/Hour at peak (57%
63% web pages, building a 400M
savings)! 50%
entry index in around 14
50%
hours for $100 (>85%
Some say the 30th fastest
savings)!
super computer with 1 GiB 66%
50%
interconnect
50%
© 2012 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified or distributed in whole or in part without the express consent of Amazon.com, Inc.
28. © 2012 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified or distributed in whole or in part without the express consent of Amazon.com, Inc.
29. Part II:
© 2012 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified or distributed in whole or in part without the express consent of Amazon.com, Inc.
30. www.MyWebSite.com
(dynamic data)
Amazon Route 53
media.MyWebSite.com
(DNS)
(static data)
Elastic Load
Balancing
Amazon
Auto Scaling group : Web Tier CloudFront
Amazon EC2
Auto Scaling group :
App Tier Spot
Instances
Amazon
RDS
Amazon RDS Amazon S3
Availability Zone #1
Availability Zone #2
© 2012 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified or distributed in whole or in part without the express consent of Amazon.com, Inc.
31. Description Option 1 Option 2 Option 3 Option 4
2 Web servers 2 On- 2 On- 1 On-Demand and 1 On-Demand and
Demand Demand 1 Reserved 1 Reserved Light
Medium Utilization Utilization
2 App servers 2 On- 2 On- 1 On-Demand and 1 On-Demand and
Demand Demand 1 Reserved 1 Reserved Light
Medium Utilization Utilization
2 Database 2 On- 2 Reserved 2 Reserved 2 Reserved Heavy
servers Demand Medium Medium Utilization Utilization
Utilization
© 2012 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified or distributed in whole or in part without the express consent of Amazon.com, Inc.
32. Savings Option 1 Option 2 Option 3 Option 4
Calculator Calculator Calculator Calculator
Monthly Cost $702.72 $374.78 $256.20 $238.63
One-Time Cost 1 Year Term - $1280.00 $1600.00 $1698.00
3 Year Term - $2000.00 $2500.00 $2612..60
Total Cost 1 Year Term $8432.64 $5777.36 $4674.40 $4561.56
(x12)
3 Year Term $25297.92 $15492.08 $11723.20 $11203.28
(x36)
Savings 1 Year Term n/a 32% 44% 45%
(Over Option 1) 3 Year Term n/a 39% 54% 54%
© 2012 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified or distributed in whole or in part without the express consent of Amazon.com, Inc.
33. Auto Scaling group : Application Tier
Auto Scaling group: Application Tier
Auto Scaling group : Application Tier
Auto Scaling group : Application Tier
Amazon VPC Amazon RDS
Availability Zone #1
On-Premises
Amazon VPC Amazon RDS
Availability Zone #2
© 2012 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified or distributed in whole or in part without the express consent of Amazon.com, Inc.
34. © 2012 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified or distributed in whole or in part without the express consent of Amazon.com, Inc.
35. Amazon S3
Upload large datasets
or log files directly Amazon S3
Data Input
Source Data
OutputData
Task
Amazon Elastic Node
MapReduce Amazon SimpleDB
Mapper
Code/ Reducer Name Task
Service Metadata
Scripts HiveQL
Node Node
Pig Latin
Cascading Runs multiple
JobFlow Steps Core HiveQL
Node Pig Latin
Query
Core
Node
HDFS
BI Apps
Amazon Elastic MapReduce JDBC/ODBC
Hadoop Cluster
© 2012 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified or distributed in whole or in part without the express consent of Amazon.com, Inc.
36. Scenario #1
#1: Cost without Spot
Job Flow 4 instances *14 hrs * $0.45 = $25.20
Duration:
14 Hours #2: Cost with Spot
4 instances *7 hrs * $0.45 = $12.60 +
5 instances * 7 hrs * $0.225 = $7.875
Scenario #2 Total = $20.475
Job Flow
Time Savings: 50%
Cost Savings: ~19%
Duration:
7 Hours
© 2012 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified or distributed in whole or in part without the express consent of Amazon.com, Inc.
37. Auto Scaling group: Amazon EC2 On-Demand Instances
Application
that
generates
work
Amazon SQS Queue
Auto Scaling group: Amazon EC2 Spot Instances
© 2012 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified or distributed in whole or in part without the express consent of Amazon.com, Inc.
38. Free Offering Premium Offering
© 2012 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified or distributed in whole or in part without the express consent of Amazon.com, Inc.
39. Amazon S3 Amazon S3
Amazon
Elastic Compute Cloud
Input Output
Bucket Bucket
Amazon EC2
Amazon SQS Amazon SQS
Job Completed Reports
Job Website
Input Queue Output
Website Queue Amazon EC2
(Job Manager)
On-demand + Spot
Amazon
Amazon SimpleDB
CloudWatch
Amazon SimpleDB
Amazon EC2
Intranet
© 2012 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified or distributed in whole or in part without the express consent of Amazon.com, Inc.
40. Traditional Methods On-Premise
Sold at Sold at
Unused
90% Unused
64%
Discount! Discount!
Sold at Sold at
Unused
86% 79%
Unused
Discount! Discount!
Availability Zone Availability Zone
Region
Amazon EC2 running Spot
© 2012 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified or distributed in whole or in part without the express consent of Amazon.com, Inc.
41. Traditional Methods On-Premise
Unused Unused
Unused Unused
Availability Zone Availability Zone
Region
Amazon EC2 running Spot
© 2012 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified or distributed in whole or in part without the express consent of Amazon.com, Inc.
42. Spotbet weis get
I Price can
lower, socompute
this let’s
cheaper later, so
scale out… Unused
scale down…
Unused
Unused
Availability Zone
Region
© 2012 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified or distributed in whole or in part without the express consent of Amazon.com, Inc.
43. Unused
Unused
Unused
Availability Zone
Region
© 2012 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified or distributed in whole or in part without the express consent of Amazon.com, Inc.
44. © 2012 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified or distributed in whole or in part without the express consent of Amazon.com, Inc.
45. We are sincerely eager to
hear your feedback on this
presentation and on re:Invent.
Please fill out an evaluation
form when you have a
chance.
© 2012 Amazon.com, Inc. and its affiliates. All rights reserved. May not be copied, modified or distributed in whole or in part without the express consent of Amazon.com, Inc.