In this session we will present some of the stories around innovation in the Amazon Web Services Datacenter including how it partners with other vendors in the hardware space.
6. Infrastructure
Foundation
Services
Regions Availability Zones Edge POPs
Compute Storage
Networking &
Content Delivery
Security
& Access
Platform
Services
Databases
Relational
NoSQL
Columnar
Caching
Analytics
Hadoop
Real time
Data
warehouse
App Services
Queuing
Orchestration
App streaming
Transcoding
Email
Search
7. Infrastructure
Foundation
Services
Regions Availability Zones Edge POPs
Compute Storage
Networking &
Content Delivery
Security
& Access
Platform
Services
Databases
Relational
NoSQL
Columnar
Caching
Analytics
Hadoop
Real time
Data
warehouse
App Services
Queuing
Orchestration
App streaming
Transcoding
Email
Search
Deployment & Management
Containers
Dev/ops
Templates
8. Infrastructure
Foundation
Services
Regions Availability Zones Edge POPs
Compute Storage
Networking &
Content Delivery
Security
& Access
Platform
Services
Databases
Relational
NoSQL
Columnar
Caching
Analytics
Hadoop
Real time
Data
warehouse
App Services
Queuing
Orchestration
App streaming
Transcoding
Email
Search
Deployment & Management
Containers
Dev/ops
Templates
Mobile & Devices
Identity
Sync
Analytics
Notifications
9. Amazon WorkSpaces
Delivering on the promise
of desktop virtualization
Most successful preview, ever
Infrastructure & admin tools
End user desktop and mobile apps
10. Fully managed, secure document storage
and sharing service for the Enterprise
Amazon WorkDocs
Secure
Easy sharing
Simple document
feedback
Access from
any device
Integrate your
corporate directory
Low cost
11. Is secure email and calendaring made easy
Amazon WorkMail
Managed email and
calendaring solution
Always available,
anytime, anywhere.
Integrates with
Amazon WorkDocs
12. Infrastructure
Foundation
Services
Regions Availability Zones CDN Points of Presence
Storage
(Object, Block and Archive)
Networking
Security &
Access Control
Platform
Services
Databases
Relational
NoSQL
Columnar
Caching
Analytics
Hadoop
Real-time
Data
warehouse
App Services
Queuing
Orchestration
App streaming
Transcoding
Email
Search
Deployment & Management
Containers
Dev/ops Tools
Resource
Templates
Mobile & Devices
Identity
Sync
Mobile
Analytics
Notifications
Applications Virtual Desktops Collaboration and Sharing
Data
Workflows
Usage
Tracking
Monitoring
and Logs
Compute
(VMs, Auto-scaling and Load Balancing)
13. What sets AWS apart from other providers?
Breadth and Depth of Services
14. What sets AWS apart from other providers?
Breadth and Depth of Services
Relentless Focus on Cost Reduction
15. The AWS Price Reduction Philosophy
47 Price Reductions Since 2006
Infrastructure
innovation
Ecosystem
Global Footprint
New Features
New Services
17. What sets AWS apart from other providers?
Breadth and Depth of Services
Relentless Focus on Cost Reduction
Customer Driven Innovation
18. Small, autonomous teams
Roadmap ownership
Decoupled launch schedules
Small, “Two Pizza”
Teams
Get Core Functionality in the
Hands of Customers, Quickly
Operational stability
High scale
Limited initial feature set
Iterate Based on Customer Feedback
21. Rapid pace of Innovation
2008 2009 2010 2011 2012 2013 2014
280
159
82
61
48
24
516
22. What sets AWS apart from other providers?
Breadth and Depth of Services
Relentless Focus on Cost Reduction
Customer Driven Innovation
Innovation at every level of the stack
23. Every day, AWS adds enough new server capacity to
support all of Amazon’s global infrastructure when it was
a $7B annual revenue enterprise
24. Get Networks Out of the Way
Relative cost of networking increasing quickly
• Server & storage prices falling fast
• Network costs trending to dominate
Networking frozen in time
• Vertically integrated ecosystem
• Indefensible profit margins
AWS solution:
• Custom net H/W & protocol stack
• Private long haul links
57%
8%
18%
13%
4%
Servers
Networking
Equipment
Power
Distribution
&
Cooling
Power
Other
Infrastructure
Monthly Costs
3yr server & 10 yr infrastructure amortization
25. AWS Global Regions Locations
US-WEST (Oregon)
GOV CLOUD
US-WEST (N. California)
US-EAST (Virginia)
EU (Dublin)
EU (Frankfurt)
SOUTH AMERICA (Sao Paulo)
CHINA (Beijing)
ASIA PAC (Sydney)
ASIA PAC (Singapore)
ASIA PAC (Tokyo)
Regions
PoP
26. Redundant paths to transit centers
Transit centers connect to:
• Private links to other AWS regions
• Private links to AWS Direct Connect customers
• Internet through peering & paid transit
27. Redundant paths to transit centers
Transit centers connect to:
• Private links to other AWS regions
• Private links to AWS Direct Connect customers
• Internet through peering & paid transit
82, 864 fiber strands in region
AZs <2ms apart & usually <1ms
25Tbps peak inter-AZs traffic
28. Why Does AWS Offer AZs?
Asynchronous replication between
distant data centers
• Committing to an SSD order 1 to 2ms
• But, LA to New York is 74ms round trip
• You can’t wait 74ms to commit a transaction
On failure, difficult & high skill decision:
• Fail-over & lose transactions, or
• Or don’t fail-over & lose availability
• Difficult choice
• Use AZs for no-admin failover
• Sync works when <2ms
• Can be combined with regional replication for
very high availability
74ms
29. 1 of 28 availability zones world-wide
All regions have 2 or more AZs
Each AZ is 1 or more DC
- No data center is in two AZs
- Some AZs have as many as 6 DCs
DCs in AZ less than ¼ ms apart
Data centers & Availability zones
30. Single DC typically over 50,000
servers & often over 80,000
• Larger DCs undesirable (blast
radius)
• Diminishing returns on scale
Up to 102Tbps provisioned in to
a single DC
AWS custom network equipment:
• Multi-ODM sourced
• Amazon custom network protocol
stack
31.
32. Remove the “virtualization tax”
NIC supports Supports Single
Root I/O Virtualization
Much lower latency & less latency jitter
33. Logarithmic Scale
tp0 tp50 tp99 tp99.9 tp00
>2x average
latency
reduction
>10x latency
variability
improvement
Previous
generation
Current
generation
34. OEM servers
• Very general designs able to run wide variety of workloads
• Vast, expensive, world-wide distribution network (30% of cost)
AWS custom servers & storage
• Specialized servers optimized for a specific workload
• Move hot software kernels to hardware implementations
• Custom Intel processors beyond commercially available clock rates
• DCs, servers, networking, storage designed to integrated specs
Example Storage Rack
864 disks, 2,350lb
35. Power Infrastructure
Some DCs with custom power
sub-stations
• Lower power cost & build more
quickly
• Negotiated power purchasing
agreements
Custom switchgear firmware
3 100% carbon neutral regions:
• US West (Oregon)
• AWS GovCloud (US)
• EU (Frankfurt)