IT systems and applications are producing and consuming content at a rapidly growing rate. This could significantly impact costs and agility of IT organizations if not planned for appropriately. Organizations of all sizes have seen significant benefits from utilizing cloud services in their business. One early area of focus for companies has been the highly durable, low cost and massively scalable benefits that come with cloud storage services. Today, thousands of developers and businesses around the globe rely on Amazon Web Services (AWS) for their backup, archival and disaster recovery requirements. This session covers best practices on proven designs from real world customer use cases and discuss topics such as capacity planning, durability, cost, security, as well as content categorization and transfer.

1. AWS
201
Backup,
Archive
and
Disaster
Recovery
Markku
Lepistö
-­‐
Technology
Evangelist
@markkulepisto

2. Housekeeping
• Presentation ~45mins
• Post Questions Online
• Q&A at the end
• Reminder – Fill in the survey!

3. Agenda
• What’s the Problem?
• Data Transfer
• Data Stores
• Backup and DR
• What’s Next?

4. Problem

5. We
are
constantly
producing
more
data

6. Primary
Block
Storage
Primary File
Storage
Archival
Storage
Disk Based
Backup
Storage
Tape
Infrastructure &
Management
Replicated
Storage for
Disaster
Recovery
Offsite
Locations
Geo-
Resilience
Pressure on Traditional On-Premise Solutions
Complex
/
BriIle
Siloed
/
Expensive
Capacity
Guessing

7. Traditional Backups
• Long/slow recovery time
• Low durability (higher probability for data loss)
• Requires Tape Museums
• Expensive Tech Refresh

8. AWS Services
Help?

9. Transfer

10. AWS
Global
Infrastructure
10 Regions
25 Availability Zones
51 Edge Locations

11. AWS
Direct
Connect
Dedicated
bandwidth
between
your
site
and
AWS
AWS
Import/Export
Physical
transfer
of
media
into
and
out
of
AWS
When
-­‐
if
ever
-­‐
will
the
bandwidth
of
the
Internet
surpass
that
of
FedEx?
—Johan
Öbrink

12. ElasPc
Block
Store
High
performance
block
storage
device
1GB
to
1TB
in
size,
max
4000
IOPS/volume
Mount
as
drives
to
instances
with
snapshot/cloning
funcOonaliOes
Simple
Storage
Service
Highly
scalable
object
storage
1
byte
to
5TB
in
size
99.999999999%
durability
Glacier
Long
term
object
archive
1c/GB/month,
$120/TB/year
99.999999999%
durability
Very
fast
mounted
volumes
Slow,
infrequent
archive
Fast
object
storage
AWS Storage Options

13. Storage Tiers & Automated Life-Cycle

14. 1PB
Raw
Storage
800TB
Usable
Storage
600TB
Allocated
Storage
400TB
WriIen
ApplicaPon
Storage
S3
&
Glacier
–
Only
actual
usage
is
charged
Raw Storage at On perm vs. Cloud

15. Access via Console, SDKs and Third-party Solutions
S3
Glacier
Internet Web
Services API
HTTP(S)
Via SDK Via 3rd parties

16. AWS Storage Gateway for offsite disk backups
Gateway-Cached Volumes
Backup
Servers
On-premises
Host
AWS
Storage
Gateway VM
Direct Attached or
Storage Area Network Disks
iSCSI
SSL
Production
Systems
Your
Datacenter
Amazon
Simple
Storage
Service
(S3)
AWS
Storage
Gateway
Service

17. AWS Storage Gateway for departmental file shares
Gateway-Stored Volumes
On-premises
Host
AWS
Storage
Gateway VM
Direct Attached or
Storage Area Network Disks
SSL
Your
Datacenter
Amazon
Simple
Storage
Service
(S3)
AWS
Storage
Gateway
Service
iSCSI
End Users
CIFS/
NFS
File servers

18. AWS Storage Gateway - Virtual Tape Library

19. • CIFS/NFS
Local
PresentaPon
• Appliance
or
Virtual
Machine
• In-­‐Line
De-­‐DuplicaPon
• Customer
Retained
Security
Keys
• Local
Cache
for
recently
archived
data
Partner Solutions

20. Choosing the Data Store

21. Amazon
ElasPCache
Amazon
RDS
Amazon
Redshic
Amazon
S3
Request
rate
High
Low
Cost/GB
High
Low
Latency
Low
High
Data
Volume
Low
High
Amazon
Glacier
Amazon
CloudSearch
Amazon
EMR
Structure
Low
High
Amazon
DynamoDB

22. cost, volume, access pattern structure

23. Recovering from Disasters

24. Backup
and
restore
Pilot
light
Warm
standby
Hot
standby

25. cost speed of recovery

26. Backup the DB

27. Backup Server
Images

28. Create instances
from AMIs
Restore data
from backups
Restore DB and
App Servers

31. Summary

32. Internet
Web
Services
API
HTTP(S)
AWS
Direct
Connect
Block
File
AWS
Cloud
Customer
Data
Center
Storage
Use
Cases
Archive
Backup
Disaster
Recovery
Next Generation Enterprise Storage

33. Tradi8onal:
On-­‐Premise
Solu8ons
Primary
Block
Storage
Primary
File
Storage
Archival
Storage
Disk
Based
Backup
Storage
Tape
Infrastructure
&
Management
Replicated
Storage
for
Disaster
Recovery
Offsite
LocaPons
Geo-­‐
Resilience
Next
Genera8on:
Gateway
&
Cloud
Storage
Reduce
SAN
Footprint
Reduce
NAS
Footprint
Eliminate
Archival
Hardware
&
Socware
Eliminate
Backup
Hardware
&
Socware
Eliminate
Tape
Recover
in
Cloud
or
any
Data
Center
Eliminate
Secondary
Data
Centers
Reduce
Complexity.
Reduce
Cost.

34. data information
abandoned actionable

35. Amazon
CloudFront
Amazon
Cloudsearch
Amazon
ElasPc
Transcoder
Amazon
SWF
Amazon
DynamoDB
Amazon
ElasPc
MapReduce
Amazon
VPC
Amazon
EC2
Amazon
EBS
Discovery
Delivery
DR,
Archive,
Backup
and
Compute
Transcoding
Workflow
AnalyPcs
Managed
DBs
Glacier
(OR)
Business
Value
From
The
Data

36. Benefits of AWS Storage
Financial
– Significant reduction in capital investments
– Pay for only what you use: Metered Utility
– Eliminate the need to over purchase
– AWS prices continue to fall over time
Operational
– Streamline and simplify data management operations
– Reduction of systems and data centers
– Focus employees on proactive and innovative tasks
Business
– Never stop the business as capacity is endless
– Never slow the pace of innovation
– Turn IT into an innovation enabler

37. Demo
Warm Standby,
Cross-Region
Disaster!! and Recovery

38. Thank
you
Markku
Lepistö
-­‐
Technology
Evangelist
@markkulepisto

39. Your
feedback
is
important
Please
complete
the
Survey!
What’s
good,
what’s
not
What
you
want
to
see
at
these
events
What
you
want
AWS
to
deliver
for
you

40. Q&A