Re-architecting applications for the cloud can be disruptive to existing on-premises solutions. One way to ease this transition is to adopt a hybrid approach to cloud. This webinar will help you understand how to relate traditional on-premises storage infrastructures to the cloud, highlight use cases for easy wins, how to navigate architectural decisions and best practices for hybrid designs. Learning Objectives: Learn how to decide between object, file and block storage, the key benefits and differentiators for each, and when to apply them in hybrid models Who Should Attend: Application Developers, enterprise architects and storage and backup and managers familiar with traditional on-prem storage offerings

1. © 2015, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Isaiah Weiner, AWS Partner Solutions Architecture
2/23/2016
Use AWS Cloud Storage as the
Foundation for Hybrid Strategy

2. Getting Started
 Clarifying Block vs. File vs. Object
 Use Case: Backup and Recovery
 Use Case: Big Data
 Use Case: Active Archive
 Use Case: Primary Storage

3. Block vs. File vs. Object
< 5 ms
✔
< 10 ms
✔
✔
Standards-based,
Legacy app support
< 100 ms
✔
✔ + Customizable!
Modern stack support,
scalable interfaces
Latency
Data
Metadata
Access

4. What should I use, and when?
Economics Easy to Use Reduce risk Agility, Scale
 Pay as you go
 No upfront investment
 No commitment
 No risky capacity
planning
 Self service administration
 SDKs for simple
integration
 Durable and Secure
 Avoid risks of physical
media handling
 Reduce time to market
 Focus on your business,
not your infrastructure
Amazon S3
Durable object storage
for all types of data
Amazon EBS
Block storage for use
with Amazon EC2
Amazon Glacier
Archival storage
for infrequently
accessed data
Amazon EFS
File storage for use
with Amazon EC2

5. Backup and Recovery

6. Backup and Recovery to the Cloud
Amazon S3
Amazon
Glacier
AWS
Direct
Connect
Internet
Amazon S3-IA
Application
servers
Cloud Gateway
Local disk
Media
Server
Cloud Gateway
Application
servers
Cloud Connector
Local disk
Media Server
with cloud
connector

7. Gateway: AWS Storage Gateway
Amazon EBS
snapshots
Amazon S3
Amazon
Glacier
AWS
Storage Gateway
appliance
Application
server
AWS
Storage Gateway
backend
AWS
Direct
Connect
Internet
Customer premises

8. Gateway: NetApp AltaVault
Common backup applications integrated with AltaVaultSolve backup & archive headaches with cloud-integrated
storage
 90% reduction in time, cost, and data volumes
 Shrink recovery times from days to minutes
 85% of backup & software providers supported
Glacier
On Premises
AWS
Cloud-integrated
storage appliance
NetApp AltaVault
FAS
E-Series
Non-NetApp
Storage
Seamlessly integrates into
existing storage and backup
software environment
Deduplicates, compresses,
and encrypts
Caches recent backups
locally, vaults older copies to
the cloud
 NetApp SnapProtect
 Arcserve
 CommVault Simpana
 EMC NetWorker
 HP Data Protector
 IBM Tivoli
Storage Mgr
 Symantec Backup
Exec
 Symantec
NetBackup
 Veeam
 Microsoft SQL
Server
 Oracle RMAN
S3
AltaVault also available on marketplace
to protect cloud-native workloads
Store data in the public or
private cloud of choice

9. Big Data

10. S3 + EMR
EMR
cluster
Amazon S3
EMR
cluster
corporate data center
AWS
Direct
Connect
Internet
Application
server

11. S3 + RedShift
Amazon S3corporate data center
AWS
Direct
Connect
Internet
Application
server

12. Dive Deep on Big Data with S3
AWS re:Invent 2015: DAT201 Introduction to Amazon Redshift
https://www.youtube.com/watch?v=DIj1bFjiqd8
AWS re:Invent 2015: DAT308 How Yahoo! Analyzes Billions of Events a Day on Amazon RedShift
https://www.youtube.com/watch?v=3qmzwqnC67k
DAT308 Slides:
http://www.slideshare.net/AmazonWebServices/dat308-yahoo-analyzes-billions-of-events-a-day-on-
amazon-redshift
AWS re:Invent 2015: BDT305 Amazon EMR Deep Dive and Best Practices
https://www.youtube.com/watch?v=4HseALaLllc
BDT305 Slides:
http://www.slideshare.net/AmazonWebServices/bdt305-amazon-emr-deep-dive-and-best-practices
BDT314: Running a Big Data and Analytics Application on Amazon EMR and Amazon Redshift
with a Focus on Security
http://www.slideshare.net/AmazonWebServices/bdt314-a-big-data-analytics-app-on-amazon-emr-
amazon-redshift

13. Active Archive

14. AWS Import/Export Disk
• Accelerates moving large amounts of data
into and out of Amazon S3, Glacier and EBS
• Transfers your data directly onto and off of
customer owned storage devices
• Uses Amazon high-speed internal network to
complete the transfer
• Supports up to eSATA and USB 2,3 attached
drives up to 6 TB and 16 TB arrays
AWS
Import/Export

15. What is Snowball? Petabyte scale data transport
E-ink shipping
label
Ruggedizedcase
“8.5G Impact”
All data encrypted
end-to-end
Rain & dust
resistant
Tamper-resistant
case & electronics
50 TB
10GE network

16. How it works

17. How fast is Snowball?
• Less than 1 day to transfer 250TB via 5x10G connections with 5
Snowballs, less than 1 week including shipping
• Number of days to transfer 250TB via the Internet at typical utilizations
Internet Connection Speed
Utilization 1Gbps 500Mbps 300Mbps 150Mbps
25% 95 190 316 632
50% 47 95 158 316
75% 32 63 105 211

18. How fast is Snowball?
 Less than 1 day to transfer 250TB via 5x10G connections with 5
Snowballs, less than 1 week including shipping
 Number of days to transfer 250TB via the Internet at typical utilizations
Internet Connection Speed
Utilization 1Gbps 500Mbps 300Mbps 150Mbps
25% 95 190 316 632
50% 47 95 158 316
75% 32 63 105 211

19. How fast is Snowball?
 Less than 1 day to transfer 250TB via 5x10G connections with 5
Snowballs, less than 1 week including shipping
 Number of days to transfer 250TB via the Internet at typical utilizations
Internet Connection Speed
Utilization 1Gbps 500Mbps 300Mbps 150Mbps
25% 95 190 316 632
50% 47 95 158 316
75% 32 63 105 211

20. When to use AWS Import/Export Snowball
Cloud
Migration
Disaster
Recovery
Datacenter
Decommission
Content
Distribution

21. AWS Snowball AWS Import/Export Disk
When to use Disk vs Snowball?
 Import only, Export coming soon
 Currently available in US East
and US West 2
 Import to S3 only
 Supports large data transfers,
from TBs to PBs
Supports import and export for S3 buckets
and EBS snapshot import in:
 US East (N. Virginia)
 US West (Oregon)
 US West (Northern California)
 EU (Ireland)
 Asia Pacific (Singapore)
Supports import into Glacier in:
 US East (N. Virginia)
 US West (Oregon)
 US West (Northern California)
 EU (Ireland) regions.

22. Use Amazon Glacier
for lowest-cost, durable cold
storage of archival data
Use Amazon S3
for reliable, durable
primary storage
Use Amazon S3
Infrequent Access
Storage
for secondary backups
at a lower cost
S3-IA
Tiering on AWS: optimize your storage spend

23. Key prefix “logs/”
Transition objects to Glacier 30 days after creation
Delete 365 days after creation date
<LifecycleConfiguration>
<Rule>
<ID>archive-in-30-days</ID>
<Prefix>logs/</Prefix>
<Status>Enabled</Status>
<Transition>
<Days>30</Days>
<StorageClass>GLACIER</StorageClass>
</Transition>
<Expiration>
<Days>365</Days>
</Expiration>
</Rule>
</LifecycleConfiguration
S3 lifecycle policies

24. What about WORM?
 SEC Rule 17a-4(f)
 FINRA Rule 4511
 CFTC Regulation 1.31
Have: Need:
 Glacier Vault Lock

25. Dive Deep on Active Archive
AWS re:Invent 2015: STG202 AWS Import/Export Snowball: Large-Scale Data Ingest into AWS
https://www.youtube.com/watch?v=86ogJHFSJRo
Slides:
http://www.slideshare.net/AmazonWebServices/stg202-aws-importexport-snowball-largescale-data-
ingest-into-aws
Third-Party SEC 17a-4(f) Assessment for Vault Lock
https://aws.amazon.com/blogs/aws/glacier-cohasset-assessment/
Service details and pricing
https://aws.amazon.com/importexport/

26. Primary Storage

27. Hybrid Primary Storage Approaches
Java Python (boto) PHP .NET Ruby Node.js
iOS Android AWS Toolkit for
Visual Studio
AWS Toolkit
for Eclipse
AWS Tools for
Windows
PowerShell
AWS CLI
JavaScript

28. Hybrid Primary Storage Approaches
Customer Datacenter
Amazon S3
Existing
Storage
Infrastructure
On-PremisesApplication
Servers
NFS, CIFS,
SMB, iSCSI,
FC, AoE, …
Works with
existing
applications
NAS or SAN Resources
?

29. Primary Storage Technology Partners
 S3 backed, NFS/SMB
server
 Natural fit for hybrid
strategy
 Originally a NAS
accelerator
 Past founder successes:
CMU AFS, Transarc
(IBM), Spinnaker
Networks (NetApp)

30. Primary Storage Technology Partners
 Global filesystem backed
by S3 supports
NFS/SMB
 Natural fit for hybrid
strategy
 Past founder successes:
Alteon (Nortel), Aruba
Networks (HP)

31. Dive Deep with Primary Storage Use Cases
AWS re:Invent 2015: STG308 How Electronic Arts, State of Texas,
& H3 Biomedicine Use AWS
https://www.youtube.com/watch?v=PmPriuFEz1k
Slides:
http://www.slideshare.net/AmazonWebServices/stg308-how-ea-state-
of-texas-h3-biomedicine-protect-data

32. Thank you!