SlideShare ist ein Scribd-Unternehmen logo
1 von 78
Downloaden Sie, um offline zu lesen
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
“Lift and shift” storage for
business-critical applications
Joe Disher
Product Marketing Manager
Amazon Web Services
S T G 2 0 3
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Agenda
Storage for business-
critical applications
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
• Challenges with on-premises storage
• AWS storage services
• Business-critical applications
• Block storage
• File storage
• Supporting services and solutions
• One customer’s journey to all-in
• What to choose?
Agenda
Storage for business-
critical applications
S U M M I T © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
What are customers using on-premises storage for?
Archive &
compliance
Media applications,
tape replacement
Data
lakes
Fast TCO vs. siloed on
premises
Amazon Athena,
Amazon S3/Select
foundation for
machine learning
File
storage
Shared application
storage, websites,
media workflows,
backups, dev
workflows,
container storage
Block
storage
Databases, data
warehouse, Hadoop,
logs, media
Home
directories
User shares
Office files, engineering
files, etc.
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Pain with managing on-premises storage arrays
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Pain with managing on-premises storage arrays
Procurement Implementation
Time
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Pain with managing on-premises storage arrays
Cost
?
SSD HDD
Capex Provisioning Software &
maintenance
Maintenance
renewals
Physical
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Pain with managing on-premises storage arrays
Complexity
Expertise Availability Backup & DR Scalability Security &
compliance
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Pain with managing on-premises storage arrays
More time More cost More complexity
Hardware failure?
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Typical order of workload migrations
Backup/DR
High availability, backup,
DR
Application
storage (file)
Shared application
storage, media workflows
(rendering, transcoding,
vfx), backups, dev
workflows
Home
directories
User shares
Office files, engineering
files, etc.
Databases
SQL, MySQL, Oracle, SAP,
PosteSQL, Cassandra,
Mongo
Analytics
Big data (Hadoop, Kafka,
Splunk,) machine
learning, HPC
S U M M I T © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Increase agility Accelerate
innovation
Strengthen
security
Reduce
cost
AWS has been helping enterprises for 13 years
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Portfolio breadth and depth
Amazon FSx for
Windows File Server
Amazon FSx for
Lustre
Amazon
EFS
Amazon S3
Glacier
Amazon
S3
Amazon
EBS
AWS Backup
AWS Storage
Gateway family AWS DataSync AWS Transfer for
SFTP
AWS Snow*
family
S U M M I T © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Business-critical applications defined
An application that is critical or important to keep the business running
These business-critical applications can range from small tools to specialized tools to line-of-
business systems such as ERP or CRM applications
How is this different from mission-critical applications?
Mission-critical applications can take down an entire business in an irreversible way, impacting
the business with unrecoverable costs and lost business
S U M M I T © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
AWS block storage
File Storage Object StorageBlock Storage
BackupHybrid Transport & Edge
Amazon FSx for
Windows File Server
Amazon FSx for
Lustre
Amazon
EFS
Amazon S3
Glacier
Amazon
S3
Amazon
EBS
AWS Backup
AWS Storage
Gateway Family AWS DataSync AWS Transfer for
SFTP
AWS Snow*
Family
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
AWS block storage offerings
Amazon EC2
instance store
HDDSSD
sc1st1
Amazon EBS HDD-
backed volumes
Amazon EBS SSD-
backed volumes
io1gp2
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Amazon EBS
What is
Amazon EBS?
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
• Block storage as a service
• Create, attach, manage
volumes through an API
• Service accessed over
the network
• SSD or HDD
• Encryption support (on
by default)
• Point-in-time
snapshot support
Amazon EBS
What is
Amazon EBS?
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
• 99.999 availability
• 0.1–0.2% annual
failure rate (AFR)
What is
Amazon EBS?
Amazon EBS
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
EC2 instance
!=
Availability Zone
EBS volume
(boot)
What is Amazon EBS?
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
EC2 instance
EBS service
Availability Zone
EBS volume
(boot)
What is Amazon EBS?
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
EC2 instance
Availability Zone
AWS Region
EC2 instance
• Volumes persist
independent of
Amazon EC2
• Select storage and compute
based on
your workload
• Detach and attach between
instances within the same
Availability Zone
EBS volume
(boot)
What is Amazon EBS?
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
EBS volume
(boot)
Availability Zone
AWS Region
• One instance can have
many volumes attached
• Volumes attach to
one instance
• Best practice – separate
boot and data volumesEBS volume
(data)
EBS volume
(data)
EC2 instance
What is Amazon EBS?
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
SSD-based General purpose SSD volume that
balances price and performance for a
wide variety of workloads with
predictable baseline and burst
Up to 16K IOPS and 256 MB/sec
$0.10/GiB*
Highest performance SSD volume
designed for critical and I/O intensive
workloads requiring
99.9% consistent performance
Up to 64K IOPS and 1,000 MB/sec
$0.125/GiB*
$0.065/IOP*
*per GB month of provisioned storage (us-east-1)
Volume types and performance
Great for boot volumes, low-latency applications, and bursty databases
Ideal for critical applications and databases with sustained IOPS
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
HDD-based
*per GB month of provisioned storage (us-east-1)
Low-cost HDD volume designed for
frequently accessed, throughput
intensive sequential workloads
Up to 500 IOPS and 500 MB/sec
$0.045/GiB*
Lowest cost HDD volume designed for
less frequently accessed sequential
workloads
Up to 250 IOPS and 250 MB/sec
$0.025/GiB*
Volume types and performance
Ideal for sequential throughput workloads, such as logging and backup
Ideal for large-block, high-throughput sequential workloads
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Elastic volumes
Amazon EBS
• Increase volume size
• Modify performance
• Change volume type
• Continue using your
application without
downtime
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Relational databases
MySQL, PostgreSQL, SQL,
Oracle, SAP
Media
Transcoding, encoding,
rendering, file storage
Big data
Hadoop/EMR, logs,
stream processing, data
warehousing
NoSQL databases
Cassandra, MongoDB,
CouchDB, Aerospike
Solid state drive (SSD) Hard disk drive (HDD)
Amazon EBS use cases
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Amazon
EMR
Vertica
Teradata
Kafka
Tibco EMS
MongoDB
Cassandra
MySQL on
EC2/EBS
Hadoop Data warehouse Streaming NoSQL MySQL
Amazon EBS use cases
Cloudera
Hortonworks
MapR
Amazon
Redshift
Amazon
Kinesis
Amazon
DynamoDB
Amazon
RDS/Amazon
Aurora
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Development and test
Enterprise applications
Business continuity
Relational databases
NoSQL databases
Amazon EBS use cases
S U M M I T © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Everyone has files
Always growing…
never shrinking
Got files?
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
File data = unstructured data
Home Directories
Word processing
Spreadsheets
Presentations
Development Data
Code with CI/CD
Log files
Media Files
Digital photos
Audio files
Video files
Digital Security
Surveillance photos
Surveillance videos
Sensor Data
Oceanographic
Weather
Traffic
Machine Generated
Satellite images
Weather data
Seismic imagery
Atmospheric data
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Many file storage use cases
FILE SHARING
FILE
SERVICES
B A C K U P & R E S T O R E
DATABASE
BUSINESS
APPLICATIONS
COMPUTE-INTENSIVE
WORKLOADS
DATA ANALYTICS
DATA LAKE
HOME DIRECTORIES
WEB SERVING
CONTENT
MANAGEMENT
SQL
BACKUPS
MEDIA AND
ENTERTAINMENT
CONTAINERS
SOFTWARE DEVELOPMENT TOOLS
DATA TRANSFER
FILE SYSTEMS
HYBRID STORAGE
NFS
SMB
LINUX
MACHINE LEARNING HPC
FINANCIAL
SERVICES
GENOMICS
EDA
OCR EDI
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Enterprise data in silos
Enterprise
Applications
Database
Mainframe
Backup & Restore
File Services
File Services
File Services
File Sharing
File Services
File Services
Backup & Restore
Archiving
Database
Analytics
Backup & Restore
Database
Analytics
Backup & Restore
Database
Analytics
Backup & Restore
Database
Mainframe
Enterprise
Applications
Data Warehouse
Database
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
AWS file storage
File Storage Object StorageBlock Storage
BackupHybrid Transport & Edge
Amazon FSx for
Windows File Server
Amazon FSx for
Lustre
Amazon
EFS
Amazon S3
Glacier
Amazon
S3
Amazon
EBS
AWS Backup
AWS Storage
Gateway Family AWS DataSync AWS Transfer for
SFTP
AWS Snow*
Family
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
A framework for AWS service offerings
Amazon relational database options Amazon file system optionsAmazon relational database options
Cloud-native
Amazon file system options
Cloud-native Commercial
Amazon FSx for
Windows File Server
Amazon FSx for
Lustre
Amazon EFS
Simplifying setup and automating time-consuming administration tasks
Open-sourceCommercial Open-source
Amazon Aurora
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Amazon EFS Amazon FSx for
Windows File Server
Amazon FSx
for Lustre
LINUX-BASED WORKLOADS WINDOWS-BASED WORKLOADS
Fully managed Windows file servers
for business applications
Fully managed cloud-native file system
for Linux-based applications
Fully managed Lustre file system for
high performance workloads
COMPUTE-INTENSIVE WORKLOADS
AWS provides file system options that help you easily address
the diverse needs of your file-based applications and workloads
Fully managed cloud file systems
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Fully managed cloud file systems
AWS provides file system options that help you easily address
the diverse needs of your file-based applications and workloads
Amazon EFS Amazon FSx for
Windows File Server
Amazon FSx
for Lustre
LINUX-BASED WORKLOADS WINDOWS-BASED WORKLOADS
Fully managed Windows file servers
for business applications
Fully managed cloud-native file system
for Linux-based applications
Fully managed Lustre file system for
high performance workloads
COMPUTE-INTENSIVE WORKLOADS
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Amazon EFS
Performance
Shared access
Highly durable and
available
Elastic and scalable
Secure and
compliant
Storage classes
Scalable, elastic, cloud-native Linux file system
10 GB/sec &
500K IOPS
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
No changes to existing
applications using
Amazon EFS
Cost savings up
to 85%
Automated
lifecycle
management
Amazon EFS Infrequent Access
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Amazon EFS Infrequent Access
Create your
file system
Enable
lifecycle management
Files added and not
accessed based on policy
are moved to EFS IA
How it works
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Before Amazon EFS… DIY shared file storage
VPC
AZ-aAZ-b
File server
File server Storage
Volumes
Clients Storage
Volumes
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Amazon EFS
Amazon EFS cost:
Standard storage class (100 GB * $0.30/GB-month*): $30 per month
Infrequent Access storage class (400 GB * $0.045/GB-month*): $18 per month
Infrequent Access data access (400 GB*1*$0.01/GB*) = $4 per month
TOTAL: $52 per month
DIY – provisioning 600 GB of Amazon EBS (i.e., ~85% utilization)
Storage (2x 120 GB EBS gp2 volumes): $24 per month
Storage (2x 480 GB EBS sc1 volumes): $24 per month
Compute (2x m5.xlarge instances): $281 per month
Inter-AZ data transfer costs (est.): $130 per month
TOTAL $459 per month
*US N. Virginia pricing
Amazon EFS
is ~90% less
than DIY
TCO example
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Test with
general purpose
performance mode
Start with bursting
throughput mode
Linux kernel 4.3+ EFS mount helper
(NFSv4.1)
Large I/O size
(aggregate I/O)
AWS
Multiple
threads
Multiple
instances
Multiple
directories
Monitor
metrics
Best practices
S U M M I T © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
“PriortousingAmazonEFS,wewere
experiencingtimeoutsfor5–10percentof
uploadsover100MB.Now,wehavezero
timeouts,whichisahugewin.
Whenwewerelargelyusingon-premisesdata
centers,ittookaminimumofthreemonthsto
setupdevelopmentinfrastructure.UsingAWS,
teamscanrollouttheenvironmenttheyneed
inoneweek—withouthavingtogetstorageand
networkingteamsinvolved."
—Suresh Prem
Principal Systems Engineer
“AmazonEFSprovidesastandardfilesystem
interfacethatallowedustomigrateour
applicationstothecloudwithoutany
modificationtotheapplication.
Also,beingamanagedfileservice,wenolonger
hadtomanageandadministerthefilesystem
resourceswehadin-house,freeinguptimefor
ITOpstofocusonitemsthatimpactour
business.”
—Lance Smith
Associate Director of IT
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Amazon EFS use cases
Big data analyticsApplication testing
& development
Web serving and
content management
Media
workflows
Lift-and-shift enterprise
applications
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
AWS provides file system options that help you easily address
the diverse needs of your file-based applications and workloads
Amazon EFS Amazon FSx for
Windows File Server
Amazon FSx
for Lustre
LINUX-BASED WORKLOADS WINDOWS-BASED WORKLOADS
Fully managed Windows file servers
for business applications
Fully managed cloud-native file system
for Linux-based applications
Fully managed Lustre file system for
high performance workloads
COMPUTE-INTENSIVE WORKLOADS
Fully managed cloud file systems
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Lift and shift your Windows file storage with fully managed Windows file servers
Amazon FSx for Windows File Server
Fast and flexible
performance
Native Windows
compatibility
Enterprise-ready
Fully managedBroad accessibility
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Native Windows compatibility and features
Native Windows
compatibility
DFS Namespaces
and
DFS Replication
Integrates with
Active Directory
and supports
Windows ACLs
Active
Directory
NTFS
Windows Server
Native SMB
2.0 to 3.1.1
SMB
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Fast and flexible performance
Fast and flexible
performance
High
IOPS
High
throughput
Built on SSD
storage
Consistent
sub-millisecond latencies
Choose throughput
independent of storage
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Enterprise-ready
Highly available
and durable
Supports Multi-AZ
deployments using
DFS Namespaces and
DFS Replication
Backups are
stored in Amazon
S3
Replicates
data within
Availability Zone
Continually
monitors and
addresses
hardware failures
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Secure and
Compliant
Network traffic access
control using Amazon
VPC security groups
Integrates with
Active Directory
and supports
Windows ACLs
Data encrypted
at-rest and
in-transit
PCI-DSS +
ISO-compliant
and HIPAA-eligible
Monitor and log
API calls using
AWS CloudTrail
Admin API
access control
using AWS IAM
Enterprise-ready
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Extend existing Windows
environments without added
complexity
Automatically replicate data
between on-premises file
servers and Amazon FSx
NEW!
Seamless on-premises integration
Direct integration with on-premises AD environments
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Broad accessibility: What’s supported?
Broad
accessibility
Linux
(Samba client)
Windows 7+Microsoft Windows
Server 2008+
Amazon
AppStream 2.0
Amazon
WorkSpaces
VMware Cloud
on AWS
Amazon
EC2
Windows Server
SMB
2.0–3.1.1
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Fully managed
Fully managed Daily automatic backupsAutomated Windows
patch updates
Provisions and manages file
servers and storage
S U M M I T © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
“We’recommittedtorapidlymodernizingour
applications
andminimizingourdatacenterinfrastructure.
Noothercloudfilestorageofferingprovidesthe
fullWindowscompatibilityandperformanceof
AmazonFSxforWindowsFileServer.Amazon
FSxisagamechanger.”
—Mark Gogel
AVP of Core Technology Services
“WithAmazonFSxforWindowsFileServer,we
haveamanagedsolutionthateliminatesthe
needforustomanagethetasksassociatedwith
operatingfilestorage,includingperforming,
backupsandapplyingsoftwarepatches.
Thisallowsustofocusonourcorebusiness‒
deliveringgreatbusinesssoftwaretoour
customers.”
—Greg Bell
Principal Storage Operations Administrator
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Amazon FSx for Windows File Server: Use cases
AnalyticsSoftware development
environments
Home
directories
Web serving and
content management
Media
workflows
Line-of-business
applications
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
AWS provides file system options that help you easily address
the diverse needs of your file-based applications and workloads
Amazon EFS Amazon FSx for
Windows File Server
Amazon FSx
for Lustre
LINUX-BASED WORKLOADS WINDOWS-BASED WORKLOADS
Fully managed Windows file servers
for business applications
Fully managed cloud-native file system
for Linux-based applications
Fully managed Lustre file system for
high performance workloads
COMPUTE-INTENSIVE WORKLOADS
Fully managed cloud file systems
S U M M I T © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
AWS hybrid storage and transport solutions
File Storage Object StorageBlock Storage
BackupHybrid Transport & Edge
Amazon FSx for
Windows File Server
Amazon FSx for
Lustre
Amazon
EFS
Amazon S3
Glacier
Amazon
S3
Amazon
EBS
AWS Backup
AWS Storage
Gateway Family AWS DataSync AWS Transfer for
SFTP
AWS Snow*
Family
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Standard storage protocols Fully managed cache
Optimized data transfer AWS integrated
AWS Storage Gateway
Hybrid cloud service enabling on-premises apps to seamlessly use
AWS storage
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
AWS CloudCustomer premises
Files
(NFS/SMB)
Volumes
(iSCSI)
Tapes
(iSCSI VTL)
AWS Storage Gateway
Integrated with IAM, KMS, CloudTrail, CloudWatch services
Amazon S3
Glacier
Amazon S3
Amazon Elastic
Block Store
Provides on-premises access to virtually unlimited cloud storage
Configuration: VMware, Hyper-V, EC2, Hardware appliance
Amazon Backup
Amazon S3 Glacier
Deep Archive
Storage Gateway serviceStorage Gateway
HTTPS
AWS Storage Gateway
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
AWS
Online transfer service that simplifies, automates, and
accelerates moving data between on-premises storage and AWS
Combines the speed and reliability of network acceleration
software with the cost-effectiveness of open-source tools
Fast data transfer
up to 10 Gbps per
agent
Simple data
movement to
S3 or EFS
Secure and reliable Cloud integrated Cost-effective
AWS DataSync
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Shared
file system
NFS TLS
On-Premises
Amazon S3
bucket
AWS Storage resources
Agent deployed on
VMware or EC2 for
efficient access to
local NFS server
Region
AWS DataSync
agent
Highly parallel
transfers using
optimized network
protocol
Optimized to read and
writes to S3 and EFS
using IAM/VPCE
Fully managed
service scales to
send or receive data
from agent
AWS DataSync
Amazon Elastic File
System
Migrate data to AWS with DataSync
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
DataSync migrates to Amazon S3. Incremental copies keeps Amazon S3 up to date1
2 Latency-sensitive applications can access data in S3 through File Gateway
On-Premise
Applications
2
1
File Gateway
Reduce on-premises storage3
3
Region
Storage Gateway
AWS DataSync
Amazon S3
bucket
AWS DataSync
agent
NFS Server
Reduce infrastructure
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Fully-managed SFTP service enabling transfer of data into Amazon S3
Fully managed
in AWS
Native integration
with AWS services
Cost-effective
Seamless migration of
existing SFTP workflows
Simple to use
Secure and
compliant
AWS Transfer for SFTP
S U M M I T © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Lift-and-shift is just the beginning
Rehost
Lift-and-shift
Replatform
Lift, shift, and tinker
Rearchitect
Run cloud native
+ Scalability
+ Flexibility
+ Fully managed
+ Save time
+ Agility
+ Cost savings
+ Performance
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Increased agility with cloud-first initiative
Challenge:
Solution:
Lifted and shifted core file storage systems and applications into AWS
LoanLogics journey to the AWS Cloud
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
LoanLogics journey to the AWS Cloud
Where they started Their first step
Volume
Gateway
Critical data to AWS
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Successfully moved all applications to AWS
“AWS has allowed us to shift our focus from how our infrastructure is operating but to focus
on our business strategy. By using AWS, from Amazon Storage Gateway to Amazon EFS, we
are 100 percent cloud-based and continue to evolve to meet market and customer
demands”
—Terrell Cassada, Chief Information Officer
Core AWS Services:
Amazon
S3
Amazon EFSAWS
Storage
Gateway
Amazon
EBS
Amazon
EC2
AWS
CloudFormation
Amazon
DynamoDB
Amazon
Aurora
Amazon
RDS
S U M M I T © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
What to choose?
Block storage Hybrid/transportFile storage
• Lift-and-shift existing
applications
• Native support for
industry standard access
protocols
• High-performance data
processing
• Support of hybrid
environments
• Relational or NoSQL
databases
• Data warehousing
• Enterprise applications
• Big data processing
• Backup/recovery
• Simplified and
accelerated migration
to/from AWS storage
services
• Support of industry
standard protocols
• Offline data movement
Object storage
• Cloud-native application
data
• Data lakes
• Big data analytics
• Backup/recovery
• Active archive
• Hybrid storage
Amazon S3
Glacier
Amazon
S3
Amazon
EBS
FSx for
Windows
FSx for
Lustre
Amazon
EFS
AWS
Storage
Gateway
AWS
DataSync
AWS
Transfer
for SFTP
AWS
Snow*
family
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T
Where do I go now?
https://aws.amazon.com/ebs/
https://aws.amazon.com/efs/
https://aws.amazon.com/fsx/windows/
https://aws.amazon.com/storagegateway/
https://aws.amazon.com/datasync/ https://aws.amazon.com/sftp/
https://aws.amazon.com/products/storage/lift-and-shift/
Thank you!
S U M M I T © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Joe Disher
jdisher@amazon.com

Weitere ähnliche Inhalte

Was ist angesagt?

Was ist angesagt? (20)

A tale of two customers - Simplified data protection with Veeam, N2WS & AWS -...
A tale of two customers - Simplified data protection with Veeam, N2WS & AWS -...A tale of two customers - Simplified data protection with Veeam, N2WS & AWS -...
A tale of two customers - Simplified data protection with Veeam, N2WS & AWS -...
 
Make your data move: Best practices for migrating data to AWS - STG201 - New ...
Make your data move: Best practices for migrating data to AWS - STG201 - New ...Make your data move: Best practices for migrating data to AWS - STG201 - New ...
Make your data move: Best practices for migrating data to AWS - STG201 - New ...
 
HK-AWS-Quick-Start-Workshop
HK-AWS-Quick-Start-WorkshopHK-AWS-Quick-Start-Workshop
HK-AWS-Quick-Start-Workshop
 
Progetta, crea e gestisci Modern Application per web e mobile su AWS
Progetta, crea e gestisci Modern Application per web e mobile su AWSProgetta, crea e gestisci Modern Application per web e mobile su AWS
Progetta, crea e gestisci Modern Application per web e mobile su AWS
 
Build scalable applications with a serverless relational database - ADB211 - ...
Build scalable applications with a serverless relational database - ADB211 - ...Build scalable applications with a serverless relational database - ADB211 - ...
Build scalable applications with a serverless relational database - ADB211 - ...
 
Scalable, secure log analytics with Amazon ES - ADB302 - Chicago AWS Summit
Scalable, secure log analytics with Amazon ES - ADB302 - Chicago AWS SummitScalable, secure log analytics with Amazon ES - ADB302 - Chicago AWS Summit
Scalable, secure log analytics with Amazon ES - ADB302 - Chicago AWS Summit
 
No Hassle NoSQL - Amazon DynamoDB & Amazon DocumentDB | AWS Summit Tel Aviv ...
 No Hassle NoSQL - Amazon DynamoDB & Amazon DocumentDB | AWS Summit Tel Aviv ... No Hassle NoSQL - Amazon DynamoDB & Amazon DocumentDB | AWS Summit Tel Aviv ...
No Hassle NoSQL - Amazon DynamoDB & Amazon DocumentDB | AWS Summit Tel Aviv ...
 
Optimize deep learning training and inferencing using GPU and Amazon SageMake...
Optimize deep learning training and inferencing using GPU and Amazon SageMake...Optimize deep learning training and inferencing using GPU and Amazon SageMake...
Optimize deep learning training and inferencing using GPU and Amazon SageMake...
 
Increase the value of video with machine learning & AWS Media Services - SVC3...
Increase the value of video with machine learning & AWS Media Services - SVC3...Increase the value of video with machine learning & AWS Media Services - SVC3...
Increase the value of video with machine learning & AWS Media Services - SVC3...
 
利用微服務加速創新的步伐
利用微服務加速創新的步伐利用微服務加速創新的步伐
利用微服務加速創新的步伐
 
Deploy and scale your first cloud application with Amazon Lightsail - CMP208 ...
Deploy and scale your first cloud application with Amazon Lightsail - CMP208 ...Deploy and scale your first cloud application with Amazon Lightsail - CMP208 ...
Deploy and scale your first cloud application with Amazon Lightsail - CMP208 ...
 
Transform with Cloud to drive your Future | AWS Summit Tel Aviv 2019
Transform with Cloud to drive your Future | AWS Summit Tel Aviv 2019Transform with Cloud to drive your Future | AWS Summit Tel Aviv 2019
Transform with Cloud to drive your Future | AWS Summit Tel Aviv 2019
 
Journey into the Cloud with VMware Cloud on AWS: Deep Dive - CMP303 - Anaheim...
Journey into the Cloud with VMware Cloud on AWS: Deep Dive - CMP303 - Anaheim...Journey into the Cloud with VMware Cloud on AWS: Deep Dive - CMP303 - Anaheim...
Journey into the Cloud with VMware Cloud on AWS: Deep Dive - CMP303 - Anaheim...
 
Introducing-AWS-Hong-Kong-Region
Introducing-AWS-Hong-Kong-RegionIntroducing-AWS-Hong-Kong-Region
Introducing-AWS-Hong-Kong-Region
 
What's new with Amazon S3, Amazon EFS, and other AWS storage services - STG20...
What's new with Amazon S3, Amazon EFS, and other AWS storage services - STG20...What's new with Amazon S3, Amazon EFS, and other AWS storage services - STG20...
What's new with Amazon S3, Amazon EFS, and other AWS storage services - STG20...
 
AWS App Mesh: Manage services mesh discovery, recovery, and monitoring - MAD3...
AWS App Mesh: Manage services mesh discovery, recovery, and monitoring - MAD3...AWS App Mesh: Manage services mesh discovery, recovery, and monitoring - MAD3...
AWS App Mesh: Manage services mesh discovery, recovery, and monitoring - MAD3...
 
Budget management with Cloud Economics | AWS Summit Tel Aviv 2019
Budget management with Cloud Economics | AWS Summit Tel Aviv 2019Budget management with Cloud Economics | AWS Summit Tel Aviv 2019
Budget management with Cloud Economics | AWS Summit Tel Aviv 2019
 
Ask me anything about building data lakes on AWS - ADB209 - New York AWS Summit
Ask me anything about building data lakes on AWS - ADB209 - New York AWS SummitAsk me anything about building data lakes on AWS - ADB209 - New York AWS Summit
Ask me anything about building data lakes on AWS - ADB209 - New York AWS Summit
 
AWS Analytics Services - When to use what? | AWS Summit Tel Aviv 2019
AWS Analytics Services - When to use what? | AWS Summit Tel Aviv 2019AWS Analytics Services - When to use what? | AWS Summit Tel Aviv 2019
AWS Analytics Services - When to use what? | AWS Summit Tel Aviv 2019
 
CI/CD best practices for building modern applications - MAD310 - New York AWS...
CI/CD best practices for building modern applications - MAD310 - New York AWS...CI/CD best practices for building modern applications - MAD310 - New York AWS...
CI/CD best practices for building modern applications - MAD310 - New York AWS...
 

Ähnlich wie “Lift and shift” storage for business-critical applications - STG203 - New York AWS Summit

Ähnlich wie “Lift and shift” storage for business-critical applications - STG203 - New York AWS Summit (20)

AWS storage solutions for business-critical applications - STG301 - Chicago A...
AWS storage solutions for business-critical applications - STG301 - Chicago A...AWS storage solutions for business-critical applications - STG301 - Chicago A...
AWS storage solutions for business-critical applications - STG301 - Chicago A...
 
Webinar AWS: Desmistificando a Nuvem
Webinar AWS: Desmistificando a NuvemWebinar AWS: Desmistificando a Nuvem
Webinar AWS: Desmistificando a Nuvem
 
Solutions for Storage and Data Migrations | AWS Summit Tel Aviv 2019
Solutions for Storage and Data Migrations | AWS Summit Tel Aviv 2019Solutions for Storage and Data Migrations | AWS Summit Tel Aviv 2019
Solutions for Storage and Data Migrations | AWS Summit Tel Aviv 2019
 
Pitt Immersion Day Module 4 - storage in AWS
Pitt Immersion Day Module 4 - storage in AWSPitt Immersion Day Module 4 - storage in AWS
Pitt Immersion Day Module 4 - storage in AWS
 
Storage for business-critical applications - STG303 - Santa Clara AWS Summit
Storage for business-critical applications - STG303 - Santa Clara AWS SummitStorage for business-critical applications - STG303 - Santa Clara AWS Summit
Storage for business-critical applications - STG303 - Santa Clara AWS Summit
 
Optimizing Storage for Enterprise Workloads and Migrations (STG202) - AWS re:...
Optimizing Storage for Enterprise Workloads and Migrations (STG202) - AWS re:...Optimizing Storage for Enterprise Workloads and Migrations (STG202) - AWS re:...
Optimizing Storage for Enterprise Workloads and Migrations (STG202) - AWS re:...
 
AWS Portfolio: highlight delle categorie di prodotti AWS con esempi
AWS Portfolio: highlight delle categorie di prodotti AWS con esempiAWS Portfolio: highlight delle categorie di prodotti AWS con esempi
AWS Portfolio: highlight delle categorie di prodotti AWS con esempi
 
Create, map, and drive performance with Amazon FSx for Windows File Server - ...
Create, map, and drive performance with Amazon FSx for Windows File Server - ...Create, map, and drive performance with Amazon FSx for Windows File Server - ...
Create, map, and drive performance with Amazon FSx for Windows File Server - ...
 
Deep dive on security in Amazon S3 - STG306 - New York AWS Summit
Deep dive on security in Amazon S3 - STG306 - New York AWS SummitDeep dive on security in Amazon S3 - STG306 - New York AWS Summit
Deep dive on security in Amazon S3 - STG306 - New York AWS Summit
 
[AWS Media Symposium 2019] Perfecting the Media Experience with AWS - Bhavik ...
[AWS Media Symposium 2019] Perfecting the Media Experience with AWS - Bhavik ...[AWS Media Symposium 2019] Perfecting the Media Experience with AWS - Bhavik ...
[AWS Media Symposium 2019] Perfecting the Media Experience with AWS - Bhavik ...
 
Case Study: Learn how to Choose and Optimize Storage for Media and Entertainm...
Case Study: Learn how to Choose and Optimize Storage for Media and Entertainm...Case Study: Learn how to Choose and Optimize Storage for Media and Entertainm...
Case Study: Learn how to Choose and Optimize Storage for Media and Entertainm...
 
Migrating Business Critical Applications to AWS
Migrating Business Critical Applications to AWSMigrating Business Critical Applications to AWS
Migrating Business Critical Applications to AWS
 
Migrating Data to the Cloud: Explore Your Options From AWS
Migrating Data to the Cloud: Explore Your Options From AWSMigrating Data to the Cloud: Explore Your Options From AWS
Migrating Data to the Cloud: Explore Your Options From AWS
 
AWSome Day Brasil - Março 2020
AWSome Day Brasil - Março 2020AWSome Day Brasil - Março 2020
AWSome Day Brasil - Março 2020
 
AWSome Day Brasil - Junho 2020
AWSome Day Brasil - Junho 2020AWSome Day Brasil - Junho 2020
AWSome Day Brasil - Junho 2020
 
AWS Data Transfer Services Deep Dive
AWS Data Transfer Services Deep Dive AWS Data Transfer Services Deep Dive
AWS Data Transfer Services Deep Dive
 
AWS Initiate - Migrando Dados Para a Nuvem: Explorando suas opções com AWS
AWS Initiate - Migrando Dados Para a Nuvem: Explorando suas opções com AWSAWS Initiate - Migrando Dados Para a Nuvem: Explorando suas opções com AWS
AWS Initiate - Migrando Dados Para a Nuvem: Explorando suas opções com AWS
 
Enterprise-Database-Migration-Strategies-and-Options-on-AWS
Enterprise-Database-Migration-Strategies-and-Options-on-AWSEnterprise-Database-Migration-Strategies-and-Options-on-AWS
Enterprise-Database-Migration-Strategies-and-Options-on-AWS
 
Amazon Aurora, funzionalità e best practice per la migrazione di database su AWS
Amazon Aurora, funzionalità e best practice per la migrazione di database su AWSAmazon Aurora, funzionalità e best practice per la migrazione di database su AWS
Amazon Aurora, funzionalità e best practice per la migrazione di database su AWS
 
AWS Initiate Day Manchester 2019 – AWS Migrating Data to the Cloud
AWS Initiate Day Manchester 2019 – AWS Migrating Data to the CloudAWS Initiate Day Manchester 2019 – AWS Migrating Data to the Cloud
AWS Initiate Day Manchester 2019 – AWS Migrating Data to the Cloud
 

Mehr von Amazon Web Services

Tools for building your MVP on AWS
Tools for building your MVP on AWSTools for building your MVP on AWS
Tools for building your MVP on AWS
Amazon Web Services
 
How to Build a Winning Pitch Deck
How to Build a Winning Pitch DeckHow to Build a Winning Pitch Deck
How to Build a Winning Pitch Deck
Amazon Web Services
 
Building a web application without servers
Building a web application without serversBuilding a web application without servers
Building a web application without servers
Amazon Web Services
 
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...AWS_HK_StartupDay_Building Interactive websites while automating for efficien...
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...
Amazon Web Services
 

Mehr von Amazon Web Services (20)

Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...
Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...
Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...
 
Big Data per le Startup: come creare applicazioni Big Data in modalità Server...
Big Data per le Startup: come creare applicazioni Big Data in modalità Server...Big Data per le Startup: come creare applicazioni Big Data in modalità Server...
Big Data per le Startup: come creare applicazioni Big Data in modalità Server...
 
Esegui pod serverless con Amazon EKS e AWS Fargate
Esegui pod serverless con Amazon EKS e AWS FargateEsegui pod serverless con Amazon EKS e AWS Fargate
Esegui pod serverless con Amazon EKS e AWS Fargate
 
Costruire Applicazioni Moderne con AWS
Costruire Applicazioni Moderne con AWSCostruire Applicazioni Moderne con AWS
Costruire Applicazioni Moderne con AWS
 
Come spendere fino al 90% in meno con i container e le istanze spot
Come spendere fino al 90% in meno con i container e le istanze spot Come spendere fino al 90% in meno con i container e le istanze spot
Come spendere fino al 90% in meno con i container e le istanze spot
 
Open banking as a service
Open banking as a serviceOpen banking as a service
Open banking as a service
 
Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...
Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...
Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...
 
OpsWorks Configuration Management: automatizza la gestione e i deployment del...
OpsWorks Configuration Management: automatizza la gestione e i deployment del...OpsWorks Configuration Management: automatizza la gestione e i deployment del...
OpsWorks Configuration Management: automatizza la gestione e i deployment del...
 
Microsoft Active Directory su AWS per supportare i tuoi Windows Workloads
Microsoft Active Directory su AWS per supportare i tuoi Windows WorkloadsMicrosoft Active Directory su AWS per supportare i tuoi Windows Workloads
Microsoft Active Directory su AWS per supportare i tuoi Windows Workloads
 
Computer Vision con AWS
Computer Vision con AWSComputer Vision con AWS
Computer Vision con AWS
 
Database Oracle e VMware Cloud on AWS i miti da sfatare
Database Oracle e VMware Cloud on AWS i miti da sfatareDatabase Oracle e VMware Cloud on AWS i miti da sfatare
Database Oracle e VMware Cloud on AWS i miti da sfatare
 
Crea la tua prima serverless ledger-based app con QLDB e NodeJS
Crea la tua prima serverless ledger-based app con QLDB e NodeJSCrea la tua prima serverless ledger-based app con QLDB e NodeJS
Crea la tua prima serverless ledger-based app con QLDB e NodeJS
 
API moderne real-time per applicazioni mobili e web
API moderne real-time per applicazioni mobili e webAPI moderne real-time per applicazioni mobili e web
API moderne real-time per applicazioni mobili e web
 
Database Oracle e VMware Cloud™ on AWS: i miti da sfatare
Database Oracle e VMware Cloud™ on AWS: i miti da sfatareDatabase Oracle e VMware Cloud™ on AWS: i miti da sfatare
Database Oracle e VMware Cloud™ on AWS: i miti da sfatare
 
Tools for building your MVP on AWS
Tools for building your MVP on AWSTools for building your MVP on AWS
Tools for building your MVP on AWS
 
How to Build a Winning Pitch Deck
How to Build a Winning Pitch DeckHow to Build a Winning Pitch Deck
How to Build a Winning Pitch Deck
 
Building a web application without servers
Building a web application without serversBuilding a web application without servers
Building a web application without servers
 
Fundraising Essentials
Fundraising EssentialsFundraising Essentials
Fundraising Essentials
 
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...AWS_HK_StartupDay_Building Interactive websites while automating for efficien...
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...
 
Introduzione a Amazon Elastic Container Service
Introduzione a Amazon Elastic Container ServiceIntroduzione a Amazon Elastic Container Service
Introduzione a Amazon Elastic Container Service
 

“Lift and shift” storage for business-critical applications - STG203 - New York AWS Summit

  • 1. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T “Lift and shift” storage for business-critical applications Joe Disher Product Marketing Manager Amazon Web Services S T G 2 0 3
  • 2. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Agenda Storage for business- critical applications
  • 3. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T • Challenges with on-premises storage • AWS storage services • Business-critical applications • Block storage • File storage • Supporting services and solutions • One customer’s journey to all-in • What to choose? Agenda Storage for business- critical applications
  • 4. S U M M I T © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
  • 5. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T What are customers using on-premises storage for? Archive & compliance Media applications, tape replacement Data lakes Fast TCO vs. siloed on premises Amazon Athena, Amazon S3/Select foundation for machine learning File storage Shared application storage, websites, media workflows, backups, dev workflows, container storage Block storage Databases, data warehouse, Hadoop, logs, media Home directories User shares Office files, engineering files, etc.
  • 6. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Pain with managing on-premises storage arrays
  • 7. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Pain with managing on-premises storage arrays Procurement Implementation Time
  • 8. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Pain with managing on-premises storage arrays Cost ? SSD HDD Capex Provisioning Software & maintenance Maintenance renewals Physical
  • 9. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Pain with managing on-premises storage arrays Complexity Expertise Availability Backup & DR Scalability Security & compliance
  • 10. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Pain with managing on-premises storage arrays More time More cost More complexity Hardware failure?
  • 11. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Typical order of workload migrations Backup/DR High availability, backup, DR Application storage (file) Shared application storage, media workflows (rendering, transcoding, vfx), backups, dev workflows Home directories User shares Office files, engineering files, etc. Databases SQL, MySQL, Oracle, SAP, PosteSQL, Cassandra, Mongo Analytics Big data (Hadoop, Kafka, Splunk,) machine learning, HPC
  • 12. S U M M I T © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
  • 13. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Increase agility Accelerate innovation Strengthen security Reduce cost AWS has been helping enterprises for 13 years
  • 14. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Portfolio breadth and depth Amazon FSx for Windows File Server Amazon FSx for Lustre Amazon EFS Amazon S3 Glacier Amazon S3 Amazon EBS AWS Backup AWS Storage Gateway family AWS DataSync AWS Transfer for SFTP AWS Snow* family
  • 15. S U M M I T © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
  • 16. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Business-critical applications defined An application that is critical or important to keep the business running These business-critical applications can range from small tools to specialized tools to line-of- business systems such as ERP or CRM applications How is this different from mission-critical applications? Mission-critical applications can take down an entire business in an irreversible way, impacting the business with unrecoverable costs and lost business
  • 17. S U M M I T © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
  • 18. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T AWS block storage File Storage Object StorageBlock Storage BackupHybrid Transport & Edge Amazon FSx for Windows File Server Amazon FSx for Lustre Amazon EFS Amazon S3 Glacier Amazon S3 Amazon EBS AWS Backup AWS Storage Gateway Family AWS DataSync AWS Transfer for SFTP AWS Snow* Family
  • 19. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T AWS block storage offerings Amazon EC2 instance store HDDSSD sc1st1 Amazon EBS HDD- backed volumes Amazon EBS SSD- backed volumes io1gp2
  • 20. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Amazon EBS What is Amazon EBS?
  • 21. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T • Block storage as a service • Create, attach, manage volumes through an API • Service accessed over the network • SSD or HDD • Encryption support (on by default) • Point-in-time snapshot support Amazon EBS What is Amazon EBS?
  • 22. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T • 99.999 availability • 0.1–0.2% annual failure rate (AFR) What is Amazon EBS? Amazon EBS
  • 23. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T EC2 instance != Availability Zone EBS volume (boot) What is Amazon EBS?
  • 24. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T EC2 instance EBS service Availability Zone EBS volume (boot) What is Amazon EBS?
  • 25. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T EC2 instance Availability Zone AWS Region EC2 instance • Volumes persist independent of Amazon EC2 • Select storage and compute based on your workload • Detach and attach between instances within the same Availability Zone EBS volume (boot) What is Amazon EBS?
  • 26. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T EBS volume (boot) Availability Zone AWS Region • One instance can have many volumes attached • Volumes attach to one instance • Best practice – separate boot and data volumesEBS volume (data) EBS volume (data) EC2 instance What is Amazon EBS?
  • 27. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T SSD-based General purpose SSD volume that balances price and performance for a wide variety of workloads with predictable baseline and burst Up to 16K IOPS and 256 MB/sec $0.10/GiB* Highest performance SSD volume designed for critical and I/O intensive workloads requiring 99.9% consistent performance Up to 64K IOPS and 1,000 MB/sec $0.125/GiB* $0.065/IOP* *per GB month of provisioned storage (us-east-1) Volume types and performance Great for boot volumes, low-latency applications, and bursty databases Ideal for critical applications and databases with sustained IOPS
  • 28. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T HDD-based *per GB month of provisioned storage (us-east-1) Low-cost HDD volume designed for frequently accessed, throughput intensive sequential workloads Up to 500 IOPS and 500 MB/sec $0.045/GiB* Lowest cost HDD volume designed for less frequently accessed sequential workloads Up to 250 IOPS and 250 MB/sec $0.025/GiB* Volume types and performance Ideal for sequential throughput workloads, such as logging and backup Ideal for large-block, high-throughput sequential workloads
  • 29. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Elastic volumes Amazon EBS • Increase volume size • Modify performance • Change volume type • Continue using your application without downtime
  • 30. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Relational databases MySQL, PostgreSQL, SQL, Oracle, SAP Media Transcoding, encoding, rendering, file storage Big data Hadoop/EMR, logs, stream processing, data warehousing NoSQL databases Cassandra, MongoDB, CouchDB, Aerospike Solid state drive (SSD) Hard disk drive (HDD) Amazon EBS use cases
  • 31. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Amazon EMR Vertica Teradata Kafka Tibco EMS MongoDB Cassandra MySQL on EC2/EBS Hadoop Data warehouse Streaming NoSQL MySQL Amazon EBS use cases Cloudera Hortonworks MapR Amazon Redshift Amazon Kinesis Amazon DynamoDB Amazon RDS/Amazon Aurora
  • 32. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Development and test Enterprise applications Business continuity Relational databases NoSQL databases Amazon EBS use cases
  • 33. S U M M I T © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
  • 34. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Everyone has files Always growing… never shrinking Got files?
  • 35. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T File data = unstructured data Home Directories Word processing Spreadsheets Presentations Development Data Code with CI/CD Log files Media Files Digital photos Audio files Video files Digital Security Surveillance photos Surveillance videos Sensor Data Oceanographic Weather Traffic Machine Generated Satellite images Weather data Seismic imagery Atmospheric data
  • 36. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Many file storage use cases FILE SHARING FILE SERVICES B A C K U P & R E S T O R E DATABASE BUSINESS APPLICATIONS COMPUTE-INTENSIVE WORKLOADS DATA ANALYTICS DATA LAKE HOME DIRECTORIES WEB SERVING CONTENT MANAGEMENT SQL BACKUPS MEDIA AND ENTERTAINMENT CONTAINERS SOFTWARE DEVELOPMENT TOOLS DATA TRANSFER FILE SYSTEMS HYBRID STORAGE NFS SMB LINUX MACHINE LEARNING HPC FINANCIAL SERVICES GENOMICS EDA OCR EDI
  • 37. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Enterprise data in silos Enterprise Applications Database Mainframe Backup & Restore File Services File Services File Services File Sharing File Services File Services Backup & Restore Archiving Database Analytics Backup & Restore Database Analytics Backup & Restore Database Analytics Backup & Restore Database Mainframe Enterprise Applications Data Warehouse Database
  • 38. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T AWS file storage File Storage Object StorageBlock Storage BackupHybrid Transport & Edge Amazon FSx for Windows File Server Amazon FSx for Lustre Amazon EFS Amazon S3 Glacier Amazon S3 Amazon EBS AWS Backup AWS Storage Gateway Family AWS DataSync AWS Transfer for SFTP AWS Snow* Family
  • 39. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T A framework for AWS service offerings Amazon relational database options Amazon file system optionsAmazon relational database options Cloud-native Amazon file system options Cloud-native Commercial Amazon FSx for Windows File Server Amazon FSx for Lustre Amazon EFS Simplifying setup and automating time-consuming administration tasks Open-sourceCommercial Open-source Amazon Aurora
  • 40. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Amazon EFS Amazon FSx for Windows File Server Amazon FSx for Lustre LINUX-BASED WORKLOADS WINDOWS-BASED WORKLOADS Fully managed Windows file servers for business applications Fully managed cloud-native file system for Linux-based applications Fully managed Lustre file system for high performance workloads COMPUTE-INTENSIVE WORKLOADS AWS provides file system options that help you easily address the diverse needs of your file-based applications and workloads Fully managed cloud file systems
  • 41. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Fully managed cloud file systems AWS provides file system options that help you easily address the diverse needs of your file-based applications and workloads Amazon EFS Amazon FSx for Windows File Server Amazon FSx for Lustre LINUX-BASED WORKLOADS WINDOWS-BASED WORKLOADS Fully managed Windows file servers for business applications Fully managed cloud-native file system for Linux-based applications Fully managed Lustre file system for high performance workloads COMPUTE-INTENSIVE WORKLOADS
  • 42. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Amazon EFS Performance Shared access Highly durable and available Elastic and scalable Secure and compliant Storage classes Scalable, elastic, cloud-native Linux file system 10 GB/sec & 500K IOPS
  • 43. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T No changes to existing applications using Amazon EFS Cost savings up to 85% Automated lifecycle management Amazon EFS Infrequent Access
  • 44. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Amazon EFS Infrequent Access Create your file system Enable lifecycle management Files added and not accessed based on policy are moved to EFS IA How it works
  • 45. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Before Amazon EFS… DIY shared file storage VPC AZ-aAZ-b File server File server Storage Volumes Clients Storage Volumes
  • 46. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Amazon EFS Amazon EFS cost: Standard storage class (100 GB * $0.30/GB-month*): $30 per month Infrequent Access storage class (400 GB * $0.045/GB-month*): $18 per month Infrequent Access data access (400 GB*1*$0.01/GB*) = $4 per month TOTAL: $52 per month DIY – provisioning 600 GB of Amazon EBS (i.e., ~85% utilization) Storage (2x 120 GB EBS gp2 volumes): $24 per month Storage (2x 480 GB EBS sc1 volumes): $24 per month Compute (2x m5.xlarge instances): $281 per month Inter-AZ data transfer costs (est.): $130 per month TOTAL $459 per month *US N. Virginia pricing Amazon EFS is ~90% less than DIY TCO example
  • 47. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Test with general purpose performance mode Start with bursting throughput mode Linux kernel 4.3+ EFS mount helper (NFSv4.1) Large I/O size (aggregate I/O) AWS Multiple threads Multiple instances Multiple directories Monitor metrics Best practices
  • 48. S U M M I T © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. “PriortousingAmazonEFS,wewere experiencingtimeoutsfor5–10percentof uploadsover100MB.Now,wehavezero timeouts,whichisahugewin. Whenwewerelargelyusingon-premisesdata centers,ittookaminimumofthreemonthsto setupdevelopmentinfrastructure.UsingAWS, teamscanrollouttheenvironmenttheyneed inoneweek—withouthavingtogetstorageand networkingteamsinvolved." —Suresh Prem Principal Systems Engineer “AmazonEFSprovidesastandardfilesystem interfacethatallowedustomigrateour applicationstothecloudwithoutany modificationtotheapplication. Also,beingamanagedfileservice,wenolonger hadtomanageandadministerthefilesystem resourceswehadin-house,freeinguptimefor ITOpstofocusonitemsthatimpactour business.” —Lance Smith Associate Director of IT
  • 49. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Amazon EFS use cases Big data analyticsApplication testing & development Web serving and content management Media workflows Lift-and-shift enterprise applications
  • 50. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T AWS provides file system options that help you easily address the diverse needs of your file-based applications and workloads Amazon EFS Amazon FSx for Windows File Server Amazon FSx for Lustre LINUX-BASED WORKLOADS WINDOWS-BASED WORKLOADS Fully managed Windows file servers for business applications Fully managed cloud-native file system for Linux-based applications Fully managed Lustre file system for high performance workloads COMPUTE-INTENSIVE WORKLOADS Fully managed cloud file systems
  • 51. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Lift and shift your Windows file storage with fully managed Windows file servers Amazon FSx for Windows File Server Fast and flexible performance Native Windows compatibility Enterprise-ready Fully managedBroad accessibility
  • 52. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Native Windows compatibility and features Native Windows compatibility DFS Namespaces and DFS Replication Integrates with Active Directory and supports Windows ACLs Active Directory NTFS Windows Server Native SMB 2.0 to 3.1.1 SMB
  • 53. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Fast and flexible performance Fast and flexible performance High IOPS High throughput Built on SSD storage Consistent sub-millisecond latencies Choose throughput independent of storage
  • 54. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Enterprise-ready Highly available and durable Supports Multi-AZ deployments using DFS Namespaces and DFS Replication Backups are stored in Amazon S3 Replicates data within Availability Zone Continually monitors and addresses hardware failures
  • 55. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Secure and Compliant Network traffic access control using Amazon VPC security groups Integrates with Active Directory and supports Windows ACLs Data encrypted at-rest and in-transit PCI-DSS + ISO-compliant and HIPAA-eligible Monitor and log API calls using AWS CloudTrail Admin API access control using AWS IAM Enterprise-ready
  • 56. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Extend existing Windows environments without added complexity Automatically replicate data between on-premises file servers and Amazon FSx NEW! Seamless on-premises integration Direct integration with on-premises AD environments
  • 57. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Broad accessibility: What’s supported? Broad accessibility Linux (Samba client) Windows 7+Microsoft Windows Server 2008+ Amazon AppStream 2.0 Amazon WorkSpaces VMware Cloud on AWS Amazon EC2 Windows Server SMB 2.0–3.1.1
  • 58. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Fully managed Fully managed Daily automatic backupsAutomated Windows patch updates Provisions and manages file servers and storage
  • 59. S U M M I T © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. “We’recommittedtorapidlymodernizingour applications andminimizingourdatacenterinfrastructure. Noothercloudfilestorageofferingprovidesthe fullWindowscompatibilityandperformanceof AmazonFSxforWindowsFileServer.Amazon FSxisagamechanger.” —Mark Gogel AVP of Core Technology Services “WithAmazonFSxforWindowsFileServer,we haveamanagedsolutionthateliminatesthe needforustomanagethetasksassociatedwith operatingfilestorage,includingperforming, backupsandapplyingsoftwarepatches. Thisallowsustofocusonourcorebusiness‒ deliveringgreatbusinesssoftwaretoour customers.” —Greg Bell Principal Storage Operations Administrator
  • 60. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Amazon FSx for Windows File Server: Use cases AnalyticsSoftware development environments Home directories Web serving and content management Media workflows Line-of-business applications
  • 61. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T AWS provides file system options that help you easily address the diverse needs of your file-based applications and workloads Amazon EFS Amazon FSx for Windows File Server Amazon FSx for Lustre LINUX-BASED WORKLOADS WINDOWS-BASED WORKLOADS Fully managed Windows file servers for business applications Fully managed cloud-native file system for Linux-based applications Fully managed Lustre file system for high performance workloads COMPUTE-INTENSIVE WORKLOADS Fully managed cloud file systems
  • 62. S U M M I T © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
  • 63. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T AWS hybrid storage and transport solutions File Storage Object StorageBlock Storage BackupHybrid Transport & Edge Amazon FSx for Windows File Server Amazon FSx for Lustre Amazon EFS Amazon S3 Glacier Amazon S3 Amazon EBS AWS Backup AWS Storage Gateway Family AWS DataSync AWS Transfer for SFTP AWS Snow* Family
  • 64. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Standard storage protocols Fully managed cache Optimized data transfer AWS integrated AWS Storage Gateway Hybrid cloud service enabling on-premises apps to seamlessly use AWS storage
  • 65. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T AWS CloudCustomer premises Files (NFS/SMB) Volumes (iSCSI) Tapes (iSCSI VTL) AWS Storage Gateway Integrated with IAM, KMS, CloudTrail, CloudWatch services Amazon S3 Glacier Amazon S3 Amazon Elastic Block Store Provides on-premises access to virtually unlimited cloud storage Configuration: VMware, Hyper-V, EC2, Hardware appliance Amazon Backup Amazon S3 Glacier Deep Archive Storage Gateway serviceStorage Gateway HTTPS AWS Storage Gateway
  • 66. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T AWS Online transfer service that simplifies, automates, and accelerates moving data between on-premises storage and AWS Combines the speed and reliability of network acceleration software with the cost-effectiveness of open-source tools Fast data transfer up to 10 Gbps per agent Simple data movement to S3 or EFS Secure and reliable Cloud integrated Cost-effective AWS DataSync
  • 67. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Shared file system NFS TLS On-Premises Amazon S3 bucket AWS Storage resources Agent deployed on VMware or EC2 for efficient access to local NFS server Region AWS DataSync agent Highly parallel transfers using optimized network protocol Optimized to read and writes to S3 and EFS using IAM/VPCE Fully managed service scales to send or receive data from agent AWS DataSync Amazon Elastic File System Migrate data to AWS with DataSync
  • 68. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T DataSync migrates to Amazon S3. Incremental copies keeps Amazon S3 up to date1 2 Latency-sensitive applications can access data in S3 through File Gateway On-Premise Applications 2 1 File Gateway Reduce on-premises storage3 3 Region Storage Gateway AWS DataSync Amazon S3 bucket AWS DataSync agent NFS Server Reduce infrastructure
  • 69. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Fully-managed SFTP service enabling transfer of data into Amazon S3 Fully managed in AWS Native integration with AWS services Cost-effective Seamless migration of existing SFTP workflows Simple to use Secure and compliant AWS Transfer for SFTP
  • 70. S U M M I T © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
  • 71. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Lift-and-shift is just the beginning Rehost Lift-and-shift Replatform Lift, shift, and tinker Rearchitect Run cloud native + Scalability + Flexibility + Fully managed + Save time + Agility + Cost savings + Performance
  • 72. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Increased agility with cloud-first initiative Challenge: Solution: Lifted and shifted core file storage systems and applications into AWS LoanLogics journey to the AWS Cloud
  • 73. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T LoanLogics journey to the AWS Cloud Where they started Their first step Volume Gateway Critical data to AWS
  • 74. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Successfully moved all applications to AWS “AWS has allowed us to shift our focus from how our infrastructure is operating but to focus on our business strategy. By using AWS, from Amazon Storage Gateway to Amazon EFS, we are 100 percent cloud-based and continue to evolve to meet market and customer demands” —Terrell Cassada, Chief Information Officer Core AWS Services: Amazon S3 Amazon EFSAWS Storage Gateway Amazon EBS Amazon EC2 AWS CloudFormation Amazon DynamoDB Amazon Aurora Amazon RDS
  • 75. S U M M I T © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
  • 76. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T What to choose? Block storage Hybrid/transportFile storage • Lift-and-shift existing applications • Native support for industry standard access protocols • High-performance data processing • Support of hybrid environments • Relational or NoSQL databases • Data warehousing • Enterprise applications • Big data processing • Backup/recovery • Simplified and accelerated migration to/from AWS storage services • Support of industry standard protocols • Offline data movement Object storage • Cloud-native application data • Data lakes • Big data analytics • Backup/recovery • Active archive • Hybrid storage Amazon S3 Glacier Amazon S3 Amazon EBS FSx for Windows FSx for Lustre Amazon EFS AWS Storage Gateway AWS DataSync AWS Transfer for SFTP AWS Snow* family
  • 77. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.S U M M I T Where do I go now? https://aws.amazon.com/ebs/ https://aws.amazon.com/efs/ https://aws.amazon.com/fsx/windows/ https://aws.amazon.com/storagegateway/ https://aws.amazon.com/datasync/ https://aws.amazon.com/sftp/ https://aws.amazon.com/products/storage/lift-and-shift/
  • 78. Thank you! S U M M I T © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. Joe Disher jdisher@amazon.com