SlideShare ist ein Scribd-Unternehmen logo
1 von 32
P U B L I C S E C T O R
S U M M I T
Washingt on, DC
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.P U B L I C S E C T O R
S U M M I T
Make Your Data Move: Best Practices for
Migrating Data to AWS
Chris Rogers
Business Development Manager
Global Storage BD Team
AWS
3 2 2 0 7 3
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.P U B L I C S E C T O R
S U M M I T
Related breakouts
316002: Hybrid Solutions at the Edge – Go Global Faster, Efficiently,
and More Securely using AWS Cloud in a Hybrid Environment
Tom Creighton, Mike Norton, Tarshia Weldon
317945: Hybrid Data Storage made Easier with AWS Storage
Gateway
Bhavin Patel, AWS
295440: Improving Information and Communications in a
Disaster Scenario with AWS Snowball Edge
Joe Flasher, AWS
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.P U B L I C S E C T O R
S U M M I T
Agenda
• Key questions to consider
• AWS Transfer for SFTP & Demo
• AWS Snowball
• AWS DataSync & Demo
• Wrap-Up
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.P U B L I C S E C T O R
S U M M I T
As more and more critical workloads move to the cloud…
AWS
…you need to move increasingly
large datasets along with them
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.P U B L I C S E C T O R
S U M M I T
Key questions for data migration
Why are you and your teams moving data to the cloud?
What datasets are you moving?
Where will you move your data?
When do you need the data to be available?
How much available network bandwidth?
The efficiency of your migration depends on all of the above
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.P U B L I C S E C T O R
S U M M I T
Why are you moving data to AWS?
Data Center
Consolidation
Digital
Transformation
Cost
Reduction
Large-Scale
Compute-
Intensive
Workloads
Facility or
Real Estate
Decisions
Colocation or
Outsourcing
Contract Changes
Agility/Dev
Productivity
Acquisitions
or Divestitures
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.P U B L I C S E C T O R
S U M M I T
Where to put your data?
Amazon Elastic
Block Store
(Amazon EBS)
Amazon Simple
Storage Service
(Amazon S3)
Amazon Glacier
Data movement
OnlineOffline
AWS Snow family
AWS Storage Gateway family
AWS Direct Connect
AWS DataSync
Amazon S3 Transfer Acceleration
Storage partners
AWS Transfer for SFTP
Amazon Kinesis Data Streams,
Video Streams, & Firehose
Amazon Elastic File
System (Amazon EFS)
Databases
Amazon RDS
Amazon Aurora
Amazon Redshift
Amazon DynamoDB
Amazon Elasticache
Amazon QLDB
Amazon Neptune
Amazon Timestream
Amazon DocumentDB
AWS Database Migration Service
CloudEndure
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.P U B L I C S E C T O R
S U M M I T
When do you need your data?
100 Mbps 1 Gbps 10 Gbps
1 TB 30 hrs. 3 hrs. 18 min.
10 TB 12 days 30 hrs. 3 hrs.
100 TB 124 days 12 days 30 hrs.
1 PB 3 yrs. 124 days 12 days
10 PB 34 yrs. 3 yrs. 124 days
(assumes ~25% network overhead)
Usable network bandwidth
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.P U B L I C S E C T O R
S U M M I T
How can you get your data to AWS?
Online
data transfer
Hybrid
storage
Offline
data transfer
Edge
locations for
S3-enabled
applications
Online
transfer of
active data
AWS DataSync
Managed file
transfers into
Amazon S3
AWS Transfer
for SFTP
Load
streaming
data into
Amazon S3
Amazon Kinesis
Data Firehose
Ship static
data into
and out of
Amazon S3
AWS Snowball
Storage and
compute in
disconnected
environments
AWS Snowball
Edge
Access AWS
storage from
on-premises
AWS Storage
Gateway
S3 Transfer
Acceleration
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.P U B L I C S E C T O R
S U M M I T
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.P U B L I C S E C T O R
S U M M I T
SFTP workflows
Receive third-party uploads
Distributed value-added data
Transfer data internally
Financial services
$
Retail
Healthcare ..and more
SFTP is deeply embedded in workflows across a variety of industries
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.P U B L I C S E C T O R
S U M M I T
What is Transfer for SFTP
Fully-managed SFTP service enabling transfer of data into Amazon S3
Secure and compliant
SimpleFully managed in AWSSeamless migration
of existing SFTP workflows
Cost-effective Native integration
with AWS services
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.P U B L I C S E C T O R
S U M M I T
How AWS Transfer for SFTP works
Fully managed, highly available, service provides secure access to data in
customer’s S3 bucket
No change to existing clients.
Seamlessly use Transfer for SFTP
to securely move SFTP workloads
to AWS
Amazon S3
bucket
Customer’s IDP
VPC
LambdaAPIG
AWS Cloud
AWS Transfer
for SFTP
SFTP Users &
Clients
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.P U B L I C S E C T O R
S U M M I T
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.P U B L I C S E C T O R
S U M M I T
SFTP: 3 Simple Steps
Your users can now use your AWS SFTP server endpoint to transfer data
Map/create your hostname Select your S3 bucket Set up your users
1 2 3
Associate your hostname
with the server endpoint
Create an IAM role to access the
Amazon S3 buckets used for
storing data transferred over
SFTP
Create and map users to IAM roles
to enable them for file operations
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.P U B L I C S E C T O R
S U M M I T
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.P U B L I C S E C T O R
S U M M I T
Where is edge computing happening?
Research
Industrial Healthcare
Transportation Military
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.P U B L I C S E C T O R
S U M M I T
AWS Snowball AWS Snowball Edge AWS Snowmobile
• 50 or 80TB storage capacity
• 10GE networking
• Data encryption end-to-end
• Chain of Custody, Tamper Detection
• Rugged 8.5 G impact case
• Rain and dust resistant
• Amazon S3 Data Import
• Small file Batching
• Snowball command line
• S3 Adapter runs on workstation
• 42/100TB storage capacity (s3)
• 10/25/40GE networking
• Data encryption end-to-end
• Rugged 8.5 G impact case
• Chain of Custody, Tamper Detection
• Rain and dust resistant
• Amazon S3 Data import
• NFSv4 Server
• Clustering
• AWS IOT Greengrass
• EC2/AMI support for edge computing
• GPU options
• Exabyte-scale storage in a 45ft
container (90PB s3/Glacier/EBS)
• 10/25/40GE networking
• Data encryption end-to-end
• S3/Glacier Data import
• Dedicated security personnel
• GPS tracking, alarm monitoring, 24/7
surveillance, and optional additional
security
Data Transfer Only Data Transfer & Edge Compute 20+ PB Data Transfer
AWS Snow Family Portfolio
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.P U B L I C S E C T O R
S U M M I T
Create
a job
Connect the
Snowball /
Snowball Edge
Copy & Process
Data on device
Your data is
loaded into
your bucket!
Snowball and Snowball Edge import workflow
Job created
Job completed
Job Provisioned At AWS Region
In transit Delivered to you Sent to AWS Ingest to AWS
1 – 3 Days 1-N Days1-N Days (file transfer speed dependent)1 – 2 Days 1 – 2 Days
+
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.P U B L I C S E C T O R
S U M M I T
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.P U B L I C S E C T O R
S U M M I T
What is AWS DataSync?
Transfers
up to 10 Gbps
per agent
Cost
effective
Combines the speed and reliability of network acceleration
software with the cost-effectiveness of open-source tools
Simple data
movement to
S3 or EFS
Secure and
reliable
Cloud
integrated
AWS
Online transfer service that simplifies, automates, and accelerates
moving data between on-premises storage and AWS
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.P U B L I C S E C T O R
S U M M I T
DataSync & GovCloud Launch
• AWS DataSync is now available in the AWS GovCloud (US-West) Region
• Securely copy sensitive data between your sites and the AWS GovCloud
(US-West) Region
• AWS DataSync is available in the following regions:
• AWS GovCloud (US-West)
• US East (Northern Virginia and Ohio)
• US West (Northern California and Oregon)
• Europe (Ireland and Frankfurt)
• Asia Pacific (Singapore, Tokyo, Sydney, and Seoul)
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.P U B L I C S E C T O R
S U M M I T
Shared
file system
NFS TLS
How AWS DataSync works
On-Premises
Amazon S3
bucket
AWS Storage resources
Agent deployed on
VMware or EC2 for
efficient access to
local NFS server
Region
AWS DataSync
agent
Highly parallel
transfers using
optimized network
protocol
Optimized to read
and writes to S3 and
EFS using IAM/VPCE
Fully-managed
service scales to
send or receive
data from agent
AWS DataSync Amazon Elastic
File System
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.P U B L I C S E C T O R
S U M M I T
As simple as 1-2-3...
Deploy on-premises agent
and connect to your
AWS account
Create a task by
configuring storage
locations and options
Start the task and
monitor progress
1 2 3
VMware ESXi
4 vCPU
32 GB memory
On-premises NFS file
systems, S3 buckets, or EFS
file systems
Monitor in the console or
through
Amazon CloudWatch
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.P U B L I C S E C T O R
S U M M I T
DataSync Management, Monitoring and Compliance
Cloud
integrated
AWS
Monitor with Amazon CloudWatch
Detailed CloudWatch Logs track data movement
Control and audit usage with AWS Identity and
Access Management (IAM) and AWS CloudTrail
PCI-DSS compliant and HIPAA eligible
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.P U B L I C S E C T O R
S U M M I T
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.P U B L I C S E C T O R
S U M M I T
DataSync demo
Region (Simulating on-prem infra)
Availability zone
Region
• Start with on-premises
infrastructure
• NFS Storage
• a web server
• a desktop
us-west-1 us-east-2
NFS StorageEnd User
Desktop
Web
Server
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.P U B L I C S E C T O R
S U M M I T
DataSync demo
Region (Simulating on-prem infra)
Availability zone
S3 Bucket
(hybrid-demo-ohio)
Region
NFS Storage
Using DataSync we will migrate
the webserver content to S3
(preserving posix permissions)
us-west-1 us-east-2
DataSync
agent AWS
DataSync
Service
End User
Desktop
Web
Server
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.P U B L I C S E C T O R
S U M M I T
Remember the 4 “W”s (and 1 “H”)
Why?
What?
Where?
When?
How?
Thank you!
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.P U B L I C S E C T O R
S U M M I T
Chris Rogers
chrisrg@amazon.com
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.P U B L I C S E C T O R
S U M M I T

Weitere ähnliche Inhalte

Was ist angesagt?

Builders' Day - Building Data Lakes for Analytics On AWS LC
Builders' Day - Building Data Lakes for Analytics On AWS LCBuilders' Day - Building Data Lakes for Analytics On AWS LC
Builders' Day - Building Data Lakes for Analytics On AWS LCAmazon Web Services LATAM
 
Optimizing data lakes with Amazon S3 - STG302 - New York AWS Summit
Optimizing data lakes with Amazon S3 - STG302 - New York AWS SummitOptimizing data lakes with Amazon S3 - STG302 - New York AWS Summit
Optimizing data lakes with Amazon S3 - STG302 - New York AWS SummitAmazon Web Services
 
AWS Services for Data Migration - AWS Online Tech Talks
AWS Services for Data Migration - AWS Online Tech TalksAWS Services for Data Migration - AWS Online Tech Talks
AWS Services for Data Migration - AWS Online Tech TalksAmazon Web Services
 
Armazenamento em Amazon Web Service para Setor Publico
 Armazenamento em Amazon Web Service para Setor Publico  Armazenamento em Amazon Web Service para Setor Publico
Armazenamento em Amazon Web Service para Setor Publico Amazon Web Services LATAM
 
Migrate a relational database to Aurora - ADB302 - Atlanta AWS Summit
Migrate a relational database to Aurora - ADB302 - Atlanta AWS SummitMigrate a relational database to Aurora - ADB302 - Atlanta AWS Summit
Migrate a relational database to Aurora - ADB302 - Atlanta AWS SummitAmazon Web Services
 
All Databases Are Equal, But Some Databases Are More Equal than Others: How t...
All Databases Are Equal, But Some Databases Are More Equal than Others: How t...All Databases Are Equal, But Some Databases Are More Equal than Others: How t...
All Databases Are Equal, But Some Databases Are More Equal than Others: How t...javier ramirez
 
Migrating Data to the Cloud: Explore Your Options From AWS
Migrating Data to the Cloud: Explore Your Options From AWSMigrating Data to the Cloud: Explore Your Options From AWS
Migrating Data to the Cloud: Explore Your Options From AWSAmazon Web Services
 
GPSTEC313_GPS Real-Time Data Processing with AWS Lambda Quickly, at Scale, an...
GPSTEC313_GPS Real-Time Data Processing with AWS Lambda Quickly, at Scale, an...GPSTEC313_GPS Real-Time Data Processing with AWS Lambda Quickly, at Scale, an...
GPSTEC313_GPS Real-Time Data Processing with AWS Lambda Quickly, at Scale, an...Amazon Web Services
 
Cloud Computing - How AWS can help your business
Cloud Computing - How AWS can help your businessCloud Computing - How AWS can help your business
Cloud Computing - How AWS can help your businessAmazon Web Services LATAM
 
DAT202_Getting started with Amazon Aurora
DAT202_Getting started with Amazon AuroraDAT202_Getting started with Amazon Aurora
DAT202_Getting started with Amazon AuroraAmazon Web Services
 
AMF305_Autonomous Driving Algorithm Development on Amazon AI
AMF305_Autonomous Driving Algorithm Development on Amazon AIAMF305_Autonomous Driving Algorithm Development on Amazon AI
AMF305_Autonomous Driving Algorithm Development on Amazon AIAmazon Web Services
 
Innovation-at-Hyper-scale-Outlook-on-Emerging-Technologies
Innovation-at-Hyper-scale-Outlook-on-Emerging-TechnologiesInnovation-at-Hyper-scale-Outlook-on-Emerging-Technologies
Innovation-at-Hyper-scale-Outlook-on-Emerging-TechnologiesAmazon Web Services
 
AWS Media Preservation Summit - Los Angeles
AWS Media Preservation Summit - Los AngelesAWS Media Preservation Summit - Los Angeles
AWS Media Preservation Summit - Los AngelesAmazon Web Services
 
DAT339_Replicate, Analyze, and Visualize Datasets Using AWS Database Migratio...
DAT339_Replicate, Analyze, and Visualize Datasets Using AWS Database Migratio...DAT339_Replicate, Analyze, and Visualize Datasets Using AWS Database Migratio...
DAT339_Replicate, Analyze, and Visualize Datasets Using AWS Database Migratio...Amazon Web Services
 
High-Performance-Computing-on-AWS-and-Industry-Simulation
High-Performance-Computing-on-AWS-and-Industry-SimulationHigh-Performance-Computing-on-AWS-and-Industry-Simulation
High-Performance-Computing-on-AWS-and-Industry-SimulationAmazon Web Services
 
Disney's Magic The Story of Cloud Transformation - ARC206 - re:Invent 2017
Disney's Magic The Story of Cloud Transformation - ARC206 - re:Invent 2017Disney's Magic The Story of Cloud Transformation - ARC206 - re:Invent 2017
Disney's Magic The Story of Cloud Transformation - ARC206 - re:Invent 2017Amazon Web Services
 
Databases - EBC on the road Brazil Edition [Portuguese]
Databases - EBC on the road Brazil Edition [Portuguese]Databases - EBC on the road Brazil Edition [Portuguese]
Databases - EBC on the road Brazil Edition [Portuguese]Amazon Web Services
 

Was ist angesagt? (20)

Builders' Day - Building Data Lakes for Analytics On AWS LC
Builders' Day - Building Data Lakes for Analytics On AWS LCBuilders' Day - Building Data Lakes for Analytics On AWS LC
Builders' Day - Building Data Lakes for Analytics On AWS LC
 
Optimizing data lakes with Amazon S3 - STG302 - New York AWS Summit
Optimizing data lakes with Amazon S3 - STG302 - New York AWS SummitOptimizing data lakes with Amazon S3 - STG302 - New York AWS Summit
Optimizing data lakes with Amazon S3 - STG302 - New York AWS Summit
 
AWS Services for Data Migration - AWS Online Tech Talks
AWS Services for Data Migration - AWS Online Tech TalksAWS Services for Data Migration - AWS Online Tech Talks
AWS Services for Data Migration - AWS Online Tech Talks
 
Armazenamento em Amazon Web Service para Setor Publico
 Armazenamento em Amazon Web Service para Setor Publico  Armazenamento em Amazon Web Service para Setor Publico
Armazenamento em Amazon Web Service para Setor Publico
 
Migrate a relational database to Aurora - ADB302 - Atlanta AWS Summit
Migrate a relational database to Aurora - ADB302 - Atlanta AWS SummitMigrate a relational database to Aurora - ADB302 - Atlanta AWS Summit
Migrate a relational database to Aurora - ADB302 - Atlanta AWS Summit
 
All Databases Are Equal, But Some Databases Are More Equal than Others: How t...
All Databases Are Equal, But Some Databases Are More Equal than Others: How t...All Databases Are Equal, But Some Databases Are More Equal than Others: How t...
All Databases Are Equal, But Some Databases Are More Equal than Others: How t...
 
Migrating Data to the Cloud: Explore Your Options From AWS
Migrating Data to the Cloud: Explore Your Options From AWSMigrating Data to the Cloud: Explore Your Options From AWS
Migrating Data to the Cloud: Explore Your Options From AWS
 
Data Migration Best Practice
Data Migration Best PracticeData Migration Best Practice
Data Migration Best Practice
 
EC2_and_VPC_workshop
EC2_and_VPC_workshopEC2_and_VPC_workshop
EC2_and_VPC_workshop
 
GPSTEC313_GPS Real-Time Data Processing with AWS Lambda Quickly, at Scale, an...
GPSTEC313_GPS Real-Time Data Processing with AWS Lambda Quickly, at Scale, an...GPSTEC313_GPS Real-Time Data Processing with AWS Lambda Quickly, at Scale, an...
GPSTEC313_GPS Real-Time Data Processing with AWS Lambda Quickly, at Scale, an...
 
Cloud Computing - How AWS can help your business
Cloud Computing - How AWS can help your businessCloud Computing - How AWS can help your business
Cloud Computing - How AWS can help your business
 
DAT202_Getting started with Amazon Aurora
DAT202_Getting started with Amazon AuroraDAT202_Getting started with Amazon Aurora
DAT202_Getting started with Amazon Aurora
 
AWS Storage State of the Union
AWS Storage State of the UnionAWS Storage State of the Union
AWS Storage State of the Union
 
AMF305_Autonomous Driving Algorithm Development on Amazon AI
AMF305_Autonomous Driving Algorithm Development on Amazon AIAMF305_Autonomous Driving Algorithm Development on Amazon AI
AMF305_Autonomous Driving Algorithm Development on Amazon AI
 
Innovation-at-Hyper-scale-Outlook-on-Emerging-Technologies
Innovation-at-Hyper-scale-Outlook-on-Emerging-TechnologiesInnovation-at-Hyper-scale-Outlook-on-Emerging-Technologies
Innovation-at-Hyper-scale-Outlook-on-Emerging-Technologies
 
AWS Media Preservation Summit - Los Angeles
AWS Media Preservation Summit - Los AngelesAWS Media Preservation Summit - Los Angeles
AWS Media Preservation Summit - Los Angeles
 
DAT339_Replicate, Analyze, and Visualize Datasets Using AWS Database Migratio...
DAT339_Replicate, Analyze, and Visualize Datasets Using AWS Database Migratio...DAT339_Replicate, Analyze, and Visualize Datasets Using AWS Database Migratio...
DAT339_Replicate, Analyze, and Visualize Datasets Using AWS Database Migratio...
 
High-Performance-Computing-on-AWS-and-Industry-Simulation
High-Performance-Computing-on-AWS-and-Industry-SimulationHigh-Performance-Computing-on-AWS-and-Industry-Simulation
High-Performance-Computing-on-AWS-and-Industry-Simulation
 
Disney's Magic The Story of Cloud Transformation - ARC206 - re:Invent 2017
Disney's Magic The Story of Cloud Transformation - ARC206 - re:Invent 2017Disney's Magic The Story of Cloud Transformation - ARC206 - re:Invent 2017
Disney's Magic The Story of Cloud Transformation - ARC206 - re:Invent 2017
 
Databases - EBC on the road Brazil Edition [Portuguese]
Databases - EBC on the road Brazil Edition [Portuguese]Databases - EBC on the road Brazil Edition [Portuguese]
Databases - EBC on the road Brazil Edition [Portuguese]
 

Ähnlich wie Make Your Data Move: Best Practices for Migrating Data to AWS

Discuss data migration with AWS experts - STG304 - Santa Clara AWS Summit
Discuss data migration with AWS experts - STG304 - Santa Clara AWS SummitDiscuss data migration with AWS experts - STG304 - Santa Clara AWS Summit
Discuss data migration with AWS experts - STG304 - Santa Clara AWS SummitAmazon Web Services
 
Getting started on your AWS migration journey
Getting started on your AWS migration journeyGetting started on your AWS migration journey
Getting started on your AWS migration journeyAmazon Web Services
 
Initiate Edinburgh 2019 - Migrating Data to the Cloud
Initiate Edinburgh 2019 - Migrating Data to the CloudInitiate Edinburgh 2019 - Migrating Data to the Cloud
Initiate Edinburgh 2019 - Migrating Data to the CloudAmazon Web Services
 
AWS Initiate Day Manchester 2019 – AWS Migrating Data to the Cloud
AWS Initiate Day Manchester 2019 – AWS Migrating Data to the CloudAWS Initiate Day Manchester 2019 – AWS Migrating Data to the Cloud
AWS Initiate Day Manchester 2019 – AWS Migrating Data to the CloudAmazon Web Services
 
AWS Initiate Day Dublin 2019 – Migrating Data to the Cloud
AWS Initiate Day Dublin 2019 – Migrating Data to the CloudAWS Initiate Day Dublin 2019 – Migrating Data to the Cloud
AWS Initiate Day Dublin 2019 – Migrating Data to the CloudAmazon Web Services
 
Migrating Data to the Cloud, Exploring your Options from AWS
Migrating Data to the Cloud, Exploring your Options from AWSMigrating Data to the Cloud, Exploring your Options from AWS
Migrating Data to the Cloud, Exploring your Options from AWSAmazon Web Services
 
Migrando seus dados para nuvem: Explore as opções da nuvem AWS
Migrando seus dados para nuvem: Explore as opções da nuvem AWSMigrando seus dados para nuvem: Explore as opções da nuvem AWS
Migrando seus dados para nuvem: Explore as opções da nuvem AWSAmazon Web Services LATAM
 
AWS Initiate - Migrando Dados Para a Nuvem: Explorando suas opções com AWS
AWS Initiate - Migrando Dados Para a Nuvem: Explorando suas opções com AWSAWS Initiate - Migrando Dados Para a Nuvem: Explorando suas opções com AWS
AWS Initiate - Migrando Dados Para a Nuvem: Explorando suas opções com AWSAmazon Web Services LATAM
 
Best Practices for Migrating Databases to the Cloud - AWS Summit Sydney
Best Practices for Migrating Databases to the Cloud - AWS Summit SydneyBest Practices for Migrating Databases to the Cloud - AWS Summit Sydney
Best Practices for Migrating Databases to the Cloud - AWS Summit SydneyAmazon Web Services
 
Deep dive on AWS Cloud storage offerings - What to use, where, and why - STG3...
Deep dive on AWS Cloud storage offerings - What to use, where, and why - STG3...Deep dive on AWS Cloud storage offerings - What to use, where, and why - STG3...
Deep dive on AWS Cloud storage offerings - What to use, where, and why - STG3...Amazon Web Services
 
Migrating Business Critical Applications to AWS
Migrating Business Critical Applications to AWSMigrating Business Critical Applications to AWS
Migrating Business Critical Applications to AWSAmazon Web Services
 
AWS Data Transfer Services: Deep Dive - SRV302 - Chicago AWS Summit
AWS Data Transfer Services: Deep Dive - SRV302 - Chicago AWS SummitAWS Data Transfer Services: Deep Dive - SRV302 - Chicago AWS Summit
AWS Data Transfer Services: Deep Dive - SRV302 - Chicago AWS SummitAmazon Web Services
 
Architecting Digital Media Archive Migrations with AWS - STG301 - Anaheim AWS...
Architecting Digital Media Archive Migrations with AWS - STG301 - Anaheim AWS...Architecting Digital Media Archive Migrations with AWS - STG301 - Anaheim AWS...
Architecting Digital Media Archive Migrations with AWS - STG301 - Anaheim AWS...Amazon Web Services
 
Migrating Data to the Cloud: Exploring Your Options from AWS (STG205-R1) - AW...
Migrating Data to the Cloud: Exploring Your Options from AWS (STG205-R1) - AW...Migrating Data to the Cloud: Exploring Your Options from AWS (STG205-R1) - AW...
Migrating Data to the Cloud: Exploring Your Options from AWS (STG205-R1) - AW...Amazon Web Services
 
Introducing AWS DataSync - Simplify, automate, and accelerate online data tra...
Introducing AWS DataSync - Simplify, automate, and accelerate online data tra...Introducing AWS DataSync - Simplify, automate, and accelerate online data tra...
Introducing AWS DataSync - Simplify, automate, and accelerate online data tra...Amazon Web Services
 
How To Deploy Your File Workloads Quickly & Easily with AWS
How To Deploy Your File Workloads Quickly & Easily with AWSHow To Deploy Your File Workloads Quickly & Easily with AWS
How To Deploy Your File Workloads Quickly & Easily with AWSAmazon Web Services
 
Migrating Large Scale Data Sets to the Cloud - STG204 - re:Invent 2017
Migrating Large Scale Data Sets to the Cloud - STG204 - re:Invent 2017Migrating Large Scale Data Sets to the Cloud - STG204 - re:Invent 2017
Migrating Large Scale Data Sets to the Cloud - STG204 - re:Invent 2017Amazon Web Services
 
Migrating_Large_Scale_Data_Sets_to_the_Cloud
Migrating_Large_Scale_Data_Sets_to_the_CloudMigrating_Large_Scale_Data_Sets_to_the_Cloud
Migrating_Large_Scale_Data_Sets_to_the_CloudAmazon Web Services
 
Implementing a Data Warehouse on AWS in a Hybrid Environment
Implementing a Data Warehouse on AWS in a Hybrid EnvironmentImplementing a Data Warehouse on AWS in a Hybrid Environment
Implementing a Data Warehouse on AWS in a Hybrid EnvironmentAmazon Web Services
 

Ähnlich wie Make Your Data Move: Best Practices for Migrating Data to AWS (20)

Discuss data migration with AWS experts - STG304 - Santa Clara AWS Summit
Discuss data migration with AWS experts - STG304 - Santa Clara AWS SummitDiscuss data migration with AWS experts - STG304 - Santa Clara AWS Summit
Discuss data migration with AWS experts - STG304 - Santa Clara AWS Summit
 
Getting started on your AWS migration journey
Getting started on your AWS migration journeyGetting started on your AWS migration journey
Getting started on your AWS migration journey
 
Initiate Edinburgh 2019 - Migrating Data to the Cloud
Initiate Edinburgh 2019 - Migrating Data to the CloudInitiate Edinburgh 2019 - Migrating Data to the Cloud
Initiate Edinburgh 2019 - Migrating Data to the Cloud
 
AWS Initiate Day Manchester 2019 – AWS Migrating Data to the Cloud
AWS Initiate Day Manchester 2019 – AWS Migrating Data to the CloudAWS Initiate Day Manchester 2019 – AWS Migrating Data to the Cloud
AWS Initiate Day Manchester 2019 – AWS Migrating Data to the Cloud
 
AWS Initiate Day Dublin 2019 – Migrating Data to the Cloud
AWS Initiate Day Dublin 2019 – Migrating Data to the CloudAWS Initiate Day Dublin 2019 – Migrating Data to the Cloud
AWS Initiate Day Dublin 2019 – Migrating Data to the Cloud
 
Migrating Data to the Cloud, Exploring your Options from AWS
Migrating Data to the Cloud, Exploring your Options from AWSMigrating Data to the Cloud, Exploring your Options from AWS
Migrating Data to the Cloud, Exploring your Options from AWS
 
Migrando seus dados para nuvem: Explore as opções da nuvem AWS
Migrando seus dados para nuvem: Explore as opções da nuvem AWSMigrando seus dados para nuvem: Explore as opções da nuvem AWS
Migrando seus dados para nuvem: Explore as opções da nuvem AWS
 
AWS Initiate - Migrando Dados Para a Nuvem: Explorando suas opções com AWS
AWS Initiate - Migrando Dados Para a Nuvem: Explorando suas opções com AWSAWS Initiate - Migrando Dados Para a Nuvem: Explorando suas opções com AWS
AWS Initiate - Migrando Dados Para a Nuvem: Explorando suas opções com AWS
 
Best Practices for Migrating Databases to the Cloud - AWS Summit Sydney
Best Practices for Migrating Databases to the Cloud - AWS Summit SydneyBest Practices for Migrating Databases to the Cloud - AWS Summit Sydney
Best Practices for Migrating Databases to the Cloud - AWS Summit Sydney
 
Deep dive on AWS Cloud storage offerings - What to use, where, and why - STG3...
Deep dive on AWS Cloud storage offerings - What to use, where, and why - STG3...Deep dive on AWS Cloud storage offerings - What to use, where, and why - STG3...
Deep dive on AWS Cloud storage offerings - What to use, where, and why - STG3...
 
Migrating Business Critical Applications to AWS
Migrating Business Critical Applications to AWSMigrating Business Critical Applications to AWS
Migrating Business Critical Applications to AWS
 
AWS Data Transfer Services: Deep Dive - SRV302 - Chicago AWS Summit
AWS Data Transfer Services: Deep Dive - SRV302 - Chicago AWS SummitAWS Data Transfer Services: Deep Dive - SRV302 - Chicago AWS Summit
AWS Data Transfer Services: Deep Dive - SRV302 - Chicago AWS Summit
 
Architecting Digital Media Archive Migrations with AWS - STG301 - Anaheim AWS...
Architecting Digital Media Archive Migrations with AWS - STG301 - Anaheim AWS...Architecting Digital Media Archive Migrations with AWS - STG301 - Anaheim AWS...
Architecting Digital Media Archive Migrations with AWS - STG301 - Anaheim AWS...
 
Migrating Data to the Cloud: Exploring Your Options from AWS (STG205-R1) - AW...
Migrating Data to the Cloud: Exploring Your Options from AWS (STG205-R1) - AW...Migrating Data to the Cloud: Exploring Your Options from AWS (STG205-R1) - AW...
Migrating Data to the Cloud: Exploring Your Options from AWS (STG205-R1) - AW...
 
AWS-Data-Migration-module3
AWS-Data-Migration-module3AWS-Data-Migration-module3
AWS-Data-Migration-module3
 
Introducing AWS DataSync - Simplify, automate, and accelerate online data tra...
Introducing AWS DataSync - Simplify, automate, and accelerate online data tra...Introducing AWS DataSync - Simplify, automate, and accelerate online data tra...
Introducing AWS DataSync - Simplify, automate, and accelerate online data tra...
 
How To Deploy Your File Workloads Quickly & Easily with AWS
How To Deploy Your File Workloads Quickly & Easily with AWSHow To Deploy Your File Workloads Quickly & Easily with AWS
How To Deploy Your File Workloads Quickly & Easily with AWS
 
Migrating Large Scale Data Sets to the Cloud - STG204 - re:Invent 2017
Migrating Large Scale Data Sets to the Cloud - STG204 - re:Invent 2017Migrating Large Scale Data Sets to the Cloud - STG204 - re:Invent 2017
Migrating Large Scale Data Sets to the Cloud - STG204 - re:Invent 2017
 
Migrating_Large_Scale_Data_Sets_to_the_Cloud
Migrating_Large_Scale_Data_Sets_to_the_CloudMigrating_Large_Scale_Data_Sets_to_the_Cloud
Migrating_Large_Scale_Data_Sets_to_the_Cloud
 
Implementing a Data Warehouse on AWS in a Hybrid Environment
Implementing a Data Warehouse on AWS in a Hybrid EnvironmentImplementing a Data Warehouse on AWS in a Hybrid Environment
Implementing a Data Warehouse on AWS in a Hybrid Environment
 

Mehr von Amazon Web Services

Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...
Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...
Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...Amazon Web Services
 
Big Data per le Startup: come creare applicazioni Big Data in modalità Server...
Big Data per le Startup: come creare applicazioni Big Data in modalità Server...Big Data per le Startup: come creare applicazioni Big Data in modalità Server...
Big Data per le Startup: come creare applicazioni Big Data in modalità Server...Amazon Web Services
 
Esegui pod serverless con Amazon EKS e AWS Fargate
Esegui pod serverless con Amazon EKS e AWS FargateEsegui pod serverless con Amazon EKS e AWS Fargate
Esegui pod serverless con Amazon EKS e AWS FargateAmazon Web Services
 
Costruire Applicazioni Moderne con AWS
Costruire Applicazioni Moderne con AWSCostruire Applicazioni Moderne con AWS
Costruire Applicazioni Moderne con AWSAmazon Web Services
 
Come spendere fino al 90% in meno con i container e le istanze spot
Come spendere fino al 90% in meno con i container e le istanze spot Come spendere fino al 90% in meno con i container e le istanze spot
Come spendere fino al 90% in meno con i container e le istanze spot Amazon Web Services
 
Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...
Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...
Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...Amazon Web Services
 
OpsWorks Configuration Management: automatizza la gestione e i deployment del...
OpsWorks Configuration Management: automatizza la gestione e i deployment del...OpsWorks Configuration Management: automatizza la gestione e i deployment del...
OpsWorks Configuration Management: automatizza la gestione e i deployment del...Amazon Web Services
 
Microsoft Active Directory su AWS per supportare i tuoi Windows Workloads
Microsoft Active Directory su AWS per supportare i tuoi Windows WorkloadsMicrosoft Active Directory su AWS per supportare i tuoi Windows Workloads
Microsoft Active Directory su AWS per supportare i tuoi Windows WorkloadsAmazon Web Services
 
Database Oracle e VMware Cloud on AWS i miti da sfatare
Database Oracle e VMware Cloud on AWS i miti da sfatareDatabase Oracle e VMware Cloud on AWS i miti da sfatare
Database Oracle e VMware Cloud on AWS i miti da sfatareAmazon Web Services
 
Crea la tua prima serverless ledger-based app con QLDB e NodeJS
Crea la tua prima serverless ledger-based app con QLDB e NodeJSCrea la tua prima serverless ledger-based app con QLDB e NodeJS
Crea la tua prima serverless ledger-based app con QLDB e NodeJSAmazon Web Services
 
API moderne real-time per applicazioni mobili e web
API moderne real-time per applicazioni mobili e webAPI moderne real-time per applicazioni mobili e web
API moderne real-time per applicazioni mobili e webAmazon Web Services
 
Database Oracle e VMware Cloud™ on AWS: i miti da sfatare
Database Oracle e VMware Cloud™ on AWS: i miti da sfatareDatabase Oracle e VMware Cloud™ on AWS: i miti da sfatare
Database Oracle e VMware Cloud™ on AWS: i miti da sfatareAmazon Web Services
 
Tools for building your MVP on AWS
Tools for building your MVP on AWSTools for building your MVP on AWS
Tools for building your MVP on AWSAmazon Web Services
 
How to Build a Winning Pitch Deck
How to Build a Winning Pitch DeckHow to Build a Winning Pitch Deck
How to Build a Winning Pitch DeckAmazon Web Services
 
Building a web application without servers
Building a web application without serversBuilding a web application without servers
Building a web application without serversAmazon Web Services
 
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...AWS_HK_StartupDay_Building Interactive websites while automating for efficien...
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...Amazon Web Services
 
Introduzione a Amazon Elastic Container Service
Introduzione a Amazon Elastic Container ServiceIntroduzione a Amazon Elastic Container Service
Introduzione a Amazon Elastic Container ServiceAmazon Web Services
 

Mehr von Amazon Web Services (20)

Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...
Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...
Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...
 
Big Data per le Startup: come creare applicazioni Big Data in modalità Server...
Big Data per le Startup: come creare applicazioni Big Data in modalità Server...Big Data per le Startup: come creare applicazioni Big Data in modalità Server...
Big Data per le Startup: come creare applicazioni Big Data in modalità Server...
 
Esegui pod serverless con Amazon EKS e AWS Fargate
Esegui pod serverless con Amazon EKS e AWS FargateEsegui pod serverless con Amazon EKS e AWS Fargate
Esegui pod serverless con Amazon EKS e AWS Fargate
 
Costruire Applicazioni Moderne con AWS
Costruire Applicazioni Moderne con AWSCostruire Applicazioni Moderne con AWS
Costruire Applicazioni Moderne con AWS
 
Come spendere fino al 90% in meno con i container e le istanze spot
Come spendere fino al 90% in meno con i container e le istanze spot Come spendere fino al 90% in meno con i container e le istanze spot
Come spendere fino al 90% in meno con i container e le istanze spot
 
Open banking as a service
Open banking as a serviceOpen banking as a service
Open banking as a service
 
Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...
Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...
Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...
 
OpsWorks Configuration Management: automatizza la gestione e i deployment del...
OpsWorks Configuration Management: automatizza la gestione e i deployment del...OpsWorks Configuration Management: automatizza la gestione e i deployment del...
OpsWorks Configuration Management: automatizza la gestione e i deployment del...
 
Microsoft Active Directory su AWS per supportare i tuoi Windows Workloads
Microsoft Active Directory su AWS per supportare i tuoi Windows WorkloadsMicrosoft Active Directory su AWS per supportare i tuoi Windows Workloads
Microsoft Active Directory su AWS per supportare i tuoi Windows Workloads
 
Computer Vision con AWS
Computer Vision con AWSComputer Vision con AWS
Computer Vision con AWS
 
Database Oracle e VMware Cloud on AWS i miti da sfatare
Database Oracle e VMware Cloud on AWS i miti da sfatareDatabase Oracle e VMware Cloud on AWS i miti da sfatare
Database Oracle e VMware Cloud on AWS i miti da sfatare
 
Crea la tua prima serverless ledger-based app con QLDB e NodeJS
Crea la tua prima serverless ledger-based app con QLDB e NodeJSCrea la tua prima serverless ledger-based app con QLDB e NodeJS
Crea la tua prima serverless ledger-based app con QLDB e NodeJS
 
API moderne real-time per applicazioni mobili e web
API moderne real-time per applicazioni mobili e webAPI moderne real-time per applicazioni mobili e web
API moderne real-time per applicazioni mobili e web
 
Database Oracle e VMware Cloud™ on AWS: i miti da sfatare
Database Oracle e VMware Cloud™ on AWS: i miti da sfatareDatabase Oracle e VMware Cloud™ on AWS: i miti da sfatare
Database Oracle e VMware Cloud™ on AWS: i miti da sfatare
 
Tools for building your MVP on AWS
Tools for building your MVP on AWSTools for building your MVP on AWS
Tools for building your MVP on AWS
 
How to Build a Winning Pitch Deck
How to Build a Winning Pitch DeckHow to Build a Winning Pitch Deck
How to Build a Winning Pitch Deck
 
Building a web application without servers
Building a web application without serversBuilding a web application without servers
Building a web application without servers
 
Fundraising Essentials
Fundraising EssentialsFundraising Essentials
Fundraising Essentials
 
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...AWS_HK_StartupDay_Building Interactive websites while automating for efficien...
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...
 
Introduzione a Amazon Elastic Container Service
Introduzione a Amazon Elastic Container ServiceIntroduzione a Amazon Elastic Container Service
Introduzione a Amazon Elastic Container Service
 

Make Your Data Move: Best Practices for Migrating Data to AWS

  • 1. P U B L I C S E C T O R S U M M I T Washingt on, DC
  • 2. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.P U B L I C S E C T O R S U M M I T Make Your Data Move: Best Practices for Migrating Data to AWS Chris Rogers Business Development Manager Global Storage BD Team AWS 3 2 2 0 7 3
  • 3. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.P U B L I C S E C T O R S U M M I T Related breakouts 316002: Hybrid Solutions at the Edge – Go Global Faster, Efficiently, and More Securely using AWS Cloud in a Hybrid Environment Tom Creighton, Mike Norton, Tarshia Weldon 317945: Hybrid Data Storage made Easier with AWS Storage Gateway Bhavin Patel, AWS 295440: Improving Information and Communications in a Disaster Scenario with AWS Snowball Edge Joe Flasher, AWS
  • 4. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.P U B L I C S E C T O R S U M M I T Agenda • Key questions to consider • AWS Transfer for SFTP & Demo • AWS Snowball • AWS DataSync & Demo • Wrap-Up
  • 5. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.P U B L I C S E C T O R S U M M I T As more and more critical workloads move to the cloud… AWS …you need to move increasingly large datasets along with them
  • 6. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.P U B L I C S E C T O R S U M M I T Key questions for data migration Why are you and your teams moving data to the cloud? What datasets are you moving? Where will you move your data? When do you need the data to be available? How much available network bandwidth? The efficiency of your migration depends on all of the above
  • 7. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.P U B L I C S E C T O R S U M M I T Why are you moving data to AWS? Data Center Consolidation Digital Transformation Cost Reduction Large-Scale Compute- Intensive Workloads Facility or Real Estate Decisions Colocation or Outsourcing Contract Changes Agility/Dev Productivity Acquisitions or Divestitures
  • 8. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.P U B L I C S E C T O R S U M M I T Where to put your data? Amazon Elastic Block Store (Amazon EBS) Amazon Simple Storage Service (Amazon S3) Amazon Glacier Data movement OnlineOffline AWS Snow family AWS Storage Gateway family AWS Direct Connect AWS DataSync Amazon S3 Transfer Acceleration Storage partners AWS Transfer for SFTP Amazon Kinesis Data Streams, Video Streams, & Firehose Amazon Elastic File System (Amazon EFS) Databases Amazon RDS Amazon Aurora Amazon Redshift Amazon DynamoDB Amazon Elasticache Amazon QLDB Amazon Neptune Amazon Timestream Amazon DocumentDB AWS Database Migration Service CloudEndure
  • 9. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.P U B L I C S E C T O R S U M M I T When do you need your data? 100 Mbps 1 Gbps 10 Gbps 1 TB 30 hrs. 3 hrs. 18 min. 10 TB 12 days 30 hrs. 3 hrs. 100 TB 124 days 12 days 30 hrs. 1 PB 3 yrs. 124 days 12 days 10 PB 34 yrs. 3 yrs. 124 days (assumes ~25% network overhead) Usable network bandwidth
  • 10. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.P U B L I C S E C T O R S U M M I T How can you get your data to AWS? Online data transfer Hybrid storage Offline data transfer Edge locations for S3-enabled applications Online transfer of active data AWS DataSync Managed file transfers into Amazon S3 AWS Transfer for SFTP Load streaming data into Amazon S3 Amazon Kinesis Data Firehose Ship static data into and out of Amazon S3 AWS Snowball Storage and compute in disconnected environments AWS Snowball Edge Access AWS storage from on-premises AWS Storage Gateway S3 Transfer Acceleration
  • 11. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.P U B L I C S E C T O R S U M M I T
  • 12. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.P U B L I C S E C T O R S U M M I T SFTP workflows Receive third-party uploads Distributed value-added data Transfer data internally Financial services $ Retail Healthcare ..and more SFTP is deeply embedded in workflows across a variety of industries
  • 13. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.P U B L I C S E C T O R S U M M I T What is Transfer for SFTP Fully-managed SFTP service enabling transfer of data into Amazon S3 Secure and compliant SimpleFully managed in AWSSeamless migration of existing SFTP workflows Cost-effective Native integration with AWS services
  • 14. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.P U B L I C S E C T O R S U M M I T How AWS Transfer for SFTP works Fully managed, highly available, service provides secure access to data in customer’s S3 bucket No change to existing clients. Seamlessly use Transfer for SFTP to securely move SFTP workloads to AWS Amazon S3 bucket Customer’s IDP VPC LambdaAPIG AWS Cloud AWS Transfer for SFTP SFTP Users & Clients
  • 15. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.P U B L I C S E C T O R S U M M I T
  • 16. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.P U B L I C S E C T O R S U M M I T SFTP: 3 Simple Steps Your users can now use your AWS SFTP server endpoint to transfer data Map/create your hostname Select your S3 bucket Set up your users 1 2 3 Associate your hostname with the server endpoint Create an IAM role to access the Amazon S3 buckets used for storing data transferred over SFTP Create and map users to IAM roles to enable them for file operations
  • 17. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.P U B L I C S E C T O R S U M M I T
  • 18. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.P U B L I C S E C T O R S U M M I T Where is edge computing happening? Research Industrial Healthcare Transportation Military
  • 19. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.P U B L I C S E C T O R S U M M I T AWS Snowball AWS Snowball Edge AWS Snowmobile • 50 or 80TB storage capacity • 10GE networking • Data encryption end-to-end • Chain of Custody, Tamper Detection • Rugged 8.5 G impact case • Rain and dust resistant • Amazon S3 Data Import • Small file Batching • Snowball command line • S3 Adapter runs on workstation • 42/100TB storage capacity (s3) • 10/25/40GE networking • Data encryption end-to-end • Rugged 8.5 G impact case • Chain of Custody, Tamper Detection • Rain and dust resistant • Amazon S3 Data import • NFSv4 Server • Clustering • AWS IOT Greengrass • EC2/AMI support for edge computing • GPU options • Exabyte-scale storage in a 45ft container (90PB s3/Glacier/EBS) • 10/25/40GE networking • Data encryption end-to-end • S3/Glacier Data import • Dedicated security personnel • GPS tracking, alarm monitoring, 24/7 surveillance, and optional additional security Data Transfer Only Data Transfer & Edge Compute 20+ PB Data Transfer AWS Snow Family Portfolio
  • 20. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.P U B L I C S E C T O R S U M M I T Create a job Connect the Snowball / Snowball Edge Copy & Process Data on device Your data is loaded into your bucket! Snowball and Snowball Edge import workflow Job created Job completed Job Provisioned At AWS Region In transit Delivered to you Sent to AWS Ingest to AWS 1 – 3 Days 1-N Days1-N Days (file transfer speed dependent)1 – 2 Days 1 – 2 Days +
  • 21. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.P U B L I C S E C T O R S U M M I T
  • 22. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.P U B L I C S E C T O R S U M M I T What is AWS DataSync? Transfers up to 10 Gbps per agent Cost effective Combines the speed and reliability of network acceleration software with the cost-effectiveness of open-source tools Simple data movement to S3 or EFS Secure and reliable Cloud integrated AWS Online transfer service that simplifies, automates, and accelerates moving data between on-premises storage and AWS
  • 23. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.P U B L I C S E C T O R S U M M I T DataSync & GovCloud Launch • AWS DataSync is now available in the AWS GovCloud (US-West) Region • Securely copy sensitive data between your sites and the AWS GovCloud (US-West) Region • AWS DataSync is available in the following regions: • AWS GovCloud (US-West) • US East (Northern Virginia and Ohio) • US West (Northern California and Oregon) • Europe (Ireland and Frankfurt) • Asia Pacific (Singapore, Tokyo, Sydney, and Seoul)
  • 24. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.P U B L I C S E C T O R S U M M I T Shared file system NFS TLS How AWS DataSync works On-Premises Amazon S3 bucket AWS Storage resources Agent deployed on VMware or EC2 for efficient access to local NFS server Region AWS DataSync agent Highly parallel transfers using optimized network protocol Optimized to read and writes to S3 and EFS using IAM/VPCE Fully-managed service scales to send or receive data from agent AWS DataSync Amazon Elastic File System
  • 25. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.P U B L I C S E C T O R S U M M I T As simple as 1-2-3... Deploy on-premises agent and connect to your AWS account Create a task by configuring storage locations and options Start the task and monitor progress 1 2 3 VMware ESXi 4 vCPU 32 GB memory On-premises NFS file systems, S3 buckets, or EFS file systems Monitor in the console or through Amazon CloudWatch
  • 26. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.P U B L I C S E C T O R S U M M I T DataSync Management, Monitoring and Compliance Cloud integrated AWS Monitor with Amazon CloudWatch Detailed CloudWatch Logs track data movement Control and audit usage with AWS Identity and Access Management (IAM) and AWS CloudTrail PCI-DSS compliant and HIPAA eligible
  • 27. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.P U B L I C S E C T O R S U M M I T
  • 28. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.P U B L I C S E C T O R S U M M I T DataSync demo Region (Simulating on-prem infra) Availability zone Region • Start with on-premises infrastructure • NFS Storage • a web server • a desktop us-west-1 us-east-2 NFS StorageEnd User Desktop Web Server
  • 29. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.P U B L I C S E C T O R S U M M I T DataSync demo Region (Simulating on-prem infra) Availability zone S3 Bucket (hybrid-demo-ohio) Region NFS Storage Using DataSync we will migrate the webserver content to S3 (preserving posix permissions) us-west-1 us-east-2 DataSync agent AWS DataSync Service End User Desktop Web Server
  • 30. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.P U B L I C S E C T O R S U M M I T Remember the 4 “W”s (and 1 “H”) Why? What? Where? When? How?
  • 31. Thank you! © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.P U B L I C S E C T O R S U M M I T Chris Rogers chrisrg@amazon.com
  • 32. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.P U B L I C S E C T O R S U M M I T