Choosing the Right Data Storage Solution

•

2 gefällt mir•877 views

Amazon Web Services

Technologie Business

CHOOSING THE RIGHT
DATA STORAGE
SOLUTION
Carlos Conde │Solutions Architect

1. STATIC STORAGE
2. FILESYSTEMS
3. SYNC VOLUMES
4. RELATIONAL DATABASES
5. NoSQL DATABASES

ORACLE
SECURE BACKUP MODULE
ORACLE RMAN  AMAZON S3

USE AMAZON S3
WHEN YOU NEED:
 Unlimited storage capacity
 High durability
 Storage for backups

 Web access to data
+ Amazon CloudFront

USE AMAZON EBS
WHEN YOU NEED:
 Filesystem for an instance
NTFS, ExtFS, RAID, LVM…

 Long-term persistent storage
 Data changes frequently
 Access to raw, unformatted
block-level storage

VM IMPORT/EXPORT
Easily import VM images to Amazon EC2 instances and export
them back to your environment

USE AWS STORAGE GATEWAY
WHEN YOU NEED:

 Backup your data
 Synchronize data for disaster
recovery
 Export data for migration

WHAT ABOUT…

 BACKUPS?
 SCALING?
 UPDATES?
 MONITORING?
 REPLICATION?

READ REPLICAS
READ-ONLY ASYNCHRONOUS REPLICA

RDS MULTI-AZ
STAND-BY SYNCHRONOUS REPLICA

USE AMAZON RDS
WHEN YOU NEED:
 Relational database engine
(MySQL, SQLServer, Oracle)
 Peace of mind about your data

 More time!

The scalability challenge

Requirement: predictable, consistent
performance
Performance

Hardware provisioning
Data sharding
Data caching
Cluster management
Reality: performance
degrades with scale Fault management

Scalability

AMAZON DYNAMODB
HIGH-PERFORMANCE, FULLY MANAGED NoSQL
DATABASE SERVICE

LOW LATENCY
AVERAGE READS < 5MS,
WRITES < 10MS

SEAMLESS SCALABILITY
NO TABLE SIZE OR THROUGHPUT LIMITS
LIVE REPARTITIONING

PREDICTABLE
PERFORMANCE
PROVISIONED THROUGHPUT MODEL

DURABLE & AVAILABLE
CONSISTENT, DISK-ONLY WRITES (SSD)

USE AMAZON DYNAMODB
WHEN YOU NEED:
 Low latency on R/W operations
+ Scalability
+ Data durability
 Predictable performance

IT’S ALL ABOUT

CHOICE
PERFORMANCE-ORIENTED
COST-ORIENTED

Choosing the Right Data Storage Solution

Empfohlen

IMC Summit 2016 Breakout - Per Minoborg - Work with Multiple Hot Terabytes in...In-Memory Computing Summit

Running MySQL in AWSLaine Campbell

How MariaDB is approaching DBaaSMariaDB plc

Ebay: DB Capacity planning at eBayDataStax Academy

IMC Summit 2016 Breakout - Pandurang Naik - Demystifying In-Memory Data Grid,...In-Memory Computing Summit

How QBerg scaled to store data longer, query it fasterMariaDB plc

SAS Institute on Changing All Four Tires While Driving an AdTech Engine at Fu...ScyllaDB

Scylla Summit 2022: How ScyllaDB Powers This Next Tech CycleScyllaDB

Empfohlen

IMC Summit 2016 Breakout - Per Minoborg - Work with Multiple Hot Terabytes in...In-Memory Computing Summit

Running MySQL in AWSLaine Campbell

How MariaDB is approaching DBaaSMariaDB plc

Ebay: DB Capacity planning at eBayDataStax Academy

IMC Summit 2016 Breakout - Pandurang Naik - Demystifying In-Memory Data Grid,...In-Memory Computing Summit

How QBerg scaled to store data longer, query it fasterMariaDB plc

SAS Institute on Changing All Four Tires While Driving an AdTech Engine at Fu...ScyllaDB

Scylla Summit 2022: How ScyllaDB Powers This Next Tech CycleScyllaDB

Cisco: Cassandra adoption on Cisco UCS & OpenStackDataStax Academy

How Workload Prioritization Reduces Your Datacenter FootprintScyllaDB

Cassandra Summit 2014: Apache Cassandra Best Practices at EbayDataStax Academy

How to Secure Your Scylla Deployment: Authorization, Encryption, LDAP Authent...ScyllaDB

Global Data Replication with Galera for Ansell Guardian®MariaDB plc

Scylla Summit 2022: Migrating SQL Schemas for ScyllaDB: Data Modeling Best Pr...ScyllaDB

GPS Insight on Using Presto with Scylla for Data Analytics and Data ArchivalScyllaDB

How we switched to columnar at SpendHQMariaDB plc

ClustrixDB: how distributed databases scale outMariaDB plc

Configuring workload-based storage and topologiesMariaDB plc

Cassandra vs Databases Anant Corporation

iFood on Delivering 100 Million Events a Month to Restaurants with ScyllaScyllaDB

Writing powerful stored procedures in PL/SQLMariaDB plc

MySQL infra readiness-for-peak-sale-events - Kabilesh PR (Co-Founder of Mydbops)Mydbops

Building Data Pipelines with SMACK: Designing Storage Strategies for Scale an...DataStax

How to size up an Apache Cassandra cluster (Training)DataStax Academy

Running Cassandra on Amazon EC2Dave Gardner

Free & Open DynamoDB API for EveryoneScyllaDB

Databases on aws part 2Parag Patil

Cassandra Pooja GV

AWS Procuring Services for Public Sector - PetersonAmazon Web Services

RMG206 Introduction to Amazon Elastic Beanstalk - AWS re: Invent 2012Amazon Web Services

Weitere ähnliche Inhalte

Was ist angesagt?

Cisco: Cassandra adoption on Cisco UCS & OpenStackDataStax Academy

How Workload Prioritization Reduces Your Datacenter FootprintScyllaDB

Cassandra Summit 2014: Apache Cassandra Best Practices at EbayDataStax Academy

How to Secure Your Scylla Deployment: Authorization, Encryption, LDAP Authent...ScyllaDB

Global Data Replication with Galera for Ansell Guardian®MariaDB plc

Scylla Summit 2022: Migrating SQL Schemas for ScyllaDB: Data Modeling Best Pr...ScyllaDB

GPS Insight on Using Presto with Scylla for Data Analytics and Data ArchivalScyllaDB

How we switched to columnar at SpendHQMariaDB plc

ClustrixDB: how distributed databases scale outMariaDB plc

Configuring workload-based storage and topologiesMariaDB plc

Cassandra vs Databases Anant Corporation

iFood on Delivering 100 Million Events a Month to Restaurants with ScyllaScyllaDB

Writing powerful stored procedures in PL/SQLMariaDB plc

MySQL infra readiness-for-peak-sale-events - Kabilesh PR (Co-Founder of Mydbops)Mydbops

Building Data Pipelines with SMACK: Designing Storage Strategies for Scale an...DataStax

How to size up an Apache Cassandra cluster (Training)DataStax Academy

Running Cassandra on Amazon EC2Dave Gardner

Free & Open DynamoDB API for EveryoneScyllaDB

Databases on aws part 2Parag Patil

Cassandra Pooja GV

Was ist angesagt? (20)

Cisco: Cassandra adoption on Cisco UCS & OpenStack

How Workload Prioritization Reduces Your Datacenter Footprint

Cassandra Summit 2014: Apache Cassandra Best Practices at Ebay

How to Secure Your Scylla Deployment: Authorization, Encryption, LDAP Authent...

Global Data Replication with Galera for Ansell Guardian®

Scylla Summit 2022: Migrating SQL Schemas for ScyllaDB: Data Modeling Best Pr...

GPS Insight on Using Presto with Scylla for Data Analytics and Data Archival

How we switched to columnar at SpendHQ

ClustrixDB: how distributed databases scale out

Configuring workload-based storage and topologies

Cassandra vs Databases

iFood on Delivering 100 Million Events a Month to Restaurants with Scylla

Writing powerful stored procedures in PL/SQL

MySQL infra readiness-for-peak-sale-events - Kabilesh PR (Co-Founder of Mydbops)

Building Data Pipelines with SMACK: Designing Storage Strategies for Scale an...

How to size up an Apache Cassandra cluster (Training)

Running Cassandra on Amazon EC2

Free & Open DynamoDB API for Everyone

Databases on aws part 2

Cassandra

Andere mochten auch

AWS Procuring Services for Public Sector - PetersonAmazon Web Services

RMG206 Introduction to Amazon Elastic Beanstalk - AWS re: Invent 2012Amazon Web Services

News Limited Keynote - Craige Prendleton-Browne - AWS Summit 2012 AustraliaAmazon Web Services

Etendez votre datacenter avec aws v4Amazon Web Services

AWS Customer Presentation: 6Wunderkind - Berlin Summit 2012Amazon Web Services

AWS Update | London - Reserved Instance MarketplaceAmazon Web Services

SEC202 Federal Government Compliance Best Practices in the Cloud - AWS re: …Amazon Web Services

CPN204 Windows on Amazon EC2 – Top ten things - AWS re: Invent 2012Amazon Web Services

Utility Supercomputing on AWS - StoweAmazon Web Services

Developing for Your Target Market - Social, Games & Mobile - AWS India Summit...Amazon Web Services

Managing Your Cloud Assets with AWSAmazon Web Services

STP204 Pinterest Pins AWS! Running Lean on AWS Once You've Made It - AWS re: ...Amazon Web Services

STG303 Building Scalable Applications on Amazon S3 - AWS re: Invent 2012Amazon Web Services

RMG207 Introduction to AWS CloudFormation - AWS re: Invent 2012Amazon Web Services

ARC302 AWS Cloud Design Patterns - AWS re: Invent 2012Amazon Web Services

AWS Partner Presentation – Panzura – AWS Cloud Storage for the Enterprise 2012Amazon Web Services

Andere mochten auch (16)

AWS Procuring Services for Public Sector - Peterson

RMG206 Introduction to Amazon Elastic Beanstalk - AWS re: Invent 2012

News Limited Keynote - Craige Prendleton-Browne - AWS Summit 2012 Australia

Etendez votre datacenter avec aws v4

AWS Customer Presentation: 6Wunderkind - Berlin Summit 2012

AWS Update | London - Reserved Instance Marketplace

SEC202 Federal Government Compliance Best Practices in the Cloud - AWS re: …

CPN204 Windows on Amazon EC2 – Top ten things - AWS re: Invent 2012

Utility Supercomputing on AWS - Stowe

Developing for Your Target Market - Social, Games & Mobile - AWS India Summit...

Managing Your Cloud Assets with AWS

STP204 Pinterest Pins AWS! Running Lean on AWS Once You've Made It - AWS re: ...

STG303 Building Scalable Applications on Amazon S3 - AWS re: Invent 2012

RMG207 Introduction to AWS CloudFormation - AWS re: Invent 2012

ARC302 AWS Cloud Design Patterns - AWS re: Invent 2012

AWS Partner Presentation – Panzura – AWS Cloud Storage for the Enterprise 2012

Ähnlich wie Choosing the Right Data Storage Solution

Choosing the Right Data Storage - Carlos Conde - AWS Summit ParisAmazon Web Services

Amazon RDS with Amazon Aurora | AWS Public Sector Summit 2016Amazon Web Services

RDS Postgres and Aurora Postgres | AWS Public Sector Summit 2017Amazon Web Services

Getting Started with Managed Database Services on AWSAmazon Web Services

Enterprise Storage NAS - Dual ControllerFernando Barrientos

Getting Started with Managed Database Services on AWSAmazon Web Services

(DAT202) Managed Database Options on AWSAmazon Web Services

Introduction to Database ServicesAmazon Web Services

What’s new in Amazon RDS - ADB207 - Chicago AWS SummitAmazon Web Services

What's new in Amazon RDS - ADB206 - New York AWS SummitAmazon Web Services

2017 AWS DB Day | AWS 데이터베이스 개요 - 나의 업무에 적합한 데이터베이스는?Amazon Web Services Korea

Intro to AWS: Database ServicesAmazon Web Services

Leveraging ApsaraDB to Deploy Business Data on the CloudOliver Theobald

How to Leverage ApsaraDB to Deploy Business Data on the CloudAlibaba Cloud

Intro to AWS: Database ServicesAmazon Web Services

Soluzioni di Database completamente gestite: NoSQL, relazionali e Data WarehouseAmazon Web Services

(DAT312) Using Amazon Aurora for Enterprise WorkloadsAmazon Web Services

AWS re:Invent 2016: Workshop: Stretching Scalability: Doing more with Amazon ...Amazon Web Services

Amazon AuroraAmazon Web Services

Ähnlich wie Choosing the Right Data Storage Solution (20)

Choosing the Right Data Storage - Carlos Conde - AWS Summit Paris

Amazon RDS with Amazon Aurora | AWS Public Sector Summit 2016

RDS Postgres and Aurora Postgres | AWS Public Sector Summit 2017

Getting Started with Managed Database Services on AWS

Enterprise Storage NAS - Dual Controller

Getting Started with Managed Database Services on AWS

(DAT202) Managed Database Options on AWS

Introduction to Database Services

What’s new in Amazon RDS - ADB207 - Chicago AWS Summit

What's new in Amazon RDS - ADB206 - New York AWS Summit

2017 AWS DB Day | AWS 데이터베이스 개요 - 나의 업무에 적합한 데이터베이스는?

Intro to AWS: Database Services

Leveraging ApsaraDB to Deploy Business Data on the Cloud

How to Leverage ApsaraDB to Deploy Business Data on the Cloud

Intro to AWS: Database Services

Soluzioni di Database completamente gestite: NoSQL, relazionali e Data Warehouse

(DAT312) Using Amazon Aurora for Enterprise Workloads

AWS re:Invent 2016: Workshop: Stretching Scalability: Doing more with Amazon ...

Amazon Aurora

Mehr von Amazon Web Services

Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...Amazon Web Services

Big Data per le Startup: come creare applicazioni Big Data in modalità Server...Amazon Web Services

Esegui pod serverless con Amazon EKS e AWS FargateAmazon Web Services

Costruire Applicazioni Moderne con AWSAmazon Web Services

Come spendere fino al 90% in meno con i container e le istanze spot Amazon Web Services

Open banking as a serviceAmazon Web Services

Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...Amazon Web Services

OpsWorks Configuration Management: automatizza la gestione e i deployment del...Amazon Web Services

Microsoft Active Directory su AWS per supportare i tuoi Windows WorkloadsAmazon Web Services

Computer Vision con AWSAmazon Web Services

Database Oracle e VMware Cloud on AWS i miti da sfatareAmazon Web Services

Crea la tua prima serverless ledger-based app con QLDB e NodeJSAmazon Web Services

API moderne real-time per applicazioni mobili e webAmazon Web Services

Database Oracle e VMware Cloud™ on AWS: i miti da sfatareAmazon Web Services

Tools for building your MVP on AWSAmazon Web Services

How to Build a Winning Pitch DeckAmazon Web Services

Building a web application without serversAmazon Web Services

Fundraising EssentialsAmazon Web Services

AWS_HK_StartupDay_Building Interactive websites while automating for efficien...Amazon Web Services

Introduzione a Amazon Elastic Container ServiceAmazon Web Services

Mehr von Amazon Web Services (20)

Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...

Big Data per le Startup: come creare applicazioni Big Data in modalità Server...

Esegui pod serverless con Amazon EKS e AWS Fargate

Costruire Applicazioni Moderne con AWS

Come spendere fino al 90% in meno con i container e le istanze spot

Open banking as a service

Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...

OpsWorks Configuration Management: automatizza la gestione e i deployment del...

Microsoft Active Directory su AWS per supportare i tuoi Windows Workloads

Computer Vision con AWS

Database Oracle e VMware Cloud on AWS i miti da sfatare

Crea la tua prima serverless ledger-based app con QLDB e NodeJS

API moderne real-time per applicazioni mobili e web

Database Oracle e VMware Cloud™ on AWS: i miti da sfatare

Tools for building your MVP on AWS

How to Build a Winning Pitch Deck

Building a web application without servers

Fundraising Essentials

AWS_HK_StartupDay_Building Interactive websites while automating for efficien...

Introduzione a Amazon Elastic Container Service

Kürzlich hochgeladen

Driving Behavioral Change for Information Management through Data-Driven Gree...Enterprise Knowledge

The 7 Things I Know About Cyber Security After 25 Years | April 2024Rafal Los

08448380779 Call Girls In Friends Colony Women Seeking MenDelhi Call girls

Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...Igalia

Slack Application Development 101 Slidespraypatel2

08448380779 Call Girls In Diplomatic Enclave Women Seeking MenDelhi Call girls

Artificial Intelligence: Facts and MythsJoaquim Jorge

Data Cloud, More than a CDP by Matt RobisonAnna Loughnan Colquhoun

Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...Drew Madelung

GenCyber Cyber Security Day PresentationMichael W. Hawkins

08448380779 Call Girls In Greater Kailash - I Women Seeking MenDelhi Call girls

Powerful Google developer tools for immediate impact! (2023-24 C)wesley chun

🐬 The future of MySQL is Postgres 🐘RTylerCroy

Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...apidays

Real Time Object Detection Using Open CVKhem

Breaking the Kubernetes Kill Chain: Host Path MountPuma Security, LLC

Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024The Digital Insurer

Exploring the Future Potential of AI-Enabled Smartphone Processorsdebabhi2

04-2024-HHUG-Sales-and-Marketing-Alignment.pptxHampshireHUG

Handwritten Text Recognition for manuscripts and early printed textsMaria Levchenko

Kürzlich hochgeladen (20)

Driving Behavioral Change for Information Management through Data-Driven Gree...

The 7 Things I Know About Cyber Security After 25 Years | April 2024

08448380779 Call Girls In Friends Colony Women Seeking Men

Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...

Slack Application Development 101 Slides

08448380779 Call Girls In Diplomatic Enclave Women Seeking Men

Artificial Intelligence: Facts and Myths

Data Cloud, More than a CDP by Matt Robison

Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...

GenCyber Cyber Security Day Presentation

08448380779 Call Girls In Greater Kailash - I Women Seeking Men

Powerful Google developer tools for immediate impact! (2023-24 C)

🐬 The future of MySQL is Postgres 🐘

Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...

Real Time Object Detection Using Open CV

Breaking the Kubernetes Kill Chain: Host Path Mount

Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024

Exploring the Future Potential of AI-Enabled Smartphone Processors

04-2024-HHUG-Sales-and-Marketing-Alignment.pptx

Handwritten Text Recognition for manuscripts and early printed texts

Choosing the Right Data Storage Solution

1. CHOOSING THE RIGHT DATA STORAGE SOLUTION Carlos Conde │Solutions Architect

2. 1. STATIC STORAGE 2. FILESYSTEMS 3. SYNC VOLUMES 4. RELATIONAL DATABASES 5. NoSQL DATABASES

3. # 1 STATIC STORAGE ●○○○○

4. We are constantly producing more data

5. AMAZON S3 SIMPLE STORAGE SERVICE

10. 99.999999999% DURABILITY

11. ORACLE SECURE BACKUP MODULE ORACLE RMAN  AMAZON S3

12.

13. USE AMAZON S3 WHEN YOU NEED:  Unlimited storage capacity  High durability  Storage for backups  Web access to data + Amazon CloudFront

14. # 2 FILESYSTEMS ●●○○○

15. EPHEMERAL STORAGE

16. AMAZON EBS ELASTIC BLOCK STORAGE

17. 10GB  TB

18.

19.

20.

21. EBS SNAPSHOTS

22.

23. USE AMAZON EBS WHEN YOU NEED:  Filesystem for an instance NTFS, ExtFS, RAID, LVM…  Long-term persistent storage  Data changes frequently  Access to raw, unformatted block-level storage

24. # 3 SYNC VOLUMES ●●●○○

25. BACKUP MANAGEMENT

26. AWS STORAGE GATEWAY

27.

28.

29. VM IMPORT/EXPORT Easily import VM images to Amazon EC2 instances and export them back to your environment

30.

31.

32.

33. USE AWS STORAGE GATEWAY WHEN YOU NEED:  Backup your data  Synchronize data for disaster recovery  Export data for migration

34. # 4 RELATIONAL DATABASES ●●●●○

35.

36. WHAT ABOUT…  BACKUPS?  SCALING?  UPDATES?  MONITORING?  REPLICATION?

37. AMAZON RDS RELATIONAL DATABASE SERVICE

38.

39.

40.

41.

42.

43. BACKUPS & SNAPSHOTS

44.

45.

46.

47. READ REPLICAS READ-ONLY ASYNCHRONOUS REPLICA

48.

49.

50.

51. RDS MULTI-AZ STAND-BY SYNCHRONOUS REPLICA

52.

53.

54. USE AMAZON RDS WHEN YOU NEED:  Relational database engine (MySQL, SQLServer, Oracle)  Peace of mind about your data  More time!

55. # 5 NoSQL DATABASES ●●●●●

56.

57. The scalability challenge Requirement: predictable, consistent performance Performance Hardware provisioning Data sharding Data caching Cluster management Reality: performance degrades with scale Fault management Scalability

58. AMAZON DYNAMODB HIGH-PERFORMANCE, FULLY MANAGED NoSQL DATABASE SERVICE

59. LOW LATENCY AVERAGE READS < 5MS, WRITES < 10MS

60. SEAMLESS SCALABILITY NO TABLE SIZE OR THROUGHPUT LIMITS LIVE REPARTITIONING

61. PREDICTABLE PERFORMANCE PROVISIONED THROUGHPUT MODEL

62. DURABLE & AVAILABLE CONSISTENT, DISK-ONLY WRITES (SSD)

63. ZERO ADMINISTRATION

64.

65.

66.

67. USE AMAZON DYNAMODB WHEN YOU NEED:  Low latency on R/W operations + Scalability + Data durability  Predictable performance

68. 1. STATIC STORAGE 2. FILESYSTEMS 3. SYNC VOLUMES 4. RELATIONAL DATABASES 5. NoSQL DATABASES

69.

70. IT’S ALL ABOUT CHOICE PERFORMANCE-ORIENTED COST-ORIENTED