SlideShare ist ein Scribd-Unternehmen logo
1 von 23
Downloaden Sie, um offline zu lesen
Miguel Rojas
Cloud Architect EMEA
Portworx by Pure Storage
mrojas@purestorage.com
@portworx
@purestorage
Delivering a Kubernetes data
platform with Portworx
©
2022 Pure Storage 2
Kubernetes,
Containers
and
Companies
What’s your story?
Founded
2014
‘15 ‘20
‘17
A little history
3
©
2022 Pure Storage, Inc.
Cloud Native is driven by Kubernetes adoption
OF NEW APPS
are developed in
containers.
95% OF ENTERPRISES
81%
OF CNCF MEMBERS
78%
use Kubernetes in
production.
work with 2+ public
cloud providers.
OF GLOBAL BUSINESSES
85%
will be running containers in
production by 2025
(up from 35% in 2019).
Source: CNCF Survey 2021
4
©
2022 Pure Storage, Inc.
The Kubernetes stack has room to mature
Which areas of the Kubernetes tech stack need to mature the most to
make it easier to deploy cloud-native apps?
Source: Kubernetes Adoption Survey 2021 - Portworx
Ranked top three
Application
development
frameworks
Storage and
data
management
Monitoring
and
observability
Networking Orchestration
and
management
75% 68% 57% 54% 46%
5
©
2022 Pure Storage, Inc.
Connector Approach to Container-Native
Two approaches common in the industry today…
Container-Native Storage Approach
”Connector” Approach
Storage Array
1
Storage Array
2
CSI
• 1:1 container <> volume mapping
• Container capabilities vary depending on the capabilities of the
underlying array
• Storage arrays often are challenged by the object count (#
volumes, connections) and change rate (10,000s changes/day)
• Innovation limited to the features in the open CSI specification
• Storage arrays managed independently from K8s
Storage
Array
Local
SSDs/HDDs
Storage Pool
Cloud
Storage
• Many (1,000s):1 container <> volume mapping
• Designed to scale to 10,000s operations/day
• Ensures consistent storage services across ANY infrastructure
• Storage services container-granular and application consistent
• Storage “encapsulated” in a container-native virtual volume that
is free to move with the container
• Managed as a native part of K8s
Pure PSO
NetApp
Dell
6
©
2022 Pure Storage, Inc.
Kubernetes key attributes
MASSIVE-SCALE
KUBERNETES-NATIVE
PLUGGABLE
ARCHITECTURE
OPTIMIZED FOR
MULTI-CLOUD WORLD
APPLICATION CENTRIC
Scales to 1,000s of nodes, 1,000s
of concurrent operations per
minute
All platform operations should be
through a consistent control plane,
the Kubernetes API
Able to offer a consistent control pane on
heterogeneous infrastructure environments
Easily swap in and out core
”infrastructure” services –
networking, storage, monitoring
Platform capabilities should be
focused on the needs of an
application first
Compute
Platform
7
©
2022 Pure Storage, Inc.
Today, Portworx Is the Leading
Kubernetes Data Services Platform
Any App Any Distribution
GKE
DATABASE ANALYTICS STREAMING SEARCH/LOG AI/ML
5G/IoT
Any Cloud Any Infrastructure
Bare Metal Pilot
Go
Live
Global
CaaS
Test/
Dev
Every Stage
The Kubernetes Data Services Platform
PX-Store PX-Secure
PX-Backup PX-DR PX-Migrate PX-Autopilot
Portworx
Data
Services
8
©
2022 Pure Storage, Inc.
What would you like to solve?
The Kubernetes Data Services Platform
PX-Store PX-Secure
PX-Backup PX-DR PX-Migrate PX-Autopilot
Storage,
Share, Scale,
Monitor
Anywhere in
K8s
Backup and
restore from,
and to,
anywhere
DR:
RTO of minutes,
Minutes RPO
Migrate or
duplicate
environments
fast
Auto-pilot
Intelligent,
performant, hyper
converged
self-service
Storage.
The Kubernetes Data Services Platform
PX-Store PX-Secure
PX-Backup PX-DR PX-Migrate PX-Autopilot
Portworx
Data
Services
Secure and
grant storage
access with
RBAC and
Integrations
DBaaS
anywhere fully
managed by
Portworx.
9
©
2022 Pure Storage, Inc.
Portworx sets the gold standard for Kubernetes Storage
Portworx named a Cloud-Native Data Storage & Enterprise Kubernetes Storage leader in 2021 GigaOm Radars
Cloud-Native Data
Storage
GigaOm Radar for Cloud-Native Data Storage for Kubernetes, 2021 GigaOm Radar for Enterprise Kubernetes Storage, 2021
Enterprise Kubernetes
Storage
10
©
2022 Pure Storage, Inc.
Use case: App and Data Migrations
Data centre 1 / Cloud 1 Data centre 2 / Cloud 2
Kubernetes 1 Kubernetes 2
OBJECT STORAGE
► Async data & object replication
► Snap restore based
► Scheduled or on-demand
► RPO 5 minutes
► RTO 5 minutes
11
©
2022 Pure Storage, Inc.
Use case: Container backup & restore
Application granular backup & restore
App 1 App 2
1. k8s objects
2. Config
3. Data
On-premises
ANY Object Storage
NFS – coming soon!
PX-Backup App 1 App 2
App 1 App 2
Second site
Cloud environment
RESTORE
RESTORE
12
©
2022 Pure Storage, Inc.
Portworx Backup
Namespace A
AWS mysql-0
Namespace B
On-Prem mongo-0
Backup Location
Schedule
Rules
Backup Location
Schedule
AWS S3-A AWS S3-B
Daily Hourly
FB S3-A FB S3-B
Weekly Monthly
Developer
User Type
App Owner
Admin
● Backup/restore
their apps
● App + namespace
granularity
Permissions
+
● Set schedules
● Set rules
● Use existing
cloud accounts
+
● Add users
● Create and share
cloud accounts &
backup locations
● Create custom
roles
Building platforms with
Portworx
14
©
2022 Pure Storage, Inc.
Operator
Kubernetes
Installing Portworx
Installing Portworx deploys an Operator to run worker nodes, not on the control plane nodes
Control plane
Worker Worker
Worker
Spec based installation HELM Package manager
15
©
2022 Pure Storage, Inc.
Installing Portworx
Local storage or SAN based storage will be used to create a virtual storage pool
SSD
SSD
LUN
SSD
SSD
LUN
SSD
SSD
LUN
Storage Pool
Worker Worker
Worker
16
©
2022 Pure Storage, Inc.
Using Portworx
Application can create Persistent Volumes from the storage pool using Persistent Volume Claims
SSD
SSD
LUN
SSD
SSD
LUN
SSD
SSD
LUN
Storage Pool
Worker Worker
Worker
Replication factor 1
Replication factor 2
Replication factor 3
50G 50G 50G
For high availability you can
mirror volumes across nodes
using a replication factor,
which can be applied to the
volume or the stroage class
17
©
2022 Pure Storage, Inc.
Respond to a node failure
Application can create Persistent Volumes from the storage pool using Persistent Volume Claims
SSD
SSD
LUN
SSD
SSD
LUN
SSD
SSD
LUN
Storage Pool
Worker Worker
Worker
50G 50G 50G
Portworx integrates with the
Kubernetes scheduler to
reschedule the Pod on a
worker with a local replica
Designing a Portworx deployment
Deployment models
19
©
2022 Pure Storage, Inc.
Standard deployment
• Single Portworx and Kubernetes cluster
• Minimum of three worker nodes
• A block storage device
Worker Worker
Worker
20
©
2022 Pure Storage, Inc.
AZ 2 AZ 3
AZ 1
Worker
Worker
Worker
Multi-zone high availability (HA)
VOL
VOL VOL
Volume replica placement
Follows K8s failure
domains
Multi-zone
Kubernetes cluster
ETCD ETCD
ETCD
Worker Worker
Worker
21
©
2022 Pure Storage, Inc.
Storage Cluster
Scale and manage storage
Compute Cluster
Scale and manage compute
PWX
PWX PWX
PWX
Portworx cluster
KVDB
VOL
VOL
VOL
VOL
Disaggregated compute and storage
PVC PVC PVC
22
©
2022 Pure Storage, Inc.
Case Study: Consumer scale for Enterprise PaaS
CHALLENGE
► Scale back-office apps responsible for T-Mobile
store experience during Apple launches
SOLUTION
► Portworx Enterprise running on-prem to provide
complete data lifecycle management- provisioning,
encryption, backup, and more.
RESULTS
► Regularly withstand the launch of new Apple
products results in dramatic spike in usage Data services used:
23
©
2022 Pure Storage, Inc.
©
2022 Pure Storage, Inc.

Weitere ähnliche Inhalte

Was ist angesagt?

Azure Security Fundamentals
Azure Security FundamentalsAzure Security Fundamentals
Azure Security FundamentalsLorenzo Barbieri
 
Microsoft Azure Platform-as-a-Service (PaaS)
Microsoft Azure Platform-as-a-Service (PaaS)Microsoft Azure Platform-as-a-Service (PaaS)
Microsoft Azure Platform-as-a-Service (PaaS)Chris Dufour
 
VMware Tanzu Introduction- June 11, 2020
VMware Tanzu Introduction- June 11, 2020VMware Tanzu Introduction- June 11, 2020
VMware Tanzu Introduction- June 11, 2020VMware Tanzu
 
Google Cloud Anthos on HPE Simplivity
Google Cloud Anthos on HPE SimplivityGoogle Cloud Anthos on HPE Simplivity
Google Cloud Anthos on HPE SimplivityTanawit Chansuchai
 
20명 규모의 팀에서 Vault 사용하기
20명 규모의 팀에서 Vault 사용하기20명 규모의 팀에서 Vault 사용하기
20명 규모의 팀에서 Vault 사용하기Doyoon Kim
 
Microsoft Azure Fundamentals
Microsoft Azure FundamentalsMicrosoft Azure Fundamentals
Microsoft Azure FundamentalsAdwait Ullal
 
Infrastructure as Code Maturity Model v1
Infrastructure as Code Maturity Model v1Infrastructure as Code Maturity Model v1
Infrastructure as Code Maturity Model v1Gary Stafford
 
Cloud Migration Cookbook: A Guide To Moving Your Apps To The Cloud
Cloud Migration Cookbook: A Guide To Moving Your Apps To The CloudCloud Migration Cookbook: A Guide To Moving Your Apps To The Cloud
Cloud Migration Cookbook: A Guide To Moving Your Apps To The CloudNew Relic
 
Cloud Architecture - Multi Cloud, Edge, On-Premise
Cloud Architecture - Multi Cloud, Edge, On-PremiseCloud Architecture - Multi Cloud, Edge, On-Premise
Cloud Architecture - Multi Cloud, Edge, On-PremiseAraf Karsh Hamid
 
Architect your app modernization journey with containers on Microsoft Azure
Architect your app modernization journey with containers on Microsoft AzureArchitect your app modernization journey with containers on Microsoft Azure
Architect your app modernization journey with containers on Microsoft AzureDavide Benvegnù
 
Red hat ansible automation technical deck
Red hat ansible automation technical deckRed hat ansible automation technical deck
Red hat ansible automation technical deckJuraj Hantak
 
AZ-204 : Implement Azure security
AZ-204 : Implement Azure securityAZ-204 : Implement Azure security
AZ-204 : Implement Azure securityAzureEzy1
 
App Modernization Pitch Deck.pptx
App Modernization Pitch Deck.pptxApp Modernization Pitch Deck.pptx
App Modernization Pitch Deck.pptxMONISH407209
 
INTERFACE by apidays 2023 - How APIs are fueling the growth of 5G and MEC
INTERFACE by apidays 2023 - How APIs are fueling the growth of 5G and MECINTERFACE by apidays 2023 - How APIs are fueling the growth of 5G and MEC
INTERFACE by apidays 2023 - How APIs are fueling the growth of 5G and MECapidays
 
VMware Tanzu Introduction
VMware Tanzu IntroductionVMware Tanzu Introduction
VMware Tanzu IntroductionVMware Tanzu
 

Was ist angesagt? (20)

Azure Security Fundamentals
Azure Security FundamentalsAzure Security Fundamentals
Azure Security Fundamentals
 
Microsoft Azure Platform-as-a-Service (PaaS)
Microsoft Azure Platform-as-a-Service (PaaS)Microsoft Azure Platform-as-a-Service (PaaS)
Microsoft Azure Platform-as-a-Service (PaaS)
 
VMware Tanzu Introduction- June 11, 2020
VMware Tanzu Introduction- June 11, 2020VMware Tanzu Introduction- June 11, 2020
VMware Tanzu Introduction- June 11, 2020
 
Cbs aws-fundamentals-1
Cbs aws-fundamentals-1Cbs aws-fundamentals-1
Cbs aws-fundamentals-1
 
Google Cloud Anthos on HPE Simplivity
Google Cloud Anthos on HPE SimplivityGoogle Cloud Anthos on HPE Simplivity
Google Cloud Anthos on HPE Simplivity
 
20명 규모의 팀에서 Vault 사용하기
20명 규모의 팀에서 Vault 사용하기20명 규모의 팀에서 Vault 사용하기
20명 규모의 팀에서 Vault 사용하기
 
AWS & Cloud Foundations
AWS & Cloud FoundationsAWS & Cloud Foundations
AWS & Cloud Foundations
 
Microsoft Azure Fundamentals
Microsoft Azure FundamentalsMicrosoft Azure Fundamentals
Microsoft Azure Fundamentals
 
Infrastructure as Code Maturity Model v1
Infrastructure as Code Maturity Model v1Infrastructure as Code Maturity Model v1
Infrastructure as Code Maturity Model v1
 
AWS WAF
AWS WAFAWS WAF
AWS WAF
 
Cloud Migration Cookbook: A Guide To Moving Your Apps To The Cloud
Cloud Migration Cookbook: A Guide To Moving Your Apps To The CloudCloud Migration Cookbook: A Guide To Moving Your Apps To The Cloud
Cloud Migration Cookbook: A Guide To Moving Your Apps To The Cloud
 
Cloud Architecture - Multi Cloud, Edge, On-Premise
Cloud Architecture - Multi Cloud, Edge, On-PremiseCloud Architecture - Multi Cloud, Edge, On-Premise
Cloud Architecture - Multi Cloud, Edge, On-Premise
 
Azure: PaaS or IaaS
Azure: PaaS or IaaSAzure: PaaS or IaaS
Azure: PaaS or IaaS
 
Architect your app modernization journey with containers on Microsoft Azure
Architect your app modernization journey with containers on Microsoft AzureArchitect your app modernization journey with containers on Microsoft Azure
Architect your app modernization journey with containers on Microsoft Azure
 
Red hat ansible automation technical deck
Red hat ansible automation technical deckRed hat ansible automation technical deck
Red hat ansible automation technical deck
 
AZ-204 : Implement Azure security
AZ-204 : Implement Azure securityAZ-204 : Implement Azure security
AZ-204 : Implement Azure security
 
Kong
KongKong
Kong
 
App Modernization Pitch Deck.pptx
App Modernization Pitch Deck.pptxApp Modernization Pitch Deck.pptx
App Modernization Pitch Deck.pptx
 
INTERFACE by apidays 2023 - How APIs are fueling the growth of 5G and MEC
INTERFACE by apidays 2023 - How APIs are fueling the growth of 5G and MECINTERFACE by apidays 2023 - How APIs are fueling the growth of 5G and MEC
INTERFACE by apidays 2023 - How APIs are fueling the growth of 5G and MEC
 
VMware Tanzu Introduction
VMware Tanzu IntroductionVMware Tanzu Introduction
VMware Tanzu Introduction
 

Ähnlich wie stackconf 2022: Data Management in Kubernetes – Backup, DR, HA

Portworx 201 Customer Deck.pptx
Portworx 201 Customer Deck.pptxPortworx 201 Customer Deck.pptx
Portworx 201 Customer Deck.pptxssuser1490e8
 
Portworx Data Services 101 Deck.pdf
Portworx Data Services 101 Deck.pdfPortworx Data Services 101 Deck.pdf
Portworx Data Services 101 Deck.pdfssuser1490e8
 
OpenShift 4, the smarter Kubernetes platform
OpenShift 4, the smarter Kubernetes platformOpenShift 4, the smarter Kubernetes platform
OpenShift 4, the smarter Kubernetes platformKangaroot
 
Leveraging HybridMultiCloud for Devops and Automation Platform
Leveraging HybridMultiCloud for Devops and Automation PlatformLeveraging HybridMultiCloud for Devops and Automation Platform
Leveraging HybridMultiCloud for Devops and Automation PlatformDevOps Indonesia
 
PSOCLD 1007 Cisco Hybrid Cloud Platform for Google Cloud
PSOCLD 1007 Cisco Hybrid Cloud Platform for Google CloudPSOCLD 1007 Cisco Hybrid Cloud Platform for Google Cloud
PSOCLD 1007 Cisco Hybrid Cloud Platform for Google CloudRohit Agarwalla
 
Overpowered Kubernetes: CI/CD for K8s on Enterprise IaaS
Overpowered Kubernetes: CI/CD for K8s on Enterprise IaaSOverpowered Kubernetes: CI/CD for K8s on Enterprise IaaS
Overpowered Kubernetes: CI/CD for K8s on Enterprise IaaSJ On The Beach
 
OpenStack and Kubernetes - A match made for Telco Heaven
OpenStack and Kubernetes - A match made for Telco HeavenOpenStack and Kubernetes - A match made for Telco Heaven
OpenStack and Kubernetes - A match made for Telco HeavenTrinath Somanchi
 
Pivotal Container Service : la nuova soluzione per gestire Kubernetes in azienda
Pivotal Container Service : la nuova soluzione per gestire Kubernetes in aziendaPivotal Container Service : la nuova soluzione per gestire Kubernetes in azienda
Pivotal Container Service : la nuova soluzione per gestire Kubernetes in aziendaVMware Tanzu
 
The ultimate Kubernetes Deployment Checklist - Infra to Microservices
The ultimate Kubernetes Deployment Checklist - Infra to MicroservicesThe ultimate Kubernetes Deployment Checklist - Infra to Microservices
The ultimate Kubernetes Deployment Checklist - Infra to MicroservicesPrakarsh -
 
SpringOne Tour: Deliver 15-Factor Applications on Kubernetes with Spring Boot
SpringOne Tour: Deliver 15-Factor Applications on Kubernetes with Spring BootSpringOne Tour: Deliver 15-Factor Applications on Kubernetes with Spring Boot
SpringOne Tour: Deliver 15-Factor Applications on Kubernetes with Spring BootVMware Tanzu
 
CA Performance Manager Agility by using Docker Containers for Network Manag...
CA Performance Manager Agility by using Docker Containers for Network Manag...CA Performance Manager Agility by using Docker Containers for Network Manag...
CA Performance Manager Agility by using Docker Containers for Network Manag...CA Technologies
 
VMworld 2015: vCloud Air 2015 – Getting Started with Hybrid Cloud
VMworld 2015: vCloud Air 2015 – Getting Started with Hybrid CloudVMworld 2015: vCloud Air 2015 – Getting Started with Hybrid Cloud
VMworld 2015: vCloud Air 2015 – Getting Started with Hybrid CloudVMworld
 
Application Modernization with PKS / Kubernetes
Application Modernization with PKS / KubernetesApplication Modernization with PKS / Kubernetes
Application Modernization with PKS / KubernetesPaul Czarkowski
 
VMworld 2015: Container Orchestration with the SDDC
VMworld 2015: Container Orchestration with the SDDCVMworld 2015: Container Orchestration with the SDDC
VMworld 2015: Container Orchestration with the SDDCVMworld
 
Kubernetes for the VI Admin
Kubernetes for the VI AdminKubernetes for the VI Admin
Kubernetes for the VI AdminKendrick Coleman
 
StorPool Storage Оverview and Integration with CloudStack
StorPool Storage Оverview and Integration with CloudStackStorPool Storage Оverview and Integration with CloudStack
StorPool Storage Оverview and Integration with CloudStackShapeBlue
 
Docker Bday #5, SF Edition: Introduction to Docker
Docker Bday #5, SF Edition: Introduction to DockerDocker Bday #5, SF Edition: Introduction to Docker
Docker Bday #5, SF Edition: Introduction to DockerDocker, Inc.
 

Ähnlich wie stackconf 2022: Data Management in Kubernetes – Backup, DR, HA (20)

Portworx 201 Customer Deck.pptx
Portworx 201 Customer Deck.pptxPortworx 201 Customer Deck.pptx
Portworx 201 Customer Deck.pptx
 
Autopilot : Securing Cloud Native Storage
Autopilot : Securing Cloud Native StorageAutopilot : Securing Cloud Native Storage
Autopilot : Securing Cloud Native Storage
 
Portworx Data Services 101 Deck.pdf
Portworx Data Services 101 Deck.pdfPortworx Data Services 101 Deck.pdf
Portworx Data Services 101 Deck.pdf
 
OpenShift 4, the smarter Kubernetes platform
OpenShift 4, the smarter Kubernetes platformOpenShift 4, the smarter Kubernetes platform
OpenShift 4, the smarter Kubernetes platform
 
Leveraging HybridMultiCloud for Devops and Automation Platform
Leveraging HybridMultiCloud for Devops and Automation PlatformLeveraging HybridMultiCloud for Devops and Automation Platform
Leveraging HybridMultiCloud for Devops and Automation Platform
 
PSOCLD 1007 Cisco Hybrid Cloud Platform for Google Cloud
PSOCLD 1007 Cisco Hybrid Cloud Platform for Google CloudPSOCLD 1007 Cisco Hybrid Cloud Platform for Google Cloud
PSOCLD 1007 Cisco Hybrid Cloud Platform for Google Cloud
 
Overpowered Kubernetes: CI/CD for K8s on Enterprise IaaS
Overpowered Kubernetes: CI/CD for K8s on Enterprise IaaSOverpowered Kubernetes: CI/CD for K8s on Enterprise IaaS
Overpowered Kubernetes: CI/CD for K8s on Enterprise IaaS
 
OpenStack and Kubernetes - A match made for Telco Heaven
OpenStack and Kubernetes - A match made for Telco HeavenOpenStack and Kubernetes - A match made for Telco Heaven
OpenStack and Kubernetes - A match made for Telco Heaven
 
Pivotal Container Service : la nuova soluzione per gestire Kubernetes in azienda
Pivotal Container Service : la nuova soluzione per gestire Kubernetes in aziendaPivotal Container Service : la nuova soluzione per gestire Kubernetes in azienda
Pivotal Container Service : la nuova soluzione per gestire Kubernetes in azienda
 
Red hat cloud platforms
Red hat cloud platformsRed hat cloud platforms
Red hat cloud platforms
 
The rise of microservices
The rise of microservicesThe rise of microservices
The rise of microservices
 
The ultimate Kubernetes Deployment Checklist - Infra to Microservices
The ultimate Kubernetes Deployment Checklist - Infra to MicroservicesThe ultimate Kubernetes Deployment Checklist - Infra to Microservices
The ultimate Kubernetes Deployment Checklist - Infra to Microservices
 
SpringOne Tour: Deliver 15-Factor Applications on Kubernetes with Spring Boot
SpringOne Tour: Deliver 15-Factor Applications on Kubernetes with Spring BootSpringOne Tour: Deliver 15-Factor Applications on Kubernetes with Spring Boot
SpringOne Tour: Deliver 15-Factor Applications on Kubernetes with Spring Boot
 
CA Performance Manager Agility by using Docker Containers for Network Manag...
CA Performance Manager Agility by using Docker Containers for Network Manag...CA Performance Manager Agility by using Docker Containers for Network Manag...
CA Performance Manager Agility by using Docker Containers for Network Manag...
 
VMworld 2015: vCloud Air 2015 – Getting Started with Hybrid Cloud
VMworld 2015: vCloud Air 2015 – Getting Started with Hybrid CloudVMworld 2015: vCloud Air 2015 – Getting Started with Hybrid Cloud
VMworld 2015: vCloud Air 2015 – Getting Started with Hybrid Cloud
 
Application Modernization with PKS / Kubernetes
Application Modernization with PKS / KubernetesApplication Modernization with PKS / Kubernetes
Application Modernization with PKS / Kubernetes
 
VMworld 2015: Container Orchestration with the SDDC
VMworld 2015: Container Orchestration with the SDDCVMworld 2015: Container Orchestration with the SDDC
VMworld 2015: Container Orchestration with the SDDC
 
Kubernetes for the VI Admin
Kubernetes for the VI AdminKubernetes for the VI Admin
Kubernetes for the VI Admin
 
StorPool Storage Оverview and Integration with CloudStack
StorPool Storage Оverview and Integration with CloudStackStorPool Storage Оverview and Integration with CloudStack
StorPool Storage Оverview and Integration with CloudStack
 
Docker Bday #5, SF Edition: Introduction to Docker
Docker Bday #5, SF Edition: Introduction to DockerDocker Bday #5, SF Edition: Introduction to Docker
Docker Bday #5, SF Edition: Introduction to Docker
 

Kürzlich hochgeladen

How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerThousandEyes
 
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...Neo4j
 
Salesforce Community Group Quito, Salesforce 101
Salesforce Community Group Quito, Salesforce 101Salesforce Community Group Quito, Salesforce 101
Salesforce Community Group Quito, Salesforce 101Paola De la Torre
 
🐬 The future of MySQL is Postgres 🐘
🐬  The future of MySQL is Postgres   🐘🐬  The future of MySQL is Postgres   🐘
🐬 The future of MySQL is Postgres 🐘RTylerCroy
 
How to convert PDF to text with Nanonets
How to convert PDF to text with NanonetsHow to convert PDF to text with Nanonets
How to convert PDF to text with Nanonetsnaman860154
 
Unblocking The Main Thread Solving ANRs and Frozen Frames
Unblocking The Main Thread Solving ANRs and Frozen FramesUnblocking The Main Thread Solving ANRs and Frozen Frames
Unblocking The Main Thread Solving ANRs and Frozen FramesSinan KOZAK
 
Breaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path MountBreaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path MountPuma Security, LLC
 
Scaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationScaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationRadu Cotescu
 
Automating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps ScriptAutomating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps Scriptwesley chun
 
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptxHampshireHUG
 
GenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day PresentationGenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day PresentationMichael W. Hawkins
 
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationFrom Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationSafe Software
 
Developing An App To Navigate The Roads of Brazil
Developing An App To Navigate The Roads of BrazilDeveloping An App To Navigate The Roads of Brazil
Developing An App To Navigate The Roads of BrazilV3cube
 
A Call to Action for Generative AI in 2024
A Call to Action for Generative AI in 2024A Call to Action for Generative AI in 2024
A Call to Action for Generative AI in 2024Results
 
The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024Rafal Los
 
IAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsIAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsEnterprise Knowledge
 
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking MenDelhi Call girls
 
Histor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slideHistor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slidevu2urc
 
Data Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonData Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonAnna Loughnan Colquhoun
 
08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking MenDelhi Call girls
 

Kürzlich hochgeladen (20)

How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected Worker
 
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...
 
Salesforce Community Group Quito, Salesforce 101
Salesforce Community Group Quito, Salesforce 101Salesforce Community Group Quito, Salesforce 101
Salesforce Community Group Quito, Salesforce 101
 
🐬 The future of MySQL is Postgres 🐘
🐬  The future of MySQL is Postgres   🐘🐬  The future of MySQL is Postgres   🐘
🐬 The future of MySQL is Postgres 🐘
 
How to convert PDF to text with Nanonets
How to convert PDF to text with NanonetsHow to convert PDF to text with Nanonets
How to convert PDF to text with Nanonets
 
Unblocking The Main Thread Solving ANRs and Frozen Frames
Unblocking The Main Thread Solving ANRs and Frozen FramesUnblocking The Main Thread Solving ANRs and Frozen Frames
Unblocking The Main Thread Solving ANRs and Frozen Frames
 
Breaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path MountBreaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path Mount
 
Scaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationScaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organization
 
Automating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps ScriptAutomating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps Script
 
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
 
GenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day PresentationGenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day Presentation
 
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationFrom Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
 
Developing An App To Navigate The Roads of Brazil
Developing An App To Navigate The Roads of BrazilDeveloping An App To Navigate The Roads of Brazil
Developing An App To Navigate The Roads of Brazil
 
A Call to Action for Generative AI in 2024
A Call to Action for Generative AI in 2024A Call to Action for Generative AI in 2024
A Call to Action for Generative AI in 2024
 
The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024
 
IAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsIAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI Solutions
 
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
 
Histor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slideHistor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slide
 
Data Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonData Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt Robison
 
08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men
 

stackconf 2022: Data Management in Kubernetes – Backup, DR, HA

  • 1. Miguel Rojas Cloud Architect EMEA Portworx by Pure Storage mrojas@purestorage.com @portworx @purestorage Delivering a Kubernetes data platform with Portworx
  • 2. © 2022 Pure Storage 2 Kubernetes, Containers and Companies What’s your story? Founded 2014 ‘15 ‘20 ‘17 A little history
  • 3. 3 © 2022 Pure Storage, Inc. Cloud Native is driven by Kubernetes adoption OF NEW APPS are developed in containers. 95% OF ENTERPRISES 81% OF CNCF MEMBERS 78% use Kubernetes in production. work with 2+ public cloud providers. OF GLOBAL BUSINESSES 85% will be running containers in production by 2025 (up from 35% in 2019). Source: CNCF Survey 2021
  • 4. 4 © 2022 Pure Storage, Inc. The Kubernetes stack has room to mature Which areas of the Kubernetes tech stack need to mature the most to make it easier to deploy cloud-native apps? Source: Kubernetes Adoption Survey 2021 - Portworx Ranked top three Application development frameworks Storage and data management Monitoring and observability Networking Orchestration and management 75% 68% 57% 54% 46%
  • 5. 5 © 2022 Pure Storage, Inc. Connector Approach to Container-Native Two approaches common in the industry today… Container-Native Storage Approach ”Connector” Approach Storage Array 1 Storage Array 2 CSI • 1:1 container <> volume mapping • Container capabilities vary depending on the capabilities of the underlying array • Storage arrays often are challenged by the object count (# volumes, connections) and change rate (10,000s changes/day) • Innovation limited to the features in the open CSI specification • Storage arrays managed independently from K8s Storage Array Local SSDs/HDDs Storage Pool Cloud Storage • Many (1,000s):1 container <> volume mapping • Designed to scale to 10,000s operations/day • Ensures consistent storage services across ANY infrastructure • Storage services container-granular and application consistent • Storage “encapsulated” in a container-native virtual volume that is free to move with the container • Managed as a native part of K8s Pure PSO NetApp Dell
  • 6. 6 © 2022 Pure Storage, Inc. Kubernetes key attributes MASSIVE-SCALE KUBERNETES-NATIVE PLUGGABLE ARCHITECTURE OPTIMIZED FOR MULTI-CLOUD WORLD APPLICATION CENTRIC Scales to 1,000s of nodes, 1,000s of concurrent operations per minute All platform operations should be through a consistent control plane, the Kubernetes API Able to offer a consistent control pane on heterogeneous infrastructure environments Easily swap in and out core ”infrastructure” services – networking, storage, monitoring Platform capabilities should be focused on the needs of an application first Compute Platform
  • 7. 7 © 2022 Pure Storage, Inc. Today, Portworx Is the Leading Kubernetes Data Services Platform Any App Any Distribution GKE DATABASE ANALYTICS STREAMING SEARCH/LOG AI/ML 5G/IoT Any Cloud Any Infrastructure Bare Metal Pilot Go Live Global CaaS Test/ Dev Every Stage The Kubernetes Data Services Platform PX-Store PX-Secure PX-Backup PX-DR PX-Migrate PX-Autopilot Portworx Data Services
  • 8. 8 © 2022 Pure Storage, Inc. What would you like to solve? The Kubernetes Data Services Platform PX-Store PX-Secure PX-Backup PX-DR PX-Migrate PX-Autopilot Storage, Share, Scale, Monitor Anywhere in K8s Backup and restore from, and to, anywhere DR: RTO of minutes, Minutes RPO Migrate or duplicate environments fast Auto-pilot Intelligent, performant, hyper converged self-service Storage. The Kubernetes Data Services Platform PX-Store PX-Secure PX-Backup PX-DR PX-Migrate PX-Autopilot Portworx Data Services Secure and grant storage access with RBAC and Integrations DBaaS anywhere fully managed by Portworx.
  • 9. 9 © 2022 Pure Storage, Inc. Portworx sets the gold standard for Kubernetes Storage Portworx named a Cloud-Native Data Storage & Enterprise Kubernetes Storage leader in 2021 GigaOm Radars Cloud-Native Data Storage GigaOm Radar for Cloud-Native Data Storage for Kubernetes, 2021 GigaOm Radar for Enterprise Kubernetes Storage, 2021 Enterprise Kubernetes Storage
  • 10. 10 © 2022 Pure Storage, Inc. Use case: App and Data Migrations Data centre 1 / Cloud 1 Data centre 2 / Cloud 2 Kubernetes 1 Kubernetes 2 OBJECT STORAGE ► Async data & object replication ► Snap restore based ► Scheduled or on-demand ► RPO 5 minutes ► RTO 5 minutes
  • 11. 11 © 2022 Pure Storage, Inc. Use case: Container backup & restore Application granular backup & restore App 1 App 2 1. k8s objects 2. Config 3. Data On-premises ANY Object Storage NFS – coming soon! PX-Backup App 1 App 2 App 1 App 2 Second site Cloud environment RESTORE RESTORE
  • 12. 12 © 2022 Pure Storage, Inc. Portworx Backup Namespace A AWS mysql-0 Namespace B On-Prem mongo-0 Backup Location Schedule Rules Backup Location Schedule AWS S3-A AWS S3-B Daily Hourly FB S3-A FB S3-B Weekly Monthly Developer User Type App Owner Admin ● Backup/restore their apps ● App + namespace granularity Permissions + ● Set schedules ● Set rules ● Use existing cloud accounts + ● Add users ● Create and share cloud accounts & backup locations ● Create custom roles
  • 14. 14 © 2022 Pure Storage, Inc. Operator Kubernetes Installing Portworx Installing Portworx deploys an Operator to run worker nodes, not on the control plane nodes Control plane Worker Worker Worker Spec based installation HELM Package manager
  • 15. 15 © 2022 Pure Storage, Inc. Installing Portworx Local storage or SAN based storage will be used to create a virtual storage pool SSD SSD LUN SSD SSD LUN SSD SSD LUN Storage Pool Worker Worker Worker
  • 16. 16 © 2022 Pure Storage, Inc. Using Portworx Application can create Persistent Volumes from the storage pool using Persistent Volume Claims SSD SSD LUN SSD SSD LUN SSD SSD LUN Storage Pool Worker Worker Worker Replication factor 1 Replication factor 2 Replication factor 3 50G 50G 50G For high availability you can mirror volumes across nodes using a replication factor, which can be applied to the volume or the stroage class
  • 17. 17 © 2022 Pure Storage, Inc. Respond to a node failure Application can create Persistent Volumes from the storage pool using Persistent Volume Claims SSD SSD LUN SSD SSD LUN SSD SSD LUN Storage Pool Worker Worker Worker 50G 50G 50G Portworx integrates with the Kubernetes scheduler to reschedule the Pod on a worker with a local replica
  • 18. Designing a Portworx deployment Deployment models
  • 19. 19 © 2022 Pure Storage, Inc. Standard deployment • Single Portworx and Kubernetes cluster • Minimum of three worker nodes • A block storage device Worker Worker Worker
  • 20. 20 © 2022 Pure Storage, Inc. AZ 2 AZ 3 AZ 1 Worker Worker Worker Multi-zone high availability (HA) VOL VOL VOL Volume replica placement Follows K8s failure domains Multi-zone Kubernetes cluster ETCD ETCD ETCD Worker Worker Worker
  • 21. 21 © 2022 Pure Storage, Inc. Storage Cluster Scale and manage storage Compute Cluster Scale and manage compute PWX PWX PWX PWX Portworx cluster KVDB VOL VOL VOL VOL Disaggregated compute and storage PVC PVC PVC
  • 22. 22 © 2022 Pure Storage, Inc. Case Study: Consumer scale for Enterprise PaaS CHALLENGE ► Scale back-office apps responsible for T-Mobile store experience during Apple launches SOLUTION ► Portworx Enterprise running on-prem to provide complete data lifecycle management- provisioning, encryption, backup, and more. RESULTS ► Regularly withstand the launch of new Apple products results in dramatic spike in usage Data services used:
  • 23. 23 © 2022 Pure Storage, Inc. © 2022 Pure Storage, Inc.