SlideShare ist ein Scribd-Unternehmen logo
1 von 17
Crunchy Data
Container Technology
December 2018
Agenda
● Crunchy Data Overview
● Crunchy PostgreSQL for Kubernetes
○ Crunchy Container Suite
○ Crunchy PostgreSQL Operator
● Container Tech. Roadmap
● Conclusion/Next Steps
2
- Crunchy Certified PostgreSQL is open source and Common Criteria EAL 2+ Certified, with
essential security enhancements for enterprise deployments
- Author of DISA Secure Technology Implementation Guide for PostgreSQL and CIS PostgreSQL
Benchmark
- Automated Security and “Authority to Operate (ATO) in a Day”
Crunchy Data Overview
3
Market Leading Data Security
Cloud Ready Data Management
- Crunchy PostgreSQL for Kubernetes - open source & scales to 1000s of PostgreSQL instances
- Cloud Agnostic - Deploy to your choice of public or private clouds, or on-premise infrastructure
Leader in Open Source Enterprise PostgreSQL
- Leading PostgreSQL Contributor, driving PostgreSQL stability, security, and performance
- Open source solutions for high-availability, disaster recovery, and monitoring
Crunchy PostgreSQL for Kubernetes
● Group of open source projects to combine the robustness of PostgreSQL
with the deployment flexibility of Kubernetes
○ Crunchy Container Suite
○ Crunchy PostgreSQL Operator
● Works on enterprise Kubernetes based platforms
● Actively developed
● Successfully deployed at Fortune 100 and Government customers
4
Container Container Suite
5
https://github.com/CrunchyData/crunchy-containers
● Microservices architecture
● PostgreSQL/PostGIS Containers
(9.5, 9.6, 10.x, 11.x)
● PostgreSQL utility containers that
are the building blocks for running
production environments:
○ High Availability
○ Disaster recovery for
terabyte-scale clusters with
pgBackRest
○ Monitoring
● Open source
● Examples provided
Looks great!
But I have 50+ clusters to manage...
When to Use Kubernetes with PostgreSQL
● Value of Kubernetes increases
exponentially as number of containers
increases
● Due to statefulness of databases,
Kubernetes requires more knowledge
to successfully operate a standard
database workload:
○ Avoid scheduling and availability issues for
longer-running database containers
○ Data continues to exist even if container
does not
7
Crunchy PostgreSQL Operator Overview
● Open source project to provide a smarter way of provisioning PostgreSQL
clusters on Kubernetes
● Based on the Kubernetes client APIs, written in golang
● Custom Resource Definitions used to capture the definition of PostgreSQL
clusters and administration tasks
● REST API provides client integration, RBAC included for fine grained controls
● Goal is to assist in Day 2 operations as well as provisioning
● Single Deployment per Namespace, PostgreSQL clusters represented as
Deployments
● Leverages the Crunchy Container Suite set of microservice containers
8 https://github.com/CrunchyData/postgres-operator
● Allows an administrator to run PostgreSQL-specific commands to
manage database clusters, including:
○ Creating / Deleting a cluster (your own DBaaS)
○ Scaling up / down replicas
○ Failover
○ Apply user policies to PostgreSQL instances
○ Define what container resources to use (RAM, CPU, etc.)
○ Smart pod deployments to nodes
○ Backup and restore
○ Backup scheduling
● REST API allows for easy integration with other services (e.g. pgo-
osb)
● The Crunchy PostgreSQL Operator enables your own secure,
elastic database-as-a-service
Crunchy PostgreSQL Operator Features
9
Crunchy PostgreSQL Operator Architecture
10
● Utilizes Kubernetes
Deployments
● Flexibility in storage
classes
● Flexibility in operating
environments
○ Node affinity
○ Resource (CPU, RAM)
configurations
● Flexibility in database
version runtimes
Why Use An Operator With PostgreSQL?
11
● Automation: Complex, multi-step DBA
tasks reduced to one-line commands
● Standardization: Many customizations,
same workflow
● Ease-of-Use: Simple CLI; UI in beta
● Scale
○ Provision & manage clusters quickly
amongst thousands of instances
○ Load balancing, disaster recovery,
security policies, deployment
specifications
● Security: Sandboxed environments,
RBAC, mass grant/revoke policies
Operator HA Support
The Crunchy PostgreSQL Operator
supports:
● PostgreSQL Deployments spread
across Kubernetes Nodes.
● Multiple storage backends within a
single PostgreSQL cluster
● High-availability through automated
and manual failover
● Rescheduling if a Kubernetes Node
becomes unavailable
● Storage providers replicating storage
between zones depending upon
storage vendor
12
Crunchy PostgreSQL Operator Successes
● Federal Government organizations’ deployments,
automated provisioning process from days to minutes
● Fortune 100 manufacturer deploying the Operator to build
an in-house database-as-a-service offering internally,
reducing provisioning times from weeks to seconds
● Fortune 250 customers using Container Suite and
Operator to simplify their development, test, QA
processes on on-premise and public cloud infrastructure
13
Crunchy PostgreSQL Operator Roadmap
● Open service broker implementation (pgo-osb) (underway)
● Web user interface (pgo-ui) (underway)
● pgBackRest integration (underway)
● Backup management
● Advanced Data loading
● Disk level snapshots
● archive/export/import
● Ingress integration
● Operator Federation (cross-namespace and cross-Kube-cluster)
● Additional advanced user management
● Automated Postgres Upgrading
● Sharding/Advanced Data Deployments
14
Crunchy PostgreSQL Operator Roadmap
15
Next steps
Questions to consider
● Do you want to securely provision thousands of databases in a reliable, auditable environment?
● Do you want to be able to deploy your databases to ANY cloud platform, public or private, from a
single interface?
● Do you want to simply create highly-available PostgreSQL clusters with full disaster recovery
capabilities for databases of terabyte scale?
● Do you want to give your developers the ability to instantly provision databases that meet your
compliance requirements?
● Would the ability to leverage cost-effective open source used by Fortune 100 companies to
provision and manage thousands of databases be meaningful to your business?
Who to call?
Robert Bates, robert.bates@crunchydata.com, 770-330-5838
Paul Laurence, paul@crunchydata.com, 843-737-6045
16
RESOURCES
https://github.com/crunchydata/crunchy-containers.git
https://github.com/crunchydata/postgres-operator.git
https://github.com/crunchydata/pgo-osb.git
Robert.Bates@crunchydata.com

Weitere ähnliche Inhalte

Was ist angesagt?

GPU/SSD Accelerates PostgreSQL - challenge towards query processing throughpu...
GPU/SSD Accelerates PostgreSQL - challenge towards query processing throughpu...GPU/SSD Accelerates PostgreSQL - challenge towards query processing throughpu...
GPU/SSD Accelerates PostgreSQL - challenge towards query processing throughpu...Kohei KaiGai
 
FDW-based Sharding Update and Future
FDW-based Sharding Update and FutureFDW-based Sharding Update and Future
FDW-based Sharding Update and FutureMasahiko Sawada
 
OpenStack cloud for ConoHa, Z.com and GMO AppsCloud in okinawa opendays 2015 ...
OpenStack cloud for ConoHa, Z.com and GMO AppsCloud in okinawa opendays 2015 ...OpenStack cloud for ConoHa, Z.com and GMO AppsCloud in okinawa opendays 2015 ...
OpenStack cloud for ConoHa, Z.com and GMO AppsCloud in okinawa opendays 2015 ...Naoto Gohko
 
20201128_OSC_Fukuoka_Online_GPUPostGIS
20201128_OSC_Fukuoka_Online_GPUPostGIS20201128_OSC_Fukuoka_Online_GPUPostGIS
20201128_OSC_Fukuoka_Online_GPUPostGISKohei KaiGai
 
OpenStack Congress and Datalog (English)
OpenStack Congress and Datalog (English)OpenStack Congress and Datalog (English)
OpenStack Congress and Datalog (English)Motonori Shindo
 
Stangel open stack community activity board and metrics 041513
Stangel open stack community activity board and metrics 041513Stangel open stack community activity board and metrics 041513
Stangel open stack community activity board and metrics 041513OpenStack Foundation
 
OCDET Activity and Glusterfs
OCDET Activity and GlusterfsOCDET Activity and Glusterfs
OCDET Activity and GlusterfsMasanori Itoh
 
Ceph Performance on OpenStack - Barcelona Summit
Ceph Performance on OpenStack - Barcelona SummitCeph Performance on OpenStack - Barcelona Summit
Ceph Performance on OpenStack - Barcelona SummitTakehiro Kudou
 
Building Software Ecosystems for AI Cloud using Singularity HPC Container
Building Software Ecosystems for AI Cloud using Singularity HPC ContainerBuilding Software Ecosystems for AI Cloud using Singularity HPC Container
Building Software Ecosystems for AI Cloud using Singularity HPC ContainerHitoshi Sato
 
OpenStack運用管理最前線 - OpenStack最新情報セミナー 2014年12月
OpenStack運用管理最前線 - OpenStack最新情報セミナー 2014年12月OpenStack運用管理最前線 - OpenStack最新情報セミナー 2014年12月
OpenStack運用管理最前線 - OpenStack最新情報セミナー 2014年12月VirtualTech Japan Inc.
 
Advanced GeoServer Security with GeoFence
Advanced GeoServer Security with GeoFenceAdvanced GeoServer Security with GeoFence
Advanced GeoServer Security with GeoFenceGeoSolutions
 
kubectl internal / Kubernetes Internal #8
kubectl internal / Kubernetes Internal #8kubectl internal / Kubernetes Internal #8
kubectl internal / Kubernetes Internal #8Preferred Networks
 
VirtualTech Japan Business update 2016/1/26
VirtualTech Japan Business update 2016/1/26VirtualTech Japan Business update 2016/1/26
VirtualTech Japan Business update 2016/1/26VirtualTech Japan Inc.
 
PGConf.ASIA 2019 Bali - Keynote Speech 3 - Kohei KaiGai
PGConf.ASIA 2019 Bali - Keynote Speech 3 - Kohei KaiGaiPGConf.ASIA 2019 Bali - Keynote Speech 3 - Kohei KaiGai
PGConf.ASIA 2019 Bali - Keynote Speech 3 - Kohei KaiGaiEqunix Business Solutions
 
20180926 kubeflow-meetup-1-kubeflow-operators-Preferred Networks-Shingo Omura
20180926 kubeflow-meetup-1-kubeflow-operators-Preferred Networks-Shingo Omura20180926 kubeflow-meetup-1-kubeflow-operators-Preferred Networks-Shingo Omura
20180926 kubeflow-meetup-1-kubeflow-operators-Preferred Networks-Shingo OmuraPreferred Networks
 
PGConf.ASIA 2019 Bali - Toward Implementing Incremental View Maintenance on P...
PGConf.ASIA 2019 Bali - Toward Implementing Incremental View Maintenance on P...PGConf.ASIA 2019 Bali - Toward Implementing Incremental View Maintenance on P...
PGConf.ASIA 2019 Bali - Toward Implementing Incremental View Maintenance on P...Equnix Business Solutions
 

Was ist angesagt? (20)

GPU/SSD Accelerates PostgreSQL - challenge towards query processing throughpu...
GPU/SSD Accelerates PostgreSQL - challenge towards query processing throughpu...GPU/SSD Accelerates PostgreSQL - challenge towards query processing throughpu...
GPU/SSD Accelerates PostgreSQL - challenge towards query processing throughpu...
 
Application of postgre sql to large social infrastructure
Application of postgre sql to large social infrastructureApplication of postgre sql to large social infrastructure
Application of postgre sql to large social infrastructure
 
OpenStack 4th Birthday
OpenStack 4th BirthdayOpenStack 4th Birthday
OpenStack 4th Birthday
 
FDW-based Sharding Update and Future
FDW-based Sharding Update and FutureFDW-based Sharding Update and Future
FDW-based Sharding Update and Future
 
OpenStack cloud for ConoHa, Z.com and GMO AppsCloud in okinawa opendays 2015 ...
OpenStack cloud for ConoHa, Z.com and GMO AppsCloud in okinawa opendays 2015 ...OpenStack cloud for ConoHa, Z.com and GMO AppsCloud in okinawa opendays 2015 ...
OpenStack cloud for ConoHa, Z.com and GMO AppsCloud in okinawa opendays 2015 ...
 
20201128_OSC_Fukuoka_Online_GPUPostGIS
20201128_OSC_Fukuoka_Online_GPUPostGIS20201128_OSC_Fukuoka_Online_GPUPostGIS
20201128_OSC_Fukuoka_Online_GPUPostGIS
 
OpenStack Congress and Datalog (English)
OpenStack Congress and Datalog (English)OpenStack Congress and Datalog (English)
OpenStack Congress and Datalog (English)
 
Stangel open stack community activity board and metrics 041513
Stangel open stack community activity board and metrics 041513Stangel open stack community activity board and metrics 041513
Stangel open stack community activity board and metrics 041513
 
OCDET Activity and Glusterfs
OCDET Activity and GlusterfsOCDET Activity and Glusterfs
OCDET Activity and Glusterfs
 
Ceph Performance on OpenStack - Barcelona Summit
Ceph Performance on OpenStack - Barcelona SummitCeph Performance on OpenStack - Barcelona Summit
Ceph Performance on OpenStack - Barcelona Summit
 
Building Software Ecosystems for AI Cloud using Singularity HPC Container
Building Software Ecosystems for AI Cloud using Singularity HPC ContainerBuilding Software Ecosystems for AI Cloud using Singularity HPC Container
Building Software Ecosystems for AI Cloud using Singularity HPC Container
 
OpenStack運用管理最前線 - OpenStack最新情報セミナー 2014年12月
OpenStack運用管理最前線 - OpenStack最新情報セミナー 2014年12月OpenStack運用管理最前線 - OpenStack最新情報セミナー 2014年12月
OpenStack運用管理最前線 - OpenStack最新情報セミナー 2014年12月
 
Nbu guide
Nbu guideNbu guide
Nbu guide
 
Advanced GeoServer Security with GeoFence
Advanced GeoServer Security with GeoFenceAdvanced GeoServer Security with GeoFence
Advanced GeoServer Security with GeoFence
 
Collect, summarize and notify of OpenStack's log
Collect, summarize and notify of OpenStack's logCollect, summarize and notify of OpenStack's log
Collect, summarize and notify of OpenStack's log
 
kubectl internal / Kubernetes Internal #8
kubectl internal / Kubernetes Internal #8kubectl internal / Kubernetes Internal #8
kubectl internal / Kubernetes Internal #8
 
VirtualTech Japan Business update 2016/1/26
VirtualTech Japan Business update 2016/1/26VirtualTech Japan Business update 2016/1/26
VirtualTech Japan Business update 2016/1/26
 
PGConf.ASIA 2019 Bali - Keynote Speech 3 - Kohei KaiGai
PGConf.ASIA 2019 Bali - Keynote Speech 3 - Kohei KaiGaiPGConf.ASIA 2019 Bali - Keynote Speech 3 - Kohei KaiGai
PGConf.ASIA 2019 Bali - Keynote Speech 3 - Kohei KaiGai
 
20180926 kubeflow-meetup-1-kubeflow-operators-Preferred Networks-Shingo Omura
20180926 kubeflow-meetup-1-kubeflow-operators-Preferred Networks-Shingo Omura20180926 kubeflow-meetup-1-kubeflow-operators-Preferred Networks-Shingo Omura
20180926 kubeflow-meetup-1-kubeflow-operators-Preferred Networks-Shingo Omura
 
PGConf.ASIA 2019 Bali - Toward Implementing Incremental View Maintenance on P...
PGConf.ASIA 2019 Bali - Toward Implementing Incremental View Maintenance on P...PGConf.ASIA 2019 Bali - Toward Implementing Incremental View Maintenance on P...
PGConf.ASIA 2019 Bali - Toward Implementing Incremental View Maintenance on P...
 

Ähnlich wie PostgreSQL-as-a-Service with Crunchy PostgreSQL for PKS

Running PostgreSQL in Kubernetes: from day 0 to day 2 with CloudNativePG - Do...
Running PostgreSQL in Kubernetes: from day 0 to day 2 with CloudNativePG - Do...Running PostgreSQL in Kubernetes: from day 0 to day 2 with CloudNativePG - Do...
Running PostgreSQL in Kubernetes: from day 0 to day 2 with CloudNativePG - Do...DoKC
 
Operating PostgreSQL at Scale with Kubernetes
Operating PostgreSQL at Scale with KubernetesOperating PostgreSQL at Scale with Kubernetes
Operating PostgreSQL at Scale with KubernetesJonathan Katz
 
Using PostgreSQL With Docker & Kubernetes - July 2018
Using PostgreSQL With Docker & Kubernetes - July 2018Using PostgreSQL With Docker & Kubernetes - July 2018
Using PostgreSQL With Docker & Kubernetes - July 2018Jonathan Katz
 
Introduction to rook
Introduction to rookIntroduction to rook
Introduction to rookRohan Gupta
 
Automating using Ansible
Automating using AnsibleAutomating using Ansible
Automating using AnsibleAlok Patra
 
[WSO2Con Asia 2018] Architecting for Container-native Environments
[WSO2Con Asia 2018] Architecting for Container-native Environments[WSO2Con Asia 2018] Architecting for Container-native Environments
[WSO2Con Asia 2018] Architecting for Container-native EnvironmentsWSO2
 
Architecting Analytic Pipelines on GCP - Chicago Cloud Conference 2020
Architecting Analytic Pipelines on GCP - Chicago Cloud Conference 2020Architecting Analytic Pipelines on GCP - Chicago Cloud Conference 2020
Architecting Analytic Pipelines on GCP - Chicago Cloud Conference 2020Mariano Gonzalez
 
NetflixOSS Meetup season 3 episode 1
NetflixOSS Meetup season 3 episode 1NetflixOSS Meetup season 3 episode 1
NetflixOSS Meetup season 3 episode 1Ruslan Meshenberg
 
Kubernetes for Beginners
Kubernetes for BeginnersKubernetes for Beginners
Kubernetes for BeginnersDigitalOcean
 
USENIX LISA15: How TubeMogul Handles over One Trillion HTTP Requests a Month
USENIX LISA15: How TubeMogul Handles over One Trillion HTTP Requests a MonthUSENIX LISA15: How TubeMogul Handles over One Trillion HTTP Requests a Month
USENIX LISA15: How TubeMogul Handles over One Trillion HTTP Requests a MonthNicolas Brousse
 
How Kubernetes helps Devops
How Kubernetes helps DevopsHow Kubernetes helps Devops
How Kubernetes helps DevopsSreenivas Makam
 
[Virtual Meetup] Using Elasticsearch as a Time-Series Database in the Endpoin...
[Virtual Meetup] Using Elasticsearch as a Time-Series Database in the Endpoin...[Virtual Meetup] Using Elasticsearch as a Time-Series Database in the Endpoin...
[Virtual Meetup] Using Elasticsearch as a Time-Series Database in the Endpoin...Anna Ossowski
 
Deploying PostgreSQL on Kubernetes
Deploying PostgreSQL on KubernetesDeploying PostgreSQL on Kubernetes
Deploying PostgreSQL on KubernetesJimmy Angelakos
 
Open shift and docker - october,2014
Open shift and docker - october,2014Open shift and docker - october,2014
Open shift and docker - october,2014Hojoong Kim
 
What's coming in Airflow 2.0? - NYC Apache Airflow Meetup
What's coming in Airflow 2.0? - NYC Apache Airflow MeetupWhat's coming in Airflow 2.0? - NYC Apache Airflow Meetup
What's coming in Airflow 2.0? - NYC Apache Airflow MeetupKaxil Naik
 
Como creamos QuestDB Cloud, un SaaS basado en Kubernetes alrededor de QuestDB...
Como creamos QuestDB Cloud, un SaaS basado en Kubernetes alrededor de QuestDB...Como creamos QuestDB Cloud, un SaaS basado en Kubernetes alrededor de QuestDB...
Como creamos QuestDB Cloud, un SaaS basado en Kubernetes alrededor de QuestDB...javier ramirez
 
[Study Guide] Google Professional Cloud Architect (GCP-PCA) Certification
[Study Guide] Google Professional Cloud Architect (GCP-PCA) Certification[Study Guide] Google Professional Cloud Architect (GCP-PCA) Certification
[Study Guide] Google Professional Cloud Architect (GCP-PCA) CertificationAmaaira Johns
 
Kubernetes Forum Seoul 2019: Re-architecting Data Platform with Kubernetes
Kubernetes Forum Seoul 2019: Re-architecting Data Platform with KubernetesKubernetes Forum Seoul 2019: Re-architecting Data Platform with Kubernetes
Kubernetes Forum Seoul 2019: Re-architecting Data Platform with KubernetesSeungYong Oh
 

Ähnlich wie PostgreSQL-as-a-Service with Crunchy PostgreSQL for PKS (20)

Running PostgreSQL in Kubernetes: from day 0 to day 2 with CloudNativePG - Do...
Running PostgreSQL in Kubernetes: from day 0 to day 2 with CloudNativePG - Do...Running PostgreSQL in Kubernetes: from day 0 to day 2 with CloudNativePG - Do...
Running PostgreSQL in Kubernetes: from day 0 to day 2 with CloudNativePG - Do...
 
Operating PostgreSQL at Scale with Kubernetes
Operating PostgreSQL at Scale with KubernetesOperating PostgreSQL at Scale with Kubernetes
Operating PostgreSQL at Scale with Kubernetes
 
Using PostgreSQL With Docker & Kubernetes - July 2018
Using PostgreSQL With Docker & Kubernetes - July 2018Using PostgreSQL With Docker & Kubernetes - July 2018
Using PostgreSQL With Docker & Kubernetes - July 2018
 
Introduction to rook
Introduction to rookIntroduction to rook
Introduction to rook
 
Crunchy containers
Crunchy containersCrunchy containers
Crunchy containers
 
Automating using Ansible
Automating using AnsibleAutomating using Ansible
Automating using Ansible
 
[WSO2Con Asia 2018] Architecting for Container-native Environments
[WSO2Con Asia 2018] Architecting for Container-native Environments[WSO2Con Asia 2018] Architecting for Container-native Environments
[WSO2Con Asia 2018] Architecting for Container-native Environments
 
Architecting Analytic Pipelines on GCP - Chicago Cloud Conference 2020
Architecting Analytic Pipelines on GCP - Chicago Cloud Conference 2020Architecting Analytic Pipelines on GCP - Chicago Cloud Conference 2020
Architecting Analytic Pipelines on GCP - Chicago Cloud Conference 2020
 
NetflixOSS Meetup season 3 episode 1
NetflixOSS Meetup season 3 episode 1NetflixOSS Meetup season 3 episode 1
NetflixOSS Meetup season 3 episode 1
 
Kubernetes for Beginners
Kubernetes for BeginnersKubernetes for Beginners
Kubernetes for Beginners
 
USENIX LISA15: How TubeMogul Handles over One Trillion HTTP Requests a Month
USENIX LISA15: How TubeMogul Handles over One Trillion HTTP Requests a MonthUSENIX LISA15: How TubeMogul Handles over One Trillion HTTP Requests a Month
USENIX LISA15: How TubeMogul Handles over One Trillion HTTP Requests a Month
 
How Kubernetes helps Devops
How Kubernetes helps DevopsHow Kubernetes helps Devops
How Kubernetes helps Devops
 
[Virtual Meetup] Using Elasticsearch as a Time-Series Database in the Endpoin...
[Virtual Meetup] Using Elasticsearch as a Time-Series Database in the Endpoin...[Virtual Meetup] Using Elasticsearch as a Time-Series Database in the Endpoin...
[Virtual Meetup] Using Elasticsearch as a Time-Series Database in the Endpoin...
 
Deploying PostgreSQL on Kubernetes
Deploying PostgreSQL on KubernetesDeploying PostgreSQL on Kubernetes
Deploying PostgreSQL on Kubernetes
 
Open shift and docker - october,2014
Open shift and docker - october,2014Open shift and docker - october,2014
Open shift and docker - october,2014
 
What's coming in Airflow 2.0? - NYC Apache Airflow Meetup
What's coming in Airflow 2.0? - NYC Apache Airflow MeetupWhat's coming in Airflow 2.0? - NYC Apache Airflow Meetup
What's coming in Airflow 2.0? - NYC Apache Airflow Meetup
 
Como creamos QuestDB Cloud, un SaaS basado en Kubernetes alrededor de QuestDB...
Como creamos QuestDB Cloud, un SaaS basado en Kubernetes alrededor de QuestDB...Como creamos QuestDB Cloud, un SaaS basado en Kubernetes alrededor de QuestDB...
Como creamos QuestDB Cloud, un SaaS basado en Kubernetes alrededor de QuestDB...
 
Kubernetes intro
Kubernetes introKubernetes intro
Kubernetes intro
 
[Study Guide] Google Professional Cloud Architect (GCP-PCA) Certification
[Study Guide] Google Professional Cloud Architect (GCP-PCA) Certification[Study Guide] Google Professional Cloud Architect (GCP-PCA) Certification
[Study Guide] Google Professional Cloud Architect (GCP-PCA) Certification
 
Kubernetes Forum Seoul 2019: Re-architecting Data Platform with Kubernetes
Kubernetes Forum Seoul 2019: Re-architecting Data Platform with KubernetesKubernetes Forum Seoul 2019: Re-architecting Data Platform with Kubernetes
Kubernetes Forum Seoul 2019: Re-architecting Data Platform with Kubernetes
 

Mehr von Carlos Andrés García

Cloud Native Security: New Approach for a New Reality
Cloud Native Security: New Approach for a New RealityCloud Native Security: New Approach for a New Reality
Cloud Native Security: New Approach for a New RealityCarlos Andrés García
 
Automate and Enhance Application Security Analysis
Automate and Enhance Application Security AnalysisAutomate and Enhance Application Security Analysis
Automate and Enhance Application Security AnalysisCarlos Andrés García
 
Cloud-Native Streaming Platform: Running Apache Kafka on PKS (Pivotal Contain...
Cloud-Native Streaming Platform: Running Apache Kafka on PKS (Pivotal Contain...Cloud-Native Streaming Platform: Running Apache Kafka on PKS (Pivotal Contain...
Cloud-Native Streaming Platform: Running Apache Kafka on PKS (Pivotal Contain...Carlos Andrés García
 
High performance Spark distribution on PKS by SnappyData
High performance Spark distribution on PKS by SnappyDataHigh performance Spark distribution on PKS by SnappyData
High performance Spark distribution on PKS by SnappyDataCarlos Andrés García
 
PKS - Solving Complexity for Modern Data Workloads
PKS - Solving Complexity for Modern Data Workloads PKS - Solving Complexity for Modern Data Workloads
PKS - Solving Complexity for Modern Data Workloads Carlos Andrés García
 
A Planet-Scale Database for Low Latency Transactional Apps by Yugabyte
A Planet-Scale Database for Low Latency Transactional Apps by YugabyteA Planet-Scale Database for Low Latency Transactional Apps by Yugabyte
A Planet-Scale Database for Low Latency Transactional Apps by YugabyteCarlos Andrés García
 
Orchestrating Stateful Applications with PKS and Portworx
Orchestrating Stateful Applications with PKS and PortworxOrchestrating Stateful Applications with PKS and Portworx
Orchestrating Stateful Applications with PKS and PortworxCarlos Andrés García
 

Mehr von Carlos Andrés García (8)

Cloud Native Security: New Approach for a New Reality
Cloud Native Security: New Approach for a New RealityCloud Native Security: New Approach for a New Reality
Cloud Native Security: New Approach for a New Reality
 
Automate and Enhance Application Security Analysis
Automate and Enhance Application Security AnalysisAutomate and Enhance Application Security Analysis
Automate and Enhance Application Security Analysis
 
Securing a Cloud Migration
Securing a Cloud MigrationSecuring a Cloud Migration
Securing a Cloud Migration
 
Cloud-Native Streaming Platform: Running Apache Kafka on PKS (Pivotal Contain...
Cloud-Native Streaming Platform: Running Apache Kafka on PKS (Pivotal Contain...Cloud-Native Streaming Platform: Running Apache Kafka on PKS (Pivotal Contain...
Cloud-Native Streaming Platform: Running Apache Kafka on PKS (Pivotal Contain...
 
High performance Spark distribution on PKS by SnappyData
High performance Spark distribution on PKS by SnappyDataHigh performance Spark distribution on PKS by SnappyData
High performance Spark distribution on PKS by SnappyData
 
PKS - Solving Complexity for Modern Data Workloads
PKS - Solving Complexity for Modern Data Workloads PKS - Solving Complexity for Modern Data Workloads
PKS - Solving Complexity for Modern Data Workloads
 
A Planet-Scale Database for Low Latency Transactional Apps by Yugabyte
A Planet-Scale Database for Low Latency Transactional Apps by YugabyteA Planet-Scale Database for Low Latency Transactional Apps by Yugabyte
A Planet-Scale Database for Low Latency Transactional Apps by Yugabyte
 
Orchestrating Stateful Applications with PKS and Portworx
Orchestrating Stateful Applications with PKS and PortworxOrchestrating Stateful Applications with PKS and Portworx
Orchestrating Stateful Applications with PKS and Portworx
 

Kürzlich hochgeladen

Developing An App To Navigate The Roads of Brazil
Developing An App To Navigate The Roads of BrazilDeveloping An App To Navigate The Roads of Brazil
Developing An App To Navigate The Roads of BrazilV3cube
 
Handwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed textsHandwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed textsMaria Levchenko
 
Unblocking The Main Thread Solving ANRs and Frozen Frames
Unblocking The Main Thread Solving ANRs and Frozen FramesUnblocking The Main Thread Solving ANRs and Frozen Frames
Unblocking The Main Thread Solving ANRs and Frozen FramesSinan KOZAK
 
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationFrom Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationSafe Software
 
Kalyanpur ) Call Girls in Lucknow Finest Escorts Service 🍸 8923113531 🎰 Avail...
Kalyanpur ) Call Girls in Lucknow Finest Escorts Service 🍸 8923113531 🎰 Avail...Kalyanpur ) Call Girls in Lucknow Finest Escorts Service 🍸 8923113531 🎰 Avail...
Kalyanpur ) Call Girls in Lucknow Finest Escorts Service 🍸 8923113531 🎰 Avail...gurkirankumar98700
 
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptxHampshireHUG
 
Tata AIG General Insurance Company - Insurer Innovation Award 2024
Tata AIG General Insurance Company - Insurer Innovation Award 2024Tata AIG General Insurance Company - Insurer Innovation Award 2024
Tata AIG General Insurance Company - Insurer Innovation Award 2024The Digital Insurer
 
Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...Enterprise Knowledge
 
Partners Life - Insurer Innovation Award 2024
Partners Life - Insurer Innovation Award 2024Partners Life - Insurer Innovation Award 2024
Partners Life - Insurer Innovation Award 2024The Digital Insurer
 
Scaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationScaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationRadu Cotescu
 
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking MenDelhi Call girls
 
Breaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path MountBreaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path MountPuma Security, LLC
 
[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdf[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdfhans926745
 
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...Drew Madelung
 
IAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsIAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsEnterprise Knowledge
 
08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking Men08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking MenDelhi Call girls
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerThousandEyes
 
A Call to Action for Generative AI in 2024
A Call to Action for Generative AI in 2024A Call to Action for Generative AI in 2024
A Call to Action for Generative AI in 2024Results
 
Slack Application Development 101 Slides
Slack Application Development 101 SlidesSlack Application Development 101 Slides
Slack Application Development 101 Slidespraypatel2
 
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...Miguel Araújo
 

Kürzlich hochgeladen (20)

Developing An App To Navigate The Roads of Brazil
Developing An App To Navigate The Roads of BrazilDeveloping An App To Navigate The Roads of Brazil
Developing An App To Navigate The Roads of Brazil
 
Handwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed textsHandwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed texts
 
Unblocking The Main Thread Solving ANRs and Frozen Frames
Unblocking The Main Thread Solving ANRs and Frozen FramesUnblocking The Main Thread Solving ANRs and Frozen Frames
Unblocking The Main Thread Solving ANRs and Frozen Frames
 
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationFrom Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
 
Kalyanpur ) Call Girls in Lucknow Finest Escorts Service 🍸 8923113531 🎰 Avail...
Kalyanpur ) Call Girls in Lucknow Finest Escorts Service 🍸 8923113531 🎰 Avail...Kalyanpur ) Call Girls in Lucknow Finest Escorts Service 🍸 8923113531 🎰 Avail...
Kalyanpur ) Call Girls in Lucknow Finest Escorts Service 🍸 8923113531 🎰 Avail...
 
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
 
Tata AIG General Insurance Company - Insurer Innovation Award 2024
Tata AIG General Insurance Company - Insurer Innovation Award 2024Tata AIG General Insurance Company - Insurer Innovation Award 2024
Tata AIG General Insurance Company - Insurer Innovation Award 2024
 
Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...
 
Partners Life - Insurer Innovation Award 2024
Partners Life - Insurer Innovation Award 2024Partners Life - Insurer Innovation Award 2024
Partners Life - Insurer Innovation Award 2024
 
Scaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationScaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organization
 
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
 
Breaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path MountBreaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path Mount
 
[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdf[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdf
 
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
 
IAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsIAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI Solutions
 
08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking Men08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking Men
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected Worker
 
A Call to Action for Generative AI in 2024
A Call to Action for Generative AI in 2024A Call to Action for Generative AI in 2024
A Call to Action for Generative AI in 2024
 
Slack Application Development 101 Slides
Slack Application Development 101 SlidesSlack Application Development 101 Slides
Slack Application Development 101 Slides
 
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
 

PostgreSQL-as-a-Service with Crunchy PostgreSQL for PKS

  • 2. Agenda ● Crunchy Data Overview ● Crunchy PostgreSQL for Kubernetes ○ Crunchy Container Suite ○ Crunchy PostgreSQL Operator ● Container Tech. Roadmap ● Conclusion/Next Steps 2
  • 3. - Crunchy Certified PostgreSQL is open source and Common Criteria EAL 2+ Certified, with essential security enhancements for enterprise deployments - Author of DISA Secure Technology Implementation Guide for PostgreSQL and CIS PostgreSQL Benchmark - Automated Security and “Authority to Operate (ATO) in a Day” Crunchy Data Overview 3 Market Leading Data Security Cloud Ready Data Management - Crunchy PostgreSQL for Kubernetes - open source & scales to 1000s of PostgreSQL instances - Cloud Agnostic - Deploy to your choice of public or private clouds, or on-premise infrastructure Leader in Open Source Enterprise PostgreSQL - Leading PostgreSQL Contributor, driving PostgreSQL stability, security, and performance - Open source solutions for high-availability, disaster recovery, and monitoring
  • 4. Crunchy PostgreSQL for Kubernetes ● Group of open source projects to combine the robustness of PostgreSQL with the deployment flexibility of Kubernetes ○ Crunchy Container Suite ○ Crunchy PostgreSQL Operator ● Works on enterprise Kubernetes based platforms ● Actively developed ● Successfully deployed at Fortune 100 and Government customers 4
  • 5. Container Container Suite 5 https://github.com/CrunchyData/crunchy-containers ● Microservices architecture ● PostgreSQL/PostGIS Containers (9.5, 9.6, 10.x, 11.x) ● PostgreSQL utility containers that are the building blocks for running production environments: ○ High Availability ○ Disaster recovery for terabyte-scale clusters with pgBackRest ○ Monitoring ● Open source ● Examples provided
  • 6. Looks great! But I have 50+ clusters to manage...
  • 7. When to Use Kubernetes with PostgreSQL ● Value of Kubernetes increases exponentially as number of containers increases ● Due to statefulness of databases, Kubernetes requires more knowledge to successfully operate a standard database workload: ○ Avoid scheduling and availability issues for longer-running database containers ○ Data continues to exist even if container does not 7
  • 8. Crunchy PostgreSQL Operator Overview ● Open source project to provide a smarter way of provisioning PostgreSQL clusters on Kubernetes ● Based on the Kubernetes client APIs, written in golang ● Custom Resource Definitions used to capture the definition of PostgreSQL clusters and administration tasks ● REST API provides client integration, RBAC included for fine grained controls ● Goal is to assist in Day 2 operations as well as provisioning ● Single Deployment per Namespace, PostgreSQL clusters represented as Deployments ● Leverages the Crunchy Container Suite set of microservice containers 8 https://github.com/CrunchyData/postgres-operator
  • 9. ● Allows an administrator to run PostgreSQL-specific commands to manage database clusters, including: ○ Creating / Deleting a cluster (your own DBaaS) ○ Scaling up / down replicas ○ Failover ○ Apply user policies to PostgreSQL instances ○ Define what container resources to use (RAM, CPU, etc.) ○ Smart pod deployments to nodes ○ Backup and restore ○ Backup scheduling ● REST API allows for easy integration with other services (e.g. pgo- osb) ● The Crunchy PostgreSQL Operator enables your own secure, elastic database-as-a-service Crunchy PostgreSQL Operator Features 9
  • 10. Crunchy PostgreSQL Operator Architecture 10 ● Utilizes Kubernetes Deployments ● Flexibility in storage classes ● Flexibility in operating environments ○ Node affinity ○ Resource (CPU, RAM) configurations ● Flexibility in database version runtimes
  • 11. Why Use An Operator With PostgreSQL? 11 ● Automation: Complex, multi-step DBA tasks reduced to one-line commands ● Standardization: Many customizations, same workflow ● Ease-of-Use: Simple CLI; UI in beta ● Scale ○ Provision & manage clusters quickly amongst thousands of instances ○ Load balancing, disaster recovery, security policies, deployment specifications ● Security: Sandboxed environments, RBAC, mass grant/revoke policies
  • 12. Operator HA Support The Crunchy PostgreSQL Operator supports: ● PostgreSQL Deployments spread across Kubernetes Nodes. ● Multiple storage backends within a single PostgreSQL cluster ● High-availability through automated and manual failover ● Rescheduling if a Kubernetes Node becomes unavailable ● Storage providers replicating storage between zones depending upon storage vendor 12
  • 13. Crunchy PostgreSQL Operator Successes ● Federal Government organizations’ deployments, automated provisioning process from days to minutes ● Fortune 100 manufacturer deploying the Operator to build an in-house database-as-a-service offering internally, reducing provisioning times from weeks to seconds ● Fortune 250 customers using Container Suite and Operator to simplify their development, test, QA processes on on-premise and public cloud infrastructure 13
  • 14. Crunchy PostgreSQL Operator Roadmap ● Open service broker implementation (pgo-osb) (underway) ● Web user interface (pgo-ui) (underway) ● pgBackRest integration (underway) ● Backup management ● Advanced Data loading ● Disk level snapshots ● archive/export/import ● Ingress integration ● Operator Federation (cross-namespace and cross-Kube-cluster) ● Additional advanced user management ● Automated Postgres Upgrading ● Sharding/Advanced Data Deployments 14
  • 16. Next steps Questions to consider ● Do you want to securely provision thousands of databases in a reliable, auditable environment? ● Do you want to be able to deploy your databases to ANY cloud platform, public or private, from a single interface? ● Do you want to simply create highly-available PostgreSQL clusters with full disaster recovery capabilities for databases of terabyte scale? ● Do you want to give your developers the ability to instantly provision databases that meet your compliance requirements? ● Would the ability to leverage cost-effective open source used by Fortune 100 companies to provision and manage thousands of databases be meaningful to your business? Who to call? Robert Bates, robert.bates@crunchydata.com, 770-330-5838 Paul Laurence, paul@crunchydata.com, 843-737-6045 16

Hinweis der Redaktion

  1. Founded in 2012, emphasizing the security, scalability and reliability of PostgreSQL Early PostgreSQL requirements at US Department of Defense Common Criteria EAL 2+ Certified PostgreSQL DISA STIG for PostgreSQL, NIST 800-53 conformance, CIS PostgreSQL Benchmark World-class PostgreSQL expertise, including Core Developers, Committers and Major Contributors. Responsible for a number of PostgreSQL enhancements including: pgJDBC, pgBackRest, pgAudit, pgPartman, pgMonitor, and others Support from 100% Senior PostgreSQL engineers (not a call center model) 100% Open Source- NO proprietary license fees. Business model: Annual Support Subscription on Trusted Distribution of PostgreSQL Professional Services, Remote DBA & Training Available
  2. Introduce the concepts here: CCS is a set of microservices required for successful production deployment of PostgreSQL Operator allows stateful PostgreSQL to run in Kubernetes
  3. PGO CLI - REST Client API Server - REST API server postgres-operator - core operator logic Template based, alternative deployment models are possible but not easy! Configuration is server side Command set (provision, user mgmt., volume mgmt., scaling, failover, policy mgmt., simple data loading, labeling, status) Failover (manual and automated) implemented natively within the Operator Targets Day 2 Operations/Use Cases
  4. PGO CLI - Rest client that comes with the Operator PGO UI - easy-to-use interface for managing PostgreSQL clusters PGO OSB - Open Service Broker implementation for communicating across applications The Operator is deployed to a namespace on a Kube cluster, it operates on PG clusters created in that namespace. The Operator Pod includes up to 3 containers including the REST API server, the operator logic, and the web user interface. The pgo CLI tool runs outside the cluster on your laptop for example where you can access the Operator features.
  5. The Operator deploys a PG cluster which includes a Service, a primary PG deployment, storage, and optionally PG replicas. The operator also can embed a metrics collection container into the PG pod to enable metrics collection. Also, the Operator can deploy a pgpool Pod configured for your PG cluster, also optional.