SlideShare ist ein Scribd-Unternehmen logo
1 von 14
Downloaden Sie, um offline zu lesen
Step-by-step
implementation
Jeroen de Graaff
PostgreSQL at
Rijkswaterstaat
12 July 2018
RWS INFORMATIE 1
Organisation
2 Title
Movie – introduction Rijkswaterstaat and data
• https://youtu.be/8PdNcYu1kk8
Organisation
3 Title
Some pictures – in case movie doesn’t show
Organisation
4 Title
This is me. I love:
• Gold panning
• Aikido
• Nature
• Family
Organisation
5 Title
Take home message
• Rijkswaterstaat is data driven.
• So we need robust and reliable data platforms.
• PostgreSQL delivers that.
Organisation
6 Title
Content
• Introduction Rijkswaterstaat and Data (movie)
• Take home message
• Rijkswaterstaat and Database Technology
• Rijkswaterstaat and PostgreSQL
• We apply it – 2 cases
• Next steps
• Some lessons
• Want to link?
• Take home message
Organisation
7 Title
Rijkswaterstaat and Data
• Supporting our business goals
– dry feet, clean water, flowing traffic
– data for ourselves and the public (partly: open data)
• Prepared for the future
– circulair economy, sustainability
– autonomous driving cars and vessels
– protected for threats
• on information management
• water quality & quantity
Organisation
8 Title
Rijkswaterstaat and Database technology
• Relational Database Management technologies
– Microsoft SQL 2008, 2012, 2016
– Oracle database 10, 11 & 12c
– PostgreSQL – open source, supported by EnterpriseDB
• Other database types
– GreenPlum big data – open source, supported by Pivotal
Organisation
9 Title
Rijkswaterstaat and PostgreSQL
• The preferred building block, under architecture: open standards, open source
• Key features
– Internal “as a service” delivery
– High availability on 2 node datacenter with server and storage
virtualization
– Geo / spatial data types (PostGIS)
– Grows (and shrinks) as needed
– Enterprise level support (EnterpiseDB)
• Vision, roadmap & planning
Organisation
10 Title
We apply it – two cases
• Protide
– 'PRobabilistic TIdal window DEtermination'
– to manage ships harbouring
– database migrated to PostgreSQL building block, “2016 release”
• PaaS Pivotal Could Foundry – open source
– for the active and perstitent data
– database to PostgreSQL building block, “2018 release” starting using the
BETA release in 2017
Organisation
11 Title
Next steps
• Follow roadmap supported components (PostgreSQL, Linux, tooling)
• Service definition including costing
• Avoid double releases of building blocks – if possible
• Data migration, e.g. from Oracle to PostgreSQL
Organisation
12 Title
Some lessons
• Agile working:
– short feedback loops
– apply what has value a.s.a.p.
• Knowledge and resources has been an issue à constraint speed agile
development and delivery. We have some partner consultancy support
(EnterpriseDB / Nibble)
• Knowledge exchange with collegues, like from government SSC (DJI Gouda)
is valuable
Organisation
13 Title
Want to link?
• Please find me for a chat at Rijkswaterstaat Delft or Rotterdam 17th floor
Jeroen de Graaff
Product Owner for Datacenter services
E-mail jeroen.de.graaff@rws.nl
Tel +31-615575082
Linkedin https://linkedin.com/in/jeroenwmdegraaff
Organisation
14 Title
Take home message
• Rijkswaterstaat is data driven.
• So we need robust and reliable data platforms.
• PostgreSQL delivers that.

Weitere ähnliche Inhalte

Was ist angesagt?

Tracking data lineage at Stitch Fix
Tracking data lineage at Stitch FixTracking data lineage at Stitch Fix
Tracking data lineage at Stitch Fix
Stitch Fix Algorithms
 
Tatyana Matvienko,Senior Java Developer, Big data storages
 Tatyana Matvienko,Senior Java Developer, Big data storages Tatyana Matvienko,Senior Java Developer, Big data storages
Tatyana Matvienko,Senior Java Developer, Big data storages
Alina Vilk
 

Was ist angesagt? (20)

Tracking data lineage at Stitch Fix
Tracking data lineage at Stitch FixTracking data lineage at Stitch Fix
Tracking data lineage at Stitch Fix
 
Research Data Shared Services
Research Data Shared ServicesResearch Data Shared Services
Research Data Shared Services
 
TYPO3 and CMIS
TYPO3 and CMISTYPO3 and CMIS
TYPO3 and CMIS
 
ELT is Better. Here's Why.
ELT is Better. Here's Why. ELT is Better. Here's Why.
ELT is Better. Here's Why.
 
SeaDataCloud – further developing the pan-European SeaDataNet infrastructure ...
SeaDataCloud – further developing the pan-European SeaDataNet infrastructure ...SeaDataCloud – further developing the pan-European SeaDataNet infrastructure ...
SeaDataCloud – further developing the pan-European SeaDataNet infrastructure ...
 
WRAST, Worldwide Repository for Assets. Project Cloud QTR meeting @ Disney/ABC
WRAST, Worldwide Repository for Assets. Project Cloud QTR meeting @ Disney/ABC  WRAST, Worldwide Repository for Assets. Project Cloud QTR meeting @ Disney/ABC
WRAST, Worldwide Repository for Assets. Project Cloud QTR meeting @ Disney/ABC
 
DataverseEU as multilingual repository
DataverseEU as multilingual repositoryDataverseEU as multilingual repository
DataverseEU as multilingual repository
 
Tatyana Matvienko,Senior Java Developer, Big data storages
 Tatyana Matvienko,Senior Java Developer, Big data storages Tatyana Matvienko,Senior Java Developer, Big data storages
Tatyana Matvienko,Senior Java Developer, Big data storages
 
Big data storages
Big data storagesBig data storages
Big data storages
 
Elasticsearch and the Database Market
Elasticsearch and the Database MarketElasticsearch and the Database Market
Elasticsearch and the Database Market
 
Pick a Winner: How to Choose a Data Warehouse
Pick a Winner: How to Choose a Data WarehousePick a Winner: How to Choose a Data Warehouse
Pick a Winner: How to Choose a Data Warehouse
 
Presentation by Erik van der Hoeven (Wisdom as a Service) at the Data Vault M...
Presentation by Erik van der Hoeven (Wisdom as a Service) at the Data Vault M...Presentation by Erik van der Hoeven (Wisdom as a Service) at the Data Vault M...
Presentation by Erik van der Hoeven (Wisdom as a Service) at the Data Vault M...
 
Introduction to ELK
Introduction to ELKIntroduction to ELK
Introduction to ELK
 
Object storage is awesome.. ETC "Project Cloud" QTR meeting @ Disney/ABC
Object storage is awesome..  ETC "Project Cloud" QTR meeting @ Disney/ABC Object storage is awesome..  ETC "Project Cloud" QTR meeting @ Disney/ABC
Object storage is awesome.. ETC "Project Cloud" QTR meeting @ Disney/ABC
 
Reach New Heights with Amazon Redshift
Reach New Heights with Amazon RedshiftReach New Heights with Amazon Redshift
Reach New Heights with Amazon Redshift
 
Real Use Cases - Pentaho & Big Data Ecosystem
Real Use Cases - Pentaho & Big Data Ecosystem Real Use Cases - Pentaho & Big Data Ecosystem
Real Use Cases - Pentaho & Big Data Ecosystem
 
Sharing our best secrets: Design a distributed system from scratch
Sharing our best secrets: Design a distributed system from scratchSharing our best secrets: Design a distributed system from scratch
Sharing our best secrets: Design a distributed system from scratch
 
BSides JAX 2019 - Threat Hunting with the Elastic Stack
BSides JAX 2019 - Threat Hunting with the Elastic StackBSides JAX 2019 - Threat Hunting with the Elastic Stack
BSides JAX 2019 - Threat Hunting with the Elastic Stack
 
Build an Open Source Data Lake For Data Scientists
Build an Open Source Data Lake For Data ScientistsBuild an Open Source Data Lake For Data Scientists
Build an Open Source Data Lake For Data Scientists
 
Serverless data lake architecture
Serverless data lake architectureServerless data lake architecture
Serverless data lake architecture
 

Ähnlich wie PGDay.Amsterdam 2018 - Jeroen de Graaff - Step-by-step implementation of PostgreSQL at Rijkswaterstaat

AGIT 2015 - Hans Viehmann: "Big Data and Smart Cities"
AGIT 2015  - Hans Viehmann: "Big Data and Smart Cities"AGIT 2015  - Hans Viehmann: "Big Data and Smart Cities"
AGIT 2015 - Hans Viehmann: "Big Data and Smart Cities"
jstrobl
 
Data Lakes: A Logical Approach for Faster Unified Insights (ASEAN)
Data Lakes: A Logical Approach for Faster Unified Insights (ASEAN)Data Lakes: A Logical Approach for Faster Unified Insights (ASEAN)
Data Lakes: A Logical Approach for Faster Unified Insights (ASEAN)
Denodo
 
情報処理学会 Exciting Coding! Treasure Data
情報処理学会 Exciting Coding! Treasure Data情報処理学会 Exciting Coding! Treasure Data
情報処理学会 Exciting Coding! Treasure Data
Treasure Data, Inc.
 

Ähnlich wie PGDay.Amsterdam 2018 - Jeroen de Graaff - Step-by-step implementation of PostgreSQL at Rijkswaterstaat (20)

Modernizing Global Shared Data Analytics Platform and our Alluxio Journey
Modernizing Global Shared Data Analytics Platform and our Alluxio JourneyModernizing Global Shared Data Analytics Platform and our Alluxio Journey
Modernizing Global Shared Data Analytics Platform and our Alluxio Journey
 
Shaping the Role of a Data Lake in a Modern Data Fabric Architecture
Shaping the Role of a Data Lake in a Modern Data Fabric ArchitectureShaping the Role of a Data Lake in a Modern Data Fabric Architecture
Shaping the Role of a Data Lake in a Modern Data Fabric Architecture
 
AGIT 2015 - Hans Viehmann: "Big Data and Smart Cities"
AGIT 2015  - Hans Viehmann: "Big Data and Smart Cities"AGIT 2015  - Hans Viehmann: "Big Data and Smart Cities"
AGIT 2015 - Hans Viehmann: "Big Data and Smart Cities"
 
Logical Data Lakes: From Single Purpose to Multipurpose Data Lakes (APAC)
Logical Data Lakes: From Single Purpose to Multipurpose Data Lakes (APAC)Logical Data Lakes: From Single Purpose to Multipurpose Data Lakes (APAC)
Logical Data Lakes: From Single Purpose to Multipurpose Data Lakes (APAC)
 
Data Lakehouse, Data Mesh, and Data Fabric (r1)
Data Lakehouse, Data Mesh, and Data Fabric (r1)Data Lakehouse, Data Mesh, and Data Fabric (r1)
Data Lakehouse, Data Mesh, and Data Fabric (r1)
 
Data Lakes: A Logical Approach for Faster Unified Insights (ASEAN)
Data Lakes: A Logical Approach for Faster Unified Insights (ASEAN)Data Lakes: A Logical Approach for Faster Unified Insights (ASEAN)
Data Lakes: A Logical Approach for Faster Unified Insights (ASEAN)
 
情報処理学会 Exciting Coding! Treasure Data
情報処理学会 Exciting Coding! Treasure Data情報処理学会 Exciting Coding! Treasure Data
情報処理学会 Exciting Coding! Treasure Data
 
Architecting Agile Data Applications for Scale
Architecting Agile Data Applications for ScaleArchitecting Agile Data Applications for Scale
Architecting Agile Data Applications for Scale
 
Logical Data Lakes: From Single Purpose to Multipurpose Data Lakes (APAC)
Logical Data Lakes: From Single Purpose to Multipurpose Data Lakes (APAC)Logical Data Lakes: From Single Purpose to Multipurpose Data Lakes (APAC)
Logical Data Lakes: From Single Purpose to Multipurpose Data Lakes (APAC)
 
Designing a modern data warehouse in azure
Designing a modern data warehouse in azure   Designing a modern data warehouse in azure
Designing a modern data warehouse in azure
 
Designing a modern data warehouse in azure
Designing a modern data warehouse in azure   Designing a modern data warehouse in azure
Designing a modern data warehouse in azure
 
Using Archivemedia to preserve research data
Using Archivemedia to preserve research dataUsing Archivemedia to preserve research data
Using Archivemedia to preserve research data
 
Big Data Modeling and Analytic Patterns – Beyond Schema on Read
Big Data Modeling and Analytic Patterns – Beyond Schema on ReadBig Data Modeling and Analytic Patterns – Beyond Schema on Read
Big Data Modeling and Analytic Patterns – Beyond Schema on Read
 
Big data.ppt
Big data.pptBig data.ppt
Big data.ppt
 
The Data Lake and Getting Buisnesses the Big Data Insights They Need
The Data Lake and Getting Buisnesses the Big Data Insights They NeedThe Data Lake and Getting Buisnesses the Big Data Insights They Need
The Data Lake and Getting Buisnesses the Big Data Insights They Need
 
ADV Slides: Building and Growing Organizational Analytics with Data Lakes
ADV Slides: Building and Growing Organizational Analytics with Data LakesADV Slides: Building and Growing Organizational Analytics with Data Lakes
ADV Slides: Building and Growing Organizational Analytics with Data Lakes
 
Partner webinar featuring CatDV
Partner webinar featuring CatDVPartner webinar featuring CatDV
Partner webinar featuring CatDV
 
Lecture1
Lecture1Lecture1
Lecture1
 
Case Study: Implementing Hadoop and Elastic Map Reduce on Scale-out Object S...
Case Study: Implementing Hadoop and Elastic Map Reduce on Scale-out Object S...Case Study: Implementing Hadoop and Elastic Map Reduce on Scale-out Object S...
Case Study: Implementing Hadoop and Elastic Map Reduce on Scale-out Object S...
 
A beginners guide to Cloudera Hadoop
A beginners guide to Cloudera HadoopA beginners guide to Cloudera Hadoop
A beginners guide to Cloudera Hadoop
 

KĂźrzlich hochgeladen

+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
?#DUbAI#??##{{(☎️+971_581248768%)**%*]'#abortion pills for sale in dubai@
 
Artificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and MythsArtificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and Myths
Joaquim Jorge
 

KĂźrzlich hochgeladen (20)

Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
 
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
 
A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)
 
Artificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and MythsArtificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and Myths
 
Automating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps ScriptAutomating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps Script
 
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
 
Deploy with confidence: VMware Cloud Foundation 5.1 on next gen Dell PowerEdg...
Deploy with confidence: VMware Cloud Foundation 5.1 on next gen Dell PowerEdg...Deploy with confidence: VMware Cloud Foundation 5.1 on next gen Dell PowerEdg...
Deploy with confidence: VMware Cloud Foundation 5.1 on next gen Dell PowerEdg...
 
A Year of the Servo Reboot: Where Are We Now?
A Year of the Servo Reboot: Where Are We Now?A Year of the Servo Reboot: Where Are We Now?
A Year of the Servo Reboot: Where Are We Now?
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected Worker
 
Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood
Polkadot JAM Slides - Token2049 - By Dr. Gavin WoodPolkadot JAM Slides - Token2049 - By Dr. Gavin Wood
Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood
 
Real Time Object Detection Using Open CV
Real Time Object Detection Using Open CVReal Time Object Detection Using Open CV
Real Time Object Detection Using Open CV
 
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemkeProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
 
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
 
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
 
The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024
 
Artificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : UncertaintyArtificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : Uncertainty
 
Data Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonData Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt Robison
 
TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data DiscoveryTrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
 
Manulife - Insurer Innovation Award 2024
Manulife - Insurer Innovation Award 2024Manulife - Insurer Innovation Award 2024
Manulife - Insurer Innovation Award 2024
 
Partners Life - Insurer Innovation Award 2024
Partners Life - Insurer Innovation Award 2024Partners Life - Insurer Innovation Award 2024
Partners Life - Insurer Innovation Award 2024
 

PGDay.Amsterdam 2018 - Jeroen de Graaff - Step-by-step implementation of PostgreSQL at Rijkswaterstaat

  • 1. Step-by-step implementation Jeroen de Graaff PostgreSQL at Rijkswaterstaat 12 July 2018 RWS INFORMATIE 1
  • 2. Organisation 2 Title Movie – introduction Rijkswaterstaat and data • https://youtu.be/8PdNcYu1kk8
  • 3. Organisation 3 Title Some pictures – in case movie doesn’t show
  • 4. Organisation 4 Title This is me. I love: • Gold panning • Aikido • Nature • Family
  • 5. Organisation 5 Title Take home message • Rijkswaterstaat is data driven. • So we need robust and reliable data platforms. • PostgreSQL delivers that.
  • 6. Organisation 6 Title Content • Introduction Rijkswaterstaat and Data (movie) • Take home message • Rijkswaterstaat and Database Technology • Rijkswaterstaat and PostgreSQL • We apply it – 2 cases • Next steps • Some lessons • Want to link? • Take home message
  • 7. Organisation 7 Title Rijkswaterstaat and Data • Supporting our business goals – dry feet, clean water, flowing traffic – data for ourselves and the public (partly: open data) • Prepared for the future – circulair economy, sustainability – autonomous driving cars and vessels – protected for threats • on information management • water quality & quantity
  • 8. Organisation 8 Title Rijkswaterstaat and Database technology • Relational Database Management technologies – Microsoft SQL 2008, 2012, 2016 – Oracle database 10, 11 & 12c – PostgreSQL – open source, supported by EnterpriseDB • Other database types – GreenPlum big data – open source, supported by Pivotal
  • 9. Organisation 9 Title Rijkswaterstaat and PostgreSQL • The preferred building block, under architecture: open standards, open source • Key features – Internal “as a service” delivery – High availability on 2 node datacenter with server and storage virtualization – Geo / spatial data types (PostGIS) – Grows (and shrinks) as needed – Enterprise level support (EnterpiseDB) • Vision, roadmap & planning
  • 10. Organisation 10 Title We apply it – two cases • Protide – 'PRobabilistic TIdal window DEtermination' – to manage ships harbouring – database migrated to PostgreSQL building block, “2016 release” • PaaS Pivotal Could Foundry – open source – for the active and perstitent data – database to PostgreSQL building block, “2018 release” starting using the BETA release in 2017
  • 11. Organisation 11 Title Next steps • Follow roadmap supported components (PostgreSQL, Linux, tooling) • Service definition including costing • Avoid double releases of building blocks – if possible • Data migration, e.g. from Oracle to PostgreSQL
  • 12. Organisation 12 Title Some lessons • Agile working: – short feedback loops – apply what has value a.s.a.p. • Knowledge and resources has been an issue Ă  constraint speed agile development and delivery. We have some partner consultancy support (EnterpriseDB / Nibble) • Knowledge exchange with collegues, like from government SSC (DJI Gouda) is valuable
  • 13. Organisation 13 Title Want to link? • Please find me for a chat at Rijkswaterstaat Delft or Rotterdam 17th floor Jeroen de Graaff Product Owner for Datacenter services E-mail jeroen.de.graaff@rws.nl Tel +31-615575082 Linkedin https://linkedin.com/in/jeroenwmdegraaff
  • 14. Organisation 14 Title Take home message • Rijkswaterstaat is data driven. • So we need robust and reliable data platforms. • PostgreSQL delivers that.