Equnix Professional PostgreSQL Gathering Know the Challenges, Stages, and Best Practices on Oracle to PostgreSQL Migration

1. March 27, 2019
Bunga Rampai Resto
EQUNIX PostgreSQL Professional Gathering
Plaza Semanggi 9 Fl, Unit 9
Jl. Jend Sudirman Kav 50, Jakarta - 12930 Indonesia
8 Eu Tong Street, #14-94, THE CENTRAL Singapore
+6221-22866662 | info@equnix.asia
Oracle to PostgreSQL,
A Challenge or Opportunity?

2. Copyright Notice
This document is owned by Equnix Business Solutions PTE LTD. This document contains
confidential information, which is protected by law. No part of this publication could be
photocopied, reproduced or translated into another language without permitted or the
express written consent of Equnix Business Solutions PTE LTD.
Data and information regarding the proposal and its offer is for limited use and are not
disclosed. The information contained in this document is subject to change at any time
without prior notice.
All rights reserved, © Copyright 2019
Equnix Business Solutions, PT
Equnix Business Solutions, PTE Ltd

3. info@equnix.asia | http://equnix.asia
Mission
Critical
Services
World Class
Software
Development
System
Optimization
Expertise

6. Open Source is the New Enterprise

7. RDBMS Trend from time to time

8. What is the real
“MONSTER” we are facing?

9. It's OK to have your eggs in one basket
as long as you control what happens to
that basket.
~ Elon Musk

11. RDBMS - L'histoire de development
A relational database management system (RDBMS) is a database management
system (DBMS) that is based on the relational model as introduced by E. F. Codd
in 1970, of IBM's San Jose Research Laboratory. Many popular databases currently
in use are based on the relational database model.

12. RDBMS - A.C.I.D
Atomicity
Either all of transaction happens or nothing
Consistency
Database is brought from one consistent state to
another
Durability
After commit, the transaction is permanent/durable.
No data lost potential
Isolation
The effects of transaction may not be visible to other
transactions until the transaction committed

14. PostgreSQL is ENTERPRISE
PostgreSQL is an ENTERPRISE
Level database
(does not even require commercial license)

15. The Similarity
SQL ANSI Coverage
Full Core conformance = 179 features on Core SQL 2011 (and 2008)
PostgreSQL conforms to at least 160.
Features Oracle PostgreSQL
Parallelism Requires Hint Automatically Loaded on
SELECT
Table Partitioning Supported Supported
Tablespace Supported Supported
Stored Procedures &
Functions
Supported Supported
Online Backup Active
DataGuard/GoldenGate
Natively

16. PostgreSQL ENTERPRISE Features

17. Big Machine VS BIG Machine

18. EXADATA to PostgreSQL?

19. 7 times faster than Oracle.

20. PostgreSQL Native Mirroring
Write-Ahead Log

23. High Availability amongst PostgreSQL
Enterprise Level High Availability
configuration without hassle
Keep It Simple, SUCCESS!

24. Winning Stories - EDII
Oracle Migration
From 4 Servers Oracle RAC
System
Into 1 Server Intel
PostgreSQL

25. EDII - Current Topology

26. Jumping over the
“Rainbow”

27. Migration STAGES
Migration Stages
A. Migration Assessment
a. Preliminary
b. Comprehensive
B. Schematic Migration
C. Data Migration (Test and
clean up)
D. Logic Migration
E. System Migration
~To win the battle, you
must understand your
enemy~ Sun Tzu.

28. Migration Assessment
- Preliminary Assessment
Given a couple of days (2 days) to
analyze all the database Objects briefly
to get some ideas on how long it take to
do such Comprehensive Assessment.
Look for potential Stopper: System
Functions, Customization possibility,
Specific Function/Datatype, Allowable
Downtime, Any potential copyright
infrigment, etc. Develop Mitigation,
solution and possibility workaround.
- Comprehensive Assessment
Assess all the object mentioned in the
scope of work, very detailed. Produce
Comprehensive Assessment Report,
consist:
1. Level of Difficulties
2. How many Mandays Effort
3. Migration Schedules
4. Proposed Migration Rundown
5. Analysis Report
(This is Commercial Effort)

29. Schematic Migration
Most of the Structures are compatible with PostgreSQL (even not 100%).
Prepare the “bucket” first, then the “water”
❖ Dump all database object structures (tables, sequences, views, etc.)
❖ Check whether specific data types should be converted
❖ User Defined Types should be deeply examined
❖ Constraints (PK, FK, Uniqueness, Indices) will be recreated in
PostgreSQL, as long as Database Object Relationship is kept consistent

30. Data Migration - Analysis
Migration Data from Oracle to PostgreSQL is dealing with downtime and
ETL, and somehow it needs very fast.
❖ How much is the Downtime tolerance
❖ Housekeep data from Oracle Source Database
❖ Doing Stress Test to the pre-migrated data
❖ Using FDW/ETL Tools, it is possible to start synchronizing data without
interrupting current Transactional Process on Source Database

31. Logic Migration - Analysis
Logic conversion is the PAIN, when doing migration.
Requires a deep understanding on how the function works.
❖ Streamline the Logic
❖ How many total line of codes used on Stored
Procedures/Functions/Packages
❖ Is there any Oracle specific functions used?
❖ Create a mimic for called functions, as long as output is the same
❖ PostgreSQL is highly extensible platform, if not supported yet, we can
create it as long as we have the expertise
❖ Do System Integration and Regression Test with application

32. System Migration - Analysis

33. Case Study 1 (by Chris Travers)
Bioprospecting platform by a Danish biotech company
❖ 12TB of genome and protein data
❖ 100 million transactions a day
❖ 12TB of genome and protein data
❖ 100 million transactions a day or more
❖ Main workload similar to most line of business or financial applications
❖ Single PostgreSQL server backing 1000 core scientific computing
cluster running 24x7

34. Case Study 2 (by Chris Travers)
Advertising Analytics Platform by German Ad
❖ 1PB of mobile event data
❖ 1-300000 requests a second
❖ Near-real-time analytics
❖ Queries similar to data warehouses
❖ Distributed, “Big Data” environment

35. Technology - Foreign Data Wrapper (FDW)
PostgreSQL has a useful feature called Foreign Data Wrapper, which lets you
create foreign tables in a PostgreSQL database from other data source.
When you make a query against a foreign table, the Foreign Data Wrapper
will query the external data source and return the results as if they were
coming from a table in your database.

36. FDW - High Integration

37. Enterprise ETL Tools

38. DATABASE AGGREGATION
Head Office
TABLE A
(Subscriber)
DATABASE
Medan
TABLE A
(Publisher)
DATABASE
Bandung
TABLE A
(Publisher)
TABLE C
(Subscriber)
TABLE D
(Subscriber)
TABLE B
(Subscriber)
DATABASE
Surabaya
TABLE A
(Publisher)
DATABAS
E Jakarta
TABLE A
(Publisher)
Table Replication (Realtime)

39. Geographic Information System

40. JSON = NoSQL in PostgreSQL

42. IndustriesEducation
Community

50. PostgreSQL Meetup Indonesia

51. Equnix Campus Campaign

52. Equnix Campus Campaign Semarang

53. Equnix Campus Campaign Bali