Learning Objectives:
- Learn about the capabilities of the PostgreSQL database
- Learn about PostgreSQL offerings on AWS
- Learn how to migrate from Oracle to PostgreSQL with minimal disruption
2. Why migrate from Oracle to PostgreSQL?
Simplicity and innovations of open source
Lower cost and no licensing
Reduce uncertainty
Compatibility between Oracle and PostgreSQL
3. Why migrate databases to the cloud?
Reduce costs
Simplify operations
Increase flexibility and possibilities
4. Open source database
In active development for 20 years
Owned by a foundation, not a single company
Permissive innovation-friendly open source license
High performance out of the box
Object-oriented and ANSI-SQL:2008 compatible
Most geospatial features of any open source database
Supports stored procedures in 12 languages (Java, Perl, Python,
Ruby, Tcl, C/C++, its own Oracle-like PL/pgSQL, etc.)
Most Oracle-compatible open source databases
Highest AWS Schema Conversion Tool automatic conversion rates
are from Oracle to PostgreSQL
PostgreSQL fast facts
Open Source Initiative
5. Why migrate from Oracle to PostgreSQL in AWS?
Power, HVAC, net
Rack & stack
Server maintenance
OS patches
DB s/w patches
Database backups
Scaling
High availability
DB s/w installs
OS installation
you
App optimization
6. Why migrate databases to AWS?
Power, HVAC, net
Rack & stack
Server maintenance
OS patches
DB s/w patches
Database backups
Scaling
High availability
DB s/w installs
OS installation
you
App optimization
7. Why migrate to Amazon RDS?
Power, HVAC, net
Rack & stack
Server maintenance
OS patches
DB s/w patches
Database backups
App optimization
High availability
DB s/w installs
OS installation
you
Scaling
8. Cloud-optimized relational database
Performance and availability of
commercial databases
Simplicity and cost effectiveness of
open source databases,
with PostgreSQL compatibility
What is Amazon Aurora?
9. A service-oriented architecture applied to the database
Move the logging and storage layer into a
multitenant, scale-out, database-optimized
storage service
Integrate with other AWS services like
Amazon EC2, Amazon VPC, Amazon
DynamoDB, Amazon SWF, and Amazon
Route 53 for control & monitoring
Make it a managed service – using Amazon
RDS. Takes care of management and
administrative functions.
Amazon
DynamoDB
Amazon SWF
Amazon Route 53
Logging + Storage
SQL
Transactions
Caching
Amazon S3
1
2
3
Amazon RDS
10. How can I get to the cloud?
How will my on-premises data migrate to the cloud?
How can I make it transparent to my users?
Afterwards, how will on-premises and cloud data interact?
How can I integrate my data assets within AWS?
Can I get help moving off of commercial databases?
11. Migration used to be cost + complexity + time
Commercial data migration and replication software
Complex to set up and manage
Application downtime
Database-engine-specific application code
12. What are AWS DMS and AWS SCT?
AWS Database Migration Service (DMS) easily and securely
migrates and/or replicate your databases and data warehouses
to AWS
AWS Schema Conversion Tool (SCT) converts your commercial
database and data warehouse schemas to open source engines or
AWS-native services, such as Amazon Aurora and Redshift
We have migrated over 34,000 unique databases. And counting…
14. When to use AWS DMS and AWS SCT?
Modernize Migrate Replicate
Modernize your database tier –
• Commercial to open-source
• Commercial to Amazon Aurora
Modernize your Data Warehouse –
• Commercial to Redshift
• Migrate business-critical
applications
• Migrate from Classic to VPC
• Migrate data warehouse to
Redshift
• Upgrade to a minor version
• Consolidate shards into Aurora
• Create cross-Region Read Replicas
• Run your analytics in the cloud
• Keep your dev/test and production
environment sync
15. When to use AWS DMS and AWS SCT? Modernize
Modernize your database tier
• Commercial to open source
• Commercial to Amazon Aurora
Modernize your warehouse
• Commercial to Redshift
Amazon Redshift
Amazon Aurora
16. New AWS SCT Data Extractors
Extract data from your data warehouse* and migrate to Amazon Redshift
• Extracts through local migration agents
• Data is optimized for Redshift and saved
in local files
• Files are loaded to an Amazon S3 bucket
(through network or Amazon Snowball)
and then to Amazon Redshift
Amazon
Redshift
AWS SCT S3 Bucket
* 1st release supports Oracle v11 and up and Teradata v14 and up
17. Why use AWS DMS and AWS SCT?
Secure
Cost effective
Remove barriers
to entry
Allow DB
freedom
Keep a leg in
the cloud
Easy to use, but
sophisticated…
Near-zero
downtime
21. AWS SCT helps with converting tables, views, & code
Sequences
User-defined types
Synonyms
Packages
Stored procedures
Functions
Triggers
Schemas
Tables
Indexes
Views
Sort and distribution keys
22. Customer
premises
Application users
AWS
Internet
VPN
Start a replication instance
Connect to source and target
databases
Select tables, schemas, or
databases
Let AWS DMS create tables,
load data, and keep them in
sync
Switch applications over to
the target at your convenience
Keep your apps running during the migration
AWS
DMS
23. Load is table by table
Replication instance
Source Target
24. Change data capture (CDC) and apply
Replication instanceSource Target
Update
t1 t2
t1
t2
Transactions Change
apply
after bulk
load
32. Heterogeneous migration
Oracle private DC to RDS PostgreSQL migration
Used the AWS Schema Conversion Tool to
convert their database schema
Used on-going replication (CDC) to keep
databases in sync until they reached the cutover
window
Benefits:
• Improved reliability of the cloud environment
• Savings on Oracle licensing costs
• SCT Assessment Report let them understand
the scope of the migration
33. Scale up migration
RDS MySQL to Amazon Aurora Migration
Used DMS with on-going replication (CDC) to
migrate the data
Benefits:
• Aurora handles their larger data storage
requirements. Per regulations they are storing
120 TB of data for 2 years
• Reduced cost and improved performance when
compared to large MySQL instances
34. Homogeneous migration
RDS MySQL on EC Classic to VPC
Database ran an end-user application so could
not take downtime
70 RDS instances have been migrated
Benefits:
• Leveraging CDC, they could decrease
outage per database to less than 5 mins
• 70 RDS instances have been seamlessly
migrated
35. Split migration
35 million members on its site
Many interdependent applications built over the
last 15 years with unique high IOPS
requirements
Migration from legacy cloud service to AWS
Combination of migration to MySQL on EC2 and
Amazon Aurora
Benefits:
• AWS DMS reduced the time required to
migrate our databases by 40 percent
• Realized 55 percent cost savings by moving
some DBs to Amazon Aurora
37. APN Consulting Partners and Amazon Aurora
Experienced APN Partners, validated
by AWS service teams and AWS
customers
Amazon Aurora, Amazon RDS
PostgreSQL, AWS Database
Migration Service
Assessments, Proof of Concept,
Migrations, Net New Implementations