SlideShare ist ein Scribd-Unternehmen logo
1 von 13
Downloaden Sie, um offline zu lesen
w w w . j a d e g l o b a l . c o m
A Jade Global White Paper
Migrating Data Warehouse Solutions
from Oracle to non-Oracle Databases
A step-by-step How-To Guide
By Manoj Machiwal, Consulting Manager
1
w w w . j a d e g l o b a l . c o m
TABLE OF CONTENTS
Preparing A Migration Plan 02
Before You Migrate 04
Capturing the Source Database 05
Creating and Customizing the Oracle Model 05
Migrating the Database 06
Testing the Oracle Database 06
Deploying the Oracle Database 07
Case Study 10
2
w w w . j a d e g l o b a l . c o m
Though there are many standardized data warehouse solutions in the
industry today, many organizations want to migrate their data
warehouses to Oracle based ones primarily because of its widely
accepted user base and superb support.
This whitepaper is a step-by-step guide for migrating non-Oracle
database solutions to Oracle ones.
Preparing a Migration Plan
The first step in a migration process is to identify databases that are to
be migrated and applications that access the database. This step must
go hand-in-hand with evaluating the business requirements that make
use of these databases and also defining the test criteria.
 Determining the requirements of Migration Project
Listed below are some key questions that need to be answered to
better assess the scope of the project,
- What third-party databases are being migrating?
- What are their versions?
- What is the character set of the third-party database?
- What source applications would be affected by migrating this
third-party database to an Oracle database?
- What is the third-party application language and its version?
- Will the applications be re-written or modified to work with an
Oracle database?
 Analyzing the Operational Requirements
This step identifies whether the migrating database is simple or
complex. The table below serves as a guideline for distinguishing
between simple and complex scenarios.
3
w w w . j a d e g l o b a l . c o m
Complex Simple
Large Database (> 1TB) Small Database (< 1 TB)
Data warehouse Simple OLTP Database
Large applications (with more
than 100 forms and reports)
Small applications (with few
forms and reports)
Distributed deployment Centralized deployment
Larger business users (> 50) Less business users (< 50)
High availability requirement Average availability (during
business hours)
Once an environmental scenario is identified, its operational
requirements can be easily identified and taken into account while
developing the project plan.
The new environment may also need additional resources such as new
hardware or added system resources and these have to be accounted
for. A backup schedule for the new environment also needs to be
determined.
 Define the testing and acceptance criteria
 Analyzing the application
- Determine whether changes to the application are required to
make them run effectively on the destination database.
- Identify the number of connections to the database that are in
the application and modify these connections to use the Oracle
database.
- Identify the embedded SQL statements that should change in
the application before it can be tested against the Oracle
database.
A summation of all these steps should eventually lead to a well-defined
project plan for the migration.
4
w w w . j a d e g l o b a l . c o m
Before you migrate
Zeroing on the Migration Technology
- Tool Evaluation
Identifying migration tools that match the project requirements
closely is very important. A proof of concept for each of these tools
is recommended. The following tools can automate the Migration
process,
o SQL Developer
o Data warehouse builder
o Custom Scripts, SQL Loader
o Heterogeneous Services
- Decision Factor
Migration tools can be selected by rating them on factors listed
below.
o Efficiency
o Data Loss
o Data type mapping
o Effort involved
A ratings comparison would serve as a guideline for identifying the
right tool.
5
w w w . j a d e g l o b a l . c o m
Capturing the Source Database
Before migrating a third-party database, information from the database
must be extracted. This information is a representation of the structure
of the source database called the Source Model. The process of
extracting the information from the database is called capturing the
source database.
Capturing a source database involves creating a source Model ER
Diagram, list of objects, type of objects, data types and all other
database environment information. Most of these tasks can be
automated by using a migration tool. A model can be created reverse
engineering the data model in the source database.
The appropriate Oracle model can be determined by identifying all the
external interfaces to the database.
Creating and Customizing the Oracle Model
Before migrating to a third-party database, an Oracle Model must be
created. The Oracle Model is a representation of the destination
database structure.
To obtain best results from the migrated database, an Oracle Model can
be customized to use specific Oracle database features such as multiple
tablespaces.
Based on the Oracle database version, correct storage and database
initialization parameters should be identified at this point. For better
database performance, best practices such as collecting statistics,
defining portioning strategy, defining indexing strategy and index
monitoring scripts should be implemented.
6
w w w . j a d e g l o b a l . c o m
Migrating the Database
To migrate the source database, a customized Oracle data model must
be created by implementing the steps for capturing the source
database.
Oracle recommends that the databases should be migrated in the
following order:
- Migrate tablespaces, users, and user tables
- Migrate data
- Migrate the remaining schema objects
If no migration tools are being used, then all migration scripts can be
created using SQL loader, or PL SQL scripts. These in turn can use
external file features to read the source data from flat files. Programs
should be written to convert data in the source database to a flat file
format. Should this be not done, heterogonous services in the oracle
database should be defined which can directly connect to the source
database. All migration scripts should also be tested for performance as
well.
Testing the Oracle Database
During the testing phase, the application and the Oracle database are
tested to ensure,
- Migrated data is complete and accurate
- Applications function in the same way as the source database
- Both the source and Oracle databases are producing the same
results
- All applications and the Oracle database meet the operational and
performance requirements
7
w w w . j a d e g l o b a l . c o m
A collection of unit and system tests from the original application may
already exist which can be used to test the Oracle database. These tests
should run in the same way as the tests against the source database.
This section focuses only on the database testing. However, regardless
of added features, it should be ensured that the application connects to
the Oracle database and that the SQL statements it issues produces the
correct results.
Testing Methodology
Many constraints shape the style and amount of testing that can be
performed on a database. Testing can contain one or all of the
following,
- Simple data validation (Records count in source and destination
database)
- Full life cycle testing and addressing of individual units
- System and acceptance testing
Deploying the Oracle Database
Rollout Strategies
The strategy for migrating a third-party database to an Oracle database
must take into consideration the users and the type of business that
may be affected during the transition period.
For example, the Big Bang approach can be used when enough systems
aren’t available to run the source database and Oracle database
simultaneously. On the other hand a phased approach can be taken to
ensure that the system is operating in the user environment correctly
before it is released to the general user population.
8
w w w . j a d e g l o b a l . c o m
Phased Approach
Using the phased approach, groups of users are migrated at different
times. The selected users should represent a cross-section of the
complete user-base.
This approach allows profiling users as they are introduced to the Oracle
database. The system can be reconfigured such that only selected users
are affected by the migration and unscheduled outages only affect a
small percentage of the user population. This approach may affect the
users that are being migrated.
However, because the number of users is limited, support services are
not overloaded with issues. The phased approach allows us to debug
scalability issues as the number of migrated users increases. However,
using this approach may mean that data must be migrated to and from
legacy systems during the migration process. The application
architecture should also support a phased approach.
Big Bang Approach
Using the Big Bang approach, all the users are migrated at the same
time. This approach may cause schedule outages during the time you
are removing the old system, migrating the data, deploying the Oracle
system, and testing that the system is operating correctly.
This approach relies on testing the database on the same scale as the
original database. It has the advantage of minimal data conversion and
synchronization with the original database because that database is
switched off.
The disadvantage with this approach is that it can be labor intensive and
disruptive for business activities due to the switch-over period needed
to install the Oracle database and perform the other migration project
tasks.
9
w w w . j a d e g l o b a l . c o m
Parallel Approach
Using the Parallel approach, both the source and destination Oracle
databases are maintained simultaneously. To ensure that the
application behaves the same way in the production environment for
the source and destination databases, data is entered in both the
databases and data results are analyzed.
The advantage of this approach is, if problems occur in the destination
database, users can continue using the source database.
The disadvantage of the parallel approach is that running and
maintaining both the source and the destination database may require
more resources and hardware than other approaches.
10
w w w . j a d e g l o b a l . c o m
Customer Case Study
Industry – Manufacturing
Customer Annual Revenue – 3000M
Our clients were running their large data warehousing system on IBM
redbrick and wished to migrate this to oracle 11g. As part of this
migration they wanted to achieve,
- Hardware migration to a new version of HP-UX
- Data warehouse migration to oracle 11g from redbrick
- An easy to scale Oracle 11g environment that allowed higher
transaction levels without affecting performance levels
- Mitigating the risk of rare skilled workers for redbrick
Many tools were evaluated and finally custom scripts were selected for
migration, which utilized external files and PL-SQL. We had extracted
data from the source database in the form of flat files and used them to
load data into the destination database using External files and PL-SQL.
The parallel approach method was used for deployment considering the
large user base and critical business requirements. This led to better
testing on parallel systems as audit reports were generated and
compared with both oracle and redbrick system to make sure the
migration was successful.
11
w w w . j a d e g l o b a l . c o m
About the Author
Manoj Machiwal is a Consulting Manager at Jade Global. He has over 11
years of experience in Oracle DBA and Oracle Apps DBA. Manoj is a
specialist in Upgrades, Migrations, High Availability and Performance,
Datawarehouse architecting and Proactive Monitoring.
Manoj has worked for some major names in the industry including
Solyndra, Orbotech, Gallo Wineries, Silicon Storage Technology (SST),
Telegent Systems, Riverbed Technology, Cisco Systems and Merrill
Lynch.
He is also an Oracle Certified Professional DBA .
Manoj can be reached at manoj.machiwal@jadeglobal.com and on
+1-408-899-7217.
12
w w w . j a d e g l o b a l . c o m
Jade Global, Inc.
Worldwide Headquarters
1731 Technology Drive
Suite 350
San Jose, CA 95110
www.jadeglobal.com
Northeast
1900 West Park Drive
Suite# 280
Westborough, MA 01581
Pune, India
E-Space IT Park, A-3, 2nd Floor
102 D/E, Wadgaon Sheri
Pune-Nagar Road,
Pune 411014, India
New Delhi, India
JMD Regent Square
M.G. Road, Level 6
Gurgaon, Haryana 122002, India
Worldwide Inquiries
+1-408-899-7200
pr@jadeglobal.com
Copyright © 2011. All rights reserved.
This document is provided for information purposes only and the contents hereof are subject to change without
notice. This document is not warranted to be error-free, nor subject to any other warranties or conditions, whether
expressed orally or implied in law, including implied warranties and conditions of merchant ability or fitness for a
particular purpose. We specifically disclaim any liability with respect to this document and no contractual obligations
are formed either directly or indirectly by this document. This document may not be reproduced or transmitted in any
form or by any means, electronic or mechanical, for any purpose, without our prior written permission.

Weitere ähnliche Inhalte

Was ist angesagt?

What is a Data Warehouse and How Do I Test It?
What is a Data Warehouse and How Do I Test It?What is a Data Warehouse and How Do I Test It?
What is a Data Warehouse and How Do I Test It?
RTTS
 
Data Warehouse Testing in the Pharmaceutical Industry
Data Warehouse Testing in the Pharmaceutical IndustryData Warehouse Testing in the Pharmaceutical Industry
Data Warehouse Testing in the Pharmaceutical Industry
RTTS
 
A data driven etl test framework sqlsat madison
A data driven etl test framework sqlsat madisonA data driven etl test framework sqlsat madison
A data driven etl test framework sqlsat madison
Terry Bunio
 

Was ist angesagt? (20)

ETL Testing Interview Questions and Answers
ETL Testing Interview Questions and AnswersETL Testing Interview Questions and Answers
ETL Testing Interview Questions and Answers
 
What is a Data Warehouse and How Do I Test It?
What is a Data Warehouse and How Do I Test It?What is a Data Warehouse and How Do I Test It?
What is a Data Warehouse and How Do I Test It?
 
Data Warehousing in Pharma: How to Find Bad Data while Meeting Regulatory Req...
Data Warehousing in Pharma: How to Find Bad Data while Meeting Regulatory Req...Data Warehousing in Pharma: How to Find Bad Data while Meeting Regulatory Req...
Data Warehousing in Pharma: How to Find Bad Data while Meeting Regulatory Req...
 
Etl And Data Test Guidelines For Large Applications
Etl And Data Test Guidelines For Large ApplicationsEtl And Data Test Guidelines For Large Applications
Etl And Data Test Guidelines For Large Applications
 
Introduction to ETL process
Introduction to ETL process Introduction to ETL process
Introduction to ETL process
 
Etl testing
Etl testingEtl testing
Etl testing
 
Testing data warehouse applications by Kirti Bhushan
Testing data warehouse applications by Kirti BhushanTesting data warehouse applications by Kirti Bhushan
Testing data warehouse applications by Kirti Bhushan
 
Etl process in data warehouse
Etl process in data warehouseEtl process in data warehouse
Etl process in data warehouse
 
Creating a Data validation and Testing Strategy
Creating a Data validation and Testing StrategyCreating a Data validation and Testing Strategy
Creating a Data validation and Testing Strategy
 
Get started with data migration
Get started with data migrationGet started with data migration
Get started with data migration
 
QuerySurge - the automated Data Testing solution
QuerySurge - the automated Data Testing solutionQuerySurge - the automated Data Testing solution
QuerySurge - the automated Data Testing solution
 
Data migration
Data migrationData migration
Data migration
 
Data Warehouse Testing in the Pharmaceutical Industry
Data Warehouse Testing in the Pharmaceutical IndustryData Warehouse Testing in the Pharmaceutical Industry
Data Warehouse Testing in the Pharmaceutical Industry
 
ETL Testing Overview
ETL Testing OverviewETL Testing Overview
ETL Testing Overview
 
A data driven etl test framework sqlsat madison
A data driven etl test framework sqlsat madisonA data driven etl test framework sqlsat madison
A data driven etl test framework sqlsat madison
 
Etl Overview (Extract, Transform, And Load)
Etl Overview (Extract, Transform, And Load)Etl Overview (Extract, Transform, And Load)
Etl Overview (Extract, Transform, And Load)
 
Completing the Data Equation: Test Data + Data Validation = Success
Completing the Data Equation: Test Data + Data Validation = SuccessCompleting the Data Equation: Test Data + Data Validation = Success
Completing the Data Equation: Test Data + Data Validation = Success
 
What is ETL testing & how to enforce it in Data Wharehouse
What is ETL testing & how to enforce it in Data WharehouseWhat is ETL testing & how to enforce it in Data Wharehouse
What is ETL testing & how to enforce it in Data Wharehouse
 
Database migration
Database migrationDatabase migration
Database migration
 
ETL Testing - Introduction to ETL testing
ETL Testing - Introduction to ETL testingETL Testing - Introduction to ETL testing
ETL Testing - Introduction to ETL testing
 

Ähnlich wie Migrating Data Warehouse Solutions from Oracle to non-Oracle Databases

Exploring Oracle Database Performance Tuning Best Practices for DBAs and Deve...
Exploring Oracle Database Performance Tuning Best Practices for DBAs and Deve...Exploring Oracle Database Performance Tuning Best Practices for DBAs and Deve...
Exploring Oracle Database Performance Tuning Best Practices for DBAs and Deve...
Aaron Shilo
 
שבוע אורקל 2016
שבוע אורקל 2016שבוע אורקל 2016
שבוע אורקל 2016
Aaron Shilo
 
How to Rapidly Configure Oracle Life Sciences Data Hub (LSH) to Support the M...
How to Rapidly Configure Oracle Life Sciences Data Hub (LSH) to Support the M...How to Rapidly Configure Oracle Life Sciences Data Hub (LSH) to Support the M...
How to Rapidly Configure Oracle Life Sciences Data Hub (LSH) to Support the M...
Perficient
 
Pradeep_ETL Testing_CV with 3 years of Exerience
Pradeep_ETL Testing_CV with 3 years of ExeriencePradeep_ETL Testing_CV with 3 years of Exerience
Pradeep_ETL Testing_CV with 3 years of Exerience
Pradeep Shahapur
 

Ähnlich wie Migrating Data Warehouse Solutions from Oracle to non-Oracle Databases (20)

Database performance management
Database performance managementDatabase performance management
Database performance management
 
Migration to Oracle 12c Made Easy Using Replication Technology
Migration to Oracle 12c Made Easy Using Replication TechnologyMigration to Oracle 12c Made Easy Using Replication Technology
Migration to Oracle 12c Made Easy Using Replication Technology
 
From Relational Database Management to Big Data: Solutions for Data Migration...
From Relational Database Management to Big Data: Solutions for Data Migration...From Relational Database Management to Big Data: Solutions for Data Migration...
From Relational Database Management to Big Data: Solutions for Data Migration...
 
Exploring Oracle Database Performance Tuning Best Practices for DBAs and Deve...
Exploring Oracle Database Performance Tuning Best Practices for DBAs and Deve...Exploring Oracle Database Performance Tuning Best Practices for DBAs and Deve...
Exploring Oracle Database Performance Tuning Best Practices for DBAs and Deve...
 
OMC_ITAnalytics_DataSheet
OMC_ITAnalytics_DataSheetOMC_ITAnalytics_DataSheet
OMC_ITAnalytics_DataSheet
 
E&P data management: Implementing data standards
E&P data management: Implementing data standardsE&P data management: Implementing data standards
E&P data management: Implementing data standards
 
Collaborate 2012-business data transformation and consolidation
Collaborate 2012-business data transformation and consolidationCollaborate 2012-business data transformation and consolidation
Collaborate 2012-business data transformation and consolidation
 
Collaborate 2012-business data transformation and consolidation for a global ...
Collaborate 2012-business data transformation and consolidation for a global ...Collaborate 2012-business data transformation and consolidation for a global ...
Collaborate 2012-business data transformation and consolidation for a global ...
 
Streamline it management
Streamline it managementStreamline it management
Streamline it management
 
Implement Test Harness For Streaming Data Pipelines
Implement Test Harness For Streaming Data PipelinesImplement Test Harness For Streaming Data Pipelines
Implement Test Harness For Streaming Data Pipelines
 
שבוע אורקל 2016
שבוע אורקל 2016שבוע אורקל 2016
שבוע אורקל 2016
 
86921864 olap-case-study-vj
86921864 olap-case-study-vj86921864 olap-case-study-vj
86921864 olap-case-study-vj
 
The Shifting Landscape of Data Integration
The Shifting Landscape of Data IntegrationThe Shifting Landscape of Data Integration
The Shifting Landscape of Data Integration
 
Delivering changes for applications and databases
Delivering changes for applications and databasesDelivering changes for applications and databases
Delivering changes for applications and databases
 
2013 OHSUG - Use Cases for Using the Program Type View in Oracle Life Science...
2013 OHSUG - Use Cases for Using the Program Type View in Oracle Life Science...2013 OHSUG - Use Cases for Using the Program Type View in Oracle Life Science...
2013 OHSUG - Use Cases for Using the Program Type View in Oracle Life Science...
 
Data warehouse testing
Data warehouse testingData warehouse testing
Data warehouse testing
 
How to Rapidly Configure Oracle Life Sciences Data Hub (LSH) to Support the M...
How to Rapidly Configure Oracle Life Sciences Data Hub (LSH) to Support the M...How to Rapidly Configure Oracle Life Sciences Data Hub (LSH) to Support the M...
How to Rapidly Configure Oracle Life Sciences Data Hub (LSH) to Support the M...
 
Delivering Changes for Applications and Databases
Delivering Changes for Applications and DatabasesDelivering Changes for Applications and Databases
Delivering Changes for Applications and Databases
 
S18 das
S18 dasS18 das
S18 das
 
Pradeep_ETL Testing_CV with 3 years of Exerience
Pradeep_ETL Testing_CV with 3 years of ExeriencePradeep_ETL Testing_CV with 3 years of Exerience
Pradeep_ETL Testing_CV with 3 years of Exerience
 

Mehr von Jade Global

Mehr von Jade Global (20)

How Life Sciences Can Meet the Track and Trace Supply Chain Challenge.pptx
How Life Sciences Can Meet the Track and Trace Supply Chain Challenge.pptxHow Life Sciences Can Meet the Track and Trace Supply Chain Challenge.pptx
How Life Sciences Can Meet the Track and Trace Supply Chain Challenge.pptx
 
The Future of API Management: Trends and Innovations
The Future of API Management: Trends and InnovationsThe Future of API Management: Trends and Innovations
The Future of API Management: Trends and Innovations
 
Why Boomi iPaaS is the Smart Choice for Your Integration Needs
Why Boomi iPaaS is the Smart Choice for Your Integration NeedsWhy Boomi iPaaS is the Smart Choice for Your Integration Needs
Why Boomi iPaaS is the Smart Choice for Your Integration Needs
 
How to Maximize Data Governance in Snowflake Test Environment
How to Maximize Data Governance in Snowflake Test EnvironmentHow to Maximize Data Governance in Snowflake Test Environment
How to Maximize Data Governance in Snowflake Test Environment
 
Rightsizing the Time and Cost of GxP
Rightsizing the Time and Cost of GxPRightsizing the Time and Cost of GxP
Rightsizing the Time and Cost of GxP
 
Top 5 Emerging Trends in Data Integration
Top 5 Emerging Trends in Data IntegrationTop 5 Emerging Trends in Data Integration
Top 5 Emerging Trends in Data Integration
 
Unlock the Power of Supply Chain Analytics
Unlock the Power of Supply Chain AnalyticsUnlock the Power of Supply Chain Analytics
Unlock the Power of Supply Chain Analytics
 
Seamless SAP and Salesforce Integration Tips, Techniques, and Best Practices
Seamless SAP and Salesforce Integration Tips, Techniques, and Best PracticesSeamless SAP and Salesforce Integration Tips, Techniques, and Best Practices
Seamless SAP and Salesforce Integration Tips, Techniques, and Best Practices
 
How to Leverage SAP To Meet Withholding Tax Challenges-completed
How to Leverage SAP To Meet Withholding Tax Challenges-completedHow to Leverage SAP To Meet Withholding Tax Challenges-completed
How to Leverage SAP To Meet Withholding Tax Challenges-completed
 
Nine Tips for a Successful SAP Concur Implementation
Nine Tips for a Successful SAP Concur ImplementationNine Tips for a Successful SAP Concur Implementation
Nine Tips for a Successful SAP Concur Implementation
 
4 Ways Automation-Driven SAP AMS Can Help You-completed
4 Ways Automation-Driven SAP AMS Can Help You-completed4 Ways Automation-Driven SAP AMS Can Help You-completed
4 Ways Automation-Driven SAP AMS Can Help You-completed
 
Why Businesses Must Adopt NetSuite ERP Data Migration
Why Businesses Must Adopt NetSuite ERP Data MigrationWhy Businesses Must Adopt NetSuite ERP Data Migration
Why Businesses Must Adopt NetSuite ERP Data Migration
 
EDI Integration Process Overview & Benefits for Multiple Channel Partners
EDI Integration Process Overview & Benefits for Multiple Channel PartnersEDI Integration Process Overview & Benefits for Multiple Channel Partners
EDI Integration Process Overview & Benefits for Multiple Channel Partners
 
Benefits of Upgrading Oracle E-Business Suite to Latest Release 12.2.11
Benefits of Upgrading Oracle E-Business Suite to Latest Release 12.2.11Benefits of Upgrading Oracle E-Business Suite to Latest Release 12.2.11
Benefits of Upgrading Oracle E-Business Suite to Latest Release 12.2.11
 
Why Should Businesses Partner with a NetSuite ERP Provider
Why Should Businesses Partner with a NetSuite ERP ProviderWhy Should Businesses Partner with a NetSuite ERP Provider
Why Should Businesses Partner with a NetSuite ERP Provider
 
NetSuite Email Campaigns Best Practices for Delivering Results
NetSuite Email Campaigns Best Practices for Delivering ResultsNetSuite Email Campaigns Best Practices for Delivering Results
NetSuite Email Campaigns Best Practices for Delivering Results
 
Oracle Integration Cloud – Pragmatic approach to integrations
Oracle Integration Cloud – Pragmatic approach to integrationsOracle Integration Cloud – Pragmatic approach to integrations
Oracle Integration Cloud – Pragmatic approach to integrations
 
P2P Cycle in Oracle Cloud Fusion
P2P Cycle in Oracle Cloud FusionP2P Cycle in Oracle Cloud Fusion
P2P Cycle in Oracle Cloud Fusion
 
Oracle Revenue Management Cloud Service (RMCS)
Oracle Revenue Management Cloud Service (RMCS)Oracle Revenue Management Cloud Service (RMCS)
Oracle Revenue Management Cloud Service (RMCS)
 
NetSuite Ship Central 
NetSuite Ship Central NetSuite Ship Central 
NetSuite Ship Central 
 

Kürzlich hochgeladen

CNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of ServiceCNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of Service
giselly40
 
Artificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and MythsArtificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and Myths
Joaquim Jorge
 

Kürzlich hochgeladen (20)

04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
 
GenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day PresentationGenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day Presentation
 
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdfThe Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
 
Partners Life - Insurer Innovation Award 2024
Partners Life - Insurer Innovation Award 2024Partners Life - Insurer Innovation Award 2024
Partners Life - Insurer Innovation Award 2024
 
Scaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationScaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organization
 
Evaluating the top large language models.pdf
Evaluating the top large language models.pdfEvaluating the top large language models.pdf
Evaluating the top large language models.pdf
 
CNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of ServiceCNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of Service
 
2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...
 
Artificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and MythsArtificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and Myths
 
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
 
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot TakeoffStrategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
 
Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024
 
08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking Men08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking Men
 
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law DevelopmentsTrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
 
08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men
 
presentation ICT roal in 21st century education
presentation ICT roal in 21st century educationpresentation ICT roal in 21st century education
presentation ICT roal in 21st century education
 
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
 
Boost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdfBoost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdf
 
Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...
Workshop - Best of Both Worlds_ Combine  KG and Vector search for  enhanced R...Workshop - Best of Both Worlds_ Combine  KG and Vector search for  enhanced R...
Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected Worker
 

Migrating Data Warehouse Solutions from Oracle to non-Oracle Databases

  • 1. w w w . j a d e g l o b a l . c o m A Jade Global White Paper Migrating Data Warehouse Solutions from Oracle to non-Oracle Databases A step-by-step How-To Guide By Manoj Machiwal, Consulting Manager
  • 2. 1 w w w . j a d e g l o b a l . c o m TABLE OF CONTENTS Preparing A Migration Plan 02 Before You Migrate 04 Capturing the Source Database 05 Creating and Customizing the Oracle Model 05 Migrating the Database 06 Testing the Oracle Database 06 Deploying the Oracle Database 07 Case Study 10
  • 3. 2 w w w . j a d e g l o b a l . c o m Though there are many standardized data warehouse solutions in the industry today, many organizations want to migrate their data warehouses to Oracle based ones primarily because of its widely accepted user base and superb support. This whitepaper is a step-by-step guide for migrating non-Oracle database solutions to Oracle ones. Preparing a Migration Plan The first step in a migration process is to identify databases that are to be migrated and applications that access the database. This step must go hand-in-hand with evaluating the business requirements that make use of these databases and also defining the test criteria.  Determining the requirements of Migration Project Listed below are some key questions that need to be answered to better assess the scope of the project, - What third-party databases are being migrating? - What are their versions? - What is the character set of the third-party database? - What source applications would be affected by migrating this third-party database to an Oracle database? - What is the third-party application language and its version? - Will the applications be re-written or modified to work with an Oracle database?  Analyzing the Operational Requirements This step identifies whether the migrating database is simple or complex. The table below serves as a guideline for distinguishing between simple and complex scenarios.
  • 4. 3 w w w . j a d e g l o b a l . c o m Complex Simple Large Database (> 1TB) Small Database (< 1 TB) Data warehouse Simple OLTP Database Large applications (with more than 100 forms and reports) Small applications (with few forms and reports) Distributed deployment Centralized deployment Larger business users (> 50) Less business users (< 50) High availability requirement Average availability (during business hours) Once an environmental scenario is identified, its operational requirements can be easily identified and taken into account while developing the project plan. The new environment may also need additional resources such as new hardware or added system resources and these have to be accounted for. A backup schedule for the new environment also needs to be determined.  Define the testing and acceptance criteria  Analyzing the application - Determine whether changes to the application are required to make them run effectively on the destination database. - Identify the number of connections to the database that are in the application and modify these connections to use the Oracle database. - Identify the embedded SQL statements that should change in the application before it can be tested against the Oracle database. A summation of all these steps should eventually lead to a well-defined project plan for the migration.
  • 5. 4 w w w . j a d e g l o b a l . c o m Before you migrate Zeroing on the Migration Technology - Tool Evaluation Identifying migration tools that match the project requirements closely is very important. A proof of concept for each of these tools is recommended. The following tools can automate the Migration process, o SQL Developer o Data warehouse builder o Custom Scripts, SQL Loader o Heterogeneous Services - Decision Factor Migration tools can be selected by rating them on factors listed below. o Efficiency o Data Loss o Data type mapping o Effort involved A ratings comparison would serve as a guideline for identifying the right tool.
  • 6. 5 w w w . j a d e g l o b a l . c o m Capturing the Source Database Before migrating a third-party database, information from the database must be extracted. This information is a representation of the structure of the source database called the Source Model. The process of extracting the information from the database is called capturing the source database. Capturing a source database involves creating a source Model ER Diagram, list of objects, type of objects, data types and all other database environment information. Most of these tasks can be automated by using a migration tool. A model can be created reverse engineering the data model in the source database. The appropriate Oracle model can be determined by identifying all the external interfaces to the database. Creating and Customizing the Oracle Model Before migrating to a third-party database, an Oracle Model must be created. The Oracle Model is a representation of the destination database structure. To obtain best results from the migrated database, an Oracle Model can be customized to use specific Oracle database features such as multiple tablespaces. Based on the Oracle database version, correct storage and database initialization parameters should be identified at this point. For better database performance, best practices such as collecting statistics, defining portioning strategy, defining indexing strategy and index monitoring scripts should be implemented.
  • 7. 6 w w w . j a d e g l o b a l . c o m Migrating the Database To migrate the source database, a customized Oracle data model must be created by implementing the steps for capturing the source database. Oracle recommends that the databases should be migrated in the following order: - Migrate tablespaces, users, and user tables - Migrate data - Migrate the remaining schema objects If no migration tools are being used, then all migration scripts can be created using SQL loader, or PL SQL scripts. These in turn can use external file features to read the source data from flat files. Programs should be written to convert data in the source database to a flat file format. Should this be not done, heterogonous services in the oracle database should be defined which can directly connect to the source database. All migration scripts should also be tested for performance as well. Testing the Oracle Database During the testing phase, the application and the Oracle database are tested to ensure, - Migrated data is complete and accurate - Applications function in the same way as the source database - Both the source and Oracle databases are producing the same results - All applications and the Oracle database meet the operational and performance requirements
  • 8. 7 w w w . j a d e g l o b a l . c o m A collection of unit and system tests from the original application may already exist which can be used to test the Oracle database. These tests should run in the same way as the tests against the source database. This section focuses only on the database testing. However, regardless of added features, it should be ensured that the application connects to the Oracle database and that the SQL statements it issues produces the correct results. Testing Methodology Many constraints shape the style and amount of testing that can be performed on a database. Testing can contain one or all of the following, - Simple data validation (Records count in source and destination database) - Full life cycle testing and addressing of individual units - System and acceptance testing Deploying the Oracle Database Rollout Strategies The strategy for migrating a third-party database to an Oracle database must take into consideration the users and the type of business that may be affected during the transition period. For example, the Big Bang approach can be used when enough systems aren’t available to run the source database and Oracle database simultaneously. On the other hand a phased approach can be taken to ensure that the system is operating in the user environment correctly before it is released to the general user population.
  • 9. 8 w w w . j a d e g l o b a l . c o m Phased Approach Using the phased approach, groups of users are migrated at different times. The selected users should represent a cross-section of the complete user-base. This approach allows profiling users as they are introduced to the Oracle database. The system can be reconfigured such that only selected users are affected by the migration and unscheduled outages only affect a small percentage of the user population. This approach may affect the users that are being migrated. However, because the number of users is limited, support services are not overloaded with issues. The phased approach allows us to debug scalability issues as the number of migrated users increases. However, using this approach may mean that data must be migrated to and from legacy systems during the migration process. The application architecture should also support a phased approach. Big Bang Approach Using the Big Bang approach, all the users are migrated at the same time. This approach may cause schedule outages during the time you are removing the old system, migrating the data, deploying the Oracle system, and testing that the system is operating correctly. This approach relies on testing the database on the same scale as the original database. It has the advantage of minimal data conversion and synchronization with the original database because that database is switched off. The disadvantage with this approach is that it can be labor intensive and disruptive for business activities due to the switch-over period needed to install the Oracle database and perform the other migration project tasks.
  • 10. 9 w w w . j a d e g l o b a l . c o m Parallel Approach Using the Parallel approach, both the source and destination Oracle databases are maintained simultaneously. To ensure that the application behaves the same way in the production environment for the source and destination databases, data is entered in both the databases and data results are analyzed. The advantage of this approach is, if problems occur in the destination database, users can continue using the source database. The disadvantage of the parallel approach is that running and maintaining both the source and the destination database may require more resources and hardware than other approaches.
  • 11. 10 w w w . j a d e g l o b a l . c o m Customer Case Study Industry – Manufacturing Customer Annual Revenue – 3000M Our clients were running their large data warehousing system on IBM redbrick and wished to migrate this to oracle 11g. As part of this migration they wanted to achieve, - Hardware migration to a new version of HP-UX - Data warehouse migration to oracle 11g from redbrick - An easy to scale Oracle 11g environment that allowed higher transaction levels without affecting performance levels - Mitigating the risk of rare skilled workers for redbrick Many tools were evaluated and finally custom scripts were selected for migration, which utilized external files and PL-SQL. We had extracted data from the source database in the form of flat files and used them to load data into the destination database using External files and PL-SQL. The parallel approach method was used for deployment considering the large user base and critical business requirements. This led to better testing on parallel systems as audit reports were generated and compared with both oracle and redbrick system to make sure the migration was successful.
  • 12. 11 w w w . j a d e g l o b a l . c o m About the Author Manoj Machiwal is a Consulting Manager at Jade Global. He has over 11 years of experience in Oracle DBA and Oracle Apps DBA. Manoj is a specialist in Upgrades, Migrations, High Availability and Performance, Datawarehouse architecting and Proactive Monitoring. Manoj has worked for some major names in the industry including Solyndra, Orbotech, Gallo Wineries, Silicon Storage Technology (SST), Telegent Systems, Riverbed Technology, Cisco Systems and Merrill Lynch. He is also an Oracle Certified Professional DBA . Manoj can be reached at manoj.machiwal@jadeglobal.com and on +1-408-899-7217.
  • 13. 12 w w w . j a d e g l o b a l . c o m Jade Global, Inc. Worldwide Headquarters 1731 Technology Drive Suite 350 San Jose, CA 95110 www.jadeglobal.com Northeast 1900 West Park Drive Suite# 280 Westborough, MA 01581 Pune, India E-Space IT Park, A-3, 2nd Floor 102 D/E, Wadgaon Sheri Pune-Nagar Road, Pune 411014, India New Delhi, India JMD Regent Square M.G. Road, Level 6 Gurgaon, Haryana 122002, India Worldwide Inquiries +1-408-899-7200 pr@jadeglobal.com Copyright © 2011. All rights reserved. This document is provided for information purposes only and the contents hereof are subject to change without notice. This document is not warranted to be error-free, nor subject to any other warranties or conditions, whether expressed orally or implied in law, including implied warranties and conditions of merchant ability or fitness for a particular purpose. We specifically disclaim any liability with respect to this document and no contractual obligations are formed either directly or indirectly by this document. This document may not be reproduced or transmitted in any form or by any means, electronic or mechanical, for any purpose, without our prior written permission.