Diese Präsentation wurde erfolgreich gemeldet.
Die SlideShare-Präsentation wird heruntergeladen. ×

The Time is Now! Migrating from OWB to ODI 12c

The Time is Now! Migrating from OWB to ODI 12c

Herunterladen, um offline zu lesen

Prior to the introduction of Data Integrator (ODI), Oracle had another data integration tool: Warehouse Builder (OWB). Usually positioned as an ETL tool, OWB excelled in environments with a strong footprint in the Oracle Database. Oracle's statement of direction has been clear: to deliver a unified data integration platform, combining the best from both tools into a true world class product. With ODI 12c, that day has arrived.

In this presentation, I’ll demonstrate the features available for migrating from OWB to ODI 12c. I’ll also describe a phased approach for doing a “right-time” conversion to ODI 12c, which involves migrating bite-sized chunks of OWB processes over to ODI when that migration adds legitimate value for the customer.

Prior to the introduction of Data Integrator (ODI), Oracle had another data integration tool: Warehouse Builder (OWB). Usually positioned as an ETL tool, OWB excelled in environments with a strong footprint in the Oracle Database. Oracle's statement of direction has been clear: to deliver a unified data integration platform, combining the best from both tools into a true world class product. With ODI 12c, that day has arrived.

In this presentation, I’ll demonstrate the features available for migrating from OWB to ODI 12c. I’ll also describe a phased approach for doing a “right-time” conversion to ODI 12c, which involves migrating bite-sized chunks of OWB processes over to ODI when that migration adds legitimate value for the customer.

Weitere Verwandte Inhalte

Ähnliche Bücher

Kostenlos mit einer 30-tägigen Testversion von Scribd

Alle anzeigen

Ähnliche Hörbücher

Kostenlos mit einer 30-tägigen Testversion von Scribd

Alle anzeigen

The Time is Now! Migrating from OWB to ODI 12c

  1. 1. The Time is Now! Migrating from Oracle Warehouse Builder to Oracle Data Integrator 12c www.RedPillAnalytics.com info@RedPillAnalytics.com @RedPillA © 2014 RED PILL Analytics 2 Stewart Bryson medium.com/@stewartbryson @stewartbryson linkedin.com/in/stewartbryson
  2. 2. © 2014 RED PILL Analytics Who is Red Pill Analytics?
  3. 3. Red Pill Analytics: Leadership www.RedPillAnalytics.com info@RedPillAnalytics.com @RedPillA © 2014 RED PILL Analytics 4 Stewart Bryson ! Oracle ACE Director ! Previously From: Rittman Mead Informix Software ! Data Warehousing & Business Intelligence since 1996 Kevin McGinley ! Oracle ACE Director ! Previously From: Accenture BI Consulting Group ! Data Warehousing & Business Intelligence since 1997
  4. 4. About Red Pill Analytics Other Services ! • Expert Retainer • Support • Training www.RedPillAnalytics.com info@RedPillAnalytics.com @RedPillA © 2014 RED PILL Analytics 5 ! ! • DevOps for BI and DI • Hosted or On-premise • Used in Capacity Analytics Capacity Analytics ! • Development-as-a-service • Agile methodology • Faster/cheaper than traditional consulting • Subscription billing
  5. 5. Oracle Technology Network White Paper www.RedPillAnalytics.com info@RedPillAnalytics.com @RedPillA © 2014 RED PILL Analytics 6
  6. 6. Oracle Technology Network White Paper www.RedPillAnalytics.com info@RedPillAnalytics.com @RedPillA © 2014 RED PILL Analytics 7 http://bit.ly/owb-odi Google Search: otn odi bryson
  7. 7. © 2014 RED PILL Analytics Oh Captain My Captain
  8. 8. © 2014 RED PILL Analytics Goodbye Old Friend
  9. 9. © 2014 RED PILL Analytics Migrations are Hard
  10. 10. © 2014 RED PILL Analytics Add Value
  11. 11. © 2014 RED PILL Analytics Have a Mission Statement
  12. 12. Mission Statement www.RedPillAnalytics.com info@RedPillAnalytics.com @RedPillA © 2014 RED PILL Analytics 13 Any task undertaken to migrate content from OWB to ODI will add immediate value to our BI stakeholders.
  13. 13. ODI 12c: Overview www.RedPillAnalytics.com info@RedPillAnalytics.com @RedPillA © 2014 RED PILL Analytics 14 Flow-Based Declarative Design with Component-Based Development New Mappings replace interfaces and allow multi-step design patterns Reusable Mappings and Datasets for Declarative Design similar to 11g
  14. 14. ODI 12c: Overview www.RedPillAnalytics.com info@RedPillAnalytics.com @RedPillA © 2014 RED PILL Analytics 15 Components Provide Multi-Step Process
  15. 15. ODI 12c: Overview www.RedPillAnalytics.com info@RedPillAnalytics.com @RedPillA © 2014 RED PILL Analytics 15 Components Provide Multi-Step Process Data Lineage built into the Mapping Editor
  16. 16. ODI 12c: Overview www.RedPillAnalytics.com info@RedPillAnalytics.com @RedPillA © 2014 RED PILL Analytics 16 Warehouse Builder-like Components including Pivot/Unpivot, Join, Expression, Set, etc.
  17. 17. ODI 12c: Overview www.RedPillAnalytics.com info@RedPillAnalytics.com @RedPillA © 2014 RED PILL Analytics 17 Component-Style KM’s encapsulate modular, reusable pieces of logic specific to particular Components
  18. 18. ODI 12c: Overview www.RedPillAnalytics.com info@RedPillAnalytics.com @RedPillA © 2014 RED PILL Analytics 18
  19. 19. Installing ODI 12c: Enterprise Installation www.RedPillAnalytics.com info@RedPillAnalytics.com @RedPillA © 2014 RED PILL Analytics 19 Enterprise Installation includes Fusion Middleware and supports Standalone Colocated Agents Handles configuration of the Master and Work repositories and other FMW tables (Work Tables) JEE Agents can utilize Weblogic Coherence for high availability
  20. 20. Installing ODI 12c: Enterprise Installation www.RedPillAnalytics.com info@RedPillAnalytics.com @RedPillA © 2014 RED PILL Analytics 20 Warning: FMW Needs to be installed for JEE Agents
  21. 21. Installing ODI 12c: Enterprise Installation www.RedPillAnalytics.com info@RedPillAnalytics.com @RedPillA © 2014 RED PILL Analytics 20 Warning: FMW Needs to be installed for JEE Agents Ignore This! The Enterprise Installation installs WLS and FMW behind the scenes
  22. 22. Installing ODI 12c: Enterprise Installation www.RedPillAnalytics.com info@RedPillAnalytics.com @RedPillA © 2014 RED PILL Analytics 21 Features Specifically Selected WLS and FMW are installed as an internal feature
  23. 23. Installing ODI 12c: Enterprise Installation www.RedPillAnalytics.com info@RedPillAnalytics.com @RedPillA © 2014 RED PILL Analytics 22 We get all this cool stuff!
  24. 24. Installing ODI 12c: Enterprise Installation www.RedPillAnalytics.com info@RedPillAnalytics.com @RedPillA © 2014 RED PILL Analytics 23
  25. 25. Repository Creation Utility www.RedPillAnalytics.com info@RedPillAnalytics.com @RedPillA © 2014 RED PILL Analytics 24 Recent Oracle Database versions, including 11gR2 and 12c, as well as DB2 and SQL Server Master Repository contains Topology information, Work Repository contains development information Creates Fusion Middleware tables, including Fusion Work Tables
  26. 26. Agents www.RedPillAnalytics.com info@RedPillAnalytics.com @RedPillA © 2014 RED PILL Analytics 25
  27. 27. Agents www.RedPillAnalytics.com info@RedPillAnalytics.com @RedPillA © 2014 RED PILL Analytics 26 ODI Agents execute load processes, including compiled Load Plans and Scenarios Somewhat comparable to the OWB Control Center (much, much better) Deployed as JEE Agents or Standalone Agents
  28. 28. Domain Configuration www.RedPillAnalytics.com info@RedPillAnalytics.com @RedPillA © 2014 RED PILL Analytics 27 Use built-in FMW and WLS functionality to “harden” our ODI Agents Our JEE-deployed ODI Agent is comparable to an ETL Server Utilizing Coherence gives us performance increases in certain circumstances, fault tolerance, etc.
  29. 29. Domain Configuration www.RedPillAnalytics.com info@RedPillAnalytics.com @RedPillA © 2014 RED PILL Analytics 28 Domain Configuration Templates make it easy to mix and match deployed functionality to our domain
  30. 30. Domain Configuration Service Table Schema (STB) stores relevant information from our install to www.RedPillAnalytics.com info@RedPillAnalytics.com @RedPillA © 2014 RED PILL Analytics 29 feed the templates
  31. 31. Domain Configuration www.RedPillAnalytics.com info@RedPillAnalytics.com @RedPillA © 2014 RED PILL Analytics 30 In the end, we have a WLS Domain complete with Admin Server and Managed Server
  32. 32. Domain Configuration www.RedPillAnalytics.com info@RedPillAnalytics.com @RedPillA © 2014 RED PILL Analytics 31
  33. 33. OWB Runtime Integration www.RedPillAnalytics.com info@RedPillAnalytics.com @RedPillA © 2014 RED PILL Analytics 32 Execute OWB processes as standard ODI processes, including Mappings and Process Flows Full execution from OWB Control Center captured in standard ODI audit tables Orchestrate our loads wherever we want: ODI Load Plans or OWB Process Flows
  34. 34. OWB Runtime Integration Topology www.RedPillAnalytics.com info@RedPillAnalytics.com @RedPillA © 2014 RED PILL Analytics 33 Data Server configured with OWB Workspace Owner
  35. 35. OWB Runtime Integration Topology www.RedPillAnalytics.com info@RedPillAnalytics.com @RedPillA © 2014 RED PILL Analytics 34 JDBC Configuration to the OWB Workspace
  36. 36. OWB Runtime Integration Topology www.RedPillAnalytics.com info@RedPillAnalytics.com @RedPillA © 2014 RED PILL Analytics 35 Configure the Workspace Owner as the Physical Schema
  37. 37. OWB Runtime Integration Topology www.RedPillAnalytics.com info@RedPillAnalytics.com @RedPillA © 2014 RED PILL Analytics 36 Setting a Logical Schema to abstract the Physical Schema and Data Server
  38. 38. OWB Runtime Integration Topology www.RedPillAnalytics.com info@RedPillAnalytics.com @RedPillA © 2014 RED PILL Analytics 37
  39. 39. OWB Runtime Integration Execution www.RedPillAnalytics.com info@RedPillAnalytics.com @RedPillA © 2014 RED PILL Analytics 38 Use the ODI Package Editor and the new OdiStartOwbJob tool We can execute Mappings or Process Flows OdiStartOwbJob "-WORKSPACE=OWBREP" "-LOCATION=OWF_MGR" "-OBJECT_NAME=SBATCH/MAIN_LOAD" "-OBJECT_TYPE=PROCESSFLOW"
  40. 40. OWB Runtime Integration Execution www.RedPillAnalytics.com info@RedPillAnalytics.com @RedPillA © 2014 RED PILL Analytics 39 ODI Scenario for Process Flow
  41. 41. OWB Runtime Integration Execution www.RedPillAnalytics.com info@RedPillAnalytics.com @RedPillA © 2014 RED PILL Analytics 39 ODI Scenario for Process Flow Main Process Flow execution
  42. 42. OWB Runtime Integration Execution www.RedPillAnalytics.com info@RedPillAnalytics.com @RedPillA © 2014 RED PILL Analytics 39 ODI Scenario for Process Flow Main Process Flow execution Sub-Process Flow execution Sub-Process Flow execution
  43. 43. OWB Runtime Integration Execution Main Process Flow execution Sub-Process Flow execution www.RedPillAnalytics.com info@RedPillAnalytics.com @RedPillA © 2014 RED PILL Analytics 39 ODI Scenario for Process Flow Mapping Execution Sub-Process Flow execution Mapping Execution
  44. 44. OWB Runtime Integration Execution www.RedPillAnalytics.com info@RedPillAnalytics.com @RedPillA © 2014 RED PILL Analytics 40 Full Auditing Results
  45. 45. OWB Runtime Integration Execution www.RedPillAnalytics.com info@RedPillAnalytics.com @RedPillA © 2014 RED PILL Analytics 41
  46. 46. Migration Utility www.RedPillAnalytics.com info@RedPillAnalytics.com @RedPillA © 2014 RED PILL Analytics 42 Supports 11.2.0.4 of Warehouse Builder with Patch 17830453 Apply Patch 17053768 to Data Integrator if not already included in release Command-line utility to perform the OWB to ODI Migration
  47. 47. Migration Utility: Run Modes FAST_CHECK Performs a read-only check of the OWB repository and reports back the items than can and cannot be migrated. DRY_RUN Performs a migration to ODI using the ODI 12c SDK, but does not perform a commit at the end of the process. RUN (Default) Executes the migration and commits migrated objects to the target ODI 12c repository. www.RedPillAnalytics.com info@RedPillAnalytics.com @RedPillA © 2014 RED PILL Analytics 43
  48. 48. Migration Utility: Configuration www.RedPillAnalytics.com info@RedPillAnalytics.com @RedPillA © 2014 RED PILL Analytics 44 ODI Master Repository Connection Information
  49. 49. Migration Utility: Configuration www.RedPillAnalytics.com info@RedPillAnalytics.com @RedPillA © 2014 RED PILL Analytics 44 ODI Master Repository Connection Information ODI Work Repository Information
  50. 50. Migration Utility: Configuration www.RedPillAnalytics.com info@RedPillAnalytics.com @RedPillA © 2014 RED PILL Analytics 44 ODI Master Repository Connection Information ODI Work Repository Information OWB Workspace Information
  51. 51. Migration Utility: Configuration OWB Workspace Information www.RedPillAnalytics.com info@RedPillAnalytics.com @RedPillA © 2014 RED PILL Analytics 44 ODI Master Repository Connection Information ODI Work Repository Information Migration Options
  52. 52. Migration Utility: Configuration www.RedPillAnalytics.com info@RedPillAnalytics.com @RedPillA © 2014 RED PILL Analytics 45
  53. 53. Migration Utility: Configuration www.RedPillAnalytics.com info@RedPillAnalytics.com @RedPillA © 2014 RED PILL Analytics 45 ODI and OWB passwords Configuration File
  54. 54. Migration Utility: Configuration www.RedPillAnalytics.com info@RedPillAnalytics.com @RedPillA © 2014 RED PILL Analytics 46 Migration Results
  55. 55. Migration Utility: Configuration Migrated Mappings Migrated Models www.RedPillAnalytics.com info@RedPillAnalytics.com @RedPillA © 2014 RED PILL Analytics 47
  56. 56. Migration Utility: Configuration www.RedPillAnalytics.com info@RedPillAnalytics.com @RedPillA © 2014 RED PILL Analytics 48
  57. 57. Oracle Warehouse Builder (Our Old Friend) www.RedPillAnalytics.com info@RedPillAnalytics.com @RedPillA © 2014 RED PILL Analytics 50 Wildly Successful • Flow-based design • High-performing code (EL-T) • Ships with Database 10g and 11g • PL/SQL Code Generation • Freemium model Deprecated •Certified (not shipped) with Database 12c • In maintenance mode Limited Integration Capabilities
  58. 58. Oracle Data Integrator 12c www.RedPillAnalytics.com info@RedPillAnalytics.com @RedPillA © 2014 RED PILL Analytics 52 Best of both worlds! •Now with flow-based design • High-performing code (EL-T) •Knowledge Module architecture • Enterprise Manager integration • Fusion Middleware integration Is there value in changing? • “Our organization has a major investment in OWB” • “Our mappings and process flows just work”
  59. 59. If Only There Was a Way to… www.RedPillAnalytics.com info@RedPillAnalytics.com @RedPillA © 2014 RED PILL Analytics 53
  60. 60. If Only There Was a Way to… www.RedPillAnalytics.com info@RedPillAnalytics.com @RedPillA © 2014 RED PILL Analytics 54 Maintain investment in OWB •Continue to execute legacy code • Only port our code when it presents value to do so Blaze new trails with ODI 12c •Fantastic new features are dying to be used •The Knowledge Module (KM) architecture pays huge dividends Deploy a coherent strategy • Shouldn’t feel like two tools
  61. 61. © 2014 RED PILL Analytics It’s not an easy choice
  62. 62. Phase 1: Run OWB Process Flows in ODI www.RedPillAnalytics.com info@RedPillAnalytics.com @RedPillA © 2014 RED PILL Analytics 56
  63. 63. Phase 1: Run OWB Process Flows in ODI www.RedPillAnalytics.com info@RedPillAnalytics.com @RedPillA © 2014 RED PILL Analytics 57
  64. 64. Phase 2: Orchestrate our OWB Mappings in ODI www.RedPillAnalytics.com info@RedPillAnalytics.com @RedPillA © 2014 RED PILL Analytics 58
  65. 65. Phase 2: Orchestrate our OWB Mappings in ODI www.RedPillAnalytics.com info@RedPillAnalytics.com @RedPillA © 2014 RED PILL Analytics 59
  66. 66. Phase 2: Orchestrate our OWB Mappings in ODI www.RedPillAnalytics.com info@RedPillAnalytics.com @RedPillA © 2014 RED PILL Analytics 60
  67. 67. Phase 3: Re-implement in ODI When Necessary www.RedPillAnalytics.com info@RedPillAnalytics.com @RedPillA © 2014 RED PILL Analytics 61
  68. 68. Phase 3: Re-implement in ODI When Necessary www.RedPillAnalytics.com info@RedPillAnalytics.com @RedPillA © 2014 RED PILL Analytics 62
  69. 69. Phase 3: Re-implement in ODI When Necessary www.RedPillAnalytics.com info@RedPillAnalytics.com @RedPillA © 2014 RED PILL Analytics 63

×