SlideShare ist ein Scribd-Unternehmen logo
1 von 12
Data integration
A case study on the creation
of an integration framework
for the Oil & Gas industry




www.etlsolutions.com
Introduction
    Transformation Manager, our data integration toolkit for developers,
    is used to efficiently connect oil and gas data stores with the
    industry„s leading integration standard.


•   Our client is a global oilfield services
    company with a long track record in the Oil
    & Gas industry.
•   To maintain their position as the leader in
    the sector, the client‟s new product
    development plan included a Professional
    Petroleum Data Model (PPDM) based
    software product.
The challenge


•   The product required a data integration
    framework capable of tackling multiple and
    diverse Exploration & Production (E&P) data
    sources.
•   The challenge was to develop scalable export
    components from the underlying PPDM
    database to LAS, DLIS and WITSML.
The solution
•   After evaluating a range of potential data integration
    tools, the client chose our professional services and
    Transformation Manager software for a number of                   Transformation
    reasons:                                                           Manager data
     •   We have a long and successful track record in E&P           movement software
         technical data management.
     •   We offer a comprehensive service to help in the design
         and development of all the required export components, in
         a highly competitive and risk sharing commercial
         arrangement.
     •   We have a track record of delivering on budget and to
         client deadline.                                               Consultancy
     •   Transformation Manager offers a tried and tested toolset        services
         for the efficient delivery of the project.
     •   Transformation Manager has the ability to connect and
         transform all the data types and footprint required.
     •   We were able to provide an integrated solution fitting
         directly into the client architecture.
•   The project was divided into three stages…
Phase 1: Design phase

•   The architecture design defined the
    deployment code framework, specifying the
    interaction between the client‟s product
    architecture and Transformation Manager‟s
    own deployment code.
•   Mapping rules were defined in conjunction
    with the client. A mapping rule spreadsheet
    was created for each export function,
    containing the PPDM table/element level
    mappings to file format specifications.
•   Output file formats were also specified,
    particularly any requirements not already
    defined by the standards. These included
    ordering, spacing, custom sections and data
    type representation.
Phase 2: deployment code framework development

•   The deployment code was developed to a
    range of specifications, including export
    parameters and reporting requirements.
•   The framework‟s interfaces were hooked up to
    the implementations required by the client‟s
    product using JNDI. This obtained a database
    connection and performed the other tasks
    required.
•   The export code included transforms
    generated with Transformation Manager.
    Using the software‟s TM Designer application,
    the client‟s developers are now able to specify
    the rules by which the PPDM source data is
    mapped to the target data.
Phase 3: Export function development

•   As mentioned, the project focused on three file
    formats: LAS, DLIS and WITSML. For each format,
    a set of tests were defined. These tests consisted
    of a sample set of PPDM data and the export file to
    be produced, which were then used for final
    acceptance testing.
•   Our consultants tested the deployment code and
    mapping implementation, and also conducted
    performance testing. Integration testing was a joint
    activity between our consultants and the client‟s
    developers. The client carried out acceptance and
    final performance testing, with support from our
    team.
•   The transforms created in this phase conformed to
    the mapping rules defined in Phase 1. The adapter
    for each file format was designed to be scalable to
    meet the requirements defined during the design
    phase.
The result


•   We used our expertise, tools and
    commercial flexibility to meet a challenging
    client requirement. Our team delivered a
    component which can efficiently deploy
    PPDM data to a range of the most popular
    file formats.
•   The client is able to benefit from reduced
    risk and cost, alongside increased control
    and transparency of their own clients‟ E&P
    data.
Why Transformation Manager?

For the user:    Everything under one roof
                 Greater control and
                  transparency
                 Identify and test against errors
                  iteratively
                 Greater understanding of the
                  transformation requirement
                 Automatically document
                 Re-use and change
                  management
                 Uses domain specific
                  terminology in the mapping
Why Transformation Manager?

For the business:    Reduces cost and effort
                     Reduces risk in the project
                     Delivers higher quality and
                      reduces error
                     Increases control and
                      transparency in the
                      development
                     Single product
                     Reduces time to market
Why ETL Solutions?

                                                         ““We‟ve cut a six-month project
• 10-year track record in data                              down to three months…a
  management, working with global blue                  sophisticated product that is easy
                                                         to work with and maintain AND
  chip clients                                             gives us great performance.
• Unparalleled knowledge from our team of                 We‟re very confident with the
                                                                    solution."
  data integration experts, many of whom                       Arnaud Daeschner,
  have been with us since inception                               BNP Paribas

• Our Transformation Manager and
  DataHub software have been proven in
  even the most complex data movements                      “Honda has been seeking to
                                                              achieve Dealer Network
• Expert support: first line of contact is with          Integration for the last ten years.
                                                          With the help of ETL Solutions,
  a developer or consultant                               this has finally been achieved.
• Data integration focus – it‟s all that we do           Considering the success, Honda
                                                           is now planning to extend this
                                                             approach to the European
                                                                      dealers.”
                                                            Michael Doyle, Honda UK


                                  ©2009 ETL Solutions
Contact us for more information:
   Karl Glenn, Business Development Director
   kg@etlsolutions.com
   +44 (0) 1912 894040


   Read more on our website:
   www.etlsolutions.com




                                                                     Raising data
                                                                     management
                                                                      standards
www.etlsolutions.com
 www.etlsolutions.com
                                               Images from Free Digital Photos freedigitalphotos.net

Weitere ähnliche Inhalte

Was ist angesagt?

PJM01_RUC_2003_Presentation
PJM01_RUC_2003_PresentationPJM01_RUC_2003_Presentation
PJM01_RUC_2003_PresentationLisa Statland
 
Blaine Wolff Resume
Blaine Wolff ResumeBlaine Wolff Resume
Blaine Wolff Resumebwolff52
 
Sandip Mukherjee Profile
Sandip Mukherjee ProfileSandip Mukherjee Profile
Sandip Mukherjee Profilesandipm
 
Resume G Bisanz Detailed Feb22012
Resume G Bisanz Detailed Feb22012Resume G Bisanz Detailed Feb22012
Resume G Bisanz Detailed Feb22012Gregory Bisanz
 
Cipher Introduction
Cipher IntroductionCipher Introduction
Cipher Introductionmmmmmm_mala
 
Bohill Consulting Project Management And Solutions Consultancy
Bohill Consulting   Project Management And Solutions ConsultancyBohill Consulting   Project Management And Solutions Consultancy
Bohill Consulting Project Management And Solutions Consultancygabrielleburns
 
Software Development 1 June2012
Software Development 1 June2012Software Development 1 June2012
Software Development 1 June2012Jay Encarnacion
 
Overview of Rational Services Offerings
Overview of Rational Services OfferingsOverview of Rational Services Offerings
Overview of Rational Services OfferingsIBM Rational software
 
Jack Holcombe
Jack HolcombeJack Holcombe
Jack Holcombejack0352
 
Nagaraj Nayakar Resume IBM
Nagaraj Nayakar Resume IBMNagaraj Nayakar Resume IBM
Nagaraj Nayakar Resume IBMnagaraj nayakar
 
ITIL compliant Open Source tools
ITIL compliant Open Source toolsITIL compliant Open Source tools
ITIL compliant Open Source toolsBruno Cornec
 
[QUATIC 2012] A Multi-Model Case Study: High Maturity in Development + Servic...
[QUATIC 2012] A Multi-Model Case Study: High Maturity in Development + Servic...[QUATIC 2012] A Multi-Model Case Study: High Maturity in Development + Servic...
[QUATIC 2012] A Multi-Model Case Study: High Maturity in Development + Servic...Strongstep - Innovation in software quality
 
Business Process Management - From Market Consolidation to Process Innovation
Business Process Management - From Market Consolidation to Process InnovationBusiness Process Management - From Market Consolidation to Process Innovation
Business Process Management - From Market Consolidation to Process InnovationMichael zur Muehlen
 
Guide to New Product Development (NPD)
Guide to New Product Development (NPD)Guide to New Product Development (NPD)
Guide to New Product Development (NPD)Technology Multipliers
 
Rapid Software Development Process
Rapid Software Development ProcessRapid Software Development Process
Rapid Software Development ProcessThanh Nguyen
 
How business process mapping saved an IT project.
How business process mapping saved an IT project.How business process mapping saved an IT project.
How business process mapping saved an IT project.Garrett Hunter
 

Was ist angesagt? (20)

PJM01_RUC_2003_Presentation
PJM01_RUC_2003_PresentationPJM01_RUC_2003_Presentation
PJM01_RUC_2003_Presentation
 
Blaine Wolff Resume
Blaine Wolff ResumeBlaine Wolff Resume
Blaine Wolff Resume
 
Sandip Mukherjee Profile
Sandip Mukherjee ProfileSandip Mukherjee Profile
Sandip Mukherjee Profile
 
Resume G Bisanz Detailed Feb22012
Resume G Bisanz Detailed Feb22012Resume G Bisanz Detailed Feb22012
Resume G Bisanz Detailed Feb22012
 
Cipher Introduction
Cipher IntroductionCipher Introduction
Cipher Introduction
 
Bohill Consulting Project Management And Solutions Consultancy
Bohill Consulting   Project Management And Solutions ConsultancyBohill Consulting   Project Management And Solutions Consultancy
Bohill Consulting Project Management And Solutions Consultancy
 
DianaTChua
DianaTChuaDianaTChua
DianaTChua
 
Software Development 1 June2012
Software Development 1 June2012Software Development 1 June2012
Software Development 1 June2012
 
Overview of Rational Services Offerings
Overview of Rational Services OfferingsOverview of Rational Services Offerings
Overview of Rational Services Offerings
 
Jack Holcombe
Jack HolcombeJack Holcombe
Jack Holcombe
 
Short version
Short versionShort version
Short version
 
Nagaraj Nayakar Resume IBM
Nagaraj Nayakar Resume IBMNagaraj Nayakar Resume IBM
Nagaraj Nayakar Resume IBM
 
ITIL compliant Open Source tools
ITIL compliant Open Source toolsITIL compliant Open Source tools
ITIL compliant Open Source tools
 
Indranil Pujari - v2
Indranil Pujari - v2Indranil Pujari - v2
Indranil Pujari - v2
 
[QUATIC 2012] A Multi-Model Case Study: High Maturity in Development + Servic...
[QUATIC 2012] A Multi-Model Case Study: High Maturity in Development + Servic...[QUATIC 2012] A Multi-Model Case Study: High Maturity in Development + Servic...
[QUATIC 2012] A Multi-Model Case Study: High Maturity in Development + Servic...
 
Business Process Management - From Market Consolidation to Process Innovation
Business Process Management - From Market Consolidation to Process InnovationBusiness Process Management - From Market Consolidation to Process Innovation
Business Process Management - From Market Consolidation to Process Innovation
 
Guide to New Product Development (NPD)
Guide to New Product Development (NPD)Guide to New Product Development (NPD)
Guide to New Product Development (NPD)
 
Sheldon cousino resume
Sheldon cousino resumeSheldon cousino resume
Sheldon cousino resume
 
Rapid Software Development Process
Rapid Software Development ProcessRapid Software Development Process
Rapid Software Development Process
 
How business process mapping saved an IT project.
How business process mapping saved an IT project.How business process mapping saved an IT project.
How business process mapping saved an IT project.
 

Ähnlich wie Data integration case study: Oil & Gas industry

Data integration case study: Automotive industry
Data integration case study: Automotive industryData integration case study: Automotive industry
Data integration case study: Automotive industryETLSolutions
 
Cynoteck - Salesforce Presentation - Consulting Services
Cynoteck  -  Salesforce Presentation - Consulting ServicesCynoteck  -  Salesforce Presentation - Consulting Services
Cynoteck - Salesforce Presentation - Consulting ServicesRosa Aguiar Catraio
 
Des serveurs créés pour vos usages specifiques, vous en avez reve HP l'a fait.
Des serveurs créés pour vos usages specifiques, vous en avez reve HP l'a fait.Des serveurs créés pour vos usages specifiques, vous en avez reve HP l'a fait.
Des serveurs créés pour vos usages specifiques, vous en avez reve HP l'a fait.Microsoft Décideurs IT
 
Des serveurs créés pour vos usages specifiques, vous en avez reve HP l'a fait.
Des serveurs créés pour vos usages specifiques, vous en avez reve HP l'a fait.Des serveurs créés pour vos usages specifiques, vous en avez reve HP l'a fait.
Des serveurs créés pour vos usages specifiques, vous en avez reve HP l'a fait.Microsoft Technet France
 
Add Agility to Your Business Communications
Add Agility to Your Business CommunicationsAdd Agility to Your Business Communications
Add Agility to Your Business CommunicationsPrecisely
 
[WSO2Con USA 2018] Winning Strategy For Enterprise Integration to Empower Dig...
[WSO2Con USA 2018] Winning Strategy For Enterprise Integration to Empower Dig...[WSO2Con USA 2018] Winning Strategy For Enterprise Integration to Empower Dig...
[WSO2Con USA 2018] Winning Strategy For Enterprise Integration to Empower Dig...WSO2
 
Make A Stress Free Move To The Cloud: Application Modernization and Managemen...
Make A Stress Free Move To The Cloud: Application Modernization and Managemen...Make A Stress Free Move To The Cloud: Application Modernization and Managemen...
Make A Stress Free Move To The Cloud: Application Modernization and Managemen...Dell World
 
GrayCell Corporate Presentation
GrayCell Corporate PresentationGrayCell Corporate Presentation
GrayCell Corporate PresentationAmit-GrayCell
 
Goken Corporate Presentation - Interiors & Seating
Goken Corporate Presentation - Interiors & SeatingGoken Corporate Presentation - Interiors & Seating
Goken Corporate Presentation - Interiors & SeatingAshleyTaylor66055
 
ITMAGINATION - competences, facts, technologies, clients
ITMAGINATION - competences, facts, technologies, clientsITMAGINATION - competences, facts, technologies, clients
ITMAGINATION - competences, facts, technologies, clientsITMAGINATION
 
Cp Company Overview
Cp Company OverviewCp Company Overview
Cp Company Overviewssbhatia
 
shoubhik_Resume_latest
shoubhik_Resume_latestshoubhik_Resume_latest
shoubhik_Resume_latestShoubhik Ghosh
 
Cobb Solutions Overview 6-28-12
Cobb Solutions Overview 6-28-12Cobb Solutions Overview 6-28-12
Cobb Solutions Overview 6-28-12Michael Swart
 
Benchmarking As a Tool for Optimising Software Development Performance
Benchmarking As a Tool for Optimising Software Development PerformanceBenchmarking As a Tool for Optimising Software Development Performance
Benchmarking As a Tool for Optimising Software Development PerformanceDCG Software Value
 
Webinar: 5 Clear Steps to Get Your Nonprofit Cloud Ready - 2018-5-31
Webinar: 5 Clear Steps to Get Your Nonprofit Cloud Ready - 2018-5-31Webinar: 5 Clear Steps to Get Your Nonprofit Cloud Ready - 2018-5-31
Webinar: 5 Clear Steps to Get Your Nonprofit Cloud Ready - 2018-5-31TechSoup
 
Satyam Business Honeycomb Booklet
Satyam Business Honeycomb BookletSatyam Business Honeycomb Booklet
Satyam Business Honeycomb Bookletguestff9c4c73
 

Ähnlich wie Data integration case study: Oil & Gas industry (20)

Data integration case study: Automotive industry
Data integration case study: Automotive industryData integration case study: Automotive industry
Data integration case study: Automotive industry
 
Cynoteck - Salesforce Presentation - Consulting Services
Cynoteck  -  Salesforce Presentation - Consulting ServicesCynoteck  -  Salesforce Presentation - Consulting Services
Cynoteck - Salesforce Presentation - Consulting Services
 
DevOps with Chef
DevOps with ChefDevOps with Chef
DevOps with Chef
 
Des serveurs créés pour vos usages specifiques, vous en avez reve HP l'a fait.
Des serveurs créés pour vos usages specifiques, vous en avez reve HP l'a fait.Des serveurs créés pour vos usages specifiques, vous en avez reve HP l'a fait.
Des serveurs créés pour vos usages specifiques, vous en avez reve HP l'a fait.
 
Des serveurs créés pour vos usages specifiques, vous en avez reve HP l'a fait.
Des serveurs créés pour vos usages specifiques, vous en avez reve HP l'a fait.Des serveurs créés pour vos usages specifiques, vous en avez reve HP l'a fait.
Des serveurs créés pour vos usages specifiques, vous en avez reve HP l'a fait.
 
Add Agility to Your Business Communications
Add Agility to Your Business CommunicationsAdd Agility to Your Business Communications
Add Agility to Your Business Communications
 
[WSO2Con USA 2018] Winning Strategy For Enterprise Integration to Empower Dig...
[WSO2Con USA 2018] Winning Strategy For Enterprise Integration to Empower Dig...[WSO2Con USA 2018] Winning Strategy For Enterprise Integration to Empower Dig...
[WSO2Con USA 2018] Winning Strategy For Enterprise Integration to Empower Dig...
 
Make A Stress Free Move To The Cloud: Application Modernization and Managemen...
Make A Stress Free Move To The Cloud: Application Modernization and Managemen...Make A Stress Free Move To The Cloud: Application Modernization and Managemen...
Make A Stress Free Move To The Cloud: Application Modernization and Managemen...
 
GrayCell Corporate Presentation
GrayCell Corporate PresentationGrayCell Corporate Presentation
GrayCell Corporate Presentation
 
Goken Corporate Presentation - Interiors & Seating
Goken Corporate Presentation - Interiors & SeatingGoken Corporate Presentation - Interiors & Seating
Goken Corporate Presentation - Interiors & Seating
 
It assessment case study
It assessment case studyIt assessment case study
It assessment case study
 
ITMAGINATION - competences, facts, technologies, clients
ITMAGINATION - competences, facts, technologies, clientsITMAGINATION - competences, facts, technologies, clients
ITMAGINATION - competences, facts, technologies, clients
 
Cp Company Overview
Cp Company OverviewCp Company Overview
Cp Company Overview
 
Everything ITROI
Everything  ITROIEverything  ITROI
Everything ITROI
 
shoubhik_Resume_latest
shoubhik_Resume_latestshoubhik_Resume_latest
shoubhik_Resume_latest
 
Cobb Solutions Overview 6-28-12
Cobb Solutions Overview 6-28-12Cobb Solutions Overview 6-28-12
Cobb Solutions Overview 6-28-12
 
Benchmarking As a Tool for Optimising Software Development Performance
Benchmarking As a Tool for Optimising Software Development PerformanceBenchmarking As a Tool for Optimising Software Development Performance
Benchmarking As a Tool for Optimising Software Development Performance
 
About Atidan 2016
About Atidan 2016About Atidan 2016
About Atidan 2016
 
Webinar: 5 Clear Steps to Get Your Nonprofit Cloud Ready - 2018-5-31
Webinar: 5 Clear Steps to Get Your Nonprofit Cloud Ready - 2018-5-31Webinar: 5 Clear Steps to Get Your Nonprofit Cloud Ready - 2018-5-31
Webinar: 5 Clear Steps to Get Your Nonprofit Cloud Ready - 2018-5-31
 
Satyam Business Honeycomb Booklet
Satyam Business Honeycomb BookletSatyam Business Honeycomb Booklet
Satyam Business Honeycomb Booklet
 

Mehr von ETLSolutions

How to create a successful proof of concept
How to create a successful proof of conceptHow to create a successful proof of concept
How to create a successful proof of conceptETLSolutions
 
DMS data integration: 6 ways to get it right
DMS data integration: 6 ways to get it rightDMS data integration: 6 ways to get it right
DMS data integration: 6 ways to get it rightETLSolutions
 
WITSML to PPDM mapping project
WITSML to PPDM mapping projectWITSML to PPDM mapping project
WITSML to PPDM mapping projectETLSolutions
 
How to prepare data before a data migration
How to prepare data before a data migrationHow to prepare data before a data migration
How to prepare data before a data migrationETLSolutions
 
E&P data management: Implementing data standards
E&P data management: Implementing data standardsE&P data management: Implementing data standards
E&P data management: Implementing data standardsETLSolutions
 
An example of a successful proof of concept
An example of a successful proof of conceptAn example of a successful proof of concept
An example of a successful proof of conceptETLSolutions
 
Migrating data: How to reduce risk
Migrating data: How to reduce riskMigrating data: How to reduce risk
Migrating data: How to reduce riskETLSolutions
 
Preparing a data migration plan: A practical guide
Preparing a data migration plan: A practical guidePreparing a data migration plan: A practical guide
Preparing a data migration plan: A practical guideETLSolutions
 
A 5-step methodology for complex E&P data management
A 5-step methodology for complex E&P data managementA 5-step methodology for complex E&P data management
A 5-step methodology for complex E&P data managementETLSolutions
 
Automotive data integration: An example of a successful project structure
Automotive data integration: An example of a successful project structureAutomotive data integration: An example of a successful project structure
Automotive data integration: An example of a successful project structureETLSolutions
 

Mehr von ETLSolutions (10)

How to create a successful proof of concept
How to create a successful proof of conceptHow to create a successful proof of concept
How to create a successful proof of concept
 
DMS data integration: 6 ways to get it right
DMS data integration: 6 ways to get it rightDMS data integration: 6 ways to get it right
DMS data integration: 6 ways to get it right
 
WITSML to PPDM mapping project
WITSML to PPDM mapping projectWITSML to PPDM mapping project
WITSML to PPDM mapping project
 
How to prepare data before a data migration
How to prepare data before a data migrationHow to prepare data before a data migration
How to prepare data before a data migration
 
E&P data management: Implementing data standards
E&P data management: Implementing data standardsE&P data management: Implementing data standards
E&P data management: Implementing data standards
 
An example of a successful proof of concept
An example of a successful proof of conceptAn example of a successful proof of concept
An example of a successful proof of concept
 
Migrating data: How to reduce risk
Migrating data: How to reduce riskMigrating data: How to reduce risk
Migrating data: How to reduce risk
 
Preparing a data migration plan: A practical guide
Preparing a data migration plan: A practical guidePreparing a data migration plan: A practical guide
Preparing a data migration plan: A practical guide
 
A 5-step methodology for complex E&P data management
A 5-step methodology for complex E&P data managementA 5-step methodology for complex E&P data management
A 5-step methodology for complex E&P data management
 
Automotive data integration: An example of a successful project structure
Automotive data integration: An example of a successful project structureAutomotive data integration: An example of a successful project structure
Automotive data integration: An example of a successful project structure
 

Kürzlich hochgeladen

Microservices, Docker deploy and Microservices source code in C#
Microservices, Docker deploy and Microservices source code in C#Microservices, Docker deploy and Microservices source code in C#
Microservices, Docker deploy and Microservices source code in C#Karmanjay Verma
 
Microsoft 365 Copilot: How to boost your productivity with AI – Part two: Dat...
Microsoft 365 Copilot: How to boost your productivity with AI – Part two: Dat...Microsoft 365 Copilot: How to boost your productivity with AI – Part two: Dat...
Microsoft 365 Copilot: How to boost your productivity with AI – Part two: Dat...Nikki Chapple
 
Generative Artificial Intelligence: How generative AI works.pdf
Generative Artificial Intelligence: How generative AI works.pdfGenerative Artificial Intelligence: How generative AI works.pdf
Generative Artificial Intelligence: How generative AI works.pdfIngrid Airi González
 
2024 April Patch Tuesday
2024 April Patch Tuesday2024 April Patch Tuesday
2024 April Patch TuesdayIvanti
 
The Future Roadmap for the Composable Data Stack - Wes McKinney - Data Counci...
The Future Roadmap for the Composable Data Stack - Wes McKinney - Data Counci...The Future Roadmap for the Composable Data Stack - Wes McKinney - Data Counci...
The Future Roadmap for the Composable Data Stack - Wes McKinney - Data Counci...Wes McKinney
 
A Framework for Development in the AI Age
A Framework for Development in the AI AgeA Framework for Development in the AI Age
A Framework for Development in the AI AgeCprime
 
Manual 508 Accessibility Compliance Audit
Manual 508 Accessibility Compliance AuditManual 508 Accessibility Compliance Audit
Manual 508 Accessibility Compliance AuditSkynet Technologies
 
Modern Roaming for Notes and Nomad – Cheaper Faster Better Stronger
Modern Roaming for Notes and Nomad – Cheaper Faster Better StrongerModern Roaming for Notes and Nomad – Cheaper Faster Better Stronger
Modern Roaming for Notes and Nomad – Cheaper Faster Better Strongerpanagenda
 
Glenn Lazarus- Why Your Observability Strategy Needs Security Observability
Glenn Lazarus- Why Your Observability Strategy Needs Security ObservabilityGlenn Lazarus- Why Your Observability Strategy Needs Security Observability
Glenn Lazarus- Why Your Observability Strategy Needs Security Observabilityitnewsafrica
 
React Native vs Ionic - The Best Mobile App Framework
React Native vs Ionic - The Best Mobile App FrameworkReact Native vs Ionic - The Best Mobile App Framework
React Native vs Ionic - The Best Mobile App FrameworkPixlogix Infotech
 
Varsha Sewlal- Cyber Attacks on Critical Critical Infrastructure
Varsha Sewlal- Cyber Attacks on Critical Critical InfrastructureVarsha Sewlal- Cyber Attacks on Critical Critical Infrastructure
Varsha Sewlal- Cyber Attacks on Critical Critical Infrastructureitnewsafrica
 
Français Patch Tuesday - Avril
Français Patch Tuesday - AvrilFrançais Patch Tuesday - Avril
Français Patch Tuesday - AvrilIvanti
 
Transcript: New from BookNet Canada for 2024: BNC SalesData and LibraryData -...
Transcript: New from BookNet Canada for 2024: BNC SalesData and LibraryData -...Transcript: New from BookNet Canada for 2024: BNC SalesData and LibraryData -...
Transcript: New from BookNet Canada for 2024: BNC SalesData and LibraryData -...BookNet Canada
 
Kuma Meshes Part I - The basics - A tutorial
Kuma Meshes Part I - The basics - A tutorialKuma Meshes Part I - The basics - A tutorial
Kuma Meshes Part I - The basics - A tutorialJoão Esperancinha
 
Bridging Between CAD & GIS: 6 Ways to Automate Your Data Integration
Bridging Between CAD & GIS:  6 Ways to Automate Your Data IntegrationBridging Between CAD & GIS:  6 Ways to Automate Your Data Integration
Bridging Between CAD & GIS: 6 Ways to Automate Your Data Integrationmarketing932765
 
Genislab builds better products and faster go-to-market with Lean project man...
Genislab builds better products and faster go-to-market with Lean project man...Genislab builds better products and faster go-to-market with Lean project man...
Genislab builds better products and faster go-to-market with Lean project man...Farhan Tariq
 
A Glance At The Java Performance Toolbox
A Glance At The Java Performance ToolboxA Glance At The Java Performance Toolbox
A Glance At The Java Performance ToolboxAna-Maria Mihalceanu
 
Long journey of Ruby standard library at RubyConf AU 2024
Long journey of Ruby standard library at RubyConf AU 2024Long journey of Ruby standard library at RubyConf AU 2024
Long journey of Ruby standard library at RubyConf AU 2024Hiroshi SHIBATA
 
Arizona Broadband Policy Past, Present, and Future Presentation 3/25/24
Arizona Broadband Policy Past, Present, and Future Presentation 3/25/24Arizona Broadband Policy Past, Present, and Future Presentation 3/25/24
Arizona Broadband Policy Past, Present, and Future Presentation 3/25/24Mark Goldstein
 
Testing tools and AI - ideas what to try with some tool examples
Testing tools and AI - ideas what to try with some tool examplesTesting tools and AI - ideas what to try with some tool examples
Testing tools and AI - ideas what to try with some tool examplesKari Kakkonen
 

Kürzlich hochgeladen (20)

Microservices, Docker deploy and Microservices source code in C#
Microservices, Docker deploy and Microservices source code in C#Microservices, Docker deploy and Microservices source code in C#
Microservices, Docker deploy and Microservices source code in C#
 
Microsoft 365 Copilot: How to boost your productivity with AI – Part two: Dat...
Microsoft 365 Copilot: How to boost your productivity with AI – Part two: Dat...Microsoft 365 Copilot: How to boost your productivity with AI – Part two: Dat...
Microsoft 365 Copilot: How to boost your productivity with AI – Part two: Dat...
 
Generative Artificial Intelligence: How generative AI works.pdf
Generative Artificial Intelligence: How generative AI works.pdfGenerative Artificial Intelligence: How generative AI works.pdf
Generative Artificial Intelligence: How generative AI works.pdf
 
2024 April Patch Tuesday
2024 April Patch Tuesday2024 April Patch Tuesday
2024 April Patch Tuesday
 
The Future Roadmap for the Composable Data Stack - Wes McKinney - Data Counci...
The Future Roadmap for the Composable Data Stack - Wes McKinney - Data Counci...The Future Roadmap for the Composable Data Stack - Wes McKinney - Data Counci...
The Future Roadmap for the Composable Data Stack - Wes McKinney - Data Counci...
 
A Framework for Development in the AI Age
A Framework for Development in the AI AgeA Framework for Development in the AI Age
A Framework for Development in the AI Age
 
Manual 508 Accessibility Compliance Audit
Manual 508 Accessibility Compliance AuditManual 508 Accessibility Compliance Audit
Manual 508 Accessibility Compliance Audit
 
Modern Roaming for Notes and Nomad – Cheaper Faster Better Stronger
Modern Roaming for Notes and Nomad – Cheaper Faster Better StrongerModern Roaming for Notes and Nomad – Cheaper Faster Better Stronger
Modern Roaming for Notes and Nomad – Cheaper Faster Better Stronger
 
Glenn Lazarus- Why Your Observability Strategy Needs Security Observability
Glenn Lazarus- Why Your Observability Strategy Needs Security ObservabilityGlenn Lazarus- Why Your Observability Strategy Needs Security Observability
Glenn Lazarus- Why Your Observability Strategy Needs Security Observability
 
React Native vs Ionic - The Best Mobile App Framework
React Native vs Ionic - The Best Mobile App FrameworkReact Native vs Ionic - The Best Mobile App Framework
React Native vs Ionic - The Best Mobile App Framework
 
Varsha Sewlal- Cyber Attacks on Critical Critical Infrastructure
Varsha Sewlal- Cyber Attacks on Critical Critical InfrastructureVarsha Sewlal- Cyber Attacks on Critical Critical Infrastructure
Varsha Sewlal- Cyber Attacks on Critical Critical Infrastructure
 
Français Patch Tuesday - Avril
Français Patch Tuesday - AvrilFrançais Patch Tuesday - Avril
Français Patch Tuesday - Avril
 
Transcript: New from BookNet Canada for 2024: BNC SalesData and LibraryData -...
Transcript: New from BookNet Canada for 2024: BNC SalesData and LibraryData -...Transcript: New from BookNet Canada for 2024: BNC SalesData and LibraryData -...
Transcript: New from BookNet Canada for 2024: BNC SalesData and LibraryData -...
 
Kuma Meshes Part I - The basics - A tutorial
Kuma Meshes Part I - The basics - A tutorialKuma Meshes Part I - The basics - A tutorial
Kuma Meshes Part I - The basics - A tutorial
 
Bridging Between CAD & GIS: 6 Ways to Automate Your Data Integration
Bridging Between CAD & GIS:  6 Ways to Automate Your Data IntegrationBridging Between CAD & GIS:  6 Ways to Automate Your Data Integration
Bridging Between CAD & GIS: 6 Ways to Automate Your Data Integration
 
Genislab builds better products and faster go-to-market with Lean project man...
Genislab builds better products and faster go-to-market with Lean project man...Genislab builds better products and faster go-to-market with Lean project man...
Genislab builds better products and faster go-to-market with Lean project man...
 
A Glance At The Java Performance Toolbox
A Glance At The Java Performance ToolboxA Glance At The Java Performance Toolbox
A Glance At The Java Performance Toolbox
 
Long journey of Ruby standard library at RubyConf AU 2024
Long journey of Ruby standard library at RubyConf AU 2024Long journey of Ruby standard library at RubyConf AU 2024
Long journey of Ruby standard library at RubyConf AU 2024
 
Arizona Broadband Policy Past, Present, and Future Presentation 3/25/24
Arizona Broadband Policy Past, Present, and Future Presentation 3/25/24Arizona Broadband Policy Past, Present, and Future Presentation 3/25/24
Arizona Broadband Policy Past, Present, and Future Presentation 3/25/24
 
Testing tools and AI - ideas what to try with some tool examples
Testing tools and AI - ideas what to try with some tool examplesTesting tools and AI - ideas what to try with some tool examples
Testing tools and AI - ideas what to try with some tool examples
 

Data integration case study: Oil & Gas industry

  • 1. Data integration A case study on the creation of an integration framework for the Oil & Gas industry www.etlsolutions.com
  • 2. Introduction Transformation Manager, our data integration toolkit for developers, is used to efficiently connect oil and gas data stores with the industry„s leading integration standard. • Our client is a global oilfield services company with a long track record in the Oil & Gas industry. • To maintain their position as the leader in the sector, the client‟s new product development plan included a Professional Petroleum Data Model (PPDM) based software product.
  • 3. The challenge • The product required a data integration framework capable of tackling multiple and diverse Exploration & Production (E&P) data sources. • The challenge was to develop scalable export components from the underlying PPDM database to LAS, DLIS and WITSML.
  • 4. The solution • After evaluating a range of potential data integration tools, the client chose our professional services and Transformation Manager software for a number of Transformation reasons: Manager data • We have a long and successful track record in E&P movement software technical data management. • We offer a comprehensive service to help in the design and development of all the required export components, in a highly competitive and risk sharing commercial arrangement. • We have a track record of delivering on budget and to client deadline. Consultancy • Transformation Manager offers a tried and tested toolset services for the efficient delivery of the project. • Transformation Manager has the ability to connect and transform all the data types and footprint required. • We were able to provide an integrated solution fitting directly into the client architecture. • The project was divided into three stages…
  • 5. Phase 1: Design phase • The architecture design defined the deployment code framework, specifying the interaction between the client‟s product architecture and Transformation Manager‟s own deployment code. • Mapping rules were defined in conjunction with the client. A mapping rule spreadsheet was created for each export function, containing the PPDM table/element level mappings to file format specifications. • Output file formats were also specified, particularly any requirements not already defined by the standards. These included ordering, spacing, custom sections and data type representation.
  • 6. Phase 2: deployment code framework development • The deployment code was developed to a range of specifications, including export parameters and reporting requirements. • The framework‟s interfaces were hooked up to the implementations required by the client‟s product using JNDI. This obtained a database connection and performed the other tasks required. • The export code included transforms generated with Transformation Manager. Using the software‟s TM Designer application, the client‟s developers are now able to specify the rules by which the PPDM source data is mapped to the target data.
  • 7. Phase 3: Export function development • As mentioned, the project focused on three file formats: LAS, DLIS and WITSML. For each format, a set of tests were defined. These tests consisted of a sample set of PPDM data and the export file to be produced, which were then used for final acceptance testing. • Our consultants tested the deployment code and mapping implementation, and also conducted performance testing. Integration testing was a joint activity between our consultants and the client‟s developers. The client carried out acceptance and final performance testing, with support from our team. • The transforms created in this phase conformed to the mapping rules defined in Phase 1. The adapter for each file format was designed to be scalable to meet the requirements defined during the design phase.
  • 8. The result • We used our expertise, tools and commercial flexibility to meet a challenging client requirement. Our team delivered a component which can efficiently deploy PPDM data to a range of the most popular file formats. • The client is able to benefit from reduced risk and cost, alongside increased control and transparency of their own clients‟ E&P data.
  • 9. Why Transformation Manager? For the user:  Everything under one roof  Greater control and transparency  Identify and test against errors iteratively  Greater understanding of the transformation requirement  Automatically document  Re-use and change management  Uses domain specific terminology in the mapping
  • 10. Why Transformation Manager? For the business:  Reduces cost and effort  Reduces risk in the project  Delivers higher quality and reduces error  Increases control and transparency in the development  Single product  Reduces time to market
  • 11. Why ETL Solutions? ““We‟ve cut a six-month project • 10-year track record in data down to three months…a management, working with global blue sophisticated product that is easy to work with and maintain AND chip clients gives us great performance. • Unparalleled knowledge from our team of We‟re very confident with the solution." data integration experts, many of whom Arnaud Daeschner, have been with us since inception BNP Paribas • Our Transformation Manager and DataHub software have been proven in even the most complex data movements “Honda has been seeking to achieve Dealer Network • Expert support: first line of contact is with Integration for the last ten years. With the help of ETL Solutions, a developer or consultant this has finally been achieved. • Data integration focus – it‟s all that we do Considering the success, Honda is now planning to extend this approach to the European dealers.” Michael Doyle, Honda UK ©2009 ETL Solutions
  • 12. Contact us for more information: Karl Glenn, Business Development Director kg@etlsolutions.com +44 (0) 1912 894040 Read more on our website: www.etlsolutions.com Raising data management standards www.etlsolutions.com www.etlsolutions.com Images from Free Digital Photos freedigitalphotos.net