Weitere ähnliche Inhalte
Ähnlich wie Oracle real time replica solution (Oracle GoldenGate) in Telco and FSI verticals (20)
Kürzlich hochgeladen (20)
Oracle real time replica solution (Oracle GoldenGate) in Telco and FSI verticals
- 1. Copyright © 2012, Oracle and/or its affiliates. All rights reserved.1
Oracle Real Time Replica
Solution :
Oracle GoldenGate
Milomir Vojvodic
EMEA Senior Business Development Manager
Oracle Data Integration Product Group
September 2012
- 2. Copyright © 2012, Oracle and/or its affiliates. All rights reserved.2
The following is intended to outline our general product direction. It is
intended for information purposes only, and may not be incorporated
into any contract.
It is not a commitment to deliver any material, code, or functionality,
and should not be relied upon in making purchasing decisions. The
development, release, and timing of any features or functionality
described for Oracle’s products remains at the sole discretion of
Oracle.
Safe Harbor Statement
- 3. Copyright © 2012, Oracle and/or its affiliates. All rights reserved.3
New DB/HW/OS/APP
Fully Active DB
Reporting Database and/or DR database
Data Warehouse
OGG
OGG
OGG ADG
OGG
Zero Downtime
Migrations & Upgrades
Active/Active High
Availability
Query Off-Loading
and Disaster Recovery
BI&DW
Synchronization and Loading
Migrations & Consolidations
ODI
ODI
Oracle Data Integration Solutions Together
EDQ
EDQ
- 4. Copyright © 2012, Oracle and/or its affiliates. All rights reserved.4
Oracle Real Time
Replica Solution
(Oracle
GoldenGate)
- 5. Copyright © 2012, Oracle and/or its affiliates. All rights reserved.5
Target DB
OGG
Source DB
What is OGG?
- 6. Copyright © 2012, Oracle and/or its affiliates. All rights reserved.6
New DB/HW/OS/APP
Fully Active DB
Reporting Database and/or DR database
Data Warehouse
OGG
OGG
OGG ADG
OGG
Zero Downtime
Migrations & Upgrades
Active/Active High
Availability
Query Off-Loading
and Disaster Recovery
BI&DW
Synchronization and Loading
Migrations & Consolidations
Use Cases Of OGG
- 7. Copyright © 2012, Oracle and/or its affiliates. All rights reserved.7
Target DB
OGG
Source DB
First OGG Differentiator
Accessing directly transaction
logs
Second OGG Differentiator Moving
only committed transactions
Why Is OGG Different?
- 8. Copyright © 2012, Oracle and/or its affiliates. All rights reserved.8
TIME REQUIRED FOR THE END OF DAY
PROCEDURE
Hours
NO OF CPUs REQUIRED FOR SAME
PERFORMANCE*
No Of Required CPUs
ESTIMATED COSTS FOR SERVER AND
LICENSE**
Estimated Cost of Purchase in USD
0
50
100
150
Year1 Year2 Year3 Year4 Year5
Currently during the End Of Day
utilizes the Server CPU by 40-50%
and the IO by 90%. Probably the IO
is the bottleneck.
0
20
40
60
80
100
120
Year1 Year2 Year3 Year4 Year5
Disaster Recovery Test
and Development
Primary Site
$-
$1
$1
$2
$2
$3
Millions
Oracle
License
Costs
Hardware
Costs
Daily load time can
reach 5 days with
the current HW
OR
Replacing Batch Window
First OGG Differentiator
Accessing directly
transaction logs
- 9. Copyright © 2012, Oracle and/or its affiliates. All rights reserved.9
Physical Replication OGG
Like-to-like databases and platforms Heterogeneous databases and platforms
One-to-one topology with all-or-nothing
data replication
Many-to-many topology with selective and
optimized data movement
No transaction integrity Guaranteed transaction integrity
Data corruption propagated to target Data corruption is isolated at source
No rollback or point-in-time recovery Selective and dynamic rollback with advanced
point-in-time recovery
Target system unavailable for data
processing
Both source and target systems are available
No data transformation capability Data transformation and enrichment
Geographic distance limitation between
data source and target
No distance limitations
OR
Second OGG
Differentiator
Moving only
committed
transactions
Replacing Storage Replica
Begin,
TX 1
Insert,
TX 1
Begin,
TX 2
Update,
TX 1
Insert,
TX 2
Commit,
TX 2
Begin,
TX 3
Insert,
TX 3
Begin,
TX 4
Commit,
TX 3
Delete,
TX 4
Begin,
TX 2
Insert,
TX 2
Commit,
TX 2
Begin,
TX 3
Insert,
TX 3
Commit,
TX 3
Begin,
TX 2
Insert,
TX 2
Commit,
TX 2
Capture
Checkpoint
Pump
Checkpoint
Delivery
Checkpoint
- 10. Copyright © 2012, Oracle and/or its affiliates. All rights reserved.10
Unidirectional
Query Offloading
Zero-Downtime Migration
Bi-Directional
Hot Standby or
Active-Active for HA
Peer-to-Peer
Load Balancing
Multi-Master
Broadcast
Data Distribution
Integration/Consolidation
Data Warehouse
BPM
BAM
CEP
Data Distribution
via Messaging
Directions
- 11. Copyright © 2012, Oracle and/or its affiliates. All rights reserved.11
Log-based change data capture
– High volume
– Low overhead
Decoupled architecture
– Multiple capture processes may be used to scale, but generally not required
– Possible to split “hot” tables into a separate capture process
Filtering and compression
– Unnecessary change data is discarded immediately
– Updates and deletes are “compressed” by default
– Before images are discarded by default
OGG Capture
- 12. Copyright © 2012, Oracle and/or its affiliates. All rights reserved.13
New DB/HW/OS/APP
Fully Active DB
Reporting Database and/or DR database
Data Warehouse
OGG
OGG
OGG ADG
OGG
Zero Downtime
Migrations & Upgrades
Active/Active High
Availability
Query Off-Loading
and Disaster Recovery
BI&DW
Synchronization and Loading
Migrations & Consolidations
Use Cases Of OGG
- 13. Copyright © 2012, Oracle and/or its affiliates. All rights reserved.14
Reduce the workload on production
Annual amortization of HW purchase 250 000 USD (1 000 000 USD per 4 years)
Annual HW maintanence 100 000 USD
Annual SW maintance 200 000 USD
Energy, floor space 200 000 USD
Overall 800 000 USD, as there are 36 CPUs, Annual cost 22 000 USD per CPU
Overhead 8% with other solution, overhead 3% with GoldenGate
Cost of overhead 64 000 USD vs 24 000 USD
Savings 40 000 USD per year
Alternative option for target server
DB software first option 100 000 USD, DB software second option 50 000 USD,
Annual DB software support 22 000 USD vs 11 000 USD
OGG Offload Reporting Benefits
- 14. Copyright © 2012, Oracle and/or its affiliates. All rights reserved.15
New DB/HW/OS/APP
Fully Active DB
Reporting Database and/or DR database
Data Warehouse
OGG
OGG
OGG ADG
OGG
Zero Downtime
Migrations & Upgrades
Active/Active High
Availability
Query Off-Loading
and Disaster Recovery
BI&DW
Synchronization and Loading
Migrations & Consolidations
Use Cases Of OGG
- 15. Copyright © 2012, Oracle and/or its affiliates. All rights reserved.16
APPS
APPS APPS
ONLY
REPORTINGAPPS
OGG Benefits For Dual Active DBs
- 16. Copyright © 2012, Oracle and/or its affiliates. All rights reserved.17
New DB/HW/OS/APP
Fully Active DB
Reporting Database and/or DR database
Data Warehouse
OGG
OGG
OGG ADG
OGG
Zero Downtime
Migrations & Upgrades
Active/Active High
Availability
Query Off-Loading
and Disaster Recovery
BI&DW
Synchronization and Loading
Migrations & Consolidations
Use Cases Of OGG
- 17. Copyright © 2012, Oracle and/or its affiliates. All rights reserved.18
Analysis
and script
generation
using
PL/SQL
New SAP
implementation
Existing SAP
implementation
Capture
Source Trail
Delivery
Target Trail
Migration scripts are created to
create new DB, table-space and
implement GoldenGate and allow
verification
Installation and commencement of
real-time GoldenGate transactional
data capture does not require
system downtime and has limited
impact on production system
performance (“remote capture” can
be used if needed)
• Minimum Oracle database version for the production system is 9.2.0.8
• Oracle version on the target can be 10.2 or 11.2 and any UNIX, Linux or Windows platform is supported
• All SAP products and solutions where Oracle database is certified are supported (such as R/3, BW, CRM or XI)
• Supplemental Logging must be enabled on the source database prior to Oracle GoldenGate implementation
• The source Oracle database cannot contain any OLTP compressed tables
Oracle 9i or above
Existing Platform
Oracle 11g
New Platform
Migration scripts are executed
against the target/new
implementation and large tables
are transferred directly to new DB
GoldenGate delivery commences
into new database with
optimization to support migration
needs
Final switch over takes place –
SAP tasks are undertaken and
production users move to migrated
system
GoldenGate process can continue
running for as long as needed to
ensure that target system is
optimized for use – no time limits
SAP Note 1508271
- 18. Copyright © 2012, Oracle and/or its affiliates. All rights reserved.19
Available – no issues
• Planned outage
• Upgrade
• Migration
• Maintenance
• Unplanned outage
• System failure
• Data failure
• Semi-available
• Performance
issues
Reusability Of OGG Licenses
- 19. Copyright © 2012, Oracle and/or its affiliates. All rights reserved.20
Available – no issues
• Planned Outage
• Upgrade
• Migration
• Maintenance
• Unplanned Outage
• System Failure
• Data Failure
• Need Additional Computing Resources
• Performance issues
• Growth
Reusability Of OGG Licenses
- 20. Copyright © 2012, Oracle and/or its affiliates. All rights reserved.21
Available – no issues
Reusability Of OGG Licenses
• Planned Outage
• Upgrade
• Migration
• Maintenance
• Unplanned Outage
• System Failure
• Data Failure
• Need Additional Computing Resources
• Performance issues
• Growth
- 21. Copyright © 2012, Oracle and/or its affiliates. All rights reserved.22
Reusability Of OGG Licenses
- 22. Copyright © 2012, Oracle and/or its affiliates. All rights reserved.23
Reusability Of OGG Licenses
- 23. Copyright © 2012, Oracle and/or its affiliates. All rights reserved.24
Reusability Of OGG Licenses
- 24. Copyright © 2012, Oracle and/or its affiliates. All rights reserved.25
GoldenGate as a
platform for all use
cases
-70%
-80%
-70%• Reduce downtime (end user productivity and customer
satisfaction ) by 70%
• Reduce migration and recovery effort by 80%
• Reduce source system overhead (and costs for
stronger HW) by at least 70%
• Decrease TCO because of report server by 80%
• Communication Cost Savings by 10%
• Global optimization of resources as having real time
insight in regional capacities
• Avoiding data loss
• Consolidating and modernizing into more efficient
systems
Performance
Flexible &
Extendable
Reliable
OGG Value Proposition
- 25. Copyright © 2012, Oracle and/or its affiliates. All rights reserved.26
Avoids expensive network infrastructure upgrades:
– Moves only the committed changed data on a continuous basis
– Avoids moving the same data more than once
– Allows low overhead on the network
– No need for fibre channel upgrade or investment
– Reduce source system overhead (and costs for stronger HW)
– Reduce TCO for Reporting Server
Requires minimal labour resources for deployment and management:
– Provides fast and easy deployment
– Requires minimal intervention once deployed
– Offers fast and complete recovery from any outages or interruptions
– Reducing downtime, increasing work force satisfaction and productivity
– Avoiding Data Loss, additional costs from inaccurate data man/days to recover from data loss
– Reduced recovery efforts in events of network or communication failure
Real Time Replica And OGG Value Proposition
- 26. Copyright © 2012, Oracle and/or its affiliates. All rights reserved.27
Oracle GoldenGate Director:
Has basic configuration,
management, monitoring,
and alerting.
Based on legacy pull infrastructure.
Works on legacy
GoldenGate instances.
OGG Director
- 27. Copyright © 2012, Oracle and/or its affiliates. All rights reserved.28
Oracle GoldenGate Monitor:
Has advanced monitoring,
alerting (SNMP support),
lag graphs,
and historical repository.
Based on new agent
infrastructure,
which will be the foundation for all future integration projects.
OGG Monitor
- 28. Copyright © 2012, Oracle and/or its affiliates. All rights reserved.29
• A high-speed, low impact data
comparison solution
• Identifies and reports data discrepancies
between heterogeneous databases
without interrupting their availability
• Benefits:
• Reduce financial/legal risk exposure
• Speed and simplify IT work in comparing
data sources
• No disruption to business systems
• Improved failover to backup systems
• Confident decision-making and reporting
OGG Monitor
- 29. Copyright © 2012, Oracle and/or its affiliates. All rights reserved.30
ODI OGG
OWB
=Gateways for non Oracle sources
=Declarative Design
=Integrating with other Oracle Products
INFA PowerCenter
=No such reusability already built best practice procedures
=Push Down
=Client Installation
Manual Coding
=Metadata Repository
=Designing DW schema
=Profile in advance source apps
Talend
=Metadata Level Limitations
=Datatype Conversion
=Separation between Physical and Logical resources
IBM DataStage
=Legacy Code
=Push Down
=Universe DB
INFA PowerExchange
=Disturb source CDC operation when scale
=Auto-restart feature, trapping apply side errors&exceptions
=DDL support
Streams
=Streams capture changes immediately in Redo.
=Advanced Queuing
=Multiple Stored Procedures
IBM InfoSphere CDC
=Check-pointing mechanism stored as database tables
Storage Level Replica
=Commit Transactions
=Transformation
=Corrupted Data
Competition
3 Key Functional Differences
Shareplex
=Data Transformations
=Pre-image check
=DDL and data types
- 30. Copyright © 2012, Oracle and/or its affiliates. All rights reserved.31
References
Extract For Financial Services
- 31. Copyright © 2012, Oracle and/or its affiliates. All rights reserved.32
References
Extract for Telco
- 32. Copyright © 2012, Oracle and/or its affiliates. All rights reserved.33
Real Time Replica
(Oracle
GoldenGate) For
Financial Services
- 33. Copyright © 2012, Oracle and/or its affiliates. All rights reserved.34
Migration of Card Authorization System
Migration of Core Banking Systems + Migration of Payment Processing System
DR+AA for Payment Processing System
DR+AA for Payment Processing System + unidirectional to DW
Feeds from Payment Processing System to Fraud Detection System
Feeds from Payment Processing System to Device Monitoring System
Feeds from Core Banking Systems to other Back Office Applications (Risk Management, Clearing and
Settlement, Reporting to Member Banks)
Offload Reporting from Core Banking Systems in order to improve performance
Bi-directional synchronization between Payment Processing and Card Management System
Real Time Replica In Financial Services
- 34. Copyright © 2012, Oracle and/or its affiliates. All rights reserved.35
Credit
Cards
Loans,
Mortgages
Funds,
Assets
Business Unit
A Marketing
System
Business Unit
B Accounting
System
Group Risk
Management
Group Risk
Management
CRM
Regulatory
reporting
Statutory
reporting
Management
Information
Systems
Customers
Accounts
…
ODI
EDQ
Core Banking
(Payment
Processing,
Accounts)
ODI
R
Fraud
Detection
OGG OGG OGG
OGG
OGG
OGG
OGG
OGG
OGG
Real Time Replica In Financial Services
- 35. Copyright © 2012, Oracle and/or its affiliates. All rights reserved.36
Core Banking
Loans,
Mortgages
Credit
Cards
Funds,
Assets
Business Unit
A Marketing
System
Business Unit
B Accounting
System
Group Risk
Management
Group Risk
Management
CRM
Regulatory
reporting
Statutory
reporting
Management
Information
Systems
Banking Architecture
- 36. Copyright © 2012, Oracle and/or its affiliates. All rights reserved.39
Customer
Place
Order
Telephone
Network
Bill
Customer
Customer
Care
Billing
Collect
Usage
Self Care CRM
Call
Center
Customers
ODI
EDQ
Billing
R
R
SR ODS
ODI
OGG
OGG OGG OGG
R
Real Time Replica In Telco
- 37. Copyright © 2012, Oracle and/or its affiliates. All rights reserved.40
Telephone
Network
Service
Fulfillment
Service
Assurance
Configure
Network
Monitor
Network
Order
Fulfillment
R
Network
ODI
Intentory and Workorder
Management System
Network Alarms
Monitoring System
Network Performance
Monitoring System
Network Managament
System
ODI
OGG
Real Time Replica In Telco
- 38. Copyright © 2012, Oracle and/or its affiliates. All rights reserved.41
The preceding is intended to outline our general product direction. It
is intended for information purposes only, and may not be
incorporated into any contract.
It is not a commitment to deliver any material, code, or functionality,
and should not be relied upon in making purchasing decisions. The
development, release, and timing of any features or functionality
described for Oracle’s products remains at the sole discretion of
Oracle.
Safe Harbor Statement