SlideShare ist ein Scribd-Unternehmen logo
1 von 27
Bring Your SAP and Enterprise
Data to Hadoop, Apache Kafka
and the Cloud
Lessons from Fortune 100 Companies about Data Ingestion
Ted Orme – VP Technology EMEA
Ted.Orme@Attunity.com
CONFIDENTIAL INFORMATION © 2017 Attunity
Technology Investment Areas 2016 2015 2014
BI/Analytics 1 1 1
Cloud 2 3 5
Mobile 3 5 3
Digitization/Digital Marketing 4 6 7
Infrastructure and Data Center 5 2 2
ERP 6 4 4
Security 7 7 7
Industry Specific Applications 8 10 9
CRM 9 9 10
Networking/Voice-Data Comm’s 10 8 6
Top CIO Priorities:
Sources: Gartner CIO Surveys 2013-2015
Big Data adoption
Migration & Analytics
Data Integration for Analytics and IoT
CONFIDENTIAL INFORMATION © 2017 Attunity
• Corporate Data Lake Initiative for Real-time Compliance
• Reduce fraudulent activity, reputational damage
Global Bank
• IoT Data Lake for New Analytics
• Predictive Maintenance
Global Auto Maker
• IoT Data Lake integrated with SAP data
• Improve food production efficiencies and fleet maintenance
Global Food Processing
• Data Lake for real-time access to online and legacy data
• Increase revenues with dynamic policy changes
Global Insurance
• Data Lake for Design Analytics with Real Time Data
• Expects 3x improvement in manufacturingAirline Manufacturer
Examples – Fortune 100 Customers
Building Data Lakes for Analytics and IoT
CONFIDENTIAL INFORMATION © 2017 Attunity
• 100s to 1000s of Data Sources
• Business and Machine data
Analyze
Everything
• On-premise or in the Cloud
• In DB, DW, Hadoop, In-Memory, etc.
Analyze
Anywhere
• Capture new/changing data
• Process/stream in motion
Analyze in
Real-time
• Capture new/changing data
• Process/stream in motion
Analyze in
Real-time
‘Be Prepared’ – build architecture so you
can:
CONFIDENTIAL INFORMATION © 2017 Attunity
Transfer
TransformFilterBatch
CDC Incremental
In-Memory
File Channel
Batch
Attunity Replicate
Hadoop
Files
RDBMS
Data Warehouse
Mainframe
Cloud
On-prem
Cloud
On-prem
Hadoop
Files
RDBMS
Data Warehouse
Kafka
Management
Automation
CONFIDENTIAL INFORMATION © 2017 Attunity
Needs & Challenges in SAP Analytic Environments
Real-time access to SAP
data for reporting and
analytics
Flexibility to access and
analyse SAP data across
different BI tools and
environments like Cloud,
other DW & Hadoop
Remove lock-in and
dependency on SAP BW
Reduce complex and
costly projects to
integrate SAP data
Decode Complex SAP
data for business users
for common data model
integration
CONFIDENTIAL INFORMATION © 2017 Attunity
Attunity Replicate for SAP
Extending Attunity Replication Leadership and SAP Integration
RDBMS | EDW | Hadoop | Kafka
On Premises | Cloud
Core and Industry-Specific
SAP Modules
Attunity Replicate
RDBMS | EDW | Hadoop
On Premises or Cloud
Bulk Load CDC
2017 Attunity
CONFIDENTIAL INFORMATION © 2017 Attunity
Use Cases
1. Data Lakes: Live SAP Data Ingest for Hadoop Data Lakes / Kafka
2. Cloud Analytics: Live SAP Data Ingest/Migration for Cloud
Analytics
3. ODS: Create an SAP ODS (operational data store) for Real-time BI
4. Real-time data warehousing: with SAP application data
CONFIDENTIAL INFORMATION © 2017 Attunity
Configurable, Pre-defined
Automation
• Intuitive and easy to use web-
interface
• Simple to configure and manage
replication tasks
• Single interface for any
source to target
• Easy management with alerts
notifications
Intuitive User Experience
CONFIDENTIAL INFORMATION © 2017 Attunity
Replicate for SAP – App-Level Replication
• Business object level
metadata
• Real-time CDC aligned with
business object
• Unpacks pooled and
clustered tables
CONFIDENTIAL INFORMATION © 2017 Attunity
In Memory and File Optimised Data Transport
Enterprise-class CDC for SAP
Flexible and optimized CDC
options
• Transactions applied in real-
time and in order
• Changes applied in
optimised batches
• Integration with data
warehouse native loaders to
ingest and merge
• Message encoded
streaming of changes (for
Kafka message broker)
R1
R1
R2
R1
R2
R1
R2Batch CDC
Data Warehouse
Ingest-Merge
SQL
n 2 1
SQL SQL
Transactional CDC
Message Encoded
CDC
2017 Attunity
CONFIDENTIAL INFORMATION © 2017 Attunity
SAP certified agent to decode complex SAP data structures with metadata for replication
Automated SAP Data selection via UI from pool, clustered or indexed tables
Enable data transformation during replication for all SAP data sets
Support for SAP ERP (ECC), CRM, and custom SAP modules
Maintaining SAP data integrity during replication and during CDC
Minimal performance impact on SAP system by adding support for RFC calls
Key Enablers for SAP Environments
CONFIDENTIAL INFORMATION © 2017 Attunity
Replicate for SAP
TransformFilter
Batch
CDC Incremental
In-Memory
File Channel
Batch
Architecture
Persistent Store
Extract relationships for Pool and Cluster Tables
Navigate and
select SAP
business objects
Automated ABAP
Mapping and Change-
Data-Capture for Pool
and Cluster tables
1. Replicate for SAP UI
2. Replicate for SAP RFC Calls
RDBMS
(Oracle, DB2, etc.)
Redo/
Archive
logs
or
Journal
File
----------------
Transparent
Tables
On Premises
Hadoop RDBMS
Data
WarehouseKafka
Cloud
CONFIDENTIAL INFORMATION © 2017 Attunity
SAP Platforms Supported by Attunity Replicate
*Replicate 5.1.2 supports SAP as of November
Supported SAP Versions Supported DBs for SAP
• Primarily SAP ECC 6.0 + all
EhP levels
• Can also support ECC 5.0, 4.7
Enterprise and 4.6C
CONFIDENTIAL INFORMATION © 2017 Attunity
SAP Applications Supported by Attunity
Replicate
ERP / ECC (Enterprise Resource Planning / ERP Core Components)*
CRM (Customer Relationship Management)
SRM (Supplier Relationship Management)
GTS (Global Trade System)
MDG (Master Data Governance)
* All modules supported but HR
CONFIDENTIAL INFORMATION © 2017 Attunity
• Ability to realise new analytics value in native target schema aka Hive,
Kafka, Cloud
• SAP data access via BI reports running directly against the replicated
data with logical naming
• End-to-end automation from SAP data selection to loading data with
transformations via intuitive “Click to Load” interface
• Faster performance with less overhead on SAP system by limiting
RFC calls
• Real-time change data capture (CDC) applied to SAP data sets
Key Value of Attunity Replicate for SAP
Rapid Data Access for More Users and Systems
CONFIDENTIAL INFORMATION © 2017 Attunity
SOURCES
OLTP, ERP,
CRM Systems
Documents,
Emails
Web Logs,
Click Streams
Social
Networks
Machine
Generated
Sensor
Data
Geolocation
Data
Data Integration & Ingest
Attunity Replicate for HDP and HDF
Accelerate time-to-insights by delivering solutions
faster, with fresher data, from many sources
- Automated data ingest
- Incremental data ingest (CDC)
- Broad support for many sources
Integrating SAP Data into the Hortonworks
Connected Data Platform
CONFIDENTIAL INFORMATION © 2017 Attunity
SOURCES
OLTP, ERP,
CRM Systems
Documents,
Emails
Web Logs,
Click Streams
Social
Networks
Machine
Generated
Sensor
Data
Geolocation
Data
Data Integration & Ingest
Attunity Replicate for HDP and HDF
Accelerate time-to-insights by delivering solutions
faster, with fresher data, from many sources
- Automated data ingest
- Incremental data ingest (CDC)
- Broad support for many sources
Integrating SAP Data into the Hortonworks
Connected Data Platform
CONFIDENTIAL INFORMATION © 2017 Attunity
• Accelerate data delivery across enterprise and cloud
• Empower rapid utilization of data by the business
• Continually optimize with intelligent insight
Attunity Corporate Overview
Over 2000 Customers in 65 Countries
Financial Services Manufacturing / Industrials GovernmentHealth Care
Technology / Telecommunications Other Industries
Enterprise Data Management
On Premise | Cloud | Across Platforms
Global Organization
USA
EMEA
APAC
CONFIDENTIAL INFORMATION © 2017 Attunity
Attunity – Trusted Technology and Partner
 Trusted by Microsoft with 3 OEMs, bundled inside SQL Server
 Trusted by Amazon (AWS) with technology licensing for cloud migration service
 Trusted by IBM and Oracle with respective OEMs of Attunity technology
 Trusted by Teradata as a reseller for Data warehouse and Hadoop market
 Trusted by HP as a reseller for Data warehouse and analytics market
 Trusted by Accenture, Capgemini and Cognizant as SI partners
 Trusted by Hortonworks, Cloudera and MapR for Hadoop solutions
 Trusted by over 2000 customers in over 65 countries
CONFIDENTIAL INFORMATION © 2017 Attunity
Data Ingest for Hadoop Data Lakes
Attunity
Replicate
Batch
CDC Incremental
Batch
Cloud
On-
prem
Cloud
On-
prem
Persistent Store
Hadoop
Files
RDBMS
Data Warehouse
Mainframe
CONFIDENTIAL INFORMATION © 2017 Attunity
Data Ingest for Hadoop Data Lakes
Attunity
Replicate
Batch
CDC Incremental
Batch
Cloud
On-
prem
Cloud
On-
prem
Persistent Store
Hadoop
Files
RDBMS
Data Warehouse
Mainframe
Thanks!
attunity.com
CONFIDENTIAL INFORMATION © 2017 Attunity
Technical Time - Cluster Table example in
SAP
RFBLG is a table cluster for Accounting Documents. It has a BLOB
column that holds the BSEG, BSEC, BSED, BSES and BSET cluster
tables within it.
A cluster table is a special hash-keyed area of the database that
allows for more efficient storage of redundant data. You cannot have
a cluster table (like BSEG) within an OpenSQL join statement.
There used to be an Oracle limitation. Oracle could only handle a
certain number of columns in a single table, but BSEG was wider, so
SAP came up with the Cluster design
CONFIDENTIAL INFORMATION © 2017 Attunity
RFBLG copied Oracle to SQL
Blob Column
CONFIDENTIAL INFORMATION © 2017 Attunity
BSEG copied by R4SAP into SQL
SAP Table Meta Data – Field Names
BSEG is part of the Blob from RFBLG
BSEG does not exist on its own in the DB

Weitere ähnliche Inhalte

Was ist angesagt?

Internet of things Crash Course Workshop
Internet of things Crash Course WorkshopInternet of things Crash Course Workshop
Internet of things Crash Course WorkshopDataWorks Summit
 
ING- CoreIntel- Collect and Process Network Logs Across Data Centers in Real ...
ING- CoreIntel- Collect and Process Network Logs Across Data Centers in Real ...ING- CoreIntel- Collect and Process Network Logs Across Data Centers in Real ...
ING- CoreIntel- Collect and Process Network Logs Across Data Centers in Real ...DataWorks Summit/Hadoop Summit
 
Hadoop crash course workshop at Hadoop Summit
Hadoop crash course workshop at Hadoop SummitHadoop crash course workshop at Hadoop Summit
Hadoop crash course workshop at Hadoop SummitDataWorks Summit
 
Hortonworks Technical Workshop: Real Time Monitoring with Apache Hadoop
Hortonworks Technical Workshop: Real Time Monitoring with Apache HadoopHortonworks Technical Workshop: Real Time Monitoring with Apache Hadoop
Hortonworks Technical Workshop: Real Time Monitoring with Apache HadoopHortonworks
 
Benefits of an Agile Data Fabric for Business Intelligence
Benefits of an Agile Data Fabric for Business IntelligenceBenefits of an Agile Data Fabric for Business Intelligence
Benefits of an Agile Data Fabric for Business IntelligenceDataWorks Summit/Hadoop Summit
 
Depositing Value from Transactional Data at Danske Bank
Depositing Value from Transactional Data at Danske BankDepositing Value from Transactional Data at Danske Bank
Depositing Value from Transactional Data at Danske BankDataWorks Summit/Hadoop Summit
 
Scaling Data Science on Big Data
Scaling Data Science on Big DataScaling Data Science on Big Data
Scaling Data Science on Big DataDataWorks Summit
 
Insights into Real World Data Management Challenges
Insights into Real World Data Management ChallengesInsights into Real World Data Management Challenges
Insights into Real World Data Management ChallengesDataWorks Summit
 
Verizon Centralizes Data into a Data Lake in Real Time for Analytics
Verizon Centralizes Data into a Data Lake in Real Time for AnalyticsVerizon Centralizes Data into a Data Lake in Real Time for Analytics
Verizon Centralizes Data into a Data Lake in Real Time for AnalyticsHortonworks
 
High Performance Spatial-Temporal Trajectory Analysis with Spark
High Performance Spatial-Temporal Trajectory Analysis with Spark High Performance Spatial-Temporal Trajectory Analysis with Spark
High Performance Spatial-Temporal Trajectory Analysis with Spark DataWorks Summit/Hadoop Summit
 
Starting Small and Scaling Big with Hadoop (Talend and Hortonworks webinar)) ...
Starting Small and Scaling Big with Hadoop (Talend and Hortonworks webinar)) ...Starting Small and Scaling Big with Hadoop (Talend and Hortonworks webinar)) ...
Starting Small and Scaling Big with Hadoop (Talend and Hortonworks webinar)) ...Hortonworks
 
Addressing Enterprise Customer Pain Points with a Data Driven Architecture
Addressing Enterprise Customer Pain Points with a Data Driven ArchitectureAddressing Enterprise Customer Pain Points with a Data Driven Architecture
Addressing Enterprise Customer Pain Points with a Data Driven ArchitectureDataWorks Summit
 
Big Data Platform Processes Daily Healthcare Data for Clinic Use at Mayo Clinic
Big Data Platform Processes Daily Healthcare Data for Clinic Use at Mayo ClinicBig Data Platform Processes Daily Healthcare Data for Clinic Use at Mayo Clinic
Big Data Platform Processes Daily Healthcare Data for Clinic Use at Mayo ClinicDataWorks Summit
 
Implementing the Business Catalog in the Modern Enterprise: Bridging Traditio...
Implementing the Business Catalog in the Modern Enterprise: Bridging Traditio...Implementing the Business Catalog in the Modern Enterprise: Bridging Traditio...
Implementing the Business Catalog in the Modern Enterprise: Bridging Traditio...DataWorks Summit/Hadoop Summit
 
Dancing Elephants - Efficiently Working with Object Stories from Apache Spark...
Dancing Elephants - Efficiently Working with Object Stories from Apache Spark...Dancing Elephants - Efficiently Working with Object Stories from Apache Spark...
Dancing Elephants - Efficiently Working with Object Stories from Apache Spark...DataWorks Summit/Hadoop Summit
 
Journey to the Data Lake: How Progressive Paved a Faster, Smoother Path to In...
Journey to the Data Lake: How Progressive Paved a Faster, Smoother Path to In...Journey to the Data Lake: How Progressive Paved a Faster, Smoother Path to In...
Journey to the Data Lake: How Progressive Paved a Faster, Smoother Path to In...DataWorks Summit
 
Hortonworks and HP Vertica Webinar
Hortonworks and HP Vertica WebinarHortonworks and HP Vertica Webinar
Hortonworks and HP Vertica WebinarHortonworks
 

Was ist angesagt? (20)

Internet of things Crash Course Workshop
Internet of things Crash Course WorkshopInternet of things Crash Course Workshop
Internet of things Crash Course Workshop
 
Beyond TCO
Beyond TCOBeyond TCO
Beyond TCO
 
ING- CoreIntel- Collect and Process Network Logs Across Data Centers in Real ...
ING- CoreIntel- Collect and Process Network Logs Across Data Centers in Real ...ING- CoreIntel- Collect and Process Network Logs Across Data Centers in Real ...
ING- CoreIntel- Collect and Process Network Logs Across Data Centers in Real ...
 
How Hadoop Makes the Natixis Pack More Efficient
How Hadoop Makes the Natixis Pack More Efficient How Hadoop Makes the Natixis Pack More Efficient
How Hadoop Makes the Natixis Pack More Efficient
 
Hadoop crash course workshop at Hadoop Summit
Hadoop crash course workshop at Hadoop SummitHadoop crash course workshop at Hadoop Summit
Hadoop crash course workshop at Hadoop Summit
 
Hortonworks Technical Workshop: Real Time Monitoring with Apache Hadoop
Hortonworks Technical Workshop: Real Time Monitoring with Apache HadoopHortonworks Technical Workshop: Real Time Monitoring with Apache Hadoop
Hortonworks Technical Workshop: Real Time Monitoring with Apache Hadoop
 
Benefits of an Agile Data Fabric for Business Intelligence
Benefits of an Agile Data Fabric for Business IntelligenceBenefits of an Agile Data Fabric for Business Intelligence
Benefits of an Agile Data Fabric for Business Intelligence
 
Depositing Value from Transactional Data at Danske Bank
Depositing Value from Transactional Data at Danske BankDepositing Value from Transactional Data at Danske Bank
Depositing Value from Transactional Data at Danske Bank
 
Scaling Data Science on Big Data
Scaling Data Science on Big DataScaling Data Science on Big Data
Scaling Data Science on Big Data
 
Insights into Real World Data Management Challenges
Insights into Real World Data Management ChallengesInsights into Real World Data Management Challenges
Insights into Real World Data Management Challenges
 
Verizon Centralizes Data into a Data Lake in Real Time for Analytics
Verizon Centralizes Data into a Data Lake in Real Time for AnalyticsVerizon Centralizes Data into a Data Lake in Real Time for Analytics
Verizon Centralizes Data into a Data Lake in Real Time for Analytics
 
High Performance Spatial-Temporal Trajectory Analysis with Spark
High Performance Spatial-Temporal Trajectory Analysis with Spark High Performance Spatial-Temporal Trajectory Analysis with Spark
High Performance Spatial-Temporal Trajectory Analysis with Spark
 
Starting Small and Scaling Big with Hadoop (Talend and Hortonworks webinar)) ...
Starting Small and Scaling Big with Hadoop (Talend and Hortonworks webinar)) ...Starting Small and Scaling Big with Hadoop (Talend and Hortonworks webinar)) ...
Starting Small and Scaling Big with Hadoop (Talend and Hortonworks webinar)) ...
 
Addressing Enterprise Customer Pain Points with a Data Driven Architecture
Addressing Enterprise Customer Pain Points with a Data Driven ArchitectureAddressing Enterprise Customer Pain Points with a Data Driven Architecture
Addressing Enterprise Customer Pain Points with a Data Driven Architecture
 
Modernise your EDW - Data Lake
Modernise your EDW - Data LakeModernise your EDW - Data Lake
Modernise your EDW - Data Lake
 
Big Data Platform Processes Daily Healthcare Data for Clinic Use at Mayo Clinic
Big Data Platform Processes Daily Healthcare Data for Clinic Use at Mayo ClinicBig Data Platform Processes Daily Healthcare Data for Clinic Use at Mayo Clinic
Big Data Platform Processes Daily Healthcare Data for Clinic Use at Mayo Clinic
 
Implementing the Business Catalog in the Modern Enterprise: Bridging Traditio...
Implementing the Business Catalog in the Modern Enterprise: Bridging Traditio...Implementing the Business Catalog in the Modern Enterprise: Bridging Traditio...
Implementing the Business Catalog in the Modern Enterprise: Bridging Traditio...
 
Dancing Elephants - Efficiently Working with Object Stories from Apache Spark...
Dancing Elephants - Efficiently Working with Object Stories from Apache Spark...Dancing Elephants - Efficiently Working with Object Stories from Apache Spark...
Dancing Elephants - Efficiently Working with Object Stories from Apache Spark...
 
Journey to the Data Lake: How Progressive Paved a Faster, Smoother Path to In...
Journey to the Data Lake: How Progressive Paved a Faster, Smoother Path to In...Journey to the Data Lake: How Progressive Paved a Faster, Smoother Path to In...
Journey to the Data Lake: How Progressive Paved a Faster, Smoother Path to In...
 
Hortonworks and HP Vertica Webinar
Hortonworks and HP Vertica WebinarHortonworks and HP Vertica Webinar
Hortonworks and HP Vertica Webinar
 

Ähnlich wie Bring your SAP and Enterprise Data to Hadoop, Apache Kafka and the Cloud

Verizon Centralizes Data into a Data Lake in Real Time for Analytics
Verizon Centralizes Data into a Data Lake in Real Time for AnalyticsVerizon Centralizes Data into a Data Lake in Real Time for Analytics
Verizon Centralizes Data into a Data Lake in Real Time for AnalyticsDataWorks Summit
 
2017 OpenWorld Keynote for Data Integration
2017 OpenWorld Keynote for Data Integration2017 OpenWorld Keynote for Data Integration
2017 OpenWorld Keynote for Data IntegrationJeffrey T. Pollock
 
Modernizing Business Processes with Big Data: Real-World Use Cases for Produc...
Modernizing Business Processes with Big Data: Real-World Use Cases for Produc...Modernizing Business Processes with Big Data: Real-World Use Cases for Produc...
Modernizing Business Processes with Big Data: Real-World Use Cases for Produc...DataWorks Summit/Hadoop Summit
 
Accelerating Big Data Analytics
Accelerating Big Data AnalyticsAccelerating Big Data Analytics
Accelerating Big Data AnalyticsAttunity
 
Trafodion overview
Trafodion overviewTrafodion overview
Trafodion overviewRohit Jain
 
NRB - LUXEMBOURG MAINFRAME DAY 2017 - Data Spark and the Data Federation
NRB - LUXEMBOURG MAINFRAME DAY 2017 - Data Spark and the Data FederationNRB - LUXEMBOURG MAINFRAME DAY 2017 - Data Spark and the Data Federation
NRB - LUXEMBOURG MAINFRAME DAY 2017 - Data Spark and the Data FederationNRB
 
NRB - BE MAINFRAME DAY 2017 - Data spark and the data federation
NRB - BE MAINFRAME DAY 2017 - Data spark and the data federation NRB - BE MAINFRAME DAY 2017 - Data spark and the data federation
NRB - BE MAINFRAME DAY 2017 - Data spark and the data federation NRB
 
Exclusive Verizon Employee Webinar: Getting More From Your CDR Data
Exclusive Verizon Employee Webinar: Getting More From Your CDR DataExclusive Verizon Employee Webinar: Getting More From Your CDR Data
Exclusive Verizon Employee Webinar: Getting More From Your CDR DataPentaho
 
Horses for Courses: Database Roundtable
Horses for Courses: Database RoundtableHorses for Courses: Database Roundtable
Horses for Courses: Database RoundtableEric Kavanagh
 
Modernize & Automate Analytics Data Pipelines
Modernize & Automate Analytics Data PipelinesModernize & Automate Analytics Data Pipelines
Modernize & Automate Analytics Data PipelinesCarole Gunst
 
SAP Analytics Cloud: Haben Sie schon alle Datenquellen im Live-Zugriff?
SAP Analytics Cloud: Haben Sie schon alle Datenquellen im Live-Zugriff?SAP Analytics Cloud: Haben Sie schon alle Datenquellen im Live-Zugriff?
SAP Analytics Cloud: Haben Sie schon alle Datenquellen im Live-Zugriff?Denodo
 
Ibm integrated analytics system
Ibm integrated analytics systemIbm integrated analytics system
Ibm integrated analytics systemModusOptimum
 
Best Practices For Building and Operating A Managed Data Lake - StampedeCon 2016
Best Practices For Building and Operating A Managed Data Lake - StampedeCon 2016Best Practices For Building and Operating A Managed Data Lake - StampedeCon 2016
Best Practices For Building and Operating A Managed Data Lake - StampedeCon 2016StampedeCon
 
Intelligent Integration OOW2017 - Jeff Pollock
Intelligent Integration OOW2017 - Jeff PollockIntelligent Integration OOW2017 - Jeff Pollock
Intelligent Integration OOW2017 - Jeff PollockJeffrey T. Pollock
 
SendGrid Improves Email Delivery with Hybrid Data Warehousing
SendGrid Improves Email Delivery with Hybrid Data WarehousingSendGrid Improves Email Delivery with Hybrid Data Warehousing
SendGrid Improves Email Delivery with Hybrid Data WarehousingAmazon Web Services
 
Streaming Real-time Data to Azure Data Lake Storage Gen 2
Streaming Real-time Data to Azure Data Lake Storage Gen 2Streaming Real-time Data to Azure Data Lake Storage Gen 2
Streaming Real-time Data to Azure Data Lake Storage Gen 2Carole Gunst
 
The Most Trusted In-Memory database in the world- Altibase
The Most Trusted In-Memory database in the world- AltibaseThe Most Trusted In-Memory database in the world- Altibase
The Most Trusted In-Memory database in the world- AltibaseAltibase
 
Track B-1 建構新世代的智慧數據平台
Track B-1 建構新世代的智慧數據平台Track B-1 建構新世代的智慧數據平台
Track B-1 建構新世代的智慧數據平台Etu Solution
 
Migrating legacy ERP data into Hadoop
Migrating legacy ERP data into HadoopMigrating legacy ERP data into Hadoop
Migrating legacy ERP data into HadoopDataWorks Summit
 

Ähnlich wie Bring your SAP and Enterprise Data to Hadoop, Apache Kafka and the Cloud (20)

Verizon Centralizes Data into a Data Lake in Real Time for Analytics
Verizon Centralizes Data into a Data Lake in Real Time for AnalyticsVerizon Centralizes Data into a Data Lake in Real Time for Analytics
Verizon Centralizes Data into a Data Lake in Real Time for Analytics
 
2017 OpenWorld Keynote for Data Integration
2017 OpenWorld Keynote for Data Integration2017 OpenWorld Keynote for Data Integration
2017 OpenWorld Keynote for Data Integration
 
Modernizing Business Processes with Big Data: Real-World Use Cases for Produc...
Modernizing Business Processes with Big Data: Real-World Use Cases for Produc...Modernizing Business Processes with Big Data: Real-World Use Cases for Produc...
Modernizing Business Processes with Big Data: Real-World Use Cases for Produc...
 
Accelerating Big Data Analytics
Accelerating Big Data AnalyticsAccelerating Big Data Analytics
Accelerating Big Data Analytics
 
Trafodion overview
Trafodion overviewTrafodion overview
Trafodion overview
 
NRB - LUXEMBOURG MAINFRAME DAY 2017 - Data Spark and the Data Federation
NRB - LUXEMBOURG MAINFRAME DAY 2017 - Data Spark and the Data FederationNRB - LUXEMBOURG MAINFRAME DAY 2017 - Data Spark and the Data Federation
NRB - LUXEMBOURG MAINFRAME DAY 2017 - Data Spark and the Data Federation
 
NRB - BE MAINFRAME DAY 2017 - Data spark and the data federation
NRB - BE MAINFRAME DAY 2017 - Data spark and the data federation NRB - BE MAINFRAME DAY 2017 - Data spark and the data federation
NRB - BE MAINFRAME DAY 2017 - Data spark and the data federation
 
Exclusive Verizon Employee Webinar: Getting More From Your CDR Data
Exclusive Verizon Employee Webinar: Getting More From Your CDR DataExclusive Verizon Employee Webinar: Getting More From Your CDR Data
Exclusive Verizon Employee Webinar: Getting More From Your CDR Data
 
Horses for Courses: Database Roundtable
Horses for Courses: Database RoundtableHorses for Courses: Database Roundtable
Horses for Courses: Database Roundtable
 
Modernize & Automate Analytics Data Pipelines
Modernize & Automate Analytics Data PipelinesModernize & Automate Analytics Data Pipelines
Modernize & Automate Analytics Data Pipelines
 
SAP Analytics Cloud: Haben Sie schon alle Datenquellen im Live-Zugriff?
SAP Analytics Cloud: Haben Sie schon alle Datenquellen im Live-Zugriff?SAP Analytics Cloud: Haben Sie schon alle Datenquellen im Live-Zugriff?
SAP Analytics Cloud: Haben Sie schon alle Datenquellen im Live-Zugriff?
 
Ibm integrated analytics system
Ibm integrated analytics systemIbm integrated analytics system
Ibm integrated analytics system
 
Best Practices For Building and Operating A Managed Data Lake - StampedeCon 2016
Best Practices For Building and Operating A Managed Data Lake - StampedeCon 2016Best Practices For Building and Operating A Managed Data Lake - StampedeCon 2016
Best Practices For Building and Operating A Managed Data Lake - StampedeCon 2016
 
Intelligent Integration OOW2017 - Jeff Pollock
Intelligent Integration OOW2017 - Jeff PollockIntelligent Integration OOW2017 - Jeff Pollock
Intelligent Integration OOW2017 - Jeff Pollock
 
SendGrid Improves Email Delivery with Hybrid Data Warehousing
SendGrid Improves Email Delivery with Hybrid Data WarehousingSendGrid Improves Email Delivery with Hybrid Data Warehousing
SendGrid Improves Email Delivery with Hybrid Data Warehousing
 
Big dataandhp cforawsbrasilsummit
Big dataandhp cforawsbrasilsummitBig dataandhp cforawsbrasilsummit
Big dataandhp cforawsbrasilsummit
 
Streaming Real-time Data to Azure Data Lake Storage Gen 2
Streaming Real-time Data to Azure Data Lake Storage Gen 2Streaming Real-time Data to Azure Data Lake Storage Gen 2
Streaming Real-time Data to Azure Data Lake Storage Gen 2
 
The Most Trusted In-Memory database in the world- Altibase
The Most Trusted In-Memory database in the world- AltibaseThe Most Trusted In-Memory database in the world- Altibase
The Most Trusted In-Memory database in the world- Altibase
 
Track B-1 建構新世代的智慧數據平台
Track B-1 建構新世代的智慧數據平台Track B-1 建構新世代的智慧數據平台
Track B-1 建構新世代的智慧數據平台
 
Migrating legacy ERP data into Hadoop
Migrating legacy ERP data into HadoopMigrating legacy ERP data into Hadoop
Migrating legacy ERP data into Hadoop
 

Mehr von DataWorks Summit/Hadoop Summit

Unleashing the Power of Apache Atlas with Apache Ranger
Unleashing the Power of Apache Atlas with Apache RangerUnleashing the Power of Apache Atlas with Apache Ranger
Unleashing the Power of Apache Atlas with Apache RangerDataWorks Summit/Hadoop Summit
 
Enabling Digital Diagnostics with a Data Science Platform
Enabling Digital Diagnostics with a Data Science PlatformEnabling Digital Diagnostics with a Data Science Platform
Enabling Digital Diagnostics with a Data Science PlatformDataWorks Summit/Hadoop Summit
 
Double Your Hadoop Performance with Hortonworks SmartSense
Double Your Hadoop Performance with Hortonworks SmartSenseDouble Your Hadoop Performance with Hortonworks SmartSense
Double Your Hadoop Performance with Hortonworks SmartSenseDataWorks Summit/Hadoop Summit
 
Building a Large-Scale, Adaptive Recommendation Engine with Apache Flink and ...
Building a Large-Scale, Adaptive Recommendation Engine with Apache Flink and ...Building a Large-Scale, Adaptive Recommendation Engine with Apache Flink and ...
Building a Large-Scale, Adaptive Recommendation Engine with Apache Flink and ...DataWorks Summit/Hadoop Summit
 
Real-Time Anomaly Detection using LSTM Auto-Encoders with Deep Learning4J on ...
Real-Time Anomaly Detection using LSTM Auto-Encoders with Deep Learning4J on ...Real-Time Anomaly Detection using LSTM Auto-Encoders with Deep Learning4J on ...
Real-Time Anomaly Detection using LSTM Auto-Encoders with Deep Learning4J on ...DataWorks Summit/Hadoop Summit
 
Mool - Automated Log Analysis using Data Science and ML
Mool - Automated Log Analysis using Data Science and MLMool - Automated Log Analysis using Data Science and ML
Mool - Automated Log Analysis using Data Science and MLDataWorks Summit/Hadoop Summit
 
The Challenge of Driving Business Value from the Analytics of Things (AOT)
The Challenge of Driving Business Value from the Analytics of Things (AOT)The Challenge of Driving Business Value from the Analytics of Things (AOT)
The Challenge of Driving Business Value from the Analytics of Things (AOT)DataWorks Summit/Hadoop Summit
 
From Regulatory Process Verification to Predictive Maintenance and Beyond wit...
From Regulatory Process Verification to Predictive Maintenance and Beyond wit...From Regulatory Process Verification to Predictive Maintenance and Beyond wit...
From Regulatory Process Verification to Predictive Maintenance and Beyond wit...DataWorks Summit/Hadoop Summit
 
Scaling HDFS to Manage Billions of Files with Distributed Storage Schemes
Scaling HDFS to Manage Billions of Files with Distributed Storage SchemesScaling HDFS to Manage Billions of Files with Distributed Storage Schemes
Scaling HDFS to Manage Billions of Files with Distributed Storage SchemesDataWorks Summit/Hadoop Summit
 

Mehr von DataWorks Summit/Hadoop Summit (20)

Running Apache Spark & Apache Zeppelin in Production
Running Apache Spark & Apache Zeppelin in ProductionRunning Apache Spark & Apache Zeppelin in Production
Running Apache Spark & Apache Zeppelin in Production
 
State of Security: Apache Spark & Apache Zeppelin
State of Security: Apache Spark & Apache ZeppelinState of Security: Apache Spark & Apache Zeppelin
State of Security: Apache Spark & Apache Zeppelin
 
Unleashing the Power of Apache Atlas with Apache Ranger
Unleashing the Power of Apache Atlas with Apache RangerUnleashing the Power of Apache Atlas with Apache Ranger
Unleashing the Power of Apache Atlas with Apache Ranger
 
Enabling Digital Diagnostics with a Data Science Platform
Enabling Digital Diagnostics with a Data Science PlatformEnabling Digital Diagnostics with a Data Science Platform
Enabling Digital Diagnostics with a Data Science Platform
 
Revolutionize Text Mining with Spark and Zeppelin
Revolutionize Text Mining with Spark and ZeppelinRevolutionize Text Mining with Spark and Zeppelin
Revolutionize Text Mining with Spark and Zeppelin
 
Double Your Hadoop Performance with Hortonworks SmartSense
Double Your Hadoop Performance with Hortonworks SmartSenseDouble Your Hadoop Performance with Hortonworks SmartSense
Double Your Hadoop Performance with Hortonworks SmartSense
 
Hadoop Crash Course
Hadoop Crash CourseHadoop Crash Course
Hadoop Crash Course
 
Data Science Crash Course
Data Science Crash CourseData Science Crash Course
Data Science Crash Course
 
Apache Spark Crash Course
Apache Spark Crash CourseApache Spark Crash Course
Apache Spark Crash Course
 
Dataflow with Apache NiFi
Dataflow with Apache NiFiDataflow with Apache NiFi
Dataflow with Apache NiFi
 
Schema Registry - Set you Data Free
Schema Registry - Set you Data FreeSchema Registry - Set you Data Free
Schema Registry - Set you Data Free
 
Building a Large-Scale, Adaptive Recommendation Engine with Apache Flink and ...
Building a Large-Scale, Adaptive Recommendation Engine with Apache Flink and ...Building a Large-Scale, Adaptive Recommendation Engine with Apache Flink and ...
Building a Large-Scale, Adaptive Recommendation Engine with Apache Flink and ...
 
Real-Time Anomaly Detection using LSTM Auto-Encoders with Deep Learning4J on ...
Real-Time Anomaly Detection using LSTM Auto-Encoders with Deep Learning4J on ...Real-Time Anomaly Detection using LSTM Auto-Encoders with Deep Learning4J on ...
Real-Time Anomaly Detection using LSTM Auto-Encoders with Deep Learning4J on ...
 
Mool - Automated Log Analysis using Data Science and ML
Mool - Automated Log Analysis using Data Science and MLMool - Automated Log Analysis using Data Science and ML
Mool - Automated Log Analysis using Data Science and ML
 
HBase in Practice
HBase in Practice HBase in Practice
HBase in Practice
 
The Challenge of Driving Business Value from the Analytics of Things (AOT)
The Challenge of Driving Business Value from the Analytics of Things (AOT)The Challenge of Driving Business Value from the Analytics of Things (AOT)
The Challenge of Driving Business Value from the Analytics of Things (AOT)
 
Breaking the 1 Million OPS/SEC Barrier in HOPS Hadoop
Breaking the 1 Million OPS/SEC Barrier in HOPS HadoopBreaking the 1 Million OPS/SEC Barrier in HOPS Hadoop
Breaking the 1 Million OPS/SEC Barrier in HOPS Hadoop
 
From Regulatory Process Verification to Predictive Maintenance and Beyond wit...
From Regulatory Process Verification to Predictive Maintenance and Beyond wit...From Regulatory Process Verification to Predictive Maintenance and Beyond wit...
From Regulatory Process Verification to Predictive Maintenance and Beyond wit...
 
Backup and Disaster Recovery in Hadoop
Backup and Disaster Recovery in Hadoop Backup and Disaster Recovery in Hadoop
Backup and Disaster Recovery in Hadoop
 
Scaling HDFS to Manage Billions of Files with Distributed Storage Schemes
Scaling HDFS to Manage Billions of Files with Distributed Storage SchemesScaling HDFS to Manage Billions of Files with Distributed Storage Schemes
Scaling HDFS to Manage Billions of Files with Distributed Storage Schemes
 

Kürzlich hochgeladen

Advanced Test Driven-Development @ php[tek] 2024
Advanced Test Driven-Development @ php[tek] 2024Advanced Test Driven-Development @ php[tek] 2024
Advanced Test Driven-Development @ php[tek] 2024Scott Keck-Warren
 
Are Multi-Cloud and Serverless Good or Bad?
Are Multi-Cloud and Serverless Good or Bad?Are Multi-Cloud and Serverless Good or Bad?
Are Multi-Cloud and Serverless Good or Bad?Mattias Andersson
 
Artificial intelligence in cctv survelliance.pptx
Artificial intelligence in cctv survelliance.pptxArtificial intelligence in cctv survelliance.pptx
Artificial intelligence in cctv survelliance.pptxhariprasad279825
 
Scanning the Internet for External Cloud Exposures via SSL Certs
Scanning the Internet for External Cloud Exposures via SSL CertsScanning the Internet for External Cloud Exposures via SSL Certs
Scanning the Internet for External Cloud Exposures via SSL CertsRizwan Syed
 
How to write a Business Continuity Plan
How to write a Business Continuity PlanHow to write a Business Continuity Plan
How to write a Business Continuity PlanDatabarracks
 
Leverage Zilliz Serverless - Up to 50X Saving for Your Vector Storage Cost
Leverage Zilliz Serverless - Up to 50X Saving for Your Vector Storage CostLeverage Zilliz Serverless - Up to 50X Saving for Your Vector Storage Cost
Leverage Zilliz Serverless - Up to 50X Saving for Your Vector Storage CostZilliz
 
TrustArc Webinar - How to Build Consumer Trust Through Data Privacy
TrustArc Webinar - How to Build Consumer Trust Through Data PrivacyTrustArc Webinar - How to Build Consumer Trust Through Data Privacy
TrustArc Webinar - How to Build Consumer Trust Through Data PrivacyTrustArc
 
The Ultimate Guide to Choosing WordPress Pros and Cons
The Ultimate Guide to Choosing WordPress Pros and ConsThe Ultimate Guide to Choosing WordPress Pros and Cons
The Ultimate Guide to Choosing WordPress Pros and ConsPixlogix Infotech
 
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks..."LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...Fwdays
 
"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii Soldatenko"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii SoldatenkoFwdays
 
Unleash Your Potential - Namagunga Girls Coding Club
Unleash Your Potential - Namagunga Girls Coding ClubUnleash Your Potential - Namagunga Girls Coding Club
Unleash Your Potential - Namagunga Girls Coding ClubKalema Edgar
 
WordPress Websites for Engineers: Elevate Your Brand
WordPress Websites for Engineers: Elevate Your BrandWordPress Websites for Engineers: Elevate Your Brand
WordPress Websites for Engineers: Elevate Your Brandgvaughan
 
DevEX - reference for building teams, processes, and platforms
DevEX - reference for building teams, processes, and platformsDevEX - reference for building teams, processes, and platforms
DevEX - reference for building teams, processes, and platformsSergiu Bodiu
 
Story boards and shot lists for my a level piece
Story boards and shot lists for my a level pieceStory boards and shot lists for my a level piece
Story boards and shot lists for my a level piececharlottematthew16
 
Unraveling Multimodality with Large Language Models.pdf
Unraveling Multimodality with Large Language Models.pdfUnraveling Multimodality with Large Language Models.pdf
Unraveling Multimodality with Large Language Models.pdfAlex Barbosa Coqueiro
 
"ML in Production",Oleksandr Bagan
"ML in Production",Oleksandr Bagan"ML in Production",Oleksandr Bagan
"ML in Production",Oleksandr BaganFwdays
 
Search Engine Optimization SEO PDF for 2024.pdf
Search Engine Optimization SEO PDF for 2024.pdfSearch Engine Optimization SEO PDF for 2024.pdf
Search Engine Optimization SEO PDF for 2024.pdfRankYa
 
Streamlining Python Development: A Guide to a Modern Project Setup
Streamlining Python Development: A Guide to a Modern Project SetupStreamlining Python Development: A Guide to a Modern Project Setup
Streamlining Python Development: A Guide to a Modern Project SetupFlorian Wilhelm
 
Ensuring Technical Readiness For Copilot in Microsoft 365
Ensuring Technical Readiness For Copilot in Microsoft 365Ensuring Technical Readiness For Copilot in Microsoft 365
Ensuring Technical Readiness For Copilot in Microsoft 3652toLead Limited
 
Human Factors of XR: Using Human Factors to Design XR Systems
Human Factors of XR: Using Human Factors to Design XR SystemsHuman Factors of XR: Using Human Factors to Design XR Systems
Human Factors of XR: Using Human Factors to Design XR SystemsMark Billinghurst
 

Kürzlich hochgeladen (20)

Advanced Test Driven-Development @ php[tek] 2024
Advanced Test Driven-Development @ php[tek] 2024Advanced Test Driven-Development @ php[tek] 2024
Advanced Test Driven-Development @ php[tek] 2024
 
Are Multi-Cloud and Serverless Good or Bad?
Are Multi-Cloud and Serverless Good or Bad?Are Multi-Cloud and Serverless Good or Bad?
Are Multi-Cloud and Serverless Good or Bad?
 
Artificial intelligence in cctv survelliance.pptx
Artificial intelligence in cctv survelliance.pptxArtificial intelligence in cctv survelliance.pptx
Artificial intelligence in cctv survelliance.pptx
 
Scanning the Internet for External Cloud Exposures via SSL Certs
Scanning the Internet for External Cloud Exposures via SSL CertsScanning the Internet for External Cloud Exposures via SSL Certs
Scanning the Internet for External Cloud Exposures via SSL Certs
 
How to write a Business Continuity Plan
How to write a Business Continuity PlanHow to write a Business Continuity Plan
How to write a Business Continuity Plan
 
Leverage Zilliz Serverless - Up to 50X Saving for Your Vector Storage Cost
Leverage Zilliz Serverless - Up to 50X Saving for Your Vector Storage CostLeverage Zilliz Serverless - Up to 50X Saving for Your Vector Storage Cost
Leverage Zilliz Serverless - Up to 50X Saving for Your Vector Storage Cost
 
TrustArc Webinar - How to Build Consumer Trust Through Data Privacy
TrustArc Webinar - How to Build Consumer Trust Through Data PrivacyTrustArc Webinar - How to Build Consumer Trust Through Data Privacy
TrustArc Webinar - How to Build Consumer Trust Through Data Privacy
 
The Ultimate Guide to Choosing WordPress Pros and Cons
The Ultimate Guide to Choosing WordPress Pros and ConsThe Ultimate Guide to Choosing WordPress Pros and Cons
The Ultimate Guide to Choosing WordPress Pros and Cons
 
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks..."LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...
 
"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii Soldatenko"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii Soldatenko
 
Unleash Your Potential - Namagunga Girls Coding Club
Unleash Your Potential - Namagunga Girls Coding ClubUnleash Your Potential - Namagunga Girls Coding Club
Unleash Your Potential - Namagunga Girls Coding Club
 
WordPress Websites for Engineers: Elevate Your Brand
WordPress Websites for Engineers: Elevate Your BrandWordPress Websites for Engineers: Elevate Your Brand
WordPress Websites for Engineers: Elevate Your Brand
 
DevEX - reference for building teams, processes, and platforms
DevEX - reference for building teams, processes, and platformsDevEX - reference for building teams, processes, and platforms
DevEX - reference for building teams, processes, and platforms
 
Story boards and shot lists for my a level piece
Story boards and shot lists for my a level pieceStory boards and shot lists for my a level piece
Story boards and shot lists for my a level piece
 
Unraveling Multimodality with Large Language Models.pdf
Unraveling Multimodality with Large Language Models.pdfUnraveling Multimodality with Large Language Models.pdf
Unraveling Multimodality with Large Language Models.pdf
 
"ML in Production",Oleksandr Bagan
"ML in Production",Oleksandr Bagan"ML in Production",Oleksandr Bagan
"ML in Production",Oleksandr Bagan
 
Search Engine Optimization SEO PDF for 2024.pdf
Search Engine Optimization SEO PDF for 2024.pdfSearch Engine Optimization SEO PDF for 2024.pdf
Search Engine Optimization SEO PDF for 2024.pdf
 
Streamlining Python Development: A Guide to a Modern Project Setup
Streamlining Python Development: A Guide to a Modern Project SetupStreamlining Python Development: A Guide to a Modern Project Setup
Streamlining Python Development: A Guide to a Modern Project Setup
 
Ensuring Technical Readiness For Copilot in Microsoft 365
Ensuring Technical Readiness For Copilot in Microsoft 365Ensuring Technical Readiness For Copilot in Microsoft 365
Ensuring Technical Readiness For Copilot in Microsoft 365
 
Human Factors of XR: Using Human Factors to Design XR Systems
Human Factors of XR: Using Human Factors to Design XR SystemsHuman Factors of XR: Using Human Factors to Design XR Systems
Human Factors of XR: Using Human Factors to Design XR Systems
 

Bring your SAP and Enterprise Data to Hadoop, Apache Kafka and the Cloud

  • 1. Bring Your SAP and Enterprise Data to Hadoop, Apache Kafka and the Cloud Lessons from Fortune 100 Companies about Data Ingestion Ted Orme – VP Technology EMEA Ted.Orme@Attunity.com
  • 2. CONFIDENTIAL INFORMATION © 2017 Attunity Technology Investment Areas 2016 2015 2014 BI/Analytics 1 1 1 Cloud 2 3 5 Mobile 3 5 3 Digitization/Digital Marketing 4 6 7 Infrastructure and Data Center 5 2 2 ERP 6 4 4 Security 7 7 7 Industry Specific Applications 8 10 9 CRM 9 9 10 Networking/Voice-Data Comm’s 10 8 6 Top CIO Priorities: Sources: Gartner CIO Surveys 2013-2015 Big Data adoption Migration & Analytics
  • 3. Data Integration for Analytics and IoT
  • 4. CONFIDENTIAL INFORMATION © 2017 Attunity • Corporate Data Lake Initiative for Real-time Compliance • Reduce fraudulent activity, reputational damage Global Bank • IoT Data Lake for New Analytics • Predictive Maintenance Global Auto Maker • IoT Data Lake integrated with SAP data • Improve food production efficiencies and fleet maintenance Global Food Processing • Data Lake for real-time access to online and legacy data • Increase revenues with dynamic policy changes Global Insurance • Data Lake for Design Analytics with Real Time Data • Expects 3x improvement in manufacturingAirline Manufacturer Examples – Fortune 100 Customers Building Data Lakes for Analytics and IoT
  • 5. CONFIDENTIAL INFORMATION © 2017 Attunity • 100s to 1000s of Data Sources • Business and Machine data Analyze Everything • On-premise or in the Cloud • In DB, DW, Hadoop, In-Memory, etc. Analyze Anywhere • Capture new/changing data • Process/stream in motion Analyze in Real-time • Capture new/changing data • Process/stream in motion Analyze in Real-time ‘Be Prepared’ – build architecture so you can:
  • 6. CONFIDENTIAL INFORMATION © 2017 Attunity Transfer TransformFilterBatch CDC Incremental In-Memory File Channel Batch Attunity Replicate Hadoop Files RDBMS Data Warehouse Mainframe Cloud On-prem Cloud On-prem Hadoop Files RDBMS Data Warehouse Kafka Management Automation
  • 7. CONFIDENTIAL INFORMATION © 2017 Attunity Needs & Challenges in SAP Analytic Environments Real-time access to SAP data for reporting and analytics Flexibility to access and analyse SAP data across different BI tools and environments like Cloud, other DW & Hadoop Remove lock-in and dependency on SAP BW Reduce complex and costly projects to integrate SAP data Decode Complex SAP data for business users for common data model integration
  • 8. CONFIDENTIAL INFORMATION © 2017 Attunity Attunity Replicate for SAP Extending Attunity Replication Leadership and SAP Integration RDBMS | EDW | Hadoop | Kafka On Premises | Cloud Core and Industry-Specific SAP Modules Attunity Replicate RDBMS | EDW | Hadoop On Premises or Cloud Bulk Load CDC 2017 Attunity
  • 9. CONFIDENTIAL INFORMATION © 2017 Attunity Use Cases 1. Data Lakes: Live SAP Data Ingest for Hadoop Data Lakes / Kafka 2. Cloud Analytics: Live SAP Data Ingest/Migration for Cloud Analytics 3. ODS: Create an SAP ODS (operational data store) for Real-time BI 4. Real-time data warehousing: with SAP application data
  • 10. CONFIDENTIAL INFORMATION © 2017 Attunity Configurable, Pre-defined Automation • Intuitive and easy to use web- interface • Simple to configure and manage replication tasks • Single interface for any source to target • Easy management with alerts notifications Intuitive User Experience
  • 11. CONFIDENTIAL INFORMATION © 2017 Attunity Replicate for SAP – App-Level Replication • Business object level metadata • Real-time CDC aligned with business object • Unpacks pooled and clustered tables
  • 12. CONFIDENTIAL INFORMATION © 2017 Attunity In Memory and File Optimised Data Transport Enterprise-class CDC for SAP Flexible and optimized CDC options • Transactions applied in real- time and in order • Changes applied in optimised batches • Integration with data warehouse native loaders to ingest and merge • Message encoded streaming of changes (for Kafka message broker) R1 R1 R2 R1 R2 R1 R2Batch CDC Data Warehouse Ingest-Merge SQL n 2 1 SQL SQL Transactional CDC Message Encoded CDC 2017 Attunity
  • 13. CONFIDENTIAL INFORMATION © 2017 Attunity SAP certified agent to decode complex SAP data structures with metadata for replication Automated SAP Data selection via UI from pool, clustered or indexed tables Enable data transformation during replication for all SAP data sets Support for SAP ERP (ECC), CRM, and custom SAP modules Maintaining SAP data integrity during replication and during CDC Minimal performance impact on SAP system by adding support for RFC calls Key Enablers for SAP Environments
  • 14. CONFIDENTIAL INFORMATION © 2017 Attunity Replicate for SAP TransformFilter Batch CDC Incremental In-Memory File Channel Batch Architecture Persistent Store Extract relationships for Pool and Cluster Tables Navigate and select SAP business objects Automated ABAP Mapping and Change- Data-Capture for Pool and Cluster tables 1. Replicate for SAP UI 2. Replicate for SAP RFC Calls RDBMS (Oracle, DB2, etc.) Redo/ Archive logs or Journal File ---------------- Transparent Tables On Premises Hadoop RDBMS Data WarehouseKafka Cloud
  • 15. CONFIDENTIAL INFORMATION © 2017 Attunity SAP Platforms Supported by Attunity Replicate *Replicate 5.1.2 supports SAP as of November Supported SAP Versions Supported DBs for SAP • Primarily SAP ECC 6.0 + all EhP levels • Can also support ECC 5.0, 4.7 Enterprise and 4.6C
  • 16. CONFIDENTIAL INFORMATION © 2017 Attunity SAP Applications Supported by Attunity Replicate ERP / ECC (Enterprise Resource Planning / ERP Core Components)* CRM (Customer Relationship Management) SRM (Supplier Relationship Management) GTS (Global Trade System) MDG (Master Data Governance) * All modules supported but HR
  • 17. CONFIDENTIAL INFORMATION © 2017 Attunity • Ability to realise new analytics value in native target schema aka Hive, Kafka, Cloud • SAP data access via BI reports running directly against the replicated data with logical naming • End-to-end automation from SAP data selection to loading data with transformations via intuitive “Click to Load” interface • Faster performance with less overhead on SAP system by limiting RFC calls • Real-time change data capture (CDC) applied to SAP data sets Key Value of Attunity Replicate for SAP Rapid Data Access for More Users and Systems
  • 18. CONFIDENTIAL INFORMATION © 2017 Attunity SOURCES OLTP, ERP, CRM Systems Documents, Emails Web Logs, Click Streams Social Networks Machine Generated Sensor Data Geolocation Data Data Integration & Ingest Attunity Replicate for HDP and HDF Accelerate time-to-insights by delivering solutions faster, with fresher data, from many sources - Automated data ingest - Incremental data ingest (CDC) - Broad support for many sources Integrating SAP Data into the Hortonworks Connected Data Platform
  • 19. CONFIDENTIAL INFORMATION © 2017 Attunity SOURCES OLTP, ERP, CRM Systems Documents, Emails Web Logs, Click Streams Social Networks Machine Generated Sensor Data Geolocation Data Data Integration & Ingest Attunity Replicate for HDP and HDF Accelerate time-to-insights by delivering solutions faster, with fresher data, from many sources - Automated data ingest - Incremental data ingest (CDC) - Broad support for many sources Integrating SAP Data into the Hortonworks Connected Data Platform
  • 20. CONFIDENTIAL INFORMATION © 2017 Attunity • Accelerate data delivery across enterprise and cloud • Empower rapid utilization of data by the business • Continually optimize with intelligent insight Attunity Corporate Overview Over 2000 Customers in 65 Countries Financial Services Manufacturing / Industrials GovernmentHealth Care Technology / Telecommunications Other Industries Enterprise Data Management On Premise | Cloud | Across Platforms Global Organization USA EMEA APAC
  • 21. CONFIDENTIAL INFORMATION © 2017 Attunity Attunity – Trusted Technology and Partner  Trusted by Microsoft with 3 OEMs, bundled inside SQL Server  Trusted by Amazon (AWS) with technology licensing for cloud migration service  Trusted by IBM and Oracle with respective OEMs of Attunity technology  Trusted by Teradata as a reseller for Data warehouse and Hadoop market  Trusted by HP as a reseller for Data warehouse and analytics market  Trusted by Accenture, Capgemini and Cognizant as SI partners  Trusted by Hortonworks, Cloudera and MapR for Hadoop solutions  Trusted by over 2000 customers in over 65 countries
  • 22. CONFIDENTIAL INFORMATION © 2017 Attunity Data Ingest for Hadoop Data Lakes Attunity Replicate Batch CDC Incremental Batch Cloud On- prem Cloud On- prem Persistent Store Hadoop Files RDBMS Data Warehouse Mainframe
  • 23. CONFIDENTIAL INFORMATION © 2017 Attunity Data Ingest for Hadoop Data Lakes Attunity Replicate Batch CDC Incremental Batch Cloud On- prem Cloud On- prem Persistent Store Hadoop Files RDBMS Data Warehouse Mainframe
  • 25. CONFIDENTIAL INFORMATION © 2017 Attunity Technical Time - Cluster Table example in SAP RFBLG is a table cluster for Accounting Documents. It has a BLOB column that holds the BSEG, BSEC, BSED, BSES and BSET cluster tables within it. A cluster table is a special hash-keyed area of the database that allows for more efficient storage of redundant data. You cannot have a cluster table (like BSEG) within an OpenSQL join statement. There used to be an Oracle limitation. Oracle could only handle a certain number of columns in a single table, but BSEG was wider, so SAP came up with the Cluster design
  • 26. CONFIDENTIAL INFORMATION © 2017 Attunity RFBLG copied Oracle to SQL Blob Column
  • 27. CONFIDENTIAL INFORMATION © 2017 Attunity BSEG copied by R4SAP into SQL SAP Table Meta Data – Field Names BSEG is part of the Blob from RFBLG BSEG does not exist on its own in the DB