apidays LIVE Hong Kong 2021 - API Ecosystem & Data Interchange
August 25 & 26, 2021
Rethinking Financial Services with Data in Motion
Jeffrey Lam, Senior Solution Engineer, Greater China Region at Confluent
2. Data sharing in the rise of banking ecosystem -
open banking and beyond
2
E-Commerce
Financial
Services
Providers
Digital Social
Media
Payment
Services
Providers
Schools
Home Finding
Apps
Travel Services
Providers
Entertainment
Companies
Automotives
Smart City
Telco
Bank
3. 3
ATM
Tandem - Base24
Contact
Center
Core
enabled
branches
Internet
Banking
Mobile
Banking
Microservices
Ecosystem
External API layer
Customer
microservice
Product
Notification
Cross-Sell
Payment
Personalisation
Customer
360
Gov
Services
...
ESB Layer Streaming Caching NoSQL
Databases Mainframes MQs Data Lake
...
Typical data infrastructure for internal or
external sharing
High
throughput
Event driven
Real Time
BaaS
Agility
Omni-channel
Big Data /
ML / AI
Cloud Data Driven
Business
Segregated
software stacks
Asynchronous
4. âWe need to shift
our thinking from
everything-at-rest to
everything-in-motion.â
Director of Citi
5. Data at rest - a giant mess for data sharing
LINE OF BUSINESSES PUBLIC CLOUD ECOSYSTEM
Data architecture is rigid, complicated, and expensive - making it too hard,
time consuming and cost-prohibitive to digitally transform
5
6. ...
Device
Logs ... ...
...
Data Stores Logs 3rd Party Apps Custom Apps / Microservices
Data-in-Motion Streams
Amazon
S3
SaaS
apps
Data in motion - requires both API and underlying
Kafka protocol
Real-time
Inventory
Real-time Fraud
Detection
Real-time
Customer 360
Machine
Learning
Models
Real-time Data
Transformation ...
Event-Streaming Applications
1. Publish & Subscribe
every channel, location, system
2. Store
entire history in a
fault tolerant way
3. Process & Analyze
in real time, as they occur
4. Govern
Discovery, lineage, quality
7. 1. Liberate your mainframe data
Mainframe
Customer Data
Customer
Experience
Fraud Analytics
STREAM
PROCESSING
ATM
Bank
Open
Banking
Eco
system
Native Kafka
REST API
8. 2. Innovate across LOBs with decoupled data &
services
Event driven microservices & workflows
Trading
Service
Investor
Service
Mortgage
Service
Cash Mgt
Service
Credit Risk
Service
Market
Data
Payment
Service
Credit
Service
Digital
Marketing
KYC
Service
ATM
Bank
Open
Banking
Eco
system
REST
API
REST
API
9. 3. Speed up your journey to cloud with a single
data bridge
Multi clouds
ATM
Bank
Open
Banking
Eco
system
Ensure data are
consistent everywhere,
in real time, enterprise-
wide
Native Kafka
replication
10. 4. Reduce machine learning lifecycle with
effective data prep and serving
Real-time layer
Batch layer
Machine
learning API /
data API
ATM
Bank
Open
Banking
Eco
system
Same
processing
Access to all enterprise
data in real time
11. 5. Data mesh with domain owned data products
Domain Y
Domain X
Domain M
Domain N
Domain 1
Domain 2
Domain 3
ATM
Bank
Open
Banking
Eco
system
REST API /
Native
Kafka
Native Kafka
REST API
12. Data in motion is already a trend in financial
industry
Streaming
awareness and
pilot
Early production
streaming
Mission critical
streaming
Mission critical
integrated LOBs
Central
nervous system
12
Towards real time
data sharing with
ecosystem
13. On-premises
A bridge to the cloud
App
Fraud system
Cloud
Dataproc
Cloud
Dataflow
BigQuery
Cloud
Storage
Cloud
Bigtable
Machine
Learning
Confluent Replicator
Migration to cloud for complex traditional banks canât happen all at once. Kafka Hybrid data streaming with Change Data
Capture (CDC) provides real time view of on-premise legacy systems (eg: Mainframes, Oracle, etc) in the cloud. This enables
banks to immediately modernize with new LOB cloud Apps & Data analytics, while staying in sync with legacy systems.
This enables banks to demise their on-prem systems, with 100s of $Ms in cost savings, while investing in cloud.
A Global Bank
Visualization
Connectors
App
App
Events from
Omni-
Channel