With the evolution of data-driven strategies, event-based business models are influential in innovative organizations. These new business models are built around the availability of real-time information on customers, payments and supply chains. As businesses look to expand traditional revenues, sourcing events from enterprise applications, mobile apps, IoT devices and social media in real time becomes essential to staying ahead of the competition.
Join John Santaferraro, Research Director at leading IT analyst firm Enterprise Management Associates (EMA), and Lyndon Hedderly, Director of Customer Solutions at Confluent, to learn how business and technology leaders are adopting streaming strategies and how the world of streaming data implementations have changed for the better.
You will also learn how organizations are:
-Adopting streaming as a strategic decision
-Using streaming data for a competitive advantage
-Using real-time processing for their applications
-Evolving roadblocks for streaming data
-Creating business value with a streaming platform
The 7 Things I Know About Cyber Security After 25 Years | April 2024
Â
Event-driven Business: How Leading Companies Are Adopting Streaming Strategies
1. IT & DATA MANAGEMENT RESEARCH, INDUSTRY
ANALYSIS & CONSULTING
Event-driven Business: How Leading Companies
are Adopting Streaming Strategies
John Santaferraro
Research Director
Enterprise Management Associates
Lyndon Hedderly
Director Customer Solutions
Confluent
5. IT & DATA MANAGEMENT RESEARCH, INDUSTRY
ANALYSIS & CONSULTING
Event-Driven Business
How to stay on top of the flow of data
6. Three Trends Driving Streaming Platform Adoption
Mobile Machine
Learning
Internet of
Things
Microservices
1. The digital revolution,
including increased
connectivity & IoT
2. Increased automation, incl.
the web, machine learning and
AI
3. An overall improvement in underlying
technology
9. IT & DATA MANAGEMENT RESEARCH, INDUSTRY
ANALYSIS & CONSULTING
Stream Data is
The Faster the Better
Big Data was
The More the Better
ValueofData
Volume of Data
ValueofData
Age of Data
The value of data is related to time, not just volume.
10. IT & DATA MANAGEMENT RESEARCH, INDUSTRY
ANALYSIS & CONSULTING
Adopting Streaming is a Strategic Decision
13. IT & DATA MANAGEMENT RESEARCH, INDUSTRY
ANALYSIS & CONSULTING
13C K O 2 0 1 8 J U L Y
Business Value per Use Case
Improve
Customer
Experience
(CX)
Increase
Revenue
(make money)
Business
Value
Decrease
Costs
(save
money)
Core Business
Platform
Increase
Operational
Efficiency
Migrate to
Cloud
Mitigate Risk
(protect money)
Key Drivers
Strategic
Objectives
(sample)
Fraud
Detection
IoT sensor
ingestion
Digital
replatforming/
Mainframe Offload
Connected Car: Navigation &
improved in-car experience: Audi
Customer 360
Simplifying Omni-channel Retail at
Scale: Target
Faster transactional
processing / analysis
incl. Machine Learning / AI
Mainframe Offload: RBC
Microservices
Architecture
Online Fraud Detection
Online Security
(syslog, log
aggregation, Splunk
replacement)
Middleware
replacement
Regulatory
Digital
Transformation
Application Modernization: Multiple
Examples
Website / Core
Operations
(Central Nervous
System)
The [Silicon Valley] Digital Natives;
LinkedIn, Netflix, Uber, Yelp...
Predictive Maintenance: Audi
Streaming Platform in a regulated
environment (e.g. Electronic Medical
Records): Celmatix
Real-time app
updates
Real Time Streaming Platform for
Communications and Beyond: Capital One
Developer Velocity - Building Stateful
Financial Applications with Kafka
Streams: Funding Circle
Detect Fraud & Prevent Fraud in Real
Time: PayPal
Kafka as a Service - A Tale of Security
and Multi-Tenancy: Apple
Example Use Cases
$↑
$↓
$↔
How Apache Kafka® and
Confluent support example use
cases to enable
strategic objectives
and drive
business
value.
14. IT & DATA MANAGEMENT RESEARCH, INDUSTRY
ANALYSIS & CONSULTING
Organizations are Using Real-time
Streaming for Their Applications
16. IT & DATA MANAGEMENT RESEARCH, INDUSTRY
ANALYSIS & CONSULTING
Event-Streaming Maturity Model / Adoption Journey
Pre-Streaming
Streaming
Awareness
and Pilot
Early Production
Streaming
Mission
Critical,
Integrated
Streaming
Global
Streaming
Central
Nervous
System
Customers realise varying
levels of business value,
depending on where
they are on their
adoption journey
(event-streaming
maturity)
17. IT & DATA MANAGEMENT RESEARCH, INDUSTRY
ANALYSIS & CONSULTING
Roadblocks for Streaming Data are Evolving
19. IT & DATA MANAGEMENT RESEARCH, INDUSTRY
ANALYSIS & CONSULTING
Event-Streaming Maturity Model / Adoption Journey
Pre-Streaming
Streaming
Awareness
and Pilot
Early Production
Streaming
Mission
Critical,
Integrated
Streaming
Global
Streaming
Central
Nervous
System
Customers realise varying
levels of business value,
depending on where
they are on their
adoption journey
(event-streaming
maturity)
Three trends are driving this change;
The digital revolution, including increased connectivity & IoT
Increased automation, including the web, machine learning and AI
An overall improvement in underlying technology.
This matters since the world has changed. There are several big trends at the heart of the digitization of business:
IoT
Microservices
Mobile
ML
Last generation solutions are fragile and manual and don’t scale. Confluent is a modern, global self-service cloud-ready data system for the event-driven organization
Big Data Use Cases
The situation is complicated because it’s not just volume driving value…
We believe Streaming platforms are challenging old assumptions.
With big data it was - the more the better.
...With Stream Data it’s about the speed. More recent data is more valuable.
Some data has time value just like money has time value. I once worked with a major European stock exchange that claimed that a single stock trade transaction loses 80% of its value 5 seconds after that trade occurs. What is the time value of data in your enterprise?
https://medium.com/@johnt_16099/data-has-time-value-winners-exploit-data-streaming-now-not-later-f2018eadd775
Why? A shift in tech usage from messaging between applications to a new era where insight is added to the stream of messages between applications. Between applicatinos there might be some realtime data cleansing or analysis, or there might be the addition of insight or data from a data lake or data warehouse.
Horizontal Value Hierarchy diagram - showing use cases - and some examples…
There’s obviously a lot of overlap here. Some use cases span multiple strategic objectives and business drivers - this diagram shows the primary relationship.
Legacy systems. Batch processes; → Complex → Slow / Silo’d → Expensive
Developer downloads Kafka & experiments, Pilot(s).
LOB(s); Small teams experimenting; pub/sub / integration. → 1-3 use cases quickly moved into Production - but fragmented.
Multiple mission critical use cases in production, with; scale, DR & SLAs. → Streaming clearly delivering business value, with C-suite visibility.
Streaming Platform managing majority of mission critical data processes, globally, with multi-datacenter replication across on-prem and hybrid clouds. In parallel with other Big Data infrastructure.
All data in the organization managed through a single Streaming Platform. → Digital natives / digital pure players - probably using Machine Learning & AI
(Relational databases - redundant).
Legacy systems. Batch processes; → Complex → Slow / Silo’d → Expensive
Developer downloads Kafka & experiments, Pilot(s).
LOB(s); Small teams experimenting; pub/sub / integration. → 1-3 use cases quickly moved into Production - but fragmented.
Multiple mission critical use cases in production, with; scale, DR & SLAs. → Streaming clearly delivering business value, with C-suite visibility.
Streaming Platform managing majority of mission critical data processes, globally, with multi-datacenter replication across on-prem and hybrid clouds. In parallel with other Big Data infrastructure.
All data in the organization managed through a single Streaming Platform. → Digital natives / digital pure players - probably using Machine Learning & AI
(Relational databases - redundant).
Complete
The only streaming platform built entirely on
Apache Kafka Open Source. Complete means: Data bus + data
integration (Kafka Connect) + stream processing (Kafka Streams).
And we are the only one that provides support for each of these.
Open
Open source at the core. Easily plugs into your
existing infrastructure. This is Confluent Open Source (vs vendor
lock-in)
Trusted
Once it is in the process stream it is available. It is
written and it is going to be there. Any data can written to Kafka
which ensures data compatibility/reliability across pipelines.
Enterprise
Tools that are open source and Confluent, make
it easy to operationalize Kafka data across the lines of business. We
provide operations tools for keeping the platform running smoothly,
plus monitoring and administration to streamline operational costs.
This is Confluent Enterprise.