SlideShare a Scribd company logo
1 of 32
Download to read offline
11
2 0 1 9 – K a f k a S u m m i t – L o n d o n
Vitality ONE
22
”Provide a global behavioural change platform that
is quick to implement, easy to configure and efficient
to operate - serving over 50 million global users by
2023”
Vision
33
Vitality ONE Platform Objective
Create a platform that can adapt to the needs of different markets
Make the Vitality One Platform the preferred platform for the development of all
Behavioral Change Functionality by:
• Allowing for rapid development and deployment cycles
• Unblocking delivery bottlenecks and enabling empowered development / federated development
• Creating technical tools that facilitate rapid development into the platform
• Providing optimal support, consulting, training to all development teams
• Providing rational and practical collaborative governance
• Continuing to secure, enhance and improve the platform
• Ensuring the Integrity and Capability of the Platform – so development work is consistent, of a high
quality and predictable
V1 Accreditation is the process of training partners on how to develop in the V1 style / pattern
and to educate them on the governance structures and processes that need to be adhered to
when developing features for the V1 solution.
44
V1 Platform supports over 1m registered users in 6 months
1st Quarter 2019
KOREA
1 000 000+
200 000+
P L A T F O R M
>1000 100 000
next 6 months
55
Q2 2019 Q3 2019 Q4 2019
Group Benefits
Q1 2020
USA
Vitality ONE Market Rollouts planned and in progress
Q2 2020
GERMANY
New Markets
AUSTRIA
New Markets
P L A T F O R M
Ecuador
Argentina
Netherlands
Chile
Saudi Arabia
Argentina -2
66
Ingres
Nodes
Master Nodes
Worker Nodes
Container Management Environment
Scale worker
nodes to
increase
throughput
WS02
API Manager & ESB
Database
WS02
IDM Manager
Elastic
Search
Kafka
Messaging
Zookeeper -
Distributed
Co-ordination
ETCD
Nodes
Liferay
Portal Server
Kibana
CF Hub
Worker Nodes contain:
Vitality One Microservices – approx. 60
Business Rules
Zuul - load balancing
Eureka – service registry
Config Server
“Standalone” Environment
Environment
Management
Auditing and
logging
SFTP
Production Environment Topology
Client
77
Developed centrally and deployed / run in various
jurisdictions
UAT Prod
Central Asset
Dev
Central
Asset Test
Central
Asset QA
UAT Prod
UAT Prod
UAT Prod
UAT Prod
BUILD A WORLD CLASS TECHNOLOGY PLATFORM TO CATER FOR THE REQUIREMENTS OF THE BUSINESS
88
So what’s inside the platform?
V 1 P L A T F O R M
Generic Business Capabilities
Client Management Product Management Contract Management Finance Management
Behavioural Change
Assessment
Partner Integration
Activities
Goals
Incentivisation
Rewards
Purchases
Gamification
Vitality-Specific CapabilitiesPoints Status
Gateway
IP
VDX
99
Kafka topics used extensively
V 1 P L A T F O R M
Generic Business Capabilities
Client Management Product Management Contract Management Finance Management
Behavioural Change
Assessment
Partner Integration
Activities
Goals
Incentivisation
Rewards
Purchases
Gamification
Vitality-Specific CapabilitiesPoints Status
Gateway
IP
VDX
Event Driven through Kafka topics
Event Driven through Kafka topics
Event Driven through Kafka topics
Event Driven through Kafka topics
1010
Vitality ONE
Back-end
Vitality ONE
Front-ends
Vitality ONE
Back-end
Partner
Front-ends
Vitality ONE APIs
Vitality ONE
Back-end
Partner
Front-ends
Vitality ONE APIs
Partner developed functions
As partners build into the platform it will increase the functionality available and accelerate delivery
Vitality ONE APIs
1 2 3
Provided Federated
Vitality ONE Development Options
Create a platform that can adapt to the needs of different markets
Service Portal
MCMP
Service Portal
MCMP
Service Portal
MCMP
1111
Vitality ONE Pipeline Process
Create a platform that can adapt to the needs of different markets
1212
Architectural Capabilities
DEVELOP BEST IN INDUSTRY ASSETS TO DELIVER ON OUR VISION
1313
DEVELOP BEST IN INDUSTRY ASSETS TO DELIVER ON OUR VISION
Architectural Capabilities – How does Kafka Fit?
1414
Why is Vitality ONE so different and a leader in its class
DEVELOP BEST IN INDUSTRY ASSETS TO DELIVER ON OUR VISION
1. Built from the ground up to cater for international requirements – multi language / multi
tenancy / multi language / time zones etc.
2. Built using new architecture and technologies to enable a more flexible delivery structure to
allow for scale. It leverages the technologies used by companies like Google, Netflix, Linked in
where scale and performance is critical
3. Built using industry standard technologies and models to ensure that we leveraged off proven
assets
4. Built to enable configuration over development
5. Built to allow third party developers and partners to contribute to the platform
6. Can be as open as we would like it to be
7. Built on a lightweight technology stack to avoid the overheads of software enterprise licenses
8. Designed to allow the parallel implementation of multiple countries
9. Built to provide a standard Vitality experience globally to ensure brand awareness, consistency
and value
1515
Our Journey to Kafka as a 3 Act Story
DEVELOP BEST IN INDUSTRY ASSETS TO DELIVER ON OUR VISION
Act 1: The Setup
The Problem with our
Current Architecture
Choosing Kafka as
our Future
Act 2: The Confrontation Act 3: The Resolution
Our Kafka success story
1616
Act 1: The Problem with our Current Architecture
DEVELOP BEST IN INDUSTRY ASSETS TO DELIVER ON OUR VISION
Before V1 - Vitality was built using a JMS implementation as it’s
message broker
JMS had a few drawbacks & complexities:
• Complicated error handling strategies
• Slower MTTR from outages
• Limited horizontal scalability
• The need to consume messages (on average) faster than or at the
same rate as they are published
1717
Act 1: The Problem with our Current Architecture
DEVELOP BEST IN INDUSTRY ASSETS TO DELIVER ON OUR VISION
“Considering we are building a health and
wellness platform for the future, we need to
look for a messaging system from the future,
rather than relying on the systems from the
past”
- Jesse Leresche
1818
Act 1: The Problem with our Current Architecture
DEVELOP BEST IN INDUSTRY ASSETS TO DELIVER ON OUR VISION
Needed a system that could:
• Provide infinite horizontally scalability
• Be fault tolerant & resilient
• Be able to handle large amounts of data
• Be fast
• Scale as we grew (opposed to requiring large
infrastructures from the outset)
1919
Act 2: Choosing Kafka as our Future
DEVELOP BEST IN INDUSTRY ASSETS TO DELIVER ON OUR VISION
2 major concerns:
• Lack of transactionality / 2-phase commit
• Guaranteed single message delivery mechanisms
2020
Act 2: Choosing Kafka as our Future
DEVELOP BEST IN INDUSTRY ASSETS TO DELIVER ON OUR VISION
2121
Act 2: Choosing Kafka as our Future – Educate!
DEVELOP BEST IN INDUSTRY ASSETS TO DELIVER ON OUR VISION
Take time to educate & change the organizational culture
• Kafka is not simply a JMS replacement
• Give people time to adjust to the new concepts - Kafka
can be difficult to explain & understand!
• Be patient
2222
Act 2: Choosing Kafka as our Future – RTFM
DEVELOP BEST IN INDUSTRY ASSETS TO DELIVER ON OUR VISION
2323
Act 2: Choosing Kafka as our Future – Keep up-to-date
DEVELOP BEST IN INDUSTRY ASSETS TO DELIVER ON OUR VISION
Keep as up-to-date as possible.
• Falling behind can make for complex upgrades later on
• Every new version has got more bug fixes and is more
stable – why wouldn’t you upgrade
• Not fun explaining to people that the production
outage you just had was avoidable had you upgraded
2424
Act 2: Choosing Kafka as our Future – Be cautious when creating
internal topics
DEVELOP BEST IN INDUSTRY ASSETS TO DELIVER ON OUR VISION
2525
Act 2: Choosing Kafka as our Future – Get your monitoring in place
DEVELOP BEST IN INDUSTRY ASSETS TO DELIVER ON OUR VISION
Originally – used open-source Kafka viewer
• Was good for point-in-time monitoring / spot checks
• Good tool for allowing dev’s to troubleshoot and
investigate issues
• Lacked ability to compare data-over-time
• Link: //TODO//
2626
Act 2: Choosing Kafka as our Future – Get your monitoring in place
DEVELOP BEST IN INDUSTRY ASSETS TO DELIVER ON OUR VISION
At launch we had a large load coming in - realized we
needed more in-depth monitoring
• Ad-hoc commands describing consumers not
sustainable
• Developed Bash script & PowerBi Dashboard
• Allowed comparison of throughput, alerting on lag etc.
• Process is slow – spins up new JVM per consumer group
• Migrating to Java-based service using the Kafka Admin Client – faster
responses, more fault tolerant, less bash, easier to deploy via our
pipeline
• Has RBAC and mobile view (via PowerBi) - can share this over the
internet securely
• Link: //TODO//
2727
Act 2: Choosing Kafka as our Future – Get your monitoring in place
DEVELOP BEST IN INDUSTRY ASSETS TO DELIVER ON OUR VISION
Dynatrace is used throughout our system for
monitoring & alerting
• Can monitor application health, uptime, disk space
etc.
• Use JMX metrics & alert & monitor on those – ISR’s
etc.
2828
Act 2: Choosing Kafka as our Future – Get your monitoring in place
DEVELOP BEST IN INDUSTRY ASSETS TO DELIVER ON OUR VISION
Upgraded our clusters to Confluent Platform
Enterprise, we were able to make use of Confluent
Control Centre
• Allowed monitoring of consumer groups, inspecting
of messages, schemas etc.
• Allowed monitoring of over & under consumption &
historical view of data processing/throughput
• Allowed monitoring of application health, ISR’s,
broker health etc.
2929
Act 3: Our Kafka success story
DEVELOP BEST IN INDUSTRY ASSETS TO DELIVER ON OUR VISION
1. Total number of Messages across clusters
2. Number messages per day
3. Number of Topics per cluster
4. Number of points awarded per hour
3030
Act 3: Our Kafka success story
DEVELOP BEST IN INDUSTRY ASSETS TO DELIVER ON OUR VISION
Roadmap for Kafka in V1:
• Move logs to ELK via Kafka
• Data Warehousing – moving data from the DB to Data Warehouse
using CDC & Kafka
• Migration of legacy components to Kafka
• Implement streaming – real-time fraud detection, points
calculations, system analytics
• Publishing DevOps pipeline events – services scaling up/down,
deployments, alerts etc.
3131
Act 3: Our Kafka success story
DEVELOP BEST IN INDUSTRY ASSETS TO DELIVER ON OUR VISION
3232

More Related Content

What's hot

Oracle_Multitenant_19c_-_All_About_Pluggable_D.pdf
Oracle_Multitenant_19c_-_All_About_Pluggable_D.pdfOracle_Multitenant_19c_-_All_About_Pluggable_D.pdf
Oracle_Multitenant_19c_-_All_About_Pluggable_D.pdfSrirakshaSrinivasan2
 
2019 - OOW - Database Migration Methods from On-Premise to Cloud
2019 - OOW - Database Migration Methods from On-Premise to Cloud2019 - OOW - Database Migration Methods from On-Premise to Cloud
2019 - OOW - Database Migration Methods from On-Premise to CloudMarcus Vinicius Miguel Pedro
 
Hybrid Data Guard to Cloud GEN2 ExaCS.pdf
Hybrid Data Guard to Cloud GEN2 ExaCS.pdfHybrid Data Guard to Cloud GEN2 ExaCS.pdf
Hybrid Data Guard to Cloud GEN2 ExaCS.pdfALI ANWAR, OCP®
 
Теоретический минимум для понимания Java Memory Model (для JPoint 2014)
Теоретический минимум для понимания Java Memory Model (для JPoint 2014)Теоретический минимум для понимания Java Memory Model (для JPoint 2014)
Теоретический минимум для понимания Java Memory Model (для JPoint 2014)Roman Elizarov
 
Dealing with different Synapse Roles in Azure Synapse Analytics Erwin de Kreuk
Dealing with different Synapse Roles in Azure Synapse Analytics Erwin de KreukDealing with different Synapse Roles in Azure Synapse Analytics Erwin de Kreuk
Dealing with different Synapse Roles in Azure Synapse Analytics Erwin de KreukErwin de Kreuk
 
Data cleansing and prep with synapse data flows
Data cleansing and prep with synapse data flowsData cleansing and prep with synapse data flows
Data cleansing and prep with synapse data flowsMark Kromer
 
AZ-900 Azure Fundamentals.pdf
AZ-900 Azure Fundamentals.pdfAZ-900 Azure Fundamentals.pdf
AZ-900 Azure Fundamentals.pdfssuser5813861
 
An Introduction to Confluent Cloud: Apache Kafka as a Service
An Introduction to Confluent Cloud: Apache Kafka as a ServiceAn Introduction to Confluent Cloud: Apache Kafka as a Service
An Introduction to Confluent Cloud: Apache Kafka as a Serviceconfluent
 
Oracle Performance Tools of the Trade
Oracle Performance Tools of the TradeOracle Performance Tools of the Trade
Oracle Performance Tools of the TradeCarlos Sierra
 
Kafka for Real-Time Replication between Edge and Hybrid Cloud
Kafka for Real-Time Replication between Edge and Hybrid CloudKafka for Real-Time Replication between Edge and Hybrid Cloud
Kafka for Real-Time Replication between Edge and Hybrid CloudKai Wähner
 
ORACLE 12C DATA GUARD: FAR SYNC, REAL-TIME CASCADE STANDBY AND OTHER GOODIES
ORACLE 12C DATA GUARD: FAR SYNC, REAL-TIME CASCADE STANDBY AND OTHER GOODIESORACLE 12C DATA GUARD: FAR SYNC, REAL-TIME CASCADE STANDBY AND OTHER GOODIES
ORACLE 12C DATA GUARD: FAR SYNC, REAL-TIME CASCADE STANDBY AND OTHER GOODIESLudovico Caldara
 
DB2 V 10 HADR Multiple Standby
DB2 V 10 HADR Multiple StandbyDB2 V 10 HADR Multiple Standby
DB2 V 10 HADR Multiple StandbyDale McInnis
 
Kafka Tutorial - introduction to the Kafka streaming platform
Kafka Tutorial - introduction to the Kafka streaming platformKafka Tutorial - introduction to the Kafka streaming platform
Kafka Tutorial - introduction to the Kafka streaming platformJean-Paul Azar
 
Art of agile coaching
Art of agile coachingArt of agile coaching
Art of agile coachingCoffee Talk
 
On Track: The ART of Avoiding a Train Wreck
On Track: The ART of Avoiding a Train WreckOn Track: The ART of Avoiding a Train Wreck
On Track: The ART of Avoiding a Train WreckEm Campbell-Pretty
 
Modelo para la evolución de competencias para Facilitadores de Equipos
Modelo para la evolución de competencias para Facilitadores de EquiposModelo para la evolución de competencias para Facilitadores de Equipos
Modelo para la evolución de competencias para Facilitadores de EquiposGiovanny Cifuentes
 
SAFe® PI Planning - 4 locations - but how?
SAFe® PI Planning - 4 locations - but how?SAFe® PI Planning - 4 locations - but how?
SAFe® PI Planning - 4 locations - but how?Silvio Wandfluh
 

What's hot (20)

Oracle_Multitenant_19c_-_All_About_Pluggable_D.pdf
Oracle_Multitenant_19c_-_All_About_Pluggable_D.pdfOracle_Multitenant_19c_-_All_About_Pluggable_D.pdf
Oracle_Multitenant_19c_-_All_About_Pluggable_D.pdf
 
2019 - OOW - Database Migration Methods from On-Premise to Cloud
2019 - OOW - Database Migration Methods from On-Premise to Cloud2019 - OOW - Database Migration Methods from On-Premise to Cloud
2019 - OOW - Database Migration Methods from On-Premise to Cloud
 
Data-Driven IT Automation: A Vision for the Modern CIO
Data-Driven IT Automation: A Vision for the Modern CIOData-Driven IT Automation: A Vision for the Modern CIO
Data-Driven IT Automation: A Vision for the Modern CIO
 
Hybrid Data Guard to Cloud GEN2 ExaCS.pdf
Hybrid Data Guard to Cloud GEN2 ExaCS.pdfHybrid Data Guard to Cloud GEN2 ExaCS.pdf
Hybrid Data Guard to Cloud GEN2 ExaCS.pdf
 
Теоретический минимум для понимания Java Memory Model (для JPoint 2014)
Теоретический минимум для понимания Java Memory Model (для JPoint 2014)Теоретический минимум для понимания Java Memory Model (для JPoint 2014)
Теоретический минимум для понимания Java Memory Model (для JPoint 2014)
 
Dealing with different Synapse Roles in Azure Synapse Analytics Erwin de Kreuk
Dealing with different Synapse Roles in Azure Synapse Analytics Erwin de KreukDealing with different Synapse Roles in Azure Synapse Analytics Erwin de Kreuk
Dealing with different Synapse Roles in Azure Synapse Analytics Erwin de Kreuk
 
Yahoo compares Storm and Spark
Yahoo compares Storm and SparkYahoo compares Storm and Spark
Yahoo compares Storm and Spark
 
Data cleansing and prep with synapse data flows
Data cleansing and prep with synapse data flowsData cleansing and prep with synapse data flows
Data cleansing and prep with synapse data flows
 
AZ-900 Azure Fundamentals.pdf
AZ-900 Azure Fundamentals.pdfAZ-900 Azure Fundamentals.pdf
AZ-900 Azure Fundamentals.pdf
 
An Introduction to Confluent Cloud: Apache Kafka as a Service
An Introduction to Confluent Cloud: Apache Kafka as a ServiceAn Introduction to Confluent Cloud: Apache Kafka as a Service
An Introduction to Confluent Cloud: Apache Kafka as a Service
 
Oracle Performance Tools of the Trade
Oracle Performance Tools of the TradeOracle Performance Tools of the Trade
Oracle Performance Tools of the Trade
 
Kafka for Real-Time Replication between Edge and Hybrid Cloud
Kafka for Real-Time Replication between Edge and Hybrid CloudKafka for Real-Time Replication between Edge and Hybrid Cloud
Kafka for Real-Time Replication between Edge and Hybrid Cloud
 
ORACLE 12C DATA GUARD: FAR SYNC, REAL-TIME CASCADE STANDBY AND OTHER GOODIES
ORACLE 12C DATA GUARD: FAR SYNC, REAL-TIME CASCADE STANDBY AND OTHER GOODIESORACLE 12C DATA GUARD: FAR SYNC, REAL-TIME CASCADE STANDBY AND OTHER GOODIES
ORACLE 12C DATA GUARD: FAR SYNC, REAL-TIME CASCADE STANDBY AND OTHER GOODIES
 
DB2 V 10 HADR Multiple Standby
DB2 V 10 HADR Multiple StandbyDB2 V 10 HADR Multiple Standby
DB2 V 10 HADR Multiple Standby
 
Kafka Tutorial - introduction to the Kafka streaming platform
Kafka Tutorial - introduction to the Kafka streaming platformKafka Tutorial - introduction to the Kafka streaming platform
Kafka Tutorial - introduction to the Kafka streaming platform
 
The Agile Team Facilitator Mindset
The Agile Team Facilitator MindsetThe Agile Team Facilitator Mindset
The Agile Team Facilitator Mindset
 
Art of agile coaching
Art of agile coachingArt of agile coaching
Art of agile coaching
 
On Track: The ART of Avoiding a Train Wreck
On Track: The ART of Avoiding a Train WreckOn Track: The ART of Avoiding a Train Wreck
On Track: The ART of Avoiding a Train Wreck
 
Modelo para la evolución de competencias para Facilitadores de Equipos
Modelo para la evolución de competencias para Facilitadores de EquiposModelo para la evolución de competencias para Facilitadores de Equipos
Modelo para la evolución de competencias para Facilitadores de Equipos
 
SAFe® PI Planning - 4 locations - but how?
SAFe® PI Planning - 4 locations - but how?SAFe® PI Planning - 4 locations - but how?
SAFe® PI Planning - 4 locations - but how?
 

Similar to How to Build and Operate a Global Behavioral Change Platform (Neil Adamson, Vitality and Jesse Leresche, Entelect / Discovery) Kafka Summit London 2019

Confluent Steaming Webinar - Cape Town - Vitality
Confluent Steaming Webinar - Cape Town - VitalityConfluent Steaming Webinar - Cape Town - Vitality
Confluent Steaming Webinar - Cape Town - Vitalityconfluent
 
Resume_Achhar_Kalia
Resume_Achhar_KaliaResume_Achhar_Kalia
Resume_Achhar_KaliaAchhar Kalia
 
VMworld 2013: Best Practices for Application Lifecycle Management with vCloud...
VMworld 2013: Best Practices for Application Lifecycle Management with vCloud...VMworld 2013: Best Practices for Application Lifecycle Management with vCloud...
VMworld 2013: Best Practices for Application Lifecycle Management with vCloud...VMworld
 
Embracing Containers and Microservices for Future Proof Application Moderniza...
Embracing Containers and Microservices for Future Proof Application Moderniza...Embracing Containers and Microservices for Future Proof Application Moderniza...
Embracing Containers and Microservices for Future Proof Application Moderniza...Marlabs
 
Technology insights: Decision Science Platform
Technology insights: Decision Science PlatformTechnology insights: Decision Science Platform
Technology insights: Decision Science PlatformDecision Science Community
 
PaaS Lessons: Cisco IT Deploys OpenShift to Meet Developer Demand
PaaS Lessons: Cisco IT Deploys OpenShift to Meet Developer DemandPaaS Lessons: Cisco IT Deploys OpenShift to Meet Developer Demand
PaaS Lessons: Cisco IT Deploys OpenShift to Meet Developer DemandCisco IT
 
Contino Webinar - Migrating your Trading Workloads to the Cloud
Contino Webinar -  Migrating your Trading Workloads to the CloudContino Webinar -  Migrating your Trading Workloads to the Cloud
Contino Webinar - Migrating your Trading Workloads to the CloudBen Saunders
 
Disruptive Trends in Application Development
Disruptive Trends in Application DevelopmentDisruptive Trends in Application Development
Disruptive Trends in Application DevelopmentWaveMaker, Inc.
 
Red hat's updates on the cloud & infrastructure strategy
Red hat's updates on the cloud & infrastructure strategyRed hat's updates on the cloud & infrastructure strategy
Red hat's updates on the cloud & infrastructure strategyOrgad Kimchi
 
VMworld 2015: Container Orchestration with the SDDC
VMworld 2015: Container Orchestration with the SDDCVMworld 2015: Container Orchestration with the SDDC
VMworld 2015: Container Orchestration with the SDDCVMworld
 
Centralized logging in a changing environment at the UK’s DVLA
Centralized logging in a changing environment at the UK’s DVLACentralized logging in a changing environment at the UK’s DVLA
Centralized logging in a changing environment at the UK’s DVLAElasticsearch
 
apidays LIVE Paris 2021 - Synchronous Communication Patterns by Sébastien Ber...
apidays LIVE Paris 2021 - Synchronous Communication Patterns by Sébastien Ber...apidays LIVE Paris 2021 - Synchronous Communication Patterns by Sébastien Ber...
apidays LIVE Paris 2021 - Synchronous Communication Patterns by Sébastien Ber...apidays
 
Container Technologies and Transformational value
Container Technologies and Transformational valueContainer Technologies and Transformational value
Container Technologies and Transformational valueMihai Criveti
 
DevOps for Enterprise Systems : Innovate like a Startup
DevOps for Enterprise Systems : Innovate like a StartupDevOps for Enterprise Systems : Innovate like a Startup
DevOps for Enterprise Systems : Innovate like a StartupDevOps for Enterprise Systems
 
DCSF19 Adding a Modern API Layer to ‘Dockerized’ Legacy Apps
DCSF19 Adding a Modern API Layer to ‘Dockerized’ Legacy Apps  DCSF19 Adding a Modern API Layer to ‘Dockerized’ Legacy Apps
DCSF19 Adding a Modern API Layer to ‘Dockerized’ Legacy Apps Docker, Inc.
 
Whitepaper factors to consider commercial infrastructure management vendors
Whitepaper  factors to consider commercial infrastructure management vendorsWhitepaper  factors to consider commercial infrastructure management vendors
Whitepaper factors to consider commercial infrastructure management vendorsapprize360
 
Service Mesh Talk for CTO Forum
Service Mesh Talk for CTO ForumService Mesh Talk for CTO Forum
Service Mesh Talk for CTO ForumRick Hightower
 
Whitepaper factors to consider when selecting an open source infrastructure ...
Whitepaper  factors to consider when selecting an open source infrastructure ...Whitepaper  factors to consider when selecting an open source infrastructure ...
Whitepaper factors to consider when selecting an open source infrastructure ...apprize360
 
MuleSoft Manchester Meetup #4 slides 11th February 2021
MuleSoft Manchester Meetup #4 slides 11th February 2021MuleSoft Manchester Meetup #4 slides 11th February 2021
MuleSoft Manchester Meetup #4 slides 11th February 2021Ieva Navickaite
 
Modern Cloud-Native Streaming Platforms: Event Streaming Microservices with A...
Modern Cloud-Native Streaming Platforms: Event Streaming Microservices with A...Modern Cloud-Native Streaming Platforms: Event Streaming Microservices with A...
Modern Cloud-Native Streaming Platforms: Event Streaming Microservices with A...confluent
 

Similar to How to Build and Operate a Global Behavioral Change Platform (Neil Adamson, Vitality and Jesse Leresche, Entelect / Discovery) Kafka Summit London 2019 (20)

Confluent Steaming Webinar - Cape Town - Vitality
Confluent Steaming Webinar - Cape Town - VitalityConfluent Steaming Webinar - Cape Town - Vitality
Confluent Steaming Webinar - Cape Town - Vitality
 
Resume_Achhar_Kalia
Resume_Achhar_KaliaResume_Achhar_Kalia
Resume_Achhar_Kalia
 
VMworld 2013: Best Practices for Application Lifecycle Management with vCloud...
VMworld 2013: Best Practices for Application Lifecycle Management with vCloud...VMworld 2013: Best Practices for Application Lifecycle Management with vCloud...
VMworld 2013: Best Practices for Application Lifecycle Management with vCloud...
 
Embracing Containers and Microservices for Future Proof Application Moderniza...
Embracing Containers and Microservices for Future Proof Application Moderniza...Embracing Containers and Microservices for Future Proof Application Moderniza...
Embracing Containers and Microservices for Future Proof Application Moderniza...
 
Technology insights: Decision Science Platform
Technology insights: Decision Science PlatformTechnology insights: Decision Science Platform
Technology insights: Decision Science Platform
 
PaaS Lessons: Cisco IT Deploys OpenShift to Meet Developer Demand
PaaS Lessons: Cisco IT Deploys OpenShift to Meet Developer DemandPaaS Lessons: Cisco IT Deploys OpenShift to Meet Developer Demand
PaaS Lessons: Cisco IT Deploys OpenShift to Meet Developer Demand
 
Contino Webinar - Migrating your Trading Workloads to the Cloud
Contino Webinar -  Migrating your Trading Workloads to the CloudContino Webinar -  Migrating your Trading Workloads to the Cloud
Contino Webinar - Migrating your Trading Workloads to the Cloud
 
Disruptive Trends in Application Development
Disruptive Trends in Application DevelopmentDisruptive Trends in Application Development
Disruptive Trends in Application Development
 
Red hat's updates on the cloud & infrastructure strategy
Red hat's updates on the cloud & infrastructure strategyRed hat's updates on the cloud & infrastructure strategy
Red hat's updates on the cloud & infrastructure strategy
 
VMworld 2015: Container Orchestration with the SDDC
VMworld 2015: Container Orchestration with the SDDCVMworld 2015: Container Orchestration with the SDDC
VMworld 2015: Container Orchestration with the SDDC
 
Centralized logging in a changing environment at the UK’s DVLA
Centralized logging in a changing environment at the UK’s DVLACentralized logging in a changing environment at the UK’s DVLA
Centralized logging in a changing environment at the UK’s DVLA
 
apidays LIVE Paris 2021 - Synchronous Communication Patterns by Sébastien Ber...
apidays LIVE Paris 2021 - Synchronous Communication Patterns by Sébastien Ber...apidays LIVE Paris 2021 - Synchronous Communication Patterns by Sébastien Ber...
apidays LIVE Paris 2021 - Synchronous Communication Patterns by Sébastien Ber...
 
Container Technologies and Transformational value
Container Technologies and Transformational valueContainer Technologies and Transformational value
Container Technologies and Transformational value
 
DevOps for Enterprise Systems : Innovate like a Startup
DevOps for Enterprise Systems : Innovate like a StartupDevOps for Enterprise Systems : Innovate like a Startup
DevOps for Enterprise Systems : Innovate like a Startup
 
DCSF19 Adding a Modern API Layer to ‘Dockerized’ Legacy Apps
DCSF19 Adding a Modern API Layer to ‘Dockerized’ Legacy Apps  DCSF19 Adding a Modern API Layer to ‘Dockerized’ Legacy Apps
DCSF19 Adding a Modern API Layer to ‘Dockerized’ Legacy Apps
 
Whitepaper factors to consider commercial infrastructure management vendors
Whitepaper  factors to consider commercial infrastructure management vendorsWhitepaper  factors to consider commercial infrastructure management vendors
Whitepaper factors to consider commercial infrastructure management vendors
 
Service Mesh Talk for CTO Forum
Service Mesh Talk for CTO ForumService Mesh Talk for CTO Forum
Service Mesh Talk for CTO Forum
 
Whitepaper factors to consider when selecting an open source infrastructure ...
Whitepaper  factors to consider when selecting an open source infrastructure ...Whitepaper  factors to consider when selecting an open source infrastructure ...
Whitepaper factors to consider when selecting an open source infrastructure ...
 
MuleSoft Manchester Meetup #4 slides 11th February 2021
MuleSoft Manchester Meetup #4 slides 11th February 2021MuleSoft Manchester Meetup #4 slides 11th February 2021
MuleSoft Manchester Meetup #4 slides 11th February 2021
 
Modern Cloud-Native Streaming Platforms: Event Streaming Microservices with A...
Modern Cloud-Native Streaming Platforms: Event Streaming Microservices with A...Modern Cloud-Native Streaming Platforms: Event Streaming Microservices with A...
Modern Cloud-Native Streaming Platforms: Event Streaming Microservices with A...
 

More from confluent

Catch the Wave: SAP Event-Driven and Data Streaming for the Intelligence Ente...
Catch the Wave: SAP Event-Driven and Data Streaming for the Intelligence Ente...Catch the Wave: SAP Event-Driven and Data Streaming for the Intelligence Ente...
Catch the Wave: SAP Event-Driven and Data Streaming for the Intelligence Ente...confluent
 
Santander Stream Processing with Apache Flink
Santander Stream Processing with Apache FlinkSantander Stream Processing with Apache Flink
Santander Stream Processing with Apache Flinkconfluent
 
Unlocking the Power of IoT: A comprehensive approach to real-time insights
Unlocking the Power of IoT: A comprehensive approach to real-time insightsUnlocking the Power of IoT: A comprehensive approach to real-time insights
Unlocking the Power of IoT: A comprehensive approach to real-time insightsconfluent
 
Workshop híbrido: Stream Processing con Flink
Workshop híbrido: Stream Processing con FlinkWorkshop híbrido: Stream Processing con Flink
Workshop híbrido: Stream Processing con Flinkconfluent
 
Industry 4.0: Building the Unified Namespace with Confluent, HiveMQ and Spark...
Industry 4.0: Building the Unified Namespace with Confluent, HiveMQ and Spark...Industry 4.0: Building the Unified Namespace with Confluent, HiveMQ and Spark...
Industry 4.0: Building the Unified Namespace with Confluent, HiveMQ and Spark...confluent
 
AWS Immersion Day Mapfre - Confluent
AWS Immersion Day Mapfre   -   ConfluentAWS Immersion Day Mapfre   -   Confluent
AWS Immersion Day Mapfre - Confluentconfluent
 
Eventos y Microservicios - Santander TechTalk
Eventos y Microservicios - Santander TechTalkEventos y Microservicios - Santander TechTalk
Eventos y Microservicios - Santander TechTalkconfluent
 
Q&A with Confluent Experts: Navigating Networking in Confluent Cloud
Q&A with Confluent Experts: Navigating Networking in Confluent CloudQ&A with Confluent Experts: Navigating Networking in Confluent Cloud
Q&A with Confluent Experts: Navigating Networking in Confluent Cloudconfluent
 
Citi TechTalk Session 2: Kafka Deep Dive
Citi TechTalk Session 2: Kafka Deep DiveCiti TechTalk Session 2: Kafka Deep Dive
Citi TechTalk Session 2: Kafka Deep Diveconfluent
 
Build real-time streaming data pipelines to AWS with Confluent
Build real-time streaming data pipelines to AWS with ConfluentBuild real-time streaming data pipelines to AWS with Confluent
Build real-time streaming data pipelines to AWS with Confluentconfluent
 
Q&A with Confluent Professional Services: Confluent Service Mesh
Q&A with Confluent Professional Services: Confluent Service MeshQ&A with Confluent Professional Services: Confluent Service Mesh
Q&A with Confluent Professional Services: Confluent Service Meshconfluent
 
Citi Tech Talk: Event Driven Kafka Microservices
Citi Tech Talk: Event Driven Kafka MicroservicesCiti Tech Talk: Event Driven Kafka Microservices
Citi Tech Talk: Event Driven Kafka Microservicesconfluent
 
Confluent & GSI Webinars series - Session 3
Confluent & GSI Webinars series - Session 3Confluent & GSI Webinars series - Session 3
Confluent & GSI Webinars series - Session 3confluent
 
Citi Tech Talk: Messaging Modernization
Citi Tech Talk: Messaging ModernizationCiti Tech Talk: Messaging Modernization
Citi Tech Talk: Messaging Modernizationconfluent
 
Citi Tech Talk: Data Governance for streaming and real time data
Citi Tech Talk: Data Governance for streaming and real time dataCiti Tech Talk: Data Governance for streaming and real time data
Citi Tech Talk: Data Governance for streaming and real time dataconfluent
 
Confluent & GSI Webinars series: Session 2
Confluent & GSI Webinars series: Session 2Confluent & GSI Webinars series: Session 2
Confluent & GSI Webinars series: Session 2confluent
 
Data In Motion Paris 2023
Data In Motion Paris 2023Data In Motion Paris 2023
Data In Motion Paris 2023confluent
 
Confluent Partner Tech Talk with Synthesis
Confluent Partner Tech Talk with SynthesisConfluent Partner Tech Talk with Synthesis
Confluent Partner Tech Talk with Synthesisconfluent
 
The Future of Application Development - API Days - Melbourne 2023
The Future of Application Development - API Days - Melbourne 2023The Future of Application Development - API Days - Melbourne 2023
The Future of Application Development - API Days - Melbourne 2023confluent
 
The Playful Bond Between REST And Data Streams
The Playful Bond Between REST And Data StreamsThe Playful Bond Between REST And Data Streams
The Playful Bond Between REST And Data Streamsconfluent
 

More from confluent (20)

Catch the Wave: SAP Event-Driven and Data Streaming for the Intelligence Ente...
Catch the Wave: SAP Event-Driven and Data Streaming for the Intelligence Ente...Catch the Wave: SAP Event-Driven and Data Streaming for the Intelligence Ente...
Catch the Wave: SAP Event-Driven and Data Streaming for the Intelligence Ente...
 
Santander Stream Processing with Apache Flink
Santander Stream Processing with Apache FlinkSantander Stream Processing with Apache Flink
Santander Stream Processing with Apache Flink
 
Unlocking the Power of IoT: A comprehensive approach to real-time insights
Unlocking the Power of IoT: A comprehensive approach to real-time insightsUnlocking the Power of IoT: A comprehensive approach to real-time insights
Unlocking the Power of IoT: A comprehensive approach to real-time insights
 
Workshop híbrido: Stream Processing con Flink
Workshop híbrido: Stream Processing con FlinkWorkshop híbrido: Stream Processing con Flink
Workshop híbrido: Stream Processing con Flink
 
Industry 4.0: Building the Unified Namespace with Confluent, HiveMQ and Spark...
Industry 4.0: Building the Unified Namespace with Confluent, HiveMQ and Spark...Industry 4.0: Building the Unified Namespace with Confluent, HiveMQ and Spark...
Industry 4.0: Building the Unified Namespace with Confluent, HiveMQ and Spark...
 
AWS Immersion Day Mapfre - Confluent
AWS Immersion Day Mapfre   -   ConfluentAWS Immersion Day Mapfre   -   Confluent
AWS Immersion Day Mapfre - Confluent
 
Eventos y Microservicios - Santander TechTalk
Eventos y Microservicios - Santander TechTalkEventos y Microservicios - Santander TechTalk
Eventos y Microservicios - Santander TechTalk
 
Q&A with Confluent Experts: Navigating Networking in Confluent Cloud
Q&A with Confluent Experts: Navigating Networking in Confluent CloudQ&A with Confluent Experts: Navigating Networking in Confluent Cloud
Q&A with Confluent Experts: Navigating Networking in Confluent Cloud
 
Citi TechTalk Session 2: Kafka Deep Dive
Citi TechTalk Session 2: Kafka Deep DiveCiti TechTalk Session 2: Kafka Deep Dive
Citi TechTalk Session 2: Kafka Deep Dive
 
Build real-time streaming data pipelines to AWS with Confluent
Build real-time streaming data pipelines to AWS with ConfluentBuild real-time streaming data pipelines to AWS with Confluent
Build real-time streaming data pipelines to AWS with Confluent
 
Q&A with Confluent Professional Services: Confluent Service Mesh
Q&A with Confluent Professional Services: Confluent Service MeshQ&A with Confluent Professional Services: Confluent Service Mesh
Q&A with Confluent Professional Services: Confluent Service Mesh
 
Citi Tech Talk: Event Driven Kafka Microservices
Citi Tech Talk: Event Driven Kafka MicroservicesCiti Tech Talk: Event Driven Kafka Microservices
Citi Tech Talk: Event Driven Kafka Microservices
 
Confluent & GSI Webinars series - Session 3
Confluent & GSI Webinars series - Session 3Confluent & GSI Webinars series - Session 3
Confluent & GSI Webinars series - Session 3
 
Citi Tech Talk: Messaging Modernization
Citi Tech Talk: Messaging ModernizationCiti Tech Talk: Messaging Modernization
Citi Tech Talk: Messaging Modernization
 
Citi Tech Talk: Data Governance for streaming and real time data
Citi Tech Talk: Data Governance for streaming and real time dataCiti Tech Talk: Data Governance for streaming and real time data
Citi Tech Talk: Data Governance for streaming and real time data
 
Confluent & GSI Webinars series: Session 2
Confluent & GSI Webinars series: Session 2Confluent & GSI Webinars series: Session 2
Confluent & GSI Webinars series: Session 2
 
Data In Motion Paris 2023
Data In Motion Paris 2023Data In Motion Paris 2023
Data In Motion Paris 2023
 
Confluent Partner Tech Talk with Synthesis
Confluent Partner Tech Talk with SynthesisConfluent Partner Tech Talk with Synthesis
Confluent Partner Tech Talk with Synthesis
 
The Future of Application Development - API Days - Melbourne 2023
The Future of Application Development - API Days - Melbourne 2023The Future of Application Development - API Days - Melbourne 2023
The Future of Application Development - API Days - Melbourne 2023
 
The Playful Bond Between REST And Data Streams
The Playful Bond Between REST And Data StreamsThe Playful Bond Between REST And Data Streams
The Playful Bond Between REST And Data Streams
 

Recently uploaded

Histor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slideHistor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slidevu2urc
 
🐬 The future of MySQL is Postgres 🐘
🐬  The future of MySQL is Postgres   🐘🐬  The future of MySQL is Postgres   🐘
🐬 The future of MySQL is Postgres 🐘RTylerCroy
 
08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking Men08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking MenDelhi Call girls
 
FULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | Delhi
FULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | DelhiFULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | Delhi
FULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | Delhisoniya singh
 
Data Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonData Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonAnna Loughnan Colquhoun
 
My Hashitalk Indonesia April 2024 Presentation
My Hashitalk Indonesia April 2024 PresentationMy Hashitalk Indonesia April 2024 Presentation
My Hashitalk Indonesia April 2024 PresentationRidwan Fadjar
 
Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...
Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...
Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...HostedbyConfluent
 
Salesforce Community Group Quito, Salesforce 101
Salesforce Community Group Quito, Salesforce 101Salesforce Community Group Quito, Salesforce 101
Salesforce Community Group Quito, Salesforce 101Paola De la Torre
 
Presentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreterPresentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreternaman860154
 
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...Miguel Araújo
 
SQL Database Design For Developers at php[tek] 2024
SQL Database Design For Developers at php[tek] 2024SQL Database Design For Developers at php[tek] 2024
SQL Database Design For Developers at php[tek] 2024Scott Keck-Warren
 
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationFrom Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationSafe Software
 
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...Igalia
 
Scaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationScaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationRadu Cotescu
 
Boost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivityBoost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivityPrincipled Technologies
 
Google AI Hackathon: LLM based Evaluator for RAG
Google AI Hackathon: LLM based Evaluator for RAGGoogle AI Hackathon: LLM based Evaluator for RAG
Google AI Hackathon: LLM based Evaluator for RAGSujit Pal
 
CNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of ServiceCNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of Servicegiselly40
 
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure service
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure serviceWhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure service
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure servicePooja Nehwal
 
IAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsIAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsEnterprise Knowledge
 
Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024BookNet Canada
 

Recently uploaded (20)

Histor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slideHistor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slide
 
🐬 The future of MySQL is Postgres 🐘
🐬  The future of MySQL is Postgres   🐘🐬  The future of MySQL is Postgres   🐘
🐬 The future of MySQL is Postgres 🐘
 
08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking Men08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking Men
 
FULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | Delhi
FULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | DelhiFULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | Delhi
FULL ENJOY 🔝 8264348440 🔝 Call Girls in Diplomatic Enclave | Delhi
 
Data Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonData Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt Robison
 
My Hashitalk Indonesia April 2024 Presentation
My Hashitalk Indonesia April 2024 PresentationMy Hashitalk Indonesia April 2024 Presentation
My Hashitalk Indonesia April 2024 Presentation
 
Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...
Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...
Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...
 
Salesforce Community Group Quito, Salesforce 101
Salesforce Community Group Quito, Salesforce 101Salesforce Community Group Quito, Salesforce 101
Salesforce Community Group Quito, Salesforce 101
 
Presentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreterPresentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreter
 
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
 
SQL Database Design For Developers at php[tek] 2024
SQL Database Design For Developers at php[tek] 2024SQL Database Design For Developers at php[tek] 2024
SQL Database Design For Developers at php[tek] 2024
 
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationFrom Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
 
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
 
Scaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationScaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organization
 
Boost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivityBoost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivity
 
Google AI Hackathon: LLM based Evaluator for RAG
Google AI Hackathon: LLM based Evaluator for RAGGoogle AI Hackathon: LLM based Evaluator for RAG
Google AI Hackathon: LLM based Evaluator for RAG
 
CNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of ServiceCNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of Service
 
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure service
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure serviceWhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure service
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure service
 
IAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsIAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI Solutions
 
Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
 

How to Build and Operate a Global Behavioral Change Platform (Neil Adamson, Vitality and Jesse Leresche, Entelect / Discovery) Kafka Summit London 2019

  • 1. 11 2 0 1 9 – K a f k a S u m m i t – L o n d o n Vitality ONE
  • 2. 22 ”Provide a global behavioural change platform that is quick to implement, easy to configure and efficient to operate - serving over 50 million global users by 2023” Vision
  • 3. 33 Vitality ONE Platform Objective Create a platform that can adapt to the needs of different markets Make the Vitality One Platform the preferred platform for the development of all Behavioral Change Functionality by: • Allowing for rapid development and deployment cycles • Unblocking delivery bottlenecks and enabling empowered development / federated development • Creating technical tools that facilitate rapid development into the platform • Providing optimal support, consulting, training to all development teams • Providing rational and practical collaborative governance • Continuing to secure, enhance and improve the platform • Ensuring the Integrity and Capability of the Platform – so development work is consistent, of a high quality and predictable V1 Accreditation is the process of training partners on how to develop in the V1 style / pattern and to educate them on the governance structures and processes that need to be adhered to when developing features for the V1 solution.
  • 4. 44 V1 Platform supports over 1m registered users in 6 months 1st Quarter 2019 KOREA 1 000 000+ 200 000+ P L A T F O R M >1000 100 000 next 6 months
  • 5. 55 Q2 2019 Q3 2019 Q4 2019 Group Benefits Q1 2020 USA Vitality ONE Market Rollouts planned and in progress Q2 2020 GERMANY New Markets AUSTRIA New Markets P L A T F O R M Ecuador Argentina Netherlands Chile Saudi Arabia Argentina -2
  • 6. 66 Ingres Nodes Master Nodes Worker Nodes Container Management Environment Scale worker nodes to increase throughput WS02 API Manager & ESB Database WS02 IDM Manager Elastic Search Kafka Messaging Zookeeper - Distributed Co-ordination ETCD Nodes Liferay Portal Server Kibana CF Hub Worker Nodes contain: Vitality One Microservices – approx. 60 Business Rules Zuul - load balancing Eureka – service registry Config Server “Standalone” Environment Environment Management Auditing and logging SFTP Production Environment Topology Client
  • 7. 77 Developed centrally and deployed / run in various jurisdictions UAT Prod Central Asset Dev Central Asset Test Central Asset QA UAT Prod UAT Prod UAT Prod UAT Prod BUILD A WORLD CLASS TECHNOLOGY PLATFORM TO CATER FOR THE REQUIREMENTS OF THE BUSINESS
  • 8. 88 So what’s inside the platform? V 1 P L A T F O R M Generic Business Capabilities Client Management Product Management Contract Management Finance Management Behavioural Change Assessment Partner Integration Activities Goals Incentivisation Rewards Purchases Gamification Vitality-Specific CapabilitiesPoints Status Gateway IP VDX
  • 9. 99 Kafka topics used extensively V 1 P L A T F O R M Generic Business Capabilities Client Management Product Management Contract Management Finance Management Behavioural Change Assessment Partner Integration Activities Goals Incentivisation Rewards Purchases Gamification Vitality-Specific CapabilitiesPoints Status Gateway IP VDX Event Driven through Kafka topics Event Driven through Kafka topics Event Driven through Kafka topics Event Driven through Kafka topics
  • 10. 1010 Vitality ONE Back-end Vitality ONE Front-ends Vitality ONE Back-end Partner Front-ends Vitality ONE APIs Vitality ONE Back-end Partner Front-ends Vitality ONE APIs Partner developed functions As partners build into the platform it will increase the functionality available and accelerate delivery Vitality ONE APIs 1 2 3 Provided Federated Vitality ONE Development Options Create a platform that can adapt to the needs of different markets Service Portal MCMP Service Portal MCMP Service Portal MCMP
  • 11. 1111 Vitality ONE Pipeline Process Create a platform that can adapt to the needs of different markets
  • 12. 1212 Architectural Capabilities DEVELOP BEST IN INDUSTRY ASSETS TO DELIVER ON OUR VISION
  • 13. 1313 DEVELOP BEST IN INDUSTRY ASSETS TO DELIVER ON OUR VISION Architectural Capabilities – How does Kafka Fit?
  • 14. 1414 Why is Vitality ONE so different and a leader in its class DEVELOP BEST IN INDUSTRY ASSETS TO DELIVER ON OUR VISION 1. Built from the ground up to cater for international requirements – multi language / multi tenancy / multi language / time zones etc. 2. Built using new architecture and technologies to enable a more flexible delivery structure to allow for scale. It leverages the technologies used by companies like Google, Netflix, Linked in where scale and performance is critical 3. Built using industry standard technologies and models to ensure that we leveraged off proven assets 4. Built to enable configuration over development 5. Built to allow third party developers and partners to contribute to the platform 6. Can be as open as we would like it to be 7. Built on a lightweight technology stack to avoid the overheads of software enterprise licenses 8. Designed to allow the parallel implementation of multiple countries 9. Built to provide a standard Vitality experience globally to ensure brand awareness, consistency and value
  • 15. 1515 Our Journey to Kafka as a 3 Act Story DEVELOP BEST IN INDUSTRY ASSETS TO DELIVER ON OUR VISION Act 1: The Setup The Problem with our Current Architecture Choosing Kafka as our Future Act 2: The Confrontation Act 3: The Resolution Our Kafka success story
  • 16. 1616 Act 1: The Problem with our Current Architecture DEVELOP BEST IN INDUSTRY ASSETS TO DELIVER ON OUR VISION Before V1 - Vitality was built using a JMS implementation as it’s message broker JMS had a few drawbacks & complexities: • Complicated error handling strategies • Slower MTTR from outages • Limited horizontal scalability • The need to consume messages (on average) faster than or at the same rate as they are published
  • 17. 1717 Act 1: The Problem with our Current Architecture DEVELOP BEST IN INDUSTRY ASSETS TO DELIVER ON OUR VISION “Considering we are building a health and wellness platform for the future, we need to look for a messaging system from the future, rather than relying on the systems from the past” - Jesse Leresche
  • 18. 1818 Act 1: The Problem with our Current Architecture DEVELOP BEST IN INDUSTRY ASSETS TO DELIVER ON OUR VISION Needed a system that could: • Provide infinite horizontally scalability • Be fault tolerant & resilient • Be able to handle large amounts of data • Be fast • Scale as we grew (opposed to requiring large infrastructures from the outset)
  • 19. 1919 Act 2: Choosing Kafka as our Future DEVELOP BEST IN INDUSTRY ASSETS TO DELIVER ON OUR VISION 2 major concerns: • Lack of transactionality / 2-phase commit • Guaranteed single message delivery mechanisms
  • 20. 2020 Act 2: Choosing Kafka as our Future DEVELOP BEST IN INDUSTRY ASSETS TO DELIVER ON OUR VISION
  • 21. 2121 Act 2: Choosing Kafka as our Future – Educate! DEVELOP BEST IN INDUSTRY ASSETS TO DELIVER ON OUR VISION Take time to educate & change the organizational culture • Kafka is not simply a JMS replacement • Give people time to adjust to the new concepts - Kafka can be difficult to explain & understand! • Be patient
  • 22. 2222 Act 2: Choosing Kafka as our Future – RTFM DEVELOP BEST IN INDUSTRY ASSETS TO DELIVER ON OUR VISION
  • 23. 2323 Act 2: Choosing Kafka as our Future – Keep up-to-date DEVELOP BEST IN INDUSTRY ASSETS TO DELIVER ON OUR VISION Keep as up-to-date as possible. • Falling behind can make for complex upgrades later on • Every new version has got more bug fixes and is more stable – why wouldn’t you upgrade • Not fun explaining to people that the production outage you just had was avoidable had you upgraded
  • 24. 2424 Act 2: Choosing Kafka as our Future – Be cautious when creating internal topics DEVELOP BEST IN INDUSTRY ASSETS TO DELIVER ON OUR VISION
  • 25. 2525 Act 2: Choosing Kafka as our Future – Get your monitoring in place DEVELOP BEST IN INDUSTRY ASSETS TO DELIVER ON OUR VISION Originally – used open-source Kafka viewer • Was good for point-in-time monitoring / spot checks • Good tool for allowing dev’s to troubleshoot and investigate issues • Lacked ability to compare data-over-time • Link: //TODO//
  • 26. 2626 Act 2: Choosing Kafka as our Future – Get your monitoring in place DEVELOP BEST IN INDUSTRY ASSETS TO DELIVER ON OUR VISION At launch we had a large load coming in - realized we needed more in-depth monitoring • Ad-hoc commands describing consumers not sustainable • Developed Bash script & PowerBi Dashboard • Allowed comparison of throughput, alerting on lag etc. • Process is slow – spins up new JVM per consumer group • Migrating to Java-based service using the Kafka Admin Client – faster responses, more fault tolerant, less bash, easier to deploy via our pipeline • Has RBAC and mobile view (via PowerBi) - can share this over the internet securely • Link: //TODO//
  • 27. 2727 Act 2: Choosing Kafka as our Future – Get your monitoring in place DEVELOP BEST IN INDUSTRY ASSETS TO DELIVER ON OUR VISION Dynatrace is used throughout our system for monitoring & alerting • Can monitor application health, uptime, disk space etc. • Use JMX metrics & alert & monitor on those – ISR’s etc.
  • 28. 2828 Act 2: Choosing Kafka as our Future – Get your monitoring in place DEVELOP BEST IN INDUSTRY ASSETS TO DELIVER ON OUR VISION Upgraded our clusters to Confluent Platform Enterprise, we were able to make use of Confluent Control Centre • Allowed monitoring of consumer groups, inspecting of messages, schemas etc. • Allowed monitoring of over & under consumption & historical view of data processing/throughput • Allowed monitoring of application health, ISR’s, broker health etc.
  • 29. 2929 Act 3: Our Kafka success story DEVELOP BEST IN INDUSTRY ASSETS TO DELIVER ON OUR VISION 1. Total number of Messages across clusters 2. Number messages per day 3. Number of Topics per cluster 4. Number of points awarded per hour
  • 30. 3030 Act 3: Our Kafka success story DEVELOP BEST IN INDUSTRY ASSETS TO DELIVER ON OUR VISION Roadmap for Kafka in V1: • Move logs to ELK via Kafka • Data Warehousing – moving data from the DB to Data Warehouse using CDC & Kafka • Migration of legacy components to Kafka • Implement streaming – real-time fraud detection, points calculations, system analytics • Publishing DevOps pipeline events – services scaling up/down, deployments, alerts etc.
  • 31. 3131 Act 3: Our Kafka success story DEVELOP BEST IN INDUSTRY ASSETS TO DELIVER ON OUR VISION
  • 32. 3232