SlideShare ist ein Scribd-Unternehmen logo
1 von 25
Evolutionary Event-Driven
Architecture for Accelerated
Digital Transformation
Slobodan Sipcic, Ph.D.
Enterprise IT Architect
Presented at:
Monthly IBM GBS Architecture Forum
July 8, 2021
1
July 8, 2021
The presentation introduces an innovative approach for accelerated development and deployment
of a wide range of agile Services and Data Digital Transformation Solutions that scale. The platform
is based on modern 4-tier evolutionary event-driven architectural style including cloud, containers,
microservices, events, streaming, and sync & async processing. The approach is instantiated as a
reusable asset “Enterprise Digital Transformation Platform”. The platform is featured at Think 2019
and The Open Group Agile Architecture meetings and created considerably interest. It is currently
deployed in TFS and TMC Japan and in the process of evaluation by TMNA, Salesforce, and
Albertsons.
July 8, 2021 2
Abstract
Table of Contents
• What are We Trying to Solve?
Digital Transformation Domain: Business Drivers and Challenges
• What Architectural Concepts Can Help Us Address Challenges
• Putting Architectural Concepts to Work: How Platform Computing and EDTP
Address Challenges
• EDTP Digital Transformation Accelerators:
o Full Stack Deployment Automation
o Microservice Templating
• Toyota Financial Services Use Cases
• Request a Demo
3
July 8, 2021
What are We Trying to Solve?
Digital Transformation Domain:
Business Drivers & Challenge
4
July 8, 2021
Drivers for Digital Transformation
Businesses may take on Digital
Transformation for several reasons. But by
far, the most likely reason is that they
must: It is a survival issue.
A business’ ability to adapt quickly to
disruptions from incumbents and startups,
to time to market pressures, and to rapidly
changing customer expectations has
become critical.
It is all about evolutions and changes.
5
July 8, 2021
Digital Transformation Challenges
Data and integration challenges
hindering businesses’ ability to
transform include:
1. Data Quality and Consistency,
2. Coupling on Data & BL levels,
3. Point-to-Point Integration n-
square problem,
4. Point-to-Point with imbedded
transformations,
5. Multiple runtime environments.
6
July 8, 2021
Digital Transformation Platform’s North Star Attributes
• Decoupling
• Adaptability:
Service Layer
Data Layer
Integration Layer
• Agility
• Elasticity
• Experimenting
• Fast-failing
7
July 8, 2021
What Architectural Concepts Can Help Us
Address Challenges
8
July 8, 2021
• Evolutionary Architecture:
An evolutionary architecture designs for incremental change in an architecture as a first principle. Evolutionary
architectures are appealing because change has historically been difficult to anticipate and expensive to retrofit. If
evolutionary change is built into the architecture, change becomes easier and cheaper, allowing changes to
development practices, release practices, and overall agility.
Changes: Business Changes; Technology Changes
Dimensions: Auditability; Performance; Security; Data; Legality; Scalability; Elasticity
• Event Driven Architecture:
An event-driven architecture is a software architecture and model for application design. With an event-driven system,
the capture, communication, processing, and persistence of events are the core structure of the solution — events-first
principle. The event-first approach facilitates Decoupling, Encapsulation, and Evolutionary Change.
Event: An event can be defined as "a significant change in state".
Note: Evolutionary architecture is a natural benefit from event-first thinking and event-driven architectures.
• Design Patterns:
Design patterns establish repeatable solutions to common design problems which helps keep code maintainable,
extensible, and loosely coupled. Some patterns discussed in this presentation include Synchronous Pattern,
Asynchronous Pattern, Asynchronous Pattern with Retries, Event Notification, Event-Carried State Transfer, Event-
Sourcing, CQRS, Saga, and many more.
9
July 8, 2021
Defining Relevant Architectural Concepts
• Domain-Driven Design:
DDD is about designing software based on models of the underlying domain. It is hard to build a single unified model of
large complex domains. DDD deals with large models by providing decomposition categories including:
Domains: A domain defines a problem area for which the software is going to provide solutions.
Subdomains: DDD recommends splitting a domain up into smaller parts called subdomains for easier identification.
Bounded Context: A bounded context delimits the applicability of a specific model.
• Microservices Architecture:
A microservice architectural style is an approach to developing a single application as a suite of small services, each
running in its own process and communicating with lightweight mechanisms, often an HTTP resource API. One of the
biggest challenges of microservices design is to define the boundaries of individual services.
The principles of DDD can assist microservice design through decomposition of a domain to subdomains and bounded
contexts and using that information to define and design microservices. Typically, each microservice operates in its own
bounded context.
• Four-Tier Engagement Platform:
A four-tier engagement platform is engineered for performance, device-tailored experiences, and for integration of both
internal services and external services and APIs. The platform is broken into device, delivery, aggregation, and services
layers.
10
July 8, 2021
Defining Relevant Architectural Concepts
Putting Architectural Concepts to Work:
How Platform Computing and EDTP
Address Challenges
11
July 8, 2021
Enterprise Digital Transformation Platform
To address the challenges, we developed EDTP
for accelerated development and deployment of
a wide range of agile Services and Data Digital
Transformation Solutions (DTS) that scale.
EDTP is a Four-Tier Engagement Platform
designed based on:
• Evolutionary Architecture principles,
• Event Driven Architecture principles,
• Streaming Architectures,
• Use of design patterns,
• Microservices architectural style,
• Cloud & Containers.
12
July 8, 2021
EDTP Layered Architecture
EDTP is built on top of core technologies
including Docker Kubernetes and OpenShift:
• Docker provides container services,
• Kubernetes run and scale containers for
production,
• OpenShift provides developers with the
features to manage their DevOps,
• EDTP builds on top of it to deliver full-stack
automation and accelerators for delivery
of DTS.
13
July 8, 2021
EDTP Layered Distributed Architecture
EDTP consists of small decoupled services that work
together to deliver its functionality. It runs on top of
OpenShift and Kubernetes clusters. The services are broken
down by function:
• EDTP Technology Components and Services are deployed in
Containers – which are virtual boundaries of compute and
memory resources assigned to the components. Docker images
are used to spin up containers.
• OpenShift leverages the Kubernetes concept of a POD, which is
one or more Containers deployed together on one Worker Node.
• A Kubernetes Service serves as an internal load balancer. It
exposes an application running on a set of PODs as a network
service.
• An OpenShift Route exposes a Service by giving it an externally
reachable hostname.
• Master Nodes manage the OpenShift cluster.
14
July 8, 2021
EDTP Reference Architecture
15
July 8, 2021
If we consider EDTP as a Four-Tier
Engagement Platform, then conceptually
we can identify three types of
interoperating services:
• Core Services – Infrastructure (AWS), Docker,
Kubernetes, and OpenShift.
• Technology Components – Access & Delivery
(NiFi), API Gateway (Ambassador), Storage
(S3 & MongoDB), Streaming (Kafka, Kafka
Streams, Schema Registry), Observability
(Elastic), and Service Mesh (Istio).
• EDTP Streaming Data Processing Services –
Ingress, Harmonization, Materialization, and
Connector.
• EDTP API Aggregation and Processing services.
EDTP is architected as an Event Processing Digital Platform around which all Businesses’ current and
future data sources, consumers, services, and processes interact. It consists of EDTP Services Layer and
EDTP Data Layer.
EDTP Realization - Digital Transformation
Accelerators:
- Full Stack Deployment Automation
- Microservice Templating
16
July 8, 2021
EDTP Fully Stack Automated Deployment on AWS
• IaC pipeline (Terraform).
• Technology Components
pipeline (Jenkins):
 Ambassador,
 Nifi,
 Kafka, Kafka Streams, and
Schema Registry,
 MongoDB,
 ELK,
 …
• Services pipeline (Jenkins):
 Harmonization,
 Materialization,
 Registration & Templates,
 Ingress & Egress,
 Connectors,
 …
17
July 8, 2021
EDTP Microservices Templating
A Template Developer :
• Defines Generic Schema that might include
information such as Tenant ID, Version No.,
Correlation ID, and section for API Data.
• For a given Pattern designs and develops
Service Class that incorporates implementation
of all cross-cutting concerns such as
externalized configuration, logging, health
checks, metrics, service registration and
discovery, circuit breakers, distributed tracing.
• Create Service Constructor API which Service
Developers can use to instantiate service
instances of that class.
18
July 8, 2021
EDTP’s patent pending approach for accelerated development of Microservices is based on Object-Oriented
Programming paradigm where a Microservice is an instance of a Microservice Class. Each Microservice Class has a
Constructor that is exposed as an API that can be invoked to create an instance of Microservice from the Class.
Templating idea is especially powerful when combined with an idea of using Patterns to define Service Classes.
EDTP Microservices Instantiation from Template
1. Developer invokes the Constructor
API,
2. Constructor clones the Service Class
Code,
3. Constructor deploys the Service
Instance into Kubernetes runtime
environment.
4. The result of the Constructor’s process
is deployed Service Instance exposed
via Rest API with generic Service Class
business logic.
5. Finally, the developer implements
business logic specific to his Use Case.
19
July 8, 2021
The process of instantiating a Service Instance from the Service Class includes the following steps:
EDTP Provides Templates for many Patterns
20
Synchronous Pattern Asynchronous Pattern Asynchronous Pattern with Retries
The slide depicts Synchronous Pattern, Asynchronous Pattern, and Asynchronous Pattern with Retries.
Other patterns include Event Notification, Event-Carried State Transfer, Event-Sourcing, CQRS, and
many more.
July 8, 2021
EDTP novel approach offers manifold of benefits including:
• It offers structured process for development and governance of
Microservices,
• It ensures that the cross-cutting concerns are implemented in standardized
and consistent ways,
• It ensures that the security related cross-cutting concerns are implemented in
the standardized and consistent way,
• Developers can quickly and easily get started with developing Microservices,
• Developers can focus on development of Use Case implementation logic
rather than on setting up Service and related cross-cutting concerns.
21
EDTP Microservices Templating Benefits
July 8, 2021
Toyota Financial Services Use Cases
22
July 8, 2021
10/29/20 23
• NiFI Ingress Service (Async):
1) Receives Batch Files,
2) Persists the Raw Data in S3,
3) Stream the file records to Kafka
Harmonization Topic.
• Harmonization Service (Async):
4) Picks the records of the Topic. Harmonizes
data to a single point of truth and persist
the harmonized data in MongoDB
Collections,
5) Streams data to Kafka Materialization
Topic.
• Materialization Service (Async):
6) Picks the data of the Topic. Transforms the
data in a format appropriate for
consumption by the consumers. Persists
the data in MongoDB.
 Delivery Service (Async with Retries):
7) Delivers materialized data to the
consumers.
1
2
3
4
5
6
7
Batch Processing
EDTP is a stream processing platform capable of efficient processing of real-time and batch data.
24
1 2
3
4
5
6
EDTP Enabled Mainframe Modernization
EDTP deploys and integrates technologies that foster TFS’s digital transformation. This use case illustrates bringing
Mainframe into the TFS API ecosystem.
Due Date Change Use Case:
1) CSR Requests DDC (Sync).
2) Controller Service receives the request, puts
it on Kafka Topic (guaranteed delivery) and
sends the ACK response,
3) DDC Service picks up the request for
processing,
4) DDC Service is an aggregate of six APIs
exposed by z/OS Connect,
5) DDC Services invokes the APIs and executes
relevant business logic,
6) Once done, DDC Services invokes Responder
Service to deliver the response to CEP.
July 8, 2021
Request A Demo
The following EDTP unique features can be demonstrate to Clients:
1. Automated Deployment of EDTP in Client’s AWS environment including:
a. Infrastructure,
b. Technology Components,
c. Services.
2. EDTP Data and Integration Capabilities including:
a. Ingestion of streaming and batch data,
b. Harmonization and Materialization of the streaming data,
c. Integration based on the EDTP Connector Services – such integration with Snowflake,
d. Service templating for accelerated deployment of enterprise services.
3. EDTP Support for Pattern Based Service Development including:
a. Event Notification,
b. Event-Carried State Transfer,
c. Event-Sourcing,
d. CQRS,
e. Asynchronous Processing,
f. Service Retries Processing,
g. and many more…
25
July 8, 2021

Weitere ähnliche Inhalte

Was ist angesagt?

IBM INTEGRATION BUS (IIB V10)—DATA ROUTING AND TRANSFORMATION
IBM INTEGRATION BUS (IIB V10)—DATA ROUTING AND TRANSFORMATIONIBM INTEGRATION BUS (IIB V10)—DATA ROUTING AND TRANSFORMATION
IBM INTEGRATION BUS (IIB V10)—DATA ROUTING AND TRANSFORMATIONKellton Tech Solutions Ltd
 
Enterprise Integration Patterns Revisited (again) for the Era of Big Data, In...
Enterprise Integration Patterns Revisited (again) for the Era of Big Data, In...Enterprise Integration Patterns Revisited (again) for the Era of Big Data, In...
Enterprise Integration Patterns Revisited (again) for the Era of Big Data, In...Kai Wähner
 
IDC Multicloud 2019 - Conference Milano , Oracle speech
IDC Multicloud 2019 - Conference Milano , Oracle speechIDC Multicloud 2019 - Conference Milano , Oracle speech
IDC Multicloud 2019 - Conference Milano , Oracle speechRiccardo Romani
 
INT Inc | Benefits of a Microservices Architecture
INT Inc | Benefits of a Microservices ArchitectureINT Inc | Benefits of a Microservices Architecture
INT Inc | Benefits of a Microservices ArchitectureThelma Gros
 
InfluxDB Live Product Training
InfluxDB Live Product TrainingInfluxDB Live Product Training
InfluxDB Live Product TrainingInfluxData
 
Enterprise Integration Patterns Revisited (EIP, Apache Camel, Talend ESB)
Enterprise Integration Patterns Revisited (EIP, Apache Camel, Talend ESB)Enterprise Integration Patterns Revisited (EIP, Apache Camel, Talend ESB)
Enterprise Integration Patterns Revisited (EIP, Apache Camel, Talend ESB)Kai Wähner
 
Driving Enterprise Architecture Redesign: Cloud-Native Platforms, APIs, and D...
Driving Enterprise Architecture Redesign: Cloud-Native Platforms, APIs, and D...Driving Enterprise Architecture Redesign: Cloud-Native Platforms, APIs, and D...
Driving Enterprise Architecture Redesign: Cloud-Native Platforms, APIs, and D...Chris Haddad
 
Extending open source and hybrid cloud to drive OT transformation - Future Oi...
Extending open source and hybrid cloud to drive OT transformation - Future Oi...Extending open source and hybrid cloud to drive OT transformation - Future Oi...
Extending open source and hybrid cloud to drive OT transformation - Future Oi...John Archer
 
Engage 2018 - What About the Apps? A Domino Modernisation Story
Engage 2018 - What About the Apps? A Domino Modernisation StoryEngage 2018 - What About the Apps? A Domino Modernisation Story
Engage 2018 - What About the Apps? A Domino Modernisation StoryJared Roberts
 
Who Wants to Become an IT Architect? A Look at the Bigger Picture (Oracle Gro...
Who Wants to Become an IT Architect? A Look at the Bigger Picture (Oracle Gro...Who Wants to Become an IT Architect? A Look at the Bigger Picture (Oracle Gro...
Who Wants to Become an IT Architect? A Look at the Bigger Picture (Oracle Gro...Lucas Jellema
 
Architecting the Transformation (V1.2)
Architecting the Transformation (V1.2)Architecting the Transformation (V1.2)
Architecting the Transformation (V1.2)Asanka Abeysinghe
 
Iterative Architecture: Your Path to on-time Delivery
Iterative Architecture: Your Path to on-time DeliveryIterative Architecture: Your Path to on-time Delivery
Iterative Architecture: Your Path to on-time DeliveryAsanka Abeysinghe
 
Swift at IBM: Mobile, open source and the drive to the cloud
Swift at IBM: Mobile, open source and the drive to the cloudSwift at IBM: Mobile, open source and the drive to the cloud
Swift at IBM: Mobile, open source and the drive to the cloudDev_Events
 
WSO2Con'14 US - Roadmap to a Connected Business
WSO2Con'14 US - Roadmap to a Connected BusinessWSO2Con'14 US - Roadmap to a Connected Business
WSO2Con'14 US - Roadmap to a Connected BusinessAsanka Abeysinghe
 
Kubernetes and Container Technologies from Cloud Native Computing Foundation
Kubernetes and Container Technologies from Cloud Native Computing FoundationKubernetes and Container Technologies from Cloud Native Computing Foundation
Kubernetes and Container Technologies from Cloud Native Computing FoundationCloud Standards Customer Council
 
Azure App Modernization
Azure App ModernizationAzure App Modernization
Azure App ModernizationPhi Huynh
 
IBM Cloud Integration Platform High Availability - Integration Tech Conference
IBM Cloud Integration Platform High Availability - Integration Tech ConferenceIBM Cloud Integration Platform High Availability - Integration Tech Conference
IBM Cloud Integration Platform High Availability - Integration Tech ConferenceRobert Nicholson
 
Slides: Polyglot Persistence for the MongoDB, MySQL & PostgreSQL DBA
Slides: Polyglot Persistence for the MongoDB, MySQL & PostgreSQL DBASlides: Polyglot Persistence for the MongoDB, MySQL & PostgreSQL DBA
Slides: Polyglot Persistence for the MongoDB, MySQL & PostgreSQL DBASeveralnines
 
Data to Consumer : end to end middleware capabilities
Data to Consumer : end to end middleware capabilitiesData to Consumer : end to end middleware capabilities
Data to Consumer : end to end middleware capabilitiesAsanka Abeysinghe
 

Was ist angesagt? (20)

IBM INTEGRATION BUS (IIB V10)—DATA ROUTING AND TRANSFORMATION
IBM INTEGRATION BUS (IIB V10)—DATA ROUTING AND TRANSFORMATIONIBM INTEGRATION BUS (IIB V10)—DATA ROUTING AND TRANSFORMATION
IBM INTEGRATION BUS (IIB V10)—DATA ROUTING AND TRANSFORMATION
 
Enterprise Integration Patterns Revisited (again) for the Era of Big Data, In...
Enterprise Integration Patterns Revisited (again) for the Era of Big Data, In...Enterprise Integration Patterns Revisited (again) for the Era of Big Data, In...
Enterprise Integration Patterns Revisited (again) for the Era of Big Data, In...
 
IDC Multicloud 2019 - Conference Milano , Oracle speech
IDC Multicloud 2019 - Conference Milano , Oracle speechIDC Multicloud 2019 - Conference Milano , Oracle speech
IDC Multicloud 2019 - Conference Milano , Oracle speech
 
INT Inc | Benefits of a Microservices Architecture
INT Inc | Benefits of a Microservices ArchitectureINT Inc | Benefits of a Microservices Architecture
INT Inc | Benefits of a Microservices Architecture
 
InfluxDB Live Product Training
InfluxDB Live Product TrainingInfluxDB Live Product Training
InfluxDB Live Product Training
 
Enterprise Integration Patterns Revisited (EIP, Apache Camel, Talend ESB)
Enterprise Integration Patterns Revisited (EIP, Apache Camel, Talend ESB)Enterprise Integration Patterns Revisited (EIP, Apache Camel, Talend ESB)
Enterprise Integration Patterns Revisited (EIP, Apache Camel, Talend ESB)
 
Driving Enterprise Architecture Redesign: Cloud-Native Platforms, APIs, and D...
Driving Enterprise Architecture Redesign: Cloud-Native Platforms, APIs, and D...Driving Enterprise Architecture Redesign: Cloud-Native Platforms, APIs, and D...
Driving Enterprise Architecture Redesign: Cloud-Native Platforms, APIs, and D...
 
Extending open source and hybrid cloud to drive OT transformation - Future Oi...
Extending open source and hybrid cloud to drive OT transformation - Future Oi...Extending open source and hybrid cloud to drive OT transformation - Future Oi...
Extending open source and hybrid cloud to drive OT transformation - Future Oi...
 
Engage 2018 - What About the Apps? A Domino Modernisation Story
Engage 2018 - What About the Apps? A Domino Modernisation StoryEngage 2018 - What About the Apps? A Domino Modernisation Story
Engage 2018 - What About the Apps? A Domino Modernisation Story
 
Who Wants to Become an IT Architect? A Look at the Bigger Picture (Oracle Gro...
Who Wants to Become an IT Architect? A Look at the Bigger Picture (Oracle Gro...Who Wants to Become an IT Architect? A Look at the Bigger Picture (Oracle Gro...
Who Wants to Become an IT Architect? A Look at the Bigger Picture (Oracle Gro...
 
Architecting the Transformation (V1.2)
Architecting the Transformation (V1.2)Architecting the Transformation (V1.2)
Architecting the Transformation (V1.2)
 
Iterative Architecture: Your Path to on-time Delivery
Iterative Architecture: Your Path to on-time DeliveryIterative Architecture: Your Path to on-time Delivery
Iterative Architecture: Your Path to on-time Delivery
 
Swift at IBM: Mobile, open source and the drive to the cloud
Swift at IBM: Mobile, open source and the drive to the cloudSwift at IBM: Mobile, open source and the drive to the cloud
Swift at IBM: Mobile, open source and the drive to the cloud
 
WSO2Con'14 US - Roadmap to a Connected Business
WSO2Con'14 US - Roadmap to a Connected BusinessWSO2Con'14 US - Roadmap to a Connected Business
WSO2Con'14 US - Roadmap to a Connected Business
 
Kubernetes and Container Technologies from Cloud Native Computing Foundation
Kubernetes and Container Technologies from Cloud Native Computing FoundationKubernetes and Container Technologies from Cloud Native Computing Foundation
Kubernetes and Container Technologies from Cloud Native Computing Foundation
 
Azure App Modernization
Azure App ModernizationAzure App Modernization
Azure App Modernization
 
IBM Cloud Integration Platform High Availability - Integration Tech Conference
IBM Cloud Integration Platform High Availability - Integration Tech ConferenceIBM Cloud Integration Platform High Availability - Integration Tech Conference
IBM Cloud Integration Platform High Availability - Integration Tech Conference
 
App Modernization
App ModernizationApp Modernization
App Modernization
 
Slides: Polyglot Persistence for the MongoDB, MySQL & PostgreSQL DBA
Slides: Polyglot Persistence for the MongoDB, MySQL & PostgreSQL DBASlides: Polyglot Persistence for the MongoDB, MySQL & PostgreSQL DBA
Slides: Polyglot Persistence for the MongoDB, MySQL & PostgreSQL DBA
 
Data to Consumer : end to end middleware capabilities
Data to Consumer : end to end middleware capabilitiesData to Consumer : end to end middleware capabilities
Data to Consumer : end to end middleware capabilities
 

Ähnlich wie Evolutionary evnt-driven-architecture-for-accelerated-digital-transformation

Automating Applications with Habitat - Sydney Cloud Native Meetup
Automating Applications with Habitat - Sydney Cloud Native MeetupAutomating Applications with Habitat - Sydney Cloud Native Meetup
Automating Applications with Habitat - Sydney Cloud Native MeetupMatt Ray
 
Application Centric Microservices from Redhat Summit 2015
Application Centric Microservices from Redhat Summit 2015Application Centric Microservices from Redhat Summit 2015
Application Centric Microservices from Redhat Summit 2015Ken Owens
 
Microservices Architecture - Cloud Native Apps
Microservices Architecture - Cloud Native AppsMicroservices Architecture - Cloud Native Apps
Microservices Architecture - Cloud Native AppsAraf Karsh Hamid
 
Microservices Docker Kubernetes Istio Kanban DevOps SRE
Microservices Docker Kubernetes Istio Kanban DevOps SREMicroservices Docker Kubernetes Istio Kanban DevOps SRE
Microservices Docker Kubernetes Istio Kanban DevOps SREAraf Karsh Hamid
 
JAVA J2EE LEAD coming out of CITI
JAVA J2EE LEAD coming out of CITIJAVA J2EE LEAD coming out of CITI
JAVA J2EE LEAD coming out of CITIvravi123
 
Toyota Financial Services Digital Transformation - Think 2019
Toyota Financial Services Digital Transformation - Think 2019Toyota Financial Services Digital Transformation - Think 2019
Toyota Financial Services Digital Transformation - Think 2019Slobodan Sipcic
 
Technology insights: Decision Science Platform
Technology insights: Decision Science PlatformTechnology insights: Decision Science Platform
Technology insights: Decision Science PlatformDecision Science Community
 
Developing Hybrid Cloud Applications
Developing Hybrid Cloud ApplicationsDeveloping Hybrid Cloud Applications
Developing Hybrid Cloud ApplicationsDaniel Berg
 
Business and IT agility through DevOps and microservice architecture powered ...
Business and IT agility through DevOps and microservice architecture powered ...Business and IT agility through DevOps and microservice architecture powered ...
Business and IT agility through DevOps and microservice architecture powered ...Lucas Jellema
 
The Reality of Managing Microservices in Your CD Pipeline
The Reality of Managing Microservices in Your CD PipelineThe Reality of Managing Microservices in Your CD Pipeline
The Reality of Managing Microservices in Your CD PipelineDevOps.com
 
CNCF Introduction - Feb 2018
CNCF Introduction - Feb 2018CNCF Introduction - Feb 2018
CNCF Introduction - Feb 2018Krishna-Kumar
 
Designing Microservices
Designing MicroservicesDesigning Microservices
Designing MicroservicesDavid Chou
 
apidays LIVE Hong Kong 2021 - Modernizing Monolith Applications with API Arch...
apidays LIVE Hong Kong 2021 - Modernizing Monolith Applications with API Arch...apidays LIVE Hong Kong 2021 - Modernizing Monolith Applications with API Arch...
apidays LIVE Hong Kong 2021 - Modernizing Monolith Applications with API Arch...apidays
 
MicroserviceArchitecture in detail over Monolith.
MicroserviceArchitecture in detail over Monolith.MicroserviceArchitecture in detail over Monolith.
MicroserviceArchitecture in detail over Monolith.PLovababu
 
Data Engineer, Patterns & Architecture The future: Deep-dive into Microservic...
Data Engineer, Patterns & Architecture The future: Deep-dive into Microservic...Data Engineer, Patterns & Architecture The future: Deep-dive into Microservic...
Data Engineer, Patterns & Architecture The future: Deep-dive into Microservic...Igor De Souza
 
Monolithic to Microservices Architecture
Monolithic to Microservices ArchitectureMonolithic to Microservices Architecture
Monolithic to Microservices ArchitectureVin Dahake
 

Ähnlich wie Evolutionary evnt-driven-architecture-for-accelerated-digital-transformation (20)

Automating Applications with Habitat - Sydney Cloud Native Meetup
Automating Applications with Habitat - Sydney Cloud Native MeetupAutomating Applications with Habitat - Sydney Cloud Native Meetup
Automating Applications with Habitat - Sydney Cloud Native Meetup
 
Application Centric Microservices from Redhat Summit 2015
Application Centric Microservices from Redhat Summit 2015Application Centric Microservices from Redhat Summit 2015
Application Centric Microservices from Redhat Summit 2015
 
Microservices Architecture - Cloud Native Apps
Microservices Architecture - Cloud Native AppsMicroservices Architecture - Cloud Native Apps
Microservices Architecture - Cloud Native Apps
 
Microservices Docker Kubernetes Istio Kanban DevOps SRE
Microservices Docker Kubernetes Istio Kanban DevOps SREMicroservices Docker Kubernetes Istio Kanban DevOps SRE
Microservices Docker Kubernetes Istio Kanban DevOps SRE
 
JAVA J2EE LEAD coming out of CITI
JAVA J2EE LEAD coming out of CITIJAVA J2EE LEAD coming out of CITI
JAVA J2EE LEAD coming out of CITI
 
Toyota Financial Services Digital Transformation - Think 2019
Toyota Financial Services Digital Transformation - Think 2019Toyota Financial Services Digital Transformation - Think 2019
Toyota Financial Services Digital Transformation - Think 2019
 
Technology insights: Decision Science Platform
Technology insights: Decision Science PlatformTechnology insights: Decision Science Platform
Technology insights: Decision Science Platform
 
Developing Hybrid Cloud Applications
Developing Hybrid Cloud ApplicationsDeveloping Hybrid Cloud Applications
Developing Hybrid Cloud Applications
 
Inside CBP's Quest for the Cloud
Inside CBP's Quest for the CloudInside CBP's Quest for the Cloud
Inside CBP's Quest for the Cloud
 
Business and IT agility through DevOps and microservice architecture powered ...
Business and IT agility through DevOps and microservice architecture powered ...Business and IT agility through DevOps and microservice architecture powered ...
Business and IT agility through DevOps and microservice architecture powered ...
 
The Reality of Managing Microservices in Your CD Pipeline
The Reality of Managing Microservices in Your CD PipelineThe Reality of Managing Microservices in Your CD Pipeline
The Reality of Managing Microservices in Your CD Pipeline
 
CNCF Introduction - Feb 2018
CNCF Introduction - Feb 2018CNCF Introduction - Feb 2018
CNCF Introduction - Feb 2018
 
Cloud to Edge
Cloud to EdgeCloud to Edge
Cloud to Edge
 
Designing Microservices
Designing MicroservicesDesigning Microservices
Designing Microservices
 
Rashmi_TL
Rashmi_TLRashmi_TL
Rashmi_TL
 
apidays LIVE Hong Kong 2021 - Modernizing Monolith Applications with API Arch...
apidays LIVE Hong Kong 2021 - Modernizing Monolith Applications with API Arch...apidays LIVE Hong Kong 2021 - Modernizing Monolith Applications with API Arch...
apidays LIVE Hong Kong 2021 - Modernizing Monolith Applications with API Arch...
 
Docker12 factor
Docker12 factorDocker12 factor
Docker12 factor
 
MicroserviceArchitecture in detail over Monolith.
MicroserviceArchitecture in detail over Monolith.MicroserviceArchitecture in detail over Monolith.
MicroserviceArchitecture in detail over Monolith.
 
Data Engineer, Patterns & Architecture The future: Deep-dive into Microservic...
Data Engineer, Patterns & Architecture The future: Deep-dive into Microservic...Data Engineer, Patterns & Architecture The future: Deep-dive into Microservic...
Data Engineer, Patterns & Architecture The future: Deep-dive into Microservic...
 
Monolithic to Microservices Architecture
Monolithic to Microservices ArchitectureMonolithic to Microservices Architecture
Monolithic to Microservices Architecture
 

Kürzlich hochgeladen

Apidays Singapore 2024 - Scalable LLM APIs for AI and Generative AI Applicati...
Apidays Singapore 2024 - Scalable LLM APIs for AI and Generative AI Applicati...Apidays Singapore 2024 - Scalable LLM APIs for AI and Generative AI Applicati...
Apidays Singapore 2024 - Scalable LLM APIs for AI and Generative AI Applicati...apidays
 
A Beginners Guide to Building a RAG App Using Open Source Milvus
A Beginners Guide to Building a RAG App Using Open Source MilvusA Beginners Guide to Building a RAG App Using Open Source Milvus
A Beginners Guide to Building a RAG App Using Open Source MilvusZilliz
 
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...Drew Madelung
 
ICT role in 21st century education and its challenges
ICT role in 21st century education and its challengesICT role in 21st century education and its challenges
ICT role in 21st century education and its challengesrafiqahmad00786416
 
Ransomware_Q4_2023. The report. [EN].pdf
Ransomware_Q4_2023. The report. [EN].pdfRansomware_Q4_2023. The report. [EN].pdf
Ransomware_Q4_2023. The report. [EN].pdfOverkill Security
 
Automating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps ScriptAutomating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps Scriptwesley chun
 
presentation ICT roal in 21st century education
presentation ICT roal in 21st century educationpresentation ICT roal in 21st century education
presentation ICT roal in 21st century educationjfdjdjcjdnsjd
 
AXA XL - Insurer Innovation Award Americas 2024
AXA XL - Insurer Innovation Award Americas 2024AXA XL - Insurer Innovation Award Americas 2024
AXA XL - Insurer Innovation Award Americas 2024The Digital Insurer
 
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...DianaGray10
 
Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024The Digital Insurer
 
FWD Group - Insurer Innovation Award 2024
FWD Group - Insurer Innovation Award 2024FWD Group - Insurer Innovation Award 2024
FWD Group - Insurer Innovation Award 2024The Digital Insurer
 
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot TakeoffStrategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoffsammart93
 
Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...
Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...
Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...Zilliz
 
"I see eyes in my soup": How Delivery Hero implemented the safety system for ...
"I see eyes in my soup": How Delivery Hero implemented the safety system for ..."I see eyes in my soup": How Delivery Hero implemented the safety system for ...
"I see eyes in my soup": How Delivery Hero implemented the safety system for ...Zilliz
 
DBX First Quarter 2024 Investor Presentation
DBX First Quarter 2024 Investor PresentationDBX First Quarter 2024 Investor Presentation
DBX First Quarter 2024 Investor PresentationDropbox
 
Real Time Object Detection Using Open CV
Real Time Object Detection Using Open CVReal Time Object Detection Using Open CV
Real Time Object Detection Using Open CVKhem
 
Architecting Cloud Native Applications
Architecting Cloud Native ApplicationsArchitecting Cloud Native Applications
Architecting Cloud Native ApplicationsWSO2
 
A Year of the Servo Reboot: Where Are We Now?
A Year of the Servo Reboot: Where Are We Now?A Year of the Servo Reboot: Where Are We Now?
A Year of the Servo Reboot: Where Are We Now?Igalia
 
Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...apidays
 
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost SavingRepurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost SavingEdi Saputra
 

Kürzlich hochgeladen (20)

Apidays Singapore 2024 - Scalable LLM APIs for AI and Generative AI Applicati...
Apidays Singapore 2024 - Scalable LLM APIs for AI and Generative AI Applicati...Apidays Singapore 2024 - Scalable LLM APIs for AI and Generative AI Applicati...
Apidays Singapore 2024 - Scalable LLM APIs for AI and Generative AI Applicati...
 
A Beginners Guide to Building a RAG App Using Open Source Milvus
A Beginners Guide to Building a RAG App Using Open Source MilvusA Beginners Guide to Building a RAG App Using Open Source Milvus
A Beginners Guide to Building a RAG App Using Open Source Milvus
 
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
 
ICT role in 21st century education and its challenges
ICT role in 21st century education and its challengesICT role in 21st century education and its challenges
ICT role in 21st century education and its challenges
 
Ransomware_Q4_2023. The report. [EN].pdf
Ransomware_Q4_2023. The report. [EN].pdfRansomware_Q4_2023. The report. [EN].pdf
Ransomware_Q4_2023. The report. [EN].pdf
 
Automating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps ScriptAutomating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps Script
 
presentation ICT roal in 21st century education
presentation ICT roal in 21st century educationpresentation ICT roal in 21st century education
presentation ICT roal in 21st century education
 
AXA XL - Insurer Innovation Award Americas 2024
AXA XL - Insurer Innovation Award Americas 2024AXA XL - Insurer Innovation Award Americas 2024
AXA XL - Insurer Innovation Award Americas 2024
 
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
 
Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024
 
FWD Group - Insurer Innovation Award 2024
FWD Group - Insurer Innovation Award 2024FWD Group - Insurer Innovation Award 2024
FWD Group - Insurer Innovation Award 2024
 
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot TakeoffStrategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
 
Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...
Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...
Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...
 
"I see eyes in my soup": How Delivery Hero implemented the safety system for ...
"I see eyes in my soup": How Delivery Hero implemented the safety system for ..."I see eyes in my soup": How Delivery Hero implemented the safety system for ...
"I see eyes in my soup": How Delivery Hero implemented the safety system for ...
 
DBX First Quarter 2024 Investor Presentation
DBX First Quarter 2024 Investor PresentationDBX First Quarter 2024 Investor Presentation
DBX First Quarter 2024 Investor Presentation
 
Real Time Object Detection Using Open CV
Real Time Object Detection Using Open CVReal Time Object Detection Using Open CV
Real Time Object Detection Using Open CV
 
Architecting Cloud Native Applications
Architecting Cloud Native ApplicationsArchitecting Cloud Native Applications
Architecting Cloud Native Applications
 
A Year of the Servo Reboot: Where Are We Now?
A Year of the Servo Reboot: Where Are We Now?A Year of the Servo Reboot: Where Are We Now?
A Year of the Servo Reboot: Where Are We Now?
 
Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...
 
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost SavingRepurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
 

Evolutionary evnt-driven-architecture-for-accelerated-digital-transformation

  • 1. Evolutionary Event-Driven Architecture for Accelerated Digital Transformation Slobodan Sipcic, Ph.D. Enterprise IT Architect Presented at: Monthly IBM GBS Architecture Forum July 8, 2021 1 July 8, 2021
  • 2. The presentation introduces an innovative approach for accelerated development and deployment of a wide range of agile Services and Data Digital Transformation Solutions that scale. The platform is based on modern 4-tier evolutionary event-driven architectural style including cloud, containers, microservices, events, streaming, and sync & async processing. The approach is instantiated as a reusable asset “Enterprise Digital Transformation Platform”. The platform is featured at Think 2019 and The Open Group Agile Architecture meetings and created considerably interest. It is currently deployed in TFS and TMC Japan and in the process of evaluation by TMNA, Salesforce, and Albertsons. July 8, 2021 2 Abstract
  • 3. Table of Contents • What are We Trying to Solve? Digital Transformation Domain: Business Drivers and Challenges • What Architectural Concepts Can Help Us Address Challenges • Putting Architectural Concepts to Work: How Platform Computing and EDTP Address Challenges • EDTP Digital Transformation Accelerators: o Full Stack Deployment Automation o Microservice Templating • Toyota Financial Services Use Cases • Request a Demo 3 July 8, 2021
  • 4. What are We Trying to Solve? Digital Transformation Domain: Business Drivers & Challenge 4 July 8, 2021
  • 5. Drivers for Digital Transformation Businesses may take on Digital Transformation for several reasons. But by far, the most likely reason is that they must: It is a survival issue. A business’ ability to adapt quickly to disruptions from incumbents and startups, to time to market pressures, and to rapidly changing customer expectations has become critical. It is all about evolutions and changes. 5 July 8, 2021
  • 6. Digital Transformation Challenges Data and integration challenges hindering businesses’ ability to transform include: 1. Data Quality and Consistency, 2. Coupling on Data & BL levels, 3. Point-to-Point Integration n- square problem, 4. Point-to-Point with imbedded transformations, 5. Multiple runtime environments. 6 July 8, 2021
  • 7. Digital Transformation Platform’s North Star Attributes • Decoupling • Adaptability: Service Layer Data Layer Integration Layer • Agility • Elasticity • Experimenting • Fast-failing 7 July 8, 2021
  • 8. What Architectural Concepts Can Help Us Address Challenges 8 July 8, 2021
  • 9. • Evolutionary Architecture: An evolutionary architecture designs for incremental change in an architecture as a first principle. Evolutionary architectures are appealing because change has historically been difficult to anticipate and expensive to retrofit. If evolutionary change is built into the architecture, change becomes easier and cheaper, allowing changes to development practices, release practices, and overall agility. Changes: Business Changes; Technology Changes Dimensions: Auditability; Performance; Security; Data; Legality; Scalability; Elasticity • Event Driven Architecture: An event-driven architecture is a software architecture and model for application design. With an event-driven system, the capture, communication, processing, and persistence of events are the core structure of the solution — events-first principle. The event-first approach facilitates Decoupling, Encapsulation, and Evolutionary Change. Event: An event can be defined as "a significant change in state". Note: Evolutionary architecture is a natural benefit from event-first thinking and event-driven architectures. • Design Patterns: Design patterns establish repeatable solutions to common design problems which helps keep code maintainable, extensible, and loosely coupled. Some patterns discussed in this presentation include Synchronous Pattern, Asynchronous Pattern, Asynchronous Pattern with Retries, Event Notification, Event-Carried State Transfer, Event- Sourcing, CQRS, Saga, and many more. 9 July 8, 2021 Defining Relevant Architectural Concepts
  • 10. • Domain-Driven Design: DDD is about designing software based on models of the underlying domain. It is hard to build a single unified model of large complex domains. DDD deals with large models by providing decomposition categories including: Domains: A domain defines a problem area for which the software is going to provide solutions. Subdomains: DDD recommends splitting a domain up into smaller parts called subdomains for easier identification. Bounded Context: A bounded context delimits the applicability of a specific model. • Microservices Architecture: A microservice architectural style is an approach to developing a single application as a suite of small services, each running in its own process and communicating with lightweight mechanisms, often an HTTP resource API. One of the biggest challenges of microservices design is to define the boundaries of individual services. The principles of DDD can assist microservice design through decomposition of a domain to subdomains and bounded contexts and using that information to define and design microservices. Typically, each microservice operates in its own bounded context. • Four-Tier Engagement Platform: A four-tier engagement platform is engineered for performance, device-tailored experiences, and for integration of both internal services and external services and APIs. The platform is broken into device, delivery, aggregation, and services layers. 10 July 8, 2021 Defining Relevant Architectural Concepts
  • 11. Putting Architectural Concepts to Work: How Platform Computing and EDTP Address Challenges 11 July 8, 2021
  • 12. Enterprise Digital Transformation Platform To address the challenges, we developed EDTP for accelerated development and deployment of a wide range of agile Services and Data Digital Transformation Solutions (DTS) that scale. EDTP is a Four-Tier Engagement Platform designed based on: • Evolutionary Architecture principles, • Event Driven Architecture principles, • Streaming Architectures, • Use of design patterns, • Microservices architectural style, • Cloud & Containers. 12 July 8, 2021
  • 13. EDTP Layered Architecture EDTP is built on top of core technologies including Docker Kubernetes and OpenShift: • Docker provides container services, • Kubernetes run and scale containers for production, • OpenShift provides developers with the features to manage their DevOps, • EDTP builds on top of it to deliver full-stack automation and accelerators for delivery of DTS. 13 July 8, 2021
  • 14. EDTP Layered Distributed Architecture EDTP consists of small decoupled services that work together to deliver its functionality. It runs on top of OpenShift and Kubernetes clusters. The services are broken down by function: • EDTP Technology Components and Services are deployed in Containers – which are virtual boundaries of compute and memory resources assigned to the components. Docker images are used to spin up containers. • OpenShift leverages the Kubernetes concept of a POD, which is one or more Containers deployed together on one Worker Node. • A Kubernetes Service serves as an internal load balancer. It exposes an application running on a set of PODs as a network service. • An OpenShift Route exposes a Service by giving it an externally reachable hostname. • Master Nodes manage the OpenShift cluster. 14 July 8, 2021
  • 15. EDTP Reference Architecture 15 July 8, 2021 If we consider EDTP as a Four-Tier Engagement Platform, then conceptually we can identify three types of interoperating services: • Core Services – Infrastructure (AWS), Docker, Kubernetes, and OpenShift. • Technology Components – Access & Delivery (NiFi), API Gateway (Ambassador), Storage (S3 & MongoDB), Streaming (Kafka, Kafka Streams, Schema Registry), Observability (Elastic), and Service Mesh (Istio). • EDTP Streaming Data Processing Services – Ingress, Harmonization, Materialization, and Connector. • EDTP API Aggregation and Processing services. EDTP is architected as an Event Processing Digital Platform around which all Businesses’ current and future data sources, consumers, services, and processes interact. It consists of EDTP Services Layer and EDTP Data Layer.
  • 16. EDTP Realization - Digital Transformation Accelerators: - Full Stack Deployment Automation - Microservice Templating 16 July 8, 2021
  • 17. EDTP Fully Stack Automated Deployment on AWS • IaC pipeline (Terraform). • Technology Components pipeline (Jenkins):  Ambassador,  Nifi,  Kafka, Kafka Streams, and Schema Registry,  MongoDB,  ELK,  … • Services pipeline (Jenkins):  Harmonization,  Materialization,  Registration & Templates,  Ingress & Egress,  Connectors,  … 17 July 8, 2021
  • 18. EDTP Microservices Templating A Template Developer : • Defines Generic Schema that might include information such as Tenant ID, Version No., Correlation ID, and section for API Data. • For a given Pattern designs and develops Service Class that incorporates implementation of all cross-cutting concerns such as externalized configuration, logging, health checks, metrics, service registration and discovery, circuit breakers, distributed tracing. • Create Service Constructor API which Service Developers can use to instantiate service instances of that class. 18 July 8, 2021 EDTP’s patent pending approach for accelerated development of Microservices is based on Object-Oriented Programming paradigm where a Microservice is an instance of a Microservice Class. Each Microservice Class has a Constructor that is exposed as an API that can be invoked to create an instance of Microservice from the Class. Templating idea is especially powerful when combined with an idea of using Patterns to define Service Classes.
  • 19. EDTP Microservices Instantiation from Template 1. Developer invokes the Constructor API, 2. Constructor clones the Service Class Code, 3. Constructor deploys the Service Instance into Kubernetes runtime environment. 4. The result of the Constructor’s process is deployed Service Instance exposed via Rest API with generic Service Class business logic. 5. Finally, the developer implements business logic specific to his Use Case. 19 July 8, 2021 The process of instantiating a Service Instance from the Service Class includes the following steps:
  • 20. EDTP Provides Templates for many Patterns 20 Synchronous Pattern Asynchronous Pattern Asynchronous Pattern with Retries The slide depicts Synchronous Pattern, Asynchronous Pattern, and Asynchronous Pattern with Retries. Other patterns include Event Notification, Event-Carried State Transfer, Event-Sourcing, CQRS, and many more. July 8, 2021
  • 21. EDTP novel approach offers manifold of benefits including: • It offers structured process for development and governance of Microservices, • It ensures that the cross-cutting concerns are implemented in standardized and consistent ways, • It ensures that the security related cross-cutting concerns are implemented in the standardized and consistent way, • Developers can quickly and easily get started with developing Microservices, • Developers can focus on development of Use Case implementation logic rather than on setting up Service and related cross-cutting concerns. 21 EDTP Microservices Templating Benefits July 8, 2021
  • 22. Toyota Financial Services Use Cases 22 July 8, 2021
  • 23. 10/29/20 23 • NiFI Ingress Service (Async): 1) Receives Batch Files, 2) Persists the Raw Data in S3, 3) Stream the file records to Kafka Harmonization Topic. • Harmonization Service (Async): 4) Picks the records of the Topic. Harmonizes data to a single point of truth and persist the harmonized data in MongoDB Collections, 5) Streams data to Kafka Materialization Topic. • Materialization Service (Async): 6) Picks the data of the Topic. Transforms the data in a format appropriate for consumption by the consumers. Persists the data in MongoDB.  Delivery Service (Async with Retries): 7) Delivers materialized data to the consumers. 1 2 3 4 5 6 7 Batch Processing EDTP is a stream processing platform capable of efficient processing of real-time and batch data.
  • 24. 24 1 2 3 4 5 6 EDTP Enabled Mainframe Modernization EDTP deploys and integrates technologies that foster TFS’s digital transformation. This use case illustrates bringing Mainframe into the TFS API ecosystem. Due Date Change Use Case: 1) CSR Requests DDC (Sync). 2) Controller Service receives the request, puts it on Kafka Topic (guaranteed delivery) and sends the ACK response, 3) DDC Service picks up the request for processing, 4) DDC Service is an aggregate of six APIs exposed by z/OS Connect, 5) DDC Services invokes the APIs and executes relevant business logic, 6) Once done, DDC Services invokes Responder Service to deliver the response to CEP. July 8, 2021
  • 25. Request A Demo The following EDTP unique features can be demonstrate to Clients: 1. Automated Deployment of EDTP in Client’s AWS environment including: a. Infrastructure, b. Technology Components, c. Services. 2. EDTP Data and Integration Capabilities including: a. Ingestion of streaming and batch data, b. Harmonization and Materialization of the streaming data, c. Integration based on the EDTP Connector Services – such integration with Snowflake, d. Service templating for accelerated deployment of enterprise services. 3. EDTP Support for Pattern Based Service Development including: a. Event Notification, b. Event-Carried State Transfer, c. Event-Sourcing, d. CQRS, e. Asynchronous Processing, f. Service Retries Processing, g. and many more… 25 July 8, 2021