Diese Präsentation wurde erfolgreich gemeldet.
Wir verwenden Ihre LinkedIn Profilangaben und Informationen zu Ihren Aktivitäten, um Anzeigen zu personalisieren und Ihnen relevantere Inhalte anzuzeigen. Sie können Ihre Anzeigeneinstellungen jederzeit ändern.
A NEW PLATFORM FOR A NEW ERA
© Copyright 2014 Pivotal. All rights reserved.© Copyright 2014 Pivotal. All rights reserved.
Data Microservices with Sprin...
© Copyright 2014 Pivotal. All rights reserved.© Copyright 2014 Pivotal. All rights reserved. 3
About Me
@fredmelo_br
Fred ...
© Copyright 2014 Pivotal. All rights reserved.
© Copyright 2014 Pivotal. All rights reserved.
© Copyright 2014 Pivotal. All rights reserved.
User Mgmt
Order Mgmt
Shipping
Inventory
Payment
Payment
Order
Mgmt
Inventor...
© Copyright 2014 Pivotal. All rights reserved.
Deploy
>cf push
Cloud
Controller
BBS
(message bus)
Router
App Deployed
Orde...
© Copyright 2014 Pivotal. All rights reserved.
Scale
Re-deploy
Migrate
Distribute
Upgrade Update
Order
Mgmt
Contract
User
...
© Copyright 2014 Pivotal. All rights reserved.
Integration Bus / ESB
System A
System BUser Mgmt
Order Mgmt
Shipping
Invent...
© Copyright 2014 Pivotal. All rights reserved.
Integration Bus / ESB
System A
System BOrder
Mgmt
Contract
Inventory
Contra...
© Copyright 2014 Pivotal. All rights reserved.
Integration Bus / ESB
System A
System B
E
T
L
Data
WarehouseOrder
Mgmt
Cont...
© Copyright 2014 Pivotal. All rights reserved.
Integration Bus / ESB
System A
System BOrder
Mgmt
Contract
Inventory
Contra...
© Copyright 2014 Pivotal. All rights reserved.
Anatomy of a typical Integration Pipeline
Source
Processing
Step
Processing...
© Copyright 2014 Pivotal. All rights reserved.
Integration Pipeline
Scale
Re-deploy
Upgrade
Migrate
Distribute
Update
Sour...
© Copyright 2014 Pivotal. All rights reserved.
Integration Pipeline
Source Destination
Processing
Step
Processing
Step
Pro...
© Copyright 2014 Pivotal. All rights reserved.
Binding Abstraction Layer
Transport Options
Integration Pipeline
Data Messa...
© Copyright 2014 Pivotal. All rights reserved.
Backing Services
Transport Options
Pivotal Cloud Foundry
Auto Scaling
Auto ...
© Copyright 2014 Pivotal. All rights reserved.
Backing Services
Transport Options
Pivotal Cloud Foundry
Auto Scaling
Auto ...
© Copyright 2014 Pivotal. All rights reserved.
JSON
Filter
Transform Enrich
Custom
HTTP
Sample pipeline
Deploy
SpringBoot
...
© Copyright 2014 Pivotal. All rights reserved.
DEMO
“Fast Data"
Machine
Learning
Normal
High Risk
© Copyright 2014 Pivotal. All rights reserved.
Rest / HTTP
Transactions
Browser
Machine
Learning
?
GemFire
Greenplum
Analy...
© Copyright 2014 Pivotal. All rights reserved.
Machine Learning
(Clustering)
GemFire
Greenplum
Analytics
Train
© Copyright 2014 Pivotal. All rights reserved.
Machine Learning
(Clustering)
GemFire
Greenplum
Analytics
Train
distance fr...
© Copyright 2014 Pivotal. All rights reserved.
Machine Learning
(Clustering)
GemFire
Greenplum
Analytics
Train
PMML
+ Dist...
© Copyright 2014 Pivotal. All rights reserved.
Rest / HTTP
Transactions
Browser
High Risk Alerts
GemFire
Greenplum
+ Dista...
© Copyright 2014 Pivotal. All rights reserved.
Order
Mgmt
Contract
Inventory
Contract
Shipping
Contract
Payments
Contract
...
A NEW PLATFORM FOR A NEW ERA
Nächste SlideShare
Wird geladen in …5
×

Architecting for Cloud Native Data: Data Microservices Done Right Using Spring Cloud

2.181 Aufrufe

Veröffentlicht am

SpringOne Platform 2016
Speaker: Fred Melo; Technical Director, Pivotal

Microservices are definitely offering best practice guidance for those architecting cloud native applications. The ability to quickly create small services that can be individually deployed, configured and scaled, as building blocks for scalable, highly distributed and fault-tolerant systems has been causing every company to rethink on how to architect modern systems and making Spring Boot shine in popularity. In the same perspective, in order to achieve the same level of resilience, scalability and flexibility for stateful systems we need to start building our data components over the concepts of Data Microservices. This session will introduce Spring Cloud Stream from a Data Microservices perspective. We’ll explore its architecture model, highlighting the scalability, high availability, importance of dynamic transport biding layer and different options for orchestration / cloud deployment. We’ll then give an architecture walk-through on how Spring Cloud Data Flow orchestrates those Data Microservices into an advanced data pipelining solution, exemplified by a live demo.

Veröffentlicht in: Technologie
  • Als Erste(r) kommentieren

Architecting for Cloud Native Data: Data Microservices Done Right Using Spring Cloud

  1. 1. A NEW PLATFORM FOR A NEW ERA
  2. 2. © Copyright 2014 Pivotal. All rights reserved.© Copyright 2014 Pivotal. All rights reserved. Data Microservices with Spring
 2 Breaking the enterprise integration monolith Fred Melo @fredmelo_br
  3. 3. © Copyright 2014 Pivotal. All rights reserved.© Copyright 2014 Pivotal. All rights reserved. 3 About Me @fredmelo_br Fred Melo Mountain View, CA https://www.linkedin.com/in/ melofred
  4. 4. © Copyright 2014 Pivotal. All rights reserved.
  5. 5. © Copyright 2014 Pivotal. All rights reserved.
  6. 6. © Copyright 2014 Pivotal. All rights reserved. User Mgmt Order Mgmt Shipping Inventory Payment Payment Order Mgmt Inventory User Mgmt Shipping Contract Contract Contract Contract Contract Conway’s Law and Microservices Going Agile - Breaking the monolith Dev Team
  7. 7. © Copyright 2014 Pivotal. All rights reserved. Deploy >cf push Cloud Controller BBS (message bus) Router App Deployed Order Mgmt Contract Automating through the Platform
  8. 8. © Copyright 2014 Pivotal. All rights reserved. Scale Re-deploy Migrate Distribute Upgrade Update Order Mgmt Contract User Mgmt Contract Pivotal Cloud Foundry
  9. 9. © Copyright 2014 Pivotal. All rights reserved. Integration Bus / ESB System A System BUser Mgmt Order Mgmt Shipping Inventory Payment
  10. 10. © Copyright 2014 Pivotal. All rights reserved. Integration Bus / ESB System A System BOrder Mgmt Contract Inventory Contract Shipping ContractUser Mgmt Contract
  11. 11. © Copyright 2014 Pivotal. All rights reserved. Integration Bus / ESB System A System B E T L Data WarehouseOrder Mgmt Contract Inventory Contract Shipping ContractUser Mgmt Contract
  12. 12. © Copyright 2014 Pivotal. All rights reserved. Integration Bus / ESB System A System BOrder Mgmt Contract Inventory Contract Shipping ContractUser Mgmt Contract E T L Data Warehouse ???
  13. 13. © Copyright 2014 Pivotal. All rights reserved. Anatomy of a typical Integration Pipeline Source Processing Step Processing Step Processing Step Processing Step Data Data Monolith Destination
  14. 14. © Copyright 2014 Pivotal. All rights reserved. Integration Pipeline Scale Re-deploy Upgrade Migrate Distribute Update Source Destination Processing Step Processing Step Processing Step Processing Step
  15. 15. © Copyright 2014 Pivotal. All rights reserved. Integration Pipeline Source Destination Processing Step Processing Step Processing Step Processing Step SpringBoot app Contract SpringBoot app Contract SpringBoot app Contract SpringBoot app Contract SpringBoot app Contract SpringBoot app Contract
  16. 16. © Copyright 2014 Pivotal. All rights reserved. Binding Abstraction Layer Transport Options Integration Pipeline Data Messaging Microservices Spring Cloud Stream Data Data SpringBoot app Contract SpringBoot app Contract SpringBoot app Contract SpringBoot app Contract SpringBoot app Contract SpringBoot app Contract SpringBoot app Contract SpringBoot app Contract
  17. 17. © Copyright 2014 Pivotal. All rights reserved. Backing Services Transport Options Pivotal Cloud Foundry Auto Scaling Auto Healing Aggregated Logging Integrated Metrics Transport Transparency Infrastructure Transparency SpringBoot app Contract SpringBoot app Contract SpringBoot app Contract SpringBoot app Contract SpringBoot app Contract SpringBoot app Contract SpringBoot app Contract SpringBoot app Contract Data Pipeline Visual Design Integrated Monitoring
  18. 18. © Copyright 2014 Pivotal. All rights reserved. Backing Services Transport Options Pivotal Cloud Foundry Auto Scaling Auto Healing Aggregated Logging Integrated Metrics Transport Transparency Infrastructure Transparency SpringBoot app Contract SpringBoot app Contract SpringBoot app Contract SpringBoot app Contract SpringBoot app Contract SpringBoot app Contract SpringBoot app Contract SpringBoot app Contract Data Pipeline Visual Design Integrated Monitoring
  19. 19. © Copyright 2014 Pivotal. All rights reserved. JSON Filter Transform Enrich Custom HTTP Sample pipeline Deploy SpringBoot app Contract SpringBoot app Contract SpringBoot app Contract SpringBoot app Contract SpringBoot app Contract SpringBoot app Contract SpringBoot app Contract SpringBoot app Contract Pivotal Cloud Foundry Spring Cloud Data Flow
  20. 20. © Copyright 2014 Pivotal. All rights reserved. DEMO “Fast Data" Machine Learning Normal High Risk
  21. 21. © Copyright 2014 Pivotal. All rights reserved. Rest / HTTP Transactions Browser Machine Learning ? GemFire Greenplum Analytics
  22. 22. © Copyright 2014 Pivotal. All rights reserved. Machine Learning (Clustering) GemFire Greenplum Analytics Train
  23. 23. © Copyright 2014 Pivotal. All rights reserved. Machine Learning (Clustering) GemFire Greenplum Analytics Train distance from home location transactionvalue Medium RiskLow Risk High Risk
  24. 24. © Copyright 2014 Pivotal. All rights reserved. Machine Learning (Clustering) GemFire Greenplum Analytics Train PMML + Distance from home ML Evaluation high risk transactions Suspects
  25. 25. © Copyright 2014 Pivotal. All rights reserved. Rest / HTTP Transactions Browser High Risk Alerts GemFire Greenplum + Distance from hom
  26. 26. © Copyright 2014 Pivotal. All rights reserved. Order Mgmt Contract Inventory Contract Shipping Contract Payments Contract Pivotal Cloud Foundry SpringBoot app Contract SpringBoot app Contract SpringBoot app Contract SpringBoot app Contract SpringBoot app Contract SpringBoot app Contract SpringBoot app Contract SpringBoot app Contract SpringBoot app Contract SpringBoot app Contract SpringBoot app Contract SpringBoot app Contract SpringBoot app Contract SpringBoot app Contract SpringBoot app Contract SpringBoot app Contract Data Warehouse PMML Model External services Actionable insights Recommendation Engine Business Microservices Data Microservices
  27. 27. A NEW PLATFORM FOR A NEW ERA

×