SlideShare ist ein Scribd-Unternehmen logo
1 von 28
Creating a Common Consumer Profile
Management Service with WebSphere
DataPower
Speakers:
Brian Backer - Business Leader, Enterprise Architecture(MasterCard)
Bin Tang – Consultant, Enterprise Architecture(MasterCard)
Prithvi Srinivasan – SOA/Integration Practice Director(Prolifics)
Date: May 1st 2013
Agenda
• Introductions
• Business Case for a Common Consumer Profile Service
• Architecture Overview
– IT Landscape before the CCRS Implementation
– CCRS and the Future-state IT Landscape
• CCRS Implementation – Developing Complex Composite Services
– Logical Architecture
– Service Orchestration Overview
• WebSphere DataPower Performance Testing and Capacity Planning
– Approach
– Test Cases & Results
• WebSphere DataPower Tuning and Optimization Options
2
Agenda
• Introductions
• Business Case for a Common Consumer Profile Service
• Architecture Overview
– IT Landscape before the CCRS Implementation
– CCRS and the Future-state IT Landscape
• CCRS Implementation – Developing Complex Composite Services
– Logical Architecture
– Service Orchestration Overview
• WebSphere DataPower Performance Testing and Capacity Planning
– Approach
– Test Cases & Results
• WebSphere DataPower Tuning and Optimization Options
3
Common Consumer Registration Service (CCRS)
Page 4
• Centralized enterprise
capabilities for managing
consumer users
• Benefits
– Centralized management of
consumer identities
– Single identity across
multiple applications
– Security compliance
– Eliminate redundant
solutions
Overview / Problem Statement
CCRS represents the next evolution of shared services. Orchestration of a common business
process from the ESB.
Agenda
• Introductions
• Business Case for a Common Consumer Profile Service
• Architecture Overview
– IT Landscape before the CCRS Implementation
– CCRS and the Future-state IT Landscape
• CCRS Implementation – Developing Complex Composite Services
– Logical Architecture
– Service Orchestration Overview
• WebSphere DataPower Performance Testing and Capacity Planning
– Approach
– Test Cases & Results
• WebSphere DataPower Tuning and Optimization Options
5
Landscape Prior to CCRS on the ESB
Page 6
• Point to Point connection to credential management
service
– Inconsistent implementation
• Localized User Profile Information
– Consumer profile information spread across
multiple databases
• Lead generation activities submitted via batch file
– Lead generation profiles not matched with login
profiles
Landscape Prior to CCRS on the ESB
Page 7
CCRS on the ESB Landscape
Page 8
• Common service to manage authentication credentials and
user profile information
• Common user profile repository leveraging master data
management platform
• Service extensible for supporting traditional and single sign-
on models
• Service accessible from external gateway for Lead
Generation and Pre-Registration activities
– Provides common consumer profile across lead gen and
login models
• Leverages ESB security and monitoring models
CCRS on the ESB Landscape
Page 9
Agenda
• Introductions
• Business Case for a Common Consumer Profile Service
• Architecture Overview
– IT Landscape before the CCRS Implementation
– CCRS and the Future-state IT Landscape
• CCRS Implementation – Developing Complex Composite Services
– Logical Architecture
– Service Orchestration Overview
• WebSphere DataPower Performance Testing and Capacity Planning
– Approach
– Test Cases & Results
• WebSphere DataPower Tuning and Optimization Options
10
High Level Orchestration
Page 11
Registration Sequence Diagram
Page 12
CCRS Orchestration Proxy
Page 13
Agenda
• Introductions
• Business Case for a Common Consumer Profile Service
• Architecture Overview
– IT Landscape before the CCRS Implementation
– CCRS and the Future-state IT Landscape
• CCRS Implementation – Developing Complex Composite Services
– Logical Architecture
– Service Orchestration Overview
• WebSphere DataPower Performance Testing and Capacity Planning
– Approach
– Test Cases & Results
• WebSphere DataPower Tuning and Optimization Options
14
Performance and Load Testing Approach
Testing should focus on observing the appliance under
• Normal anticipated traffic load
• Anticipated traffic spikes
• And finally complete saturation (un-anticipated traffic spikes)
Appliance statistics should be studied including
• Number of connections
• CPU/load behavior
• Consumed memory
• Response times
• Interactional throughput at saturation
15
What to Monitor ?
• XSLT
– XSLTs is probably the most common reason for low performance. It is where
complex business transformation logic is written, for instance the url-open
extension function.
• Services
– Service objects like WS-Proxy/MPGW/XMLFW…
• Message Flows : The message flows are categorized in 4 types:
– Message: The time taken to process the request message received from
client, plus processing time by the server, plus time taken to process the
server response by the device (The full transaction cycle).
– Request: The time taken by DataPower to process the request message
before sending it to the server.
– Server: The time taken by the server to process the request message sent
to it by WebSphere DataPower.
– Response: The time taken by WebSphere DataPower to process the
message received from the server before sending it back to the client.
16
What to Monitor ? (Contd.)
• Connections
– You can get a snapshot of inbound, outbound and internal TCP
connections, you can also watch services listening on specific ports.
• Device Utilization
– It is also beneficial to watch the device metrics (CPU, Memory and
System Usage) under different situations. This is usually done via
periodic SNMP polling in most environments.
**Monitoring System Load/Usage provides a better metric of appliance
load than CPU usage.
• System Usage
• CPU Usage
• Memory Usage
• Transaction Rate
• Receive and Transmit Throughput17
Performance Testing Usecases
Test Result Summary
19
1 2 3 4 5
TPS 1572 1319 654 457 31
% Drop 16% 50% 30% 93%
CPU 48% 48% 88% 90% 23%
Memory 15% 15% 20% 76% 17%
0
0.1
0.2
0.3
0.4
0.5
0.6
0.7
0.8
0.9
1
0
200
400
600
800
1000
1200
1400
1600
1800
TPS
http -> mssl add AAA add MQ add real svc endpoint
Agenda
• Introductions
• Business Case for a Common Consumer Profile Service
• Architecture Overview
– IT Landscape before the CCRS Implementation
– CCRS and the Future-state IT Landscape
• CCRS Implementation – Developing Complex Composite Services
– Logical Architecture
– Service Orchestration Overview
• WebSphere DataPower Performance Testing and Capacity Planning
– Approach
– Test Cases & Results
• WebSphere DataPower Tuning and Optimization Options
20
Tuning Options
• Caching : Caching is the most important option for performance tuning, think of
the time used for network communication, retrieval of WSDL documents or
compiling XSLT files.
– XSLTs
• Objects > XML Processing > XML Manager > XML Manager ->XSL cache
size
– Documents
• Objects > XML Processing > XML Manager > XML Manager -> Document
Cache Size/ Document Cache Count
– WSDLs stored in WSRR
• Control Panel > Web Service Proxy > Your Proxy->WSDL tab->WSDL
Subscription->Refresh Interval
– AAA Cache
• Objects > XML Processing > AAA Policy > Your Policy-> AuthN/AuthZ tab-
> Cache Lifetime
21
Tuning Options (Contd.)
• HTTP Persistent Connections : HTTP Persistent connections means reusing
opened connection for sending multiple messages instead of
opening/closing a connection for each message, this option decreases CPU
cycles, network traffic and latency.
– Control Panel-> Your WSProxy->Advanced Proxy Tab->Persistent
Connections = "On“ and specify persistence timeout
• Streaming : It provides many advantages, one of which is decreasing
memory usage.
– DP supports many types of streaming such as
• execution streaming (using SAX when executing XSLTs), attachment
streaming,
• message streaming
• context streaming
• WebSphere MQ Queue Manager
• When connecting to MQ, use "dpmq://" instead of direct MQ
connection "mq://",
22
Tuning Options – (Contd.)
• Processing Rules :
– PIPE and NULL Contexts
• Whenever applicable use PIPE as Input and Output between two
contiguous action nodes
• Use NULL as Input or Output of any action that doesn't need to
produce or use predecessor actions' results
– Asynchronous Rules
• Limit the usage of asynchronous rules because as you can
imagine parallel processing will increase CPU Utilization (Context
Switching)
– Reusable Rules
• Reusable rules are often called many times from parent
rules, this may introduce redundancy in action node execution
– XSLT Code
• Avoid using "//"; specify the node you are targeting using its
absolute tree path
• Limit the number of backend calls like url-open23
24
 Self Balancing: Self balance across a cluster of appliances
 Replace front-end IP load balancer
 New support (introduced in firmware version 4.0.2) enables connections to be
preserved, without loss, during failover scenario
 Dynamic and Intelligent Load Distribution to backend systems
 Replace backend load balancer
Front-end IP load
balancers not needed
Self balancing (IP
spraying)
Application Optimization
25
Provides application-aware Intelligent Load Distribution
 Auto-discovers application targets and distributes load using dynamic feedback
mechanism
 Topology learning for WAS ND and VE
 Uses intelligent weighted distribution algorithms based on current server load
 Weighted Least Connection load balancing algorithm
 Provides several options for enabling Session Affinity
DataPower performs dynamic back-side
routing and load distribution (leveraging
dynamic information from back-ends)
Failure of target appliances
are masked by appropriate
weighted distribution
Application Optimization
REST
2
6
DataPower XC10 As a Side Cache
User
1
5
3
2 4
Client
Provider
1. Client submits application request.
2. DataPower XI parses request and queries XC10. On a hit, skip to step 5.
3. On a miss, XI forwards request to target Provider.
4. XI adds application response to XC10.
5. Client receives response from XI.
 Easily integrates into the existing business process
– No code changes to the client or back-end
application
– Simply add the side cache mediation at the ESB laye
 Significantly reduces the load on the back-end system by
eliminating redundant requests
 Response time from elastic cache is in milliseconds
Improved
Response Time
ImprovedLoad
DataPower XC10
DataPower XI Appliances
Large Response Time
Questions ??
Thank You!!

Weitere ähnliche Inhalte

Was ist angesagt?

Impact 2014 - IIB - selecting the right transformation option
Impact 2014 -  IIB - selecting the right transformation optionImpact 2014 -  IIB - selecting the right transformation option
Impact 2014 - IIB - selecting the right transformation option
Andrew Coleman
 
Business driven IT design
Business driven IT designBusiness driven IT design
Business driven IT design
Chris Haddad
 
Data power Performance Tuning
Data power Performance TuningData power Performance Tuning
Data power Performance Tuning
KINGSHUK MAJUMDER
 

Was ist angesagt? (20)

PPWT2019 - EmPower your BI architecture
PPWT2019 - EmPower your BI architecturePPWT2019 - EmPower your BI architecture
PPWT2019 - EmPower your BI architecture
 
Impact 2014 - IIB - selecting the right transformation option
Impact 2014 -  IIB - selecting the right transformation optionImpact 2014 -  IIB - selecting the right transformation option
Impact 2014 - IIB - selecting the right transformation option
 
Effective admin and development in iib
Effective admin and development in iibEffective admin and development in iib
Effective admin and development in iib
 
Hhm 3474 mq messaging technologies and support for high availability and acti...
Hhm 3474 mq messaging technologies and support for high availability and acti...Hhm 3474 mq messaging technologies and support for high availability and acti...
Hhm 3474 mq messaging technologies and support for high availability and acti...
 
IBM MQ High Availabillity and Disaster Recovery (2017 version)
IBM MQ High Availabillity and Disaster Recovery (2017 version)IBM MQ High Availabillity and Disaster Recovery (2017 version)
IBM MQ High Availabillity and Disaster Recovery (2017 version)
 
Business driven IT design
Business driven IT designBusiness driven IT design
Business driven IT design
 
VTU Open Elective 6th Sem CSE - Module 2 - Cloud Computing
VTU Open Elective 6th Sem CSE - Module 2 - Cloud ComputingVTU Open Elective 6th Sem CSE - Module 2 - Cloud Computing
VTU Open Elective 6th Sem CSE - Module 2 - Cloud Computing
 
Tổng quan công nghệ Net backup - Phần 2
Tổng quan công nghệ Net backup - Phần 2Tổng quan công nghệ Net backup - Phần 2
Tổng quan công nghệ Net backup - Phần 2
 
Software Architecture for Cloud Infrastructure
Software Architecture for Cloud InfrastructureSoftware Architecture for Cloud Infrastructure
Software Architecture for Cloud Infrastructure
 
Data power Performance Tuning
Data power Performance TuningData power Performance Tuning
Data power Performance Tuning
 
Maximizing performance via tuning and optimization
Maximizing performance via tuning and optimizationMaximizing performance via tuning and optimization
Maximizing performance via tuning and optimization
 
Cloud Design Pattern part1
Cloud Design Pattern part1Cloud Design Pattern part1
Cloud Design Pattern part1
 
Caching for Microservices Architectures: Session II - Caching Patterns
Caching for Microservices Architectures: Session II - Caching PatternsCaching for Microservices Architectures: Session II - Caching Patterns
Caching for Microservices Architectures: Session II - Caching Patterns
 
5 Postgres DBA Tips
5 Postgres DBA Tips5 Postgres DBA Tips
5 Postgres DBA Tips
 
Redefining End-to-End Monitoring: The Foundation - High-Performance Architect...
Redefining End-to-End Monitoring: The Foundation - High-Performance Architect...Redefining End-to-End Monitoring: The Foundation - High-Performance Architect...
Redefining End-to-End Monitoring: The Foundation - High-Performance Architect...
 
Hia 1689-techinical introduction-to_iib
Hia 1689-techinical introduction-to_iibHia 1689-techinical introduction-to_iib
Hia 1689-techinical introduction-to_iib
 
Tổng quan công nghệ Net backup - Phần 1
Tổng quan công nghệ Net backup - Phần 1Tổng quan công nghệ Net backup - Phần 1
Tổng quan công nghệ Net backup - Phần 1
 
Scaling Your Database In The Cloud
Scaling Your Database In The CloudScaling Your Database In The Cloud
Scaling Your Database In The Cloud
 
OpenText Archive Server on Azure
OpenText Archive Server on AzureOpenText Archive Server on Azure
OpenText Archive Server on Azure
 
Introduction to Cloud Data Center and Network Issues
Introduction to Cloud Data Center and Network IssuesIntroduction to Cloud Data Center and Network Issues
Introduction to Cloud Data Center and Network Issues
 

Andere mochten auch

Buyer persona template
Buyer persona templateBuyer persona template
Buyer persona template
hersenstehuur
 

Andere mochten auch (9)

DataPower sessions @IMPACT2013
DataPower sessions @IMPACT2013DataPower sessions @IMPACT2013
DataPower sessions @IMPACT2013
 
Turbo Charge DataPower to Reach Your SOA Goals
Turbo Charge DataPower to Reach Your SOA Goals Turbo Charge DataPower to Reach Your SOA Goals
Turbo Charge DataPower to Reach Your SOA Goals
 
Using IBM DataPower for rapid security and application integration with an op...
Using IBM DataPower for rapid security and application integration with an op...Using IBM DataPower for rapid security and application integration with an op...
Using IBM DataPower for rapid security and application integration with an op...
 
Buyer persona template
Buyer persona templateBuyer persona template
Buyer persona template
 
10 Rules for Buyer Persona Development
10 Rules for Buyer Persona Development10 Rules for Buyer Persona Development
10 Rules for Buyer Persona Development
 
HubSpot Guide to Buyer Persona Creation
HubSpot Guide to Buyer Persona CreationHubSpot Guide to Buyer Persona Creation
HubSpot Guide to Buyer Persona Creation
 
Persona mapping
Persona mappingPersona mapping
Persona mapping
 
Design Thinking With Persona
Design Thinking With PersonaDesign Thinking With Persona
Design Thinking With Persona
 
Content Curation Scorecard for Content Marketing Success
Content Curation Scorecard for Content Marketing SuccessContent Curation Scorecard for Content Marketing Success
Content Curation Scorecard for Content Marketing Success
 

Ähnlich wie Creating a Centralized Consumer Profile Management Service with WebSphere DataPower

chapter10-120827115414-phpapp02.pdf
chapter10-120827115414-phpapp02.pdfchapter10-120827115414-phpapp02.pdf
chapter10-120827115414-phpapp02.pdf
AxmedMaxamuud6
 

Ähnlich wie Creating a Centralized Consumer Profile Management Service with WebSphere DataPower (20)

Opal: Simple Web Services Wrappers for Scientific Applications
Opal: Simple Web Services Wrappers for Scientific ApplicationsOpal: Simple Web Services Wrappers for Scientific Applications
Opal: Simple Web Services Wrappers for Scientific Applications
 
Share 2014 Pittsburgh CICS Technical Overview
Share 2014 Pittsburgh CICS Technical OverviewShare 2014 Pittsburgh CICS Technical Overview
Share 2014 Pittsburgh CICS Technical Overview
 
Databus - LinkedIn's Change Data Capture Pipeline
Databus - LinkedIn's Change Data Capture PipelineDatabus - LinkedIn's Change Data Capture Pipeline
Databus - LinkedIn's Change Data Capture Pipeline
 
IBM Impact session CICS V52 overview
IBM Impact session CICS V52 overview IBM Impact session CICS V52 overview
IBM Impact session CICS V52 overview
 
Chapter 10 System Architecture.Information Technology Project Management pptx
Chapter 10 System Architecture.Information Technology Project Management pptxChapter 10 System Architecture.Information Technology Project Management pptx
Chapter 10 System Architecture.Information Technology Project Management pptx
 
Technical Architectures
Technical ArchitecturesTechnical Architectures
Technical Architectures
 
Micro service architecture
Micro service architecture  Micro service architecture
Micro service architecture
 
Presentation cisco intelligent automation for cloud
Presentation   cisco intelligent automation for cloudPresentation   cisco intelligent automation for cloud
Presentation cisco intelligent automation for cloud
 
A Public Cloud Based SOA Workflow for Machine Learning Based Recommendation A...
A Public Cloud Based SOA Workflow for Machine Learning Based Recommendation A...A Public Cloud Based SOA Workflow for Machine Learning Based Recommendation A...
A Public Cloud Based SOA Workflow for Machine Learning Based Recommendation A...
 
The Essential Guide for Automating CMDB population and maintenance
The Essential Guide for Automating CMDB population and maintenanceThe Essential Guide for Automating CMDB population and maintenance
The Essential Guide for Automating CMDB population and maintenance
 
Transforming Legacy Applications Into Dynamically Scalable Web Services
Transforming Legacy Applications Into Dynamically Scalable Web ServicesTransforming Legacy Applications Into Dynamically Scalable Web Services
Transforming Legacy Applications Into Dynamically Scalable Web Services
 
The Evolving Data Center – Past, Present and Future
The Evolving Data Center – Past, Present and FutureThe Evolving Data Center – Past, Present and Future
The Evolving Data Center – Past, Present and Future
 
Caching for Microservices Architectures: Session I
Caching for Microservices Architectures: Session ICaching for Microservices Architectures: Session I
Caching for Microservices Architectures: Session I
 
DEVNET-1153 Enterprise Application to Infrastructure Integration – SDN Apps
DEVNET-1153	Enterprise Application to Infrastructure Integration – SDN AppsDEVNET-1153	Enterprise Application to Infrastructure Integration – SDN Apps
DEVNET-1153 Enterprise Application to Infrastructure Integration – SDN Apps
 
chapter10-120827115414-phpapp02.pdf
chapter10-120827115414-phpapp02.pdfchapter10-120827115414-phpapp02.pdf
chapter10-120827115414-phpapp02.pdf
 
Enterprise Application to Infrastructure Integration - SDN Apps
Enterprise Application to Infrastructure Integration - SDN AppsEnterprise Application to Infrastructure Integration - SDN Apps
Enterprise Application to Infrastructure Integration - SDN Apps
 
Achieve business agility with Cloud APIs, Cloud-aware Apps, and Cloud DevOps ...
Achieve business agility with Cloud APIs, Cloud-aware Apps, and Cloud DevOps ...Achieve business agility with Cloud APIs, Cloud-aware Apps, and Cloud DevOps ...
Achieve business agility with Cloud APIs, Cloud-aware Apps, and Cloud DevOps ...
 
Paa sing a java ee 6 application kshitiz saxena
Paa sing a java ee 6 application   kshitiz saxenaPaa sing a java ee 6 application   kshitiz saxena
Paa sing a java ee 6 application kshitiz saxena
 
Architecture Concepts
Architecture ConceptsArchitecture Concepts
Architecture Concepts
 
Operational-Analytics
Operational-AnalyticsOperational-Analytics
Operational-Analytics
 

Mehr von Prolifics

Discover BPM Optimization in the Cloud
Discover BPM Optimization in the CloudDiscover BPM Optimization in the Cloud
Discover BPM Optimization in the Cloud
Prolifics
 
Customizing the Mobile Connections App
Customizing the Mobile Connections AppCustomizing the Mobile Connections App
Customizing the Mobile Connections App
Prolifics
 

Mehr von Prolifics (20)

Prolifics SAP Data Assessment
Prolifics SAP Data AssessmentProlifics SAP Data Assessment
Prolifics SAP Data Assessment
 
Prolifics Level 2 Test Lifecycle Automation Services Star West
Prolifics Level 2 Test Lifecycle Automation Services Star WestProlifics Level 2 Test Lifecycle Automation Services Star West
Prolifics Level 2 Test Lifecycle Automation Services Star West
 
PureApplication: System, Service, Software
PureApplication: System, Service, SoftwarePureApplication: System, Service, Software
PureApplication: System, Service, Software
 
Cloud Options for a Modern Architecture
Cloud Options for a Modern ArchitectureCloud Options for a Modern Architecture
Cloud Options for a Modern Architecture
 
Discover BPM Optimization in the Cloud
Discover BPM Optimization in the CloudDiscover BPM Optimization in the Cloud
Discover BPM Optimization in the Cloud
 
Leveraging Governance in the IBM WebSphere Service Registry and Repository fo...
Leveraging Governance in the IBM WebSphere Service Registry and Repository fo...Leveraging Governance in the IBM WebSphere Service Registry and Repository fo...
Leveraging Governance in the IBM WebSphere Service Registry and Repository fo...
 
Applying an IBM SOA Approach to Manual Processes Automation
Applying an IBM SOA Approach to Manual Processes AutomationApplying an IBM SOA Approach to Manual Processes Automation
Applying an IBM SOA Approach to Manual Processes Automation
 
How Broadcast Music, Inc. Devised and Enabled Enterprise Architecture from Co...
How Broadcast Music, Inc. Devised and Enabled Enterprise Architecture from Co...How Broadcast Music, Inc. Devised and Enabled Enterprise Architecture from Co...
How Broadcast Music, Inc. Devised and Enabled Enterprise Architecture from Co...
 
Using the Power of IBM Tivoli Common Reporting to Make Smart Decisions: The U...
Using the Power of IBM Tivoli Common Reporting to Make Smart Decisions: The U...Using the Power of IBM Tivoli Common Reporting to Make Smart Decisions: The U...
Using the Power of IBM Tivoli Common Reporting to Make Smart Decisions: The U...
 
Empowering SmartCloud APM - Predictive Insights and Analysis: A Use Case Scen...
Empowering SmartCloud APM - Predictive Insights and Analysis: A Use Case Scen...Empowering SmartCloud APM - Predictive Insights and Analysis: A Use Case Scen...
Empowering SmartCloud APM - Predictive Insights and Analysis: A Use Case Scen...
 
Best Practices for Monitoring Your Cloud Environment and Applications
Best Practices for Monitoring Your Cloud Environment and ApplicationsBest Practices for Monitoring Your Cloud Environment and Applications
Best Practices for Monitoring Your Cloud Environment and Applications
 
Smarter Integration Using the IBM SOA Foundation Stack: Best Practices and Le...
Smarter Integration Using the IBM SOA Foundation Stack: Best Practices and Le...Smarter Integration Using the IBM SOA Foundation Stack: Best Practices and Le...
Smarter Integration Using the IBM SOA Foundation Stack: Best Practices and Le...
 
Delivering Enterprise Applications: Faster. Cheaper. Better
Delivering Enterprise Applications: Faster. Cheaper. BetterDelivering Enterprise Applications: Faster. Cheaper. Better
Delivering Enterprise Applications: Faster. Cheaper. Better
 
Architecting and Tuning IIB/eXtreme Scale for Maximum Performance and Reliabi...
Architecting and Tuning IIB/eXtreme Scale for Maximum Performance and Reliabi...Architecting and Tuning IIB/eXtreme Scale for Maximum Performance and Reliabi...
Architecting and Tuning IIB/eXtreme Scale for Maximum Performance and Reliabi...
 
Integrating IBM PureApplication System and IBM UrbanCode Deploy: A GE Capital...
Integrating IBM PureApplication System and IBM UrbanCode Deploy: A GE Capital...Integrating IBM PureApplication System and IBM UrbanCode Deploy: A GE Capital...
Integrating IBM PureApplication System and IBM UrbanCode Deploy: A GE Capital...
 
Broadcast Music Inc. Release Rockstars: Program-Wide DevOps Success with Urba...
Broadcast Music Inc. Release Rockstars: Program-Wide DevOps Success with Urba...Broadcast Music Inc. Release Rockstars: Program-Wide DevOps Success with Urba...
Broadcast Music Inc. Release Rockstars: Program-Wide DevOps Success with Urba...
 
From Print to the Cloud and Beyond: The Story of a Century Old Company and it...
From Print to the Cloud and Beyond: The Story of a Century Old Company and it...From Print to the Cloud and Beyond: The Story of a Century Old Company and it...
From Print to the Cloud and Beyond: The Story of a Century Old Company and it...
 
Integrating Salesforce.com and Oracle ERP Using IBM WebSphere Cast Iron
Integrating Salesforce.com and Oracle ERP Using IBM WebSphere Cast IronIntegrating Salesforce.com and Oracle ERP Using IBM WebSphere Cast Iron
Integrating Salesforce.com and Oracle ERP Using IBM WebSphere Cast Iron
 
Recommended Design Considerations for Enterprise Monitoring
Recommended Design Considerations for Enterprise Monitoring Recommended Design Considerations for Enterprise Monitoring
Recommended Design Considerations for Enterprise Monitoring
 
Customizing the Mobile Connections App
Customizing the Mobile Connections AppCustomizing the Mobile Connections App
Customizing the Mobile Connections App
 

Kürzlich hochgeladen

Artificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and MythsArtificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and Myths
Joaquim Jorge
 

Kürzlich hochgeladen (20)

Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood
Polkadot JAM Slides - Token2049 - By Dr. Gavin WoodPolkadot JAM Slides - Token2049 - By Dr. Gavin Wood
Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood
 
presentation ICT roal in 21st century education
presentation ICT roal in 21st century educationpresentation ICT roal in 21st century education
presentation ICT roal in 21st century education
 
The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024
 
2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...
 
Artificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and MythsArtificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and Myths
 
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
 
AWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of TerraformAWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of Terraform
 
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationFrom Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
 
Top 5 Benefits OF Using Muvi Live Paywall For Live Streams
Top 5 Benefits OF Using Muvi Live Paywall For Live StreamsTop 5 Benefits OF Using Muvi Live Paywall For Live Streams
Top 5 Benefits OF Using Muvi Live Paywall For Live Streams
 
Artificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : UncertaintyArtificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : Uncertainty
 
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost SavingRepurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
 
Top 10 Most Downloaded Games on Play Store in 2024
Top 10 Most Downloaded Games on Play Store in 2024Top 10 Most Downloaded Games on Play Store in 2024
Top 10 Most Downloaded Games on Play Store in 2024
 
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
 
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
 
Manulife - Insurer Innovation Award 2024
Manulife - Insurer Innovation Award 2024Manulife - Insurer Innovation Award 2024
Manulife - Insurer Innovation Award 2024
 
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemkeProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
 
Partners Life - Insurer Innovation Award 2024
Partners Life - Insurer Innovation Award 2024Partners Life - Insurer Innovation Award 2024
Partners Life - Insurer Innovation Award 2024
 
Strategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a FresherStrategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a Fresher
 
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, AdobeApidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
 
🐬 The future of MySQL is Postgres 🐘
🐬  The future of MySQL is Postgres   🐘🐬  The future of MySQL is Postgres   🐘
🐬 The future of MySQL is Postgres 🐘
 

Creating a Centralized Consumer Profile Management Service with WebSphere DataPower

  • 1. Creating a Common Consumer Profile Management Service with WebSphere DataPower Speakers: Brian Backer - Business Leader, Enterprise Architecture(MasterCard) Bin Tang – Consultant, Enterprise Architecture(MasterCard) Prithvi Srinivasan – SOA/Integration Practice Director(Prolifics) Date: May 1st 2013
  • 2. Agenda • Introductions • Business Case for a Common Consumer Profile Service • Architecture Overview – IT Landscape before the CCRS Implementation – CCRS and the Future-state IT Landscape • CCRS Implementation – Developing Complex Composite Services – Logical Architecture – Service Orchestration Overview • WebSphere DataPower Performance Testing and Capacity Planning – Approach – Test Cases & Results • WebSphere DataPower Tuning and Optimization Options 2
  • 3. Agenda • Introductions • Business Case for a Common Consumer Profile Service • Architecture Overview – IT Landscape before the CCRS Implementation – CCRS and the Future-state IT Landscape • CCRS Implementation – Developing Complex Composite Services – Logical Architecture – Service Orchestration Overview • WebSphere DataPower Performance Testing and Capacity Planning – Approach – Test Cases & Results • WebSphere DataPower Tuning and Optimization Options 3
  • 4. Common Consumer Registration Service (CCRS) Page 4 • Centralized enterprise capabilities for managing consumer users • Benefits – Centralized management of consumer identities – Single identity across multiple applications – Security compliance – Eliminate redundant solutions Overview / Problem Statement CCRS represents the next evolution of shared services. Orchestration of a common business process from the ESB.
  • 5. Agenda • Introductions • Business Case for a Common Consumer Profile Service • Architecture Overview – IT Landscape before the CCRS Implementation – CCRS and the Future-state IT Landscape • CCRS Implementation – Developing Complex Composite Services – Logical Architecture – Service Orchestration Overview • WebSphere DataPower Performance Testing and Capacity Planning – Approach – Test Cases & Results • WebSphere DataPower Tuning and Optimization Options 5
  • 6. Landscape Prior to CCRS on the ESB Page 6
  • 7. • Point to Point connection to credential management service – Inconsistent implementation • Localized User Profile Information – Consumer profile information spread across multiple databases • Lead generation activities submitted via batch file – Lead generation profiles not matched with login profiles Landscape Prior to CCRS on the ESB Page 7
  • 8. CCRS on the ESB Landscape Page 8
  • 9. • Common service to manage authentication credentials and user profile information • Common user profile repository leveraging master data management platform • Service extensible for supporting traditional and single sign- on models • Service accessible from external gateway for Lead Generation and Pre-Registration activities – Provides common consumer profile across lead gen and login models • Leverages ESB security and monitoring models CCRS on the ESB Landscape Page 9
  • 10. Agenda • Introductions • Business Case for a Common Consumer Profile Service • Architecture Overview – IT Landscape before the CCRS Implementation – CCRS and the Future-state IT Landscape • CCRS Implementation – Developing Complex Composite Services – Logical Architecture – Service Orchestration Overview • WebSphere DataPower Performance Testing and Capacity Planning – Approach – Test Cases & Results • WebSphere DataPower Tuning and Optimization Options 10
  • 14. Agenda • Introductions • Business Case for a Common Consumer Profile Service • Architecture Overview – IT Landscape before the CCRS Implementation – CCRS and the Future-state IT Landscape • CCRS Implementation – Developing Complex Composite Services – Logical Architecture – Service Orchestration Overview • WebSphere DataPower Performance Testing and Capacity Planning – Approach – Test Cases & Results • WebSphere DataPower Tuning and Optimization Options 14
  • 15. Performance and Load Testing Approach Testing should focus on observing the appliance under • Normal anticipated traffic load • Anticipated traffic spikes • And finally complete saturation (un-anticipated traffic spikes) Appliance statistics should be studied including • Number of connections • CPU/load behavior • Consumed memory • Response times • Interactional throughput at saturation 15
  • 16. What to Monitor ? • XSLT – XSLTs is probably the most common reason for low performance. It is where complex business transformation logic is written, for instance the url-open extension function. • Services – Service objects like WS-Proxy/MPGW/XMLFW… • Message Flows : The message flows are categorized in 4 types: – Message: The time taken to process the request message received from client, plus processing time by the server, plus time taken to process the server response by the device (The full transaction cycle). – Request: The time taken by DataPower to process the request message before sending it to the server. – Server: The time taken by the server to process the request message sent to it by WebSphere DataPower. – Response: The time taken by WebSphere DataPower to process the message received from the server before sending it back to the client. 16
  • 17. What to Monitor ? (Contd.) • Connections – You can get a snapshot of inbound, outbound and internal TCP connections, you can also watch services listening on specific ports. • Device Utilization – It is also beneficial to watch the device metrics (CPU, Memory and System Usage) under different situations. This is usually done via periodic SNMP polling in most environments. **Monitoring System Load/Usage provides a better metric of appliance load than CPU usage. • System Usage • CPU Usage • Memory Usage • Transaction Rate • Receive and Transmit Throughput17
  • 19. Test Result Summary 19 1 2 3 4 5 TPS 1572 1319 654 457 31 % Drop 16% 50% 30% 93% CPU 48% 48% 88% 90% 23% Memory 15% 15% 20% 76% 17% 0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1 0 200 400 600 800 1000 1200 1400 1600 1800 TPS http -> mssl add AAA add MQ add real svc endpoint
  • 20. Agenda • Introductions • Business Case for a Common Consumer Profile Service • Architecture Overview – IT Landscape before the CCRS Implementation – CCRS and the Future-state IT Landscape • CCRS Implementation – Developing Complex Composite Services – Logical Architecture – Service Orchestration Overview • WebSphere DataPower Performance Testing and Capacity Planning – Approach – Test Cases & Results • WebSphere DataPower Tuning and Optimization Options 20
  • 21. Tuning Options • Caching : Caching is the most important option for performance tuning, think of the time used for network communication, retrieval of WSDL documents or compiling XSLT files. – XSLTs • Objects > XML Processing > XML Manager > XML Manager ->XSL cache size – Documents • Objects > XML Processing > XML Manager > XML Manager -> Document Cache Size/ Document Cache Count – WSDLs stored in WSRR • Control Panel > Web Service Proxy > Your Proxy->WSDL tab->WSDL Subscription->Refresh Interval – AAA Cache • Objects > XML Processing > AAA Policy > Your Policy-> AuthN/AuthZ tab- > Cache Lifetime 21
  • 22. Tuning Options (Contd.) • HTTP Persistent Connections : HTTP Persistent connections means reusing opened connection for sending multiple messages instead of opening/closing a connection for each message, this option decreases CPU cycles, network traffic and latency. – Control Panel-> Your WSProxy->Advanced Proxy Tab->Persistent Connections = "On“ and specify persistence timeout • Streaming : It provides many advantages, one of which is decreasing memory usage. – DP supports many types of streaming such as • execution streaming (using SAX when executing XSLTs), attachment streaming, • message streaming • context streaming • WebSphere MQ Queue Manager • When connecting to MQ, use "dpmq://" instead of direct MQ connection "mq://", 22
  • 23. Tuning Options – (Contd.) • Processing Rules : – PIPE and NULL Contexts • Whenever applicable use PIPE as Input and Output between two contiguous action nodes • Use NULL as Input or Output of any action that doesn't need to produce or use predecessor actions' results – Asynchronous Rules • Limit the usage of asynchronous rules because as you can imagine parallel processing will increase CPU Utilization (Context Switching) – Reusable Rules • Reusable rules are often called many times from parent rules, this may introduce redundancy in action node execution – XSLT Code • Avoid using "//"; specify the node you are targeting using its absolute tree path • Limit the number of backend calls like url-open23
  • 24. 24  Self Balancing: Self balance across a cluster of appliances  Replace front-end IP load balancer  New support (introduced in firmware version 4.0.2) enables connections to be preserved, without loss, during failover scenario  Dynamic and Intelligent Load Distribution to backend systems  Replace backend load balancer Front-end IP load balancers not needed Self balancing (IP spraying) Application Optimization
  • 25. 25 Provides application-aware Intelligent Load Distribution  Auto-discovers application targets and distributes load using dynamic feedback mechanism  Topology learning for WAS ND and VE  Uses intelligent weighted distribution algorithms based on current server load  Weighted Least Connection load balancing algorithm  Provides several options for enabling Session Affinity DataPower performs dynamic back-side routing and load distribution (leveraging dynamic information from back-ends) Failure of target appliances are masked by appropriate weighted distribution Application Optimization
  • 26. REST 2 6 DataPower XC10 As a Side Cache User 1 5 3 2 4 Client Provider 1. Client submits application request. 2. DataPower XI parses request and queries XC10. On a hit, skip to step 5. 3. On a miss, XI forwards request to target Provider. 4. XI adds application response to XC10. 5. Client receives response from XI.  Easily integrates into the existing business process – No code changes to the client or back-end application – Simply add the side cache mediation at the ESB laye  Significantly reduces the load on the back-end system by eliminating redundant requests  Response time from elastic cache is in milliseconds Improved Response Time ImprovedLoad DataPower XC10 DataPower XI Appliances Large Response Time