SlideShare ist ein Scribd-Unternehmen logo
1 von 15
The Next Step in
Reconciliation Testing

        Natalia Zaitseva, Automation Lead for Borsa Italiana, ITS-Expert
        Natalia Popovchuk, Development Lead, ITS-Expert
•   What is Reconciliation testing?




           Reconciliation is a process
         of finding discrepancies in data
        obtained from different sources
•   Where is reconciliation needed?


                                Trading System

•Drop Copy

•Market data


•Back Office

• Smart Order Router
• •Complexity ofof reconciliation
    Complexity reconciliation




                                      2. More complex
                                        2. More complex



  3. Complex
  3. Complex
                                                 1 : n relationship
                                              1 : n relationship


                         n : n relationship
                     n : n relationship
•   Benefits of Automated reconciliation



    •Fast analysis
    •Automated matching process
    •Report generation
    •Increases productivity
•   Requirements to a reconciliation tool




    •Capacity / Scalability
    •Fast Matching Engine
    •Flexibility
    •User friendly interface
Reconciliation report
•   Requirements for conformance testing




    •No limitations on the incoming feed
    •High performance
    •Monitoring in real-time
    •Reporting
•   Further improvements




    1. Enriching the functionality
    2. Conversion from passive listener
       to active mode
•   System under test
•   Testing options




    1   Involve clients in system testing

    2   Manually check each client
            connection separately
    3   Automated testing
•   Automated testing solution
•   Automated testing steps


                  Step 2               Step 3
       Aggregate Data                    Create Test Scenarios




      Step 1                                        Step 4
      Process                                      Execute Test Scenarios
         Logs




                              Step 5. Reconcile Test Output
•    Reconciliation Levels


•       Detailed comparison. On this level, each test message will be compared with the expected result (production
        message) field by field and every distinction will be reported.

Sample of Executions comparison:




 •       High-level analysis. Detailed results will be processed, and the summary of issues and recommendations on
         Adapters adjustments will be provided as a result.

 Sample of tag combination analysis:
Questions & Answers

Weitere ähnliche Inhalte

Was ist angesagt?

QA Meet up in Saratov 25.07.15: Инструменты для тестирования и Лондонская фон...
QA Meet up in Saratov 25.07.15: Инструменты для тестирования и Лондонская фон...QA Meet up in Saratov 25.07.15: Инструменты для тестирования и Лондонская фон...
QA Meet up in Saratov 25.07.15: Инструменты для тестирования и Лондонская фон...Iosif Itkin
 
EXTENT-2016: Trading Technology Trends and Innovation
EXTENT-2016: Trading Technology Trends and InnovationEXTENT-2016: Trading Technology Trends and Innovation
EXTENT-2016: Trading Technology Trends and InnovationIosif Itkin
 
Reconciliation Testing Aspects of Trading Systems Software Failures
Reconciliation Testing Aspects of Trading Systems Software FailuresReconciliation Testing Aspects of Trading Systems Software Failures
Reconciliation Testing Aspects of Trading Systems Software FailuresIosif Itkin
 
EXTENT-2016: Quality at Source
EXTENT-2016: Quality at SourceEXTENT-2016: Quality at Source
EXTENT-2016: Quality at SourceIosif Itkin
 
EXTENT-2015: Reconciliation Testing Aspects
EXTENT-2015: Reconciliation Testing AspectsEXTENT-2015: Reconciliation Testing Aspects
EXTENT-2015: Reconciliation Testing AspectsIosif Itkin
 
Technical User Group
Technical User GroupTechnical User Group
Technical User GroupIosif Itkin
 
EXTENT-2016: Managing QA for Complex Systems in Agile Development Framework
EXTENT-2016: Managing QA for Complex Systems in Agile Development FrameworkEXTENT-2016: Managing QA for Complex Systems in Agile Development Framework
EXTENT-2016: Managing QA for Complex Systems in Agile Development FrameworkIosif Itkin
 
High Frequency Trading Infrastructure and Quality Assurance
High Frequency Trading Infrastructure and Quality AssuranceHigh Frequency Trading Infrastructure and Quality Assurance
High Frequency Trading Infrastructure and Quality AssuranceIosif Itkin
 
SEC Regulation SCI Automation Review Compliance
SEC Regulation SCI Automation Review ComplianceSEC Regulation SCI Automation Review Compliance
SEC Regulation SCI Automation Review ComplianceIosif Itkin
 
EXTENT-2016: Key Challenges and Lessons Learned from Testing a New Trading Sy...
EXTENT-2016: Key Challenges and Lessons Learned from Testing a New Trading Sy...EXTENT-2016: Key Challenges and Lessons Learned from Testing a New Trading Sy...
EXTENT-2016: Key Challenges and Lessons Learned from Testing a New Trading Sy...Iosif Itkin
 
EXTENT-2015: LSEG Technology Overview
EXTENT-2015: LSEG Technology Overview EXTENT-2015: LSEG Technology Overview
EXTENT-2015: LSEG Technology Overview Iosif Itkin
 
EXTENT-2015: Millennium Surveillance™ – Achieving Excellence
EXTENT-2015: Millennium Surveillance™ –  Achieving ExcellenceEXTENT-2015: Millennium Surveillance™ –  Achieving Excellence
EXTENT-2015: Millennium Surveillance™ – Achieving ExcellenceIosif Itkin
 
Iosif Itkin - Network models for exchange trade analysis
Iosif Itkin - Network models for exchange trade analysisIosif Itkin - Network models for exchange trade analysis
Iosif Itkin - Network models for exchange trade analysisAIST
 
Alyona Lamash-Innovation in C&S
Alyona Lamash-Innovation in C&SAlyona Lamash-Innovation in C&S
Alyona Lamash-Innovation in C&SAlexey Zverev
 
EXTENT-2016: Conference Opening
EXTENT-2016: Conference OpeningEXTENT-2016: Conference Opening
EXTENT-2016: Conference OpeningIosif Itkin
 
Лекция в СГТУ: Информационные системы и технологическая инфраструктура биржев...
Лекция в СГТУ: Информационные системы и технологическая инфраструктура биржев...Лекция в СГТУ: Информационные системы и технологическая инфраструктура биржев...
Лекция в СГТУ: Информационные системы и технологическая инфраструктура биржев...Iosif Itkin
 
Spirent TrafficCenter - Network Testing Made Easy
Spirent TrafficCenter - Network Testing Made EasySpirent TrafficCenter - Network Testing Made Easy
Spirent TrafficCenter - Network Testing Made EasyMalathi Malla
 
Webmetrics Graphical Overview
Webmetrics Graphical OverviewWebmetrics Graphical Overview
Webmetrics Graphical OverviewJason_Volm
 
FLIGHT WEST 2018 Presentation - Open Source License Management in Black Duck Hub
FLIGHT WEST 2018 Presentation - Open Source License Management in Black Duck HubFLIGHT WEST 2018 Presentation - Open Source License Management in Black Duck Hub
FLIGHT WEST 2018 Presentation - Open Source License Management in Black Duck HubBlack Duck by Synopsys
 
25 Jul 2018 - What is New in codeBeamer 9.2
25 Jul 2018 - What is New in codeBeamer 9.2 25 Jul 2018 - What is New in codeBeamer 9.2
25 Jul 2018 - What is New in codeBeamer 9.2 Intland Software GmbH
 

Was ist angesagt? (20)

QA Meet up in Saratov 25.07.15: Инструменты для тестирования и Лондонская фон...
QA Meet up in Saratov 25.07.15: Инструменты для тестирования и Лондонская фон...QA Meet up in Saratov 25.07.15: Инструменты для тестирования и Лондонская фон...
QA Meet up in Saratov 25.07.15: Инструменты для тестирования и Лондонская фон...
 
EXTENT-2016: Trading Technology Trends and Innovation
EXTENT-2016: Trading Technology Trends and InnovationEXTENT-2016: Trading Technology Trends and Innovation
EXTENT-2016: Trading Technology Trends and Innovation
 
Reconciliation Testing Aspects of Trading Systems Software Failures
Reconciliation Testing Aspects of Trading Systems Software FailuresReconciliation Testing Aspects of Trading Systems Software Failures
Reconciliation Testing Aspects of Trading Systems Software Failures
 
EXTENT-2016: Quality at Source
EXTENT-2016: Quality at SourceEXTENT-2016: Quality at Source
EXTENT-2016: Quality at Source
 
EXTENT-2015: Reconciliation Testing Aspects
EXTENT-2015: Reconciliation Testing AspectsEXTENT-2015: Reconciliation Testing Aspects
EXTENT-2015: Reconciliation Testing Aspects
 
Technical User Group
Technical User GroupTechnical User Group
Technical User Group
 
EXTENT-2016: Managing QA for Complex Systems in Agile Development Framework
EXTENT-2016: Managing QA for Complex Systems in Agile Development FrameworkEXTENT-2016: Managing QA for Complex Systems in Agile Development Framework
EXTENT-2016: Managing QA for Complex Systems in Agile Development Framework
 
High Frequency Trading Infrastructure and Quality Assurance
High Frequency Trading Infrastructure and Quality AssuranceHigh Frequency Trading Infrastructure and Quality Assurance
High Frequency Trading Infrastructure and Quality Assurance
 
SEC Regulation SCI Automation Review Compliance
SEC Regulation SCI Automation Review ComplianceSEC Regulation SCI Automation Review Compliance
SEC Regulation SCI Automation Review Compliance
 
EXTENT-2016: Key Challenges and Lessons Learned from Testing a New Trading Sy...
EXTENT-2016: Key Challenges and Lessons Learned from Testing a New Trading Sy...EXTENT-2016: Key Challenges and Lessons Learned from Testing a New Trading Sy...
EXTENT-2016: Key Challenges and Lessons Learned from Testing a New Trading Sy...
 
EXTENT-2015: LSEG Technology Overview
EXTENT-2015: LSEG Technology Overview EXTENT-2015: LSEG Technology Overview
EXTENT-2015: LSEG Technology Overview
 
EXTENT-2015: Millennium Surveillance™ – Achieving Excellence
EXTENT-2015: Millennium Surveillance™ –  Achieving ExcellenceEXTENT-2015: Millennium Surveillance™ –  Achieving Excellence
EXTENT-2015: Millennium Surveillance™ – Achieving Excellence
 
Iosif Itkin - Network models for exchange trade analysis
Iosif Itkin - Network models for exchange trade analysisIosif Itkin - Network models for exchange trade analysis
Iosif Itkin - Network models for exchange trade analysis
 
Alyona Lamash-Innovation in C&S
Alyona Lamash-Innovation in C&SAlyona Lamash-Innovation in C&S
Alyona Lamash-Innovation in C&S
 
EXTENT-2016: Conference Opening
EXTENT-2016: Conference OpeningEXTENT-2016: Conference Opening
EXTENT-2016: Conference Opening
 
Лекция в СГТУ: Информационные системы и технологическая инфраструктура биржев...
Лекция в СГТУ: Информационные системы и технологическая инфраструктура биржев...Лекция в СГТУ: Информационные системы и технологическая инфраструктура биржев...
Лекция в СГТУ: Информационные системы и технологическая инфраструктура биржев...
 
Spirent TrafficCenter - Network Testing Made Easy
Spirent TrafficCenter - Network Testing Made EasySpirent TrafficCenter - Network Testing Made Easy
Spirent TrafficCenter - Network Testing Made Easy
 
Webmetrics Graphical Overview
Webmetrics Graphical OverviewWebmetrics Graphical Overview
Webmetrics Graphical Overview
 
FLIGHT WEST 2018 Presentation - Open Source License Management in Black Duck Hub
FLIGHT WEST 2018 Presentation - Open Source License Management in Black Duck HubFLIGHT WEST 2018 Presentation - Open Source License Management in Black Duck Hub
FLIGHT WEST 2018 Presentation - Open Source License Management in Black Duck Hub
 
25 Jul 2018 - What is New in codeBeamer 9.2
25 Jul 2018 - What is New in codeBeamer 9.2 25 Jul 2018 - What is New in codeBeamer 9.2
25 Jul 2018 - What is New in codeBeamer 9.2
 

Andere mochten auch

Extent april2012-kostroma social-networks-socialmedia-trading
Extent april2012-kostroma social-networks-socialmedia-tradingExtent april2012-kostroma social-networks-socialmedia-trading
Extent april2012-kostroma social-networks-socialmedia-tradingextentconf Tsoy
 
Extent3 exante broker_for_algorithmic_trading_2012
Extent3 exante broker_for_algorithmic_trading_2012Extent3 exante broker_for_algorithmic_trading_2012
Extent3 exante broker_for_algorithmic_trading_2012extentconf Tsoy
 
Exactpro Test Tools EXTENT Feb 2011
Exactpro Test Tools EXTENT Feb 2011Exactpro Test Tools EXTENT Feb 2011
Exactpro Test Tools EXTENT Feb 2011Iosif Itkin
 
Liquidity Fragmentation & SOR
Liquidity Fragmentation & SORLiquidity Fragmentation & SOR
Liquidity Fragmentation & SORIosif Itkin
 
Extent 2013 Obninsk High Performance Messaging
Extent 2013 Obninsk High Performance MessagingExtent 2013 Obninsk High Performance Messaging
Extent 2013 Obninsk High Performance Messagingextentconf Tsoy
 
Extent 2013 Obninsk LSE - The Focus Beyond Low Latency
Extent 2013 Obninsk  LSE - The Focus Beyond Low LatencyExtent 2013 Obninsk  LSE - The Focus Beyond Low Latency
Extent 2013 Obninsk LSE - The Focus Beyond Low Latencyextentconf Tsoy
 
Extent 2013 Obninsk Test Tools for Trading Systems: Evolution Theory
Extent 2013 Obninsk Test Tools for Trading Systems: Evolution TheoryExtent 2013 Obninsk Test Tools for Trading Systems: Evolution Theory
Extent 2013 Obninsk Test Tools for Trading Systems: Evolution Theoryextentconf Tsoy
 
Extent 2013 Obninsk Managing Uncertain Data at Scale
Extent 2013 Obninsk Managing Uncertain Data at ScaleExtent 2013 Obninsk Managing Uncertain Data at Scale
Extent 2013 Obninsk Managing Uncertain Data at Scaleextentconf Tsoy
 
Extent 2013 Obninsk New Trading System: Architecture and Capabilities
Extent 2013 Obninsk New Trading System: Architecture and CapabilitiesExtent 2013 Obninsk New Trading System: Architecture and Capabilities
Extent 2013 Obninsk New Trading System: Architecture and Capabilitiesextentconf Tsoy
 
EXTENT-2015: Hyper-Fast Trading
EXTENT-2015: Hyper-Fast TradingEXTENT-2015: Hyper-Fast Trading
EXTENT-2015: Hyper-Fast TradingIosif Itkin
 
EXTENT-2016: Testing the Architecture
EXTENT-2016: Testing the ArchitectureEXTENT-2016: Testing the Architecture
EXTENT-2016: Testing the ArchitectureIosif Itkin
 
EXTENT-2015: Big Button 2.0
EXTENT-2015: Big Button 2.0EXTENT-2015: Big Button 2.0
EXTENT-2015: Big Button 2.0Iosif Itkin
 
EXTENT-2015: UnaVista Technology 
EXTENT-2015: UnaVista Technology EXTENT-2015: UnaVista Technology 
EXTENT-2015: UnaVista Technology Iosif Itkin
 
EXTENT-2015: A Test Harness for Algo Trading Systems
EXTENT-2015: A Test Harness for Algo Trading Systems EXTENT-2015: A Test Harness for Algo Trading Systems
EXTENT-2015: A Test Harness for Algo Trading Systems Iosif Itkin
 
EXTENT-2015: Blockchain New Frontiers
EXTENT-2015: Blockchain New FrontiersEXTENT-2015: Blockchain New Frontiers
EXTENT-2015: Blockchain New FrontiersIosif Itkin
 
EXTENT-2015 Tradecope Presentation
EXTENT-2015 Tradecope PresentationEXTENT-2015 Tradecope Presentation
EXTENT-2015 Tradecope PresentationIosif Itkin
 

Andere mochten auch (16)

Extent april2012-kostroma social-networks-socialmedia-trading
Extent april2012-kostroma social-networks-socialmedia-tradingExtent april2012-kostroma social-networks-socialmedia-trading
Extent april2012-kostroma social-networks-socialmedia-trading
 
Extent3 exante broker_for_algorithmic_trading_2012
Extent3 exante broker_for_algorithmic_trading_2012Extent3 exante broker_for_algorithmic_trading_2012
Extent3 exante broker_for_algorithmic_trading_2012
 
Exactpro Test Tools EXTENT Feb 2011
Exactpro Test Tools EXTENT Feb 2011Exactpro Test Tools EXTENT Feb 2011
Exactpro Test Tools EXTENT Feb 2011
 
Liquidity Fragmentation & SOR
Liquidity Fragmentation & SORLiquidity Fragmentation & SOR
Liquidity Fragmentation & SOR
 
Extent 2013 Obninsk High Performance Messaging
Extent 2013 Obninsk High Performance MessagingExtent 2013 Obninsk High Performance Messaging
Extent 2013 Obninsk High Performance Messaging
 
Extent 2013 Obninsk LSE - The Focus Beyond Low Latency
Extent 2013 Obninsk  LSE - The Focus Beyond Low LatencyExtent 2013 Obninsk  LSE - The Focus Beyond Low Latency
Extent 2013 Obninsk LSE - The Focus Beyond Low Latency
 
Extent 2013 Obninsk Test Tools for Trading Systems: Evolution Theory
Extent 2013 Obninsk Test Tools for Trading Systems: Evolution TheoryExtent 2013 Obninsk Test Tools for Trading Systems: Evolution Theory
Extent 2013 Obninsk Test Tools for Trading Systems: Evolution Theory
 
Extent 2013 Obninsk Managing Uncertain Data at Scale
Extent 2013 Obninsk Managing Uncertain Data at ScaleExtent 2013 Obninsk Managing Uncertain Data at Scale
Extent 2013 Obninsk Managing Uncertain Data at Scale
 
Extent 2013 Obninsk New Trading System: Architecture and Capabilities
Extent 2013 Obninsk New Trading System: Architecture and CapabilitiesExtent 2013 Obninsk New Trading System: Architecture and Capabilities
Extent 2013 Obninsk New Trading System: Architecture and Capabilities
 
EXTENT-2015: Hyper-Fast Trading
EXTENT-2015: Hyper-Fast TradingEXTENT-2015: Hyper-Fast Trading
EXTENT-2015: Hyper-Fast Trading
 
EXTENT-2016: Testing the Architecture
EXTENT-2016: Testing the ArchitectureEXTENT-2016: Testing the Architecture
EXTENT-2016: Testing the Architecture
 
EXTENT-2015: Big Button 2.0
EXTENT-2015: Big Button 2.0EXTENT-2015: Big Button 2.0
EXTENT-2015: Big Button 2.0
 
EXTENT-2015: UnaVista Technology 
EXTENT-2015: UnaVista Technology EXTENT-2015: UnaVista Technology 
EXTENT-2015: UnaVista Technology 
 
EXTENT-2015: A Test Harness for Algo Trading Systems
EXTENT-2015: A Test Harness for Algo Trading Systems EXTENT-2015: A Test Harness for Algo Trading Systems
EXTENT-2015: A Test Harness for Algo Trading Systems
 
EXTENT-2015: Blockchain New Frontiers
EXTENT-2015: Blockchain New FrontiersEXTENT-2015: Blockchain New Frontiers
EXTENT-2015: Blockchain New Frontiers
 
EXTENT-2015 Tradecope Presentation
EXTENT-2015 Tradecope PresentationEXTENT-2015 Tradecope Presentation
EXTENT-2015 Tradecope Presentation
 

Ähnlich wie Next Step Reconciliation Testing Automation

6 Steps to Implementing a World Class Testing Ecosystem Final
6 Steps to Implementing a World Class Testing Ecosystem Final6 Steps to Implementing a World Class Testing Ecosystem Final
6 Steps to Implementing a World Class Testing Ecosystem FinalEggplant
 
The art of system and solution testing
The art of system and solution testingThe art of system and solution testing
The art of system and solution testinggaoliang641
 
6 Top Tips to a Testing Strategy That Works
6 Top Tips to a Testing Strategy That Works6 Top Tips to a Testing Strategy That Works
6 Top Tips to a Testing Strategy That WorksEggplant
 
Manual Testing Types Used in Software Testing
Manual Testing Types Used in Software TestingManual Testing Types Used in Software Testing
Manual Testing Types Used in Software Testingseojayeshts
 
Quality Inspection In General
Quality Inspection In GeneralQuality Inspection In General
Quality Inspection In Generalrheedhoo
 
DBmaestro's State of the Database Continuous Delivery Survey- Findings Revealed
DBmaestro's State of the Database Continuous Delivery Survey- Findings RevealedDBmaestro's State of the Database Continuous Delivery Survey- Findings Revealed
DBmaestro's State of the Database Continuous Delivery Survey- Findings RevealedDBmaestro - Database DevOps
 
Reconciliation Testing Aspects of Trading Systems Software Failures
Reconciliation Testing Aspects of Trading Systems Software FailuresReconciliation Testing Aspects of Trading Systems Software Failures
Reconciliation Testing Aspects of Trading Systems Software FailuresAnna-Maria Kriger
 
TEST_AUTOMATION_CASE_STUDY_(2)2[1]
TEST_AUTOMATION_CASE_STUDY_(2)2[1]TEST_AUTOMATION_CASE_STUDY_(2)2[1]
TEST_AUTOMATION_CASE_STUDY_(2)2[1]Clive Dall
 
<p>Software Testing</p>
<p>Software Testing</p><p>Software Testing</p>
<p>Software Testing</p>Atul Mishra
 
An overview to Software Testing
An overview to Software TestingAn overview to Software Testing
An overview to Software TestingAtul Mishra
 
An Automation Framework That Really Works
An Automation Framework That Really WorksAn Automation Framework That Really Works
An Automation Framework That Really WorksBasivi Reddy Junna
 
Seminar on Software Testing
Seminar on Software TestingSeminar on Software Testing
Seminar on Software TestingMD ISLAM
 
SOC Verification using SystemVerilog
SOC Verification using SystemVerilog SOC Verification using SystemVerilog
SOC Verification using SystemVerilog Ramdas Mozhikunnath
 
Elements of a Test Framework
Elements of a Test FrameworkElements of a Test Framework
Elements of a Test FrameworkSmartBear
 
Tools. Techniques. Trouble?
Tools. Techniques. Trouble?Tools. Techniques. Trouble?
Tools. Techniques. Trouble?Testplant
 
Avoiding test hell
Avoiding test hellAvoiding test hell
Avoiding test hellYun Ki Lee
 
Patterns of Distributed Application Design
Patterns of Distributed Application DesignPatterns of Distributed Application Design
Patterns of Distributed Application DesignGlobalLogic Ukraine
 

Ähnlich wie Next Step Reconciliation Testing Automation (20)

6 Steps to Implementing a World Class Testing Ecosystem Final
6 Steps to Implementing a World Class Testing Ecosystem Final6 Steps to Implementing a World Class Testing Ecosystem Final
6 Steps to Implementing a World Class Testing Ecosystem Final
 
The art of system and solution testing
The art of system and solution testingThe art of system and solution testing
The art of system and solution testing
 
6 Top Tips to a Testing Strategy That Works
6 Top Tips to a Testing Strategy That Works6 Top Tips to a Testing Strategy That Works
6 Top Tips to a Testing Strategy That Works
 
Manual Testing Types Used in Software Testing
Manual Testing Types Used in Software TestingManual Testing Types Used in Software Testing
Manual Testing Types Used in Software Testing
 
Quality Inspection In General
Quality Inspection In GeneralQuality Inspection In General
Quality Inspection In General
 
DBmaestro's State of the Database Continuous Delivery Survey- Findings Revealed
DBmaestro's State of the Database Continuous Delivery Survey- Findings RevealedDBmaestro's State of the Database Continuous Delivery Survey- Findings Revealed
DBmaestro's State of the Database Continuous Delivery Survey- Findings Revealed
 
Reconciliation Testing Aspects of Trading Systems Software Failures
Reconciliation Testing Aspects of Trading Systems Software FailuresReconciliation Testing Aspects of Trading Systems Software Failures
Reconciliation Testing Aspects of Trading Systems Software Failures
 
TEST_AUTOMATION_CASE_STUDY_(2)2[1]
TEST_AUTOMATION_CASE_STUDY_(2)2[1]TEST_AUTOMATION_CASE_STUDY_(2)2[1]
TEST_AUTOMATION_CASE_STUDY_(2)2[1]
 
<p>Software Testing</p>
<p>Software Testing</p><p>Software Testing</p>
<p>Software Testing</p>
 
An overview to Software Testing
An overview to Software TestingAn overview to Software Testing
An overview to Software Testing
 
Neev QA Offering
Neev QA OfferingNeev QA Offering
Neev QA Offering
 
An Automation Framework That Really Works
An Automation Framework That Really WorksAn Automation Framework That Really Works
An Automation Framework That Really Works
 
Seminar on Software Testing
Seminar on Software TestingSeminar on Software Testing
Seminar on Software Testing
 
SOC Verification using SystemVerilog
SOC Verification using SystemVerilog SOC Verification using SystemVerilog
SOC Verification using SystemVerilog
 
Elements of a Test Framework
Elements of a Test FrameworkElements of a Test Framework
Elements of a Test Framework
 
Tools. Techniques. Trouble?
Tools. Techniques. Trouble?Tools. Techniques. Trouble?
Tools. Techniques. Trouble?
 
XRAY for Jira
XRAY for JiraXRAY for Jira
XRAY for Jira
 
Avoiding test hell
Avoiding test hellAvoiding test hell
Avoiding test hell
 
Patterns of Distributed Application Design
Patterns of Distributed Application DesignPatterns of Distributed Application Design
Patterns of Distributed Application Design
 
Software Testing
Software Testing Software Testing
Software Testing
 

Mehr von extentconf Tsoy

Extent 2013 Obninsk How a Great QA Team Can Make a Disproportionate Contribut...
Extent 2013 Obninsk How a Great QA Team Can Make a Disproportionate Contribut...Extent 2013 Obninsk How a Great QA Team Can Make a Disproportionate Contribut...
Extent 2013 Obninsk How a Great QA Team Can Make a Disproportionate Contribut...extentconf Tsoy
 
Extent 2013 Obninsk Cross-Asset Portfolio Margin Risk Calculation for HFT
Extent 2013 Obninsk Cross-Asset Portfolio Margin Risk Calculation for HFTExtent 2013 Obninsk Cross-Asset Portfolio Margin Risk Calculation for HFT
Extent 2013 Obninsk Cross-Asset Portfolio Margin Risk Calculation for HFTextentconf Tsoy
 
Extent3 exactpro testing_of_hft_gui
Extent3 exactpro testing_of_hft_guiExtent3 exactpro testing_of_hft_gui
Extent3 exactpro testing_of_hft_guiextentconf Tsoy
 
Extent3 turquoise equity_trading_2012
Extent3 turquoise equity_trading_2012Extent3 turquoise equity_trading_2012
Extent3 turquoise equity_trading_2012extentconf Tsoy
 
Extent3 witology prediction_markets_2012
Extent3 witology prediction_markets_2012Extent3 witology prediction_markets_2012
Extent3 witology prediction_markets_2012extentconf Tsoy
 
Extent3 prognoz practical_approach_lppl_model_2012
Extent3 prognoz practical_approach_lppl_model_2012Extent3 prognoz practical_approach_lppl_model_2012
Extent3 prognoz practical_approach_lppl_model_2012extentconf Tsoy
 
Verification of Financial Models
Verification of Financial ModelsVerification of Financial Models
Verification of Financial Modelsextentconf Tsoy
 
The Simple Matter of Project Management
The Simple Matter of Project ManagementThe Simple Matter of Project Management
The Simple Matter of Project Managementextentconf Tsoy
 
Exchange Simulators for SOR / Algo Testing: Advantages vs. Shortcomings
Exchange Simulators for SOR / Algo Testing: Advantages vs. ShortcomingsExchange Simulators for SOR / Algo Testing: Advantages vs. Shortcomings
Exchange Simulators for SOR / Algo Testing: Advantages vs. Shortcomingsextentconf Tsoy
 
Behavior Driven Development Pros and Cons
Behavior Driven Development Pros and ConsBehavior Driven Development Pros and Cons
Behavior Driven Development Pros and Consextentconf Tsoy
 
Virtualization Technology for Test Automation
Virtualization Technology for Test AutomationVirtualization Technology for Test Automation
Virtualization Technology for Test Automationextentconf Tsoy
 
Cost of Quality How to Save Money
Cost of Quality How to Save MoneyCost of Quality How to Save Money
Cost of Quality How to Save Moneyextentconf Tsoy
 
Exactpro Test Tools EXTENT Feb 2011
Exactpro Test Tools EXTENT Feb 2011Exactpro Test Tools EXTENT Feb 2011
Exactpro Test Tools EXTENT Feb 2011extentconf Tsoy
 
Technical Testing Introduction
Technical Testing IntroductionTechnical Testing Introduction
Technical Testing Introductionextentconf Tsoy
 
Financial Instruments EXTENT February 2011
Financial Instruments EXTENT February 2011Financial Instruments EXTENT February 2011
Financial Instruments EXTENT February 2011extentconf Tsoy
 
Liquidity Fragmentation & SOR
Liquidity Fragmentation & SORLiquidity Fragmentation & SOR
Liquidity Fragmentation & SORextentconf Tsoy
 

Mehr von extentconf Tsoy (16)

Extent 2013 Obninsk How a Great QA Team Can Make a Disproportionate Contribut...
Extent 2013 Obninsk How a Great QA Team Can Make a Disproportionate Contribut...Extent 2013 Obninsk How a Great QA Team Can Make a Disproportionate Contribut...
Extent 2013 Obninsk How a Great QA Team Can Make a Disproportionate Contribut...
 
Extent 2013 Obninsk Cross-Asset Portfolio Margin Risk Calculation for HFT
Extent 2013 Obninsk Cross-Asset Portfolio Margin Risk Calculation for HFTExtent 2013 Obninsk Cross-Asset Portfolio Margin Risk Calculation for HFT
Extent 2013 Obninsk Cross-Asset Portfolio Margin Risk Calculation for HFT
 
Extent3 exactpro testing_of_hft_gui
Extent3 exactpro testing_of_hft_guiExtent3 exactpro testing_of_hft_gui
Extent3 exactpro testing_of_hft_gui
 
Extent3 turquoise equity_trading_2012
Extent3 turquoise equity_trading_2012Extent3 turquoise equity_trading_2012
Extent3 turquoise equity_trading_2012
 
Extent3 witology prediction_markets_2012
Extent3 witology prediction_markets_2012Extent3 witology prediction_markets_2012
Extent3 witology prediction_markets_2012
 
Extent3 prognoz practical_approach_lppl_model_2012
Extent3 prognoz practical_approach_lppl_model_2012Extent3 prognoz practical_approach_lppl_model_2012
Extent3 prognoz practical_approach_lppl_model_2012
 
Verification of Financial Models
Verification of Financial ModelsVerification of Financial Models
Verification of Financial Models
 
The Simple Matter of Project Management
The Simple Matter of Project ManagementThe Simple Matter of Project Management
The Simple Matter of Project Management
 
Exchange Simulators for SOR / Algo Testing: Advantages vs. Shortcomings
Exchange Simulators for SOR / Algo Testing: Advantages vs. ShortcomingsExchange Simulators for SOR / Algo Testing: Advantages vs. Shortcomings
Exchange Simulators for SOR / Algo Testing: Advantages vs. Shortcomings
 
Behavior Driven Development Pros and Cons
Behavior Driven Development Pros and ConsBehavior Driven Development Pros and Cons
Behavior Driven Development Pros and Cons
 
Virtualization Technology for Test Automation
Virtualization Technology for Test AutomationVirtualization Technology for Test Automation
Virtualization Technology for Test Automation
 
Cost of Quality How to Save Money
Cost of Quality How to Save MoneyCost of Quality How to Save Money
Cost of Quality How to Save Money
 
Exactpro Test Tools EXTENT Feb 2011
Exactpro Test Tools EXTENT Feb 2011Exactpro Test Tools EXTENT Feb 2011
Exactpro Test Tools EXTENT Feb 2011
 
Technical Testing Introduction
Technical Testing IntroductionTechnical Testing Introduction
Technical Testing Introduction
 
Financial Instruments EXTENT February 2011
Financial Instruments EXTENT February 2011Financial Instruments EXTENT February 2011
Financial Instruments EXTENT February 2011
 
Liquidity Fragmentation & SOR
Liquidity Fragmentation & SORLiquidity Fragmentation & SOR
Liquidity Fragmentation & SOR
 

Kürzlich hochgeladen

Merck Moving Beyond Passwords: FIDO Paris Seminar.pptx
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptxMerck Moving Beyond Passwords: FIDO Paris Seminar.pptx
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptxLoriGlavin3
 
Dev Dives: Streamline document processing with UiPath Studio Web
Dev Dives: Streamline document processing with UiPath Studio WebDev Dives: Streamline document processing with UiPath Studio Web
Dev Dives: Streamline document processing with UiPath Studio WebUiPathCommunity
 
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024BookNet Canada
 
Developer Data Modeling Mistakes: From Postgres to NoSQL
Developer Data Modeling Mistakes: From Postgres to NoSQLDeveloper Data Modeling Mistakes: From Postgres to NoSQL
Developer Data Modeling Mistakes: From Postgres to NoSQLScyllaDB
 
How AI, OpenAI, and ChatGPT impact business and software.
How AI, OpenAI, and ChatGPT impact business and software.How AI, OpenAI, and ChatGPT impact business and software.
How AI, OpenAI, and ChatGPT impact business and software.Curtis Poe
 
Ensuring Technical Readiness For Copilot in Microsoft 365
Ensuring Technical Readiness For Copilot in Microsoft 365Ensuring Technical Readiness For Copilot in Microsoft 365
Ensuring Technical Readiness For Copilot in Microsoft 3652toLead Limited
 
The State of Passkeys with FIDO Alliance.pptx
The State of Passkeys with FIDO Alliance.pptxThe State of Passkeys with FIDO Alliance.pptx
The State of Passkeys with FIDO Alliance.pptxLoriGlavin3
 
"ML in Production",Oleksandr Bagan
"ML in Production",Oleksandr Bagan"ML in Production",Oleksandr Bagan
"ML in Production",Oleksandr BaganFwdays
 
Scanning the Internet for External Cloud Exposures via SSL Certs
Scanning the Internet for External Cloud Exposures via SSL CertsScanning the Internet for External Cloud Exposures via SSL Certs
Scanning the Internet for External Cloud Exposures via SSL CertsRizwan Syed
 
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptx
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptxThe Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptx
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptxLoriGlavin3
 
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024BookNet Canada
 
Gen AI in Business - Global Trends Report 2024.pdf
Gen AI in Business - Global Trends Report 2024.pdfGen AI in Business - Global Trends Report 2024.pdf
Gen AI in Business - Global Trends Report 2024.pdfAddepto
 
"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii Soldatenko"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii SoldatenkoFwdays
 
What's New in Teams Calling, Meetings and Devices March 2024
What's New in Teams Calling, Meetings and Devices March 2024What's New in Teams Calling, Meetings and Devices March 2024
What's New in Teams Calling, Meetings and Devices March 2024Stephanie Beckett
 
unit 4 immunoblotting technique complete.pptx
unit 4 immunoblotting technique complete.pptxunit 4 immunoblotting technique complete.pptx
unit 4 immunoblotting technique complete.pptxBkGupta21
 
The Ultimate Guide to Choosing WordPress Pros and Cons
The Ultimate Guide to Choosing WordPress Pros and ConsThe Ultimate Guide to Choosing WordPress Pros and Cons
The Ultimate Guide to Choosing WordPress Pros and ConsPixlogix Infotech
 
The Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptx
The Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptxThe Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptx
The Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptxLoriGlavin3
 
Unraveling Multimodality with Large Language Models.pdf
Unraveling Multimodality with Large Language Models.pdfUnraveling Multimodality with Large Language Models.pdf
Unraveling Multimodality with Large Language Models.pdfAlex Barbosa Coqueiro
 
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)Mark Simos
 
Moving Beyond Passwords: FIDO Paris Seminar.pdf
Moving Beyond Passwords: FIDO Paris Seminar.pdfMoving Beyond Passwords: FIDO Paris Seminar.pdf
Moving Beyond Passwords: FIDO Paris Seminar.pdfLoriGlavin3
 

Kürzlich hochgeladen (20)

Merck Moving Beyond Passwords: FIDO Paris Seminar.pptx
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptxMerck Moving Beyond Passwords: FIDO Paris Seminar.pptx
Merck Moving Beyond Passwords: FIDO Paris Seminar.pptx
 
Dev Dives: Streamline document processing with UiPath Studio Web
Dev Dives: Streamline document processing with UiPath Studio WebDev Dives: Streamline document processing with UiPath Studio Web
Dev Dives: Streamline document processing with UiPath Studio Web
 
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
 
Developer Data Modeling Mistakes: From Postgres to NoSQL
Developer Data Modeling Mistakes: From Postgres to NoSQLDeveloper Data Modeling Mistakes: From Postgres to NoSQL
Developer Data Modeling Mistakes: From Postgres to NoSQL
 
How AI, OpenAI, and ChatGPT impact business and software.
How AI, OpenAI, and ChatGPT impact business and software.How AI, OpenAI, and ChatGPT impact business and software.
How AI, OpenAI, and ChatGPT impact business and software.
 
Ensuring Technical Readiness For Copilot in Microsoft 365
Ensuring Technical Readiness For Copilot in Microsoft 365Ensuring Technical Readiness For Copilot in Microsoft 365
Ensuring Technical Readiness For Copilot in Microsoft 365
 
The State of Passkeys with FIDO Alliance.pptx
The State of Passkeys with FIDO Alliance.pptxThe State of Passkeys with FIDO Alliance.pptx
The State of Passkeys with FIDO Alliance.pptx
 
"ML in Production",Oleksandr Bagan
"ML in Production",Oleksandr Bagan"ML in Production",Oleksandr Bagan
"ML in Production",Oleksandr Bagan
 
Scanning the Internet for External Cloud Exposures via SSL Certs
Scanning the Internet for External Cloud Exposures via SSL CertsScanning the Internet for External Cloud Exposures via SSL Certs
Scanning the Internet for External Cloud Exposures via SSL Certs
 
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptx
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptxThe Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptx
The Role of FIDO in a Cyber Secure Netherlands: FIDO Paris Seminar.pptx
 
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
New from BookNet Canada for 2024: Loan Stars - Tech Forum 2024
 
Gen AI in Business - Global Trends Report 2024.pdf
Gen AI in Business - Global Trends Report 2024.pdfGen AI in Business - Global Trends Report 2024.pdf
Gen AI in Business - Global Trends Report 2024.pdf
 
"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii Soldatenko"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii Soldatenko
 
What's New in Teams Calling, Meetings and Devices March 2024
What's New in Teams Calling, Meetings and Devices March 2024What's New in Teams Calling, Meetings and Devices March 2024
What's New in Teams Calling, Meetings and Devices March 2024
 
unit 4 immunoblotting technique complete.pptx
unit 4 immunoblotting technique complete.pptxunit 4 immunoblotting technique complete.pptx
unit 4 immunoblotting technique complete.pptx
 
The Ultimate Guide to Choosing WordPress Pros and Cons
The Ultimate Guide to Choosing WordPress Pros and ConsThe Ultimate Guide to Choosing WordPress Pros and Cons
The Ultimate Guide to Choosing WordPress Pros and Cons
 
The Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptx
The Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptxThe Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptx
The Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptx
 
Unraveling Multimodality with Large Language Models.pdf
Unraveling Multimodality with Large Language Models.pdfUnraveling Multimodality with Large Language Models.pdf
Unraveling Multimodality with Large Language Models.pdf
 
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
Tampa BSides - Chef's Tour of Microsoft Security Adoption Framework (SAF)
 
Moving Beyond Passwords: FIDO Paris Seminar.pdf
Moving Beyond Passwords: FIDO Paris Seminar.pdfMoving Beyond Passwords: FIDO Paris Seminar.pdf
Moving Beyond Passwords: FIDO Paris Seminar.pdf
 

Next Step Reconciliation Testing Automation

  • 1. The Next Step in Reconciliation Testing Natalia Zaitseva, Automation Lead for Borsa Italiana, ITS-Expert Natalia Popovchuk, Development Lead, ITS-Expert
  • 2. What is Reconciliation testing? Reconciliation is a process of finding discrepancies in data obtained from different sources
  • 3. Where is reconciliation needed? Trading System •Drop Copy •Market data •Back Office • Smart Order Router
  • 4. • •Complexity ofof reconciliation Complexity reconciliation 2. More complex 2. More complex 3. Complex 3. Complex 1 : n relationship 1 : n relationship n : n relationship n : n relationship
  • 5. Benefits of Automated reconciliation •Fast analysis •Automated matching process •Report generation •Increases productivity
  • 6. Requirements to a reconciliation tool •Capacity / Scalability •Fast Matching Engine •Flexibility •User friendly interface
  • 8. Requirements for conformance testing •No limitations on the incoming feed •High performance •Monitoring in real-time •Reporting
  • 9. Further improvements 1. Enriching the functionality 2. Conversion from passive listener to active mode
  • 10. System under test
  • 11. Testing options 1 Involve clients in system testing 2 Manually check each client connection separately 3 Automated testing
  • 12. Automated testing solution
  • 13. Automated testing steps Step 2 Step 3 Aggregate Data Create Test Scenarios Step 1 Step 4 Process Execute Test Scenarios Logs Step 5. Reconcile Test Output
  • 14. Reconciliation Levels • Detailed comparison. On this level, each test message will be compared with the expected result (production message) field by field and every distinction will be reported. Sample of Executions comparison: • High-level analysis. Detailed results will be processed, and the summary of issues and recommendations on Adapters adjustments will be provided as a result. Sample of tag combination analysis:

Hinweis der Redaktion

  1. Today we will talk about the reconciliation testing approach. We think that it can be extremely useful in testing complex integrated trading systems. This approach can be applied at different test levels, and what is also important, the reconciliation tool can afterwards be re-used for carrying out the other activities, such as conformance testing. Reconciliation is a process to determine the differences in data obtained from the different sources. So the Reconciliation testing is the test approach applied when it is necessary to compare the output of different systems or system components. The level of required reconciliation may be different, from simple, which can be done using simple sql scripts, to quite complex, that requires the tool with built-in business rules. Therefore, we have decided to formalize this activity and now we include the reconciliation test approach to our test plans. We are also actively working on the development of appropriate test tools.
  2. 4. Automated reconciliation process: Exactpro Reconciliation tool The reconciliation process requires automation, as it obviously has the number of advantages over the manual reconciliation: Fast analysis of large amount of data Automated matching process based on the pre-defined business rules Automatic report generation highlighting mismatches Reduces the possibility of human errors, considerably saves efforts and increases productivity
  3. The reconciliation tool should meet the following requirements: Scalability Ability to process many transactions at a time Adaptability ( или Flexibility ) User friendly interface
  4. The reconciliation tool should meet the following requirements: Scalability Ability to process many transactions at a time Adaptability ( или Flexibility ) User friendly interface
  5. One of the valuable characteristic of reconciliation testing and the reconciliation tool is that there are no limitations on the incoming data, as it is a post-transactional analysis. We can use any data for analysis rather then strictly defined by the scenarios. It allows us to use the tool for conformance testing, i.e. for analyzing the data entered by customers. Exactpro tool has also the possibility to upload the data in real-time mode and can handle the average production load of the Trading System with no impact on performance. Rich GUI and high performance of the tool makes it to be convenient tool for monitoring and reporting. In 2010 this tool was successfully used for the conformance testing for the migration project of the Trading system with several hundred clients and 6 protocols supported by the system. So I have said about the current state of the game, and now I will give the floor to my colleague to say about some other achievements in development.
  6. One of the valuable characteristic of reconciliation testing and the reconciliation tool is that there are no limitations on the incoming data, as it is a post-transactional analysis. We can use any data for analysis rather then strictly defined by the scenarios. It allows us to use the tool for conformance testing, i.e. for analyzing the data entered by customers. Exactpro tool has also the possibility to upload the data in real-time mode and can handle the average production load of the Trading System with no impact on performance. Rich GUI and high performance of the tool makes it to be convenient tool for monitoring and reporting. In 2010 this tool was successfully used for the conformance testing for the migration project of the Trading system with several hundred clients and 6 protocols supported by the system. So I have said about the current state of the game, and now I will give the floor to my colleague to say about some other achievements in development.
  7. тут тоже добавлю еще, хотя...а может быть не стоит? когда этот слайд на экране будет, я так понимаю, будет о чем-то рассказ, а о чем?