EXTENT-2016: Network Instrumentation Challenges and Solutions
•Als PPTX, PDF herunterladen•
1 gefällt mir•1,420 views
EXTENT-2016: Software Testing & Trading Technology Trends 22 June, 2016, 10 Paternoster Square, London Network Instrumentation Challenges and Solutions Claude Robitaille, CTO, Accedian Networks Would like to know more? Visit our website: extentconf.com Follow us: https://www.linkedin.com/company/exactpro-systems-llc?trk=biz-companies-cym https://twitter.com/exactpro #extent2016 #exactpro
Empfohlen
Empfohlen
Weitere ähnliche Inhalte
Was ist angesagt?
Was ist angesagt? (20)
Andere mochten auch
Andere mochten auch (9)
Ähnlich wie EXTENT-2016: Network Instrumentation Challenges and Solutions
Ähnlich wie EXTENT-2016: Network Instrumentation Challenges and Solutions (20)
Mehr von Iosif Itkin
Mehr von Iosif Itkin (20)
Kürzlich hochgeladen
Kürzlich hochgeladen (20)
EXTENT-2016: Network Instrumentation Challenges and Solutions
- 1. Claude Robitaille CTO Accedian Networks Network instrumentation challenges & solutions
- 2. NETWORK INSTRUMENTATION CHALLENGES & SOLUTIONS Core-to-edge visibility for demanding trade flow, compliance and extranet monitoring 2016-06-22Claude Robitaille CTO
- 3. 3 ©2015 ACCEDIAN NETWORKS Company Confidential “For performance, compliance, analytics” INCREASING NEED FOR VISIBILITY The Finance sector is increasingly adopting outsourced services. As a result the Regulatory and Service expectations are driving: • Increasing levels of transparency • Costs • Service levels • Performance This drives the need for greater visibility, analysis, and auditability of data: • Granular, precise Extranet performance assurance for an exceptionally fast, reliable, global infrastructure • Ubiquitous flow capture and time-stamping, for compliance and trade flow analytics analyze and optimize and account for every transaction All this is driving a new breed of instrumentation and analytic capabilities.
- 4. 4 ©2015 ACCEDIAN NETWORKS Company Confidential NETWORK LAYER INSTRUMENTATION Graph source, Cisco BQM-PNQM, 2014 CPE PE Flow Metering PM Multi-Flow • FlowMETER™: detect 10ms microbursts • Report min, max, average every second • 1-way utilization, packet loss, availability; latency, delay variation with µs precision Performance & SLA Monitoring • FlowBROKER™: µs precise time-stamping for every packet of interest • Efficient, assured delivery to analyzers • Granular flow filtering and slicing • NetFLOW / IPFix flow sttats Packet Capture for Compliance Logging Micro-Bursting CPE → PE Reported Throughput 6 s 12 18 500 ms 5 minute 10 ms 100 Sampling RateService Bandwidth Kbps 0 Monitor & Detect Flow Brokering Remote Packet Capture Trade Flow Analysis & Compliance Reporting Platforms Performance Assurance Orchestration MiFID II Dodd-Frank Capture & Broker “Network Layer Time- Stamped Packet Capture: A Unique Approach to Trade Reporting Compliance.” An elegant approach to time-sensitive flow monitoring, capture, reporting & analytics
- 5. 5 ©2015 ACCEDIAN NETWORKS Company Confidential INSTRUMENTATION FOUNDATION: DUAL-PLANE FPGA ARCHITECTURE A high-performance Packet Processor super- imposed with a sophisticated Layer 2/3/4 Test Engine, tightly interconnected in a single chip. •Allows Test Engine to surgically inject test sequences into live traffic without disruption. •Allows Packet Processor to filtering, capture, and timestamp without disruption •Measures traffic, utilization and performance accurately and transparently – non-intrusive. Provides unparalleled ability to test from within the network. Use in or out of line — introduces near-zero latency Packet Processor Layer 2/3/4 T&M
- 6. 6 ©2015 ACCEDIAN NETWORKS Company Confidential MICROBURST DETECTION Assuring trading integrity & performance
- 7. 7 ©2015 ACCEDIAN NETWORKS Company Confidential “You can’t control what you can’t see.” ASSURING EXECUTION SPEED 1. Low- Latency • High Frequency Trading (HFT) trading is ultra-competitive. Architectures that deliver the lowest latency solution are the difference between profit and loss. 2. Accurate Measurements in Sub-Second Timescales • Traditional network measurements take place over timescales of seconds and minutes: providing little or no insight into behavior at the ms, µs and ns timescales that determine success 3. Throughput Micro-Burst Reporting • Activity on the network occurs in bursts, which cause queues to build up and buffers to overflow. Visibility into these short-lived conditions is central to understanding network performance.
- 8. 8 ©2015 ACCEDIAN NETWORKS Company Confidential 5SEC Measure Every 1SEC Loss Measure Every 0.1SEC max avg min Measure Every 15SEC Link Capacity Utilization Measure Every A NEW LEVEL OF INSIGHT ● SAMPLING SPEED “Effects of Sampling Frequency • Same Data Set” No Problem Big Problem Small Problem No Problem Increasing Sampling Speed & Adding Statistical Perspectives Changes Everything
- 9. 9 ©2015 ACCEDIAN NETWORKS Company Confidential EXTRANET PM USE CASE ● DEPLOYMENT ARCHITECTURE Core Network PE Router Aggregation Router Carrier Network FS Provider Managed Last Mile Network FS FS CPE Router Traders LAN Core Network Customer or Carrier Network Customer’s Manager Last Mile Network FS FS CPE Router Traders LANCustomer Switch Customer Switch
- 10. 10 ©2015 ACCEDIAN NETWORKS Company Confidential DISTRIBUTED PACKET CAPTURE For compliance and trade flow analysis
- 11. 11 ©2015 ACCEDIAN NETWORKS Company Confidential A CASE FOR NETWORK-LAYER INSTRUMENTATION: MIFID II TIMESTAMPING / AUDIT Synchronise the clocks across every software application (requiring a costly upgrade to every system in the bank) and store data from EVERY individual flow into a single repository? OR source the data from a single source, the NETWORK, giving a secure, synchronised and timestamped audit record. level of accuracy presents some tough choices….
- 12. 12 ©2015 ACCEDIAN NETWORKS Company Confidential Intelligent, Efficient Brokering • Granular: per-filter truncation rules • Precise: microsecond time-stamping • Efficient: bundles captured packets for transit • Lossless: TCP-based capture relay to VCX controller • Complete: jumbo frame support for any network MTU Brokered bandwidth << 10% of original flows Ultra-Low Overhead Permits: Continuous Monitoring concurrent On-Demand Troubleshooting FlowBROKER™ DISTRIBUTED PACKET BROKER Lossless Transit (LAN / WAN) Solution Components: Control Count Stream (Broker) Store Unbundle Classify Slice Bundle µs-precise Capture Timestamp Remote Capture Engine (RCE)
- 13. 13 ©2015 ACCEDIAN NETWORKS Company Confidential Capture Anywhere Required: Assured Delivery • Lossless packet brokering: analyze critical flows - transactional, sync, control • Locate analyzers remotely without sacrificing data capture quality • Controller automatically verifies bandwidth availability • Authenticated session setup for secure capture control • Prioritized drop with loss accounting if session disrupted Minimize Investment Required Maximize Analyzer Use DISTRIBUTED PACKET BROKERING Unified data access for multi-vendor, multi-layer, multi-domain networks Trade Flow Analyzers / Regulartory Compliance Logging It is impractical and cost prohibitive to position and place analyzers in close proximity to every important tap point — to achieve the optimal and functionally acceptable packet analyzing environment — so instead, FlowBROKER™ brings the tap points to the analyzers. “Cost-Efficient, Complete L2-7 Visibility, Network Wide”
- 14. 14 ©2015 ACCEDIAN NETWORKS Company Confidential ACHIEVING TOTAL NETWORK INSTRUMENTATION COVERAGE FS / FSX Elements Instrumentation Performance Assurance Orchestration Platform Connectivity In-Line or Out Visibility FPGA-Based Packet Processing & Analysis 0.1 µs 0.1s Applications Packet Capture & Time-Stamping ● Microburst & Gap Detection ● Bandwidth Utilization ● Latency (sub-µs) ● Loss ● Packet Loss ● TCP Performance, … Extranet Performance & SLA Monitoring ● MiFID II Compliance ● Trade-Flow Monitoring * FIX = Financial Information eXchange OMS = Order Management System ALGO = ALGORITHMIC TRADING MAL = Market Access Layer
- 15. 15 ©2015 ACCEDIAN NETWORKS Company Confidential APPLICATION: FRONT OFFICE TRADE FLOW ANALYTICS Member Trade analytics – reassemble financial instrument execution performance using centralized, in-memory analytics Combine rich data points with meaningful calculations based on infrastructure-wide intelligence. Enables business-flow level analysis: • Insight into Order Volumes • Trade fill-rates, per-client performance • Across all front-to-back flows • Trade and Order performance metrics • Connectivity latencies and throughput • Client-level SLAs and analytics • True tick-to-trade statistics Distributed, remote packet capture enables:
- 16. 16 ©2015 ACCEDIAN NETWORKS Company Confidential THANK YOU See us at stand 7 for a live demo: Extranet performance monitoring & exchange client portal
Hinweis der Redaktion
- Slide Tags: tag-released, tag-net_apps, tag-financial, tag-sol_apps, tag-sat, tag-pm, tag-h-qos, tag-traffic_conditioning, tag-solutions Accedian assures the performance of some of the world’s largest financial networks, where inter-site and exchange access connectivity require ultra-low latency, near-zero packet loss and reliable throughput without compromise. Automated, distributed Service Activation Testing ensures links meet performance SLAs from the moment they are commissioned. Accedian understands that in trading, time is money. Our solutions for service providers and financial institutions offer 10ms micro-burst detection and µs-precise, one-way latency measurements. With per-second reporting, it’s the most granular performance monitoring available. Featuring 50+ real-time metrics and derived statistics, Accedian’s Network State+™ gives a complete end-to-end QoS feed that openly integrates with leading network management, SDN optimization, performance reporting and other platforms.
- But on the other side of the country, on Wall Street, traders were exasperated by a 30-minute delay in the opening of the stock, which didn't begin trading till around 11:30 a.m. Eastern. Nasdaq officials told members in a notice at noon that its staff was "investigating an issue in delivering trade execution messages" from trades made in Facebook's IPO. Around 1 p.m., Nasdaq indicated it would provide a "manual report" to brokers with information on Facebook trades. Once the stock opened, trading was robust. More than 200 million shares changed hands in the first hour, as investors rushed in to buy, and some who had received stock from the IPO cashed out. By day's end, 571 million shares traded hands. The glitches that beset Nasdaq on Friday helped contribute to the lackluster price for Facebook shares, according to people familiar with the snafus. One of the biggest problems, these people said, was that buyers and sellers of Facebook shares weren't provided confirmation of their trades until 2 p.m. That's akin to people not knowing how much money is in their bank account, and therefore not knowing whether to go out and spend more money or save.
- After filtering/capture, microsecond precise time-stamping, slicing, and bundling performed directly by the Module at the tap location, FlowBROKER losslessly transfers packets to the virtualized VCX Controller for remaining aspects of the brokering function (unbundling, file storage, aggregation, and duplication if being sent to more than one analyzer). This results in efficient, guaranteed packet delivery from tap to analyzer — every packet is accounted for. FlowBROKER’s patent-pending method of efficiently transporting data across the network allows remote capture to be used continuously as a monitoring tool, instead of only for intermittent troubleshooting. It can also be used alongside bandwidth utilization metering, and active test and performance monitoring methods. --- Roadmap: Stateful: stops capture when desired data received (e.g. MAC learning). Adaptive: capture additional header info for certain message types (e.g. TCP SYN/ACK)
- FlowBROKER makes it possible to locate analyzers remotely without sacrificing data capture quality. VCX Controller automatically verifies bandwidth availability for packet transfer, authenticates session setup for secure capture, and prioritizes drop with loss accounting if the session is disrupted.
- Slide Tags: tag-released, tag-net_apps, tag-financial, tag-data_center, tag-sol_apps, tag-pm, tag-h-qos, tag-traffic_conditioning, tag-solutions Accedian’s unique fast-sampling FS element’s FlowMETER™ technology detects µ-bursts as short as 10ms while providing per-second KPIs in real-time via the Vision Collect module. GbE and 10GbE FS models provide coverage from the largest trading sites & colo facilities to smaller branch offices. Units have been deployed in global financial services firms, installed in over 100 countries to assure market information transmission and trading transaction performance over large scale WANs.