LCU13: Tracing and Debugging for Networking Applications

•

0 gefällt mir•3,036 views

Resource: LCU13 Name: Tracking and Debugging for Networking Applications Date: 29-10-2013 Speaker: Magnus Karlsson Video: http://www.youtube.com/watch?v=z3BdRxMNuwA

Technologie

Tracing & Debugging for
Networking Applications
Magnus Karlsson, LSI

connect.linaro.org
•  Networking is the application
•  The networking app runs in user mode
•  Special HW with highly integrated networking functions
•  Lots of accelerators
Application Domain
Networking
Apps
Linux
Control

Apps
Net stack
CPU
0 CPU
1
–
CPU
N
Networking Accelerators & HW
Networking
SoC
User space
Kernel space

connect.linaro.org
•  Functionality for debugging and performance tuning of networking
applications
•  Reachable from user space
•  Performance data and traces even from processing that does not
touch cores. HW/SW implementation agnostic API
•  Plug in architecture needed as each vendor’s HW is different
•  Standard Linux interfaces
o  CoreSight access library
•  High resolution timers
What is missing?
Requirements

connect.linaro.org
•  Ftrace
•  LTTng
•  Perf
•  ftrace
•  Uprobes
•  Systemtap
•  Ktap?
•  GDB
•  Cat /proc/*
•  Etc…
What to build on?
Existing Linux Features

connect.linaro.org
•  Access to CoreSight (access lib from ARM)
•  Device driver for SW annotations to STM
•  LTTng & ftrace writing to trace buffers (ETB) instead of file
•  Decoding of ETB data through Linux (not DS-5). Open decoder needed
•  GDB access to HW trace functionality
•  Plugin of vendor’s accelerators into ftrace / LTTng
•  Monitoring core isolation disturbances
•  What about scalability?
•  Feature uplift to x86 level? What functionality to target?
•  What does ODP need?
What more to add?
What Functionality to Add?

connect.linaro.org
•  For many people looking at this, English may be their second,
third or fourth language,…
•  Try and keep bullet points to a minimum
•  Relevant images are great
•  Contact marketing (Steve and Jen) if you need some help with
images and/or editing
Slide 1

More about Linaro: http://www.linaro.org/about/
More about Linaro engineering: http://www.linaro.org/engineering/
How to join: http://www.linaro.org/about/how-to-join
Linaro members: www.linaro.org/members
connect.linaro.org

Weitere ähnliche Inhalte

Mehr von Linaro

Talk Title: Huawei’s requirements for the ARM based HPC solution readiness Talk Abstract: A high level review of a wide range of requirements to architect an ARM based competitive HPC solution is provided. The review combines both Industry and Huawei’s unique views with the intend to communicate openly not only the alignment and support in ongoing efforts carried over by other ARM key players but to brief on the areas of differentiation that Huawei is investing towards the research, development and deployment of homegrown ARM based HPC solution(s). Speaker: Joshua Mora Speaker Bio: 20 years of experience in research and development of both software and hardware for high performance computing. Currently leading the architecture definition and development of ARM based HPC solutions, both hardware and software, all the way to the applications (ie. turnkey HPC solutions for different compute intensive markets where ARM will succeed !!).

Huawei’s requirements for the ARM based HPC solution readiness - Joshua Mora

Linaro

“Delivering a well working distribution is hard. There are a lot of different hardware platforms that need to be verified and the software stack is in a big flux during development phases. In rolling releases, this gets even worse, as nothing ever stands still. The only sane answer to that problem are working Continuous Integration tests. The SUSE way to check whether any change breaks normal distribution behavior is OpenQA. Using OpenQA we can automatically run tests that hard working QA people did manually in the old days. That way we have fast enough turnaround times to find and reject breaking changes This session shows how OpenQA works, what pitfalls we had to make ARM work with OpenQA and what we’re doing to improve it for ARM specific use cases.”

Bud17 113: distribution ci using qemu and open qa

Linaro

Speaker: Renato Golin Speaker Bio: He started programming in the late 80's in C for PCs after a few years playing with 8-bit computers, but he only started programming professionally in the late 90's during the .com bubble. After many years working on Internet's back-end, he moved to UK and worked a few years on bioinformatics at EBI before joining ARM, where he worked on the DS-5 debugger and on the EDG-to-LLVM bridge, where he became the LLVM Tech Lead. Recently, he worked with large clusters and big data at HPCC before moving to Linaro. Talk Title: OpenHPC Automation with Ansible Talk Abstract: "In order to test OpenHPC packages and components and to use it as a platform to benchmark HPC applications, Linaro is developing an automated deployment strategy, using Ansible, Mr-Provisioner and Jenkins, to install the OS, OpenHPC and prepare the environment on varied architectures (Arm, x86). This work is meant to replace the existing ageing Bash-based recipes upstream while still keeping the documents intact. Our aim is to make it easier to vary hardware configuration, allow for different provisioning techniques and mix internal infrastructure logic to different labs, while still using the same recipes. We hope this will help more people use OpenHPC with a better out-of-the-box experience and with more robust results"

OpenHPC Automation with Ansible - Renato Golin - Linaro Arm HPC Workshop 2018

Linaro

Speaker: Pavel Shamis Company: Arm Speaker Bio: "Pavel is a Principal Research Engineer at ARM with over 16 years of experience in development HPC solutions. His work is focused on co-design software and hardware building blocks for high-performance interconnect technologies, development communication middleware and novel programming models. Prior to joining ARM, he spent five years at Oak Ridge National Laboratory (ORNL) as a research scientist at Computer Science and Math Division (CSMD). In this role, Pavel was responsible for research and development multiple projects in high-performance communication domain including: Collective Communication Offload (CORE-Direct & Cheetah), OpenSHMEM, and OpenUCX. Before joining ORNL, Pavel spent ten years at Mellanox Technologies, where he led Mellanox HPC team and was one of the key driver in enablement Mellanox HPC software stack, including OFA software stack, OpenMPI, MVAPICH, OpenSHMEM, and other. Pavel is a recipient of prestigious R&D100 award for his contribution in development of the CORE-Direct collective offload technology and he published in excess of 20 research papers. " Talk Title: HPC network stack on ARM Talk Abstract: Applications, programming languages, and libraries that leverage sophisticated network hardware capabilities have a natural advantage when used in today¹s and tomorrow's high-performance and data center computer environments. Modern RDMA based network interconnects provides incredibly rich functionality (RDMA, Atomics, OS-bypass, etc.) that enable low-latency and high-bandwidth communication services. The functionality is supported by a variety of interconnect technologies such as InfiniBand, RoCE, iWARP, Intel OPA, Cray¹s Aries/Gemini, and others. Over the last decade, the HPC community has developed variety user/kernel level protocols and libraries that enable a variety of high-performance applications over RDMA interconnects including MPI, SHMEM, UPC, etc. With the emerging availability HPC solutions based on ARM CPU architecture it is important to understand how ARM integrates with the RDMA hardware and HPC network software stack. In this talk, we will overview ARM architecture and system software stack, including MPI runtimes, OpenSHMEM, and OpenUCX.

HPC network stack on ARM - Linaro HPC Workshop 2018

Linaro

Speaker: Jay Kruemcke Speaker Company: SUSE Bio: "Jay is responsible for the SUSE Linux server products for High Performance Computing, 64-bit ARM systems, and SUSE Linux for IBM Power servers. Jay has built an extensive career in product management including using social media for client collaboration, product positioning, driving future product directions, and evangelizing the capabilities and future directions for dozens of enterprise products. " Talk Title: It just keeps getting better - SUSE enablement for Arm Talk Abstract: SUSE has been delivering commercial Linux support for Arm based servers since 2016. Initially the focus was on high end servers for HPC and Ceph based software defined storage. But we have enabled a number of other Arm SoCs and are even supporting the Raspberry Pi. This session will cover the SUSE products that are available for the Arm platform and view to the future.

It just keeps getting better - SUSE enablement for Arm - Linaro HPC Workshop ...

Linaro

Speakers: Gilad Shainer and Scot Schultz Company: Mellanox Technologies Talk Title: Intelligent Interconnect Architecture to Enable Next Generation HPC Talk Abstract: The latest revolution in HPC interconnect architecture is the development of In-Network Computing, a technology that enables handling and accelerating application workloads at the network level. By placing data-related algorithms on an intelligent network, we can overcome the new performance bottlenecks and improve the data center and applications performance. The combination of In-Network Computing and ARM based processors offer a rich set of capabilities and opportunities to build the next generation of HPC platforms. Gilad Shainer Bio: Gilad Shainer has served as Mellanox's vice president of marketing since March 2013. Previously, Mr. Shainer was Mellanox's vice president of marketing development from March 2012 to March 2013. Mr. Shainer joined Mellanox in 2001 as a design engineer and later served in senior marketing management roles between July 2005 and February 2012. Mr. Shainer holds several patents in the field of high-speed networking and contributed to the PCI-SIG PCI-X and PCIe specifications. Gilad Shainer holds a MSc degree (2001, Cum Laude) and a BSc degree (1998, Cum Laude) in Electrical Engineering from the Technion Institute of Technology in Israel. Scot Schultz Bio: Scot Schultz is a HPC technology specialist with broad knowledge in operating systems, high speed interconnects and processor technologies. Joining the Mellanox team in 2013, Schultz is 30-year veteran of the computing industry. Prior to joining Mellanox, he spent the past 17 years at AMD in various engineering and leadership roles in the area of high performance computing. Scot has also been instrumental with the growth and development of various industry organizations including the Open Fabrics Alliance, and continues to serve as a founding board-member of the OpenPOWER Foundation and Director of Educational Outreach and founding member of the HPC-AI Advisory Council.

Intelligent Interconnect Architecture to Enable Next Generation HPC - Linaro ...

Linaro

Yutaka Ishikawa - Post-K and Arm HPC Ecosystem - Linaro Arm HPC Workshop Santa Clara 2018 Bio: "Yutaka Ishikawa is the project leader of developing the post K supercomputer. From 1987 to 2001, he was a member of AIST (former Electrotechnical Laboratory), METI. From 1993 to 2001, he was the chief of Parallel and Distributed System Software Laboratory at Real World Computing Partnership. He led development of cluster system software called SCore, which was used in several large PC cluster systems around 2004. From 2002 to 2014, he was a professor at the University Tokyo. He led a project to design a commodity-based supercomputer called T2K open supercomputer. As a result, three universities, Tsukuba, Tokyo, and Kyoto, obtained each supercomputer based on the specification in 2008. He was also involved with the design of the Oakleaf-PACS, the successor of T2K supercomputer in both Tsukuba and Tokyo, whose peak performance is 25PF." Session Title: Post-K and Arm HPC Ecosystem Session Description: "Post-K, a flagship supercomputer in Japan, is being developed by Riken and Fujitsu. It will be the first supercomputer with Armv8-A+SVE. This talk will give an overview of Post-K and how RIKEN and Fujitsu are currently working on software stack for an Arm architecture."

Yutaka Ishikawa - Post-K and Arm HPC Ecosystem - Linaro Arm HPC Workshop Sant...

Linaro

Event: Arm Architecture HPC Workshop by Linaro and HiSilicon Location: Santa Clara, CA Speaker: Andrew J Younge Talk Title: Vanguard Astra - Petascale Arm Platform for U.S. DOE/ASC Supercomputing Talk Desc: The Vanguard program looks to expand the potential technology choices for leadership-class High Performance Computing (HPC) platforms, not only for the National Nuclear Security Administration (NNSA) but for the Department of Energy (DOE) and wider HPC community. Specifically, there is a need to expand the supercomputing ecosystem by investing and developing emerging, yet-to-be-proven technologies and address both hardware and software challenges together, as well as to prove-out the viability of such novel platforms for production HPC workloads. The first deployment of the Vanguard program will be Astra, a prototype Petascale Arm supercomputer to be sited at Sandia National Laboratories during 2018. This talk will focus on the arthictecural details of Astra and the significant investments being made towards the maturing the Arm software ecosystem. Furthermore, we will share initial performance results based on our pre-general availability testbed system and outline several planned research activities for the machine. Bio: Andrew Younge is a R&D Computer Scientist at Sandia National Laboratories with the Scalable System Software group. His research interests include Cloud Computing, Virtualization, Distributed Systems, and energy efficient computing. Andrew has a Ph.D in Computer Science from Indiana University, where he was the Persistent Systems fellow and a member of the FutureGrid project, an NSF-funded experimental cyberinfrastructure test-bed. Over the years, Andrew has held visiting positions at the MITRE Corporation, the University of Southern California / Information Sciences Institute, and the University of Maryland, College Park. He received his Bachelors and Masters of Science from the Computer Science Department at Rochester Institute of Technology (RIT) in 2008 and 2010, respectively.

Andrew J Younge - Vanguard Astra - Petascale Arm Platform for U.S. DOE/ASC Su...

Linaro

HKG18-501 - EAS on Common Kernel 4.14 and getting (much) closer to mainline

Linaro

HKG18-100K1 - George Grey: Opening Keynote

Linaro

HKG18-318 - OpenAMP Workshop

Linaro

HKG18-501 - EAS on Common Kernel 4.14 and getting (much) closer to mainline

Linaro

HKG18-315 - Why the ecosystem is a wonderful thing, warts and all

Linaro

HKG18- 115 - Partitioning ARM Systems with the Jailhouse Hypervisor

Linaro

HKG18-TR08 - Upstreaming SVE in QEMU

Linaro

HKG18-113- Secure Data Path work with i.MX8M

Linaro

HKG18-120 - Devicetree Schema Documentation and Validation

Linaro

HKG18-223 - Trusted FirmwareM: Trusted boot

Linaro

HKG18-500K1 - Keynote: Dileep Bhandarkar - Emerging Computing Trends in the D...

Linaro

HKG18-317 - Arm Server Ready Program

Linaro

Mehr von Linaro (20)

Huawei’s requirements for the ARM based HPC solution readiness - Joshua Mora

Bud17 113: distribution ci using qemu and open qa

OpenHPC Automation with Ansible - Renato Golin - Linaro Arm HPC Workshop 2018

HPC network stack on ARM - Linaro HPC Workshop 2018

It just keeps getting better - SUSE enablement for Arm - Linaro HPC Workshop ...

Intelligent Interconnect Architecture to Enable Next Generation HPC - Linaro ...

Yutaka Ishikawa - Post-K and Arm HPC Ecosystem - Linaro Arm HPC Workshop Sant...

Andrew J Younge - Vanguard Astra - Petascale Arm Platform for U.S. DOE/ASC Su...

HKG18-501 - EAS on Common Kernel 4.14 and getting (much) closer to mainline

HKG18-100K1 - George Grey: Opening Keynote

HKG18-318 - OpenAMP Workshop

HKG18-501 - EAS on Common Kernel 4.14 and getting (much) closer to mainline

HKG18-315 - Why the ecosystem is a wonderful thing, warts and all

HKG18- 115 - Partitioning ARM Systems with the Jailhouse Hypervisor

HKG18-TR08 - Upstreaming SVE in QEMU

HKG18-113- Secure Data Path work with i.MX8M

HKG18-120 - Devicetree Schema Documentation and Validation

HKG18-223 - Trusted FirmwareM: Trusted boot

HKG18-500K1 - Keynote: Dileep Bhandarkar - Emerging Computing Trends in the D...

HKG18-317 - Arm Server Ready Program

Kürzlich hochgeladen

FWD Group - Insurer Innovation Award 2024

The Digital Insurer

Automating Google Workspace (GWS) & more with Apps Script

wesley chun

Accelerating FinTech Innovation: Unleashing API Economy and GenAI Vasa Krishnan, Chief Technology Officer - FinResults Apidays New York 2024: The API Economy in the AI Era (April 30 & May 1, 2024) ------ Check out our conferences at https://www.apidays.global/ Do you want to sponsor or talk at one of our conferences? https://apidays.typeform.com/to/ILJeAaV8 Learn more on APIscene, the global media made by the community for the community: https://www.apiscene.io Explore the API ecosystem with the API Landscape: https://apilandscape.apiscene.io/

Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...

apidays

Artificial Intelligence Chap.5 : Uncertainty

Khushali Kathiriya

ICT role in 21st century education and its challenges

rafiqahmad00786416

Manulife - Insurer Transformation Award 2024

The Digital Insurer

Boost Fertility New Invention Ups Success Rates.pdf

sudhanshuwaghmare1

2024: Domino Containers - The Next Step. News from the Domino Container commu...

Martijn de Jong

Webinar Recording: https://www.panagenda.com/webinars/why-teams-call-analytics-is-critical-to-your-entire-business Nothing is as frustrating and noticeable as being in an important call and being unable to see or hear the other person. Not surprising then, that issues with Teams calls are among the most common problems users call their helpdesk for. Having in depth insight into everything relevant going on at the user’s device, local network, ISP and Microsoft itself during the call is crucial for good Microsoft Teams Call quality support. To ensure a quick and adequate solution and to ensure your users get the most out of their Microsoft 365. But did you know that ‘bad calls’ are also an excellent indicator of other problems arising? Precisely because it is so noticeable!? Like the canary in the mine, bad calls can be early indicators of problems. Problems that might otherwise not have been noticed for a while but can have a big impact on productivity and satisfaction. Join this session by Christoph Adler to learn how true Microsoft Teams call quality analytics helped other organizations troubleshoot bad calls and identify and fix problems that impacted Teams calls or the use of Microsoft365 in general. See what it can do to keep your users happy and productive! In this session we will cover - Why CQD data alone is not enough to troubleshoot call problems - The importance of attributing call problems to the right call participant - What call quality analytics can do to help you quickly find, fix-, and prevent problems - Why having retrospective detailed insights matters - Real life examples of how others have used Microsoft Teams call quality monitoring to problem shoot problems with their ISP, network, device health and more.

Why Teams call analytics are critical to your entire business

panagenda

MySQL Webinar, presented on the 25th of April, 2024. Summary: MySQL solutions enable the deployment of diverse Database Architectures tailored to specific needs, including High Availability, Disaster Recovery, and Read Scale-Out. With MySQL Shell's AdminAPI, administrators can seamlessly set up, manage, and monitor these solutions, ensuring efficiency and ease of use in their administration. MySQL Router, on the other hand, provides transparent routing from the application traffic to the backend servers in the architectures, requiring minimal configuration. Completely built in-house and supported by Oracle, these solutions have been adopted by enterprises of all sizes for their business-critical applications. In this presentation, we'll delve into various database architecture solutions to help you choose the right one based on your business requirements. Focusing on technical details and the latest features to maximize the potential of these solutions.

Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...

Miguel Araújo

Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...

Zilliz

Strategies for Landing an Oracle DBA Job as a Fresher

Remote DBA Services

Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving

Edi Saputra

This presentations targets students or working professionals. You may know Google for search, YouTube, Android, Chrome, and Gmail, but did you know Google has many developer tools, platforms & APIs? This comprehensive yet still high-level overview outlines the most impactful tools for where to run your code, store & analyze your data. It will also inspire you as to what's possible. This talk is 50 minutes in length.

Powerful Google developer tools for immediate impact! (2023-24 C)

wesley chun

DBX First Quarter 2024 Investor Presentation

Dropbox

Corporate and higher education. Two industries that, in the past, have had a clear divide with very little crossover. The difference in goals, learning styles and objectives paved the way for differing learning technologies platforms to evolve. Now, those stark lines are blurring as both sides are discovering they have content that’s relevant to the other. Join Tammy Rutherford as she walks through the pros and cons of corporate and higher ed collaborating. And the challenges of these different technology platforms working together for a brighter future.

Corporate and higher education May webinar.pptx

Rustici Software

Data Cloud, More than a CDP by Matt Robison

Anna Loughnan Colquhoun

Modernizing Securities Finance: The cloud-native prime brokerage platform transforming capital markets. Madhu Subbu, Managing Director, Head of Securities Finance Engineering Apidays Singapore 2024: Connecting Customers, Business and Technology (April 17 & 18, 2024) ------ Check out our conferences at https://www.apidays.global/ Do you want to sponsor or talk at one of our conferences? https://apidays.typeform.com/to/ILJeAaV8 Learn more on APIscene, the global media made by the community for the community: https://www.apiscene.io Explore the API ecosystem with the API Landscape: https://apilandscape.apiscene.io/

Apidays Singapore 2024 - Modernizing Securities Finance by Madhu Subbu

apidays

How to Troubleshoot Apps for the Modern Connected Worker

ThousandEyes

AXA XL - Insurer Innovation Award Americas 2024

The Digital Insurer

Kürzlich hochgeladen (20)

FWD Group - Insurer Innovation Award 2024

Automating Google Workspace (GWS) & more with Apps Script

Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...

Artificial Intelligence Chap.5 : Uncertainty

ICT role in 21st century education and its challenges

Manulife - Insurer Transformation Award 2024

Boost Fertility New Invention Ups Success Rates.pdf

2024: Domino Containers - The Next Step. News from the Domino Container commu...

Why Teams call analytics are critical to your entire business

Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...

Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...

Strategies for Landing an Oracle DBA Job as a Fresher

Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving

Powerful Google developer tools for immediate impact! (2023-24 C)

DBX First Quarter 2024 Investor Presentation

Corporate and higher education May webinar.pptx

Data Cloud, More than a CDP by Matt Robison

Apidays Singapore 2024 - Modernizing Securities Finance by Madhu Subbu

How to Troubleshoot Apps for the Modern Connected Worker

AXA XL - Insurer Innovation Award Americas 2024

LCU13: Tracing and Debugging for Networking Applications

1. Tracing & Debugging for Networking Applications Magnus Karlsson, LSI

2. connect.linaro.org •  Networking is the application •  The networking app runs in user mode •  Special HW with highly integrated networking functions •  Lots of accelerators Application Domain Networking Apps Linux Control Apps Net stack CPU 0 CPU 1 – CPU N Networking Accelerators & HW Networking SoC User space Kernel space

3. connect.linaro.org •  Functionality for debugging and performance tuning of networking applications •  Reachable from user space •  Performance data and traces even from processing that does not touch cores. HW/SW implementation agnostic API •  Plug in architecture needed as each vendor’s HW is different •  Standard Linux interfaces o  CoreSight access library •  High resolution timers What is missing? Requirements

4. connect.linaro.org •  Ftrace •  LTTng •  Perf •  ftrace •  Uprobes •  Systemtap •  Ktap? •  GDB •  Cat /proc/* •  Etc… What to build on? Existing Linux Features

5. connect.linaro.org •  Access to CoreSight (access lib from ARM) •  Device driver for SW annotations to STM •  LTTng & ftrace writing to trace buffers (ETB) instead of file •  Decoding of ETB data through Linux (not DS-5). Open decoder needed •  GDB access to HW trace functionality •  Plugin of vendor’s accelerators into ftrace / LTTng •  Monitoring core isolation disturbances •  What about scalability? •  Feature uplift to x86 level? What functionality to target? •  What does ODP need? What more to add? What Functionality to Add?

6. connect.linaro.org •  For many people looking at this, English may be their second, third or fourth language,… •  Try and keep bullet points to a minimum •  Relevant images are great •  Contact marketing (Steve and Jen) if you need some help with images and/or editing Slide 1

7. More about Linaro: http://www.linaro.org/about/ More about Linaro engineering: http://www.linaro.org/engineering/ How to join: http://www.linaro.org/about/how-to-join Linaro members: www.linaro.org/members connect.linaro.org

LCU13: Tracing and Debugging for Networking Applications

Empfohlen

Empfohlen

Weitere ähnliche Inhalte

Mehr von Linaro

Mehr von Linaro (20)

Kürzlich hochgeladen

Kürzlich hochgeladen (20)

LCU13: Tracing and Debugging for Networking Applications