Mellanox OpenPOWER features

1© 2018 Mellanox Technologies | Confidential
November 2018
Interconnect Your Future

Company
Headquarters
Mellanox
Overview
Ticker: MLNX
Yokneam, Israel
Sunnyvale, California
Worldwide Offices
~2,700Employees worldwide

Higher Data Speeds
Faster Data Processing
Better Data Security
Adapters Switches
Cables &
Transceivers
SmartNIC System on a Chip
HPC and AI Needs the Most
Intelligent Interconnect

Leading Supplier
of End-to-End
Interconnect
Solutions
Storage
Front /
Back-End
Server /
Compute
Switch /
Gateway
56/100/200G
InfiniBand
10/25/40/50/
100/200/400GbE
Virtual Protocol
Interconnect
56/100/200G
InfiniBand
10/25/40/50/
100/200/400GbE
Virtual Protocol
Interconnect

Mellanox Accelerates Leading HPC and AI Systems
World’s Top 3 Supercomputers
Summit CORAL System
World’s Fastest HPC / AI System
9.2K InfiniBand Nodes
Sierra CORAL System
#2 USA Supercomputer
8.6K InfiniBand Nodes
1 2
Wuxi Supercomputing Center
Fastest Supercomputer in China
41K InfiniBand Nodes
3

The Need for Intelligent and Faster Interconnect
CPU-Centric (Onload) Data-Centric (Offload)
Must Wait for the Data
Creates Performance Bottlenecks
Faster Data Speeds and In-Network Computing
Enable Higher Performance and Scale
GPU
CPU
GPU
CPU
Onload Network In-Network Computing
GPU
CPU
CPU
GPU
GPU
CPU
GPU
CPU
GPU
CPU
CPU
GPU
Analyze Data as it Moves!
Higher Performance and Scale

In-Network Computing to Enable
Data-Centric Data Centers
GPU
CPU
GPU
CPU
GPU
CPU
CPU
GPU
GPUDirect
RDMA
Scalable Hierarchical
Aggregation and
Reduction Protocol
NVMeOver
Fabrics

In-Network
Computing
Self-Healing
Technology
In-Network
Computing
Unbreakable Data Centers
Delivers Highest Application Performance
GPUDirect™ RDMA
Critical for HPC and Machine Learning ApplicationsGPU Acceleration Technology
10X Performance Acceleration
Critical for HPC and Machine Learning Applications
35X
Faster Network Recovery
5000X
10X Performance Acceleration
Performance Acceleration
In-Network Computing Delivers Highest Performance
Scalable Hierarchical
Aggregation and
Reduction Protocol

SHARP AllReduce Performance Advantages (128 Nodes)
SHARP enables 75% Reduction in Latency
Providing Scalable Flat Latency

Performs the Gradient Averaging
Replaces all physical parameter servers
Accelerate AI Performance
SHARP Accelerates AI Performance
The CPU in a parameter server
becomes the bottleneck

SHARP Performance Advantage for AI
 SHARP provides 16% Performance Increase for deep learning, initial results
 TensorFlow with Horovod running ResNet50 benchmark, HDR InfiniBand (ConnectX-6, Quantum)
16%

10X Higher Performance with GPUDirect™ RDMA
Accelerates HPC and Deep Learning performance
Lowest communication latency for GPUs
GPUDirect™ RDMA

Mellanox Supercharges Leading AI Companies
Higher ROI
Lower CapEx
& OpEx
60%
50%
Unlocking the Power of Artificial Intelligence
Cognitive Toolkit
RDMA Supercharges Leading AI Frameworks

Mellanox Product
Details

Leading Connectivity
ConnectX-6 - The Road to Exascale
Leading Performance
Leading Features
 200Gb/s InfiniBand and Ethernet
 HDR, HDR100, EDR (100Gb/s) and lower speeds
 200GbE, 100GbE and lower speeds
 Single and dual ports
 50Gb/s PAM4 SerDes
 200Gb/s throughput, 0.6usec latency, 215 million message per second
 PCIe Gen3 / Gen4, 32 lanes
 Integrated PCIe switch
 Multi-Host - up to 8 hosts, supporting 4 dual-socket servers
 In-network computing and memory for HPC collective offloads
 Security – Block-level encryption to storage, key management, FIPS
 Storage – NVMe Emulation, NVMe-oF target, Erasure coding, T10/DIF
 Media – Video packets hardware reconstruction

HDR InfiniBand Switch: QM8700, 1U Series
 40 ports of HDR, 200G
 80 ports of HDR100, 100G
Superior performance
40 QSFP56 ports (50G PAM4 per lane)
 90ns latency
 390M packets per sec (64B)
 16Tb/s aggregate bandwidth
Superior resiliency
 22’’ depth
 6 fans (5+1), hot swappable
 2 power supplies (1+1), hot swappable

HDR InfiniBand Switch: CS8500, Modular Series
 800 ports of HDR, 200G
 1600 ports of HDR100, 100G
Superior performance
800 QSFP56 ports
 300ns latency
 320Tb/s aggregate bandwidth
 LCD Tablet IO panel
Water-cooled solution
 Liquid – Liquid 4U CDU
 Liquid – Air 42U (350mm wide) stand alone HEX
 0C – 35C (air) or 40C (water) operating air range

Innova and Innova-2 Smart Flexible Adapters
Configurable Adapters to Fit Your Needs
Crypto OffloadsProgrammable

Innova-2 Flex – Programmable Adapter
TCO savings using NIC and FPGA on same board
OpenCAPI
interface
ConnectX-5
4GB-8GB
DDR4
Memory
Xilinx Kintex
UltraScale+
PCIe Gen4
x8
25Gb/s
Interfaces
Embedded
PCIe Switch
Network
Offload
RDMA
Storage
Offload
GPUDirect OVS Offload

BlueField Block Diagram
 Tile Architecture - 16 ARM® A72 CPUs subsystem
 SkyMesh™ fully coherent low-latency interconnect
 8MB L2 Cache, 8 Tiles
 48KB I-Cache, 32KB D-Cache per core
 12MB L3 Last Level Cache
 ARM Frequency: 0.8GHz - 1.3GHz
 Dual Port 100g IO Controller, based on ConnectX-5
 Dual 100Gb/s Ethernet/InfiniBand, compatible with ConnectX-5
 NVMe-oF hardware accelerator
 High-end Networking Offloads: RDMA, Erasure Coding, T10-DIF
 Fully Integrated PCIe switch
 32 Bifurcated PCI Gen3/4 lanes (up to 200Gb/s)
 Root Complex or Endpoint modes
 2x16, 4x8, 8x4 or 16x2 configurations
 Hardware Accelerators, Crypto Engines
 Bulk crypto by A72 Neon ISA (AES, SHA)
 Public Key acceleration, True RNG
 Memory Controllers
 2x Channels DDR4 Memory Controllers w/ ECC
 NVDIMM-N Support
Dual VPI Ports
Ethernet/InfiniBand:
1, 10, 25,40,50,100G
32-lanes
PCIe Gen3/4

BlueField Product Line
 Different SKUs
 # Cores
 Speeds
 Perf points
SmartNIC
Ethernet
Dual Port 100Gb/s
Controller
BF1600
Dual Port 100Gb/s
Controller
BF1700
BlueField™ Platform
BF1100 & BF1200System on Chip
 Different SKUs
 GPU and SSD
 1U and 2U
 Up to 16 SSDs
 Different SKUs
 16/8/4 cores
 Dual 25Gb/s
 Storage card Different SKUs
 PCIe x16
 PCIe x32
 SDK and Development Tools
 Networking , Security Features
 Full NVMe storage capability
Full Software Enablement
SmartNIC VPI
BF1660
 VPI 2-ports 100G
 100Gb/s / EDR
 16 Cores

Open Ethernet – The Freedom to Optimize
Open APIs
Automation
End-to-End
Interconnect
Network-OS
Choice
SONiC
SDK
Customer-OS

SN2100 – 16x100GbE ports
(up to 32 x50GbE , 64x25/10GbE)
Ideal storage / Database 25/100GbE Switch
Open Ethernet SN2000 Series
300nsSN2700 – 169W
SN2410 – 165W
SN2100 – 94W
 Predictable Performance
 Fair Traffic Distribution for Cloud
 Best-in-Class Throughput, Latency, Power Consumption
 Zero Packet Loss
SN2700 – 32x100GbE (up to 64 x 50/25/10GbE)
The Ideal 100GbE ToR / Aggregation
SN2410 – 8x100GbE + 48x25GbE
25GbE  100GbE ToR
Energy efficiency
SN2010 – 4x100GbE + 18x10/25GbE
Ideal Hyperconverged Switch
10/25GbE  100GbE half width ToR

Highest-Performance 200Gb/s Interconnect Solutions
Transceivers
Active Optical and Copper Cables
(10 / 25 / 40 / 50 / 56 / 100 / 200Gb/s)
40 HDR (200Gb/s) InfiniBand Ports
80 HDR100 InfiniBand Ports
Throughput of 16Tb/s, <90ns Latency
200Gb/s Adapter, 0.6us latency
200 million messages per second
(10 / 25 / 40 / 50 / 56 / 100 / 200Gb/s)
16 400GbE, 32 200GbE, 128 25/50GbE Ports
(10 / 25 / 40 / 50 / 100 / 200 GbE)
Throughput of 6.4Tb/s
MPI, SHMEM/PGAS, UPC
For Commercial and Open Source Applications
Leverages Hardware Accelerations
System on Chip and SmartNIC
Programmable adapter
Smart Offloads

Thank You

Mellanox OpenPOWER features

Recommended

Recommended

More Related Content

What's hot

What's hot (20)

Similar to Mellanox OpenPOWER features

Similar to Mellanox OpenPOWER features (20)

More from Ganesan Narayanasamy

More from Ganesan Narayanasamy (20)

Recently uploaded

Recently uploaded (20)

Mellanox OpenPOWER features