This presentation entitled "Seamless FPGA deployment over Spark in cloud computing: A use case on machine learning hardware acceleration" was conducted in the 14th International Symposium, ARC 2018, Santorini, Greece, May 2-4, 2018.
Seamless FPGA deployment over Spark in cloud computing: A use case on machine learning hardware acceleration
1. Christoforos Kachris, Elias Koromilas, Ioannis Stamelos, Dimitrios Soudris
kachris@microlab.ntua.gr
ICCS-National Technical University of Athens
ARC 2018, Santorini
Seamless FPGA deployment over Spark in cloud
computing: A use case on machine learning
hardware acceleration
3. www.vineyard-h2020.eu
Power consumption in the data centers
3
• Currently Data
Centers consume
huge amounts of
energy
• Servers consume
around 30% of the
total power budget of
the IT infrastructure
Christoforos Kachris, ICCS, Greece
5. www.vineyard-h2020.eu
FPGAs at the spotlight
5
April 2015
Submission of VINEYARD proposal
2015
2016
2017
December 2016
Overall, Intel now has five different AI
platforms; FPGAs, the Xeon Phi, the
Nervana NNP, the Myriad X, and its
traditional Core processor. The Core
processor still performs most AI tasks.
7. www.vineyard-h2020.eu
FPGAs in Data Center
• Intel: “Two orders of magnitude faster than GPU by 2020”
($16.7 billion bet)
Broadwel Xeon with Arria 10
• Microsoft Bing with Altera Stratix V
• IBM SupperVessel with Power8 + Xilinx
• Xilinx SDAccel on Nimbix Cloud
• Google has released TPU only for Tensorflow – ISCA 2017
7
Christoforos Kachris, ICCS, Greece
8. www.vineyard-h2020.eu
Machine learning market size
• The machine learning market
size is expected to grow from
USD 1.41 Billion in 2017 to
USD 8.81 Billion by 2022, at a
Compound Annual Growth
Rate (CAGR) of 44.1%.
https://www.marketsandmarkets.com/PressReleas
es/machine-learning.asp
Christoforos Kachris, ICCS, Greece 8
10. www.vineyard-h2020.eu
Apache Spark
The largest open source project in
data processing.
• Structured Data
• Streaming Analytics
• Machine Learning
• Graph Computation
Provides an interface for
programming entire clusters with
implicit data parallelism and fault-
tolerance.
10
Christoforos Kachris, ICCS, Greece
11. www.vineyard-h2020.eu
Contributions
• The FPGA driver API is packed in a shared object library and
can be used in a transparent way hiding all the low level
details.
• We implemented top level APIs in Python for standalone and
Apache Spark integrated use, that are easy to be used and are
also easily maintained since the middle layer, our shared
library remains the same for all of the above.
Christoforos Kachris, ICCS, Greece 11
12. www.vineyard-h2020.eu
System stack
• Application Layer: This layer
hosts users’ applications. The
applications can run natively
using Python.
• Vineyard Layer: This layer hosts
the whole functionality of our
framework. The key element of
this layer is the implemented
shared library
• SDSoC-HLS API and FPGA
layerhared library
Christoforos Kachris, ICCS, Greece 12
13. www.vineyard-h2020.eu
Flow for data movement - RDDS
• Flow of the original
and optimized
method for the
DMA transfers to
the accelerator
Christoforos Kachris, ICCS, Greece 13
16. www.vineyard-h2020.eu
Pynq: Python Productivity for Zynq
• An open-source project from Xilinx that
makes it easy to design embedded
systems with Zynq MPSoCs.
• The APSoC is programmed using
Python.
• The code is developed and tested
directly on the PYNQ-Z1 board.
• The programmable logic circuits are
imported as hardware libraries and
programmed through their APIs in
essentially the same way as the
software libraries.
16
Christoforos Kachris, ICCS, Greece
29. www.vineyard-h2020.eu
Main goals
VINEYARD AIMS TO
• Build an integrated platform for energy-efficient data
centres based on novel programmable hardware
accelerators
• Develop a high-level programming framework and big
data infrastructure for allowing end-users to seamlessly
utilize these accelerators in heterogeneous computing
systems by employing typical data-centre programming
frameworks (i.e. Spark.).
• VINEYARD also foster the establishment of an
ecosystem that will empower open innovation based on
hardware accelerators as data-centre plugins for
marketplace, thereby facilitating innovative enterprises
(large industries, SMEs, and creative start-ups) to
develop novel solutions using VINEYARDS’s leading
edge developments.
29
Christoforos Kachris, ICCS, Greece
30. • Speedup your application seamlessly
• An integrated framework for the utilization of hardware
accelerators in HPC and data center seamlessly
Contact detais: kachris@microlab.ntua.gr