SlideShare ist ein Scribd-Unternehmen logo
1 von 11
Downloaden Sie, um offline zu lesen
“The ELASTIC project has received funding from the European Union's Horizon 2020
research and innovation programme under the grant agreement No 825473”
The ELASTIC Project
LEGaTO Final Event: Low-Energy Heterogeneous Computing Workshop
Eduardo Quiñones
eduardo.quinones@bsc.es
9/9/20
General Information
9/9/20 2
§ ELASTIC: a software architecture for Extreme-scaLe big-data
AnalyticS in fog compuTIng eCosystems
§ Under the scope of the H2020 call ICT-12-2018-2020: Big Data technologies
and extreme-scale analytics
§ 36 month project (starting Dec 2018); 6 million € budget
Motivation: The Importance of ELASTIC
9/9/20 3
1. Geographically distributed data
sources and data analytics
requirements, e.g., smart cities
2. The fulfillment of non-functional
properties inherited from the
domain: real-time, energy,
communications and security
3. Constant increment of volume,
variety and velocity of data-sets
Data sources
Large
data-sets
Edge computing
- Data collection and
transfer
- Limited computation
capabilities
Cloud computing
- Data storage
- High computation
capabilities Data
Centers
Data Analytics
Network
Latent
Data-at-rest
analytics
Reactive
data-in-motion
analytics
ComputeContinuum
A coordination of edge and
cloud resources is needed!
ELASTIC’s Vision
9/9/20 4
Cloud
Computing
ComputeContinuum
Data sources
Data analytics across the
compute continuum
1. Significantly increase the capabilities of
the data analytics
2. Integrate both responsive data-in-motion
and latent data-at-rest analytics
3. Fulfill the non-functional properties
inherit from the domain
EdgeComputing
Large data-sets
Network
ELASTIC’s Main Contribution
9/9/20 5
Productivity
A novel software architecture capable of:
1. Efficiently distribute analytics workloads
2. Combine responsive data-in-motion and
latent data-at-rest analytics
3. Fulfill the real-time, energy-efficiency,
quality of communications and security
properties
4. Use advance parallel and energy-efficiency
embedded platforms at edge side
+ Programmability
+ Portability/Scalability
+ Performance
Cloud
Computing
ComputeContinuum
Data sources
EdgeComputing
Large data-sets
Network
Data analytics across the
compute continuum
Druid dataClayKafka
Security
Time/
energy
Comm.
DeploymentScheduler
Nuvla
NuvlaBox KonnektBox MQTTCloud (Swarm/K8S)
DDAP
Fog Platform
NFR COMPSs
ELASTIC Software Architecture
9/9/20 6
Converging multiple computing areas
1. SoA data-in-motion and data-at-rest analytics
solutions supported with a Distributed Data
platform (DDAP)
2. Advanced orchestraction methods for
complex data-analytics workflow scheduling
and deployment
3. Non-functional analysis inherited from the
cyber-physical domain to monitor the
execution of workflows
4. Fog-based platforms including
§ Cloud-based Container as a Service (Caas)
technologies for resource auto-scaling
§ IoT cyber-secured communication and
network protocols
§ Advanced highly parallel and energy-
efficiency embedded platforms
Smart Mobility Use-Case
9/9/20 7
§ Test and highlight the benefits of
the ELASTIC Software architecture
§ Deployed on the Florence tramway
network (Italy)
§ Tram vehicles equipped with
§ Advanced parallel embedded processor
architectures
§ V2X communication
§ Variety of sensors (cameras,
radars/LIDAR, IMU, etc.)
ELASTIC-825473 - page 15 of 78
tional
analysis tools
Cloud and
edge run-time
services
sions (GNU)
the SCHED_PREEMPT or the SCHED_DEADLINE ad-
dressing timing or the Energy-Aware Scheduling (EAS)
framework addressing energy properties.
SteelskinPEP
(FIWARE)
Open-source
(GNU)
A XACML Policy Enforcement Point (PEP) to work along
with Keypass to restrict the access to the Platform
Keypass
(FIWARE)
Open-source
(Apache)
A flexible multi-tenant XACML server with PAP (Policy
Administration Point) and PDP (Policy Detention Point) ca-
pabilities, to manage roles and permissions in the platform I
Keystone
SCIM
Open-source
(Apache)
An identity service (OpenStack Identity API) that provides
Single Sign On (SSO) capabilities, covering both Authenti-
cation (AuthN) and RBAC Authorisation (AuthZ).
From lab to market: ELASTIC applied to the Florence tramway network
We have carefully selected a realistic use-case
from the smart mobility domain, upon which the
ELASTIC software architecture capabilities will
be tested and evaluated.
Concretely, ELASTIC use case aims to enhance
the Florence tramway network as well as its inter-
action with the private vehicle transportation in the
area of the Metropolitan City of Florence (Italy).
To do so, ELASTIC will efficiently process multi-
ple and heterogeneous streams of data coming
from multiple IoT sensors located along the three
lines of the tramway network, and the tram vehi-
cles, to extract valuable knowledge with extreme-
scale analytics, while fulfilling non-functional
properties inherited by the tramway system, i.e. Figure 4. Florence tramway networkFlorence Tramway network
Tram vehicle from the Florence
Tramway network
City of Florence
9/9/20 8
12
Figure 5: Core components of the public access Wi-Fi network are hosted
the control centre.
2.1.2 Backbone network
The backbone network relies on a fibre optics ring, connecting the core a
installed at each stop. The backbone network features a fail-safe configur
currently operated at 1 Gbps. The layout of the backbone network is show
Figure 6: A fibre optics ring connects the control centre and the sto
2.1.3 Access network
The Wi-Fi access network supports the 802.11a/b/g/n protocols
connection of common user devices; to this end, a public SSID is publishe
gain access to the Internet through a captive portal. Moreover, hidde
configured on the network. A typical configuration of the access network
one or more access points connected to the LAN switch installed in the ca
tramway stop. The typical layout of the access network at a single sto
below.
Porta
al Prato
Field cabinet
(e.g. pole / semaphore / other)
wireless
bridge
V2X
station
edge
computer
traffic control
device(s)
3
nected to the LAN switch at each stop.
nt possible locations for edge and/or fog
lights (figure (a)), lighting poles (figure (b))
(b)
ext to the traffic lights; (b) a lighting pole
a video camera; (c) cabinet at a stop.
er LAN port with PoE output, enabling
sors, cameras, etc.) – this could ease the
d for the implementation of the ELASTIC use
V2X
station
edge
computer
traffic control
device(s)
camera
Track cabinet
(at stops)
13
Figure 7: Wi-Fi access points are connected to the LAN switch at each stop.
The following pictures show the different possible locations for edge and/or fog
devices, such as cabinets next to traffic lights (figure (a)), lighting poles (figure (b))
and cabinets at stops (figure (c)).
(a) (b)
(c)
Figure 8: (a) Cabinet hosting devices next to the traffic lights; (b) a lighting pole
hosting a Wi-Fi access point and a video camera; (c) cabinet at a stop.
Access points feature a 1 Gbps copper LAN port with PoE output, enabling
connection of further devices (e.g. sensors, cameras, etc.) – this could ease the
installation of additional devices required for the implementation of the ELASTIC use
cases.
Cloud
(GEST depot)
T1 Line
Wifi
edge
computers
camera
NGAP
Wifi
LTE
ELASTIC Use-Cases
9/9/20 9
1. Next Generation Autonomous Positioning (NGAP) and
Advanced Driving Assistant System (ADAS)
§ Autonomously localize tram vehicles to support ADAS functionalities
(i.e. obstacle detection and collision avoidance) based on data
fusion coming from network and vehicle sensors
2. Predictive maintenance
§ Monitor the operation of the tramway to identify failures before
they happened
§ Driving optimization based on energy consumption, acceleration and
speed
3. Interaction between the public and the private transport in
the City of Florence
§ Enhance the transportation system to better manage interactions
between different transportation networks, i.e., public and private
Conclusions
9/9/20 10
1. ELASTIC aims to increase development and deployment
productivity of systems based on data-analytics by developing
a novel software architecture capable of guaranteeing the
non-functional properties inherited from the domain
2. ELASTIC aims to increase data analytics capabilities by
efficiently combine reactive data-in-motion and latent data-
at-rest analytics
3. ELASTIC aims to apply the software architecture to develop a
distributed sensing/computing infrastructure within the
Florence tramway network for advanced urban mobility
applications
www.elastic-project.eu
@elastic_EU www.linkedin.com/company/elastic-project
Thank you
eduardo.quinones@bsc.es

Weitere ähnliche Inhalte

Mehr von LEGATO project

LEGaTO: Software Stack Programming Models
LEGaTO: Software Stack Programming ModelsLEGaTO: Software Stack Programming Models
LEGaTO: Software Stack Programming ModelsLEGATO project
 
LEGaTO: Software Stack Runtimes
LEGaTO: Software Stack RuntimesLEGaTO: Software Stack Runtimes
LEGaTO: Software Stack RuntimesLEGATO project
 
LEGaTO Heterogeneous Hardware
LEGaTO Heterogeneous HardwareLEGaTO Heterogeneous Hardware
LEGaTO Heterogeneous HardwareLEGATO project
 
LEGaTO: Low-Energy Heterogeneous Computing Workshop
LEGaTO: Low-Energy Heterogeneous Computing WorkshopLEGaTO: Low-Energy Heterogeneous Computing Workshop
LEGaTO: Low-Energy Heterogeneous Computing WorkshopLEGATO project
 
TZ4Fabric: Executing Smart Contracts with ARM TrustZone
TZ4Fabric: Executing Smart Contracts with ARM TrustZoneTZ4Fabric: Executing Smart Contracts with ARM TrustZone
TZ4Fabric: Executing Smart Contracts with ARM TrustZoneLEGATO project
 
Infection Research with Maxeler Dataflow Computing
Infection Research with Maxeler Dataflow ComputingInfection Research with Maxeler Dataflow Computing
Infection Research with Maxeler Dataflow ComputingLEGATO project
 
Smart Home - AI at the edge
Smart Home - AI at the edgeSmart Home - AI at the edge
Smart Home - AI at the edgeLEGATO project
 
FPGA Undervolting and Checkpointing for Energy-Efficiency and Error-Resiliency
FPGA Undervolting and Checkpointing for Energy-Efficiency and Error-ResiliencyFPGA Undervolting and Checkpointing for Energy-Efficiency and Error-Resiliency
FPGA Undervolting and Checkpointing for Energy-Efficiency and Error-ResiliencyLEGATO project
 
Device Data Directory and Asynchronous execution: A path to heterogeneous com...
Device Data Directory and Asynchronous execution: A path to heterogeneous com...Device Data Directory and Asynchronous execution: A path to heterogeneous com...
Device Data Directory and Asynchronous execution: A path to heterogeneous com...LEGATO project
 
Scheduling Task-parallel Applications in Dynamically Asymmetric Environments
Scheduling Task-parallel Applications in Dynamically Asymmetric EnvironmentsScheduling Task-parallel Applications in Dynamically Asymmetric Environments
Scheduling Task-parallel Applications in Dynamically Asymmetric EnvironmentsLEGATO project
 
RECS – Cloud to Edge Microserver Platform for Energy-Efficient Computing
RECS – Cloud to Edge Microserver Platform for Energy-Efficient ComputingRECS – Cloud to Edge Microserver Platform for Energy-Efficient Computing
RECS – Cloud to Edge Microserver Platform for Energy-Efficient ComputingLEGATO project
 
Secure Task-Based Programming with OmpSs and SGX
Secure Task-Based Programming with OmpSs and SGXSecure Task-Based Programming with OmpSs and SGX
Secure Task-Based Programming with OmpSs and SGXLEGATO project
 
HiPerMAb: A statistical tool for judging the potential of short fat data
HiPerMAb: A statistical tool for judging the potential of short fat dataHiPerMAb: A statistical tool for judging the potential of short fat data
HiPerMAb: A statistical tool for judging the potential of short fat dataLEGATO project
 
Moldable pipelines for CNNs on heterogeneous edge devices
Moldable pipelines for CNNs on heterogeneous edge devicesMoldable pipelines for CNNs on heterogeneous edge devices
Moldable pipelines for CNNs on heterogeneous edge devicesLEGATO project
 
Low Energy Task Scheduling based on Work Stealing
Low Energy Task Scheduling based on Work StealingLow Energy Task Scheduling based on Work Stealing
Low Energy Task Scheduling based on Work StealingLEGATO project
 
Privacy Preserving Cloud Storage - A Rollback Protection Service for Untruste...
Privacy Preserving Cloud Storage - A Rollback Protection Service for Untruste...Privacy Preserving Cloud Storage - A Rollback Protection Service for Untruste...
Privacy Preserving Cloud Storage - A Rollback Protection Service for Untruste...LEGATO project
 
Introducing Generalized Deduplication for Energy-efficient IoT Networks with ...
Introducing Generalized Deduplication for Energy-efficient IoT Networks with ...Introducing Generalized Deduplication for Energy-efficient IoT Networks with ...
Introducing Generalized Deduplication for Energy-efficient IoT Networks with ...LEGATO project
 
SpecFuzz: Bringing Spectre-type vulnerabilities to the surface
SpecFuzz: Bringing Spectre-type vulnerabilities to the surfaceSpecFuzz: Bringing Spectre-type vulnerabilities to the surface
SpecFuzz: Bringing Spectre-type vulnerabilities to the surfaceLEGATO project
 

Mehr von LEGATO project (20)

LEGaTO Integration
LEGaTO IntegrationLEGaTO Integration
LEGaTO Integration
 
LEGaTO: Use cases
LEGaTO: Use casesLEGaTO: Use cases
LEGaTO: Use cases
 
LEGaTO: Software Stack Programming Models
LEGaTO: Software Stack Programming ModelsLEGaTO: Software Stack Programming Models
LEGaTO: Software Stack Programming Models
 
LEGaTO: Software Stack Runtimes
LEGaTO: Software Stack RuntimesLEGaTO: Software Stack Runtimes
LEGaTO: Software Stack Runtimes
 
LEGaTO Heterogeneous Hardware
LEGaTO Heterogeneous HardwareLEGaTO Heterogeneous Hardware
LEGaTO Heterogeneous Hardware
 
LEGaTO: Low-Energy Heterogeneous Computing Workshop
LEGaTO: Low-Energy Heterogeneous Computing WorkshopLEGaTO: Low-Energy Heterogeneous Computing Workshop
LEGaTO: Low-Energy Heterogeneous Computing Workshop
 
TZ4Fabric: Executing Smart Contracts with ARM TrustZone
TZ4Fabric: Executing Smart Contracts with ARM TrustZoneTZ4Fabric: Executing Smart Contracts with ARM TrustZone
TZ4Fabric: Executing Smart Contracts with ARM TrustZone
 
Infection Research with Maxeler Dataflow Computing
Infection Research with Maxeler Dataflow ComputingInfection Research with Maxeler Dataflow Computing
Infection Research with Maxeler Dataflow Computing
 
Smart Home - AI at the edge
Smart Home - AI at the edgeSmart Home - AI at the edge
Smart Home - AI at the edge
 
FPGA Undervolting and Checkpointing for Energy-Efficiency and Error-Resiliency
FPGA Undervolting and Checkpointing for Energy-Efficiency and Error-ResiliencyFPGA Undervolting and Checkpointing for Energy-Efficiency and Error-Resiliency
FPGA Undervolting and Checkpointing for Energy-Efficiency and Error-Resiliency
 
Device Data Directory and Asynchronous execution: A path to heterogeneous com...
Device Data Directory and Asynchronous execution: A path to heterogeneous com...Device Data Directory and Asynchronous execution: A path to heterogeneous com...
Device Data Directory and Asynchronous execution: A path to heterogeneous com...
 
Scheduling Task-parallel Applications in Dynamically Asymmetric Environments
Scheduling Task-parallel Applications in Dynamically Asymmetric EnvironmentsScheduling Task-parallel Applications in Dynamically Asymmetric Environments
Scheduling Task-parallel Applications in Dynamically Asymmetric Environments
 
RECS – Cloud to Edge Microserver Platform for Energy-Efficient Computing
RECS – Cloud to Edge Microserver Platform for Energy-Efficient ComputingRECS – Cloud to Edge Microserver Platform for Energy-Efficient Computing
RECS – Cloud to Edge Microserver Platform for Energy-Efficient Computing
 
Secure Task-Based Programming with OmpSs and SGX
Secure Task-Based Programming with OmpSs and SGXSecure Task-Based Programming with OmpSs and SGX
Secure Task-Based Programming with OmpSs and SGX
 
HiPerMAb: A statistical tool for judging the potential of short fat data
HiPerMAb: A statistical tool for judging the potential of short fat dataHiPerMAb: A statistical tool for judging the potential of short fat data
HiPerMAb: A statistical tool for judging the potential of short fat data
 
Moldable pipelines for CNNs on heterogeneous edge devices
Moldable pipelines for CNNs on heterogeneous edge devicesMoldable pipelines for CNNs on heterogeneous edge devices
Moldable pipelines for CNNs on heterogeneous edge devices
 
Low Energy Task Scheduling based on Work Stealing
Low Energy Task Scheduling based on Work StealingLow Energy Task Scheduling based on Work Stealing
Low Energy Task Scheduling based on Work Stealing
 
Privacy Preserving Cloud Storage - A Rollback Protection Service for Untruste...
Privacy Preserving Cloud Storage - A Rollback Protection Service for Untruste...Privacy Preserving Cloud Storage - A Rollback Protection Service for Untruste...
Privacy Preserving Cloud Storage - A Rollback Protection Service for Untruste...
 
Introducing Generalized Deduplication for Energy-efficient IoT Networks with ...
Introducing Generalized Deduplication for Energy-efficient IoT Networks with ...Introducing Generalized Deduplication for Energy-efficient IoT Networks with ...
Introducing Generalized Deduplication for Energy-efficient IoT Networks with ...
 
SpecFuzz: Bringing Spectre-type vulnerabilities to the surface
SpecFuzz: Bringing Spectre-type vulnerabilities to the surfaceSpecFuzz: Bringing Spectre-type vulnerabilities to the surface
SpecFuzz: Bringing Spectre-type vulnerabilities to the surface
 

Kürzlich hochgeladen

Introduction of DNA analysis in Forensic's .pptx
Introduction of DNA analysis in Forensic's .pptxIntroduction of DNA analysis in Forensic's .pptx
Introduction of DNA analysis in Forensic's .pptxrohankumarsinghrore1
 
Module for Grade 9 for Asynchronous/Distance learning
Module for Grade 9 for Asynchronous/Distance learningModule for Grade 9 for Asynchronous/Distance learning
Module for Grade 9 for Asynchronous/Distance learninglevieagacer
 
300003-World Science Day For Peace And Development.pptx
300003-World Science Day For Peace And Development.pptx300003-World Science Day For Peace And Development.pptx
300003-World Science Day For Peace And Development.pptxryanrooker
 
(May 9, 2024) Enhanced Ultrafast Vector Flow Imaging (VFI) Using Multi-Angle ...
(May 9, 2024) Enhanced Ultrafast Vector Flow Imaging (VFI) Using Multi-Angle ...(May 9, 2024) Enhanced Ultrafast Vector Flow Imaging (VFI) Using Multi-Angle ...
(May 9, 2024) Enhanced Ultrafast Vector Flow Imaging (VFI) Using Multi-Angle ...Scintica Instrumentation
 
biology HL practice questions IB BIOLOGY
biology HL practice questions IB BIOLOGYbiology HL practice questions IB BIOLOGY
biology HL practice questions IB BIOLOGY1301aanya
 
Call Girls Ahmedabad +917728919243 call me Independent Escort Service
Call Girls Ahmedabad +917728919243 call me Independent Escort ServiceCall Girls Ahmedabad +917728919243 call me Independent Escort Service
Call Girls Ahmedabad +917728919243 call me Independent Escort Serviceshivanisharma5244
 
Dr. E. Muralinath_ Blood indices_clinical aspects
Dr. E. Muralinath_ Blood indices_clinical  aspectsDr. E. Muralinath_ Blood indices_clinical  aspects
Dr. E. Muralinath_ Blood indices_clinical aspectsmuralinath2
 
Bacterial Identification and Classifications
Bacterial Identification and ClassificationsBacterial Identification and Classifications
Bacterial Identification and ClassificationsAreesha Ahmad
 
Thyroid Physiology_Dr.E. Muralinath_ Associate Professor
Thyroid Physiology_Dr.E. Muralinath_ Associate ProfessorThyroid Physiology_Dr.E. Muralinath_ Associate Professor
Thyroid Physiology_Dr.E. Muralinath_ Associate Professormuralinath2
 
development of diagnostic enzyme assay to detect leuser virus
development of diagnostic enzyme assay to detect leuser virusdevelopment of diagnostic enzyme assay to detect leuser virus
development of diagnostic enzyme assay to detect leuser virusNazaninKarimi6
 
PSYCHOSOCIAL NEEDS. in nursing II sem pptx
PSYCHOSOCIAL NEEDS. in nursing II sem pptxPSYCHOSOCIAL NEEDS. in nursing II sem pptx
PSYCHOSOCIAL NEEDS. in nursing II sem pptxSuji236384
 
Human genetics..........................pptx
Human genetics..........................pptxHuman genetics..........................pptx
Human genetics..........................pptxSilpa
 
Biogenic Sulfur Gases as Biosignatures on Temperate Sub-Neptune Waterworlds
Biogenic Sulfur Gases as Biosignatures on Temperate Sub-Neptune WaterworldsBiogenic Sulfur Gases as Biosignatures on Temperate Sub-Neptune Waterworlds
Biogenic Sulfur Gases as Biosignatures on Temperate Sub-Neptune WaterworldsSérgio Sacani
 
Grade 7 - Lesson 1 - Microscope and Its Functions
Grade 7 - Lesson 1 - Microscope and Its FunctionsGrade 7 - Lesson 1 - Microscope and Its Functions
Grade 7 - Lesson 1 - Microscope and Its FunctionsOrtegaSyrineMay
 
CURRENT SCENARIO OF POULTRY PRODUCTION IN INDIA
CURRENT SCENARIO OF POULTRY PRODUCTION IN INDIACURRENT SCENARIO OF POULTRY PRODUCTION IN INDIA
CURRENT SCENARIO OF POULTRY PRODUCTION IN INDIADr. TATHAGAT KHOBRAGADE
 
Exploring Criminology and Criminal Behaviour.pdf
Exploring Criminology and Criminal Behaviour.pdfExploring Criminology and Criminal Behaviour.pdf
Exploring Criminology and Criminal Behaviour.pdfrohankumarsinghrore1
 
Digital Dentistry.Digital Dentistryvv.pptx
Digital Dentistry.Digital Dentistryvv.pptxDigital Dentistry.Digital Dentistryvv.pptx
Digital Dentistry.Digital Dentistryvv.pptxMohamedFarag457087
 
Zoology 5th semester notes( Sumit_yadav).pdf
Zoology 5th semester notes( Sumit_yadav).pdfZoology 5th semester notes( Sumit_yadav).pdf
Zoology 5th semester notes( Sumit_yadav).pdfSumit Kumar yadav
 
FAIRSpectra - Enabling the FAIRification of Spectroscopy and Spectrometry
FAIRSpectra - Enabling the FAIRification of Spectroscopy and SpectrometryFAIRSpectra - Enabling the FAIRification of Spectroscopy and Spectrometry
FAIRSpectra - Enabling the FAIRification of Spectroscopy and SpectrometryAlex Henderson
 

Kürzlich hochgeladen (20)

Introduction of DNA analysis in Forensic's .pptx
Introduction of DNA analysis in Forensic's .pptxIntroduction of DNA analysis in Forensic's .pptx
Introduction of DNA analysis in Forensic's .pptx
 
Clean In Place(CIP).pptx .
Clean In Place(CIP).pptx                 .Clean In Place(CIP).pptx                 .
Clean In Place(CIP).pptx .
 
Module for Grade 9 for Asynchronous/Distance learning
Module for Grade 9 for Asynchronous/Distance learningModule for Grade 9 for Asynchronous/Distance learning
Module for Grade 9 for Asynchronous/Distance learning
 
300003-World Science Day For Peace And Development.pptx
300003-World Science Day For Peace And Development.pptx300003-World Science Day For Peace And Development.pptx
300003-World Science Day For Peace And Development.pptx
 
(May 9, 2024) Enhanced Ultrafast Vector Flow Imaging (VFI) Using Multi-Angle ...
(May 9, 2024) Enhanced Ultrafast Vector Flow Imaging (VFI) Using Multi-Angle ...(May 9, 2024) Enhanced Ultrafast Vector Flow Imaging (VFI) Using Multi-Angle ...
(May 9, 2024) Enhanced Ultrafast Vector Flow Imaging (VFI) Using Multi-Angle ...
 
biology HL practice questions IB BIOLOGY
biology HL practice questions IB BIOLOGYbiology HL practice questions IB BIOLOGY
biology HL practice questions IB BIOLOGY
 
Call Girls Ahmedabad +917728919243 call me Independent Escort Service
Call Girls Ahmedabad +917728919243 call me Independent Escort ServiceCall Girls Ahmedabad +917728919243 call me Independent Escort Service
Call Girls Ahmedabad +917728919243 call me Independent Escort Service
 
Dr. E. Muralinath_ Blood indices_clinical aspects
Dr. E. Muralinath_ Blood indices_clinical  aspectsDr. E. Muralinath_ Blood indices_clinical  aspects
Dr. E. Muralinath_ Blood indices_clinical aspects
 
Bacterial Identification and Classifications
Bacterial Identification and ClassificationsBacterial Identification and Classifications
Bacterial Identification and Classifications
 
Thyroid Physiology_Dr.E. Muralinath_ Associate Professor
Thyroid Physiology_Dr.E. Muralinath_ Associate ProfessorThyroid Physiology_Dr.E. Muralinath_ Associate Professor
Thyroid Physiology_Dr.E. Muralinath_ Associate Professor
 
development of diagnostic enzyme assay to detect leuser virus
development of diagnostic enzyme assay to detect leuser virusdevelopment of diagnostic enzyme assay to detect leuser virus
development of diagnostic enzyme assay to detect leuser virus
 
PSYCHOSOCIAL NEEDS. in nursing II sem pptx
PSYCHOSOCIAL NEEDS. in nursing II sem pptxPSYCHOSOCIAL NEEDS. in nursing II sem pptx
PSYCHOSOCIAL NEEDS. in nursing II sem pptx
 
Human genetics..........................pptx
Human genetics..........................pptxHuman genetics..........................pptx
Human genetics..........................pptx
 
Biogenic Sulfur Gases as Biosignatures on Temperate Sub-Neptune Waterworlds
Biogenic Sulfur Gases as Biosignatures on Temperate Sub-Neptune WaterworldsBiogenic Sulfur Gases as Biosignatures on Temperate Sub-Neptune Waterworlds
Biogenic Sulfur Gases as Biosignatures on Temperate Sub-Neptune Waterworlds
 
Grade 7 - Lesson 1 - Microscope and Its Functions
Grade 7 - Lesson 1 - Microscope and Its FunctionsGrade 7 - Lesson 1 - Microscope and Its Functions
Grade 7 - Lesson 1 - Microscope and Its Functions
 
CURRENT SCENARIO OF POULTRY PRODUCTION IN INDIA
CURRENT SCENARIO OF POULTRY PRODUCTION IN INDIACURRENT SCENARIO OF POULTRY PRODUCTION IN INDIA
CURRENT SCENARIO OF POULTRY PRODUCTION IN INDIA
 
Exploring Criminology and Criminal Behaviour.pdf
Exploring Criminology and Criminal Behaviour.pdfExploring Criminology and Criminal Behaviour.pdf
Exploring Criminology and Criminal Behaviour.pdf
 
Digital Dentistry.Digital Dentistryvv.pptx
Digital Dentistry.Digital Dentistryvv.pptxDigital Dentistry.Digital Dentistryvv.pptx
Digital Dentistry.Digital Dentistryvv.pptx
 
Zoology 5th semester notes( Sumit_yadav).pdf
Zoology 5th semester notes( Sumit_yadav).pdfZoology 5th semester notes( Sumit_yadav).pdf
Zoology 5th semester notes( Sumit_yadav).pdf
 
FAIRSpectra - Enabling the FAIRification of Spectroscopy and Spectrometry
FAIRSpectra - Enabling the FAIRification of Spectroscopy and SpectrometryFAIRSpectra - Enabling the FAIRification of Spectroscopy and Spectrometry
FAIRSpectra - Enabling the FAIRification of Spectroscopy and Spectrometry
 

A Software Architecture for Extreme-Scale Big-Data Analytics in Fog Computing Ecosystems

  • 1. “The ELASTIC project has received funding from the European Union's Horizon 2020 research and innovation programme under the grant agreement No 825473” The ELASTIC Project LEGaTO Final Event: Low-Energy Heterogeneous Computing Workshop Eduardo Quiñones eduardo.quinones@bsc.es 9/9/20
  • 2. General Information 9/9/20 2 § ELASTIC: a software architecture for Extreme-scaLe big-data AnalyticS in fog compuTIng eCosystems § Under the scope of the H2020 call ICT-12-2018-2020: Big Data technologies and extreme-scale analytics § 36 month project (starting Dec 2018); 6 million € budget
  • 3. Motivation: The Importance of ELASTIC 9/9/20 3 1. Geographically distributed data sources and data analytics requirements, e.g., smart cities 2. The fulfillment of non-functional properties inherited from the domain: real-time, energy, communications and security 3. Constant increment of volume, variety and velocity of data-sets Data sources Large data-sets Edge computing - Data collection and transfer - Limited computation capabilities Cloud computing - Data storage - High computation capabilities Data Centers Data Analytics Network Latent Data-at-rest analytics Reactive data-in-motion analytics ComputeContinuum A coordination of edge and cloud resources is needed!
  • 4. ELASTIC’s Vision 9/9/20 4 Cloud Computing ComputeContinuum Data sources Data analytics across the compute continuum 1. Significantly increase the capabilities of the data analytics 2. Integrate both responsive data-in-motion and latent data-at-rest analytics 3. Fulfill the non-functional properties inherit from the domain EdgeComputing Large data-sets Network
  • 5. ELASTIC’s Main Contribution 9/9/20 5 Productivity A novel software architecture capable of: 1. Efficiently distribute analytics workloads 2. Combine responsive data-in-motion and latent data-at-rest analytics 3. Fulfill the real-time, energy-efficiency, quality of communications and security properties 4. Use advance parallel and energy-efficiency embedded platforms at edge side + Programmability + Portability/Scalability + Performance Cloud Computing ComputeContinuum Data sources EdgeComputing Large data-sets Network Data analytics across the compute continuum
  • 6. Druid dataClayKafka Security Time/ energy Comm. DeploymentScheduler Nuvla NuvlaBox KonnektBox MQTTCloud (Swarm/K8S) DDAP Fog Platform NFR COMPSs ELASTIC Software Architecture 9/9/20 6 Converging multiple computing areas 1. SoA data-in-motion and data-at-rest analytics solutions supported with a Distributed Data platform (DDAP) 2. Advanced orchestraction methods for complex data-analytics workflow scheduling and deployment 3. Non-functional analysis inherited from the cyber-physical domain to monitor the execution of workflows 4. Fog-based platforms including § Cloud-based Container as a Service (Caas) technologies for resource auto-scaling § IoT cyber-secured communication and network protocols § Advanced highly parallel and energy- efficiency embedded platforms
  • 7. Smart Mobility Use-Case 9/9/20 7 § Test and highlight the benefits of the ELASTIC Software architecture § Deployed on the Florence tramway network (Italy) § Tram vehicles equipped with § Advanced parallel embedded processor architectures § V2X communication § Variety of sensors (cameras, radars/LIDAR, IMU, etc.) ELASTIC-825473 - page 15 of 78 tional analysis tools Cloud and edge run-time services sions (GNU) the SCHED_PREEMPT or the SCHED_DEADLINE ad- dressing timing or the Energy-Aware Scheduling (EAS) framework addressing energy properties. SteelskinPEP (FIWARE) Open-source (GNU) A XACML Policy Enforcement Point (PEP) to work along with Keypass to restrict the access to the Platform Keypass (FIWARE) Open-source (Apache) A flexible multi-tenant XACML server with PAP (Policy Administration Point) and PDP (Policy Detention Point) ca- pabilities, to manage roles and permissions in the platform I Keystone SCIM Open-source (Apache) An identity service (OpenStack Identity API) that provides Single Sign On (SSO) capabilities, covering both Authenti- cation (AuthN) and RBAC Authorisation (AuthZ). From lab to market: ELASTIC applied to the Florence tramway network We have carefully selected a realistic use-case from the smart mobility domain, upon which the ELASTIC software architecture capabilities will be tested and evaluated. Concretely, ELASTIC use case aims to enhance the Florence tramway network as well as its inter- action with the private vehicle transportation in the area of the Metropolitan City of Florence (Italy). To do so, ELASTIC will efficiently process multi- ple and heterogeneous streams of data coming from multiple IoT sensors located along the three lines of the tramway network, and the tram vehi- cles, to extract valuable knowledge with extreme- scale analytics, while fulfilling non-functional properties inherited by the tramway system, i.e. Figure 4. Florence tramway networkFlorence Tramway network Tram vehicle from the Florence Tramway network City of Florence
  • 8. 9/9/20 8 12 Figure 5: Core components of the public access Wi-Fi network are hosted the control centre. 2.1.2 Backbone network The backbone network relies on a fibre optics ring, connecting the core a installed at each stop. The backbone network features a fail-safe configur currently operated at 1 Gbps. The layout of the backbone network is show Figure 6: A fibre optics ring connects the control centre and the sto 2.1.3 Access network The Wi-Fi access network supports the 802.11a/b/g/n protocols connection of common user devices; to this end, a public SSID is publishe gain access to the Internet through a captive portal. Moreover, hidde configured on the network. A typical configuration of the access network one or more access points connected to the LAN switch installed in the ca tramway stop. The typical layout of the access network at a single sto below. Porta al Prato Field cabinet (e.g. pole / semaphore / other) wireless bridge V2X station edge computer traffic control device(s) 3 nected to the LAN switch at each stop. nt possible locations for edge and/or fog lights (figure (a)), lighting poles (figure (b)) (b) ext to the traffic lights; (b) a lighting pole a video camera; (c) cabinet at a stop. er LAN port with PoE output, enabling sors, cameras, etc.) – this could ease the d for the implementation of the ELASTIC use V2X station edge computer traffic control device(s) camera Track cabinet (at stops) 13 Figure 7: Wi-Fi access points are connected to the LAN switch at each stop. The following pictures show the different possible locations for edge and/or fog devices, such as cabinets next to traffic lights (figure (a)), lighting poles (figure (b)) and cabinets at stops (figure (c)). (a) (b) (c) Figure 8: (a) Cabinet hosting devices next to the traffic lights; (b) a lighting pole hosting a Wi-Fi access point and a video camera; (c) cabinet at a stop. Access points feature a 1 Gbps copper LAN port with PoE output, enabling connection of further devices (e.g. sensors, cameras, etc.) – this could ease the installation of additional devices required for the implementation of the ELASTIC use cases. Cloud (GEST depot) T1 Line Wifi edge computers camera NGAP Wifi LTE
  • 9. ELASTIC Use-Cases 9/9/20 9 1. Next Generation Autonomous Positioning (NGAP) and Advanced Driving Assistant System (ADAS) § Autonomously localize tram vehicles to support ADAS functionalities (i.e. obstacle detection and collision avoidance) based on data fusion coming from network and vehicle sensors 2. Predictive maintenance § Monitor the operation of the tramway to identify failures before they happened § Driving optimization based on energy consumption, acceleration and speed 3. Interaction between the public and the private transport in the City of Florence § Enhance the transportation system to better manage interactions between different transportation networks, i.e., public and private
  • 10. Conclusions 9/9/20 10 1. ELASTIC aims to increase development and deployment productivity of systems based on data-analytics by developing a novel software architecture capable of guaranteeing the non-functional properties inherited from the domain 2. ELASTIC aims to increase data analytics capabilities by efficiently combine reactive data-in-motion and latent data- at-rest analytics 3. ELASTIC aims to apply the software architecture to develop a distributed sensing/computing infrastructure within the Florence tramway network for advanced urban mobility applications