SlideShare a Scribd company logo
1 of 33
A Design of
Distributed Storage System
over HTTP
for Collecting Sensor Data
Sayed Ahmad Naweed
Supervisor: Dr. Yokoyama Teruaki
4th June 2016
1
Environmental
Monitoring
Transportation
Industry
Weather
Military
Medical
Intelligent
Transportation
System
Background
2
Application of Sensor
Technology
Environmental
Monitoring
Transportation
Industry
Weather
Military
Medical
3
Collecting Sensor Data
4
Collecting Sensor Data
5
Collecting Sensor Data
6
Collecting Sensor Data
7
Data
Collection
Afghanistan IT Infrastructure
8
Afghanistan National Data
Center (ANDC)
e-Government
e-Commerce
m-Government
Cloud Computing
Sources: http://andc.gov.af/en/page/1098
Possible Image of Sensor
Network in Afghanistan
9
Sensors
ANDC Location
App
App
ANDC
Sensors
DC Location
Sensors
DC Location
App
App
ANDC
Challenges of Data Collection
①Storing sensor
data to a far
distant server
Long Distant
10
Sensors
DC Location
App
App
ANDC
Challenges of Data Collection
②Single Point of
Failure
11
12
Sensors
DC Location
App
App
ANDC
Challenges of Data Collection
③Traffic Congestion
12
Our Proposed Design
13
Copying Data to the Core
Storage
14
Nature of Sensor Data
15
Sensor
Data
Key
Time
Value
1
2
3
Usually sensor data
is stored in time
series format.
(Key, Time, Value)
Data Accessing Mechanism
16
1
Data Accessing Mechanism
2
1
17
2
1
Data Accessing Mechanism
2
1
18
2
1
Data Verification Respond
3
Data Accessing Mechanism
2
1
19
2
1
Data Verification Respond
3
Send Data
4
Advantage of the Proposed
System
1
Data Availability
①Link disconnection
between Core and Edge
Node
20
Advantage of the Proposed
System
1
Data Availability
①Link disconnection
between Core and Edge
Node
②Core Storage failure
21
2
Advantage of the Proposed
System
1
Data Availability
①Link disconnection
between Core and Edge
Node
②Core Storage failure
22
2
Our Contributions
Transferring sensor
data to the far-
distant Core Node
1
23
Core
Storage
Edge
Storage
Sensor
Network
Our Contributions
Developers design
applications by
accessing sensor
data
2
24
Core
Storage
Edge
Storage
Sensor
Network
Originality
Available Systems
Distributed Database
System
• Mostly in one location
inside a SAN
• Requires Consistency
Our System
Distributed Storage
System
• Distributed
geographically in far-
distance places
• No consistency
because of sensor data
25
Limitation
• The CAP theorem:
– Consistency
– Availability
– Partitioning
Trade-off
Availability
Consistency
26
Challenge
27
How do clients
find or switch to a
nearest edge
storage?
Experiment
28
InternetCore
Storage
JapanAfghanistan
cURL
1
Experiment
29
Internet
Edge
Storage
Core
Storage
JapanAfghanistan
cURL
cURL
1
2
Result
30
Internet
Edge
Storage
Core
Storage
JapanAfghanistan
cURL
cURL
4.3
2.5
3.5
4.5
2.2
2
1.2
1
2
0.5
0
0.5
1
1.5
2
2.5
3
3.5
4
4.5
5
8:00 9:00 10:00 11:00 12:00
Data from
core Storage
Data from
Edge Storage
Monday 23rd May 2016
Future Work
31
Future Work
32
P2P Network
Thank you
“Things should be made as simple as possible, but no simpler.”
Albert Einstein
33

More Related Content

Similar to A Design of Distributed Storage System over HTTP for Collecting Sensor Data

A Mobile Sensing Architecture for Massive Urban Scanning
A Mobile Sensing Architecture for Massive Urban ScanningA Mobile Sensing Architecture for Massive Urban Scanning
A Mobile Sensing Architecture for Massive Urban ScanningEuroCloud
 
Io t platform-infotech_arpanpal
Io t platform-infotech_arpanpalIo t platform-infotech_arpanpal
Io t platform-infotech_arpanpalArpan Pal
 
The Live: Stream Computing
The Live: Stream ComputingThe Live: Stream Computing
The Live: Stream ComputingIRJET Journal
 
Powering the Future of Data  
Powering the Future of Data	   Powering the Future of Data	   
Powering the Future of Data  Bilot
 
Neil Sarkar (AdHawk Microsystems): Ultra-Fast Eye Tracking Without Cameras fo...
Neil Sarkar (AdHawk Microsystems): Ultra-Fast Eye Tracking Without Cameras fo...Neil Sarkar (AdHawk Microsystems): Ultra-Fast Eye Tracking Without Cameras fo...
Neil Sarkar (AdHawk Microsystems): Ultra-Fast Eye Tracking Without Cameras fo...AugmentedWorldExpo
 
Smart parking system
Smart parking systemSmart parking system
Smart parking systemEditorIJAERD
 
Platform introduction & Summary
Platform introduction & SummaryPlatform introduction & Summary
Platform introduction & SummaryBigData_Europe
 
A novel real time video and data capture of vehicular accident in intelligent...
A novel real time video and data capture of vehicular accident in intelligent...A novel real time video and data capture of vehicular accident in intelligent...
A novel real time video and data capture of vehicular accident in intelligent...IJCNCJournal
 
On-line IDACS for Embedded Real Time Application
On-line IDACS for Embedded Real Time ApplicationOn-line IDACS for Embedded Real Time Application
On-line IDACS for Embedded Real Time ApplicationAM Publications
 
On-line IDACS for Embedded Real Time Application
On-line IDACS for Embedded Real Time ApplicationOn-line IDACS for Embedded Real Time Application
On-line IDACS for Embedded Real Time ApplicationAM Publications
 
IRJET- IoT based Smart BLACK BOX System
IRJET- IoT based Smart BLACK BOX SystemIRJET- IoT based Smart BLACK BOX System
IRJET- IoT based Smart BLACK BOX SystemIRJET Journal
 
Towards Adaptive Sensor-cloud for Internet of Things
Towards Adaptive Sensor-cloud for Internet of ThingsTowards Adaptive Sensor-cloud for Internet of Things
Towards Adaptive Sensor-cloud for Internet of ThingsTELKOMNIKA JOURNAL
 
Automatic Free Parking Slot Status Intimating System
Automatic Free Parking Slot Status Intimating SystemAutomatic Free Parking Slot Status Intimating System
Automatic Free Parking Slot Status Intimating SystemIRJET Journal
 
MapR Edge : Act Locally Learn Globally
MapR Edge : Act Locally Learn GloballyMapR Edge : Act Locally Learn Globally
MapR Edge : Act Locally Learn Globallyridhav
 
Land vehicle tracking system using java on android platform
Land vehicle tracking system using java on android platformLand vehicle tracking system using java on android platform
Land vehicle tracking system using java on android platformAlexander Decker
 
IRJET- Intelligent Car Parking System commanded by Android Application
IRJET- Intelligent Car Parking System commanded by Android ApplicationIRJET- Intelligent Car Parking System commanded by Android Application
IRJET- Intelligent Car Parking System commanded by Android ApplicationIRJET Journal
 
Overcoming the AIoT Obstacles through Smart Component Integration
Overcoming the AIoT Obstacles through Smart Component IntegrationOvercoming the AIoT Obstacles through Smart Component Integration
Overcoming the AIoT Obstacles through Smart Component IntegrationInnodisk Corporation
 
Arpan pal icdcn
Arpan pal icdcnArpan pal icdcn
Arpan pal icdcnArpan Pal
 

Similar to A Design of Distributed Storage System over HTTP for Collecting Sensor Data (20)

A Mobile Sensing Architecture for Massive Urban Scanning
A Mobile Sensing Architecture for Massive Urban ScanningA Mobile Sensing Architecture for Massive Urban Scanning
A Mobile Sensing Architecture for Massive Urban Scanning
 
Io t platform-infotech_arpanpal
Io t platform-infotech_arpanpalIo t platform-infotech_arpanpal
Io t platform-infotech_arpanpal
 
The Live: Stream Computing
The Live: Stream ComputingThe Live: Stream Computing
The Live: Stream Computing
 
Powering the Future of Data  
Powering the Future of Data	   Powering the Future of Data	   
Powering the Future of Data  
 
Neil Sarkar (AdHawk Microsystems): Ultra-Fast Eye Tracking Without Cameras fo...
Neil Sarkar (AdHawk Microsystems): Ultra-Fast Eye Tracking Without Cameras fo...Neil Sarkar (AdHawk Microsystems): Ultra-Fast Eye Tracking Without Cameras fo...
Neil Sarkar (AdHawk Microsystems): Ultra-Fast Eye Tracking Without Cameras fo...
 
SSG4Env EGU2010
SSG4Env EGU2010SSG4Env EGU2010
SSG4Env EGU2010
 
Smart parking system
Smart parking systemSmart parking system
Smart parking system
 
Platform introduction & Summary
Platform introduction & SummaryPlatform introduction & Summary
Platform introduction & Summary
 
A novel real time video and data capture of vehicular accident in intelligent...
A novel real time video and data capture of vehicular accident in intelligent...A novel real time video and data capture of vehicular accident in intelligent...
A novel real time video and data capture of vehicular accident in intelligent...
 
On-line IDACS for Embedded Real Time Application
On-line IDACS for Embedded Real Time ApplicationOn-line IDACS for Embedded Real Time Application
On-line IDACS for Embedded Real Time Application
 
On-line IDACS for Embedded Real Time Application
On-line IDACS for Embedded Real Time ApplicationOn-line IDACS for Embedded Real Time Application
On-line IDACS for Embedded Real Time Application
 
IRJET- IoT based Smart BLACK BOX System
IRJET- IoT based Smart BLACK BOX SystemIRJET- IoT based Smart BLACK BOX System
IRJET- IoT based Smart BLACK BOX System
 
Towards Adaptive Sensor-cloud for Internet of Things
Towards Adaptive Sensor-cloud for Internet of ThingsTowards Adaptive Sensor-cloud for Internet of Things
Towards Adaptive Sensor-cloud for Internet of Things
 
Automatic Free Parking Slot Status Intimating System
Automatic Free Parking Slot Status Intimating SystemAutomatic Free Parking Slot Status Intimating System
Automatic Free Parking Slot Status Intimating System
 
MapR Edge : Act Locally Learn Globally
MapR Edge : Act Locally Learn GloballyMapR Edge : Act Locally Learn Globally
MapR Edge : Act Locally Learn Globally
 
Land vehicle tracking system using java on android platform
Land vehicle tracking system using java on android platformLand vehicle tracking system using java on android platform
Land vehicle tracking system using java on android platform
 
IRJET- Intelligent Car Parking System commanded by Android Application
IRJET- Intelligent Car Parking System commanded by Android ApplicationIRJET- Intelligent Car Parking System commanded by Android Application
IRJET- Intelligent Car Parking System commanded by Android Application
 
Overcoming the AIoT Obstacles through Smart Component Integration
Overcoming the AIoT Obstacles through Smart Component IntegrationOvercoming the AIoT Obstacles through Smart Component Integration
Overcoming the AIoT Obstacles through Smart Component Integration
 
Sub1590
Sub1590Sub1590
Sub1590
 
Arpan pal icdcn
Arpan pal icdcnArpan pal icdcn
Arpan pal icdcn
 

Recently uploaded

Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, AdobeApidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobeapidays
 
FWD Group - Insurer Innovation Award 2024
FWD Group - Insurer Innovation Award 2024FWD Group - Insurer Innovation Award 2024
FWD Group - Insurer Innovation Award 2024The Digital Insurer
 
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...Drew Madelung
 
Artificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : UncertaintyArtificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : UncertaintyKhushali Kathiriya
 
DBX First Quarter 2024 Investor Presentation
DBX First Quarter 2024 Investor PresentationDBX First Quarter 2024 Investor Presentation
DBX First Quarter 2024 Investor PresentationDropbox
 
Why Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire businessWhy Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire businesspanagenda
 
"I see eyes in my soup": How Delivery Hero implemented the safety system for ...
"I see eyes in my soup": How Delivery Hero implemented the safety system for ..."I see eyes in my soup": How Delivery Hero implemented the safety system for ...
"I see eyes in my soup": How Delivery Hero implemented the safety system for ...Zilliz
 
2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...Martijn de Jong
 
Data Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonData Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonAnna Loughnan Colquhoun
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerThousandEyes
 
Apidays Singapore 2024 - Scalable LLM APIs for AI and Generative AI Applicati...
Apidays Singapore 2024 - Scalable LLM APIs for AI and Generative AI Applicati...Apidays Singapore 2024 - Scalable LLM APIs for AI and Generative AI Applicati...
Apidays Singapore 2024 - Scalable LLM APIs for AI and Generative AI Applicati...apidays
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FMESafe Software
 
TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data DiscoveryTrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data DiscoveryTrustArc
 
Manulife - Insurer Transformation Award 2024
Manulife - Insurer Transformation Award 2024Manulife - Insurer Transformation Award 2024
Manulife - Insurer Transformation Award 2024The Digital Insurer
 
Corporate and higher education May webinar.pptx
Corporate and higher education May webinar.pptxCorporate and higher education May webinar.pptx
Corporate and higher education May webinar.pptxRustici Software
 
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost SavingRepurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost SavingEdi Saputra
 
GenAI Risks & Security Meetup 01052024.pdf
GenAI Risks & Security Meetup 01052024.pdfGenAI Risks & Security Meetup 01052024.pdf
GenAI Risks & Security Meetup 01052024.pdflior mazor
 
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law DevelopmentsTrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law DevelopmentsTrustArc
 
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...Jeffrey Haguewood
 
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...apidays
 

Recently uploaded (20)

Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, AdobeApidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
 
FWD Group - Insurer Innovation Award 2024
FWD Group - Insurer Innovation Award 2024FWD Group - Insurer Innovation Award 2024
FWD Group - Insurer Innovation Award 2024
 
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
 
Artificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : UncertaintyArtificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : Uncertainty
 
DBX First Quarter 2024 Investor Presentation
DBX First Quarter 2024 Investor PresentationDBX First Quarter 2024 Investor Presentation
DBX First Quarter 2024 Investor Presentation
 
Why Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire businessWhy Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire business
 
"I see eyes in my soup": How Delivery Hero implemented the safety system for ...
"I see eyes in my soup": How Delivery Hero implemented the safety system for ..."I see eyes in my soup": How Delivery Hero implemented the safety system for ...
"I see eyes in my soup": How Delivery Hero implemented the safety system for ...
 
2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...
 
Data Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonData Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt Robison
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected Worker
 
Apidays Singapore 2024 - Scalable LLM APIs for AI and Generative AI Applicati...
Apidays Singapore 2024 - Scalable LLM APIs for AI and Generative AI Applicati...Apidays Singapore 2024 - Scalable LLM APIs for AI and Generative AI Applicati...
Apidays Singapore 2024 - Scalable LLM APIs for AI and Generative AI Applicati...
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
 
TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data DiscoveryTrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
 
Manulife - Insurer Transformation Award 2024
Manulife - Insurer Transformation Award 2024Manulife - Insurer Transformation Award 2024
Manulife - Insurer Transformation Award 2024
 
Corporate and higher education May webinar.pptx
Corporate and higher education May webinar.pptxCorporate and higher education May webinar.pptx
Corporate and higher education May webinar.pptx
 
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost SavingRepurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
 
GenAI Risks & Security Meetup 01052024.pdf
GenAI Risks & Security Meetup 01052024.pdfGenAI Risks & Security Meetup 01052024.pdf
GenAI Risks & Security Meetup 01052024.pdf
 
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law DevelopmentsTrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
 
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
 
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
 

A Design of Distributed Storage System over HTTP for Collecting Sensor Data

Editor's Notes

  1. How clients switch to the edge nodes.