SlideShare ist ein Scribd-Unternehmen logo
1 von 23
Downloaden Sie, um offline zu lesen
Using Linked Data in a
Heterogeneous Sensor Web:
Challenges, Experiments and
Lessons Learned

Liang Yu and Yong Liu

{liangyu, yongliu}@ncsa.illinois.edu



       National Center for Supercomputing Applications
       University of Illinois at Urbana-Champaign
Outline

   Ø Motivation and Goal
   Ø Using Linked Data for Integration
   Ø Services for Consuming Linked Data
   Ø An Example: Visualization
   Ø Conclusion and Future Work




Imaginations unbound
Motivation

   •  Interoperability as a grand challenge in a Virtual
      Environmental Observatory
        •  The need to integrating different sensor data, citizen sensing,
           and other geospatial data etc.
            •  e.g., all river gage height values from all gages in Illinois
               between 1st May and 3rd May 2011.
   •  A heterogeneous Sensor Web is a reality
        •  Different protocols and formats, unknown semantics and no
           links.
   •  A paradigm shift: using Linked Data to build a Linked
      Sensor Web
        •  Linked data has the potential to provide a solution: URI naming
           system, HTTP protocol, RDF, links to other resources.
             •  E.g. an OGC SOS usually has no links to other resources
Imaginations unbound
Objective: Data Integration in a Virtual
   Environmental Observatory


                                WaterML




Imaginations unbound
Outline

   Ø Motivation and Goal
   Ø Using Linked Data for Integration
   Ø Services for Consuming Linked Data
   Ø An Example: Visualization
   Ø Conclusion and Future Work




Imaginations unbound
A Simplified View of Linked Data

   •  Obtain sensors and observation data from sensors in
      Illinois

                                           Sensors            Data
           States          Illinois
                                           in Illinois       Stream



http://                                          http://
sensorweb.ncsa.uiuc.edu/                         sensorweb.ncsa.uiuc.edu/api/
data/map/state/USGS/ Illinois                    sensordata/observations?
                                                 observedBy.within=http://
                                                 sensorweb.ncsa.uiuc.edu/data/
                                                 map/state/USGS/Illinois
             http://sensorweb.ncsa.uiuc.edu/api/
             sensordata/sites?within=http://
             sensorweb.ncsa.uiuc.edu/data/map/state/
             USGS/Illinois

Imaginations unbound
Key Challenges

   •  Publishing Linked Data
        •  Re-publishing existing plain data to semantically linked data.
        •  Linking potentially “linkable data” together and enabling complex
           queries in a heterogeneous Sensor Web.
   •  Consuming Linked Data
        •  Serving data in an OGC RESTful SOS-like service.
        •  Tracking the provenance of Linked Data to facilitate trust and
           validation.




Imaginations unbound
Workflow of Publishing and Consuming
   Linked Data


Raw Data                Linked Data       Linked Data




                                  Geometric
           Tools                   Analysis
                                                        LDA




                       Ontology


Imaginations unbound
Republishing Data to RDF (1)

   •  Use XML as an intermediate format
        •  All non-XML data (Shapefile, Excel) are transformed to XML.
   •  Use XSLT to convert intermediate XML to RDF/XML
        •  Three different annotations are implemented in XSLT
            •  semantic annotation (rdf:type)
            •  outgoing links (to DBPedia), and
            •  provenance.
        •  Both syntactic transformations and semantic annotations are
           performed




Imaginations unbound
Republishing Data to RDF (2)




           provenance



                        Outgoing
                          link




rdf:type




Imaginations unbound
Using Multiple Ontologies




Imaginations unbound
Creating Links by Geometric Analysis (1)
   •  To discover and create links between entities based on
      their spatial attributes.
        •  Different from previous work
            •  E.g.: http://www4.wiwiss.fu-berlin.de/bizer/silk/
   •  Tools: Geotools (Java).




Imaginations unbound
Creating Links by Geometric Analysis (2)




Imaginations unbound
Provenance in Linked Data

   •  Where did the data come from? How were they
      processed?
   •  Using Open Provenance Model (OPM)

                 Observation       opmo:wasDerivedFromStar




                  ssn:observedBy        opmo:WasGeneratedBy


                       Sensor      opmo:wasDerivedFromStar




  <ssn:observedBy rdf:resource="http://sensorweb.ncsa.uiuc.edu/data/sensordata/sites/CUAHSI/
  NWIS/03339000"/>
  <opmo:wasDerivedFromStar rdf:resource="http://waterservices.usgs.gov/nwis/iv"/>




Imaginations unbound
Outline

   Ø Motivation and Goal
   Ø Using Linked Data for Integration
   Ø Services for Consuming Linked Data
   Ø An Example: Visualization
   Ø Conclusion and Future Work




Imaginations unbound
Developing SOS with Linked Data API (1)

   •  An OGC RESTful SOS-like service over the integrated
      linked data
        •  Can be accessed by simple URLs.
        •  Is as flexible as SPARQL but with simpler syntax.
  q  Feature of Interest (
      http://sensorweb.ncsa.uiuc.edu/data/map/watershed/USGS/2009_0)
  q  Single sensor site
      (
      http://sensorweb.ncsa.uiuc.edu/data/sensordata/sites/CUAHSI/EPA/
      MWRDSTOR:WW_39)
  q  Collection of sensor sites
      (http://sensorweb.ncsa.uiuc.edu/api/sensordata/sites)
  q  Single observation (
      http://sensorweb.ncsa.uiuc.edu/data/event/hail/noaa/
      2010/10908_2010-12-31T22:40:00)
  q  Collection of observations (
      http://sensorweb.ncsa.uiuc.edu/api/sensordata/observations)
Imaginations unbound
Developing SOS with Linked Data API (2)
    •    Obtain all the sensor sites within Illinois state.
          •    http://sensorweb.ncsa.uiuc.edu/api/sensordata/sites?within=http://sensorweb.ncsa.uiuc.edu/data/
               map/state/USGS/Illinois



       items": [
       {"_about": "
       http://sensorweb.ncsa.uiuc.edu/data/sensordata/sites/CUAHSI/EPA/MWRDSTOR:WW_39",
       "hasCode": "MWRDSTOR:WW 39",
       "hasLocation": {
                    "lat": 41.88185119628906,
                    "long": -87.63558197021484,
                    "type": "http://www.w3.org/2003/01/geo/wgs84_pos#Point"},
                    "hasName": "South Branch Chicago River @ Madison St.",
                    "hasNetwork": "
                    http://sensorweb.ncsa.uiuc.edu/data/sensordata/network/CUAHSI/EPA",
                    "hasStream": "
                    http://sensorweb.ncsa.uiuc.edu/api/sensordata/observations?observedBy=http://
                    sensorweb.ncsa.uiuc.edu/data/sensordata/sites/CUAHSI/EPA/
                    MWRDSTOR:WW_39",
                    "type": "Sensor",
                    "wasDerivedFromStar": "http://water.sdsc.edu/waterOneFlow/",
                    "within": ["
                    http://sensorweb.ncsa.uiuc.edu/data/map/county/USGS/Cook_County,_IL","
                    http://sensorweb.ncsa.uiuc.edu/data/map/state/USGS/Illinois","
                    http://sensorweb.ncsa.uiuc.edu/data/map/watershed/USGS/2009_2627"]},
Imaginations unbound
Outline

   Ø Motivation and Goal
   Ø Using Linked Data for Integration
   Ø Services for Consuming Linked Data
   Ø An Example: Visualization
   Ø Conclusion and Future Work




Imaginations unbound
An Example Application (Visualization of
   SOS Results)
   •    Visualization Platform: WWT (World Wide Telescope)|Earth
   •    Sensor Data: river gage height values produced by gages in Illinois between
        2011-05-01 and 2011-05-03.
         q    http://sensorweb.ncsa.uiuc.edu/api/sensordata/observations?observedBy.within=http://
               sensorweb.ncsa.uiuc.edu/data/map/state/USGS/Illinois&_sort=observationResultTime.inXSDDateTime&min-
               observationResultTime.inXSDDateTime=2011-05-01T00:00:00-05:00&_page=0&max-
               observationResultTime.inXSDDateTime=2011-05-03T00:00:00-05:00&observedProperty=http://
               sensorweb.ncsa.uiuc.edu/data/property/USGS/NWIS:UnitValues/00065




Imaginations unbound
Outline

   Ø Motivation and Goal
   Ø Using Linked Data for Integration
   Ø Services for Consuming Linked Data
   Ø An Example: Visualization
   Ø Conclusion and Future Work




Imaginations unbound
Conclusion

   •  A “Linked Sensor Web” solution for integrating
      heterogeneous sensor data sources and geospatial data.
        •  A best practice of using W3C SSN ontology as well as other
           domain ontologies.
        •  A method to discover and create links among spatial data.
        •  Using Linked Data API to provide OGC RESTful SOS-like
           services
            •  http://sensorweb.ncsa.uiuc.edu/api-list.html
        •  Tracking provenance data and managing them using OPM.




Imaginations unbound
Future Work


   •    Towards Linked Geostreaming Data
   •    Tuning the performance
   •    Facilitating searching and crawling of Linked data
   •    End-to-end provenance management




Imaginations unbound
Acknowledgements

   Ø Microsoft Research Connections
        Ø  “Environmental Informatics” Program
   Ø  Institute for Advanced Computing Applications and
       Technologies at the University of Illinois at Urbana-
       Champaign
        Ø  “Virtual Observatory for Sustainability of Intensively Managed
            Environmental Systems” Project




Imaginations unbound

Weitere ähnliche Inhalte

Ähnlich wie Using linked data in a heterogeneous sensor web: Challenges, experiments and lessons learned

Professor Dame Wendy Hall - Saving the Web
Professor Dame Wendy Hall - Saving the WebProfessor Dame Wendy Hall - Saving the Web
Professor Dame Wendy Hall - Saving the WebRamine Tinati
 
Escaping Flatland: Interactive High-Dimensional Data Analysis in Drug Discove...
Escaping Flatland: Interactive High-Dimensional Data Analysis in Drug Discove...Escaping Flatland: Interactive High-Dimensional Data Analysis in Drug Discove...
Escaping Flatland: Interactive High-Dimensional Data Analysis in Drug Discove...Spark Summit
 
Smarter Data for Smarter Libraries
Smarter Data for Smarter LibrariesSmarter Data for Smarter Libraries
Smarter Data for Smarter LibrariesOCLC
 
In search of lost knowledge: joining the dots with Linked Data
In search of lost knowledge: joining the dots with Linked DataIn search of lost knowledge: joining the dots with Linked Data
In search of lost knowledge: joining the dots with Linked Datajonblower
 
Social Semantic (Sensor) Web
Social Semantic (Sensor) WebSocial Semantic (Sensor) Web
Social Semantic (Sensor) WebDavid Crowley
 
#2 NCI data services - Fair data webinar 6 Sept 2017
#2 NCI data services - Fair data webinar 6 Sept 2017#2 NCI data services - Fair data webinar 6 Sept 2017
#2 NCI data services - Fair data webinar 6 Sept 2017ARDC
 
Talk at OHSU, September 25, 2013
Talk at OHSU, September 25, 2013Talk at OHSU, September 25, 2013
Talk at OHSU, September 25, 2013Anita de Waard
 
Meeting Federal Research Requirements
Meeting Federal Research RequirementsMeeting Federal Research Requirements
Meeting Federal Research RequirementsICPSR
 
Accelerating Data-driven Discovery in Energy Science
Accelerating Data-driven Discovery in Energy ScienceAccelerating Data-driven Discovery in Energy Science
Accelerating Data-driven Discovery in Energy ScienceIan Foster
 
Globus for Data Management: 2014 Joint Facility User Forum
Globus for Data Management: 2014 Joint Facility User ForumGlobus for Data Management: 2014 Joint Facility User Forum
Globus for Data Management: 2014 Joint Facility User ForumGlobus
 
Linked data and Semantic Web Applications for Libraries
Linked data and Semantic Web Applications for LibrariesLinked data and Semantic Web Applications for Libraries
Linked data and Semantic Web Applications for LibrariesVikas Bhushan
 
EarthCube Monthly Community Webinar- Nov. 22, 2013
EarthCube Monthly Community Webinar- Nov. 22, 2013EarthCube Monthly Community Webinar- Nov. 22, 2013
EarthCube Monthly Community Webinar- Nov. 22, 2013EarthCube
 
FAIR Software (and Data) Citation: Europe, Research Object Systems, Networks ...
FAIR Software (and Data) Citation: Europe, Research Object Systems, Networks ...FAIR Software (and Data) Citation: Europe, Research Object Systems, Networks ...
FAIR Software (and Data) Citation: Europe, Research Object Systems, Networks ...Carole Goble
 
WORLDMAP: A SPATIAL INFRASTRUCTURE TO SUPPORT TEACHING AND RESEARCH (BROWN BA...
WORLDMAP: A SPATIAL INFRASTRUCTURE TO SUPPORT TEACHING AND RESEARCH (BROWN BA...WORLDMAP: A SPATIAL INFRASTRUCTURE TO SUPPORT TEACHING AND RESEARCH (BROWN BA...
WORLDMAP: A SPATIAL INFRASTRUCTURE TO SUPPORT TEACHING AND RESEARCH (BROWN BA...Micah Altman
 
Tackling variety in event based systems
Tackling variety in event based systemsTackling variety in event based systems
Tackling variety in event based systemsSouleiman Hasan
 
GENI Engineering Conference -- Ian Foster
GENI Engineering Conference -- Ian FosterGENI Engineering Conference -- Ian Foster
GENI Engineering Conference -- Ian FosterIan Foster
 
2013 04-29 american art collaborative lod meeting - washington dc - web
2013 04-29 american art collaborative lod meeting - washington dc - web2013 04-29 american art collaborative lod meeting - washington dc - web
2013 04-29 american art collaborative lod meeting - washington dc - weblecmaj
 

Ähnlich wie Using linked data in a heterogeneous sensor web: Challenges, experiments and lessons learned (20)

Professor Dame Wendy Hall - Saving the Web
Professor Dame Wendy Hall - Saving the WebProfessor Dame Wendy Hall - Saving the Web
Professor Dame Wendy Hall - Saving the Web
 
Escaping Flatland: Interactive High-Dimensional Data Analysis in Drug Discove...
Escaping Flatland: Interactive High-Dimensional Data Analysis in Drug Discove...Escaping Flatland: Interactive High-Dimensional Data Analysis in Drug Discove...
Escaping Flatland: Interactive High-Dimensional Data Analysis in Drug Discove...
 
Smarter Data for Smarter Libraries
Smarter Data for Smarter LibrariesSmarter Data for Smarter Libraries
Smarter Data for Smarter Libraries
 
In search of lost knowledge: joining the dots with Linked Data
In search of lost knowledge: joining the dots with Linked DataIn search of lost knowledge: joining the dots with Linked Data
In search of lost knowledge: joining the dots with Linked Data
 
Social Semantic (Sensor) Web
Social Semantic (Sensor) WebSocial Semantic (Sensor) Web
Social Semantic (Sensor) Web
 
Lapis Guides
Lapis GuidesLapis Guides
Lapis Guides
 
#2 NCI data services - Fair data webinar 6 Sept 2017
#2 NCI data services - Fair data webinar 6 Sept 2017#2 NCI data services - Fair data webinar 6 Sept 2017
#2 NCI data services - Fair data webinar 6 Sept 2017
 
Enabling Citizen-empowered Apps over Linked Data
Enabling Citizen-empowered Apps over Linked DataEnabling Citizen-empowered Apps over Linked Data
Enabling Citizen-empowered Apps over Linked Data
 
Talk at OHSU, September 25, 2013
Talk at OHSU, September 25, 2013Talk at OHSU, September 25, 2013
Talk at OHSU, September 25, 2013
 
Meeting Federal Research Requirements
Meeting Federal Research RequirementsMeeting Federal Research Requirements
Meeting Federal Research Requirements
 
Accelerating Data-driven Discovery in Energy Science
Accelerating Data-driven Discovery in Energy ScienceAccelerating Data-driven Discovery in Energy Science
Accelerating Data-driven Discovery in Energy Science
 
"In the Early Days of a Better Nation": Enhancing the power of metadata today...
"In the Early Days of a Better Nation": Enhancing the power of metadata today..."In the Early Days of a Better Nation": Enhancing the power of metadata today...
"In the Early Days of a Better Nation": Enhancing the power of metadata today...
 
Globus for Data Management: 2014 Joint Facility User Forum
Globus for Data Management: 2014 Joint Facility User ForumGlobus for Data Management: 2014 Joint Facility User Forum
Globus for Data Management: 2014 Joint Facility User Forum
 
Linked data and Semantic Web Applications for Libraries
Linked data and Semantic Web Applications for LibrariesLinked data and Semantic Web Applications for Libraries
Linked data and Semantic Web Applications for Libraries
 
EarthCube Monthly Community Webinar- Nov. 22, 2013
EarthCube Monthly Community Webinar- Nov. 22, 2013EarthCube Monthly Community Webinar- Nov. 22, 2013
EarthCube Monthly Community Webinar- Nov. 22, 2013
 
FAIR Software (and Data) Citation: Europe, Research Object Systems, Networks ...
FAIR Software (and Data) Citation: Europe, Research Object Systems, Networks ...FAIR Software (and Data) Citation: Europe, Research Object Systems, Networks ...
FAIR Software (and Data) Citation: Europe, Research Object Systems, Networks ...
 
WORLDMAP: A SPATIAL INFRASTRUCTURE TO SUPPORT TEACHING AND RESEARCH (BROWN BA...
WORLDMAP: A SPATIAL INFRASTRUCTURE TO SUPPORT TEACHING AND RESEARCH (BROWN BA...WORLDMAP: A SPATIAL INFRASTRUCTURE TO SUPPORT TEACHING AND RESEARCH (BROWN BA...
WORLDMAP: A SPATIAL INFRASTRUCTURE TO SUPPORT TEACHING AND RESEARCH (BROWN BA...
 
Tackling variety in event based systems
Tackling variety in event based systemsTackling variety in event based systems
Tackling variety in event based systems
 
GENI Engineering Conference -- Ian Foster
GENI Engineering Conference -- Ian FosterGENI Engineering Conference -- Ian Foster
GENI Engineering Conference -- Ian Foster
 
2013 04-29 american art collaborative lod meeting - washington dc - web
2013 04-29 american art collaborative lod meeting - washington dc - web2013 04-29 american art collaborative lod meeting - washington dc - web
2013 04-29 american art collaborative lod meeting - washington dc - web
 

Mehr von Cybera Inc.

Cyber Summit 2016: Technology, Education, and Democracy
Cyber Summit 2016: Technology, Education, and DemocracyCyber Summit 2016: Technology, Education, and Democracy
Cyber Summit 2016: Technology, Education, and DemocracyCybera Inc.
 
Cyber Summit 2016: Understanding Users' (In)Secure Behaviour
Cyber Summit 2016: Understanding Users' (In)Secure BehaviourCyber Summit 2016: Understanding Users' (In)Secure Behaviour
Cyber Summit 2016: Understanding Users' (In)Secure BehaviourCybera Inc.
 
Cyber Summit 2016: Insider Threat Indicators: Human Behaviour
Cyber Summit 2016: Insider Threat Indicators: Human BehaviourCyber Summit 2016: Insider Threat Indicators: Human Behaviour
Cyber Summit 2016: Insider Threat Indicators: Human BehaviourCybera Inc.
 
Cyber Summit 2016: Research Data and the Canadian Innovation Challenge
Cyber Summit 2016: Research Data and the Canadian Innovation ChallengeCyber Summit 2016: Research Data and the Canadian Innovation Challenge
Cyber Summit 2016: Research Data and the Canadian Innovation ChallengeCybera Inc.
 
Cyber Summit 2016: Knowing More and Understanding Less in the Age of Big Data
Cyber Summit 2016: Knowing More and Understanding Less in the Age of Big DataCyber Summit 2016: Knowing More and Understanding Less in the Age of Big Data
Cyber Summit 2016: Knowing More and Understanding Less in the Age of Big DataCybera Inc.
 
Cyber Summit 2016: Privacy Issues in Big Data Sharing and Reuse
Cyber Summit 2016: Privacy Issues in Big Data Sharing and ReuseCyber Summit 2016: Privacy Issues in Big Data Sharing and Reuse
Cyber Summit 2016: Privacy Issues in Big Data Sharing and ReuseCybera Inc.
 
Cyber Summit 2016: Establishing an Ethics Framework for Predictive Analytics ...
Cyber Summit 2016: Establishing an Ethics Framework for Predictive Analytics ...Cyber Summit 2016: Establishing an Ethics Framework for Predictive Analytics ...
Cyber Summit 2016: Establishing an Ethics Framework for Predictive Analytics ...Cybera Inc.
 
Cyber Summit 2016: The Data Tsunami vs The Network: How More Data Changes Eve...
Cyber Summit 2016: The Data Tsunami vs The Network: How More Data Changes Eve...Cyber Summit 2016: The Data Tsunami vs The Network: How More Data Changes Eve...
Cyber Summit 2016: The Data Tsunami vs The Network: How More Data Changes Eve...Cybera Inc.
 
Cyber Summit 2016: Issues and Challenges Facing Municipalities In Securing Data
Cyber Summit 2016: Issues and Challenges Facing Municipalities In Securing DataCyber Summit 2016: Issues and Challenges Facing Municipalities In Securing Data
Cyber Summit 2016: Issues and Challenges Facing Municipalities In Securing DataCybera Inc.
 
Cyber Summit 2016: Using Law Responsibly: What Happens When Law Meets Technol...
Cyber Summit 2016: Using Law Responsibly: What Happens When Law Meets Technol...Cyber Summit 2016: Using Law Responsibly: What Happens When Law Meets Technol...
Cyber Summit 2016: Using Law Responsibly: What Happens When Law Meets Technol...Cybera Inc.
 
Privacy, Security & Access to Data
Privacy, Security & Access to DataPrivacy, Security & Access to Data
Privacy, Security & Access to DataCybera Inc.
 
Do Universities Dream of Big Data
Do Universities Dream of Big DataDo Universities Dream of Big Data
Do Universities Dream of Big DataCybera Inc.
 
Predicting the Future With Microsoft Bing
Predicting the Future With Microsoft BingPredicting the Future With Microsoft Bing
Predicting the Future With Microsoft BingCybera Inc.
 
Analytics 101: How to not fail at analytics
Analytics 101: How to not fail at analyticsAnalytics 101: How to not fail at analytics
Analytics 101: How to not fail at analyticsCybera Inc.
 
Are MOOC's past their peak?
Are MOOC's past their peak?Are MOOC's past their peak?
Are MOOC's past their peak?Cybera Inc.
 
Opening the doors of the laboratory
Opening the doors of the laboratoryOpening the doors of the laboratory
Opening the doors of the laboratoryCybera Inc.
 
Open City - Edmonton
Open City - EdmontonOpen City - Edmonton
Open City - EdmontonCybera Inc.
 
Unlocking the power of healthcare data
Unlocking the power of healthcare dataUnlocking the power of healthcare data
Unlocking the power of healthcare dataCybera Inc.
 
Checking in on Healthcare Data Analytics
Checking in on Healthcare Data AnalyticsChecking in on Healthcare Data Analytics
Checking in on Healthcare Data AnalyticsCybera Inc.
 
Open access and open data: international trends and strategic context
Open access and open data: international trends and strategic contextOpen access and open data: international trends and strategic context
Open access and open data: international trends and strategic contextCybera Inc.
 

Mehr von Cybera Inc. (20)

Cyber Summit 2016: Technology, Education, and Democracy
Cyber Summit 2016: Technology, Education, and DemocracyCyber Summit 2016: Technology, Education, and Democracy
Cyber Summit 2016: Technology, Education, and Democracy
 
Cyber Summit 2016: Understanding Users' (In)Secure Behaviour
Cyber Summit 2016: Understanding Users' (In)Secure BehaviourCyber Summit 2016: Understanding Users' (In)Secure Behaviour
Cyber Summit 2016: Understanding Users' (In)Secure Behaviour
 
Cyber Summit 2016: Insider Threat Indicators: Human Behaviour
Cyber Summit 2016: Insider Threat Indicators: Human BehaviourCyber Summit 2016: Insider Threat Indicators: Human Behaviour
Cyber Summit 2016: Insider Threat Indicators: Human Behaviour
 
Cyber Summit 2016: Research Data and the Canadian Innovation Challenge
Cyber Summit 2016: Research Data and the Canadian Innovation ChallengeCyber Summit 2016: Research Data and the Canadian Innovation Challenge
Cyber Summit 2016: Research Data and the Canadian Innovation Challenge
 
Cyber Summit 2016: Knowing More and Understanding Less in the Age of Big Data
Cyber Summit 2016: Knowing More and Understanding Less in the Age of Big DataCyber Summit 2016: Knowing More and Understanding Less in the Age of Big Data
Cyber Summit 2016: Knowing More and Understanding Less in the Age of Big Data
 
Cyber Summit 2016: Privacy Issues in Big Data Sharing and Reuse
Cyber Summit 2016: Privacy Issues in Big Data Sharing and ReuseCyber Summit 2016: Privacy Issues in Big Data Sharing and Reuse
Cyber Summit 2016: Privacy Issues in Big Data Sharing and Reuse
 
Cyber Summit 2016: Establishing an Ethics Framework for Predictive Analytics ...
Cyber Summit 2016: Establishing an Ethics Framework for Predictive Analytics ...Cyber Summit 2016: Establishing an Ethics Framework for Predictive Analytics ...
Cyber Summit 2016: Establishing an Ethics Framework for Predictive Analytics ...
 
Cyber Summit 2016: The Data Tsunami vs The Network: How More Data Changes Eve...
Cyber Summit 2016: The Data Tsunami vs The Network: How More Data Changes Eve...Cyber Summit 2016: The Data Tsunami vs The Network: How More Data Changes Eve...
Cyber Summit 2016: The Data Tsunami vs The Network: How More Data Changes Eve...
 
Cyber Summit 2016: Issues and Challenges Facing Municipalities In Securing Data
Cyber Summit 2016: Issues and Challenges Facing Municipalities In Securing DataCyber Summit 2016: Issues and Challenges Facing Municipalities In Securing Data
Cyber Summit 2016: Issues and Challenges Facing Municipalities In Securing Data
 
Cyber Summit 2016: Using Law Responsibly: What Happens When Law Meets Technol...
Cyber Summit 2016: Using Law Responsibly: What Happens When Law Meets Technol...Cyber Summit 2016: Using Law Responsibly: What Happens When Law Meets Technol...
Cyber Summit 2016: Using Law Responsibly: What Happens When Law Meets Technol...
 
Privacy, Security & Access to Data
Privacy, Security & Access to DataPrivacy, Security & Access to Data
Privacy, Security & Access to Data
 
Do Universities Dream of Big Data
Do Universities Dream of Big DataDo Universities Dream of Big Data
Do Universities Dream of Big Data
 
Predicting the Future With Microsoft Bing
Predicting the Future With Microsoft BingPredicting the Future With Microsoft Bing
Predicting the Future With Microsoft Bing
 
Analytics 101: How to not fail at analytics
Analytics 101: How to not fail at analyticsAnalytics 101: How to not fail at analytics
Analytics 101: How to not fail at analytics
 
Are MOOC's past their peak?
Are MOOC's past their peak?Are MOOC's past their peak?
Are MOOC's past their peak?
 
Opening the doors of the laboratory
Opening the doors of the laboratoryOpening the doors of the laboratory
Opening the doors of the laboratory
 
Open City - Edmonton
Open City - EdmontonOpen City - Edmonton
Open City - Edmonton
 
Unlocking the power of healthcare data
Unlocking the power of healthcare dataUnlocking the power of healthcare data
Unlocking the power of healthcare data
 
Checking in on Healthcare Data Analytics
Checking in on Healthcare Data AnalyticsChecking in on Healthcare Data Analytics
Checking in on Healthcare Data Analytics
 
Open access and open data: international trends and strategic context
Open access and open data: international trends and strategic contextOpen access and open data: international trends and strategic context
Open access and open data: international trends and strategic context
 

Kürzlich hochgeladen

ICS2208 Lecture6 Notes for SL spaces.pdf
ICS2208 Lecture6 Notes for SL spaces.pdfICS2208 Lecture6 Notes for SL spaces.pdf
ICS2208 Lecture6 Notes for SL spaces.pdfVanessa Camilleri
 
4.16.24 21st Century Movements for Black Lives.pptx
4.16.24 21st Century Movements for Black Lives.pptx4.16.24 21st Century Movements for Black Lives.pptx
4.16.24 21st Century Movements for Black Lives.pptxmary850239
 
Active Learning Strategies (in short ALS).pdf
Active Learning Strategies (in short ALS).pdfActive Learning Strategies (in short ALS).pdf
Active Learning Strategies (in short ALS).pdfPatidar M
 
Oppenheimer Film Discussion for Philosophy and Film
Oppenheimer Film Discussion for Philosophy and FilmOppenheimer Film Discussion for Philosophy and Film
Oppenheimer Film Discussion for Philosophy and FilmStan Meyer
 
Inclusivity Essentials_ Creating Accessible Websites for Nonprofits .pdf
Inclusivity Essentials_ Creating Accessible Websites for Nonprofits .pdfInclusivity Essentials_ Creating Accessible Websites for Nonprofits .pdf
Inclusivity Essentials_ Creating Accessible Websites for Nonprofits .pdfTechSoup
 
Q4-PPT-Music9_Lesson-1-Romantic-Opera.pptx
Q4-PPT-Music9_Lesson-1-Romantic-Opera.pptxQ4-PPT-Music9_Lesson-1-Romantic-Opera.pptx
Q4-PPT-Music9_Lesson-1-Romantic-Opera.pptxlancelewisportillo
 
Visit to a blind student's school🧑‍🦯🧑‍🦯(community medicine)
Visit to a blind student's school🧑‍🦯🧑‍🦯(community medicine)Visit to a blind student's school🧑‍🦯🧑‍🦯(community medicine)
Visit to a blind student's school🧑‍🦯🧑‍🦯(community medicine)lakshayb543
 
4.16.24 Poverty and Precarity--Desmond.pptx
4.16.24 Poverty and Precarity--Desmond.pptx4.16.24 Poverty and Precarity--Desmond.pptx
4.16.24 Poverty and Precarity--Desmond.pptxmary850239
 
ROLES IN A STAGE PRODUCTION in arts.pptx
ROLES IN A STAGE PRODUCTION in arts.pptxROLES IN A STAGE PRODUCTION in arts.pptx
ROLES IN A STAGE PRODUCTION in arts.pptxVanesaIglesias10
 
Grade 9 Quarter 4 Dll Grade 9 Quarter 4 DLL.pdf
Grade 9 Quarter 4 Dll Grade 9 Quarter 4 DLL.pdfGrade 9 Quarter 4 Dll Grade 9 Quarter 4 DLL.pdf
Grade 9 Quarter 4 Dll Grade 9 Quarter 4 DLL.pdfJemuel Francisco
 
Presentation Activity 2. Unit 3 transv.pptx
Presentation Activity 2. Unit 3 transv.pptxPresentation Activity 2. Unit 3 transv.pptx
Presentation Activity 2. Unit 3 transv.pptxRosabel UA
 
Integumentary System SMP B. Pharm Sem I.ppt
Integumentary System SMP B. Pharm Sem I.pptIntegumentary System SMP B. Pharm Sem I.ppt
Integumentary System SMP B. Pharm Sem I.pptshraddhaparab530
 
How to Add Barcode on PDF Report in Odoo 17
How to Add Barcode on PDF Report in Odoo 17How to Add Barcode on PDF Report in Odoo 17
How to Add Barcode on PDF Report in Odoo 17Celine George
 
AUDIENCE THEORY -CULTIVATION THEORY - GERBNER.pptx
AUDIENCE THEORY -CULTIVATION THEORY -  GERBNER.pptxAUDIENCE THEORY -CULTIVATION THEORY -  GERBNER.pptx
AUDIENCE THEORY -CULTIVATION THEORY - GERBNER.pptxiammrhaywood
 
Activity 2-unit 2-update 2024. English translation
Activity 2-unit 2-update 2024. English translationActivity 2-unit 2-update 2024. English translation
Activity 2-unit 2-update 2024. English translationRosabel UA
 
Expanded definition: technical and operational
Expanded definition: technical and operationalExpanded definition: technical and operational
Expanded definition: technical and operationalssuser3e220a
 
EMBODO Lesson Plan Grade 9 Law of Sines.docx
EMBODO Lesson Plan Grade 9 Law of Sines.docxEMBODO Lesson Plan Grade 9 Law of Sines.docx
EMBODO Lesson Plan Grade 9 Law of Sines.docxElton John Embodo
 

Kürzlich hochgeladen (20)

ICS2208 Lecture6 Notes for SL spaces.pdf
ICS2208 Lecture6 Notes for SL spaces.pdfICS2208 Lecture6 Notes for SL spaces.pdf
ICS2208 Lecture6 Notes for SL spaces.pdf
 
4.16.24 21st Century Movements for Black Lives.pptx
4.16.24 21st Century Movements for Black Lives.pptx4.16.24 21st Century Movements for Black Lives.pptx
4.16.24 21st Century Movements for Black Lives.pptx
 
Active Learning Strategies (in short ALS).pdf
Active Learning Strategies (in short ALS).pdfActive Learning Strategies (in short ALS).pdf
Active Learning Strategies (in short ALS).pdf
 
LEFT_ON_C'N_ PRELIMS_EL_DORADO_2024.pptx
LEFT_ON_C'N_ PRELIMS_EL_DORADO_2024.pptxLEFT_ON_C'N_ PRELIMS_EL_DORADO_2024.pptx
LEFT_ON_C'N_ PRELIMS_EL_DORADO_2024.pptx
 
Oppenheimer Film Discussion for Philosophy and Film
Oppenheimer Film Discussion for Philosophy and FilmOppenheimer Film Discussion for Philosophy and Film
Oppenheimer Film Discussion for Philosophy and Film
 
Inclusivity Essentials_ Creating Accessible Websites for Nonprofits .pdf
Inclusivity Essentials_ Creating Accessible Websites for Nonprofits .pdfInclusivity Essentials_ Creating Accessible Websites for Nonprofits .pdf
Inclusivity Essentials_ Creating Accessible Websites for Nonprofits .pdf
 
Q4-PPT-Music9_Lesson-1-Romantic-Opera.pptx
Q4-PPT-Music9_Lesson-1-Romantic-Opera.pptxQ4-PPT-Music9_Lesson-1-Romantic-Opera.pptx
Q4-PPT-Music9_Lesson-1-Romantic-Opera.pptx
 
Visit to a blind student's school🧑‍🦯🧑‍🦯(community medicine)
Visit to a blind student's school🧑‍🦯🧑‍🦯(community medicine)Visit to a blind student's school🧑‍🦯🧑‍🦯(community medicine)
Visit to a blind student's school🧑‍🦯🧑‍🦯(community medicine)
 
4.16.24 Poverty and Precarity--Desmond.pptx
4.16.24 Poverty and Precarity--Desmond.pptx4.16.24 Poverty and Precarity--Desmond.pptx
4.16.24 Poverty and Precarity--Desmond.pptx
 
ROLES IN A STAGE PRODUCTION in arts.pptx
ROLES IN A STAGE PRODUCTION in arts.pptxROLES IN A STAGE PRODUCTION in arts.pptx
ROLES IN A STAGE PRODUCTION in arts.pptx
 
Grade 9 Quarter 4 Dll Grade 9 Quarter 4 DLL.pdf
Grade 9 Quarter 4 Dll Grade 9 Quarter 4 DLL.pdfGrade 9 Quarter 4 Dll Grade 9 Quarter 4 DLL.pdf
Grade 9 Quarter 4 Dll Grade 9 Quarter 4 DLL.pdf
 
Presentation Activity 2. Unit 3 transv.pptx
Presentation Activity 2. Unit 3 transv.pptxPresentation Activity 2. Unit 3 transv.pptx
Presentation Activity 2. Unit 3 transv.pptx
 
Integumentary System SMP B. Pharm Sem I.ppt
Integumentary System SMP B. Pharm Sem I.pptIntegumentary System SMP B. Pharm Sem I.ppt
Integumentary System SMP B. Pharm Sem I.ppt
 
How to Add Barcode on PDF Report in Odoo 17
How to Add Barcode on PDF Report in Odoo 17How to Add Barcode on PDF Report in Odoo 17
How to Add Barcode on PDF Report in Odoo 17
 
AUDIENCE THEORY -CULTIVATION THEORY - GERBNER.pptx
AUDIENCE THEORY -CULTIVATION THEORY -  GERBNER.pptxAUDIENCE THEORY -CULTIVATION THEORY -  GERBNER.pptx
AUDIENCE THEORY -CULTIVATION THEORY - GERBNER.pptx
 
Activity 2-unit 2-update 2024. English translation
Activity 2-unit 2-update 2024. English translationActivity 2-unit 2-update 2024. English translation
Activity 2-unit 2-update 2024. English translation
 
YOUVE GOT EMAIL_FINALS_EL_DORADO_2024.pptx
YOUVE GOT EMAIL_FINALS_EL_DORADO_2024.pptxYOUVE GOT EMAIL_FINALS_EL_DORADO_2024.pptx
YOUVE GOT EMAIL_FINALS_EL_DORADO_2024.pptx
 
Expanded definition: technical and operational
Expanded definition: technical and operationalExpanded definition: technical and operational
Expanded definition: technical and operational
 
EMBODO Lesson Plan Grade 9 Law of Sines.docx
EMBODO Lesson Plan Grade 9 Law of Sines.docxEMBODO Lesson Plan Grade 9 Law of Sines.docx
EMBODO Lesson Plan Grade 9 Law of Sines.docx
 
FINALS_OF_LEFT_ON_C'N_EL_DORADO_2024.pptx
FINALS_OF_LEFT_ON_C'N_EL_DORADO_2024.pptxFINALS_OF_LEFT_ON_C'N_EL_DORADO_2024.pptx
FINALS_OF_LEFT_ON_C'N_EL_DORADO_2024.pptx
 

Using linked data in a heterogeneous sensor web: Challenges, experiments and lessons learned

  • 1. Using Linked Data in a Heterogeneous Sensor Web: Challenges, Experiments and Lessons Learned Liang Yu and Yong Liu {liangyu, yongliu}@ncsa.illinois.edu National Center for Supercomputing Applications University of Illinois at Urbana-Champaign
  • 2. Outline Ø Motivation and Goal Ø Using Linked Data for Integration Ø Services for Consuming Linked Data Ø An Example: Visualization Ø Conclusion and Future Work Imaginations unbound
  • 3. Motivation •  Interoperability as a grand challenge in a Virtual Environmental Observatory •  The need to integrating different sensor data, citizen sensing, and other geospatial data etc. •  e.g., all river gage height values from all gages in Illinois between 1st May and 3rd May 2011. •  A heterogeneous Sensor Web is a reality •  Different protocols and formats, unknown semantics and no links. •  A paradigm shift: using Linked Data to build a Linked Sensor Web •  Linked data has the potential to provide a solution: URI naming system, HTTP protocol, RDF, links to other resources. •  E.g. an OGC SOS usually has no links to other resources Imaginations unbound
  • 4. Objective: Data Integration in a Virtual Environmental Observatory WaterML Imaginations unbound
  • 5. Outline Ø Motivation and Goal Ø Using Linked Data for Integration Ø Services for Consuming Linked Data Ø An Example: Visualization Ø Conclusion and Future Work Imaginations unbound
  • 6. A Simplified View of Linked Data •  Obtain sensors and observation data from sensors in Illinois Sensors Data States Illinois in Illinois Stream http:// http:// sensorweb.ncsa.uiuc.edu/ sensorweb.ncsa.uiuc.edu/api/ data/map/state/USGS/ Illinois sensordata/observations? observedBy.within=http:// sensorweb.ncsa.uiuc.edu/data/ map/state/USGS/Illinois http://sensorweb.ncsa.uiuc.edu/api/ sensordata/sites?within=http:// sensorweb.ncsa.uiuc.edu/data/map/state/ USGS/Illinois Imaginations unbound
  • 7. Key Challenges •  Publishing Linked Data •  Re-publishing existing plain data to semantically linked data. •  Linking potentially “linkable data” together and enabling complex queries in a heterogeneous Sensor Web. •  Consuming Linked Data •  Serving data in an OGC RESTful SOS-like service. •  Tracking the provenance of Linked Data to facilitate trust and validation. Imaginations unbound
  • 8. Workflow of Publishing and Consuming Linked Data Raw Data Linked Data Linked Data Geometric Tools Analysis LDA Ontology Imaginations unbound
  • 9. Republishing Data to RDF (1) •  Use XML as an intermediate format •  All non-XML data (Shapefile, Excel) are transformed to XML. •  Use XSLT to convert intermediate XML to RDF/XML •  Three different annotations are implemented in XSLT •  semantic annotation (rdf:type) •  outgoing links (to DBPedia), and •  provenance. •  Both syntactic transformations and semantic annotations are performed Imaginations unbound
  • 10. Republishing Data to RDF (2) provenance Outgoing link rdf:type Imaginations unbound
  • 12. Creating Links by Geometric Analysis (1) •  To discover and create links between entities based on their spatial attributes. •  Different from previous work •  E.g.: http://www4.wiwiss.fu-berlin.de/bizer/silk/ •  Tools: Geotools (Java). Imaginations unbound
  • 13. Creating Links by Geometric Analysis (2) Imaginations unbound
  • 14. Provenance in Linked Data •  Where did the data come from? How were they processed? •  Using Open Provenance Model (OPM) Observation opmo:wasDerivedFromStar ssn:observedBy opmo:WasGeneratedBy Sensor opmo:wasDerivedFromStar <ssn:observedBy rdf:resource="http://sensorweb.ncsa.uiuc.edu/data/sensordata/sites/CUAHSI/ NWIS/03339000"/> <opmo:wasDerivedFromStar rdf:resource="http://waterservices.usgs.gov/nwis/iv"/> Imaginations unbound
  • 15. Outline Ø Motivation and Goal Ø Using Linked Data for Integration Ø Services for Consuming Linked Data Ø An Example: Visualization Ø Conclusion and Future Work Imaginations unbound
  • 16. Developing SOS with Linked Data API (1) •  An OGC RESTful SOS-like service over the integrated linked data •  Can be accessed by simple URLs. •  Is as flexible as SPARQL but with simpler syntax. q  Feature of Interest ( http://sensorweb.ncsa.uiuc.edu/data/map/watershed/USGS/2009_0) q  Single sensor site ( http://sensorweb.ncsa.uiuc.edu/data/sensordata/sites/CUAHSI/EPA/ MWRDSTOR:WW_39) q  Collection of sensor sites (http://sensorweb.ncsa.uiuc.edu/api/sensordata/sites) q  Single observation ( http://sensorweb.ncsa.uiuc.edu/data/event/hail/noaa/ 2010/10908_2010-12-31T22:40:00) q  Collection of observations ( http://sensorweb.ncsa.uiuc.edu/api/sensordata/observations) Imaginations unbound
  • 17. Developing SOS with Linked Data API (2) •  Obtain all the sensor sites within Illinois state. •  http://sensorweb.ncsa.uiuc.edu/api/sensordata/sites?within=http://sensorweb.ncsa.uiuc.edu/data/ map/state/USGS/Illinois items": [ {"_about": " http://sensorweb.ncsa.uiuc.edu/data/sensordata/sites/CUAHSI/EPA/MWRDSTOR:WW_39", "hasCode": "MWRDSTOR:WW 39", "hasLocation": { "lat": 41.88185119628906, "long": -87.63558197021484, "type": "http://www.w3.org/2003/01/geo/wgs84_pos#Point"}, "hasName": "South Branch Chicago River @ Madison St.", "hasNetwork": " http://sensorweb.ncsa.uiuc.edu/data/sensordata/network/CUAHSI/EPA", "hasStream": " http://sensorweb.ncsa.uiuc.edu/api/sensordata/observations?observedBy=http:// sensorweb.ncsa.uiuc.edu/data/sensordata/sites/CUAHSI/EPA/ MWRDSTOR:WW_39", "type": "Sensor", "wasDerivedFromStar": "http://water.sdsc.edu/waterOneFlow/", "within": [" http://sensorweb.ncsa.uiuc.edu/data/map/county/USGS/Cook_County,_IL"," http://sensorweb.ncsa.uiuc.edu/data/map/state/USGS/Illinois"," http://sensorweb.ncsa.uiuc.edu/data/map/watershed/USGS/2009_2627"]}, Imaginations unbound
  • 18. Outline Ø Motivation and Goal Ø Using Linked Data for Integration Ø Services for Consuming Linked Data Ø An Example: Visualization Ø Conclusion and Future Work Imaginations unbound
  • 19. An Example Application (Visualization of SOS Results) •  Visualization Platform: WWT (World Wide Telescope)|Earth •  Sensor Data: river gage height values produced by gages in Illinois between 2011-05-01 and 2011-05-03. q  http://sensorweb.ncsa.uiuc.edu/api/sensordata/observations?observedBy.within=http:// sensorweb.ncsa.uiuc.edu/data/map/state/USGS/Illinois&_sort=observationResultTime.inXSDDateTime&min- observationResultTime.inXSDDateTime=2011-05-01T00:00:00-05:00&_page=0&max- observationResultTime.inXSDDateTime=2011-05-03T00:00:00-05:00&observedProperty=http:// sensorweb.ncsa.uiuc.edu/data/property/USGS/NWIS:UnitValues/00065 Imaginations unbound
  • 20. Outline Ø Motivation and Goal Ø Using Linked Data for Integration Ø Services for Consuming Linked Data Ø An Example: Visualization Ø Conclusion and Future Work Imaginations unbound
  • 21. Conclusion •  A “Linked Sensor Web” solution for integrating heterogeneous sensor data sources and geospatial data. •  A best practice of using W3C SSN ontology as well as other domain ontologies. •  A method to discover and create links among spatial data. •  Using Linked Data API to provide OGC RESTful SOS-like services •  http://sensorweb.ncsa.uiuc.edu/api-list.html •  Tracking provenance data and managing them using OPM. Imaginations unbound
  • 22. Future Work •  Towards Linked Geostreaming Data •  Tuning the performance •  Facilitating searching and crawling of Linked data •  End-to-end provenance management Imaginations unbound
  • 23. Acknowledgements Ø Microsoft Research Connections Ø  “Environmental Informatics” Program Ø  Institute for Advanced Computing Applications and Technologies at the University of Illinois at Urbana- Champaign Ø  “Virtual Observatory for Sustainability of Intensively Managed Environmental Systems” Project Imaginations unbound