Diese Präsentation wurde erfolgreich gemeldet.
Wir verwenden Ihre LinkedIn Profilangaben und Informationen zu Ihren Aktivitäten, um Anzeigen zu personalisieren und Ihnen relevantere Inhalte anzuzeigen. Sie können Ihre Anzeigeneinstellungen jederzeit ändern.
1 von 30

Augmenting the World using Semantic Web Technologies

0

Teilen

Herunterladen, um offline zu lesen

ABSTRACT:
Creating and maintaining scenes for mobile Augmented Reality browsers can be a challenging and time consuming task. The timeliness of digital information artifacts connected to changing urban environments require authors to constantly update the structural representations of augmented scenes or to accept that the information will soon be outdated. We investigated approaches for retrieving multimedia content and relevant web services for mobile Augmented Reality applications at runtime. Using semantic web technologies we are able to postpone the retrieval of actual media items to the moment a user actually perceives an augmented scene. This allows content creators to augment a scene only once and avoid continous manual updates.

Ähnliche Bücher

Kostenlos mit einer 30-tägigen Testversion von Scribd

Alle anzeigen

Ähnliche Hörbücher

Kostenlos mit einer 30-tägigen Testversion von Scribd

Alle anzeigen

Augmenting the World using Semantic Web Technologies

  1. 1. Jens Grubert+, Lyndon Nixon†, Gerhard Reitmayr+ +Institute for Computer Graphics and Vision †STI International Augmenting the World using Semantic Web Technologies
  2. 2. Do I have time? Are my friends attending? What kind of music they play? How much are the tickets?
  3. 3. Do I have time? Are my friends attending? What kind of music they play? How much are the tickets? As time goes by …
  4. 4. How to create information? How to update information?
  5. 5. Standard approach: direct links to content Creating augmented media … <mainresource> http://www.klimmstein.com/before.jpg </mainresource> …
  6. 6. Standard approach: manual update … <mainresource> http://www.klimmstein.com/before.jpg </mainresource> … outdated information after.jpg Updating augmented media
  7. 7. Link to concepts, not to content Retrieve the content at runtime Our approach Less effort for updating augmented scenes Potential added value due to context-sensitive retrieval
  8. 8. Link to concepts, not to content Retrieve the content at runtime Our approach
  9. 9. Concept Link to structured machine-readable data in ontologies (Linked Data) Link to concepts, not to content
  10. 10. • Events: o Clubbings, festivals o Small to midscale • Authors: o Event organizers o public relations Link to concepts, not to content
  11. 11. Link to concepts, not to content concept (URI or tag) display region
  12. 12. Link to concepts, not to content TOI reposit ory TOI Thing of Interest structured description of an augmented object
  13. 13. <toi:segment_annotation …> <toi:representation> <toi:hasDisplayLocation>0.59, 0.03</toi:hasDisplayLocation> <toi:hasDisplayDimension>0.44, 0.31</toi:hasDisplayDimension> <toi:hasLocatingInformation>0.11, 0.03</toi:hasLocatingInformation> <toi:hasDimension>0.44, 0.34</toi:hasDimension> </toi:representation> <toi:represents> <toi:identifier="http://data.play.fm/artist/chrisharvey"> <toi:classification rdf:resource="http://www.play.fm/ontology#Artist"/> </toi:represents> </toi:segment_annotation>
  14. 14. Link to concepts, not to content Retrieve the content at runtime Our approach
  15. 15. TOI Reposit ory SmartReality Server Web of Data Semantic Web Services Augmented Reality Client Object Recognition Thing-of-Interest Initialization Content Retrieval Tracking and Rendering Image Recognition DB Retrieve the content at runtime
  16. 16. Image Recognition DB ID Millions of Images Augmented Reality Client Object Recognition
  17. 17. TOI Reposit ory SmartReality Server Augmented Reality Client Thing-of-Interest Initialization Image ID Sesame Triple Store http://www.smartreality.at/rdf/toi How is it represented? What does it represent? (classification) Thing-of-Interest (TOI) TOI TOI TOI … Linking Open Data cloud diagram, Sept. 2011. http://lod-cloud.net/ Artist, Event, Club, Show, Recording, Track Timeline, Event, Dublin Core Uses:
  18. 18. SmartReality Server Augmented Reality Client Content Retrieval Linked Open Data Collector TOI classification Crawling Rules RDF/N3 e.g., for each Music Group crawl also each member + BBC Music MusicBrainz
  19. 19. SmartReality Server Semantic Web Services Augmented Reality Client Content Retrieval RDF Service Repository (WSMO-Lite) Discover relevant web services Rank and execute web services
  20. 20. How are the Posters annotated?
  21. 21. who | what? when? where?
  22. 22. • Authors: o event organizers o PR personal • Events: o clubbings, festivals o small to mid scale
  23. 23. <toi:segment_annotation …> <toi:representation> <toi:hasDisplayLocation>0.59, 0.03</toi:hasDisplayLocation> <toi:hasDisplayDimension>0.44, 0.31</toi:hasDisplayDimension> <toi:hasLocatingInformation>0.11, 0.03</toi:hasLocatingInformation> <toi:hasDimension>0.44, 0.34</toi:hasDimension> </toi:representation> <toi:represents> <toi:identifier="http://data.play.fm/artist/chrisharvey"> <toi:classification rdf:resource="http://www.play.fm/ontology#Artist"/> </toi:represents> </toi:segment_annotation>
  24. 24. Challenges • Effort to extend it beyond existing use case? o Suitable Ontologies o Crawling Rules • Semantic Descriptions of 3D Models? • Performance (roundtrip currently ~ 10 seconds) • How to capture the context? o User Model, Context Model (e.g., FOAF, Activity Streams)
  25. 25. Summary • Goals o Context-aware information access ion real objects in-situ o Minimize creation effort for authors (non-programmers) • How? o Semantic Web Technologies for content retrieval o Augmented Reality for content presentation • Challenges o Not yet able to model visually compelling (3D) scenes
  26. 26. This work is made possible by the Austrian National Research Funding Agency FFG in the SmartReality project. Thank you for your attention. www.smartreality.at

Notizen

  • Story:

    Motivation through event poster use case (why does it make sense to use SWT)?
    Short introduction of traditional, “hard coded” approach
    Reporting of the SWT approach, highlight the general approach – not the concrete infrastructure – e.g. approach does not have to rely on client server model but could be integrated in client only applications as well
    Only discuss annotation process briefly and reference to previous WS talk
    Show limitations of the approach and open up discussion
  • Initial motivation
  • Traditional approach
  • The traditional approach of directly linking to media assets requires manually updating the references in an augmented scene … otherwise the information will be outdated soon.
  • Potential added value: we did not implement advanced context retrieval (beyond location and time) like e.g. in QC https://gimbal.com/ – but the approach is open to integrate context recognition approaches  context types have to modeled/reflected in crawling rules for Linked Open Data sources
  • http://richard.cyganiak.de/2007/10/lod/
  • Only briefly discuss this, as the authoring pipeline was presented already last year
    Take play.fm only as example of how this approach could be integrated into an existing infrastructure

    Idea: Enable authors to connect digital media related to their events in a simple manner


    Message: event posters typically consist of certain information types

    http://www.play.fm/event/zuckerwatt_crazypreslaurentgarnierlbs1
  • TOI: extension to POI
    Supports different coordinate frames / tracking systems
  • <toi:represents>
    <toi:classification rdf:resource="http://www.someontology.com/ontology#SomeClass"/>
    <toi:identifier>http://www.someurl.com/aUsefulRessource#</toi:identifier>
    </toi:represents>
  • - Can be removed
  • How are the TOIs created?
  • _:r1 a mc:Rule ;
    mc:appliesToClass mo:MusicGroup ;
    mc:usesCondition _:c1 .
     
    _:c1 a mc:Condition ;
    mc:appliesToProperty mo:member ;
    mc:addValue rdf:Object .
  • Idea: Enable them to connect digital media related to their events in a simple manner


    Message: event posters typically consist of certain information types
  • Idea: Enable them to connect digital media related to their events in a simple manner


    Message: event posters typically consist of certain information types

    http://www.play.fm/event/zuckerwatt_crazypreslaurentgarnierlbs1
  • http://vm.play.fm:8180/playfmrdf/imageselect

    Highwayclubpompadourzuckerwattpreslaurentgarnier

    http://data.play.fm/artist/laurentgarnier
  • http://vm.play.fm:8180/playfmrdf/imageselect highwayclubpompadourzuckerwattpreslaurentgarnier
  • <toi:represents>
    <toi:classification rdf:resource="http://www.someontology.com/ontology#SomeClass"/>
    <toi:identifier>http://www.someurl.com/aUsefulRessource#</toi:identifier>
    </toi:represents>
  • Coding
    Scripting
    Libs
    visual programmning
  • ×