A brief introduction to tools from the LinkedTV project which can be used together to build new media applications based on conceptual linking of media fragments.
LinkedTV tools for Linked Media applications (LIME 2015 workshop talk)
1. Television Linked To The Web
www.linkedtv.eu
Lyndon Nixon, MODUL University Vienna GmbH
Raphael Troncy, EURECOM
Johan Oomen, Sound and Vision
Towards New Media Applications with
Linked Media – using the LinkedTV
project toolset
18 May 2015 LiME Workshop WWW2015
2. 2
www.linkedtv.eu
What is Linked Media?
1. Web media descriptions need a common representation
of media structure
2.2. Web media descriptions need a common representationWeb media descriptions need a common representation
of media contentof media content
3.3. Web media descriptions need to use a media ontologyWeb media descriptions need to use a media ontology
which supports description of both the structure andwhich supports description of both the structure and
content of mediacontent of media
4.4. The descriptions of media in terms of common representations ofThe descriptions of media in terms of common representations of
structure and content are the basis for deriving links acrossstructure and content are the basis for deriving links across
media on the Web (Linked Media)media on the Web (Linked Media)
3. 3
www.linkedtv.eu
LinkedTV: background
40% of TV viewers are using a companion
device alongside the TV program.*
* J. Abreu, P. Almeida, B. Teles, and M. Reis. Viewer behaviors and practices in the (new)
television environment. In Proceedings of the 11th European Conference on Interactive TV
and Video, EuroITV '13.
http://www.linkedtv.eu
Ever saw something
on TV and wanted to
know more about it,
but didn‘t even know
how to search for it?
4. 4
www.linkedtv.eu
LinkedTV: applications
Scenario 1:
LinkedNews app
Easy access to
background to the news
Focus on key concepts of
interest in each item
hbbTV single screen and
dual screen apps
Scenario 2:
LinkedCulture app
Easy access to
information on the art
objects discussed in the
program
Secondary screen-
orientation, cast TV
program to main screen
LinkedNews demo:
https://vimeo.com/1062
LinkedCulture
demo:
https://vimeo.com/1088
5. 5
www.linkedtv.eu
LinkedTV technology
“...schilderij van Jan Sluijters....”
Video object and
word detection
dbpedia.org/resource/Jan_Sluyters
Connection to
concepts
Paintings by Jan Sluijters
Selection of
related concepts
Selection of
related content
Presentation
engine
6. 6
www.linkedtv.eu
Annotation task: LinkedTV Ontology
Published at
http://www.linkedtv.eu/ontology
(Enquiries: r.troncy@eurecom.fr)
Annotation
Concept
Keyword
ANALYSIS RESULTS (Support for segmentation)
Ontology for
Media
Resources
(W3C)
Open Annotation
Core Data Model
EXTERNAL DATASETS
Entity
NERD
Provenance
Ontology for
Provenance
Management
Scene
Shot
MediaFragment
Face
7. 7
www.linkedtv.eu
Annotation task: manual approaches
The LinkedTV Editor Tool code is open source (GNU GPL 3.0) -
https://github.com/linkedtv/editortool
A test installation can be used at http://editortoolv2.linkedtv.eu/trial
(Enquiries: jblom@beeldengeluid.nl)
9. 9
www.linkedtv.eu
Annotation retrieval: Platform SPARQL endpoint and
REST API
Survey of Semantic Media Annotation Tools for the Web:
Towards new Media Applications with Linked Media
LinkedTV Platform SPARQL endpoint https://data.linkedtv.eu/sparql
Further information & test access to add your own content:
contact rolf.fricke@condat.de
10. 10
www.linkedtv.eu
Examples
Annotate videos by chapter in the Editor Tool
Query the metadata on the LinkedTV Platform
Try out some media linking via DBPedia paths!
-----------------------------------------------------------------
Want more LinkedTV?
•http://showcase.linkedtv.eu
•lyndon.nixon@modul.ac.at
•@linkedtv
Hinweis der Redaktion
Fragment media assets (since a consumer may be interested in only a part of a larger asset)
Annotate those fragments (so that media retrieval can be at the fragment level)
With Linked Data concepts (so programs can access metadata about any concept in an annotation and have a shared understanding of the semantics of the annotation)
And use the Links in Linked Data to derive Links between Annotated Media.
Space for Editor Tool: automated annotation can be inaccurate, process allows for editor checking and correcting annotations, use of named graphs/LinkedTV Ontology to maintain provenance information between automated and curated annotations in the media metadata