This presentation was presented by Rolf Fricke, Condat AG, during Xinnovations 2012 in Humboldt University in Berlin on September 11th, 2012.
The main objective of the LinkedTV project is the integration of hyperlinks in videos to open up new possibilities for the interactive, seamless usage of video on the Web. One challenge is the placement of tags and hyperlinks above the video layer, which should be closely associated to the underlying media fragments for persons or objects shown in the video. As the media fragments dynamically appear, move and disappear a precise synchronization of the overlays and related media fragments is needed. We plan to implement these features together with further user interface features on the basis of the HTML5 elements video, CSS3 and web workers. As we target WebTV as well as Broadcast TV, we plan to provide a restricted HbbTV 1.1 implementation for TV-sets, but we finally expect to profit from a HTML5 integration in upcoming HbbTV releases.
Using IESVE for Loads, Sizing and Heat Pump Modeling to Achieve Decarbonization
Implementation of Hyperlinks in videos with HTML5
1. Xinnovations 2012
W3C Days, 10./11.9.2012
Implementation of Hyperlinks
for Videos with HTML5
Rolf Fricke, Condat AGt
2. Condat® AG
TV- / Media
Mobile
Web
Rolf Fricke
R&D
Alt-Moabit 91 d
10559 Berlin
Tel. +49-30-3949-1109
www.condat.de
rf@condat.de
Condat AG 2
3. EU-FP7 Project
Project: LinkedTV - Television linked to the Web
FP7 Objective: ICT Networked Media and Search Systems
Duration: 10/2011 - 3/2015
Partner: Name Country
Fraunhofer IAIS Germany
CERTH Greece
University of Economics Prague Czech Republic
CWI Holland
Eurecom France
University of St Gallen Switzerland
STI Austria
Condat Germany
Noterik Holland
Sound and Vision Holland
University of Mons Belgium
RBB Germany
Condat AG 3
4. Motivation for LinkedTV
Fast growing relevance of Video:
Videoportals
TV Live Channels in
Deficits:
the Web Video still isolated in the
IPTV Web without:
...
search in the video stream
hyperlinks
annotations
only complete download
....
Condat AG 4
5. LinkedTV Objectives
Convergence of TV and Web with rich
browsing experience by:
Search for
"Claude Hyperlink
Trichet"
Angela Merkel
Angela Merkel
Tags
for
WebTV with Browsers (HTML5) and
TV-Sets (HbbTV)
Condat AG 5
6. development of tools for
Video analysis for speech, subtitels,
shots/scenes, text to identify relevant
objects, persons, events ...
Named Entity Recognition and
Semantic Enrichment using the Link
Data Cloud (LoD)
Personalization / Filtering
....
Condat AG 6
12. 1) Show Video
by HTML5 video tag to
play, stop, rewind the video
Condat AG 12
13. 2) Draw Tags above Media Fragments
by CSS3 using:
MF spatial rectangle to place tags at
right position in the video
z-index for placement above video layer
relative positioning make tags move with
the video
Condat AG 13
15. 3) Display Tags during specified time frame
precise synchronisation of tags with
underlying video objects
is triggered by HTML5 video timeupdate event and
uses currentTime attribute
uses Media Fragments time parameter to
determine display time span
Condat AG 15
16. Display Tags above Moving Media Fragments
upcoming MF Specificiations are planned to support also
moving Fragments:
Stork
precise drawing of tag trajectory requires fast fire rates for
timeupdate event up to 60 frames per second (ca. 15 ms)
HTML5 allows setting fire rates or timeupdate between 15
and 250 ms
many Browsers only support between 100 - 250 ms (such as
Firefox)
use of setTimeout() function allows faster update rates also for
this Browsers
Condat AG 16
17. 4) Eventhandling "Mouse over",
"Click/Touch" on Hyperlink
by DOM event model:
onmouseover event to show additional
info to an object
onclick / ontouchmove event to activate
hyperlinks placed above MF object
Condat AG 17
18. Parallel execution of Video, DB access, HTML display
Parallel execution of several tasks may harm (for less powerful
CPUs):
smooth display of video
synchronized display of tags, device pointers and underlying
objects.
Solution: use HTML5 Web Workers to run scripts as separate
threads for
fetching MF objects stepwise from DB
drawing UI elements above the video layer
Condat AG 18
19. HbbTV Implementation
LinkedTV
plans restricted HbbTV 1.1 implementation for TV Sets
hopes to profit from integration of HTML5 elements in
HbbTV
intended uptake of HTML5 for HbbTV still under discussion,
since combined use of TV sets for broadcast and internet
access
not allow direct uptake of HTML5 video element
(HbbTV triggers load of HTML pages by stream events in
Broadcast protocol)
should consider weak CPUs of TV Sets
have no pointing device
Condat AG 19
20. References
1. Silvia Pfeiffer: A definitive Guide to HTML5 Video, 2010,
apress
2. Raphael Troncy, Addressing and Annotating Multimedia
Fragments, Paris, April 2012
3. http://caniuse.com/#cats=HTML5
4. http://dev.w3.org/html5/spec/single-page.html
5. http://www.w3.org/2010/05/video/mediaevents.html
6. http://www.w3schools.com/html5/html5_video.asp
Condat AG 20