Presentation for the FutureTV session at EuroITV 2013. See http://www.linkedtv.eu/event/futuretv2013/.
Paper presented by Lotte Belice Baltussen of the Netherlands Institute for Sound and Vision.
Lotte Belice Baltussen, Roeland Ordelman, Jaap Blom. VideoHypE: An Editor Tool for Supervised Automatic Video Hyperlinking. In 11th European Interactive TV Conference (EuroITV 2013), June 2013, Como, Italy.
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
EuroITV - VideoHypE
1. Television Linked To The Web
www.linkedtv.eu
Lotte Belice Baltussen, Roeland Ordelman, Jaap Blom
Netherlands Institute for Sound and Vision
VideoHypE: An Editor Tool for Supervised
Automatic Video Hyperlinking
EuroITV | Como, Italy – 24 June 2013
2. 2
www.linkedtv.eu
LinkedTV: interweaving Web and TV into a
single experience
Mixing lean back and lean forward
Want to maintain immersion while removing fourth
wall illusion
Works only for certain genres and audiences
Does second screen help or hinder?
The LinkedTV vision
linkedtv.eu
3. 3
www.linkedtv.eu
Scenarios and content
Enriched News
Professional news content
produced by RBB for general
audience
local news show rbb Aktuell
People, locations and events
can be linked to previous
events.
Antiques Interactive
Program watched
predominantly by 50+ers
AVRO:
Tussen Kunst en Kitsch (TKK)
Objects, locations and
experts provide anchors to
related materials (targets).
linkedtv.eu
7. 7
www.linkedtv.eu
Why do we need VideoHypE?
, Roeland Ordelman1
Broadcasters want to have some control.
Editors have the expertise to determine relevance +
The user interface can only show a limited amount of links, and there are many
Research: sample 805 videos, average 55 NEs per video. 55 NEs = many, many
possible links depending on the size of the white list [Li et al., 2013]
NE - person: Jan Sluijters
NE – art syle: Fauvism
NE - person: Emiel Aardewerk
Link white list 1
Link white list 2
Link white list 3
Link white list 6
Link white list 7
Link white list etc etc
Link white list 4
Link white list 5
8. 8
www.linkedtv.eu
VideoHypE requirements
, Roeland Ordelman1
Requirements session with 5 AVRO editorial members +
digital staff of TKK. Main outcomes:
1. Selecting from list of available episodes
2. Create and edit chapters
3. Timeline with chapters
4. See annotations per chapters, distinction between entity types
5. Select annotations + related hyperlinks
6. Add selected, approved hyperlinks
7. Timeline with enities and hyperlinks
8. Add new hyperlinks to media fragments (e.g. shots/chapters/spatial)
9. Remove hyperlinks and/or entities (per media fragment or episode)
10. Separate user environment for each end user partner
11. Adding to white list
12. Sorting on entity types
13. Collaborative space
14. Delete annotations forever
15. Level of completion per chapter / episode
16. Variable # suggested links depending on time pressure
MAX 20-30 minutes per episode!!!
16. 17
www.linkedtv.eu
1. Implementing remaining requirements.
2. How to make the editor tool scalable?
• Different programmes, different requirements
• How to deal with live content?
• There is not just one front-end => one-screen solutions, 2nd screens, multiple
screens, etc.
1. Personalisation: what ‘bandwith’ is left personalisation?
2. Relevance is a crucial issue – how can the system ‘learn’?
3. User testing with real editors
VideoHypE – discussion & future work
17. 18
www.linkedtv.eu
Thanks!
, Roeland Ordelman1
Find me here:
@lottebelice | lbbaltussen@beeldengeluid.nl
Credits:
Again: other authors are Roeland Ordelman and Jaap Blom
Slides partly by: Lynda Hardman (CWI)
Heaps of thanks to AVRO for so generously letting LinkedTV use their content.
Links:
www.linkedtv.eu
twitter.com/BenGlabs
www.avro.nl
Editor's Notes
(1) Big Q: Do you ever have a question about what you are watching? Would you like related information about something you have seen? Something someone mentioned? One option is to pause the TV, go find your smart phone or pad and start some google search. When you carry out the search, your device doesn't know what you were watching, nor what the specific scene was about. Wouldn't it be nice to have a system that knows what you are watching, knows what you like and that presents links to extra pieces of information to you? Technology only likely to be useful when audience , content and program genre match. (2) slide
(1) Currently developing tools using 2 program genres
(1) What do we think it will look like? Not like this! Select video. Link to video! http://www.linkedtv.eu/scenarios/hyperlinked-documentary-scenario/
Developing individual technologies, using content from 2 program genres, with the aim of creating an end2end prototype. 1. Given a video: segment it to shots detect visual concepts detect faces perform audio analysis (ASR) perform keyword extraction 2. Media fragments => time-related! 3. ANCHORS Named Entities => e.g. Jan Sluyters, disambiguated wtih DBpedia link 4. TARGETS web content from WHITE LIST connected to the ANCHORS