1. Advanced methods and
tools for Web-Based
education
Technologies for Structuring, Analyzing, Modelling, Personalisation
OCWC Global Conference 2013
Bali
3. Agenda
• Brief introduction to the workshop (Mitja Jermol, K4A, JSI) (15’)
• Introducing K4A (Colin de La Higuera, K4A, Nantes) (15’)
• Some challenges in using Machine Learning in OER (Colin de La Higuera, K4A,
Nantes) (15’)
• Break
• Technologies and solutions for content structuring (Marko Grobelnik, K4A, JSI)
(45’)
• Technologies and solutions for user modelling and analytics (Marko Grobelnik,
K4A, JSI) (30’)
• Break
• Technologies, solutions and prospects of OER in the Videolectures.net case (Mitja
Jermol, K4A, JSI) (45’)
• Wrap up and discussion (20’)
16. Translectures
Our aim is to develop innovative, cost-effective solutions to produce
accurate transcriptions and translations in VideoLectures, with
generality across other Matterhorn-related repositories.
Three scientific and technological objectives:
• Improvement of transcription and translation quality by massive
adaptation.
• Improvement of transcription and translation quality by intelligent
interaction.
• Integration into Matterhorn to enable real-life evaluation.
4 June 2013 17
17. Results
Freely available tools and services for accurate transcriptions and translations:
- Automatic transcription of videos: English, Slovenian, German, French, Spanish
- Automated translation of videos: en⇆es, en⇆sl, en fr and en de.
Initial implementation:
- Videolectures
- poliMedia
- Matterhorn
18
18. Project factsheet
• Total Cost: €4,491,143.00
• EC Contribution: €3,125,000.00
• Execution: From: 11/2011 To: 10/2014
19
No Name Short
name
Country Exit
Month
Exit
month
1 UNIVERSITAT POLITECNICA DE VALENCIA UPV Spain 1 36
2 XEROX SAS XEROX France 1 36
3 INSTITUT JOZEF STEFAN JSI Slovenia 1 36
3+ KNOWLEDGE FOR ALL FOUNDATION K4A UK 1 36
4 RHEINISCH-WESTFAELISCHE
TECHNISCHE HOCHSCHULE AACHEN
RWTH Germany 1 36
5 EUROPEAN MEDIA LABORATORY GMBH EML Germany 1 36
6 Deluxe Digital Studios Ltd DDS UK 1 36
22. Overview About Adaptation
23
acoustic model
adaptation
translation model
adaptation
ASR SMT
language model
adaptation
investigate
• conditions
• models
• adaptation techniques
(time-aligned slides)
decide
23. Languages and Training Data
• ASR
24
Repository Language Acoustic Model
Training Hours
Language Model
Running Words
videolectures.net
English 768 4657 million
Slovenian 27 75 million
poliMedia Spanish 390 1609 million
24. Language Pairs and Training Data
• SMT
25
Repository Language Pair
Bilingual
Sentences
Monolingual
Running Words
poliMedia Spanish to English 12.9 million 57 million
videolectures.net
English to Spanish 12.9 million 34 million
English to Slovenian 4.7 million 378 million
English to French 4.0 million 119 million
English to German 2.2 million 621 million
Slovenian to English 1.1 million 57 million
26. Media fragments
Media mixing is the process
by which self-contained parts
of media (fragments) are
identified and exposed via
media repository interfaces,
so that consumers can access
and re-use only the parts
they are interested in.
Media
Mixer
Hub
AV Content
Provider (1-n)
AV Content
Demander (1-m)
1) AV
material
analysis and
annotation
2) Fragment
Definition
3) Rights
and Cost
Assignment
6) Search.
Browsing
7) Rights
and Cost
Assessment
8) Download
4) Fragment
Upload
5) Clearing
(Sell)
9) Composition
of new AV
materials
10) Clearing
(Buy)
annotated &
linked Media
Fragments
27. Mediamixer (http://mediamixer.eu/)
• Community set-up and networking for the reMIXing of online MEDIA
fragments
• to set up and sustain a community of video producers, hosters, and
redistributors who will be supported in the adoption of semantic
multimedia technology in their systems and workflows to build a
European market for media fragment re-purposing and re-selling.
• http://community.mediamixer.eu/
30. Matterhorn basic facts
• Opensource (http://opencast.org/matterhorn/download)
• Started July 2009
• Official Ver 1.3.1, March 2012, Ver 1.4 in testing
• Starting 2Y funds by:
• The Andrew W. Mellon: 1M US
• The William and Flora Hewlett foundations: 0.5 US
• Now supported by institutions itself
31. Adopting organisations
University College Cork
University of Applied Sciences Osnabrück
University of Bergen
University of California Berkeley
University of California Davis
University of Cape Town
University of Helsinki
University of Manchester
University of Nebraska-Lincoln
University of New Mexico
University of Osnabrueck
University of Saskatchewan
University Of The Arts London
University of Vigo
Vienna University of Technology
Visionaire Campus
Universidad Carlos III de Madrid
Universidad Distrital Francisco Jose de Caldas
Ben - Gurion University
Boise State University
Entwine
ETH Zurich
Ghent university
Loughborough University
North-West University
Northwestern University
OBIS/Oxford Brookes University, Oxford UK
Polytechnical University of Valencia (UPV)
Reformed Theological Seminary
Rice University
Rochester Institute of Technology
RRZE Uni-Erlangen
Tel Aviv University
Teltek Video Research
The Institute for Global Outreach Developments International
UNINETT AS
33. Video journal - status
• Video Journal of Machine Learning Abstracts
• Volume 1, 2, 3 – now preparing Vol. 4
• 146 video abstracts, 15k views
• Building up review committes
• PlanetData NoE - Video Journal of Semantic Data Management Abstracts
• Volume 1, now preparing Vol.2
Feedback from the community
Have separate tracks
Have different selection criteria (no need to check sound, etc).
Allow submissions of more multimedia-like presentations
35. UNESCO collaboration
• VideoLectures Winner of WSA in 2009
• March 2013 WSIS+10 Global Champion
• VideoLectures.Net was selected as the winner in the “e- Science & Technology” category
• 2 directors attended the Gala ceremony
• meeting with Mr Qian Tang, Assistant Director-General for Education, UNESCO and
discussed:
• Boost-up education in UNESCO member states
• Provide a hub for MA, MSc, PhD video content exchange
• Bring the latest research and development in Africa and globally to institutions in Africa
• Potential to improve and facilitate mobile learning
• Creation of AI training/research in developing countrires
• Visit of UNESCO director-general Irina Bokova in Ljubljana 9.4.2013
36. Already taken actions towards the future
• Future (not so distant)
• Responsive learning environments
• Learning companions
• New academia/research
• Speaker modelling
37. Links and contacts
Davor Orlic
Davor.Orlic@k4all.org
http://www.translectures.eu/
ajuan@dsic.upv.es
Alfons Juan-Ciscar
Universitat Politècnica de València (DSIC)
http://www.xlike.org/ Marko Grobelnik
Jozef Stefan Institute
marko.grobelnik@ijs.si
http://www.k4all.org/
http://mediamixer.eu/ Lyndon Nixon
STI - International
lyndon.nixon@sti2.org