Controlled vocabularies are appropriate for collection-alignment of video-content by providing fine-grained collections of terms. In fact, there already exist classifications and thesauri dedicated for indexing audiovisual material, but they are hardly available in interoperable formats (as e.g. RDF/SKOS), are hidden in private or public media archives or ain't use german language. Though, there is an increasing demand for audiovisual related vocabularies. We have encouraged major film archives in Germany, as e.g., German National Archive (BA), National Broadcasting Archive (DRA)
and German Broadcasting Compound to make their controlled vocabularies available for public use, but encountered a bottleneck in human- and technical resources. Therefore we plan to provide a skosification and hosting service for small and mid-sized archives. This contributions to the scientific- and film-industry community, was motivated by:
* Reuse of controlled vocabulary on films and film related material for indexing, facetted browsing, and retrieval issues.
* Interlinking and alignment of heterogeneous collections on the content-layer by using thesauri and classifications with semantic web technology such as RDF, SKOS and LOD.
* Promotion of open standards for knowledge exchange and adding value for small and middle-size archives by providing a conversion and hosting service. We plan to support the public funded media archives with manpower to make their vocabularies available in SKOS-format.
Johannes Hercher & Dr. Harald Sack
Hasso-Plattner-Institute for IT Systems Engineering
Potsdam, Germany
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...
Indexing German Audiovisual Heritage -- SKOSification Made Easy
1. Indexing German Audiovisual Heritage
- SKOSification Made Easy
Johannes Hercher & Dr. Harald Sack
Hasso-Plattner-Institute for IT Systems Engineering
Potsdam, Germany
Parts of this work were funded by the German Federal Ministry of Economics and Technology
(Promotional Reference No. 01MQ09031)
2. Approach - Table of Contents
2
1. Problem Statement & mediaglobe Project
2. Why Do We Need (SKOSified) Controlled Vocabularies
3. Update on the Current State of Controlled Vocabularies
□ vocabularies for AV-related content
□ results of a survey on usage of controlled vocabularies
□ why is there a problem?
4. Solution: an Easy Webservice to Publish Vocabularies
□ how does it work?
□ recommended features
□ wireframe modell
Johannes Hercher & Harald Sack : Indexing German Audiovisual Heritage - SKOSification Made Easy.
Hasso-Plattner-Institute, University Potsdam - 10th Sept. 2010
4. 1.1 Introducing the Problem
4
Cultural heritage taped on film (Germany)
> 1.200 film collections*
> 200 institutions with more than 100 h of film**
~ 83% of film archives plan to digitise their collections**
> 1000 film collections in
Germany*
Johannes Hercher & Harald Sack : Indexing German Audiovisual Heritage - SKOSification Made Easy.
*) Bockhorn, V; Morsbach; Ronneburg, S; Schmidt, W. (1996). Topographie audiovisueller Quellenüberlieferung - Film- und Videobestände in Archiven und archivischen
Einrichtungen in der Bundesrepublik Deutschland. Koblen
Hasso-Plattner-Institute, University Potsdam - 10 Sept. 2010
**) Mediaglobe, Deliverable-1.1 Report 2010.
th
5. 1.1 Introducing the Problem
4
Cultural heritage taped on film (Germany)
> 1.200 film collections*
> 200 institutions with more than 100 h of film**
~ 83% of film archives plan to digitise their collections**
> 1000 filmcollections in
> 1000 collections
need connections
Germany*
Johannes Hercher & Harald Sack : Indexing German Audiovisual Heritage - SKOSification Made Easy.
*) Bockhorn, V; Morsbach; Ronneburg, S; Schmidt, W. (1996). Topographie audiovisueller Quellenüberlieferung - Film- und Videobestände in Archiven und archivischen
Einrichtungen in der Bundesrepublik Deutschland. Koblen
Hasso-Plattner-Institute, University Potsdam - 10 Sept. 2010
**) Mediaglobe, Deliverable-1.1 Report 2010.
th
6. 1.1 Introducing the Problem
4
Cultural heritage taped on film (Germany)
> 1.200 film collections*
> 200 institutions with more than 100 h of film**
~ 83% of film archives plan to digitise their collections**
> 1000 filmcollections in
> 1000 collections
need connections
Germany*
Semantic glue
Classifications and Thesauri
Johannes Hercher & Harald Sack : Indexing German Audiovisual Heritage - SKOSification Made Easy.
*) Bockhorn, V; Morsbach; Ronneburg, S; Schmidt, W. (1996). Topographie audiovisueller Quellenüberlieferung - Film- und Videobestände in Archiven und archivischen
Einrichtungen in der Bundesrepublik Deutschland. Koblen
Hasso-Plattner-Institute, University Potsdam - 10 Sept. 2010
**) Mediaglobe, Deliverable-1.1 Report 2010.
th
7. 1.1 Introducing the Problem
4
Cultural heritage taped on film (Germany) Classification &
Thesauri needed:
> 1.200 film collections*
> 200 institutions with more than 100 h of film** □ integrate various
collections
~ 83% of film archives plan to digitise their collections**
}
□ harness semantic
relations
> 1000 filmcollections in
> 1000 collections
need connections
Germany*
□ align content
Semantic glue
Classifications and Thesauri
Johannes Hercher & Harald Sack : Indexing German Audiovisual Heritage - SKOSification Made Easy.
*) Bockhorn, V; Morsbach; Ronneburg, S; Schmidt, W. (1996). Topographie audiovisueller Quellenüberlieferung - Film- und Videobestände in Archiven und archivischen
Einrichtungen in der Bundesrepublik Deutschland. Koblen
Hasso-Plattner-Institute, University Potsdam - 10 Sept. 2010
**) Mediaglobe, Deliverable-1.1 Report 2010.
th
8. 1.1 Introducing the Problem
4
Cultural heritage taped on film (Germany) Classification &
Thesauri needed:
> 1.200 film collections*
> 200 institutions with more than 100 h of film** □ integrate various
collections
~ 83% of film archives plan to digitise their collections**
}
□ harness semantic
relations
> 1000 filmcollections in
> 1000 collections
need connections
Germany*
□ align content
Semantic glue but… !
Classifications and Thesauri
Johannes Hercher & Harald Sack : Indexing German Audiovisual Heritage - SKOSification Made Easy.
*) Bockhorn, V; Morsbach; Ronneburg, S; Schmidt, W. (1996). Topographie audiovisueller Quellenüberlieferung - Film- und Videobestände in Archiven und archivischen
Einrichtungen in der Bundesrepublik Deutschland. Koblen
Hasso-Plattner-Institute, University Potsdam - 10 Sept. 2010
**) Mediaglobe, Deliverable-1.1 Report 2010.
th
9. 1.1 Introducing the Problem
4
Cultural heritage taped on film (Germany) Classification &
Thesauri needed:
> 1.200 film collections*
> 200 institutions with more than 100 h of film** □ integrate various
collections
~ 83% of film archives plan to digitise their collections**
}
□ harness semantic
relations
> 1000 filmcollections in
> 1000 collections
need connections
Germany*
□ align content
Semantic glue but… !
Classifications and Thesauri
vocabularies missing
Johannes Hercher & Harald Sack : Indexing German Audiovisual Heritage - SKOSification Made Easy.
*) Bockhorn, V; Morsbach; Ronneburg, S; Schmidt, W. (1996). Topographie audiovisueller Quellenüberlieferung - Film- und Videobestände in Archiven und archivischen
Einrichtungen in der Bundesrepublik Deutschland. Koblen
Hasso-Plattner-Institute, University Potsdam - 10 Sept. 2010
**) Mediaglobe, Deliverable-1.1 Report 2010.
th
10. 1.2 The mediaglobe Project
5 mediaglobe - the Digital Archive
<•••• narrower •••••••••••••••••••• broader ••••>
makes cultural heritage
accessible & tangible
■ augmenting workflows in media-archives
□ efficient multimedia-analysis
□ (semi-)automated semantic indexing
□ retrieval of AV-content
■ covers
□ >1.000h of AV-data (defa-spektrum Archive)
□ newsreels, interviews, factual recordings, …
Johannes Hercher & Harald Sack : Indexing German Audiovisual Heritage - SKOSification Made Easy.
Hasso-Plattner-Institute, University Potsdam - 10th Sept. 2010
12. 2.1 Why Do We Need Controlled Vocabularies
7
■ AV-media needs descriptions
□ content topics
□ types of broadcast
□ genres
□… tagclouds VS thesauri
TT Films
■ tags are not sufficient…
UF Motion picture
NT Nonfiction films
□ variant, ambiguous, flat (...)
NT Documentary films
□ => inconsistent, uncontrolled
SN A heading used for ...
UF Documentaries, Motion picture
UF Factual films
UF Motion pictures documentaries
■ controlled vocabulary is suited
BT Nonfiction films
RT Actualities (Motion pictures)
due to term-relations
Johannes Hercher & Harald Sack : Indexing German Audiovisual Heritage - SKOSification Made Easy.
Hasso-Plattner-Institute, University Potsdam - 10th Sept. 2010
13. 2.2 Why Do We Need SKOS
8
http://www.w3.org/TR/2005/WD-swbp-skos-core-guide-20051102/
http://www.jenitennison.com/visualisation/offences.html http://www.jigs4owl.com/demos/treemap
Johannes Hercher & Harald Sack : Indexing German Audiovisual Heritage - SKOSification Made Easy.
Hasso-Plattner-Institute, University Potsdam - 10th Sept. 2010
14. 2.2 Why Do We Need SKOS
8
http://www.w3.org/TR/2005/WD-swbp-skos-core-guide-20051102/
Because:
□ simple
□ interoperable standard
□ widely used in Semantic Web
□ appropriate for mapping
http://www.jenitennison.com/visualisation/offences.html http://www.jigs4owl.com/demos/treemap
Johannes Hercher & Harald Sack : Indexing German Audiovisual Heritage - SKOSification Made Easy.
Hasso-Plattner-Institute, University Potsdam - 10th Sept. 2010
16. 3.1 How to Find Vocabularies
10 ■ Catalogues
□ http://www.w3.org/2001/sw/wiki/SKOS/Datasets
□ http://www.vocabularyserver.com
□ http://www.taxonomywarehouse.com/
□…
■ Specialised search engines
■ Major associations
Johannes Hercher & Harald Sack : Indexing German Audiovisual Heritage - SKOSification Made Easy.
Hasso-Plattner-Institute, University Potsdam - 10th Sept. 2010
17. 3.2 Vocabularies Related to AV-Media
11 ■ Results
□ AV-related Vocabularies are mainly in english language.
□ German broadcasters do NOT publish vocabularies !
□ Many small and mid-sized archives have own vocabularies.
□ Low availability of vocabularies (in german language).
□ Name SKOS
IPTC Thesaurus International Press Telecommunication Council x
TGM Thesaurus for Graphic Materials (Library of Congress) X
FIAF GSH FIAF General Subject Headings X
MIM Moving Image Materials X
LCGFT Moving Image Genre-Form Headings (Library of Congress) (X)
T-POL Thesaurus Politics of (former) GDR-Filmarchive (~12.000 Terms) -
REM ~6 co-existing thesauri of German broadcasting compound. -
Small >200 Collections with custom classification. Only a few use thesauri-
-
Archives terms of the public broadcasting compound.
Johannes Hercher & Harald Sack : Indexing German Audiovisual Heritage - SKOSification Made Easy.
Hasso-Plattner-Institute, University Potsdam - 10th Sept. 2010
18. 3.2 Lack of SKOSified Vocabolaries - Discovering Reasons
12 ■ appropriate vocabularies exist…
■ But we can not use them, because
□ they are not encoded in RDF
□ they are not published
□ (some) are not up to date
Johannes Hercher & Harald Sack : Indexing German Audiovisual Heritage - SKOSification Made Easy.
Hasso-Plattner-Institute, University Potsdam - 10th Sept. 2010
19. 3.2 Lack of SKOSified Vocabolaries - Discovering Reasons
12 ■ appropriate vocabularies exist…
■ But we can not use them, because
□ they are not encoded in RDF
some answers from
□ they are not published telephone interviews
□ (some) are not up to date
"… our vocabulary needs review and revision first…"
"… ownership and copyrights not clear at the moment…"
"… we are interested but have no resources…"
Johannes Hercher & Harald Sack : Indexing German Audiovisual Heritage - SKOSification Made Easy.
Hasso-Plattner-Institute, University Potsdam - 10th Sept. 2010
21. 4.1) A Webservice for SKOSification
14 ■ Idea =>
»SKOSify existing vocabularies (even more) easily
■ Main requirements
□ simple ingest (example follows)
□ download/publish an SKOS/RDF encoded vocabulary
□ low learning curve (simple)
□ no installation required
■ Need more features?
□ indexing assistance & term search
□ mapping & collaborative development
□ management & visualisation
Johannes Hercher & Harald Sack : Indexing German Audiovisual Heritage - SKOSification Made Easy.
Hasso-Plattner-Institute, University Potsdam - 10th Sept. 2010
22. 4.1) A Webservice for SKOSification
14 ■ Idea =>
»SKOSify existing vocabularies (even more) easily
■ Main requirements
□ simple ingest (example follows)
□ download/publish an SKOS/RDF encoded vocabulary
□ low learning curve (simple)
□ no installation required
}
■ Need more features?
□ indexing assistance & term search
□ mapping & collaborative development
xTree
□ management & visualisation (digicult)
Johannes Hercher & Harald Sack : Indexing German Audiovisual Heritage - SKOSification Made Easy.
Hasso-Plattner-Institute, University Potsdam - 10th Sept. 2010
23. 4.2) SKOSification - How Does it Work?
15
Johannes Hercher & Harald Sack : Indexing German Audiovisual Heritage - SKOSification Made Easy.
Hasso-Plattner-Institute, University Potsdam - 10th Sept. 2010
24. 4.2) SKOSification - How Does it Work?
15
Scan
paper based
thesauri
Johannes Hercher & Harald Sack : Indexing German Audiovisual Heritage - SKOSification Made Easy.
Hasso-Plattner-Institute, University Potsdam - 10th Sept. 2010
25. 4.2) SKOSification - How Does it Work?
15
Scan
paper based
thesauri
(OCR) &
cleanup
Johannes Hercher & Harald Sack : Indexing German Audiovisual Heritage - SKOSification Made Easy.
Hasso-Plattner-Institute, University Potsdam - 10th Sept. 2010
26. 4.2) SKOSification - How Does it Work?
15
Scan
paper based
thesauri
(OCR) &
cleanup
TT Documentary films
SN A heading used for…
UF Documentaries
NT Factual films
BT Nonfiction films
RT Actualities
Johannes Hercher & Harald Sack : Indexing German Audiovisual Heritage - SKOSification Made Easy.
Hasso-Plattner-Institute, University Potsdam - 10th Sept. 2010
27. 4.2) SKOSification - How Does it Work?
15
Scan
paper based
thesauri
(OCR) &
cleanup
TT Documentary films
SN A heading used for…
UF Documentaries
NT Factual films
BT Nonfiction films
RT Actualities
Preprocess
Assign Relation Label
for each Term per line
Johannes Hercher & Harald Sack : Indexing German Audiovisual Heritage - SKOSification Made Easy.
Hasso-Plattner-Institute, University Potsdam - 10th Sept. 2010
28. 4.2) SKOSification - How Does it Work?
15
Scan
paper based
thesauri
(OCR) &
cleanup
TT Documentary films
SN A heading used for…
UF Documentaries
NT Factual films
BT Nonfiction films SKOSify
RT Actualities
Processing
deduces relations from
Preprocess
indention level and
Assign Relation Label
labels
for each Term per line
Johannes Hercher & Harald Sack : Indexing German Audiovisual Heritage - SKOSification Made Easy.
Hasso-Plattner-Institute, University Potsdam - 10th Sept. 2010
29. 4.2) SKOSification - How Does it Work?
15
Scan
paper based
thesauri
(OCR) &
cleanup
TT Documentary films
Output
SN A heading used for…
UF Documentaries RDF/SKOS Document
NT Factual films
BT Nonfiction films SKOSify
RT Actualities
Processing
deduces relations from
Preprocess
indention level and
Assign Relation Label
labels
for each Term per line
Johannes Hercher & Harald Sack : Indexing German Audiovisual Heritage - SKOSification Made Easy.
Hasso-Plattner-Institute, University Potsdam - 10th Sept. 2010
30. 16
Johannes Hercher & Harald Sack : Indexing German Audiovisual Heritage - SKOSification Made Easy.
Hasso-Plattner-Institute, University Potsdam - 10th Sept. 2010
31. 16
Johannes Hercher & Harald Sack : Indexing German Audiovisual Heritage - SKOSification Made Easy.
Hasso-Plattner-Institute, University Potsdam - 10th Sept. 2010
32. 16
Johannes Hercher & Harald Sack : Indexing German Audiovisual Heritage - SKOSification Made Easy.
Hasso-Plattner-Institute, University Potsdam - 10th Sept. 2010
33. 16
Johannes Hercher & Harald Sack : Indexing German Audiovisual Heritage - SKOSification Made Easy.
Hasso-Plattner-Institute, University Potsdam - 10th Sept. 2010
34. 16
Johannes Hercher & Harald Sack : Indexing German Audiovisual Heritage - SKOSification Made Easy.
Hasso-Plattner-Institute, University Potsdam - 10th Sept. 2010
35. Questions
Comments
Discussion
Thank You!
Johannes Hercher Dr. Harald Sack
phone: +49 (0)331-5509-547 phone: +49 (0)331-5509-527
email: Johannes.Hercher@hpi.uni-potsdam.de email: Harald.Sack@hpi.uni-potsdam.de
http://www.hpi.uni-potsdam.de/meinel/forschung/future_internet/semantic_technologies.html
http://www.projekt-mediaglobe.de/
